-- Logs begin at Sun 2022-10-02 00:10:46 UTC, end at Sun 2022-10-02 02:46:01 UTC. -- Oct 02 00:43:49.407858 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Oct 02 00:43:49.417000 n-d-master-1 devstack@keystone.service[81839]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 02 00:43:49.419041 n-d-master-1 devstack@keystone.service[81839]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 2 00:43:49 2022] *** Oct 02 00:43:49.419041 n-d-master-1 devstack@keystone.service[81839]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 02 00:43:49.419041 n-d-master-1 devstack@keystone.service[81839]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 02 00:43:49.419041 n-d-master-1 devstack@keystone.service[81839]: nodename: n-d-master-1 Oct 02 00:43:49.419041 n-d-master-1 devstack@keystone.service[81839]: machine: x86_64 Oct 02 00:43:49.419041 n-d-master-1 devstack@keystone.service[81839]: clock source: unix Oct 02 00:43:49.419041 n-d-master-1 devstack@keystone.service[81839]: pcre jit disabled Oct 02 00:43:49.419041 n-d-master-1 devstack@keystone.service[81839]: detected number of CPU cores: 4 Oct 02 00:43:49.419041 n-d-master-1 devstack@keystone.service[81839]: current working directory: / Oct 02 00:43:49.419041 n-d-master-1 devstack@keystone.service[81839]: detected binary path: /usr/bin/uwsgi-core Oct 02 00:43:49.419041 n-d-master-1 devstack@keystone.service[81839]: your processes number limit is 47680 Oct 02 00:43:49.419657 n-d-master-1 devstack@keystone.service[81839]: your memory page size is 4096 bytes Oct 02 00:43:49.419657 n-d-master-1 devstack@keystone.service[81839]: detected max file descriptor number: 2048 Oct 02 00:43:49.419657 n-d-master-1 devstack@keystone.service[81839]: lock engine: pthread robust mutexes Oct 02 00:43:49.419657 n-d-master-1 devstack@keystone.service[81839]: thunder lock: enabled Oct 02 00:43:49.419657 n-d-master-1 devstack@keystone.service[81839]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 02 00:43:49.419657 n-d-master-1 devstack@keystone.service[81839]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 02 00:43:49.459126 n-d-master-1 devstack@keystone.service[81839]: Python main interpreter initialized at 0x5630574f79c0 Oct 02 00:43:49.459126 n-d-master-1 devstack@keystone.service[81839]: python threads support enabled Oct 02 00:43:49.459126 n-d-master-1 devstack@keystone.service[81839]: your server socket listen backlog is limited to 100 connections Oct 02 00:43:49.459126 n-d-master-1 devstack@keystone.service[81839]: your mercy for graceful operations on workers is 90 seconds Oct 02 00:43:49.459512 n-d-master-1 devstack@keystone.service[81839]: mapped 403077 bytes (393 KB) for 2 cores Oct 02 00:43:49.459595 n-d-master-1 devstack@keystone.service[81839]: *** Operational MODE: preforking *** Oct 02 00:43:49.459820 n-d-master-1 devstack@keystone.service[81839]: *** uWSGI is running in multiple interpreter mode *** Oct 02 00:43:49.459820 n-d-master-1 devstack@keystone.service[81839]: spawned uWSGI master process (pid: 81839) Oct 02 00:43:49.460028 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Oct 02 00:43:49.461108 n-d-master-1 devstack@keystone.service[81839]: spawned uWSGI worker 1 (pid: 81853, cores: 1) Oct 02 00:43:49.461108 n-d-master-1 devstack@keystone.service[81839]: spawned uWSGI worker 2 (pid: 81854, cores: 1) Oct 02 00:43:49.461108 n-d-master-1 devstack@keystone.service[81839]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 02 00:43:53.744308 n-d-master-1 devstack@keystone.service[81854]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:43:53.744308 n-d-master-1 devstack@keystone.service[81854]: from cryptography.utils import int_from_bytes Oct 02 00:43:53.745177 n-d-master-1 devstack@keystone.service[81854]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:43:53.745177 n-d-master-1 devstack@keystone.service[81854]: from cryptography.utils import int_from_bytes Oct 02 00:43:53.748932 n-d-master-1 devstack@keystone.service[81853]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:43:53.748932 n-d-master-1 devstack@keystone.service[81853]: from cryptography.utils import int_from_bytes Oct 02 00:43:53.749372 n-d-master-1 devstack@keystone.service[81853]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:43:53.749372 n-d-master-1 devstack@keystone.service[81853]: from cryptography.utils import int_from_bytes Oct 02 00:43:53.798573 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:43:53.798789 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:43:53.798894 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:43:53.798986 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] command line args: [] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:43:53.799064 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:43:53.799192 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] command line args: [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:43:53.799275 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:43:53.799395 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ================================================================================ {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:43:53.799479 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:43:53.799629 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ================================================================================ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:43:53.799707 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] admin_token = **** {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.799875 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] config_dir = [] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.799963 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] admin_token = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.800061 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.800146 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] config_dir = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.800242 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] config_source = [] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.800325 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.800420 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] debug = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.800505 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] config_source = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.800616 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.800932 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] debug = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.800932 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.801160 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.801259 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.801360 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.801468 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.801570 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.801671 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.801779 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.801882 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.801984 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] list_limit = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.802084 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.802181 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] log_config_append = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.802282 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] log_config_append = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.802384 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.802492 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.802589 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] log_dir = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.802723 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] log_dir = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.802829 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] log_file = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.802932 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] log_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.803038 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.803134 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.803235 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.803337 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.803438 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.803533 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.803636 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.803746 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.803851 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.803948 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.804050 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.804155 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.804253 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.804359 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.804468 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.804564 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.804919 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.805035 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.805132 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.805227 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.805328 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.805431 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.805526 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.805628 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.805733 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.805833 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.805941 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.806043 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.806139 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.806243 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.806722 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.806722 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] publish_errors = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.806955 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.806955 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] publish_errors = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.807156 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.807260 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.807356 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.807460 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.807562 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.807562 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.807789 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.807921 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.808044 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.808164 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.808278 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] standard_threads = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.808392 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] standard_threads = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.808515 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.808638 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.808719 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.808719 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.808902 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.808974 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] use_journal = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.809043 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.809164 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] use_json = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.809237 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] use_journal = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.809312 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] use_stderr = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.809388 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] use_json = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.809459 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] use_syslog = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.809534 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] use_stderr = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.809534 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] use_syslog = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.809668 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.809745 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:43:53.809815 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.809950 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.810057 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.810189 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.810274 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.810423 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.810506 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.810694 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.810774 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.810934 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.811013 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.811170 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.811247 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.811400 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.811477 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.811642 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.811719 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.811882 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.811958 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.812125 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.812202 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.812354 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.812432 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.812594 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.812670 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.812825 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.812909 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.813066 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.813144 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.813306 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.813395 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.813541 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.813619 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.813775 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.813854 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.814028 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.814110 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.814273 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.814357 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.814507 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.814580 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.814761 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.814848 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.815014 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.815098 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.815264 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.815342 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.815508 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.815586 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.815737 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.815825 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.815965 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.816042 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.816193 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.816269 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.816422 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.816506 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.816656 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.816738 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.816895 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.816971 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.817121 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.817206 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.817347 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.817430 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.817581 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.817657 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.817820 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.817908 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.818055 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.818132 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.818290 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.818371 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.818515 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.818623 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.818771 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.818849 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.819005 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.819087 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.819233 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.819320 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.819460 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.819543 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.819688 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.819771 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.819915 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.820066 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.820139 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.820207 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.820366 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.820451 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.820593 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.820678 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.820827 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.820904 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.821054 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.821137 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.821283 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.821367 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.821514 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.821597 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.821748 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.821824 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.822014 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.822098 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.822252 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.822446 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.822530 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.822724 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.822846 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.822945 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.823023 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.823181 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.823296 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.823409 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.823498 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.823644 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.823731 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.823877 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.823957 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.824108 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.824195 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.824339 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.824426 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.824574 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.824660 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.824807 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.824897 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.825033 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.825125 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.825272 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.825353 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.825505 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.825585 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.825740 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.825827 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.825977 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.826057 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.826223 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.826302 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.826465 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.826553 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.826722 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.826805 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.826957 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.827037 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.827191 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.827282 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.827425 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.827504 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.827658 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.827738 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.827892 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.827980 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.828127 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.828212 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.828359 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.828439 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.828602 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.828847 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.828847 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.829111 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.829241 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.829370 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.829500 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.829636 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.829766 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.829887 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.830015 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.830135 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.830266 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.830397 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.830522 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.830668 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.830747 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.830864 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.830940 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.831068 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.831145 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.831220 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.831286 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.831356 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.831478 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.831633 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.831709 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.831826 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.831901 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.832015 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.832099 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.832180 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.832260 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.832332 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.832447 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.832522 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.832638 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.832712 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.832830 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.832952 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.833070 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.833148 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.833305 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.833383 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.833553 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.833633 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.833788 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.833870 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.834036 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.834159 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.834275 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.834355 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.834515 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.834611 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.834778 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] auth.external = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.834937 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.835024 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.835111 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.835245 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.external = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.835325 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.835478 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.835592 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.835722 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] auth.password = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.835800 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.835949 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] auth.token = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.836030 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.836186 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.836273 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.password = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.836418 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.836503 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.token = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.836653 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.836733 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.836877 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.836956 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.837120 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.837199 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.837348 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.837428 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.838096 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.838210 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.838386 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] credential.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.838475 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.838558 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.838684 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.838824 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.838904 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.839074 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.839153 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.839312 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.839392 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.839555 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.839641 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.839789 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.839875 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.840032 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.840112 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.840268 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.840347 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.840500 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.840597 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.840752 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.840838 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.840999 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.841096 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.841242 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.841326 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.841503 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.841583 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.841744 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.841840 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.841995 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.842079 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.842227 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] federation.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.842308 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.842462 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.842548 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.842721 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.842816 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.842962 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.843049 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.843187 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.843266 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.843431 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.843511 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.843662 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.843743 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.843906 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.843985 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.844140 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.844229 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.844388 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.844468 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.844620 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.844699 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.844865 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.844952 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.845098 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.845178 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.845339 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.845420 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.845573 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.845728 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.845805 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.845877 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.846027 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.846107 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.846273 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.846360 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.846500 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.846578 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.846762 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.846842 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.846993 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.847084 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.847233 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.847313 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.847464 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.847542 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.847693 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.847781 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.847924 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.848004 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.848162 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.848241 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.848396 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.848483 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.848636 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.848714 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.848879 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.848960 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.849122 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.849210 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.849374 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.849454 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.849615 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.849693 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.849852 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.849941 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.850083 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.850162 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.850320 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.850406 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.850550 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.850664 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.850809 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.850888 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.851038 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.851116 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.851273 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.851359 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.851511 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.851590 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.851737 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.851816 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.851983 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.852069 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.852214 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.852294 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.852443 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.852522 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.852686 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.852774 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.852919 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.852997 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.853165 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.853844 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.853919 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.854000 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.854170 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.854250 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.854409 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.854489 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.854660 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.854744 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.854902 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.854981 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.855141 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.855220 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.855385 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.855502 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.855623 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.855760 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.855979 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.856058 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.856228 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.856308 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.856458 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.856539 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.856696 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.856774 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.856930 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.857011 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.857163 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.857241 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.857398 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.857477 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.857634 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.857715 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.857863 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.857942 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.858102 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.858181 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.858332 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.858420 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.858574 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.858698 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.858856 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.858935 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.859093 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.859174 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.859342 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.859421 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.859590 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.859669 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.859815 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.859895 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.860053 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.860134 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.860281 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.860359 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.860514 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.860593 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.860741 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.860820 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.860978 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.861055 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.861211 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.861291 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.861451 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.861528 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.861694 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.861772 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.861935 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.862014 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.862163 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.862242 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.862410 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.862487 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.862668 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.862752 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.862910 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.862989 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.863145 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.863224 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.863380 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.863461 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.863614 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.863692 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.863852 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.863931 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.864083 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.864169 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.864334 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.864413 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.864561 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.864638 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.864803 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.864884 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.865032 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.865112 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.865265 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.865342 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.865500 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.865580 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.865735 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.865812 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.865974 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.866053 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.866200 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.866280 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.866435 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.866513 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.866694 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.866777 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] resource.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.866936 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.867017 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.867179 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.867258 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.867414 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.867492 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.867662 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.867746 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.867897 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.867975 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.868132 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.868211 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.868377 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.868457 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.868611 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.868689 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.868887 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.868969 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.869212 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.869294 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] role.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.869455 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.869529 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] role.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.869696 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] role.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.869834 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.869963 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.870087 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] role.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.870213 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.870340 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.870481 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.870644 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.870768 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.870892 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.871014 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.871135 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.871257 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.871391 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.871514 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.871636 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.871758 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.871879 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.871879 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.872124 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.872247 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.872370 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.872498 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.872620 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.872741 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.872871 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.872993 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.873114 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.873114 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.873344 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.873467 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.873595 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.873595 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.873834 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.873955 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.874077 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.874198 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.874327 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.874449 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.874572 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.874728 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.874855 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.874980 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.875115 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.875242 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.875377 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.875503 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.875629 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.875762 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.875888 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.876013 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.876138 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.876262 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.876389 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.876539 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.876663 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.876789 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.876914 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.877049 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.877174 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.877307 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.877435 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.877560 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.877685 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.877811 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.877935 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.878067 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] token.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.878191 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.878317 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.878442 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.878614 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.878739 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] token.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.878884 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.879006 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.879131 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.879253 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.879375 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.879496 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.879625 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.879748 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.879869 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.879990 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.880110 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.880231 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.880364 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.880486 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.880617 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.880739 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.880861 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.880982 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.881110 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.881232 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.881353 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.881475 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.881595 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.881716 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.881845 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.881976 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.882105 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.882237 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.882358 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.882481 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.882630 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.connection = **** {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.882761 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.882888 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.883022 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.883148 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.883273 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.883398 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.883523 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.883649 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.883786 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.883912 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.884047 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.884173 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.884297 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.884452 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.884630 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.884771 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.884849 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.884922 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.884994 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885066 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885147 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885221 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885293 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885371 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885444 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885516 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885595 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885669 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885742 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885742 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885872 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.885943 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.886023 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.886096 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.886168 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.886239 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.886311 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.886311 n-d-master-1 devstack@keystone.service[81853]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:43:53.886448 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.886448 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:43:53.886448 n-d-master-1 devstack@keystone.service[81854]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:43:53.915809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:53.916582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:53.916729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:53.916814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:53.916937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:53.917068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:53.924978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:53.925308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:53.952744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:53.952963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:53.953430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:53.953666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.006318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.006531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.056565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.056795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.059243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.059478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.216125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.216310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.216422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.216502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.216600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.216679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.216753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.216861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.216944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.217080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.217172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.217298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.239563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.239799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.239892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.240018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.240102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.240235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.240317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.240446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.240536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.240656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.240739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.240866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.240948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.241123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.251809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.252320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.264867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.265072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.265277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.265373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.265503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.265587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.265718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.265801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.265928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.266012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.266138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.266221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.266351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.266569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 02 00:43:54.282689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.282897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 02 00:43:54.282981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.283162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 02 00:43:54.283243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.283425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 02 00:43:54.283508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.283693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 02 00:43:54.283774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.283954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.284043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.284214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.284297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.284474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.284553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.284737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.294579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.294879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.294964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.295150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.295233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.295433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.295517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.295766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.302367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.302774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.305529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.305814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.305953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.306100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.306299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.306538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.306657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.306890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.306972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.307159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.307240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.307434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.307515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.307706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.307785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.307978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.308066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.308249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.308330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.308515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.308595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.308785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.331669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.332061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.333124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.333409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.333533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.333823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.338130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.338413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.338587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.338725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.338897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.339184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.345044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.345330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.345549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.345842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.350964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.351260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.351553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.351636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.351843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.351940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.352121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.352205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.352397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.352480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.352672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.352781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.352948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.353543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.353754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.354028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.370212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.370506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.371436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.371725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.374359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.375613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.377594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.377899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.378872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.379170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.382088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.383371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.385264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.386574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.388466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.388769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.389060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.389352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.389636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.389816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.389910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.390113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.390396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.390701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.390987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.391273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.405766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.406058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.406331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.406617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.407101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.407393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.407661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.407923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.413494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.414743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.415068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.417056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.417391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.417675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.419064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.419342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.420556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.420847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.421143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.421446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.421836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.422176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.422463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.422779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.423074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.423459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.434073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.434358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.434667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.434962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.435347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.435463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.435646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.435770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.435926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.436013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.436232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.436613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.436901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.437178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.451649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.452639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.454562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.455565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.457482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.458437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.458964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.460045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.460435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.460736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.461142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.461530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.461823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.462221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.468083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.469082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.469554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.470541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.472461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.472857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.473150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.473427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.473509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.473821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.474111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.474391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.481854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.482149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.482436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.482869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.483162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.483441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.489376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.489665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.489950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.490232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.490313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 02 00:43:54.490517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.490694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.490843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.490981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.491114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.491255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.491385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.491522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.491660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.491797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.491938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.492077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.492207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.492335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.492464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.492592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.492721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.492856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.492986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.493114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.493243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.493448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.493767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 02 00:43:54.527695 n-d-master-1 devstack@keystone.service[81854]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5630574f79c0 pid: 81854 (default app) Oct 02 00:43:54.528693 n-d-master-1 devstack@keystone.service[81853]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5630574f79c0 pid: 81853 (default app) Oct 02 00:43:54.530943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d692cb-3686-4774-9c08-07dca7f7f7a3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:43:54.531234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d692cb-3686-4774-9c08-07dca7f7f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:43:54.531511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d692cb-3686-4774-9c08-07dca7f7f7a3 None None] PATH_INFO: `/v3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:43:54.535646 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Sun Oct 2 00:43:54 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:01.288353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27f23b-5b14-448b-b130-dc9ca90a4b58 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:01.288854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27f23b-5b14-448b-b130-dc9ca90a4b58 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:01.288854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27f23b-5b14-448b-b130-dc9ca90a4b58 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:01.293588 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:01.298652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc331bd-75c6-40f1-821c-0adf195f81f3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:01.299070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc331bd-75c6-40f1-821c-0adf195f81f3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:01.299206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc331bd-75c6-40f1-821c-0adf195f81f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:01.369161 n-d-master-1 devstack@keystone.service[81854]: INFO dbcounter [None req-9bc331bd-75c6-40f1-821c-0adf195f81f3 None None] Registered counter for database keystone Oct 02 00:44:01.387694 n-d-master-1 devstack@keystone.service[81854]: DEBUG oslo_db.sqlalchemy.engines [None req-9bc331bd-75c6-40f1-821c-0adf195f81f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:44:01.393761 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writer thread running {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:44:01.571988 n-d-master-1 devstack@keystone.service[81854]: DEBUG passlib.handlers.bcrypt [None req-9bc331bd-75c6-40f1-821c-0adf195f81f3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81854) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 02 00:44:01.572282 n-d-master-1 devstack@keystone.service[81854]: DEBUG passlib.handlers.bcrypt [None req-9bc331bd-75c6-40f1-821c-0adf195f81f3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81854) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 02 00:44:01.631789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9bc331bd-75c6-40f1-821c-0adf195f81f3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:01.633592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9bc331bd-75c6-40f1-821c-0adf195f81f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:01.759734 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 02 00:44:02.223164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27f23b-5b14-448b-b130-dc9ca90a4b58 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:02.294086 n-d-master-1 devstack@keystone.service[81853]: INFO dbcounter [None req-8a27f23b-5b14-448b-b130-dc9ca90a4b58 None None] Registered counter for database keystone Oct 02 00:44:02.315074 n-d-master-1 devstack@keystone.service[81853]: DEBUG oslo_db.sqlalchemy.engines [None req-8a27f23b-5b14-448b-b130-dc9ca90a4b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81853) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:44:02.321706 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writer thread running {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:44:02.440567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27f23b-5b14-448b-b130-dc9ca90a4b58 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:02.444719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12074867-018b-4e88-90e4-9bdda9cc114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:02.445863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12074867-018b-4e88-90e4-9bdda9cc114f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:02.446142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12074867-018b-4e88-90e4-9bdda9cc114f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:02.446410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12074867-018b-4e88-90e4-9bdda9cc114f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:02.454421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12074867-018b-4e88-90e4-9bdda9cc114f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:02.507118 n-d-master-1 devstack@keystone.service[81853]: WARNING keystone.common.rbac_enforcer.enforcer [None req-12074867-018b-4e88-90e4-9bdda9cc114f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 02 00:44:02.507392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12074867-018b-4e88-90e4-9bdda9cc114f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:02.517530 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Sun Oct 2 00:44:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 00:44:02.523577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc331bd-75c6-40f1-821c-0adf195f81f3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:02.540441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc331bd-75c6-40f1-821c-0adf195f81f3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:02.544818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d43ddc-07b3-4121-b36d-9c841bc66c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:02.545925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d43ddc-07b3-4121-b36d-9c841bc66c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:02.546209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d43ddc-07b3-4121-b36d-9c841bc66c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:02.546480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d43ddc-07b3-4121-b36d-9c841bc66c65 admin admin] PATH_INFO: `/v3/projects/bd709e757c564f0baea68763e7e07e28` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:02.548085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d43ddc-07b3-4121-b36d-9c841bc66c65 admin admin] RBAC: Authorizing `identity:get_project(project_id=bd709e757c564f0baea68763e7e07e28)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:02.600360 n-d-master-1 devstack@keystone.service[81854]: WARNING keystone.common.rbac_enforcer.enforcer [None req-76d43ddc-07b3-4121-b36d-9c841bc66c65 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 02 00:44:02.600713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d43ddc-07b3-4121-b36d-9c841bc66c65 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:02.605690 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 2 00:44:02 2022] GET /identity/v3/projects/bd709e757c564f0baea68763e7e07e28 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:04.729740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0a80a-3c8b-4a34-8dd1-96b482b94f7e None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:04.730289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0a80a-3c8b-4a34-8dd1-96b482b94f7e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:04.730289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0a80a-3c8b-4a34-8dd1-96b482b94f7e None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:04.734342 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:04.739617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b3a45-2c4c-4bbd-9308-4844b33512c9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:04.740043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b3a45-2c4c-4bbd-9308-4844b33512c9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:04.740176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b3a45-2c4c-4bbd-9308-4844b33512c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:04.760404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b82b3a45-2c4c-4bbd-9308-4844b33512c9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:04.761918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b82b3a45-2c4c-4bbd-9308-4844b33512c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:04.769624 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 02 00:44:05.034123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0a80a-3c8b-4a34-8dd1-96b482b94f7e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:05.046710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0a80a-3c8b-4a34-8dd1-96b482b94f7e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:05.050888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40109d97-3c7a-4a59-8521-bb1ba34a848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:05.051479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109d97-3c7a-4a59-8521-bb1ba34a848b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:05.051761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109d97-3c7a-4a59-8521-bb1ba34a848b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:05.052035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109d97-3c7a-4a59-8521-bb1ba34a848b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:05.059770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40109d97-3c7a-4a59-8521-bb1ba34a848b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:05.061536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40109d97-3c7a-4a59-8521-bb1ba34a848b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:05.070422 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Sun Oct 2 00:44:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 00:44:05.075638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b3a45-2c4c-4bbd-9308-4844b33512c9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:05.084523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b3a45-2c4c-4bbd-9308-4844b33512c9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:05.089620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331feeb5-630c-49f4-affd-20e23f90e956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:05.090240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331feeb5-630c-49f4-affd-20e23f90e956 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:05.090520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331feeb5-630c-49f4-affd-20e23f90e956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:05.090820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331feeb5-630c-49f4-affd-20e23f90e956 admin admin] PATH_INFO: `/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:05.092115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331feeb5-630c-49f4-affd-20e23f90e956 admin admin] RBAC: Authorizing `identity:get_user(user_id=a87a2f5ec4d74905b0b84b2127c02e7c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:05.093958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331feeb5-630c-49f4-affd-20e23f90e956 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:05.095488 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Sun Oct 2 00:44:05 2022] GET /identity/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:07.286401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379c93-1c29-4ac7-9f48-59392600c478 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:07.286950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379c93-1c29-4ac7-9f48-59392600c478 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:07.286950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379c93-1c29-4ac7-9f48-59392600c478 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:07.288311 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:07.293562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb71f8-ad1f-4768-99fe-57d735882d2d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:07.293993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb71f8-ad1f-4768-99fe-57d735882d2d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:07.294113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb71f8-ad1f-4768-99fe-57d735882d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:07.312542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a4eb71f8-ad1f-4768-99fe-57d735882d2d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:07.313709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a4eb71f8-ad1f-4768-99fe-57d735882d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:07.327599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af46bf-6d5f-410d-93fd-ae32ad9f7bf4 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:07.327881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af46bf-6d5f-410d-93fd-ae32ad9f7bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:07.328153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af46bf-6d5f-410d-93fd-ae32ad9f7bf4 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:07.329480 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:07.334749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3d4f1-8b19-4f0e-a067-66bbb416fcbd None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:07.335044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3d4f1-8b19-4f0e-a067-66bbb416fcbd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:07.335381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3d4f1-8b19-4f0e-a067-66bbb416fcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:07.376502 n-d-master-1 devstack@keystone.service[81853]: DEBUG passlib.handlers.bcrypt [None req-f7b3d4f1-8b19-4f0e-a067-66bbb416fcbd None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81853) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 02 00:44:07.376883 n-d-master-1 devstack@keystone.service[81853]: DEBUG passlib.handlers.bcrypt [None req-f7b3d4f1-8b19-4f0e-a067-66bbb416fcbd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81853) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 02 00:44:07.396497 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:07.426847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f7b3d4f1-8b19-4f0e-a067-66bbb416fcbd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:07.428867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f7b3d4f1-8b19-4f0e-a067-66bbb416fcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:07.529867 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:44:07.672797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb71f8-ad1f-4768-99fe-57d735882d2d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:07.697333 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:07.776529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb71f8-ad1f-4768-99fe-57d735882d2d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:07.799326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3d4f1-8b19-4f0e-a067-66bbb416fcbd None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:07.815391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a5eee-a0c2-4eb1-9ecf-cae8c4b63b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:07.816028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a5eee-a0c2-4eb1-9ecf-cae8c4b63b8d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:07.816311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a5eee-a0c2-4eb1-9ecf-cae8c4b63b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:07.816593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a5eee-a0c2-4eb1-9ecf-cae8c4b63b8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:07.827668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a5eee-a0c2-4eb1-9ecf-cae8c4b63b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f88a5eee-a0c2-4eb1-9ecf-cae8c4b63b8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:07.836579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:07.837521 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:07.838343 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:07.843481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a5eee-a0c2-4eb1-9ecf-cae8c4b63b8d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:07.901191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3d4f1-8b19-4f0e-a067-66bbb416fcbd None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:07.903441 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:07.926741 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:07.939618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63576f-766b-48b6-9c2a-2d2ddb28e940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:07.940639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63576f-766b-48b6-9c2a-2d2ddb28e940 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:07.941243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63576f-766b-48b6-9c2a-2d2ddb28e940 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:07.941529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63576f-766b-48b6-9c2a-2d2ddb28e940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:07.946417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a5eee-a0c2-4eb1-9ecf-cae8c4b63b8d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:07.982931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e442f-52c0-4f76-99a7-b8f106de8479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:07.983542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e442f-52c0-4f76-99a7-b8f106de8479 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:07.983826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e442f-52c0-4f76-99a7-b8f106de8479 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:07.984102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e442f-52c0-4f76-99a7-b8f106de8479 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:07.984779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e442f-52c0-4f76-99a7-b8f106de8479 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:07.985086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e442f-52c0-4f76-99a7-b8f106de8479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:07.986501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e442f-52c0-4f76-99a7-b8f106de8479 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:07.998170 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:08.003777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e442f-52c0-4f76-99a7-b8f106de8479 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:08.014847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63576f-766b-48b6-9c2a-2d2ddb28e940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:08.016376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63576f-766b-48b6-9c2a-2d2ddb28e940 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:08.102369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e442f-52c0-4f76-99a7-b8f106de8479 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:08.113139 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 02 00:44:08.119405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63576f-766b-48b6-9c2a-2d2ddb28e940 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:08.123147 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:08.139232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66d51e-8e64-4953-b4e2-37da22eb0088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:08.140148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66d51e-8e64-4953-b4e2-37da22eb0088 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:08.140568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66d51e-8e64-4953-b4e2-37da22eb0088 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:08.140978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66d51e-8e64-4953-b4e2-37da22eb0088 None admin] PATH_INFO: `/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:08.142824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66d51e-8e64-4953-b4e2-37da22eb0088 None admin] RBAC: Authorizing `identity:get_user(user_id=a87a2f5ec4d74905b0b84b2127c02e7c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:08.145389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66d51e-8e64-4953-b4e2-37da22eb0088 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:08.153229 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:08 2022] GET /identity/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:08.154348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66d51e-8e64-4953-b4e2-37da22eb0088 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:08.170455 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:08.219269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63576f-766b-48b6-9c2a-2d2ddb28e940 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:08.252550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53535649-2c9c-4ec0-b1d9-52d619672bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:08.253394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535649-2c9c-4ec0-b1d9-52d619672bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:08.253673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535649-2c9c-4ec0-b1d9-52d619672bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:08.253945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535649-2c9c-4ec0-b1d9-52d619672bb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:08.254216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66d51e-8e64-4953-b4e2-37da22eb0088 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:08.272422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53535649-2c9c-4ec0-b1d9-52d619672bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:08.274050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53535649-2c9c-4ec0-b1d9-52d619672bb2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:08.289703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a856b-e4a6-4edf-82f1-80dc94558d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:08.290426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a856b-e4a6-4edf-82f1-80dc94558d51 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:08.290752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a856b-e4a6-4edf-82f1-80dc94558d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:08.291030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a856b-e4a6-4edf-82f1-80dc94558d51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:08.292161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a856b-e4a6-4edf-82f1-80dc94558d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-53535649-2c9c-4ec0-b1d9-52d619672bb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:44:08.293145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:08.294418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:44:08.295270 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:44:08.295270 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:44:08.295270 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:08.295435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a856b-e4a6-4edf-82f1-80dc94558d51 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:08.295770 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:44:08.295844 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:08.300854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a856b-e4a6-4edf-82f1-80dc94558d51 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:08.300971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53535649-2c9c-4ec0-b1d9-52d619672bb2 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:08.356145 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:08.380496 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:08.399969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a856b-e4a6-4edf-82f1-80dc94558d51 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:08.400140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53535649-2c9c-4ec0-b1d9-52d619672bb2 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:08.433340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560ed15-04aa-4a18-8277-63daf172da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:08.433725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4b100-d5d4-44db-b996-7e1078560767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:08.433948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560ed15-04aa-4a18-8277-63daf172da91 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:08.434235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560ed15-04aa-4a18-8277-63daf172da91 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:08.434321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4b100-d5d4-44db-b996-7e1078560767 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:08.434516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560ed15-04aa-4a18-8277-63daf172da91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:08.434620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4b100-d5d4-44db-b996-7e1078560767 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:08.434882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4b100-d5d4-44db-b996-7e1078560767 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:08.435274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560ed15-04aa-4a18-8277-63daf172da91 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.domain.id=default, user.id=a87a2f5ec4d74905b0b84b2127c02e7c) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:08.435525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4b100-d5d4-44db-b996-7e1078560767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:08.435665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560ed15-04aa-4a18-8277-63daf172da91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:08.435829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4b100-d5d4-44db-b996-7e1078560767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:08.437034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560ed15-04aa-4a18-8277-63daf172da91 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:08.437187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4b100-d5d4-44db-b996-7e1078560767 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:08.445276 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1322 bytes} [Sun Oct 2 00:44:08 2022] GET /identity/v3/role_assignments?user.id=a87a2f5ec4d74905b0b84b2127c02e7c&scope.domain.id=default&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:08.454377 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:10.748186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d5ee-a740-4f4e-9518-7a2d3a411fcc None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:10.749209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d5ee-a740-4f4e-9518-7a2d3a411fcc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:10.749696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d5ee-a740-4f4e-9518-7a2d3a411fcc None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:10.751253 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:10.757312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2108dd-f767-4ffb-bf84-aded468903d1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:10.758127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2108dd-f767-4ffb-bf84-aded468903d1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:10.758641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2108dd-f767-4ffb-bf84-aded468903d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:10.783451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2d2108dd-f767-4ffb-bf84-aded468903d1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:10.784963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d2108dd-f767-4ffb-bf84-aded468903d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:10.867006 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:11.143037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15701aab-8161-4425-9853-8f0574c436cb None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:11.143392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15701aab-8161-4425-9853-8f0574c436cb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:11.143879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15701aab-8161-4425-9853-8f0574c436cb None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:11.145411 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:11.151946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f144ab-88e9-44ad-ad46-c803c83f3315 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:11.152509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f144ab-88e9-44ad-ad46-c803c83f3315 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:11.152980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f144ab-88e9-44ad-ad46-c803c83f3315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:11.176147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-54f144ab-88e9-44ad-ad46-c803c83f3315 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:11.178223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-54f144ab-88e9-44ad-ad46-c803c83f3315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:11.257663 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:11.262691 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:11.425070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15701aab-8161-4425-9853-8f0574c436cb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:11.561988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15701aab-8161-4425-9853-8f0574c436cb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:11.588297 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:11.592631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237c35e-a182-4cc5-8f3f-1652ae6ae723 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:11.593195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237c35e-a182-4cc5-8f3f-1652ae6ae723 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:11.593674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237c35e-a182-4cc5-8f3f-1652ae6ae723 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:11.600140 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 14/26] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:11.607027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6bf20-fb63-43ce-a0e6-4780efa943fc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:11.607576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6bf20-fb63-43ce-a0e6-4780efa943fc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:11.608041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6bf20-fb63-43ce-a0e6-4780efa943fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:11.637535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a1e6bf20-fb63-43ce-a0e6-4780efa943fc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:11.640040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a1e6bf20-fb63-43ce-a0e6-4780efa943fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:11.643947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c5002-c814-4d95-8a16-1143c28a6081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:11.644816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c5002-c814-4d95-8a16-1143c28a6081 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:11.645284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c5002-c814-4d95-8a16-1143c28a6081 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:11.645762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c5002-c814-4d95-8a16-1143c28a6081 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:11.667161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c5002-c814-4d95-8a16-1143c28a6081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-9b1c5002-c814-4d95-8a16-1143c28a6081 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:11.674967 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:11.675856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:11.676856 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:11.681643 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 13/27] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:11.683082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c2762-18d2-4e70-9662-8f5639c50c0e None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:11.683575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c2762-18d2-4e70-9662-8f5639c50c0e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:11.684132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c2762-18d2-4e70-9662-8f5639c50c0e None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:11.685547 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 14/28] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:11.691940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c2762-18d2-4e70-9662-8f5639c50c0e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:11.742286 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:11.743754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a468f-e4b2-405b-bedd-6c2904b22193 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:11.746825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a468f-e4b2-405b-bedd-6c2904b22193 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:11.747278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a468f-e4b2-405b-bedd-6c2904b22193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:11.789121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b02a468f-e4b2-405b-bedd-6c2904b22193 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:11.792533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b02a468f-e4b2-405b-bedd-6c2904b22193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:11.887833 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 16/30] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:11.888193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c2762-18d2-4e70-9662-8f5639c50c0e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:11.889435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a468f-e4b2-405b-bedd-6c2904b22193 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:11.964602 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:11.999837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5895fe-f195-4578-9346-341c6345e04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:12.000454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5895fe-f195-4578-9346-341c6345e04c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:12.000733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5895fe-f195-4578-9346-341c6345e04c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:12.001001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5895fe-f195-4578-9346-341c6345e04c None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:12.001671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5895fe-f195-4578-9346-341c6345e04c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:12.001973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5895fe-f195-4578-9346-341c6345e04c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:12.003394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5895fe-f195-4578-9346-341c6345e04c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:12.024117 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 15/31] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:12.032349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a468f-e4b2-405b-bedd-6c2904b22193 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:12.035599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5895fe-f195-4578-9346-341c6345e04c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:12.092972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a9a5-a9fd-4808-bbcd-f8118a1759e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:12.093702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a9a5-a9fd-4808-bbcd-f8118a1759e6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:12.093987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a9a5-a9fd-4808-bbcd-f8118a1759e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:12.094262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a9a5-a9fd-4808-bbcd-f8118a1759e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:12.105917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a9a5-a9fd-4808-bbcd-f8118a1759e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:12.107602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a9a5-a9fd-4808-bbcd-f8118a1759e6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:12.121983 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f690a9a5-a9fd-4808-bbcd-f8118a1759e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:44:12.125908 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:12.128452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:44:12.129239 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:44:12.129239 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:44:12.129239 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:12.129239 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 17/32] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:12.133339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a9a5-a9fd-4808-bbcd-f8118a1759e6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:12.229495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5895fe-f195-4578-9346-341c6345e04c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:12.262979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a9a5-a9fd-4808-bbcd-f8118a1759e6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:12.275564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15a356-f5b2-4498-a367-a6f8caf08f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:12.276546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a356-f5b2-4498-a367-a6f8caf08f1c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:12.277016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a356-f5b2-4498-a367-a6f8caf08f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:12.277474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a356-f5b2-4498-a367-a6f8caf08f1c None admin] PATH_INFO: `/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:12.277573 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:12.280236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15a356-f5b2-4498-a367-a6f8caf08f1c None admin] RBAC: Authorizing `identity:get_user(user_id=a87a2f5ec4d74905b0b84b2127c02e7c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:12.282344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15a356-f5b2-4498-a367-a6f8caf08f1c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:12.284602 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 16/33] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:12 2022] GET /identity/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:12.285542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15a356-f5b2-4498-a367-a6f8caf08f1c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:12.302931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9af6a-27c9-42d9-b2a1-3a95a81c274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:12.303676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9af6a-27c9-42d9-b2a1-3a95a81c274a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:12.304023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9af6a-27c9-42d9-b2a1-3a95a81c274a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:12.304367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9af6a-27c9-42d9-b2a1-3a95a81c274a None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:12.305086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9af6a-27c9-42d9-b2a1-3a95a81c274a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:12.305456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9af6a-27c9-42d9-b2a1-3a95a81c274a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:12.307095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9af6a-27c9-42d9-b2a1-3a95a81c274a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:12.320175 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 18/34] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:12.320945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9af6a-27c9-42d9-b2a1-3a95a81c274a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:12.416698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15a356-f5b2-4498-a367-a6f8caf08f1c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:12.430679 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:12.432412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9af6a-27c9-42d9-b2a1-3a95a81c274a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:12.458448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8c839-6bcc-46cf-a4b5-e64227c11437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:12.459307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c839-6bcc-46cf-a4b5-e64227c11437 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:12.459948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c839-6bcc-46cf-a4b5-e64227c11437 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:12.460315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c839-6bcc-46cf-a4b5-e64227c11437 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:12.461261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8c839-6bcc-46cf-a4b5-e64227c11437 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:12.462766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8c839-6bcc-46cf-a4b5-e64227c11437 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:12.473893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed17b-e225-4616-ab1a-ee3aeb24603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:12.475355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed17b-e225-4616-ab1a-ee3aeb24603e None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:12.475779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed17b-e225-4616-ab1a-ee3aeb24603e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:12.476328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed17b-e225-4616-ab1a-ee3aeb24603e None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:12.477243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ed17b-e225-4616-ab1a-ee3aeb24603e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:12.478896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ed17b-e225-4616-ab1a-ee3aeb24603e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:12.595777 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 17/35] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 2 00:44:12 2022] POST /identity/v3/roles => generated 225 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:12.596816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8c839-6bcc-46cf-a4b5-e64227c11437 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:12.607288 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 19/36] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 2 00:44:12 2022] POST /identity/v3/roles => generated 219 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:12.608532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed17b-e225-4616-ab1a-ee3aeb24603e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:12.694125 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:12.786532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8c839-6bcc-46cf-a4b5-e64227c11437 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:12.832718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd564-55b4-4559-ae63-480b42431f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:12.833388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd564-55b4-4559-ae63-480b42431f19 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:12.833749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd564-55b4-4559-ae63-480b42431f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:12.834032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd564-55b4-4559-ae63-480b42431f19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:12.835498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edd564-55b4-4559-ae63-480b42431f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:12.837129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edd564-55b4-4559-ae63-480b42431f19 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:12.838947 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 18/37] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:12.840256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0ab77-95a9-4847-b2c9-58fa19102306 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:12.840547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0ab77-95a9-4847-b2c9-58fa19102306 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:12.840827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0ab77-95a9-4847-b2c9-58fa19102306 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:12.842137 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 19/38] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:12.847384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0ab77-95a9-4847-b2c9-58fa19102306 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:12.903184 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:12.977916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed17b-e225-4616-ab1a-ee3aeb24603e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:12.982331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0ab77-95a9-4847-b2c9-58fa19102306 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:13.021622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a90e4-2be9-44bd-ae15-7b1e22dd34ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:13.022884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a90e4-2be9-44bd-ae15-7b1e22dd34ce None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.023175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a90e4-2be9-44bd-ae15-7b1e22dd34ce None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.023457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a90e4-2be9-44bd-ae15-7b1e22dd34ce None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.024124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a90e4-2be9-44bd-ae15-7b1e22dd34ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:13.025742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a90e4-2be9-44bd-ae15-7b1e22dd34ce None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:13.027695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133c302-6927-4251-b41f-b582fe06ebe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:13.028370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c302-6927-4251-b41f-b582fe06ebe4 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.029073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c302-6927-4251-b41f-b582fe06ebe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.029365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c302-6927-4251-b41f-b582fe06ebe4 None admin] PATH_INFO: `/v3/domains/default/users/a87a2f5ec4d74905b0b84b2127c02e7c/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.031470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133c302-6927-4251-b41f-b582fe06ebe4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a87a2f5ec4d74905b0b84b2127c02e7c, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:13.032907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133c302-6927-4251-b41f-b582fe06ebe4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:13.049796 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 20/39] 10.222.0.23 () {58 vars in 1361 bytes} [Sun Oct 2 00:44:12 2022] PUT /identity/v3/domains/default/users/a87a2f5ec4d74905b0b84b2127c02e7c/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:13.050988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fca1d-3ead-4cd7-ac26-953986c61a70 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.051620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fca1d-3ead-4cd7-ac26-953986c61a70 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.051902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fca1d-3ead-4cd7-ac26-953986c61a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.057689 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:44:12 2022] POST /identity/v3/projects => generated 301 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:13.058933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d239-0bdc-4b49-9f42-0b95512ee701 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.059233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d239-0bdc-4b49-9f42-0b95512ee701 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.059513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d239-0bdc-4b49-9f42-0b95512ee701 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.061081 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 21/41] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:13.067060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56934e25-434f-4f05-8189-10457f1d7682 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.067402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56934e25-434f-4f05-8189-10457f1d7682 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.067629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56934e25-434f-4f05-8189-10457f1d7682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.085670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-200fca1d-3ead-4cd7-ac26-953986c61a70 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:13.087739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-200fca1d-3ead-4cd7-ac26-953986c61a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:13.101308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-56934e25-434f-4f05-8189-10457f1d7682 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:13.104141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-56934e25-434f-4f05-8189-10457f1d7682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:13.175243 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 21/42] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:13.209198 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 22/43] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:13.454238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fca1d-3ead-4cd7-ac26-953986c61a70 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:13.481479 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:13.484999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56934e25-434f-4f05-8189-10457f1d7682 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:13.500511 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:13.562925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fca1d-3ead-4cd7-ac26-953986c61a70 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:13.599395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147c132-e9b9-4514-8716-a78cc9020cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:13.600046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c132-e9b9-4514-8716-a78cc9020cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.600327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c132-e9b9-4514-8716-a78cc9020cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.600540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56934e25-434f-4f05-8189-10457f1d7682 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:13.600637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c132-e9b9-4514-8716-a78cc9020cd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.601715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147c132-e9b9-4514-8716-a78cc9020cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:13.603217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147c132-e9b9-4514-8716-a78cc9020cd5 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:13.604779 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 22/44] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:13.610359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147c132-e9b9-4514-8716-a78cc9020cd5 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:13.641046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cf3c4-d0bb-4531-810b-d111dd1c226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:13.641658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf3c4-d0bb-4531-810b-d111dd1c226f None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.641938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf3c4-d0bb-4531-810b-d111dd1c226f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.642369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf3c4-d0bb-4531-810b-d111dd1c226f None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.642972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cf3c4-d0bb-4531-810b-d111dd1c226f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:13.644310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cf3c4-d0bb-4531-810b-d111dd1c226f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:13.661513 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 2 00:44:13 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:44:13.719882 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:13.728000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147c132-e9b9-4514-8716-a78cc9020cd5 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:13.767243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013773e-a964-4df0-8f03-7280190d6b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:13.767872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013773e-a964-4df0-8f03-7280190d6b96 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:13.768160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013773e-a964-4df0-8f03-7280190d6b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:13.768438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013773e-a964-4df0-8f03-7280190d6b96 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:13.769117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013773e-a964-4df0-8f03-7280190d6b96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:13.770659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013773e-a964-4df0-8f03-7280190d6b96 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:13.802635 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:44:13 2022] POST /identity/v3/projects => generated 312 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:44:15.247964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93af46-2aca-4278-bbc7-76185686f297 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:15.248543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93af46-2aca-4278-bbc7-76185686f297 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:15.248543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93af46-2aca-4278-bbc7-76185686f297 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:15.249767 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:15.255490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029cdbf-a66d-462b-a749-7ff4396207d6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:15.255919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029cdbf-a66d-462b-a749-7ff4396207d6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:15.256044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029cdbf-a66d-462b-a749-7ff4396207d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:15.274086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e029cdbf-a66d-462b-a749-7ff4396207d6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:15.275309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e029cdbf-a66d-462b-a749-7ff4396207d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:15.339227 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:15.607286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93af46-2aca-4278-bbc7-76185686f297 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:15.681890 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:15.708880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93af46-2aca-4278-bbc7-76185686f297 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:15.741976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5528b7-2da0-43d8-a9a6-79e517322acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:15.742634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5528b7-2da0-43d8-a9a6-79e517322acf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:15.742918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5528b7-2da0-43d8-a9a6-79e517322acf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:15.743193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5528b7-2da0-43d8-a9a6-79e517322acf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:15.755284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5528b7-2da0-43d8-a9a6-79e517322acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1a5528b7-2da0-43d8-a9a6-79e517322acf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:15.760045 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:15.760871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:15.761770 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 25/49] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:15.766969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029cdbf-a66d-462b-a749-7ff4396207d6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:15.843666 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:15.867737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029cdbf-a66d-462b-a749-7ff4396207d6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:15.983223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab63176-aa48-4e5a-968f-60d1f76301e6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:15.983822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab63176-aa48-4e5a-968f-60d1f76301e6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:15.984103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab63176-aa48-4e5a-968f-60d1f76301e6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:15.985470 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 26/50] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:15.990942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4c85e-1a8d-4a32-87a5-badde09fc886 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:15.991221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4c85e-1a8d-4a32-87a5-badde09fc886 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:15.991492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4c85e-1a8d-4a32-87a5-badde09fc886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:16.007122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1bfb9-78cb-4785-ac69-beaa853191eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:16.007731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1bfb9-78cb-4785-ac69-beaa853191eb None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:16.008010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1bfb9-78cb-4785-ac69-beaa853191eb None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:16.008289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1bfb9-78cb-4785-ac69-beaa853191eb None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:16.008955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1bfb9-78cb-4785-ac69-beaa853191eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:16.009150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1bd4c85e-1a8d-4a32-87a5-badde09fc886 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:16.009261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1bfb9-78cb-4785-ac69-beaa853191eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:16.010376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1bd4c85e-1a8d-4a32-87a5-badde09fc886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:16.010627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1bfb9-78cb-4785-ac69-beaa853191eb None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:16.019166 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 25/51] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:16.024811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1bfb9-78cb-4785-ac69-beaa853191eb None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:16.077701 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 27/52] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:44:16.125492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1bfb9-78cb-4785-ac69-beaa853191eb None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:16.158243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4568-617a-4c2a-8605-60f77cba322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:16.158894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4568-617a-4c2a-8605-60f77cba322c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:16.159179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4568-617a-4c2a-8605-60f77cba322c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:16.159454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4568-617a-4c2a-8605-60f77cba322c None admin] PATH_INFO: `/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:16.160578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4568-617a-4c2a-8605-60f77cba322c None admin] RBAC: Authorizing `identity:get_user(user_id=a87a2f5ec4d74905b0b84b2127c02e7c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:16.162536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4568-617a-4c2a-8605-60f77cba322c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:16.164298 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:16 2022] GET /identity/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:16.169661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4c85e-1a8d-4a32-87a5-badde09fc886 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:16.231317 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:16.268078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4c85e-1a8d-4a32-87a5-badde09fc886 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:16.300651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc8647-ddfb-47bd-b9a5-4006a13da9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:16.301549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8647-ddfb-47bd-b9a5-4006a13da9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:16.302033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8647-ddfb-47bd-b9a5-4006a13da9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:16.302443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8647-ddfb-47bd-b9a5-4006a13da9a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:16.303570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc8647-ddfb-47bd-b9a5-4006a13da9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:16.305028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc8647-ddfb-47bd-b9a5-4006a13da9a2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:16.306613 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 28/54] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:16.312323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4568-617a-4c2a-8605-60f77cba322c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:16.323713 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:16.350488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc8647-ddfb-47bd-b9a5-4006a13da9a2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:16.414859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4568-617a-4c2a-8605-60f77cba322c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:16.447698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c6ab9-40e4-4471-bec3-c1211597b9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:16.448386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c6ab9-40e4-4471-bec3-c1211597b9ce None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:16.448675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c6ab9-40e4-4471-bec3-c1211597b9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:16.448951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c6ab9-40e4-4471-bec3-c1211597b9ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:16.449651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc8647-ddfb-47bd-b9a5-4006a13da9a2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:16.449743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c6ab9-40e4-4471-bec3-c1211597b9ce None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.domain.id=default, user.id=a87a2f5ec4d74905b0b84b2127c02e7c) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:16.449973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c6ab9-40e4-4471-bec3-c1211597b9ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:16.451448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c6ab9-40e4-4471-bec3-c1211597b9ce None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:16.457354 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1322 bytes} [Sun Oct 2 00:44:16 2022] GET /identity/v3/role_assignments?user.id=a87a2f5ec4d74905b0b84b2127c02e7c&scope.domain.id=default&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:16.480965 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:16.486398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533150e-8edf-4e18-b245-c014535713aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:16.487357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533150e-8edf-4e18-b245-c014535713aa None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:16.487631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533150e-8edf-4e18-b245-c014535713aa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:16.487907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533150e-8edf-4e18-b245-c014535713aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:16.489158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533150e-8edf-4e18-b245-c014535713aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:16.490680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533150e-8edf-4e18-b245-c014535713aa None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:16.492319 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 29/56] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:16.498131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c6ab9-40e4-4471-bec3-c1211597b9ce None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:16.572081 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:16.604093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c6ab9-40e4-4471-bec3-c1211597b9ce None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:16.641825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8055ae-375c-42d4-b9d3-b2eb4a1a10fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:16.642445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8055ae-375c-42d4-b9d3-b2eb4a1a10fe None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:16.642769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8055ae-375c-42d4-b9d3-b2eb4a1a10fe None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:16.643050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8055ae-375c-42d4-b9d3-b2eb4a1a10fe None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:16.643726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8055ae-375c-42d4-b9d3-b2eb4a1a10fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:16.645180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8055ae-375c-42d4-b9d3-b2eb4a1a10fe None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:16.672261 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 28/57] 10.222.0.23 () {60 vars in 1140 bytes} [Sun Oct 2 00:44:16 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:18.837125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e60b4c-be6b-4483-a863-59249dc8bd17 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:18.837651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e60b4c-be6b-4483-a863-59249dc8bd17 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:18.837651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e60b4c-be6b-4483-a863-59249dc8bd17 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:18.839061 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:18.844164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37b95b-7b6c-4fe3-ae85-3d3c7838264e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:18.844596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37b95b-7b6c-4fe3-ae85-3d3c7838264e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:18.844722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37b95b-7b6c-4fe3-ae85-3d3c7838264e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:18.862934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0b37b95b-7b6c-4fe3-ae85-3d3c7838264e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:18.864950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0b37b95b-7b6c-4fe3-ae85-3d3c7838264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:18.928176 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:19.196200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e60b4c-be6b-4483-a863-59249dc8bd17 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:19.293564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e60b4c-be6b-4483-a863-59249dc8bd17 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:19.326638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d363b-7bb8-4684-a49e-213f5083e0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:19.327271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d363b-7bb8-4684-a49e-213f5083e0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:19.327531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d363b-7bb8-4684-a49e-213f5083e0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:19.327803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d363b-7bb8-4684-a49e-213f5083e0b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:19.328891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d363b-7bb8-4684-a49e-213f5083e0b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:19.330326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d363b-7bb8-4684-a49e-213f5083e0b3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:19.331871 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 31/60] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:19.337399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37b95b-7b6c-4fe3-ae85-3d3c7838264e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:19.390832 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:19.433624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37b95b-7b6c-4fe3-ae85-3d3c7838264e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:19.465803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9ecf2-c19e-4601-b618-531f3c31b0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:19.466344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9ecf2-c19e-4601-b618-531f3c31b0cf None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:19.466652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9ecf2-c19e-4601-b618-531f3c31b0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:19.466933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9ecf2-c19e-4601-b618-531f3c31b0cf None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:19.467576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9ecf2-c19e-4601-b618-531f3c31b0cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:19.469025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9ecf2-c19e-4601-b618-531f3c31b0cf None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:19.495941 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 30/61] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:44:19 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:22.770995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7a83-ccd6-4be5-a8ad-68f623e74f6e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:22.771507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7a83-ccd6-4be5-a8ad-68f623e74f6e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:22.771581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7a83-ccd6-4be5-a8ad-68f623e74f6e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:22.772882 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 32/62] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:22.778189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c2f06-5539-4d54-80be-60ae9e582ff3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:22.778980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c2f06-5539-4d54-80be-60ae9e582ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:22.779403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c2f06-5539-4d54-80be-60ae9e582ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:22.803869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-071c2f06-5539-4d54-80be-60ae9e582ff3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:22.805303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-071c2f06-5539-4d54-80be-60ae9e582ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:22.821213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01332d-e232-4d4e-afb8-cd4d17f61668 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:22.821213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01332d-e232-4d4e-afb8-cd4d17f61668 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:22.821213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01332d-e232-4d4e-afb8-cd4d17f61668 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:22.821837 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 33/63] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:22.828029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35ab58-c223-44f4-acbe-11f31063c953 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:22.829369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35ab58-c223-44f4-acbe-11f31063c953 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:22.829841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35ab58-c223-44f4-acbe-11f31063c953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:22.863939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ec35ab58-c223-44f4-acbe-11f31063c953 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:22.866107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ec35ab58-c223-44f4-acbe-11f31063c953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:22.911796 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 31/64] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:22.986694 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:22.993963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d025e1-92de-489f-825b-4784e4f70751 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:22.994709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d025e1-92de-489f-825b-4784e4f70751 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:22.995264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d025e1-92de-489f-825b-4784e4f70751 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:22.996808 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 32/65] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:23.000713 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 34/66] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:23.002048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28408c9-808c-46f1-8cba-d091aad22c61 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.002532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28408c9-808c-46f1-8cba-d091aad22c61 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.003031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28408c9-808c-46f1-8cba-d091aad22c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.036740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d28408c9-808c-46f1-8cba-d091aad22c61 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:23.038263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d28408c9-808c-46f1-8cba-d091aad22c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:23.096088 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:23.144848 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 33/67] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:23.257233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35ab58-c223-44f4-acbe-11f31063c953 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:23.403173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35ab58-c223-44f4-acbe-11f31063c953 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:23.439320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28408c9-808c-46f1-8cba-d091aad22c61 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:23.454643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49d3ef-e66b-4c86-8212-ffef310a98bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:23.454643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d3ef-e66b-4c86-8212-ffef310a98bf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.454643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d3ef-e66b-4c86-8212-ffef310a98bf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.454643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d3ef-e66b-4c86-8212-ffef310a98bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.467309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49d3ef-e66b-4c86-8212-ffef310a98bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ca49d3ef-e66b-4c86-8212-ffef310a98bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:23.472813 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:23.473988 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:23.474931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:23.477107 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 35/68] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:23.491697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49d3ef-e66b-4c86-8212-ffef310a98bf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:23.554727 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:23.575447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28408c9-808c-46f1-8cba-d091aad22c61 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:23.596934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49d3ef-e66b-4c86-8212-ffef310a98bf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:23.608831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f903c-1754-4203-a82d-3fa88924f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:23.609463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f903c-1754-4203-a82d-3fa88924f87a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.609750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f903c-1754-4203-a82d-3fa88924f87a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.610038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f903c-1754-4203-a82d-3fa88924f87a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.620071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f903c-1754-4203-a82d-3fa88924f87a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-6f5f903c-1754-4203-a82d-3fa88924f87a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:23.624933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:23.625757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:23.626981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f903c-1754-4203-a82d-3fa88924f87a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:23.634614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a61f5-7305-4f9e-abcd-bdbd34c3e832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:23.635241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a61f5-7305-4f9e-abcd-bdbd34c3e832 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.635551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a61f5-7305-4f9e-abcd-bdbd34c3e832 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.635813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a61f5-7305-4f9e-abcd-bdbd34c3e832 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.636486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a61f5-7305-4f9e-abcd-bdbd34c3e832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:23.636820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a61f5-7305-4f9e-abcd-bdbd34c3e832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:23.638209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a61f5-7305-4f9e-abcd-bdbd34c3e832 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:23.647135 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:23.648415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be97e-0632-49b4-b11b-7520869b62da None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.648707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be97e-0632-49b4-b11b-7520869b62da None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.648981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be97e-0632-49b4-b11b-7520869b62da None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.650207 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 37/71] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:23.651244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949004c-591a-4239-91ec-f42ef2a179b3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.651884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949004c-591a-4239-91ec-f42ef2a179b3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.651991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949004c-591a-4239-91ec-f42ef2a179b3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.653094 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 38/72] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:23.655471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949004c-591a-4239-91ec-f42ef2a179b3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:23.665576 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:23.734616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f903c-1754-4203-a82d-3fa88924f87a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:23.758489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949004c-591a-4239-91ec-f42ef2a179b3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:23.768452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8d05b-6a89-4cf2-aaef-f98e598c383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:23.769124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8d05b-6a89-4cf2-aaef-f98e598c383c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.769379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8d05b-6a89-4cf2-aaef-f98e598c383c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.769647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8d05b-6a89-4cf2-aaef-f98e598c383c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.777740 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:23.779305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8d05b-6a89-4cf2-aaef-f98e598c383c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-6ae8d05b-6a89-4cf2-aaef-f98e598c383c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:23.784011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:23.784992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 35/73] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:44:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:23.790705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8d05b-6a89-4cf2-aaef-f98e598c383c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:23.793126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e17bd6-f294-44b7-8fb8-8af31d58e7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:23.793733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e17bd6-f294-44b7-8fb8-8af31d58e7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.794012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e17bd6-f294-44b7-8fb8-8af31d58e7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.794336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e17bd6-f294-44b7-8fb8-8af31d58e7f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.795037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e17bd6-f294-44b7-8fb8-8af31d58e7f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:23.795344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e17bd6-f294-44b7-8fb8-8af31d58e7f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:23.796719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e17bd6-f294-44b7-8fb8-8af31d58e7f7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:23.805997 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 39/74] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:23.807232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962c3bb-b7d3-4b16-85c1-c1e673b9a179 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.807520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962c3bb-b7d3-4b16-85c1-c1e673b9a179 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.807788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962c3bb-b7d3-4b16-85c1-c1e673b9a179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.826150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6962c3bb-b7d3-4b16-85c1-c1e673b9a179 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:23.827416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6962c3bb-b7d3-4b16-85c1-c1e673b9a179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:23.882318 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:23.892475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8d05b-6a89-4cf2-aaef-f98e598c383c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:23.894494 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 40/75] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:23.895930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035b305-bed2-400e-8b58-16980e6ac542 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.896216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035b305-bed2-400e-8b58-16980e6ac542 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.896489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035b305-bed2-400e-8b58-16980e6ac542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.926296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3035b305-bed2-400e-8b58-16980e6ac542 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:23.926616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37500f-0f55-407d-a5ab-ace175d58558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:23.927258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37500f-0f55-407d-a5ab-ace175d58558 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:23.927540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37500f-0f55-407d-a5ab-ace175d58558 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:23.927815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37500f-0f55-407d-a5ab-ace175d58558 None admin] PATH_INFO: `/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:23.928764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3035b305-bed2-400e-8b58-16980e6ac542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:23.928948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37500f-0f55-407d-a5ab-ace175d58558 None admin] RBAC: Authorizing `identity:get_user(user_id=a87a2f5ec4d74905b0b84b2127c02e7c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:23.930403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37500f-0f55-407d-a5ab-ace175d58558 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:23.931992 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 36/76] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:23 2022] GET /identity/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:23.932736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37500f-0f55-407d-a5ab-ace175d58558 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.001419 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 41/77] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:24.002265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035b305-bed2-400e-8b58-16980e6ac542 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.052802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37500f-0f55-407d-a5ab-ace175d58558 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:24.068262 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.092557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97d944-754f-47c4-81f4-add740028649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:24.093493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d944-754f-47c4-81f4-add740028649 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:24.094036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d944-754f-47c4-81f4-add740028649 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:24.094500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d944-754f-47c4-81f4-add740028649 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:24.095487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97d944-754f-47c4-81f4-add740028649 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:24.096011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97d944-754f-47c4-81f4-add740028649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:24.098119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97d944-754f-47c4-81f4-add740028649 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:24.107230 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 37/78] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:44:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:24.108249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97d944-754f-47c4-81f4-add740028649 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.133461 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.139025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035b305-bed2-400e-8b58-16980e6ac542 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:24.179292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cae4f-0b73-4847-aded-d1bd20f16697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:24.179608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cae4f-0b73-4847-aded-d1bd20f16697 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:24.179891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cae4f-0b73-4847-aded-d1bd20f16697 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:24.180167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cae4f-0b73-4847-aded-d1bd20f16697 None admin] PATH_INFO: `/v3/users/40bcd9aa5e344ab38aab7605ac197048` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:24.194618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cae4f-0b73-4847-aded-d1bd20f16697 None admin] RBAC: Authorizing `identity:get_user(user_id=40bcd9aa5e344ab38aab7605ac197048)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:24.196092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cae4f-0b73-4847-aded-d1bd20f16697 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:24.198347 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 42/79] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:24 2022] GET /identity/v3/users/40bcd9aa5e344ab38aab7605ac197048 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:24.199220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cae4f-0b73-4847-aded-d1bd20f16697 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.218931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97d944-754f-47c4-81f4-add740028649 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:24.251179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f6f74-c450-49de-aafd-83b4eca1b83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:24.251786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6f74-c450-49de-aafd-83b4eca1b83d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:24.252065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6f74-c450-49de-aafd-83b4eca1b83d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:24.252347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6f74-c450-49de-aafd-83b4eca1b83d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:24.303036 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.306260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cae4f-0b73-4847-aded-d1bd20f16697 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:24.322530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f6f74-c450-49de-aafd-83b4eca1b83d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:24.324045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f6f74-c450-49de-aafd-83b4eca1b83d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:24.342015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea090-5bb6-42d0-abaf-fb04ab59a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:24.342670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea090-5bb6-42d0-abaf-fb04ab59a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:24.343009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea090-5bb6-42d0-abaf-fb04ab59a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:24.343287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea090-5bb6-42d0-abaf-fb04ab59a0a5 None admin] PATH_INFO: `/v3/users/40bcd9aa5e344ab38aab7605ac197048` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:24.344410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ea090-5bb6-42d0-abaf-fb04ab59a0a5 None admin] RBAC: Authorizing `identity:get_user(user_id=40bcd9aa5e344ab38aab7605ac197048)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:24.344528 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.346214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ea090-5bb6-42d0-abaf-fb04ab59a0a5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:24.347945 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 43/80] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:24 2022] GET /identity/v3/users/40bcd9aa5e344ab38aab7605ac197048 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:24.348695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea090-5bb6-42d0-abaf-fb04ab59a0a5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.422500 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 38/81] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:24.423291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f6f74-c450-49de-aafd-83b4eca1b83d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.448309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea090-5bb6-42d0-abaf-fb04ab59a0a5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:24.481756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196604f1-e38a-4cb2-8644-753f280e2465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:24.482396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196604f1-e38a-4cb2-8644-753f280e2465 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:24.482724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196604f1-e38a-4cb2-8644-753f280e2465 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:24.483007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196604f1-e38a-4cb2-8644-753f280e2465 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:24.484146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196604f1-e38a-4cb2-8644-753f280e2465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:24.485607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196604f1-e38a-4cb2-8644-753f280e2465 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:24.487253 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 44/82] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:24.488206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196604f1-e38a-4cb2-8644-753f280e2465 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.521810 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.524127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f6f74-c450-49de-aafd-83b4eca1b83d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:24.543943 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.558510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e334fc9-d80c-454d-ba25-2adf7d8a17af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:24.559148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334fc9-d80c-454d-ba25-2adf7d8a17af None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:24.559428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334fc9-d80c-454d-ba25-2adf7d8a17af None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:24.559697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334fc9-d80c-454d-ba25-2adf7d8a17af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:24.592981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196604f1-e38a-4cb2-8644-753f280e2465 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:24.625767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e334fc9-d80c-454d-ba25-2adf7d8a17af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:24.626457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006a211-3132-4a8c-9b8d-157b35856fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:24.627125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a211-3132-4a8c-9b8d-157b35856fab None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:24.627284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e334fc9-d80c-454d-ba25-2adf7d8a17af None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:24.627406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a211-3132-4a8c-9b8d-157b35856fab None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:24.627678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a211-3132-4a8c-9b8d-157b35856fab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:24.638379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006a211-3132-4a8c-9b8d-157b35856fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f006a211-3132-4a8c-9b8d-157b35856fab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:24.643267 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:24.644948 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:24.645785 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 45/83] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:24.646518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006a211-3132-4a8c-9b8d-157b35856fab None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.728925 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 39/84] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:24.729678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e334fc9-d80c-454d-ba25-2adf7d8a17af None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.739225 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.745500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006a211-3132-4a8c-9b8d-157b35856fab None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:24.751081 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.778827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa44c2-c4c7-4d74-87c7-c2350f2146aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:24.779437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa44c2-c4c7-4d74-87c7-c2350f2146aa None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:24.779721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa44c2-c4c7-4d74-87c7-c2350f2146aa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:24.779993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa44c2-c4c7-4d74-87c7-c2350f2146aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:24.827394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e334fc9-d80c-454d-ba25-2adf7d8a17af None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:24.846870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa44c2-c4c7-4d74-87c7-c2350f2146aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:24.848391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa44c2-c4c7-4d74-87c7-c2350f2146aa None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:24.864699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c87490-94ee-4aed-b654-2e951f3deb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:24.865335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c87490-94ee-4aed-b654-2e951f3deb13 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:24.865628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c87490-94ee-4aed-b654-2e951f3deb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:24.865904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c87490-94ee-4aed-b654-2e951f3deb13 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:24.867079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c87490-94ee-4aed-b654-2e951f3deb13 None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:24.868526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c87490-94ee-4aed-b654-2e951f3deb13 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:24.870171 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 40/85] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:24 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:24.871031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c87490-94ee-4aed-b654-2e951f3deb13 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.946177 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.952960 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 46/86] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:24.953762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa44c2-c4c7-4d74-87c7-c2350f2146aa None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:24.964780 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:24.978446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c87490-94ee-4aed-b654-2e951f3deb13 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:25.011484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726b56e-dc8a-4b84-a0a7-ef28f9ad41e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:25.012016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726b56e-dc8a-4b84-a0a7-ef28f9ad41e8 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:25.012297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726b56e-dc8a-4b84-a0a7-ef28f9ad41e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:25.012572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726b56e-dc8a-4b84-a0a7-ef28f9ad41e8 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:25.013216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726b56e-dc8a-4b84-a0a7-ef28f9ad41e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:25.014689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726b56e-dc8a-4b84-a0a7-ef28f9ad41e8 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:25.036105 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 41/87] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:44:24 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:25.036899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726b56e-dc8a-4b84-a0a7-ef28f9ad41e8 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:25.054827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa44c2-c4c7-4d74-87c7-c2350f2146aa None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:25.095102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5037ad-2744-444b-8c64-005e5545cd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:25.095737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5037ad-2744-444b-8c64-005e5545cd73 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:25.096021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5037ad-2744-444b-8c64-005e5545cd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:25.096296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5037ad-2744-444b-8c64-005e5545cd73 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:25.097150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5037ad-2744-444b-8c64-005e5545cd73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:25.097459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5037ad-2744-444b-8c64-005e5545cd73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:25.099319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5037ad-2744-444b-8c64-005e5545cd73 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:25.109019 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 47/88] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:25.110266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5037ad-2744-444b-8c64-005e5545cd73 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:25.167707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726b56e-dc8a-4b84-a0a7-ef28f9ad41e8 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:25.182089 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:25.207192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335e9ad-044f-4805-96d2-1b09a26c17c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:25.208019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e9ad-044f-4805-96d2-1b09a26c17c3 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:25.208303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e9ad-044f-4805-96d2-1b09a26c17c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:25.208573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e9ad-044f-4805-96d2-1b09a26c17c3 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:25.209729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335e9ad-044f-4805-96d2-1b09a26c17c3 None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:25.211216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335e9ad-044f-4805-96d2-1b09a26c17c3 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:25.212839 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 42/89] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:25 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:25.213686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335e9ad-044f-4805-96d2-1b09a26c17c3 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:25.231544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5037ad-2744-444b-8c64-005e5545cd73 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:25.231971 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:25.276387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec6663-5e47-43c1-942c-dd4fac738386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:25.276987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec6663-5e47-43c1-942c-dd4fac738386 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:25.277274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec6663-5e47-43c1-942c-dd4fac738386 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:25.277856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec6663-5e47-43c1-942c-dd4fac738386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:25.278311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec6663-5e47-43c1-942c-dd4fac738386 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=123533f35dfa451ba661bea2bceb664c, user.id=a87a2f5ec4d74905b0b84b2127c02e7c) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:25.278683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec6663-5e47-43c1-942c-dd4fac738386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:25.280150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec6663-5e47-43c1-942c-dd4fac738386 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:25.289225 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 48/90] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:25 2022] GET /identity/v3/role_assignments?user.id=a87a2f5ec4d74905b0b84b2127c02e7c&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:25.289926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec6663-5e47-43c1-942c-dd4fac738386 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:25.349094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335e9ad-044f-4805-96d2-1b09a26c17c3 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:25.390970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5581b21-8777-4b2d-9ac3-d483f130eaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:25.391625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581b21-8777-4b2d-9ac3-d483f130eaba None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:25.391910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581b21-8777-4b2d-9ac3-d483f130eaba None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:25.392184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581b21-8777-4b2d-9ac3-d483f130eaba None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:25.393383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5581b21-8777-4b2d-9ac3-d483f130eaba None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:25.395408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5581b21-8777-4b2d-9ac3-d483f130eaba None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:25.397728 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 43/91] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:25 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:25.399099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5581b21-8777-4b2d-9ac3-d483f130eaba None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:25.427990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec6663-5e47-43c1-942c-dd4fac738386 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:25.455259 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:25.473737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4181db4-ba42-40c1-954f-c4dfc71f3d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:25.474498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181db4-ba42-40c1-954f-c4dfc71f3d3b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:25.474825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181db4-ba42-40c1-954f-c4dfc71f3d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:25.475103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181db4-ba42-40c1-954f-c4dfc71f3d3b None admin] PATH_INFO: `/v3/users/40bcd9aa5e344ab38aab7605ac197048` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:25.476481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4181db4-ba42-40c1-954f-c4dfc71f3d3b None admin] RBAC: Authorizing `identity:get_user(user_id=40bcd9aa5e344ab38aab7605ac197048)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:25.478077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4181db4-ba42-40c1-954f-c4dfc71f3d3b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:25.480351 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 49/92] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:25 2022] GET /identity/v3/users/40bcd9aa5e344ab38aab7605ac197048 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:25.481177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4181db4-ba42-40c1-954f-c4dfc71f3d3b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:25.515812 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:25.544409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5581b21-8777-4b2d-9ac3-d483f130eaba None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:25.585425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d031336-4381-4bbd-a444-cb938aed2c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:25.586043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d031336-4381-4bbd-a444-cb938aed2c1d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:25.586323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d031336-4381-4bbd-a444-cb938aed2c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:25.586614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d031336-4381-4bbd-a444-cb938aed2c1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:25.587509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d031336-4381-4bbd-a444-cb938aed2c1d None admin] RBAC: Adding query filter params (role.id=beb2c562d1d14ef599b41dd5788b6e4d, scope.project.id=123533f35dfa451ba661bea2bceb664c, user.id=40bcd9aa5e344ab38aab7605ac197048) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:25.587888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d031336-4381-4bbd-a444-cb938aed2c1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:25.589446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d031336-4381-4bbd-a444-cb938aed2c1d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:25.595974 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 44/93] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:25 2022] GET /identity/v3/role_assignments?user.id=40bcd9aa5e344ab38aab7605ac197048&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:25.597405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d031336-4381-4bbd-a444-cb938aed2c1d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:25.627261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4181db4-ba42-40c1-954f-c4dfc71f3d3b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:25.703761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ae2f1-a3c4-46e8-88cf-7de642e7889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:25.704823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ae2f1-a3c4-46e8-88cf-7de642e7889e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:25.705355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ae2f1-a3c4-46e8-88cf-7de642e7889e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:25.705826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ae2f1-a3c4-46e8-88cf-7de642e7889e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:25.706853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ae2f1-a3c4-46e8-88cf-7de642e7889e None admin] RBAC: Adding query filter params (role.id=25dd37ef41a046b1b26386c2672249fe, scope.project.id=123533f35dfa451ba661bea2bceb664c, user.id=40bcd9aa5e344ab38aab7605ac197048) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:25.707476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ae2f1-a3c4-46e8-88cf-7de642e7889e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:25.709269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ae2f1-a3c4-46e8-88cf-7de642e7889e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:25.720583 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 50/94] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:25 2022] GET /identity/v3/role_assignments?user.id=40bcd9aa5e344ab38aab7605ac197048&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=25dd37ef41a046b1b26386c2672249fe => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:25.751464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d031336-4381-4bbd-a444-cb938aed2c1d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:25.792607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04748a3f-6542-4ee2-aa0e-4710d4039dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:25.793246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04748a3f-6542-4ee2-aa0e-4710d4039dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:25.793524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04748a3f-6542-4ee2-aa0e-4710d4039dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:25.793801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04748a3f-6542-4ee2-aa0e-4710d4039dc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:25.812388 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:25.874226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04748a3f-6542-4ee2-aa0e-4710d4039dc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:25.875827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04748a3f-6542-4ee2-aa0e-4710d4039dc7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:25.983745 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 45/95] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:25.990156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ae2f1-a3c4-46e8-88cf-7de642e7889e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:26.062787 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:26.117130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ae2f1-a3c4-46e8-88cf-7de642e7889e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:26.160820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90825dd2-3ed4-4e85-9cd3-7250e86bbf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:26.161471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90825dd2-3ed4-4e85-9cd3-7250e86bbf41 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:26.161809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90825dd2-3ed4-4e85-9cd3-7250e86bbf41 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:26.162093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90825dd2-3ed4-4e85-9cd3-7250e86bbf41 None admin] PATH_INFO: `/v3/projects/a4fcbe4ab08a4155ab22c3831e5e7fa0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:26.163326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90825dd2-3ed4-4e85-9cd3-7250e86bbf41 None admin] RBAC: Authorizing `identity:get_project(project_id=a4fcbe4ab08a4155ab22c3831e5e7fa0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:26.164833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90825dd2-3ed4-4e85-9cd3-7250e86bbf41 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:26.166488 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 51/96] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:25 2022] GET /identity/v3/projects/a4fcbe4ab08a4155ab22c3831e5e7fa0 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:26.172562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04748a3f-6542-4ee2-aa0e-4710d4039dc7 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:26.224591 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:26.281007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04748a3f-6542-4ee2-aa0e-4710d4039dc7 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:26.318053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902e7cb-b72a-4f92-ba19-c6c3df072d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:26.318592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902e7cb-b72a-4f92-ba19-c6c3df072d3a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:26.318905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902e7cb-b72a-4f92-ba19-c6c3df072d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:26.319187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902e7cb-b72a-4f92-ba19-c6c3df072d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:26.319930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902e7cb-b72a-4f92-ba19-c6c3df072d3a None admin] RBAC: Adding query filter params (role.id=beb2c562d1d14ef599b41dd5788b6e4d, scope.project.id=a4fcbe4ab08a4155ab22c3831e5e7fa0, user.id=40bcd9aa5e344ab38aab7605ac197048) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:26.320245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902e7cb-b72a-4f92-ba19-c6c3df072d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:26.321788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902e7cb-b72a-4f92-ba19-c6c3df072d3a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:26.327916 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 46/97] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:26 2022] GET /identity/v3/role_assignments?user.id=40bcd9aa5e344ab38aab7605ac197048&scope.project.id=a4fcbe4ab08a4155ab22c3831e5e7fa0&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:28.135261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd3868-237e-4603-86b6-355b80e0f0e3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:28.135799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd3868-237e-4603-86b6-355b80e0f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:28.135799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd3868-237e-4603-86b6-355b80e0f0e3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:28.137330 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 52/98] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:28.142325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624591-e43a-4666-83ae-9fc696443015 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:28.142747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624591-e43a-4666-83ae-9fc696443015 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:28.142928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624591-e43a-4666-83ae-9fc696443015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:28.162046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ae624591-e43a-4666-83ae-9fc696443015 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:28.163314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ae624591-e43a-4666-83ae-9fc696443015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:28.238799 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 47/99] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:28.463286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c219-21ef-420d-b81b-ee8f9e65f38e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:28.463960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c219-21ef-420d-b81b-ee8f9e65f38e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:28.464458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c219-21ef-420d-b81b-ee8f9e65f38e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:28.466294 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 53/100] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:28.471253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97274a99-29a6-4f5c-a2c6-ada17f4d7e84 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:28.471796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97274a99-29a6-4f5c-a2c6-ada17f4d7e84 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:28.472291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97274a99-29a6-4f5c-a2c6-ada17f4d7e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:28.492613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-97274a99-29a6-4f5c-a2c6-ada17f4d7e84 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:28.494069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-97274a99-29a6-4f5c-a2c6-ada17f4d7e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:28.533157 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:28.573176 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 48/101] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:28.667648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c219-21ef-420d-b81b-ee8f9e65f38e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:28.792771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c219-21ef-420d-b81b-ee8f9e65f38e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:28.821509 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:28.839554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d07eb8-4685-4de8-af08-0003458ea5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:28.840508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d07eb8-4685-4de8-af08-0003458ea5ee None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:28.840993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d07eb8-4685-4de8-af08-0003458ea5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:28.841489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d07eb8-4685-4de8-af08-0003458ea5ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:28.859452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d07eb8-4685-4de8-af08-0003458ea5ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-89d07eb8-4685-4de8-af08-0003458ea5ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:28.864960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:28.865843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:28.866617 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:28.868556 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 54/102] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:28.874439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97274a99-29a6-4f5c-a2c6-ada17f4d7e84 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:28.895497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d07eb8-4685-4de8-af08-0003458ea5ee None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:29.042639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97274a99-29a6-4f5c-a2c6-ada17f4d7e84 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:29.082054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d07eb8-4685-4de8-af08-0003458ea5ee None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:29.107050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c581eb-1c28-4574-a395-29bfc297d9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:29.107675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c581eb-1c28-4574-a395-29bfc297d9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.108006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c581eb-1c28-4574-a395-29bfc297d9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.108293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c581eb-1c28-4574-a395-29bfc297d9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.108979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c581eb-1c28-4574-a395-29bfc297d9a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:29.109285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c581eb-1c28-4574-a395-29bfc297d9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:29.110732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c581eb-1c28-4574-a395-29bfc297d9a8 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:29.128418 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 49/103] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:29.135405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c581eb-1c28-4574-a395-29bfc297d9a8 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:29.155605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb07a9-2c55-4b05-b719-6d35954b8a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:29.156301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb07a9-2c55-4b05-b719-6d35954b8a93 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.156654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb07a9-2c55-4b05-b719-6d35954b8a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.156934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb07a9-2c55-4b05-b719-6d35954b8a93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.177198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb07a9-2c55-4b05-b719-6d35954b8a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a9bb07a9-2c55-4b05-b719-6d35954b8a93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:29.185085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:29.185950 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:29.186765 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:29.187352 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 55/104] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:29.199015 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:29.200591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb07a9-2c55-4b05-b719-6d35954b8a93 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:29.279095 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:29.337975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c581eb-1c28-4574-a395-29bfc297d9a8 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:29.370544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb07a9-2c55-4b05-b719-6d35954b8a93 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:29.404558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479306d-2050-4380-8829-bc72474d225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:29.405589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479306d-2050-4380-8829-bc72474d225d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.406876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479306d-2050-4380-8829-bc72474d225d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.407361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479306d-2050-4380-8829-bc72474d225d None admin] PATH_INFO: `/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.409479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479306d-2050-4380-8829-bc72474d225d None admin] RBAC: Authorizing `identity:get_user(user_id=a87a2f5ec4d74905b0b84b2127c02e7c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:29.413347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479306d-2050-4380-8829-bc72474d225d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:29.415385 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 50/105] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:29 2022] GET /identity/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:29.417291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13e20-08e5-4793-a7f1-ed05a0b9c4af None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.417610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13e20-08e5-4793-a7f1-ed05a0b9c4af None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.417962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13e20-08e5-4793-a7f1-ed05a0b9c4af None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.423426 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 51/106] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:29.423426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9107a-7433-4368-94a0-0239d05a9e82 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.423426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9107a-7433-4368-94a0-0239d05a9e82 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.423426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9107a-7433-4368-94a0-0239d05a9e82 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.423426 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 52/107] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:29.423426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9107a-7433-4368-94a0-0239d05a9e82 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:29.431287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d9866-70dc-458b-ab4a-1cd0989ab802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:29.433095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d9866-70dc-458b-ab4a-1cd0989ab802 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.433589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d9866-70dc-458b-ab4a-1cd0989ab802 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.434177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d9866-70dc-458b-ab4a-1cd0989ab802 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.435084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d9866-70dc-458b-ab4a-1cd0989ab802 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:29.435606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d9866-70dc-458b-ab4a-1cd0989ab802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:29.437655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d9866-70dc-458b-ab4a-1cd0989ab802 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:29.449687 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 56/108] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:29.451669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe9697-a2c2-4b47-889e-eae994861682 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.452161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe9697-a2c2-4b47-889e-eae994861682 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.452637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe9697-a2c2-4b47-889e-eae994861682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.476868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c6fe9697-a2c2-4b47-889e-eae994861682 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:29.478835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c6fe9697-a2c2-4b47-889e-eae994861682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:29.544949 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:29.549939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9107a-7433-4368-94a0-0239d05a9e82 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:29.563709 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 57/109] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:29.563709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4df9a-3036-4787-bb63-ff7a9c7126a7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.563709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4df9a-3036-4787-bb63-ff7a9c7126a7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.563709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4df9a-3036-4787-bb63-ff7a9c7126a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.576603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f1d4df9a-3036-4787-bb63-ff7a9c7126a7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:29.577842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f1d4df9a-3036-4787-bb63-ff7a9c7126a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:29.598932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02010-9460-4705-bc84-abaffe282682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:29.599616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02010-9460-4705-bc84-abaffe282682 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.599913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02010-9460-4705-bc84-abaffe282682 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.600193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02010-9460-4705-bc84-abaffe282682 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.601517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac02010-9460-4705-bc84-abaffe282682 None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:29.603044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac02010-9460-4705-bc84-abaffe282682 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:29.605211 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 53/110] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:29 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:29.606098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02010-9460-4705-bc84-abaffe282682 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:29.611451 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:29.657922 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 58/111] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:29.664084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274ef2a-7220-410f-b23a-4903c412400c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.664372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274ef2a-7220-410f-b23a-4903c412400c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.664707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274ef2a-7220-410f-b23a-4903c412400c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.666013 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 59/112] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:29.666784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274ef2a-7220-410f-b23a-4903c412400c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:29.732417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02010-9460-4705-bc84-abaffe282682 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:29.775457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619b018-c261-44ca-be86-93d4ed36d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:29.776202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619b018-c261-44ca-be86-93d4ed36d11f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.776545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619b018-c261-44ca-be86-93d4ed36d11f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.776891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619b018-c261-44ca-be86-93d4ed36d11f None admin] PATH_INFO: `/v3/users/f6c1a1b1bb22463086c579a84df21f22` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.796660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619b018-c261-44ca-be86-93d4ed36d11f None admin] RBAC: Authorizing `identity:get_user(user_id=f6c1a1b1bb22463086c579a84df21f22)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:29.798126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619b018-c261-44ca-be86-93d4ed36d11f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:29.800367 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 54/113] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:29 2022] GET /identity/v3/users/f6c1a1b1bb22463086c579a84df21f22 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:29.806076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a725c-74fb-40d0-82ad-0b2d4239af0a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.806364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a725c-74fb-40d0-82ad-0b2d4239af0a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.806666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a725c-74fb-40d0-82ad-0b2d4239af0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.808693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274ef2a-7220-410f-b23a-4903c412400c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:29.824985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ca9a725c-74fb-40d0-82ad-0b2d4239af0a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:29.826224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ca9a725c-74fb-40d0-82ad-0b2d4239af0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:29.847853 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:29.853489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b4ffa-6851-4217-b0d9-7a37af0e7a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:29.854963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b4ffa-6851-4217-b0d9-7a37af0e7a35 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.855778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b4ffa-6851-4217-b0d9-7a37af0e7a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.856058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b4ffa-6851-4217-b0d9-7a37af0e7a35 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c/users/a87a2f5ec4d74905b0b84b2127c02e7c/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.858900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b4ffa-6851-4217-b0d9-7a37af0e7a35 None admin] RBAC: Authorizing `identity:create_grant(project_id=123533f35dfa451ba661bea2bceb664c, user_id=a87a2f5ec4d74905b0b84b2127c02e7c, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:29.860647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b4ffa-6851-4217-b0d9-7a37af0e7a35 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:29.876324 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 60/114] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:29 2022] PUT /identity/v3/projects/123533f35dfa451ba661bea2bceb664c/users/a87a2f5ec4d74905b0b84b2127c02e7c/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:29.877965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9645a2-51f3-4d2d-821b-270f7199122c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:29.878266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9645a2-51f3-4d2d-821b-270f7199122c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:29.878542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9645a2-51f3-4d2d-821b-270f7199122c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:29.880057 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 61/115] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:29.880667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9645a2-51f3-4d2d-821b-270f7199122c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:29.911954 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:29.923464 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 55/116] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:29.930225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a725c-74fb-40d0-82ad-0b2d4239af0a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:30.048324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9645a2-51f3-4d2d-821b-270f7199122c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:30.061722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a725c-74fb-40d0-82ad-0b2d4239af0a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:30.091305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702efb2c-3a11-4e64-8144-a2c48c3d9505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:30.091991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efb2c-3a11-4e64-8144-a2c48c3d9505 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:30.092214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efb2c-3a11-4e64-8144-a2c48c3d9505 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:30.092492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efb2c-3a11-4e64-8144-a2c48c3d9505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:30.101344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f139537-5e29-4b89-b3d5-5e3cc3108088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:30.101986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f139537-5e29-4b89-b3d5-5e3cc3108088 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:30.102270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f139537-5e29-4b89-b3d5-5e3cc3108088 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:30.102546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f139537-5e29-4b89-b3d5-5e3cc3108088 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:30.103754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f139537-5e29-4b89-b3d5-5e3cc3108088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:30.105147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f139537-5e29-4b89-b3d5-5e3cc3108088 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:30.111208 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 56/117] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:30.111208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ceb2-9ea2-44fe-b9f3-a859bd6990aa None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:30.111208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ceb2-9ea2-44fe-b9f3-a859bd6990aa None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:30.111208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ceb2-9ea2-44fe-b9f3-a859bd6990aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:30.129344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-72f5ceb2-9ea2-44fe-b9f3-a859bd6990aa None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:30.131162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-72f5ceb2-9ea2-44fe-b9f3-a859bd6990aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:30.154974 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:30.183364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702efb2c-3a11-4e64-8144-a2c48c3d9505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:30.185870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702efb2c-3a11-4e64-8144-a2c48c3d9505 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:30.217310 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:30.219462 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 57/118] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:30.220318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5ceb2-9ea2-44fe-b9f3-a859bd6990aa None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:30.320843 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 62/119] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:30.322413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702efb2c-3a11-4e64-8144-a2c48c3d9505 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:30.328768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5ceb2-9ea2-44fe-b9f3-a859bd6990aa None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:30.367528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bd81c-a6ca-4026-8cd4-6c46ef16abe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:30.368224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bd81c-a6ca-4026-8cd4-6c46ef16abe7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:30.368604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bd81c-a6ca-4026-8cd4-6c46ef16abe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:30.368998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bd81c-a6ca-4026-8cd4-6c46ef16abe7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:30.381425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bd81c-a6ca-4026-8cd4-6c46ef16abe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-453bd81c-a6ca-4026-8cd4-6c46ef16abe7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:30.386890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:30.387835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:30.388780 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:30.395310 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 58/120] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:44:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:30.395310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bd81c-a6ca-4026-8cd4-6c46ef16abe7 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:30.414985 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:30.441949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702efb2c-3a11-4e64-8144-a2c48c3d9505 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:30.475797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b09f46-ed3d-4f27-91f9-e2744003e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:30.476427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b09f46-ed3d-4f27-91f9-e2744003e35b None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:30.476716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b09f46-ed3d-4f27-91f9-e2744003e35b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:30.476985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b09f46-ed3d-4f27-91f9-e2744003e35b None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:30.477634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b09f46-ed3d-4f27-91f9-e2744003e35b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:30.479145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b09f46-ed3d-4f27-91f9-e2744003e35b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:30.494996 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:30.511407 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 63/121] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:44:30 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:30.512289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b09f46-ed3d-4f27-91f9-e2744003e35b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:30.513372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bd81c-a6ca-4026-8cd4-6c46ef16abe7 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:30.556462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5320a-2503-4513-9f58-0f336e266908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:30.557142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5320a-2503-4513-9f58-0f336e266908 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:30.557427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5320a-2503-4513-9f58-0f336e266908 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:30.557999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5320a-2503-4513-9f58-0f336e266908 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:30.571979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5320a-2503-4513-9f58-0f336e266908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-f7b5320a-2503-4513-9f58-0f336e266908 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:30.577904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:30.578872 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:30.579624 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:30.580208 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 59/122] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:30.585396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5320a-2503-4513-9f58-0f336e266908 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:30.653788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b09f46-ed3d-4f27-91f9-e2744003e35b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:30.675005 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:30.698955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d057fc-7ed9-48a6-8569-8a2e2f2be8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:30.699619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d057fc-7ed9-48a6-8569-8a2e2f2be8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:30.699903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d057fc-7ed9-48a6-8569-8a2e2f2be8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:30.700177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d057fc-7ed9-48a6-8569-8a2e2f2be8e5 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:30.701568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d057fc-7ed9-48a6-8569-8a2e2f2be8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:30.703062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d057fc-7ed9-48a6-8569-8a2e2f2be8e5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:30.705010 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 64/123] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:30 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:30.705596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d057fc-7ed9-48a6-8569-8a2e2f2be8e5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:30.714565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5320a-2503-4513-9f58-0f336e266908 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:30.753263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d3f18-b1cd-4a71-97a9-6cc594ecec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:30.753883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3f18-b1cd-4a71-97a9-6cc594ecec23 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:30.754165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3f18-b1cd-4a71-97a9-6cc594ecec23 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:30.754438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3f18-b1cd-4a71-97a9-6cc594ecec23 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:30.755138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d3f18-b1cd-4a71-97a9-6cc594ecec23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:30.755442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d3f18-b1cd-4a71-97a9-6cc594ecec23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:30.756840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d3f18-b1cd-4a71-97a9-6cc594ecec23 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:30.758106 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:30.766541 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 60/124] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:44:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:30.767782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d3f18-b1cd-4a71-97a9-6cc594ecec23 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:30.819845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d057fc-7ed9-48a6-8569-8a2e2f2be8e5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:30.861225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cf8bb-a024-4ab7-9e15-03001af8d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:30.863068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cf8bb-a024-4ab7-9e15-03001af8d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:30.863557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cf8bb-a024-4ab7-9e15-03001af8d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:30.864029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cf8bb-a024-4ab7-9e15-03001af8d1c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:30.876360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cf8bb-a024-4ab7-9e15-03001af8d1c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-004cf8bb-a024-4ab7-9e15-03001af8d1c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:30.882945 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:30.883823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:30.884594 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:30.887020 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 65/125] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:30.888130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cf8bb-a024-4ab7-9e15-03001af8d1c9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:30.894276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d3f18-b1cd-4a71-97a9-6cc594ecec23 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:30.935366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689176e4-06ec-4021-a89d-3d1b3a8f01ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:30.935978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689176e4-06ec-4021-a89d-3d1b3a8f01ad None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:30.936260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689176e4-06ec-4021-a89d-3d1b3a8f01ad None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:30.936535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689176e4-06ec-4021-a89d-3d1b3a8f01ad None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:30.937197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689176e4-06ec-4021-a89d-3d1b3a8f01ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:30.937500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689176e4-06ec-4021-a89d-3d1b3a8f01ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:30.939363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689176e4-06ec-4021-a89d-3d1b3a8f01ad None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:30.941731 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:30.955294 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 61/126] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:30.956904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689176e4-06ec-4021-a89d-3d1b3a8f01ad None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:31.010347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cf8bb-a024-4ab7-9e15-03001af8d1c9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:31.013105 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:31.048380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd48544-a006-453e-8814-b3d29f6a03f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:31.049570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd48544-a006-453e-8814-b3d29f6a03f4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:31.049956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd48544-a006-453e-8814-b3d29f6a03f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:31.050354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd48544-a006-453e-8814-b3d29f6a03f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:31.051299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd48544-a006-453e-8814-b3d29f6a03f4 None admin] RBAC: Adding query filter params (role.id=24d5a978aad041e5ac5f969daacd12c0, scope.project.id=123533f35dfa451ba661bea2bceb664c, user.id=f6c1a1b1bb22463086c579a84df21f22) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:31.051718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd48544-a006-453e-8814-b3d29f6a03f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:31.053670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd48544-a006-453e-8814-b3d29f6a03f4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:31.059939 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 66/127] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:30 2022] GET /identity/v3/role_assignments?user.id=f6c1a1b1bb22463086c579a84df21f22&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=24d5a978aad041e5ac5f969daacd12c0 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:31.060923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd48544-a006-453e-8814-b3d29f6a03f4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:31.077679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689176e4-06ec-4021-a89d-3d1b3a8f01ad None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:31.126288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc025397-b8c0-40f5-84a9-4dcb83824fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:31.129160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc025397-b8c0-40f5-84a9-4dcb83824fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:31.129160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc025397-b8c0-40f5-84a9-4dcb83824fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:31.129160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc025397-b8c0-40f5-84a9-4dcb83824fc3 None admin] PATH_INFO: `/v3/users/40bcd9aa5e344ab38aab7605ac197048` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:31.133144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc025397-b8c0-40f5-84a9-4dcb83824fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=40bcd9aa5e344ab38aab7605ac197048)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:31.134644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc025397-b8c0-40f5-84a9-4dcb83824fc3 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:31.137683 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 62/128] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:30 2022] GET /identity/v3/users/40bcd9aa5e344ab38aab7605ac197048 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:31.144051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc025397-b8c0-40f5-84a9-4dcb83824fc3 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:31.237439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd48544-a006-453e-8814-b3d29f6a03f4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:31.261789 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:31.293850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb61dfe-26d4-418f-b665-91bf8413f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:31.294473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61dfe-26d4-418f-b665-91bf8413f622 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:31.294794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61dfe-26d4-418f-b665-91bf8413f622 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:31.295135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61dfe-26d4-418f-b665-91bf8413f622 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:31.295819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb61dfe-26d4-418f-b665-91bf8413f622 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:31.296130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb61dfe-26d4-418f-b665-91bf8413f622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:31.297549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb61dfe-26d4-418f-b665-91bf8413f622 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:31.311254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc025397-b8c0-40f5-84a9-4dcb83824fc3 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:31.317020 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 67/129] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:31.317966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb61dfe-26d4-418f-b665-91bf8413f622 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:31.368508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b193768-c502-45ef-be57-9f3e005f0d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:31.370869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b193768-c502-45ef-be57-9f3e005f0d5a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:31.372303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b193768-c502-45ef-be57-9f3e005f0d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:31.372762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b193768-c502-45ef-be57-9f3e005f0d5a None admin] PATH_INFO: `/v3/users/40bcd9aa5e344ab38aab7605ac197048` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:31.374778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b193768-c502-45ef-be57-9f3e005f0d5a None admin] RBAC: Authorizing `identity:get_user(user_id=40bcd9aa5e344ab38aab7605ac197048)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:31.376491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b193768-c502-45ef-be57-9f3e005f0d5a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:31.379161 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 63/130] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:31 2022] GET /identity/v3/users/40bcd9aa5e344ab38aab7605ac197048 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:31.380323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b193768-c502-45ef-be57-9f3e005f0d5a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:31.387209 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:31.528878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb61dfe-26d4-418f-b665-91bf8413f622 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:31.529685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b193768-c502-45ef-be57-9f3e005f0d5a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:31.561447 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:31.569057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9206c-c121-4abb-ab18-cf8d428c875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:31.570038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9206c-c121-4abb-ab18-cf8d428c875b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:31.570497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9206c-c121-4abb-ab18-cf8d428c875b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:31.570985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9206c-c121-4abb-ab18-cf8d428c875b None admin] PATH_INFO: `/v3/users/40bcd9aa5e344ab38aab7605ac197048` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:31.572447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9206c-c121-4abb-ab18-cf8d428c875b None admin] RBAC: Authorizing `identity:get_user(user_id=40bcd9aa5e344ab38aab7605ac197048)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:31.574212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9206c-c121-4abb-ab18-cf8d428c875b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:31.576338 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 64/131] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:31 2022] GET /identity/v3/users/40bcd9aa5e344ab38aab7605ac197048 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:31.577404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9206c-c121-4abb-ab18-cf8d428c875b None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:31.615686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07226b73-cc80-46a2-9c43-483880887865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:31.616346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07226b73-cc80-46a2-9c43-483880887865 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:31.616637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07226b73-cc80-46a2-9c43-483880887865 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:31.616916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07226b73-cc80-46a2-9c43-483880887865 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:31.623583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07226b73-cc80-46a2-9c43-483880887865 None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:31.624810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07226b73-cc80-46a2-9c43-483880887865 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:31.626474 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 68/132] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:31 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:31.628258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07226b73-cc80-46a2-9c43-483880887865 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:31.696224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9206c-c121-4abb-ab18-cf8d428c875b None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:31.732436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44077b5a-9fc0-41b7-8265-65183bf3cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:31.733082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44077b5a-9fc0-41b7-8265-65183bf3cfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:31.733378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44077b5a-9fc0-41b7-8265-65183bf3cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:31.733665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44077b5a-9fc0-41b7-8265-65183bf3cfb4 None admin] PATH_INFO: `/v3/projects/a4fcbe4ab08a4155ab22c3831e5e7fa0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:31.734856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44077b5a-9fc0-41b7-8265-65183bf3cfb4 None admin] RBAC: Authorizing `identity:get_project(project_id=a4fcbe4ab08a4155ab22c3831e5e7fa0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:31.736529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44077b5a-9fc0-41b7-8265-65183bf3cfb4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:31.738185 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 65/133] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:31 2022] GET /identity/v3/projects/a4fcbe4ab08a4155ab22c3831e5e7fa0 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:31.739125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44077b5a-9fc0-41b7-8265-65183bf3cfb4 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:31.811316 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:31.849116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44077b5a-9fc0-41b7-8265-65183bf3cfb4 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:31.888327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1c519-dba5-428c-a6c0-31aa69b86939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:31.889045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c519-dba5-428c-a6c0-31aa69b86939 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:31.889338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c519-dba5-428c-a6c0-31aa69b86939 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:31.889616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c519-dba5-428c-a6c0-31aa69b86939 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c/users/40bcd9aa5e344ab38aab7605ac197048/roles/25dd37ef41a046b1b26386c2672249fe` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:31.891845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1c519-dba5-428c-a6c0-31aa69b86939 None admin] RBAC: Authorizing `identity:create_grant(project_id=123533f35dfa451ba661bea2bceb664c, user_id=40bcd9aa5e344ab38aab7605ac197048, role_id=25dd37ef41a046b1b26386c2672249fe)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:31.894176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1c519-dba5-428c-a6c0-31aa69b86939 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:31.896910 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:31.904728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07226b73-cc80-46a2-9c43-483880887865 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:31.921370 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 66/134] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:31 2022] PUT /identity/v3/projects/123533f35dfa451ba661bea2bceb664c/users/40bcd9aa5e344ab38aab7605ac197048/roles/25dd37ef41a046b1b26386c2672249fe => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:31.922268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1c519-dba5-428c-a6c0-31aa69b86939 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:31.975426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404eaa07-b1cf-4316-bb0b-099a6834b7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:31.976063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eaa07-b1cf-4316-bb0b-099a6834b7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:31.976346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eaa07-b1cf-4316-bb0b-099a6834b7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:31.976621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eaa07-b1cf-4316-bb0b-099a6834b7a1 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:31.980990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404eaa07-b1cf-4316-bb0b-099a6834b7a1 None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:31.982501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404eaa07-b1cf-4316-bb0b-099a6834b7a1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:31.984533 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 69/135] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:31 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:31.991289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404eaa07-b1cf-4316-bb0b-099a6834b7a1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:32.136517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1c519-dba5-428c-a6c0-31aa69b86939 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:32.171905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404eaa07-b1cf-4316-bb0b-099a6834b7a1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:32.194627 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:32.210303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3eb17-6aee-44d9-8622-97cbeac9f1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:32.214706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3eb17-6aee-44d9-8622-97cbeac9f1b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:32.215349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3eb17-6aee-44d9-8622-97cbeac9f1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:32.215830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3eb17-6aee-44d9-8622-97cbeac9f1b2 None admin] PATH_INFO: `/v3/projects/a4fcbe4ab08a4155ab22c3831e5e7fa0/users/40bcd9aa5e344ab38aab7605ac197048/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:32.218335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3eb17-6aee-44d9-8622-97cbeac9f1b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4fcbe4ab08a4155ab22c3831e5e7fa0, user_id=40bcd9aa5e344ab38aab7605ac197048, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:32.220072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3eb17-6aee-44d9-8622-97cbeac9f1b2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:32.247728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3edc1-5956-47d8-8513-e09c768b6cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:32.248411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3edc1-5956-47d8-8513-e09c768b6cb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:32.248703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3edc1-5956-47d8-8513-e09c768b6cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:32.248983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3edc1-5956-47d8-8513-e09c768b6cb5 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c/users/40bcd9aa5e344ab38aab7605ac197048/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:32.249282 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 67/136] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:31 2022] PUT /identity/v3/projects/a4fcbe4ab08a4155ab22c3831e5e7fa0/users/40bcd9aa5e344ab38aab7605ac197048/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:32.251387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3edc1-5956-47d8-8513-e09c768b6cb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=123533f35dfa451ba661bea2bceb664c, user_id=40bcd9aa5e344ab38aab7605ac197048, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:32.253188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3edc1-5956-47d8-8513-e09c768b6cb5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:32.278951 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 70/137] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:31 2022] PUT /identity/v3/projects/123533f35dfa451ba661bea2bceb664c/users/40bcd9aa5e344ab38aab7605ac197048/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:32.550678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f941f-0791-489b-8e1d-f8235d227c1a None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:32.551717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f941f-0791-489b-8e1d-f8235d227c1a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:32.552229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f941f-0791-489b-8e1d-f8235d227c1a None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:32.554192 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 68/138] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:32.566333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2d732-064d-4a6f-8eff-dd98fb1c176f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:32.566671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2d732-064d-4a6f-8eff-dd98fb1c176f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:32.566931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2d732-064d-4a6f-8eff-dd98fb1c176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:32.592024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f3d2d732-064d-4a6f-8eff-dd98fb1c176f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:32.593253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f3d2d732-064d-4a6f-8eff-dd98fb1c176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:32.621342 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:32.678440 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 71/139] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:32.990996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f941f-0791-489b-8e1d-f8235d227c1a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:33.116597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f941f-0791-489b-8e1d-f8235d227c1a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:33.163286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc43d5-8500-4569-a330-96a020282249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:33.164329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc43d5-8500-4569-a330-96a020282249 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:33.164823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc43d5-8500-4569-a330-96a020282249 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:33.165301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc43d5-8500-4569-a330-96a020282249 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:33.183444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc43d5-8500-4569-a330-96a020282249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-7cfc43d5-8500-4569-a330-96a020282249 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:33.188633 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:33.189614 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:33.190419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:33.193017 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 69/140] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:33.198936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2d732-064d-4a6f-8eff-dd98fb1c176f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:33.270287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a0112-149f-4a72-be74-d4f1e6c90383 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:33.270572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a0112-149f-4a72-be74-d4f1e6c90383 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:33.270796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a0112-149f-4a72-be74-d4f1e6c90383 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:33.272140 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 70/141] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:33.277218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2375-ec77-4d10-8b4d-ee7098cd100b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:33.277516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2375-ec77-4d10-8b4d-ee7098cd100b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:33.277792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2375-ec77-4d10-8b4d-ee7098cd100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:33.297078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c49a2375-ec77-4d10-8b4d-ee7098cd100b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:33.298252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c49a2375-ec77-4d10-8b4d-ee7098cd100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:33.356881 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:33.384096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2d732-064d-4a6f-8eff-dd98fb1c176f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:33.384632 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 71/142] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:33.444359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee1780-d616-455e-8771-a628f11477ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:33.444985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee1780-d616-455e-8771-a628f11477ef None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:33.445269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee1780-d616-455e-8771-a628f11477ef None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:33.445546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee1780-d616-455e-8771-a628f11477ef None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:33.446221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee1780-d616-455e-8771-a628f11477ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:33.446527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee1780-d616-455e-8771-a628f11477ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:33.447955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee1780-d616-455e-8771-a628f11477ef None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:33.458638 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 72/143] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:33.464405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2375-ec77-4d10-8b4d-ee7098cd100b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:33.566592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2375-ec77-4d10-8b4d-ee7098cd100b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:33.602392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4abe8-e9bf-4abb-8372-cf7cbd760ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:33.603162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4abe8-e9bf-4abb-8372-cf7cbd760ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:33.603441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4abe8-e9bf-4abb-8372-cf7cbd760ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:33.603715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4abe8-e9bf-4abb-8372-cf7cbd760ea4 None admin] PATH_INFO: `/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:33.604906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4abe8-e9bf-4abb-8372-cf7cbd760ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=a87a2f5ec4d74905b0b84b2127c02e7c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:33.606423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4abe8-e9bf-4abb-8372-cf7cbd760ea4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:33.608113 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 72/144] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:33 2022] GET /identity/v3/users/a87a2f5ec4d74905b0b84b2127c02e7c => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:33.614561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee1780-d616-455e-8771-a628f11477ef None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:33.637053 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:33.748374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee1780-d616-455e-8771-a628f11477ef None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:33.788769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aec80c-ff9b-4661-82c4-4b940f20da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:33.789379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec80c-ff9b-4661-82c4-4b940f20da26 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:33.789720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec80c-ff9b-4661-82c4-4b940f20da26 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:33.790012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec80c-ff9b-4661-82c4-4b940f20da26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:33.881957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aec80c-ff9b-4661-82c4-4b940f20da26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:33.883457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aec80c-ff9b-4661-82c4-4b940f20da26 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:33.914628 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:34.009951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4abe8-e9bf-4abb-8372-cf7cbd760ea4 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:34.032961 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 73/145] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:34.048257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aec80c-ff9b-4661-82c4-4b940f20da26 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:34.071068 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:34.140115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4abe8-e9bf-4abb-8372-cf7cbd760ea4 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:34.179587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aec80c-ff9b-4661-82c4-4b940f20da26 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:34.188220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10338d-9a54-43f1-ac7a-8861c3ef0276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:34.188864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10338d-9a54-43f1-ac7a-8861c3ef0276 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:34.189723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10338d-9a54-43f1-ac7a-8861c3ef0276 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:34.190749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10338d-9a54-43f1-ac7a-8861c3ef0276 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:34.192675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10338d-9a54-43f1-ac7a-8861c3ef0276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:34.194465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10338d-9a54-43f1-ac7a-8861c3ef0276 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:34.196832 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 73/146] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:34.198370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0508-fd37-42a8-b627-781135501bcb None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:34.202705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0508-fd37-42a8-b627-781135501bcb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:34.203281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0508-fd37-42a8-b627-781135501bcb None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:34.205159 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 74/147] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:34.206126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a0508-fd37-42a8-b627-781135501bcb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:34.206660 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:34.252489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b1cb5-7e22-4f6e-93fe-aac5d0c5dc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:34.254434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b1cb5-7e22-4f6e-93fe-aac5d0c5dc7d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:34.254930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b1cb5-7e22-4f6e-93fe-aac5d0c5dc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:34.260253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b1cb5-7e22-4f6e-93fe-aac5d0c5dc7d None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:34.261730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b1cb5-7e22-4f6e-93fe-aac5d0c5dc7d None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:34.263459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b1cb5-7e22-4f6e-93fe-aac5d0c5dc7d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:34.267946 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 74/148] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:34 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:34.270809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01413-1e8a-4f48-9e1a-3d0e3d2ac299 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:34.271489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01413-1e8a-4f48-9e1a-3d0e3d2ac299 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:34.273137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01413-1e8a-4f48-9e1a-3d0e3d2ac299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:34.302141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-08c01413-1e8a-4f48-9e1a-3d0e3d2ac299 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:34.303682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-08c01413-1e8a-4f48-9e1a-3d0e3d2ac299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:34.402190 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 75/149] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:34.403004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c01413-1e8a-4f48-9e1a-3d0e3d2ac299 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:34.447276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a0508-fd37-42a8-b627-781135501bcb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:34.488210 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:34.518728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c01413-1e8a-4f48-9e1a-3d0e3d2ac299 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:34.550937 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:34.559188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e76c0-130e-4a65-8127-62a91c94715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:34.559806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e76c0-130e-4a65-8127-62a91c94715b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:34.560091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e76c0-130e-4a65-8127-62a91c94715b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:34.560457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e76c0-130e-4a65-8127-62a91c94715b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:34.561411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e76c0-130e-4a65-8127-62a91c94715b None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=123533f35dfa451ba661bea2bceb664c, user.id=a87a2f5ec4d74905b0b84b2127c02e7c) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:34.561839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e76c0-130e-4a65-8127-62a91c94715b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:34.563713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e76c0-130e-4a65-8127-62a91c94715b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:34.563831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e0b1d-3a60-4384-96a8-149ee8d64c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:34.565165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e0b1d-3a60-4384-96a8-149ee8d64c84 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:34.565312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e0b1d-3a60-4384-96a8-149ee8d64c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:34.565576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e0b1d-3a60-4384-96a8-149ee8d64c84 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:34.566235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e0b1d-3a60-4384-96a8-149ee8d64c84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:34.567697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e0b1d-3a60-4384-96a8-149ee8d64c84 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:34.571661 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 76/150] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:34 2022] GET /identity/v3/role_assignments?user.id=a87a2f5ec4d74905b0b84b2127c02e7c&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:34.615219 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 75/151] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:44:34 2022] POST /identity/v3/users => generated 283 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:34.765646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e76c0-130e-4a65-8127-62a91c94715b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:34.913728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e76c0-130e-4a65-8127-62a91c94715b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:34.958060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea95f2-618e-4550-a2bd-883ce1af45fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:34.963929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea95f2-618e-4550-a2bd-883ce1af45fc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:34.964260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea95f2-618e-4550-a2bd-883ce1af45fc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:34.964547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea95f2-618e-4550-a2bd-883ce1af45fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:34.982862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea95f2-618e-4550-a2bd-883ce1af45fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-01ea95f2-618e-4550-a2bd-883ce1af45fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:34.989932 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:34.990923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:34.991687 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 77/152] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:34.999349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e0b1d-3a60-4384-96a8-149ee8d64c84 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:35.145039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e0b1d-3a60-4384-96a8-149ee8d64c84 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:35.184309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f9d7f-edb7-4494-915d-c02caa73a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:35.184921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9d7f-edb7-4494-915d-c02caa73a15b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.185201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9d7f-edb7-4494-915d-c02caa73a15b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.185470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9d7f-edb7-4494-915d-c02caa73a15b None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.186134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f9d7f-edb7-4494-915d-c02caa73a15b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:35.186434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f9d7f-edb7-4494-915d-c02caa73a15b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:35.187837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f9d7f-edb7-4494-915d-c02caa73a15b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:35.198447 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 76/153] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:35.204281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea95f2-618e-4550-a2bd-883ce1af45fc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:35.257405 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:35.331365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea95f2-618e-4550-a2bd-883ce1af45fc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:35.377535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118d23-f49a-46ae-b1f2-48119d4af996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:35.378190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118d23-f49a-46ae-b1f2-48119d4af996 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.378474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118d23-f49a-46ae-b1f2-48119d4af996 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.378774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118d23-f49a-46ae-b1f2-48119d4af996 None admin] PATH_INFO: `/v3/users/f6c1a1b1bb22463086c579a84df21f22` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.381388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118d23-f49a-46ae-b1f2-48119d4af996 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c1a1b1bb22463086c579a84df21f22)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:35.382872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118d23-f49a-46ae-b1f2-48119d4af996 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:35.384733 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 78/154] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:35 2022] GET /identity/v3/users/f6c1a1b1bb22463086c579a84df21f22 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:35.390264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f9d7f-edb7-4494-915d-c02caa73a15b None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:35.433465 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:35.478659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55c301-43e5-4515-9c00-922c7b35e7e0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.479174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55c301-43e5-4515-9c00-922c7b35e7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.479256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55c301-43e5-4515-9c00-922c7b35e7e0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.480757 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 79/155] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:35.485813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0df-d12f-48d4-b13f-d4f753f8cc64 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.487392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0df-d12f-48d4-b13f-d4f753f8cc64 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.488759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0df-d12f-48d4-b13f-d4f753f8cc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.525009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e9cac0df-d12f-48d4-b13f-d4f753f8cc64 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:35.526545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e9cac0df-d12f-48d4-b13f-d4f753f8cc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:35.532148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f9d7f-edb7-4494-915d-c02caa73a15b None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:35.579890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555651e-3b56-4c1c-a23d-420cea73301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:35.582485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555651e-3b56-4c1c-a23d-420cea73301d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.582485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555651e-3b56-4c1c-a23d-420cea73301d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.582485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555651e-3b56-4c1c-a23d-420cea73301d None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.583572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555651e-3b56-4c1c-a23d-420cea73301d None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:35.585215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555651e-3b56-4c1c-a23d-420cea73301d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:35.586954 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 77/156] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:35 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:35.594421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555651e-3b56-4c1c-a23d-420cea73301d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:35.644238 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 80/157] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:44:35.692747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abd06b-6439-4fc3-9f86-602fdebc3553 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.693036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abd06b-6439-4fc3-9f86-602fdebc3553 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.693267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abd06b-6439-4fc3-9f86-602fdebc3553 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.694640 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 81/158] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:35.697297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6d107-1475-4490-8d73-ff85d68b460f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.697694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6d107-1475-4490-8d73-ff85d68b460f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.697974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6d107-1475-4490-8d73-ff85d68b460f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.699689 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 82/159] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:35.704104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d105-dfba-4567-b61c-3adcdb759d49 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.704500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d105-dfba-4567-b61c-3adcdb759d49 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.705364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d105-dfba-4567-b61c-3adcdb759d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.725306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-39b5d105-dfba-4567-b61c-3adcdb759d49 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:35.726566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-39b5d105-dfba-4567-b61c-3adcdb759d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:35.732471 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:35.735652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555651e-3b56-4c1c-a23d-420cea73301d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:35.765624 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:35.781972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfa132-7a7c-43b7-9a2e-8230d877ed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:35.782691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa132-7a7c-43b7-9a2e-8230d877ed7b None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.783526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa132-7a7c-43b7-9a2e-8230d877ed7b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.783800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa132-7a7c-43b7-9a2e-8230d877ed7b None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c/users/f6c1a1b1bb22463086c579a84df21f22/roles/24d5a978aad041e5ac5f969daacd12c0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.786082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfa132-7a7c-43b7-9a2e-8230d877ed7b None admin] RBAC: Authorizing `identity:create_grant(project_id=123533f35dfa451ba661bea2bceb664c, user_id=f6c1a1b1bb22463086c579a84df21f22, role_id=24d5a978aad041e5ac5f969daacd12c0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:35.787584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfa132-7a7c-43b7-9a2e-8230d877ed7b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:35.805747 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 78/160] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:35 2022] PUT /identity/v3/projects/123533f35dfa451ba661bea2bceb664c/users/f6c1a1b1bb22463086c579a84df21f22/roles/24d5a978aad041e5ac5f969daacd12c0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:35.812154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a343fa-0345-43c8-a4dd-be8272f8c937 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:35.812433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a343fa-0345-43c8-a4dd-be8272f8c937 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:35.812764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a343fa-0345-43c8-a4dd-be8272f8c937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:35.815302 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 83/161] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:44:35.833770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-80a343fa-0345-43c8-a4dd-be8272f8c937 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:35.835108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-80a343fa-0345-43c8-a4dd-be8272f8c937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:35.921724 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 79/162] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:35.973594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5d105-dfba-4567-b61c-3adcdb759d49 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:36.092167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5d105-dfba-4567-b61c-3adcdb759d49 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:36.129468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0555a8-a7c0-43a3-a78c-a75d6bf6d271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:36.130111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0555a8-a7c0-43a3-a78c-a75d6bf6d271 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:36.130394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0555a8-a7c0-43a3-a78c-a75d6bf6d271 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:36.130699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0555a8-a7c0-43a3-a78c-a75d6bf6d271 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:36.142077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0555a8-a7c0-43a3-a78c-a75d6bf6d271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-3b0555a8-a7c0-43a3-a78c-a75d6bf6d271 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:36.147620 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:36.149455 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:36.150417 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 84/163] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:36.154450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a343fa-0345-43c8-a4dd-be8272f8c937 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:36.196309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0555a8-a7c0-43a3-a78c-a75d6bf6d271 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:36.241503 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:36.287232 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:36.301011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a343fa-0345-43c8-a4dd-be8272f8c937 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:36.348916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0555a8-a7c0-43a3-a78c-a75d6bf6d271 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:36.349361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fcd9a-7743-404a-85a0-e87ce3c071d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:36.350165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fcd9a-7743-404a-85a0-e87ce3c071d5 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:36.350765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fcd9a-7743-404a-85a0-e87ce3c071d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:36.352100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fcd9a-7743-404a-85a0-e87ce3c071d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:36.352931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fcd9a-7743-404a-85a0-e87ce3c071d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:36.353373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fcd9a-7743-404a-85a0-e87ce3c071d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:36.354984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fcd9a-7743-404a-85a0-e87ce3c071d5 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:36.365644 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 80/164] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:36.366712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fcd9a-7743-404a-85a0-e87ce3c071d5 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:36.390098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de3b54-2e25-44b7-aee4-de9f4e973ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:36.391003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de3b54-2e25-44b7-aee4-de9f4e973ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:36.391450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de3b54-2e25-44b7-aee4-de9f4e973ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:36.391899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de3b54-2e25-44b7-aee4-de9f4e973ac6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:36.404585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de3b54-2e25-44b7-aee4-de9f4e973ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-13de3b54-2e25-44b7-aee4-de9f4e973ac6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:36.410147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:36.411065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:36.411827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:36.418727 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 85/165] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:36.419806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de3b54-2e25-44b7-aee4-de9f4e973ac6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:36.536712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de3b54-2e25-44b7-aee4-de9f4e973ac6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:36.546611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fcd9a-7743-404a-85a0-e87ce3c071d5 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:36.563026 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:36.583877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd45416-711c-4901-ab22-78d091e5e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:36.584842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd45416-711c-4901-ab22-78d091e5e623 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:36.586790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd45416-711c-4901-ab22-78d091e5e623 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:36.587163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd45416-711c-4901-ab22-78d091e5e623 None admin] PATH_INFO: `/v3/users/40bcd9aa5e344ab38aab7605ac197048` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:36.590195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd45416-711c-4901-ab22-78d091e5e623 None admin] RBAC: Authorizing `identity:get_user(user_id=40bcd9aa5e344ab38aab7605ac197048)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:36.594417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd45416-711c-4901-ab22-78d091e5e623 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:36.596708 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 86/166] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:36 2022] GET /identity/v3/users/40bcd9aa5e344ab38aab7605ac197048 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:36.598227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd45416-711c-4901-ab22-78d091e5e623 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:36.665651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f2d59-5f37-4feb-8e0e-2ff46190138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:36.666976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f2d59-5f37-4feb-8e0e-2ff46190138e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:36.667401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f2d59-5f37-4feb-8e0e-2ff46190138e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:36.667814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f2d59-5f37-4feb-8e0e-2ff46190138e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:36.699289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f2d59-5f37-4feb-8e0e-2ff46190138e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-916f2d59-5f37-4feb-8e0e-2ff46190138e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:36.705651 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:36.706559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:36.707457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:36.715201 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 81/167] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:44:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:36.716501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f2d59-5f37-4feb-8e0e-2ff46190138e None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:36.749939 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:36.780942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd45416-711c-4901-ab22-78d091e5e623 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:36.896278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ec8b0-467d-4fbb-8018-de6fca136e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:36.896812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec8b0-467d-4fbb-8018-de6fca136e07 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:36.897094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec8b0-467d-4fbb-8018-de6fca136e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:36.897374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec8b0-467d-4fbb-8018-de6fca136e07 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:36.898052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ec8b0-467d-4fbb-8018-de6fca136e07 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:36.898357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ec8b0-467d-4fbb-8018-de6fca136e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:36.899774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ec8b0-467d-4fbb-8018-de6fca136e07 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:36.920501 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 87/168] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:36.921343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ec8b0-467d-4fbb-8018-de6fca136e07 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:36.937926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f2d59-5f37-4feb-8e0e-2ff46190138e None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:36.982378 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:37.027968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d6169-4d55-4639-80d4-1c5c1115f881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:37.028593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d6169-4d55-4639-80d4-1c5c1115f881 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:37.028992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d6169-4d55-4639-80d4-1c5c1115f881 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:37.029239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d6169-4d55-4639-80d4-1c5c1115f881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:37.139582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ec8b0-467d-4fbb-8018-de6fca136e07 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:37.186372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66aa550-b0a3-4f1f-bed9-75847129a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:37.187009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66aa550-b0a3-4f1f-bed9-75847129a086 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:37.187287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66aa550-b0a3-4f1f-bed9-75847129a086 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:37.187558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66aa550-b0a3-4f1f-bed9-75847129a086 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:37.188345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66aa550-b0a3-4f1f-bed9-75847129a086 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:37.188652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66aa550-b0a3-4f1f-bed9-75847129a086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:37.190898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66aa550-b0a3-4f1f-bed9-75847129a086 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:37.206837 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 88/169] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:44:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:37.207582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66aa550-b0a3-4f1f-bed9-75847129a086 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:37.220663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d6169-4d55-4639-80d4-1c5c1115f881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:37.222297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d6169-4d55-4639-80d4-1c5c1115f881 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:37.243563 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:37.334278 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 82/170] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:37.334278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d6169-4d55-4639-80d4-1c5c1115f881 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:37.358629 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:37.384332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66aa550-b0a3-4f1f-bed9-75847129a086 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:37.436041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d6169-4d55-4639-80d4-1c5c1115f881 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:37.451010 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:37.457022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a7869-9479-4aa6-8c0a-a810eacbe8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:37.457994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7869-9479-4aa6-8c0a-a810eacbe8ec None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:37.458479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7869-9479-4aa6-8c0a-a810eacbe8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:37.458968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7869-9479-4aa6-8c0a-a810eacbe8ec None admin] PATH_INFO: `/v3/users/40bcd9aa5e344ab38aab7605ac197048` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:37.462443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a7869-9479-4aa6-8c0a-a810eacbe8ec None admin] RBAC: Authorizing `identity:get_user(user_id=40bcd9aa5e344ab38aab7605ac197048)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:37.464328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a7869-9479-4aa6-8c0a-a810eacbe8ec None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:37.466205 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 89/171] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:37 2022] GET /identity/v3/users/40bcd9aa5e344ab38aab7605ac197048 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:37.467341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a7869-9479-4aa6-8c0a-a810eacbe8ec None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:37.479378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dbdc2-8934-44d9-8357-88f643ca4c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:37.480017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dbdc2-8934-44d9-8357-88f643ca4c62 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:37.480294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dbdc2-8934-44d9-8357-88f643ca4c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:37.480570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dbdc2-8934-44d9-8357-88f643ca4c62 None admin] PATH_INFO: `/v3/users/40bcd9aa5e344ab38aab7605ac197048` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:37.483940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dbdc2-8934-44d9-8357-88f643ca4c62 None admin] RBAC: Authorizing `identity:get_user(user_id=40bcd9aa5e344ab38aab7605ac197048)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:37.485384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dbdc2-8934-44d9-8357-88f643ca4c62 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:37.487503 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 83/172] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:37 2022] GET /identity/v3/users/40bcd9aa5e344ab38aab7605ac197048 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:37.488780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dbdc2-8934-44d9-8357-88f643ca4c62 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:37.656068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dbdc2-8934-44d9-8357-88f643ca4c62 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:37.673520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a7869-9479-4aa6-8c0a-a810eacbe8ec None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:37.722187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629e82-4de2-4f26-af82-a00773ab7c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:37.722729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629e82-4de2-4f26-af82-a00773ab7c4b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:37.723004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629e82-4de2-4f26-af82-a00773ab7c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:37.723277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629e82-4de2-4f26-af82-a00773ab7c4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:37.741628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd948e9-1634-4084-8401-acc73626de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:37.742270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd948e9-1634-4084-8401-acc73626de69 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:37.742548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd948e9-1634-4084-8401-acc73626de69 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:37.742851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd948e9-1634-4084-8401-acc73626de69 None admin] PATH_INFO: `/v3/projects/a4fcbe4ab08a4155ab22c3831e5e7fa0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:37.744020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd948e9-1634-4084-8401-acc73626de69 None admin] RBAC: Authorizing `identity:get_project(project_id=a4fcbe4ab08a4155ab22c3831e5e7fa0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:37.745495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd948e9-1634-4084-8401-acc73626de69 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:37.752653 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 90/173] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:37 2022] GET /identity/v3/projects/a4fcbe4ab08a4155ab22c3831e5e7fa0 => generated 312 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:37.753650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd948e9-1634-4084-8401-acc73626de69 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:37.786208 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:37.807328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46629e82-4de2-4f26-af82-a00773ab7c4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:37.808809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46629e82-4de2-4f26-af82-a00773ab7c4b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:37.854987 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:37.870949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd948e9-1634-4084-8401-acc73626de69 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:37.912171 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 84/174] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:37.913021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629e82-4de2-4f26-af82-a00773ab7c4b None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:37.947133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7e52-59a8-483b-8c43-604474c1be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:37.947804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7e52-59a8-483b-8c43-604474c1be4d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:37.948089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7e52-59a8-483b-8c43-604474c1be4d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:37.948361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7e52-59a8-483b-8c43-604474c1be4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:37.998754 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:38.019073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629e82-4de2-4f26-af82-a00773ab7c4b None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:38.058091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f5428-37a5-4401-bfbe-3e07ad23ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:38.058811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f5428-37a5-4401-bfbe-3e07ad23ef1c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:38.059098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f5428-37a5-4401-bfbe-3e07ad23ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:38.059377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f5428-37a5-4401-bfbe-3e07ad23ef1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:38.060116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f5428-37a5-4401-bfbe-3e07ad23ef1c None admin] RBAC: Adding query filter params (role.id=beb2c562d1d14ef599b41dd5788b6e4d, scope.project.id=a4fcbe4ab08a4155ab22c3831e5e7fa0, user.id=40bcd9aa5e344ab38aab7605ac197048) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:38.060428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f5428-37a5-4401-bfbe-3e07ad23ef1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:38.061899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f5428-37a5-4401-bfbe-3e07ad23ef1c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:38.068898 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 85/175] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:37 2022] GET /identity/v3/role_assignments?user.id=40bcd9aa5e344ab38aab7605ac197048&scope.project.id=a4fcbe4ab08a4155ab22c3831e5e7fa0&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:38.069726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f5428-37a5-4401-bfbe-3e07ad23ef1c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:38.126923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f7e52-59a8-483b-8c43-604474c1be4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:38.128435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f7e52-59a8-483b-8c43-604474c1be4d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:38.184007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f5428-37a5-4401-bfbe-3e07ad23ef1c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:38.187187 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:38.222150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7f727-44db-48f1-b7b9-18869df5ebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:38.222830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7f727-44db-48f1-b7b9-18869df5ebed None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:38.223110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7f727-44db-48f1-b7b9-18869df5ebed None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:38.223390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7f727-44db-48f1-b7b9-18869df5ebed None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:38.224536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7f727-44db-48f1-b7b9-18869df5ebed None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:38.225981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7f727-44db-48f1-b7b9-18869df5ebed None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:38.227643 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 86/176] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:38 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:38.238423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7f727-44db-48f1-b7b9-18869df5ebed None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:38.259944 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:38.378026 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 91/177] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:38.391894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7e52-59a8-483b-8c43-604474c1be4d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:38.399802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7f727-44db-48f1-b7b9-18869df5ebed None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:38.450396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c226e-391b-430f-a727-aca27db6237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:38.451379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c226e-391b-430f-a727-aca27db6237c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:38.451807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c226e-391b-430f-a727-aca27db6237c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:38.452250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c226e-391b-430f-a727-aca27db6237c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:38.453302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c226e-391b-430f-a727-aca27db6237c None admin] RBAC: Adding query filter params (role.id=beb2c562d1d14ef599b41dd5788b6e4d, scope.project.id=123533f35dfa451ba661bea2bceb664c, user.id=40bcd9aa5e344ab38aab7605ac197048) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:38.453798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c226e-391b-430f-a727-aca27db6237c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:38.455491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c226e-391b-430f-a727-aca27db6237c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:38.462143 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 87/178] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:38 2022] GET /identity/v3/role_assignments?user.id=40bcd9aa5e344ab38aab7605ac197048&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:38.561997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7e52-59a8-483b-8c43-604474c1be4d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:38.579878 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:38.601088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d856b-30ae-4a72-a816-a1d122e1c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:38.601728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d856b-30ae-4a72-a816-a1d122e1c22a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:38.602006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d856b-30ae-4a72-a816-a1d122e1c22a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:38.602275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d856b-30ae-4a72-a816-a1d122e1c22a None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:38.603456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d856b-30ae-4a72-a816-a1d122e1c22a None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:38.604927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d856b-30ae-4a72-a816-a1d122e1c22a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:38.606638 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 92/179] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:38 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:38.616069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c226e-391b-430f-a727-aca27db6237c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:38.736707 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:38.770288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c226e-391b-430f-a727-aca27db6237c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:38.812831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12731ba4-18b6-4176-ba33-02e44883888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:38.813940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12731ba4-18b6-4176-ba33-02e44883888e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:38.814464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12731ba4-18b6-4176-ba33-02e44883888e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:38.815005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12731ba4-18b6-4176-ba33-02e44883888e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:38.815906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12731ba4-18b6-4176-ba33-02e44883888e None admin] RBAC: Adding query filter params (role.id=25dd37ef41a046b1b26386c2672249fe, scope.project.id=123533f35dfa451ba661bea2bceb664c, user.id=40bcd9aa5e344ab38aab7605ac197048) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:38.816220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12731ba4-18b6-4176-ba33-02e44883888e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:38.817672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12731ba4-18b6-4176-ba33-02e44883888e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:38.824450 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 88/180] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:38 2022] GET /identity/v3/role_assignments?user.id=40bcd9aa5e344ab38aab7605ac197048&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=25dd37ef41a046b1b26386c2672249fe => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:39.185928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd2b89-66a7-4b80-b5aa-d91bc90df4af None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.186448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd2b89-66a7-4b80-b5aa-d91bc90df4af None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.186448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd2b89-66a7-4b80-b5aa-d91bc90df4af None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.188008 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 93/181] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:39.194777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5ac9d-c3f4-4581-8679-7257b8ea5570 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.195088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5ac9d-c3f4-4581-8679-7257b8ea5570 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.195341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5ac9d-c3f4-4581-8679-7257b8ea5570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.217826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b18c-41a7-40c7-aa69-31900d05be2f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.218464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b18c-41a7-40c7-aa69-31900d05be2f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.218582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fab5ac9d-c3f4-4581-8679-7257b8ea5570 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:39.219118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b18c-41a7-40c7-aa69-31900d05be2f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.219765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fab5ac9d-c3f4-4581-8679-7257b8ea5570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:39.221100 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 94/182] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:39.227246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a449d-725b-473e-b0be-058e6629e597 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.227907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a449d-725b-473e-b0be-058e6629e597 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.228373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a449d-725b-473e-b0be-058e6629e597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.249321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ee1a449d-725b-473e-b0be-058e6629e597 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:39.250844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee1a449d-725b-473e-b0be-058e6629e597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:39.298443 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 89/183] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:39.336099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f7bf-69fd-4938-9b49-f214dfdfbaa7 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.336396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f7bf-69fd-4938-9b49-f214dfdfbaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.336651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f7bf-69fd-4938-9b49-f214dfdfbaa7 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.338120 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 90/184] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:39.339578 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 95/185] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:44:39.343813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977445b3-8613-4acf-8c2a-95c3e499659a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.344103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977445b3-8613-4acf-8c2a-95c3e499659a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.344377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977445b3-8613-4acf-8c2a-95c3e499659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.362842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-977445b3-8613-4acf-8c2a-95c3e499659a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:39.364071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-977445b3-8613-4acf-8c2a-95c3e499659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:39.427373 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:39.432059 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 91/186] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:44:39.589653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a449d-725b-473e-b0be-058e6629e597 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:39.618803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977445b3-8613-4acf-8c2a-95c3e499659a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:39.706120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a449d-725b-473e-b0be-058e6629e597 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:39.721752 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:39.737178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977445b3-8613-4acf-8c2a-95c3e499659a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:39.743776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7891-d882-42aa-8d32-6f9fbf047971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:39.744413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7891-d882-42aa-8d32-6f9fbf047971 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.744691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7891-d882-42aa-8d32-6f9fbf047971 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.744964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7891-d882-42aa-8d32-6f9fbf047971 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.757014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c7891-d882-42aa-8d32-6f9fbf047971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4f3c7891-d882-42aa-8d32-6f9fbf047971 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:39.762189 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:39.763367 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 96/187] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:39.764349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7891-d882-42aa-8d32-6f9fbf047971 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:39.779553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9c580-0fb5-4494-bd2c-248fb622180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:39.780188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c580-0fb5-4494-bd2c-248fb622180e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.780466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c580-0fb5-4494-bd2c-248fb622180e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.780737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c580-0fb5-4494-bd2c-248fb622180e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.791319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9c580-0fb5-4494-bd2c-248fb622180e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-25b9c580-0fb5-4494-bd2c-248fb622180e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:39.796067 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:39.796940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 92/188] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:44:39.799519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9c580-0fb5-4494-bd2c-248fb622180e None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:39.868756 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:39.878091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7891-d882-42aa-8d32-6f9fbf047971 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:39.911914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b8988-9b5a-413e-a68b-40b54b98e49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:39.912538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8988-9b5a-413e-a68b-40b54b98e49c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.912814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8988-9b5a-413e-a68b-40b54b98e49c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.913080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8988-9b5a-413e-a68b-40b54b98e49c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.919845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9c580-0fb5-4494-bd2c-248fb622180e None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:39.923961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b8988-9b5a-413e-a68b-40b54b98e49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7a9b8988-9b5a-413e-a68b-40b54b98e49c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:39.929163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:39.930082 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:39.930922 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 97/189] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:44:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:39.931605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b8988-9b5a-413e-a68b-40b54b98e49c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:39.969864 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:39.973458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cffd1c-14df-486a-af8a-53f6409d09c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:39.974078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cffd1c-14df-486a-af8a-53f6409d09c8 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:39.974357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cffd1c-14df-486a-af8a-53f6409d09c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:39.974715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cffd1c-14df-486a-af8a-53f6409d09c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:39.975398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cffd1c-14df-486a-af8a-53f6409d09c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:39.975701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cffd1c-14df-486a-af8a-53f6409d09c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:39.977073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cffd1c-14df-486a-af8a-53f6409d09c8 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:39.990008 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 93/190] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:39.990008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cffd1c-14df-486a-af8a-53f6409d09c8 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:40.042505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b8988-9b5a-413e-a68b-40b54b98e49c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:40.076555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6995cb7-335c-49b9-9e40-40acf39c3404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:40.077185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6995cb7-335c-49b9-9e40-40acf39c3404 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:40.077465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6995cb7-335c-49b9-9e40-40acf39c3404 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:40.077735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6995cb7-335c-49b9-9e40-40acf39c3404 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:40.078420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6995cb7-335c-49b9-9e40-40acf39c3404 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:40.078767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6995cb7-335c-49b9-9e40-40acf39c3404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:40.080808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6995cb7-335c-49b9-9e40-40acf39c3404 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:40.089660 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 98/191] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:40.090522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6995cb7-335c-49b9-9e40-40acf39c3404 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:40.104597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cffd1c-14df-486a-af8a-53f6409d09c8 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:40.128589 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:40.141265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a6782-e4a4-4681-99e0-30a91b6b0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:40.141899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6782-e4a4-4681-99e0-30a91b6b0594 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:40.142200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6782-e4a4-4681-99e0-30a91b6b0594 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:40.142481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6782-e4a4-4681-99e0-30a91b6b0594 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:40.143344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a6782-e4a4-4681-99e0-30a91b6b0594 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:40.143451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a6782-e4a4-4681-99e0-30a91b6b0594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:40.144767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a6782-e4a4-4681-99e0-30a91b6b0594 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:40.153304 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 94/192] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:44:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:40.153914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a6782-e4a4-4681-99e0-30a91b6b0594 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:40.207493 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:40.215777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6995cb7-335c-49b9-9e40-40acf39c3404 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:40.253104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d602230-843f-4a04-b99e-fee9cfb8696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:40.253734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602230-843f-4a04-b99e-fee9cfb8696a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:40.254020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602230-843f-4a04-b99e-fee9cfb8696a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:40.254298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602230-843f-4a04-b99e-fee9cfb8696a None admin] PATH_INFO: `/v3/users/f6c1a1b1bb22463086c579a84df21f22` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:40.255465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d602230-843f-4a04-b99e-fee9cfb8696a None admin] RBAC: Authorizing `identity:get_user(user_id=f6c1a1b1bb22463086c579a84df21f22)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:40.256315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a6782-e4a4-4681-99e0-30a91b6b0594 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:40.256929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d602230-843f-4a04-b99e-fee9cfb8696a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:40.258508 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 99/193] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:40 2022] GET /identity/v3/users/f6c1a1b1bb22463086c579a84df21f22 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:40.259290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d602230-843f-4a04-b99e-fee9cfb8696a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:40.293356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a8975-c9ad-434b-9d41-efb54a66ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:40.293978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a8975-c9ad-434b-9d41-efb54a66ebd7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:40.294254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a8975-c9ad-434b-9d41-efb54a66ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:40.294523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a8975-c9ad-434b-9d41-efb54a66ebd7 None admin] PATH_INFO: `/v3/users/522811f1ed184ffeb6286a73b211a07c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:40.308091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a8975-c9ad-434b-9d41-efb54a66ebd7 None admin] RBAC: Authorizing `identity:get_user(user_id=522811f1ed184ffeb6286a73b211a07c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:40.309547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a8975-c9ad-434b-9d41-efb54a66ebd7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:40.311187 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 95/194] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:40 2022] GET /identity/v3/users/522811f1ed184ffeb6286a73b211a07c => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:40.312313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bcfed-7535-429c-a0b5-0110088f3d00 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:40.312592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bcfed-7535-429c-a0b5-0110088f3d00 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:40.312862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bcfed-7535-429c-a0b5-0110088f3d00 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:40.315197 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 96/195] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:40.317594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bcfed-7535-429c-a0b5-0110088f3d00 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:40.359845 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:40.361767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d602230-843f-4a04-b99e-fee9cfb8696a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:40.398888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed56a6b-9974-4e6b-9d72-8ad7f4bdeab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:40.399432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed56a6b-9974-4e6b-9d72-8ad7f4bdeab8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:40.399707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed56a6b-9974-4e6b-9d72-8ad7f4bdeab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:40.399969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed56a6b-9974-4e6b-9d72-8ad7f4bdeab8 None admin] PATH_INFO: `/v3/users/522811f1ed184ffeb6286a73b211a07c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:40.401099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed56a6b-9974-4e6b-9d72-8ad7f4bdeab8 None admin] RBAC: Authorizing `identity:get_user(user_id=522811f1ed184ffeb6286a73b211a07c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:40.402537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed56a6b-9974-4e6b-9d72-8ad7f4bdeab8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:40.404131 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 100/196] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:40 2022] GET /identity/v3/users/522811f1ed184ffeb6286a73b211a07c => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:40.404876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed56a6b-9974-4e6b-9d72-8ad7f4bdeab8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:40.419756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bcfed-7535-429c-a0b5-0110088f3d00 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:40.440104 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:40.453679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010ab3-01dc-4832-a2dd-0dc87061dc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:40.455062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010ab3-01dc-4832-a2dd-0dc87061dc4e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:40.455178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010ab3-01dc-4832-a2dd-0dc87061dc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:40.455444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010ab3-01dc-4832-a2dd-0dc87061dc4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:40.508172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed56a6b-9974-4e6b-9d72-8ad7f4bdeab8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:40.520933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65010ab3-01dc-4832-a2dd-0dc87061dc4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:40.522389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65010ab3-01dc-4832-a2dd-0dc87061dc4e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:40.541319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802915f-2602-408d-8fce-09b644c0cb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:40.541906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802915f-2602-408d-8fce-09b644c0cb9e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:40.542181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802915f-2602-408d-8fce-09b644c0cb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:40.542452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802915f-2602-408d-8fce-09b644c0cb9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:40.564051 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:40.608763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802915f-2602-408d-8fce-09b644c0cb9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:40.610273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802915f-2602-408d-8fce-09b644c0cb9e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:40.624056 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 97/197] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:40.624056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac0e67-ecc8-4db8-919c-9ee634ceb3a9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:40.624056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac0e67-ecc8-4db8-919c-9ee634ceb3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:40.624056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac0e67-ecc8-4db8-919c-9ee634ceb3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:40.638681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-aeac0e67-ecc8-4db8-919c-9ee634ceb3a9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:40.639842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-aeac0e67-ecc8-4db8-919c-9ee634ceb3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:40.646441 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:40.706228 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 98/198] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:40.707135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac0e67-ecc8-4db8-919c-9ee634ceb3a9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:40.719700 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 101/199] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:40.720556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802915f-2602-408d-8fce-09b644c0cb9e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:40.793753 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:40.827820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac0e67-ecc8-4db8-919c-9ee634ceb3a9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:40.828029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802915f-2602-408d-8fce-09b644c0cb9e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:40.859402 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:40.866031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2428e2e-911a-45d7-a229-4ff92ab868c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:40.866452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4f6e3-bbe2-4875-8cf0-c20f3d45da61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:40.866788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2428e2e-911a-45d7-a229-4ff92ab868c9 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:40.866947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2428e2e-911a-45d7-a229-4ff92ab868c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:40.867101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f6e3-bbe2-4875-8cf0-c20f3d45da61 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:40.867191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2428e2e-911a-45d7-a229-4ff92ab868c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:40.867385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f6e3-bbe2-4875-8cf0-c20f3d45da61 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:40.867727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f6e3-bbe2-4875-8cf0-c20f3d45da61 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:40.868770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4f6e3-bbe2-4875-8cf0-c20f3d45da61 None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:40.870539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4f6e3-bbe2-4875-8cf0-c20f3d45da61 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:40.872456 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 102/200] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:40 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:40.873047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4f6e3-bbe2-4875-8cf0-c20f3d45da61 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:40.939090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2428e2e-911a-45d7-a229-4ff92ab868c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:40.940667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2428e2e-911a-45d7-a229-4ff92ab868c9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:40.989119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4f6e3-bbe2-4875-8cf0-c20f3d45da61 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:41.010490 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:41.022487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90cb8f-abac-49ca-b4aa-d01b5b823a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:41.023145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90cb8f-abac-49ca-b4aa-d01b5b823a73 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:41.023426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90cb8f-abac-49ca-b4aa-d01b5b823a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:41.023697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90cb8f-abac-49ca-b4aa-d01b5b823a73 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:41.024809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90cb8f-abac-49ca-b4aa-d01b5b823a73 None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:41.026263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90cb8f-abac-49ca-b4aa-d01b5b823a73 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:41.027907 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 103/201] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:40 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:41.028665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90cb8f-abac-49ca-b4aa-d01b5b823a73 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:41.050357 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 99/202] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:41.050357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2428e2e-911a-45d7-a229-4ff92ab868c9 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:41.092312 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:41.125029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90cb8f-abac-49ca-b4aa-d01b5b823a73 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:41.143544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2428e2e-911a-45d7-a229-4ff92ab868c9 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:41.160789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115d57d-2844-4a63-9203-982b56bd1258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:41.161394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115d57d-2844-4a63-9203-982b56bd1258 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:41.161672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115d57d-2844-4a63-9203-982b56bd1258 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:41.161944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115d57d-2844-4a63-9203-982b56bd1258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:41.162693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115d57d-2844-4a63-9203-982b56bd1258 None admin] RBAC: Adding query filter params (role.id=24d5a978aad041e5ac5f969daacd12c0, scope.project.id=123533f35dfa451ba661bea2bceb664c, user.id=f6c1a1b1bb22463086c579a84df21f22) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:41.163005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115d57d-2844-4a63-9203-982b56bd1258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:41.164452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115d57d-2844-4a63-9203-982b56bd1258 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:41.170014 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 104/203] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:41 2022] GET /identity/v3/role_assignments?user.id=f6c1a1b1bb22463086c579a84df21f22&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=24d5a978aad041e5ac5f969daacd12c0 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:41.171469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115d57d-2844-4a63-9203-982b56bd1258 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:41.176898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111652a-e764-4bce-8c02-d56e02cb2c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:41.177547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111652a-e764-4bce-8c02-d56e02cb2c5c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:41.177825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111652a-e764-4bce-8c02-d56e02cb2c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:41.178096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111652a-e764-4bce-8c02-d56e02cb2c5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:41.179296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111652a-e764-4bce-8c02-d56e02cb2c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:41.180797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111652a-e764-4bce-8c02-d56e02cb2c5c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:41.182675 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 100/204] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:41.187697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111652a-e764-4bce-8c02-d56e02cb2c5c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:41.240339 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:41.289453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115d57d-2844-4a63-9203-982b56bd1258 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:41.307179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111652a-e764-4bce-8c02-d56e02cb2c5c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:41.322071 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:41.328043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf824d-20fa-415b-9a87-817b2eb56e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:41.329672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf824d-20fa-415b-9a87-817b2eb56e61 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:41.330021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf824d-20fa-415b-9a87-817b2eb56e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:41.330362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf824d-20fa-415b-9a87-817b2eb56e61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:41.331204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf824d-20fa-415b-9a87-817b2eb56e61 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af, user.id=522811f1ed184ffeb6286a73b211a07c) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:41.331579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf824d-20fa-415b-9a87-817b2eb56e61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:41.333675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf824d-20fa-415b-9a87-817b2eb56e61 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:41.339787 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 105/205] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:41 2022] GET /identity/v3/role_assignments?user.id=522811f1ed184ffeb6286a73b211a07c&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:41.340796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf824d-20fa-415b-9a87-817b2eb56e61 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:41.364147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a3f06-4d2c-43dc-a9bc-661563889096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:41.364824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a3f06-4d2c-43dc-a9bc-661563889096 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:41.365212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a3f06-4d2c-43dc-a9bc-661563889096 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:41.365646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a3f06-4d2c-43dc-a9bc-661563889096 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:41.366921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a3f06-4d2c-43dc-a9bc-661563889096 None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:41.368796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a3f06-4d2c-43dc-a9bc-661563889096 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:41.371330 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 101/206] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:41 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:41.377568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a3f06-4d2c-43dc-a9bc-661563889096 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:41.479800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf824d-20fa-415b-9a87-817b2eb56e61 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:41.509021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a3f06-4d2c-43dc-a9bc-661563889096 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:41.519116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aaed1-a436-4eab-a235-da72e0b8cefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:41.519332 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:41.519740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aaed1-a436-4eab-a235-da72e0b8cefe None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:41.520018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aaed1-a436-4eab-a235-da72e0b8cefe None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:41.520292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aaed1-a436-4eab-a235-da72e0b8cefe None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:41.521064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aaed1-a436-4eab-a235-da72e0b8cefe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:41.522721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aaed1-a436-4eab-a235-da72e0b8cefe None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:41.550589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7b325-b4cf-4856-93a0-2cb02ced6538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:41.551223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b325-b4cf-4856-93a0-2cb02ced6538 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:41.551504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b325-b4cf-4856-93a0-2cb02ced6538 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:41.551826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b325-b4cf-4856-93a0-2cb02ced6538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:41.552562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7b325-b4cf-4856-93a0-2cb02ced6538 None admin] RBAC: Adding query filter params (role.id=25dd37ef41a046b1b26386c2672249fe, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af, user.id=522811f1ed184ffeb6286a73b211a07c) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:41.552875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7b325-b4cf-4856-93a0-2cb02ced6538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:41.553096 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 106/207] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:44:41 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:41.556041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7b325-b4cf-4856-93a0-2cb02ced6538 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:41.567621 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 102/208] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:41 2022] GET /identity/v3/role_assignments?user.id=522811f1ed184ffeb6286a73b211a07c&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=25dd37ef41a046b1b26386c2672249fe => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:43.714686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372cd2-1009-4ed2-b020-4a8272b18e28 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:43.715258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372cd2-1009-4ed2-b020-4a8272b18e28 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:43.715258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372cd2-1009-4ed2-b020-4a8272b18e28 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:43.716566 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 107/209] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:43.723481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4baf-9f46-4dfd-87c1-9a79b755a41c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:43.723948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4baf-9f46-4dfd-87c1-9a79b755a41c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:43.724024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4baf-9f46-4dfd-87c1-9a79b755a41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:43.744023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-41ec4baf-9f46-4dfd-87c1-9a79b755a41c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:43.745225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-41ec4baf-9f46-4dfd-87c1-9a79b755a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:43.825541 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 103/210] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:44:43.830629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d905f46-9446-47d0-a3cd-f9ff077f8fd1 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:43.830629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d905f46-9446-47d0-a3cd-f9ff077f8fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:43.830629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d905f46-9446-47d0-a3cd-f9ff077f8fd1 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:43.830629 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 108/211] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:43.835670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475cde-ad10-4abf-b7d6-23d1ae8410a7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:43.836311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475cde-ad10-4abf-b7d6-23d1ae8410a7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:43.836792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475cde-ad10-4abf-b7d6-23d1ae8410a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:43.857325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e6475cde-ad10-4abf-b7d6-23d1ae8410a7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:43.858867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e6475cde-ad10-4abf-b7d6-23d1ae8410a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:43.931429 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 104/212] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:43.943695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01886a-0122-4aee-b116-88da9502c77c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:43.944251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01886a-0122-4aee-b116-88da9502c77c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:43.944534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01886a-0122-4aee-b116-88da9502c77c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:43.945368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2c11-5dde-47e7-8724-f91f837097ca None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:43.945665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2c11-5dde-47e7-8724-f91f837097ca None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:43.945873 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 109/213] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:43.945966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2c11-5dde-47e7-8724-f91f837097ca None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:43.947268 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 105/214] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:43.951458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61310-0a43-471b-ad16-39e7f0cc7d8f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:43.951751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61310-0a43-471b-ad16-39e7f0cc7d8f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:43.952027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61310-0a43-471b-ad16-39e7f0cc7d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:43.952416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa1c2-2cfd-495b-9c4a-5bf5dd8e89da None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:43.952703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa1c2-2cfd-495b-9c4a-5bf5dd8e89da None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:43.952984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa1c2-2cfd-495b-9c4a-5bf5dd8e89da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:43.972463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-52eaa1c2-2cfd-495b-9c4a-5bf5dd8e89da None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:43.973620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-52eaa1c2-2cfd-495b-9c4a-5bf5dd8e89da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:43.983676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-08f61310-0a43-471b-ad16-39e7f0cc7d8f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:43.986301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-08f61310-0a43-471b-ad16-39e7f0cc7d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:44.005193 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:44.038584 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:44.054524 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 106/215] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:44.068307 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 110/216] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:44.122234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaa1c2-2cfd-495b-9c4a-5bf5dd8e89da None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:44.206941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f61310-0a43-471b-ad16-39e7f0cc7d8f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:44.228575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaa1c2-2cfd-495b-9c4a-5bf5dd8e89da None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:44.275763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8fe48-7bae-44d2-9f04-4fe7c4ba9194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:44.276648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fe48-7bae-44d2-9f04-4fe7c4ba9194 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:44.277348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fe48-7bae-44d2-9f04-4fe7c4ba9194 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:44.277681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fe48-7bae-44d2-9f04-4fe7c4ba9194 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:44.292201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8fe48-7bae-44d2-9f04-4fe7c4ba9194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-1ec8fe48-7bae-44d2-9f04-4fe7c4ba9194 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:44.299970 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:44.300855 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:44.301648 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:44.302265 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 107/217] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:44.308597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8fe48-7bae-44d2-9f04-4fe7c4ba9194 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:44.326234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f61310-0a43-471b-ad16-39e7f0cc7d8f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:44.337147 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:44.363017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff995e-7830-43c0-9379-83754b2ca767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:44.363654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff995e-7830-43c0-9379-83754b2ca767 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:44.363931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff995e-7830-43c0-9379-83754b2ca767 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:44.364214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff995e-7830-43c0-9379-83754b2ca767 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:44.374422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff995e-7830-43c0-9379-83754b2ca767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-09ff995e-7830-43c0-9379-83754b2ca767 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:44.379725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:44.380671 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 111/218] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:44:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:44:44.381644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff995e-7830-43c0-9379-83754b2ca767 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:44.423515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8fe48-7bae-44d2-9f04-4fe7c4ba9194 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:44.426044 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:44.456919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b9250-9494-4048-aac2-b2fa61fd410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:44.457519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b9250-9494-4048-aac2-b2fa61fd410a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:44.457796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b9250-9494-4048-aac2-b2fa61fd410a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:44.458066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b9250-9494-4048-aac2-b2fa61fd410a None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:44.458768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b9250-9494-4048-aac2-b2fa61fd410a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:44.459066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b9250-9494-4048-aac2-b2fa61fd410a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:44.460427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b9250-9494-4048-aac2-b2fa61fd410a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:44.468157 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 108/219] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:44.468945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b9250-9494-4048-aac2-b2fa61fd410a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:44.485394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff995e-7830-43c0-9379-83754b2ca767 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:44.520069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4c321-cf26-4686-859d-8272d59e601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:44.520921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4c321-cf26-4686-859d-8272d59e601a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:44.521202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4c321-cf26-4686-859d-8272d59e601a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:44.521480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4c321-cf26-4686-859d-8272d59e601a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:44.522590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4c321-cf26-4686-859d-8272d59e601a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:44.524086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4c321-cf26-4686-859d-8272d59e601a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:44.525644 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 112/220] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:44.526406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4c321-cf26-4686-859d-8272d59e601a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:44.551306 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:44.566890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b9250-9494-4048-aac2-b2fa61fd410a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:44.599353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107893d-1b26-43f7-a27e-66114ac13689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:44.599970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107893d-1b26-43f7-a27e-66114ac13689 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:44.600245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107893d-1b26-43f7-a27e-66114ac13689 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:44.600514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107893d-1b26-43f7-a27e-66114ac13689 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:44.610518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107893d-1b26-43f7-a27e-66114ac13689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-8107893d-1b26-43f7-a27e-66114ac13689 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:44.616469 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:44.617352 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:44.618148 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 109/221] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:44.618828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107893d-1b26-43f7-a27e-66114ac13689 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:44.627014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4c321-cf26-4686-859d-8272d59e601a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:44.637456 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:44.661595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b269f-d5f3-4b0a-8fc7-d8e81f2c06ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:44.662199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b269f-d5f3-4b0a-8fc7-d8e81f2c06ff None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:44.662478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b269f-d5f3-4b0a-8fc7-d8e81f2c06ff None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:44.662777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b269f-d5f3-4b0a-8fc7-d8e81f2c06ff None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:44.663445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b269f-d5f3-4b0a-8fc7-d8e81f2c06ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:44.663747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b269f-d5f3-4b0a-8fc7-d8e81f2c06ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:44.665128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b269f-d5f3-4b0a-8fc7-d8e81f2c06ff None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:44.673402 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 113/222] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:44:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:44.674004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b269f-d5f3-4b0a-8fc7-d8e81f2c06ff None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:44.718769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107893d-1b26-43f7-a27e-66114ac13689 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:44.751701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53be05-c0f9-4b82-b8c5-e5c92e4d6ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:44.752318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53be05-c0f9-4b82-b8c5-e5c92e4d6ecb None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:44.752518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53be05-c0f9-4b82-b8c5-e5c92e4d6ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:44.752790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53be05-c0f9-4b82-b8c5-e5c92e4d6ecb None admin] PATH_INFO: `/v3/users/522811f1ed184ffeb6286a73b211a07c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:44.753893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53be05-c0f9-4b82-b8c5-e5c92e4d6ecb None admin] RBAC: Authorizing `identity:get_user(user_id=522811f1ed184ffeb6286a73b211a07c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:44.755357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53be05-c0f9-4b82-b8c5-e5c92e4d6ecb None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:44.757058 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 110/223] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:44 2022] GET /identity/v3/users/522811f1ed184ffeb6286a73b211a07c => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:44.757633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53be05-c0f9-4b82-b8c5-e5c92e4d6ecb None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:44.771990 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:44.780164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b269f-d5f3-4b0a-8fc7-d8e81f2c06ff None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:44.814355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6a738-7f19-4d6b-aaf3-2b17e7e7f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:44.814991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6a738-7f19-4d6b-aaf3-2b17e7e7f868 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:44.815271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6a738-7f19-4d6b-aaf3-2b17e7e7f868 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:44.815539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6a738-7f19-4d6b-aaf3-2b17e7e7f868 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:44.816185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6a738-7f19-4d6b-aaf3-2b17e7e7f868 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:44.817702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6a738-7f19-4d6b-aaf3-2b17e7e7f868 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:44.838462 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 114/224] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:44:44 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:44.839301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6a738-7f19-4d6b-aaf3-2b17e7e7f868 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:44.866846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53be05-c0f9-4b82-b8c5-e5c92e4d6ecb None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:44.872916 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:44.908808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685527f-d50b-40a2-bcd5-b8a4a51787df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:44.909439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685527f-d50b-40a2-bcd5-b8a4a51787df None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:44.909733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685527f-d50b-40a2-bcd5-b8a4a51787df None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:44.910011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685527f-d50b-40a2-bcd5-b8a4a51787df None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:44.910728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685527f-d50b-40a2-bcd5-b8a4a51787df None admin] RBAC: Adding query filter params (name=member) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:44.911040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685527f-d50b-40a2-bcd5-b8a4a51787df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:44.912466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685527f-d50b-40a2-bcd5-b8a4a51787df None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:44.921573 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 111/225] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:44.923198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685527f-d50b-40a2-bcd5-b8a4a51787df None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:44.971915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6a738-7f19-4d6b-aaf3-2b17e7e7f868 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:45.012001 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:45.013550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39038dc0-e04a-4e24-bbfb-e328bd1ccd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:45.014719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038dc0-e04a-4e24-bbfb-e328bd1ccd69 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:45.014719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038dc0-e04a-4e24-bbfb-e328bd1ccd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:45.014719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038dc0-e04a-4e24-bbfb-e328bd1ccd69 None admin] PATH_INFO: `/v3/users/522811f1ed184ffeb6286a73b211a07c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:45.016432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39038dc0-e04a-4e24-bbfb-e328bd1ccd69 None admin] RBAC: Authorizing `identity:get_user(user_id=522811f1ed184ffeb6286a73b211a07c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:45.019018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39038dc0-e04a-4e24-bbfb-e328bd1ccd69 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:45.019789 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 115/226] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:44 2022] GET /identity/v3/users/522811f1ed184ffeb6286a73b211a07c => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:45.024513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39038dc0-e04a-4e24-bbfb-e328bd1ccd69 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:45.047036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685527f-d50b-40a2-bcd5-b8a4a51787df None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:45.084752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe1676-6caf-4c81-839d-e993b76381c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:45.085402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe1676-6caf-4c81-839d-e993b76381c2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:45.085678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe1676-6caf-4c81-839d-e993b76381c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:45.085935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe1676-6caf-4c81-839d-e993b76381c2 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:45.087262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe1676-6caf-4c81-839d-e993b76381c2 None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:45.088837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe1676-6caf-4c81-839d-e993b76381c2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:45.092503 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 112/227] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:44 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:45.092503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe1676-6caf-4c81-839d-e993b76381c2 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:45.126168 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:45.136544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39038dc0-e04a-4e24-bbfb-e328bd1ccd69 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:45.175504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cec16-e51d-49e5-b15f-68101fa6460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:45.176290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cec16-e51d-49e5-b15f-68101fa6460d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:45.176665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cec16-e51d-49e5-b15f-68101fa6460d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:45.177031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cec16-e51d-49e5-b15f-68101fa6460d None admin] PATH_INFO: `/v3/users/aed80b4f90ec4eb8b9a444c59693a512` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:45.195970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cec16-e51d-49e5-b15f-68101fa6460d None admin] RBAC: Authorizing `identity:get_user(user_id=aed80b4f90ec4eb8b9a444c59693a512)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:45.196264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cec16-e51d-49e5-b15f-68101fa6460d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:45.198309 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 116/228] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:45 2022] GET /identity/v3/users/aed80b4f90ec4eb8b9a444c59693a512 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:45.199153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cec16-e51d-49e5-b15f-68101fa6460d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:45.232606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe1676-6caf-4c81-839d-e993b76381c2 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:45.278578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba514ff-a028-4bf7-8c28-4a3c58bccade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:45.279431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba514ff-a028-4bf7-8c28-4a3c58bccade None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:45.279717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba514ff-a028-4bf7-8c28-4a3c58bccade None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:45.279994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba514ff-a028-4bf7-8c28-4a3c58bccade None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:45.281120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba514ff-a028-4bf7-8c28-4a3c58bccade None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:45.283132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba514ff-a028-4bf7-8c28-4a3c58bccade None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:45.285820 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 113/229] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:45 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:45.286662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba514ff-a028-4bf7-8c28-4a3c58bccade None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:45.308965 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:45.329121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cec16-e51d-49e5-b15f-68101fa6460d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:45.367743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62971dda-3d03-4125-85db-6a3c632c7a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:45.368382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62971dda-3d03-4125-85db-6a3c632c7a07 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:45.368708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62971dda-3d03-4125-85db-6a3c632c7a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:45.368983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62971dda-3d03-4125-85db-6a3c632c7a07 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/users/522811f1ed184ffeb6286a73b211a07c/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:45.371716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62971dda-3d03-4125-85db-6a3c632c7a07 None admin] RBAC: Authorizing `identity:create_grant(project_id=d73af77d824e4885afc5f1e9a8cdf3af, user_id=522811f1ed184ffeb6286a73b211a07c, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:45.372737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62971dda-3d03-4125-85db-6a3c632c7a07 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:45.388150 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 117/230] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:45 2022] PUT /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/users/522811f1ed184ffeb6286a73b211a07c/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:45.395573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62971dda-3d03-4125-85db-6a3c632c7a07 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:45.404173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba514ff-a028-4bf7-8c28-4a3c58bccade None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:45.428660 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:45.442100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a41995-449b-4a37-bf59-5a29b1153780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:45.443324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a41995-449b-4a37-bf59-5a29b1153780 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:45.443723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a41995-449b-4a37-bf59-5a29b1153780 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:45.444131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a41995-449b-4a37-bf59-5a29b1153780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:45.519777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a41995-449b-4a37-bf59-5a29b1153780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:45.521437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a41995-449b-4a37-bf59-5a29b1153780 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:45.534343 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:45.634639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62971dda-3d03-4125-85db-6a3c632c7a07 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:45.711269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7709-4bf0-4187-a9ee-4d214d8e4cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:45.712138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7709-4bf0-4187-a9ee-4d214d8e4cef None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:45.713335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7709-4bf0-4187-a9ee-4d214d8e4cef None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:45.713335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7709-4bf0-4187-a9ee-4d214d8e4cef None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/users/522811f1ed184ffeb6286a73b211a07c/roles/25dd37ef41a046b1b26386c2672249fe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:45.716822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de7709-4bf0-4187-a9ee-4d214d8e4cef None admin] RBAC: Authorizing `identity:create_grant(project_id=d73af77d824e4885afc5f1e9a8cdf3af, user_id=522811f1ed184ffeb6286a73b211a07c, role_id=25dd37ef41a046b1b26386c2672249fe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:45.718314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de7709-4bf0-4187-a9ee-4d214d8e4cef None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:45.745158 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 118/231] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:45 2022] PUT /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/users/522811f1ed184ffeb6286a73b211a07c/roles/25dd37ef41a046b1b26386c2672249fe => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:45.787889 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 114/232] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:45.794033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7709-4bf0-4187-a9ee-4d214d8e4cef None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:45.940351 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:45.993165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7709-4bf0-4187-a9ee-4d214d8e4cef None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:46.057589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3dc8b-d5b6-4c25-b447-4c4b98c551cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:46.058167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3dc8b-d5b6-4c25-b447-4c4b98c551cd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:46.058453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3dc8b-d5b6-4c25-b447-4c4b98c551cd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:46.058758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3dc8b-d5b6-4c25-b447-4c4b98c551cd None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:46.059916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3dc8b-d5b6-4c25-b447-4c4b98c551cd None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:46.068343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3dc8b-d5b6-4c25-b447-4c4b98c551cd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:46.070530 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 119/233] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:45 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:46.080052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a41995-449b-4a37-bf59-5a29b1153780 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:46.248504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a41995-449b-4a37-bf59-5a29b1153780 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:46.261479 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:46.301824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad8ec0-a402-4610-b228-fea8291cac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:46.304435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad8ec0-a402-4610-b228-fea8291cac9b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:46.304723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad8ec0-a402-4610-b228-fea8291cac9b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:46.305004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad8ec0-a402-4610-b228-fea8291cac9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:46.305745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad8ec0-a402-4610-b228-fea8291cac9b None admin] RBAC: Adding query filter params (role.id=beb2c562d1d14ef599b41dd5788b6e4d, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af, user.id=aed80b4f90ec4eb8b9a444c59693a512) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:46.306053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad8ec0-a402-4610-b228-fea8291cac9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:46.307568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad8ec0-a402-4610-b228-fea8291cac9b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:46.316712 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 115/234] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:46 2022] GET /identity/v3/role_assignments?user.id=aed80b4f90ec4eb8b9a444c59693a512&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:47.536803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc453-841c-4593-a2ed-0b428fe3eced None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:47.537326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc453-841c-4593-a2ed-0b428fe3eced None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:47.537326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc453-841c-4593-a2ed-0b428fe3eced None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:47.538839 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 120/235] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:47.544594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c049-fb36-49b3-8c2e-c306fbc73b61 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:47.545120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c049-fb36-49b3-8c2e-c306fbc73b61 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:47.545120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c049-fb36-49b3-8c2e-c306fbc73b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:47.565929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f0e9c049-fb36-49b3-8c2e-c306fbc73b61 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:47.567195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f0e9c049-fb36-49b3-8c2e-c306fbc73b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:47.644829 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 116/236] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:44:47.813480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b92aa-63f6-4b9b-a81f-669fd511de3d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:47.813769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b92aa-63f6-4b9b-a81f-669fd511de3d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:47.814011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b92aa-63f6-4b9b-a81f-669fd511de3d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:47.815605 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 121/237] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:47.820996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e017a85-6e6a-4d59-8131-23d2749b00fb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:47.821285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e017a85-6e6a-4d59-8131-23d2749b00fb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:47.821560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e017a85-6e6a-4d59-8131-23d2749b00fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:47.842548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1e017a85-6e6a-4d59-8131-23d2749b00fb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:47.843809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1e017a85-6e6a-4d59-8131-23d2749b00fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:47.928836 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 117/238] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:48.000850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b92aa-63f6-4b9b-a81f-669fd511de3d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:48.120101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b92aa-63f6-4b9b-a81f-669fd511de3d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:48.166789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2eec3-8a62-4a6f-92b8-63950b342428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:48.167425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2eec3-8a62-4a6f-92b8-63950b342428 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:48.167707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2eec3-8a62-4a6f-92b8-63950b342428 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:48.167979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2eec3-8a62-4a6f-92b8-63950b342428 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:48.178825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2eec3-8a62-4a6f-92b8-63950b342428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-07a2eec3-8a62-4a6f-92b8-63950b342428 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:48.183899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:48.184779 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:48.185565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:48.189328 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 122/239] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:48.191838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e017a85-6e6a-4d59-8131-23d2749b00fb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:48.218742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4426c-ec07-4124-8c9d-0a5acaed200c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:48.219127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4426c-ec07-4124-8c9d-0a5acaed200c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:48.219615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4426c-ec07-4124-8c9d-0a5acaed200c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:48.220955 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 123/240] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:48.226184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90abab-ab2e-4669-8ba7-d1f1c4fee062 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:48.226473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90abab-ab2e-4669-8ba7-d1f1c4fee062 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:48.226789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90abab-ab2e-4669-8ba7-d1f1c4fee062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:48.236340 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:48.245497 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:48.245638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-be90abab-ab2e-4669-8ba7-d1f1c4fee062 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:48.246942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be90abab-ab2e-4669-8ba7-d1f1c4fee062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:48.362831 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 124/241] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:44:48.372186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e017a85-6e6a-4d59-8131-23d2749b00fb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:48.392066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90abab-ab2e-4669-8ba7-d1f1c4fee062 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:48.443788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05017f6-b2a7-4a0c-8046-88cfee1dc53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:48.444419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05017f6-b2a7-4a0c-8046-88cfee1dc53f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:48.444698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05017f6-b2a7-4a0c-8046-88cfee1dc53f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:48.444968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05017f6-b2a7-4a0c-8046-88cfee1dc53f None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:48.445637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05017f6-b2a7-4a0c-8046-88cfee1dc53f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:48.445940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05017f6-b2a7-4a0c-8046-88cfee1dc53f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:48.447333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05017f6-b2a7-4a0c-8046-88cfee1dc53f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:48.471254 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 118/242] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:48.474252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05017f6-b2a7-4a0c-8046-88cfee1dc53f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:48.598119 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:48.605370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90abab-ab2e-4669-8ba7-d1f1c4fee062 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:48.607192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05017f6-b2a7-4a0c-8046-88cfee1dc53f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:48.658424 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:48.665660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026173c-9f9a-4bcc-8a4b-d0bbfe81491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:48.666303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026173c-9f9a-4bcc-8a4b-d0bbfe81491e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:48.666585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026173c-9f9a-4bcc-8a4b-d0bbfe81491e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:48.667317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026173c-9f9a-4bcc-8a4b-d0bbfe81491e None admin] PATH_INFO: `/v3/users/b78533f17eb44b36b4e9ae957ce933dc` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:48.670391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85067-ada1-4929-950c-3259d869192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:48.671055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85067-ada1-4929-950c-3259d869192a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:48.671333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85067-ada1-4929-950c-3259d869192a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:48.671602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85067-ada1-4929-950c-3259d869192a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:48.674659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc85067-ada1-4929-950c-3259d869192a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:48.676187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc85067-ada1-4929-950c-3259d869192a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:48.678084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 125/243] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:48.682756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85067-ada1-4929-950c-3259d869192a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:48.692200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026173c-9f9a-4bcc-8a4b-d0bbfe81491e None admin] RBAC: Authorizing `identity:get_user(user_id=b78533f17eb44b36b4e9ae957ce933dc)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:48.693719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026173c-9f9a-4bcc-8a4b-d0bbfe81491e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:48.695630 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 119/244] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:48 2022] GET /identity/v3/users/b78533f17eb44b36b4e9ae957ce933dc => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:48.696433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026173c-9f9a-4bcc-8a4b-d0bbfe81491e None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:48.808983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85067-ada1-4929-950c-3259d869192a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:48.814533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026173c-9f9a-4bcc-8a4b-d0bbfe81491e None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:48.844885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d6d38-fbd5-46c9-a802-0d57b529f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:48.845513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6d38-fbd5-46c9-a802-0d57b529f1bc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:48.845789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6d38-fbd5-46c9-a802-0d57b529f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:48.846059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6d38-fbd5-46c9-a802-0d57b529f1bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:48.848987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c25ead-9882-4baf-b884-3d5153995655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:48.849601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25ead-9882-4baf-b884-3d5153995655 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:48.849878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25ead-9882-4baf-b884-3d5153995655 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:48.850146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25ead-9882-4baf-b884-3d5153995655 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:48.850837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c25ead-9882-4baf-b884-3d5153995655 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:48.852300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c25ead-9882-4baf-b884-3d5153995655 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:48.857052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d6d38-fbd5-46c9-a802-0d57b529f1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-816d6d38-fbd5-46c9-a802-0d57b529f1bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:48.863868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:48.864852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:48.865769 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 126/245] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:48.866447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d6d38-fbd5-46c9-a802-0d57b529f1bc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:48.884354 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 120/246] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:44:48 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:48.886648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7855de9-1500-4847-9468-f8ff586abee2 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:48.887565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7855de9-1500-4847-9468-f8ff586abee2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:48.888039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7855de9-1500-4847-9468-f8ff586abee2 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:48.889670 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 121/247] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:48.895480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7855de9-1500-4847-9468-f8ff586abee2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:48.912502 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:48.946307 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:49.002272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d6d38-fbd5-46c9-a802-0d57b529f1bc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:49.039950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97760d3e-0fbd-420a-abf1-1149eb31cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:49.040624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97760d3e-0fbd-420a-abf1-1149eb31cb90 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:49.040898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97760d3e-0fbd-420a-abf1-1149eb31cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:49.041172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97760d3e-0fbd-420a-abf1-1149eb31cb90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:49.051158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7855de9-1500-4847-9468-f8ff586abee2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:49.091126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7d855-1e4d-481e-b48e-12b3d9c9b6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:49.091749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7d855-1e4d-481e-b48e-12b3d9c9b6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:49.092071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7d855-1e4d-481e-b48e-12b3d9c9b6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:49.092354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7d855-1e4d-481e-b48e-12b3d9c9b6f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:49.093027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7d855-1e4d-481e-b48e-12b3d9c9b6f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:49.094690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7d855-1e4d-481e-b48e-12b3d9c9b6f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:49.095329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7d855-1e4d-481e-b48e-12b3d9c9b6f4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:49.105660 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 122/248] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:49.107123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c29ad8-70bd-44d7-b284-74cc2e331531 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:49.107763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c29ad8-70bd-44d7-b284-74cc2e331531 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:49.108047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c29ad8-70bd-44d7-b284-74cc2e331531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:49.122711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97760d3e-0fbd-420a-abf1-1149eb31cb90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:49.124212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97760d3e-0fbd-420a-abf1-1149eb31cb90 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:49.128132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-89c29ad8-70bd-44d7-b284-74cc2e331531 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:49.129570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-89c29ad8-70bd-44d7-b284-74cc2e331531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:49.200049 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:49.210887 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 123/249] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:49.212902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c091-7257-4bc2-a6c0-6d10e71efd80 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:49.213242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c091-7257-4bc2-a6c0-6d10e71efd80 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:49.213581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c091-7257-4bc2-a6c0-6d10e71efd80 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:49.215497 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 124/250] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:49.216284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079c091-7257-4bc2-a6c0-6d10e71efd80 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:49.220739 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:49.261093 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 127/251] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:49.264257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d987-18c3-4fc8-b613-3e6f5958bdb6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:49.264801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d987-18c3-4fc8-b613-3e6f5958bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:49.265269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d987-18c3-4fc8-b613-3e6f5958bdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:49.288168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8080d987-18c3-4fc8-b613-3e6f5958bdb6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:49.291048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8080d987-18c3-4fc8-b613-3e6f5958bdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:49.357810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079c091-7257-4bc2-a6c0-6d10e71efd80 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:49.371831 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 128/252] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:49.373025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080d987-18c3-4fc8-b613-3e6f5958bdb6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:49.397771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4515af-6380-4704-b0dc-f360f5afea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:49.398379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4515af-6380-4704-b0dc-f360f5afea22 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:49.398680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4515af-6380-4704-b0dc-f360f5afea22 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:49.398954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4515af-6380-4704-b0dc-f360f5afea22 None admin] PATH_INFO: `/v3/users/522811f1ed184ffeb6286a73b211a07c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:49.400339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4515af-6380-4704-b0dc-f360f5afea22 None admin] RBAC: Authorizing `identity:get_user(user_id=522811f1ed184ffeb6286a73b211a07c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:49.402494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4515af-6380-4704-b0dc-f360f5afea22 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:49.404393 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 125/253] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:49 2022] GET /identity/v3/users/522811f1ed184ffeb6286a73b211a07c => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:49.411543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4515af-6380-4704-b0dc-f360f5afea22 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:49.486033 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:49.497838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080d987-18c3-4fc8-b613-3e6f5958bdb6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:49.507826 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:49.547541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4515af-6380-4704-b0dc-f360f5afea22 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:49.548758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d721f0e-9376-4ed5-8985-db5280af921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:49.549843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d721f0e-9376-4ed5-8985-db5280af921a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:49.551315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d721f0e-9376-4ed5-8985-db5280af921a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:49.551798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d721f0e-9376-4ed5-8985-db5280af921a None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:49.553240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d721f0e-9376-4ed5-8985-db5280af921a None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:49.554947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d721f0e-9376-4ed5-8985-db5280af921a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:49.557475 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 129/254] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:49 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:49.563933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d721f0e-9376-4ed5-8985-db5280af921a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:49.592922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db6741-edd9-450a-95ee-eea00ecbd971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:49.593807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db6741-edd9-450a-95ee-eea00ecbd971 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:49.594174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db6741-edd9-450a-95ee-eea00ecbd971 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:49.594566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db6741-edd9-450a-95ee-eea00ecbd971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:49.681593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d721f0e-9376-4ed5-8985-db5280af921a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:49.700927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db6741-edd9-450a-95ee-eea00ecbd971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:49.702388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db6741-edd9-450a-95ee-eea00ecbd971 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:49.720505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b15c15-fd4d-4819-b5c7-d029127c1831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:49.721433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15c15-fd4d-4819-b5c7-d029127c1831 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:49.721912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15c15-fd4d-4819-b5c7-d029127c1831 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:49.722382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15c15-fd4d-4819-b5c7-d029127c1831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:49.723365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b15c15-fd4d-4819-b5c7-d029127c1831 None admin] RBAC: Adding query filter params (role.id=24d5a978aad041e5ac5f969daacd12c0, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af, user.id=b78533f17eb44b36b4e9ae957ce933dc) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:49.723876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b15c15-fd4d-4819-b5c7-d029127c1831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:49.725567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b15c15-fd4d-4819-b5c7-d029127c1831 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:49.731947 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 130/255] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:49 2022] GET /identity/v3/role_assignments?user.id=b78533f17eb44b36b4e9ae957ce933dc&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=24d5a978aad041e5ac5f969daacd12c0 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:49.732987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b15c15-fd4d-4819-b5c7-d029127c1831 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:49.778706 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:49.845742 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:49.886553 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 126/256] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:49.887445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db6741-edd9-450a-95ee-eea00ecbd971 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:49.925560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b15c15-fd4d-4819-b5c7-d029127c1831 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:50.004749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0db7b2-b677-474a-bdb1-5e05eef2bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:50.004967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db6741-edd9-450a-95ee-eea00ecbd971 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:50.005860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db7b2-b677-474a-bdb1-5e05eef2bc58 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:50.006332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db7b2-b677-474a-bdb1-5e05eef2bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:50.006835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db7b2-b677-474a-bdb1-5e05eef2bc58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:50.037287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0db7b2-b677-474a-bdb1-5e05eef2bc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1c0db7b2-b677-474a-bdb1-5e05eef2bc58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:50.043134 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:50.044014 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:44:50.044817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:50.049278 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 131/257] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:44:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:50.051724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0db7b2-b677-474a-bdb1-5e05eef2bc58 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:50.085140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188348e-29e6-4af2-af54-63609ee5c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:50.086119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188348e-29e6-4af2-af54-63609ee5c15d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:50.086687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188348e-29e6-4af2-af54-63609ee5c15d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:50.087149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188348e-29e6-4af2-af54-63609ee5c15d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:50.109628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188348e-29e6-4af2-af54-63609ee5c15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-7188348e-29e6-4af2-af54-63609ee5c15d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:50.115936 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:50.116794 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:50.117599 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:50.122859 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 127/258] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:50.135852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188348e-29e6-4af2-af54-63609ee5c15d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:50.194317 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:50.204934 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:50.244087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0db7b2-b677-474a-bdb1-5e05eef2bc58 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:50.303172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38554b5e-0638-476b-8831-0031d53cc82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:50.303717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554b5e-0638-476b-8831-0031d53cc82d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:50.303990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554b5e-0638-476b-8831-0031d53cc82d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:50.304258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554b5e-0638-476b-8831-0031d53cc82d None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:50.306380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38554b5e-0638-476b-8831-0031d53cc82d None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:50.307943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38554b5e-0638-476b-8831-0031d53cc82d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:50.310288 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 132/259] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:50 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:50.311100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38554b5e-0638-476b-8831-0031d53cc82d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:50.328923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188348e-29e6-4af2-af54-63609ee5c15d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:50.389032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e943fc5-b807-4e98-9f50-9564938f2283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:50.389643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e943fc5-b807-4e98-9f50-9564938f2283 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:50.389920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e943fc5-b807-4e98-9f50-9564938f2283 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:50.390238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e943fc5-b807-4e98-9f50-9564938f2283 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:50.390988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e943fc5-b807-4e98-9f50-9564938f2283 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:50.391315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e943fc5-b807-4e98-9f50-9564938f2283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:50.392768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e943fc5-b807-4e98-9f50-9564938f2283 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:50.400958 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 128/260] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:44:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:50.401757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e943fc5-b807-4e98-9f50-9564938f2283 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:50.495008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38554b5e-0638-476b-8831-0031d53cc82d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:50.560764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e26137-13b5-4f3b-9c4d-b3d1f2dd0dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:50.561305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e26137-13b5-4f3b-9c4d-b3d1f2dd0dfa None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:50.561580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e26137-13b5-4f3b-9c4d-b3d1f2dd0dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:50.561844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e26137-13b5-4f3b-9c4d-b3d1f2dd0dfa None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:50.562829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e26137-13b5-4f3b-9c4d-b3d1f2dd0dfa None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:50.563849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e26137-13b5-4f3b-9c4d-b3d1f2dd0dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:50.565253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e26137-13b5-4f3b-9c4d-b3d1f2dd0dfa None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:50.566960 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:50.572335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e943fc5-b807-4e98-9f50-9564938f2283 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:50.584737 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 133/261] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:50.585571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e26137-13b5-4f3b-9c4d-b3d1f2dd0dfa None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:50.614964 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:50.638116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ecb2-8371-4540-b47f-08ec424bb824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:50.638750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ecb2-8371-4540-b47f-08ec424bb824 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:50.639030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ecb2-8371-4540-b47f-08ec424bb824 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:50.639349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ecb2-8371-4540-b47f-08ec424bb824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:50.640080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3ecb2-8371-4540-b47f-08ec424bb824 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af, user.id=522811f1ed184ffeb6286a73b211a07c) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:50.640488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3ecb2-8371-4540-b47f-08ec424bb824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:50.641921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3ecb2-8371-4540-b47f-08ec424bb824 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:50.658225 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 129/262] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:50 2022] GET /identity/v3/role_assignments?user.id=522811f1ed184ffeb6286a73b211a07c&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:50.659197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ecb2-8371-4540-b47f-08ec424bb824 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:50.777351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e26137-13b5-4f3b-9c4d-b3d1f2dd0dfa None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:50.845324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ecb2-8371-4540-b47f-08ec424bb824 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:50.849776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167ab10-445a-4aeb-90ba-ab5a9b3d13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:50.850417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ab10-445a-4aeb-90ba-ab5a9b3d13e3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:50.850724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ab10-445a-4aeb-90ba-ab5a9b3d13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:50.850996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ab10-445a-4aeb-90ba-ab5a9b3d13e3 None admin] PATH_INFO: `/v3/users/522811f1ed184ffeb6286a73b211a07c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:50.855266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167ab10-445a-4aeb-90ba-ab5a9b3d13e3 None admin] RBAC: Authorizing `identity:get_user(user_id=522811f1ed184ffeb6286a73b211a07c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:50.856828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167ab10-445a-4aeb-90ba-ab5a9b3d13e3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:50.860217 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 134/263] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:50 2022] GET /identity/v3/users/522811f1ed184ffeb6286a73b211a07c => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:50.865870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167ab10-445a-4aeb-90ba-ab5a9b3d13e3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:50.936255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0736b-335d-4b30-bd7d-10cd7edd18e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:50.936915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0736b-335d-4b30-bd7d-10cd7edd18e5 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:50.937281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0736b-335d-4b30-bd7d-10cd7edd18e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:50.937555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0736b-335d-4b30-bd7d-10cd7edd18e5 None admin] PATH_INFO: `/v3/users/aed80b4f90ec4eb8b9a444c59693a512` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:50.943433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0736b-335d-4b30-bd7d-10cd7edd18e5 None admin] RBAC: Authorizing `identity:get_user(user_id=aed80b4f90ec4eb8b9a444c59693a512)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:50.944918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0736b-335d-4b30-bd7d-10cd7edd18e5 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:50.946627 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 130/264] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:50 2022] GET /identity/v3/users/aed80b4f90ec4eb8b9a444c59693a512 => generated 297 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:50.955917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0736b-335d-4b30-bd7d-10cd7edd18e5 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:50.982873 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:51.022938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167ab10-445a-4aeb-90ba-ab5a9b3d13e3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:51.035938 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:51.101701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922edbac-5f82-40a2-8deb-8f5789061beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:51.102587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922edbac-5f82-40a2-8deb-8f5789061beb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:51.103022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922edbac-5f82-40a2-8deb-8f5789061beb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:51.103675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922edbac-5f82-40a2-8deb-8f5789061beb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:51.168500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0736b-335d-4b30-bd7d-10cd7edd18e5 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:51.211245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922edbac-5f82-40a2-8deb-8f5789061beb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:51.213042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922edbac-5f82-40a2-8deb-8f5789061beb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:51.247495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee491f-587c-4aa1-b69a-c01d5e4ac2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:51.248465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee491f-587c-4aa1-b69a-c01d5e4ac2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:51.248883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee491f-587c-4aa1-b69a-c01d5e4ac2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:51.249334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee491f-587c-4aa1-b69a-c01d5e4ac2b5 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:51.251916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee491f-587c-4aa1-b69a-c01d5e4ac2b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:51.253501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee491f-587c-4aa1-b69a-c01d5e4ac2b5 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:51.258410 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 131/265] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:50 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:51.263407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee491f-587c-4aa1-b69a-c01d5e4ac2b5 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:51.359719 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:51.395813 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 135/266] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:51.402731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922edbac-5f82-40a2-8deb-8f5789061beb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:51.412497 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:51.428005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee491f-587c-4aa1-b69a-c01d5e4ac2b5 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:51.465848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46121d83-e1fa-4456-8af9-087e69106bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:51.466507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121d83-e1fa-4456-8af9-087e69106bb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:51.466812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121d83-e1fa-4456-8af9-087e69106bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:51.467083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121d83-e1fa-4456-8af9-087e69106bb0 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/users/aed80b4f90ec4eb8b9a444c59693a512/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:51.469140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46121d83-e1fa-4456-8af9-087e69106bb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d73af77d824e4885afc5f1e9a8cdf3af, user_id=aed80b4f90ec4eb8b9a444c59693a512, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:51.470618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46121d83-e1fa-4456-8af9-087e69106bb0 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:51.489452 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 132/267] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:51 2022] PUT /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/users/aed80b4f90ec4eb8b9a444c59693a512/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:51.589311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922edbac-5f82-40a2-8deb-8f5789061beb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:51.645912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644ff34-fecb-43a1-a63b-6e4e5a7dbd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:51.646481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644ff34-fecb-43a1-a63b-6e4e5a7dbd33 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:51.646796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644ff34-fecb-43a1-a63b-6e4e5a7dbd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:51.647066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644ff34-fecb-43a1-a63b-6e4e5a7dbd33 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:51.648280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644ff34-fecb-43a1-a63b-6e4e5a7dbd33 None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:51.649769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644ff34-fecb-43a1-a63b-6e4e5a7dbd33 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:51.651768 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 136/268] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:51 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:51.658365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46121d83-e1fa-4456-8af9-087e69106bb0 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:51.800030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46121d83-e1fa-4456-8af9-087e69106bb0 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:51.841482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53ff99-b760-4c77-9e8b-805c3800a3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:51.842457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53ff99-b760-4c77-9e8b-805c3800a3ee None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:51.842959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53ff99-b760-4c77-9e8b-805c3800a3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:51.843904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53ff99-b760-4c77-9e8b-805c3800a3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:51.844846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53ff99-b760-4c77-9e8b-805c3800a3ee None admin] RBAC: Adding query filter params (role.id=25dd37ef41a046b1b26386c2672249fe, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af, user.id=522811f1ed184ffeb6286a73b211a07c) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:51.845353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53ff99-b760-4c77-9e8b-805c3800a3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:51.847551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53ff99-b760-4c77-9e8b-805c3800a3ee None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:51.859785 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 133/269] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:51 2022] GET /identity/v3/role_assignments?user.id=522811f1ed184ffeb6286a73b211a07c&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=25dd37ef41a046b1b26386c2672249fe => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:52.100903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586207-2171-462b-b72b-d9a9eeb10160 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:52.101408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586207-2171-462b-b72b-d9a9eeb10160 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:52.101512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586207-2171-462b-b72b-d9a9eeb10160 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:52.103227 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 137/270] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:52.108431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34694-d28f-4b8b-a357-25973b6b15a4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:52.108772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34694-d28f-4b8b-a357-25973b6b15a4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:52.109315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34694-d28f-4b8b-a357-25973b6b15a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:52.120109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfc5e3-94cf-44eb-b058-3784771d9590 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:52.120426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfc5e3-94cf-44eb-b058-3784771d9590 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:52.120663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfc5e3-94cf-44eb-b058-3784771d9590 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:52.122196 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 138/271] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:52.128775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33590-ddc0-4e96-be4c-fd3f508aba6a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:52.129086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33590-ddc0-4e96-be4c-fd3f508aba6a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:52.129364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33590-ddc0-4e96-be4c-fd3f508aba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:52.134009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d4d34694-d28f-4b8b-a357-25973b6b15a4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:52.135384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d4d34694-d28f-4b8b-a357-25973b6b15a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:52.148876 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:52.155016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a8c33590-ddc0-4e96-be4c-fd3f508aba6a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:52.156368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a8c33590-ddc0-4e96-be4c-fd3f508aba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:52.207286 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:52.228602 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 134/272] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:52.236196 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 139/273] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:52.270120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948afb3-bac0-4721-afb9-25fc75c1bc60 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:52.270431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948afb3-bac0-4721-afb9-25fc75c1bc60 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:52.270742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948afb3-bac0-4721-afb9-25fc75c1bc60 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:52.272371 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 135/274] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:52.277286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffce3ec-148a-482a-865b-f90014dbc404 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:52.277573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffce3ec-148a-482a-865b-f90014dbc404 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:52.277848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffce3ec-148a-482a-865b-f90014dbc404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:52.301066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fffce3ec-148a-482a-865b-f90014dbc404 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:52.302247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fffce3ec-148a-482a-865b-f90014dbc404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:52.381404 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 140/275] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:52.526470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948afb3-bac0-4721-afb9-25fc75c1bc60 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:52.536597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffce3ec-148a-482a-865b-f90014dbc404 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:52.649056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffce3ec-148a-482a-865b-f90014dbc404 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:52.657956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948afb3-bac0-4721-afb9-25fc75c1bc60 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:52.659837 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:52.690079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ca2b3-8834-4663-8805-837b68584bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:52.691528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ca2b3-8834-4663-8805-837b68584bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:52.692260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ca2b3-8834-4663-8805-837b68584bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:52.692888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ca2b3-8834-4663-8805-837b68584bb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:52.703415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e04e02-4608-4983-ab52-c96ad52c4866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:52.704201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e04e02-4608-4983-ab52-c96ad52c4866 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:52.704482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e04e02-4608-4983-ab52-c96ad52c4866 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:52.704753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e04e02-4608-4983-ab52-c96ad52c4866 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:52.705908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e04e02-4608-4983-ab52-c96ad52c4866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:52.707388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e04e02-4608-4983-ab52-c96ad52c4866 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:52.709233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ca2b3-8834-4663-8805-837b68584bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:52.709340 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 136/276] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:52.709767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e04e02-4608-4983-ab52-c96ad52c4866 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f57ca2b3-8834-4663-8805-837b68584bb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:52.716905 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:52.718996 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 141/277] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:44:52.720340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ca2b3-8834-4663-8805-837b68584bb1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:52.728032 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:52.824326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e04e02-4608-4983-ab52-c96ad52c4866 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:52.827123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ca2b3-8834-4663-8805-837b68584bb1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:52.859467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdcc11-373a-49c9-8ff2-5c8635ad8b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:52.860172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdcc11-373a-49c9-8ff2-5c8635ad8b48 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:52.860458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdcc11-373a-49c9-8ff2-5c8635ad8b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:52.860726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdcc11-373a-49c9-8ff2-5c8635ad8b48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:52.863420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac6d85-d6ad-40aa-ad83-47fbfd99f4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:52.864028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6d85-d6ad-40aa-ad83-47fbfd99f4ba None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:52.864307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6d85-d6ad-40aa-ad83-47fbfd99f4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:52.864577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6d85-d6ad-40aa-ad83-47fbfd99f4ba None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:52.865222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac6d85-d6ad-40aa-ad83-47fbfd99f4ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:52.866863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac6d85-d6ad-40aa-ad83-47fbfd99f4ba None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:52.871055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdcc11-373a-49c9-8ff2-5c8635ad8b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-bffdcc11-373a-49c9-8ff2-5c8635ad8b48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:52.876728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:52.877629 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:52.878426 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 137/278] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:52.879674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdcc11-373a-49c9-8ff2-5c8635ad8b48 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:52.906883 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 142/279] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:44:52 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:52.906883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac6d85-d6ad-40aa-ad83-47fbfd99f4ba None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:52.933534 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:53.002721 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:53.036544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac6d85-d6ad-40aa-ad83-47fbfd99f4ba None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:53.037628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdcc11-373a-49c9-8ff2-5c8635ad8b48 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:53.077048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed5189-51c1-4e69-b74a-b6b541f506db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:53.078268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed5189-51c1-4e69-b74a-b6b541f506db None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:53.078508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed5189-51c1-4e69-b74a-b6b541f506db None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:53.078845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed5189-51c1-4e69-b74a-b6b541f506db None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:53.079537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed5189-51c1-4e69-b74a-b6b541f506db None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:53.079845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed5189-51c1-4e69-b74a-b6b541f506db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:53.081258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed5189-51c1-4e69-b74a-b6b541f506db None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:53.082073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7af657-1da4-40ee-aba2-308ba38b92ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:53.083076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af657-1da4-40ee-aba2-308ba38b92ef None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:53.083553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af657-1da4-40ee-aba2-308ba38b92ef None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:53.084060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af657-1da4-40ee-aba2-308ba38b92ef None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:53.084931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7af657-1da4-40ee-aba2-308ba38b92ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:53.085452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7af657-1da4-40ee-aba2-308ba38b92ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:53.087180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7af657-1da4-40ee-aba2-308ba38b92ef None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:53.096263 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 143/280] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:53.097708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed5189-51c1-4e69-b74a-b6b541f506db None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:53.105681 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 138/281] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:53.106734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7af657-1da4-40ee-aba2-308ba38b92ef None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:53.214372 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:53.231546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed5189-51c1-4e69-b74a-b6b541f506db None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:53.244729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7af657-1da4-40ee-aba2-308ba38b92ef None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:53.281393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38f36-7349-4f34-a2a9-0e0179e39c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:53.282789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38f36-7349-4f34-a2a9-0e0179e39c9f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:53.282789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38f36-7349-4f34-a2a9-0e0179e39c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:53.282953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38f36-7349-4f34-a2a9-0e0179e39c9f None admin] PATH_INFO: `/v3/users/b78533f17eb44b36b4e9ae957ce933dc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:53.284399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd38f36-7349-4f34-a2a9-0e0179e39c9f None admin] RBAC: Authorizing `identity:get_user(user_id=b78533f17eb44b36b4e9ae957ce933dc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:53.285974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd38f36-7349-4f34-a2a9-0e0179e39c9f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:53.287853 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 144/282] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:53 2022] GET /identity/v3/users/b78533f17eb44b36b4e9ae957ce933dc => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:53.293713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38f36-7349-4f34-a2a9-0e0179e39c9f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:53.293849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85031834-ea2c-437a-b359-a6692cbe3ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:53.294491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85031834-ea2c-437a-b359-a6692cbe3ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:53.294798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85031834-ea2c-437a-b359-a6692cbe3ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:53.295074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85031834-ea2c-437a-b359-a6692cbe3ab7 None admin] PATH_INFO: `/v3/users/925866ecbb5c4a0ba93d2783b239d4aa` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:53.301055 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:53.316048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85031834-ea2c-437a-b359-a6692cbe3ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=925866ecbb5c4a0ba93d2783b239d4aa)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:53.317643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85031834-ea2c-437a-b359-a6692cbe3ab7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:53.320396 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 139/283] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:53 2022] GET /identity/v3/users/925866ecbb5c4a0ba93d2783b239d4aa => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:53.326396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85031834-ea2c-437a-b359-a6692cbe3ab7 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:53.434523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38f36-7349-4f34-a2a9-0e0179e39c9f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:53.457550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85031834-ea2c-437a-b359-a6692cbe3ab7 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:53.496037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abea62-5d51-493b-a37a-db02f7af4787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:53.497261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abea62-5d51-493b-a37a-db02f7af4787 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:53.498201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abea62-5d51-493b-a37a-db02f7af4787 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:53.498991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d741e4d-4720-43ee-9ac6-966a7d4b359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:53.500394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d741e4d-4720-43ee-9ac6-966a7d4b359f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:53.500827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abea62-5d51-493b-a37a-db02f7af4787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:53.501728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abea62-5d51-493b-a37a-db02f7af4787 None admin] RBAC: Adding query filter params (role.id=beb2c562d1d14ef599b41dd5788b6e4d, user.id=925866ecbb5c4a0ba93d2783b239d4aa, scope.system=all) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:53.502190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d741e4d-4720-43ee-9ac6-966a7d4b359f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:53.502643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d741e4d-4720-43ee-9ac6-966a7d4b359f None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:53.503621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abea62-5d51-493b-a37a-db02f7af4787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:53.505228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abea62-5d51-493b-a37a-db02f7af4787 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:53.506013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d741e4d-4720-43ee-9ac6-966a7d4b359f None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:53.507658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d741e4d-4720-43ee-9ac6-966a7d4b359f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:53.511008 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 145/284] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:53 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:53.516115 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 140/285] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 2 00:44:53 2022] GET /identity/v3/role_assignments?user.id=925866ecbb5c4a0ba93d2783b239d4aa&scope.system=all&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:53.521231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d741e4d-4720-43ee-9ac6-966a7d4b359f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:53.556457 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:53.662576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d741e4d-4720-43ee-9ac6-966a7d4b359f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:53.709490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f26e4-fc3a-4e82-9a1e-bbb2f493fc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:53.710448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f26e4-fc3a-4e82-9a1e-bbb2f493fc56 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:53.710935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f26e4-fc3a-4e82-9a1e-bbb2f493fc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:53.711377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f26e4-fc3a-4e82-9a1e-bbb2f493fc56 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/users/b78533f17eb44b36b4e9ae957ce933dc/roles/24d5a978aad041e5ac5f969daacd12c0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:53.713604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f26e4-fc3a-4e82-9a1e-bbb2f493fc56 None admin] RBAC: Authorizing `identity:create_grant(project_id=d73af77d824e4885afc5f1e9a8cdf3af, user_id=b78533f17eb44b36b4e9ae957ce933dc, role_id=24d5a978aad041e5ac5f969daacd12c0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:53.715268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f26e4-fc3a-4e82-9a1e-bbb2f493fc56 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:53.744154 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 146/286] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:44:53 2022] PUT /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/users/b78533f17eb44b36b4e9ae957ce933dc/roles/24d5a978aad041e5ac5f969daacd12c0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:54.147802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af75ce-4d9e-4af1-9cb4-ff4e3da2575b None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:54.148752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af75ce-4d9e-4af1-9cb4-ff4e3da2575b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:54.149203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af75ce-4d9e-4af1-9cb4-ff4e3da2575b None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:54.150836 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 141/287] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:54.158960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9658b-a381-4952-bc9c-c0895dcec2ce None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:54.159533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9658b-a381-4952-bc9c-c0895dcec2ce None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:54.159983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9658b-a381-4952-bc9c-c0895dcec2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:54.183089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-45c9658b-a381-4952-bc9c-c0895dcec2ce None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:54.184551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45c9658b-a381-4952-bc9c-c0895dcec2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:54.290375 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 147/288] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:54.677856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af75ce-4d9e-4af1-9cb4-ff4e3da2575b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:54.769417 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:54.821700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af75ce-4d9e-4af1-9cb4-ff4e3da2575b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:54.857881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f17b1-f86a-4b76-8441-0aca204d69f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:54.859697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f17b1-f86a-4b76-8441-0aca204d69f4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:54.859990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f17b1-f86a-4b76-8441-0aca204d69f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:54.860269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f17b1-f86a-4b76-8441-0aca204d69f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:54.870688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f17b1-f86a-4b76-8441-0aca204d69f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-208f17b1-f86a-4b76-8441-0aca204d69f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:54.876184 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:54.877036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:54.877900 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 142/289] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:54.883328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9658b-a381-4952-bc9c-c0895dcec2ce None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:54.913256 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:55.054315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9658b-a381-4952-bc9c-c0895dcec2ce None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:55.092552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0c52-1878-4de3-ae04-b7748b3ee38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:55.094014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0c52-1878-4de3-ae04-b7748b3ee38e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:55.094309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0c52-1878-4de3-ae04-b7748b3ee38e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:55.094588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0c52-1878-4de3-ae04-b7748b3ee38e None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:55.095306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0c52-1878-4de3-ae04-b7748b3ee38e None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:55.095615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0c52-1878-4de3-ae04-b7748b3ee38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:55.097098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0c52-1878-4de3-ae04-b7748b3ee38e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:55.106697 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 148/290] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:55.115982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f17b1-f86a-4b76-8441-0aca204d69f4 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:55.254375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f17b1-f86a-4b76-8441-0aca204d69f4 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:55.277714 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:55.305620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8399fde-e801-4289-8e3a-b419405e44bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:55.306254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8399fde-e801-4289-8e3a-b419405e44bd None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:55.306536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8399fde-e801-4289-8e3a-b419405e44bd None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:55.306836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8399fde-e801-4289-8e3a-b419405e44bd None admin] PATH_INFO: `/v3/users/aed80b4f90ec4eb8b9a444c59693a512` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:55.307989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8399fde-e801-4289-8e3a-b419405e44bd None admin] RBAC: Authorizing `identity:get_user(user_id=aed80b4f90ec4eb8b9a444c59693a512)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:55.309499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8399fde-e801-4289-8e3a-b419405e44bd None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:55.311439 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 143/291] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:55 2022] GET /identity/v3/users/aed80b4f90ec4eb8b9a444c59693a512 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:55.317355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0c52-1878-4de3-ae04-b7748b3ee38e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:55.422127 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:55.452902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0c52-1878-4de3-ae04-b7748b3ee38e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:55.497796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35778d5-d4e6-47c8-920a-c3f6aa46455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:55.498417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35778d5-d4e6-47c8-920a-c3f6aa46455a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:55.498781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35778d5-d4e6-47c8-920a-c3f6aa46455a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:55.499789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35778d5-d4e6-47c8-920a-c3f6aa46455a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:55.595085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35778d5-d4e6-47c8-920a-c3f6aa46455a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:55.597003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35778d5-d4e6-47c8-920a-c3f6aa46455a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:55.701297 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:55.732627 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 149/292] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:55.739005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8399fde-e801-4289-8e3a-b419405e44bd None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:55.749251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be8f45-2ef5-4103-a596-1074b3852c0f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:55.749557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be8f45-2ef5-4103-a596-1074b3852c0f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:55.749801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be8f45-2ef5-4103-a596-1074b3852c0f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:55.751646 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 150/293] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:55.756899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99cecf-4923-4c0b-adf7-ed6d2c6b10d4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:55.757188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99cecf-4923-4c0b-adf7-ed6d2c6b10d4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:55.757470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99cecf-4923-4c0b-adf7-ed6d2c6b10d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:55.776191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-eb99cecf-4923-4c0b-adf7-ed6d2c6b10d4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:55.777388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb99cecf-4923-4c0b-adf7-ed6d2c6b10d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:55.881245 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 151/294] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:44:55.956993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8399fde-e801-4289-8e3a-b419405e44bd None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:56.004382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72ff29-4c1b-41ae-81e2-029091602f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:56.005012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ff29-4c1b-41ae-81e2-029091602f55 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.005291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ff29-4c1b-41ae-81e2-029091602f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.005557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ff29-4c1b-41ae-81e2-029091602f55 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.015158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72ff29-4c1b-41ae-81e2-029091602f55 None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:56.016652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72ff29-4c1b-41ae-81e2-029091602f55 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:56.018300 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 144/295] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:55 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:56.024281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99cecf-4923-4c0b-adf7-ed6d2c6b10d4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:56.037113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cad0d-ae32-48e1-a023-3a1bdd53245a None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.037478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cad0d-ae32-48e1-a023-3a1bdd53245a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.037669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cad0d-ae32-48e1-a023-3a1bdd53245a None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.041648 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 145/296] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:56.045820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a24a-98e9-4ce8-b323-fe250402f812 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.046105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a24a-98e9-4ce8-b323-fe250402f812 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.046375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a24a-98e9-4ce8-b323-fe250402f812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.084762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a9b9a24a-98e9-4ce8-b323-fe250402f812 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:56.085942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a9b9a24a-98e9-4ce8-b323-fe250402f812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:56.179986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99cecf-4923-4c0b-adf7-ed6d2c6b10d4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:56.182905 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:56.218564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c8f6c-7906-493f-9242-5594dfc7aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:56.219668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8f6c-7906-493f-9242-5594dfc7aeae None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.220091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8f6c-7906-493f-9242-5594dfc7aeae None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.220502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8f6c-7906-493f-9242-5594dfc7aeae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.221673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c8f6c-7906-493f-9242-5594dfc7aeae None admin] RBAC: Adding query filter params (role.id=beb2c562d1d14ef599b41dd5788b6e4d, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af, user.id=aed80b4f90ec4eb8b9a444c59693a512) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:56.222142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c8f6c-7906-493f-9242-5594dfc7aeae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:56.223810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c8f6c-7906-493f-9242-5594dfc7aeae None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:56.231375 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 152/297] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:56 2022] GET /identity/v3/role_assignments?user.id=aed80b4f90ec4eb8b9a444c59693a512&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:56.236823 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:56.245269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c8f6c-7906-493f-9242-5594dfc7aeae None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:56.279554 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 146/298] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:56.357990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c8f6c-7906-493f-9242-5594dfc7aeae None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:56.360659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02056a21-61eb-40fe-9535-0e5fcc837154 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.361216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02056a21-61eb-40fe-9535-0e5fcc837154 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.361691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02056a21-61eb-40fe-9535-0e5fcc837154 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.367634 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 147/299] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:44:56.369726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6c362-55e1-4fdb-9dbc-34da56b16c93 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.370233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6c362-55e1-4fdb-9dbc-34da56b16c93 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.370868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6c362-55e1-4fdb-9dbc-34da56b16c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.396383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-14a6c362-55e1-4fdb-9dbc-34da56b16c93 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:56.397946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-14a6c362-55e1-4fdb-9dbc-34da56b16c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:56.404071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fa85a-f685-4255-a427-de015c0011ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:56.404734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fa85a-f685-4255-a427-de015c0011ff None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.405017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fa85a-f685-4255-a427-de015c0011ff None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.405880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fa85a-f685-4255-a427-de015c0011ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.421769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fa85a-f685-4255-a427-de015c0011ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-2d9fa85a-f685-4255-a427-de015c0011ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:56.428463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:56.429383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:56.430902 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 153/300] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:44:56.436500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fa85a-f685-4255-a427-de015c0011ff None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:56.479527 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:56.486793 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 148/301] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:56.557497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fa85a-f685-4255-a427-de015c0011ff None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:56.594468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a754-f4c8-4788-a86c-c35820a96817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:56.595125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a754-f4c8-4788-a86c-c35820a96817 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.595466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a754-f4c8-4788-a86c-c35820a96817 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.595749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a754-f4c8-4788-a86c-c35820a96817 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.597829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192a754-f4c8-4788-a86c-c35820a96817 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:56.597829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192a754-f4c8-4788-a86c-c35820a96817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:56.598147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192a754-f4c8-4788-a86c-c35820a96817 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:56.608334 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 154/302] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:56.614828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6c362-55e1-4fdb-9dbc-34da56b16c93 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:56.716815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a754-f4c8-4788-a86c-c35820a96817 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:56.735884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6c362-55e1-4fdb-9dbc-34da56b16c93 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:56.756454 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:56.780476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538785c-120a-4b8c-a0f9-d379b2b40914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:56.781678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538785c-120a-4b8c-a0f9-d379b2b40914 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.781967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538785c-120a-4b8c-a0f9-d379b2b40914 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.782247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538785c-120a-4b8c-a0f9-d379b2b40914 None admin] PATH_INFO: `/v3/users/3bb0fd206d6f42fdb25002550328d4f9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.798077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538785c-120a-4b8c-a0f9-d379b2b40914 None admin] RBAC: Authorizing `identity:get_user(user_id=3bb0fd206d6f42fdb25002550328d4f9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:56.799633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538785c-120a-4b8c-a0f9-d379b2b40914 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:56.801550 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 149/303] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:56 2022] GET /identity/v3/users/3bb0fd206d6f42fdb25002550328d4f9 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:56.802512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e999af-69cf-4198-8590-081a9ed50271 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.802874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e999af-69cf-4198-8590-081a9ed50271 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.803147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e999af-69cf-4198-8590-081a9ed50271 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.804617 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 150/304] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:56.807575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e999af-69cf-4198-8590-081a9ed50271 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:56.834483 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:56.846430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a754-f4c8-4788-a86c-c35820a96817 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:56.880015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c84ca-6cab-47fe-8fb7-15553ffedaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:56.880641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c84ca-6cab-47fe-8fb7-15553ffedaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.880924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c84ca-6cab-47fe-8fb7-15553ffedaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.881199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c84ca-6cab-47fe-8fb7-15553ffedaf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.882305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c84ca-6cab-47fe-8fb7-15553ffedaf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:56.883816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c84ca-6cab-47fe-8fb7-15553ffedaf5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:56.885407 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 155/305] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:56.886140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c84ca-6cab-47fe-8fb7-15553ffedaf5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:56.914070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e999af-69cf-4198-8590-081a9ed50271 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:56.946966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205563-9c40-42da-b35a-0df82f867f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:56.947589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205563-9c40-42da-b35a-0df82f867f58 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.947874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205563-9c40-42da-b35a-0df82f867f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.948178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205563-9c40-42da-b35a-0df82f867f58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.958543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9205563-9c40-42da-b35a-0df82f867f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-f9205563-9c40-42da-b35a-0df82f867f58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:56.963667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:56.964758 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:56.965757 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 151/306] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:56.966591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d5899-a24f-4124-b234-f5f1b2b9afa6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:56.966591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d5899-a24f-4124-b234-f5f1b2b9afa6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:56.966807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d5899-a24f-4124-b234-f5f1b2b9afa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:56.985172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b91d5899-a24f-4124-b234-f5f1b2b9afa6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:56.986530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b91d5899-a24f-4124-b234-f5f1b2b9afa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:56.990387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c84ca-6cab-47fe-8fb7-15553ffedaf5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:57.011643 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:57.023454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2f626-f472-4316-b4f0-f0eda30c2950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:57.024050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f626-f472-4316-b4f0-f0eda30c2950 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:57.024335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f626-f472-4316-b4f0-f0eda30c2950 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:57.024606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f626-f472-4316-b4f0-f0eda30c2950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:57.025323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2f626-f472-4316-b4f0-f0eda30c2950 None admin] RBAC: Adding query filter params (role.id=24d5a978aad041e5ac5f969daacd12c0, user.id=3bb0fd206d6f42fdb25002550328d4f9, scope.system=all) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:57.025630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2f626-f472-4316-b4f0-f0eda30c2950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:57.027102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2f626-f472-4316-b4f0-f0eda30c2950 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:57.032466 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 156/307] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 2 00:44:56 2022] GET /identity/v3/role_assignments?user.id=3bb0fd206d6f42fdb25002550328d4f9&scope.system=all&role.id=24d5a978aad041e5ac5f969daacd12c0 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:57.033239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2f626-f472-4316-b4f0-f0eda30c2950 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:57.060779 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:57.078629 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 152/308] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:57.078629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d5899-a24f-4124-b234-f5f1b2b9afa6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:57.182978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2f626-f472-4316-b4f0-f0eda30c2950 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:57.194653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d5899-a24f-4124-b234-f5f1b2b9afa6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:57.230893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f811220-9250-4d12-b140-5a6780288869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:57.231430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f811220-9250-4d12-b140-5a6780288869 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:57.231712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f811220-9250-4d12-b140-5a6780288869 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:57.231888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e24aa7-e530-47fb-ae6a-2be19fae4e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:57.232014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f811220-9250-4d12-b140-5a6780288869 None admin] PATH_INFO: `/v3/groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:57.232455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e24aa7-e530-47fb-ae6a-2be19fae4e00 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:57.232627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f811220-9250-4d12-b140-5a6780288869 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:57.232719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e24aa7-e530-47fb-ae6a-2be19fae4e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:57.232993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e24aa7-e530-47fb-ae6a-2be19fae4e00 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:57.234062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e24aa7-e530-47fb-ae6a-2be19fae4e00 None admin] RBAC: Adding query filter params (name=member) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:57.234062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e24aa7-e530-47fb-ae6a-2be19fae4e00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:57.234436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f811220-9250-4d12-b140-5a6780288869 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:57.235409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e24aa7-e530-47fb-ae6a-2be19fae4e00 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:57.245198 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 153/309] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:57.252002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e24aa7-e530-47fb-ae6a-2be19fae4e00 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:57.258668 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 157/310] 10.222.0.23 () {60 vars in 1134 bytes} [Sun Oct 2 00:44:57 2022] POST /identity/v3/groups => generated 229 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:44:57.287579 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:57.379722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f811220-9250-4d12-b140-5a6780288869 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:57.380623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e24aa7-e530-47fb-ae6a-2be19fae4e00 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:57.422093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78e7ac-2b52-4604-829e-c74e236fea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:57.422879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78e7ac-2b52-4604-829e-c74e236fea21 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:57.423163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78e7ac-2b52-4604-829e-c74e236fea21 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:57.423436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78e7ac-2b52-4604-829e-c74e236fea21 None admin] PATH_INFO: `/v3/users/925866ecbb5c4a0ba93d2783b239d4aa` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:57.424667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78e7ac-2b52-4604-829e-c74e236fea21 None admin] RBAC: Authorizing `identity:get_user(user_id=925866ecbb5c4a0ba93d2783b239d4aa)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:57.426138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78e7ac-2b52-4604-829e-c74e236fea21 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:57.428179 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 154/311] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:57 2022] GET /identity/v3/users/925866ecbb5c4a0ba93d2783b239d4aa => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:57.435667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78e7ac-2b52-4604-829e-c74e236fea21 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:57.503081 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:57.530225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f811220-9250-4d12-b140-5a6780288869 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:57.557964 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:57.568538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78e7ac-2b52-4604-829e-c74e236fea21 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:57.574901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b7051-5f4c-482c-a69b-d6d9fc16e96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:57.575552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b7051-5f4c-482c-a69b-d6d9fc16e96b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:57.575833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b7051-5f4c-482c-a69b-d6d9fc16e96b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:57.576636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b7051-5f4c-482c-a69b-d6d9fc16e96b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:57.591336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b7051-5f4c-482c-a69b-d6d9fc16e96b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-eb1b7051-5f4c-482c-a69b-d6d9fc16e96b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:57.599442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:57.600539 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:44:57.601504 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 158/312] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:57.607513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b7051-5f4c-482c-a69b-d6d9fc16e96b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:57.608739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291447d-a7c1-4300-b364-4b159a2052ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:57.609528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291447d-a7c1-4300-b364-4b159a2052ba None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:57.609821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291447d-a7c1-4300-b364-4b159a2052ba None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:57.610094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291447d-a7c1-4300-b364-4b159a2052ba None admin] PATH_INFO: `/v3/system/users/925866ecbb5c4a0ba93d2783b239d4aa/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:57.611535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291447d-a7c1-4300-b364-4b159a2052ba None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=925866ecbb5c4a0ba93d2783b239d4aa, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:57.612907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291447d-a7c1-4300-b364-4b159a2052ba None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:57.630692 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 155/313] 10.222.0.23 () {58 vars in 1334 bytes} [Sun Oct 2 00:44:57 2022] PUT /identity/v3/system/users/925866ecbb5c4a0ba93d2783b239d4aa/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:44:57.748431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b7051-5f4c-482c-a69b-d6d9fc16e96b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:57.795358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598cb4-f3fd-454b-b53e-a73a4f2c2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:57.796032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598cb4-f3fd-454b-b53e-a73a4f2c2421 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:57.796315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598cb4-f3fd-454b-b53e-a73a4f2c2421 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:57.796878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598cb4-f3fd-454b-b53e-a73a4f2c2421 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:57.797589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00598cb4-f3fd-454b-b53e-a73a4f2c2421 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:57.797893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00598cb4-f3fd-454b-b53e-a73a4f2c2421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:57.799387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00598cb4-f3fd-454b-b53e-a73a4f2c2421 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:57.809531 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 159/314] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:44:57.815901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291447d-a7c1-4300-b364-4b159a2052ba None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:57.932242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291447d-a7c1-4300-b364-4b159a2052ba None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:57.971306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bd20f-1ffc-421a-a8a9-c2cb6826c6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:57.971950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd20f-1ffc-421a-a8a9-c2cb6826c6ac None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:57.972228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd20f-1ffc-421a-a8a9-c2cb6826c6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:57.972503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd20f-1ffc-421a-a8a9-c2cb6826c6ac None admin] PATH_INFO: `/v3/users/b78533f17eb44b36b4e9ae957ce933dc` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:57.973712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bd20f-1ffc-421a-a8a9-c2cb6826c6ac None admin] RBAC: Authorizing `identity:get_user(user_id=b78533f17eb44b36b4e9ae957ce933dc)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:57.975259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bd20f-1ffc-421a-a8a9-c2cb6826c6ac None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:57.977205 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 156/315] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:57 2022] GET /identity/v3/users/b78533f17eb44b36b4e9ae957ce933dc => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:57.982654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598cb4-f3fd-454b-b53e-a73a4f2c2421 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:57.987471 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:58.101339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598cb4-f3fd-454b-b53e-a73a4f2c2421 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:58.137428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6932b21-c61a-4357-a3a2-e9594f0d3665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:58.138406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6932b21-c61a-4357-a3a2-e9594f0d3665 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:58.138991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6932b21-c61a-4357-a3a2-e9594f0d3665 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:58.140117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6932b21-c61a-4357-a3a2-e9594f0d3665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:58.212591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6932b21-c61a-4357-a3a2-e9594f0d3665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:58.214490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6932b21-c61a-4357-a3a2-e9594f0d3665 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:58.219378 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:58.324525 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 160/316] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:44:58.331844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bd20f-1ffc-421a-a8a9-c2cb6826c6ac None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:58.361919 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:58.451062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bd20f-1ffc-421a-a8a9-c2cb6826c6ac None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:58.488030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a177-849c-4279-acec-fa278a2680d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:58.489047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a177-849c-4279-acec-fa278a2680d3 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:58.489530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a177-849c-4279-acec-fa278a2680d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:58.490004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a177-849c-4279-acec-fa278a2680d3 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:58.491349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94a177-849c-4279-acec-fa278a2680d3 None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:58.493047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94a177-849c-4279-acec-fa278a2680d3 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:58.495249 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 157/317] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:44:58 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:58.501390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6932b21-c61a-4357-a3a2-e9594f0d3665 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:58.605381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6932b21-c61a-4357-a3a2-e9594f0d3665 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:58.607752 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:58.640606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55bac5-5a02-4fa4-bb77-56190755ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:58.641132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55bac5-5a02-4fa4-bb77-56190755ca81 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:58.641413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55bac5-5a02-4fa4-bb77-56190755ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:58.641687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55bac5-5a02-4fa4-bb77-56190755ca81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:58.642415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55bac5-5a02-4fa4-bb77-56190755ca81 None admin] RBAC: Adding query filter params (role.id=24d5a978aad041e5ac5f969daacd12c0, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af, user.id=b78533f17eb44b36b4e9ae957ce933dc) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:58.642756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55bac5-5a02-4fa4-bb77-56190755ca81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:58.644214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55bac5-5a02-4fa4-bb77-56190755ca81 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:58.650495 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 161/318] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:44:58 2022] GET /identity/v3/role_assignments?user.id=b78533f17eb44b36b4e9ae957ce933dc&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=24d5a978aad041e5ac5f969daacd12c0 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:59.235428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5fbb3-b834-45dc-a87d-8387860a833b None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:59.235769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5fbb3-b834-45dc-a87d-8387860a833b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:59.235960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5fbb3-b834-45dc-a87d-8387860a833b None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:59.237362 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 158/319] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:59.242338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b730057-3fd9-4d2d-a244-30844ac469ea None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:59.242648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b730057-3fd9-4d2d-a244-30844ac469ea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:59.242923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b730057-3fd9-4d2d-a244-30844ac469ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:59.261212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2b730057-3fd9-4d2d-a244-30844ac469ea None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:59.262391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2b730057-3fd9-4d2d-a244-30844ac469ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:59.328671 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 162/320] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:59.554534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e57a7-5890-46f1-8aff-d3f90f40642b None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:59.555059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e57a7-5890-46f1-8aff-d3f90f40642b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:59.555059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e57a7-5890-46f1-8aff-d3f90f40642b None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:59.556515 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 159/321] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:44:59.562032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb92da6-3b34-4c43-8907-edcdea2f0c24 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:59.562422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb92da6-3b34-4c43-8907-edcdea2f0c24 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:59.562765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb92da6-3b34-4c43-8907-edcdea2f0c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:59.580965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ceb92da6-3b34-4c43-8907-edcdea2f0c24 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:44:59.582141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ceb92da6-3b34-4c43-8907-edcdea2f0c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:44:59.597194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e57a7-5890-46f1-8aff-d3f90f40642b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:59.655238 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 163/322] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:44:59.694806 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:59.706354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e57a7-5890-46f1-8aff-d3f90f40642b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:59.740631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a84055-ee2a-4423-b504-a6d8fde6a848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:59.741251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a84055-ee2a-4423-b504-a6d8fde6a848 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:59.741529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a84055-ee2a-4423-b504-a6d8fde6a848 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:59.741800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a84055-ee2a-4423-b504-a6d8fde6a848 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:59.752353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a84055-ee2a-4423-b504-a6d8fde6a848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-17a84055-ee2a-4423-b504-a6d8fde6a848 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:44:59.757128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:44:59.758002 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:44:59.758842 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 160/323] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:44:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:44:59.766395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb92da6-3b34-4c43-8907-edcdea2f0c24 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:59.792219 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:44:59.868624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb92da6-3b34-4c43-8907-edcdea2f0c24 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:44:59.904239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c4455-5afa-4199-8821-5e4fc5da9d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:44:59.904870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c4455-5afa-4199-8821-5e4fc5da9d0c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:44:59.905146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c4455-5afa-4199-8821-5e4fc5da9d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:44:59.905413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c4455-5afa-4199-8821-5e4fc5da9d0c None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:44:59.906121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c4455-5afa-4199-8821-5e4fc5da9d0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:44:59.906420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c4455-5afa-4199-8821-5e4fc5da9d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:44:59.907838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c4455-5afa-4199-8821-5e4fc5da9d0c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:44:59.915983 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 164/324] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:44:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:44:59.922003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a84055-ee2a-4423-b504-a6d8fde6a848 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:44:59.938564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c4455-5afa-4199-8821-5e4fc5da9d0c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:00.026434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a84055-ee2a-4423-b504-a6d8fde6a848 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:00.030581 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:00.040483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c4455-5afa-4199-8821-5e4fc5da9d0c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:00.060886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df007586-44ab-48b6-914c-468d4148b6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:00.062083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df007586-44ab-48b6-914c-468d4148b6cb None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:00.062438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df007586-44ab-48b6-914c-468d4148b6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:00.062749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df007586-44ab-48b6-914c-468d4148b6cb None admin] PATH_INFO: `/v3/users/3bb0fd206d6f42fdb25002550328d4f9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:00.064023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df007586-44ab-48b6-914c-468d4148b6cb None admin] RBAC: Authorizing `identity:get_user(user_id=3bb0fd206d6f42fdb25002550328d4f9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:00.065467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df007586-44ab-48b6-914c-468d4148b6cb None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:00.067068 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 161/325] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:44:59 2022] GET /identity/v3/users/3bb0fd206d6f42fdb25002550328d4f9 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:00.068148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d4a4-1dce-4aba-a495-0567ce744cde None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:00.068426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d4a4-1dce-4aba-a495-0567ce744cde None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:00.068695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d4a4-1dce-4aba-a495-0567ce744cde None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:00.069861 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 162/326] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:00.072480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664d4a4-1dce-4aba-a495-0567ce744cde None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:00.078956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85ff69-d348-47f2-8ca6-6d14561e4b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:00.079595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85ff69-d348-47f2-8ca6-6d14561e4b9b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:00.079874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85ff69-d348-47f2-8ca6-6d14561e4b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:00.080148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85ff69-d348-47f2-8ca6-6d14561e4b9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:00.081249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85ff69-d348-47f2-8ca6-6d14561e4b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:00.082733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85ff69-d348-47f2-8ca6-6d14561e4b9b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:00.084288 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 165/327] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:44:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:00.085371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d14f5e-6de9-417b-bc21-b8c4ad7e2817 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:00.085656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d14f5e-6de9-417b-bc21-b8c4ad7e2817 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:00.085929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d14f5e-6de9-417b-bc21-b8c4ad7e2817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:00.095785 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:00.105547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e9d14f5e-6de9-417b-bc21-b8c4ad7e2817 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:00.106761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e9d14f5e-6de9-417b-bc21-b8c4ad7e2817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:00.172344 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 166/328] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:00.173155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d14f5e-6de9-417b-bc21-b8c4ad7e2817 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:00.182799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664d4a4-1dce-4aba-a495-0567ce744cde None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:00.219894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60c781-343d-4357-9c56-933ded651c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:00.220541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c781-343d-4357-9c56-933ded651c74 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:00.220820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c781-343d-4357-9c56-933ded651c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:00.221094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c781-343d-4357-9c56-933ded651c74 None admin] PATH_INFO: `/v3/system/users/3bb0fd206d6f42fdb25002550328d4f9/roles/24d5a978aad041e5ac5f969daacd12c0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:00.222479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60c781-343d-4357-9c56-933ded651c74 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3bb0fd206d6f42fdb25002550328d4f9, role_id=24d5a978aad041e5ac5f969daacd12c0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:00.223868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60c781-343d-4357-9c56-933ded651c74 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:00.232353 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 163/329] 10.222.0.23 () {58 vars in 1334 bytes} [Sun Oct 2 00:45:00 2022] PUT /identity/v3/system/users/3bb0fd206d6f42fdb25002550328d4f9/roles/24d5a978aad041e5ac5f969daacd12c0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:00.273698 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:00.288048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d14f5e-6de9-417b-bc21-b8c4ad7e2817 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:00.326316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ca8fe-89ce-4032-86da-30aebeda35fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:00.327112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ca8fe-89ce-4032-86da-30aebeda35fb None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:00.327450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ca8fe-89ce-4032-86da-30aebeda35fb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:00.327659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ca8fe-89ce-4032-86da-30aebeda35fb None admin] PATH_INFO: `/v3/groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:00.328292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ca8fe-89ce-4032-86da-30aebeda35fb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:00.329844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ca8fe-89ce-4032-86da-30aebeda35fb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:00.346472 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 167/330] 10.222.0.23 () {60 vars in 1134 bytes} [Sun Oct 2 00:45:00 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:45:00.446892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60c781-343d-4357-9c56-933ded651c74 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:00.538295 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:00.556842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60c781-343d-4357-9c56-933ded651c74 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:00.593676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78071a44-c7b0-4f52-8d93-16ed6f16e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:00.594359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071a44-c7b0-4f52-8d93-16ed6f16e46e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:00.594728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071a44-c7b0-4f52-8d93-16ed6f16e46e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:00.594904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071a44-c7b0-4f52-8d93-16ed6f16e46e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:00.605472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78071a44-c7b0-4f52-8d93-16ed6f16e46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-78071a44-c7b0-4f52-8d93-16ed6f16e46e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:00.610890 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:00.611807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:00.612620 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 164/331] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:00.617808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ca8fe-89ce-4032-86da-30aebeda35fb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:00.729478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ca8fe-89ce-4032-86da-30aebeda35fb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:00.765981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5684d7-102d-442f-be57-af7de28b2e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:00.766904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5684d7-102d-442f-be57-af7de28b2e6c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:00.767336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5684d7-102d-442f-be57-af7de28b2e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:00.767767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5684d7-102d-442f-be57-af7de28b2e6c None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:00.768599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5684d7-102d-442f-be57-af7de28b2e6c None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:00.768908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5684d7-102d-442f-be57-af7de28b2e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:00.770291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5684d7-102d-442f-be57-af7de28b2e6c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:00.779890 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 168/332] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:45:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:00.785804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78071a44-c7b0-4f52-8d93-16ed6f16e46e None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:00.901052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78071a44-c7b0-4f52-8d93-16ed6f16e46e None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:00.936954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac0b86-da7d-4963-b7f9-7f440979f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:00.937917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac0b86-da7d-4963-b7f9-7f440979f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:00.938369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac0b86-da7d-4963-b7f9-7f440979f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:00.938837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac0b86-da7d-4963-b7f9-7f440979f0d2 None admin] PATH_INFO: `/v3/users/925866ecbb5c4a0ba93d2783b239d4aa` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:00.940173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac0b86-da7d-4963-b7f9-7f440979f0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=925866ecbb5c4a0ba93d2783b239d4aa)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:00.941901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac0b86-da7d-4963-b7f9-7f440979f0d2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:00.944001 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 165/333] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:45:00 2022] GET /identity/v3/users/925866ecbb5c4a0ba93d2783b239d4aa => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:00.949979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5684d7-102d-442f-be57-af7de28b2e6c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:00.968281 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:01.099275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5684d7-102d-442f-be57-af7de28b2e6c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:01.146635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c99a3d-c829-4f47-990b-0ce2417ae6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:01.147557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c99a3d-c829-4f47-990b-0ce2417ae6ff None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:01.148025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c99a3d-c829-4f47-990b-0ce2417ae6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:01.148503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c99a3d-c829-4f47-990b-0ce2417ae6ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:01.149413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c99a3d-c829-4f47-990b-0ce2417ae6ff None admin] RBAC: Adding query filter params (role.id=beb2c562d1d14ef599b41dd5788b6e4d, user.id=925866ecbb5c4a0ba93d2783b239d4aa, scope.system=all) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:01.149908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c99a3d-c829-4f47-990b-0ce2417ae6ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:01.151653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c99a3d-c829-4f47-990b-0ce2417ae6ff None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:01.165236 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 169/334] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 2 00:45:00 2022] GET /identity/v3/role_assignments?user.id=925866ecbb5c4a0ba93d2783b239d4aa&scope.system=all&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:02.530709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7c7e4-8a59-4e24-990c-11a5b0fd440e None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:02.531249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7c7e4-8a59-4e24-990c-11a5b0fd440e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:02.531329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7c7e4-8a59-4e24-990c-11a5b0fd440e None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:02.532678 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 166/335] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:02.540488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a83b3b-f3b8-4e9c-b9c5-a8d17d570fc8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:02.540963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a83b3b-f3b8-4e9c-b9c5-a8d17d570fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:02.541038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a83b3b-f3b8-4e9c-b9c5-a8d17d570fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:02.563612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-71a83b3b-f3b8-4e9c-b9c5-a8d17d570fc8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:02.564819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-71a83b3b-f3b8-4e9c-b9c5-a8d17d570fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:02.643268 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:02.652868 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 170/336] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:03.071968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7c7e4-8a59-4e24-990c-11a5b0fd440e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:03.093560 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:03.135395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79ecd-6940-40cc-bda0-38f623c554ea None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:03.135775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79ecd-6940-40cc-bda0-38f623c554ea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:03.136029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79ecd-6940-40cc-bda0-38f623c554ea None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:03.138058 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 171/337] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:03.144082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29374-fea4-4273-9c5c-a28e1af87f88 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:03.144358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29374-fea4-4273-9c5c-a28e1af87f88 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:03.144632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29374-fea4-4273-9c5c-a28e1af87f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:03.175745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0ae29374-fea4-4273-9c5c-a28e1af87f88 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:03.177027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ae29374-fea4-4273-9c5c-a28e1af87f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:03.204961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7c7e4-8a59-4e24-990c-11a5b0fd440e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:03.246105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ad78-4907-420d-bbe9-942644681ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:03.246700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ad78-4907-420d-bbe9-942644681ddb None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:03.246981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ad78-4907-420d-bbe9-942644681ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:03.247255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ad78-4907-420d-bbe9-942644681ddb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:03.263637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0ad78-4907-420d-bbe9-942644681ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-0af0ad78-4907-420d-bbe9-942644681ddb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:03.269786 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:03.270748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:03.271563 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 167/338] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:03.278345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ad78-4907-420d-bbe9-942644681ddb None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:03.283263 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 172/339] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:03.338383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a77c5-7e21-4529-b4b6-904a73dfd0ea None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:03.338711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a77c5-7e21-4529-b4b6-904a73dfd0ea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:03.338944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a77c5-7e21-4529-b4b6-904a73dfd0ea None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:03.340292 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 173/340] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:03.346108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be472b-5614-4eb5-aab2-a030e9ba9f69 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:03.346385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be472b-5614-4eb5-aab2-a030e9ba9f69 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:03.346674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be472b-5614-4eb5-aab2-a030e9ba9f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:03.368443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-05be472b-5614-4eb5-aab2-a030e9ba9f69 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:03.369624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-05be472b-5614-4eb5-aab2-a030e9ba9f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:03.394958 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:03.469117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ad78-4907-420d-bbe9-942644681ddb None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:03.485130 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 174/341] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:45:03.543383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d51952-738a-4adc-a5e2-49a819c7f1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:03.543947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51952-738a-4adc-a5e2-49a819c7f1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:03.544183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51952-738a-4adc-a5e2-49a819c7f1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:03.544455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51952-738a-4adc-a5e2-49a819c7f1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:03.545152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d51952-738a-4adc-a5e2-49a819c7f1f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:03.545455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d51952-738a-4adc-a5e2-49a819c7f1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:03.547134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d51952-738a-4adc-a5e2-49a819c7f1f7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:03.560427 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 168/342] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:45:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:03.566340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be472b-5614-4eb5-aab2-a030e9ba9f69 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:03.625555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d51952-738a-4adc-a5e2-49a819c7f1f7 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:03.651693 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:03.709003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be472b-5614-4eb5-aab2-a030e9ba9f69 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:03.753985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4582c-d07c-48b6-951e-8fd84ac62616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:03.754634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4582c-d07c-48b6-951e-8fd84ac62616 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:03.754916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4582c-d07c-48b6-951e-8fd84ac62616 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:03.755240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4582c-d07c-48b6-951e-8fd84ac62616 None admin] PATH_INFO: `/v3/users/3bb0fd206d6f42fdb25002550328d4f9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:03.759446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4582c-d07c-48b6-951e-8fd84ac62616 None admin] RBAC: Authorizing `identity:get_user(user_id=3bb0fd206d6f42fdb25002550328d4f9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:03.760910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4582c-d07c-48b6-951e-8fd84ac62616 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:03.762682 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 175/343] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:45:03 2022] GET /identity/v3/users/3bb0fd206d6f42fdb25002550328d4f9 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:03.769117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4582c-d07c-48b6-951e-8fd84ac62616 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:03.821094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d51952-738a-4adc-a5e2-49a819c7f1f7 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:03.883882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1bece-55e4-4293-8414-83799c327b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:03.884534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1bece-55e4-4293-8414-83799c327b36 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:03.884814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1bece-55e4-4293-8414-83799c327b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:03.885081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1bece-55e4-4293-8414-83799c327b36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:03.897061 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:03.909000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1bece-55e4-4293-8414-83799c327b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-1ea1bece-55e4-4293-8414-83799c327b36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:03.921284 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:03.922350 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:03.923219 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 169/344] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:03.930377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1bece-55e4-4293-8414-83799c327b36 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:03.931521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4582c-d07c-48b6-951e-8fd84ac62616 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:03.978382 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:03.999498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effc15b-8041-4bdb-8d02-3deb907705b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:04.000105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effc15b-8041-4bdb-8d02-3deb907705b0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:04.000377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effc15b-8041-4bdb-8d02-3deb907705b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:04.000645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effc15b-8041-4bdb-8d02-3deb907705b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:04.001375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effc15b-8041-4bdb-8d02-3deb907705b0 None admin] RBAC: Adding query filter params (role.id=24d5a978aad041e5ac5f969daacd12c0, user.id=3bb0fd206d6f42fdb25002550328d4f9, scope.system=all) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:04.001682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effc15b-8041-4bdb-8d02-3deb907705b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:04.004864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effc15b-8041-4bdb-8d02-3deb907705b0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:04.028105 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 176/345] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 2 00:45:03 2022] GET /identity/v3/role_assignments?user.id=3bb0fd206d6f42fdb25002550328d4f9&scope.system=all&role.id=24d5a978aad041e5ac5f969daacd12c0 => generated 510 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:04.029703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8ab31-d0ee-49cf-8307-489a4f73eef7 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:04.031149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8ab31-d0ee-49cf-8307-489a4f73eef7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:04.031422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8ab31-d0ee-49cf-8307-489a4f73eef7 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:04.032752 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 177/346] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:04.040460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c428442-6e83-4087-b000-1b8607d52286 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:04.042320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c428442-6e83-4087-b000-1b8607d52286 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:04.042641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c428442-6e83-4087-b000-1b8607d52286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:04.080783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4c428442-6e83-4087-b000-1b8607d52286 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:04.081904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4c428442-6e83-4087-b000-1b8607d52286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:04.113207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1bece-55e4-4293-8414-83799c327b36 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:04.168089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688286fd-4e92-4908-8bc0-9d6b7d6246d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:04.168988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688286fd-4e92-4908-8bc0-9d6b7d6246d2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:04.169426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688286fd-4e92-4908-8bc0-9d6b7d6246d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:04.169843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688286fd-4e92-4908-8bc0-9d6b7d6246d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:04.170836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688286fd-4e92-4908-8bc0-9d6b7d6246d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:04.171587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688286fd-4e92-4908-8bc0-9d6b7d6246d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:04.173251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688286fd-4e92-4908-8bc0-9d6b7d6246d2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:04.192995 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 170/347] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:45:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:04.198556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688286fd-4e92-4908-8bc0-9d6b7d6246d2 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:04.216077 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 178/348] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:04.217030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c428442-6e83-4087-b000-1b8607d52286 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:04.270396 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:04.345069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688286fd-4e92-4908-8bc0-9d6b7d6246d2 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:04.398147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef084f-ee6f-4d13-93c2-2a6041682688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:04.398812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef084f-ee6f-4d13-93c2-2a6041682688 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:04.399091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef084f-ee6f-4d13-93c2-2a6041682688 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:04.399363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef084f-ee6f-4d13-93c2-2a6041682688 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:04.410850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef084f-ee6f-4d13-93c2-2a6041682688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-0eef084f-ee6f-4d13-93c2-2a6041682688 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:04.418061 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:04.419001 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:04.420559 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 171/349] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:45:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:04.427578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef084f-ee6f-4d13-93c2-2a6041682688 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:04.435990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c428442-6e83-4087-b000-1b8607d52286 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:04.469533 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:04.516480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5e027-9527-43a9-a4f1-69e6a2867840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:04.517117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5e027-9527-43a9-a4f1-69e6a2867840 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:04.517397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5e027-9527-43a9-a4f1-69e6a2867840 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:04.517670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5e027-9527-43a9-a4f1-69e6a2867840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:04.555164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef084f-ee6f-4d13-93c2-2a6041682688 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:04.595883 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:04.596477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4506f-4533-470c-be8d-de6e9fe3fbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:04.597316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4506f-4533-470c-be8d-de6e9fe3fbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:04.597904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4506f-4533-470c-be8d-de6e9fe3fbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:04.598393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4506f-4533-470c-be8d-de6e9fe3fbe9 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:04.600379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4506f-4533-470c-be8d-de6e9fe3fbe9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:04.600892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4506f-4533-470c-be8d-de6e9fe3fbe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:04.602482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4506f-4533-470c-be8d-de6e9fe3fbe9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:04.613063 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 172/350] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:04.614262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4506f-4533-470c-be8d-de6e9fe3fbe9 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:04.663339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5e027-9527-43a9-a4f1-69e6a2867840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:04.664820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5e027-9527-43a9-a4f1-69e6a2867840 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:04.748533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4506f-4533-470c-be8d-de6e9fe3fbe9 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:04.781847 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 179/351] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:04.782740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5e027-9527-43a9-a4f1-69e6a2867840 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:04.794113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bc3ed-0d9c-48d0-b497-53b3518aec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:04.795378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bc3ed-0d9c-48d0-b497-53b3518aec96 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:04.795651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bc3ed-0d9c-48d0-b497-53b3518aec96 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:04.796166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bc3ed-0d9c-48d0-b497-53b3518aec96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:04.802434 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:04.813305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bc3ed-0d9c-48d0-b497-53b3518aec96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-c61bc3ed-0d9c-48d0-b497-53b3518aec96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:04.821481 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:04.822396 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:04.823232 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:04.825714 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 173/352] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:04.827269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bc3ed-0d9c-48d0-b497-53b3518aec96 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:04.883487 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:04.909129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5e027-9527-43a9-a4f1-69e6a2867840 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:04.955121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5d707-e876-4ca7-93a4-1c26b81a0c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:04.955890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d707-e876-4ca7-93a4-1c26b81a0c52 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:04.956261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d707-e876-4ca7-93a4-1c26b81a0c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:04.956624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d707-e876-4ca7-93a4-1c26b81a0c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:04.978076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bc3ed-0d9c-48d0-b497-53b3518aec96 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:05.018796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf0245-5b2c-4209-97c7-22dc059632cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:05.019431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf0245-5b2c-4209-97c7-22dc059632cd None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:05.019707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf0245-5b2c-4209-97c7-22dc059632cd None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:05.019977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf0245-5b2c-4209-97c7-22dc059632cd None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:05.023997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf0245-5b2c-4209-97c7-22dc059632cd None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:05.025520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf0245-5b2c-4209-97c7-22dc059632cd None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:05.027496 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 174/353] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:04 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:05.028259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf0245-5b2c-4209-97c7-22dc059632cd None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:05.044449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5d707-e876-4ca7-93a4-1c26b81a0c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:05.047025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5d707-e876-4ca7-93a4-1c26b81a0c52 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:05.066643 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:05.168113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf0245-5b2c-4209-97c7-22dc059632cd None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:05.176573 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 180/354] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:05.177192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5d707-e876-4ca7-93a4-1c26b81a0c52 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:05.177873 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:05.221101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c6efb-6728-426c-bc1b-9c65ce79e203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:05.221706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c6efb-6728-426c-bc1b-9c65ce79e203 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:05.221982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c6efb-6728-426c-bc1b-9c65ce79e203 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:05.222249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c6efb-6728-426c-bc1b-9c65ce79e203 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:05.222947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c6efb-6728-426c-bc1b-9c65ce79e203 None admin] RBAC: Adding query filter params (name=member) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:05.223249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c6efb-6728-426c-bc1b-9c65ce79e203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:05.224616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c6efb-6728-426c-bc1b-9c65ce79e203 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:05.236434 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 175/355] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:45:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:05.237924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b8722-18dd-4834-8cf1-b9946197aa4f None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:05.238494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b8722-18dd-4834-8cf1-b9946197aa4f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:05.238494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b8722-18dd-4834-8cf1-b9946197aa4f None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:05.239819 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 176/356] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:05.244084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b8722-18dd-4834-8cf1-b9946197aa4f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:05.313172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5d707-e876-4ca7-93a4-1c26b81a0c52 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:05.328873 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:05.355192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4e462-01d8-4e63-ab57-a4ded463f6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:05.355934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e462-01d8-4e63-ab57-a4ded463f6cf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:05.356260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e462-01d8-4e63-ab57-a4ded463f6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:05.356533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e462-01d8-4e63-ab57-a4ded463f6cf None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:05.363304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4e462-01d8-4e63-ab57-a4ded463f6cf None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:05.363887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b8722-18dd-4834-8cf1-b9946197aa4f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:05.364734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4e462-01d8-4e63-ab57-a4ded463f6cf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:05.366369 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 181/357] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:05 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:05.367163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4e462-01d8-4e63-ab57-a4ded463f6cf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:05.407522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65616f-e3ac-48a5-878f-cf0ddf67472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:05.408221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65616f-e3ac-48a5-878f-cf0ddf67472a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:05.408502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65616f-e3ac-48a5-878f-cf0ddf67472a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:05.408825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65616f-e3ac-48a5-878f-cf0ddf67472a None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:05.409966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65616f-e3ac-48a5-878f-cf0ddf67472a None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:05.411495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65616f-e3ac-48a5-878f-cf0ddf67472a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:05.413313 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 177/358] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:05 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:05.414254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19083e26-d224-47ae-aa0a-1856a973df35 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:05.414530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19083e26-d224-47ae-aa0a-1856a973df35 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:05.414826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19083e26-d224-47ae-aa0a-1856a973df35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:05.438427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-19083e26-d224-47ae-aa0a-1856a973df35 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:05.438983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-19083e26-d224-47ae-aa0a-1856a973df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:05.478573 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:05.487842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4e462-01d8-4e63-ab57-a4ded463f6cf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:05.533383 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 178/359] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:05.534099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19083e26-d224-47ae-aa0a-1856a973df35 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:05.541715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4826db-b025-4391-95bf-a285292e5ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:05.542691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4826db-b025-4391-95bf-a285292e5ffd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:05.543181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4826db-b025-4391-95bf-a285292e5ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:05.544146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4826db-b025-4391-95bf-a285292e5ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:05.603684 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:05.632348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4826db-b025-4391-95bf-a285292e5ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:05.634122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4826db-b025-4391-95bf-a285292e5ffd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:05.664396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19083e26-d224-47ae-aa0a-1856a973df35 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:05.710349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f129f-76dd-4d33-8250-7fce05721304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:05.711506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f129f-76dd-4d33-8250-7fce05721304 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:05.711796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f129f-76dd-4d33-8250-7fce05721304 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:05.712072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f129f-76dd-4d33-8250-7fce05721304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:05.712809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f129f-76dd-4d33-8250-7fce05721304 None admin] RBAC: Adding query filter params (group.id=cd4fa4750b044750bf72d9ff49bd0751, role.id=beb2c562d1d14ef599b41dd5788b6e4d, scope.project.id=123533f35dfa451ba661bea2bceb664c) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:05.713282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f129f-76dd-4d33-8250-7fce05721304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:05.715095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f129f-76dd-4d33-8250-7fce05721304 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:05.722920 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 179/360] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 2 00:45:05 2022] GET /identity/v3/role_assignments?group.id=cd4fa4750b044750bf72d9ff49bd0751&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:05.724838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f129f-76dd-4d33-8250-7fce05721304 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:05.780863 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 182/361] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:05.788728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4826db-b025-4391-95bf-a285292e5ffd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:05.804562 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:05.911559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f129f-76dd-4d33-8250-7fce05721304 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:05.916791 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:05.942270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4826db-b025-4391-95bf-a285292e5ffd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:05.957972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a4d61-598d-48ce-8097-9a6a9df8a903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:05.958358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a4d61-598d-48ce-8097-9a6a9df8a903 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:05.958753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a4d61-598d-48ce-8097-9a6a9df8a903 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:05.958923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a4d61-598d-48ce-8097-9a6a9df8a903 None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:05.962332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a4d61-598d-48ce-8097-9a6a9df8a903 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:05.962332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a4d61-598d-48ce-8097-9a6a9df8a903 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:05.965625 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 180/362] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:05 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:05.968528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a4d61-598d-48ce-8097-9a6a9df8a903 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:05.997626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ff375-636b-42f6-baf4-98e717f969ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:05.998441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ff375-636b-42f6-baf4-98e717f969ff None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:05.999126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ff375-636b-42f6-baf4-98e717f969ff None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:05.999126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ff375-636b-42f6-baf4-98e717f969ff None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:06.000083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ff375-636b-42f6-baf4-98e717f969ff None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:06.001538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ff375-636b-42f6-baf4-98e717f969ff None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:06.003208 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 183/363] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:05 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:06.004318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af89f1-910a-42e7-923b-3ea8d1146b75 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:06.004594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af89f1-910a-42e7-923b-3ea8d1146b75 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:06.004864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af89f1-910a-42e7-923b-3ea8d1146b75 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:06.006286 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 184/364] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:06.007029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af89f1-910a-42e7-923b-3ea8d1146b75 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:06.090982 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:06.096275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a4d61-598d-48ce-8097-9a6a9df8a903 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:06.145307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5881996-17cc-4a4c-941e-ac4e257d7e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:06.145862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5881996-17cc-4a4c-941e-ac4e257d7e0a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:06.146138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5881996-17cc-4a4c-941e-ac4e257d7e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:06.146409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5881996-17cc-4a4c-941e-ac4e257d7e0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:06.149596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af89f1-910a-42e7-923b-3ea8d1146b75 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:06.162443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5881996-17cc-4a4c-941e-ac4e257d7e0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-b5881996-17cc-4a4c-941e-ac4e257d7e0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:06.169101 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:06.170202 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 181/365] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:45:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:06.171375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5881996-17cc-4a4c-941e-ac4e257d7e0a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:06.198523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc0fb1-d1d0-4ba3-84aa-e66d2b272e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:06.199626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0fb1-d1d0-4ba3-84aa-e66d2b272e0d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:06.199919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0fb1-d1d0-4ba3-84aa-e66d2b272e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:06.200288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0fb1-d1d0-4ba3-84aa-e66d2b272e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:06.200935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0fb1-d1d0-4ba3-84aa-e66d2b272e0d None admin] RBAC: Adding query filter params (group.id=cd4fa4750b044750bf72d9ff49bd0751, role.id=25dd37ef41a046b1b26386c2672249fe, scope.project.id=123533f35dfa451ba661bea2bceb664c) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:06.202099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0fb1-d1d0-4ba3-84aa-e66d2b272e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:06.204512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0fb1-d1d0-4ba3-84aa-e66d2b272e0d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:06.214719 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 185/366] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 2 00:45:06 2022] GET /identity/v3/role_assignments?group.id=cd4fa4750b044750bf72d9ff49bd0751&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=25dd37ef41a046b1b26386c2672249fe => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:06.214719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74254052-6d07-4da5-8009-17a5b770cfbb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:06.214719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74254052-6d07-4da5-8009-17a5b770cfbb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:06.214719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74254052-6d07-4da5-8009-17a5b770cfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:06.235703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-74254052-6d07-4da5-8009-17a5b770cfbb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:06.236921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-74254052-6d07-4da5-8009-17a5b770cfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:06.241125 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:06.317421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5881996-17cc-4a4c-941e-ac4e257d7e0a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:06.322143 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 186/367] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:06.323421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74254052-6d07-4da5-8009-17a5b770cfbb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:06.363518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d75e47-4c1b-4b7c-be5c-c5e2ac4a2ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:06.364161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d75e47-4c1b-4b7c-be5c-c5e2ac4a2ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:06.364441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d75e47-4c1b-4b7c-be5c-c5e2ac4a2ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:06.364716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d75e47-4c1b-4b7c-be5c-c5e2ac4a2ef4 None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:06.366820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d75e47-4c1b-4b7c-be5c-c5e2ac4a2ef4 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:06.369552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d75e47-4c1b-4b7c-be5c-c5e2ac4a2ef4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:06.372075 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 182/368] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:06 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:06.389169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d75e47-4c1b-4b7c-be5c-c5e2ac4a2ef4 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:06.452768 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:06.509577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74254052-6d07-4da5-8009-17a5b770cfbb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:06.536956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d75e47-4c1b-4b7c-be5c-c5e2ac4a2ef4 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:06.573580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296701b4-bdea-4317-9140-3a429ee82153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:06.574250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296701b4-bdea-4317-9140-3a429ee82153 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:06.574536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296701b4-bdea-4317-9140-3a429ee82153 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:06.574895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296701b4-bdea-4317-9140-3a429ee82153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:06.575631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296701b4-bdea-4317-9140-3a429ee82153 None admin] RBAC: Adding query filter params (group.id=cd4fa4750b044750bf72d9ff49bd0751, role.id=beb2c562d1d14ef599b41dd5788b6e4d, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:06.575937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296701b4-bdea-4317-9140-3a429ee82153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:06.577917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296701b4-bdea-4317-9140-3a429ee82153 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:06.584565 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 183/369] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 2 00:45:06 2022] GET /identity/v3/role_assignments?group.id=cd4fa4750b044750bf72d9ff49bd0751&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:06.604748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767729d-bd09-4847-ba32-a5088ae038ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:06.605669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767729d-bd09-4847-ba32-a5088ae038ae None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:06.606090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767729d-bd09-4847-ba32-a5088ae038ae None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:06.606514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767729d-bd09-4847-ba32-a5088ae038ae None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:06.607679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767729d-bd09-4847-ba32-a5088ae038ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:06.608156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767729d-bd09-4847-ba32-a5088ae038ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:06.610434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767729d-bd09-4847-ba32-a5088ae038ae None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:06.640662 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 187/370] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:06.646054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296701b4-bdea-4317-9140-3a429ee82153 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:06.728442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767729d-bd09-4847-ba32-a5088ae038ae None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:06.737365 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:06.755524 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:06.771429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296701b4-bdea-4317-9140-3a429ee82153 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:06.815177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22840e-29ee-4185-a273-64b33c6ef487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:06.815796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22840e-29ee-4185-a273-64b33c6ef487 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:06.816128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22840e-29ee-4185-a273-64b33c6ef487 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:06.816583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22840e-29ee-4185-a273-64b33c6ef487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:06.914702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22840e-29ee-4185-a273-64b33c6ef487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:06.916988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22840e-29ee-4185-a273-64b33c6ef487 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:06.974485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767729d-bd09-4847-ba32-a5088ae038ae None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:07.016194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca1db4-23ef-4084-976c-29b2bd199689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:07.016830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca1db4-23ef-4084-976c-29b2bd199689 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:07.017129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca1db4-23ef-4084-976c-29b2bd199689 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:07.017401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca1db4-23ef-4084-976c-29b2bd199689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:07.033554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca1db4-23ef-4084-976c-29b2bd199689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c6ca1db4-23ef-4084-976c-29b2bd199689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:07.039902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:07.040801 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:07.041689 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 188/371] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:07.047156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca1db4-23ef-4084-976c-29b2bd199689 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:07.048168 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:07.061026 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 184/372] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:07.066839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22840e-29ee-4185-a273-64b33c6ef487 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:07.152728 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:07.225987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca1db4-23ef-4084-976c-29b2bd199689 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:07.255553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22840e-29ee-4185-a273-64b33c6ef487 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:07.291531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2845bc1-158c-41f1-90f1-487ca53bd623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:07.292059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2845bc1-158c-41f1-90f1-487ca53bd623 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:07.292336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2845bc1-158c-41f1-90f1-487ca53bd623 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:07.292600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2845bc1-158c-41f1-90f1-487ca53bd623 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:07.293272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2845bc1-158c-41f1-90f1-487ca53bd623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:07.293574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2845bc1-158c-41f1-90f1-487ca53bd623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:07.295732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2845bc1-158c-41f1-90f1-487ca53bd623 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:07.309283 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 189/373] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:07.316333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2845bc1-158c-41f1-90f1-487ca53bd623 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:07.320259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47594c-671b-48d7-b27c-9dc554fe890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:07.320899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47594c-671b-48d7-b27c-9dc554fe890c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:07.321180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47594c-671b-48d7-b27c-9dc554fe890c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:07.321447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47594c-671b-48d7-b27c-9dc554fe890c None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:07.324156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47594c-671b-48d7-b27c-9dc554fe890c None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:07.331251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47594c-671b-48d7-b27c-9dc554fe890c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:07.333254 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 185/374] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:07 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:07.338219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47594c-671b-48d7-b27c-9dc554fe890c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:07.442973 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:07.500655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2845bc1-158c-41f1-90f1-487ca53bd623 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:07.518947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47594c-671b-48d7-b27c-9dc554fe890c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:07.543198 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:07.563532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a0d45-6750-40fd-871d-b67994c79b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:07.564150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a0d45-6750-40fd-871d-b67994c79b8c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:07.564427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a0d45-6750-40fd-871d-b67994c79b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:07.564695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a0d45-6750-40fd-871d-b67994c79b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:07.583335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb691ecd-4859-4b42-8554-2082be66ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:07.583966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb691ecd-4859-4b42-8554-2082be66ed69 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:07.584240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb691ecd-4859-4b42-8554-2082be66ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:07.584508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb691ecd-4859-4b42-8554-2082be66ed69 None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:07.585722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb691ecd-4859-4b42-8554-2082be66ed69 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:07.587186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb691ecd-4859-4b42-8554-2082be66ed69 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:07.591315 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 186/375] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:07 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:07.596474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb691ecd-4859-4b42-8554-2082be66ed69 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:07.688341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a0d45-6750-40fd-871d-b67994c79b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:07.689879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a0d45-6750-40fd-871d-b67994c79b8c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:07.781093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb691ecd-4859-4b42-8554-2082be66ed69 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:07.824447 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:07.835341 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 190/376] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:07.839505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426348-776c-4552-8021-bb25fe0f16bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:07.840579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426348-776c-4552-8021-bb25fe0f16bf None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:07.840937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a0d45-6750-40fd-871d-b67994c79b8c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:07.841300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426348-776c-4552-8021-bb25fe0f16bf None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:07.842305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426348-776c-4552-8021-bb25fe0f16bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:07.843264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b426348-776c-4552-8021-bb25fe0f16bf None admin] RBAC: Adding query filter params (group.id=cd4fa4750b044750bf72d9ff49bd0751, role.id=25dd37ef41a046b1b26386c2672249fe, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:07.843772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b426348-776c-4552-8021-bb25fe0f16bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:07.845426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b426348-776c-4552-8021-bb25fe0f16bf None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:07.868901 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 187/377] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 2 00:45:07 2022] GET /identity/v3/role_assignments?group.id=cd4fa4750b044750bf72d9ff49bd0751&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=25dd37ef41a046b1b26386c2672249fe => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:07.874122 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:07.968119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a0d45-6750-40fd-871d-b67994c79b8c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:08.010331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48750b-d583-4cd2-89f6-c8b461f5a059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:08.010990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48750b-d583-4cd2-89f6-c8b461f5a059 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:08.011271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48750b-d583-4cd2-89f6-c8b461f5a059 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:08.011545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48750b-d583-4cd2-89f6-c8b461f5a059 None admin] PATH_INFO: `/v3/projects/bd709e757c564f0baea68763e7e07e28` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:08.012777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48750b-d583-4cd2-89f6-c8b461f5a059 None admin] RBAC: Authorizing `identity:get_project(project_id=bd709e757c564f0baea68763e7e07e28)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:08.015096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48750b-d583-4cd2-89f6-c8b461f5a059 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:08.017193 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 191/378] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:07 2022] GET /identity/v3/projects/bd709e757c564f0baea68763e7e07e28 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:08.023056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426348-776c-4552-8021-bb25fe0f16bf None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:08.147959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426348-776c-4552-8021-bb25fe0f16bf None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:08.186873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f72d58-15b7-4979-8e44-dfdde2dbece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:08.187511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f72d58-15b7-4979-8e44-dfdde2dbece6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:08.187791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f72d58-15b7-4979-8e44-dfdde2dbece6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:08.188063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f72d58-15b7-4979-8e44-dfdde2dbece6 None admin] PATH_INFO: `/v3/groups/75adc2e0f8e147009ea68f8b379d7a69` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:08.199200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f72d58-15b7-4979-8e44-dfdde2dbece6 None admin] RBAC: Authorizing `identity:get_group(group_id=75adc2e0f8e147009ea68f8b379d7a69)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:08.200662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f72d58-15b7-4979-8e44-dfdde2dbece6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:08.203205 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 188/379] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:08 2022] GET /identity/v3/groups/75adc2e0f8e147009ea68f8b379d7a69 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:08.209322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48750b-d583-4cd2-89f6-c8b461f5a059 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:08.352113 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:08.363530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48750b-d583-4cd2-89f6-c8b461f5a059 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:08.392352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5f854-17ef-4130-b495-00bc36c3953c None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:08.392709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5f854-17ef-4130-b495-00bc36c3953c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:08.392909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5f854-17ef-4130-b495-00bc36c3953c None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:08.394386 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 189/380] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:08.399834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611e70-6334-4452-b5a1-d1e3b152b604 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:08.400055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611e70-6334-4452-b5a1-d1e3b152b604 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:08.400333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611e70-6334-4452-b5a1-d1e3b152b604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:08.407734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7931ed-e611-4ba4-b238-22aa0e43f89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:08.408354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7931ed-e611-4ba4-b238-22aa0e43f89c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:08.408636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7931ed-e611-4ba4-b238-22aa0e43f89c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:08.408914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7931ed-e611-4ba4-b238-22aa0e43f89c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:08.409641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7931ed-e611-4ba4-b238-22aa0e43f89c None admin] RBAC: Adding query filter params (group.id=75adc2e0f8e147009ea68f8b379d7a69, role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=bd709e757c564f0baea68763e7e07e28) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:08.409953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7931ed-e611-4ba4-b238-22aa0e43f89c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:08.411537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7931ed-e611-4ba4-b238-22aa0e43f89c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:08.417746 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 192/381] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 2 00:45:08 2022] GET /identity/v3/role_assignments?group.id=75adc2e0f8e147009ea68f8b379d7a69&scope.project.id=bd709e757c564f0baea68763e7e07e28&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:08.447824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-df611e70-6334-4452-b5a1-d1e3b152b604 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:08.449055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-df611e70-6334-4452-b5a1-d1e3b152b604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:08.534973 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:08.559105 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 190/382] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:08.855497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7931ed-e611-4ba4-b238-22aa0e43f89c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:08.988246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7931ed-e611-4ba4-b238-22aa0e43f89c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:09.033765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15fb19-5f72-499b-ae87-9fec84134afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:09.034378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15fb19-5f72-499b-ae87-9fec84134afa None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:09.034688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15fb19-5f72-499b-ae87-9fec84134afa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:09.034959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15fb19-5f72-499b-ae87-9fec84134afa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:09.047868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15fb19-5f72-499b-ae87-9fec84134afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cb15fb19-5f72-499b-ae87-9fec84134afa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:09.053104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:09.053991 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:09.055199 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 193/383] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:09.063707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df611e70-6334-4452-b5a1-d1e3b152b604 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:09.139214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259eb6-2b9b-4c84-9be2-ec7a1b88bed2 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:09.139550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259eb6-2b9b-4c84-9be2-ec7a1b88bed2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:09.139934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259eb6-2b9b-4c84-9be2-ec7a1b88bed2 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:09.141646 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 194/384] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:09.155101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b745a-98c1-4390-915f-f1aa3d2e3ae7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:09.155379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b745a-98c1-4390-915f-f1aa3d2e3ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:09.155640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b745a-98c1-4390-915f-f1aa3d2e3ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:09.195684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c94b745a-98c1-4390-915f-f1aa3d2e3ae7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:09.196902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c94b745a-98c1-4390-915f-f1aa3d2e3ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:09.201466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df611e70-6334-4452-b5a1-d1e3b152b604 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:09.214955 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:09.241485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a63d-e855-4659-9c45-2e5ad8e0b3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:09.242099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a63d-e855-4659-9c45-2e5ad8e0b3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:09.242375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a63d-e855-4659-9c45-2e5ad8e0b3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:09.242666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a63d-e855-4659-9c45-2e5ad8e0b3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:09.243337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1a63d-e855-4659-9c45-2e5ad8e0b3c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:09.243636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1a63d-e855-4659-9c45-2e5ad8e0b3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:09.246367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1a63d-e855-4659-9c45-2e5ad8e0b3c2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:09.264651 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 191/385] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:45:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:09.274666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a63d-e855-4659-9c45-2e5ad8e0b3c2 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:09.331709 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 195/386] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:45:09.349230 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:09.406737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a63d-e855-4659-9c45-2e5ad8e0b3c2 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:09.445360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505e599-2354-4825-aa53-f7864df9382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:09.445993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e599-2354-4825-aa53-f7864df9382a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:09.446270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e599-2354-4825-aa53-f7864df9382a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:09.446544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e599-2354-4825-aa53-f7864df9382a None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:09.451854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505e599-2354-4825-aa53-f7864df9382a None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:09.453356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505e599-2354-4825-aa53-f7864df9382a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:09.455333 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 192/387] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:09 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:09.460936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b745a-98c1-4390-915f-f1aa3d2e3ae7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:09.573162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b745a-98c1-4390-915f-f1aa3d2e3ae7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:09.620367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc821245-21d8-4995-bfc3-8d4b12964865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:09.621027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821245-21d8-4995-bfc3-8d4b12964865 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:09.621304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821245-21d8-4995-bfc3-8d4b12964865 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:09.621577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821245-21d8-4995-bfc3-8d4b12964865 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:09.627617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc821245-21d8-4995-bfc3-8d4b12964865 None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:09.629291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc821245-21d8-4995-bfc3-8d4b12964865 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:09.631210 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 196/388] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:09 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:09.637179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505e599-2354-4825-aa53-f7864df9382a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:09.714047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc821245-21d8-4995-bfc3-8d4b12964865 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:09.736972 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:09.786970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505e599-2354-4825-aa53-f7864df9382a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:09.802845 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:09.825031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ecada-1cd0-4afc-831e-19b54ff425ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:09.826100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ecada-1cd0-4afc-831e-19b54ff425ec None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:09.826337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ecada-1cd0-4afc-831e-19b54ff425ec None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:09.826728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ecada-1cd0-4afc-831e-19b54ff425ec None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c/groups/cd4fa4750b044750bf72d9ff49bd0751/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:09.829814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ecada-1cd0-4afc-831e-19b54ff425ec None admin] RBAC: Authorizing `identity:create_grant(project_id=123533f35dfa451ba661bea2bceb664c, group_id=cd4fa4750b044750bf72d9ff49bd0751, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:09.831438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ecada-1cd0-4afc-831e-19b54ff425ec None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:09.848541 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 193/389] 10.222.0.23 () {58 vars in 1442 bytes} [Sun Oct 2 00:45:09 2022] PUT /identity/v3/projects/123533f35dfa451ba661bea2bceb664c/groups/cd4fa4750b044750bf72d9ff49bd0751/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:09.850111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596b2e-5b57-4045-bbb3-fb9ae2db6c6f None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:09.850493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596b2e-5b57-4045-bbb3-fb9ae2db6c6f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:09.851197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596b2e-5b57-4045-bbb3-fb9ae2db6c6f None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:09.855036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc821245-21d8-4995-bfc3-8d4b12964865 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:09.856814 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 194/390] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:09.859836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab501ac-e0de-4bda-bb3f-d4cba83b961a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:09.859836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab501ac-e0de-4bda-bb3f-d4cba83b961a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:09.860158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab501ac-e0de-4bda-bb3f-d4cba83b961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:09.885434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5ab501ac-e0de-4bda-bb3f-d4cba83b961a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:09.886751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5ab501ac-e0de-4bda-bb3f-d4cba83b961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:09.915029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ffc7a-27a5-4e49-a83f-ab4147a6fd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:09.916006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ffc7a-27a5-4e49-a83f-ab4147a6fd3f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:09.916482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ffc7a-27a5-4e49-a83f-ab4147a6fd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:09.916949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ffc7a-27a5-4e49-a83f-ab4147a6fd3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:09.940609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ffc7a-27a5-4e49-a83f-ab4147a6fd3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-e72ffc7a-27a5-4e49-a83f-ab4147a6fd3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:09.946090 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:09.947070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:09.947895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:09.950638 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 197/391] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:45:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:09.957370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ffc7a-27a5-4e49-a83f-ab4147a6fd3f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:09.981973 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 195/392] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:45:10.075067 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:10.098481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ffc7a-27a5-4e49-a83f-ab4147a6fd3f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:10.136242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff6602-86ed-42b6-8256-b1f869ece80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:10.136862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6602-86ed-42b6-8256-b1f869ece80a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:10.137143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6602-86ed-42b6-8256-b1f869ece80a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:10.137417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6602-86ed-42b6-8256-b1f869ece80a None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:10.138082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff6602-86ed-42b6-8256-b1f869ece80a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:10.139039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff6602-86ed-42b6-8256-b1f869ece80a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:10.140650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff6602-86ed-42b6-8256-b1f869ece80a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:10.149429 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 198/393] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:10.154841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab501ac-e0de-4bda-bb3f-d4cba83b961a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:10.287309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab501ac-e0de-4bda-bb3f-d4cba83b961a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:10.290985 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:10.297984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff6602-86ed-42b6-8256-b1f869ece80a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:10.350650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e31e9b-99c6-419e-8c6a-09312cca077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:10.351664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e31e9b-99c6-419e-8c6a-09312cca077e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:10.352134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e31e9b-99c6-419e-8c6a-09312cca077e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:10.352613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e31e9b-99c6-419e-8c6a-09312cca077e None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:10.355672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e31e9b-99c6-419e-8c6a-09312cca077e None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:10.358036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e31e9b-99c6-419e-8c6a-09312cca077e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:10.361186 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 196/394] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:10 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:10.366225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e31e9b-99c6-419e-8c6a-09312cca077e None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:10.471543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff6602-86ed-42b6-8256-b1f869ece80a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:10.514855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeeb71-11fa-49cc-ade6-cbc9cb45a676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:10.515869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeeb71-11fa-49cc-ade6-cbc9cb45a676 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:10.516344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeeb71-11fa-49cc-ade6-cbc9cb45a676 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:10.517094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeeb71-11fa-49cc-ade6-cbc9cb45a676 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:10.534753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdeeb71-11fa-49cc-ade6-cbc9cb45a676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:10.540321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e31e9b-99c6-419e-8c6a-09312cca077e None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-dcdeeb71-11fa-49cc-ade6-cbc9cb45a676 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:10.543469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:10.544360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:10.545264 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:10.547796 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 199/395] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:10.551422 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:10.554550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeeb71-11fa-49cc-ade6-cbc9cb45a676 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:10.635226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9980fc8-d713-44b5-9d48-02272cb82dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:10.635859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9980fc8-d713-44b5-9d48-02272cb82dbd None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:10.636136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9980fc8-d713-44b5-9d48-02272cb82dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:10.636405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9980fc8-d713-44b5-9d48-02272cb82dbd None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:10.640492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9980fc8-d713-44b5-9d48-02272cb82dbd None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:10.641931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9980fc8-d713-44b5-9d48-02272cb82dbd None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:10.644874 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 197/396] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:10 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:10.651000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9980fc8-d713-44b5-9d48-02272cb82dbd None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:10.709428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeeb71-11fa-49cc-ade6-cbc9cb45a676 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:10.724664 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:10.773573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3505bb4-4d8f-45cd-8729-2fa394ab3060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:10.774272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3505bb4-4d8f-45cd-8729-2fa394ab3060 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:10.774589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3505bb4-4d8f-45cd-8729-2fa394ab3060 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:10.774988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3505bb4-4d8f-45cd-8729-2fa394ab3060 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:10.775685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3505bb4-4d8f-45cd-8729-2fa394ab3060 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:10.775994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3505bb4-4d8f-45cd-8729-2fa394ab3060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:10.777389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3505bb4-4d8f-45cd-8729-2fa394ab3060 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:10.790848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9980fc8-d713-44b5-9d48-02272cb82dbd None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:10.799001 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 200/397] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:45:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:10.805213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3505bb4-4d8f-45cd-8729-2fa394ab3060 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:10.828573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f01fd-2fe0-48a4-9fc5-e2956ce9d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:10.829285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f01fd-2fe0-48a4-9fc5-e2956ce9d4fc None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:10.829567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f01fd-2fe0-48a4-9fc5-e2956ce9d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:10.829837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f01fd-2fe0-48a4-9fc5-e2956ce9d4fc None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c/groups/cd4fa4750b044750bf72d9ff49bd0751/roles/25dd37ef41a046b1b26386c2672249fe` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:10.832561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f01fd-2fe0-48a4-9fc5-e2956ce9d4fc None admin] RBAC: Authorizing `identity:create_grant(project_id=123533f35dfa451ba661bea2bceb664c, group_id=cd4fa4750b044750bf72d9ff49bd0751, role_id=25dd37ef41a046b1b26386c2672249fe)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:10.834120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f01fd-2fe0-48a4-9fc5-e2956ce9d4fc None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:10.851688 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 198/398] 10.222.0.23 () {58 vars in 1442 bytes} [Sun Oct 2 00:45:10 2022] PUT /identity/v3/projects/123533f35dfa451ba661bea2bceb664c/groups/cd4fa4750b044750bf72d9ff49bd0751/roles/25dd37ef41a046b1b26386c2672249fe => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:10.930725 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:10.980034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a7c2e-6870-41ea-80e5-e5b447a05145 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:10.982284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a7c2e-6870-41ea-80e5-e5b447a05145 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:10.982284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a7c2e-6870-41ea-80e5-e5b447a05145 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:10.982284 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 199/399] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:45:10.988482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518e52-6811-4950-b0f7-bade956f77ec None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:10.988762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518e52-6811-4950-b0f7-bade956f77ec None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:10.989162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518e52-6811-4950-b0f7-bade956f77ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:11.010033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b6518e52-6811-4950-b0f7-bade956f77ec None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:11.011314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b6518e52-6811-4950-b0f7-bade956f77ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:11.012247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3505bb4-4d8f-45cd-8729-2fa394ab3060 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:11.090264 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 200/400] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:11.108793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560fa77-52e0-4489-a8b4-1fb872cac90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:11.109459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560fa77-52e0-4489-a8b4-1fb872cac90c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:11.109732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560fa77-52e0-4489-a8b4-1fb872cac90c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:11.110003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560fa77-52e0-4489-a8b4-1fb872cac90c None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:11.111185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560fa77-52e0-4489-a8b4-1fb872cac90c None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:11.112668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560fa77-52e0-4489-a8b4-1fb872cac90c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:11.114666 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 201/401] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:10 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:11.120436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6518e52-6811-4950-b0f7-bade956f77ec None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:11.161021 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:11.236066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6518e52-6811-4950-b0f7-bade956f77ec None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:11.271137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56610e-cd68-4d93-8ac9-130a94c128d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:11.271745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56610e-cd68-4d93-8ac9-130a94c128d4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:11.272014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56610e-cd68-4d93-8ac9-130a94c128d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:11.272320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56610e-cd68-4d93-8ac9-130a94c128d4 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:11.273464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56610e-cd68-4d93-8ac9-130a94c128d4 None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:11.274914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56610e-cd68-4d93-8ac9-130a94c128d4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:11.276836 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 201/402] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:11 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:11.287643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560fa77-52e0-4489-a8b4-1fb872cac90c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:11.305803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549606cb-dddf-4915-9f00-55da8db2d592 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:11.306109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549606cb-dddf-4915-9f00-55da8db2d592 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:11.306409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549606cb-dddf-4915-9f00-55da8db2d592 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:11.308038 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 202/403] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:11.313997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e578e20-9b5d-4b0b-a35f-7129a0062fbb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:11.314278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e578e20-9b5d-4b0b-a35f-7129a0062fbb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:11.314553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e578e20-9b5d-4b0b-a35f-7129a0062fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:11.334288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6e578e20-9b5d-4b0b-a35f-7129a0062fbb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:11.335857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6e578e20-9b5d-4b0b-a35f-7129a0062fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:11.408066 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 203/404] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:45:11.408862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e578e20-9b5d-4b0b-a35f-7129a0062fbb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:11.458947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560fa77-52e0-4489-a8b4-1fb872cac90c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:11.464114 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:11.496634 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:11.511058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351a398-21fc-4b9c-bc1e-353dfd7c9a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:11.511720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351a398-21fc-4b9c-bc1e-353dfd7c9a6d None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:11.511997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351a398-21fc-4b9c-bc1e-353dfd7c9a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:11.512266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351a398-21fc-4b9c-bc1e-353dfd7c9a6d None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/groups/cd4fa4750b044750bf72d9ff49bd0751/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:11.518581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351a398-21fc-4b9c-bc1e-353dfd7c9a6d None admin] RBAC: Authorizing `identity:create_grant(project_id=d73af77d824e4885afc5f1e9a8cdf3af, group_id=cd4fa4750b044750bf72d9ff49bd0751, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:11.520086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351a398-21fc-4b9c-bc1e-353dfd7c9a6d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:11.544027 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 202/405] 10.222.0.23 () {58 vars in 1442 bytes} [Sun Oct 2 00:45:11 2022] PUT /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/groups/cd4fa4750b044750bf72d9ff49bd0751/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:11.604679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e578e20-9b5d-4b0b-a35f-7129a0062fbb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:11.660893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9f78d-572d-4d63-8572-152ec0d11e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:11.661904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9f78d-572d-4d63-8572-152ec0d11e9f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:11.662384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9f78d-572d-4d63-8572-152ec0d11e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:11.662896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9f78d-572d-4d63-8572-152ec0d11e9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:11.675253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9f78d-572d-4d63-8572-152ec0d11e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-b2a9f78d-572d-4d63-8572-152ec0d11e9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:11.680677 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:11.681632 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:11.682459 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:11.684858 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 204/406] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:45:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:11.691677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351a398-21fc-4b9c-bc1e-353dfd7c9a6d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:11.759743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9f78d-572d-4d63-8572-152ec0d11e9f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:11.840174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351a398-21fc-4b9c-bc1e-353dfd7c9a6d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:11.902104 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:11.906511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be7f21-6f5c-4154-9af7-f9ba29981152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:11.907383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be7f21-6f5c-4154-9af7-f9ba29981152 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:11.907663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be7f21-6f5c-4154-9af7-f9ba29981152 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:11.907936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be7f21-6f5c-4154-9af7-f9ba29981152 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:11.908605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be7f21-6f5c-4154-9af7-f9ba29981152 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:11.908903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be7f21-6f5c-4154-9af7-f9ba29981152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:11.910289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be7f21-6f5c-4154-9af7-f9ba29981152 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:11.926321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9f78d-572d-4d63-8572-152ec0d11e9f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:11.932753 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 203/407] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:11.938685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be7f21-6f5c-4154-9af7-f9ba29981152 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:11.974433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cede2-62fb-47cc-9a14-ef4aa47ce375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:11.976080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cede2-62fb-47cc-9a14-ef4aa47ce375 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:11.976359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cede2-62fb-47cc-9a14-ef4aa47ce375 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:11.976632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cede2-62fb-47cc-9a14-ef4aa47ce375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:12.000224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cede2-62fb-47cc-9a14-ef4aa47ce375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-314cede2-62fb-47cc-9a14-ef4aa47ce375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:12.012488 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:12.013943 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:12.014753 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:12.019549 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 205/408] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:12.034230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cede2-62fb-47cc-9a14-ef4aa47ce375 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:12.047636 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:12.125614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be7f21-6f5c-4154-9af7-f9ba29981152 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:12.161431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d211c-c16b-48a1-aff8-4055edb137c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:12.162064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d211c-c16b-48a1-aff8-4055edb137c4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:12.162340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d211c-c16b-48a1-aff8-4055edb137c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:12.162625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d211c-c16b-48a1-aff8-4055edb137c4 None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:12.163854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d211c-c16b-48a1-aff8-4055edb137c4 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:12.165380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d211c-c16b-48a1-aff8-4055edb137c4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:12.166986 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 204/409] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:11 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:12.173432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d211c-c16b-48a1-aff8-4055edb137c4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:12.232568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cede2-62fb-47cc-9a14-ef4aa47ce375 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:12.291272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34986140-98a1-4585-b20c-1975c01e721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:12.291880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34986140-98a1-4585-b20c-1975c01e721c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:12.292153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34986140-98a1-4585-b20c-1975c01e721c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:12.292420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34986140-98a1-4585-b20c-1975c01e721c None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:12.293083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34986140-98a1-4585-b20c-1975c01e721c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:12.293386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34986140-98a1-4585-b20c-1975c01e721c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:12.294920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34986140-98a1-4585-b20c-1975c01e721c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:12.316391 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 206/410] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:12.317324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34986140-98a1-4585-b20c-1975c01e721c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:12.328005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d211c-c16b-48a1-aff8-4055edb137c4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:12.338846 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:12.354962 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:12.386766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1c656-06af-42a9-a81c-1432d4b59f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:12.387396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1c656-06af-42a9-a81c-1432d4b59f46 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:12.387676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1c656-06af-42a9-a81c-1432d4b59f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:12.387954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1c656-06af-42a9-a81c-1432d4b59f46 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:12.390420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1c656-06af-42a9-a81c-1432d4b59f46 None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:12.391894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1c656-06af-42a9-a81c-1432d4b59f46 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:12.394644 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 205/411] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:12 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:12.402129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1c656-06af-42a9-a81c-1432d4b59f46 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:12.496923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34986140-98a1-4585-b20c-1975c01e721c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:12.556964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2de46-c8b1-4b9c-844b-32976bd86827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:12.557627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2de46-c8b1-4b9c-844b-32976bd86827 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:12.557908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2de46-c8b1-4b9c-844b-32976bd86827 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:12.558177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2de46-c8b1-4b9c-844b-32976bd86827 None admin] PATH_INFO: `/v3/groups/75adc2e0f8e147009ea68f8b379d7a69` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:12.560853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2de46-c8b1-4b9c-844b-32976bd86827 None admin] RBAC: Authorizing `identity:get_group(group_id=75adc2e0f8e147009ea68f8b379d7a69)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:12.562343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2de46-c8b1-4b9c-844b-32976bd86827 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:12.564065 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 207/412] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:12 2022] GET /identity/v3/groups/75adc2e0f8e147009ea68f8b379d7a69 => generated 229 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:12.572843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2de46-c8b1-4b9c-844b-32976bd86827 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:12.593675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1c656-06af-42a9-a81c-1432d4b59f46 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:12.651877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f2faf-d33d-4179-a628-20a48acbb952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:12.652547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f2faf-d33d-4179-a628-20a48acbb952 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:12.652824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f2faf-d33d-4179-a628-20a48acbb952 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:12.653093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f2faf-d33d-4179-a628-20a48acbb952 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/groups/cd4fa4750b044750bf72d9ff49bd0751/roles/25dd37ef41a046b1b26386c2672249fe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:12.657486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f2faf-d33d-4179-a628-20a48acbb952 None admin] RBAC: Authorizing `identity:create_grant(project_id=d73af77d824e4885afc5f1e9a8cdf3af, group_id=cd4fa4750b044750bf72d9ff49bd0751, role_id=25dd37ef41a046b1b26386c2672249fe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:12.658962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f2faf-d33d-4179-a628-20a48acbb952 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:12.677699 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 206/413] 10.222.0.23 () {58 vars in 1442 bytes} [Sun Oct 2 00:45:12 2022] PUT /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af/groups/cd4fa4750b044750bf72d9ff49bd0751/roles/25dd37ef41a046b1b26386c2672249fe => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:12.687231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4cac-8156-48da-ab88-847808daca2b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:12.687528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4cac-8156-48da-ab88-847808daca2b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:12.687805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4cac-8156-48da-ab88-847808daca2b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:12.689569 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 207/414] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:12.695510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea49be-19af-4723-985a-bc8b3a35768f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:12.695783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea49be-19af-4723-985a-bc8b3a35768f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:12.696061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea49be-19af-4723-985a-bc8b3a35768f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:12.710769 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:12.725733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6cea49be-19af-4723-985a-bc8b3a35768f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:12.728294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6cea49be-19af-4723-985a-bc8b3a35768f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:12.782272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2de46-c8b1-4b9c-844b-32976bd86827 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:12.819961 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:12.849177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834946e-cfad-416e-b2b0-b053a1c91db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:12.850217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834946e-cfad-416e-b2b0-b053a1c91db9 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:12.850727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834946e-cfad-416e-b2b0-b053a1c91db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:12.851199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834946e-cfad-416e-b2b0-b053a1c91db9 None admin] PATH_INFO: `/v3/projects/bd709e757c564f0baea68763e7e07e28` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:12.852905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834946e-cfad-416e-b2b0-b053a1c91db9 None admin] RBAC: Authorizing `identity:get_project(project_id=bd709e757c564f0baea68763e7e07e28)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:12.855283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834946e-cfad-416e-b2b0-b053a1c91db9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:12.861923 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 208/415] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:12 2022] GET /identity/v3/projects/bd709e757c564f0baea68763e7e07e28 => generated 344 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:12.864594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834946e-cfad-416e-b2b0-b053a1c91db9 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:12.877101 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 208/416] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:45:12.995078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834946e-cfad-416e-b2b0-b053a1c91db9 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:13.037813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a572aa-0214-4ced-b38d-04a832b1e3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:13.038401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a572aa-0214-4ced-b38d-04a832b1e3e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:13.038708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a572aa-0214-4ced-b38d-04a832b1e3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:13.038985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a572aa-0214-4ced-b38d-04a832b1e3e9 None admin] PATH_INFO: `/v3/projects/bd709e757c564f0baea68763e7e07e28/groups/75adc2e0f8e147009ea68f8b379d7a69/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:13.041588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a572aa-0214-4ced-b38d-04a832b1e3e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd709e757c564f0baea68763e7e07e28, group_id=75adc2e0f8e147009ea68f8b379d7a69, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:13.043296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a572aa-0214-4ced-b38d-04a832b1e3e9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:13.071727 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 209/417] 10.222.0.23 () {58 vars in 1442 bytes} [Sun Oct 2 00:45:12 2022] PUT /identity/v3/projects/bd709e757c564f0baea68763e7e07e28/groups/75adc2e0f8e147009ea68f8b379d7a69/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:13.164078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea49be-19af-4723-985a-bc8b3a35768f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:13.318545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea49be-19af-4723-985a-bc8b3a35768f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:13.362296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281dc3a-7c3c-4b24-a837-c55eba7d32c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:13.362961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281dc3a-7c3c-4b24-a837-c55eba7d32c4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:13.363238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281dc3a-7c3c-4b24-a837-c55eba7d32c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:13.363509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281dc3a-7c3c-4b24-a837-c55eba7d32c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:13.374111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281dc3a-7c3c-4b24-a837-c55eba7d32c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b281dc3a-7c3c-4b24-a837-c55eba7d32c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:13.378899 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:13.379796 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:13.380607 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 209/418] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:13.387007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a572aa-0214-4ced-b38d-04a832b1e3e9 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:13.401368 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:13.529456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a572aa-0214-4ced-b38d-04a832b1e3e9 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:13.579400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed01d-bd85-4498-b413-1591f1b3129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:13.580287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed01d-bd85-4498-b413-1591f1b3129d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:13.580766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed01d-bd85-4498-b413-1591f1b3129d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:13.581188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed01d-bd85-4498-b413-1591f1b3129d None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:13.582006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed01d-bd85-4498-b413-1591f1b3129d None admin] RBAC: Adding query filter params (name=member) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:13.582469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed01d-bd85-4498-b413-1591f1b3129d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:13.584004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed01d-bd85-4498-b413-1591f1b3129d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:13.593107 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 210/419] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:45:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:13.599011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281dc3a-7c3c-4b24-a837-c55eba7d32c4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:13.623872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc390-d177-4c49-a776-77835a20fc56 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:13.624471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc390-d177-4c49-a776-77835a20fc56 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:13.624749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc390-d177-4c49-a776-77835a20fc56 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:13.626212 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 211/420] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:13.632017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a25b1-6edd-4e79-9abe-a53f9e8f3512 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:13.632302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a25b1-6edd-4e79-9abe-a53f9e8f3512 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:13.632581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a25b1-6edd-4e79-9abe-a53f9e8f3512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:13.651448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dd0a25b1-6edd-4e79-9abe-a53f9e8f3512 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:13.652629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dd0a25b1-6edd-4e79-9abe-a53f9e8f3512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:13.669947 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:13.747313 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:13.757159 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 212/421] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:45:13.770040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281dc3a-7c3c-4b24-a837-c55eba7d32c4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:13.805483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cc48b-47ac-4e56-a705-5a135ccbabf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:13.806099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc48b-47ac-4e56-a705-5a135ccbabf8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:13.806735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc48b-47ac-4e56-a705-5a135ccbabf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:13.807012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc48b-47ac-4e56-a705-5a135ccbabf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:13.909121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cc48b-47ac-4e56-a705-5a135ccbabf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:13.910550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cc48b-47ac-4e56-a705-5a135ccbabf8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:13.961873 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:14.061239 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 210/422] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:14.066454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a25b1-6edd-4e79-9abe-a53f9e8f3512 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:14.085152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cc48b-47ac-4e56-a705-5a135ccbabf8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:14.204606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cc48b-47ac-4e56-a705-5a135ccbabf8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:14.247912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f215-8c99-4137-a928-a10972552b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:14.248943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f215-8c99-4137-a928-a10972552b50 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:14.249419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f215-8c99-4137-a928-a10972552b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:14.249903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f215-8c99-4137-a928-a10972552b50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:14.258967 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:14.265409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26f215-8c99-4137-a928-a10972552b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-9e26f215-8c99-4137-a928-a10972552b50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:14.271578 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:14.272638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:14.273430 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 211/423] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:45:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:14.279794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f215-8c99-4137-a928-a10972552b50 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:14.320705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a25b1-6edd-4e79-9abe-a53f9e8f3512 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:14.393939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f215-8c99-4137-a928-a10972552b50 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:14.422997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971653ce-3e88-4365-ae7e-b08398e8b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:14.423647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971653ce-3e88-4365-ae7e-b08398e8b960 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:14.423913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971653ce-3e88-4365-ae7e-b08398e8b960 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:14.424190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971653ce-3e88-4365-ae7e-b08398e8b960 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:14.425319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971653ce-3e88-4365-ae7e-b08398e8b960 None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:14.430841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971653ce-3e88-4365-ae7e-b08398e8b960 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:14.433063 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 213/424] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:14 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:14.438911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971653ce-3e88-4365-ae7e-b08398e8b960 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:14.440519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e05c84-7399-4d1e-b730-c813767bc683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:14.443037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e05c84-7399-4d1e-b730-c813767bc683 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:14.443520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e05c84-7399-4d1e-b730-c813767bc683 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:14.444002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e05c84-7399-4d1e-b730-c813767bc683 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:14.445922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e05c84-7399-4d1e-b730-c813767bc683 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:14.446427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e05c84-7399-4d1e-b730-c813767bc683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:14.453494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e05c84-7399-4d1e-b730-c813767bc683 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:14.467817 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 212/425] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:14.484718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e05c84-7399-4d1e-b730-c813767bc683 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:14.577495 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:14.581736 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:14.632983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971653ce-3e88-4365-ae7e-b08398e8b960 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:14.639731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e05c84-7399-4d1e-b730-c813767bc683 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:14.677524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772fe67-88e9-4201-bfd8-3d698315a6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:14.678142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772fe67-88e9-4201-bfd8-3d698315a6ad None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:14.678539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772fe67-88e9-4201-bfd8-3d698315a6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:14.678950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772fe67-88e9-4201-bfd8-3d698315a6ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:14.681566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f134b-19f4-4d0e-8f72-63f8c43d4cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:14.682450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f134b-19f4-4d0e-8f72-63f8c43d4cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:14.683679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f134b-19f4-4d0e-8f72-63f8c43d4cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:14.683963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f134b-19f4-4d0e-8f72-63f8c43d4cd8 None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:14.685150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f134b-19f4-4d0e-8f72-63f8c43d4cd8 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:14.686618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f134b-19f4-4d0e-8f72-63f8c43d4cd8 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:14.689217 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 214/426] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:14 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:14.690394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a810-9b89-4092-8af7-3f543cf6f239 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:14.690695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a810-9b89-4092-8af7-3f543cf6f239 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:14.691538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a810-9b89-4092-8af7-3f543cf6f239 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:14.693259 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 215/427] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:14.694161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a810-9b89-4092-8af7-3f543cf6f239 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:14.764563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772fe67-88e9-4201-bfd8-3d698315a6ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:14.765950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772fe67-88e9-4201-bfd8-3d698315a6ad None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:14.824023 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:14.841321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a810-9b89-4092-8af7-3f543cf6f239 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:14.873794 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 213/428] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:14.873981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25406dc6-5c84-45e0-a692-6faedc8721fc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:14.874221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25406dc6-5c84-45e0-a692-6faedc8721fc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:14.874436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25406dc6-5c84-45e0-a692-6faedc8721fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:14.896000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb213b-b6d3-4b68-abfd-319ec45a7bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:14.896920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb213b-b6d3-4b68-abfd-319ec45a7bfe None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:14.897392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb213b-b6d3-4b68-abfd-319ec45a7bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:14.897965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb213b-b6d3-4b68-abfd-319ec45a7bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:14.898631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-25406dc6-5c84-45e0-a692-6faedc8721fc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:14.899124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb213b-b6d3-4b68-abfd-319ec45a7bfe None admin] RBAC: Adding query filter params (group.id=cd4fa4750b044750bf72d9ff49bd0751, role.id=beb2c562d1d14ef599b41dd5788b6e4d, scope.project.id=123533f35dfa451ba661bea2bceb664c) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:14.899674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb213b-b6d3-4b68-abfd-319ec45a7bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:14.899840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-25406dc6-5c84-45e0-a692-6faedc8721fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:14.901469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb213b-b6d3-4b68-abfd-319ec45a7bfe None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:14.904739 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:14.911266 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 216/429] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 2 00:45:14 2022] GET /identity/v3/role_assignments?group.id=cd4fa4750b044750bf72d9ff49bd0751&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:14.912433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb213b-b6d3-4b68-abfd-319ec45a7bfe None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:14.987232 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 214/430] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:15.049166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb213b-b6d3-4b68-abfd-319ec45a7bfe None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:15.086970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1bb80-20b8-4c55-bd5f-d2f219f8aba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:15.087992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1bb80-20b8-4c55-bd5f-d2f219f8aba2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:15.088461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1bb80-20b8-4c55-bd5f-d2f219f8aba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:15.088944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1bb80-20b8-4c55-bd5f-d2f219f8aba2 None admin] PATH_INFO: `/v3/projects/123533f35dfa451ba661bea2bceb664c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:15.090334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1bb80-20b8-4c55-bd5f-d2f219f8aba2 None admin] RBAC: Authorizing `identity:get_project(project_id=123533f35dfa451ba661bea2bceb664c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:15.092572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1bb80-20b8-4c55-bd5f-d2f219f8aba2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:15.098726 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 217/431] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:14 2022] GET /identity/v3/projects/123533f35dfa451ba661bea2bceb664c => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:15.100923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25406dc6-5c84-45e0-a692-6faedc8721fc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:15.197363 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:15.212659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25406dc6-5c84-45e0-a692-6faedc8721fc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:15.248879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582532f-6abc-416c-a5b8-1278e972220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:15.249511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582532f-6abc-416c-a5b8-1278e972220c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:15.249789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582532f-6abc-416c-a5b8-1278e972220c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:15.250059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582532f-6abc-416c-a5b8-1278e972220c None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:15.251188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582532f-6abc-416c-a5b8-1278e972220c None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:15.252636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582532f-6abc-416c-a5b8-1278e972220c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:15.254422 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 215/432] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:15 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:15.260233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1bb80-20b8-4c55-bd5f-d2f219f8aba2 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:15.275980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f6831-a361-4ed3-82ac-349aa89b57c8 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:15.276591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f6831-a361-4ed3-82ac-349aa89b57c8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:15.277062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f6831-a361-4ed3-82ac-349aa89b57c8 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:15.278660 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 216/433] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:45:15.284793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2a8e1-cd52-47e6-be6f-e9eecbd33cd0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:15.285355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2a8e1-cd52-47e6-be6f-e9eecbd33cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:15.285849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2a8e1-cd52-47e6-be6f-e9eecbd33cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:15.305398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d6b2a8e1-cd52-47e6-be6f-e9eecbd33cd0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:15.306500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6b2a8e1-cd52-47e6-be6f-e9eecbd33cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:15.344524 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:15.390839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1bb80-20b8-4c55-bd5f-d2f219f8aba2 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:15.397678 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 217/434] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:15.398545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2a8e1-cd52-47e6-be6f-e9eecbd33cd0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:15.433629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a0c68-60d4-45de-af34-0a51d6b6ff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:15.434303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a0c68-60d4-45de-af34-0a51d6b6ff15 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:15.434557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a0c68-60d4-45de-af34-0a51d6b6ff15 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:15.435518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a0c68-60d4-45de-af34-0a51d6b6ff15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:15.436512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a0c68-60d4-45de-af34-0a51d6b6ff15 None admin] RBAC: Adding query filter params (group.id=cd4fa4750b044750bf72d9ff49bd0751, role.id=25dd37ef41a046b1b26386c2672249fe, scope.project.id=123533f35dfa451ba661bea2bceb664c) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:15.437650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a0c68-60d4-45de-af34-0a51d6b6ff15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:15.439126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a0c68-60d4-45de-af34-0a51d6b6ff15 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:15.451011 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 218/435] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 2 00:45:15 2022] GET /identity/v3/role_assignments?group.id=cd4fa4750b044750bf72d9ff49bd0751&scope.project.id=123533f35dfa451ba661bea2bceb664c&role.id=25dd37ef41a046b1b26386c2672249fe => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:15.496250 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:15.515424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2a8e1-cd52-47e6-be6f-e9eecbd33cd0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:15.554741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a0d1e-c0a7-47c4-90bd-1e9754fa8d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:15.555466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a0d1e-c0a7-47c4-90bd-1e9754fa8d7c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:15.555693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a0d1e-c0a7-47c4-90bd-1e9754fa8d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:15.555976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a0d1e-c0a7-47c4-90bd-1e9754fa8d7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:15.568306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a0d1e-c0a7-47c4-90bd-1e9754fa8d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-aa0a0d1e-c0a7-47c4-90bd-1e9754fa8d7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:15.573275 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:15.574191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:15.575058 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 218/436] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:15.581300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a0c68-60d4-45de-af34-0a51d6b6ff15 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:15.711147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a0c68-60d4-45de-af34-0a51d6b6ff15 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:15.741453 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:15.749301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a0d1e-c0a7-47c4-90bd-1e9754fa8d7c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:15.751714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372029e-bb7a-46a1-a2c3-88e7f7723965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:15.752334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372029e-bb7a-46a1-a2c3-88e7f7723965 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:15.752618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372029e-bb7a-46a1-a2c3-88e7f7723965 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:15.752893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372029e-bb7a-46a1-a2c3-88e7f7723965 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:15.753572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372029e-bb7a-46a1-a2c3-88e7f7723965 None admin] RBAC: Adding query filter params (name=member) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:15.753880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372029e-bb7a-46a1-a2c3-88e7f7723965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:15.755288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372029e-bb7a-46a1-a2c3-88e7f7723965 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:15.765402 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 219/437] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:45:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:15.770834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372029e-bb7a-46a1-a2c3-88e7f7723965 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:15.876925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a0d1e-c0a7-47c4-90bd-1e9754fa8d7c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:15.894537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372029e-bb7a-46a1-a2c3-88e7f7723965 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:15.915535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2efa06-ded0-4136-ba40-ae9ae8334cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:15.916171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2efa06-ded0-4136-ba40-ae9ae8334cbb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:15.916452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2efa06-ded0-4136-ba40-ae9ae8334cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:15.916725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2efa06-ded0-4136-ba40-ae9ae8334cbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:15.929832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2efa06-ded0-4136-ba40-ae9ae8334cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cf2efa06-ded0-4136-ba40-ae9ae8334cbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:15.936715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:15.937641 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:15.938438 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:15.939085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405341db-098e-4af4-ade5-9bbb617c02c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:15.939085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405341db-098e-4af4-ade5-9bbb617c02c3 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:15.939231 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 219/438] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:45:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:15.939306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405341db-098e-4af4-ade5-9bbb617c02c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:15.939306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405341db-098e-4af4-ade5-9bbb617c02c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:15.939423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d937ca-85b7-433b-acce-caa73fd460e3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:15.939423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d937ca-85b7-433b-acce-caa73fd460e3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:15.939423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d937ca-85b7-433b-acce-caa73fd460e3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:15.943636 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 220/439] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:15.945104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346978-c0d4-4e9d-864c-39c785cc03ed None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:15.945578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346978-c0d4-4e9d-864c-39c785cc03ed None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:15.945681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346978-c0d4-4e9d-864c-39c785cc03ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:15.955166 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:15.967083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e2346978-c0d4-4e9d-864c-39c785cc03ed None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:15.968376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e2346978-c0d4-4e9d-864c-39c785cc03ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:16.010152 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:16.020024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405341db-098e-4af4-ade5-9bbb617c02c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:16.021486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405341db-098e-4af4-ade5-9bbb617c02c3 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:16.040781 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 221/440] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:16.041620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2346978-c0d4-4e9d-864c-39c785cc03ed None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:16.121068 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 220/441] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:16.127400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405341db-098e-4af4-ade5-9bbb617c02c3 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:16.151439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2346978-c0d4-4e9d-864c-39c785cc03ed None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:16.184160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a0e0e-b8c1-49d7-8271-773e3f835bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:16.185331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a0e0e-b8c1-49d7-8271-773e3f835bcb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:16.185816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a0e0e-b8c1-49d7-8271-773e3f835bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:16.186147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a0e0e-b8c1-49d7-8271-773e3f835bcb None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:16.186837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a0e0e-b8c1-49d7-8271-773e3f835bcb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:16.187144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a0e0e-b8c1-49d7-8271-773e3f835bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:16.188512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a0e0e-b8c1-49d7-8271-773e3f835bcb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:16.189842 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:16.197514 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 222/442] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:16.204052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a0e0e-b8c1-49d7-8271-773e3f835bcb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:16.223642 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:16.233600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405341db-098e-4af4-ade5-9bbb617c02c3 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:16.269724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d95bb-60eb-4458-b93c-9f629acf87f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:16.270346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d95bb-60eb-4458-b93c-9f629acf87f5 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:16.270639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d95bb-60eb-4458-b93c-9f629acf87f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:16.270915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d95bb-60eb-4458-b93c-9f629acf87f5 None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:16.272095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d95bb-60eb-4458-b93c-9f629acf87f5 None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:16.273523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d95bb-60eb-4458-b93c-9f629acf87f5 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:16.275301 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 221/443] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:16 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:16.280994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d95bb-60eb-4458-b93c-9f629acf87f5 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:16.311121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a0e0e-b8c1-49d7-8271-773e3f835bcb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:16.345666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311247f0-28c9-412c-b5ea-12242682d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:16.346264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311247f0-28c9-412c-b5ea-12242682d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:16.346547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311247f0-28c9-412c-b5ea-12242682d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:16.346842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311247f0-28c9-412c-b5ea-12242682d0b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:16.380417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d95bb-60eb-4458-b93c-9f629acf87f5 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:16.404906 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:16.411614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311247f0-28c9-412c-b5ea-12242682d0b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:16.413057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311247f0-28c9-412c-b5ea-12242682d0b9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:16.413872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab8e1f-7977-4964-9106-819f23644fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:16.414490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab8e1f-7977-4964-9106-819f23644fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:16.414799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab8e1f-7977-4964-9106-819f23644fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:16.415067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab8e1f-7977-4964-9106-819f23644fd9 None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:16.416167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab8e1f-7977-4964-9106-819f23644fd9 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:16.417570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab8e1f-7977-4964-9106-819f23644fd9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:16.419254 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 222/444] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:16 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:16.419997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab8e1f-7977-4964-9106-819f23644fd9 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:16.447412 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:16.515277 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 223/445] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 02 00:45:16.515277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311247f0-28c9-412c-b5ea-12242682d0b9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:16.520579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab8e1f-7977-4964-9106-819f23644fd9 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:16.554144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea5a91-a9bc-4f43-8136-3670554d6059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:16.554803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea5a91-a9bc-4f43-8136-3670554d6059 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:16.555086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea5a91-a9bc-4f43-8136-3670554d6059 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:16.555352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea5a91-a9bc-4f43-8136-3670554d6059 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:16.565683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea5a91-a9bc-4f43-8136-3670554d6059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-1eea5a91-a9bc-4f43-8136-3670554d6059 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:16.571123 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:16.572056 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:16.572859 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 223/446] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:16.573561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea5a91-a9bc-4f43-8136-3670554d6059 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:16.610733 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:16.617221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311247f0-28c9-412c-b5ea-12242682d0b9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:16.651530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad0416-111a-4f60-8b17-6133dcff275b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:16.652059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad0416-111a-4f60-8b17-6133dcff275b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:16.652339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad0416-111a-4f60-8b17-6133dcff275b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:16.652619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad0416-111a-4f60-8b17-6133dcff275b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:16.654242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad0416-111a-4f60-8b17-6133dcff275b None admin] RBAC: Adding query filter params (group.id=cd4fa4750b044750bf72d9ff49bd0751, role.id=beb2c562d1d14ef599b41dd5788b6e4d, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:16.654568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad0416-111a-4f60-8b17-6133dcff275b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:16.656040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad0416-111a-4f60-8b17-6133dcff275b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:16.659949 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:16.669605 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 224/447] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 2 00:45:16 2022] GET /identity/v3/role_assignments?group.id=cd4fa4750b044750bf72d9ff49bd0751&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=beb2c562d1d14ef599b41dd5788b6e4d => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:16.669605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad0416-111a-4f60-8b17-6133dcff275b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:16.681159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea5a91-a9bc-4f43-8136-3670554d6059 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:16.717653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67ca68-3185-46aa-ae97-9e882523937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:16.718369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67ca68-3185-46aa-ae97-9e882523937a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:16.718674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67ca68-3185-46aa-ae97-9e882523937a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:16.718949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67ca68-3185-46aa-ae97-9e882523937a None admin] PATH_INFO: `/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:16.720167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67ca68-3185-46aa-ae97-9e882523937a None admin] RBAC: Authorizing `identity:get_project(project_id=d73af77d824e4885afc5f1e9a8cdf3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:16.721694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67ca68-3185-46aa-ae97-9e882523937a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:16.723618 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 224/448] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:16 2022] GET /identity/v3/projects/d73af77d824e4885afc5f1e9a8cdf3af => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:16.729155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67ca68-3185-46aa-ae97-9e882523937a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:16.787018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad0416-111a-4f60-8b17-6133dcff275b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:16.825637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8539664-e11a-45ca-8cea-71647964b406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:16.826251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8539664-e11a-45ca-8cea-71647964b406 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:16.826537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8539664-e11a-45ca-8cea-71647964b406 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:16.826880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8539664-e11a-45ca-8cea-71647964b406 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:16.827558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8539664-e11a-45ca-8cea-71647964b406 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:16.827988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8539664-e11a-45ca-8cea-71647964b406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:16.829501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8539664-e11a-45ca-8cea-71647964b406 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:16.838222 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 225/449] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:16.844686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8539664-e11a-45ca-8cea-71647964b406 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:16.847254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67ca68-3185-46aa-ae97-9e882523937a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:16.876265 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:16.895977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8f71e-f04c-49f7-962d-6dc07b8a290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:16.896703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8f71e-f04c-49f7-962d-6dc07b8a290b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:16.897866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8f71e-f04c-49f7-962d-6dc07b8a290b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:16.897866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8f71e-f04c-49f7-962d-6dc07b8a290b None admin] PATH_INFO: `/v3/groups/cd4fa4750b044750bf72d9ff49bd0751` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:16.899115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8f71e-f04c-49f7-962d-6dc07b8a290b None admin] RBAC: Authorizing `identity:get_group(group_id=cd4fa4750b044750bf72d9ff49bd0751)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:16.900087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8f71e-f04c-49f7-962d-6dc07b8a290b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:16.902504 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 225/450] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:16 2022] GET /identity/v3/groups/cd4fa4750b044750bf72d9ff49bd0751 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:16.908749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8f71e-f04c-49f7-962d-6dc07b8a290b None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:16.943057 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:16.980698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8539664-e11a-45ca-8cea-71647964b406 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:17.019230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269aa9bb-8d00-42e8-aa67-564eed6384c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:17.019843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aa9bb-8d00-42e8-aa67-564eed6384c1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:17.020125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aa9bb-8d00-42e8-aa67-564eed6384c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:17.020401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aa9bb-8d00-42e8-aa67-564eed6384c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:17.039682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8f71e-f04c-49f7-962d-6dc07b8a290b None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:17.076753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef610b0-5595-4f82-98d6-cf9ee4b6f893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:17.077354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef610b0-5595-4f82-98d6-cf9ee4b6f893 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:17.077637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef610b0-5595-4f82-98d6-cf9ee4b6f893 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:17.077912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef610b0-5595-4f82-98d6-cf9ee4b6f893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:17.078660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef610b0-5595-4f82-98d6-cf9ee4b6f893 None admin] RBAC: Adding query filter params (group.id=cd4fa4750b044750bf72d9ff49bd0751, role.id=25dd37ef41a046b1b26386c2672249fe, scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:17.078971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef610b0-5595-4f82-98d6-cf9ee4b6f893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:17.080398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef610b0-5595-4f82-98d6-cf9ee4b6f893 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:17.086231 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 226/451] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 2 00:45:16 2022] GET /identity/v3/role_assignments?group.id=cd4fa4750b044750bf72d9ff49bd0751&scope.project.id=d73af77d824e4885afc5f1e9a8cdf3af&role.id=25dd37ef41a046b1b26386c2672249fe => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:17.091312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269aa9bb-8d00-42e8-aa67-564eed6384c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:17.092921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269aa9bb-8d00-42e8-aa67-564eed6384c1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:17.119926 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:17.201161 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 226/452] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 02 00:45:17.207115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef610b0-5595-4f82-98d6-cf9ee4b6f893 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:17.295221 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:17.307367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef610b0-5595-4f82-98d6-cf9ee4b6f893 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:17.342665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3526e-3c80-4a76-881b-db3e73e1807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:17.343302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3526e-3c80-4a76-881b-db3e73e1807b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:17.343584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3526e-3c80-4a76-881b-db3e73e1807b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:17.343860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3526e-3c80-4a76-881b-db3e73e1807b None admin] PATH_INFO: `/v3/projects/bd709e757c564f0baea68763e7e07e28` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:17.344982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3526e-3c80-4a76-881b-db3e73e1807b None admin] RBAC: Authorizing `identity:get_project(project_id=bd709e757c564f0baea68763e7e07e28)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:17.346409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3526e-3c80-4a76-881b-db3e73e1807b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:17.348073 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 227/453] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:45:17 2022] GET /identity/v3/projects/bd709e757c564f0baea68763e7e07e28 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:17.353707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269aa9bb-8d00-42e8-aa67-564eed6384c1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:17.454100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269aa9bb-8d00-42e8-aa67-564eed6384c1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:17.475728 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:17.487082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c123414-b8b6-4371-92b0-7751faaadec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:17.487694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123414-b8b6-4371-92b0-7751faaadec8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:17.487974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123414-b8b6-4371-92b0-7751faaadec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:17.488245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123414-b8b6-4371-92b0-7751faaadec8 None admin] PATH_INFO: `/v3/groups/75adc2e0f8e147009ea68f8b379d7a69` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:17.489335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c123414-b8b6-4371-92b0-7751faaadec8 None admin] RBAC: Authorizing `identity:get_group(group_id=75adc2e0f8e147009ea68f8b379d7a69)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:17.490827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c123414-b8b6-4371-92b0-7751faaadec8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:17.492376 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 227/454] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 2 00:45:17 2022] GET /identity/v3/groups/75adc2e0f8e147009ea68f8b379d7a69 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:17.498861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3526e-3c80-4a76-881b-db3e73e1807b None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:17.593740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3526e-3c80-4a76-881b-db3e73e1807b None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:17.626475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc013fd-049d-4f47-ab3a-c7613c8def5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:17.627094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc013fd-049d-4f47-ab3a-c7613c8def5c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:17.627376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc013fd-049d-4f47-ab3a-c7613c8def5c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:17.627650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc013fd-049d-4f47-ab3a-c7613c8def5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:17.628368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc013fd-049d-4f47-ab3a-c7613c8def5c None admin] RBAC: Adding query filter params (group.id=75adc2e0f8e147009ea68f8b379d7a69, role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=bd709e757c564f0baea68763e7e07e28) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:17.628677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc013fd-049d-4f47-ab3a-c7613c8def5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:17.630096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc013fd-049d-4f47-ab3a-c7613c8def5c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:17.635764 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 228/455] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 2 00:45:17 2022] GET /identity/v3/role_assignments?group.id=75adc2e0f8e147009ea68f8b379d7a69&scope.project.id=bd709e757c564f0baea68763e7e07e28&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:20.207913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b42b8-009f-47f3-93e1-d5d41130301e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:20.208457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b42b8-009f-47f3-93e1-d5d41130301e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:20.208457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b42b8-009f-47f3-93e1-d5d41130301e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:20.210059 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 228/456] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:20.215331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46c9f4-a5e8-4e4b-84f7-54350f7a869d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:20.215792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46c9f4-a5e8-4e4b-84f7-54350f7a869d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:20.216017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46c9f4-a5e8-4e4b-84f7-54350f7a869d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:20.243682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7d46c9f4-a5e8-4e4b-84f7-54350f7a869d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:20.244797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7d46c9f4-a5e8-4e4b-84f7-54350f7a869d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:20.264088 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:20.340395 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 229/457] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:20.456474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a95d0-c709-41fa-becd-e34c22108da6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:20.456765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a95d0-c709-41fa-becd-e34c22108da6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:20.457027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a95d0-c709-41fa-becd-e34c22108da6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:20.458634 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 229/458] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:20.463942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b82480-d2a3-45bd-905f-34099f85b86f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:20.464231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b82480-d2a3-45bd-905f-34099f85b86f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:20.464508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b82480-d2a3-45bd-905f-34099f85b86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:20.486673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-88b82480-d2a3-45bd-905f-34099f85b86f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:20.487843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-88b82480-d2a3-45bd-905f-34099f85b86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:20.569203 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 230/459] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:20.791733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a95d0-c709-41fa-becd-e34c22108da6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:20.875333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b82480-d2a3-45bd-905f-34099f85b86f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:20.938274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a95d0-c709-41fa-becd-e34c22108da6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:20.982701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53ce26-20ac-45c0-b2f0-b8ef5669773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:20.983329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ce26-20ac-45c0-b2f0-b8ef5669773f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:20.983611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ce26-20ac-45c0-b2f0-b8ef5669773f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:20.983885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ce26-20ac-45c0-b2f0-b8ef5669773f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:20.994449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53ce26-20ac-45c0-b2f0-b8ef5669773f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:20.996105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53ce26-20ac-45c0-b2f0-b8ef5669773f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:20.996487 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7e53ce26-20ac-45c0-b2f0-b8ef5669773f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:21.010965 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:21.011943 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:21.013657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:21.013657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:21.013657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:21.013657 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 230/460] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:21.013941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596a9f-a62c-4fdd-9394-90a4c6ea098e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.014009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596a9f-a62c-4fdd-9394-90a4c6ea098e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.014262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596a9f-a62c-4fdd-9394-90a4c6ea098e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.015647 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 231/461] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:21.016487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548445e7-e189-460e-b112-ae21437fdc9a None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.016769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548445e7-e189-460e-b112-ae21437fdc9a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.017018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548445e7-e189-460e-b112-ae21437fdc9a None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.018343 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 232/462] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:21.023823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548445e7-e189-460e-b112-ae21437fdc9a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:21.026711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b82480-d2a3-45bd-905f-34099f85b86f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:21.066302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f54233-e212-48d5-839d-e1a1af84ea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:21.066960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f54233-e212-48d5-839d-e1a1af84ea2b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.067237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f54233-e212-48d5-839d-e1a1af84ea2b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.067537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f54233-e212-48d5-839d-e1a1af84ea2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.072670 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:21.078418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f54233-e212-48d5-839d-e1a1af84ea2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:21.079891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f54233-e212-48d5-839d-e1a1af84ea2b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-78f54233-e212-48d5-839d-e1a1af84ea2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:21.095276 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:21.096231 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:21.097099 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:21.097099 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:21.097099 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:21.097099 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 231/463] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:21.097813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6788361-4b4b-4216-876e-4f3d7c82e7bc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.098090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6788361-4b4b-4216-876e-4f3d7c82e7bc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.098359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6788361-4b4b-4216-876e-4f3d7c82e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.116981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e6788361-4b4b-4216-876e-4f3d7c82e7bc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:21.118142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e6788361-4b4b-4216-876e-4f3d7c82e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:21.141775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548445e7-e189-460e-b112-ae21437fdc9a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:21.178175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd37a74-f33d-464b-8385-a4511a57db3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:21.178796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37a74-f33d-464b-8385-a4511a57db3a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.179177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37a74-f33d-464b-8385-a4511a57db3a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.179351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37a74-f33d-464b-8385-a4511a57db3a None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.179976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd37a74-f33d-464b-8385-a4511a57db3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:21.180487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd37a74-f33d-464b-8385-a4511a57db3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:21.181644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd37a74-f33d-464b-8385-a4511a57db3a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:21.192628 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 232/464] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:21.192628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338819f6-5dc8-43ed-9dee-94fecd7411d7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.192628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338819f6-5dc8-43ed-9dee-94fecd7411d7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.192628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338819f6-5dc8-43ed-9dee-94fecd7411d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.198781 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 233/465] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:21.199712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd37a74-f33d-464b-8385-a4511a57db3a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:21.206828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-338819f6-5dc8-43ed-9dee-94fecd7411d7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:21.207994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-338819f6-5dc8-43ed-9dee-94fecd7411d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:21.267862 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:21.287007 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 233/466] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:21.287935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338819f6-5dc8-43ed-9dee-94fecd7411d7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:21.326810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd37a74-f33d-464b-8385-a4511a57db3a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:21.330291 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:21.398397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e1834-0273-41d1-8934-31ddef295e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:21.399943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e1834-0273-41d1-8934-31ddef295e26 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.400662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e1834-0273-41d1-8934-31ddef295e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.402173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e1834-0273-41d1-8934-31ddef295e26 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.404116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e1834-0273-41d1-8934-31ddef295e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:21.404810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e1834-0273-41d1-8934-31ddef295e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:21.406514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e1834-0273-41d1-8934-31ddef295e26 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:21.433361 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 234/467] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:21.435235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e1834-0273-41d1-8934-31ddef295e26 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:21.479711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338819f6-5dc8-43ed-9dee-94fecd7411d7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:21.541282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e1834-0273-41d1-8934-31ddef295e26 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:21.550475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001dd5e-6a02-487f-8f15-482b4f2054bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:21.551164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001dd5e-6a02-487f-8f15-482b4f2054bc None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.551452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001dd5e-6a02-487f-8f15-482b4f2054bc None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.551813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001dd5e-6a02-487f-8f15-482b4f2054bc None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.552475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001dd5e-6a02-487f-8f15-482b4f2054bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:21.554191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001dd5e-6a02-487f-8f15-482b4f2054bc None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:21.583216 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 234/468] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:45:21 2022] POST /identity/v3/users => generated 246 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:45:21.583997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001dd5e-6a02-487f-8f15-482b4f2054bc None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:21.585369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa432f-fad4-427b-be8d-574c5894b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:21.586323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa432f-fad4-427b-be8d-574c5894b1c9 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.586878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa432f-fad4-427b-be8d-574c5894b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.587349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa432f-fad4-427b-be8d-574c5894b1c9 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.588340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa432f-fad4-427b-be8d-574c5894b1c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:21.590094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa432f-fad4-427b-be8d-574c5894b1c9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:21.618822 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 235/469] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:45:21 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:45:21.620350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa432f-fad4-427b-be8d-574c5894b1c9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:21.659681 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:21.659872 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:21.803475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001dd5e-6a02-487f-8f15-482b4f2054bc None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:21.816152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa432f-fad4-427b-be8d-574c5894b1c9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:21.863778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3693d7f-a736-4db3-bfe7-c0701868d69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:21.865964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693d7f-a736-4db3-bfe7-c0701868d69e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.865964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693d7f-a736-4db3-bfe7-c0701868d69e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.865964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693d7f-a736-4db3-bfe7-c0701868d69e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.870676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c9a9-1596-4e9e-9c94-3bbff12a7296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:21.872322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c9a9-1596-4e9e-9c94-3bbff12a7296 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.872322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c9a9-1596-4e9e-9c94-3bbff12a7296 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.872322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c9a9-1596-4e9e-9c94-3bbff12a7296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.877979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3693d7f-a736-4db3-bfe7-c0701868d69e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:21.879498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3693d7f-a736-4db3-bfe7-c0701868d69e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:21.887906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1c9a9-1596-4e9e-9c94-3bbff12a7296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:21.889557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1c9a9-1596-4e9e-9c94-3bbff12a7296 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-b3693d7f-a736-4db3-bfe7-c0701868d69e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:21.896358 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:21.897252 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:21.898105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:21.898105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:21.898105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:21.898105 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 235/470] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:21.899090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7986a-b72f-44ca-a64f-db2781c6c00a None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.899377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7986a-b72f-44ca-a64f-db2781c6c00a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.899648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7986a-b72f-44ca-a64f-db2781c6c00a None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.901100 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 236/471] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:21.903918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7986a-b72f-44ca-a64f-db2781c6c00a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f6d1c9a9-1596-4e9e-9c94-3bbff12a7296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:21.914171 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:21.915214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:21.916488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:21.916488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:21.916488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:21.916488 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 236/472] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:21.916866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc387a1-af4b-4606-8df7-08790c9be598 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:21.918039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc387a1-af4b-4606-8df7-08790c9be598 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:21.918039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc387a1-af4b-4606-8df7-08790c9be598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:21.942484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4dc387a1-af4b-4606-8df7-08790c9be598 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:21.943741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4dc387a1-af4b-4606-8df7-08790c9be598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:22.029728 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:22.031321 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:22.033349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7986a-b72f-44ca-a64f-db2781c6c00a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:22.036120 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 237/473] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:22.037760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc387a1-af4b-4606-8df7-08790c9be598 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:22.073743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba479e-98bf-41dd-b536-e57d2befbab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:22.075588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba479e-98bf-41dd-b536-e57d2befbab6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:22.076163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba479e-98bf-41dd-b536-e57d2befbab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:22.076688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba479e-98bf-41dd-b536-e57d2befbab6 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:22.077487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba479e-98bf-41dd-b536-e57d2befbab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:22.077999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba479e-98bf-41dd-b536-e57d2befbab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:22.079859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba479e-98bf-41dd-b536-e57d2befbab6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:22.101084 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 237/474] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:22.108056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba479e-98bf-41dd-b536-e57d2befbab6 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:22.182653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc387a1-af4b-4606-8df7-08790c9be598 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:22.232535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdd4e7-f54a-4b3b-824b-ba534c4f1511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:22.233166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdd4e7-f54a-4b3b-824b-ba534c4f1511 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:22.233442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdd4e7-f54a-4b3b-824b-ba534c4f1511 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:22.233713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdd4e7-f54a-4b3b-824b-ba534c4f1511 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:22.234353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdd4e7-f54a-4b3b-824b-ba534c4f1511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:22.234680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdd4e7-f54a-4b3b-824b-ba534c4f1511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:22.236204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdd4e7-f54a-4b3b-824b-ba534c4f1511 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:22.253285 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 238/475] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:22.255177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdd4e7-f54a-4b3b-824b-ba534c4f1511 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:22.296943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba479e-98bf-41dd-b536-e57d2befbab6 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:22.326319 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:22.375734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdd4e7-f54a-4b3b-824b-ba534c4f1511 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:22.382422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24064725-5a70-4c84-b265-1325c496002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:22.383070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064725-5a70-4c84-b265-1325c496002e None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:22.383351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064725-5a70-4c84-b265-1325c496002e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:22.383626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064725-5a70-4c84-b265-1325c496002e None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:22.384278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24064725-5a70-4c84-b265-1325c496002e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:22.385696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24064725-5a70-4c84-b265-1325c496002e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:22.414622 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 238/476] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:45:22 2022] POST /identity/v3/users => generated 248 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:45:22.414622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24064725-5a70-4c84-b265-1325c496002e None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:22.435339 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:22.436450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf63d9-f2c5-48a8-895f-3e60df16b897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:22.437305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf63d9-f2c5-48a8-895f-3e60df16b897 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:22.437785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf63d9-f2c5-48a8-895f-3e60df16b897 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:22.438282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf63d9-f2c5-48a8-895f-3e60df16b897 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:22.439226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf63d9-f2c5-48a8-895f-3e60df16b897 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:22.440872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf63d9-f2c5-48a8-895f-3e60df16b897 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:22.497799 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 239/477] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:45:22 2022] POST /identity/v3/users => generated 249 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:45:22.531991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24064725-5a70-4c84-b265-1325c496002e None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:22.575794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde81ba5-f453-4854-bc0f-7cd504513a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:22.576604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde81ba5-f453-4854-bc0f-7cd504513a52 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:22.576881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde81ba5-f453-4854-bc0f-7cd504513a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:22.577150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde81ba5-f453-4854-bc0f-7cd504513a52 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:22.577890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde81ba5-f453-4854-bc0f-7cd504513a52 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:22.579389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde81ba5-f453-4854-bc0f-7cd504513a52 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:22.587848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.sql.core [None req-bde81ba5-f453-4854-bc0f-7cd504513a52 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 02 00:45:22.587848 n-d-master-1 devstack@keystone.service[81853]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 02 00:45:22.587848 n-d-master-1 devstack@keystone.service[81853]: [parameters: {'id': '3340072dd9b642eb9dca2df36933f91d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 02 00:45:22.587848 n-d-master-1 devstack@keystone.service[81853]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81853) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-bde81ba5-f453-4854-bc0f-7cd504513a52 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result.read() Oct 02 00:45:22.605941 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return ref.to_dict() Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:45:22.607169 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application yield resource Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.session.rollback() Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.force_reraise() Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise self.value Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application session.commit() Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 02 00:45:22.608194 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._prepare_impl() Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.session.flush() Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._flush(objects) Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application compat.raise_( Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application flush_context.execute() Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rec.execute(self) Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 02 00:45:22.609071 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:45:22.609959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result.read() Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:45:22.611982 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [parameters: {'id': '3340072dd9b642eb9dca2df36933f91d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:22.614206 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 02 00:45:22.616275 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:22.625917 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 239/478] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 2 00:45:22 2022] POST /identity/v3/roles => generated 144 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:22.626078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf63d9-f2c5-48a8-895f-3e60df16b897 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:22.743216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf63d9-f2c5-48a8-895f-3e60df16b897 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:22.763111 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:22.788254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ce83c-a18b-40ff-97b5-45801874648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:22.788506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce83c-a18b-40ff-97b5-45801874648f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:22.788722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce83c-a18b-40ff-97b5-45801874648f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:22.788968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce83c-a18b-40ff-97b5-45801874648f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:22.802622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ce83c-a18b-40ff-97b5-45801874648f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1e8ce83c-a18b-40ff-97b5-45801874648f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:22.808341 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:22.809846 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:22.810804 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 240/479] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:45:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:22.815884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde81ba5-f453-4854-bc0f-7cd504513a52 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:22.904734 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:22.925131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde81ba5-f453-4854-bc0f-7cd504513a52 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:22.965060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69423b9-856a-4f4d-8c2c-292981f9acf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:22.966236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69423b9-856a-4f4d-8c2c-292981f9acf3 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:22.966510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69423b9-856a-4f4d-8c2c-292981f9acf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:22.966812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69423b9-856a-4f4d-8c2c-292981f9acf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:22.968347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69423b9-856a-4f4d-8c2c-292981f9acf3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:22.968347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69423b9-856a-4f4d-8c2c-292981f9acf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:22.969174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69423b9-856a-4f4d-8c2c-292981f9acf3 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:22.977887 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 240/480] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:24.129505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c62b-92df-43c2-8f9e-850d6c1ea3cb None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:24.130015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c62b-92df-43c2-8f9e-850d6c1ea3cb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:24.130015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c62b-92df-43c2-8f9e-850d6c1ea3cb None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:24.131671 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 241/481] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:24.137042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cd461-052b-46ba-a0f1-f670b999a0dc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:24.137565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cd461-052b-46ba-a0f1-f670b999a0dc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:24.137669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cd461-052b-46ba-a0f1-f670b999a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:24.169692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f13cd461-052b-46ba-a0f1-f670b999a0dc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:24.171240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f13cd461-052b-46ba-a0f1-f670b999a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:24.264935 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 241/482] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:24.306648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc93a3-c906-4ab4-9cad-a41c9ad5a85d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:24.306974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc93a3-c906-4ab4-9cad-a41c9ad5a85d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:24.307203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc93a3-c906-4ab4-9cad-a41c9ad5a85d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:24.308537 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 242/483] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:24.314299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7d248-3456-48f6-ab3c-dd3ecc980760 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:24.314584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7d248-3456-48f6-ab3c-dd3ecc980760 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:24.314883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7d248-3456-48f6-ab3c-dd3ecc980760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:24.339589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9be7d248-3456-48f6-ab3c-dd3ecc980760 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:24.341409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9be7d248-3456-48f6-ab3c-dd3ecc980760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:24.428664 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 242/484] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:24.645175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc93a3-c906-4ab4-9cad-a41c9ad5a85d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:24.768686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc93a3-c906-4ab4-9cad-a41c9ad5a85d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:24.775313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7d248-3456-48f6-ab3c-dd3ecc980760 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:24.777580 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:24.806758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8e096-aa52-4959-8c80-85f5c6d5d2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:24.807384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8e096-aa52-4959-8c80-85f5c6d5d2da None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:24.807945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8e096-aa52-4959-8c80-85f5c6d5d2da None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:24.808220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8e096-aa52-4959-8c80-85f5c6d5d2da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:24.821069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8e096-aa52-4959-8c80-85f5c6d5d2da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7dd8e096-aa52-4959-8c80-85f5c6d5d2da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:24.826362 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:24.827307 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:24.828108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:24.828809 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 243/485] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:24.839545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8e096-aa52-4959-8c80-85f5c6d5d2da None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:24.879192 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:24.952475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8e096-aa52-4959-8c80-85f5c6d5d2da None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:24.991135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecd6fa-ee54-41d5-819c-3eb462a78b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:24.991747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecd6fa-ee54-41d5-819c-3eb462a78b12 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:24.992025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecd6fa-ee54-41d5-819c-3eb462a78b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:24.992295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecd6fa-ee54-41d5-819c-3eb462a78b12 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:24.993379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecd6fa-ee54-41d5-819c-3eb462a78b12 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:24.993683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecd6fa-ee54-41d5-819c-3eb462a78b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:24.995256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecd6fa-ee54-41d5-819c-3eb462a78b12 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:25.003739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7d248-3456-48f6-ab3c-dd3ecc980760 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:25.004842 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 244/486] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:25.010384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecd6fa-ee54-41d5-819c-3eb462a78b12 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:25.107954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb765a-b7ed-4f7b-ada0-2ead92b42bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:25.108605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb765a-b7ed-4f7b-ada0-2ead92b42bae None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.108885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb765a-b7ed-4f7b-ada0-2ead92b42bae None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.109155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb765a-b7ed-4f7b-ada0-2ead92b42bae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.124904 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:25.129357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecd6fa-ee54-41d5-819c-3eb462a78b12 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:25.132944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb765a-b7ed-4f7b-ada0-2ead92b42bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-45cb765a-b7ed-4f7b-ada0-2ead92b42bae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:25.146100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:25.147521 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:25.148327 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 243/487] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:25.152929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb765a-b7ed-4f7b-ada0-2ead92b42bae None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:25.194024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7fd0f-846c-43be-abc2-4c06e39b3074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:25.194724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7fd0f-846c-43be-abc2-4c06e39b3074 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.195001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7fd0f-846c-43be-abc2-4c06e39b3074 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.195266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7fd0f-846c-43be-abc2-4c06e39b3074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.219730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7fd0f-846c-43be-abc2-4c06e39b3074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:25.221151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7fd0f-846c-43be-abc2-4c06e39b3074 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:25.240579 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f6f7fd0f-846c-43be-abc2-4c06e39b3074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:25.261623 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:25.263413 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:25.264291 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:25.264291 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:25.264291 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:25.264291 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 245/488] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:25.264801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee284f93-e1a9-46b4-9f7d-148094e260b3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.265366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee284f93-e1a9-46b4-9f7d-148094e260b3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.265784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee284f93-e1a9-46b4-9f7d-148094e260b3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.271511 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 246/489] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:25.272392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee284f93-e1a9-46b4-9f7d-148094e260b3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:25.279881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb765a-b7ed-4f7b-ada0-2ead92b42bae None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:25.315409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033814e-46ae-410f-a9ee-294489f85161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:25.316020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033814e-46ae-410f-a9ee-294489f85161 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.316295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033814e-46ae-410f-a9ee-294489f85161 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.316567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033814e-46ae-410f-a9ee-294489f85161 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.321092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033814e-46ae-410f-a9ee-294489f85161 None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:25.321417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033814e-46ae-410f-a9ee-294489f85161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:25.322937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033814e-46ae-410f-a9ee-294489f85161 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:25.331998 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 244/490] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:25.333391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a3bbc-9675-4403-8222-29aba7e59707 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.333731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a3bbc-9675-4403-8222-29aba7e59707 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.334009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a3bbc-9675-4403-8222-29aba7e59707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.352490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-323a3bbc-9675-4403-8222-29aba7e59707 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:25.353670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-323a3bbc-9675-4403-8222-29aba7e59707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:25.401938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee284f93-e1a9-46b4-9f7d-148094e260b3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:25.428795 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 245/491] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:25.429756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a3bbc-9675-4403-8222-29aba7e59707 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:25.440345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc444c5-071d-45de-a990-c32445284c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:25.441110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc444c5-071d-45de-a990-c32445284c01 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.441485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc444c5-071d-45de-a990-c32445284c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.441953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc444c5-071d-45de-a990-c32445284c01 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.442749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc444c5-071d-45de-a990-c32445284c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:25.443144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc444c5-071d-45de-a990-c32445284c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:25.444755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc444c5-071d-45de-a990-c32445284c01 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:25.473841 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 247/492] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:25.479435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc444c5-071d-45de-a990-c32445284c01 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:25.498288 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:25.503148 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:25.541496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a3bbc-9675-4403-8222-29aba7e59707 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:25.580298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50cfa7-9512-4a70-b8fd-949d163aaa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:25.580935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50cfa7-9512-4a70-b8fd-949d163aaa1b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.581214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50cfa7-9512-4a70-b8fd-949d163aaa1b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.581484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50cfa7-9512-4a70-b8fd-949d163aaa1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.594222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50cfa7-9512-4a70-b8fd-949d163aaa1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:25.596159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50cfa7-9512-4a70-b8fd-949d163aaa1b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-4b50cfa7-9512-4a70-b8fd-949d163aaa1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:25.615198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:25.616178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:25.617053 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:25.617053 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:25.617053 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:25.617053 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 246/493] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:25.617959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b09ed-1397-4a3b-a3b3-70a43b371ded None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.618248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b09ed-1397-4a3b-a3b3-70a43b371ded None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.618521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b09ed-1397-4a3b-a3b3-70a43b371ded None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.624607 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 247/494] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:25.624607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b09ed-1397-4a3b-a3b3-70a43b371ded None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:25.680725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc444c5-071d-45de-a990-c32445284c01 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:25.718159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895fe1-41bb-4e9f-a614-0d5e4f2c4ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:25.718820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895fe1-41bb-4e9f-a614-0d5e4f2c4ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.719102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895fe1-41bb-4e9f-a614-0d5e4f2c4ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.719471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895fe1-41bb-4e9f-a614-0d5e4f2c4ae8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.727231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42895fe1-41bb-4e9f-a614-0d5e4f2c4ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:25.728603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42895fe1-41bb-4e9f-a614-0d5e4f2c4ae8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:25.743219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b09ed-1397-4a3b-a3b3-70a43b371ded None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-42895fe1-41bb-4e9f-a614-0d5e4f2c4ae8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:25.747468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:25.748363 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:25.749346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:25.749346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:25.749346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:25.749346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:25.749346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:25.749346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:25.749346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:25.749346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:25.749346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:45:25.749346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:25.749346 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 248/495] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:25.750430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce6e86-3401-4bcb-9f5d-7d6db8fc8d8e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.750430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce6e86-3401-4bcb-9f5d-7d6db8fc8d8e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.754663 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:25.754799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce6e86-3401-4bcb-9f5d-7d6db8fc8d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.772290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-96ce6e86-3401-4bcb-9f5d-7d6db8fc8d8e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:25.773479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96ce6e86-3401-4bcb-9f5d-7d6db8fc8d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:25.783065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702415b-5ee9-49dd-a08f-91e7f408ec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:25.784037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702415b-5ee9-49dd-a08f-91e7f408ec2f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.784323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702415b-5ee9-49dd-a08f-91e7f408ec2f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.784901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702415b-5ee9-49dd-a08f-91e7f408ec2f None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.785567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702415b-5ee9-49dd-a08f-91e7f408ec2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:25.785879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702415b-5ee9-49dd-a08f-91e7f408ec2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:25.787278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702415b-5ee9-49dd-a08f-91e7f408ec2f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:25.804643 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 248/496] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:25.804643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702415b-5ee9-49dd-a08f-91e7f408ec2f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:25.844681 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:25.849530 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 249/497] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:25.850352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce6e86-3401-4bcb-9f5d-7d6db8fc8d8e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:25.927353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702415b-5ee9-49dd-a08f-91e7f408ec2f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:25.983005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98203ce3-e77d-43fa-ab20-bb68c5e886e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:25.984583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98203ce3-e77d-43fa-ab20-bb68c5e886e0 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:25.984867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98203ce3-e77d-43fa-ab20-bb68c5e886e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:25.985138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98203ce3-e77d-43fa-ab20-bb68c5e886e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:25.998752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce6e86-3401-4bcb-9f5d-7d6db8fc8d8e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:25.999900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98203ce3-e77d-43fa-ab20-bb68c5e886e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-98203ce3-e77d-43fa-ab20-bb68c5e886e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:26.006460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:26.007496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:26.008293 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:26.008896 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 249/498] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:26.009661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98203ce3-e77d-43fa-ab20-bb68c5e886e0 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:26.041316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f57201-94e9-40db-939c-708e31d7ffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:26.041934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f57201-94e9-40db-939c-708e31d7ffc9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.042212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f57201-94e9-40db-939c-708e31d7ffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.042358 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:26.042496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f57201-94e9-40db-939c-708e31d7ffc9 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.043889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f57201-94e9-40db-939c-708e31d7ffc9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:26.044172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f57201-94e9-40db-939c-708e31d7ffc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:26.046079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f57201-94e9-40db-939c-708e31d7ffc9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:26.084556 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 250/499] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 2 00:45:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:26.085475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f57201-94e9-40db-939c-708e31d7ffc9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:26.126081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98203ce3-e77d-43fa-ab20-bb68c5e886e0 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:26.144861 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:26.158967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29eb64-46b2-4f10-b086-f66b4c0119e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:26.159586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29eb64-46b2-4f10-b086-f66b4c0119e1 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.159861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29eb64-46b2-4f10-b086-f66b4c0119e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.160133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29eb64-46b2-4f10-b086-f66b4c0119e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.167323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29eb64-46b2-4f10-b086-f66b4c0119e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:26.169271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29eb64-46b2-4f10-b086-f66b4c0119e1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-be29eb64-46b2-4f10-b086-f66b4c0119e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:26.181611 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:26.182547 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:26.183498 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:26.183498 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:26.183498 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:26.183498 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:26.183498 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:26.183498 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:26.183498 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:26.183498 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:26.183498 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:45:26.183498 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:26.183498 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 250/500] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 2 00:45:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:26.184698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c1a0-e0b4-4313-a5fb-6803913b7966 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.184698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c1a0-e0b4-4313-a5fb-6803913b7966 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.184916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c1a0-e0b4-4313-a5fb-6803913b7966 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.186071 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 251/501] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:26.186777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c1a0-e0b4-4313-a5fb-6803913b7966 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:26.193061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f57201-94e9-40db-939c-708e31d7ffc9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:26.225761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bdab8-73c2-4242-9644-400747eb1bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:26.226361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bdab8-73c2-4242-9644-400747eb1bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.226636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bdab8-73c2-4242-9644-400747eb1bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.226900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bdab8-73c2-4242-9644-400747eb1bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.227548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bdab8-73c2-4242-9644-400747eb1bd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:26.227845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bdab8-73c2-4242-9644-400747eb1bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:26.229224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bdab8-73c2-4242-9644-400747eb1bd7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:26.237756 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 251/502] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:26.238736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bdab8-73c2-4242-9644-400747eb1bd7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:26.275198 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:26.291184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c1a0-e0b4-4313-a5fb-6803913b7966 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:26.325620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318183b6-6bfd-41b6-84c4-fde32fa271c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:26.326253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318183b6-6bfd-41b6-84c4-fde32fa271c6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.326532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318183b6-6bfd-41b6-84c4-fde32fa271c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.326835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318183b6-6bfd-41b6-84c4-fde32fa271c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.339351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bdab8-73c2-4242-9644-400747eb1bd7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:26.358797 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:26.374357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1424660-67e1-4edd-9212-c4072b53850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:26.375006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424660-67e1-4edd-9212-c4072b53850a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.375284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424660-67e1-4edd-9212-c4072b53850a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.375552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424660-67e1-4edd-9212-c4072b53850a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.385338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1424660-67e1-4edd-9212-c4072b53850a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c1424660-67e1-4edd-9212-c4072b53850a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:26.391094 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:26.392113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:26.393000 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 252/503] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:26.393670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318183b6-6bfd-41b6-84c4-fde32fa271c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:26.393751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1424660-67e1-4edd-9212-c4072b53850a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:26.394380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318183b6-6bfd-41b6-84c4-fde32fa271c6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:26.476806 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:26.491162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1424660-67e1-4edd-9212-c4072b53850a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:26.492194 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 252/504] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:26.493405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4e10-e076-49f7-b838-4b4d59d2423d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.493691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4e10-e076-49f7-b838-4b4d59d2423d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.493968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4e10-e076-49f7-b838-4b4d59d2423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.511318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0fde4e10-e076-49f7-b838-4b4d59d2423d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:26.513239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0fde4e10-e076-49f7-b838-4b4d59d2423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:26.529181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3155e0c-8829-49ae-8715-7fe7d3546c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:26.529784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3155e0c-8829-49ae-8715-7fe7d3546c0c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.530069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3155e0c-8829-49ae-8715-7fe7d3546c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.530346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3155e0c-8829-49ae-8715-7fe7d3546c0c None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.531104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3155e0c-8829-49ae-8715-7fe7d3546c0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:26.531414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3155e0c-8829-49ae-8715-7fe7d3546c0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:26.532861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3155e0c-8829-49ae-8715-7fe7d3546c0c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:26.549799 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 253/505] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 2 00:45:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:26.550588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3155e0c-8829-49ae-8715-7fe7d3546c0c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:26.579426 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 253/506] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:26.580247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde4e10-e076-49f7-b838-4b4d59d2423d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:26.605826 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:26.669659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3155e0c-8829-49ae-8715-7fe7d3546c0c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:26.679258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde4e10-e076-49f7-b838-4b4d59d2423d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:26.696025 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:26.705232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e91b8-4821-4f1c-9a53-a613a918892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:26.705859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e91b8-4821-4f1c-9a53-a613a918892d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.706150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e91b8-4821-4f1c-9a53-a613a918892d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.706414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e91b8-4821-4f1c-9a53-a613a918892d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.715632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c0efe-3346-4f3e-a93f-c6def74c2fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:26.716234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c0efe-3346-4f3e-a93f-c6def74c2fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.716512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c0efe-3346-4f3e-a93f-c6def74c2fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.716781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c0efe-3346-4f3e-a93f-c6def74c2fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.717016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e91b8-4821-4f1c-9a53-a613a918892d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:26.717440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c0efe-3346-4f3e-a93f-c6def74c2fc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:26.717744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c0efe-3346-4f3e-a93f-c6def74c2fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:26.718676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e91b8-4821-4f1c-9a53-a613a918892d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:26.719131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c0efe-3346-4f3e-a93f-c6def74c2fc4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:26.731648 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 254/507] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:26.731648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c0efe-3346-4f3e-a93f-c6def74c2fc4 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-843e91b8-4821-4f1c-9a53-a613a918892d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:26.737883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:26.739021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:26.739986 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:26.739986 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:26.739986 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:26.739986 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 254/508] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:26.740209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e91b8-4821-4f1c-9a53-a613a918892d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:26.833626 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:26.837643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c0efe-3346-4f3e-a93f-c6def74c2fc4 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:26.844239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e91b8-4821-4f1c-9a53-a613a918892d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:26.870495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efec4e-283e-48c8-8259-c401faa0561b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:26.871221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efec4e-283e-48c8-8259-c401faa0561b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.871734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efec4e-283e-48c8-8259-c401faa0561b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.872012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efec4e-283e-48c8-8259-c401faa0561b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.878170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfaa73-a697-4672-bbe8-69943772631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:26.878803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfaa73-a697-4672-bbe8-69943772631c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:26.879080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfaa73-a697-4672-bbe8-69943772631c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:26.879350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfaa73-a697-4672-bbe8-69943772631c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:26.882176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efec4e-283e-48c8-8259-c401faa0561b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:26.883636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efec4e-283e-48c8-8259-c401faa0561b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-88efec4e-283e-48c8-8259-c401faa0561b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:26.897817 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:26.898835 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:26.899697 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:26.899697 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:26.899697 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:26.899697 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 255/509] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:26.899697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efec4e-283e-48c8-8259-c401faa0561b None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:26.931267 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:26.946380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfaa73-a697-4672-bbe8-69943772631c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:26.947904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfaa73-a697-4672-bbe8-69943772631c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.002321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efec4e-283e-48c8-8259-c401faa0561b None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.038422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59319af9-9ab4-4607-9753-43c3c2558247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.039094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59319af9-9ab4-4607-9753-43c3c2558247 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.039376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59319af9-9ab4-4607-9753-43c3c2558247 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.039645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59319af9-9ab4-4607-9753-43c3c2558247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.046182 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:27.050047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59319af9-9ab4-4607-9753-43c3c2558247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.051615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59319af9-9ab4-4607-9753-43c3c2558247 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.056360 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 255/510] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:27.057180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfaa73-a697-4672-bbe8-69943772631c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-59319af9-9ab4-4607-9753-43c3c2558247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:27.066843 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:27.067818 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:27.068660 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:27.068660 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:27.068660 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:27.068660 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 256/511] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:27.068660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59319af9-9ab4-4607-9753-43c3c2558247 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.148341 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:27.156694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfaa73-a697-4672-bbe8-69943772631c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.167079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59319af9-9ab4-4607-9753-43c3c2558247 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.190192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499719ea-46c4-4ac5-aa0e-2ffc5bf100ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.190814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499719ea-46c4-4ac5-aa0e-2ffc5bf100ff None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.191093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499719ea-46c4-4ac5-aa0e-2ffc5bf100ff None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.191369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499719ea-46c4-4ac5-aa0e-2ffc5bf100ff None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.192000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499719ea-46c4-4ac5-aa0e-2ffc5bf100ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:27.192302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499719ea-46c4-4ac5-aa0e-2ffc5bf100ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.193662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499719ea-46c4-4ac5-aa0e-2ffc5bf100ff None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.200321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cfc64-a4af-43b0-a001-4c293fd61134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.200947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cfc64-a4af-43b0-a001-4c293fd61134 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.201226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cfc64-a4af-43b0-a001-4c293fd61134 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.201499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cfc64-a4af-43b0-a001-4c293fd61134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.205057 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 256/512] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:27.205847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499719ea-46c4-4ac5-aa0e-2ffc5bf100ff None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.211780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cfc64-a4af-43b0-a001-4c293fd61134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.213218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cfc64-a4af-43b0-a001-4c293fd61134 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-a38cfc64-a4af-43b0-a001-4c293fd61134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:27.227333 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:27.228332 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:27.229193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:27.229193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:27.229193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:27.229193 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 257/513] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:27.229193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cfc64-a4af-43b0-a001-4c293fd61134 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.258699 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:27.308389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499719ea-46c4-4ac5-aa0e-2ffc5bf100ff None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.327583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cfc64-a4af-43b0-a001-4c293fd61134 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.345028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33f949-4e24-4432-b834-b7c457b75c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.345632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f949-4e24-4432-b834-b7c457b75c1e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.345910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f949-4e24-4432-b834-b7c457b75c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.346183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f949-4e24-4432-b834-b7c457b75c1e None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.346850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33f949-4e24-4432-b834-b7c457b75c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:27.347152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33f949-4e24-4432-b834-b7c457b75c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.348543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33f949-4e24-4432-b834-b7c457b75c1e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.359813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f40b6-bb1f-4746-bc6c-09eff3a85f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.360436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f40b6-bb1f-4746-bc6c-09eff3a85f65 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.360554 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 257/514] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:27.360736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f40b6-bb1f-4746-bc6c-09eff3a85f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.360987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f40b6-bb1f-4746-bc6c-09eff3a85f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.361215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33f949-4e24-4432-b834-b7c457b75c1e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.368050 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:27.372494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f40b6-bb1f-4746-bc6c-09eff3a85f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.374431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f40b6-bb1f-4746-bc6c-09eff3a85f65 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-1d2f40b6-bb1f-4746-bc6c-09eff3a85f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:27.388773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:27.389865 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:27.391006 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:27.391006 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:27.391006 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:27.391006 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 258/515] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:27.391006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f40b6-bb1f-4746-bc6c-09eff3a85f65 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.467888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33f949-4e24-4432-b834-b7c457b75c1e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.478817 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:27.487985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f40b6-bb1f-4746-bc6c-09eff3a85f65 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.502591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cd136-9cfc-455b-a086-e3b86501d56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.503219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cd136-9cfc-455b-a086-e3b86501d56d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.503495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cd136-9cfc-455b-a086-e3b86501d56d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.503765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cd136-9cfc-455b-a086-e3b86501d56d None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.504403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cd136-9cfc-455b-a086-e3b86501d56d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:27.504702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cd136-9cfc-455b-a086-e3b86501d56d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.506080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cd136-9cfc-455b-a086-e3b86501d56d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.516855 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 258/516] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:27.517628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cd136-9cfc-455b-a086-e3b86501d56d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.521682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b6581-2e70-4c47-b996-88ceb988e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.522368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b6581-2e70-4c47-b996-88ceb988e94f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.522681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b6581-2e70-4c47-b996-88ceb988e94f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.522961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b6581-2e70-4c47-b996-88ceb988e94f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.530334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b6581-2e70-4c47-b996-88ceb988e94f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.531812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b6581-2e70-4c47-b996-88ceb988e94f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-b77b6581-2e70-4c47-b996-88ceb988e94f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:27.542897 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:27.544755 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 259/517] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:27.545986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b6581-2e70-4c47-b996-88ceb988e94f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.592285 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:27.620201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cd136-9cfc-455b-a086-e3b86501d56d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.645773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b6581-2e70-4c47-b996-88ceb988e94f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.653796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cbeb5-bd5b-46d3-8367-80237da3cd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.654395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cbeb5-bd5b-46d3-8367-80237da3cd73 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.654773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cbeb5-bd5b-46d3-8367-80237da3cd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.655048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cbeb5-bd5b-46d3-8367-80237da3cd73 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.655696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cbeb5-bd5b-46d3-8367-80237da3cd73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:27.655998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cbeb5-bd5b-46d3-8367-80237da3cd73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.657368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cbeb5-bd5b-46d3-8367-80237da3cd73 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.668525 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 259/518] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:27.671648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cbeb5-bd5b-46d3-8367-80237da3cd73 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.678918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b2b5e-e731-4a80-ad39-a81af639d747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.679572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b2b5e-e731-4a80-ad39-a81af639d747 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.679854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b2b5e-e731-4a80-ad39-a81af639d747 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.680126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b2b5e-e731-4a80-ad39-a81af639d747 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.686683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b2b5e-e731-4a80-ad39-a81af639d747 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.688065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b2b5e-e731-4a80-ad39-a81af639d747 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-f38b2b5e-e731-4a80-ad39-a81af639d747 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:27.700278 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:27.701228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:27.707100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:27.707100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:27.707100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:27.707100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:27.707100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:27.707100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:27.707100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:27.707100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:27.707100 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 260/519] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:27.707100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b2b5e-e731-4a80-ad39-a81af639d747 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.710684 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:27.769111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cbeb5-bd5b-46d3-8367-80237da3cd73 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.799876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b2b5e-e731-4a80-ad39-a81af639d747 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.802401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f205690-c360-48e0-902e-4991ae0a5848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.803032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f205690-c360-48e0-902e-4991ae0a5848 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.803313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f205690-c360-48e0-902e-4991ae0a5848 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.803586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f205690-c360-48e0-902e-4991ae0a5848 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.804223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f205690-c360-48e0-902e-4991ae0a5848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:27.804522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f205690-c360-48e0-902e-4991ae0a5848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.805890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f205690-c360-48e0-902e-4991ae0a5848 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.806968 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:27.817741 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 260/520] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:27.818537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f205690-c360-48e0-902e-4991ae0a5848 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.842723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6593a58-707e-41e6-a783-e11ebe25b5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.843342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593a58-707e-41e6-a783-e11ebe25b5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.843618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593a58-707e-41e6-a783-e11ebe25b5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.843882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593a58-707e-41e6-a783-e11ebe25b5e9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.850910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6593a58-707e-41e6-a783-e11ebe25b5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.852340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6593a58-707e-41e6-a783-e11ebe25b5e9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-e6593a58-707e-41e6-a783-e11ebe25b5e9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:27.863492 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:27.864551 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:27.865808 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:27.865808 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:27.865808 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:27.865808 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:27.865808 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:27.865808 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:27.865808 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:27.865808 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:27.865808 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:45:27.865808 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:27.866752 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 261/521] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:27.867582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6593a58-707e-41e6-a783-e11ebe25b5e9 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:27.908498 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:27.919024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f205690-c360-48e0-902e-4991ae0a5848 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.953439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd303612-9d7b-483d-bcfd-d298f7b81e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:27.954124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd303612-9d7b-483d-bcfd-d298f7b81e53 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:27.954410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd303612-9d7b-483d-bcfd-d298f7b81e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:27.954713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd303612-9d7b-483d-bcfd-d298f7b81e53 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:27.955443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd303612-9d7b-483d-bcfd-d298f7b81e53 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:27.955749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd303612-9d7b-483d-bcfd-d298f7b81e53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:27.957182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd303612-9d7b-483d-bcfd-d298f7b81e53 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:27.966030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6593a58-707e-41e6-a783-e11ebe25b5e9 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:27.975624 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 261/522] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:27.976447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd303612-9d7b-483d-bcfd-d298f7b81e53 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:28.002095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f45b1-5357-4cda-a066-d16cd61ab67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:28.002731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f45b1-5357-4cda-a066-d16cd61ab67e None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:28.003012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f45b1-5357-4cda-a066-d16cd61ab67e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:28.003285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f45b1-5357-4cda-a066-d16cd61ab67e None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:28.003917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f45b1-5357-4cda-a066-d16cd61ab67e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:28.005341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f45b1-5357-4cda-a066-d16cd61ab67e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:28.030872 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 262/523] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:45:27 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:45:28.032356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f45b1-5357-4cda-a066-d16cd61ab67e None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:28.068145 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:28.086285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd303612-9d7b-483d-bcfd-d298f7b81e53 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:28.124767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f54462-6410-49a3-8c04-381153bdfd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:28.125386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f54462-6410-49a3-8c04-381153bdfd14 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:28.125670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f54462-6410-49a3-8c04-381153bdfd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:28.125945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f54462-6410-49a3-8c04-381153bdfd14 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:28.126685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f54462-6410-49a3-8c04-381153bdfd14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:28.127000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f54462-6410-49a3-8c04-381153bdfd14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:28.128498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f54462-6410-49a3-8c04-381153bdfd14 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:28.147649 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 262/524] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:28.148511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f54462-6410-49a3-8c04-381153bdfd14 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:28.162174 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:28.163485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f45b1-5357-4cda-a066-d16cd61ab67e None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:28.205629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f28c7-2994-4029-be52-2ede7c995791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:28.206247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f28c7-2994-4029-be52-2ede7c995791 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:28.206529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f28c7-2994-4029-be52-2ede7c995791 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:28.206835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f28c7-2994-4029-be52-2ede7c995791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:28.215786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f28c7-2994-4029-be52-2ede7c995791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:28.217252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f28c7-2994-4029-be52-2ede7c995791 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-400f28c7-2994-4029-be52-2ede7c995791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:28.229371 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:28.230257 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:28.232050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:28.232050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:28.232050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:28.232050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:28.232050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:28.232050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:28.232050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:28.232050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:28.232050 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 263/525] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:28.232050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f28c7-2994-4029-be52-2ede7c995791 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:28.269933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f54462-6410-49a3-8c04-381153bdfd14 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:28.306442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4c462-f70a-48ce-ab06-84214cecee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:28.307274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c462-f70a-48ce-ab06-84214cecee49 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:28.307554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c462-f70a-48ce-ab06-84214cecee49 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:28.307823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c462-f70a-48ce-ab06-84214cecee49 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:28.310289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4c462-f70a-48ce-ab06-84214cecee49 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:28.310648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4c462-f70a-48ce-ab06-84214cecee49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:28.312121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4c462-f70a-48ce-ab06-84214cecee49 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:28.322979 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:28.335684 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 263/526] 10.222.0.23 () {56 vars in 1139 bytes} [Sun Oct 2 00:45:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:28.336525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4c462-f70a-48ce-ab06-84214cecee49 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:28.344908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f28c7-2994-4029-be52-2ede7c995791 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:28.383870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9420b3-1a5d-44c5-a6b4-455ac63be0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:28.385367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9420b3-1a5d-44c5-a6b4-455ac63be0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:28.386022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9420b3-1a5d-44c5-a6b4-455ac63be0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:28.386294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9420b3-1a5d-44c5-a6b4-455ac63be0a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:28.408814 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:28.451532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4c462-f70a-48ce-ab06-84214cecee49 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:28.461768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9420b3-1a5d-44c5-a6b4-455ac63be0a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:28.463604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9420b3-1a5d-44c5-a6b4-455ac63be0a6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:28.489596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be134ee-6c62-42ae-9f27-69d450d8e8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:28.490192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be134ee-6c62-42ae-9f27-69d450d8e8ee None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:28.490468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be134ee-6c62-42ae-9f27-69d450d8e8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:28.490768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be134ee-6c62-42ae-9f27-69d450d8e8ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:28.491484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be134ee-6c62-42ae-9f27-69d450d8e8ee None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=7cee33d8425d4be0ba5721ec419a12e1) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:28.491787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be134ee-6c62-42ae-9f27-69d450d8e8ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:28.493211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be134ee-6c62-42ae-9f27-69d450d8e8ee None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:28.499439 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 264/527] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:28 2022] GET /identity/v3/role_assignments?user.id=7cee33d8425d4be0ba5721ec419a12e1&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:28.510394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be134ee-6c62-42ae-9f27-69d450d8e8ee None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:28.565169 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:28.593597 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 264/528] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:28.594671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9420b3-1a5d-44c5-a6b4-455ac63be0a6 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:28.647396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be134ee-6c62-42ae-9f27-69d450d8e8ee None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:28.691794 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:28.697548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c0e1a-b61d-437e-8bf9-8c083aa49a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:28.698157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0e1a-b61d-437e-8bf9-8c083aa49a8e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:28.698434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0e1a-b61d-437e-8bf9-8c083aa49a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:28.698751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0e1a-b61d-437e-8bf9-8c083aa49a8e None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:28.699566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c0e1a-b61d-437e-8bf9-8c083aa49a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:28.700035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c0e1a-b61d-437e-8bf9-8c083aa49a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:28.702172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c0e1a-b61d-437e-8bf9-8c083aa49a8e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:28.719963 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 265/529] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:28.721131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c0e1a-b61d-437e-8bf9-8c083aa49a8e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:28.734724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9420b3-1a5d-44c5-a6b4-455ac63be0a6 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:28.772582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5355616-2555-4f97-8b83-2ff2a4a85206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:28.773184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355616-2555-4f97-8b83-2ff2a4a85206 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:28.773463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355616-2555-4f97-8b83-2ff2a4a85206 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:28.773734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355616-2555-4f97-8b83-2ff2a4a85206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:28.834936 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:28.867307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5355616-2555-4f97-8b83-2ff2a4a85206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:28.868772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5355616-2555-4f97-8b83-2ff2a4a85206 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:28.869503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c0e1a-b61d-437e-8bf9-8c083aa49a8e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:28.919104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436fa6-aa9d-40c2-be5f-46f5339e6be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:28.919824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436fa6-aa9d-40c2-be5f-46f5339e6be5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:28.920370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436fa6-aa9d-40c2-be5f-46f5339e6be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:28.920648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436fa6-aa9d-40c2-be5f-46f5339e6be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:28.931193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d436fa6-aa9d-40c2-be5f-46f5339e6be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:28.932702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d436fa6-aa9d-40c2-be5f-46f5339e6be5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7d436fa6-aa9d-40c2-be5f-46f5339e6be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:28.953472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:28.955113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:28.956342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:28.956342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:28.956342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:28.956342 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 266/530] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:28.956342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436fa6-aa9d-40c2-be5f-46f5339e6be5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:29.025444 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:29.029346 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 265/531] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:29.032352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5355616-2555-4f97-8b83-2ff2a4a85206 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:29.099308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436fa6-aa9d-40c2-be5f-46f5339e6be5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:29.136739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dae35-8af2-4d44-a7fe-dabe34e2eb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:29.137588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dae35-8af2-4d44-a7fe-dabe34e2eb79 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:29.137588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dae35-8af2-4d44-a7fe-dabe34e2eb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:29.139120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dae35-8af2-4d44-a7fe-dabe34e2eb79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:29.139318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dae35-8af2-4d44-a7fe-dabe34e2eb79 None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=b85fc7e555f348c3ab6c63ee15f6ceb0) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:29.139579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dae35-8af2-4d44-a7fe-dabe34e2eb79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:29.141035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dae35-8af2-4d44-a7fe-dabe34e2eb79 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:29.148555 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 267/532] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:28 2022] GET /identity/v3/role_assignments?user.id=b85fc7e555f348c3ab6c63ee15f6ceb0&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:29.153818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dae35-8af2-4d44-a7fe-dabe34e2eb79 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:29.156940 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:29.206631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5355616-2555-4f97-8b83-2ff2a4a85206 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:29.295399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd225b9d-8ce9-43cc-a175-41f1eb8a17c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:29.296334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225b9d-8ce9-43cc-a175-41f1eb8a17c8 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:29.296708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225b9d-8ce9-43cc-a175-41f1eb8a17c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:29.296979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225b9d-8ce9-43cc-a175-41f1eb8a17c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:29.297664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd225b9d-8ce9-43cc-a175-41f1eb8a17c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:29.298204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd225b9d-8ce9-43cc-a175-41f1eb8a17c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:29.309329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd225b9d-8ce9-43cc-a175-41f1eb8a17c8 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:29.320158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dae35-8af2-4d44-a7fe-dabe34e2eb79 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:29.333015 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:29.343503 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 266/533] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:29.349445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd225b9d-8ce9-43cc-a175-41f1eb8a17c8 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:29.396071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73613e-3847-4bff-bdb9-2174fda797ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:29.396751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73613e-3847-4bff-bdb9-2174fda797ef None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:29.397032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73613e-3847-4bff-bdb9-2174fda797ef None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:29.397305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73613e-3847-4bff-bdb9-2174fda797ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:29.420374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73613e-3847-4bff-bdb9-2174fda797ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:29.422633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73613e-3847-4bff-bdb9-2174fda797ef None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-bb73613e-3847-4bff-bdb9-2174fda797ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:29.456268 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:29.457263 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:29.458126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:29.458126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:29.458126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:29.458126 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 268/534] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:29.462052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73613e-3847-4bff-bdb9-2174fda797ef None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:29.506351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd225b9d-8ce9-43cc-a175-41f1eb8a17c8 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:29.555272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a54a2-a992-42c2-afaa-a0f8adacd8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:29.555972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a54a2-a992-42c2-afaa-a0f8adacd8cf None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:29.556219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a54a2-a992-42c2-afaa-a0f8adacd8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:29.556479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a54a2-a992-42c2-afaa-a0f8adacd8cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:29.565273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a54a2-a992-42c2-afaa-a0f8adacd8cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:29.566630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a54a2-a992-42c2-afaa-a0f8adacd8cf None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-f44a54a2-a992-42c2-afaa-a0f8adacd8cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:29.581166 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:29.582647 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:29.583573 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:29.583573 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:29.583573 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:29.583573 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:29.583573 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:29.583573 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:29.583573 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:29.583573 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:29.583573 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 267/535] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:29.589374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a54a2-a992-42c2-afaa-a0f8adacd8cf None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:29.592571 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:29.643244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73613e-3847-4bff-bdb9-2174fda797ef None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:29.728182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee5966-931c-4649-bb98-614d719da095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:29.728800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee5966-931c-4649-bb98-614d719da095 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:29.729074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee5966-931c-4649-bb98-614d719da095 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:29.729342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee5966-931c-4649-bb98-614d719da095 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:29.729980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee5966-931c-4649-bb98-614d719da095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:29.730275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee5966-931c-4649-bb98-614d719da095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:29.738714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee5966-931c-4649-bb98-614d719da095 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:29.763711 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 269/536] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:29.768954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee5966-931c-4649-bb98-614d719da095 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:29.783572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a54a2-a992-42c2-afaa-a0f8adacd8cf None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:29.822718 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:29.830652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867892ff-628d-44e4-b303-ab470b5f2cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:29.831248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867892ff-628d-44e4-b303-ab470b5f2cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:29.831524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867892ff-628d-44e4-b303-ab470b5f2cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:29.831798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867892ff-628d-44e4-b303-ab470b5f2cb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:29.832584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867892ff-628d-44e4-b303-ab470b5f2cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:29.832965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867892ff-628d-44e4-b303-ab470b5f2cb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:29.834543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867892ff-628d-44e4-b303-ab470b5f2cb7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:29.855333 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 268/537] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:29.863225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867892ff-628d-44e4-b303-ab470b5f2cb7 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:29.941416 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:29.992111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee5966-931c-4649-bb98-614d719da095 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:30.006886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867892ff-628d-44e4-b303-ab470b5f2cb7 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:30.064782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e100176-7a75-4a7a-b95b-29d234e3f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:30.065419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100176-7a75-4a7a-b95b-29d234e3f6fc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:30.065695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100176-7a75-4a7a-b95b-29d234e3f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:30.065967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100176-7a75-4a7a-b95b-29d234e3f6fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:30.070398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c56a80-8fab-427d-918e-1cdb4e8f8ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:30.071030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c56a80-8fab-427d-918e-1cdb4e8f8ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:30.071306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c56a80-8fab-427d-918e-1cdb4e8f8ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:30.071576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c56a80-8fab-427d-918e-1cdb4e8f8ad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:30.072302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c56a80-8fab-427d-918e-1cdb4e8f8ad7 None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=c62cd9bcc90e4d6685c5d0fc1d8ceae3) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:30.072605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c56a80-8fab-427d-918e-1cdb4e8f8ad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:30.074027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c56a80-8fab-427d-918e-1cdb4e8f8ad7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:30.082309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e100176-7a75-4a7a-b95b-29d234e3f6fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:30.083790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e100176-7a75-4a7a-b95b-29d234e3f6fc None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:30.089726 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 269/538] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:29 2022] GET /identity/v3/role_assignments?user.id=c62cd9bcc90e4d6685c5d0fc1d8ceae3&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-3e100176-7a75-4a7a-b95b-29d234e3f6fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:30.105474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:30.106829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:30.107702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:30.107702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:30.107702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:30.107702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:30.107702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:30.107702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:30.107702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:30.107702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:30.107702 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 270/539] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:30.115797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c56a80-8fab-427d-918e-1cdb4e8f8ad7 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:30.284582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c56a80-8fab-427d-918e-1cdb4e8f8ad7 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:30.321283 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:30.331588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a081a81-5e47-4e71-b57a-4afdfdeaf484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:30.332413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081a81-5e47-4e71-b57a-4afdfdeaf484 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:30.332691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081a81-5e47-4e71-b57a-4afdfdeaf484 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:30.332965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081a81-5e47-4e71-b57a-4afdfdeaf484 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:30.333656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a081a81-5e47-4e71-b57a-4afdfdeaf484 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:30.333956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a081a81-5e47-4e71-b57a-4afdfdeaf484 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:30.335464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a081a81-5e47-4e71-b57a-4afdfdeaf484 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:30.350836 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 270/540] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:30.358046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e100176-7a75-4a7a-b95b-29d234e3f6fc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:30.385837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6c725-a8f4-47d0-8681-5a18bceb170c None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:30.386152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6c725-a8f4-47d0-8681-5a18bceb170c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:30.386407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6c725-a8f4-47d0-8681-5a18bceb170c None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:30.388940 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 271/541] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:45:30.393876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348fe5-49ef-4064-903d-cb59f7575898 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:30.394161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348fe5-49ef-4064-903d-cb59f7575898 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:30.394438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348fe5-49ef-4064-903d-cb59f7575898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:30.433752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-09348fe5-49ef-4064-903d-cb59f7575898 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:30.434985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-09348fe5-49ef-4064-903d-cb59f7575898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:30.498560 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:30.540217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e100176-7a75-4a7a-b95b-29d234e3f6fc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:30.568887 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 272/542] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:45:30.590443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7038c0-5791-4e52-965f-085b9099456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:30.591089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7038c0-5791-4e52-965f-085b9099456d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:30.591369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7038c0-5791-4e52-965f-085b9099456d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:30.591643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7038c0-5791-4e52-965f-085b9099456d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:30.592373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7038c0-5791-4e52-965f-085b9099456d None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=29854b3a4cda48f8a1dea8a01b4589a1) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:30.592684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7038c0-5791-4e52-965f-085b9099456d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:30.594145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7038c0-5791-4e52-965f-085b9099456d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:30.599936 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 271/543] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:30 2022] GET /identity/v3/role_assignments?user.id=29854b3a4cda48f8a1dea8a01b4589a1&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:30.890042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348fe5-49ef-4064-903d-cb59f7575898 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:31.012181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348fe5-49ef-4064-903d-cb59f7575898 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:31.029973 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:31.043022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6626d2-96cb-496e-a5bf-8b02420d7db1 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:31.043798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6626d2-96cb-496e-a5bf-8b02420d7db1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:31.044200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6626d2-96cb-496e-a5bf-8b02420d7db1 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:31.049791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 272/544] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:45:31.051632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6e36b-0b75-4897-94d8-dfd23446e7bf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:31.051919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6e36b-0b75-4897-94d8-dfd23446e7bf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:31.052191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6e36b-0b75-4897-94d8-dfd23446e7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:31.057390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4e00d-dc94-46f5-ac49-1f283a2c8415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:31.058036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4e00d-dc94-46f5-ac49-1f283a2c8415 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:31.058309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4e00d-dc94-46f5-ac49-1f283a2c8415 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:31.058637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4e00d-dc94-46f5-ac49-1f283a2c8415 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:31.072582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5ab6e36b-0b75-4897-94d8-dfd23446e7bf None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:31.073799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5ab6e36b-0b75-4897-94d8-dfd23446e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:31.076154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4e00d-dc94-46f5-ac49-1f283a2c8415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-66d4e00d-dc94-46f5-ac49-1f283a2c8415 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:31.080889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:31.081807 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:31.082615 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 273/545] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:31.089450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4e00d-dc94-46f5-ac49-1f283a2c8415 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:31.168119 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 273/546] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 02 00:45:31.225981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4e00d-dc94-46f5-ac49-1f283a2c8415 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:31.267631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17120e5b-03b0-4305-8f19-424d46161e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:31.268242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17120e5b-03b0-4305-8f19-424d46161e40 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:31.268519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17120e5b-03b0-4305-8f19-424d46161e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:31.268792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17120e5b-03b0-4305-8f19-424d46161e40 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:31.269453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17120e5b-03b0-4305-8f19-424d46161e40 None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:31.269755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17120e5b-03b0-4305-8f19-424d46161e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:31.273638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17120e5b-03b0-4305-8f19-424d46161e40 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:31.284835 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 274/547] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:31.290760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6e36b-0b75-4897-94d8-dfd23446e7bf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:31.397084 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:31.431405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6e36b-0b75-4897-94d8-dfd23446e7bf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:31.473067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129ed16-1a29-4597-8a63-1fca48d1be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:31.474047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129ed16-1a29-4597-8a63-1fca48d1be65 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:31.474551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129ed16-1a29-4597-8a63-1fca48d1be65 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:31.475075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129ed16-1a29-4597-8a63-1fca48d1be65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:31.488746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129ed16-1a29-4597-8a63-1fca48d1be65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:31.490433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129ed16-1a29-4597-8a63-1fca48d1be65 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:31.499529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17120e5b-03b0-4305-8f19-424d46161e40 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c129ed16-1a29-4597-8a63-1fca48d1be65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:31.510515 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:31.511496 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:31.512906 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:31.512906 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:31.512906 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:31.514977 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 274/548] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:31.520733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129ed16-1a29-4597-8a63-1fca48d1be65 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:31.541703 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:31.602531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17120e5b-03b0-4305-8f19-424d46161e40 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:31.637958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765d3ee-b9a1-41d9-8297-ffa50b278a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:31.638588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765d3ee-b9a1-41d9-8297-ffa50b278a33 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:31.638909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765d3ee-b9a1-41d9-8297-ffa50b278a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:31.639185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765d3ee-b9a1-41d9-8297-ffa50b278a33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:31.649741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765d3ee-b9a1-41d9-8297-ffa50b278a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-4765d3ee-b9a1-41d9-8297-ffa50b278a33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:31.654901 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:31.656545 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:31.657704 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 275/549] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:31.661860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765d3ee-b9a1-41d9-8297-ffa50b278a33 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:31.710117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129ed16-1a29-4597-8a63-1fca48d1be65 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:31.753782 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:31.766856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765d3ee-b9a1-41d9-8297-ffa50b278a33 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:31.778938 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:31.783336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762c161-f550-47ac-8ed3-6f8abeacc181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:31.783948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762c161-f550-47ac-8ed3-6f8abeacc181 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:31.784233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762c161-f550-47ac-8ed3-6f8abeacc181 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:31.784507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762c161-f550-47ac-8ed3-6f8abeacc181 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:31.785162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762c161-f550-47ac-8ed3-6f8abeacc181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:31.785467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762c161-f550-47ac-8ed3-6f8abeacc181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:31.786880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762c161-f550-47ac-8ed3-6f8abeacc181 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:31.808390 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 275/550] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:31.812537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23349d0a-be5b-4b0f-b0d0-7e92fbb86173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:31.813034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23349d0a-be5b-4b0f-b0d0-7e92fbb86173 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:31.813314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23349d0a-be5b-4b0f-b0d0-7e92fbb86173 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:31.813585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23349d0a-be5b-4b0f-b0d0-7e92fbb86173 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:31.814265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23349d0a-be5b-4b0f-b0d0-7e92fbb86173 None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:31.814569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23349d0a-be5b-4b0f-b0d0-7e92fbb86173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:31.815981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23349d0a-be5b-4b0f-b0d0-7e92fbb86173 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:31.818281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762c161-f550-47ac-8ed3-6f8abeacc181 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:31.841823 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 276/551] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:31.846274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23349d0a-be5b-4b0f-b0d0-7e92fbb86173 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:31.997628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23349d0a-be5b-4b0f-b0d0-7e92fbb86173 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:32.012744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762c161-f550-47ac-8ed3-6f8abeacc181 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:32.066155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b0bfa-1388-4b19-899f-b9e20397cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:32.067333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b0bfa-1388-4b19-899f-b9e20397cd40 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.067618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b0bfa-1388-4b19-899f-b9e20397cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.067894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b0bfa-1388-4b19-899f-b9e20397cd40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.074015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c789f0-56ca-4d6a-acc8-f09cee28ba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:32.079586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c789f0-56ca-4d6a-acc8-f09cee28ba90 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.079935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c789f0-56ca-4d6a-acc8-f09cee28ba90 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.080217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c789f0-56ca-4d6a-acc8-f09cee28ba90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.083133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b0bfa-1388-4b19-899f-b9e20397cd40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:32.084610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b0bfa-1388-4b19-899f-b9e20397cd40 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:32.103455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c789f0-56ca-4d6a-acc8-f09cee28ba90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:32.104921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c789f0-56ca-4d6a-acc8-f09cee28ba90 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-708b0bfa-1388-4b19-899f-b9e20397cd40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:32.110437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:32.111506 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:32.112424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:32.112424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:32.112424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:32.112424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:32.112424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:32.112424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:32.112424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:32.112424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:32.112424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:45:32.112424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:32.112948 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 276/552] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:32.118526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b0bfa-1388-4b19-899f-b9e20397cd40 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-03c789f0-56ca-4d6a-acc8-f09cee28ba90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:32.135640 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:32.137141 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:32.138199 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:32.138199 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:32.138199 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:32.138826 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 277/553] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:32.144458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c789f0-56ca-4d6a-acc8-f09cee28ba90 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:32.175141 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:32.197166 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:32.263783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b0bfa-1388-4b19-899f-b9e20397cd40 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:32.303110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d6b64-ae5c-450a-8925-d7bd498c8c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:32.304116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d6b64-ae5c-450a-8925-d7bd498c8c42 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.304606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d6b64-ae5c-450a-8925-d7bd498c8c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.305074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d6b64-ae5c-450a-8925-d7bd498c8c42 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.306003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d6b64-ae5c-450a-8925-d7bd498c8c42 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:32.306519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d6b64-ae5c-450a-8925-d7bd498c8c42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:32.308207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d6b64-ae5c-450a-8925-d7bd498c8c42 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:32.328124 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 277/554] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 2 00:45:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:32.331310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c789f0-56ca-4d6a-acc8-f09cee28ba90 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:32.334449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d6b64-ae5c-450a-8925-d7bd498c8c42 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:32.400201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62294006-5326-4b97-84de-612d7d020167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:32.400827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62294006-5326-4b97-84de-612d7d020167 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.401109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62294006-5326-4b97-84de-612d7d020167 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.401383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62294006-5326-4b97-84de-612d7d020167 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.402039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62294006-5326-4b97-84de-612d7d020167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:32.403262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62294006-5326-4b97-84de-612d7d020167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:32.405201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62294006-5326-4b97-84de-612d7d020167 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:32.422889 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 278/555] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:32.425039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e42c0-7b98-488d-b8f3-898b7b4b4ab3 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.425330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e42c0-7b98-488d-b8f3-898b7b4b4ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.425659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e42c0-7b98-488d-b8f3-898b7b4b4ab3 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.430674 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 279/556] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:32.431712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e42c0-7b98-488d-b8f3-898b7b4b4ab3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:32.475260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d6b64-ae5c-450a-8925-d7bd498c8c42 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:32.477579 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:32.515683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada22294-846c-411a-9b1e-f134760b7ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:32.516757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada22294-846c-411a-9b1e-f134760b7ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.517256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada22294-846c-411a-9b1e-f134760b7ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.517766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada22294-846c-411a-9b1e-f134760b7ee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.533389 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:32.576689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e42c0-7b98-488d-b8f3-898b7b4b4ab3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:32.601138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada22294-846c-411a-9b1e-f134760b7ee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:32.603144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada22294-846c-411a-9b1e-f134760b7ee3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:32.623322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd5e10-78b2-42fb-a9b9-dbc85ab97a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:32.624247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd5e10-78b2-42fb-a9b9-dbc85ab97a2b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.624536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd5e10-78b2-42fb-a9b9-dbc85ab97a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.624813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd5e10-78b2-42fb-a9b9-dbc85ab97a2b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.634522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd5e10-78b2-42fb-a9b9-dbc85ab97a2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:32.636177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd5e10-78b2-42fb-a9b9-dbc85ab97a2b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-72cd5e10-78b2-42fb-a9b9-dbc85ab97a2b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:32.650581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:32.653052 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 280/557] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d8cb8-c787-445b-92a6-e0fb89548764 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.654146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d8cb8-c787-445b-92a6-e0fb89548764 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.654877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d8cb8-c787-445b-92a6-e0fb89548764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.677505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6f1d8cb8-c787-445b-92a6-e0fb89548764 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:32.678961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6f1d8cb8-c787-445b-92a6-e0fb89548764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:32.712742 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 278/558] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:32.714004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93672004-b2de-4fae-b5f6-23da9ca5c12e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.714291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93672004-b2de-4fae-b5f6-23da9ca5c12e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.714565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93672004-b2de-4fae-b5f6-23da9ca5c12e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.720488 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 279/559] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:32.721140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93672004-b2de-4fae-b5f6-23da9ca5c12e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:32.723891 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:32.770701 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 281/560] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:32.770701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d8cb8-c787-445b-92a6-e0fb89548764 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:32.838551 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:32.853100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93672004-b2de-4fae-b5f6-23da9ca5c12e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:32.882386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d8cb8-c787-445b-92a6-e0fb89548764 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:32.898220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad54551-531c-47cc-82b9-5304776b7334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:32.899262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54551-531c-47cc-82b9-5304776b7334 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.899637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54551-531c-47cc-82b9-5304776b7334 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.900054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54551-531c-47cc-82b9-5304776b7334 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.901452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad54551-531c-47cc-82b9-5304776b7334 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:32.901939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad54551-531c-47cc-82b9-5304776b7334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:32.903611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad54551-531c-47cc-82b9-5304776b7334 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:32.926777 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 280/561] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 2 00:45:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:32.927636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8646d0-92c2-432a-ac19-9f66375a5b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:32.928334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8646d0-92c2-432a-ac19-9f66375a5b98 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.928611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8646d0-92c2-432a-ac19-9f66375a5b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.928884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8646d0-92c2-432a-ac19-9f66375a5b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.933552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4b072-8778-4921-a2b0-37cdf79f032c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:32.934593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4b072-8778-4921-a2b0-37cdf79f032c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:32.935046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4b072-8778-4921-a2b0-37cdf79f032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:32.941806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8646d0-92c2-432a-ac19-9f66375a5b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:32.943457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8646d0-92c2-432a-ac19-9f66375a5b98 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:32.956443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-98d4b072-8778-4921-a2b0-37cdf79f032c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:32.957618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-98d4b072-8778-4921-a2b0-37cdf79f032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-4d8646d0-92c2-432a-ac19-9f66375a5b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:32.959028 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:32.959933 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:32.960829 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:32.960829 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:32.960829 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:32.961526 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 282/562] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:32.964537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8646d0-92c2-432a-ac19-9f66375a5b98 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:33.046175 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:33.064388 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 281/563] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:33.065609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4b072-8778-4921-a2b0-37cdf79f032c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:33.085258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8646d0-92c2-432a-ac19-9f66375a5b98 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:33.101698 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:33.128961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efeeaa2-fec0-41b2-8799-a8fcac18cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:33.129584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeeaa2-fec0-41b2-8799-a8fcac18cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.129859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeeaa2-fec0-41b2-8799-a8fcac18cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.130128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeeaa2-fec0-41b2-8799-a8fcac18cdd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.146023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efeeaa2-fec0-41b2-8799-a8fcac18cdd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:33.147513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efeeaa2-fec0-41b2-8799-a8fcac18cdd6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-1efeeaa2-fec0-41b2-8799-a8fcac18cdd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:33.164027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:33.165046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:33.165930 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:33.165930 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:33.165930 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:33.171367 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 283/564] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:33.172099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efeeaa2-fec0-41b2-8799-a8fcac18cdd6 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:33.189084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4b072-8778-4921-a2b0-37cdf79f032c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:33.240281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533c083-9fa5-4240-8537-f20690e6060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:33.241828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533c083-9fa5-4240-8537-f20690e6060f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.242301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533c083-9fa5-4240-8537-f20690e6060f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.243024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533c083-9fa5-4240-8537-f20690e6060f None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.244108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533c083-9fa5-4240-8537-f20690e6060f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:33.244618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533c083-9fa5-4240-8537-f20690e6060f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:33.247561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533c083-9fa5-4240-8537-f20690e6060f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:33.269052 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 282/565] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:33.269434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533c083-9fa5-4240-8537-f20690e6060f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:33.300055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efeeaa2-fec0-41b2-8799-a8fcac18cdd6 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:33.322588 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:33.341028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df64cf8-5ab9-4b96-913e-d53409833da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:33.341708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df64cf8-5ab9-4b96-913e-d53409833da6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.341984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df64cf8-5ab9-4b96-913e-d53409833da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.342289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df64cf8-5ab9-4b96-913e-d53409833da6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.354075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df64cf8-5ab9-4b96-913e-d53409833da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-6df64cf8-5ab9-4b96-913e-d53409833da6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:33.360041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:33.361050 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:33.361919 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 284/566] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:33.362714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df64cf8-5ab9-4b96-913e-d53409833da6 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:33.382362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533c083-9fa5-4240-8537-f20690e6060f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:33.387683 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:33.416728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a7c62-0601-4601-bde0-afa08863063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:33.417330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a7c62-0601-4601-bde0-afa08863063f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.417613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a7c62-0601-4601-bde0-afa08863063f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.417959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a7c62-0601-4601-bde0-afa08863063f None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.419304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a7c62-0601-4601-bde0-afa08863063f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:33.419609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a7c62-0601-4601-bde0-afa08863063f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:33.421245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a7c62-0601-4601-bde0-afa08863063f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:33.433281 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 283/567] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:33.434724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6f4c-e313-4aab-b5b8-2bd64320b4d6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.435453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6f4c-e313-4aab-b5b8-2bd64320b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.435740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6f4c-e313-4aab-b5b8-2bd64320b4d6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.437539 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 284/568] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:33.439359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6f4c-e313-4aab-b5b8-2bd64320b4d6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:33.463253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df64cf8-5ab9-4b96-913e-d53409833da6 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:33.498184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34d460-70c6-42f4-af6c-f2318235eee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:33.498852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34d460-70c6-42f4-af6c-f2318235eee2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.499134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34d460-70c6-42f4-af6c-f2318235eee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.499410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34d460-70c6-42f4-af6c-f2318235eee2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.505926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34d460-70c6-42f4-af6c-f2318235eee2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:33.507521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34d460-70c6-42f4-af6c-f2318235eee2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-db34d460-70c6-42f4-af6c-f2318235eee2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:33.519259 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:33.520317 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:33.521210 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:33.521210 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:33.521210 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:33.521210 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:33.521210 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:33.521210 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:33.521210 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:33.521210 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:33.521210 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 285/569] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:33.521210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34d460-70c6-42f4-af6c-f2318235eee2 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:33.545640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6f4c-e313-4aab-b5b8-2bd64320b4d6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:33.562339 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:33.586327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d916d1-ef10-401a-8775-8d3a7cdeb964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:33.586991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d916d1-ef10-401a-8775-8d3a7cdeb964 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.587267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d916d1-ef10-401a-8775-8d3a7cdeb964 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.587541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d916d1-ef10-401a-8775-8d3a7cdeb964 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.597854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d916d1-ef10-401a-8775-8d3a7cdeb964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-92d916d1-ef10-401a-8775-8d3a7cdeb964 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:33.602554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:33.603551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 285/570] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:33.604400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d916d1-ef10-401a-8775-8d3a7cdeb964 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:33.609747 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:33.624208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34d460-70c6-42f4-af6c-f2318235eee2 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:33.656883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4ebce-d966-4f3f-882e-8d97c7bda9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:33.657476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4ebce-d966-4f3f-882e-8d97c7bda9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.657753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4ebce-d966-4f3f-882e-8d97c7bda9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.658026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4ebce-d966-4f3f-882e-8d97c7bda9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.658718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4ebce-d966-4f3f-882e-8d97c7bda9e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:33.659020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4ebce-d966-4f3f-882e-8d97c7bda9e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:33.660387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4ebce-d966-4f3f-882e-8d97c7bda9e0 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:33.668076 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 286/571] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:33.669151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e380d72-b1b5-4718-938f-c0949e24ce2e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.669434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e380d72-b1b5-4718-938f-c0949e24ce2e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.669704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e380d72-b1b5-4718-938f-c0949e24ce2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.687304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1e380d72-b1b5-4718-938f-c0949e24ce2e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:33.688477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1e380d72-b1b5-4718-938f-c0949e24ce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:33.710300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d916d1-ef10-401a-8775-8d3a7cdeb964 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:33.743316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeded0a-d0bf-4758-a029-5cda3f9789b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:33.743933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeded0a-d0bf-4758-a029-5cda3f9789b2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.744208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeded0a-d0bf-4758-a029-5cda3f9789b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.744478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeded0a-d0bf-4758-a029-5cda3f9789b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.751310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeded0a-d0bf-4758-a029-5cda3f9789b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:33.752814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeded0a-d0bf-4758-a029-5cda3f9789b2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:33.754261 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 287/572] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:33.755118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e380d72-b1b5-4718-938f-c0949e24ce2e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-deeded0a-d0bf-4758-a029-5cda3f9789b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:33.765812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:33.766818 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:33.767733 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:33.767733 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:33.767733 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:33.767733 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:33.767733 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:33.767733 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:33.767733 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:33.767733 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:33.768459 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 286/573] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:33.768911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeded0a-d0bf-4758-a029-5cda3f9789b2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:33.805791 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:33.846168 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:33.869902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e380d72-b1b5-4718-938f-c0949e24ce2e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:33.884887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeded0a-d0bf-4758-a029-5cda3f9789b2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:33.904254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e250f76-e7c5-4eea-aaf6-0455c846de52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:33.905050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e250f76-e7c5-4eea-aaf6-0455c846de52 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.905508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e250f76-e7c5-4eea-aaf6-0455c846de52 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.905924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e250f76-e7c5-4eea-aaf6-0455c846de52 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.906778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e250f76-e7c5-4eea-aaf6-0455c846de52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:33.907225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e250f76-e7c5-4eea-aaf6-0455c846de52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:33.908800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e250f76-e7c5-4eea-aaf6-0455c846de52 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:33.922238 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 288/574] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:33.922893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcbefc-3874-4fbb-a0a3-f4c0b3952afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:33.923386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e250f76-e7c5-4eea-aaf6-0455c846de52 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:33.923490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcbefc-3874-4fbb-a0a3-f4c0b3952afe None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:33.923759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcbefc-3874-4fbb-a0a3-f4c0b3952afe None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:33.924025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcbefc-3874-4fbb-a0a3-f4c0b3952afe None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:33.924678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcbefc-3874-4fbb-a0a3-f4c0b3952afe None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:33.924973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcbefc-3874-4fbb-a0a3-f4c0b3952afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:33.926323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcbefc-3874-4fbb-a0a3-f4c0b3952afe None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:33.934627 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 287/575] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:33.935521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcbefc-3874-4fbb-a0a3-f4c0b3952afe None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:34.037596 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:34.045644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e250f76-e7c5-4eea-aaf6-0455c846de52 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:34.046807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcbefc-3874-4fbb-a0a3-f4c0b3952afe None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:34.079597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afced4-5237-4c70-89fa-05b4f719181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:34.079840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6fb7-9f83-4332-8520-49590f3bc697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:34.080231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afced4-5237-4c70-89fa-05b4f719181a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:34.080335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6fb7-9f83-4332-8520-49590f3bc697 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:34.080512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afced4-5237-4c70-89fa-05b4f719181a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:34.080606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6fb7-9f83-4332-8520-49590f3bc697 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:34.080785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afced4-5237-4c70-89fa-05b4f719181a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:34.080879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6fb7-9f83-4332-8520-49590f3bc697 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:34.081495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6fb7-9f83-4332-8520-49590f3bc697 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:34.081797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6fb7-9f83-4332-8520-49590f3bc697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:34.083252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6fb7-9f83-4332-8520-49590f3bc697 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:34.087741 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:34.091992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afced4-5237-4c70-89fa-05b4f719181a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:34.093410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afced4-5237-4c70-89fa-05b4f719181a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:34.095115 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 288/576] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:34.096063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6fb7-9f83-4332-8520-49590f3bc697 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-20afced4-5237-4c70-89fa-05b4f719181a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:34.112245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:34.113267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:34.114157 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:34.114157 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:34.114157 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:34.114157 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 289/577] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:34.114157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afced4-5237-4c70-89fa-05b4f719181a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:34.198241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6fb7-9f83-4332-8520-49590f3bc697 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:34.214842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afced4-5237-4c70-89fa-05b4f719181a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:34.231235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a0b39-9833-4724-9456-f28c438c0573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:34.231829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a0b39-9833-4724-9456-f28c438c0573 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:34.232107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a0b39-9833-4724-9456-f28c438c0573 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:34.232378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a0b39-9833-4724-9456-f28c438c0573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:34.233089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a0b39-9833-4724-9456-f28c438c0573 None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=a0fa4948f9b546dea031acfc0f3e3d95) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:34.233399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a0b39-9833-4724-9456-f28c438c0573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:34.234968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a0b39-9833-4724-9456-f28c438c0573 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:34.240369 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 289/578] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:34 2022] GET /identity/v3/role_assignments?user.id=a0fa4948f9b546dea031acfc0f3e3d95&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:34.241131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a0b39-9833-4724-9456-f28c438c0573 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:34.252990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717d5f6-cfeb-46cf-95bc-e5d4dace0a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:34.253639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717d5f6-cfeb-46cf-95bc-e5d4dace0a30 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:34.253944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717d5f6-cfeb-46cf-95bc-e5d4dace0a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:34.254217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717d5f6-cfeb-46cf-95bc-e5d4dace0a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:34.266955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717d5f6-cfeb-46cf-95bc-e5d4dace0a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:34.269160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717d5f6-cfeb-46cf-95bc-e5d4dace0a30 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:34.271274 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-c717d5f6-cfeb-46cf-95bc-e5d4dace0a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:34.286029 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:34.287122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:34.288042 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:34.288042 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:34.288042 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:34.288042 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 290/579] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:34.288781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717d5f6-cfeb-46cf-95bc-e5d4dace0a30 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:34.340206 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:34.364795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a0b39-9833-4724-9456-f28c438c0573 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:34.406189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c4e9-069d-4cbf-89aa-2f455b2bf6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:34.406870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c4e9-069d-4cbf-89aa-2f455b2bf6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:34.407146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c4e9-069d-4cbf-89aa-2f455b2bf6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:34.407423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c4e9-069d-4cbf-89aa-2f455b2bf6b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:34.418362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3c4e9-069d-4cbf-89aa-2f455b2bf6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d7c3c4e9-069d-4cbf-89aa-2f455b2bf6b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:34.423992 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:34.425188 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 290/580] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:34.426194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c4e9-069d-4cbf-89aa-2f455b2bf6b3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:34.431274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717d5f6-cfeb-46cf-95bc-e5d4dace0a30 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:34.469643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849165-298f-41d3-812f-31dc50aa44e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:34.470300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849165-298f-41d3-812f-31dc50aa44e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:34.470575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849165-298f-41d3-812f-31dc50aa44e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:34.470872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849165-298f-41d3-812f-31dc50aa44e2 None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/7cee33d8425d4be0ba5721ec419a12e1/roles/0905222c6f30467abc2b2a41d74fa282` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:34.485921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3849165-298f-41d3-812f-31dc50aa44e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=7cee33d8425d4be0ba5721ec419a12e1, role_id=0905222c6f30467abc2b2a41d74fa282)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:34.487396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3849165-298f-41d3-812f-31dc50aa44e2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:34.510644 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 291/581] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:45:34 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/7cee33d8425d4be0ba5721ec419a12e1/roles/0905222c6f30467abc2b2a41d74fa282 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:34.510644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849165-298f-41d3-812f-31dc50aa44e2 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:34.522321 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:34.554494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c4e9-069d-4cbf-89aa-2f455b2bf6b3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:34.601211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc09660-657a-4f34-8b76-3dfe5a8dab99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:34.601827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc09660-657a-4f34-8b76-3dfe5a8dab99 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:34.602202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc09660-657a-4f34-8b76-3dfe5a8dab99 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:34.602521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc09660-657a-4f34-8b76-3dfe5a8dab99 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:34.603345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc09660-657a-4f34-8b76-3dfe5a8dab99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:34.603745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc09660-657a-4f34-8b76-3dfe5a8dab99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:34.605332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc09660-657a-4f34-8b76-3dfe5a8dab99 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:34.620830 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 291/582] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:34.622227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc09660-657a-4f34-8b76-3dfe5a8dab99 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:34.626076 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:34.639974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849165-298f-41d3-812f-31dc50aa44e2 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:34.680467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ebc5a-64a4-4ed1-9e23-793afaee3a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:34.681409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ebc5a-64a4-4ed1-9e23-793afaee3a3a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:34.681930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ebc5a-64a4-4ed1-9e23-793afaee3a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:34.682343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ebc5a-64a4-4ed1-9e23-793afaee3a3a None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:34.683183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ebc5a-64a4-4ed1-9e23-793afaee3a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:34.683682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ebc5a-64a4-4ed1-9e23-793afaee3a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:34.685452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ebc5a-64a4-4ed1-9e23-793afaee3a3a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:34.698758 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 292/583] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:34.700248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ebc5a-64a4-4ed1-9e23-793afaee3a3a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:34.749384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc09660-657a-4f34-8b76-3dfe5a8dab99 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:34.791958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf9387-3e1b-43ee-a014-bdb054207703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:34.793460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf9387-3e1b-43ee-a014-bdb054207703 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:34.794497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf9387-3e1b-43ee-a014-bdb054207703 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:34.795206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf9387-3e1b-43ee-a014-bdb054207703 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:34.796451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf9387-3e1b-43ee-a014-bdb054207703 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:34.797206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf9387-3e1b-43ee-a014-bdb054207703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:34.799119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf9387-3e1b-43ee-a014-bdb054207703 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:34.803007 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:34.813509 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 292/584] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:34.814996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf9387-3e1b-43ee-a014-bdb054207703 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:34.826632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ebc5a-64a4-4ed1-9e23-793afaee3a3a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:34.864075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb735def-7021-44ab-a1d7-89ab5ca1d78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:34.864814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb735def-7021-44ab-a1d7-89ab5ca1d78d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:34.865159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb735def-7021-44ab-a1d7-89ab5ca1d78d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:34.865498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb735def-7021-44ab-a1d7-89ab5ca1d78d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:34.877184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb735def-7021-44ab-a1d7-89ab5ca1d78d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:34.878704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb735def-7021-44ab-a1d7-89ab5ca1d78d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-bb735def-7021-44ab-a1d7-89ab5ca1d78d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:34.893642 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:34.894837 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:34.896017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:34.896017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:34.896017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:34.896017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:34.896017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:34.896017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:34.896017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:34.896017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:34.896017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:45:34.896017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:34.896017 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 293/585] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 2 00:45:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:34.896775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb735def-7021-44ab-a1d7-89ab5ca1d78d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:34.914964 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:34.945128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf9387-3e1b-43ee-a014-bdb054207703 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:34.992236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4db048-e0bc-44f0-af4f-eb7c32a77465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:34.993250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db048-e0bc-44f0-af4f-eb7c32a77465 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:34.993750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db048-e0bc-44f0-af4f-eb7c32a77465 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:34.994225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db048-e0bc-44f0-af4f-eb7c32a77465 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:35.003693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4db048-e0bc-44f0-af4f-eb7c32a77465 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:35.005663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4db048-e0bc-44f0-af4f-eb7c32a77465 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5f4db048-e0bc-44f0-af4f-eb7c32a77465 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:35.018654 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:35.019634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:35.020597 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:35.020597 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:35.020597 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:35.020597 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:35.020597 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:35.020597 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:35.020597 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:35.020597 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:35.020597 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:45:35.020597 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:35.023315 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 293/586] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:35.024017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb735def-7021-44ab-a1d7-89ab5ca1d78d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:35.024603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4db048-e0bc-44f0-af4f-eb7c32a77465 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:35.072474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70280f-82f9-4cd4-adb5-0a77bf3ebe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:35.073553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70280f-82f9-4cd4-adb5-0a77bf3ebe05 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:35.073840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70280f-82f9-4cd4-adb5-0a77bf3ebe05 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:35.074841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70280f-82f9-4cd4-adb5-0a77bf3ebe05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:35.089627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70280f-82f9-4cd4-adb5-0a77bf3ebe05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:35.091957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70280f-82f9-4cd4-adb5-0a77bf3ebe05 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:35.092760 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-cd70280f-82f9-4cd4-adb5-0a77bf3ebe05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:35.112639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:35.113685 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:35.114586 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:35.114586 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:35.114586 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:35.114586 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 294/587] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:35.115330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70280f-82f9-4cd4-adb5-0a77bf3ebe05 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:35.148828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4db048-e0bc-44f0-af4f-eb7c32a77465 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:35.184328 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:35.188458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89896371-745c-4cbc-bad5-2e9f63b5b10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:35.190001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89896371-745c-4cbc-bad5-2e9f63b5b10e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:35.190001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89896371-745c-4cbc-bad5-2e9f63b5b10e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:35.190001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89896371-745c-4cbc-bad5-2e9f63b5b10e None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:35.190389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89896371-745c-4cbc-bad5-2e9f63b5b10e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:35.190757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89896371-745c-4cbc-bad5-2e9f63b5b10e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:35.192813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89896371-745c-4cbc-bad5-2e9f63b5b10e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:35.212231 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 294/588] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 2 00:45:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:35.213117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89896371-745c-4cbc-bad5-2e9f63b5b10e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:35.227579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70280f-82f9-4cd4-adb5-0a77bf3ebe05 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:35.262868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aadd4-cf7d-4a33-b442-356545da1a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:35.263958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aadd4-cf7d-4a33-b442-356545da1a15 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:35.264427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aadd4-cf7d-4a33-b442-356545da1a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:35.264938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aadd4-cf7d-4a33-b442-356545da1a15 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:35.265946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05aadd4-cf7d-4a33-b442-356545da1a15 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:35.266491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05aadd4-cf7d-4a33-b442-356545da1a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:35.268206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05aadd4-cf7d-4a33-b442-356545da1a15 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:35.317806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89896371-745c-4cbc-bad5-2e9f63b5b10e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:35.319272 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 295/589] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 2 00:45:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:35.320404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aadd4-cf7d-4a33-b442-356545da1a15 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:35.335892 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:35.354172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f62f6-8fc7-4b00-9f61-c78cf667200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:35.354807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f62f6-8fc7-4b00-9f61-c78cf667200c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:35.355137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f62f6-8fc7-4b00-9f61-c78cf667200c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:35.355454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f62f6-8fc7-4b00-9f61-c78cf667200c None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:35.356095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f62f6-8fc7-4b00-9f61-c78cf667200c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:35.356475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f62f6-8fc7-4b00-9f61-c78cf667200c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:35.357806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f62f6-8fc7-4b00-9f61-c78cf667200c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:35.369404 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 295/590] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:35.370203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f62f6-8fc7-4b00-9f61-c78cf667200c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:35.439730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aadd4-cf7d-4a33-b442-356545da1a15 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:35.466978 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:35.481681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12593c19-2217-44c3-a5dd-17398f1f91b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:35.482866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12593c19-2217-44c3-a5dd-17398f1f91b8 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:35.483426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12593c19-2217-44c3-a5dd-17398f1f91b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:35.483897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12593c19-2217-44c3-a5dd-17398f1f91b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:35.497619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12593c19-2217-44c3-a5dd-17398f1f91b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:35.500152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12593c19-2217-44c3-a5dd-17398f1f91b8 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:35.502842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f62f6-8fc7-4b00-9f61-c78cf667200c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-12593c19-2217-44c3-a5dd-17398f1f91b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:35.517535 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:35.518539 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:35.519468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:35.519468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:35.519468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:35.520219 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 296/591] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:35.520637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12593c19-2217-44c3-a5dd-17398f1f91b8 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:35.546093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551f1eb-2fa2-4b66-8b8d-4ab07f01b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:35.547197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551f1eb-2fa2-4b66-8b8d-4ab07f01b8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:35.547758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551f1eb-2fa2-4b66-8b8d-4ab07f01b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:35.548358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551f1eb-2fa2-4b66-8b8d-4ab07f01b8a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:35.561789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551f1eb-2fa2-4b66-8b8d-4ab07f01b8a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:35.564135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551f1eb-2fa2-4b66-8b8d-4ab07f01b8a9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b551f1eb-2fa2-4b66-8b8d-4ab07f01b8a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:35.580827 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:35.581836 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:35.582773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:35.582773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:35.582773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:35.585009 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 296/592] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:35.586070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551f1eb-2fa2-4b66-8b8d-4ab07f01b8a9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:35.625612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12593c19-2217-44c3-a5dd-17398f1f91b8 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:35.626111 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:35.663486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e867c-07e3-4417-9db1-8e95a918b44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:35.664111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e867c-07e3-4417-9db1-8e95a918b44d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:35.664386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e867c-07e3-4417-9db1-8e95a918b44d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:35.664657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e867c-07e3-4417-9db1-8e95a918b44d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:35.673538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e867c-07e3-4417-9db1-8e95a918b44d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:35.675071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e867c-07e3-4417-9db1-8e95a918b44d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-da2e867c-07e3-4417-9db1-8e95a918b44d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:35.687082 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:35.688068 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:35.689018 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:35.689018 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:35.689018 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:35.689018 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:35.689018 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:35.689018 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:35.689018 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:35.689018 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:35.689018 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:45:35.689018 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:35.689018 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 297/593] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:35.689609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e867c-07e3-4417-9db1-8e95a918b44d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:35.725411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551f1eb-2fa2-4b66-8b8d-4ab07f01b8a9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:35.726962 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:35.773953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fae4f9-439a-4fba-8173-c7fc53b80897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:35.774871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fae4f9-439a-4fba-8173-c7fc53b80897 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:35.775299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fae4f9-439a-4fba-8173-c7fc53b80897 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:35.776163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fae4f9-439a-4fba-8173-c7fc53b80897 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:35.776992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fae4f9-439a-4fba-8173-c7fc53b80897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:35.778483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fae4f9-439a-4fba-8173-c7fc53b80897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:35.780569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fae4f9-439a-4fba-8173-c7fc53b80897 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:35.798330 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 297/594] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:35.799543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fae4f9-439a-4fba-8173-c7fc53b80897 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:35.800534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e867c-07e3-4417-9db1-8e95a918b44d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:35.840836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46fc82-c3ce-4506-874f-09b0c99f7c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:35.841606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46fc82-c3ce-4506-874f-09b0c99f7c5a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:35.841978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46fc82-c3ce-4506-874f-09b0c99f7c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:35.842340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46fc82-c3ce-4506-874f-09b0c99f7c5a None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:35.843116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46fc82-c3ce-4506-874f-09b0c99f7c5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:35.843515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46fc82-c3ce-4506-874f-09b0c99f7c5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:35.844968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46fc82-c3ce-4506-874f-09b0c99f7c5a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:35.858437 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 298/595] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:35.859512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46fc82-c3ce-4506-874f-09b0c99f7c5a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:35.933094 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:35.951852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fae4f9-439a-4fba-8173-c7fc53b80897 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:35.972251 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:35.984083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46fc82-c3ce-4506-874f-09b0c99f7c5a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:36.014817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21d8f2-f118-4c3d-a06c-94294818c91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:36.015943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21d8f2-f118-4c3d-a06c-94294818c91a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.016818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21d8f2-f118-4c3d-a06c-94294818c91a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.017515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21d8f2-f118-4c3d-a06c-94294818c91a None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.018494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21d8f2-f118-4c3d-a06c-94294818c91a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:36.019067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21d8f2-f118-4c3d-a06c-94294818c91a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:36.020855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21d8f2-f118-4c3d-a06c-94294818c91a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:36.021439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25e3f7-2902-46a0-9080-8c92c87054f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:36.022137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25e3f7-2902-46a0-9080-8c92c87054f4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.022483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25e3f7-2902-46a0-9080-8c92c87054f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.022849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25e3f7-2902-46a0-9080-8c92c87054f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.030581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25e3f7-2902-46a0-9080-8c92c87054f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:36.032177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25e3f7-2902-46a0-9080-8c92c87054f4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-db25e3f7-2902-46a0-9080-8c92c87054f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:36.047505 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:36.048472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:36.049395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:36.049395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:36.049395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:36.049395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:36.049395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:36.049395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:36.049395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:36.049395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:36.049941 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 298/597] 10.222.0.23 () {56 vars in 1139 bytes} [Sun Oct 2 00:45:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:36.051518 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 299/597] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:36.051735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21d8f2-f118-4c3d-a06c-94294818c91a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:36.052211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25e3f7-2902-46a0-9080-8c92c87054f4 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:36.169007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21d8f2-f118-4c3d-a06c-94294818c91a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:36.186957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25e3f7-2902-46a0-9080-8c92c87054f4 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:36.206631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfa7d8-71e7-4e99-947d-9fc9127aaaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:36.207042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfa7d8-71e7-4e99-947d-9fc9127aaaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.207322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfa7d8-71e7-4e99-947d-9fc9127aaaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.207597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfa7d8-71e7-4e99-947d-9fc9127aaaa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.215450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfa7d8-71e7-4e99-947d-9fc9127aaaa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:36.216924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfa7d8-71e7-4e99-947d-9fc9127aaaa6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-aedfa7d8-71e7-4e99-947d-9fc9127aaaa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:36.228693 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:36.229909 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:36.231586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:36.231586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:36.231586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:36.231586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:36.231586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:36.231586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:36.231586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:36.231586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:36.234841 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 299/598] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:36.236064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfa7d8-71e7-4e99-947d-9fc9127aaaa6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:36.237550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bd5d3-2757-41df-862a-9bab4c3ad792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:36.238392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bd5d3-2757-41df-862a-9bab4c3ad792 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.239203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bd5d3-2757-41df-862a-9bab4c3ad792 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.240631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bd5d3-2757-41df-862a-9bab4c3ad792 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.241515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bd5d3-2757-41df-862a-9bab4c3ad792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:36.242043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bd5d3-2757-41df-862a-9bab4c3ad792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:36.243773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bd5d3-2757-41df-862a-9bab4c3ad792 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:36.245291 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:36.262734 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 300/599] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:36.263864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bd5d3-2757-41df-862a-9bab4c3ad792 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:36.286589 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:36.347937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfa7d8-71e7-4e99-947d-9fc9127aaaa6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:36.386052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2f334-ec9d-4cb2-a167-8a2317e96b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:36.386816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2f334-ec9d-4cb2-a167-8a2317e96b6d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.387097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2f334-ec9d-4cb2-a167-8a2317e96b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.387466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2f334-ec9d-4cb2-a167-8a2317e96b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.401698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2f334-ec9d-4cb2-a167-8a2317e96b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:36.403938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2f334-ec9d-4cb2-a167-8a2317e96b6d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:36.411783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bd5d3-2757-41df-862a-9bab4c3ad792 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-18f2f334-ec9d-4cb2-a167-8a2317e96b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:36.420318 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:36.421525 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:36.422511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:36.422511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:36.422511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:36.426436 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 300/600] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:36.427282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2f334-ec9d-4cb2-a167-8a2317e96b6d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:36.460088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9730cf0-682d-4eac-94fe-c6da08e0b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:36.461628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730cf0-682d-4eac-94fe-c6da08e0b9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.462203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730cf0-682d-4eac-94fe-c6da08e0b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.462953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730cf0-682d-4eac-94fe-c6da08e0b9a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.463828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9730cf0-682d-4eac-94fe-c6da08e0b9a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:36.465275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9730cf0-682d-4eac-94fe-c6da08e0b9a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:36.467861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9730cf0-682d-4eac-94fe-c6da08e0b9a6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:36.488728 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 301/601] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:36.488728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9730cf0-682d-4eac-94fe-c6da08e0b9a6 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:36.507506 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:36.556376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2f334-ec9d-4cb2-a167-8a2317e96b6d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:36.584181 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:36.592212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29af98b-8c34-4b39-9921-0c155875b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:36.592876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af98b-8c34-4b39-9921-0c155875b99d None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.593156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af98b-8c34-4b39-9921-0c155875b99d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.593425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af98b-8c34-4b39-9921-0c155875b99d None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/b85fc7e555f348c3ab6c63ee15f6ceb0/roles/0905222c6f30467abc2b2a41d74fa282` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.609573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29af98b-8c34-4b39-9921-0c155875b99d None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=b85fc7e555f348c3ab6c63ee15f6ceb0, role_id=0905222c6f30467abc2b2a41d74fa282)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:36.611130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29af98b-8c34-4b39-9921-0c155875b99d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:36.615653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9730cf0-682d-4eac-94fe-c6da08e0b9a6 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:36.631287 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 301/602] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:45:36 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/b85fc7e555f348c3ab6c63ee15f6ceb0/roles/0905222c6f30467abc2b2a41d74fa282 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:36.631287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad114cfc-2e85-488b-8420-7ad8bcfa8957 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.631287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad114cfc-2e85-488b-8420-7ad8bcfa8957 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.631287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad114cfc-2e85-488b-8420-7ad8bcfa8957 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.631287 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 302/603] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:36.631287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad114cfc-2e85-488b-8420-7ad8bcfa8957 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:36.664625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f254f1a-a599-43c7-adec-76fc4deaa0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:36.665545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f254f1a-a599-43c7-adec-76fc4deaa0cd None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.665829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f254f1a-a599-43c7-adec-76fc4deaa0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.666657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f254f1a-a599-43c7-adec-76fc4deaa0cd None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.667660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f254f1a-a599-43c7-adec-76fc4deaa0cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:36.667967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f254f1a-a599-43c7-adec-76fc4deaa0cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:36.669442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f254f1a-a599-43c7-adec-76fc4deaa0cd None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:36.688340 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 302/604] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:36.689768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11420193-3579-49bf-a7e8-35cebe6aed4f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.690057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11420193-3579-49bf-a7e8-35cebe6aed4f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.690333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11420193-3579-49bf-a7e8-35cebe6aed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.710562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-11420193-3579-49bf-a7e8-35cebe6aed4f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:36.711917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-11420193-3579-49bf-a7e8-35cebe6aed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:36.756132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad114cfc-2e85-488b-8420-7ad8bcfa8957 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:36.767888 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:36.796403 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 303/605] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:36.797679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11420193-3579-49bf-a7e8-35cebe6aed4f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:36.821857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bac765-9b6a-4fbf-bb36-5be17d74de01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:36.823671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bac765-9b6a-4fbf-bb36-5be17d74de01 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.824145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bac765-9b6a-4fbf-bb36-5be17d74de01 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.824746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bac765-9b6a-4fbf-bb36-5be17d74de01 None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/c62cd9bcc90e4d6685c5d0fc1d8ceae3/roles/0905222c6f30467abc2b2a41d74fa282` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.851933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bac765-9b6a-4fbf-bb36-5be17d74de01 None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=c62cd9bcc90e4d6685c5d0fc1d8ceae3, role_id=0905222c6f30467abc2b2a41d74fa282)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:36.853544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bac765-9b6a-4fbf-bb36-5be17d74de01 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:36.871771 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 303/606] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:45:36 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/c62cd9bcc90e4d6685c5d0fc1d8ceae3/roles/0905222c6f30467abc2b2a41d74fa282 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:36.872754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4546479-5429-4f5f-b1ba-25bc5b18b75b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.873133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4546479-5429-4f5f-b1ba-25bc5b18b75b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.873496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4546479-5429-4f5f-b1ba-25bc5b18b75b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.879127 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 304/607] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:36.881167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488e96c-87f6-45f3-aaa6-a440aeec67ab None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:36.882753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488e96c-87f6-45f3-aaa6-a440aeec67ab None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:36.883945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488e96c-87f6-45f3-aaa6-a440aeec67ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:36.911417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c488e96c-87f6-45f3-aaa6-a440aeec67ab None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:36.912900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c488e96c-87f6-45f3-aaa6-a440aeec67ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:36.926390 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:37.022018 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 305/608] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:37.038346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11420193-3579-49bf-a7e8-35cebe6aed4f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:37.079794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13034f-ef44-4a0d-8c02-72e2f3dd74ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:37.080432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13034f-ef44-4a0d-8c02-72e2f3dd74ee None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:37.080717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13034f-ef44-4a0d-8c02-72e2f3dd74ee None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:37.080989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13034f-ef44-4a0d-8c02-72e2f3dd74ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:37.090285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13034f-ef44-4a0d-8c02-72e2f3dd74ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:37.092038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13034f-ef44-4a0d-8c02-72e2f3dd74ee None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-7f13034f-ef44-4a0d-8c02-72e2f3dd74ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:37.105070 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:37.106806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:37.107902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:37.107902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:37.107902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:37.107902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:37.107902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:37.107902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:37.107902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:37.107902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:37.110000 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 304/609] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:37.115312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488e96c-87f6-45f3-aaa6-a440aeec67ab None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:37.139895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13034f-ef44-4a0d-8c02-72e2f3dd74ee None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:37.249240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13034f-ef44-4a0d-8c02-72e2f3dd74ee None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:37.258956 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:37.273838 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:37.281800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488e96c-87f6-45f3-aaa6-a440aeec67ab None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:37.293690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393339c-d17b-4f0b-8645-61413bc82c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:37.294332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393339c-d17b-4f0b-8645-61413bc82c3d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:37.294630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393339c-d17b-4f0b-8645-61413bc82c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:37.295187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393339c-d17b-4f0b-8645-61413bc82c3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:37.314239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393339c-d17b-4f0b-8645-61413bc82c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-3393339c-d17b-4f0b-8645-61413bc82c3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:37.321290 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:37.324803 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:37.325657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:37.328048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb8c9e-9e76-466c-910b-e9a8a1ca3b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:37.328920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8c9e-9e76-466c-910b-e9a8a1ca3b73 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:37.329370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8c9e-9e76-466c-910b-e9a8a1ca3b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:37.329800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8c9e-9e76-466c-910b-e9a8a1ca3b73 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:37.330685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb8c9e-9e76-466c-910b-e9a8a1ca3b73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:37.330845 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 305/610] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:37.331827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393339c-d17b-4f0b-8645-61413bc82c3d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:37.332300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb8c9e-9e76-466c-910b-e9a8a1ca3b73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:37.333913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb8c9e-9e76-466c-910b-e9a8a1ca3b73 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:37.351334 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 306/611] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:37.357374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb8c9e-9e76-466c-910b-e9a8a1ca3b73 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:37.446162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393339c-d17b-4f0b-8645-61413bc82c3d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:37.484284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff136e-8f22-4af1-81a1-21b078d77ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:37.485662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff136e-8f22-4af1-81a1-21b078d77ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:37.486126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff136e-8f22-4af1-81a1-21b078d77ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:37.486617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff136e-8f22-4af1-81a1-21b078d77ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:37.487460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff136e-8f22-4af1-81a1-21b078d77ae6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:37.487963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff136e-8f22-4af1-81a1-21b078d77ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:37.489509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff136e-8f22-4af1-81a1-21b078d77ae6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:37.493136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb8c9e-9e76-466c-910b-e9a8a1ca3b73 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:37.498783 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 306/612] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:37.499867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff136e-8f22-4af1-81a1-21b078d77ae6 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:37.530369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69c7c-9d5b-4cbf-aa66-d9b71fe65c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:37.530930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69c7c-9d5b-4cbf-aa66-d9b71fe65c66 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:37.531206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69c7c-9d5b-4cbf-aa66-d9b71fe65c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:37.531535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69c7c-9d5b-4cbf-aa66-d9b71fe65c66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:37.542433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd69c7c-9d5b-4cbf-aa66-d9b71fe65c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4cd69c7c-9d5b-4cbf-aa66-d9b71fe65c66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:37.548064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:37.549021 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:37.549880 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:37.554176 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 307/613] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:37.554996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69c7c-9d5b-4cbf-aa66-d9b71fe65c66 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:37.566986 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:37.567248 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:37.633175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff136e-8f22-4af1-81a1-21b078d77ae6 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:37.665531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69c7c-9d5b-4cbf-aa66-d9b71fe65c66 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:37.674587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa407f54-8323-4257-85ab-a4542813e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:37.675496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa407f54-8323-4257-85ab-a4542813e293 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:37.675926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa407f54-8323-4257-85ab-a4542813e293 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:37.676381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa407f54-8323-4257-85ab-a4542813e293 None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/29854b3a4cda48f8a1dea8a01b4589a1/roles/0905222c6f30467abc2b2a41d74fa282` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:37.694124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa407f54-8323-4257-85ab-a4542813e293 None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=29854b3a4cda48f8a1dea8a01b4589a1, role_id=0905222c6f30467abc2b2a41d74fa282)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:37.695851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa407f54-8323-4257-85ab-a4542813e293 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:37.704209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a675a7-9f9c-4222-80ef-85b07bfbb160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:37.704885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a675a7-9f9c-4222-80ef-85b07bfbb160 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:37.705168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a675a7-9f9c-4222-80ef-85b07bfbb160 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:37.705479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a675a7-9f9c-4222-80ef-85b07bfbb160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:37.717957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a675a7-9f9c-4222-80ef-85b07bfbb160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:37.718336 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 307/614] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:45:37 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/29854b3a4cda48f8a1dea8a01b4589a1/roles/0905222c6f30467abc2b2a41d74fa282 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:37.719430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a675a7-9f9c-4222-80ef-85b07bfbb160 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:37.719844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa407f54-8323-4257-85ab-a4542813e293 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-37a675a7-9f9c-4222-80ef-85b07bfbb160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:37.737803 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:37.739142 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:37.740273 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:37.740273 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:37.740273 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:37.740273 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 308/615] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:37.743063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a675a7-9f9c-4222-80ef-85b07bfbb160 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:37.852737 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:37.863940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa407f54-8323-4257-85ab-a4542813e293 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:37.866722 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:37.912046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5068e8-8ef5-4be8-aa3a-eb584d26fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:37.912820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5068e8-8ef5-4be8-aa3a-eb584d26fc04 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:37.913201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5068e8-8ef5-4be8-aa3a-eb584d26fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:37.913576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5068e8-8ef5-4be8-aa3a-eb584d26fc04 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:37.914429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5068e8-8ef5-4be8-aa3a-eb584d26fc04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:37.914804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5068e8-8ef5-4be8-aa3a-eb584d26fc04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:37.916283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5068e8-8ef5-4be8-aa3a-eb584d26fc04 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:37.927317 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 308/616] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:37.937297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5068e8-8ef5-4be8-aa3a-eb584d26fc04 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:37.953477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a675a7-9f9c-4222-80ef-85b07bfbb160 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:38.022133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce36760-4f3d-4c7a-96ce-235208aee335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:38.023194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36760-4f3d-4c7a-96ce-235208aee335 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:38.023680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36760-4f3d-4c7a-96ce-235208aee335 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:38.024171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36760-4f3d-4c7a-96ce-235208aee335 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:38.025629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce36760-4f3d-4c7a-96ce-235208aee335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:38.026219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce36760-4f3d-4c7a-96ce-235208aee335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:38.028029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce36760-4f3d-4c7a-96ce-235208aee335 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:38.042476 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 309/617] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:38.051170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce36760-4f3d-4c7a-96ce-235208aee335 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:38.119987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5068e8-8ef5-4be8-aa3a-eb584d26fc04 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:38.168984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8038-2e27-4499-8435-88728b11422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:38.169618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8038-2e27-4499-8435-88728b11422c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:38.170159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8038-2e27-4499-8435-88728b11422c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:38.170430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8038-2e27-4499-8435-88728b11422c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:38.185422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce36760-4f3d-4c7a-96ce-235208aee335 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:38.187589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca8038-2e27-4499-8435-88728b11422c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:38.189051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca8038-2e27-4499-8435-88728b11422c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-50ca8038-2e27-4499-8435-88728b11422c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:38.211395 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:38.212397 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:38.213292 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:38.213292 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:38.213292 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:38.213292 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 309/618] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:38.219788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8038-2e27-4499-8435-88728b11422c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:38.226664 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:38.241305 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:38.251831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a938a-46e6-409a-8470-064fd4c57b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:38.252465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a938a-46e6-409a-8470-064fd4c57b05 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:38.252792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a938a-46e6-409a-8470-064fd4c57b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:38.253049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a938a-46e6-409a-8470-064fd4c57b05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:38.260955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a938a-46e6-409a-8470-064fd4c57b05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:38.262957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a938a-46e6-409a-8470-064fd4c57b05 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-921a938a-46e6-409a-8470-064fd4c57b05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:38.277466 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:38.279902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:38.282212 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:38.282212 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:38.282212 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:38.282212 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:38.282212 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:38.282212 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:38.282212 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:38.282212 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:38.282212 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:45:38.282212 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:38.282212 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 310/619] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:38.288144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a938a-46e6-409a-8470-064fd4c57b05 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:38.427426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8038-2e27-4499-8435-88728b11422c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:38.440735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a938a-46e6-409a-8470-064fd4c57b05 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:38.493004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2fe5-3e16-4456-9b0b-71ce81bf328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:38.493694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2fe5-3e16-4456-9b0b-71ce81bf328d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:38.493864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2fe5-3e16-4456-9b0b-71ce81bf328d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:38.494130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2fe5-3e16-4456-9b0b-71ce81bf328d None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:38.495028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c2fe5-3e16-4456-9b0b-71ce81bf328d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:38.495207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c2fe5-3e16-4456-9b0b-71ce81bf328d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:38.496467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c2fe5-3e16-4456-9b0b-71ce81bf328d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:38.504509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40f7b1-7c4e-4046-98d6-5dfb0521680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:38.505412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40f7b1-7c4e-4046-98d6-5dfb0521680a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:38.505894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40f7b1-7c4e-4046-98d6-5dfb0521680a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:38.506377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40f7b1-7c4e-4046-98d6-5dfb0521680a None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:38.507356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40f7b1-7c4e-4046-98d6-5dfb0521680a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:38.507884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40f7b1-7c4e-4046-98d6-5dfb0521680a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:38.509534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40f7b1-7c4e-4046-98d6-5dfb0521680a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:38.510244 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 310/620] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:38.522139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2fe5-3e16-4456-9b0b-71ce81bf328d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:38.533780 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 311/621] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 2 00:45:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:38.547709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40f7b1-7c4e-4046-98d6-5dfb0521680a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:38.611321 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:38.617922 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:38.654764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2fe5-3e16-4456-9b0b-71ce81bf328d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:38.724464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca2e14-cb46-4e55-87c4-fa02eb40d9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:38.725021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2e14-cb46-4e55-87c4-fa02eb40d9cb None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:38.725301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2e14-cb46-4e55-87c4-fa02eb40d9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:38.725573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2e14-cb46-4e55-87c4-fa02eb40d9cb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:38.728252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40f7b1-7c4e-4046-98d6-5dfb0521680a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:38.742288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca2e14-cb46-4e55-87c4-fa02eb40d9cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:38.743764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca2e14-cb46-4e55-87c4-fa02eb40d9cb None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-3cca2e14-cb46-4e55-87c4-fa02eb40d9cb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:38.759729 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:38.760769 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:38.762411 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:38.762411 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:38.762411 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:38.762411 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:38.762411 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:38.762411 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:38.762411 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:38.762411 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:38.762411 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 02 00:45:38.762411 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:38.762411 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 311/622] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:38.767262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca2e14-cb46-4e55-87c4-fa02eb40d9cb None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:38.785077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de9f15-3dc8-4f63-ba22-0b396ff88cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:38.785839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de9f15-3dc8-4f63-ba22-0b396ff88cbb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:38.786191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de9f15-3dc8-4f63-ba22-0b396ff88cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:38.786537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de9f15-3dc8-4f63-ba22-0b396ff88cbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:38.797721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de9f15-3dc8-4f63-ba22-0b396ff88cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:38.799395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de9f15-3dc8-4f63-ba22-0b396ff88cbb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-20de9f15-3dc8-4f63-ba22-0b396ff88cbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:38.814798 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:38.815809 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:38.816705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:38.816705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:38.816705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:38.816705 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 312/623] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:38.821963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de9f15-3dc8-4f63-ba22-0b396ff88cbb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:38.970944 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:38.988187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de9f15-3dc8-4f63-ba22-0b396ff88cbb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:39.025624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca2e14-cb46-4e55-87c4-fa02eb40d9cb None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:39.045514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741345d-f8a2-42ef-a7a7-afe4d8af6b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:39.046125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741345d-f8a2-42ef-a7a7-afe4d8af6b77 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:39.046406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741345d-f8a2-42ef-a7a7-afe4d8af6b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:39.049399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741345d-f8a2-42ef-a7a7-afe4d8af6b77 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:39.050079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741345d-f8a2-42ef-a7a7-afe4d8af6b77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:39.050391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741345d-f8a2-42ef-a7a7-afe4d8af6b77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:39.051805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741345d-f8a2-42ef-a7a7-afe4d8af6b77 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:39.078845 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:39.085037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b786ad-308b-4740-bf72-a4032411f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:39.085207 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 313/624] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:39.085652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b786ad-308b-4740-bf72-a4032411f5ce None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:39.085935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b786ad-308b-4740-bf72-a4032411f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:39.086208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b786ad-308b-4740-bf72-a4032411f5ce None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:39.092273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b786ad-308b-4740-bf72-a4032411f5ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:39.092596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b786ad-308b-4740-bf72-a4032411f5ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:39.094037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b786ad-308b-4740-bf72-a4032411f5ce None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:39.095551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741345d-f8a2-42ef-a7a7-afe4d8af6b77 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:39.112760 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 312/625] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 2 00:45:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:39.118218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b786ad-308b-4740-bf72-a4032411f5ce None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:39.233813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b786ad-308b-4740-bf72-a4032411f5ce None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:39.274260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da38e1-a7e6-4f1b-8001-e30dfb3bbc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:39.274819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da38e1-a7e6-4f1b-8001-e30dfb3bbc9b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:39.275102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da38e1-a7e6-4f1b-8001-e30dfb3bbc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:39.275710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da38e1-a7e6-4f1b-8001-e30dfb3bbc9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:39.324185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741345d-f8a2-42ef-a7a7-afe4d8af6b77 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:39.343002 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:39.356451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da38e1-a7e6-4f1b-8001-e30dfb3bbc9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:39.357915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da38e1-a7e6-4f1b-8001-e30dfb3bbc9b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:39.365396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94a3bd-51d9-490d-9fcb-ca6df0f701d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:39.366506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94a3bd-51d9-490d-9fcb-ca6df0f701d5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:39.366834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94a3bd-51d9-490d-9fcb-ca6df0f701d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:39.367117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94a3bd-51d9-490d-9fcb-ca6df0f701d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:39.376151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94a3bd-51d9-490d-9fcb-ca6df0f701d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:39.377627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94a3bd-51d9-490d-9fcb-ca6df0f701d5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ce94a3bd-51d9-490d-9fcb-ca6df0f701d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:39.389280 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:39.390210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:39.391144 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:39.391144 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:39.391144 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:39.391144 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:39.391144 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:39.391144 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:39.391144 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:39.391144 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:39.391144 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 314/626] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:39.392246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5296ee4-55e4-4a20-a73e-2f11060d45ab None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:39.392246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5296ee4-55e4-4a20-a73e-2f11060d45ab None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:39.392511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5296ee4-55e4-4a20-a73e-2f11060d45ab None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:39.393866 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 315/627] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:39.398804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b2f7-28e2-4b48-a269-95e17d990061 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:39.399090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b2f7-28e2-4b48-a269-95e17d990061 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:39.399363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b2f7-28e2-4b48-a269-95e17d990061 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:39.405785 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 316/628] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:39.405785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1b2f7-28e2-4b48-a269-95e17d990061 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:39.418138 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:39.476962 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 313/629] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:39.478518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef5c8b-5ee7-4b08-91c9-7d6ff743a5f4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:39.478835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef5c8b-5ee7-4b08-91c9-7d6ff743a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:39.479103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef5c8b-5ee7-4b08-91c9-7d6ff743a5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:39.497463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1fef5c8b-5ee7-4b08-91c9-7d6ff743a5f4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:39.498663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1fef5c8b-5ee7-4b08-91c9-7d6ff743a5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:39.516628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1b2f7-28e2-4b48-a269-95e17d990061 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:39.550394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b5cfe-67b9-4883-835c-2801195f2e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:39.550937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5cfe-67b9-4883-835c-2801195f2e09 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:39.551211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5cfe-67b9-4883-835c-2801195f2e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:39.551477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5cfe-67b9-4883-835c-2801195f2e09 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:39.552155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b5cfe-67b9-4883-835c-2801195f2e09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:39.552455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b5cfe-67b9-4883-835c-2801195f2e09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:39.553888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b5cfe-67b9-4883-835c-2801195f2e09 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:39.566228 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 317/630] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:39.567395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670414f-4942-44f7-9e33-3d3c66ee3ce5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:39.567675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670414f-4942-44f7-9e33-3d3c66ee3ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:39.567945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670414f-4942-44f7-9e33-3d3c66ee3ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:39.574806 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 314/631] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:39.575831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef5c8b-5ee7-4b08-91c9-7d6ff743a5f4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:39.591382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a670414f-4942-44f7-9e33-3d3c66ee3ce5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:39.593264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a670414f-4942-44f7-9e33-3d3c66ee3ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:39.597099 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:39.679276 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:39.681657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef5c8b-5ee7-4b08-91c9-7d6ff743a5f4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:39.691430 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 318/632] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:39.692545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670414f-4942-44f7-9e33-3d3c66ee3ce5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:39.795552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4750e-c854-4a53-babc-9b3bea4218e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:39.796218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4750e-c854-4a53-babc-9b3bea4218e1 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:39.796496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4750e-c854-4a53-babc-9b3bea4218e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:39.796774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4750e-c854-4a53-babc-9b3bea4218e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:39.805193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670414f-4942-44f7-9e33-3d3c66ee3ce5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:39.816439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4750e-c854-4a53-babc-9b3bea4218e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:39.817956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4750e-c854-4a53-babc-9b3bea4218e1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:39.849819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b36c6-38a8-4155-92e2-a74b7f81f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:39.850329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b36c6-38a8-4155-92e2-a74b7f81f804 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:39.850621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b36c6-38a8-4155-92e2-a74b7f81f804 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:39.855596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b36c6-38a8-4155-92e2-a74b7f81f804 None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/a0fa4948f9b546dea031acfc0f3e3d95/roles/0905222c6f30467abc2b2a41d74fa282` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-41f4750e-c854-4a53-babc-9b3bea4218e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:39.856842 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:39.857747 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:39.858667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:39.858667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:39.858667 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:39.860388 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 315/633] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:39.865344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4750e-c854-4a53-babc-9b3bea4218e1 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:39.875485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b36c6-38a8-4155-92e2-a74b7f81f804 None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=a0fa4948f9b546dea031acfc0f3e3d95, role_id=0905222c6f30467abc2b2a41d74fa282)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:39.876979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b36c6-38a8-4155-92e2-a74b7f81f804 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:39.898624 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 319/634] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:45:39 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/a0fa4948f9b546dea031acfc0f3e3d95/roles/0905222c6f30467abc2b2a41d74fa282 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:39.898624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b36c6-38a8-4155-92e2-a74b7f81f804 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:39.988653 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:40.011814 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:40.045796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b36c6-38a8-4155-92e2-a74b7f81f804 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:40.065314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4750e-c854-4a53-babc-9b3bea4218e1 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:40.083711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813cc6a-74ff-4266-9dd5-c85b84eb8332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:40.083969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813cc6a-74ff-4266-9dd5-c85b84eb8332 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.084278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813cc6a-74ff-4266-9dd5-c85b84eb8332 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.084549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813cc6a-74ff-4266-9dd5-c85b84eb8332 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.097702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813cc6a-74ff-4266-9dd5-c85b84eb8332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:40.101139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d97a-4b12-4987-a8b6-206cb83c9820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:40.101741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d97a-4b12-4987-a8b6-206cb83c9820 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.102016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d97a-4b12-4987-a8b6-206cb83c9820 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.102281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d97a-4b12-4987-a8b6-206cb83c9820 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-3813cc6a-74ff-4266-9dd5-c85b84eb8332 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:40.102780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:40.103829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:40.104692 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:40.105922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410d97a-4b12-4987-a8b6-206cb83c9820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:40.105922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410d97a-4b12-4987-a8b6-206cb83c9820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:40.105922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410d97a-4b12-4987-a8b6-206cb83c9820 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:40.108003 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 320/635] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:40.109485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813cc6a-74ff-4266-9dd5-c85b84eb8332 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:40.119668 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 316/636] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:40.120376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d97a-4b12-4987-a8b6-206cb83c9820 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:40.231762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813cc6a-74ff-4266-9dd5-c85b84eb8332 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:40.241337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d97a-4b12-4987-a8b6-206cb83c9820 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:40.246449 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:40.277016 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:40.280958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df19041-be73-4464-a65e-9f252e413d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:40.281614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df19041-be73-4464-a65e-9f252e413d21 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.281891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df19041-be73-4464-a65e-9f252e413d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.282160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df19041-be73-4464-a65e-9f252e413d21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.283324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b9703-620d-48d2-82b3-22890c3e905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:40.284223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9703-620d-48d2-82b3-22890c3e905f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.284759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9703-620d-48d2-82b3-22890c3e905f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.285173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9703-620d-48d2-82b3-22890c3e905f None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.286479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b9703-620d-48d2-82b3-22890c3e905f None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:40.287004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b9703-620d-48d2-82b3-22890c3e905f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:40.288601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b9703-620d-48d2-82b3-22890c3e905f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:40.297297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df19041-be73-4464-a65e-9f252e413d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:40.299894 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 317/637] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:40.300877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b9703-620d-48d2-82b3-22890c3e905f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5df19041-be73-4464-a65e-9f252e413d21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:40.302897 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:40.304013 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:40.304893 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:40.305529 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 321/638] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:40.312247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df19041-be73-4464-a65e-9f252e413d21 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:40.421912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b9703-620d-48d2-82b3-22890c3e905f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:40.435181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df19041-be73-4464-a65e-9f252e413d21 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:40.460247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7502c3-3aa7-4507-93cd-311d00502ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:40.460880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7502c3-3aa7-4507-93cd-311d00502ecc None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.461162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7502c3-3aa7-4507-93cd-311d00502ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.461438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7502c3-3aa7-4507-93cd-311d00502ecc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.469946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7502c3-3aa7-4507-93cd-311d00502ecc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:40.471433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7502c3-3aa7-4507-93cd-311d00502ecc None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:40.472711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20218850-5623-40df-af3d-33f4d07e79bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:40.473622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20218850-5623-40df-af3d-33f4d07e79bb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.474150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20218850-5623-40df-af3d-33f4d07e79bb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.474626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20218850-5623-40df-af3d-33f4d07e79bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-cf7502c3-3aa7-4507-93cd-311d00502ecc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:40.483457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:40.484369 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:40.485273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:40.485273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:40.485273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:40.485273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:40.485273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:40.485273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:40.485273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:40.485273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:40.485273 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 318/639] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:40.485767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7502c3-3aa7-4507-93cd-311d00502ecc None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:40.488632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20218850-5623-40df-af3d-33f4d07e79bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:40.490345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20218850-5623-40df-af3d-33f4d07e79bb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-20218850-5623-40df-af3d-33f4d07e79bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:40.505229 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:40.506277 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:40.507245 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:40.507245 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:40.507245 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:40.510998 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 322/640] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:40.512961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e867d7-fa99-4313-9e8b-7b4c1d8e02ba None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.513245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e867d7-fa99-4313-9e8b-7b4c1d8e02ba None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.513520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e867d7-fa99-4313-9e8b-7b4c1d8e02ba None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.515274 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 323/641] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:40.515956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e867d7-fa99-4313-9e8b-7b4c1d8e02ba None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:40.545226 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:40.553103 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:40.605064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7502c3-3aa7-4507-93cd-311d00502ecc None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:40.633511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e867d7-fa99-4313-9e8b-7b4c1d8e02ba None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:40.643841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413f2b6-cd6c-487b-b240-11ac16ae9f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:40.644690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413f2b6-cd6c-487b-b240-11ac16ae9f74 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.644972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413f2b6-cd6c-487b-b240-11ac16ae9f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.645237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413f2b6-cd6c-487b-b240-11ac16ae9f74 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.645965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413f2b6-cd6c-487b-b240-11ac16ae9f74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:40.646270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413f2b6-cd6c-487b-b240-11ac16ae9f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:40.647691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413f2b6-cd6c-487b-b240-11ac16ae9f74 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:40.658939 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 319/642] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:40.659661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413f2b6-cd6c-487b-b240-11ac16ae9f74 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:40.676199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3d31e-b22a-4cf1-884a-2726f0932168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:40.676726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3d31e-b22a-4cf1-884a-2726f0932168 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.677010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3d31e-b22a-4cf1-884a-2726f0932168 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.677287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3d31e-b22a-4cf1-884a-2726f0932168 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.677977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3d31e-b22a-4cf1-884a-2726f0932168 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:40.678287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3d31e-b22a-4cf1-884a-2726f0932168 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:40.679766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3d31e-b22a-4cf1-884a-2726f0932168 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:40.697220 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 324/643] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:40.697220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74ce83-9adb-4b85-a26f-479d81bdd65f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.697220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74ce83-9adb-4b85-a26f-479d81bdd65f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.697220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74ce83-9adb-4b85-a26f-479d81bdd65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.714333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ee74ce83-9adb-4b85-a26f-479d81bdd65f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:40.716562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee74ce83-9adb-4b85-a26f-479d81bdd65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:40.774839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413f2b6-cd6c-487b-b240-11ac16ae9f74 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:40.788811 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:40.795855 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 325/644] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:40.795855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74ce83-9adb-4b85-a26f-479d81bdd65f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:40.812386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527b0e-9c8f-44d9-a4ec-518d0178274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:40.812993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527b0e-9c8f-44d9-a4ec-518d0178274c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.813271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527b0e-9c8f-44d9-a4ec-518d0178274c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.813659 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:40.814254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527b0e-9c8f-44d9-a4ec-518d0178274c None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.814986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85527b0e-9c8f-44d9-a4ec-518d0178274c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:40.815341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85527b0e-9c8f-44d9-a4ec-518d0178274c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:40.816723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85527b0e-9c8f-44d9-a4ec-518d0178274c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:40.831029 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 320/645] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:40.831673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527b0e-9c8f-44d9-a4ec-518d0178274c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:40.925531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74ce83-9adb-4b85-a26f-479d81bdd65f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:40.952490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527b0e-9c8f-44d9-a4ec-518d0178274c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:40.965288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb2728-e560-48e7-8c9e-9ccb129da63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:40.966009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb2728-e560-48e7-8c9e-9ccb129da63f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:40.966383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb2728-e560-48e7-8c9e-9ccb129da63f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:40.966831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb2728-e560-48e7-8c9e-9ccb129da63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:40.981303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb2728-e560-48e7-8c9e-9ccb129da63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:40.983031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb2728-e560-48e7-8c9e-9ccb129da63f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:40.999677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2750d-2783-4e1a-bb66-12177a56457d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:41.000284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2750d-2783-4e1a-bb66-12177a56457d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.000568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2750d-2783-4e1a-bb66-12177a56457d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.000845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2750d-2783-4e1a-bb66-12177a56457d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-38cb2728-e560-48e7-8c9e-9ccb129da63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:41.001391 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:41.002323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:41.003412 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:41.003412 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:41.003412 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:41.003585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2750d-2783-4e1a-bb66-12177a56457d None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=7cee33d8425d4be0ba5721ec419a12e1) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:41.003585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2750d-2783-4e1a-bb66-12177a56457d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:41.003711 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 326/646] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:41.003779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2750d-2783-4e1a-bb66-12177a56457d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:41.003859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb2728-e560-48e7-8c9e-9ccb129da63f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:41.017975 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 321/647] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:40 2022] GET /identity/v3/role_assignments?user.id=7cee33d8425d4be0ba5721ec419a12e1&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:41.017975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2750d-2783-4e1a-bb66-12177a56457d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:41.088026 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:41.110633 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:41.140692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb2728-e560-48e7-8c9e-9ccb129da63f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:41.181350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa5b52-e69f-4356-9ff7-71c61530c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:41.182422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5b52-e69f-4356-9ff7-71c61530c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.182939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5b52-e69f-4356-9ff7-71c61530c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.183458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5b52-e69f-4356-9ff7-71c61530c1d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.184604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2750d-2783-4e1a-bb66-12177a56457d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:41.193132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa5b52-e69f-4356-9ff7-71c61530c1d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:41.195046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa5b52-e69f-4356-9ff7-71c61530c1d4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c7aa5b52-e69f-4356-9ff7-71c61530c1d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:41.208964 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:41.209960 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:41.210959 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:41.210959 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:41.210959 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:41.210959 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:41.210959 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:41.210959 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:41.210959 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:41.210959 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:41.210959 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:45:41.210959 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:41.220389 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 327/648] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 2 00:45:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:41.222547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa5b52-e69f-4356-9ff7-71c61530c1d4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:41.226322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca5aa2-5cd0-4a04-b364-0ec7cdf07873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:41.227135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5aa2-5cd0-4a04-b364-0ec7cdf07873 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.227456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5aa2-5cd0-4a04-b364-0ec7cdf07873 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.227804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5aa2-5cd0-4a04-b364-0ec7cdf07873 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.228549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca5aa2-5cd0-4a04-b364-0ec7cdf07873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:41.229756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca5aa2-5cd0-4a04-b364-0ec7cdf07873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:41.230735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca5aa2-5cd0-4a04-b364-0ec7cdf07873 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:41.244257 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 322/649] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:41.245858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca5aa2-5cd0-4a04-b364-0ec7cdf07873 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:41.341163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa5b52-e69f-4356-9ff7-71c61530c1d4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:41.358484 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:41.363564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca5aa2-5cd0-4a04-b364-0ec7cdf07873 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:41.370091 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:41.385424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0401e89-f129-4a1e-8b86-764ae479f9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:41.386235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0401e89-f129-4a1e-8b86-764ae479f9ee None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.386705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0401e89-f129-4a1e-8b86-764ae479f9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.386908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0401e89-f129-4a1e-8b86-764ae479f9ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.399963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0401e89-f129-4a1e-8b86-764ae479f9ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:41.401686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10252778-5596-4504-b0de-2692a1f47489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:41.402845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252778-5596-4504-b0de-2692a1f47489 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.403129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252778-5596-4504-b0de-2692a1f47489 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.403401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252778-5596-4504-b0de-2692a1f47489 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.404133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10252778-5596-4504-b0de-2692a1f47489 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:41.404439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10252778-5596-4504-b0de-2692a1f47489 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b0401e89-f129-4a1e-8b86-764ae479f9ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:41.405850 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:41.406842 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:41.407721 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:41.408932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10252778-5596-4504-b0de-2692a1f47489 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:41.409087 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 328/650] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:41.409087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0401e89-f129-4a1e-8b86-764ae479f9ee None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:41.428919 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 323/651] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 2 00:45:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:41.429772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10252778-5596-4504-b0de-2692a1f47489 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:41.538338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10252778-5596-4504-b0de-2692a1f47489 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:41.539489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0401e89-f129-4a1e-8b86-764ae479f9ee None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:41.584249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfa0ae-f4a7-4aa5-88c1-a04ba606cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:41.584950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfa0ae-f4a7-4aa5-88c1-a04ba606cae3 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.585159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfa0ae-f4a7-4aa5-88c1-a04ba606cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.585412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfa0ae-f4a7-4aa5-88c1-a04ba606cae3 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.586090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfa0ae-f4a7-4aa5-88c1-a04ba606cae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:41.586387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfa0ae-f4a7-4aa5-88c1-a04ba606cae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:41.587121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb7ca-d377-4d93-999e-75f59d78c274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:41.587776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfa0ae-f4a7-4aa5-88c1-a04ba606cae3 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:41.588162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb7ca-d377-4d93-999e-75f59d78c274 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.588645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb7ca-d377-4d93-999e-75f59d78c274 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.589447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb7ca-d377-4d93-999e-75f59d78c274 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.597205 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 324/652] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:41.598047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfa0ae-f4a7-4aa5-88c1-a04ba606cae3 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:41.600040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cb7ca-d377-4d93-999e-75f59d78c274 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:41.603255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cb7ca-d377-4d93-999e-75f59d78c274 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:41.619668 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-910cb7ca-d377-4d93-999e-75f59d78c274 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:41.620340 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:41.621828 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:41.622805 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:41.622805 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:41.622805 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:41.622805 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:41.622805 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:41.622805 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:41.622805 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:41.622805 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:41.622805 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:45:41.622805 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:41.630921 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 329/653] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:41.631687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb7ca-d377-4d93-999e-75f59d78c274 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:41.681903 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:41.732937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfa0ae-f4a7-4aa5-88c1-a04ba606cae3 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:41.748095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb7ca-d377-4d93-999e-75f59d78c274 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:41.778142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b173cb-7d04-439f-baec-43c44dd0612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:41.778909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b173cb-7d04-439f-baec-43c44dd0612d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.779254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b173cb-7d04-439f-baec-43c44dd0612d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.779594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b173cb-7d04-439f-baec-43c44dd0612d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.793159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54c124-e0d3-46d0-8116-75693f19585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:41.794454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54c124-e0d3-46d0-8116-75693f19585d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.795310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54c124-e0d3-46d0-8116-75693f19585d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.795764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54c124-e0d3-46d0-8116-75693f19585d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.810731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54c124-e0d3-46d0-8116-75693f19585d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:41.812913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54c124-e0d3-46d0-8116-75693f19585d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ca54c124-e0d3-46d0-8116-75693f19585d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:41.831205 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:41.832670 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:41.833576 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:41.833576 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:41.833576 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:41.833576 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 330/654] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:41.833576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54c124-e0d3-46d0-8116-75693f19585d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:41.865182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b173cb-7d04-439f-baec-43c44dd0612d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:41.867649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b173cb-7d04-439f-baec-43c44dd0612d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:41.922988 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:41.935331 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:41.944280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54c124-e0d3-46d0-8116-75693f19585d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:41.993761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ebd49-dddc-4511-8e97-89b23eaa7290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:41.994528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ebd49-dddc-4511-8e97-89b23eaa7290 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:41.994910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ebd49-dddc-4511-8e97-89b23eaa7290 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:41.995270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ebd49-dddc-4511-8e97-89b23eaa7290 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:41.996224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ebd49-dddc-4511-8e97-89b23eaa7290 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:41.996788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ebd49-dddc-4511-8e97-89b23eaa7290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:41.997502 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 325/655] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:41.998489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b173cb-7d04-439f-baec-43c44dd0612d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:41.998642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ebd49-dddc-4511-8e97-89b23eaa7290 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.022304 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 331/656] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 2 00:45:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:42.023417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ebd49-dddc-4511-8e97-89b23eaa7290 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.137474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b173cb-7d04-439f-baec-43c44dd0612d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:42.162779 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:42.165281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ebd49-dddc-4511-8e97-89b23eaa7290 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:42.184972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f20ab-91cb-4b88-9281-ac084991134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:42.185863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f20ab-91cb-4b88-9281-ac084991134d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.186139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f20ab-91cb-4b88-9281-ac084991134d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.186408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f20ab-91cb-4b88-9281-ac084991134d None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.187082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f20ab-91cb-4b88-9281-ac084991134d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:42.187385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f20ab-91cb-4b88-9281-ac084991134d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:42.188747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f20ab-91cb-4b88-9281-ac084991134d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.202758 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 326/657] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:42.202758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f20ab-91cb-4b88-9281-ac084991134d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.206199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557ec9d-f27f-477a-99fa-6746eb1789e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:42.206929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ec9d-f27f-477a-99fa-6746eb1789e5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.207210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ec9d-f27f-477a-99fa-6746eb1789e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.207482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ec9d-f27f-477a-99fa-6746eb1789e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.218700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ec9d-f27f-477a-99fa-6746eb1789e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:42.220153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ec9d-f27f-477a-99fa-6746eb1789e5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-3557ec9d-f27f-477a-99fa-6746eb1789e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:42.234895 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:42.235847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:42.236751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:42.236751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:42.236751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:42.236751 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 332/658] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:42.237371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8afbdc-3c89-484f-9ec1-7444f52afc9b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.237475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8afbdc-3c89-484f-9ec1-7444f52afc9b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.237744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8afbdc-3c89-484f-9ec1-7444f52afc9b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.242649 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 333/659] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:42.242649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8afbdc-3c89-484f-9ec1-7444f52afc9b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.254831 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:42.314934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f20ab-91cb-4b88-9281-ac084991134d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:42.351043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e1ec5-6fa0-4180-be18-344b19752dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:42.351742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e1ec5-6fa0-4180-be18-344b19752dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.352109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e1ec5-6fa0-4180-be18-344b19752dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.352384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e1ec5-6fa0-4180-be18-344b19752dd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.352966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8afbdc-3c89-484f-9ec1-7444f52afc9b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:42.388783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83089b-95c7-4754-8128-646b5d4997bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:42.389335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83089b-95c7-4754-8128-646b5d4997bf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.389618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83089b-95c7-4754-8128-646b5d4997bf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.389890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83089b-95c7-4754-8128-646b5d4997bf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.397463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83089b-95c7-4754-8128-646b5d4997bf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:42.398946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83089b-95c7-4754-8128-646b5d4997bf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.407598 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0e83089b-95c7-4754-8128-646b5d4997bf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:42.411113 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:42.412058 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 334/660] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:42.413290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83089b-95c7-4754-8128-646b5d4997bf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.440541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e1ec5-6fa0-4180-be18-344b19752dd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:42.442557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e1ec5-6fa0-4180-be18-344b19752dd2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.483481 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:42.525097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83089b-95c7-4754-8128-646b5d4997bf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:42.551480 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 327/661] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:42.553136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887243-5125-4df7-90c1-b9360e0cfc59 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.553422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887243-5125-4df7-90c1-b9360e0cfc59 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.553696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887243-5125-4df7-90c1-b9360e0cfc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.567676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaf78c-6816-491b-a0a5-a88302580284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:42.568610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaf78c-6816-491b-a0a5-a88302580284 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.569084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaf78c-6816-491b-a0a5-a88302580284 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.569578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaf78c-6816-491b-a0a5-a88302580284 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.570409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaf78c-6816-491b-a0a5-a88302580284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:42.570941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaf78c-6816-491b-a0a5-a88302580284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:42.572481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0a887243-5125-4df7-90c1-b9360e0cfc59 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:42.572697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaf78c-6816-491b-a0a5-a88302580284 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.573657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0a887243-5125-4df7-90c1-b9360e0cfc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:42.586327 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 335/662] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:42.587429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaf78c-6816-491b-a0a5-a88302580284 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.662708 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 328/663] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:42.662708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a887243-5125-4df7-90c1-b9360e0cfc59 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.672341 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:42.714173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaf78c-6816-491b-a0a5-a88302580284 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:42.749375 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:42.760458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049602cd-0e47-4ed1-a11c-8dc7fc8fff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:42.761300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049602cd-0e47-4ed1-a11c-8dc7fc8fff91 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.761807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049602cd-0e47-4ed1-a11c-8dc7fc8fff91 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.762177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049602cd-0e47-4ed1-a11c-8dc7fc8fff91 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.763248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049602cd-0e47-4ed1-a11c-8dc7fc8fff91 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:42.763656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049602cd-0e47-4ed1-a11c-8dc7fc8fff91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:42.765380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049602cd-0e47-4ed1-a11c-8dc7fc8fff91 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.783736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a887243-5125-4df7-90c1-b9360e0cfc59 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:42.788686 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 336/664] 10.222.0.23 () {56 vars in 1139 bytes} [Sun Oct 2 00:45:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:42.789645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049602cd-0e47-4ed1-a11c-8dc7fc8fff91 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.830976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac1e45-d209-428b-8611-a44350eca454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:42.832142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac1e45-d209-428b-8611-a44350eca454 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.832430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac1e45-d209-428b-8611-a44350eca454 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.832703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac1e45-d209-428b-8611-a44350eca454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.847421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac1e45-d209-428b-8611-a44350eca454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:42.849234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac1e45-d209-428b-8611-a44350eca454 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-19ac1e45-d209-428b-8611-a44350eca454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:42.868760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:42.869871 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:42.871345 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:42.871345 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:42.871345 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:42.871345 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 329/665] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:42.872884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac1e45-d209-428b-8611-a44350eca454 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.905672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049602cd-0e47-4ed1-a11c-8dc7fc8fff91 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:42.938174 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:42.948189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204d89b-6a1d-4238-a873-42a8034099c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:42.949144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204d89b-6a1d-4238-a873-42a8034099c6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:42.949649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204d89b-6a1d-4238-a873-42a8034099c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:42.950064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204d89b-6a1d-4238-a873-42a8034099c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:42.960064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204d89b-6a1d-4238-a873-42a8034099c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:42.961705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204d89b-6a1d-4238-a873-42a8034099c6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0204d89b-6a1d-4238-a873-42a8034099c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:42.974821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:42.975783 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:42.976695 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:42.976695 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:42.976695 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:42.976695 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:42.976695 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:42.976695 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:42.976695 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:42.976695 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:42.981662 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 337/666] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:42.982536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204d89b-6a1d-4238-a873-42a8034099c6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:42.990108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac1e45-d209-428b-8611-a44350eca454 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:43.028333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60155a1f-1c1a-407f-a792-95c5531754cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:43.028949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60155a1f-1c1a-407f-a792-95c5531754cd None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.029348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60155a1f-1c1a-407f-a792-95c5531754cd None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.029597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60155a1f-1c1a-407f-a792-95c5531754cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.031345 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:43.089538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204d89b-6a1d-4238-a873-42a8034099c6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:43.100816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60155a1f-1c1a-407f-a792-95c5531754cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:43.102271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60155a1f-1c1a-407f-a792-95c5531754cd None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:43.127352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d5d7c-d5c8-4d6f-ac24-94d30a4676b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:43.127961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d5d7c-d5c8-4d6f-ac24-94d30a4676b2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.128237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d5d7c-d5c8-4d6f-ac24-94d30a4676b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.128506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d5d7c-d5c8-4d6f-ac24-94d30a4676b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.129144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d5d7c-d5c8-4d6f-ac24-94d30a4676b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:43.129449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d5d7c-d5c8-4d6f-ac24-94d30a4676b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:43.130857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d5d7c-d5c8-4d6f-ac24-94d30a4676b2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:43.142904 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 338/667] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:43.143693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d5d7c-d5c8-4d6f-ac24-94d30a4676b2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:43.165868 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:43.213702 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 330/668] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:43.215099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60155a1f-1c1a-407f-a792-95c5531754cd None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:43.255478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d5d7c-d5c8-4d6f-ac24-94d30a4676b2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:43.257768 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:43.290692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3439c-eb09-4114-aa24-fb769b7dc5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:43.291297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3439c-eb09-4114-aa24-fb769b7dc5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.291570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3439c-eb09-4114-aa24-fb769b7dc5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.291865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3439c-eb09-4114-aa24-fb769b7dc5f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.293164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3439c-eb09-4114-aa24-fb769b7dc5f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:43.293468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3439c-eb09-4114-aa24-fb769b7dc5f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:43.295186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3439c-eb09-4114-aa24-fb769b7dc5f3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:43.306627 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 339/669] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:43.307397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3439c-eb09-4114-aa24-fb769b7dc5f3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:43.327694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60155a1f-1c1a-407f-a792-95c5531754cd None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:43.366723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08526a47-ff8b-4b81-95b8-ae81c230f48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:43.367477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08526a47-ff8b-4b81-95b8-ae81c230f48d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.367759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08526a47-ff8b-4b81-95b8-ae81c230f48d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.368134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08526a47-ff8b-4b81-95b8-ae81c230f48d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.381028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08526a47-ff8b-4b81-95b8-ae81c230f48d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-08526a47-ff8b-4b81-95b8-ae81c230f48d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:43.385866 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:43.387641 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:43.388510 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 331/670] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:43.389201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08526a47-ff8b-4b81-95b8-ae81c230f48d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:43.412693 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:43.415983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3439c-eb09-4114-aa24-fb769b7dc5f3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:43.458980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab26ad-831a-4196-9166-4abcd8d002d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:43.459614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab26ad-831a-4196-9166-4abcd8d002d6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.459898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab26ad-831a-4196-9166-4abcd8d002d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.460172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab26ad-831a-4196-9166-4abcd8d002d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.467098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab26ad-831a-4196-9166-4abcd8d002d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:43.468497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab26ad-831a-4196-9166-4abcd8d002d6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f3ab26ad-831a-4196-9166-4abcd8d002d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:43.481428 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:43.482505 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:43.483478 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:43.483478 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:43.483478 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:43.483478 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:43.483478 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:43.483478 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:43.483478 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:43.483478 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:43.486736 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 340/671] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:43.487704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab26ad-831a-4196-9166-4abcd8d002d6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:43.495582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08526a47-ff8b-4b81-95b8-ae81c230f48d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:43.512763 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:43.528877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c175f93-8409-47c5-876d-82d05f1cb18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:43.529495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175f93-8409-47c5-876d-82d05f1cb18d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.529776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175f93-8409-47c5-876d-82d05f1cb18d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.530046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175f93-8409-47c5-876d-82d05f1cb18d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.539603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c175f93-8409-47c5-876d-82d05f1cb18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:43.541025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c175f93-8409-47c5-876d-82d05f1cb18d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-0c175f93-8409-47c5-876d-82d05f1cb18d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:43.555743 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:43.556728 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:43.557622 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:43.557622 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:43.557622 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:43.557622 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 332/672] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:43.557622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c175f93-8409-47c5-876d-82d05f1cb18d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:43.593191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab26ad-831a-4196-9166-4abcd8d002d6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:43.626867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8bd99-d117-4623-8d65-4ed1ccaa5bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:43.627461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8bd99-d117-4623-8d65-4ed1ccaa5bbe None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.627742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8bd99-d117-4623-8d65-4ed1ccaa5bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.628011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8bd99-d117-4623-8d65-4ed1ccaa5bbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.628729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8bd99-d117-4623-8d65-4ed1ccaa5bbe None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=b85fc7e555f348c3ab6c63ee15f6ceb0) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:43.629020 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:43.629128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8bd99-d117-4623-8d65-4ed1ccaa5bbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:43.630518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8bd99-d117-4623-8d65-4ed1ccaa5bbe None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:43.636570 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 341/673] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:43 2022] GET /identity/v3/role_assignments?user.id=b85fc7e555f348c3ab6c63ee15f6ceb0&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:43.637475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f85ef-bec9-4625-9823-f102fe94f528 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.637756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f85ef-bec9-4625-9823-f102fe94f528 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.638027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f85ef-bec9-4625-9823-f102fe94f528 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.639237 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 342/674] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:43.640014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f85ef-bec9-4625-9823-f102fe94f528 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:43.672867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c175f93-8409-47c5-876d-82d05f1cb18d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:43.712705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24893755-cd00-4241-b61c-63661789394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:43.713520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24893755-cd00-4241-b61c-63661789394d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.713898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24893755-cd00-4241-b61c-63661789394d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.714811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24893755-cd00-4241-b61c-63661789394d None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.716067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24893755-cd00-4241-b61c-63661789394d None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:43.716548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24893755-cd00-4241-b61c-63661789394d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:43.718101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24893755-cd00-4241-b61c-63661789394d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:43.732247 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 333/675] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:43.732247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24893755-cd00-4241-b61c-63661789394d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:43.749383 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:43.764626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f85ef-bec9-4625-9823-f102fe94f528 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:43.804664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cf977-60eb-4161-91c0-ad24e71339af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:43.805687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cf977-60eb-4161-91c0-ad24e71339af None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.805886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cf977-60eb-4161-91c0-ad24e71339af None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.806178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cf977-60eb-4161-91c0-ad24e71339af None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.807220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cf977-60eb-4161-91c0-ad24e71339af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:43.807526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cf977-60eb-4161-91c0-ad24e71339af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:43.809329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cf977-60eb-4161-91c0-ad24e71339af None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:43.821908 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 343/676] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:43.824892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9610127-8e43-4732-ab36-812fa7ad4c0f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.824892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9610127-8e43-4732-ab36-812fa7ad4c0f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.825273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9610127-8e43-4732-ab36-812fa7ad4c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.845041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24893755-cd00-4241-b61c-63661789394d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:43.845237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f9610127-8e43-4732-ab36-812fa7ad4c0f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:43.846331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f9610127-8e43-4732-ab36-812fa7ad4c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:43.888898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b3994-811a-4478-89e7-838b66c21097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:43.889517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3994-811a-4478-89e7-838b66c21097 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:43.889802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3994-811a-4478-89e7-838b66c21097 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:43.890079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3994-811a-4478-89e7-838b66c21097 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:43.891326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b3994-811a-4478-89e7-838b66c21097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:43.891631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b3994-811a-4478-89e7-838b66c21097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:43.893404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b3994-811a-4478-89e7-838b66c21097 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:43.895659 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:43.908835 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 334/677] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:43.910285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b3994-811a-4478-89e7-838b66c21097 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:43.918795 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 344/678] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:43.919706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9610127-8e43-4732-ab36-812fa7ad4c0f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:44.019410 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:44.049151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b3994-811a-4478-89e7-838b66c21097 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:44.049674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9610127-8e43-4732-ab36-812fa7ad4c0f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:44.091924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416c3a0-a89b-41f3-b3a6-95cd773b6dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:44.092558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c3a0-a89b-41f3-b3a6-95cd773b6dba None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:44.092843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c3a0-a89b-41f3-b3a6-95cd773b6dba None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:44.093114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c3a0-a89b-41f3-b3a6-95cd773b6dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:44.100657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b361a17-6f94-4b8d-b4b4-b2ad08892d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:44.101602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b361a17-6f94-4b8d-b4b4-b2ad08892d90 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:44.102131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b361a17-6f94-4b8d-b4b4-b2ad08892d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:44.102615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b361a17-6f94-4b8d-b4b4-b2ad08892d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:44.103637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b361a17-6f94-4b8d-b4b4-b2ad08892d90 None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=c62cd9bcc90e4d6685c5d0fc1d8ceae3) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:44.104187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b361a17-6f94-4b8d-b4b4-b2ad08892d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:44.105899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416c3a0-a89b-41f3-b3a6-95cd773b6dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:44.106793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b361a17-6f94-4b8d-b4b4-b2ad08892d90 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:44.107463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416c3a0-a89b-41f3-b3a6-95cd773b6dba None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:44.114086 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 345/679] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:43 2022] GET /identity/v3/role_assignments?user.id=c62cd9bcc90e4d6685c5d0fc1d8ceae3&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:44.115339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b361a17-6f94-4b8d-b4b4-b2ad08892d90 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-0416c3a0-a89b-41f3-b3a6-95cd773b6dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:44.123980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:44.125027 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:44.125957 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:44.125957 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:44.125957 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:44.129892 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 335/680] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:44.131302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416c3a0-a89b-41f3-b3a6-95cd773b6dba None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:44.187275 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:44.249762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b361a17-6f94-4b8d-b4b4-b2ad08892d90 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:44.264761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416c3a0-a89b-41f3-b3a6-95cd773b6dba None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:44.307371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec4092-ce2a-44ab-9472-d2ce015690f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:44.307713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd878a-218c-41b1-a687-a56862bb4bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:44.309023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec4092-ce2a-44ab-9472-d2ce015690f4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:44.309281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd878a-218c-41b1-a687-a56862bb4bce None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:44.309618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec4092-ce2a-44ab-9472-d2ce015690f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:44.309833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd878a-218c-41b1-a687-a56862bb4bce None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:44.310203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd878a-218c-41b1-a687-a56862bb4bce None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:44.310314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec4092-ce2a-44ab-9472-d2ce015690f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:44.311411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd878a-218c-41b1-a687-a56862bb4bce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:44.311994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd878a-218c-41b1-a687-a56862bb4bce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:44.313709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd878a-218c-41b1-a687-a56862bb4bce None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:44.320105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec4092-ce2a-44ab-9472-d2ce015690f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:44.321881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec4092-ce2a-44ab-9472-d2ce015690f4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:44.334114 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 336/681] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:44.334114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd878a-218c-41b1-a687-a56862bb4bce None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-96ec4092-ce2a-44ab-9472-d2ce015690f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:44.348745 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:44.349889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:44.351050 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:44.351050 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:44.351050 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:44.351050 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:44.351050 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:44.351050 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:44.351050 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:44.351050 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:44.353464 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 346/682] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:44.354495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec4092-ce2a-44ab-9472-d2ce015690f4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:44.359106 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:44.467849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd878a-218c-41b1-a687-a56862bb4bce None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:44.478949 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:44.479585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec4092-ce2a-44ab-9472-d2ce015690f4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:44.506838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d800e0-d7fc-431e-a775-b7ed3a5a4497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:44.506838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d800e0-d7fc-431e-a775-b7ed3a5a4497 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:44.506838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d800e0-d7fc-431e-a775-b7ed3a5a4497 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:44.506838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d800e0-d7fc-431e-a775-b7ed3a5a4497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:44.517400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63adeca-6ed6-4380-9795-0f65b63aefdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:44.518000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d800e0-d7fc-431e-a775-b7ed3a5a4497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:44.518406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63adeca-6ed6-4380-9795-0f65b63aefdc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:44.518876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63adeca-6ed6-4380-9795-0f65b63aefdc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:44.519286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63adeca-6ed6-4380-9795-0f65b63aefdc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:44.519993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d800e0-d7fc-431e-a775-b7ed3a5a4497 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:44.528237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63adeca-6ed6-4380-9795-0f65b63aefdc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:44.529861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63adeca-6ed6-4380-9795-0f65b63aefdc None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-e8d800e0-d7fc-431e-a775-b7ed3a5a4497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:44.536385 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:44.537465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:44.538383 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:44.538383 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:44.538383 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:44.539428 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 337/683] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:44.540296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d800e0-d7fc-431e-a775-b7ed3a5a4497 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f63adeca-6ed6-4380-9795-0f65b63aefdc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:44.545675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:44.546852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:44.547808 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:44.547808 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:44.547808 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:44.547808 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:44.547808 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:44.547808 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:44.547808 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:44.547808 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:44.547808 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:45:44.547808 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:44.554524 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 347/684] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:44.555649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63adeca-6ed6-4380-9795-0f65b63aefdc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:44.623451 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:44.658043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d800e0-d7fc-431e-a775-b7ed3a5a4497 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:44.664358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63adeca-6ed6-4380-9795-0f65b63aefdc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:44.695700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b39ad-5022-4d73-9daf-9b13c0960418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:44.696325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b39ad-5022-4d73-9daf-9b13c0960418 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:44.696837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b39ad-5022-4d73-9daf-9b13c0960418 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:44.697180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b39ad-5022-4d73-9daf-9b13c0960418 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:44.698104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b39ad-5022-4d73-9daf-9b13c0960418 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:44.698389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b39ad-5022-4d73-9daf-9b13c0960418 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:44.700456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b39ad-5022-4d73-9daf-9b13c0960418 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:44.704201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb7a57-7390-43e1-b28a-0d437d4fa578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:44.705019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb7a57-7390-43e1-b28a-0d437d4fa578 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:44.705490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb7a57-7390-43e1-b28a-0d437d4fa578 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:44.705934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb7a57-7390-43e1-b28a-0d437d4fa578 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:44.706800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb7a57-7390-43e1-b28a-0d437d4fa578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:44.707274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb7a57-7390-43e1-b28a-0d437d4fa578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:44.708835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb7a57-7390-43e1-b28a-0d437d4fa578 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:44.715006 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 338/685] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:44.715921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b39ad-5022-4d73-9daf-9b13c0960418 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:44.723731 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 348/686] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:44.724937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb7a57-7390-43e1-b28a-0d437d4fa578 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:44.761837 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:44.823306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b39ad-5022-4d73-9daf-9b13c0960418 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:44.828439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb7a57-7390-43e1-b28a-0d437d4fa578 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:44.851882 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:44.861487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fc68b-aeb4-4b38-b9ef-f5b01516266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:44.862920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc68b-aeb4-4b38-b9ef-f5b01516266b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:44.863593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc68b-aeb4-4b38-b9ef-f5b01516266b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:44.863935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc68b-aeb4-4b38-b9ef-f5b01516266b None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:44.864926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fc68b-aeb4-4b38-b9ef-f5b01516266b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:44.865288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fc68b-aeb4-4b38-b9ef-f5b01516266b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:44.865751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b73060-69e3-4ba2-82e9-99640ba091c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:44.866531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b73060-69e3-4ba2-82e9-99640ba091c8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:44.866933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fc68b-aeb4-4b38-b9ef-f5b01516266b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:44.867201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b73060-69e3-4ba2-82e9-99640ba091c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:44.867640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b73060-69e3-4ba2-82e9-99640ba091c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:44.868530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b73060-69e3-4ba2-82e9-99640ba091c8 None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=29854b3a4cda48f8a1dea8a01b4589a1) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:44.869018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b73060-69e3-4ba2-82e9-99640ba091c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:44.870653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b73060-69e3-4ba2-82e9-99640ba091c8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:44.877045 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 349/687] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:44 2022] GET /identity/v3/role_assignments?user.id=29854b3a4cda48f8a1dea8a01b4589a1&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:44.878175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b73060-69e3-4ba2-82e9-99640ba091c8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:44.885763 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 339/688] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 2 00:45:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:44.892376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fc68b-aeb4-4b38-b9ef-f5b01516266b None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:44.993473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b73060-69e3-4ba2-82e9-99640ba091c8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:45.018862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fc68b-aeb4-4b38-b9ef-f5b01516266b None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:45.031694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0a8b6-e898-4873-93cd-c404d55ce4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:45.032671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0a8b6-e898-4873-93cd-c404d55ce4f9 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:45.033156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0a8b6-e898-4873-93cd-c404d55ce4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:45.033608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0a8b6-e898-4873-93cd-c404d55ce4f9 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:45.034459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0a8b6-e898-4873-93cd-c404d55ce4f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:45.036336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0a8b6-e898-4873-93cd-c404d55ce4f9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:45.047010 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:45.060400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d5ed6-cb0b-4369-a7db-015d87eca940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:45.061222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d5ed6-cb0b-4369-a7db-015d87eca940 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:45.061569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d5ed6-cb0b-4369-a7db-015d87eca940 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:45.061936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d5ed6-cb0b-4369-a7db-015d87eca940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:45.063433 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 350/689] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:45:44 2022] POST /identity/v3/users => generated 254 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:45:45.152422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d5ed6-cb0b-4369-a7db-015d87eca940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:45.152789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d5ed6-cb0b-4369-a7db-015d87eca940 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:45.239789 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:45.276865 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 340/690] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:45.282966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0a8b6-e898-4873-93cd-c404d55ce4f9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:45.341941 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:45.410523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0a8b6-e898-4873-93cd-c404d55ce4f9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:45.446301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6574d-6b1c-431b-9d78-2b62a49600b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:45.446958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6574d-6b1c-431b-9d78-2b62a49600b6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:45.447236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6574d-6b1c-431b-9d78-2b62a49600b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:45.447502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6574d-6b1c-431b-9d78-2b62a49600b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:45.458932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6574d-6b1c-431b-9d78-2b62a49600b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:45.460388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6574d-6b1c-431b-9d78-2b62a49600b6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-68c6574d-6b1c-431b-9d78-2b62a49600b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:45.474780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:45.475752 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:45.476645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:45.476645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:45.476645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:45.476645 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 351/691] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:45.481911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d5ed6-cb0b-4369-a7db-015d87eca940 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:45.596589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d5ed6-cb0b-4369-a7db-015d87eca940 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:45.638130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7063-efae-42ec-b9e6-a07549914eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:45.639061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7063-efae-42ec-b9e6-a07549914eae None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:45.639597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7063-efae-42ec-b9e6-a07549914eae None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:45.640041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7063-efae-42ec-b9e6-a07549914eae None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:45.640853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed7063-efae-42ec-b9e6-a07549914eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:45.641330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed7063-efae-42ec-b9e6-a07549914eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:45.642892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed7063-efae-42ec-b9e6-a07549914eae None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:45.659635 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 341/692] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:45.665104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6574d-6b1c-431b-9d78-2b62a49600b6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:45.797018 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:45.809579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6574d-6b1c-431b-9d78-2b62a49600b6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:45.862156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb5995-7bcb-4961-9a81-5cdc9af8435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:45.862745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb5995-7bcb-4961-9a81-5cdc9af8435f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:45.863022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb5995-7bcb-4961-9a81-5cdc9af8435f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:45.863288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb5995-7bcb-4961-9a81-5cdc9af8435f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:45.875733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb5995-7bcb-4961-9a81-5cdc9af8435f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:45.877196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb5995-7bcb-4961-9a81-5cdc9af8435f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0bfb5995-7bcb-4961-9a81-5cdc9af8435f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:45.889495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:45.890411 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:45.891364 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:45.891364 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:45.891364 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:45.891364 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:45.891364 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:45.891364 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:45.891364 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:45.891364 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:45.895179 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 352/693] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:45.896178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7063-efae-42ec-b9e6-a07549914eae None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:45.936624 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:46.022360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7063-efae-42ec-b9e6-a07549914eae None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:46.069187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01a8e9-da42-4a3e-ab30-265a1b14e3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:46.069785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01a8e9-da42-4a3e-ab30-265a1b14e3bd None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:46.070063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01a8e9-da42-4a3e-ab30-265a1b14e3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:46.070330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01a8e9-da42-4a3e-ab30-265a1b14e3bd None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:46.071040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01a8e9-da42-4a3e-ab30-265a1b14e3bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:46.071340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01a8e9-da42-4a3e-ab30-265a1b14e3bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:46.072746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01a8e9-da42-4a3e-ab30-265a1b14e3bd None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:46.085005 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 342/694] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:46.090913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb5995-7bcb-4961-9a81-5cdc9af8435f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:46.232794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb5995-7bcb-4961-9a81-5cdc9af8435f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:46.277193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd8829-3907-4864-83d9-182da8068841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:46.277894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd8829-3907-4864-83d9-182da8068841 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:46.278173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd8829-3907-4864-83d9-182da8068841 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:46.278439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd8829-3907-4864-83d9-182da8068841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:46.279188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd8829-3907-4864-83d9-182da8068841 None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=a0fa4948f9b546dea031acfc0f3e3d95) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:46.279490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd8829-3907-4864-83d9-182da8068841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:46.280921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd8829-3907-4864-83d9-182da8068841 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:46.291005 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 353/695] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:46 2022] GET /identity/v3/role_assignments?user.id=a0fa4948f9b546dea031acfc0f3e3d95&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:46.493638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08cc0-54d2-4232-9090-f109e1cbab48 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:46.493817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08cc0-54d2-4232-9090-f109e1cbab48 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:46.494085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08cc0-54d2-4232-9090-f109e1cbab48 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:46.496230 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 343/696] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:46.502392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c301-2ebe-46f3-b517-c3cebab0633d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:46.502727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c301-2ebe-46f3-b517-c3cebab0633d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:46.502961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c301-2ebe-46f3-b517-c3cebab0633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:46.532519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8ce0c301-2ebe-46f3-b517-c3cebab0633d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:46.533743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8ce0c301-2ebe-46f3-b517-c3cebab0633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:46.555311 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:46.666625 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 354/697] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:46.883044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e97b0-f0ba-43eb-b2d2-1b5cb2f832f1 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:46.883349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e97b0-f0ba-43eb-b2d2-1b5cb2f832f1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:46.883530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e97b0-f0ba-43eb-b2d2-1b5cb2f832f1 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:46.885090 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 344/698] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:46.891172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c88ae-33c7-40ed-a5ac-91b8634b14bd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:46.891462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c88ae-33c7-40ed-a5ac-91b8634b14bd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:46.891739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c88ae-33c7-40ed-a5ac-91b8634b14bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:46.914034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-715c88ae-33c7-40ed-a5ac-91b8634b14bd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:46.915946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-715c88ae-33c7-40ed-a5ac-91b8634b14bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:47.014848 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 355/699] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:47.050699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e97b0-f0ba-43eb-b2d2-1b5cb2f832f1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:47.174900 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:47.185469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e97b0-f0ba-43eb-b2d2-1b5cb2f832f1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:47.228228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281afc2a-788c-41ed-a8d0-d3defa4fa3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:47.228970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281afc2a-788c-41ed-a8d0-d3defa4fa3cf None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.229249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281afc2a-788c-41ed-a8d0-d3defa4fa3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.229516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281afc2a-788c-41ed-a8d0-d3defa4fa3cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.246092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281afc2a-788c-41ed-a8d0-d3defa4fa3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-281afc2a-788c-41ed-a8d0-d3defa4fa3cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:47.250928 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:47.251845 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:47.252693 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 345/700] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:47.259603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c88ae-33c7-40ed-a5ac-91b8634b14bd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:47.317450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281afc2a-788c-41ed-a8d0-d3defa4fa3cf None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:47.381632 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:47.422574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c88ae-33c7-40ed-a5ac-91b8634b14bd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:47.494146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907abc0f-fa28-410c-9c9a-7de69b4e0e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:47.494702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907abc0f-fa28-410c-9c9a-7de69b4e0e3a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.494979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907abc0f-fa28-410c-9c9a-7de69b4e0e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.495245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907abc0f-fa28-410c-9c9a-7de69b4e0e3a None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.495956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907abc0f-fa28-410c-9c9a-7de69b4e0e3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:47.496307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907abc0f-fa28-410c-9c9a-7de69b4e0e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:47.497627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907abc0f-fa28-410c-9c9a-7de69b4e0e3a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:47.516005 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 356/701] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:47.521777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907abc0f-fa28-410c-9c9a-7de69b4e0e3a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:47.523997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281afc2a-788c-41ed-a8d0-d3defa4fa3cf None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:47.566377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac252add-b2b9-4abd-a1a5-77761d1846df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:47.567055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac252add-b2b9-4abd-a1a5-77761d1846df None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.567373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac252add-b2b9-4abd-a1a5-77761d1846df None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.567647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac252add-b2b9-4abd-a1a5-77761d1846df None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.570638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac252add-b2b9-4abd-a1a5-77761d1846df None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:47.570638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac252add-b2b9-4abd-a1a5-77761d1846df None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-ac252add-b2b9-4abd-a1a5-77761d1846df None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:47.583940 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:47.585135 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:47.586021 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 346/702] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Oct 2 00:45:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:47.592858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac252add-b2b9-4abd-a1a5-77761d1846df None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:47.635665 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:47.686460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907abc0f-fa28-410c-9c9a-7de69b4e0e3a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:47.725716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afa6b9-2f19-4834-827b-2f9a75296221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:47.726762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afa6b9-2f19-4834-827b-2f9a75296221 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.727045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afa6b9-2f19-4834-827b-2f9a75296221 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.727318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afa6b9-2f19-4834-827b-2f9a75296221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.740304 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:47.743425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afa6b9-2f19-4834-827b-2f9a75296221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:47.745008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afa6b9-2f19-4834-827b-2f9a75296221 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:47.745132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac252add-b2b9-4abd-a1a5-77761d1846df None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-97afa6b9-2f19-4834-827b-2f9a75296221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:47.764862 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:47.765868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:47.766879 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:47.766879 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:47.766879 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:47.766879 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 357/703] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:47.771874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bacd2-bb1b-4aa1-9fd8-fba0a39652ee None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.771874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bacd2-bb1b-4aa1-9fd8-fba0a39652ee None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.771874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bacd2-bb1b-4aa1-9fd8-fba0a39652ee None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.774743 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 358/704] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:47.775998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bacd2-bb1b-4aa1-9fd8-fba0a39652ee None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:47.787936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c6d60-c357-4a24-9c57-58886377c31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:47.789390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c6d60-c357-4a24-9c57-58886377c31d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.789669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c6d60-c357-4a24-9c57-58886377c31d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.789947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c6d60-c357-4a24-9c57-58886377c31d None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.790675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c6d60-c357-4a24-9c57-58886377c31d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:47.791603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c6d60-c357-4a24-9c57-58886377c31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:47.794214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c6d60-c357-4a24-9c57-58886377c31d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:47.803301 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 347/705] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 2 00:45:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:47.804717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2683923-4e56-4411-9c10-5d995c0cbbb5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.805070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2683923-4e56-4411-9c10-5d995c0cbbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.805410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2683923-4e56-4411-9c10-5d995c0cbbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.826690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e2683923-4e56-4411-9c10-5d995c0cbbb5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:47.828002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e2683923-4e56-4411-9c10-5d995c0cbbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:47.895684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bacd2-bb1b-4aa1-9fd8-fba0a39652ee None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:47.906696 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 348/706] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:47.907610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2683923-4e56-4411-9c10-5d995c0cbbb5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:47.928251 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:47.936866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bdb6d-5d30-42c6-a330-292ff9fb4035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:47.937617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bdb6d-5d30-42c6-a330-292ff9fb4035 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.937897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bdb6d-5d30-42c6-a330-292ff9fb4035 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.938175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bdb6d-5d30-42c6-a330-292ff9fb4035 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.938952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bdb6d-5d30-42c6-a330-292ff9fb4035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:47.939261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bdb6d-5d30-42c6-a330-292ff9fb4035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:47.940624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bdb6d-5d30-42c6-a330-292ff9fb4035 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:47.956162 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 359/707] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:47.957881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb59ef2-05cd-4810-bcea-504a3b140dd7 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:47.958165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb59ef2-05cd-4810-bcea-504a3b140dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:47.958437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb59ef2-05cd-4810-bcea-504a3b140dd7 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:47.960470 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 360/708] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:47.961528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb59ef2-05cd-4810-bcea-504a3b140dd7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:48.036131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2683923-4e56-4411-9c10-5d995c0cbbb5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:48.037658 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:48.077176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eccf6f-d908-449f-a7ce-091d7f64fc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:48.078507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eccf6f-d908-449f-a7ce-091d7f64fc19 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:48.079079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eccf6f-d908-449f-a7ce-091d7f64fc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:48.079655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eccf6f-d908-449f-a7ce-091d7f64fc19 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:48.080626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eccf6f-d908-449f-a7ce-091d7f64fc19 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:48.081121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eccf6f-d908-449f-a7ce-091d7f64fc19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:48.082713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eccf6f-d908-449f-a7ce-091d7f64fc19 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:48.095197 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 349/709] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 2 00:45:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:48.097012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df0dfb-cf5e-4e3b-945b-c2edd7f72126 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:48.097526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df0dfb-cf5e-4e3b-945b-c2edd7f72126 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:48.098041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df0dfb-cf5e-4e3b-945b-c2edd7f72126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:48.101513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb59ef2-05cd-4810-bcea-504a3b140dd7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:48.131935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b0df0dfb-cf5e-4e3b-945b-c2edd7f72126 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:48.133124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b0df0dfb-cf5e-4e3b-945b-c2edd7f72126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:48.155954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b54cd2-5096-4481-9335-cf2c4c46ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:48.156672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b54cd2-5096-4481-9335-cf2c4c46ab02 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:48.156956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b54cd2-5096-4481-9335-cf2c4c46ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:48.157225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b54cd2-5096-4481-9335-cf2c4c46ab02 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:48.174565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b54cd2-5096-4481-9335-cf2c4c46ab02 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:48.176070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b54cd2-5096-4481-9335-cf2c4c46ab02 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-48b54cd2-5096-4481-9335-cf2c4c46ab02 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:48.197507 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:48.199232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:48.201068 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:48.201068 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:48.201068 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:48.201068 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:48.201068 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:48.201068 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:48.201068 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:48.201068 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:48.201068 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:45:48.201068 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:48.201068 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 361/710] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 2 00:45:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:48.203798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b54cd2-5096-4481-9335-cf2c4c46ab02 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:48.255470 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 350/711] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:48.256358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df0dfb-cf5e-4e3b-945b-c2edd7f72126 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:48.268025 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:48.333573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b54cd2-5096-4481-9335-cf2c4c46ab02 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:48.350442 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:48.374267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df0dfb-cf5e-4e3b-945b-c2edd7f72126 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:48.375941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a860a58-24a4-46f7-9c6f-38f9cb16a748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:48.376860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a860a58-24a4-46f7-9c6f-38f9cb16a748 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:48.377142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a860a58-24a4-46f7-9c6f-38f9cb16a748 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:48.377416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a860a58-24a4-46f7-9c6f-38f9cb16a748 None admin] PATH_INFO: `/v3/services/network` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:48.378057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a860a58-24a4-46f7-9c6f-38f9cb16a748 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:48.379983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a860a58-24a4-46f7-9c6f-38f9cb16a748 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0a860a58-24a4-46f7-9c6f-38f9cb16a748 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:48.392675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:48.393741 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:48.394580 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 362/712] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:48 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:48.399428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a860a58-24a4-46f7-9c6f-38f9cb16a748 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:48.416196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdd262-4c23-4327-8b71-bc13f097b8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:48.416808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdd262-4c23-4327-8b71-bc13f097b8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:48.417840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdd262-4c23-4327-8b71-bc13f097b8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:48.418116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdd262-4c23-4327-8b71-bc13f097b8b0 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:48.418938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdd262-4c23-4327-8b71-bc13f097b8b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:48.419526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdd262-4c23-4327-8b71-bc13f097b8b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:48.421270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdd262-4c23-4327-8b71-bc13f097b8b0 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:48.441772 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 351/713] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 2 00:45:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:48.450639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdd262-4c23-4327-8b71-bc13f097b8b0 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:48.551021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a860a58-24a4-46f7-9c6f-38f9cb16a748 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:48.570970 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:48.605279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5141b38-12af-47db-b819-e3bb56301023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:48.606309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5141b38-12af-47db-b819-e3bb56301023 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:48.606931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5141b38-12af-47db-b819-e3bb56301023 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:48.607403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5141b38-12af-47db-b819-e3bb56301023 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:48.608203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5141b38-12af-47db-b819-e3bb56301023 None admin] RBAC: Adding query filter params (name=network) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:48.608669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5141b38-12af-47db-b819-e3bb56301023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:48.610319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5141b38-12af-47db-b819-e3bb56301023 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:48.615762 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 363/714] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:45:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:48.626418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5141b38-12af-47db-b819-e3bb56301023 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:48.640023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdd262-4c23-4327-8b71-bc13f097b8b0 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:48.672051 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:48.678467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44d974-a1a0-410a-8cf9-8a15bc05ebc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:48.679101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44d974-a1a0-410a-8cf9-8a15bc05ebc9 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:48.679382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44d974-a1a0-410a-8cf9-8a15bc05ebc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:48.679653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44d974-a1a0-410a-8cf9-8a15bc05ebc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:48.735299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5141b38-12af-47db-b819-e3bb56301023 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:48.758171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44d974-a1a0-410a-8cf9-8a15bc05ebc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:48.759829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44d974-a1a0-410a-8cf9-8a15bc05ebc9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:48.773832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46883864-3ae6-46ef-befe-ca4fad2adc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:48.774442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46883864-3ae6-46ef-befe-ca4fad2adc11 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:48.774770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46883864-3ae6-46ef-befe-ca4fad2adc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:48.775042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46883864-3ae6-46ef-befe-ca4fad2adc11 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:48.775669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46883864-3ae6-46ef-befe-ca4fad2adc11 None admin] RBAC: Adding query filter params (type=network) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:48.775965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46883864-3ae6-46ef-befe-ca4fad2adc11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:48.777362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46883864-3ae6-46ef-befe-ca4fad2adc11 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:48.783421 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 364/715] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:45:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:48.784236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46883864-3ae6-46ef-befe-ca4fad2adc11 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:48.861710 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:48.936319 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 352/716] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:48.942069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44d974-a1a0-410a-8cf9-8a15bc05ebc9 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:49.000119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46883864-3ae6-46ef-befe-ca4fad2adc11 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.005736 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:49.076127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cbb6b-f3ba-4291-92ab-104fc4c990f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.076765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbb6b-f3ba-4291-92ab-104fc4c990f9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.077040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbb6b-f3ba-4291-92ab-104fc4c990f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.077308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbb6b-f3ba-4291-92ab-104fc4c990f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.102244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cbb6b-f3ba-4291-92ab-104fc4c990f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-910cbb6b-f3ba-4291-92ab-104fc4c990f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:49.113070 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:49.114237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:49.115303 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:49.117854 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 365/717] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:49.123679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cbb6b-f3ba-4291-92ab-104fc4c990f9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:49.137608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44d974-a1a0-410a-8cf9-8a15bc05ebc9 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.202196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb3465-ef4c-4f0b-ac99-8c9367286897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.203313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb3465-ef4c-4f0b-ac99-8c9367286897 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.203795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb3465-ef4c-4f0b-ac99-8c9367286897 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.204261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb3465-ef4c-4f0b-ac99-8c9367286897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.226255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb3465-ef4c-4f0b-ac99-8c9367286897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:49.228130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb3465-ef4c-4f0b-ac99-8c9367286897 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-23cb3465-ef4c-4f0b-ac99-8c9367286897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:49.260847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:49.262351 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:49.263297 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:49.263297 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:49.263297 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:49.265420 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 353/718] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:49.272858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb3465-ef4c-4f0b-ac99-8c9367286897 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:49.301953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cbb6b-f3ba-4291-92ab-104fc4c990f9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.309451 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:49.349291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba729d-d9f7-4bb2-8f4d-f5dffca66d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.350031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba729d-d9f7-4bb2-8f4d-f5dffca66d63 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.350315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba729d-d9f7-4bb2-8f4d-f5dffca66d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.350586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba729d-d9f7-4bb2-8f4d-f5dffca66d63 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.351318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba729d-d9f7-4bb2-8f4d-f5dffca66d63 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:49.351622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba729d-d9f7-4bb2-8f4d-f5dffca66d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:49.353050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba729d-d9f7-4bb2-8f4d-f5dffca66d63 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:49.369853 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 366/719] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:49.375711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba729d-d9f7-4bb2-8f4d-f5dffca66d63 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:49.406977 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:49.483938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba729d-d9f7-4bb2-8f4d-f5dffca66d63 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.492098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb3465-ef4c-4f0b-ac99-8c9367286897 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.520959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0c5c1-0fef-4dc8-ba74-814e7cc94b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.521669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0c5c1-0fef-4dc8-ba74-814e7cc94b0f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.522020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0c5c1-0fef-4dc8-ba74-814e7cc94b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.522459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0c5c1-0fef-4dc8-ba74-814e7cc94b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.530986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558b0a1-17cd-4c47-b4d6-d08a6df95e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.531899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558b0a1-17cd-4c47-b4d6-d08a6df95e83 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.532381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558b0a1-17cd-4c47-b4d6-d08a6df95e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.532891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558b0a1-17cd-4c47-b4d6-d08a6df95e83 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.533716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558b0a1-17cd-4c47-b4d6-d08a6df95e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:49.534209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558b0a1-17cd-4c47-b4d6-d08a6df95e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:49.534661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0c5c1-0fef-4dc8-ba74-814e7cc94b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:49.536022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558b0a1-17cd-4c47-b4d6-d08a6df95e83 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:49.536132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0c5c1-0fef-4dc8-ba74-814e7cc94b0f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:49.550383 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 354/720] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:49.551984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0380bb3-4e96-4965-a2ec-b9754ba2890f None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.552467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0380bb3-4e96-4965-a2ec-b9754ba2890f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.552962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0380bb3-4e96-4965-a2ec-b9754ba2890f None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7ec0c5c1-0fef-4dc8-ba74-814e7cc94b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:49.558645 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:49.559615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:49.560493 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:49.560493 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:49.560493 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:49.560493 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 367/722] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:49.560493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0c5c1-0fef-4dc8-ba74-814e7cc94b0f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:49.560784 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 355/722] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:49.561204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb06ff-7e51-49ed-9309-76cfa1bc51aa None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.561728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb06ff-7e51-49ed-9309-76cfa1bc51aa None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.562097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb06ff-7e51-49ed-9309-76cfa1bc51aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.582321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-41fb06ff-7e51-49ed-9309-76cfa1bc51aa None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:49.583804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-41fb06ff-7e51-49ed-9309-76cfa1bc51aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:49.649593 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:49.662863 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 356/723] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:49.663793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb06ff-7e51-49ed-9309-76cfa1bc51aa None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:49.674502 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:49.694473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0c5c1-0fef-4dc8-ba74-814e7cc94b0f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.761655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956f323-c068-4932-85c1-6428bdc0a492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.762308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f323-c068-4932-85c1-6428bdc0a492 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.762586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f323-c068-4932-85c1-6428bdc0a492 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.762884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f323-c068-4932-85c1-6428bdc0a492 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.778205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956f323-c068-4932-85c1-6428bdc0a492 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:49.779705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956f323-c068-4932-85c1-6428bdc0a492 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-3956f323-c068-4932-85c1-6428bdc0a492 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:49.802495 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:49.803437 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:49.804331 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:49.804331 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:49.804331 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:49.804331 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:49.804331 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:49.804331 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:49.804331 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:49.804331 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:49.804331 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 368/724] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:49.809744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956f323-c068-4932-85c1-6428bdc0a492 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:49.833438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb06ff-7e51-49ed-9309-76cfa1bc51aa None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.920472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0e525-e8bf-4d16-b714-97e5166bb728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.921082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e525-e8bf-4d16-b714-97e5166bb728 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.921361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e525-e8bf-4d16-b714-97e5166bb728 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.921630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e525-e8bf-4d16-b714-97e5166bb728 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.922269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0e525-e8bf-4d16-b714-97e5166bb728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:49.922567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0e525-e8bf-4d16-b714-97e5166bb728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:49.923939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0e525-e8bf-4d16-b714-97e5166bb728 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:49.927190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956f323-c068-4932-85c1-6428bdc0a492 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:49.949884 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 357/725] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:49.955489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0e525-e8bf-4d16-b714-97e5166bb728 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:49.980166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283ce7-cf12-46a3-ae15-3ad4732d3d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:49.980724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283ce7-cf12-46a3-ae15-3ad4732d3d50 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:49.981095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283ce7-cf12-46a3-ae15-3ad4732d3d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:49.981372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283ce7-cf12-46a3-ae15-3ad4732d3d50 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:49.982067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283ce7-cf12-46a3-ae15-3ad4732d3d50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:49.982563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283ce7-cf12-46a3-ae15-3ad4732d3d50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:49.984932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283ce7-cf12-46a3-ae15-3ad4732d3d50 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:50.000709 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:50.011573 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 369/726] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:50.012775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283ce7-cf12-46a3-ae15-3ad4732d3d50 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:50.059803 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:50.103373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0e525-e8bf-4d16-b714-97e5166bb728 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:50.141754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283ce7-cf12-46a3-ae15-3ad4732d3d50 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:50.148075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd66d-f04f-4f10-aebf-ad041f9137e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:50.149815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd66d-f04f-4f10-aebf-ad041f9137e2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:50.150380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd66d-f04f-4f10-aebf-ad041f9137e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:50.150886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd66d-f04f-4f10-aebf-ad041f9137e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:50.160824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fd66d-f04f-4f10-aebf-ad041f9137e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:50.162542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fd66d-f04f-4f10-aebf-ad041f9137e2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-939fd66d-f04f-4f10-aebf-ad041f9137e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:50.177220 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:50.178211 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:50.179221 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:50.179221 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:50.179221 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:50.179221 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:50.179221 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:50.179221 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:50.179221 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:50.179221 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:50.179221 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:45:50.179221 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:50.181655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ac346-c030-49a1-b699-6ce1969cd6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:50.182152 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 358/727] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 2 00:45:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:50.182320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ac346-c030-49a1-b699-6ce1969cd6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:50.182609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ac346-c030-49a1-b699-6ce1969cd6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:50.183482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ac346-c030-49a1-b699-6ce1969cd6a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:50.184407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd66d-f04f-4f10-aebf-ad041f9137e2 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:50.200180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ac346-c030-49a1-b699-6ce1969cd6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4d9ac346-c030-49a1-b699-6ce1969cd6a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:50.206657 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:50.207615 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:50.208485 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 370/728] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:50.209226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ac346-c030-49a1-b699-6ce1969cd6a1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:50.281707 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:50.306052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd66d-f04f-4f10-aebf-ad041f9137e2 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:50.333587 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:50.342505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63357-6e9e-4d3e-b585-a1dda1df7a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:50.343295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63357-6e9e-4d3e-b585-a1dda1df7a24 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:50.343475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63357-6e9e-4d3e-b585-a1dda1df7a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:50.343693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63357-6e9e-4d3e-b585-a1dda1df7a24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:50.344436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a63357-6e9e-4d3e-b585-a1dda1df7a24 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=b85fc7e555f348c3ab6c63ee15f6ceb0) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:50.344718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a63357-6e9e-4d3e-b585-a1dda1df7a24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:50.346135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a63357-6e9e-4d3e-b585-a1dda1df7a24 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:50.347100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ac346-c030-49a1-b699-6ce1969cd6a1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:50.352058 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 359/729] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:50 2022] GET /identity/v3/role_assignments?user.id=b85fc7e555f348c3ab6c63ee15f6ceb0&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:50.352907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63357-6e9e-4d3e-b585-a1dda1df7a24 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:50.438123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74607dba-a33a-47d3-ac58-e88114e84b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:50.438807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607dba-a33a-47d3-ac58-e88114e84b7c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:50.439069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607dba-a33a-47d3-ac58-e88114e84b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:50.439339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607dba-a33a-47d3-ac58-e88114e84b7c None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:50.440087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74607dba-a33a-47d3-ac58-e88114e84b7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:50.440392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74607dba-a33a-47d3-ac58-e88114e84b7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:50.441859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74607dba-a33a-47d3-ac58-e88114e84b7c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:50.481747 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 371/730] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 2 00:45:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:50.488175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74607dba-a33a-47d3-ac58-e88114e84b7c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:50.500266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63357-6e9e-4d3e-b585-a1dda1df7a24 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:50.543622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8841e5-6ea6-43fa-b40a-cb0d75e39e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:50.544674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8841e5-6ea6-43fa-b40a-cb0d75e39e9a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:50.545410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8841e5-6ea6-43fa-b40a-cb0d75e39e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:50.545875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8841e5-6ea6-43fa-b40a-cb0d75e39e9a None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:50.546831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8841e5-6ea6-43fa-b40a-cb0d75e39e9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:50.547467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8841e5-6ea6-43fa-b40a-cb0d75e39e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:50.549091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8841e5-6ea6-43fa-b40a-cb0d75e39e9a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:50.559440 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 360/731] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:50.567774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8841e5-6ea6-43fa-b40a-cb0d75e39e9a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:50.641370 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:50.656051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74607dba-a33a-47d3-ac58-e88114e84b7c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:50.674722 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:50.694164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46b4ea-68fb-40f4-aef7-5470619e729e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:50.694762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46b4ea-68fb-40f4-aef7-5470619e729e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:50.695041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46b4ea-68fb-40f4-aef7-5470619e729e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:50.695307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46b4ea-68fb-40f4-aef7-5470619e729e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:50.707354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8841e5-6ea6-43fa-b40a-cb0d75e39e9a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:50.750433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd8b86-b894-4a17-8146-0345ac910de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:50.751103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd8b86-b894-4a17-8146-0345ac910de1 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:50.751383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd8b86-b894-4a17-8146-0345ac910de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:50.751653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd8b86-b894-4a17-8146-0345ac910de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:50.763600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd8b86-b894-4a17-8146-0345ac910de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:50.765136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd8b86-b894-4a17-8146-0345ac910de1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:50.780739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46b4ea-68fb-40f4-aef7-5470619e729e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-e8bd8b86-b894-4a17-8146-0345ac910de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:50.781240 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:50.782197 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:50.783128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:50.783128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:50.783128 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:50.785036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46b4ea-68fb-40f4-aef7-5470619e729e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:50.787176 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 361/732] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:50.788917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a8f23-71df-485a-8ff5-05247e2678cc None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:50.788917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a8f23-71df-485a-8ff5-05247e2678cc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:50.789117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a8f23-71df-485a-8ff5-05247e2678cc None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:50.794646 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 362/733] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:50.794646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a8f23-71df-485a-8ff5-05247e2678cc None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:50.901952 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 372/734] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 02 00:45:50.903823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c00d-3b74-4729-ac9f-0873e5e2bc64 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:50.904377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c00d-3b74-4729-ac9f-0873e5e2bc64 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:50.904857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c00d-3b74-4729-ac9f-0873e5e2bc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:50.909580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a8f23-71df-485a-8ff5-05247e2678cc None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:50.918663 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:50.925203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9316c00d-3b74-4729-ac9f-0873e5e2bc64 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:50.926701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9316c00d-3b74-4729-ac9f-0873e5e2bc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:50.941578 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:50.957951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef9956-2d3b-4069-beaa-35dacbdf51b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:50.958501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef9956-2d3b-4069-beaa-35dacbdf51b6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:50.958803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef9956-2d3b-4069-beaa-35dacbdf51b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:50.959077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef9956-2d3b-4069-beaa-35dacbdf51b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:50.962356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef9956-2d3b-4069-beaa-35dacbdf51b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:50.962356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef9956-2d3b-4069-beaa-35dacbdf51b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:50.962356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef9956-2d3b-4069-beaa-35dacbdf51b6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:50.978756 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 363/735] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:50.981203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef9956-2d3b-4069-beaa-35dacbdf51b6 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:51.034685 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 373/736] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:51.035640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316c00d-3b74-4729-ac9f-0873e5e2bc64 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:51.105304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef9956-2d3b-4069-beaa-35dacbdf51b6 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:51.145316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29c01c-c801-4dda-a3f7-53100f5acd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:51.146619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29c01c-c801-4dda-a3f7-53100f5acd0c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:51.147106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29c01c-c801-4dda-a3f7-53100f5acd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:51.147578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29c01c-c801-4dda-a3f7-53100f5acd0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:51.161909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29c01c-c801-4dda-a3f7-53100f5acd0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:51.164940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29c01c-c801-4dda-a3f7-53100f5acd0c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-6f29c01c-c801-4dda-a3f7-53100f5acd0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:51.183239 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:51.184256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:51.185145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:51.185145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:51.185145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:51.187792 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 364/737] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:51.195863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29c01c-c801-4dda-a3f7-53100f5acd0c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:51.231051 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:51.276093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316c00d-3b74-4729-ac9f-0873e5e2bc64 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:51.313005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b8cfa-02e9-4892-8687-be68e45d3d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:51.313632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b8cfa-02e9-4892-8687-be68e45d3d0e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:51.313909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b8cfa-02e9-4892-8687-be68e45d3d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:51.314181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b8cfa-02e9-4892-8687-be68e45d3d0e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:51.321427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b8cfa-02e9-4892-8687-be68e45d3d0e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:51.322900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b8cfa-02e9-4892-8687-be68e45d3d0e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-966b8cfa-02e9-4892-8687-be68e45d3d0e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:51.334323 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:51.335343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:51.336309 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:51.336309 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:51.336309 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:51.336309 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:51.336309 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:51.336309 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:51.336309 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:51.336309 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:51.336309 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:45:51.336309 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:51.336309 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 374/738] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:51.336960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3bc8d-2cea-4ad5-a7e8-1c56476d391a None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:51.336960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3bc8d-2cea-4ad5-a7e8-1c56476d391a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:51.337093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3bc8d-2cea-4ad5-a7e8-1c56476d391a None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:51.338398 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 375/739] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:51.339448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3bc8d-2cea-4ad5-a7e8-1c56476d391a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:51.344592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29c01c-c801-4dda-a3f7-53100f5acd0c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:51.348883 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:51.381557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648626f-6bab-4c2b-b448-ace02aaeea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:51.382162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648626f-6bab-4c2b-b448-ace02aaeea84 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:51.382448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648626f-6bab-4c2b-b448-ace02aaeea84 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:51.382752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648626f-6bab-4c2b-b448-ace02aaeea84 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:51.383395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648626f-6bab-4c2b-b448-ace02aaeea84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:51.383697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648626f-6bab-4c2b-b448-ace02aaeea84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:51.385048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648626f-6bab-4c2b-b448-ace02aaeea84 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:51.402414 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 365/740] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:51.402414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648626f-6bab-4c2b-b448-ace02aaeea84 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:51.457604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3bc8d-2cea-4ad5-a7e8-1c56476d391a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:51.487501 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:51.493552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1ebbf-8ca4-4791-b205-c96fd7abd7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:51.494151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1ebbf-8ca4-4791-b205-c96fd7abd7c9 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:51.494429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1ebbf-8ca4-4791-b205-c96fd7abd7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:51.494729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1ebbf-8ca4-4791-b205-c96fd7abd7c9 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:51.496288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1ebbf-8ca4-4791-b205-c96fd7abd7c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:51.497711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1ebbf-8ca4-4791-b205-c96fd7abd7c9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:51.512658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648626f-6bab-4c2b-b448-ace02aaeea84 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:51.522669 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 376/741] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:45:51 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:45:51.522669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b42ea-7fed-4251-8b07-c6ee8cbee4b0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:51.522669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b42ea-7fed-4251-8b07-c6ee8cbee4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:51.522669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b42ea-7fed-4251-8b07-c6ee8cbee4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:51.539344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-eb1b42ea-7fed-4251-8b07-c6ee8cbee4b0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:51.540614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb1b42ea-7fed-4251-8b07-c6ee8cbee4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:51.592080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42171e0-3151-4b87-a567-b9ad695520ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:51.593101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42171e0-3151-4b87-a567-b9ad695520ec None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:51.593637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42171e0-3151-4b87-a567-b9ad695520ec None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:51.594185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42171e0-3151-4b87-a567-b9ad695520ec None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:51.595192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42171e0-3151-4b87-a567-b9ad695520ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:51.595854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42171e0-3151-4b87-a567-b9ad695520ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:51.597763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42171e0-3151-4b87-a567-b9ad695520ec None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:51.622003 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:51.627361 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 366/742] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 2 00:45:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:51.628171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42171e0-3151-4b87-a567-b9ad695520ec None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:51.642790 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 377/743] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 00:45:51.644107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b42ea-7fed-4251-8b07-c6ee8cbee4b0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:51.776577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42171e0-3151-4b87-a567-b9ad695520ec None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:51.798518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b42ea-7fed-4251-8b07-c6ee8cbee4b0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:51.817114 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:51.826274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd848a9-a1da-4aca-bfda-6ac51aff2e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:51.826948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd848a9-a1da-4aca-bfda-6ac51aff2e5b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:51.827224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd848a9-a1da-4aca-bfda-6ac51aff2e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:51.827490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd848a9-a1da-4aca-bfda-6ac51aff2e5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:51.835661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd848a9-a1da-4aca-bfda-6ac51aff2e5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:51.837108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd848a9-a1da-4aca-bfda-6ac51aff2e5b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:51.839618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb353d78-7e61-4b88-88f9-fa31d5417262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:51.840543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb353d78-7e61-4b88-88f9-fa31d5417262 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:51.841650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb353d78-7e61-4b88-88f9-fa31d5417262 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:51.841650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb353d78-7e61-4b88-88f9-fa31d5417262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-bfd848a9-a1da-4aca-bfda-6ac51aff2e5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:51.851746 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:51.852847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:51.853935 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:51.853935 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:51.853935 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:51.853935 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:51.853935 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:51.853935 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:51.853935 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:51.853935 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:51.856653 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 367/744] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:51.863479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd848a9-a1da-4aca-bfda-6ac51aff2e5b None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:51.916057 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:51.933175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb353d78-7e61-4b88-88f9-fa31d5417262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:51.935160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb353d78-7e61-4b88-88f9-fa31d5417262 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:52.016678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd848a9-a1da-4aca-bfda-6ac51aff2e5b None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:52.061315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b99722-578b-4e50-9b60-934a2ecea947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:52.062258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b99722-578b-4e50-9b60-934a2ecea947 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:52.063146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b99722-578b-4e50-9b60-934a2ecea947 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:52.063598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b99722-578b-4e50-9b60-934a2ecea947 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:52.064478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b99722-578b-4e50-9b60-934a2ecea947 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:52.065279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b99722-578b-4e50-9b60-934a2ecea947 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:52.067565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b99722-578b-4e50-9b60-934a2ecea947 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:52.083605 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 368/745] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:52.084996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b99722-578b-4e50-9b60-934a2ecea947 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:52.097347 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 378/746] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:45:51 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 00:45:52.098689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb353d78-7e61-4b88-88f9-fa31d5417262 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:52.155251 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:52.215875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b99722-578b-4e50-9b60-934a2ecea947 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:52.234278 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:52.241918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb353d78-7e61-4b88-88f9-fa31d5417262 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:52.259453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b06c-ce2e-4c61-816a-e86afc4dbdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:52.260295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b06c-ce2e-4c61-816a-e86afc4dbdde None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:52.260639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b06c-ce2e-4c61-816a-e86afc4dbdde None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:52.261502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b06c-ce2e-4c61-816a-e86afc4dbdde None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:52.262243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b06c-ce2e-4c61-816a-e86afc4dbdde None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:52.263994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b06c-ce2e-4c61-816a-e86afc4dbdde None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:52.282891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d749a-0378-4a92-92ed-a9d6522b7efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:52.283737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d749a-0378-4a92-92ed-a9d6522b7efa None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:52.284166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d749a-0378-4a92-92ed-a9d6522b7efa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:52.284606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d749a-0378-4a92-92ed-a9d6522b7efa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:52.285497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d749a-0378-4a92-92ed-a9d6522b7efa None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=80a8390c507240e893e1fd82b2490df3) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:52.294630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d749a-0378-4a92-92ed-a9d6522b7efa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:52.295117 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 369/747] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:45:52 2022] POST /identity/v3/services => generated 240 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:45:52.295117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b06c-ce2e-4c61-816a-e86afc4dbdde None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:52.297179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d749a-0378-4a92-92ed-a9d6522b7efa None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:52.304068 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 379/748] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:52 2022] GET /identity/v3/role_assignments?user.id=80a8390c507240e893e1fd82b2490df3&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:52.552585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b06c-ce2e-4c61-816a-e86afc4dbdde None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:52.566224 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:52.596540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd726eae-e154-4739-9dfa-f708ca064267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:52.597185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd726eae-e154-4739-9dfa-f708ca064267 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:52.597465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd726eae-e154-4739-9dfa-f708ca064267 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:52.597738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd726eae-e154-4739-9dfa-f708ca064267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:52.609829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd726eae-e154-4739-9dfa-f708ca064267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:52.611328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd726eae-e154-4739-9dfa-f708ca064267 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-dd726eae-e154-4739-9dfa-f708ca064267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:52.627921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:52.628920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:52.630418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:52.630418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:52.630418 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:52.630418 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 370/749] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:52.635039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d749a-0378-4a92-92ed-a9d6522b7efa None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:52.772643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d749a-0378-4a92-92ed-a9d6522b7efa None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:52.821130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329ab8b-2c9d-4e57-887e-dd74d47ceabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:52.822078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329ab8b-2c9d-4e57-887e-dd74d47ceabd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:52.822554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329ab8b-2c9d-4e57-887e-dd74d47ceabd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:52.823043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329ab8b-2c9d-4e57-887e-dd74d47ceabd None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:52.824168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329ab8b-2c9d-4e57-887e-dd74d47ceabd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:52.824719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329ab8b-2c9d-4e57-887e-dd74d47ceabd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:52.826293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329ab8b-2c9d-4e57-887e-dd74d47ceabd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:52.844828 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 380/750] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:52.845160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48dd6-dfea-4d2f-b65f-43244f3871e6 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:52.847165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48dd6-dfea-4d2f-b65f-43244f3871e6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:52.847165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48dd6-dfea-4d2f-b65f-43244f3871e6 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:52.847165 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 371/751] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:45:52.852463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329ab8b-2c9d-4e57-887e-dd74d47ceabd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:52.856986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3770b5-dffe-4777-a0b2-6755e6c30d38 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:52.857265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3770b5-dffe-4777-a0b2-6755e6c30d38 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:52.858319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3770b5-dffe-4777-a0b2-6755e6c30d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:52.876933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dc3770b5-dffe-4777-a0b2-6755e6c30d38 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:52.881688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dc3770b5-dffe-4777-a0b2-6755e6c30d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:52.886982 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:52.988858 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 372/752] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:45:53.003835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329ab8b-2c9d-4e57-887e-dd74d47ceabd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:53.062150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8047206-d423-4468-8227-8151330db24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:53.062812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8047206-d423-4468-8227-8151330db24a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:53.063093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8047206-d423-4468-8227-8151330db24a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:53.063366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8047206-d423-4468-8227-8151330db24a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:53.070377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8047206-d423-4468-8227-8151330db24a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:53.071997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8047206-d423-4468-8227-8151330db24a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f8047206-d423-4468-8227-8151330db24a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:53.084001 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:53.084949 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:53.086225 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:53.086225 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:53.086225 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:53.086225 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:53.086225 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:53.086225 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:53.086225 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:53.086225 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:53.086225 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 381/753] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:53.091601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3770b5-dffe-4777-a0b2-6755e6c30d38 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:53.204985 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:53.216585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3770b5-dffe-4777-a0b2-6755e6c30d38 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:53.258297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ed6e-ef3a-43bc-8637-fa5135e809b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:53.258997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ed6e-ef3a-43bc-8637-fa5135e809b3 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:53.259280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ed6e-ef3a-43bc-8637-fa5135e809b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:53.259550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ed6e-ef3a-43bc-8637-fa5135e809b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:53.260240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ed6e-ef3a-43bc-8637-fa5135e809b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:53.260546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ed6e-ef3a-43bc-8637-fa5135e809b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:53.262590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ed6e-ef3a-43bc-8637-fa5135e809b3 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:53.274707 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 373/754] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:53.281352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8047206-d423-4468-8227-8151330db24a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:53.367067 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:53.386502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8047206-d423-4468-8227-8151330db24a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:53.428271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb6eff-3de5-4fc8-af36-4d6d93d54389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:53.428894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb6eff-3de5-4fc8-af36-4d6d93d54389 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:53.429171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb6eff-3de5-4fc8-af36-4d6d93d54389 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:53.429442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb6eff-3de5-4fc8-af36-4d6d93d54389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:53.430244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb6eff-3de5-4fc8-af36-4d6d93d54389 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=a0fa4948f9b546dea031acfc0f3e3d95) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:53.430632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb6eff-3de5-4fc8-af36-4d6d93d54389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:53.432129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb6eff-3de5-4fc8-af36-4d6d93d54389 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:53.438841 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 382/755] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:45:53 2022] GET /identity/v3/role_assignments?user.id=a0fa4948f9b546dea031acfc0f3e3d95&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:53.452171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ed6e-ef3a-43bc-8637-fa5135e809b3 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:53.572255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ed6e-ef3a-43bc-8637-fa5135e809b3 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:53.619017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89481cc-ae4b-4d2d-81c3-72524d346544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:53.619637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89481cc-ae4b-4d2d-81c3-72524d346544 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:53.619914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89481cc-ae4b-4d2d-81c3-72524d346544 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:53.620303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89481cc-ae4b-4d2d-81c3-72524d346544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:53.639351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89481cc-ae4b-4d2d-81c3-72524d346544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-d89481cc-ae4b-4d2d-81c3-72524d346544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:53.644228 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:53.645174 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:53.646033 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 374/756] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:53.652981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb6eff-3de5-4fc8-af36-4d6d93d54389 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:53.769663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb6eff-3de5-4fc8-af36-4d6d93d54389 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:53.818882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2137cd2-c74c-4cd8-8a9c-255feb45c608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:53.819845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2137cd2-c74c-4cd8-8a9c-255feb45c608 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:53.820341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2137cd2-c74c-4cd8-8a9c-255feb45c608 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:53.820845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2137cd2-c74c-4cd8-8a9c-255feb45c608 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:53.821720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2137cd2-c74c-4cd8-8a9c-255feb45c608 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:53.822222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2137cd2-c74c-4cd8-8a9c-255feb45c608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:53.823857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2137cd2-c74c-4cd8-8a9c-255feb45c608 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:53.837579 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 383/757] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:53.843185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89481cc-ae4b-4d2d-81c3-72524d346544 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:53.864592 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:53.992211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89481cc-ae4b-4d2d-81c3-72524d346544 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:54.043924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09237761-fcdb-47f2-ba43-1f2ffa1870f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:54.044567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237761-fcdb-47f2-ba43-1f2ffa1870f7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:54.045105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237761-fcdb-47f2-ba43-1f2ffa1870f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:54.045384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237761-fcdb-47f2-ba43-1f2ffa1870f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:54.058454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09237761-fcdb-47f2-ba43-1f2ffa1870f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:54.059882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09237761-fcdb-47f2-ba43-1f2ffa1870f7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-09237761-fcdb-47f2-ba43-1f2ffa1870f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:54.078783 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:54.079773 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:54.080682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:54.080682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:54.080682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:54.080682 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 375/758] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:54.085524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2137cd2-c74c-4cd8-8a9c-255feb45c608 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:54.095516 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:54.241027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2137cd2-c74c-4cd8-8a9c-255feb45c608 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:54.288762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ea45d-bfdc-4cfe-b709-32dc477f3c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:54.289733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ea45d-bfdc-4cfe-b709-32dc477f3c12 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:54.290214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ea45d-bfdc-4cfe-b709-32dc477f3c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:54.290741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ea45d-bfdc-4cfe-b709-32dc477f3c12 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:54.291610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ea45d-bfdc-4cfe-b709-32dc477f3c12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:54.292188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ea45d-bfdc-4cfe-b709-32dc477f3c12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:54.293881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ea45d-bfdc-4cfe-b709-32dc477f3c12 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:54.311554 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 384/759] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:54.319685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09237761-fcdb-47f2-ba43-1f2ffa1870f7 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:54.332756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a021f-ac53-4e92-b2c9-e1a1697b9744 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:54.333591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a021f-ac53-4e92-b2c9-e1a1697b9744 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:54.333883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a021f-ac53-4e92-b2c9-e1a1697b9744 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:54.335529 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 385/760] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:45:54.341740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3f96-9d04-4aaa-ba26-d01aa3d0ad11 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:54.342032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3f96-9d04-4aaa-ba26-d01aa3d0ad11 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:54.342311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3f96-9d04-4aaa-ba26-d01aa3d0ad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:54.362868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d8cd3f96-9d04-4aaa-ba26-d01aa3d0ad11 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:54.365359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d8cd3f96-9d04-4aaa-ba26-d01aa3d0ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:54.441070 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:54.486691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09237761-fcdb-47f2-ba43-1f2ffa1870f7 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:54.500275 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:54.526974 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 386/761] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:45:54.539287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e48d6-c9fa-4553-8afb-4283c3e85934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:54.540206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e48d6-c9fa-4553-8afb-4283c3e85934 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:54.540706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e48d6-c9fa-4553-8afb-4283c3e85934 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:54.541174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e48d6-c9fa-4553-8afb-4283c3e85934 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:54.553913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e48d6-c9fa-4553-8afb-4283c3e85934 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:54.555668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e48d6-c9fa-4553-8afb-4283c3e85934 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-d47e48d6-c9fa-4553-8afb-4283c3e85934 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:54.572045 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:54.573060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:54.574882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:54.574882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:54.574882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:54.574882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:54.574882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:54.574882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:54.574882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:54.574882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:54.574882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:45:54.574882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:54.577551 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 376/762] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 2 00:45:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:54.583958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3f96-9d04-4aaa-ba26-d01aa3d0ad11 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:54.734340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3f96-9d04-4aaa-ba26-d01aa3d0ad11 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:54.783973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b941b9-f4d9-49e1-8fb9-8fa453ee207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:54.784511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b941b9-f4d9-49e1-8fb9-8fa453ee207f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:54.784781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b941b9-f4d9-49e1-8fb9-8fa453ee207f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:54.785049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b941b9-f4d9-49e1-8fb9-8fa453ee207f None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:54.785776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b941b9-f4d9-49e1-8fb9-8fa453ee207f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:54.786076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b941b9-f4d9-49e1-8fb9-8fa453ee207f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:54.787537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b941b9-f4d9-49e1-8fb9-8fa453ee207f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:54.815278 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 387/763] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 2 00:45:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:54.820957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e48d6-c9fa-4553-8afb-4283c3e85934 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:54.850737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b941b9-f4d9-49e1-8fb9-8fa453ee207f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:54.932230 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:54.989142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e48d6-c9fa-4553-8afb-4283c3e85934 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:55.018234 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:55.029406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b941b9-f4d9-49e1-8fb9-8fa453ee207f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:55.041472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5251c-4f0e-47b8-b7a2-812070014be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:55.042473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5251c-4f0e-47b8-b7a2-812070014be1 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.042980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5251c-4f0e-47b8-b7a2-812070014be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.043450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5251c-4f0e-47b8-b7a2-812070014be1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.064472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5251c-4f0e-47b8-b7a2-812070014be1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:55.067297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5251c-4f0e-47b8-b7a2-812070014be1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-b1a5251c-4f0e-47b8-b7a2-812070014be1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:55.083134 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:55.084121 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:55.085004 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:55.085004 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:55.085004 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:55.087225 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 377/764] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:55.092034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170835e-846a-403a-b635-89b8aae47d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:55.092649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170835e-846a-403a-b635-89b8aae47d91 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.092933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170835e-846a-403a-b635-89b8aae47d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.093204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170835e-846a-403a-b635-89b8aae47d91 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.093802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170835e-846a-403a-b635-89b8aae47d91 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:55.094095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5251c-4f0e-47b8-b7a2-812070014be1 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:55.096880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170835e-846a-403a-b635-89b8aae47d91 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7170835e-846a-403a-b635-89b8aae47d91 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:55.108445 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:55.109715 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:55.110804 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 388/765] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Oct 2 00:45:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:55.111605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e7af5-da62-4929-99aa-17431a56ebc6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.111605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e7af5-da62-4929-99aa-17431a56ebc6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.111728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e7af5-da62-4929-99aa-17431a56ebc6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.117047 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 389/766] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:55.117873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e7af5-da62-4929-99aa-17431a56ebc6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:55.212044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5251c-4f0e-47b8-b7a2-812070014be1 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:55.246980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19b193-65f0-47d4-ba59-e7c71f5d06be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:55.247979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b193-65f0-47d4-ba59-e7c71f5d06be None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.248404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b193-65f0-47d4-ba59-e7c71f5d06be None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.248821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b193-65f0-47d4-ba59-e7c71f5d06be None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.249655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19b193-65f0-47d4-ba59-e7c71f5d06be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:55.250110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19b193-65f0-47d4-ba59-e7c71f5d06be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:55.251640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19b193-65f0-47d4-ba59-e7c71f5d06be None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:55.254690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e7af5-da62-4929-99aa-17431a56ebc6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:55.267365 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 378/767] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:55.269070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a799b0-775d-481a-99ba-24c1f774122f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.269500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a799b0-775d-481a-99ba-24c1f774122f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.269994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a799b0-775d-481a-99ba-24c1f774122f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.281287 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:55.295137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-81a799b0-775d-481a-99ba-24c1f774122f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:55.296989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-81a799b0-775d-481a-99ba-24c1f774122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:55.306090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbb43c-8b49-4bd9-aeee-fcdd54e1e093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:55.307131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbb43c-8b49-4bd9-aeee-fcdd54e1e093 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.307738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbb43c-8b49-4bd9-aeee-fcdd54e1e093 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.308469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbb43c-8b49-4bd9-aeee-fcdd54e1e093 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.309506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbb43c-8b49-4bd9-aeee-fcdd54e1e093 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:55.310022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbb43c-8b49-4bd9-aeee-fcdd54e1e093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:55.311771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbb43c-8b49-4bd9-aeee-fcdd54e1e093 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:55.317611 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 390/768] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 2 00:45:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:55.318817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbb43c-8b49-4bd9-aeee-fcdd54e1e093 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:55.328339 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:55.374683 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 379/769] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:45:55.378406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a799b0-775d-481a-99ba-24c1f774122f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:55.445193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbb43c-8b49-4bd9-aeee-fcdd54e1e093 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:55.484278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b88c4-c989-4172-bc25-fce1b527d581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:55.485329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b88c4-c989-4172-bc25-fce1b527d581 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.485811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b88c4-c989-4172-bc25-fce1b527d581 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.486319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b88c4-c989-4172-bc25-fce1b527d581 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.494064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b88c4-c989-4172-bc25-fce1b527d581 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:55.496427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b88c4-c989-4172-bc25-fce1b527d581 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-470b88c4-c989-4172-bc25-fce1b527d581 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:55.510518 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:55.511487 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:55.512849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:55.512849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:55.512849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:55.512849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:55.512849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:55.512849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:55.512849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:55.512849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:55.515032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a799b0-775d-481a-99ba-24c1f774122f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:55.516757 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 391/770] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:55.518021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f59cf-1560-4c14-8900-c676d7d9ecfa None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.518331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f59cf-1560-4c14-8900-c676d7d9ecfa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.518581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f59cf-1560-4c14-8900-c676d7d9ecfa None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.520175 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 392/771] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:55.520869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f59cf-1560-4c14-8900-c676d7d9ecfa None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:55.556975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41da2fa-0119-4c67-9883-d900910f57db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:55.558653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41da2fa-0119-4c67-9883-d900910f57db None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.559152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41da2fa-0119-4c67-9883-d900910f57db None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.559660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41da2fa-0119-4c67-9883-d900910f57db None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.560476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41da2fa-0119-4c67-9883-d900910f57db None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:55.560966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41da2fa-0119-4c67-9883-d900910f57db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:55.562502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41da2fa-0119-4c67-9883-d900910f57db None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:55.567944 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:55.569545 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 380/772] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 2 00:45:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:55.571249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c9cc-88a2-4d33-a9d5-af2d73b60984 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.572127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c9cc-88a2-4d33-a9d5-af2d73b60984 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.572617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c9cc-88a2-4d33-a9d5-af2d73b60984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.594814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b453c9cc-88a2-4d33-a9d5-af2d73b60984 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:55.596254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b453c9cc-88a2-4d33-a9d5-af2d73b60984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:55.624951 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:55.636697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f59cf-1560-4c14-8900-c676d7d9ecfa None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:55.678225 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 381/773] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:45:55.679280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453c9cc-88a2-4d33-a9d5-af2d73b60984 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:55.683650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233e9f4-8fed-4031-ab79-dc2c41bae819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:55.684560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233e9f4-8fed-4031-ab79-dc2c41bae819 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.685027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233e9f4-8fed-4031-ab79-dc2c41bae819 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.685466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233e9f4-8fed-4031-ab79-dc2c41bae819 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.686372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233e9f4-8fed-4031-ab79-dc2c41bae819 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:55.686886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233e9f4-8fed-4031-ab79-dc2c41bae819 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:55.689084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233e9f4-8fed-4031-ab79-dc2c41bae819 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:55.706402 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 393/774] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:55.707643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233e9f4-8fed-4031-ab79-dc2c41bae819 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:55.786652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453c9cc-88a2-4d33-a9d5-af2d73b60984 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:55.828684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0915b0-c2f5-45c5-979a-41f2bf4420df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:55.829080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233e9f4-8fed-4031-ab79-dc2c41bae819 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:55.830192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0915b0-c2f5-45c5-979a-41f2bf4420df None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.830882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0915b0-c2f5-45c5-979a-41f2bf4420df None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.831329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0915b0-c2f5-45c5-979a-41f2bf4420df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.832971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0915b0-c2f5-45c5-979a-41f2bf4420df None admin] RBAC: Adding query filter params (interface=public, service_id=c607c7cb39eb49b5be5c06f9be08e381, region_id=RegionOne) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:55.833464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0915b0-c2f5-45c5-979a-41f2bf4420df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:55.835018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0915b0-c2f5-45c5-979a-41f2bf4420df None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:55.846238 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 382/775] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 2 00:45:55 2022] GET /identity/v3/endpoints?service_id=c607c7cb39eb49b5be5c06f9be08e381&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:55.847803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0915b0-c2f5-45c5-979a-41f2bf4420df None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:55.862978 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:55.865792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81063bb7-66b3-4973-8724-45af629ee215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:55.866563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063bb7-66b3-4973-8724-45af629ee215 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:55.866977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063bb7-66b3-4973-8724-45af629ee215 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:55.867249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063bb7-66b3-4973-8724-45af629ee215 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:55.878284 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:55.879771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81063bb7-66b3-4973-8724-45af629ee215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-81063bb7-66b3-4973-8724-45af629ee215 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:55.884528 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:55.885484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 394/776] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:45:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:55.887115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81063bb7-66b3-4973-8724-45af629ee215 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:55.992821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0915b0-c2f5-45c5-979a-41f2bf4420df None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:56.005333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81063bb7-66b3-4973-8724-45af629ee215 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:56.029897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6435bb-dcde-4f6a-a924-aa8256e494d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:56.030555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6435bb-dcde-4f6a-a924-aa8256e494d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:56.030888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6435bb-dcde-4f6a-a924-aa8256e494d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:56.031118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6435bb-dcde-4f6a-a924-aa8256e494d5 None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/b85fc7e555f348c3ab6c63ee15f6ceb0/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:56.033108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6435bb-dcde-4f6a-a924-aa8256e494d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=b85fc7e555f348c3ab6c63ee15f6ceb0, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:56.034542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6435bb-dcde-4f6a-a924-aa8256e494d5 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:56.043487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50701ec-e3cf-4706-8806-0c0e0d90834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:56.044353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50701ec-e3cf-4706-8806-0c0e0d90834d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:56.044775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50701ec-e3cf-4706-8806-0c0e0d90834d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:56.045452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50701ec-e3cf-4706-8806-0c0e0d90834d None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:56.046191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50701ec-e3cf-4706-8806-0c0e0d90834d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:56.047740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50701ec-e3cf-4706-8806-0c0e0d90834d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:56.049485 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 383/777] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:45:55 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/b85fc7e555f348c3ab6c63ee15f6ceb0/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:56.050272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6435bb-dcde-4f6a-a924-aa8256e494d5 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:56.064077 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 395/778] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 2 00:45:55 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:56.065323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50701ec-e3cf-4706-8806-0c0e0d90834d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:56.117703 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:56.189479 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:56.216742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6435bb-dcde-4f6a-a924-aa8256e494d5 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:56.233201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50701ec-e3cf-4706-8806-0c0e0d90834d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:56.259698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffe7db-fb79-4c69-9fa2-44ee81a7efdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:56.260309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffe7db-fb79-4c69-9fa2-44ee81a7efdd None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:56.260589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffe7db-fb79-4c69-9fa2-44ee81a7efdd None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:56.261392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffe7db-fb79-4c69-9fa2-44ee81a7efdd None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:56.262173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffe7db-fb79-4c69-9fa2-44ee81a7efdd None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:56.262461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffe7db-fb79-4c69-9fa2-44ee81a7efdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:56.263867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffe7db-fb79-4c69-9fa2-44ee81a7efdd None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:56.272997 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 384/779] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:45:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:56.274432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df4a2c-037e-46b0-a63d-1a8d36f9378f None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:56.274432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df4a2c-037e-46b0-a63d-1a8d36f9378f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:56.274722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df4a2c-037e-46b0-a63d-1a8d36f9378f None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:56.276126 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 385/780] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:56.280770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a687943-f5b8-4d45-96f3-45f0815083a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:56.281911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687943-f5b8-4d45-96f3-45f0815083a8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:56.282097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687943-f5b8-4d45-96f3-45f0815083a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:56.282320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687943-f5b8-4d45-96f3-45f0815083a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:56.282953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a687943-f5b8-4d45-96f3-45f0815083a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:56.283579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c850e93-d657-49c0-914f-42840d667c0a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:56.283886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c850e93-d657-49c0-914f-42840d667c0a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:56.284157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c850e93-d657-49c0-914f-42840d667c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:56.284346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a687943-f5b8-4d45-96f3-45f0815083a8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0a687943-f5b8-4d45-96f3-45f0815083a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:56.294096 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:56.295489 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:56.297384 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 396/781] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:56 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:56.299404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a687943-f5b8-4d45-96f3-45f0815083a8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:56.305872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1c850e93-d657-49c0-914f-42840d667c0a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:56.305872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1c850e93-d657-49c0-914f-42840d667c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:56.377423 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 386/782] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:45:56.378119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c850e93-d657-49c0-914f-42840d667c0a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:56.417049 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:56.433407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a687943-f5b8-4d45-96f3-45f0815083a8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:56.473381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401486ec-7ce9-48cf-b43f-27f97bb2e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:56.474890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401486ec-7ce9-48cf-b43f-27f97bb2e3ef None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:56.475654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401486ec-7ce9-48cf-b43f-27f97bb2e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:56.476129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401486ec-7ce9-48cf-b43f-27f97bb2e3ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:56.504940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401486ec-7ce9-48cf-b43f-27f97bb2e3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:56.506871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401486ec-7ce9-48cf-b43f-27f97bb2e3ef None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:56.509261 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-401486ec-7ce9-48cf-b43f-27f97bb2e3ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:56.539047 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:56.540064 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:56.540974 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:56.540974 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:56.540974 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:56.543402 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 397/783] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:56.549419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401486ec-7ce9-48cf-b43f-27f97bb2e3ef None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:56.565545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c850e93-d657-49c0-914f-42840d667c0a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:56.637862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c62ff-d300-4831-bf6f-eaefb18e5f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:56.638393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c62ff-d300-4831-bf6f-eaefb18e5f47 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:56.638700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c62ff-d300-4831-bf6f-eaefb18e5f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:56.638978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c62ff-d300-4831-bf6f-eaefb18e5f47 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:56.639610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c62ff-d300-4831-bf6f-eaefb18e5f47 None admin] RBAC: Adding query filter params (name=network) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:56.639910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c62ff-d300-4831-bf6f-eaefb18e5f47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:56.641273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c62ff-d300-4831-bf6f-eaefb18e5f47 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:56.654029 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 387/784] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:45:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:56.659873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c62ff-d300-4831-bf6f-eaefb18e5f47 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:56.712604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401486ec-7ce9-48cf-b43f-27f97bb2e3ef None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:56.757177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f6b4e-1839-4e43-a569-d3e0f7e7f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:56.757797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f6b4e-1839-4e43-a569-d3e0f7e7f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:56.758084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f6b4e-1839-4e43-a569-d3e0f7e7f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:56.758362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f6b4e-1839-4e43-a569-d3e0f7e7f4a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:56.759315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f6b4e-1839-4e43-a569-d3e0f7e7f4a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:56.759623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f6b4e-1839-4e43-a569-d3e0f7e7f4a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:56.762018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f6b4e-1839-4e43-a569-d3e0f7e7f4a2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:56.779974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c62ff-d300-4831-bf6f-eaefb18e5f47 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:56.780357 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 398/785] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:56.781880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f6b4e-1839-4e43-a569-d3e0f7e7f4a2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:56.790429 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:56.832148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639bfe2-457c-426d-9b14-15f1632c8963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:56.832929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bfe2-457c-426d-9b14-15f1632c8963 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:56.833314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bfe2-457c-426d-9b14-15f1632c8963 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:56.833689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bfe2-457c-426d-9b14-15f1632c8963 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:56.834426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639bfe2-457c-426d-9b14-15f1632c8963 None admin] RBAC: Adding query filter params (type=network) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:56.834858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639bfe2-457c-426d-9b14-15f1632c8963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:56.836408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639bfe2-457c-426d-9b14-15f1632c8963 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:56.842749 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 388/786] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:45:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:56.843689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639bfe2-457c-426d-9b14-15f1632c8963 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:56.846411 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:56.912909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f6b4e-1839-4e43-a569-d3e0f7e7f4a2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:56.953034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d2ada-2602-4b86-bab9-f49f777c6eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:56.953673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d2ada-2602-4b86-bab9-f49f777c6eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:56.953950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d2ada-2602-4b86-bab9-f49f777c6eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:56.954222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d2ada-2602-4b86-bab9-f49f777c6eb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:56.965550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d2ada-2602-4b86-bab9-f49f777c6eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:56.966694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639bfe2-457c-426d-9b14-15f1632c8963 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-471d2ada-2602-4b86-bab9-f49f777c6eb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:56.970814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:56.971773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:56.972634 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:56.977123 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 399/787] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:56.978462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d2ada-2602-4b86-bab9-f49f777c6eb0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:57.011198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4a317-5ddf-4055-810a-4ed81cdc1376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:57.012489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4a317-5ddf-4055-810a-4ed81cdc1376 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:57.012978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4a317-5ddf-4055-810a-4ed81cdc1376 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:57.013456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4a317-5ddf-4055-810a-4ed81cdc1376 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:57.025189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4a317-5ddf-4055-810a-4ed81cdc1376 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:57.027432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4a317-5ddf-4055-810a-4ed81cdc1376 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-b5e4a317-5ddf-4055-810a-4ed81cdc1376 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:57.040848 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:57.042341 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:57.043512 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:57.043512 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:57.043512 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:57.043512 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:57.043512 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:57.043512 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:57.043512 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:57.043512 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:57.043512 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:45:57.043512 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:57.046774 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 389/788] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 2 00:45:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:57.048044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4a317-5ddf-4055-810a-4ed81cdc1376 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:57.060575 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:57.108875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d2ada-2602-4b86-bab9-f49f777c6eb0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:57.121050 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:57.158088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61477d-1153-4c5e-8f0f-6cd11c7adf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:57.158895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61477d-1153-4c5e-8f0f-6cd11c7adf70 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:57.159274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61477d-1153-4c5e-8f0f-6cd11c7adf70 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:57.159683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61477d-1153-4c5e-8f0f-6cd11c7adf70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:57.161762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61477d-1153-4c5e-8f0f-6cd11c7adf70 None admin] RBAC: Adding query filter params (interface=public, service_id=661213b8d1c0489ba4c27f3eebf2ef8c, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:57.162447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61477d-1153-4c5e-8f0f-6cd11c7adf70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:57.164466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61477d-1153-4c5e-8f0f-6cd11c7adf70 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:57.179399 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 400/789] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 2 00:45:56 2022] GET /identity/v3/endpoints?service_id=661213b8d1c0489ba4c27f3eebf2ef8c&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:57.179399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61477d-1153-4c5e-8f0f-6cd11c7adf70 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:57.180170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4a317-5ddf-4055-810a-4ed81cdc1376 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:57.220845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecbefd-2948-4e55-9bf6-15457213bf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:57.221828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbefd-2948-4e55-9bf6-15457213bf4d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:57.222300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbefd-2948-4e55-9bf6-15457213bf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:57.223070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbefd-2948-4e55-9bf6-15457213bf4d None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:57.224350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecbefd-2948-4e55-9bf6-15457213bf4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:57.225103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecbefd-2948-4e55-9bf6-15457213bf4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:57.226772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecbefd-2948-4e55-9bf6-15457213bf4d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:57.240707 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 390/790] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:57.242557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecbefd-2948-4e55-9bf6-15457213bf4d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:57.306955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61477d-1153-4c5e-8f0f-6cd11c7adf70 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:57.339910 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:57.352944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d552ab-61ad-4408-93f3-e87129d4957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:57.353574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d552ab-61ad-4408-93f3-e87129d4957e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:57.353842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d552ab-61ad-4408-93f3-e87129d4957e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:57.354128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d552ab-61ad-4408-93f3-e87129d4957e None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:57.355056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d552ab-61ad-4408-93f3-e87129d4957e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:57.355367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d552ab-61ad-4408-93f3-e87129d4957e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:57.357287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d552ab-61ad-4408-93f3-e87129d4957e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:57.372287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecbefd-2948-4e55-9bf6-15457213bf4d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:57.385059 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 401/791] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 2 00:45:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:57.385059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d552ab-61ad-4408-93f3-e87129d4957e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:57.399026 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:57.411497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44faa5a-ae16-4361-b028-5fcaaca71fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:57.412108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44faa5a-ae16-4361-b028-5fcaaca71fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:57.412485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44faa5a-ae16-4361-b028-5fcaaca71fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:57.412659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44faa5a-ae16-4361-b028-5fcaaca71fc2 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:57.413261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44faa5a-ae16-4361-b028-5fcaaca71fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:57.414892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44faa5a-ae16-4361-b028-5fcaaca71fc2 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:57.426691 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 391/792] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 2 00:45:57 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:57.428777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44faa5a-ae16-4361-b028-5fcaaca71fc2 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:57.573422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d552ab-61ad-4408-93f3-e87129d4957e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:57.636802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7aa59-3d39-4113-b189-90f26942d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:57.637422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7aa59-3d39-4113-b189-90f26942d4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:57.637709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7aa59-3d39-4113-b189-90f26942d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:57.637976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7aa59-3d39-4113-b189-90f26942d4f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:57.646721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44faa5a-ae16-4361-b028-5fcaaca71fc2 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:57.658517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7aa59-3d39-4113-b189-90f26942d4f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:57.660949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7aa59-3d39-4113-b189-90f26942d4f3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-8fd7aa59-3d39-4113-b189-90f26942d4f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:57.678342 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:57.679311 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:57.680218 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:57.680218 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:57.680218 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:57.682303 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 402/793] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:57.686565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253b964-b4e2-4078-bff5-23ffb1d324f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:57.686565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253b964-b4e2-4078-bff5-23ffb1d324f1 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:57.686565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253b964-b4e2-4078-bff5-23ffb1d324f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:57.686565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253b964-b4e2-4078-bff5-23ffb1d324f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:57.689499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7aa59-3d39-4113-b189-90f26942d4f3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:57.698557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253b964-b4e2-4078-bff5-23ffb1d324f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:57.700460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253b964-b4e2-4078-bff5-23ffb1d324f1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-7253b964-b4e2-4078-bff5-23ffb1d324f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:57.717750 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:57.718759 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:57.719660 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:57.719660 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:57.719660 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:57.719660 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 392/794] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:57.724820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253b964-b4e2-4078-bff5-23ffb1d324f1 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:57.731611 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:57.770457 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:57.814777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7aa59-3d39-4113-b189-90f26942d4f3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:57.830934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253b964-b4e2-4078-bff5-23ffb1d324f1 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:57.855238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89522e0-04bc-4112-872f-2c6b2412bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:57.856273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89522e0-04bc-4112-872f-2c6b2412bdcd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:57.856747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89522e0-04bc-4112-872f-2c6b2412bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:57.857241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89522e0-04bc-4112-872f-2c6b2412bdcd None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:57.858254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89522e0-04bc-4112-872f-2c6b2412bdcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:57.858849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89522e0-04bc-4112-872f-2c6b2412bdcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:57.860424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89522e0-04bc-4112-872f-2c6b2412bdcd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:57.866169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ec8bc-b00e-45fe-9b62-13d56f19a1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:57.867006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ec8bc-b00e-45fe-9b62-13d56f19a1ed None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:57.867117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ec8bc-b00e-45fe-9b62-13d56f19a1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:57.867340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ec8bc-b00e-45fe-9b62-13d56f19a1ed None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:57.867979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ec8bc-b00e-45fe-9b62-13d56f19a1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:57.868281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ec8bc-b00e-45fe-9b62-13d56f19a1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:57.870643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ec8bc-b00e-45fe-9b62-13d56f19a1ed None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:57.876364 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 403/795] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:57.882092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89522e0-04bc-4112-872f-2c6b2412bdcd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:57.882561 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 393/796] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:57.888118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ec8bc-b00e-45fe-9b62-13d56f19a1ed None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:57.989234 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:57.992074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ec8bc-b00e-45fe-9b62-13d56f19a1ed None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:58.003866 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:58.013044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89522e0-04bc-4112-872f-2c6b2412bdcd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:58.029149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1275d7-acd5-406c-b25f-bd3465c0f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:58.029480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1275d7-acd5-406c-b25f-bd3465c0f515 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.029736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1275d7-acd5-406c-b25f-bd3465c0f515 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.030014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1275d7-acd5-406c-b25f-bd3465c0f515 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.037184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1275d7-acd5-406c-b25f-bd3465c0f515 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:58.038392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1275d7-acd5-406c-b25f-bd3465c0f515 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-2e1275d7-acd5-406c-b25f-bd3465c0f515 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:58.051413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:58.052348 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:58.053273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:58.053273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:58.053273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:58.053273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:58.053273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:58.053273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:58.053273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:58.053273 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:58.053273 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 394/797] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:58.058983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1275d7-acd5-406c-b25f-bd3465c0f515 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:58.059856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84318ec3-e979-424b-982a-bb06fad39e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:58.060795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318ec3-e979-424b-982a-bb06fad39e1b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.061302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318ec3-e979-424b-982a-bb06fad39e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.061915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318ec3-e979-424b-982a-bb06fad39e1b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.070963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84318ec3-e979-424b-982a-bb06fad39e1b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:58.072873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84318ec3-e979-424b-982a-bb06fad39e1b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-84318ec3-e979-424b-982a-bb06fad39e1b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:45:58.099371 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:58.100464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:58.101396 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:58.101396 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:58.101396 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:45:58.101396 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:45:58.101396 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:45:58.101396 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:45:58.101396 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:45:58.101396 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:45:58.101396 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:45:58.101396 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:58.107820 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 404/798] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:45:58.116339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84318ec3-e979-424b-982a-bb06fad39e1b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:58.205478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1275d7-acd5-406c-b25f-bd3465c0f515 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:58.239742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc7691-c3d6-40a6-a83b-94e99f714335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:58.240270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc7691-c3d6-40a6-a83b-94e99f714335 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.240551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc7691-c3d6-40a6-a83b-94e99f714335 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.240827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc7691-c3d6-40a6-a83b-94e99f714335 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.241523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc7691-c3d6-40a6-a83b-94e99f714335 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:58.241828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc7691-c3d6-40a6-a83b-94e99f714335 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:58.243334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc7691-c3d6-40a6-a83b-94e99f714335 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:58.266025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84318ec3-e979-424b-982a-bb06fad39e1b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:58.276864 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 395/799] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:58.283519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc7691-c3d6-40a6-a83b-94e99f714335 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:58.311071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5506a7-19a9-447a-a792-2c3949e83de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:58.312741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5506a7-19a9-447a-a792-2c3949e83de8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.313389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5506a7-19a9-447a-a792-2c3949e83de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.315217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5506a7-19a9-447a-a792-2c3949e83de8 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.316353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5506a7-19a9-447a-a792-2c3949e83de8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:58.317743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5506a7-19a9-447a-a792-2c3949e83de8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:58.320095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5506a7-19a9-447a-a792-2c3949e83de8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:58.333371 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:58.359214 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 405/800] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 2 00:45:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:58.365123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5506a7-19a9-447a-a792-2c3949e83de8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:58.384909 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:58.446850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc7691-c3d6-40a6-a83b-94e99f714335 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:58.486991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ce645-e346-46d6-8a90-e1550c297041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:58.487651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ce645-e346-46d6-8a90-e1550c297041 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.487929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ce645-e346-46d6-8a90-e1550c297041 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.488200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ce645-e346-46d6-8a90-e1550c297041 None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/80a8390c507240e893e1fd82b2490df3/roles/0905222c6f30467abc2b2a41d74fa282` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.503737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5506a7-19a9-447a-a792-2c3949e83de8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:58.505318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ce645-e346-46d6-8a90-e1550c297041 None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=80a8390c507240e893e1fd82b2490df3, role_id=0905222c6f30467abc2b2a41d74fa282)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:58.508144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ce645-e346-46d6-8a90-e1550c297041 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:58.524802 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 396/801] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:45:58 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/80a8390c507240e893e1fd82b2490df3/roles/0905222c6f30467abc2b2a41d74fa282 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:58.527415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23962c9a-a9f6-4cc7-ba8d-d78fc2eb95af None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.527707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23962c9a-a9f6-4cc7-ba8d-d78fc2eb95af None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.527988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23962c9a-a9f6-4cc7-ba8d-d78fc2eb95af None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.530269 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 397/802] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:58.536700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e135595-3660-406f-a476-57d17de583e4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.537410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e135595-3660-406f-a476-57d17de583e4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.538069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e135595-3660-406f-a476-57d17de583e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.566999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3e135595-3660-406f-a476-57d17de583e4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:58.568612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3e135595-3660-406f-a476-57d17de583e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:58.583984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7270d-f853-4437-9bfb-431cbee3a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:58.584926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7270d-f853-4437-9bfb-431cbee3a9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.585481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7270d-f853-4437-9bfb-431cbee3a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.585748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7270d-f853-4437-9bfb-431cbee3a9b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.605540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7270d-f853-4437-9bfb-431cbee3a9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:58.607310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7270d-f853-4437-9bfb-431cbee3a9b4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c6f7270d-f853-4437-9bfb-431cbee3a9b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:45:58.625431 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:58.626488 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:45:58.627450 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:45:58.627450 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:45:58.627450 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:58.627450 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 406/803] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:58.631813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c0575-4b73-4a81-86b6-7ad4d87ea18b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.632131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c0575-4b73-4a81-86b6-7ad4d87ea18b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.632368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c0575-4b73-4a81-86b6-7ad4d87ea18b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.638278 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 407/804] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:45:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:45:58.639778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c0575-4b73-4a81-86b6-7ad4d87ea18b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:58.691995 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:58.701340 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 398/805] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:45:58.703788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87d064-dca1-40af-9294-ce615e35a208 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.704320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87d064-dca1-40af-9294-ce615e35a208 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.705230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87d064-dca1-40af-9294-ce615e35a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.724468 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:58.728493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5e87d064-dca1-40af-9294-ce615e35a208 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:45:58.730149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5e87d064-dca1-40af-9294-ce615e35a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:45:58.768957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c0575-4b73-4a81-86b6-7ad4d87ea18b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:58.817963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ce905-723f-49aa-9cac-0788cdfcda7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:58.819138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ce905-723f-49aa-9cac-0788cdfcda7a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:58.819419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ce905-723f-49aa-9cac-0788cdfcda7a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:58.819693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ce905-723f-49aa-9cac-0788cdfcda7a None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:58.820341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ce905-723f-49aa-9cac-0788cdfcda7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:58.820646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ce905-723f-49aa-9cac-0788cdfcda7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:58.822023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ce905-723f-49aa-9cac-0788cdfcda7a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:58.826496 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 399/806] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:45:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:45:58.839207 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 408/807] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:58.840714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87d064-dca1-40af-9294-ce615e35a208 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:58.967728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87d064-dca1-40af-9294-ce615e35a208 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.003979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6ea2e-156a-4bac-b89a-febbeeafaddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.004869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6ea2e-156a-4bac-b89a-febbeeafaddf None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.005310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6ea2e-156a-4bac-b89a-febbeeafaddf None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.005727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6ea2e-156a-4bac-b89a-febbeeafaddf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:59.013224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6ea2e-156a-4bac-b89a-febbeeafaddf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:59.014915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6ea2e-156a-4bac-b89a-febbeeafaddf None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-e0c6ea2e-156a-4bac-b89a-febbeeafaddf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:45:59.026460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:59.027394 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:59.028291 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:45:59.028291 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:45:59.028291 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:45:59.028291 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:45:59.028291 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:45:59.028291 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:45:59.028291 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:45:59.028291 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:59.034622 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 400/808] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:45:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:59.034622 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:59.036760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ce905-723f-49aa-9cac-0788cdfcda7a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.058962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6ea2e-156a-4bac-b89a-febbeeafaddf None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.177785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ce905-723f-49aa-9cac-0788cdfcda7a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.209512 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:59.221543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a4a4c-f521-454c-8b0d-13aa0e488325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.222635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a4a4c-f521-454c-8b0d-13aa0e488325 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.223098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a4a4c-f521-454c-8b0d-13aa0e488325 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.223805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a4a4c-f521-454c-8b0d-13aa0e488325 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:59.224677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a4a4c-f521-454c-8b0d-13aa0e488325 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:59.225160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a4a4c-f521-454c-8b0d-13aa0e488325 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:59.227263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a4a4c-f521-454c-8b0d-13aa0e488325 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:59.240362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6ea2e-156a-4bac-b89a-febbeeafaddf None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.244178 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 409/809] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:45:59.250403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a4a4c-f521-454c-8b0d-13aa0e488325 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.279183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d32be-fd45-4e6a-8d7a-11a223d4f56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.280004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d32be-fd45-4e6a-8d7a-11a223d4f56f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.280382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d32be-fd45-4e6a-8d7a-11a223d4f56f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.280764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d32be-fd45-4e6a-8d7a-11a223d4f56f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:59.281490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d32be-fd45-4e6a-8d7a-11a223d4f56f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:59.283115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d32be-fd45-4e6a-8d7a-11a223d4f56f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-812d32be-fd45-4e6a-8d7a-11a223d4f56f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:59.293260 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:59.294526 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 02 00:45:59.295889 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:45:59.297496 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 401/810] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Oct 2 00:45:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:59.298510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d32be-fd45-4e6a-8d7a-11a223d4f56f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.360872 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:59.382002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a4a4c-f521-454c-8b0d-13aa0e488325 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.418332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f66b4-bd99-43bd-ab28-5fdda02bbbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.419024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f66b4-bd99-43bd-ab28-5fdda02bbbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.419347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f66b4-bd99-43bd-ab28-5fdda02bbbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.420181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d32be-fd45-4e6a-8d7a-11a223d4f56f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.421237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f66b4-bd99-43bd-ab28-5fdda02bbbe9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:59.432992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f66b4-bd99-43bd-ab28-5fdda02bbbe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ef7f66b4-bd99-43bd-ab28-5fdda02bbbe9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:45:59.438886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:45:59.439855 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:45:59.440711 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:45:59.444961 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 410/811] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:45:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:45:59.446014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f66b4-bd99-43bd-ab28-5fdda02bbbe9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.467126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962067d0-1972-4622-a6dc-ad2a65d94427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.468459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962067d0-1972-4622-a6dc-ad2a65d94427 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.468939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962067d0-1972-4622-a6dc-ad2a65d94427 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.469865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962067d0-1972-4622-a6dc-ad2a65d94427 None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/a0fa4948f9b546dea031acfc0f3e3d95/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:59.472463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962067d0-1972-4622-a6dc-ad2a65d94427 None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=a0fa4948f9b546dea031acfc0f3e3d95, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:59.474674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962067d0-1972-4622-a6dc-ad2a65d94427 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:59.502662 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:59.502977 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 402/812] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:45:59 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/a0fa4948f9b546dea031acfc0f3e3d95/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:45:59.503951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962067d0-1972-4622-a6dc-ad2a65d94427 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.634907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f66b4-bd99-43bd-ab28-5fdda02bbbe9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.693789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b7369-0ae8-400e-8d30-5f905fcc96dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.694418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b7369-0ae8-400e-8d30-5f905fcc96dd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.694725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b7369-0ae8-400e-8d30-5f905fcc96dd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.694999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b7369-0ae8-400e-8d30-5f905fcc96dd None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:59.695639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b7369-0ae8-400e-8d30-5f905fcc96dd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:59.695942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b7369-0ae8-400e-8d30-5f905fcc96dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:59.697332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b7369-0ae8-400e-8d30-5f905fcc96dd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:59.715735 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 411/813] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 2 00:45:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:59.720325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b7369-0ae8-400e-8d30-5f905fcc96dd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.734127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962067d0-1972-4622-a6dc-ad2a65d94427 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.766985 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:59.782479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1d5d-010c-4dae-abef-6a8c4f9415d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.783253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1d5d-010c-4dae-abef-6a8c4f9415d8 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.783633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1d5d-010c-4dae-abef-6a8c4f9415d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.784003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1d5d-010c-4dae-abef-6a8c4f9415d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:45:59.784769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b1d5d-010c-4dae-abef-6a8c4f9415d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:45:59.785167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b1d5d-010c-4dae-abef-6a8c4f9415d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:45:59.786687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b1d5d-010c-4dae-abef-6a8c4f9415d8 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:45:59.797224 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 403/814] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:45:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:45:59.804600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1d5d-010c-4dae-abef-6a8c4f9415d8 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:45:59.919792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b7369-0ae8-400e-8d30-5f905fcc96dd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.939569 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:45:59.949583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1d5d-010c-4dae-abef-6a8c4f9415d8 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:45:59.996542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060d9f6-baed-4d4d-9723-09788480fed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:45:59.997194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060d9f6-baed-4d4d-9723-09788480fed5 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:45:59.997472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060d9f6-baed-4d4d-9723-09788480fed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:45:59.997738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060d9f6-baed-4d4d-9723-09788480fed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.009264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060d9f6-baed-4d4d-9723-09788480fed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:00.011421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060d9f6-baed-4d4d-9723-09788480fed5 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:00.024684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede22e-583e-4144-8f5b-bb490fac143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:00.025296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede22e-583e-4144-8f5b-bb490fac143a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-b060d9f6-baed-4d4d-9723-09788480fed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:00.025570 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:00.027589 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:00.028668 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:00.028668 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:00.028668 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:00.028842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede22e-583e-4144-8f5b-bb490fac143a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.028842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede22e-583e-4144-8f5b-bb490fac143a None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.028842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eede22e-583e-4144-8f5b-bb490fac143a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:00.028842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eede22e-583e-4144-8f5b-bb490fac143a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:00.029096 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 404/815] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:00.029166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eede22e-583e-4144-8f5b-bb490fac143a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:00.035639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060d9f6-baed-4d4d-9723-09788480fed5 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:00.045265 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 412/816] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 2 00:45:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:00.050375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede22e-583e-4144-8f5b-bb490fac143a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:00.070997 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:00.147082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060d9f6-baed-4d4d-9723-09788480fed5 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:00.192572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21db6-e632-4e0b-8eff-be1f19102d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:00.193196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21db6-e632-4e0b-8eff-be1f19102d99 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.193544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21db6-e632-4e0b-8eff-be1f19102d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.194132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21db6-e632-4e0b-8eff-be1f19102d99 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.195038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21db6-e632-4e0b-8eff-be1f19102d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:00.195406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21db6-e632-4e0b-8eff-be1f19102d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:00.196875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21db6-e632-4e0b-8eff-be1f19102d99 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:00.210554 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 405/817] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:00.215959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21db6-e632-4e0b-8eff-be1f19102d99 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:00.273264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede22e-583e-4144-8f5b-bb490fac143a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:00.312809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d333a7-8fc7-4845-806d-8b4304f47b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:00.313676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d333a7-8fc7-4845-806d-8b4304f47b3a None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.313955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d333a7-8fc7-4845-806d-8b4304f47b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.314258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d333a7-8fc7-4845-806d-8b4304f47b3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.315390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d333a7-8fc7-4845-806d-8b4304f47b3a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:00.317266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d333a7-8fc7-4845-806d-8b4304f47b3a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:00.321196 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:00.335275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21db6-e632-4e0b-8eff-be1f19102d99 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:00.358687 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 413/818] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 00:46:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:46:00.358687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa280d-6d4f-415c-977e-37a18241b7cc None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.358687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa280d-6d4f-415c-977e-37a18241b7cc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.358687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa280d-6d4f-415c-977e-37a18241b7cc None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.358687 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 414/819] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:00.364149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f306-e5cc-446d-91be-22f867c105e1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.364577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f306-e5cc-446d-91be-22f867c105e1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.364986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f306-e5cc-446d-91be-22f867c105e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.385406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-74a2f306-e5cc-446d-91be-22f867c105e1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:00.387830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-74a2f306-e5cc-446d-91be-22f867c105e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:00.416281 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:00.428602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da06bb-c3c9-42d6-ba74-2ecea8fd57df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:00.429252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da06bb-c3c9-42d6-ba74-2ecea8fd57df None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.429540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da06bb-c3c9-42d6-ba74-2ecea8fd57df None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.429816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da06bb-c3c9-42d6-ba74-2ecea8fd57df None admin] PATH_INFO: `/v3/users/nova` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.445563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da06bb-c3c9-42d6-ba74-2ecea8fd57df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:00.452842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da06bb-c3c9-42d6-ba74-2ecea8fd57df None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-c5da06bb-c3c9-42d6-ba74-2ecea8fd57df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:00.480465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:00.482054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:00.483049 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:00.483049 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:00.483049 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:00.483049 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:00.483049 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:00.483049 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:00.483049 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:00.483049 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:00.483049 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:46:00.483049 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:00.483049 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 406/820] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 2 00:46:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:00.487789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da06bb-c3c9-42d6-ba74-2ecea8fd57df None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:00.519276 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 415/821] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:00.637719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da06bb-c3c9-42d6-ba74-2ecea8fd57df None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:00.674232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3674e3-d630-46c0-bd74-cbd3745e456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:00.675238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3674e3-d630-46c0-bd74-cbd3745e456f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.675725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3674e3-d630-46c0-bd74-cbd3745e456f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.676239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3674e3-d630-46c0-bd74-cbd3745e456f None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.677191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3674e3-d630-46c0-bd74-cbd3745e456f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:00.677703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3674e3-d630-46c0-bd74-cbd3745e456f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:00.679414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3674e3-d630-46c0-bd74-cbd3745e456f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:00.701007 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 407/822] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 2 00:46:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:00.706358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f306-e5cc-446d-91be-22f867c105e1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:00.816793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f306-e5cc-446d-91be-22f867c105e1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:00.861950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492b1b5-2367-4dd7-912a-66494f6a14f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:00.862937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492b1b5-2367-4dd7-912a-66494f6a14f8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:00.863444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492b1b5-2367-4dd7-912a-66494f6a14f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:00.863941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492b1b5-2367-4dd7-912a-66494f6a14f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:00.876022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3674e3-d630-46c0-bd74-cbd3745e456f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:00.890004 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:00.926970 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:01.012525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492b1b5-2367-4dd7-912a-66494f6a14f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:01.014036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492b1b5-2367-4dd7-912a-66494f6a14f8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:01.068599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3674e3-d630-46c0-bd74-cbd3745e456f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:01.132334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0c50-de25-41ed-bb36-79c5f8a405c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:01.132964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0c50-de25-41ed-bb36-79c5f8a405c5 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:01.133240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0c50-de25-41ed-bb36-79c5f8a405c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:01.133511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0c50-de25-41ed-bb36-79c5f8a405c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:01.134095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b0c50-de25-41ed-bb36-79c5f8a405c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:01.135740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b0c50-de25-41ed-bb36-79c5f8a405c5 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-4e9b0c50-de25-41ed-bb36-79c5f8a405c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:01.144601 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:01.145654 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:01.146506 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 408/823] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:00 2022] GET /identity/v3/services/network => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:01.147836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b2bf-4956-4a2f-a295-7807e68524a2 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:01.147836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b2bf-4956-4a2f-a295-7807e68524a2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:01.148001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b2bf-4956-4a2f-a295-7807e68524a2 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:01.154297 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 409/824] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:01.155151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81b2bf-4956-4a2f-a295-7807e68524a2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:01.195377 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 416/825] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 02 00:46:01.197364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f1972-8752-4cfc-8d8a-a571931fac80 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:01.198886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f1972-8752-4cfc-8d8a-a571931fac80 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:01.199375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f1972-8752-4cfc-8d8a-a571931fac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:01.223419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b74f1972-8752-4cfc-8d8a-a571931fac80 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:01.225623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b74f1972-8752-4cfc-8d8a-a571931fac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:01.239096 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:01.271456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81b2bf-4956-4a2f-a295-7807e68524a2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:01.291310 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:01.310775 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 417/826] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:01.311920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f1972-8752-4cfc-8d8a-a571931fac80 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:01.315360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbe262-8616-4e44-9927-ac1a43d5a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:01.316209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe262-8616-4e44-9927-ac1a43d5a8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:01.316640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe262-8616-4e44-9927-ac1a43d5a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:01.317043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe262-8616-4e44-9927-ac1a43d5a8b9 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:01.317819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbe262-8616-4e44-9927-ac1a43d5a8b9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:01.318293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbe262-8616-4e44-9927-ac1a43d5a8b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:01.320715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbe262-8616-4e44-9927-ac1a43d5a8b9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:01.327119 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 410/827] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:46:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:01.332726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbe262-8616-4e44-9927-ac1a43d5a8b9 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:01.528069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbe262-8616-4e44-9927-ac1a43d5a8b9 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:01.583408 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:01.596570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1197812-540e-451c-8bb7-4fd46f51f87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:01.597370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197812-540e-451c-8bb7-4fd46f51f87d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:01.597658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197812-540e-451c-8bb7-4fd46f51f87d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:01.598253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197812-540e-451c-8bb7-4fd46f51f87d None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:01.598931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1197812-540e-451c-8bb7-4fd46f51f87d None admin] RBAC: Adding query filter params (type=network) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:01.599241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1197812-540e-451c-8bb7-4fd46f51f87d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:01.600619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1197812-540e-451c-8bb7-4fd46f51f87d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:01.613468 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 411/828] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:46:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:01.614831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1197812-540e-451c-8bb7-4fd46f51f87d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:01.627836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f1972-8752-4cfc-8d8a-a571931fac80 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:01.663503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52b726-e2e1-433f-ac06-f3e510a6cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:01.664569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b726-e2e1-433f-ac06-f3e510a6cf35 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:01.665042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b726-e2e1-433f-ac06-f3e510a6cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:01.665522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b726-e2e1-433f-ac06-f3e510a6cf35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:01.676481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52b726-e2e1-433f-ac06-f3e510a6cf35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:01.678169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52b726-e2e1-433f-ac06-f3e510a6cf35 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1f52b726-e2e1-433f-ac06-f3e510a6cf35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:01.693640 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:01.694643 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:01.695554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:01.695554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:01.695554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:01.697656 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 418/829] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:01.699507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52b726-e2e1-433f-ac06-f3e510a6cf35 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:01.727717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1197812-540e-451c-8bb7-4fd46f51f87d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:01.746019 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:01.767010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3744a-8818-4587-b410-2b185bc901e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:01.767628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3744a-8818-4587-b410-2b185bc901e8 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:01.767911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3744a-8818-4587-b410-2b185bc901e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:01.768185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3744a-8818-4587-b410-2b185bc901e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:01.779343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3744a-8818-4587-b410-2b185bc901e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-99d3744a-8818-4587-b410-2b185bc901e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:01.784785 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:01.785699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:01.786537 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 412/830] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:46:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:01.787341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3744a-8818-4587-b410-2b185bc901e8 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:01.809258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52b726-e2e1-433f-ac06-f3e510a6cf35 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:01.845056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b569-68d8-4d5d-8569-46b059b35dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:01.845959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b569-68d8-4d5d-8569-46b059b35dc5 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:01.846379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b569-68d8-4d5d-8569-46b059b35dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:01.846865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b569-68d8-4d5d-8569-46b059b35dc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:01.847749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6b569-68d8-4d5d-8569-46b059b35dc5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:01.848137 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:01.849436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6b569-68d8-4d5d-8569-46b059b35dc5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:01.879057 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 419/831] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 00:46:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:46:01.880327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b569-68d8-4d5d-8569-46b059b35dc5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:01.898383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3744a-8818-4587-b410-2b185bc901e8 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:01.946879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5ae8f-6060-41ac-bad8-bffbe778d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:01.946879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ae8f-6060-41ac-bad8-bffbe778d160 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:01.946879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ae8f-6060-41ac-bad8-bffbe778d160 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:01.946879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ae8f-6060-41ac-bad8-bffbe778d160 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:01.947320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5ae8f-6060-41ac-bad8-bffbe778d160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:01.947320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5ae8f-6060-41ac-bad8-bffbe778d160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:01.947320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5ae8f-6060-41ac-bad8-bffbe778d160 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:01.972784 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 413/832] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:01.974144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5ae8f-6060-41ac-bad8-bffbe778d160 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:02.100892 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:02.109816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b569-68d8-4d5d-8569-46b059b35dc5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:02.152756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5ae8f-6060-41ac-bad8-bffbe778d160 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:02.152954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306b0eb-1ec6-4b41-9208-6e051f8b8806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:02.153317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306b0eb-1ec6-4b41-9208-6e051f8b8806 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:02.153595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306b0eb-1ec6-4b41-9208-6e051f8b8806 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:02.153864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306b0eb-1ec6-4b41-9208-6e051f8b8806 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:02.154523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306b0eb-1ec6-4b41-9208-6e051f8b8806 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:02.154850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306b0eb-1ec6-4b41-9208-6e051f8b8806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:02.156211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306b0eb-1ec6-4b41-9208-6e051f8b8806 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:02.164531 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 420/833] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:46:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:02.165712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712b770-5a72-48bf-a4cd-87654113ded5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:02.165995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712b770-5a72-48bf-a4cd-87654113ded5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:02.166267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712b770-5a72-48bf-a4cd-87654113ded5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:02.168254 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 421/834] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:02.168564 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:02.173433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712b770-5a72-48bf-a4cd-87654113ded5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:02.197135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e6db2-e2fd-4298-acb5-ea4deccabc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:02.198579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e6db2-e2fd-4298-acb5-ea4deccabc38 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:02.198887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e6db2-e2fd-4298-acb5-ea4deccabc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:02.199157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e6db2-e2fd-4298-acb5-ea4deccabc38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:02.207937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e6db2-e2fd-4298-acb5-ea4deccabc38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:02.209383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e6db2-e2fd-4298-acb5-ea4deccabc38 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-e69e6db2-e2fd-4298-acb5-ea4deccabc38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:02.222340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:02.223319 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:02.224245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:02.224245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:02.224245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:02.224245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:02.224245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:02.224245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:02.224245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:02.224245 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:02.224245 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 414/835] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:02.225198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544f6c2-d431-49cc-9816-18e4a2655cb1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:02.225198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544f6c2-d431-49cc-9816-18e4a2655cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:02.226628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544f6c2-d431-49cc-9816-18e4a2655cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:02.245314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5544f6c2-d431-49cc-9816-18e4a2655cb1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:02.246809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5544f6c2-d431-49cc-9816-18e4a2655cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:02.288285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712b770-5a72-48bf-a4cd-87654113ded5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:02.324531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54605c01-7bdb-412e-8006-8be7d43fec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:02.325158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54605c01-7bdb-412e-8006-8be7d43fec37 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:02.325434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54605c01-7bdb-412e-8006-8be7d43fec37 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:02.325702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54605c01-7bdb-412e-8006-8be7d43fec37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:02.327509 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 415/836] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:02.328346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544f6c2-d431-49cc-9816-18e4a2655cb1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:02.347663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54605c01-7bdb-412e-8006-8be7d43fec37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:02.349717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54605c01-7bdb-412e-8006-8be7d43fec37 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-54605c01-7bdb-412e-8006-8be7d43fec37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:02.372923 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:02.374108 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:02.375243 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:02.375243 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:02.375243 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:02.375959 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 422/837] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:02.381313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54605c01-7bdb-412e-8006-8be7d43fec37 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:02.399879 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:02.453788 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:02.457561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544f6c2-d431-49cc-9816-18e4a2655cb1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:02.496801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f56133-21d0-4d8b-9799-f19179046068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:02.497639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f56133-21d0-4d8b-9799-f19179046068 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:02.497925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f56133-21d0-4d8b-9799-f19179046068 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:02.498194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f56133-21d0-4d8b-9799-f19179046068 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:02.499342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f56133-21d0-4d8b-9799-f19179046068 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:02.499658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f56133-21d0-4d8b-9799-f19179046068 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:02.501347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f56133-21d0-4d8b-9799-f19179046068 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:02.506162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54605c01-7bdb-412e-8006-8be7d43fec37 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:02.515980 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 416/838] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:02.521891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f56133-21d0-4d8b-9799-f19179046068 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:02.558684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb89871-0919-4c74-a76b-7f139ba4ebad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:02.559715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb89871-0919-4c74-a76b-7f139ba4ebad None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:02.560378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb89871-0919-4c74-a76b-7f139ba4ebad None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:02.561791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb89871-0919-4c74-a76b-7f139ba4ebad None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:02.562930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb89871-0919-4c74-a76b-7f139ba4ebad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:02.563514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb89871-0919-4c74-a76b-7f139ba4ebad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:02.565379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb89871-0919-4c74-a76b-7f139ba4ebad None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:02.582927 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 423/839] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:02.587490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb89871-0919-4c74-a76b-7f139ba4ebad None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:02.639847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f56133-21d0-4d8b-9799-f19179046068 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:02.672788 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:02.677642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aff84-8776-427b-94a6-bb9e091a87bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:02.678203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aff84-8776-427b-94a6-bb9e091a87bf None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:02.678480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aff84-8776-427b-94a6-bb9e091a87bf None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:02.678780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aff84-8776-427b-94a6-bb9e091a87bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:02.679507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323aff84-8776-427b-94a6-bb9e091a87bf None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=b85fc7e555f348c3ab6c63ee15f6ceb0) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:02.679998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323aff84-8776-427b-94a6-bb9e091a87bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:02.681351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323aff84-8776-427b-94a6-bb9e091a87bf None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:02.687060 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 417/840] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:02 2022] GET /identity/v3/role_assignments?user.id=b85fc7e555f348c3ab6c63ee15f6ceb0&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:02.687838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aff84-8776-427b-94a6-bb9e091a87bf None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:02.716459 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:02.723107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb89871-0919-4c74-a76b-7f139ba4ebad None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:02.773267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a4ec-258e-44da-b2ee-73b34f638f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:02.774842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a4ec-258e-44da-b2ee-73b34f638f2a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:02.775323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a4ec-258e-44da-b2ee-73b34f638f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:02.775796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a4ec-258e-44da-b2ee-73b34f638f2a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:02.786542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5a4ec-258e-44da-b2ee-73b34f638f2a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:02.788958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5a4ec-258e-44da-b2ee-73b34f638f2a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:02.803619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aff84-8776-427b-94a6-bb9e091a87bf None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f8d5a4ec-258e-44da-b2ee-73b34f638f2a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:02.808075 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:02.809123 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:02.810156 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:02.810156 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:02.810156 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:02.810156 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:02.810156 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:02.810156 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:02.810156 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:02.810156 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:02.810156 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:46:02.810156 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:02.813632 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 424/841] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 2 00:46:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:02.819060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a4ec-258e-44da-b2ee-73b34f638f2a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:02.846873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9f6a2-7b6f-45dd-b2d8-bb0e1bb3ce35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:02.847630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f6a2-7b6f-45dd-b2d8-bb0e1bb3ce35 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:02.847973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f6a2-7b6f-45dd-b2d8-bb0e1bb3ce35 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:02.848368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f6a2-7b6f-45dd-b2d8-bb0e1bb3ce35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:02.866031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9f6a2-7b6f-45dd-b2d8-bb0e1bb3ce35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-2ea9f6a2-7b6f-45dd-b2d8-bb0e1bb3ce35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:02.872962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:02.873942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:02.874831 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:02.876323 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 418/842] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:02.881676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9f6a2-7b6f-45dd-b2d8-bb0e1bb3ce35 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:02.946824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a4ec-258e-44da-b2ee-73b34f638f2a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:02.979831 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:02.985435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225ac5b-a8df-4a1f-ad07-76b4068d1e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:02.986043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225ac5b-a8df-4a1f-ad07-76b4068d1e51 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:02.986321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225ac5b-a8df-4a1f-ad07-76b4068d1e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:02.986931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225ac5b-a8df-4a1f-ad07-76b4068d1e51 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:02.987395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225ac5b-a8df-4a1f-ad07-76b4068d1e51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:02.987704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225ac5b-a8df-4a1f-ad07-76b4068d1e51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:02.989122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225ac5b-a8df-4a1f-ad07-76b4068d1e51 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:02.989878 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:03.007170 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 425/843] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 2 00:46:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:03.008192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fdddc-3f73-4e55-8d97-60c795a46fa8 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.008480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fdddc-3f73-4e55-8d97-60c795a46fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.008750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fdddc-3f73-4e55-8d97-60c795a46fa8 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.010121 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 426/844] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:03.012412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9f6a2-7b6f-45dd-b2d8-bb0e1bb3ce35 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:03.014005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fdddc-3f73-4e55-8d97-60c795a46fa8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:03.049679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd0a18-7d84-4c3f-bfbb-5628f276b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:03.050308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0a18-7d84-4c3f-bfbb-5628f276b03f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.050584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0a18-7d84-4c3f-bfbb-5628f276b03f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.050880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0a18-7d84-4c3f-bfbb-5628f276b03f None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.051536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd0a18-7d84-4c3f-bfbb-5628f276b03f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:03.051834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd0a18-7d84-4c3f-bfbb-5628f276b03f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:03.053183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd0a18-7d84-4c3f-bfbb-5628f276b03f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:03.066913 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 419/845] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:03.068077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433fca-ed6c-4ca4-bc8c-f2801a5234ea None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.068360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433fca-ed6c-4ca4-bc8c-f2801a5234ea None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.068632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433fca-ed6c-4ca4-bc8c-f2801a5234ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.087446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-44433fca-ed6c-4ca4-bc8c-f2801a5234ea None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:03.089281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-44433fca-ed6c-4ca4-bc8c-f2801a5234ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:03.120517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fdddc-3f73-4e55-8d97-60c795a46fa8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:03.155049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f979763-b59e-4b24-83e9-973a92a35d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:03.155914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f979763-b59e-4b24-83e9-973a92a35d49 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.156346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f979763-b59e-4b24-83e9-973a92a35d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.156618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f979763-b59e-4b24-83e9-973a92a35d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.174509 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 420/846] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:03.175788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44433fca-ed6c-4ca4-bc8c-f2801a5234ea None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:03.226043 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:03.242746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f979763-b59e-4b24-83e9-973a92a35d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:03.244611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f979763-b59e-4b24-83e9-973a92a35d49 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:03.270437 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:03.295385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44433fca-ed6c-4ca4-bc8c-f2801a5234ea None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:03.329618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da259a3-f140-4ce0-a92c-095928636496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:03.330246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da259a3-f140-4ce0-a92c-095928636496 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.330521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da259a3-f140-4ce0-a92c-095928636496 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.330820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da259a3-f140-4ce0-a92c-095928636496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.343794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da259a3-f140-4ce0-a92c-095928636496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:03.345231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da259a3-f140-4ce0-a92c-095928636496 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-4da259a3-f140-4ce0-a92c-095928636496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:03.360992 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:03.361983 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:03.362892 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:03.362892 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:03.362892 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:03.366796 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 421/847] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:03.367608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da259a3-f140-4ce0-a92c-095928636496 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:03.385971 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 427/848] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:46:03.391905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f979763-b59e-4b24-83e9-973a92a35d49 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:03.480097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da259a3-f140-4ce0-a92c-095928636496 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:03.507902 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:03.509581 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:03.519728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f92914-f157-4c59-b26f-0211ca1b804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:03.520278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f979763-b59e-4b24-83e9-973a92a35d49 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:03.520392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92914-f157-4c59-b26f-0211ca1b804c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.520598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92914-f157-4c59-b26f-0211ca1b804c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.520860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92914-f157-4c59-b26f-0211ca1b804c None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.521495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f92914-f157-4c59-b26f-0211ca1b804c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:03.521804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f92914-f157-4c59-b26f-0211ca1b804c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:03.523209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f92914-f157-4c59-b26f-0211ca1b804c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:03.540890 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 422/849] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:03.540890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f92914-f157-4c59-b26f-0211ca1b804c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:03.560104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19834712-37a3-43fa-990b-4f3e206096b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:03.560739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19834712-37a3-43fa-990b-4f3e206096b8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.561014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19834712-37a3-43fa-990b-4f3e206096b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.561281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19834712-37a3-43fa-990b-4f3e206096b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.571331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19834712-37a3-43fa-990b-4f3e206096b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:03.572761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19834712-37a3-43fa-990b-4f3e206096b8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-19834712-37a3-43fa-990b-4f3e206096b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:03.587870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:03.595037 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:03.596239 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:03.596239 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:03.596239 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:03.596239 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 428/850] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:03.596239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19834712-37a3-43fa-990b-4f3e206096b8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:03.656168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f92914-f157-4c59-b26f-0211ca1b804c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:03.691593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3a45f-e736-4b20-93a3-1bf0f17e6486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:03.692211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3a45f-e736-4b20-93a3-1bf0f17e6486 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.692490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3a45f-e736-4b20-93a3-1bf0f17e6486 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.692761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3a45f-e736-4b20-93a3-1bf0f17e6486 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.693333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3a45f-e736-4b20-93a3-1bf0f17e6486 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:03.694718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3a45f-e736-4b20-93a3-1bf0f17e6486 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-09c3a45f-e736-4b20-93a3-1bf0f17e6486 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:03.703748 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:03.704723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:03.705664 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 423/851] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:46:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:03.706473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3a45f-e736-4b20-93a3-1bf0f17e6486 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:03.718492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19834712-37a3-43fa-990b-4f3e206096b8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:03.751796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23078fc-46e6-4ff4-9e37-3bfc93016639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:03.752345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23078fc-46e6-4ff4-9e37-3bfc93016639 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.752621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23078fc-46e6-4ff4-9e37-3bfc93016639 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.752889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23078fc-46e6-4ff4-9e37-3bfc93016639 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.760125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23078fc-46e6-4ff4-9e37-3bfc93016639 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:03.762076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23078fc-46e6-4ff4-9e37-3bfc93016639 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:03.765186 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c23078fc-46e6-4ff4-9e37-3bfc93016639 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:03.773511 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:03.774463 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 429/852] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:46:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:03.775479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23078fc-46e6-4ff4-9e37-3bfc93016639 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:03.782036 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:03.822251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3a45f-e736-4b20-93a3-1bf0f17e6486 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:03.860331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f562c4-d7a5-4862-a862-9c0d47064f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:03.860936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f562c4-d7a5-4862-a862-9c0d47064f8c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.861218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f562c4-d7a5-4862-a862-9c0d47064f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.861492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f562c4-d7a5-4862-a862-9c0d47064f8c None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.862136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f562c4-d7a5-4862-a862-9c0d47064f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:03.862441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f562c4-d7a5-4862-a862-9c0d47064f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:03.863829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f562c4-d7a5-4862-a862-9c0d47064f8c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:03.881183 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 424/853] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:03.881183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f562c4-d7a5-4862-a862-9c0d47064f8c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:03.887007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23078fc-46e6-4ff4-9e37-3bfc93016639 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:03.922201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33b351-c82b-4185-b312-b96b49203605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:03.923262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33b351-c82b-4185-b312-b96b49203605 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:03.923546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33b351-c82b-4185-b312-b96b49203605 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:03.923823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33b351-c82b-4185-b312-b96b49203605 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:03.924455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33b351-c82b-4185-b312-b96b49203605 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:03.925109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33b351-c82b-4185-b312-b96b49203605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:03.926824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33b351-c82b-4185-b312-b96b49203605 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:03.931325 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 430/854] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:46:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:03.932083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33b351-c82b-4185-b312-b96b49203605 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:03.998270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f562c4-d7a5-4862-a862-9c0d47064f8c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:04.003911 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:04.012584 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:04.035395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eada71-d980-4afa-9a5b-877674ca25a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:04.036111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eada71-d980-4afa-9a5b-877674ca25a1 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.036393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eada71-d980-4afa-9a5b-877674ca25a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.036661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eada71-d980-4afa-9a5b-877674ca25a1 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.037378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eada71-d980-4afa-9a5b-877674ca25a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:04.037928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eada71-d980-4afa-9a5b-877674ca25a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:04.039120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eada71-d980-4afa-9a5b-877674ca25a1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:04.043903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33b351-c82b-4185-b312-b96b49203605 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:04.058083 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 425/855] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 2 00:46:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:04.059353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eada71-d980-4afa-9a5b-877674ca25a1 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:04.081272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c53cab-b5f8-4761-99f6-82fec9f5cbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:04.081895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c53cab-b5f8-4761-99f6-82fec9f5cbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.082169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c53cab-b5f8-4761-99f6-82fec9f5cbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.082441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c53cab-b5f8-4761-99f6-82fec9f5cbe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.089959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c53cab-b5f8-4761-99f6-82fec9f5cbe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:04.091450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c53cab-b5f8-4761-99f6-82fec9f5cbe8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-24c53cab-b5f8-4761-99f6-82fec9f5cbe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:04.102569 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:04.103551 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:04.104993 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:04.104993 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:04.104993 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:04.104993 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:04.104993 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:04.104993 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:04.104993 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:04.104993 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:04.104993 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 431/856] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:04.105506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c53cab-b5f8-4761-99f6-82fec9f5cbe8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:04.176032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eada71-d980-4afa-9a5b-877674ca25a1 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:04.209202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c53cab-b5f8-4761-99f6-82fec9f5cbe8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:04.213001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8e22b-ea7a-4a4e-bb21-cf9dd00cf39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:04.213647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e22b-ea7a-4a4e-bb21-cf9dd00cf39c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.214504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e22b-ea7a-4a4e-bb21-cf9dd00cf39c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.214827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e22b-ea7a-4a4e-bb21-cf9dd00cf39c None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.215591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8e22b-ea7a-4a4e-bb21-cf9dd00cf39c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:04.215904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8e22b-ea7a-4a4e-bb21-cf9dd00cf39c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:04.217369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8e22b-ea7a-4a4e-bb21-cf9dd00cf39c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:04.230933 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 426/857] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:46:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:04.230933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8e22b-ea7a-4a4e-bb21-cf9dd00cf39c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:04.245993 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:04.256940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852dac7-5eeb-4d78-aa00-51eede08d9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:04.257622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852dac7-5eeb-4d78-aa00-51eede08d9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.257973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852dac7-5eeb-4d78-aa00-51eede08d9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.258336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852dac7-5eeb-4d78-aa00-51eede08d9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.270240 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:04.353529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852dac7-5eeb-4d78-aa00-51eede08d9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:04.355236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852dac7-5eeb-4d78-aa00-51eede08d9f8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:04.361437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8e22b-ea7a-4a4e-bb21-cf9dd00cf39c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:04.419603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfce17b-1db6-4f88-a0df-dd74615b4d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:04.420541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfce17b-1db6-4f88-a0df-dd74615b4d7f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.420724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfce17b-1db6-4f88-a0df-dd74615b4d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.420993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfce17b-1db6-4f88-a0df-dd74615b4d7f None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.421685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfce17b-1db6-4f88-a0df-dd74615b4d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:04.421991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfce17b-1db6-4f88-a0df-dd74615b4d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:04.423458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfce17b-1db6-4f88-a0df-dd74615b4d7f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:04.436098 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 427/858] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:04.442247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfce17b-1db6-4f88-a0df-dd74615b4d7f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:04.487013 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 432/859] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:46:04.488243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852dac7-5eeb-4d78-aa00-51eede08d9f8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:04.523390 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:04.573631 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:04.582560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfce17b-1db6-4f88-a0df-dd74615b4d7f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:04.619968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852dac7-5eeb-4d78-aa00-51eede08d9f8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:04.627395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf18cc2-f9df-4e9b-8ab2-c69f40ae5c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:04.628207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18cc2-f9df-4e9b-8ab2-c69f40ae5c30 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.628792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18cc2-f9df-4e9b-8ab2-c69f40ae5c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.629074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18cc2-f9df-4e9b-8ab2-c69f40ae5c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.629825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf18cc2-f9df-4e9b-8ab2-c69f40ae5c30 None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=80a8390c507240e893e1fd82b2490df3) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:04.630136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf18cc2-f9df-4e9b-8ab2-c69f40ae5c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:04.631692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf18cc2-f9df-4e9b-8ab2-c69f40ae5c30 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:04.639366 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 428/860] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:04 2022] GET /identity/v3/role_assignments?user.id=80a8390c507240e893e1fd82b2490df3&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:04.665080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39e60f-707c-4e1e-8611-91d612976961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:04.666104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39e60f-707c-4e1e-8611-91d612976961 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.666585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39e60f-707c-4e1e-8611-91d612976961 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.667694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39e60f-707c-4e1e-8611-91d612976961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.680520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39e60f-707c-4e1e-8611-91d612976961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:04.682437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39e60f-707c-4e1e-8611-91d612976961 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4b39e60f-707c-4e1e-8611-91d612976961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:04.699535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:04.700691 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:04.701599 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:04.701599 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:04.701599 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:04.708536 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 433/861] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:04.710289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf18cc2-f9df-4e9b-8ab2-c69f40ae5c30 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:04.824977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf18cc2-f9df-4e9b-8ab2-c69f40ae5c30 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:04.863973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be51f2-5438-4a8e-b0cd-993e88b18c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:04.864591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be51f2-5438-4a8e-b0cd-993e88b18c6d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.864871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be51f2-5438-4a8e-b0cd-993e88b18c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.865142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be51f2-5438-4a8e-b0cd-993e88b18c6d None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.865796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be51f2-5438-4a8e-b0cd-993e88b18c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:04.866098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be51f2-5438-4a8e-b0cd-993e88b18c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:04.867513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be51f2-5438-4a8e-b0cd-993e88b18c6d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:04.881010 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 429/862] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:04.886592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39e60f-707c-4e1e-8611-91d612976961 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:04.957413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bf176-298c-4e14-a8ce-7e2e7a6ee5c7 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.957692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bf176-298c-4e14-a8ce-7e2e7a6ee5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.957962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bf176-298c-4e14-a8ce-7e2e7a6ee5c7 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.959613 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 430/863] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:04.968566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1d7b3-d3d1-48f1-971b-deb889441c25 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:04.968840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1d7b3-d3d1-48f1-971b-deb889441c25 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:04.969107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1d7b3-d3d1-48f1-971b-deb889441c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:04.985410 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:04.991242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-20b1d7b3-d3d1-48f1-971b-deb889441c25 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:04.992429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-20b1d7b3-d3d1-48f1-971b-deb889441c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:05.010314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39e60f-707c-4e1e-8611-91d612976961 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:05.019964 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:05.055816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e17d8-09df-405c-ab61-9c062671a4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:05.056861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e17d8-09df-405c-ab61-9c062671a4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:05.057148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e17d8-09df-405c-ab61-9c062671a4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:05.057486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e17d8-09df-405c-ab61-9c062671a4d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:05.066587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e17d8-09df-405c-ab61-9c062671a4d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:05.068834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e17d8-09df-405c-ab61-9c062671a4d9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:05.076213 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 431/864] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0d2e17d8-09df-405c-ab61-9c062671a4d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:05.084265 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:05.085210 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:05.086119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:05.086119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:05.086119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:05.086119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:05.086119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:05.086119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:05.086119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:05.086119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:05.090479 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 434/865] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:05.091712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1d7b3-d3d1-48f1-971b-deb889441c25 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:05.199664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1d7b3-d3d1-48f1-971b-deb889441c25 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:05.238069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379161d8-8b96-4b6d-8dd8-83beac346d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:05.238695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379161d8-8b96-4b6d-8dd8-83beac346d7f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:05.239027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379161d8-8b96-4b6d-8dd8-83beac346d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:05.239303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379161d8-8b96-4b6d-8dd8-83beac346d7f None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:05.239993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379161d8-8b96-4b6d-8dd8-83beac346d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:05.240300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379161d8-8b96-4b6d-8dd8-83beac346d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:05.241722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379161d8-8b96-4b6d-8dd8-83beac346d7f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:05.258734 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 432/866] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:05.260731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e17d8-09df-405c-ab61-9c062671a4d9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:05.364081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379161d8-8b96-4b6d-8dd8-83beac346d7f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:05.364267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e17d8-09df-405c-ab61-9c062671a4d9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:05.375609 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:05.415629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ad28a-0553-4eb9-9dd0-05b8c810da92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:05.417369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ad28a-0553-4eb9-9dd0-05b8c810da92 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:05.417685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ad28a-0553-4eb9-9dd0-05b8c810da92 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:05.418074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ad28a-0553-4eb9-9dd0-05b8c810da92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:05.418850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ad28a-0553-4eb9-9dd0-05b8c810da92 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=a0fa4948f9b546dea031acfc0f3e3d95) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:05.419159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ad28a-0553-4eb9-9dd0-05b8c810da92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:05.421380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ad28a-0553-4eb9-9dd0-05b8c810da92 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:05.431339 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 435/867] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:05 2022] GET /identity/v3/role_assignments?user.id=a0fa4948f9b546dea031acfc0f3e3d95&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:05.491868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379161d8-8b96-4b6d-8dd8-83beac346d7f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:05.532234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30f410-611c-4dcf-a62d-c15aa35685b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:05.533174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30f410-611c-4dcf-a62d-c15aa35685b9 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:05.533653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30f410-611c-4dcf-a62d-c15aa35685b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:05.534081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30f410-611c-4dcf-a62d-c15aa35685b9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:05.534868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30f410-611c-4dcf-a62d-c15aa35685b9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:05.536648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30f410-611c-4dcf-a62d-c15aa35685b9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-cd30f410-611c-4dcf-a62d-c15aa35685b9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:05.547595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:05.548885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:46:05.550078 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:05.552207 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 433/868] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 2 00:46:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:05.561717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ad28a-0553-4eb9-9dd0-05b8c810da92 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:05.561717 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:05.678416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ad28a-0553-4eb9-9dd0-05b8c810da92 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:05.715705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8305fc-88de-423b-ba55-4f855789526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:05.716681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8305fc-88de-423b-ba55-4f855789526e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:05.717181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8305fc-88de-423b-ba55-4f855789526e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:05.717690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8305fc-88de-423b-ba55-4f855789526e None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:05.718530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8305fc-88de-423b-ba55-4f855789526e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:05.719073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8305fc-88de-423b-ba55-4f855789526e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:05.720649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8305fc-88de-423b-ba55-4f855789526e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:05.726393 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 436/869] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 2 00:46:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:05.732614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30f410-611c-4dcf-a62d-c15aa35685b9 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:05.809655 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:05.839374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30f410-611c-4dcf-a62d-c15aa35685b9 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:05.877109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ee85c-168a-4407-929d-cf35b5b67c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:05.877722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee85c-168a-4407-929d-cf35b5b67c74 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:05.877999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee85c-168a-4407-929d-cf35b5b67c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:05.878271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee85c-168a-4407-929d-cf35b5b67c74 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:05.878924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ee85c-168a-4407-929d-cf35b5b67c74 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:05.879233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ee85c-168a-4407-929d-cf35b5b67c74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:05.880577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ee85c-168a-4407-929d-cf35b5b67c74 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:05.885108 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 434/870] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 2 00:46:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:06.544395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c825f-5fba-4607-adda-46210af45c8e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:06.544756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c825f-5fba-4607-adda-46210af45c8e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:06.544939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c825f-5fba-4607-adda-46210af45c8e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:06.546674 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 437/871] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:06.552034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b2815-7af1-4e83-9391-e62f782f3b55 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:06.552324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b2815-7af1-4e83-9391-e62f782f3b55 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:06.552599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b2815-7af1-4e83-9391-e62f782f3b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:06.570815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-101b2815-7af1-4e83-9391-e62f782f3b55 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:06.571990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-101b2815-7af1-4e83-9391-e62f782f3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:06.641357 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 435/872] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:06.910913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c825f-5fba-4607-adda-46210af45c8e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:06.989951 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:07.033049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c825f-5fba-4607-adda-46210af45c8e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:07.068191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024f1e3-343d-4fbc-8fa7-9cd52ba8288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:07.069089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f1e3-343d-4fbc-8fa7-9cd52ba8288b None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:07.069525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f1e3-343d-4fbc-8fa7-9cd52ba8288b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:07.069953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f1e3-343d-4fbc-8fa7-9cd52ba8288b None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:07.070787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024f1e3-343d-4fbc-8fa7-9cd52ba8288b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:07.072396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024f1e3-343d-4fbc-8fa7-9cd52ba8288b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:07.090250 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 438/873] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:46:06 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:46:07.098210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce6f25-305e-4d13-932d-3c7780827061 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:07.098781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce6f25-305e-4d13-932d-3c7780827061 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:07.098781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce6f25-305e-4d13-932d-3c7780827061 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:07.100450 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 436/874] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:07.106788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc998-c639-4481-864a-2e8eb63eb9dc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:07.107492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc998-c639-4481-864a-2e8eb63eb9dc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:07.107936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc998-c639-4481-864a-2e8eb63eb9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:07.129727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a12cc998-c639-4481-864a-2e8eb63eb9dc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:07.131351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a12cc998-c639-4481-864a-2e8eb63eb9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:07.220457 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 439/875] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:07.493291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce6f25-305e-4d13-932d-3c7780827061 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:07.562562 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:07.599289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce6f25-305e-4d13-932d-3c7780827061 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:07.643376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e87d5-e48c-4ec2-a238-ebe9192f0b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:07.644037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e87d5-e48c-4ec2-a238-ebe9192f0b6c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:07.644320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e87d5-e48c-4ec2-a238-ebe9192f0b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:07.644587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e87d5-e48c-4ec2-a238-ebe9192f0b6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:07.657870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e87d5-e48c-4ec2-a238-ebe9192f0b6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-195e87d5-e48c-4ec2-a238-ebe9192f0b6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:07.665342 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:07.666407 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:07.668060 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:07.668745 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 437/876] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 2 00:46:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:07.675664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cc998-c639-4481-864a-2e8eb63eb9dc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:07.735223 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:07.760431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ca902-cd4e-4521-ab44-4feced4d3e33 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:07.760627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ca902-cd4e-4521-ab44-4feced4d3e33 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:07.760892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ca902-cd4e-4521-ab44-4feced4d3e33 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:07.763216 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 438/877] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:07.769372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c618e61-2326-4866-9e8a-a16f8387a8c6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:07.769806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c618e61-2326-4866-9e8a-a16f8387a8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:07.770253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c618e61-2326-4866-9e8a-a16f8387a8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:07.795889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1c618e61-2326-4866-9e8a-a16f8387a8c6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:07.797094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1c618e61-2326-4866-9e8a-a16f8387a8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:07.798133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cc998-c639-4481-864a-2e8eb63eb9dc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:07.841753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803612a-c2cb-4ddd-bb13-0e76b78c0011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:07.842774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803612a-c2cb-4ddd-bb13-0e76b78c0011 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:07.843259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803612a-c2cb-4ddd-bb13-0e76b78c0011 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:07.844205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803612a-c2cb-4ddd-bb13-0e76b78c0011 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:07.845089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803612a-c2cb-4ddd-bb13-0e76b78c0011 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:07.845957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803612a-c2cb-4ddd-bb13-0e76b78c0011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:07.848250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803612a-c2cb-4ddd-bb13-0e76b78c0011 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:07.859862 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 440/878] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 2 00:46:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:07.865260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803612a-c2cb-4ddd-bb13-0e76b78c0011 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:07.878643 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 439/879] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:07.984105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803612a-c2cb-4ddd-bb13-0e76b78c0011 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:07.999039 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:08.028665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14b1b1-eb13-40cc-ad36-4515791f5474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:08.029518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14b1b1-eb13-40cc-ad36-4515791f5474 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:08.029932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14b1b1-eb13-40cc-ad36-4515791f5474 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:08.030333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14b1b1-eb13-40cc-ad36-4515791f5474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:08.048967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14b1b1-eb13-40cc-ad36-4515791f5474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:08.050556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14b1b1-eb13-40cc-ad36-4515791f5474 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4a14b1b1-eb13-40cc-ad36-4515791f5474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:08.072072 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:08.074357 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:08.075299 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:08.075299 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:08.075299 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:08.077433 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 441/880] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:08.083677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c618e61-2326-4866-9e8a-a16f8387a8c6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:08.134640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76acf99-2b7c-4af2-9467-d667e0831740 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:08.134640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76acf99-2b7c-4af2-9467-d667e0831740 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:08.134640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76acf99-2b7c-4af2-9467-d667e0831740 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:08.135915 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 442/881] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:08.141055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508ea43-8774-43a0-bb8d-9809d91c3184 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:08.141547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508ea43-8774-43a0-bb8d-9809d91c3184 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:08.141923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508ea43-8774-43a0-bb8d-9809d91c3184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:08.145323 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:08.163077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4508ea43-8774-43a0-bb8d-9809d91c3184 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:08.164398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4508ea43-8774-43a0-bb8d-9809d91c3184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:08.205965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c618e61-2326-4866-9e8a-a16f8387a8c6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:08.236460 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 443/882] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:08.237294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508ea43-8774-43a0-bb8d-9809d91c3184 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:08.250481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b547e-902a-4f23-a3c4-4bca9cdd2f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:08.251652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b547e-902a-4f23-a3c4-4bca9cdd2f91 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:08.252625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b547e-902a-4f23-a3c4-4bca9cdd2f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:08.253374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b547e-902a-4f23-a3c4-4bca9cdd2f91 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:08.254205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b547e-902a-4f23-a3c4-4bca9cdd2f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:08.254779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b547e-902a-4f23-a3c4-4bca9cdd2f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:08.256433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b547e-902a-4f23-a3c4-4bca9cdd2f91 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:08.271920 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 440/883] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:08.278809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b547e-902a-4f23-a3c4-4bca9cdd2f91 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:08.346088 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:08.354857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508ea43-8774-43a0-bb8d-9809d91c3184 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:08.397030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b547e-902a-4f23-a3c4-4bca9cdd2f91 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:08.403707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6b95b-775c-424a-b8aa-e5181e346847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:08.404424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6b95b-775c-424a-b8aa-e5181e346847 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:08.404776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6b95b-775c-424a-b8aa-e5181e346847 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:08.405117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6b95b-775c-424a-b8aa-e5181e346847 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:08.405777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6b95b-775c-424a-b8aa-e5181e346847 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:08.407836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6b95b-775c-424a-b8aa-e5181e346847 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-61a6b95b-775c-424a-b8aa-e5181e346847 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:08.419083 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:08.420549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:08.421554 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:08.423302 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:08.424082 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 444/884] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 2 00:46:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:08.429729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6b95b-775c-424a-b8aa-e5181e346847 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:08.451318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd12363-c8b6-44a6-9ae6-9a050c43abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:08.452719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12363-c8b6-44a6-9ae6-9a050c43abd4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:08.453238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12363-c8b6-44a6-9ae6-9a050c43abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:08.453716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12363-c8b6-44a6-9ae6-9a050c43abd4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:08.464840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd12363-c8b6-44a6-9ae6-9a050c43abd4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:08.466742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd12363-c8b6-44a6-9ae6-9a050c43abd4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-ddd12363-c8b6-44a6-9ae6-9a050c43abd4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:08.483361 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:08.484468 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:08.485446 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:08.485446 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:08.485446 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:08.485446 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:08.485446 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:08.485446 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:08.485446 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:08.485446 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:08.485446 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:46:08.485446 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:08.485446 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 441/885] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 2 00:46:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:08.494639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd12363-c8b6-44a6-9ae6-9a050c43abd4 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:08.547657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6b95b-775c-424a-b8aa-e5181e346847 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:08.582721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2c5b0-d990-45fd-9148-a8544ca58848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:08.583675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2c5b0-d990-45fd-9148-a8544ca58848 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:08.584168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2c5b0-d990-45fd-9148-a8544ca58848 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:08.584686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2c5b0-d990-45fd-9148-a8544ca58848 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:08.585467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2c5b0-d990-45fd-9148-a8544ca58848 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:08.585955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2c5b0-d990-45fd-9148-a8544ca58848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:08.587518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2c5b0-d990-45fd-9148-a8544ca58848 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:08.596711 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 445/886] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 2 00:46:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:08.597502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2c5b0-d990-45fd-9148-a8544ca58848 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:08.599472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd12363-c8b6-44a6-9ae6-9a050c43abd4 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:08.623255 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:08.637993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671155e3-d646-492a-a4a6-ba8127789e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:08.639031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671155e3-d646-492a-a4a6-ba8127789e3e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:08.639313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671155e3-d646-492a-a4a6-ba8127789e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:08.639582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671155e3-d646-492a-a4a6-ba8127789e3e None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:08.640649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671155e3-d646-492a-a4a6-ba8127789e3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:08.640959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671155e3-d646-492a-a4a6-ba8127789e3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:08.642699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671155e3-d646-492a-a4a6-ba8127789e3e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:08.661185 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 442/887] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 2 00:46:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:08.666593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671155e3-d646-492a-a4a6-ba8127789e3e None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:08.704373 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:08.707463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2c5b0-d990-45fd-9148-a8544ca58848 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:08.742306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28d2c6-aa95-42a1-95a1-198426b8130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:08.742943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28d2c6-aa95-42a1-95a1-198426b8130a None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:08.743218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28d2c6-aa95-42a1-95a1-198426b8130a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:08.743487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28d2c6-aa95-42a1-95a1-198426b8130a None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:08.744129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28d2c6-aa95-42a1-95a1-198426b8130a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:08.746078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28d2c6-aa95-42a1-95a1-198426b8130a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:08.761619 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 446/888] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:46:08 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:46:08.761794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28d2c6-aa95-42a1-95a1-198426b8130a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:08.791275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671155e3-d646-492a-a4a6-ba8127789e3e None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:08.847892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf22ce-978d-477b-89a8-f07f48f870dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:08.848692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf22ce-978d-477b-89a8-f07f48f870dc None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:08.848969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf22ce-978d-477b-89a8-f07f48f870dc None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:08.849237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf22ce-978d-477b-89a8-f07f48f870dc None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:08.850157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf22ce-978d-477b-89a8-f07f48f870dc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:08.850821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf22ce-978d-477b-89a8-f07f48f870dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:08.852561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf22ce-978d-477b-89a8-f07f48f870dc None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:08.866860 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 443/889] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 2 00:46:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:08.887136 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:08.909069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28d2c6-aa95-42a1-95a1-198426b8130a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:08.951851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6db6c9-4237-4b9c-bb02-8b98f4c820fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:08.952485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6db6c9-4237-4b9c-bb02-8b98f4c820fa None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:08.952764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6db6c9-4237-4b9c-bb02-8b98f4c820fa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:08.953084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6db6c9-4237-4b9c-bb02-8b98f4c820fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:09.045997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6db6c9-4237-4b9c-bb02-8b98f4c820fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:09.047515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6db6c9-4237-4b9c-bb02-8b98f4c820fa None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:09.165167 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:09.183456 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 447/890] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:08 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:46:09.188800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf22ce-978d-477b-89a8-f07f48f870dc None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:09.286195 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:09.293188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf22ce-978d-477b-89a8-f07f48f870dc None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:09.329160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6806b11-a64b-45b3-80cf-d3adbf07525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:09.329822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6806b11-a64b-45b3-80cf-d3adbf07525c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:09.330097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6806b11-a64b-45b3-80cf-d3adbf07525c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:09.330371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6806b11-a64b-45b3-80cf-d3adbf07525c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:09.343236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6806b11-a64b-45b3-80cf-d3adbf07525c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:09.344736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6806b11-a64b-45b3-80cf-d3adbf07525c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-b6806b11-a64b-45b3-80cf-d3adbf07525c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:09.362081 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:09.363122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:09.364460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:09.364460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:09.364460 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:09.364460 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 444/891] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:09.369250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6db6c9-4237-4b9c-bb02-8b98f4c820fa None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:09.454895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f697-22f3-451e-8dc2-4fec0346943e None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:09.455086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f697-22f3-451e-8dc2-4fec0346943e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:09.455344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f697-22f3-451e-8dc2-4fec0346943e None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:09.456976 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 445/892] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:09.461760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f2429-9e21-4d6b-996e-d26c85e27762 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:09.462040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f2429-9e21-4d6b-996e-d26c85e27762 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:09.462314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f2429-9e21-4d6b-996e-d26c85e27762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:09.482138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6db6c9-4237-4b9c-bb02-8b98f4c820fa None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:09.482344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8e0f2429-9e21-4d6b-996e-d26c85e27762 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:09.483762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8e0f2429-9e21-4d6b-996e-d26c85e27762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:09.527435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12877df-9265-4521-90f9-f99ba0f94f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:09.528206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12877df-9265-4521-90f9-f99ba0f94f3c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:09.528575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12877df-9265-4521-90f9-f99ba0f94f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:09.528938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12877df-9265-4521-90f9-f99ba0f94f3c None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:09.529681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12877df-9265-4521-90f9-f99ba0f94f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:09.530079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12877df-9265-4521-90f9-f99ba0f94f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:09.531630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12877df-9265-4521-90f9-f99ba0f94f3c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:09.544182 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 448/893] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:09.549894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12877df-9265-4521-90f9-f99ba0f94f3c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:09.563571 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 446/894] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:09.601654 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:09.659867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12877df-9265-4521-90f9-f99ba0f94f3c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:09.695351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e24a2-31ab-4dd9-b1a9-60891c300ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:09.695986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e24a2-31ab-4dd9-b1a9-60891c300ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:09.696264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e24a2-31ab-4dd9-b1a9-60891c300ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:09.696535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e24a2-31ab-4dd9-b1a9-60891c300ad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:09.703751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e24a2-31ab-4dd9-b1a9-60891c300ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:09.705305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e24a2-31ab-4dd9-b1a9-60891c300ad5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-9d4e24a2-31ab-4dd9-b1a9-60891c300ad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:09.716729 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:09.717678 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:09.719053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:09.719053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:09.719053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:09.719053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:09.719053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:09.719053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:09.719053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:09.719053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:09.719053 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 449/895] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:09.723955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f2429-9e21-4d6b-996e-d26c85e27762 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:09.810323 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:09.837625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f2429-9e21-4d6b-996e-d26c85e27762 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:09.844188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e24a2-31ab-4dd9-b1a9-60891c300ad5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:09.876285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919aefe-691b-4142-828b-a9327a14bf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:09.877126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aefe-691b-4142-828b-a9327a14bf57 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:09.877807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aefe-691b-4142-828b-a9327a14bf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:09.878084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aefe-691b-4142-828b-a9327a14bf57 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:09.879070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919aefe-691b-4142-828b-a9327a14bf57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:09.879376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919aefe-691b-4142-828b-a9327a14bf57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:09.880906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919aefe-691b-4142-828b-a9327a14bf57 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:09.894072 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 447/896] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:09.903723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919aefe-691b-4142-828b-a9327a14bf57 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:09.957402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e24a2-31ab-4dd9-b1a9-60891c300ad5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:09.963015 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:10.004999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b77e7-b69d-407c-9457-d8051c1f5f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:10.005734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b77e7-b69d-407c-9457-d8051c1f5f7d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:10.006020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b77e7-b69d-407c-9457-d8051c1f5f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:10.006458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b77e7-b69d-407c-9457-d8051c1f5f7d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:10.007079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b77e7-b69d-407c-9457-d8051c1f5f7d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:10.008447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b77e7-b69d-407c-9457-d8051c1f5f7d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1d2b77e7-b69d-407c-9457-d8051c1f5f7d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:10.017903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:10.018933 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:10.019804 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 450/897] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:46:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:10.031343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919aefe-691b-4142-828b-a9327a14bf57 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:10.031998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b77e7-b69d-407c-9457-d8051c1f5f7d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:10.068665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53294e72-76ed-4dd0-8e45-8a83ffef87b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:10.069262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53294e72-76ed-4dd0-8e45-8a83ffef87b6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:10.069540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53294e72-76ed-4dd0-8e45-8a83ffef87b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:10.069813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53294e72-76ed-4dd0-8e45-8a83ffef87b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:10.070531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53294e72-76ed-4dd0-8e45-8a83ffef87b6 None admin] RBAC: Adding query filter params (role.id=2f1608a8492c45d2a30b227c443cd161, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=80a8390c507240e893e1fd82b2490df3) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:10.070869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53294e72-76ed-4dd0-8e45-8a83ffef87b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:10.072291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53294e72-76ed-4dd0-8e45-8a83ffef87b6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:10.076669 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:10.086432 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 448/898] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:09 2022] GET /identity/v3/role_assignments?user.id=80a8390c507240e893e1fd82b2490df3&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=2f1608a8492c45d2a30b227c443cd161 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:10.153892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b77e7-b69d-407c-9457-d8051c1f5f7d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:10.193472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbd533-f10f-4405-8e9f-e487d9124abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:10.194468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbd533-f10f-4405-8e9f-e487d9124abe None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:10.194980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbd533-f10f-4405-8e9f-e487d9124abe None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:10.195482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbd533-f10f-4405-8e9f-e487d9124abe None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:10.196345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbd533-f10f-4405-8e9f-e487d9124abe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:10.196854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbd533-f10f-4405-8e9f-e487d9124abe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:10.198915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbd533-f10f-4405-8e9f-e487d9124abe None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:10.204793 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 451/899] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:46:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:10.211014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53294e72-76ed-4dd0-8e45-8a83ffef87b6 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:10.320732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53294e72-76ed-4dd0-8e45-8a83ffef87b6 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:10.355209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f90ae9-0c9d-4e18-b23d-9116dcd5fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:10.356159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f90ae9-0c9d-4e18-b23d-9116dcd5fdef None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:10.356646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f90ae9-0c9d-4e18-b23d-9116dcd5fdef None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:10.357151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f90ae9-0c9d-4e18-b23d-9116dcd5fdef None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:10.357980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f90ae9-0c9d-4e18-b23d-9116dcd5fdef None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:10.358485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f90ae9-0c9d-4e18-b23d-9116dcd5fdef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:10.360054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f90ae9-0c9d-4e18-b23d-9116dcd5fdef None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:10.365449 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 449/900] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:46:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:10.372165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbd533-f10f-4405-8e9f-e487d9124abe None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:10.407333 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:10.479870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbd533-f10f-4405-8e9f-e487d9124abe None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:10.515956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2b2a4-f156-409d-91e3-c185a2a897c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:10.516967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2b2a4-f156-409d-91e3-c185a2a897c0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:10.517534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2b2a4-f156-409d-91e3-c185a2a897c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:10.518022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2b2a4-f156-409d-91e3-c185a2a897c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:10.519051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2b2a4-f156-409d-91e3-c185a2a897c0 None admin] RBAC: Adding query filter params (interface=public, service_id=a1d013c07a5b44edb8c92656ef011136, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:10.519577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2b2a4-f156-409d-91e3-c185a2a897c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:10.521148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2b2a4-f156-409d-91e3-c185a2a897c0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:10.527428 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 452/901] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 2 00:46:10 2022] GET /identity/v3/endpoints?service_id=a1d013c07a5b44edb8c92656ef011136&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:10.533333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f90ae9-0c9d-4e18-b23d-9116dcd5fdef None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:10.601400 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:10.645683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f90ae9-0c9d-4e18-b23d-9116dcd5fdef None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:10.686123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f670cd9-8c03-44df-9019-40444c7f452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:10.686767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f670cd9-8c03-44df-9019-40444c7f452c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:10.687047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f670cd9-8c03-44df-9019-40444c7f452c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:10.687404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f670cd9-8c03-44df-9019-40444c7f452c None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:10.688018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f670cd9-8c03-44df-9019-40444c7f452c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:10.689384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f670cd9-8c03-44df-9019-40444c7f452c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:10.695697 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 450/902] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 2 00:46:10 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:46:11.156768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07adee-586c-4146-9fa3-16e2130c2bac None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.157733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07adee-586c-4146-9fa3-16e2130c2bac None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.158203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07adee-586c-4146-9fa3-16e2130c2bac None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.160009 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 453/903] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:11.165416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb5d1a-e7fe-453b-b26b-e7719a818790 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.165966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb5d1a-e7fe-453b-b26b-e7719a818790 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.166435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb5d1a-e7fe-453b-b26b-e7719a818790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.185441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a1bb5d1a-e7fe-453b-b26b-e7719a818790 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:11.187011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1bb5d1a-e7fe-453b-b26b-e7719a818790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:11.197526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614118b-c4f6-4d8c-beb9-9f6c64df1b5e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.198683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614118b-c4f6-4d8c-beb9-9f6c64df1b5e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.199155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614118b-c4f6-4d8c-beb9-9f6c64df1b5e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.200933 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 454/904] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:11.206142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254fc46-999b-4eee-839b-0796a3b0dc1a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.206772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254fc46-999b-4eee-839b-0796a3b0dc1a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.207286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254fc46-999b-4eee-839b-0796a3b0dc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.226870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1254fc46-999b-4eee-839b-0796a3b0dc1a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:11.228356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1254fc46-999b-4eee-839b-0796a3b0dc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:11.264913 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 451/905] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:11.306765 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 455/906] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:11.534933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb5d1a-e7fe-453b-b26b-e7719a818790 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:11.576640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254fc46-999b-4eee-839b-0796a3b0dc1a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:11.594530 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:11.617900 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:11.645836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb5d1a-e7fe-453b-b26b-e7719a818790 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:11.691402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1a4a9-9fab-4fb0-b976-147a5ccb7042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:11.692672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a4a9-9fab-4fb0-b976-147a5ccb7042 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.693260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a4a9-9fab-4fb0-b976-147a5ccb7042 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.693739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a4a9-9fab-4fb0-b976-147a5ccb7042 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.694529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1a4a9-9fab-4fb0-b976-147a5ccb7042 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:11.696321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1a4a9-9fab-4fb0-b976-147a5ccb7042 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:11.703458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254fc46-999b-4eee-839b-0796a3b0dc1a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-c7d1a4a9-9fab-4fb0-b976-147a5ccb7042 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:11.707881 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:11.708997 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:46:11.710092 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:11.716497 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 452/907] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 2 00:46:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:11.719218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1a4a9-9fab-4fb0-b976-147a5ccb7042 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:11.750916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be891ad6-accd-4f99-ba38-36ea4e5e85be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:11.752542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be891ad6-accd-4f99-ba38-36ea4e5e85be None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.753065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be891ad6-accd-4f99-ba38-36ea4e5e85be None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.753755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be891ad6-accd-4f99-ba38-36ea4e5e85be None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.755298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be891ad6-accd-4f99-ba38-36ea4e5e85be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:11.756868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be891ad6-accd-4f99-ba38-36ea4e5e85be None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:11.779405 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 456/908] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:46:11 2022] POST /identity/v3/services => generated 241 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:46:11.848906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1a4a9-9fab-4fb0-b976-147a5ccb7042 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:11.875309 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:11.896189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ebe2c-dc7e-4c34-b9ea-5777e86e2852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:11.896797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ebe2c-dc7e-4c34-b9ea-5777e86e2852 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:11.897074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ebe2c-dc7e-4c34-b9ea-5777e86e2852 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:11.897346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ebe2c-dc7e-4c34-b9ea-5777e86e2852 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:11.897969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ebe2c-dc7e-4c34-b9ea-5777e86e2852 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:11.898272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ebe2c-dc7e-4c34-b9ea-5777e86e2852 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:11.899730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ebe2c-dc7e-4c34-b9ea-5777e86e2852 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:11.905739 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 453/909] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 2 00:46:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:11.911363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be891ad6-accd-4f99-ba38-36ea4e5e85be None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:12.015016 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:12.032744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be891ad6-accd-4f99-ba38-36ea4e5e85be None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:12.069675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df929-d8c8-4fa4-b1a1-0d78d4a52e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:12.070658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df929-d8c8-4fa4-b1a1-0d78d4a52e7d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:12.071207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df929-d8c8-4fa4-b1a1-0d78d4a52e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:12.071761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df929-d8c8-4fa4-b1a1-0d78d4a52e7d None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:12.072598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233df929-d8c8-4fa4-b1a1-0d78d4a52e7d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:12.073146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233df929-d8c8-4fa4-b1a1-0d78d4a52e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:12.074743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233df929-d8c8-4fa4-b1a1-0d78d4a52e7d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:12.080520 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 457/910] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 2 00:46:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:12.086506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ebe2c-dc7e-4c34-b9ea-5777e86e2852 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:12.192265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ebe2c-dc7e-4c34-b9ea-5777e86e2852 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:12.227433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437a310-b326-43f9-a365-4a2b6a3d0907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:12.228031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a310-b326-43f9-a365-4a2b6a3d0907 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:12.228309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a310-b326-43f9-a365-4a2b6a3d0907 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:12.228580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a310-b326-43f9-a365-4a2b6a3d0907 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:12.229457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437a310-b326-43f9-a365-4a2b6a3d0907 None admin] RBAC: Adding query filter params (interface=public, service_id=365536d355ba4f4d82377ca801759a19, region_id=RegionOne) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:12.229862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437a310-b326-43f9-a365-4a2b6a3d0907 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:12.231253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437a310-b326-43f9-a365-4a2b6a3d0907 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:12.237087 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 454/911] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 2 00:46:12 2022] GET /identity/v3/endpoints?service_id=365536d355ba4f4d82377ca801759a19&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:12.242674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df929-d8c8-4fa4-b1a1-0d78d4a52e7d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:12.357278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df929-d8c8-4fa4-b1a1-0d78d4a52e7d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:12.394668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958f625-4142-42f2-820d-b0c139e50088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:12.395276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958f625-4142-42f2-820d-b0c139e50088 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:12.395553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958f625-4142-42f2-820d-b0c139e50088 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:12.395823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958f625-4142-42f2-820d-b0c139e50088 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:12.396486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958f625-4142-42f2-820d-b0c139e50088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:12.397859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958f625-4142-42f2-820d-b0c139e50088 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:12.404633 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 458/912] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 2 00:46:12 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:46:12.420923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c964-6656-4d21-aaf6-3b70c71c000f None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:12.421475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c964-6656-4d21-aaf6-3b70c71c000f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:12.421475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c964-6656-4d21-aaf6-3b70c71c000f None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:12.423188 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 455/913] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:12.428912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba74c47-2ce8-48a8-82ab-50f886c1743e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:12.429232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba74c47-2ce8-48a8-82ab-50f886c1743e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:12.429472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba74c47-2ce8-48a8-82ab-50f886c1743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:12.450020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3ba74c47-2ce8-48a8-82ab-50f886c1743e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:12.451181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3ba74c47-2ce8-48a8-82ab-50f886c1743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:12.462045 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:12.528229 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 459/914] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:12.805721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333c964-6656-4d21-aaf6-3b70c71c000f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:12.858786 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:12.920575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333c964-6656-4d21-aaf6-3b70c71c000f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:12.956920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c75d71-cce3-4eb5-af56-ca3f41b3ee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:12.957555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c75d71-cce3-4eb5-af56-ca3f41b3ee9d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:12.957830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c75d71-cce3-4eb5-af56-ca3f41b3ee9d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:12.958101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c75d71-cce3-4eb5-af56-ca3f41b3ee9d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:12.969476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c75d71-cce3-4eb5-af56-ca3f41b3ee9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-d6c75d71-cce3-4eb5-af56-ca3f41b3ee9d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:12.974306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:12.975251 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:12.976162 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 456/915] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 2 00:46:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:12.981385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba74c47-2ce8-48a8-82ab-50f886c1743e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:12.989984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef065-64d2-4d87-9096-da7fb3e3b0ea None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:12.990281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef065-64d2-4d87-9096-da7fb3e3b0ea None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:12.990558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef065-64d2-4d87-9096-da7fb3e3b0ea None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:12.992176 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 457/916] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:13.000761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b3c8-f50e-45a9-93ee-d8543c02c237 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:13.001058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b3c8-f50e-45a9-93ee-d8543c02c237 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:13.001338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b3c8-f50e-45a9-93ee-d8543c02c237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:13.021642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8951b3c8-f50e-45a9-93ee-d8543c02c237 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:13.022868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8951b3c8-f50e-45a9-93ee-d8543c02c237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:13.086980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba74c47-2ce8-48a8-82ab-50f886c1743e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:13.100562 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 458/917] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:13.129431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f553cb-5294-4d7a-b8a9-ec54505be060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:13.130400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f553cb-5294-4d7a-b8a9-ec54505be060 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:13.130902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f553cb-5294-4d7a-b8a9-ec54505be060 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:13.131394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f553cb-5294-4d7a-b8a9-ec54505be060 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:13.132258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f553cb-5294-4d7a-b8a9-ec54505be060 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:13.132801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f553cb-5294-4d7a-b8a9-ec54505be060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:13.134412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f553cb-5294-4d7a-b8a9-ec54505be060 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:13.144032 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 460/918] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 2 00:46:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:13.149887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951b3c8-f50e-45a9-93ee-d8543c02c237 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:13.187663 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:13.253796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951b3c8-f50e-45a9-93ee-d8543c02c237 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:13.287597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5691a-11d1-4a8e-a19d-e8b52765366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:13.288599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5691a-11d1-4a8e-a19d-e8b52765366d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:13.289112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5691a-11d1-4a8e-a19d-e8b52765366d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:13.289603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5691a-11d1-4a8e-a19d-e8b52765366d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:13.300668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5691a-11d1-4a8e-a19d-e8b52765366d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:13.302345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5691a-11d1-4a8e-a19d-e8b52765366d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-7ce5691a-11d1-4a8e-a19d-e8b52765366d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:13.317939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:13.318972 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:13.319870 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:13.319870 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:13.319870 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:13.321901 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 459/919] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:13.328087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f553cb-5294-4d7a-b8a9-ec54505be060 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:13.341242 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:13.378690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5691a-11d1-4a8e-a19d-e8b52765366d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:13.452763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f553cb-5294-4d7a-b8a9-ec54505be060 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:13.476442 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:13.491097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5691a-11d1-4a8e-a19d-e8b52765366d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:13.491404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5e6d1-6904-4cb8-adc9-3c633f39501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:13.492166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5e6d1-6904-4cb8-adc9-3c633f39501e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:13.492833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5e6d1-6904-4cb8-adc9-3c633f39501e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:13.494118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5e6d1-6904-4cb8-adc9-3c633f39501e None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:13.495677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5e6d1-6904-4cb8-adc9-3c633f39501e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:13.496131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5e6d1-6904-4cb8-adc9-3c633f39501e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:13.497660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5e6d1-6904-4cb8-adc9-3c633f39501e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:13.518462 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 461/920] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:13.519529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5e6d1-6904-4cb8-adc9-3c633f39501e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:13.534899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af985d0-fdcc-4e77-8ced-10ee99ba158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:13.535526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af985d0-fdcc-4e77-8ced-10ee99ba158a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:13.535802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af985d0-fdcc-4e77-8ced-10ee99ba158a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:13.536453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af985d0-fdcc-4e77-8ced-10ee99ba158a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:13.537047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af985d0-fdcc-4e77-8ced-10ee99ba158a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:13.538971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af985d0-fdcc-4e77-8ced-10ee99ba158a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-9af985d0-fdcc-4e77-8ced-10ee99ba158a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:13.550465 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:13.551523 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:13.552367 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 460/921] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:46:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:13.557419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af985d0-fdcc-4e77-8ced-10ee99ba158a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:13.611960 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:13.661856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5e6d1-6904-4cb8-adc9-3c633f39501e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:13.670974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af985d0-fdcc-4e77-8ced-10ee99ba158a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:13.705574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab9346-4fb9-4552-a770-3192eda74e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:13.706287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab9346-4fb9-4552-a770-3192eda74e72 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:13.706568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab9346-4fb9-4552-a770-3192eda74e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:13.706865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab9346-4fb9-4552-a770-3192eda74e72 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:13.707597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab9346-4fb9-4552-a770-3192eda74e72 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:13.707988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab9346-4fb9-4552-a770-3192eda74e72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:13.709379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab9346-4fb9-4552-a770-3192eda74e72 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:13.710242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e384c-f843-452d-a213-751814e6e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:13.711810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e384c-f843-452d-a213-751814e6e569 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:13.712299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e384c-f843-452d-a213-751814e6e569 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:13.712749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e384c-f843-452d-a213-751814e6e569 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:13.715849 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 461/922] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:46:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:13.721096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab9346-4fb9-4552-a770-3192eda74e72 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:13.722046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e384c-f843-452d-a213-751814e6e569 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:13.723631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e384c-f843-452d-a213-751814e6e569 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-663e384c-f843-452d-a213-751814e6e569 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:13.739822 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:13.740852 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:13.741829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:13.741829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:13.741829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:13.741829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:13.741829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:13.741829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:13.741829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:13.741829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:13.741829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:46:13.741829 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:13.746200 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 462/923] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 2 00:46:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:13.747263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e384c-f843-452d-a213-751814e6e569 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:13.749594 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:13.863714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab9346-4fb9-4552-a770-3192eda74e72 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:13.875116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e384c-f843-452d-a213-751814e6e569 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:13.902343 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:13.910536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149769a7-f738-472b-bcd7-ccb313582b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:13.911347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149769a7-f738-472b-bcd7-ccb313582b7c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:13.911631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149769a7-f738-472b-bcd7-ccb313582b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:13.911905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149769a7-f738-472b-bcd7-ccb313582b7c None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:13.912731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149769a7-f738-472b-bcd7-ccb313582b7c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:13.913044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149769a7-f738-472b-bcd7-ccb313582b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:13.914212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d9505-229c-4b80-a87c-838c0e326dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:13.914421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149769a7-f738-472b-bcd7-ccb313582b7c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:13.915302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d9505-229c-4b80-a87c-838c0e326dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:13.915860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d9505-229c-4b80-a87c-838c0e326dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:13.916334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d9505-229c-4b80-a87c-838c0e326dc1 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:13.917812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d9505-229c-4b80-a87c-838c0e326dc1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:13.918342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d9505-229c-4b80-a87c-838c0e326dc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:13.920105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d9505-229c-4b80-a87c-838c0e326dc1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:13.922759 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 462/924] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 2 00:46:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:13.926870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149769a7-f738-472b-bcd7-ccb313582b7c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:13.942432 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 463/925] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 2 00:46:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:13.949613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d9505-229c-4b80-a87c-838c0e326dc1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:14.047519 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:14.074085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d9505-229c-4b80-a87c-838c0e326dc1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:14.074832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149769a7-f738-472b-bcd7-ccb313582b7c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:14.116426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f23f2b-6ad3-40a2-b8eb-74078c107345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:14.117406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f23f2b-6ad3-40a2-b8eb-74078c107345 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.117926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f23f2b-6ad3-40a2-b8eb-74078c107345 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.118347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f23f2b-6ad3-40a2-b8eb-74078c107345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.123890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6025cab-47d0-4c83-bed5-b4d8018d83c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:14.124626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6025cab-47d0-4c83-bed5-b4d8018d83c4 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.125002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6025cab-47d0-4c83-bed5-b4d8018d83c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.125372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6025cab-47d0-4c83-bed5-b4d8018d83c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.126144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6025cab-47d0-4c83-bed5-b4d8018d83c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:14.128232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6025cab-47d0-4c83-bed5-b4d8018d83c4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:14.131371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f23f2b-6ad3-40a2-b8eb-74078c107345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:14.133287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f23f2b-6ad3-40a2-b8eb-74078c107345 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-80f23f2b-6ad3-40a2-b8eb-74078c107345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:14.150198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:14.151512 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:14.152420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:14.152420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:14.152420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:14.154733 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 464/926] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:14.160126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f23f2b-6ad3-40a2-b8eb-74078c107345 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:14.160869 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 463/927] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 00:46:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:46:14.202746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13bf4-119a-452f-8ad7-97fd5c2ddd84 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.203074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13bf4-119a-452f-8ad7-97fd5c2ddd84 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.203297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13bf4-119a-452f-8ad7-97fd5c2ddd84 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.206853 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 464/928] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:14.209970 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:14.211067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc0fe9-8714-4398-9d4d-3c4713a88c01 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.211352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc0fe9-8714-4398-9d4d-3c4713a88c01 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.211627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc0fe9-8714-4398-9d4d-3c4713a88c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.231731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4bdc0fe9-8714-4398-9d4d-3c4713a88c01 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:14.232997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4bdc0fe9-8714-4398-9d4d-3c4713a88c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:14.297577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f23f2b-6ad3-40a2-b8eb-74078c107345 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:14.323354 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 465/929] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:14.339259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330712e6-bef9-4e1c-a7c3-0ffaead1e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:14.340013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330712e6-bef9-4e1c-a7c3-0ffaead1e9ed None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.340184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330712e6-bef9-4e1c-a7c3-0ffaead1e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.340420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330712e6-bef9-4e1c-a7c3-0ffaead1e9ed None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.341073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330712e6-bef9-4e1c-a7c3-0ffaead1e9ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:14.341373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330712e6-bef9-4e1c-a7c3-0ffaead1e9ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:14.342788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330712e6-bef9-4e1c-a7c3-0ffaead1e9ed None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:14.360666 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 465/930] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:14.361919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc0fe9-8714-4398-9d4d-3c4713a88c01 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:14.426966 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:14.469944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc0fe9-8714-4398-9d4d-3c4713a88c01 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:14.507230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2789d34-900f-4827-829f-a56cfae03bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:14.508670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2789d34-900f-4827-829f-a56cfae03bdb None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.509162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2789d34-900f-4827-829f-a56cfae03bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.509715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2789d34-900f-4827-829f-a56cfae03bdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.517185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2789d34-900f-4827-829f-a56cfae03bdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:14.518953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2789d34-900f-4827-829f-a56cfae03bdb None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-e2789d34-900f-4827-829f-a56cfae03bdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:14.531164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:14.532105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:14.533041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:14.533041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:14.533041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:14.533041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:14.533041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:14.533041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:14.533041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:14.533041 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:14.535456 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 466/931] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:14.541309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330712e6-bef9-4e1c-a7c3-0ffaead1e9ed None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:14.592524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2789d34-900f-4827-829f-a56cfae03bdb None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:14.644685 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:14.650500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330712e6-bef9-4e1c-a7c3-0ffaead1e9ed None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:14.688043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa9bb6-a391-4bf7-88e4-df754e5aa61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:14.688570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa9bb6-a391-4bf7-88e4-df754e5aa61e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.688850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa9bb6-a391-4bf7-88e4-df754e5aa61e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.689124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa9bb6-a391-4bf7-88e4-df754e5aa61e None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.689811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa9bb6-a391-4bf7-88e4-df754e5aa61e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:14.690118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa9bb6-a391-4bf7-88e4-df754e5aa61e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:14.691575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa9bb6-a391-4bf7-88e4-df754e5aa61e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:14.703769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2789d34-900f-4827-829f-a56cfae03bdb None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:14.709593 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 466/932] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:14.710953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44506ae-aa41-4734-bf17-f82ab23fd5c1 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.711273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44506ae-aa41-4734-bf17-f82ab23fd5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.711546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44506ae-aa41-4734-bf17-f82ab23fd5c1 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.712793 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 467/933] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:14.713558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44506ae-aa41-4734-bf17-f82ab23fd5c1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:14.732028 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:14.747588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b6998-3972-40c9-9844-33bd96a99ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:14.748528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b6998-3972-40c9-9844-33bd96a99ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.748806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b6998-3972-40c9-9844-33bd96a99ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.749083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b6998-3972-40c9-9844-33bd96a99ef0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.749665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b6998-3972-40c9-9844-33bd96a99ef0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:14.751076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b6998-3972-40c9-9844-33bd96a99ef0 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-c92b6998-3972-40c9-9844-33bd96a99ef0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:14.759981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:14.761011 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:14.761882 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 467/934] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 2 00:46:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:14.762736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dc519-e0a1-4fe3-9b7a-d7c222a23093 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.763328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dc519-e0a1-4fe3-9b7a-d7c222a23093 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.763328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dc519-e0a1-4fe3-9b7a-d7c222a23093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.780972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fc9dc519-e0a1-4fe3-9b7a-d7c222a23093 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:14.782142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fc9dc519-e0a1-4fe3-9b7a-d7c222a23093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:14.837144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44506ae-aa41-4734-bf17-f82ab23fd5c1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:14.852477 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 468/935] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:14.859458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dc519-e0a1-4fe3-9b7a-d7c222a23093 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:14.882577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06ce1a-dae0-4249-b10f-16ee39b22a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:14.883574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06ce1a-dae0-4249-b10f-16ee39b22a2c None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:14.884080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06ce1a-dae0-4249-b10f-16ee39b22a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:14.884575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06ce1a-dae0-4249-b10f-16ee39b22a2c None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/80a8390c507240e893e1fd82b2490df3/roles/2f1608a8492c45d2a30b227c443cd161` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:14.889061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06ce1a-dae0-4249-b10f-16ee39b22a2c None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=80a8390c507240e893e1fd82b2490df3, role_id=2f1608a8492c45d2a30b227c443cd161)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:14.891308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06ce1a-dae0-4249-b10f-16ee39b22a2c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:14.919193 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 468/936] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:46:14 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/80a8390c507240e893e1fd82b2490df3/roles/2f1608a8492c45d2a30b227c443cd161 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:46:14.983273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dc519-e0a1-4fe3-9b7a-d7c222a23093 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.008548 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:15.039393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24436157-22a6-4ea5-bae9-0207a5f9f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.040828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24436157-22a6-4ea5-bae9-0207a5f9f367 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.042238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24436157-22a6-4ea5-bae9-0207a5f9f367 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.043297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24436157-22a6-4ea5-bae9-0207a5f9f367 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.044645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24436157-22a6-4ea5-bae9-0207a5f9f367 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:15.045690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24436157-22a6-4ea5-bae9-0207a5f9f367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.047737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24436157-22a6-4ea5-bae9-0207a5f9f367 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.055019 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 469/937] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 2 00:46:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:15.063822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06ce1a-dae0-4249-b10f-16ee39b22a2c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.086401 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:15.133994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24436157-22a6-4ea5-bae9-0207a5f9f367 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.186787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06ce1a-dae0-4249-b10f-16ee39b22a2c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.223374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbdc2b-c8f2-4fc2-af5b-7df79278e07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.224092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbdc2b-c8f2-4fc2-af5b-7df79278e07e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.224321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbdc2b-c8f2-4fc2-af5b-7df79278e07e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.224596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbdc2b-c8f2-4fc2-af5b-7df79278e07e None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.225224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbdc2b-c8f2-4fc2-af5b-7df79278e07e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:15.225527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbdc2b-c8f2-4fc2-af5b-7df79278e07e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.226944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbdc2b-c8f2-4fc2-af5b-7df79278e07e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.232504 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 469/938] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 2 00:46:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:15.239826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbdc2b-c8f2-4fc2-af5b-7df79278e07e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.276072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24436157-22a6-4ea5-bae9-0207a5f9f367 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.324169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095f95e-580b-4fc2-bc30-e03e0a47ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.325294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095f95e-580b-4fc2-bc30-e03e0a47ef03 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.325746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095f95e-580b-4fc2-bc30-e03e0a47ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.326081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095f95e-580b-4fc2-bc30-e03e0a47ef03 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.326792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095f95e-580b-4fc2-bc30-e03e0a47ef03 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.328227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095f95e-580b-4fc2-bc30-e03e0a47ef03 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.332269 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-f095f95e-580b-4fc2-bc30-e03e0a47ef03 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:15.340083 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:15.341066 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 02 00:46:15.341968 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:15.346436 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 470/939] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 2 00:46:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:15.347358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095f95e-580b-4fc2-bc30-e03e0a47ef03 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.356872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbdc2b-c8f2-4fc2-af5b-7df79278e07e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.395645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695f4ee-ca25-4f7d-b60b-b7616dd9b2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.396324 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:15.396970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695f4ee-ca25-4f7d-b60b-b7616dd9b2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.397352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695f4ee-ca25-4f7d-b60b-b7616dd9b2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.397618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695f4ee-ca25-4f7d-b60b-b7616dd9b2f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.398316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695f4ee-ca25-4f7d-b60b-b7616dd9b2f0 None admin] RBAC: Adding query filter params (interface=public, service_id=f785799d3e6647858b5318fa5c7ef217, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:15.398639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695f4ee-ca25-4f7d-b60b-b7616dd9b2f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.400007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695f4ee-ca25-4f7d-b60b-b7616dd9b2f0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.407008 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 470/940] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 2 00:46:15 2022] GET /identity/v3/endpoints?service_id=f785799d3e6647858b5318fa5c7ef217&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:15.412465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695f4ee-ca25-4f7d-b60b-b7616dd9b2f0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.467696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095f95e-580b-4fc2-bc30-e03e0a47ef03 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.506529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a5458-f4f6-406e-8876-46268dc0b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.507319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a5458-f4f6-406e-8876-46268dc0b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.507858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a5458-f4f6-406e-8876-46268dc0b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.508007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a5458-f4f6-406e-8876-46268dc0b5a7 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.508728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a5458-f4f6-406e-8876-46268dc0b5a7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:15.509092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a5458-f4f6-406e-8876-46268dc0b5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.511366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a5458-f4f6-406e-8876-46268dc0b5a7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.516749 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 471/941] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 2 00:46:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:15.523457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a5458-f4f6-406e-8876-46268dc0b5a7 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.555253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695f4ee-ca25-4f7d-b60b-b7616dd9b2f0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.598507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e36a8-fab9-46a8-adee-98e02a50db43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.599325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e36a8-fab9-46a8-adee-98e02a50db43 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.599610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e36a8-fab9-46a8-adee-98e02a50db43 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.599883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e36a8-fab9-46a8-adee-98e02a50db43 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.600833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e36a8-fab9-46a8-adee-98e02a50db43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.602489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e36a8-fab9-46a8-adee-98e02a50db43 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.614791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 471/942] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 2 00:46:15 2022] GET /identity/v3/services => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:46:15.661951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a5458-f4f6-406e-8876-46268dc0b5a7 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.675264 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:15.705731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992814b0-af51-4b90-b386-ce12ca9aae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.706363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992814b0-af51-4b90-b386-ce12ca9aae09 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.706672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992814b0-af51-4b90-b386-ce12ca9aae09 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.706954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992814b0-af51-4b90-b386-ce12ca9aae09 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.707679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992814b0-af51-4b90-b386-ce12ca9aae09 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:15.707988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992814b0-af51-4b90-b386-ce12ca9aae09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.709441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992814b0-af51-4b90-b386-ce12ca9aae09 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.716158 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 472/943] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 2 00:46:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:15.721481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e36a8-fab9-46a8-adee-98e02a50db43 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:15.734549 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:15.838161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e36a8-fab9-46a8-adee-98e02a50db43 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:15.875488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25660304-ace9-4a46-8545-3888120ea850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:15.876105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25660304-ace9-4a46-8545-3888120ea850 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:15.876383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25660304-ace9-4a46-8545-3888120ea850 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:15.876654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25660304-ace9-4a46-8545-3888120ea850 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:15.877322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25660304-ace9-4a46-8545-3888120ea850 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:15.878746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25660304-ace9-4a46-8545-3888120ea850 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:15.902630 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 472/944] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 00:46:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:46:16.484438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc8bd-8f43-4329-9756-fefe14fec2c5 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:16.484824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc8bd-8f43-4329-9756-fefe14fec2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:16.484968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc8bd-8f43-4329-9756-fefe14fec2c5 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:16.486562 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 473/945] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:16.491974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7b49f-45da-42d6-884b-83889e23d5ff None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:16.492414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7b49f-45da-42d6-884b-83889e23d5ff None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:16.492492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7b49f-45da-42d6-884b-83889e23d5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:16.511238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-55f7b49f-45da-42d6-884b-83889e23d5ff None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:16.512554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-55f7b49f-45da-42d6-884b-83889e23d5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:16.572033 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:16.592670 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 473/946] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:16.858778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fc8bd-8f43-4329-9756-fefe14fec2c5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:16.962012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fc8bd-8f43-4329-9756-fefe14fec2c5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:16.996466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce8d14-40cd-44eb-87b6-3a59882ddaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:16.997295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce8d14-40cd-44eb-87b6-3a59882ddaa1 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:16.997728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce8d14-40cd-44eb-87b6-3a59882ddaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:16.998151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce8d14-40cd-44eb-87b6-3a59882ddaa1 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:16.999006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce8d14-40cd-44eb-87b6-3a59882ddaa1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:17.000733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce8d14-40cd-44eb-87b6-3a59882ddaa1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:17.003506 n-d-master-1 devstack@keystone.service[81853]: WARNING keystone.server.flask.common [None req-3bce8d14-40cd-44eb-87b6-3a59882ddaa1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 02 00:46:17.025440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.sql.core [None req-3bce8d14-40cd-44eb-87b6-3a59882ddaa1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 02 00:46:17.025440 n-d-master-1 devstack@keystone.service[81853]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 02 00:46:17.025440 n-d-master-1 devstack@keystone.service[81853]: [parameters: {'id': '8abc0b99aa924aac8f5ca5af6fcaf406', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 02 00:46:17.025440 n-d-master-1 devstack@keystone.service[81853]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81853) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-3bce8d14-40cd-44eb-87b6-3a59882ddaa1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8abc0b99aa924aac8f5ca5af6fcaf406.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8abc0b99aa924aac8f5ca5af6fcaf406. Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:46:17.033444 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result.read() Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 02 00:46:17.034414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application yield resource Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.session.rollback() Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.force_reraise() Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise self.value Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application session.commit() Oct 02 00:46:17.035612 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._prepare_impl() Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.session.flush() Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._flush(objects) Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application compat.raise_( Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application flush_context.execute() Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 00:46:17.036678 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rec.execute(self) Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 02 00:46:17.037671 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result.read() Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:46:17.038591 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [parameters: {'id': '8abc0b99aa924aac8f5ca5af6fcaf406', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:17.039513 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:17.040340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:17.041962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:17.041962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 02 00:46:17.041962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 02 00:46:17.041962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:17.041962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:17.041962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 02 00:46:17.041962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 02 00:46:17.041962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8abc0b99aa924aac8f5ca5af6fcaf406. Oct 02 00:46:17.041962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:17.044201 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 474/947] 10.222.0.23 () {60 vars in 1140 bytes} [Sun Oct 2 00:46:16 2022] POST /identity/v3/projects => generated 262 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:17.054650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7b49f-45da-42d6-884b-83889e23d5ff None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:17.163182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7b49f-45da-42d6-884b-83889e23d5ff None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:17.198290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4324ff-7031-4d33-a56b-294d62c5e15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:17.198942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4324ff-7031-4d33-a56b-294d62c5e15a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:17.199218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4324ff-7031-4d33-a56b-294d62c5e15a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:17.199487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4324ff-7031-4d33-a56b-294d62c5e15a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:17.206277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4324ff-7031-4d33-a56b-294d62c5e15a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:17.207809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4324ff-7031-4d33-a56b-294d62c5e15a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0b4324ff-7031-4d33-a56b-294d62c5e15a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:17.219224 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:17.220143 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:17.221053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:17.221053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:17.221053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:17.221053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:17.221053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:17.221053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:17.221053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:17.221053 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:17.223728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422295-7f87-4594-9d54-3309121a1a22 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:17.224017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422295-7f87-4594-9d54-3309121a1a22 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:17.224293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422295-7f87-4594-9d54-3309121a1a22 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:17.225220 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 474/948] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:17.226399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4324ff-7031-4d33-a56b-294d62c5e15a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:17.229639 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 475/949] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:17.235009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd22d8-0811-4404-9e71-e593b9792e2c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:17.235291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd22d8-0811-4404-9e71-e593b9792e2c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:17.235578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd22d8-0811-4404-9e71-e593b9792e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:17.253967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-25dd22d8-0811-4404-9e71-e593b9792e2c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:17.255516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-25dd22d8-0811-4404-9e71-e593b9792e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:17.280391 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:17.283227 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:17.334177 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 476/950] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:17.357973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4324ff-7031-4d33-a56b-294d62c5e15a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:17.392609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0886a-e276-4f36-9540-a2601f6115b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:17.393217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0886a-e276-4f36-9540-a2601f6115b4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:17.393496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0886a-e276-4f36-9540-a2601f6115b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:17.393765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0886a-e276-4f36-9540-a2601f6115b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:17.394571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0886a-e276-4f36-9540-a2601f6115b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:17.394827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0886a-e276-4f36-9540-a2601f6115b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:17.396310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0886a-e276-4f36-9540-a2601f6115b4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:17.414255 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 475/951] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:46:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:17.624866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd22d8-0811-4404-9e71-e593b9792e2c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:17.731745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd22d8-0811-4404-9e71-e593b9792e2c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:17.766973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef033ca-9742-4ce3-98e1-48b7b68efab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:17.767936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef033ca-9742-4ce3-98e1-48b7b68efab8 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:17.768417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef033ca-9742-4ce3-98e1-48b7b68efab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:17.768881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef033ca-9742-4ce3-98e1-48b7b68efab8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:17.780221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef033ca-9742-4ce3-98e1-48b7b68efab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-bef033ca-9742-4ce3-98e1-48b7b68efab8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:17.785401 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:17.786346 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:17.787400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:17.789752 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 477/952] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 2 00:46:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:17.796245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0886a-e276-4f36-9540-a2601f6115b4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:17.909830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0886a-e276-4f36-9540-a2601f6115b4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:17.921429 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:17.946003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8095f07-0336-46da-802e-0e96fb5a562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:17.946630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8095f07-0336-46da-802e-0e96fb5a562d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:17.946919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8095f07-0336-46da-802e-0e96fb5a562d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:17.947192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8095f07-0336-46da-802e-0e96fb5a562d None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:17.948389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8095f07-0336-46da-802e-0e96fb5a562d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:17.948689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8095f07-0336-46da-802e-0e96fb5a562d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:17.950259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8095f07-0336-46da-802e-0e96fb5a562d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:17.959388 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 476/953] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 2 00:46:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:17.965489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef033ca-9742-4ce3-98e1-48b7b68efab8 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:17.982031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ee581-3508-498e-b503-008d40b160b8 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:17.982534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ee581-3508-498e-b503-008d40b160b8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:17.983322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ee581-3508-498e-b503-008d40b160b8 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:17.985391 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 477/954] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:17.990287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ab0f1-78e6-4155-b394-af436f691301 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:17.990574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ab0f1-78e6-4155-b394-af436f691301 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:17.990695 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:17.990876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ab0f1-78e6-4155-b394-af436f691301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.016902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3a7ab0f1-78e6-4155-b394-af436f691301 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:18.018432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a7ab0f1-78e6-4155-b394-af436f691301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:18.087208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef033ca-9742-4ce3-98e1-48b7b68efab8 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:18.088237 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 478/955] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:18.134945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faec47-d06d-4b3c-b625-b40490bd0ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:18.136209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faec47-d06d-4b3c-b625-b40490bd0ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.136741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faec47-d06d-4b3c-b625-b40490bd0ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.137215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faec47-d06d-4b3c-b625-b40490bd0ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.149739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faec47-d06d-4b3c-b625-b40490bd0ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:18.152397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faec47-d06d-4b3c-b625-b40490bd0ac9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-22faec47-d06d-4b3c-b625-b40490bd0ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:18.168991 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:18.170147 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:18.171367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:18.171367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:18.171367 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:18.173456 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 478/956] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:18.179387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ab0f1-78e6-4155-b394-af436f691301 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:18.250523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c18b1-5300-447e-a850-1d44c0740add None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.250924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c18b1-5300-447e-a850-1d44c0740add None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.251026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c18b1-5300-447e-a850-1d44c0740add None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.252623 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 479/957] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:18.257696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066f2da-cd70-4ad5-8200-e8259434cc3c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.258231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066f2da-cd70-4ad5-8200-e8259434cc3c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.258739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066f2da-cd70-4ad5-8200-e8259434cc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.280795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b066f2da-cd70-4ad5-8200-e8259434cc3c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:18.282503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b066f2da-cd70-4ad5-8200-e8259434cc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:18.288792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ab0f1-78e6-4155-b394-af436f691301 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:18.290401 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:18.332109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7de28-a49c-44cb-9ac4-4b165d90a4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:18.332727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7de28-a49c-44cb-9ac4-4b165d90a4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.333013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7de28-a49c-44cb-9ac4-4b165d90a4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.333832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7de28-a49c-44cb-9ac4-4b165d90a4f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.334498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7de28-a49c-44cb-9ac4-4b165d90a4f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:18.334838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7de28-a49c-44cb-9ac4-4b165d90a4f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:18.336683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7de28-a49c-44cb-9ac4-4b165d90a4f7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:18.357580 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 479/958] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:18.359008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7de28-a49c-44cb-9ac4-4b165d90a4f7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:18.361428 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:18.367952 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 480/959] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:18.378668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066f2da-cd70-4ad5-8200-e8259434cc3c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:18.476498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7de28-a49c-44cb-9ac4-4b165d90a4f7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:18.495119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066f2da-cd70-4ad5-8200-e8259434cc3c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:18.520266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6d63c-5a36-4f02-8a95-837d47c400ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:18.520266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d63c-5a36-4f02-8a95-837d47c400ee None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.520266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d63c-5a36-4f02-8a95-837d47c400ee None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.520266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d63c-5a36-4f02-8a95-837d47c400ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.527254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6d63c-5a36-4f02-8a95-837d47c400ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:18.529065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6d63c-5a36-4f02-8a95-837d47c400ee None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:18.529789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d656-216d-4aa6-9fd4-3ff3d5b4d8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:18.530485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d656-216d-4aa6-9fd4-3ff3d5b4d8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.530862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d656-216d-4aa6-9fd4-3ff3d5b4d8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.531202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d656-216d-4aa6-9fd4-3ff3d5b4d8e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.531920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724d656-216d-4aa6-9fd4-3ff3d5b4d8e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:18.533308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724d656-216d-4aa6-9fd4-3ff3d5b4d8e7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a0d6d63c-5a36-4f02-8a95-837d47c400ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:18.540871 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:18.542464 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:18.543452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:18.543452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:18.543452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:18.543452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:18.543452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:18.543452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:18.543452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:18.543452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:18.543452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 02 00:46:18.543452 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:18.543452 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 480/960] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 2 00:46:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-d724d656-216d-4aa6-9fd4-3ff3d5b4d8e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:18.544059 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:18.545103 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:18.546229 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 481/961] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 2 00:46:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:18.551598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6d63c-5a36-4f02-8a95-837d47c400ee None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:18.555863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d656-216d-4aa6-9fd4-3ff3d5b4d8e7 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:18.579388 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:18.647477 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:18.661839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6d63c-5a36-4f02-8a95-837d47c400ee None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:18.696023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d656-216d-4aa6-9fd4-3ff3d5b4d8e7 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:18.698427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12340c-ae51-4257-8134-70d6d7df8fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:18.699058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12340c-ae51-4257-8134-70d6d7df8fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.699338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12340c-ae51-4257-8134-70d6d7df8fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.699606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12340c-ae51-4257-8134-70d6d7df8fb4 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.700224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12340c-ae51-4257-8134-70d6d7df8fb4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:18.700521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12340c-ae51-4257-8134-70d6d7df8fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:18.701901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12340c-ae51-4257-8134-70d6d7df8fb4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:18.706663 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 481/962] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 2 00:46:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:18.712133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12340c-ae51-4257-8134-70d6d7df8fb4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:18.734203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf196a0e-d564-49d2-ba35-1c3ce378e225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:18.734840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf196a0e-d564-49d2-ba35-1c3ce378e225 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.735127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf196a0e-d564-49d2-ba35-1c3ce378e225 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.735761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf196a0e-d564-49d2-ba35-1c3ce378e225 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.736127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf196a0e-d564-49d2-ba35-1c3ce378e225 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:18.736439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf196a0e-d564-49d2-ba35-1c3ce378e225 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:18.737868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf196a0e-d564-49d2-ba35-1c3ce378e225 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:18.759641 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 482/963] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 2 00:46:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:18.759641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf196a0e-d564-49d2-ba35-1c3ce378e225 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:18.810170 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:18.827111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12340c-ae51-4257-8134-70d6d7df8fb4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:18.860956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf196a0e-d564-49d2-ba35-1c3ce378e225 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:18.865299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44096b09-00ac-4f7b-b394-846ac1c6d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:18.865928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44096b09-00ac-4f7b-b394-846ac1c6d669 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.866206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44096b09-00ac-4f7b-b394-846ac1c6d669 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.866477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44096b09-00ac-4f7b-b394-846ac1c6d669 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.867090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44096b09-00ac-4f7b-b394-846ac1c6d669 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:18.868455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44096b09-00ac-4f7b-b394-846ac1c6d669 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-44096b09-00ac-4f7b-b394-846ac1c6d669 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:18.877814 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:18.878843 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:18.879732 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 482/964] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:18.880788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44096b09-00ac-4f7b-b394-846ac1c6d669 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:18.891314 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:18.906069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b129b-1d81-4187-af8e-36c0eeea2414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:18.906696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b129b-1d81-4187-af8e-36c0eeea2414 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:18.906975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b129b-1d81-4187-af8e-36c0eeea2414 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:18.907244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b129b-1d81-4187-af8e-36c0eeea2414 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:18.908025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b129b-1d81-4187-af8e-36c0eeea2414 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:18.908319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b129b-1d81-4187-af8e-36c0eeea2414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:18.909993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b129b-1d81-4187-af8e-36c0eeea2414 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:18.915109 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 483/965] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 2 00:46:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:18.920751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b129b-1d81-4187-af8e-36c0eeea2414 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:18.988984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44096b09-00ac-4f7b-b394-846ac1c6d669 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:19.028958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860feb9f-414b-41db-9f84-c69a6b4b1451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:19.029410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860feb9f-414b-41db-9f84-c69a6b4b1451 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.029688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860feb9f-414b-41db-9f84-c69a6b4b1451 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.030012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860feb9f-414b-41db-9f84-c69a6b4b1451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.032079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b129b-1d81-4187-af8e-36c0eeea2414 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:19.051951 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:19.073820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4f2ff-9bea-49af-89e6-bf2e681bb050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:19.074351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f2ff-9bea-49af-89e6-bf2e681bb050 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.074670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f2ff-9bea-49af-89e6-bf2e681bb050 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.074949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f2ff-9bea-49af-89e6-bf2e681bb050 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.075582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4f2ff-9bea-49af-89e6-bf2e681bb050 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:19.075887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4f2ff-9bea-49af-89e6-bf2e681bb050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:19.077249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4f2ff-9bea-49af-89e6-bf2e681bb050 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:19.086916 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 484/966] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:46:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:19.087993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4f2ff-9bea-49af-89e6-bf2e681bb050 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:19.111972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860feb9f-414b-41db-9f84-c69a6b4b1451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:19.113590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860feb9f-414b-41db-9f84-c69a6b4b1451 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:19.143901 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:19.198565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4f2ff-9bea-49af-89e6-bf2e681bb050 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:19.219531 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 483/967] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:18 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:46:19.220389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860feb9f-414b-41db-9f84-c69a6b4b1451 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:19.239296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d31215-d97e-484e-82e1-49f8666c22d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:19.239904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d31215-d97e-484e-82e1-49f8666c22d4 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.240176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d31215-d97e-484e-82e1-49f8666c22d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.240495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d31215-d97e-484e-82e1-49f8666c22d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.241161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d31215-d97e-484e-82e1-49f8666c22d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:19.242507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d31215-d97e-484e-82e1-49f8666c22d4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:19.265402 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 485/968] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 00:46:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:46:19.266445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d31215-d97e-484e-82e1-49f8666c22d4 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:19.284410 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:19.359860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860feb9f-414b-41db-9f84-c69a6b4b1451 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:19.409732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d31215-d97e-484e-82e1-49f8666c22d4 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:19.411659 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:19.418493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310d7f8-5f5f-4676-9429-cfc955c83351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:19.420281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310d7f8-5f5f-4676-9429-cfc955c83351 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.421078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310d7f8-5f5f-4676-9429-cfc955c83351 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.421573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310d7f8-5f5f-4676-9429-cfc955c83351 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.422436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310d7f8-5f5f-4676-9429-cfc955c83351 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:19.424238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310d7f8-5f5f-4676-9429-cfc955c83351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:19.426704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310d7f8-5f5f-4676-9429-cfc955c83351 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:19.442631 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 484/969] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:46:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:19.465832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e21a0-86ba-40c6-a4a7-e7fe4e737523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:19.466591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e21a0-86ba-40c6-a4a7-e7fe4e737523 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.466993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e21a0-86ba-40c6-a4a7-e7fe4e737523 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.467338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e21a0-86ba-40c6-a4a7-e7fe4e737523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.480672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e21a0-86ba-40c6-a4a7-e7fe4e737523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:19.482244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e21a0-86ba-40c6-a4a7-e7fe4e737523 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-289e21a0-86ba-40c6-a4a7-e7fe4e737523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:19.498793 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:19.499996 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:19.501131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:19.501131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:19.501131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:19.501995 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 486/970] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:19.507682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310d7f8-5f5f-4676-9429-cfc955c83351 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:19.627043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310d7f8-5f5f-4676-9429-cfc955c83351 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:19.645352 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:19.672603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff987428-1ea2-426e-a5ee-0485d57cc775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:19.673216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff987428-1ea2-426e-a5ee-0485d57cc775 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.673497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff987428-1ea2-426e-a5ee-0485d57cc775 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.673770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff987428-1ea2-426e-a5ee-0485d57cc775 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.674416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff987428-1ea2-426e-a5ee-0485d57cc775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:19.674763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff987428-1ea2-426e-a5ee-0485d57cc775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:19.676136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff987428-1ea2-426e-a5ee-0485d57cc775 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:19.688206 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 485/971] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:19.693432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e21a0-86ba-40c6-a4a7-e7fe4e737523 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:19.731747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb7755-be37-42a8-805d-2724ae7860fe None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.732034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb7755-be37-42a8-805d-2724ae7860fe None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.732315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb7755-be37-42a8-805d-2724ae7860fe None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.733793 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 486/972] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:19.739378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5d7fb-d822-440f-8fff-2bfc204c52b7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.739765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5d7fb-d822-440f-8fff-2bfc204c52b7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.740147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5d7fb-d822-440f-8fff-2bfc204c52b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.759029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ddf5d7fb-d822-440f-8fff-2bfc204c52b7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:19.760454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ddf5d7fb-d822-440f-8fff-2bfc204c52b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:19.797849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e21a0-86ba-40c6-a4a7-e7fe4e737523 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:19.831289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae66e8f-179d-4297-9fdc-e4308989f94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:19.831918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae66e8f-179d-4297-9fdc-e4308989f94b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:19.832198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae66e8f-179d-4297-9fdc-e4308989f94b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:19.832469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae66e8f-179d-4297-9fdc-e4308989f94b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:19.832814 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 487/973] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:19.840340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae66e8f-179d-4297-9fdc-e4308989f94b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:19.841788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae66e8f-179d-4297-9fdc-e4308989f94b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-6ae66e8f-179d-4297-9fdc-e4308989f94b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:19.853324 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:19.855145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:19.856280 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:19.856280 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:19.856280 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:19.856280 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:19.856280 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:19.856280 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:19.856280 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:19.856280 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:19.856280 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 487/974] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:19.861157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5d7fb-d822-440f-8fff-2bfc204c52b7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:19.967092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5d7fb-d822-440f-8fff-2bfc204c52b7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:19.970054 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:20.002664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9e8b5-ac29-4b52-8fa8-8ee96da5233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:20.003281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9e8b5-ac29-4b52-8fa8-8ee96da5233f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:20.003563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9e8b5-ac29-4b52-8fa8-8ee96da5233f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:20.003839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9e8b5-ac29-4b52-8fa8-8ee96da5233f None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:20.004533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9e8b5-ac29-4b52-8fa8-8ee96da5233f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:20.004838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9e8b5-ac29-4b52-8fa8-8ee96da5233f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:20.006279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9e8b5-ac29-4b52-8fa8-8ee96da5233f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:20.022887 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 488/975] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:20.024785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae66e8f-179d-4297-9fdc-e4308989f94b None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:20.042536 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:20.117255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9e8b5-ac29-4b52-8fa8-8ee96da5233f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:20.139279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae66e8f-179d-4297-9fdc-e4308989f94b None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:20.184802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade5261-3fb9-4fdb-8318-8c98457774dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:20.185413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5261-3fb9-4fdb-8318-8c98457774dc None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:20.185696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5261-3fb9-4fdb-8318-8c98457774dc None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:20.185969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5261-3fb9-4fdb-8318-8c98457774dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:20.186889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade5261-3fb9-4fdb-8318-8c98457774dc None admin] RBAC: Adding query filter params (role.id=2f1608a8492c45d2a30b227c443cd161, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=80a8390c507240e893e1fd82b2490df3) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:20.188384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade5261-3fb9-4fdb-8318-8c98457774dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:20.189912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade5261-3fb9-4fdb-8318-8c98457774dc None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:20.206636 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 488/976] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:20 2022] GET /identity/v3/role_assignments?user.id=80a8390c507240e893e1fd82b2490df3&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=2f1608a8492c45d2a30b227c443cd161 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:20.255951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9e8b5-ac29-4b52-8fa8-8ee96da5233f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:20.293292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7515ae2-ae41-4a98-bace-200e0b7aad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:20.294246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7515ae2-ae41-4a98-bace-200e0b7aad1c None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:20.294798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7515ae2-ae41-4a98-bace-200e0b7aad1c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:20.295243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7515ae2-ae41-4a98-bace-200e0b7aad1c None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:20.296532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7515ae2-ae41-4a98-bace-200e0b7aad1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:20.298214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7515ae2-ae41-4a98-bace-200e0b7aad1c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:20.302688 n-d-master-1 devstack@keystone.service[81854]: WARNING keystone.server.flask.common [None req-d7515ae2-ae41-4a98-bace-200e0b7aad1c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 02 00:46:20.321552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.sql.core [None req-d7515ae2-ae41-4a98-bace-200e0b7aad1c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 02 00:46:20.321552 n-d-master-1 devstack@keystone.service[81854]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 02 00:46:20.321552 n-d-master-1 devstack@keystone.service[81854]: [parameters: {'user_id': 'b1278b4e9cf240be9d9196148b7b6b63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 02 00:46:20.321552 n-d-master-1 devstack@keystone.service[81854]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81854) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d7515ae2-ae41-4a98-bace-200e0b7aad1c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application result.read() Oct 02 00:46:20.341717 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:46:20.342929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application yield resource Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application next(self.gen) Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.session.rollback() Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.force_reraise() Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise self.value Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application session.commit() Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 02 00:46:20.344147 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._prepare_impl() Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.session.flush() Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._flush(objects) Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application compat.raise_( Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application flush_context.execute() Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rec.execute(self) Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 02 00:46:20.345907 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 00:46:20.348121 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application conn.query(q) Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application result.read() Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 00:46:20.350248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b1278b4e9cf240be9d9196148b7b6b63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:20.352335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 02 00:46:20.359442 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 02 00:46:20.361739 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 02 00:46:20.361739 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 02 00:46:20.361739 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 02 00:46:20.361739 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 02 00:46:20.361739 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 02 00:46:20.361739 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:20.361739 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 489/977] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 2 00:46:20 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:20.362849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade5261-3fb9-4fdb-8318-8c98457774dc None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:20.443302 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:20.467280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade5261-3fb9-4fdb-8318-8c98457774dc None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:20.503276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c33035-1887-430d-81ec-c6534c95c8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:20.504001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33035-1887-430d-81ec-c6534c95c8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:20.504377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33035-1887-430d-81ec-c6534c95c8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:20.504752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33035-1887-430d-81ec-c6534c95c8b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:20.512450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c33035-1887-430d-81ec-c6534c95c8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:20.513930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c33035-1887-430d-81ec-c6534c95c8b4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-86c33035-1887-430d-81ec-c6534c95c8b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:20.525107 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:20.526937 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:20.528145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:20.528145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:20.528145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:20.528145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:20.528145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:20.528145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:20.528145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:20.528145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:20.528145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 02 00:46:20.528145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:20.530628 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 489/978] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:46:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:20.535716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7515ae2-ae41-4a98-bace-200e0b7aad1c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:20.562886 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:20.641942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7515ae2-ae41-4a98-bace-200e0b7aad1c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:20.678247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03577026-1af4-49ec-9885-4b1ad188f4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:20.679055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03577026-1af4-49ec-9885-4b1ad188f4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:20.679436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03577026-1af4-49ec-9885-4b1ad188f4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:20.679806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03577026-1af4-49ec-9885-4b1ad188f4e0 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:20.680602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03577026-1af4-49ec-9885-4b1ad188f4e0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:20.681004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03577026-1af4-49ec-9885-4b1ad188f4e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:20.683286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03577026-1af4-49ec-9885-4b1ad188f4e0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:20.724471 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 490/979] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 2 00:46:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:21.600235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67741f-1281-4e95-95db-15be870c4998 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:21.600769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67741f-1281-4e95-95db-15be870c4998 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:21.600769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67741f-1281-4e95-95db-15be870c4998 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:21.602135 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 490/980] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:21.609183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a4165-5929-4b6a-bb20-c003dca8e5c0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:21.609694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a4165-5929-4b6a-bb20-c003dca8e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:21.609806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a4165-5929-4b6a-bb20-c003dca8e5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:21.629084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-de3a4165-5929-4b6a-bb20-c003dca8e5c0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:21.630573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de3a4165-5929-4b6a-bb20-c003dca8e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:21.696719 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 491/981] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:21.704220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f575-da31-4992-8901-ca2c737ca58a None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:21.704508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f575-da31-4992-8901-ca2c737ca58a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:21.704784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f575-da31-4992-8901-ca2c737ca58a None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:21.706203 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 491/982] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:21.711094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff056d4-2738-4a52-ae9b-93ba9f721d0d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:21.711386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff056d4-2738-4a52-ae9b-93ba9f721d0d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:21.711659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff056d4-2738-4a52-ae9b-93ba9f721d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:21.730035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-aff056d4-2738-4a52-ae9b-93ba9f721d0d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:21.731333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aff056d4-2738-4a52-ae9b-93ba9f721d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:21.734125 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:21.798426 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 492/983] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:21.962348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448f575-da31-4992-8901-ca2c737ca58a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:22.066821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff056d4-2738-4a52-ae9b-93ba9f721d0d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:22.071018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448f575-da31-4992-8901-ca2c737ca58a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:22.108104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa605a-a2b5-453f-81fe-0ce32966feaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:22.108762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa605a-a2b5-453f-81fe-0ce32966feaf None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:22.109309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa605a-a2b5-453f-81fe-0ce32966feaf None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:22.109443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa605a-a2b5-453f-81fe-0ce32966feaf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:22.109997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa605a-a2b5-453f-81fe-0ce32966feaf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:22.111516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa605a-a2b5-453f-81fe-0ce32966feaf None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-affa605a-a2b5-453f-81fe-0ce32966feaf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:22.121131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:22.122173 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:22.123046 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 492/984] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 2 00:46:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:22.128386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa605a-a2b5-453f-81fe-0ce32966feaf None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:22.130913 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:22.174685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff056d4-2738-4a52-ae9b-93ba9f721d0d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:22.209220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd762e-8a63-4fc1-b454-c4d8eb1c1405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:22.209822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd762e-8a63-4fc1-b454-c4d8eb1c1405 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:22.210097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd762e-8a63-4fc1-b454-c4d8eb1c1405 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:22.210365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd762e-8a63-4fc1-b454-c4d8eb1c1405 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:22.211195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd762e-8a63-4fc1-b454-c4d8eb1c1405 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:22.212587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd762e-8a63-4fc1-b454-c4d8eb1c1405 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:22.225446 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:22.233202 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 493/985] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:46:22 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:46:22.249612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa605a-a2b5-453f-81fe-0ce32966feaf None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:22.296894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c5f3-fa24-49fb-92c3-f700f8847167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:22.297521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c5f3-fa24-49fb-92c3-f700f8847167 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:22.297799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c5f3-fa24-49fb-92c3-f700f8847167 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:22.298074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c5f3-fa24-49fb-92c3-f700f8847167 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:22.298741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185c5f3-fa24-49fb-92c3-f700f8847167 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:22.299048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185c5f3-fa24-49fb-92c3-f700f8847167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:22.300478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185c5f3-fa24-49fb-92c3-f700f8847167 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:22.310756 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 493/986] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 2 00:46:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:22.312497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd762e-8a63-4fc1-b454-c4d8eb1c1405 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:22.425788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd762e-8a63-4fc1-b454-c4d8eb1c1405 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:22.465358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100758db-f80f-41e7-b7a4-831e620ad868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:22.465960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100758db-f80f-41e7-b7a4-831e620ad868 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:22.466305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100758db-f80f-41e7-b7a4-831e620ad868 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:22.466650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100758db-f80f-41e7-b7a4-831e620ad868 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:22.467363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100758db-f80f-41e7-b7a4-831e620ad868 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:22.467729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100758db-f80f-41e7-b7a4-831e620ad868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:22.469162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100758db-f80f-41e7-b7a4-831e620ad868 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:22.481071 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 494/987] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 2 00:46:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:22.482731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c5f3-fa24-49fb-92c3-f700f8847167 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:22.546090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52164fb6-a55c-48db-8e41-7f2f7f23e855 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:22.546543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52164fb6-a55c-48db-8e41-7f2f7f23e855 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:22.546944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52164fb6-a55c-48db-8e41-7f2f7f23e855 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:22.547189 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:22.549590 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 495/988] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:22.553891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fc144-66f3-46b8-a93e-d0276c92a23b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:22.554161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fc144-66f3-46b8-a93e-d0276c92a23b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:22.554433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fc144-66f3-46b8-a93e-d0276c92a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:22.572600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8d0fc144-66f3-46b8-a93e-d0276c92a23b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:22.574348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d0fc144-66f3-46b8-a93e-d0276c92a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:22.590649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c5f3-fa24-49fb-92c3-f700f8847167 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:22.627522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faa935-af58-4dcc-b1bf-1f99bc54a70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:22.628163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faa935-af58-4dcc-b1bf-1f99bc54a70f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:22.628437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faa935-af58-4dcc-b1bf-1f99bc54a70f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:22.628713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faa935-af58-4dcc-b1bf-1f99bc54a70f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:22.629418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faa935-af58-4dcc-b1bf-1f99bc54a70f None admin] RBAC: Adding query filter params (interface=admin, service_id=f785799d3e6647858b5318fa5c7ef217, region_id=RegionOne) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:22.629724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faa935-af58-4dcc-b1bf-1f99bc54a70f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:22.631144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faa935-af58-4dcc-b1bf-1f99bc54a70f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:22.634582 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:22.637258 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 494/989] 10.222.0.23 () {56 vars in 1249 bytes} [Sun Oct 2 00:46:22 2022] GET /identity/v3/endpoints?service_id=f785799d3e6647858b5318fa5c7ef217&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:22.643257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faa935-af58-4dcc-b1bf-1f99bc54a70f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:22.644914 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 496/990] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:22.742999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faa935-af58-4dcc-b1bf-1f99bc54a70f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:22.770408 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:22.780125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161f87d-c106-49a2-aad6-df9d2d5c8866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:22.780731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f87d-c106-49a2-aad6-df9d2d5c8866 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:22.781004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f87d-c106-49a2-aad6-df9d2d5c8866 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:22.781269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f87d-c106-49a2-aad6-df9d2d5c8866 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:22.781875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161f87d-c106-49a2-aad6-df9d2d5c8866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:22.783254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161f87d-c106-49a2-aad6-df9d2d5c8866 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:22.789446 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 495/991] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 2 00:46:22 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:46:22.918333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fc144-66f3-46b8-a93e-d0276c92a23b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:23.028863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fc144-66f3-46b8-a93e-d0276c92a23b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:23.064384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41825710-31dd-48ca-a592-f3dbb99bcb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:23.065016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41825710-31dd-48ca-a592-f3dbb99bcb88 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:23.065289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41825710-31dd-48ca-a592-f3dbb99bcb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:23.065557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41825710-31dd-48ca-a592-f3dbb99bcb88 None admin] PATH_INFO: `/v3/services/image` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:23.066132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41825710-31dd-48ca-a592-f3dbb99bcb88 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:23.067577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41825710-31dd-48ca-a592-f3dbb99bcb88 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-41825710-31dd-48ca-a592-f3dbb99bcb88 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:23.076904 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:23.077903 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:23.078849 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 497/992] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Oct 2 00:46:22 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:23.084418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161f87d-c106-49a2-aad6-df9d2d5c8866 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:23.192234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161f87d-c106-49a2-aad6-df9d2d5c8866 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:23.225689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc592036-580d-4d3a-96d3-233c1c9cd733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:23.226414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592036-580d-4d3a-96d3-233c1c9cd733 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:23.226837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592036-580d-4d3a-96d3-233c1c9cd733 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:23.227203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592036-580d-4d3a-96d3-233c1c9cd733 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:23.227931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc592036-580d-4d3a-96d3-233c1c9cd733 None admin] RBAC: Adding query filter params (name=image) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:23.228329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc592036-580d-4d3a-96d3-233c1c9cd733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:23.230269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc592036-580d-4d3a-96d3-233c1c9cd733 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:23.238643 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 496/993] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:23.241143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41825710-31dd-48ca-a592-f3dbb99bcb88 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:23.302322 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:23.345729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41825710-31dd-48ca-a592-f3dbb99bcb88 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:23.379363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26f658-1501-4f0a-aa85-ba0e7a6f55bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:23.380136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26f658-1501-4f0a-aa85-ba0e7a6f55bf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:23.380510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26f658-1501-4f0a-aa85-ba0e7a6f55bf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:23.380883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26f658-1501-4f0a-aa85-ba0e7a6f55bf None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:23.381607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26f658-1501-4f0a-aa85-ba0e7a6f55bf None admin] RBAC: Adding query filter params (type=image) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:23.382008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26f658-1501-4f0a-aa85-ba0e7a6f55bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:23.383506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26f658-1501-4f0a-aa85-ba0e7a6f55bf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:23.394636 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 498/994] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:24.468352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d28a59-2f52-4d83-952c-3cc8e2944d60 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:24.468876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d28a59-2f52-4d83-952c-3cc8e2944d60 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:24.468876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d28a59-2f52-4d83-952c-3cc8e2944d60 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:24.470405 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 497/995] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:24.475706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1f9ec-9add-42ce-b36d-1bf2bd7731d5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:24.476115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1f9ec-9add-42ce-b36d-1bf2bd7731d5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:24.476388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1f9ec-9add-42ce-b36d-1bf2bd7731d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:24.496038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5ca1f9ec-9add-42ce-b36d-1bf2bd7731d5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:24.497288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5ca1f9ec-9add-42ce-b36d-1bf2bd7731d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:24.567105 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 499/996] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:24.842415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d28a59-2f52-4d83-952c-3cc8e2944d60 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:24.904230 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:24.952225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d28a59-2f52-4d83-952c-3cc8e2944d60 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:24.992589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69663bd1-dbc3-43b7-94d9-6edd9cd32fc0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:24.992936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69663bd1-dbc3-43b7-94d9-6edd9cd32fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:24.993160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69663bd1-dbc3-43b7-94d9-6edd9cd32fc0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:24.993545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94111feb-167c-40ef-a925-e340eee34eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:24.994168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94111feb-167c-40ef-a925-e340eee34eef None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:24.994453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94111feb-167c-40ef-a925-e340eee34eef None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:24.996369 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 500/997] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:24.996480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94111feb-167c-40ef-a925-e340eee34eef None admin] PATH_INFO: `/v3/services/compute` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:24.996480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94111feb-167c-40ef-a925-e340eee34eef None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:24.997454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94111feb-167c-40ef-a925-e340eee34eef None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.001432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0387d43-8605-462c-9dc6-62ade0a6fd27 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.001721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0387d43-8605-462c-9dc6-62ade0a6fd27 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.001997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0387d43-8605-462c-9dc6-62ade0a6fd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-94111feb-167c-40ef-a925-e340eee34eef None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:25.006571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:25.007563 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:25.008413 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 498/998] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:25.013577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94111feb-167c-40ef-a925-e340eee34eef None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.022225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e0387d43-8605-462c-9dc6-62ade0a6fd27 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:25.024093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0387d43-8605-462c-9dc6-62ade0a6fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:25.082181 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:25.104740 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 501/999] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:25.123338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94111feb-167c-40ef-a925-e340eee34eef None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:25.141600 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:25.159119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f96c0-0b1f-4876-975c-8dd0618e0910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:25.159725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f96c0-0b1f-4876-975c-8dd0618e0910 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.160004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f96c0-0b1f-4876-975c-8dd0618e0910 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.160275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f96c0-0b1f-4876-975c-8dd0618e0910 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.160899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f96c0-0b1f-4876-975c-8dd0618e0910 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:25.161203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f96c0-0b1f-4876-975c-8dd0618e0910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:25.162556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f96c0-0b1f-4876-975c-8dd0618e0910 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.172740 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 499/1000] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:46:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:25.174017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0387d43-8605-462c-9dc6-62ade0a6fd27 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.275175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0387d43-8605-462c-9dc6-62ade0a6fd27 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:25.309928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658379f-305f-4665-9062-a2edfa2bcca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:25.310543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658379f-305f-4665-9062-a2edfa2bcca1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.310968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658379f-305f-4665-9062-a2edfa2bcca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.311448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658379f-305f-4665-9062-a2edfa2bcca1 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.312093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658379f-305f-4665-9062-a2edfa2bcca1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:25.312482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658379f-305f-4665-9062-a2edfa2bcca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:25.314573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658379f-305f-4665-9062-a2edfa2bcca1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.325091 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 502/1001] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:46:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:25.326674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f96c0-0b1f-4876-975c-8dd0618e0910 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.374902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658379f-305f-4665-9062-a2edfa2bcca1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.426358 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:25.435193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f96c0-0b1f-4876-975c-8dd0618e0910 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:25.471502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b69e2-4be6-4fe8-828d-0a4f7b76f6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:25.472177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b69e2-4be6-4fe8-828d-0a4f7b76f6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.472439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b69e2-4be6-4fe8-828d-0a4f7b76f6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.472708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b69e2-4be6-4fe8-828d-0a4f7b76f6e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.473459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b69e2-4be6-4fe8-828d-0a4f7b76f6e8 None admin] RBAC: Adding query filter params (interface=public, service_id=485117952c2c4c1e9c6dfbbac7579ed1, region_id=RegionOne) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:25.473771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b69e2-4be6-4fe8-828d-0a4f7b76f6e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:25.475151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b69e2-4be6-4fe8-828d-0a4f7b76f6e8 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.482772 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 500/1002] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 2 00:46:25 2022] GET /identity/v3/endpoints?service_id=485117952c2c4c1e9c6dfbbac7579ed1&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:25.486211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b69e2-4be6-4fe8-828d-0a4f7b76f6e8 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.486327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658379f-305f-4665-9062-a2edfa2bcca1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:25.523210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef8715-55f1-4f24-aa27-da52fff331fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:25.523897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef8715-55f1-4f24-aa27-da52fff331fe None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.524178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef8715-55f1-4f24-aa27-da52fff331fe None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.524556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef8715-55f1-4f24-aa27-da52fff331fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.525093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef8715-55f1-4f24-aa27-da52fff331fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:25.527221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef8715-55f1-4f24-aa27-da52fff331fe None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f9ef8715-55f1-4f24-aa27-da52fff331fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:25.536482 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:25.537698 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:25.538780 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 503/1003] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 2 00:46:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:25.539793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183977e2-51ea-492a-9cb5-dc54ee060639 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.539793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183977e2-51ea-492a-9cb5-dc54ee060639 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.539793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183977e2-51ea-492a-9cb5-dc54ee060639 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.540887 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 504/1004] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:25.541875 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:25.543475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183977e2-51ea-492a-9cb5-dc54ee060639 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.598026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b69e2-4be6-4fe8-828d-0a4f7b76f6e8 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:25.631683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d7714-e6e5-4bce-8294-874f68dc27b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:25.632212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d7714-e6e5-4bce-8294-874f68dc27b7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.632493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d7714-e6e5-4bce-8294-874f68dc27b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.632765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d7714-e6e5-4bce-8294-874f68dc27b7 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.633361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d7714-e6e5-4bce-8294-874f68dc27b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:25.634745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d7714-e6e5-4bce-8294-874f68dc27b7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.642164 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 501/1005] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 2 00:46:25 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 00:46:25.643392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbfa0b-70c5-4df5-beb1-255a66eec015 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.643678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbfa0b-70c5-4df5-beb1-255a66eec015 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.643951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbfa0b-70c5-4df5-beb1-255a66eec015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.648353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183977e2-51ea-492a-9cb5-dc54ee060639 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:25.662038 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:25.663798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-08fbfa0b-70c5-4df5-beb1-255a66eec015 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:25.664880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-08fbfa0b-70c5-4df5-beb1-255a66eec015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:25.692504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b39eb-09c9-4d7f-a133-2985217e28e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:25.693125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b39eb-09c9-4d7f-a133-2985217e28e3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.693408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b39eb-09c9-4d7f-a133-2985217e28e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.693683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b39eb-09c9-4d7f-a133-2985217e28e3 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.694324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b39eb-09c9-4d7f-a133-2985217e28e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:25.694652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b39eb-09c9-4d7f-a133-2985217e28e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:25.696074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b39eb-09c9-4d7f-a133-2985217e28e3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.702716 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 505/1006] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 2 00:46:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:25.708554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b39eb-09c9-4d7f-a133-2985217e28e3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.751076 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 502/1007] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:25.821227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b39eb-09c9-4d7f-a133-2985217e28e3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:25.856184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dffa7-4173-453a-9b55-f40144acd527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:25.856800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dffa7-4173-453a-9b55-f40144acd527 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:25.857079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dffa7-4173-453a-9b55-f40144acd527 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:25.857350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dffa7-4173-453a-9b55-f40144acd527 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:25.857972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dffa7-4173-453a-9b55-f40144acd527 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:25.858274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dffa7-4173-453a-9b55-f40144acd527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:25.859668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dffa7-4173-453a-9b55-f40144acd527 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:25.864732 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 506/1008] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 2 00:46:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:25.871196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbfa0b-70c5-4df5-beb1-255a66eec015 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:25.916262 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:25.980484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbfa0b-70c5-4df5-beb1-255a66eec015 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:26.015272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac6f92-927c-4bd8-bc13-0038b8515856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:26.016161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6f92-927c-4bd8-bc13-0038b8515856 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:26.016161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6f92-927c-4bd8-bc13-0038b8515856 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:26.016467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6f92-927c-4bd8-bc13-0038b8515856 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:26.017083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac6f92-927c-4bd8-bc13-0038b8515856 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:26.017189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dffa7-4173-453a-9b55-f40144acd527 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:26.018453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac6f92-927c-4bd8-bc13-0038b8515856 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:26.040025 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 503/1009] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 00:46:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:46:26.074673 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:26.148751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dffa7-4173-453a-9b55-f40144acd527 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:26.193725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cc72e-0e36-40e0-9bb3-f8d6c0a7b3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:26.194256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc72e-0e36-40e0-9bb3-f8d6c0a7b3d0 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:26.194535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc72e-0e36-40e0-9bb3-f8d6c0a7b3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:26.194842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc72e-0e36-40e0-9bb3-f8d6c0a7b3d0 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:26.195513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cc72e-0e36-40e0-9bb3-f8d6c0a7b3d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:26.196928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cc72e-0e36-40e0-9bb3-f8d6c0a7b3d0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:26.215795 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 507/1010] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:46:26 2022] POST /identity/v3/services => generated 242 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:46:27.820629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672d16e-b0e4-4e1c-95e8-bcaa99c55a51 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:27.821156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672d16e-b0e4-4e1c-95e8-bcaa99c55a51 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:27.821156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672d16e-b0e4-4e1c-95e8-bcaa99c55a51 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:27.822662 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 504/1011] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:27.827753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba20fe-8fea-4ff6-a0db-486b27c1ea33 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:27.828187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba20fe-8fea-4ff6-a0db-486b27c1ea33 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:27.828361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba20fe-8fea-4ff6-a0db-486b27c1ea33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:27.846906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2dba20fe-8fea-4ff6-a0db-486b27c1ea33 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:27.848078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2dba20fe-8fea-4ff6-a0db-486b27c1ea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:27.922839 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 508/1012] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:27 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:28.195996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672d16e-b0e4-4e1c-95e8-bcaa99c55a51 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:28.276211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e31a8-d02d-4391-abab-8ef7a6f29750 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.276501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e31a8-d02d-4391-abab-8ef7a6f29750 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.276778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e31a8-d02d-4391-abab-8ef7a6f29750 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.278195 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 509/1013] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:28.283233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc9a4f-48e4-4ca9-8edc-8c4535ff7418 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.283519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc9a4f-48e4-4ca9-8edc-8c4535ff7418 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.283795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc9a4f-48e4-4ca9-8edc-8c4535ff7418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.301067 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:28.303734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0ebc9a4f-48e4-4ca9-8edc-8c4535ff7418 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:28.304834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672d16e-b0e4-4e1c-95e8-bcaa99c55a51 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:28.304948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ebc9a4f-48e4-4ca9-8edc-8c4535ff7418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:28.323561 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:28.343058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798107da-523b-4600-849f-8b4d026645ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:28.343686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798107da-523b-4600-849f-8b4d026645ac None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.343966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798107da-523b-4600-849f-8b4d026645ac None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.344238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798107da-523b-4600-849f-8b4d026645ac None admin] PATH_INFO: `/v3/services/compute` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.344822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798107da-523b-4600-849f-8b4d026645ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:28.346209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798107da-523b-4600-849f-8b4d026645ac None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-798107da-523b-4600-849f-8b4d026645ac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:28.355567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:28.361595 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:28.362496 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 505/1014] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:28.363362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798107da-523b-4600-849f-8b4d026645ac None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:28.391489 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 510/1015] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:28 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:28.475825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798107da-523b-4600-849f-8b4d026645ac None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:28.507646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262e30-86c1-44fe-b7b9-d6800b1f9705 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.507946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262e30-86c1-44fe-b7b9-d6800b1f9705 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.508210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262e30-86c1-44fe-b7b9-d6800b1f9705 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.509694 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 511/1016] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:28.509801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f0954-d1da-47f5-a419-4c42997df5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:28.510237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f0954-d1da-47f5-a419-4c42997df5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.510520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f0954-d1da-47f5-a419-4c42997df5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.510828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f0954-d1da-47f5-a419-4c42997df5c1 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.511637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f0954-d1da-47f5-a419-4c42997df5c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:28.511944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f0954-d1da-47f5-a419-4c42997df5c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:28.513304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f0954-d1da-47f5-a419-4c42997df5c1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:28.515298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab27a-611b-4901-a812-da2959d847df None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.515583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab27a-611b-4901-a812-da2959d847df None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.515863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab27a-611b-4901-a812-da2959d847df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.522933 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 506/1017] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:46:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:28.523790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f0954-d1da-47f5-a419-4c42997df5c1 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:28.534753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-07cab27a-611b-4901-a812-da2959d847df None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:28.536049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-07cab27a-611b-4901-a812-da2959d847df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:28.552318 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:28.610922 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 512/1018] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:28 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:28.630259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f0954-d1da-47f5-a419-4c42997df5c1 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:28.665462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a1f44-ddff-4e38-a8a8-1fd484cb38a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:28.666064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a1f44-ddff-4e38-a8a8-1fd484cb38a0 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.666348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a1f44-ddff-4e38-a8a8-1fd484cb38a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.667207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a1f44-ddff-4e38-a8a8-1fd484cb38a0 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.667934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a1f44-ddff-4e38-a8a8-1fd484cb38a0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:28.668242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a1f44-ddff-4e38-a8a8-1fd484cb38a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:28.669597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a1f44-ddff-4e38-a8a8-1fd484cb38a0 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:28.674155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cab27a-611b-4901-a812-da2959d847df None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:28.679740 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 507/1019] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 2 00:46:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:28.680345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a1f44-ddff-4e38-a8a8-1fd484cb38a0 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:28.761340 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:28.772264 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:28.783294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a1f44-ddff-4e38-a8a8-1fd484cb38a0 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:28.783876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cab27a-611b-4901-a812-da2959d847df None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:28.826430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa709c7-c597-421b-a08a-18c1e9e7c2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:28.827379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa709c7-c597-421b-a08a-18c1e9e7c2a1 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.827546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa709c7-c597-421b-a08a-18c1e9e7c2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.827835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa709c7-c597-421b-a08a-18c1e9e7c2a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.828564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa709c7-c597-421b-a08a-18c1e9e7c2a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:28.830435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba6c88-39fc-49bb-a376-8b1fd6f109c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:28.831216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba6c88-39fc-49bb-a376-8b1fd6f109c0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:28.831598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba6c88-39fc-49bb-a376-8b1fd6f109c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:28.832000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba6c88-39fc-49bb-a376-8b1fd6f109c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:28.833202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba6c88-39fc-49bb-a376-8b1fd6f109c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:28.834964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba6c88-39fc-49bb-a376-8b1fd6f109c0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:28.835842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa709c7-c597-421b-a08a-18c1e9e7c2a1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:28.836856 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 513/1020] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:28.842898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba6c88-39fc-49bb-a376-8b1fd6f109c0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:28.859633 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 508/1021] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 00:46:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:46:28.902646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa709c7-c597-421b-a08a-18c1e9e7c2a1 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:28.987202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba6c88-39fc-49bb-a376-8b1fd6f109c0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:29.041036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7cd1e-9f05-417a-873c-c7bf7dafe9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:29.041744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7cd1e-9f05-417a-873c-c7bf7dafe9fe None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:29.042773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7cd1e-9f05-417a-873c-c7bf7dafe9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:29.043055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7cd1e-9f05-417a-873c-c7bf7dafe9fe None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:29.043729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7cd1e-9f05-417a-873c-c7bf7dafe9fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:29.045934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7cd1e-9f05-417a-873c-c7bf7dafe9fe None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:29.047781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa709c7-c597-421b-a08a-18c1e9e7c2a1 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:29.067074 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:29.083344 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 514/1022] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:46:28 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:46:29.094370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bace0-d3db-49df-b079-b991b895a402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:29.095177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bace0-d3db-49df-b079-b991b895a402 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:29.095460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bace0-d3db-49df-b079-b991b895a402 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:29.095732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bace0-d3db-49df-b079-b991b895a402 None admin] PATH_INFO: `/v3/services/image` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:29.096332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bace0-d3db-49df-b079-b991b895a402 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:29.097767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bace0-d3db-49df-b079-b991b895a402 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-e70bace0-d3db-49df-b079-b991b895a402 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:29.108164 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:29.110113 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:29.111682 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 509/1023] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Oct 2 00:46:28 2022] GET /identity/v3/services/image => generated 86 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:29.120107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7cd1e-9f05-417a-873c-c7bf7dafe9fe None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:29.247861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7cd1e-9f05-417a-873c-c7bf7dafe9fe None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:29.287855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8186fc-8e3c-4d44-95aa-ba7643b0c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:29.288474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8186fc-8e3c-4d44-95aa-ba7643b0c9ea None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:29.288754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8186fc-8e3c-4d44-95aa-ba7643b0c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:29.289030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8186fc-8e3c-4d44-95aa-ba7643b0c9ea None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:29.289696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8186fc-8e3c-4d44-95aa-ba7643b0c9ea None admin] RBAC: Adding query filter params (name=image) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:29.289999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8186fc-8e3c-4d44-95aa-ba7643b0c9ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:29.292109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8186fc-8e3c-4d44-95aa-ba7643b0c9ea None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:29.298343 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 515/1024] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:29.304575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bace0-d3db-49df-b079-b991b895a402 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:29.321571 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:29.434705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bace0-d3db-49df-b079-b991b895a402 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:29.483843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044daea8-c483-4ae5-b3d8-8604abbda8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:29.484462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044daea8-c483-4ae5-b3d8-8604abbda8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:29.484743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044daea8-c483-4ae5-b3d8-8604abbda8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:29.485023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044daea8-c483-4ae5-b3d8-8604abbda8b6 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:29.485662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044daea8-c483-4ae5-b3d8-8604abbda8b6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:29.485967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044daea8-c483-4ae5-b3d8-8604abbda8b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:29.487698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044daea8-c483-4ae5-b3d8-8604abbda8b6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:29.493594 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 510/1025] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:29.500357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8186fc-8e3c-4d44-95aa-ba7643b0c9ea None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:29.579372 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:29.639467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8186fc-8e3c-4d44-95aa-ba7643b0c9ea None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:29.685186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50340d-6fc8-4636-ab42-96f365970502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:29.685904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50340d-6fc8-4636-ab42-96f365970502 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:29.686187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50340d-6fc8-4636-ab42-96f365970502 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:29.686464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50340d-6fc8-4636-ab42-96f365970502 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:29.687207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50340d-6fc8-4636-ab42-96f365970502 None admin] RBAC: Adding query filter params (interface=public, service_id=4ab2ecea295748bea01066cb72f18688, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:29.687518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50340d-6fc8-4636-ab42-96f365970502 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:29.688900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50340d-6fc8-4636-ab42-96f365970502 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:29.694550 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 516/1026] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 2 00:46:29 2022] GET /identity/v3/endpoints?service_id=4ab2ecea295748bea01066cb72f18688&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:29.701007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044daea8-c483-4ae5-b3d8-8604abbda8b6 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:29.778440 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:29.812490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044daea8-c483-4ae5-b3d8-8604abbda8b6 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:29.844977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101493a-3a4c-45e7-a989-29bda208816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:29.845599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101493a-3a4c-45e7-a989-29bda208816a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:29.845820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101493a-3a4c-45e7-a989-29bda208816a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:29.846028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101493a-3a4c-45e7-a989-29bda208816a None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:29.846637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101493a-3a4c-45e7-a989-29bda208816a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:29.847987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101493a-3a4c-45e7-a989-29bda208816a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:29.862688 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 511/1027] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 2 00:46:29 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:46:31.252641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e867049-d629-49ec-a521-3426c6a4c8c3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:31.253137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e867049-d629-49ec-a521-3426c6a4c8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:31.253137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e867049-d629-49ec-a521-3426c6a4c8c3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:31.254575 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 517/1028] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:31.259566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09bb60-14b5-458a-b9a7-a3a0d69f641b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:31.259958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09bb60-14b5-458a-b9a7-a3a0d69f641b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:31.260119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09bb60-14b5-458a-b9a7-a3a0d69f641b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:31.278640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5d09bb60-14b5-458a-b9a7-a3a0d69f641b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:31.280096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5d09bb60-14b5-458a-b9a7-a3a0d69f641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:31.350792 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 512/1029] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:31.410889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06615-026e-4f66-bdbd-0cc6489ed259 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:31.411205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06615-026e-4f66-bdbd-0cc6489ed259 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:31.411449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06615-026e-4f66-bdbd-0cc6489ed259 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:31.412926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 518/1030] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:31.418652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5766-b152-45dd-85e6-83cf1195ceb4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:31.418952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5766-b152-45dd-85e6-83cf1195ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:31.419231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5766-b152-45dd-85e6-83cf1195ceb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:31.438142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-61fa5766-b152-45dd-85e6-83cf1195ceb4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:31.439361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-61fa5766-b152-45dd-85e6-83cf1195ceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:31.504930 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:31.513821 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 513/1031] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:31.623579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06615-026e-4f66-bdbd-0cc6489ed259 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:31.727376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06615-026e-4f66-bdbd-0cc6489ed259 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:31.751772 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:31.763951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c34deb-6a3e-4a5e-b036-3f8814947b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:31.764517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c34deb-6a3e-4a5e-b036-3f8814947b7a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:31.764797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c34deb-6a3e-4a5e-b036-3f8814947b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:31.765068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c34deb-6a3e-4a5e-b036-3f8814947b7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:31.775581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c34deb-6a3e-4a5e-b036-3f8814947b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-64c34deb-6a3e-4a5e-b036-3f8814947b7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:31.781062 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:31.782016 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:31.782902 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:31.787016 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 519/1032] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 2 00:46:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:31.788039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c34deb-6a3e-4a5e-b036-3f8814947b7a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:31.788198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa5766-b152-45dd-85e6-83cf1195ceb4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:31.892624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa5766-b152-45dd-85e6-83cf1195ceb4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:31.896717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c34deb-6a3e-4a5e-b036-3f8814947b7a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:31.931677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457dcc0-227d-4e90-9200-050070746e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:31.932919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457dcc0-227d-4e90-9200-050070746e6c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:31.933205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457dcc0-227d-4e90-9200-050070746e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:31.933489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457dcc0-227d-4e90-9200-050070746e6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:31.934931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457dcc0-227d-4e90-9200-050070746e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:31.936087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31b1f9-4ea9-44d9-9bd7-e85c000bbf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:31.936372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457dcc0-227d-4e90-9200-050070746e6c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:31.936695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31b1f9-4ea9-44d9-9bd7-e85c000bbf18 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:31.936974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31b1f9-4ea9-44d9-9bd7-e85c000bbf18 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:31.937245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31b1f9-4ea9-44d9-9bd7-e85c000bbf18 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:31.937907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31b1f9-4ea9-44d9-9bd7-e85c000bbf18 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:31.938277 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 514/1033] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:31.939016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31b1f9-4ea9-44d9-9bd7-e85c000bbf18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:31.940392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31b1f9-4ea9-44d9-9bd7-e85c000bbf18 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:31.943509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457dcc0-227d-4e90-9200-050070746e6c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:31.955071 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 520/1034] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 2 00:46:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:31.957568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31b1f9-4ea9-44d9-9bd7-e85c000bbf18 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:32.011492 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:32.011835 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:32.051022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457dcc0-227d-4e90-9200-050070746e6c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:32.065943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31b1f9-4ea9-44d9-9bd7-e85c000bbf18 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:32.083456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a6d1e-84be-4fcb-a4ee-c624fc5d4a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:32.084052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a6d1e-84be-4fcb-a4ee-c624fc5d4a0e None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:32.084331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a6d1e-84be-4fcb-a4ee-c624fc5d4a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:32.084602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a6d1e-84be-4fcb-a4ee-c624fc5d4a0e None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:32.085253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a6d1e-84be-4fcb-a4ee-c624fc5d4a0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:32.086687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a6d1e-84be-4fcb-a4ee-c624fc5d4a0e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:32.099229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fddde-c390-465b-b741-ebdabb8f50e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:32.099898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fddde-c390-465b-b741-ebdabb8f50e1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:32.100241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fddde-c390-465b-b741-ebdabb8f50e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:32.100466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fddde-c390-465b-b741-ebdabb8f50e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:32.109237 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 515/1035] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:46:31 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:46:32.109237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b594a9-fbc7-44aa-95a7-de6039530a83 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:32.109237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b594a9-fbc7-44aa-95a7-de6039530a83 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:32.109237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b594a9-fbc7-44aa-95a7-de6039530a83 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:32.127133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fddde-c390-465b-b741-ebdabb8f50e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:32.127225 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 516/1036] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:32.127320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fddde-c390-465b-b741-ebdabb8f50e1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:32.127409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25a435-45e4-4df1-a061-1d165b4d1b5a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:32.127409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25a435-45e4-4df1-a061-1d165b4d1b5a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:32.127409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25a435-45e4-4df1-a061-1d165b4d1b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-309fddde-c390-465b-b741-ebdabb8f50e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:32.130492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:32.131638 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:32.137709 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:32.137709 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:32.137709 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:32.137709 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 521/1037] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:32.137947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fddde-c390-465b-b741-ebdabb8f50e1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:32.145291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3b25a435-45e4-4df1-a061-1d165b4d1b5a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:32.146520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3b25a435-45e4-4df1-a061-1d165b4d1b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:32.224660 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 517/1038] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:32.251695 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:32.256125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fddde-c390-465b-b741-ebdabb8f50e1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:32.294955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28331e86-3acd-49ca-83b6-91414f92e920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:32.295567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28331e86-3acd-49ca-83b6-91414f92e920 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:32.296101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28331e86-3acd-49ca-83b6-91414f92e920 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:32.296380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28331e86-3acd-49ca-83b6-91414f92e920 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:32.297024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28331e86-3acd-49ca-83b6-91414f92e920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:32.297326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28331e86-3acd-49ca-83b6-91414f92e920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:32.298786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28331e86-3acd-49ca-83b6-91414f92e920 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:32.311923 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 522/1039] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:32.319412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25a435-45e4-4df1-a061-1d165b4d1b5a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:32.372746 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:32.425481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25a435-45e4-4df1-a061-1d165b4d1b5a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:32.460505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0cbda-6c78-467e-9178-86325c0d852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:32.461133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0cbda-6c78-467e-9178-86325c0d852d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:32.461411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0cbda-6c78-467e-9178-86325c0d852d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:32.461683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0cbda-6c78-467e-9178-86325c0d852d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:32.468882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0cbda-6c78-467e-9178-86325c0d852d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:32.470322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0cbda-6c78-467e-9178-86325c0d852d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-f5d0cbda-6c78-467e-9178-86325c0d852d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:32.481727 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:32.482715 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:32.483920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:32.483920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:32.483920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:32.483920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:32.483920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:32.483920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:32.483920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:32.483920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:32.483920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:46:32.483920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:32.483920 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 518/1040] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 2 00:46:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:32.489040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28331e86-3acd-49ca-83b6-91414f92e920 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:32.490920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0cbda-6c78-467e-9178-86325c0d852d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:32.597059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28331e86-3acd-49ca-83b6-91414f92e920 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:32.598055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0cbda-6c78-467e-9178-86325c0d852d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:32.608365 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:32.634208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efa2c2-3af3-4dac-8215-857250d29c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:32.635009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa2c2-3af3-4dac-8215-857250d29c4c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:32.635404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa2c2-3af3-4dac-8215-857250d29c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:32.635761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa2c2-3af3-4dac-8215-857250d29c4c None admin] PATH_INFO: `/v3/services/image` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:32.636398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efa2c2-3af3-4dac-8215-857250d29c4c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:32.636976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f204c-460b-451f-a1d8-a337207452de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:32.637647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f204c-460b-451f-a1d8-a337207452de None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:32.637938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efa2c2-3af3-4dac-8215-857250d29c4c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:32.638039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f204c-460b-451f-a1d8-a337207452de None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:32.638416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f204c-460b-451f-a1d8-a337207452de None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:32.639187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f204c-460b-451f-a1d8-a337207452de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:32.639563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f204c-460b-451f-a1d8-a337207452de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:32.641041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f204c-460b-451f-a1d8-a337207452de None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-82efa2c2-3af3-4dac-8215-857250d29c4c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:32.648093 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:32.649269 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 02 00:46:32.650318 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:32.655003 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 519/1041] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Oct 2 00:46:32 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:32.656176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efa2c2-3af3-4dac-8215-857250d29c4c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:32.667723 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 523/1042] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 2 00:46:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:32.668885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f204c-460b-451f-a1d8-a337207452de None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:32.687797 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:32.767654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efa2c2-3af3-4dac-8215-857250d29c4c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:32.778535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f204c-460b-451f-a1d8-a337207452de None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:32.804316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4c4a2-d00b-4108-8b50-04e5b0dd02a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:32.804916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c4a2-d00b-4108-8b50-04e5b0dd02a1 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:32.805191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c4a2-d00b-4108-8b50-04e5b0dd02a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:32.805459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c4a2-d00b-4108-8b50-04e5b0dd02a1 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:32.806245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4c4a2-d00b-4108-8b50-04e5b0dd02a1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:32.806546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4c4a2-d00b-4108-8b50-04e5b0dd02a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:32.808215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4c4a2-d00b-4108-8b50-04e5b0dd02a1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:32.813307 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 520/1043] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:32.818727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94184e6-d5ce-44db-a14a-4b87d128322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:32.818908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4c4a2-d00b-4108-8b50-04e5b0dd02a1 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:32.819339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94184e6-d5ce-44db-a14a-4b87d128322f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:32.819624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94184e6-d5ce-44db-a14a-4b87d128322f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:32.819893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94184e6-d5ce-44db-a14a-4b87d128322f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:32.862581 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:32.893646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94184e6-d5ce-44db-a14a-4b87d128322f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:32.895224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94184e6-d5ce-44db-a14a-4b87d128322f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:32.913014 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:32.932885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4c4a2-d00b-4108-8b50-04e5b0dd02a1 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:32.977108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcd087-d011-4254-9463-ddc51d4ae07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:32.977721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcd087-d011-4254-9463-ddc51d4ae07a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:32.978005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcd087-d011-4254-9463-ddc51d4ae07a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:32.978282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcd087-d011-4254-9463-ddc51d4ae07a None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:32.978969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcd087-d011-4254-9463-ddc51d4ae07a None admin] RBAC: Adding query filter params (type=image) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:32.979284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcd087-d011-4254-9463-ddc51d4ae07a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:32.980660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcd087-d011-4254-9463-ddc51d4ae07a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:32.986406 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 521/1044] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:32.991745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcd087-d011-4254-9463-ddc51d4ae07a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:33.013294 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 524/1045] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 02 00:46:33.018878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94184e6-d5ce-44db-a14a-4b87d128322f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:33.104910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcd087-d011-4254-9463-ddc51d4ae07a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:33.106943 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:33.127146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94184e6-d5ce-44db-a14a-4b87d128322f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:33.144683 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:33.145180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d1500-2330-438f-93ed-b5c9c057819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:33.146133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1500-2330-438f-93ed-b5c9c057819f None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:33.146383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1500-2330-438f-93ed-b5c9c057819f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:33.146667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1500-2330-438f-93ed-b5c9c057819f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:33.147390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d1500-2330-438f-93ed-b5c9c057819f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:33.149315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d1500-2330-438f-93ed-b5c9c057819f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:33.164582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539453-bfc7-4884-b07f-70331c3134d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:33.165263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539453-bfc7-4884-b07f-70331c3134d7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:33.165545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539453-bfc7-4884-b07f-70331c3134d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:33.165821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539453-bfc7-4884-b07f-70331c3134d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:33.172240 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 522/1046] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 00:46:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:46:33.187546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539453-bfc7-4884-b07f-70331c3134d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:33.189084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539453-bfc7-4884-b07f-70331c3134d7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-62539453-bfc7-4884-b07f-70331c3134d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:33.205206 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:33.206248 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:33.207725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:33.207725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:33.207725 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:33.207725 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 525/1047] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:33.212955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d1500-2330-438f-93ed-b5c9c057819f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:33.334966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d1500-2330-438f-93ed-b5c9c057819f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:33.374632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97a1eb-9c86-44cf-9ea9-021d7df1abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:33.375273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97a1eb-9c86-44cf-9ea9-021d7df1abba None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:33.375556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97a1eb-9c86-44cf-9ea9-021d7df1abba None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:33.375821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97a1eb-9c86-44cf-9ea9-021d7df1abba None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:33.376460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97a1eb-9c86-44cf-9ea9-021d7df1abba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:33.376761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97a1eb-9c86-44cf-9ea9-021d7df1abba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:33.378171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97a1eb-9c86-44cf-9ea9-021d7df1abba None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:33.389828 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 523/1048] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:33.395505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539453-bfc7-4884-b07f-70331c3134d7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:33.497443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539453-bfc7-4884-b07f-70331c3134d7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:33.531344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5d8ac-82e0-477c-b9b5-9ca8a61e8211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:33.531974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5d8ac-82e0-477c-b9b5-9ca8a61e8211 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:33.532251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5d8ac-82e0-477c-b9b5-9ca8a61e8211 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:33.532520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5d8ac-82e0-477c-b9b5-9ca8a61e8211 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:33.539128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5d8ac-82e0-477c-b9b5-9ca8a61e8211 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:33.540563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5d8ac-82e0-477c-b9b5-9ca8a61e8211 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-19f5d8ac-82e0-477c-b9b5-9ca8a61e8211 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:33.551978 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:33.553063 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:33.554162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:33.554162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:33.554162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:33.554162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:33.554162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:33.554162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:33.554162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:33.554162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:33.554779 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 526/1049] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:33.559220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97a1eb-9c86-44cf-9ea9-021d7df1abba None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:33.576577 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:33.662820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97a1eb-9c86-44cf-9ea9-021d7df1abba None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:33.697505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165eed2-2de6-4801-941c-95faeadb386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:33.698539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165eed2-2de6-4801-941c-95faeadb386c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:33.698935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165eed2-2de6-4801-941c-95faeadb386c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:33.699296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165eed2-2de6-4801-941c-95faeadb386c None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:33.700073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165eed2-2de6-4801-941c-95faeadb386c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:33.700473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165eed2-2de6-4801-941c-95faeadb386c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:33.701976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165eed2-2de6-4801-941c-95faeadb386c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:33.714925 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 524/1050] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:33.720628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5d8ac-82e0-477c-b9b5-9ca8a61e8211 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:33.749856 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:33.823001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5d8ac-82e0-477c-b9b5-9ca8a61e8211 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:33.857538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454b968-3e74-4cf4-b90f-9e5de5652a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:33.858289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454b968-3e74-4cf4-b90f-9e5de5652a23 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:33.858696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454b968-3e74-4cf4-b90f-9e5de5652a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:33.859062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454b968-3e74-4cf4-b90f-9e5de5652a23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:33.859906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454b968-3e74-4cf4-b90f-9e5de5652a23 None admin] RBAC: Adding query filter params (role.id=2f1608a8492c45d2a30b227c443cd161, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=b85fc7e555f348c3ab6c63ee15f6ceb0) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:33.860309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454b968-3e74-4cf4-b90f-9e5de5652a23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:33.861935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454b968-3e74-4cf4-b90f-9e5de5652a23 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:33.874630 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 527/1051] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:33 2022] GET /identity/v3/role_assignments?user.id=b85fc7e555f348c3ab6c63ee15f6ceb0&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=2f1608a8492c45d2a30b227c443cd161 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:34.400104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85449f2f-91dc-4057-8ec1-909705a4ea55 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:34.400597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85449f2f-91dc-4057-8ec1-909705a4ea55 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:34.400597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85449f2f-91dc-4057-8ec1-909705a4ea55 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:34.402097 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 525/1052] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:34.407290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276daee-617d-4930-899d-6315c10b984c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:34.407714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276daee-617d-4930-899d-6315c10b984c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:34.407907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276daee-617d-4930-899d-6315c10b984c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:34.426455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1276daee-617d-4930-899d-6315c10b984c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:34.427666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1276daee-617d-4930-899d-6315c10b984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:34.493668 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 528/1053] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:34.760880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85449f2f-91dc-4057-8ec1-909705a4ea55 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:34.835873 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:34.864032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85449f2f-91dc-4057-8ec1-909705a4ea55 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:34.898468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17196e4-cc88-4629-824b-7756fe1f213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:34.899122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17196e4-cc88-4629-824b-7756fe1f213a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:34.899404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17196e4-cc88-4629-824b-7756fe1f213a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:34.899677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17196e4-cc88-4629-824b-7756fe1f213a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:34.909718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17196e4-cc88-4629-824b-7756fe1f213a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-b17196e4-cc88-4629-824b-7756fe1f213a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:34.914402 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:34.915548 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:34.916419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:34.918956 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 526/1054] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:46:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:34.923738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276daee-617d-4930-899d-6315c10b984c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:34.947312 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:35.029590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276daee-617d-4930-899d-6315c10b984c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:35.066200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837bbd6-33e3-4803-b4b9-65628fc0055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:35.066886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837bbd6-33e3-4803-b4b9-65628fc0055a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:35.067170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837bbd6-33e3-4803-b4b9-65628fc0055a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:35.067444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837bbd6-33e3-4803-b4b9-65628fc0055a None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:35.068112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837bbd6-33e3-4803-b4b9-65628fc0055a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:35.068419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837bbd6-33e3-4803-b4b9-65628fc0055a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:35.069793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837bbd6-33e3-4803-b4b9-65628fc0055a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:35.082629 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 529/1055] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:46:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:35.084651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17196e4-cc88-4629-824b-7756fe1f213a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:35.191408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17196e4-cc88-4629-824b-7756fe1f213a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:35.226274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da8a3-becd-4073-ace4-03960e21bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:35.226935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da8a3-becd-4073-ace4-03960e21bbae None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:35.227220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da8a3-becd-4073-ace4-03960e21bbae None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:35.227495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da8a3-becd-4073-ace4-03960e21bbae None admin] PATH_INFO: `/v3/users/79782b16592e428a9976e81cbb240c94` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:35.229954 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:35.243410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2da8a3-becd-4073-ace4-03960e21bbae None admin] RBAC: Authorizing `identity:get_user(user_id=79782b16592e428a9976e81cbb240c94)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:35.244925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2da8a3-becd-4073-ace4-03960e21bbae None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:35.246782 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 527/1056] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:46:35 2022] GET /identity/v3/users/79782b16592e428a9976e81cbb240c94 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:35.252231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837bbd6-33e3-4803-b4b9-65628fc0055a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:35.343581 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:35.361774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837bbd6-33e3-4803-b4b9-65628fc0055a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:35.394864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06f34b-b78c-4d85-8ef5-1294ad46d7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:35.395472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06f34b-b78c-4d85-8ef5-1294ad46d7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:35.395749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06f34b-b78c-4d85-8ef5-1294ad46d7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:35.396016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06f34b-b78c-4d85-8ef5-1294ad46d7e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:35.404550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387d343-655e-4c2f-a1b2-7313af817825 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:35.405056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387d343-655e-4c2f-a1b2-7313af817825 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:35.405138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387d343-655e-4c2f-a1b2-7313af817825 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:35.406580 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 528/1057] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:35.411334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bbc64-5d74-4690-a424-53e6f34efb75 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:35.411634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bbc64-5d74-4690-a424-53e6f34efb75 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:35.411914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bbc64-5d74-4690-a424-53e6f34efb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:35.430949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-940bbc64-5d74-4690-a424-53e6f34efb75 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:35.432535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-940bbc64-5d74-4690-a424-53e6f34efb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:35.466897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06f34b-b78c-4d85-8ef5-1294ad46d7e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:35.468356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06f34b-b78c-4d85-8ef5-1294ad46d7e9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:35.507219 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 529/1058] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:35.555822 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:35.577942 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 530/1059] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:46:35.583804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bbc64-5d74-4690-a424-53e6f34efb75 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:35.685150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bbc64-5d74-4690-a424-53e6f34efb75 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:35.707655 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:35.720316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb2129-dd8a-4905-92e1-21f2df62acc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:35.720947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb2129-dd8a-4905-92e1-21f2df62acc9 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:35.721227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb2129-dd8a-4905-92e1-21f2df62acc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:35.721499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb2129-dd8a-4905-92e1-21f2df62acc9 None admin] PATH_INFO: `/v3/projects/88d0c282aa2e421f88391788005d4201` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:35.722629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb2129-dd8a-4905-92e1-21f2df62acc9 None admin] RBAC: Authorizing `identity:get_project(project_id=88d0c282aa2e421f88391788005d4201)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:35.724063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb2129-dd8a-4905-92e1-21f2df62acc9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:35.730831 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 530/1060] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:46:35 2022] GET /identity/v3/projects/88d0c282aa2e421f88391788005d4201 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:35.732745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06f34b-b78c-4d85-8ef5-1294ad46d7e9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:35.783750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb2129-dd8a-4905-92e1-21f2df62acc9 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:35.840757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06f34b-b78c-4d85-8ef5-1294ad46d7e9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:35.876020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481425f4-c915-4cf9-8381-3e2e9a1471c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:35.876724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481425f4-c915-4cf9-8381-3e2e9a1471c7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:35.877007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481425f4-c915-4cf9-8381-3e2e9a1471c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:35.877278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481425f4-c915-4cf9-8381-3e2e9a1471c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:35.878009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481425f4-c915-4cf9-8381-3e2e9a1471c7 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=88d0c282aa2e421f88391788005d4201, user.id=79782b16592e428a9976e81cbb240c94) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:35.878316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481425f4-c915-4cf9-8381-3e2e9a1471c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:35.879785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481425f4-c915-4cf9-8381-3e2e9a1471c7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:35.891063 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 531/1061] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:35 2022] GET /identity/v3/role_assignments?user.id=79782b16592e428a9976e81cbb240c94&scope.project.id=88d0c282aa2e421f88391788005d4201&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:35.912146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb2129-dd8a-4905-92e1-21f2df62acc9 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:35.952655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718c73e-e0b1-428e-bc9e-55a335525cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:35.953199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718c73e-e0b1-428e-bc9e-55a335525cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:35.953477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718c73e-e0b1-428e-bc9e-55a335525cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:35.953748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718c73e-e0b1-428e-bc9e-55a335525cb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:36.021804 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:36.034304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718c73e-e0b1-428e-bc9e-55a335525cb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:36.034680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c77f-7217-4db0-804b-a42694f74809 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:36.034874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c77f-7217-4db0-804b-a42694f74809 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:36.035146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c77f-7217-4db0-804b-a42694f74809 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:36.035804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718c73e-e0b1-428e-bc9e-55a335525cb1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:36.036693 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 532/1062] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:36.043084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8e0f9-9a96-44ce-815b-9ef139a4e328 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:36.043402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8e0f9-9a96-44ce-815b-9ef139a4e328 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:36.043632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8e0f9-9a96-44ce-815b-9ef139a4e328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:36.063637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fcd8e0f9-9a96-44ce-815b-9ef139a4e328 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:36.064835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fcd8e0f9-9a96-44ce-815b-9ef139a4e328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:36.116783 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:36.151365 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 533/1063] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:36.151573 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 531/1064] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 02 00:46:36.152480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8e0f9-9a96-44ce-815b-9ef139a4e328 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:36.253033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8e0f9-9a96-44ce-815b-9ef139a4e328 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:36.286784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21894364-ceec-4da7-b0e3-b9e5e94d047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:36.287414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894364-ceec-4da7-b0e3-b9e5e94d047b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:36.287694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894364-ceec-4da7-b0e3-b9e5e94d047b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:36.287967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894364-ceec-4da7-b0e3-b9e5e94d047b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:36.298837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21894364-ceec-4da7-b0e3-b9e5e94d047b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:36.300282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21894364-ceec-4da7-b0e3-b9e5e94d047b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-21894364-ceec-4da7-b0e3-b9e5e94d047b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:36.314563 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:36.315637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:36.321564 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:36.321564 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:36.321564 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:36.321564 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 534/1065] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:36.323425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718c73e-e0b1-428e-bc9e-55a335525cb1 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:36.410643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21894364-ceec-4da7-b0e3-b9e5e94d047b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:36.415328 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:36.426712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718c73e-e0b1-428e-bc9e-55a335525cb1 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:36.442278 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:36.467123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1ebb9-1314-4285-9271-3e9d068be7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:36.467763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1ebb9-1314-4285-9271-3e9d068be7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:36.468002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1ebb9-1314-4285-9271-3e9d068be7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:36.468266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1ebb9-1314-4285-9271-3e9d068be7c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:36.468910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1ebb9-1314-4285-9271-3e9d068be7c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:36.469199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1ebb9-1314-4285-9271-3e9d068be7c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:36.470552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1ebb9-1314-4285-9271-3e9d068be7c5 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:36.482865 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 532/1066] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:36.522994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21894364-ceec-4da7-b0e3-b9e5e94d047b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:36.560534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ada42-825d-459b-9428-2d324b39e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:36.561183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ada42-825d-459b-9428-2d324b39e124 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:36.561458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ada42-825d-459b-9428-2d324b39e124 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:36.561727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ada42-825d-459b-9428-2d324b39e124 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:36.574489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ada42-825d-459b-9428-2d324b39e124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-103ada42-825d-459b-9428-2d324b39e124 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:36.579417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:36.580485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:36.581358 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:36.582833 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 535/1067] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 2 00:46:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:36.586798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1ebb9-1314-4285-9271-3e9d068be7c5 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:36.697515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1ebb9-1314-4285-9271-3e9d068be7c5 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:36.733407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09734f08-f56e-4355-9df1-ab3762a2ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:36.734014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734f08-f56e-4355-9df1-ab3762a2ecca None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:36.734298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734f08-f56e-4355-9df1-ab3762a2ecca None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:36.734577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734f08-f56e-4355-9df1-ab3762a2ecca None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:36.735326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09734f08-f56e-4355-9df1-ab3762a2ecca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:36.735634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09734f08-f56e-4355-9df1-ab3762a2ecca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:36.736998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09734f08-f56e-4355-9df1-ab3762a2ecca None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:36.746129 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 533/1068] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 2 00:46:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:36.752123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ada42-825d-459b-9428-2d324b39e124 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:36.850108 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:36.860107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ada42-825d-459b-9428-2d324b39e124 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:36.892934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8c773-85f7-4e38-b811-6c89aa6d03fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:36.893543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8c773-85f7-4e38-b811-6c89aa6d03fb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:36.893821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8c773-85f7-4e38-b811-6c89aa6d03fb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:36.894092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8c773-85f7-4e38-b811-6c89aa6d03fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:36.904755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8c773-85f7-4e38-b811-6c89aa6d03fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:36.906200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8c773-85f7-4e38-b811-6c89aa6d03fb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-30d8c773-85f7-4e38-b811-6c89aa6d03fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:36.920252 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:36.921549 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:36.922890 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:36.922890 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:36.922890 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:36.922890 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 536/1069] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:36.927360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09734f08-f56e-4355-9df1-ab3762a2ecca None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:36.942442 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:37.032921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09734f08-f56e-4355-9df1-ab3762a2ecca None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:37.065160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c930a-23ed-4bd7-80b4-5c992436264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:37.065757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c930a-23ed-4bd7-80b4-5c992436264b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:37.066038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c930a-23ed-4bd7-80b4-5c992436264b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:37.066311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c930a-23ed-4bd7-80b4-5c992436264b None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:37.066979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c930a-23ed-4bd7-80b4-5c992436264b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:37.067285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c930a-23ed-4bd7-80b4-5c992436264b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:37.068637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c930a-23ed-4bd7-80b4-5c992436264b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:37.080213 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 534/1070] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:37.085850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8c773-85f7-4e38-b811-6c89aa6d03fb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:37.184928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8c773-85f7-4e38-b811-6c89aa6d03fb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:37.218090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3ffe3-b489-456a-b346-f701130c908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:37.218743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3ffe3-b489-456a-b346-f701130c908c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:37.219029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3ffe3-b489-456a-b346-f701130c908c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:37.219306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3ffe3-b489-456a-b346-f701130c908c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:37.226526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3ffe3-b489-456a-b346-f701130c908c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:37.227997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3ffe3-b489-456a-b346-f701130c908c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d9b3ffe3-b489-456a-b346-f701130c908c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:37.239338 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:37.240486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:37.241454 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:37.241454 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:37.241454 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:37.241454 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:37.241454 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:37.241454 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:37.241454 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:37.241454 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:37.241454 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:46:37.241454 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:37.241454 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 537/1071] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 2 00:46:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:37.246907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c930a-23ed-4bd7-80b4-5c992436264b None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:37.314964 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:37.343361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c930a-23ed-4bd7-80b4-5c992436264b None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:37.376086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02a001-a72b-4b14-b406-481f7ed3b5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:37.376764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02a001-a72b-4b14-b406-481f7ed3b5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:37.377041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02a001-a72b-4b14-b406-481f7ed3b5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:37.377309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02a001-a72b-4b14-b406-481f7ed3b5c4 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:37.378022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02a001-a72b-4b14-b406-481f7ed3b5c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:37.378322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02a001-a72b-4b14-b406-481f7ed3b5c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:37.379759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02a001-a72b-4b14-b406-481f7ed3b5c4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:37.396164 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 535/1072] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 2 00:46:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:37.402059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3ffe3-b489-456a-b346-f701130c908c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:37.404927 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:37.502221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3ffe3-b489-456a-b346-f701130c908c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:37.534247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3641e4-64fb-4f4a-a4d7-76180f545201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:37.534915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3641e4-64fb-4f4a-a4d7-76180f545201 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:37.535174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3641e4-64fb-4f4a-a4d7-76180f545201 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:37.535461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3641e4-64fb-4f4a-a4d7-76180f545201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:37.546397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3641e4-64fb-4f4a-a4d7-76180f545201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:37.547866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3641e4-64fb-4f4a-a4d7-76180f545201 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0c3641e4-64fb-4f4a-a4d7-76180f545201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:37.562262 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:37.563266 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:37.564305 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:37.564305 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:37.564305 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:37.566744 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 538/1073] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:37.569210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02a001-a72b-4b14-b406-481f7ed3b5c4 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:37.665062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02a001-a72b-4b14-b406-481f7ed3b5c4 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:37.694471 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:37.700560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04bec1-c8ba-4195-aa26-2f4dd9a1da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:37.701159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04bec1-c8ba-4195-aa26-2f4dd9a1da31 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:37.701437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04bec1-c8ba-4195-aa26-2f4dd9a1da31 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:37.701710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04bec1-c8ba-4195-aa26-2f4dd9a1da31 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:37.702342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04bec1-c8ba-4195-aa26-2f4dd9a1da31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:37.702674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04bec1-c8ba-4195-aa26-2f4dd9a1da31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:37.704023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04bec1-c8ba-4195-aa26-2f4dd9a1da31 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:37.715743 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 536/1074] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:37.721136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3641e4-64fb-4f4a-a4d7-76180f545201 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:37.775323 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:37.820506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3641e4-64fb-4f4a-a4d7-76180f545201 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:37.853037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2373e-777f-4f75-a864-292bba977e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:37.853654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2373e-777f-4f75-a864-292bba977e20 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:37.853928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2373e-777f-4f75-a864-292bba977e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:37.854775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2373e-777f-4f75-a864-292bba977e20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:37.861228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2373e-777f-4f75-a864-292bba977e20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:37.862695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2373e-777f-4f75-a864-292bba977e20 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-66b2373e-777f-4f75-a864-292bba977e20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:37.873614 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:37.874788 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:37.876040 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:37.876040 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:37.876040 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:37.876040 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:37.876040 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:37.876040 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:37.876040 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:37.876040 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:37.878921 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 539/1075] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:37.880408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04bec1-c8ba-4195-aa26-2f4dd9a1da31 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:37.991249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04bec1-c8ba-4195-aa26-2f4dd9a1da31 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:38.024387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6020d-ddba-414d-b062-9562926859a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:38.024994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6020d-ddba-414d-b062-9562926859a1 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:38.025278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6020d-ddba-414d-b062-9562926859a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:38.025606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6020d-ddba-414d-b062-9562926859a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:38.026245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6020d-ddba-414d-b062-9562926859a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:38.026552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6020d-ddba-414d-b062-9562926859a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:38.028003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6020d-ddba-414d-b062-9562926859a1 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:38.038044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329812cc-33b5-4b7b-baf6-8dc91e75e891 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:38.038325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329812cc-33b5-4b7b-baf6-8dc91e75e891 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:38.038621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329812cc-33b5-4b7b-baf6-8dc91e75e891 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:38.045031 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 537/1076] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:38.045181 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 540/1077] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:46:38.045931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329812cc-33b5-4b7b-baf6-8dc91e75e891 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:38.046470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4b10c-6cb8-4f4b-a97c-2be2eb81b821 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:38.046790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4b10c-6cb8-4f4b-a97c-2be2eb81b821 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:38.047061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4b10c-6cb8-4f4b-a97c-2be2eb81b821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:38.064692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-56f4b10c-6cb8-4f4b-a97c-2be2eb81b821 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:38.065876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-56f4b10c-6cb8-4f4b-a97c-2be2eb81b821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:38.110429 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:38.131694 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 538/1078] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:38.147064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329812cc-33b5-4b7b-baf6-8dc91e75e891 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:38.160185 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:38.180322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d509-a58b-46aa-8888-85ef3568e6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:38.180966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d509-a58b-46aa-8888-85ef3568e6c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:38.181244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d509-a58b-46aa-8888-85ef3568e6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:38.181513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d509-a58b-46aa-8888-85ef3568e6c9 None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/b85fc7e555f348c3ab6c63ee15f6ceb0/roles/2f1608a8492c45d2a30b227c443cd161` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:38.184307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23d509-a58b-46aa-8888-85ef3568e6c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=b85fc7e555f348c3ab6c63ee15f6ceb0, role_id=2f1608a8492c45d2a30b227c443cd161)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:38.185734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23d509-a58b-46aa-8888-85ef3568e6c9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:38.197851 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 541/1079] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:46:38 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/b85fc7e555f348c3ab6c63ee15f6ceb0/roles/2f1608a8492c45d2a30b227c443cd161 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:46:38.402086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4b10c-6cb8-4f4b-a97c-2be2eb81b821 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:38.498752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4b10c-6cb8-4f4b-a97c-2be2eb81b821 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:38.532369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b84586-8846-4dd3-b7d2-8eab61fa8ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:38.532999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84586-8846-4dd3-b7d2-8eab61fa8ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:38.533280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84586-8846-4dd3-b7d2-8eab61fa8ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:38.533553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84586-8846-4dd3-b7d2-8eab61fa8ff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:38.543581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b84586-8846-4dd3-b7d2-8eab61fa8ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-c3b84586-8846-4dd3-b7d2-8eab61fa8ff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:38.548533 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:38.549639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:38.550857 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:38.551875 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 539/1080] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:46:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:38.555559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d509-a58b-46aa-8888-85ef3568e6c9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:38.658348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d509-a58b-46aa-8888-85ef3568e6c9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:38.691563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c62489-9a78-4d30-b4c6-bb57f94ed4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:38.692168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c62489-9a78-4d30-b4c6-bb57f94ed4fb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:38.692446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c62489-9a78-4d30-b4c6-bb57f94ed4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:38.692721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c62489-9a78-4d30-b4c6-bb57f94ed4fb None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:38.693372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c62489-9a78-4d30-b4c6-bb57f94ed4fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:38.693672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c62489-9a78-4d30-b4c6-bb57f94ed4fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:38.695065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c62489-9a78-4d30-b4c6-bb57f94ed4fb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:38.704112 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 542/1081] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:46:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:38.709827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b84586-8846-4dd3-b7d2-8eab61fa8ff2 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:38.752478 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:38.808238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b84586-8846-4dd3-b7d2-8eab61fa8ff2 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:38.840685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e624b2c-3ce6-4488-a799-0f4ebd3d10f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:38.841307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e624b2c-3ce6-4488-a799-0f4ebd3d10f8 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:38.841583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e624b2c-3ce6-4488-a799-0f4ebd3d10f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:38.841851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e624b2c-3ce6-4488-a799-0f4ebd3d10f8 None admin] PATH_INFO: `/v3/users/79782b16592e428a9976e81cbb240c94` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:38.842980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e624b2c-3ce6-4488-a799-0f4ebd3d10f8 None admin] RBAC: Authorizing `identity:get_user(user_id=79782b16592e428a9976e81cbb240c94)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:38.844403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e624b2c-3ce6-4488-a799-0f4ebd3d10f8 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:38.846108 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 540/1082] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:46:38 2022] GET /identity/v3/users/79782b16592e428a9976e81cbb240c94 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:38.851709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c62489-9a78-4d30-b4c6-bb57f94ed4fb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:38.886807 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:38.959673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c62489-9a78-4d30-b4c6-bb57f94ed4fb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:38.997809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b73936-3583-4468-8cb8-65b5d55b9bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:38.998581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b73936-3583-4468-8cb8-65b5d55b9bdf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:38.998889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b73936-3583-4468-8cb8-65b5d55b9bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:38.999167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b73936-3583-4468-8cb8-65b5d55b9bdf None admin] PATH_INFO: `/v3/projects/88d0c282aa2e421f88391788005d4201` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:39.000318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b73936-3583-4468-8cb8-65b5d55b9bdf None admin] RBAC: Authorizing `identity:get_project(project_id=88d0c282aa2e421f88391788005d4201)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:39.001755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b73936-3583-4468-8cb8-65b5d55b9bdf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:39.003499 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 543/1083] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:46:38 2022] GET /identity/v3/projects/88d0c282aa2e421f88391788005d4201 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:39.009814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e624b2c-3ce6-4488-a799-0f4ebd3d10f8 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:39.107938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e624b2c-3ce6-4488-a799-0f4ebd3d10f8 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:39.116517 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:39.141379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cca001-c473-4f1a-9965-9b8c15fdb778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:39.142024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cca001-c473-4f1a-9965-9b8c15fdb778 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:39.142301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cca001-c473-4f1a-9965-9b8c15fdb778 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:39.142572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cca001-c473-4f1a-9965-9b8c15fdb778 None admin] PATH_INFO: `/v3/projects/88d0c282aa2e421f88391788005d4201/users/79782b16592e428a9976e81cbb240c94/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:39.144433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cca001-c473-4f1a-9965-9b8c15fdb778 None admin] RBAC: Authorizing `identity:create_grant(project_id=88d0c282aa2e421f88391788005d4201, user_id=79782b16592e428a9976e81cbb240c94, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:39.145845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cca001-c473-4f1a-9965-9b8c15fdb778 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:39.158939 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 541/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:46:39 2022] PUT /identity/v3/projects/88d0c282aa2e421f88391788005d4201/users/79782b16592e428a9976e81cbb240c94/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:46:40.368260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fb149-ceeb-4841-a1af-7531ff3f38bc None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:40.368761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fb149-ceeb-4841-a1af-7531ff3f38bc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:40.368761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fb149-ceeb-4841-a1af-7531ff3f38bc None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:40.370817 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 544/1085] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:40.376084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739678d-6f30-4f6b-b83e-f946cc2eee6f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:40.376514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739678d-6f30-4f6b-b83e-f946cc2eee6f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:40.376634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739678d-6f30-4f6b-b83e-f946cc2eee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:40.394332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4739678d-6f30-4f6b-b83e-f946cc2eee6f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:40.395528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4739678d-6f30-4f6b-b83e-f946cc2eee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:40.458870 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 542/1086] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:40.723602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fb149-ceeb-4841-a1af-7531ff3f38bc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:40.822651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fb149-ceeb-4841-a1af-7531ff3f38bc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:40.825624 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:40.857261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28291f-bae1-4eec-9027-33639cb8202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:40.857872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28291f-bae1-4eec-9027-33639cb8202b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:40.858146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28291f-bae1-4eec-9027-33639cb8202b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:40.858410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28291f-bae1-4eec-9027-33639cb8202b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:40.868342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28291f-bae1-4eec-9027-33639cb8202b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5b28291f-bae1-4eec-9027-33639cb8202b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:40.873679 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:40.875773 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:40.876941 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 545/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 2 00:46:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:40.880774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739678d-6f30-4f6b-b83e-f946cc2eee6f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:40.979621 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:40.984237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739678d-6f30-4f6b-b83e-f946cc2eee6f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:41.019075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9f6aa-bc3f-452d-ba7e-78dc77dfa8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:41.019689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9f6aa-bc3f-452d-ba7e-78dc77dfa8af None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:41.019972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9f6aa-bc3f-452d-ba7e-78dc77dfa8af None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:41.020261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9f6aa-bc3f-452d-ba7e-78dc77dfa8af None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:41.020910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9f6aa-bc3f-452d-ba7e-78dc77dfa8af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:41.021215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9f6aa-bc3f-452d-ba7e-78dc77dfa8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:41.022582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9f6aa-bc3f-452d-ba7e-78dc77dfa8af None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:41.030797 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 543/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 2 00:46:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:41.036567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28291f-bae1-4eec-9027-33639cb8202b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:41.134039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28291f-bae1-4eec-9027-33639cb8202b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:41.168152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00d2b-ea4d-4494-a2cf-23596f260be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:41.168807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00d2b-ea4d-4494-a2cf-23596f260be2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:41.169085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00d2b-ea4d-4494-a2cf-23596f260be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:41.169357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00d2b-ea4d-4494-a2cf-23596f260be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:41.180876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d00d2b-ea4d-4494-a2cf-23596f260be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:41.182451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d00d2b-ea4d-4494-a2cf-23596f260be2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-11d00d2b-ea4d-4494-a2cf-23596f260be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:41.198705 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:41.199931 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:41.201099 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:41.201099 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:41.201099 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:41.201099 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 546/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:41.205571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9f6aa-bc3f-452d-ba7e-78dc77dfa8af None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:41.284945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da48f5-f1ff-47e3-8fd0-70462711ce95 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:41.285136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da48f5-f1ff-47e3-8fd0-70462711ce95 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:41.285412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da48f5-f1ff-47e3-8fd0-70462711ce95 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:41.286911 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 547/1090] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:41.291702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46fe0c-e345-4912-aa90-8156497cb1e1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:41.292153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46fe0c-e345-4912-aa90-8156497cb1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:41.292435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46fe0c-e345-4912-aa90-8156497cb1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:41.310722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ad46fe0c-e345-4912-aa90-8156497cb1e1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:41.311224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9f6aa-bc3f-452d-ba7e-78dc77dfa8af None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:41.311906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ad46fe0c-e345-4912-aa90-8156497cb1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:41.322467 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:41.344692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63de8eb-9e9f-4552-8849-48951b8ab3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:41.345291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de8eb-9e9f-4552-8849-48951b8ab3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:41.345572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de8eb-9e9f-4552-8849-48951b8ab3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:41.345843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de8eb-9e9f-4552-8849-48951b8ab3d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:41.346495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63de8eb-9e9f-4552-8849-48951b8ab3d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:41.346813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63de8eb-9e9f-4552-8849-48951b8ab3d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:41.348167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63de8eb-9e9f-4552-8849-48951b8ab3d6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:41.364063 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 544/1091] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:41.365011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63de8eb-9e9f-4552-8849-48951b8ab3d6 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:41.378528 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 548/1092] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:41.386924 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:41.464138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63de8eb-9e9f-4552-8849-48951b8ab3d6 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:41.496249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c92821-aae7-4497-b0a6-e79aa614da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:41.496867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92821-aae7-4497-b0a6-e79aa614da58 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:41.497146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92821-aae7-4497-b0a6-e79aa614da58 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:41.497416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92821-aae7-4497-b0a6-e79aa614da58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:41.504101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c92821-aae7-4497-b0a6-e79aa614da58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:41.505520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c92821-aae7-4497-b0a6-e79aa614da58 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-62c92821-aae7-4497-b0a6-e79aa614da58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:46:41.517120 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:41.518079 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:41.519253 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:41.519253 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:41.519253 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:46:41.519253 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:46:41.519253 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:46:41.519253 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:46:41.519253 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:46:41.519253 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:46:41.519253 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 02 00:46:41.519253 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:41.522742 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 545/1093] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 2 00:46:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:41.524097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46fe0c-e345-4912-aa90-8156497cb1e1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:41.629767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46fe0c-e345-4912-aa90-8156497cb1e1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:41.649387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c92821-aae7-4497-b0a6-e79aa614da58 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:41.663375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e616fd-1247-413a-aedb-976b3d97572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:41.663977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e616fd-1247-413a-aedb-976b3d97572e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:41.664260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e616fd-1247-413a-aedb-976b3d97572e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:41.664541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e616fd-1247-413a-aedb-976b3d97572e None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:41.665264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e616fd-1247-413a-aedb-976b3d97572e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:41.665570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e616fd-1247-413a-aedb-976b3d97572e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:41.667072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e616fd-1247-413a-aedb-976b3d97572e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:41.685188 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 549/1094] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 2 00:46:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:41.691075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e616fd-1247-413a-aedb-976b3d97572e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:41.694586 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:41.732508 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:41.751823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c92821-aae7-4497-b0a6-e79aa614da58 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:41.783127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28ef3-ba05-4c62-826d-32d223d8b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:41.783742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28ef3-ba05-4c62-826d-32d223d8b78d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:41.784019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28ef3-ba05-4c62-826d-32d223d8b78d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:41.784285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28ef3-ba05-4c62-826d-32d223d8b78d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:41.795223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28ef3-ba05-4c62-826d-32d223d8b78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:46:41.795560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e616fd-1247-413a-aedb-976b3d97572e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-1ae28ef3-ba05-4c62-826d-32d223d8b78d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:46:41.800190 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:41.801315 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:46:41.802754 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 546/1095] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:41.807829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28ef3-ba05-4c62-826d-32d223d8b78d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:41.830110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefb003-a856-470f-80ea-f771ce240dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:41.830743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefb003-a856-470f-80ea-f771ce240dee None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:41.831016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefb003-a856-470f-80ea-f771ce240dee None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:41.831286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefb003-a856-470f-80ea-f771ce240dee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:41.896902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefb003-a856-470f-80ea-f771ce240dee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:41.898279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefb003-a856-470f-80ea-f771ce240dee None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:41.900840 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:41.904608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28ef3-ba05-4c62-826d-32d223d8b78d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:41.937959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e09762-ad5f-4ea4-b0a3-4a7f803fba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:41.938559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09762-ad5f-4ea4-b0a3-4a7f803fba28 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:41.938866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09762-ad5f-4ea4-b0a3-4a7f803fba28 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:41.939134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09762-ad5f-4ea4-b0a3-4a7f803fba28 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:41.939785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e09762-ad5f-4ea4-b0a3-4a7f803fba28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:41.940083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e09762-ad5f-4ea4-b0a3-4a7f803fba28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:41.941429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e09762-ad5f-4ea4-b0a3-4a7f803fba28 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:41.949887 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 547/1096] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:41.955374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e09762-ad5f-4ea4-b0a3-4a7f803fba28 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:41.957893 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:41.999314 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 550/1097] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 02 00:46:42.005077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefb003-a856-470f-80ea-f771ce240dee None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:42.055011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e09762-ad5f-4ea4-b0a3-4a7f803fba28 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:42.089095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c21d3-e13f-4560-ac46-8042a08f0502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:42.089724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c21d3-e13f-4560-ac46-8042a08f0502 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:42.090007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c21d3-e13f-4560-ac46-8042a08f0502 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:42.090280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c21d3-e13f-4560-ac46-8042a08f0502 None admin] PATH_INFO: `/v3/users/79782b16592e428a9976e81cbb240c94` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:42.091442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c21d3-e13f-4560-ac46-8042a08f0502 None admin] RBAC: Authorizing `identity:get_user(user_id=79782b16592e428a9976e81cbb240c94)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:42.092870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c21d3-e13f-4560-ac46-8042a08f0502 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:42.099048 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 548/1098] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:46:41 2022] GET /identity/v3/users/79782b16592e428a9976e81cbb240c94 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:42.099979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c21d3-e13f-4560-ac46-8042a08f0502 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:42.101837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefb003-a856-470f-80ea-f771ce240dee None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:42.104888 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:42.137341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ef66e-426f-418c-8489-85cc148cc34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:42.137969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ef66e-426f-418c-8489-85cc148cc34b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:42.138250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ef66e-426f-418c-8489-85cc148cc34b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:42.138526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ef66e-426f-418c-8489-85cc148cc34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:42.148671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ef66e-426f-418c-8489-85cc148cc34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:42.150064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ef66e-426f-418c-8489-85cc148cc34b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-930ef66e-426f-418c-8489-85cc148cc34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:46:42.164870 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:42.165860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:46:42.166890 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:46:42.166890 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:46:42.166890 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:42.166890 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 551/1099] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:46:42.171555 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:42.172113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ef66e-426f-418c-8489-85cc148cc34b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:42.204268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c21d3-e13f-4560-ac46-8042a08f0502 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:42.236660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b56248-2e9f-4174-a64f-a368e107f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:42.237252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56248-2e9f-4174-a64f-a368e107f179 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:42.237527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56248-2e9f-4174-a64f-a368e107f179 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:42.237790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56248-2e9f-4174-a64f-a368e107f179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:42.271058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ef66e-426f-418c-8489-85cc148cc34b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:42.304867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70f55a-40a7-407e-bb6a-7cdfbed64ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:42.305460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f55a-40a7-407e-bb6a-7cdfbed64ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:42.305739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f55a-40a7-407e-bb6a-7cdfbed64ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:42.306009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f55a-40a7-407e-bb6a-7cdfbed64ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:42.306619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b56248-2e9f-4174-a64f-a368e107f179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:42.306724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70f55a-40a7-407e-bb6a-7cdfbed64ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:42.306958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70f55a-40a7-407e-bb6a-7cdfbed64ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:42.308601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b56248-2e9f-4174-a64f-a368e107f179 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:42.309046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70f55a-40a7-407e-bb6a-7cdfbed64ab8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:42.320583 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 552/1100] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:42.326873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70f55a-40a7-407e-bb6a-7cdfbed64ab8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:42.343577 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:42.375711 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:42.407568 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 549/1101] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:46:42.413385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b56248-2e9f-4174-a64f-a368e107f179 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:42.424006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70f55a-40a7-407e-bb6a-7cdfbed64ab8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:42.458298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e590f9-8a68-4992-96cd-35536f72a150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:42.458942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e590f9-8a68-4992-96cd-35536f72a150 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:42.459223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e590f9-8a68-4992-96cd-35536f72a150 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:42.459499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e590f9-8a68-4992-96cd-35536f72a150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:42.466087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e590f9-8a68-4992-96cd-35536f72a150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:42.467548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e590f9-8a68-4992-96cd-35536f72a150 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-81e590f9-8a68-4992-96cd-35536f72a150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:46:42.478366 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:46:42.479973 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:46:42.481273 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:46:42.481273 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:46:42.481273 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:46:42.481273 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:46:42.481273 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:46:42.481273 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:46:42.481273 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:46:42.481273 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:46:42.481273 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 553/1102] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:46:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:46:42.485949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e590f9-8a68-4992-96cd-35536f72a150 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:42.511811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b56248-2e9f-4174-a64f-a368e107f179 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:42.545078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab410382-f446-4e11-abb5-e254dfab3b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:42.545689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab410382-f446-4e11-abb5-e254dfab3b4f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:42.545968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab410382-f446-4e11-abb5-e254dfab3b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:42.546236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab410382-f446-4e11-abb5-e254dfab3b4f None admin] PATH_INFO: `/v3/projects/88d0c282aa2e421f88391788005d4201` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:42.547616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab410382-f446-4e11-abb5-e254dfab3b4f None admin] RBAC: Authorizing `identity:get_project(project_id=88d0c282aa2e421f88391788005d4201)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:42.549028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab410382-f446-4e11-abb5-e254dfab3b4f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:42.550645 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 550/1103] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:46:42 2022] GET /identity/v3/projects/88d0c282aa2e421f88391788005d4201 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:42.556554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab410382-f446-4e11-abb5-e254dfab3b4f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:42.561739 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:42.585569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e590f9-8a68-4992-96cd-35536f72a150 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:42.595442 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:42.619669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda28f-b697-487c-862c-3a2d718f74b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:42.620267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda28f-b697-487c-862c-3a2d718f74b0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:42.620544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda28f-b697-487c-862c-3a2d718f74b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:42.620813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda28f-b697-487c-862c-3a2d718f74b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:42.621488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda28f-b697-487c-862c-3a2d718f74b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:42.621796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda28f-b697-487c-862c-3a2d718f74b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:42.623255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda28f-b697-487c-862c-3a2d718f74b0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:42.634315 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 554/1104] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:46:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:42.640974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda28f-b697-487c-862c-3a2d718f74b0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:42.655535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab410382-f446-4e11-abb5-e254dfab3b4f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:42.689149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0246ec-ab5c-4ab0-8cb8-1d9c7c4b1558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:42.689744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0246ec-ab5c-4ab0-8cb8-1d9c7c4b1558 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:42.690026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0246ec-ab5c-4ab0-8cb8-1d9c7c4b1558 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:42.690300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0246ec-ab5c-4ab0-8cb8-1d9c7c4b1558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:42.691052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0246ec-ab5c-4ab0-8cb8-1d9c7c4b1558 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=88d0c282aa2e421f88391788005d4201, user.id=79782b16592e428a9976e81cbb240c94) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:42.691359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0246ec-ab5c-4ab0-8cb8-1d9c7c4b1558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:42.692773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0246ec-ab5c-4ab0-8cb8-1d9c7c4b1558 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:42.710647 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 551/1105] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:42 2022] GET /identity/v3/role_assignments?user.id=79782b16592e428a9976e81cbb240c94&scope.project.id=88d0c282aa2e421f88391788005d4201&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:42.740627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda28f-b697-487c-862c-3a2d718f74b0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:42.778280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d6fed-0268-4165-aa61-2641799cbbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:42.778950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6fed-0268-4165-aa61-2641799cbbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:42.779219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6fed-0268-4165-aa61-2641799cbbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:42.779495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6fed-0268-4165-aa61-2641799cbbf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:42.780232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d6fed-0268-4165-aa61-2641799cbbf3 None admin] RBAC: Adding query filter params (role.id=2f1608a8492c45d2a30b227c443cd161, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=b85fc7e555f348c3ab6c63ee15f6ceb0) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:42.780545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d6fed-0268-4165-aa61-2641799cbbf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:42.782001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d6fed-0268-4165-aa61-2641799cbbf3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:42.785267 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:42.790965 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 555/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:42 2022] GET /identity/v3/role_assignments?user.id=b85fc7e555f348c3ab6c63ee15f6ceb0&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=2f1608a8492c45d2a30b227c443cd161 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:46:44.910816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2406091-e0f4-484b-95ff-35723a7b1ce3 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:44.911351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2406091-e0f4-484b-95ff-35723a7b1ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:44.911351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2406091-e0f4-484b-95ff-35723a7b1ce3 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:44.912704 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 552/1107] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:44.918394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a7a14-5475-4c4c-9e86-6730fc15f010 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:44.918857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a7a14-5475-4c4c-9e86-6730fc15f010 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:44.918971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a7a14-5475-4c4c-9e86-6730fc15f010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:44.937457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-030a7a14-5475-4c4c-9e86-6730fc15f010 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:44.938643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-030a7a14-5475-4c4c-9e86-6730fc15f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:45.003702 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 556/1108] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:45.271006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2406091-e0f4-484b-95ff-35723a7b1ce3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:45.368908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2406091-e0f4-484b-95ff-35723a7b1ce3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:45.370472 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:45.403161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af72d7-20c2-48e5-a2e8-74feb5e418dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:45.403774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af72d7-20c2-48e5-a2e8-74feb5e418dc None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:45.404058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af72d7-20c2-48e5-a2e8-74feb5e418dc None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:45.404328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af72d7-20c2-48e5-a2e8-74feb5e418dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:45.405423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af72d7-20c2-48e5-a2e8-74feb5e418dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:45.406863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af72d7-20c2-48e5-a2e8-74feb5e418dc None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:45.408408 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 553/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:45.414134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a7a14-5475-4c4c-9e86-6730fc15f010 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:45.511300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a7a14-5475-4c4c-9e86-6730fc15f010 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:45.538717 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:45.545284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b7554-e1b7-4b5b-bbbe-b4d2f9a9566f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:45.545884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b7554-e1b7-4b5b-bbbe-b4d2f9a9566f None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:45.546165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b7554-e1b7-4b5b-bbbe-b4d2f9a9566f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:45.546714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b7554-e1b7-4b5b-bbbe-b4d2f9a9566f None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:45.547378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b7554-e1b7-4b5b-bbbe-b4d2f9a9566f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:45.548815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b7554-e1b7-4b5b-bbbe-b4d2f9a9566f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:45.569554 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 557/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:46:45 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:46:47.778609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5446-2b83-4d06-99f6-322aa8c212a6 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:47.779184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5446-2b83-4d06-99f6-322aa8c212a6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:47.779184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5446-2b83-4d06-99f6-322aa8c212a6 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:47.780485 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 554/1111] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:47.785776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318000be-1145-405e-b36a-adacfe99232e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:47.786189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318000be-1145-405e-b36a-adacfe99232e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:47.786308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318000be-1145-405e-b36a-adacfe99232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:47.804826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-318000be-1145-405e-b36a-adacfe99232e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:47.806001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-318000be-1145-405e-b36a-adacfe99232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:47.871273 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 558/1112] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:48.137985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec5446-2b83-4d06-99f6-322aa8c212a6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:48.236012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec5446-2b83-4d06-99f6-322aa8c212a6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:48.267431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b7802-87fa-4f01-b0c7-917feff5d3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:48.268041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7802-87fa-4f01-b0c7-917feff5d3ba None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:48.268318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7802-87fa-4f01-b0c7-917feff5d3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:48.268589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7802-87fa-4f01-b0c7-917feff5d3ba None admin] PATH_INFO: `/v3/roles/25dd37ef41a046b1b26386c2672249fe` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:48.269942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b7802-87fa-4f01-b0c7-917feff5d3ba None admin] RBAC: Authorizing `identity:get_role(role_id=25dd37ef41a046b1b26386c2672249fe)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:48.271327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b7802-87fa-4f01-b0c7-917feff5d3ba None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:48.272623 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 555/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:46:48 2022] GET /identity/v3/roles/25dd37ef41a046b1b26386c2672249fe => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:48.279006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318000be-1145-405e-b36a-adacfe99232e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:48.375526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318000be-1145-405e-b36a-adacfe99232e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:48.391235 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:48.409644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700cc30-75f0-4673-8a9f-d379013a3dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:48.410263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700cc30-75f0-4673-8a9f-d379013a3dfe None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:48.410543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700cc30-75f0-4673-8a9f-d379013a3dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:48.410848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700cc30-75f0-4673-8a9f-d379013a3dfe None admin] PATH_INFO: `/v3/users/cf135d004fe44f16bb1ffcce82d8ed10` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:48.424530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700cc30-75f0-4673-8a9f-d379013a3dfe None admin] RBAC: Authorizing `identity:get_user(user_id=cf135d004fe44f16bb1ffcce82d8ed10)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:48.425968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700cc30-75f0-4673-8a9f-d379013a3dfe None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:48.427588 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 559/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:46:48 2022] GET /identity/v3/users/cf135d004fe44f16bb1ffcce82d8ed10 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:48.433390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b7802-87fa-4f01-b0c7-917feff5d3ba None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:48.471892 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:48.529522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b7802-87fa-4f01-b0c7-917feff5d3ba None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:48.561512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ecf35-a562-461d-a62c-5770b57fbf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:48.562098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ecf35-a562-461d-a62c-5770b57fbf9a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:48.562378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ecf35-a562-461d-a62c-5770b57fbf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:48.562675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ecf35-a562-461d-a62c-5770b57fbf9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:48.626109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ecf35-a562-461d-a62c-5770b57fbf9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:48.627588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ecf35-a562-461d-a62c-5770b57fbf9a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:48.663603 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:48.722012 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 556/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:46:48.727883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700cc30-75f0-4673-8a9f-d379013a3dfe None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:48.822560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700cc30-75f0-4673-8a9f-d379013a3dfe None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:48.855266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429afe1-1a37-4f43-8f10-34102e3ed40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:48.855872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429afe1-1a37-4f43-8f10-34102e3ed40a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:48.856149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429afe1-1a37-4f43-8f10-34102e3ed40a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:48.856417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429afe1-1a37-4f43-8f10-34102e3ed40a None admin] PATH_INFO: `/v3/projects/88d0c282aa2e421f88391788005d4201` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:48.857497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429afe1-1a37-4f43-8f10-34102e3ed40a None admin] RBAC: Authorizing `identity:get_project(project_id=88d0c282aa2e421f88391788005d4201)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:48.858942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429afe1-1a37-4f43-8f10-34102e3ed40a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:48.860517 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 560/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:46:48 2022] GET /identity/v3/projects/88d0c282aa2e421f88391788005d4201 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:48.866435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ecf35-a562-461d-a62c-5770b57fbf9a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:48.959901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ecf35-a562-461d-a62c-5770b57fbf9a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:48.993307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cabc72-ab67-4661-8333-1b5d68a6c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:48.993902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cabc72-ab67-4661-8333-1b5d68a6c349 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:48.994183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cabc72-ab67-4661-8333-1b5d68a6c349 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:48.994457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cabc72-ab67-4661-8333-1b5d68a6c349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:48.995252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cabc72-ab67-4661-8333-1b5d68a6c349 None admin] RBAC: Adding query filter params (role.id=25dd37ef41a046b1b26386c2672249fe, scope.project.id=88d0c282aa2e421f88391788005d4201, user.id=cf135d004fe44f16bb1ffcce82d8ed10) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:48.995556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cabc72-ab67-4661-8333-1b5d68a6c349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:48.996972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cabc72-ab67-4661-8333-1b5d68a6c349 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:49.002169 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 557/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:48 2022] GET /identity/v3/role_assignments?user.id=cf135d004fe44f16bb1ffcce82d8ed10&scope.project.id=88d0c282aa2e421f88391788005d4201&role.id=25dd37ef41a046b1b26386c2672249fe => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:51.112622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506b06-dec5-4369-b47a-c0c160143d71 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:51.113148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506b06-dec5-4369-b47a-c0c160143d71 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:51.113148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506b06-dec5-4369-b47a-c0c160143d71 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:51.114564 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 561/1118] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:51.119667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19588ee-6de5-45a3-bdd1-de331d79378b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:51.120099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19588ee-6de5-45a3-bdd1-de331d79378b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:51.120238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19588ee-6de5-45a3-bdd1-de331d79378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:51.127286 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:51.139836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d19588ee-6de5-45a3-bdd1-de331d79378b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:51.141003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d19588ee-6de5-45a3-bdd1-de331d79378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:51.203169 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 558/1119] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:51.474516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62506b06-dec5-4369-b47a-c0c160143d71 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:51.517412 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:51.571772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62506b06-dec5-4369-b47a-c0c160143d71 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:51.604931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9bdb9-1d8f-4927-b7e5-2eb7d363b42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:51.605546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9bdb9-1d8f-4927-b7e5-2eb7d363b42e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:51.605830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9bdb9-1d8f-4927-b7e5-2eb7d363b42e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:51.606107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9bdb9-1d8f-4927-b7e5-2eb7d363b42e None admin] PATH_INFO: `/v3/roles/25dd37ef41a046b1b26386c2672249fe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:51.607510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9bdb9-1d8f-4927-b7e5-2eb7d363b42e None admin] RBAC: Authorizing `identity:get_role(role_id=25dd37ef41a046b1b26386c2672249fe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:51.608883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9bdb9-1d8f-4927-b7e5-2eb7d363b42e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:51.610198 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 562/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:46:51 2022] GET /identity/v3/roles/25dd37ef41a046b1b26386c2672249fe => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:51.616100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19588ee-6de5-45a3-bdd1-de331d79378b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:51.711707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19588ee-6de5-45a3-bdd1-de331d79378b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:51.739589 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:51.744641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc4e7d-5caa-463e-bbd0-f23deccee526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:51.745396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc4e7d-5caa-463e-bbd0-f23deccee526 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:51.745692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc4e7d-5caa-463e-bbd0-f23deccee526 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:51.745968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc4e7d-5caa-463e-bbd0-f23deccee526 None admin] PATH_INFO: `/v3/users/cf135d004fe44f16bb1ffcce82d8ed10` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:51.747105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc4e7d-5caa-463e-bbd0-f23deccee526 None admin] RBAC: Authorizing `identity:get_user(user_id=cf135d004fe44f16bb1ffcce82d8ed10)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:51.748529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc4e7d-5caa-463e-bbd0-f23deccee526 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:51.750082 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 559/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:46:51 2022] GET /identity/v3/users/cf135d004fe44f16bb1ffcce82d8ed10 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:51.755839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9bdb9-1d8f-4927-b7e5-2eb7d363b42e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:51.851628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9bdb9-1d8f-4927-b7e5-2eb7d363b42e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:51.861912 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:51.884881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1801-ba4b-42bb-b539-8e55b7dc3c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:51.886153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1801-ba4b-42bb-b539-8e55b7dc3c87 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:51.886565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1801-ba4b-42bb-b539-8e55b7dc3c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:51.886878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1801-ba4b-42bb-b539-8e55b7dc3c87 None admin] PATH_INFO: `/v3/projects/88d0c282aa2e421f88391788005d4201` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:51.887985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a1801-ba4b-42bb-b539-8e55b7dc3c87 None admin] RBAC: Authorizing `identity:get_project(project_id=88d0c282aa2e421f88391788005d4201)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:51.889414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a1801-ba4b-42bb-b539-8e55b7dc3c87 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:51.891042 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 563/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:46:51 2022] GET /identity/v3/projects/88d0c282aa2e421f88391788005d4201 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:51.897003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc4e7d-5caa-463e-bbd0-f23deccee526 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:51.992189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc4e7d-5caa-463e-bbd0-f23deccee526 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:52.024374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba89b6-640e-47e4-a060-d0639e947520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:52.025011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba89b6-640e-47e4-a060-d0639e947520 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:52.025284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba89b6-640e-47e4-a060-d0639e947520 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:52.025552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba89b6-640e-47e4-a060-d0639e947520 None admin] PATH_INFO: `/v3/projects/88d0c282aa2e421f88391788005d4201/users/cf135d004fe44f16bb1ffcce82d8ed10/roles/25dd37ef41a046b1b26386c2672249fe` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:52.027655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba89b6-640e-47e4-a060-d0639e947520 None admin] RBAC: Authorizing `identity:create_grant(project_id=88d0c282aa2e421f88391788005d4201, user_id=cf135d004fe44f16bb1ffcce82d8ed10, role_id=25dd37ef41a046b1b26386c2672249fe)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:52.029070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba89b6-640e-47e4-a060-d0639e947520 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:52.041202 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 560/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:46:51 2022] PUT /identity/v3/projects/88d0c282aa2e421f88391788005d4201/users/cf135d004fe44f16bb1ffcce82d8ed10/roles/25dd37ef41a046b1b26386c2672249fe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:46:54.170148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16ecac-6452-4eca-9e5d-25d84ff2c397 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:54.170714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16ecac-6452-4eca-9e5d-25d84ff2c397 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:54.170829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16ecac-6452-4eca-9e5d-25d84ff2c397 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:54.172341 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 564/1124] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:54.177659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14f40f-04b9-426d-bd33-312fdd58ae58 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:54.178079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14f40f-04b9-426d-bd33-312fdd58ae58 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:54.178204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14f40f-04b9-426d-bd33-312fdd58ae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:54.196238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5d14f40f-04b9-426d-bd33-312fdd58ae58 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:54.197393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5d14f40f-04b9-426d-bd33-312fdd58ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:54.251733 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:54.263964 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 561/1125] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:46:54.543832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16ecac-6452-4eca-9e5d-25d84ff2c397 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:54.642056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16ecac-6452-4eca-9e5d-25d84ff2c397 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:54.675159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81af99-3e9a-458c-a401-1d5a8736e936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:54.675774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81af99-3e9a-458c-a401-1d5a8736e936 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:54.676055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81af99-3e9a-458c-a401-1d5a8736e936 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:54.676331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81af99-3e9a-458c-a401-1d5a8736e936 None admin] PATH_INFO: `/v3/roles/25dd37ef41a046b1b26386c2672249fe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:54.677694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81af99-3e9a-458c-a401-1d5a8736e936 None admin] RBAC: Authorizing `identity:get_role(role_id=25dd37ef41a046b1b26386c2672249fe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:54.679088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81af99-3e9a-458c-a401-1d5a8736e936 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:54.680385 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 565/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:46:54 2022] GET /identity/v3/roles/25dd37ef41a046b1b26386c2672249fe => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:54.686652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14f40f-04b9-426d-bd33-312fdd58ae58 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:54.778849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14f40f-04b9-426d-bd33-312fdd58ae58 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:54.811814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1afba-b447-47b5-843b-0333d22f6c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:54.812371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1afba-b447-47b5-843b-0333d22f6c9a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:54.812650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1afba-b447-47b5-843b-0333d22f6c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:54.812924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1afba-b447-47b5-843b-0333d22f6c9a None admin] PATH_INFO: `/v3/users/cf135d004fe44f16bb1ffcce82d8ed10` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:54.814015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1afba-b447-47b5-843b-0333d22f6c9a None admin] RBAC: Authorizing `identity:get_user(user_id=cf135d004fe44f16bb1ffcce82d8ed10)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:54.815462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1afba-b447-47b5-843b-0333d22f6c9a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:54.816997 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 562/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:46:54 2022] GET /identity/v3/users/cf135d004fe44f16bb1ffcce82d8ed10 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:54.822681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81af99-3e9a-458c-a401-1d5a8736e936 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:54.868638 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:54.919759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81af99-3e9a-458c-a401-1d5a8736e936 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:54.952381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700bcc3-9772-4fee-87f7-746801d7e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:54.952976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700bcc3-9772-4fee-87f7-746801d7e00d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:54.953256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700bcc3-9772-4fee-87f7-746801d7e00d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:54.953527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700bcc3-9772-4fee-87f7-746801d7e00d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:55.017926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700bcc3-9772-4fee-87f7-746801d7e00d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:55.021155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700bcc3-9772-4fee-87f7-746801d7e00d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:55.064385 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:55.116012 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 566/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:46:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:46:55.122069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1afba-b447-47b5-843b-0333d22f6c9a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:55.177197 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:55.217448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1afba-b447-47b5-843b-0333d22f6c9a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:55.248783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca4ce4-ef79-4d9a-85f9-a2081f176c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:55.249399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca4ce4-ef79-4d9a-85f9-a2081f176c98 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:55.249676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca4ce4-ef79-4d9a-85f9-a2081f176c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:55.249946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca4ce4-ef79-4d9a-85f9-a2081f176c98 None admin] PATH_INFO: `/v3/projects/88d0c282aa2e421f88391788005d4201` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:55.251052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca4ce4-ef79-4d9a-85f9-a2081f176c98 None admin] RBAC: Authorizing `identity:get_project(project_id=88d0c282aa2e421f88391788005d4201)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:55.252463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca4ce4-ef79-4d9a-85f9-a2081f176c98 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:55.254047 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 563/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:46:55 2022] GET /identity/v3/projects/88d0c282aa2e421f88391788005d4201 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:55.260220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700bcc3-9772-4fee-87f7-746801d7e00d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:55.355660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700bcc3-9772-4fee-87f7-746801d7e00d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:55.388134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b5d18-1322-42c6-9e1b-fc57788c32d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:55.388727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b5d18-1322-42c6-9e1b-fc57788c32d0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:55.389007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b5d18-1322-42c6-9e1b-fc57788c32d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:55.389279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b5d18-1322-42c6-9e1b-fc57788c32d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:55.389993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b5d18-1322-42c6-9e1b-fc57788c32d0 None admin] RBAC: Adding query filter params (role.id=25dd37ef41a046b1b26386c2672249fe, scope.project.id=88d0c282aa2e421f88391788005d4201, user.id=cf135d004fe44f16bb1ffcce82d8ed10) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:46:55.390297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b5d18-1322-42c6-9e1b-fc57788c32d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:55.391750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b5d18-1322-42c6-9e1b-fc57788c32d0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:55.397221 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 567/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:46:55 2022] GET /identity/v3/role_assignments?user.id=cf135d004fe44f16bb1ffcce82d8ed10&scope.project.id=88d0c282aa2e421f88391788005d4201&role.id=25dd37ef41a046b1b26386c2672249fe => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:57.548045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d23e-989a-4f1e-85c4-7f2545e823b3 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:57.548577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d23e-989a-4f1e-85c4-7f2545e823b3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:57.548577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d23e-989a-4f1e-85c4-7f2545e823b3 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:57.549909 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 564/1131] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:46:57.555046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6da1a3-7272-4abc-ae8d-4984d82c6ecc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:57.555486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6da1a3-7272-4abc-ae8d-4984d82c6ecc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:57.555582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6da1a3-7272-4abc-ae8d-4984d82c6ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:57.574566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0b6da1a3-7272-4abc-ae8d-4984d82c6ecc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:46:57.575759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b6da1a3-7272-4abc-ae8d-4984d82c6ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:46:57.578412 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:57.640134 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 568/1132] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:46:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:46:57.906329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28d23e-989a-4f1e-85c4-7f2545e823b3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:58.003761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28d23e-989a-4f1e-85c4-7f2545e823b3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:58.028570 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:58.037341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3de422-841c-4c65-b10b-dafcff5ee862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:58.037955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3de422-841c-4c65-b10b-dafcff5ee862 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:58.038228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3de422-841c-4c65-b10b-dafcff5ee862 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:58.038496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3de422-841c-4c65-b10b-dafcff5ee862 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:58.039603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3de422-841c-4c65-b10b-dafcff5ee862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:58.041015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3de422-841c-4c65-b10b-dafcff5ee862 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:58.042577 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 565/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:46:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:46:58.048617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6da1a3-7272-4abc-ae8d-4984d82c6ecc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:46:58.145354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6da1a3-7272-4abc-ae8d-4984d82c6ecc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:46:58.177556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29091f0-ef09-4c1f-8fab-8e928d78408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:46:58.178145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29091f0-ef09-4c1f-8fab-8e928d78408b None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:46:58.178422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29091f0-ef09-4c1f-8fab-8e928d78408b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:46:58.178721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29091f0-ef09-4c1f-8fab-8e928d78408b None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:46:58.179357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29091f0-ef09-4c1f-8fab-8e928d78408b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:46:58.180777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29091f0-ef09-4c1f-8fab-8e928d78408b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:46:58.191798 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:46:58.207139 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 569/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:46:58 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:47:00.361091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ccc79-cf4b-4800-ad9a-32af69fa8273 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:00.361590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ccc79-cf4b-4800-ad9a-32af69fa8273 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:00.361590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ccc79-cf4b-4800-ad9a-32af69fa8273 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:00.362893 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 566/1135] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:00.368244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f70e8-5184-44ba-ab84-f8bef5c386e4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:00.368671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f70e8-5184-44ba-ab84-f8bef5c386e4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:00.368779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f70e8-5184-44ba-ab84-f8bef5c386e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:00.386321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f54f70e8-5184-44ba-ab84-f8bef5c386e4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:00.387553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f54f70e8-5184-44ba-ab84-f8bef5c386e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:00.453578 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 570/1136] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:47:00.720004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ccc79-cf4b-4800-ad9a-32af69fa8273 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:00.816568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ccc79-cf4b-4800-ad9a-32af69fa8273 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:00.848213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a0dc6-e733-4f09-881f-8ec4a37dc515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:00.848816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a0dc6-e733-4f09-881f-8ec4a37dc515 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:00.849091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a0dc6-e733-4f09-881f-8ec4a37dc515 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:00.849359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a0dc6-e733-4f09-881f-8ec4a37dc515 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:00.850436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a0dc6-e733-4f09-881f-8ec4a37dc515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:00.851868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a0dc6-e733-4f09-881f-8ec4a37dc515 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:00.853374 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 567/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:47:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:00.859652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f70e8-5184-44ba-ab84-f8bef5c386e4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:00.952654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f70e8-5184-44ba-ab84-f8bef5c386e4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:00.974707 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:00.987462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d7119-43bf-487c-a66c-6819e34089c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:00.988061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d7119-43bf-487c-a66c-6819e34089c6 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:00.988340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d7119-43bf-487c-a66c-6819e34089c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:00.988614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d7119-43bf-487c-a66c-6819e34089c6 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:00.989309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d7119-43bf-487c-a66c-6819e34089c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:00.990775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d7119-43bf-487c-a66c-6819e34089c6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:01.010536 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 571/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:47:00 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:47:03.183596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742583-8cb9-4787-95c1-72f209822290 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:03.184140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742583-8cb9-4787-95c1-72f209822290 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:03.184235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742583-8cb9-4787-95c1-72f209822290 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:03.185520 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 568/1139] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:03.190838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7fb4-d56d-4dbe-b201-4620a215be90 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:03.191224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7fb4-d56d-4dbe-b201-4620a215be90 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:03.191428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7fb4-d56d-4dbe-b201-4620a215be90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:03.209834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-84ea7fb4-d56d-4dbe-b201-4620a215be90 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:03.211046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-84ea7fb4-d56d-4dbe-b201-4620a215be90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:03.275760 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 572/1140] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:47:03.541853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3742583-8cb9-4787-95c1-72f209822290 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:03.601434 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:03.640640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3742583-8cb9-4787-95c1-72f209822290 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:03.672957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287dad0-3f17-477c-8d20-2dd99639de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:03.673568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287dad0-3f17-477c-8d20-2dd99639de42 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:03.673847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287dad0-3f17-477c-8d20-2dd99639de42 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:03.674119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287dad0-3f17-477c-8d20-2dd99639de42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:03.684314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287dad0-3f17-477c-8d20-2dd99639de42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-f287dad0-3f17-477c-8d20-2dd99639de42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:47:03.688971 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:47:03.689880 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:47:03.690799 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 569/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:47:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:47:03.696060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7fb4-d56d-4dbe-b201-4620a215be90 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:03.793125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7fb4-d56d-4dbe-b201-4620a215be90 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:03.802123 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:03.828429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f15c6-9719-4ad4-83bc-a82065a65375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:03.829031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f15c6-9719-4ad4-83bc-a82065a65375 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:03.829311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f15c6-9719-4ad4-83bc-a82065a65375 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:03.829583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f15c6-9719-4ad4-83bc-a82065a65375 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:03.830240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f15c6-9719-4ad4-83bc-a82065a65375 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:47:03.830541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f15c6-9719-4ad4-83bc-a82065a65375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:03.831946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f15c6-9719-4ad4-83bc-a82065a65375 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:03.840178 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 573/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:47:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:03.846052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287dad0-3f17-477c-8d20-2dd99639de42 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:03.940891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287dad0-3f17-477c-8d20-2dd99639de42 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:03.961691 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:03.973765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfe3e4-c8e7-4b00-8ba9-db72b1f40cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:03.974395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe3e4-c8e7-4b00-8ba9-db72b1f40cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:03.974708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe3e4-c8e7-4b00-8ba9-db72b1f40cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:03.974985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe3e4-c8e7-4b00-8ba9-db72b1f40cb4 None admin] PATH_INFO: `/v3/users/cc11055e38644f479a21294018210a5e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:03.988497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfe3e4-c8e7-4b00-8ba9-db72b1f40cb4 None admin] RBAC: Authorizing `identity:get_user(user_id=cc11055e38644f479a21294018210a5e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:03.989927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfe3e4-c8e7-4b00-8ba9-db72b1f40cb4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:03.991558 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 570/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:47:03 2022] GET /identity/v3/users/cc11055e38644f479a21294018210a5e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:03.997455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f15c6-9719-4ad4-83bc-a82065a65375 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:04.094576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f15c6-9719-4ad4-83bc-a82065a65375 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:04.126580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42a4bd-5041-40fe-9c31-925782ea78d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:04.127205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42a4bd-5041-40fe-9c31-925782ea78d9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:04.127482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42a4bd-5041-40fe-9c31-925782ea78d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:04.127753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42a4bd-5041-40fe-9c31-925782ea78d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:04.164199 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:04.191863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42a4bd-5041-40fe-9c31-925782ea78d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:04.193293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42a4bd-5041-40fe-9c31-925782ea78d9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:04.287672 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 574/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:47:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:47:04.293615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfe3e4-c8e7-4b00-8ba9-db72b1f40cb4 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:04.390068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfe3e4-c8e7-4b00-8ba9-db72b1f40cb4 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:04.421970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943485d-4440-4706-828e-08b70351a28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:04.422867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943485d-4440-4706-828e-08b70351a28b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:04.423147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943485d-4440-4706-828e-08b70351a28b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:04.423418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943485d-4440-4706-828e-08b70351a28b None admin] PATH_INFO: `/v3/projects/26df428a61284969bb20b4dc9efaef6d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:04.424500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943485d-4440-4706-828e-08b70351a28b None admin] RBAC: Authorizing `identity:get_project(project_id=26df428a61284969bb20b4dc9efaef6d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:04.425909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943485d-4440-4706-828e-08b70351a28b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:04.427527 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 571/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:47:04 2022] GET /identity/v3/projects/26df428a61284969bb20b4dc9efaef6d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:04.433917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42a4bd-5041-40fe-9c31-925782ea78d9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:04.500325 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:04.531107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42a4bd-5041-40fe-9c31-925782ea78d9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:04.563971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1176-af56-433f-9851-43711e454142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:04.564555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1176-af56-433f-9851-43711e454142 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:04.564830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1176-af56-433f-9851-43711e454142 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:04.565096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1176-af56-433f-9851-43711e454142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:04.565806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d1176-af56-433f-9851-43711e454142 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=26df428a61284969bb20b4dc9efaef6d, user.id=cc11055e38644f479a21294018210a5e) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:47:04.566108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d1176-af56-433f-9851-43711e454142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:04.567539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d1176-af56-433f-9851-43711e454142 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:04.572658 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 575/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:47:04 2022] GET /identity/v3/role_assignments?user.id=cc11055e38644f479a21294018210a5e&scope.project.id=26df428a61284969bb20b4dc9efaef6d&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:47:06.669651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714f60b-cd52-458b-9340-6a80876e3cfa None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:06.670283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714f60b-cd52-458b-9340-6a80876e3cfa None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:06.670283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714f60b-cd52-458b-9340-6a80876e3cfa None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:06.671537 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 572/1147] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:06.677053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f6c28-8ecb-44dd-b5cb-83222e8aad45 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:06.677489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f6c28-8ecb-44dd-b5cb-83222e8aad45 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:06.677590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f6c28-8ecb-44dd-b5cb-83222e8aad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:06.695106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9d9f6c28-8ecb-44dd-b5cb-83222e8aad45 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:06.696265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9d9f6c28-8ecb-44dd-b5cb-83222e8aad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:06.762706 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 576/1148] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:47:07.029187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714f60b-cd52-458b-9340-6a80876e3cfa None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:07.077498 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:07.126956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714f60b-cd52-458b-9340-6a80876e3cfa None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:07.159144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303202f-ce33-4116-9415-07d1c72ba5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:07.159746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303202f-ce33-4116-9415-07d1c72ba5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:07.160021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303202f-ce33-4116-9415-07d1c72ba5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:07.160289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303202f-ce33-4116-9415-07d1c72ba5c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:07.170348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303202f-ce33-4116-9415-07d1c72ba5c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-f303202f-ce33-4116-9415-07d1c72ba5c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:47:07.175271 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:47:07.176439 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:47:07.177561 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 573/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:47:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:47:07.182210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f6c28-8ecb-44dd-b5cb-83222e8aad45 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:07.241754 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:07.278593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f6c28-8ecb-44dd-b5cb-83222e8aad45 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:07.311038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcb8fc-5510-450d-9515-be7e76184aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:07.311632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb8fc-5510-450d-9515-be7e76184aaf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:07.311910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb8fc-5510-450d-9515-be7e76184aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:07.312180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb8fc-5510-450d-9515-be7e76184aaf None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:07.312838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcb8fc-5510-450d-9515-be7e76184aaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:47:07.313139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcb8fc-5510-450d-9515-be7e76184aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:07.314505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcb8fc-5510-450d-9515-be7e76184aaf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:07.322253 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 577/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:47:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:07.328671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303202f-ce33-4116-9415-07d1c72ba5c2 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:07.424761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303202f-ce33-4116-9415-07d1c72ba5c2 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:07.433653 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:07.457919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8060aa1-9c7f-4a23-a0f8-ccb22c3f6371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:07.458531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8060aa1-9c7f-4a23-a0f8-ccb22c3f6371 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:07.458838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8060aa1-9c7f-4a23-a0f8-ccb22c3f6371 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:07.459112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8060aa1-9c7f-4a23-a0f8-ccb22c3f6371 None admin] PATH_INFO: `/v3/users/cc11055e38644f479a21294018210a5e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:07.460212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8060aa1-9c7f-4a23-a0f8-ccb22c3f6371 None admin] RBAC: Authorizing `identity:get_user(user_id=cc11055e38644f479a21294018210a5e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:07.461630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8060aa1-9c7f-4a23-a0f8-ccb22c3f6371 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:07.463210 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 574/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:47:07 2022] GET /identity/v3/users/cc11055e38644f479a21294018210a5e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:07.469186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcb8fc-5510-450d-9515-be7e76184aaf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:07.569547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcb8fc-5510-450d-9515-be7e76184aaf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:07.593917 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:07.602673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546389c-1bf4-47c4-a43d-62382cf89dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:07.603295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546389c-1bf4-47c4-a43d-62382cf89dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:07.603579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546389c-1bf4-47c4-a43d-62382cf89dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:07.603855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546389c-1bf4-47c4-a43d-62382cf89dc0 None admin] PATH_INFO: `/v3/projects/26df428a61284969bb20b4dc9efaef6d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:07.605626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546389c-1bf4-47c4-a43d-62382cf89dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=26df428a61284969bb20b4dc9efaef6d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:07.607085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546389c-1bf4-47c4-a43d-62382cf89dc0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:07.608698 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 578/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:47:07 2022] GET /identity/v3/projects/26df428a61284969bb20b4dc9efaef6d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:07.614574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8060aa1-9c7f-4a23-a0f8-ccb22c3f6371 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:07.707970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8060aa1-9c7f-4a23-a0f8-ccb22c3f6371 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:07.741615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9856558-6383-4d8b-9b57-b14689a14c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:07.742249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9856558-6383-4d8b-9b57-b14689a14c2c None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:07.742529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9856558-6383-4d8b-9b57-b14689a14c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:07.742827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9856558-6383-4d8b-9b57-b14689a14c2c None admin] PATH_INFO: `/v3/projects/26df428a61284969bb20b4dc9efaef6d/users/cc11055e38644f479a21294018210a5e/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:07.744673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9856558-6383-4d8b-9b57-b14689a14c2c None admin] RBAC: Authorizing `identity:create_grant(project_id=26df428a61284969bb20b4dc9efaef6d, user_id=cc11055e38644f479a21294018210a5e, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:07.746985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9856558-6383-4d8b-9b57-b14689a14c2c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:07.759355 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 575/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:47:07 2022] PUT /identity/v3/projects/26df428a61284969bb20b4dc9efaef6d/users/cc11055e38644f479a21294018210a5e/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:47:09.888523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a07ec0-f594-4a4f-b6c1-96ceb5471ad7 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:09.889121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a07ec0-f594-4a4f-b6c1-96ceb5471ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:09.889121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a07ec0-f594-4a4f-b6c1-96ceb5471ad7 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:09.890401 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 579/1154] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:09.895568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6a881-ebfe-4e33-b66c-9b643049b29f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:09.895960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6a881-ebfe-4e33-b66c-9b643049b29f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:09.896114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6a881-ebfe-4e33-b66c-9b643049b29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:09.913577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6fa6a881-ebfe-4e33-b66c-9b643049b29f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:09.914772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6fa6a881-ebfe-4e33-b66c-9b643049b29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:09.942745 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:09.979553 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 576/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:47:10.248902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a07ec0-f594-4a4f-b6c1-96ceb5471ad7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:10.347105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a07ec0-f594-4a4f-b6c1-96ceb5471ad7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:10.380196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750f75a-d3a6-4d39-8023-41a9579237eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:10.380812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750f75a-d3a6-4d39-8023-41a9579237eb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:10.381092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750f75a-d3a6-4d39-8023-41a9579237eb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:10.381365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750f75a-d3a6-4d39-8023-41a9579237eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:10.391611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750f75a-d3a6-4d39-8023-41a9579237eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b750f75a-d3a6-4d39-8023-41a9579237eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:47:10.396312 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:47:10.397424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:47:10.398647 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 580/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:47:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:47:10.403478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6a881-ebfe-4e33-b66c-9b643049b29f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:10.497364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6a881-ebfe-4e33-b66c-9b643049b29f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:10.529619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f76ec-031a-4e05-934b-b35d7d883e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:10.530154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f76ec-031a-4e05-934b-b35d7d883e7e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:10.530436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f76ec-031a-4e05-934b-b35d7d883e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:10.530747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f76ec-031a-4e05-934b-b35d7d883e7e None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:10.531409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f76ec-031a-4e05-934b-b35d7d883e7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:47:10.531713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f76ec-031a-4e05-934b-b35d7d883e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:10.533070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f76ec-031a-4e05-934b-b35d7d883e7e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:10.540770 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 577/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:47:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:10.547243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750f75a-d3a6-4d39-8023-41a9579237eb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:10.600807 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:10.645743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750f75a-d3a6-4d39-8023-41a9579237eb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:10.678731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9daaf2-8ee7-4191-bebb-151cf421dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:10.679342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9daaf2-8ee7-4191-bebb-151cf421dccf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:10.679622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9daaf2-8ee7-4191-bebb-151cf421dccf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:10.679892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9daaf2-8ee7-4191-bebb-151cf421dccf None admin] PATH_INFO: `/v3/users/cc11055e38644f479a21294018210a5e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:10.680989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9daaf2-8ee7-4191-bebb-151cf421dccf None admin] RBAC: Authorizing `identity:get_user(user_id=cc11055e38644f479a21294018210a5e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:10.682413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9daaf2-8ee7-4191-bebb-151cf421dccf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:10.684336 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 581/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:47:10 2022] GET /identity/v3/users/cc11055e38644f479a21294018210a5e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:10.690194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f76ec-031a-4e05-934b-b35d7d883e7e None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:10.717919 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:10.785486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f76ec-031a-4e05-934b-b35d7d883e7e None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:10.818648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9addb8d-1ddd-4412-97e9-916b26c44a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:10.819243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9addb8d-1ddd-4412-97e9-916b26c44a96 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:10.819521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9addb8d-1ddd-4412-97e9-916b26c44a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:10.819792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9addb8d-1ddd-4412-97e9-916b26c44a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:10.883298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9addb8d-1ddd-4412-97e9-916b26c44a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:10.884719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9addb8d-1ddd-4412-97e9-916b26c44a96 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:10.910008 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:10.978069 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 578/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:47:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:47:10.984042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9daaf2-8ee7-4191-bebb-151cf421dccf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:11.079478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9daaf2-8ee7-4191-bebb-151cf421dccf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:11.101886 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:11.113728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8b1b-dfae-4c7e-82b7-50d01efdec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:11.114349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8b1b-dfae-4c7e-82b7-50d01efdec1c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:11.114654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8b1b-dfae-4c7e-82b7-50d01efdec1c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:11.114929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8b1b-dfae-4c7e-82b7-50d01efdec1c None admin] PATH_INFO: `/v3/projects/26df428a61284969bb20b4dc9efaef6d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:11.116013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf8b1b-dfae-4c7e-82b7-50d01efdec1c None admin] RBAC: Authorizing `identity:get_project(project_id=26df428a61284969bb20b4dc9efaef6d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:11.117437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf8b1b-dfae-4c7e-82b7-50d01efdec1c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:11.119098 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 582/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:47:10 2022] GET /identity/v3/projects/26df428a61284969bb20b4dc9efaef6d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:11.125494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9addb8d-1ddd-4412-97e9-916b26c44a96 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:11.221946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9addb8d-1ddd-4412-97e9-916b26c44a96 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:11.246838 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:11.254802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c262ff2-b200-4818-9f3d-3749f70c1f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:11.255395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c262ff2-b200-4818-9f3d-3749f70c1f20 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:11.255676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c262ff2-b200-4818-9f3d-3749f70c1f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:11.255951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c262ff2-b200-4818-9f3d-3749f70c1f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:11.256671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c262ff2-b200-4818-9f3d-3749f70c1f20 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=26df428a61284969bb20b4dc9efaef6d, user.id=cc11055e38644f479a21294018210a5e) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:47:11.256981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c262ff2-b200-4818-9f3d-3749f70c1f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:11.258397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c262ff2-b200-4818-9f3d-3749f70c1f20 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:11.264486 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 579/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:47:11 2022] GET /identity/v3/role_assignments?user.id=cc11055e38644f479a21294018210a5e&scope.project.id=26df428a61284969bb20b4dc9efaef6d&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:13.444434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464f359-33a7-4f62-91d8-59e501d1e869 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:13.444970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464f359-33a7-4f62-91d8-59e501d1e869 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:13.444970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464f359-33a7-4f62-91d8-59e501d1e869 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:13.446319 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 583/1162] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:13.452351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432e8d-c071-4c1e-9f8a-5ddc20d76043 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:13.452762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432e8d-c071-4c1e-9f8a-5ddc20d76043 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:13.452894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432e8d-c071-4c1e-9f8a-5ddc20d76043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:13.471326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d9432e8d-c071-4c1e-9f8a-5ddc20d76043 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:13.472497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d9432e8d-c071-4c1e-9f8a-5ddc20d76043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:13.536943 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 580/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:47:13.807069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464f359-33a7-4f62-91d8-59e501d1e869 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:13.905068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464f359-33a7-4f62-91d8-59e501d1e869 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:13.937617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fce91-ce1f-4842-bc40-5614eaa6f95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:13.938209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fce91-ce1f-4842-bc40-5614eaa6f95f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:13.938489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fce91-ce1f-4842-bc40-5614eaa6f95f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:13.938791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fce91-ce1f-4842-bc40-5614eaa6f95f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:14.000902 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:14.012244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fce91-ce1f-4842-bc40-5614eaa6f95f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:14.013687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fce91-ce1f-4842-bc40-5614eaa6f95f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:14.107566 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 584/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:47:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:47:14.113354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432e8d-c071-4c1e-9f8a-5ddc20d76043 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:14.206436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432e8d-c071-4c1e-9f8a-5ddc20d76043 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:14.228595 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:14.240163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc574e4-01fe-426c-99c5-70f8fa64761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:14.240784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc574e4-01fe-426c-99c5-70f8fa64761b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:14.241065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc574e4-01fe-426c-99c5-70f8fa64761b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:14.241335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc574e4-01fe-426c-99c5-70f8fa64761b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:14.247946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc574e4-01fe-426c-99c5-70f8fa64761b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:14.249383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc574e4-01fe-426c-99c5-70f8fa64761b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-3cc574e4-01fe-426c-99c5-70f8fa64761b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:47:14.260233 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:47:14.261405 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:47:14.263301 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 581/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 2 00:47:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:47:14.267757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fce91-ce1f-4842-bc40-5614eaa6f95f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:14.356237 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:14.366316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fce91-ce1f-4842-bc40-5614eaa6f95f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:14.401995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813ea10-c405-4ca4-8767-f0b487be0c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:14.402676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813ea10-c405-4ca4-8767-f0b487be0c0c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:14.402957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813ea10-c405-4ca4-8767-f0b487be0c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:14.403226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813ea10-c405-4ca4-8767-f0b487be0c0c None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:14.403862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813ea10-c405-4ca4-8767-f0b487be0c0c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:47:14.404161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813ea10-c405-4ca4-8767-f0b487be0c0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:14.405526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813ea10-c405-4ca4-8767-f0b487be0c0c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:14.412282 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 585/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 2 00:47:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:16.513608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4e4b4-5ba0-479c-b471-25b22e0ee0ea None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:16.514154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4e4b4-5ba0-479c-b471-25b22e0ee0ea None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:16.514154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4e4b4-5ba0-479c-b471-25b22e0ee0ea None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:16.515525 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 582/1167] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:16.521123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34864fc-bb40-4079-93a6-df785be8a97a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:16.521525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34864fc-bb40-4079-93a6-df785be8a97a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:16.521662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34864fc-bb40-4079-93a6-df785be8a97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:16.539861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f34864fc-bb40-4079-93a6-df785be8a97a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:16.541026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f34864fc-bb40-4079-93a6-df785be8a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:16.604868 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 586/1168] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:47:16.872733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4e4b4-5ba0-479c-b471-25b22e0ee0ea None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:16.972694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4e4b4-5ba0-479c-b471-25b22e0ee0ea None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:17.005752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c6dba-8dc0-456d-ad02-bae4912050cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:17.006338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c6dba-8dc0-456d-ad02-bae4912050cc None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:17.006641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c6dba-8dc0-456d-ad02-bae4912050cc None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:17.006912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c6dba-8dc0-456d-ad02-bae4912050cc None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:17.007777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c6dba-8dc0-456d-ad02-bae4912050cc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:17.009158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c6dba-8dc0-456d-ad02-bae4912050cc None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:17.026264 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 583/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Sun Oct 2 00:47:16 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:47:19.184331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c02af-f189-47d5-b923-84ecbe9fe385 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:19.184853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c02af-f189-47d5-b923-84ecbe9fe385 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:19.184950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c02af-f189-47d5-b923-84ecbe9fe385 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:19.186205 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 587/1170] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:19.191465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c2fd-3138-45c0-b87a-a49d8e4b2825 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:19.191905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c2fd-3138-45c0-b87a-a49d8e4b2825 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:19.192025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c2fd-3138-45c0-b87a-a49d8e4b2825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:19.210324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c199c2fd-3138-45c0-b87a-a49d8e4b2825 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:19.211524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c199c2fd-3138-45c0-b87a-a49d8e4b2825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:19.245009 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:19.275759 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 584/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:47:19.541603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c02af-f189-47d5-b923-84ecbe9fe385 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:19.626498 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:19.643140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c02af-f189-47d5-b923-84ecbe9fe385 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:19.676681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182388c-3234-473b-b155-34fbf4d52f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:19.677298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182388c-3234-473b-b155-34fbf4d52f66 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:19.677578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182388c-3234-473b-b155-34fbf4d52f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:19.677851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182388c-3234-473b-b155-34fbf4d52f66 None admin] PATH_INFO: `/v3/domains/394ccb4d4efe41f6b8471583bfb2f993` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:19.687860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182388c-3234-473b-b155-34fbf4d52f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=394ccb4d4efe41f6b8471583bfb2f993)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:19.689297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182388c-3234-473b-b155-34fbf4d52f66 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:19.690896 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 588/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Sun Oct 2 00:47:19 2022] GET /identity/v3/domains/394ccb4d4efe41f6b8471583bfb2f993 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:19.696765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199c2fd-3138-45c0-b87a-a49d8e4b2825 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:19.795276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199c2fd-3138-45c0-b87a-a49d8e4b2825 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:19.827721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff66738-29a7-4190-97dc-c35f4cbd6866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:19.828316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff66738-29a7-4190-97dc-c35f4cbd6866 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:19.828596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff66738-29a7-4190-97dc-c35f4cbd6866 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:19.828867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff66738-29a7-4190-97dc-c35f4cbd6866 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:19.829519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff66738-29a7-4190-97dc-c35f4cbd6866 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:19.830972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff66738-29a7-4190-97dc-c35f4cbd6866 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:19.856925 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 585/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:47:19 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:47:22.023969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905a84f-169c-4e2f-8948-3b425b7fedde None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:22.024459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905a84f-169c-4e2f-8948-3b425b7fedde None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:22.024559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905a84f-169c-4e2f-8948-3b425b7fedde None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:22.025830 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 589/1174] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:22.031522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6362444-00bd-42c6-8440-70d847c5a1a1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:22.031895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6362444-00bd-42c6-8440-70d847c5a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:22.032084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6362444-00bd-42c6-8440-70d847c5a1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:22.050580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c6362444-00bd-42c6-8440-70d847c5a1a1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:22.051775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c6362444-00bd-42c6-8440-70d847c5a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:22.068667 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:22.116265 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 586/1175] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:47:22.391089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905a84f-169c-4e2f-8948-3b425b7fedde None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:22.488740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905a84f-169c-4e2f-8948-3b425b7fedde None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:22.520595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406713e-b040-4266-96a7-ec0732f0ea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:22.521201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406713e-b040-4266-96a7-ec0732f0ea7d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:22.521478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406713e-b040-4266-96a7-ec0732f0ea7d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:22.521749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406713e-b040-4266-96a7-ec0732f0ea7d None admin] PATH_INFO: `/v3/domains/394ccb4d4efe41f6b8471583bfb2f993` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:22.522858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406713e-b040-4266-96a7-ec0732f0ea7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=394ccb4d4efe41f6b8471583bfb2f993)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:22.524679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406713e-b040-4266-96a7-ec0732f0ea7d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:22.526202 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 590/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Sun Oct 2 00:47:22 2022] GET /identity/v3/domains/394ccb4d4efe41f6b8471583bfb2f993 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:22.532538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6362444-00bd-42c6-8440-70d847c5a1a1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:22.629998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6362444-00bd-42c6-8440-70d847c5a1a1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:22.662869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714ce1d-b84d-4118-9bd0-9949e2b7c2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:22.665929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714ce1d-b84d-4118-9bd0-9949e2b7c2dc None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:22.665929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714ce1d-b84d-4118-9bd0-9949e2b7c2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:22.665929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714ce1d-b84d-4118-9bd0-9949e2b7c2dc None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:22.665929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714ce1d-b84d-4118-9bd0-9949e2b7c2dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:22.666274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714ce1d-b84d-4118-9bd0-9949e2b7c2dc None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:22.687802 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 587/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:47:22 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:47:24.871019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95cb1d-3527-4478-9acf-7b3e7622c061 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:24.872063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95cb1d-3527-4478-9acf-7b3e7622c061 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:24.872181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95cb1d-3527-4478-9acf-7b3e7622c061 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:24.873497 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 591/1178] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:24.878770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eef47-2db4-46dc-b197-d92ad8570380 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:24.879172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eef47-2db4-46dc-b197-d92ad8570380 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:24.879325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eef47-2db4-46dc-b197-d92ad8570380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:24.897731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d90eef47-2db4-46dc-b197-d92ad8570380 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:24.898934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d90eef47-2db4-46dc-b197-d92ad8570380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:24.901605 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:24.963649 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 588/1179] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:47:25.240833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95cb1d-3527-4478-9acf-7b3e7622c061 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:25.255868 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:25.341249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95cb1d-3527-4478-9acf-7b3e7622c061 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:25.374284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570c3f1-5745-4021-9340-1782ed4fb08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:25.374925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570c3f1-5745-4021-9340-1782ed4fb08e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:25.375205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570c3f1-5745-4021-9340-1782ed4fb08e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:25.375474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570c3f1-5745-4021-9340-1782ed4fb08e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:25.385525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570c3f1-5745-4021-9340-1782ed4fb08e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-3570c3f1-5745-4021-9340-1782ed4fb08e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:47:25.390929 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:47:25.392017 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:47:25.393079 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 592/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:47:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:47:25.398068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eef47-2db4-46dc-b197-d92ad8570380 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:25.492405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eef47-2db4-46dc-b197-d92ad8570380 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:25.524996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28732a6-b8be-4902-824a-3f417b36f2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:25.525586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28732a6-b8be-4902-824a-3f417b36f2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:25.525874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28732a6-b8be-4902-824a-3f417b36f2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:25.526148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28732a6-b8be-4902-824a-3f417b36f2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:25.527155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28732a6-b8be-4902-824a-3f417b36f2b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:47:25.527462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28732a6-b8be-4902-824a-3f417b36f2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:25.529393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28732a6-b8be-4902-824a-3f417b36f2b4 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:25.537046 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 589/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:47:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:25.543016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570c3f1-5745-4021-9340-1782ed4fb08e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:25.611221 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:25.642570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570c3f1-5745-4021-9340-1782ed4fb08e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:25.675190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25baae-82cd-4309-ae94-b40c45ba4979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:25.675805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25baae-82cd-4309-ae94-b40c45ba4979 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:25.676082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25baae-82cd-4309-ae94-b40c45ba4979 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:25.676354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25baae-82cd-4309-ae94-b40c45ba4979 None admin] PATH_INFO: `/v3/users/1109f44b4f2345a693816f491996c6c5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:25.689371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25baae-82cd-4309-ae94-b40c45ba4979 None admin] RBAC: Authorizing `identity:get_user(user_id=1109f44b4f2345a693816f491996c6c5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:25.690827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25baae-82cd-4309-ae94-b40c45ba4979 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:25.692405 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 593/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:47:25 2022] GET /identity/v3/users/1109f44b4f2345a693816f491996c6c5 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:25.698237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28732a6-b8be-4902-824a-3f417b36f2b4 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:25.701822 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:25.795230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28732a6-b8be-4902-824a-3f417b36f2b4 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:25.827858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1a00c-5580-4392-ac2d-6a4b61bca01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:25.828448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a00c-5580-4392-ac2d-6a4b61bca01e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:25.828731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a00c-5580-4392-ac2d-6a4b61bca01e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:25.829005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a00c-5580-4392-ac2d-6a4b61bca01e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:25.895813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1a00c-5580-4392-ac2d-6a4b61bca01e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:25.897257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1a00c-5580-4392-ac2d-6a4b61bca01e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:25.899033 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:25.993022 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 590/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:47:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:47:25.999508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25baae-82cd-4309-ae94-b40c45ba4979 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:26.093457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25baae-82cd-4309-ae94-b40c45ba4979 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:26.120629 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:26.127073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd71ed6-ed08-46e4-b019-d0e8513dcd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:26.127687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd71ed6-ed08-46e4-b019-d0e8513dcd9c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:26.127963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd71ed6-ed08-46e4-b019-d0e8513dcd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:26.128231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd71ed6-ed08-46e4-b019-d0e8513dcd9c None admin] PATH_INFO: `/v3/projects/be4537a618da476988ea8b9e5c2561df` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:26.129316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd71ed6-ed08-46e4-b019-d0e8513dcd9c None admin] RBAC: Authorizing `identity:get_project(project_id=be4537a618da476988ea8b9e5c2561df)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:26.130767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd71ed6-ed08-46e4-b019-d0e8513dcd9c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:26.132339 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 594/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:47:25 2022] GET /identity/v3/projects/be4537a618da476988ea8b9e5c2561df => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:26.138453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1a00c-5580-4392-ac2d-6a4b61bca01e None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:26.236458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1a00c-5580-4392-ac2d-6a4b61bca01e None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:26.237943 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:26.269990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72be9c-7fdc-4ea5-a0ee-ac60f9ac3f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:26.270584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72be9c-7fdc-4ea5-a0ee-ac60f9ac3f97 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:26.270899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72be9c-7fdc-4ea5-a0ee-ac60f9ac3f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:26.271176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72be9c-7fdc-4ea5-a0ee-ac60f9ac3f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:26.271892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72be9c-7fdc-4ea5-a0ee-ac60f9ac3f97 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=be4537a618da476988ea8b9e5c2561df, user.id=1109f44b4f2345a693816f491996c6c5) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:47:26.272200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72be9c-7fdc-4ea5-a0ee-ac60f9ac3f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:26.273614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72be9c-7fdc-4ea5-a0ee-ac60f9ac3f97 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:26.279004 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 591/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:47:26 2022] GET /identity/v3/role_assignments?user.id=1109f44b4f2345a693816f491996c6c5&scope.project.id=be4537a618da476988ea8b9e5c2561df&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:28.402465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157ad9c-db1d-48b8-803d-4064fb109126 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:28.403089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157ad9c-db1d-48b8-803d-4064fb109126 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:28.403184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157ad9c-db1d-48b8-803d-4064fb109126 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:28.404517 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 595/1186] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:28.409737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096391d6-3885-4821-924b-6cf6b8f13b97 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:28.410153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096391d6-3885-4821-924b-6cf6b8f13b97 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:28.410285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096391d6-3885-4821-924b-6cf6b8f13b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:28.428572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-096391d6-3885-4821-924b-6cf6b8f13b97 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:28.429734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-096391d6-3885-4821-924b-6cf6b8f13b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:28.493666 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 592/1187] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:47:28.760245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157ad9c-db1d-48b8-803d-4064fb109126 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:28.858247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157ad9c-db1d-48b8-803d-4064fb109126 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:28.890549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a9a57-4fb8-49a8-a1b3-fba27625cb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:28.891179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9a57-4fb8-49a8-a1b3-fba27625cb86 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:28.891454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9a57-4fb8-49a8-a1b3-fba27625cb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:28.891721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9a57-4fb8-49a8-a1b3-fba27625cb86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:28.901318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a9a57-4fb8-49a8-a1b3-fba27625cb86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ef3a9a57-4fb8-49a8-a1b3-fba27625cb86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:47:28.906439 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:47:28.907581 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:47:28.908858 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 596/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:47:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:47:28.913482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096391d6-3885-4821-924b-6cf6b8f13b97 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:29.002464 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:29.008855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096391d6-3885-4821-924b-6cf6b8f13b97 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:29.041768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbd6ff-b3e0-44a6-bcbb-2581fe623033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:29.042308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbd6ff-b3e0-44a6-bcbb-2581fe623033 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:29.042587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbd6ff-b3e0-44a6-bcbb-2581fe623033 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:29.042896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbd6ff-b3e0-44a6-bcbb-2581fe623033 None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:29.043595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbd6ff-b3e0-44a6-bcbb-2581fe623033 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:47:29.043897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbd6ff-b3e0-44a6-bcbb-2581fe623033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:29.045265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbd6ff-b3e0-44a6-bcbb-2581fe623033 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:29.053170 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 593/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:47:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:29.059033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a9a57-4fb8-49a8-a1b3-fba27625cb86 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:29.116552 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:29.157133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a9a57-4fb8-49a8-a1b3-fba27625cb86 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:29.189555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a48a0c-c75d-4cf3-a9e4-cd070d9553d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:29.190172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48a0c-c75d-4cf3-a9e4-cd070d9553d9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:29.190453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48a0c-c75d-4cf3-a9e4-cd070d9553d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:29.190761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48a0c-c75d-4cf3-a9e4-cd070d9553d9 None admin] PATH_INFO: `/v3/users/1109f44b4f2345a693816f491996c6c5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:29.191880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a48a0c-c75d-4cf3-a9e4-cd070d9553d9 None admin] RBAC: Authorizing `identity:get_user(user_id=1109f44b4f2345a693816f491996c6c5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:29.193325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a48a0c-c75d-4cf3-a9e4-cd070d9553d9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:29.194932 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 597/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:47:29 2022] GET /identity/v3/users/1109f44b4f2345a693816f491996c6c5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:29.201215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbd6ff-b3e0-44a6-bcbb-2581fe623033 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:29.297594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbd6ff-b3e0-44a6-bcbb-2581fe623033 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:29.330225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2227617-dee8-41f1-823c-b42f38d6ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:29.330859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227617-dee8-41f1-823c-b42f38d6ad45 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:29.331141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227617-dee8-41f1-823c-b42f38d6ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:29.331416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227617-dee8-41f1-823c-b42f38d6ad45 None admin] PATH_INFO: `/v3/projects/be4537a618da476988ea8b9e5c2561df` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:29.332503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2227617-dee8-41f1-823c-b42f38d6ad45 None admin] RBAC: Authorizing `identity:get_project(project_id=be4537a618da476988ea8b9e5c2561df)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:29.333919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2227617-dee8-41f1-823c-b42f38d6ad45 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:29.335540 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 594/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:47:29 2022] GET /identity/v3/projects/be4537a618da476988ea8b9e5c2561df => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:29.341302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a48a0c-c75d-4cf3-a9e4-cd070d9553d9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:29.438441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a48a0c-c75d-4cf3-a9e4-cd070d9553d9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:29.463164 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:29.472024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7b246-42fe-41ea-8256-7fd37fd6f511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:29.472670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7b246-42fe-41ea-8256-7fd37fd6f511 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:29.472947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7b246-42fe-41ea-8256-7fd37fd6f511 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:29.473219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7b246-42fe-41ea-8256-7fd37fd6f511 None admin] PATH_INFO: `/v3/projects/be4537a618da476988ea8b9e5c2561df/users/1109f44b4f2345a693816f491996c6c5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:29.475095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7b246-42fe-41ea-8256-7fd37fd6f511 None admin] RBAC: Authorizing `identity:create_grant(project_id=be4537a618da476988ea8b9e5c2561df, user_id=1109f44b4f2345a693816f491996c6c5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:29.476524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7b246-42fe-41ea-8256-7fd37fd6f511 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:29.488452 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 598/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:47:29 2022] PUT /identity/v3/projects/be4537a618da476988ea8b9e5c2561df/users/1109f44b4f2345a693816f491996c6c5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:47:31.664813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb8080-4d5e-439b-a450-ae675c40a5a9 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:31.665368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb8080-4d5e-439b-a450-ae675c40a5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:31.665368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb8080-4d5e-439b-a450-ae675c40a5a9 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:31.666709 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 595/1193] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:47:31.672698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01d208-0703-4d68-81a3-45a03d816919 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:31.673084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01d208-0703-4d68-81a3-45a03d816919 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:31.673245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01d208-0703-4d68-81a3-45a03d816919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:31.691309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8c01d208-0703-4d68-81a3-45a03d816919 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:47:31.692485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8c01d208-0703-4d68-81a3-45a03d816919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:47:31.757303 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 599/1194] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:47:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:47:32.025808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb8080-4d5e-439b-a450-ae675c40a5a9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:32.053217 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:32.124166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb8080-4d5e-439b-a450-ae675c40a5a9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:32.156453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58b11-a700-48a0-b5b7-63c46be15b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:32.157062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58b11-a700-48a0-b5b7-63c46be15b19 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:32.157340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58b11-a700-48a0-b5b7-63c46be15b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:32.157610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58b11-a700-48a0-b5b7-63c46be15b19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:32.167187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c58b11-a700-48a0-b5b7-63c46be15b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-36c58b11-a700-48a0-b5b7-63c46be15b19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:47:32.172242 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:47:32.173335 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:47:32.174373 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 596/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:47:32.179565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01d208-0703-4d68-81a3-45a03d816919 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:32.273944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01d208-0703-4d68-81a3-45a03d816919 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:32.289822 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:32.308016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd191090-3141-464a-84e2-9bdd222af30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:32.308609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd191090-3141-464a-84e2-9bdd222af30e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:32.308886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd191090-3141-464a-84e2-9bdd222af30e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:32.309708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd191090-3141-464a-84e2-9bdd222af30e None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:32.310359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd191090-3141-464a-84e2-9bdd222af30e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:47:32.310684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd191090-3141-464a-84e2-9bdd222af30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:32.312044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd191090-3141-464a-84e2-9bdd222af30e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:32.319740 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 600/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:32.326371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58b11-a700-48a0-b5b7-63c46be15b19 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:32.406998 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:32.428539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58b11-a700-48a0-b5b7-63c46be15b19 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:32.462192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bca3d-9fcb-4777-996e-eac78389b6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:32.462844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bca3d-9fcb-4777-996e-eac78389b6cc None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:32.463125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bca3d-9fcb-4777-996e-eac78389b6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:32.463399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bca3d-9fcb-4777-996e-eac78389b6cc None admin] PATH_INFO: `/v3/users/1109f44b4f2345a693816f491996c6c5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:32.464501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bca3d-9fcb-4777-996e-eac78389b6cc None admin] RBAC: Authorizing `identity:get_user(user_id=1109f44b4f2345a693816f491996c6c5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:32.465954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bca3d-9fcb-4777-996e-eac78389b6cc None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:32.467541 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 597/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 2 00:47:32 2022] GET /identity/v3/users/1109f44b4f2345a693816f491996c6c5 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:47:32.473317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd191090-3141-464a-84e2-9bdd222af30e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:32.569842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd191090-3141-464a-84e2-9bdd222af30e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:32.601440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb27b2b-f758-4297-a9b7-515b5effe26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:32.602025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb27b2b-f758-4297-a9b7-515b5effe26e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:32.602302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb27b2b-f758-4297-a9b7-515b5effe26e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:32.602576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb27b2b-f758-4297-a9b7-515b5effe26e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:32.645867 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:32.666914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb27b2b-f758-4297-a9b7-515b5effe26e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:32.668351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb27b2b-f758-4297-a9b7-515b5effe26e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:32.772578 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 601/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:47:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:47:32.778646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bca3d-9fcb-4777-996e-eac78389b6cc None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:32.874691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bca3d-9fcb-4777-996e-eac78389b6cc None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:32.906378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c6fd2-1495-4671-8a9a-5ab15e2493ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:32.907018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c6fd2-1495-4671-8a9a-5ab15e2493ab None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:32.907301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c6fd2-1495-4671-8a9a-5ab15e2493ab None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:32.907572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c6fd2-1495-4671-8a9a-5ab15e2493ab None admin] PATH_INFO: `/v3/projects/be4537a618da476988ea8b9e5c2561df` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:32.908674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c6fd2-1495-4671-8a9a-5ab15e2493ab None admin] RBAC: Authorizing `identity:get_project(project_id=be4537a618da476988ea8b9e5c2561df)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:32.910095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c6fd2-1495-4671-8a9a-5ab15e2493ab None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:32.911729 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 598/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 2 00:47:32 2022] GET /identity/v3/projects/be4537a618da476988ea8b9e5c2561df => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:32.917750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb27b2b-f758-4297-a9b7-515b5effe26e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:47:32.994006 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:33.015686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb27b2b-f758-4297-a9b7-515b5effe26e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:47:33.048531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0888c78-be7d-4934-bd49-950c05c3d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:47:33.049126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0888c78-be7d-4934-bd49-950c05c3d1de None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:47:33.049404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0888c78-be7d-4934-bd49-950c05c3d1de None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:47:33.049935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0888c78-be7d-4934-bd49-950c05c3d1de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:47:33.050676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0888c78-be7d-4934-bd49-950c05c3d1de None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=be4537a618da476988ea8b9e5c2561df, user.id=1109f44b4f2345a693816f491996c6c5) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:47:33.050987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0888c78-be7d-4934-bd49-950c05c3d1de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:47:33.052431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0888c78-be7d-4934-bd49-950c05c3d1de None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:47:33.058335 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 602/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:47:32 2022] GET /identity/v3/role_assignments?user.id=1109f44b4f2345a693816f491996c6c5&scope.project.id=be4537a618da476988ea8b9e5c2561df&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:47:42.902177 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:43.055549 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=29 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:29.158036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c968e-34d6-4818-a651-5bd9ae2e61d3 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:29.158644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c968e-34d6-4818-a651-5bd9ae2e61d3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:29.158644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c968e-34d6-4818-a651-5bd9ae2e61d3 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:29.159987 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 599/1201] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:29.167085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944919-2661-4da6-ad9d-18e48fbccbb3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:29.167622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944919-2661-4da6-ad9d-18e48fbccbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:29.167801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944919-2661-4da6-ad9d-18e48fbccbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:29.190105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b3944919-2661-4da6-ad9d-18e48fbccbb3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:29.191730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b3944919-2661-4da6-ad9d-18e48fbccbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:29.313550 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 603/1202] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:48:29.622834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c968e-34d6-4818-a651-5bd9ae2e61d3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:29.772645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c968e-34d6-4818-a651-5bd9ae2e61d3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:29.817191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d80c0-886c-4169-8571-57e064bb18ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:29.817835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d80c0-886c-4169-8571-57e064bb18ad None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:29.818133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d80c0-886c-4169-8571-57e064bb18ad None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:29.818381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d80c0-886c-4169-8571-57e064bb18ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:29.829334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d80c0-886c-4169-8571-57e064bb18ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:29.830832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d80c0-886c-4169-8571-57e064bb18ad None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-096d80c0-886c-4169-8571-57e064bb18ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:29.847421 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:29.848978 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:29.849980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:29.849980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:29.849980 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:29.849980 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 600/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:29.860281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3944919-2661-4da6-ad9d-18e48fbccbb3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:29.993634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3944919-2661-4da6-ad9d-18e48fbccbb3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:30.030524 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:30.037939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65faded-4ae3-4fdd-b6fa-f0ac980d591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:30.038556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65faded-4ae3-4fdd-b6fa-f0ac980d591e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:30.038920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65faded-4ae3-4fdd-b6fa-f0ac980d591e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:30.039154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65faded-4ae3-4fdd-b6fa-f0ac980d591e None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:30.039778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65faded-4ae3-4fdd-b6fa-f0ac980d591e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:30.040141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65faded-4ae3-4fdd-b6fa-f0ac980d591e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:30.041454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65faded-4ae3-4fdd-b6fa-f0ac980d591e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:30.055872 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 604/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:30.061839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d80c0-886c-4169-8571-57e064bb18ad None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:30.127152 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:30.192650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d80c0-886c-4169-8571-57e064bb18ad None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:30.237415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ddb2f-f74c-4413-a3d8-7c6e0e935954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:30.237989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ddb2f-f74c-4413-a3d8-7c6e0e935954 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:30.238837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ddb2f-f74c-4413-a3d8-7c6e0e935954 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:30.238837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ddb2f-f74c-4413-a3d8-7c6e0e935954 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:30.239482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ddb2f-f74c-4413-a3d8-7c6e0e935954 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:30.240762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ddb2f-f74c-4413-a3d8-7c6e0e935954 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:30.267177 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 601/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 2 00:48:30 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 00:48:32.717636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bac351-691e-4ac1-97e8-25af7afacdba None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:32.718192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bac351-691e-4ac1-97e8-25af7afacdba None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:32.718192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bac351-691e-4ac1-97e8-25af7afacdba None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:32.720266 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 605/1206] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:32.725815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958cf1-8e82-4774-92c2-9276b8854b91 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:32.726290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958cf1-8e82-4774-92c2-9276b8854b91 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:32.726373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958cf1-8e82-4774-92c2-9276b8854b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:32.753430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ee958cf1-8e82-4774-92c2-9276b8854b91 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:32.754724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ee958cf1-8e82-4774-92c2-9276b8854b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:32.887153 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 602/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:48:33.208638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bac351-691e-4ac1-97e8-25af7afacdba None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:33.347666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bac351-691e-4ac1-97e8-25af7afacdba None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:33.390312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a165-2fb8-4edc-8eb0-9334c0d5577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:33.391227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a165-2fb8-4edc-8eb0-9334c0d5577b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:33.391531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a165-2fb8-4edc-8eb0-9334c0d5577b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:33.391786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a165-2fb8-4edc-8eb0-9334c0d5577b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:33.404722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39a165-2fb8-4edc-8eb0-9334c0d5577b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-6d39a165-2fb8-4edc-8eb0-9334c0d5577b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:48:33.410216 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:33.411420 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:33.412301 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 606/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:48:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:33.417384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee958cf1-8e82-4774-92c2-9276b8854b91 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:33.458510 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:33.528916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee958cf1-8e82-4774-92c2-9276b8854b91 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:33.566458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88694e-eb23-4c25-8bad-05d35f395a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:33.567112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88694e-eb23-4c25-8bad-05d35f395a4d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:33.567444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88694e-eb23-4c25-8bad-05d35f395a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:33.567745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88694e-eb23-4c25-8bad-05d35f395a4d None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:33.568518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88694e-eb23-4c25-8bad-05d35f395a4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:33.568913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88694e-eb23-4c25-8bad-05d35f395a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:33.570515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88694e-eb23-4c25-8bad-05d35f395a4d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:33.581792 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 603/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:48:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:33.587871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a165-2fb8-4edc-8eb0-9334c0d5577b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:33.643735 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:33.706399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a165-2fb8-4edc-8eb0-9334c0d5577b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:33.746606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218b19b-7ed8-444a-942c-4d43ae7620b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:33.747436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218b19b-7ed8-444a-942c-4d43ae7620b3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:33.747629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218b19b-7ed8-444a-942c-4d43ae7620b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:33.747938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218b19b-7ed8-444a-942c-4d43ae7620b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:33.761412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218b19b-7ed8-444a-942c-4d43ae7620b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:33.763162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218b19b-7ed8-444a-942c-4d43ae7620b3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1218b19b-7ed8-444a-942c-4d43ae7620b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:33.784335 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:33.785435 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:33.791313 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:33.791313 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:33.791313 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:33.791313 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 607/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:33.791553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88694e-eb23-4c25-8bad-05d35f395a4d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:33.907931 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:33.911404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88694e-eb23-4c25-8bad-05d35f395a4d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:33.950844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1136c-bca2-41b7-88e9-eb6494f2d586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:33.951461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1136c-bca2-41b7-88e9-eb6494f2d586 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:33.951742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1136c-bca2-41b7-88e9-eb6494f2d586 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:33.952012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1136c-bca2-41b7-88e9-eb6494f2d586 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:33.952654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1136c-bca2-41b7-88e9-eb6494f2d586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:33.952982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1136c-bca2-41b7-88e9-eb6494f2d586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:33.954578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1136c-bca2-41b7-88e9-eb6494f2d586 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:33.967192 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 604/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:48:33.974170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218b19b-7ed8-444a-942c-4d43ae7620b3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:34.084706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218b19b-7ed8-444a-942c-4d43ae7620b3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:34.086801 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:34.123375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e8d92-ed36-4ed3-8c7a-23a50e175fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:34.124113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e8d92-ed36-4ed3-8c7a-23a50e175fed None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:34.124447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e8d92-ed36-4ed3-8c7a-23a50e175fed None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:34.126196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e8d92-ed36-4ed3-8c7a-23a50e175fed None admin] PATH_INFO: `/v3/users/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:34.135828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e8d92-ed36-4ed3-8c7a-23a50e175fed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:34.137367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e8d92-ed36-4ed3-8c7a-23a50e175fed None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d53e8d92-ed36-4ed3-8c7a-23a50e175fed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:48:34.149676 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:34.155722 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:34.157348 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:34.157348 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:34.157348 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:48:34.157348 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:48:34.157348 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:48:34.157348 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:48:34.157348 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:48:34.157348 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:48:34.157348 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:34.157348 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:34.157348 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 608/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:34.159706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1136c-bca2-41b7-88e9-eb6494f2d586 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:34.279007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1136c-bca2-41b7-88e9-eb6494f2d586 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:34.323480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0c54a-2cae-47c7-bd25-ae4669440d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:34.324079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0c54a-2cae-47c7-bd25-ae4669440d34 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:34.324355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0c54a-2cae-47c7-bd25-ae4669440d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:34.324625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0c54a-2cae-47c7-bd25-ae4669440d34 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:34.325347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0c54a-2cae-47c7-bd25-ae4669440d34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:34.325650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0c54a-2cae-47c7-bd25-ae4669440d34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:34.327112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0c54a-2cae-47c7-bd25-ae4669440d34 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:34.345788 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 605/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 2 00:48:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:34.351907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e8d92-ed36-4ed3-8c7a-23a50e175fed None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:34.476308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e8d92-ed36-4ed3-8c7a-23a50e175fed None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:34.511950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ea508-816a-42f5-bf48-af3b12c481ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:34.512624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ea508-816a-42f5-bf48-af3b12c481ad None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:34.513025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ea508-816a-42f5-bf48-af3b12c481ad None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:34.513401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ea508-816a-42f5-bf48-af3b12c481ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:34.550811 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:34.599611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ea508-816a-42f5-bf48-af3b12c481ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:34.601190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ea508-816a-42f5-bf48-af3b12c481ad None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:34.736744 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 609/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:48:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 02 00:48:34.738059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0c54a-2cae-47c7-bd25-ae4669440d34 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:34.764940 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:34.869269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0c54a-2cae-47c7-bd25-ae4669440d34 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:34.908561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51652049-a2cd-4bcf-b05c-1ed24167aa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:34.909386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652049-a2cd-4bcf-b05c-1ed24167aa47 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:34.909764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652049-a2cd-4bcf-b05c-1ed24167aa47 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:34.910164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652049-a2cd-4bcf-b05c-1ed24167aa47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:34.920628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51652049-a2cd-4bcf-b05c-1ed24167aa47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:34.922816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51652049-a2cd-4bcf-b05c-1ed24167aa47 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-51652049-a2cd-4bcf-b05c-1ed24167aa47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:34.939256 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:34.940552 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:34.941699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:34.941699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:34.941699 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:34.942874 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 606/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:34.948566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ea508-816a-42f5-bf48-af3b12c481ad None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:35.023980 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:35.072304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ea508-816a-42f5-bf48-af3b12c481ad None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:35.122731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5306-24b8-43df-b4e6-57b9df4f67bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:35.123399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5306-24b8-43df-b4e6-57b9df4f67bb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:35.123683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5306-24b8-43df-b4e6-57b9df4f67bb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:35.123987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5306-24b8-43df-b4e6-57b9df4f67bb None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:35.124638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5306-24b8-43df-b4e6-57b9df4f67bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:35.125077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5306-24b8-43df-b4e6-57b9df4f67bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:35.127076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5306-24b8-43df-b4e6-57b9df4f67bb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:35.145188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51652049-a2cd-4bcf-b05c-1ed24167aa47 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:35.145630 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 610/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:35.228989 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:35.263847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51652049-a2cd-4bcf-b05c-1ed24167aa47 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:35.308610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbfe55-4d09-44f2-aa37-cb6e9992487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:35.309154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbfe55-4d09-44f2-aa37-cb6e9992487a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:35.309431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbfe55-4d09-44f2-aa37-cb6e9992487a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:35.309702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbfe55-4d09-44f2-aa37-cb6e9992487a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:35.320071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbfe55-4d09-44f2-aa37-cb6e9992487a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:35.321681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbfe55-4d09-44f2-aa37-cb6e9992487a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-4cfbfe55-4d09-44f2-aa37-cb6e9992487a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:48:35.333765 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:35.334942 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:35.336017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:48:35.336017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:48:35.336017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:48:35.336017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:48:35.336017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:48:35.336017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:48:35.336017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:35.336017 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:35.336017 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 607/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:48:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:35.340636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5306-24b8-43df-b4e6-57b9df4f67bb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:35.468578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5306-24b8-43df-b4e6-57b9df4f67bb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:35.504653 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:35.518896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bef9cc-b7e7-43df-b89f-9c84a88214e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:35.519509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bef9cc-b7e7-43df-b89f-9c84a88214e7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:35.519791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bef9cc-b7e7-43df-b89f-9c84a88214e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:35.520064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bef9cc-b7e7-43df-b89f-9c84a88214e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:35.521002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bef9cc-b7e7-43df-b89f-9c84a88214e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:35.521314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bef9cc-b7e7-43df-b89f-9c84a88214e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:35.523266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bef9cc-b7e7-43df-b89f-9c84a88214e7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:35.537979 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 611/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:48:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:35.544148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbfe55-4d09-44f2-aa37-cb6e9992487a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:35.663286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbfe55-4d09-44f2-aa37-cb6e9992487a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:35.695569 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:35.702693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41159411-3b64-4719-ad68-05fb7bd08fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:35.703868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159411-3b64-4719-ad68-05fb7bd08fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:35.704210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159411-3b64-4719-ad68-05fb7bd08fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:35.704512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159411-3b64-4719-ad68-05fb7bd08fa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:35.705275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41159411-3b64-4719-ad68-05fb7bd08fa7 None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=619819f081824510a9f9e127e5070662) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:35.705618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41159411-3b64-4719-ad68-05fb7bd08fa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:35.707127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41159411-3b64-4719-ad68-05fb7bd08fa7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:35.722368 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 608/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:48:35 2022] GET /identity/v3/role_assignments?user.id=619819f081824510a9f9e127e5070662&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:38.014090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c3d2a-1b6a-4dba-8220-e596b872b9aa None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:38.014739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c3d2a-1b6a-4dba-8220-e596b872b9aa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:38.014739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c3d2a-1b6a-4dba-8220-e596b872b9aa None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:38.016657 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 612/1220] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:38.022469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff9c4-0dd3-4fad-848f-6974d5f750e6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:38.022964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff9c4-0dd3-4fad-848f-6974d5f750e6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:38.023069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff9c4-0dd3-4fad-848f-6974d5f750e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:38.042335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3f9ff9c4-0dd3-4fad-848f-6974d5f750e6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:38.043562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3f9ff9c4-0dd3-4fad-848f-6974d5f750e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:38.117699 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 609/1221] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:48:38.398166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c3d2a-1b6a-4dba-8220-e596b872b9aa None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:38.522227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c3d2a-1b6a-4dba-8220-e596b872b9aa None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:38.557872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb46e1-3a8a-4b47-a268-5eca57f63ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:38.558498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb46e1-3a8a-4b47-a268-5eca57f63ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:38.558806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb46e1-3a8a-4b47-a268-5eca57f63ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:38.559080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb46e1-3a8a-4b47-a268-5eca57f63ca6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:38.570067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb46e1-3a8a-4b47-a268-5eca57f63ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-e2cb46e1-3a8a-4b47-a268-5eca57f63ca6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:48:38.575015 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:38.576192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:38.577059 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 613/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:48:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:38.583588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ff9c4-0dd3-4fad-848f-6974d5f750e6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:38.704727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ff9c4-0dd3-4fad-848f-6974d5f750e6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:38.732099 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:38.745368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386769b-16a4-4867-b463-1cb7829e08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:38.746273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386769b-16a4-4867-b463-1cb7829e08ba None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:38.746784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386769b-16a4-4867-b463-1cb7829e08ba None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:38.747031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386769b-16a4-4867-b463-1cb7829e08ba None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:38.747885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386769b-16a4-4867-b463-1cb7829e08ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:38.748388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386769b-16a4-4867-b463-1cb7829e08ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:38.750435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386769b-16a4-4867-b463-1cb7829e08ba None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:38.766819 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 610/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:48:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:38.769487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb46e1-3a8a-4b47-a268-5eca57f63ca6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:38.818521 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:38.883200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb46e1-3a8a-4b47-a268-5eca57f63ca6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:38.919236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5686fa-9b43-4d25-bfa9-504e703f8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:38.921004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5686fa-9b43-4d25-bfa9-504e703f8917 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:38.921306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5686fa-9b43-4d25-bfa9-504e703f8917 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:38.921609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5686fa-9b43-4d25-bfa9-504e703f8917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:38.936536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5686fa-9b43-4d25-bfa9-504e703f8917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:38.939946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5686fa-9b43-4d25-bfa9-504e703f8917 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-bf5686fa-9b43-4d25-bfa9-504e703f8917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:38.958712 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:38.959927 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:38.965860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:38.965860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:38.965860 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:38.965860 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 614/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:38.966911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386769b-16a4-4867-b463-1cb7829e08ba None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:39.081567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386769b-16a4-4867-b463-1cb7829e08ba None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:39.120692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b130ce9-ead3-4963-b208-71bb7309791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:39.121362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b130ce9-ead3-4963-b208-71bb7309791a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:39.121646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b130ce9-ead3-4963-b208-71bb7309791a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:39.121965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b130ce9-ead3-4963-b208-71bb7309791a None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:39.122721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b130ce9-ead3-4963-b208-71bb7309791a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:39.123079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b130ce9-ead3-4963-b208-71bb7309791a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:39.124584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b130ce9-ead3-4963-b208-71bb7309791a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:39.137022 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 611/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:39.143350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5686fa-9b43-4d25-bfa9-504e703f8917 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:39.245694 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:39.253747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5686fa-9b43-4d25-bfa9-504e703f8917 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:39.291187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81c1a2-4156-45e4-80ae-872a2a36bb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:39.291881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c1a2-4156-45e4-80ae-872a2a36bb91 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:39.292173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c1a2-4156-45e4-80ae-872a2a36bb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:39.292534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c1a2-4156-45e4-80ae-872a2a36bb91 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:39.301724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81c1a2-4156-45e4-80ae-872a2a36bb91 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:39.303342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81c1a2-4156-45e4-80ae-872a2a36bb91 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-de81c1a2-4156-45e4-80ae-872a2a36bb91 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:48:39.315472 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:39.316731 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:39.317990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:39.317990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:39.317990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:48:39.317990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:48:39.317990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:48:39.317990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:48:39.317990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:48:39.317990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:48:39.317990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:39.317990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:39.321525 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 615/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:39.322419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b130ce9-ead3-4963-b208-71bb7309791a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:39.374324 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:39.428514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b130ce9-ead3-4963-b208-71bb7309791a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:39.462743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185463da-80a2-4ab7-bafe-d12ad8db0598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:39.463339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185463da-80a2-4ab7-bafe-d12ad8db0598 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:39.463617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185463da-80a2-4ab7-bafe-d12ad8db0598 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:39.463887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185463da-80a2-4ab7-bafe-d12ad8db0598 None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:39.464606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185463da-80a2-4ab7-bafe-d12ad8db0598 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:39.464907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185463da-80a2-4ab7-bafe-d12ad8db0598 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:39.466321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185463da-80a2-4ab7-bafe-d12ad8db0598 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:39.484463 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 612/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 2 00:48:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:48:39.490788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81c1a2-4156-45e4-80ae-872a2a36bb91 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:39.598500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81c1a2-4156-45e4-80ae-872a2a36bb91 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:39.638854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7268855-3e00-43c7-ab2e-ece5870013ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:39.639877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7268855-3e00-43c7-ab2e-ece5870013ce None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:39.640311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7268855-3e00-43c7-ab2e-ece5870013ce None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:39.640672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7268855-3e00-43c7-ab2e-ece5870013ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:39.661305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7268855-3e00-43c7-ab2e-ece5870013ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:39.664473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7268855-3e00-43c7-ab2e-ece5870013ce None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d7268855-3e00-43c7-ab2e-ece5870013ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:39.693080 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:39.694214 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:39.695289 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:39.695289 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:39.695289 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:39.695289 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 616/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:39.701042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185463da-80a2-4ab7-bafe-d12ad8db0598 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:39.810093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185463da-80a2-4ab7-bafe-d12ad8db0598 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:39.812460 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:39.847452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec1623-5c1d-459c-a09e-bd1cdf4312d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:39.848057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec1623-5c1d-459c-a09e-bd1cdf4312d9 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:39.848406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec1623-5c1d-459c-a09e-bd1cdf4312d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:39.848779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec1623-5c1d-459c-a09e-bd1cdf4312d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:39.849360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec1623-5c1d-459c-a09e-bd1cdf4312d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:39.849679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec1623-5c1d-459c-a09e-bd1cdf4312d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:39.851053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec1623-5c1d-459c-a09e-bd1cdf4312d9 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:39.863111 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 613/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:48:39.868844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7268855-3e00-43c7-ab2e-ece5870013ce None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:39.879272 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:39.983847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7268855-3e00-43c7-ab2e-ece5870013ce None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:40.022328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183bd4e-71bb-410f-8196-446da786534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:40.022977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183bd4e-71bb-410f-8196-446da786534c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:40.023256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183bd4e-71bb-410f-8196-446da786534c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:40.023534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183bd4e-71bb-410f-8196-446da786534c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:40.031084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183bd4e-71bb-410f-8196-446da786534c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:40.032652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183bd4e-71bb-410f-8196-446da786534c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-8183bd4e-71bb-410f-8196-446da786534c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:48:40.043889 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:40.045740 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:40.047627 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:48:40.047627 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:48:40.047627 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:48:40.047627 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:48:40.047627 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:48:40.047627 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:48:40.047627 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:40.047627 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:40.047627 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 617/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:48:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:40.051461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec1623-5c1d-459c-a09e-bd1cdf4312d9 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:40.156931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec1623-5c1d-459c-a09e-bd1cdf4312d9 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:40.195967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53485eb1-41e0-4b2d-82ad-e656c106b499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:40.196568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485eb1-41e0-4b2d-82ad-e656c106b499 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:40.196844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485eb1-41e0-4b2d-82ad-e656c106b499 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:40.197116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485eb1-41e0-4b2d-82ad-e656c106b499 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:40.197804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53485eb1-41e0-4b2d-82ad-e656c106b499 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:40.198094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53485eb1-41e0-4b2d-82ad-e656c106b499 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:40.199559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53485eb1-41e0-4b2d-82ad-e656c106b499 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:40.217384 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 614/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:48:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:40.218524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183bd4e-71bb-410f-8196-446da786534c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:40.286029 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:40.321365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183bd4e-71bb-410f-8196-446da786534c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:40.355219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857eba78-4a02-45a5-82fc-068135153c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:40.355910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eba78-4a02-45a5-82fc-068135153c37 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:40.356158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eba78-4a02-45a5-82fc-068135153c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:40.356426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eba78-4a02-45a5-82fc-068135153c37 None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/619819f081824510a9f9e127e5070662/roles/0905222c6f30467abc2b2a41d74fa282` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:40.371258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857eba78-4a02-45a5-82fc-068135153c37 None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=619819f081824510a9f9e127e5070662, role_id=0905222c6f30467abc2b2a41d74fa282)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:40.372954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857eba78-4a02-45a5-82fc-068135153c37 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:40.386959 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 618/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:48:40 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/619819f081824510a9f9e127e5070662/roles/0905222c6f30467abc2b2a41d74fa282 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 00:48:42.790400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6e8b-509a-473b-a8df-903bb2b7955a None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:42.790986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6e8b-509a-473b-a8df-903bb2b7955a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:42.790986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6e8b-509a-473b-a8df-903bb2b7955a None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:42.792433 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 615/1233] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:48:42.799219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e4820-3046-4213-851c-126c52530488 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:42.799706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e4820-3046-4213-851c-126c52530488 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:42.799906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e4820-3046-4213-851c-126c52530488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:42.818132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-700e4820-3046-4213-851c-126c52530488 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:42.819347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-700e4820-3046-4213-851c-126c52530488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:42.894619 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 619/1234] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:48:43.180401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f6e8b-509a-473b-a8df-903bb2b7955a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:43.207013 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:43.291608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f6e8b-509a-473b-a8df-903bb2b7955a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:43.330398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbc219-4789-4d59-90e9-020c59994f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:43.331210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc219-4789-4d59-90e9-020c59994f14 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:43.331389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc219-4789-4d59-90e9-020c59994f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:43.331647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc219-4789-4d59-90e9-020c59994f14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:43.342966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbc219-4789-4d59-90e9-020c59994f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-accbc219-4789-4d59-90e9-020c59994f14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:48:43.347894 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:43.349105 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:43.349977 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 616/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 2 00:48:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:43.355391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e4820-3046-4213-851c-126c52530488 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:43.405367 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:43.460153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e4820-3046-4213-851c-126c52530488 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:43.495778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4fb98-7123-4183-8ed6-c71ae80632da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:43.496384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4fb98-7123-4183-8ed6-c71ae80632da None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:43.496661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4fb98-7123-4183-8ed6-c71ae80632da None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:43.496930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4fb98-7123-4183-8ed6-c71ae80632da None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:43.497585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4fb98-7123-4183-8ed6-c71ae80632da None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:43.497882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4fb98-7123-4183-8ed6-c71ae80632da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:43.499274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4fb98-7123-4183-8ed6-c71ae80632da None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:43.507228 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 620/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 2 00:48:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:43.513119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbc219-4789-4d59-90e9-020c59994f14 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:43.608476 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:43.627132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbc219-4789-4d59-90e9-020c59994f14 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:43.668912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bea0b8-ab02-46df-a930-dab16b429259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:43.669678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bea0b8-ab02-46df-a930-dab16b429259 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:43.669987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bea0b8-ab02-46df-a930-dab16b429259 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:43.670351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bea0b8-ab02-46df-a930-dab16b429259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:43.684970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bea0b8-ab02-46df-a930-dab16b429259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:43.686868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bea0b8-ab02-46df-a930-dab16b429259 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-08bea0b8-ab02-46df-a930-dab16b429259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:43.704806 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:43.705902 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:43.707160 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:43.707160 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:43.707160 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:43.707160 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 617/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:48:43.712276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4fb98-7123-4183-8ed6-c71ae80632da None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:43.821814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4fb98-7123-4183-8ed6-c71ae80632da None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:43.832426 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:43.858674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4496e-b72d-45c0-8d2d-e841ead17798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:43.859387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4496e-b72d-45c0-8d2d-e841ead17798 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:43.859672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4496e-b72d-45c0-8d2d-e841ead17798 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:43.860145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4496e-b72d-45c0-8d2d-e841ead17798 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:43.860997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4496e-b72d-45c0-8d2d-e841ead17798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:43.861307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4496e-b72d-45c0-8d2d-e841ead17798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:43.862727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4496e-b72d-45c0-8d2d-e841ead17798 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:43.877723 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 621/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:43.883136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bea0b8-ab02-46df-a930-dab16b429259 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:43.997042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bea0b8-ab02-46df-a930-dab16b429259 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:44.036010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de46fcb-2740-47d6-955b-a42f9ab6db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:44.036701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de46fcb-2740-47d6-955b-a42f9ab6db79 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:44.036981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de46fcb-2740-47d6-955b-a42f9ab6db79 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:44.037254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de46fcb-2740-47d6-955b-a42f9ab6db79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:44.040255 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:44.046230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de46fcb-2740-47d6-955b-a42f9ab6db79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:44.048744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de46fcb-2740-47d6-955b-a42f9ab6db79 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-5de46fcb-2740-47d6-955b-a42f9ab6db79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:48:44.059962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:44.061163 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:44.062322 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:44.062322 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:44.062322 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:48:44.062322 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:48:44.062322 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:48:44.062322 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:48:44.062322 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:48:44.062322 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:48:44.062322 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:44.062322 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:44.062322 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 618/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:44.067543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4496e-b72d-45c0-8d2d-e841ead17798 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:44.177623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4496e-b72d-45c0-8d2d-e841ead17798 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:44.216557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d05fba-14ed-4056-a1e5-299efb0be1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:44.217165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05fba-14ed-4056-a1e5-299efb0be1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:44.217443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05fba-14ed-4056-a1e5-299efb0be1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:44.217714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05fba-14ed-4056-a1e5-299efb0be1f1 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:44.218440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d05fba-14ed-4056-a1e5-299efb0be1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:44.218785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d05fba-14ed-4056-a1e5-299efb0be1f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:44.220978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d05fba-14ed-4056-a1e5-299efb0be1f1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:44.238837 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 622/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 2 00:48:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:44.244811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de46fcb-2740-47d6-955b-a42f9ab6db79 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:44.362660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de46fcb-2740-47d6-955b-a42f9ab6db79 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:44.404894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661b398-f9d4-4d3c-bc6e-cf96f9a67f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:44.405493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661b398-f9d4-4d3c-bc6e-cf96f9a67f35 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:44.405771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661b398-f9d4-4d3c-bc6e-cf96f9a67f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:44.406044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661b398-f9d4-4d3c-bc6e-cf96f9a67f35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:44.477564 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:44.487817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661b398-f9d4-4d3c-bc6e-cf96f9a67f35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:44.489531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661b398-f9d4-4d3c-bc6e-cf96f9a67f35 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:44.592608 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 619/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:48:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:48:44.599055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d05fba-14ed-4056-a1e5-299efb0be1f1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:44.633133 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:44.717770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d05fba-14ed-4056-a1e5-299efb0be1f1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:44.756278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d096822-e84d-44a2-b029-5640643d2f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:44.756926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d096822-e84d-44a2-b029-5640643d2f9e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:44.757239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d096822-e84d-44a2-b029-5640643d2f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:44.757542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d096822-e84d-44a2-b029-5640643d2f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:44.768909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d096822-e84d-44a2-b029-5640643d2f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:44.770550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d096822-e84d-44a2-b029-5640643d2f9e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-9d096822-e84d-44a2-b029-5640643d2f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:44.787680 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:44.793682 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:44.795052 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:44.795052 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:44.795052 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:44.795052 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 623/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:48:44.795372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661b398-f9d4-4d3c-bc6e-cf96f9a67f35 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:44.898555 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:44.905216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661b398-f9d4-4d3c-bc6e-cf96f9a67f35 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:44.942842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65216a-2ec6-46e9-bc29-24152a2eba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:44.943505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65216a-2ec6-46e9-bc29-24152a2eba94 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:44.943919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65216a-2ec6-46e9-bc29-24152a2eba94 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:44.944137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65216a-2ec6-46e9-bc29-24152a2eba94 None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:44.944875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65216a-2ec6-46e9-bc29-24152a2eba94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:44.945244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65216a-2ec6-46e9-bc29-24152a2eba94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:44.946745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65216a-2ec6-46e9-bc29-24152a2eba94 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:44.959446 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 620/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:44.965889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d096822-e84d-44a2-b029-5640643d2f9e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:45.050469 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:45.075331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d096822-e84d-44a2-b029-5640643d2f9e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:45.110750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad06f7-dcdb-4a95-bdf5-1dc4698d729e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:45.111390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad06f7-dcdb-4a95-bdf5-1dc4698d729e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:45.111673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad06f7-dcdb-4a95-bdf5-1dc4698d729e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:45.111986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad06f7-dcdb-4a95-bdf5-1dc4698d729e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:45.118945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad06f7-dcdb-4a95-bdf5-1dc4698d729e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:45.120378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad06f7-dcdb-4a95-bdf5-1dc4698d729e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5fad06f7-dcdb-4a95-bdf5-1dc4698d729e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:48:45.132104 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:45.133295 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:45.134217 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:48:45.134217 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:48:45.134217 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:48:45.134217 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:48:45.134217 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:48:45.134217 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:48:45.134217 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:45.134217 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:45.134217 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 624/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:48:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:45.139535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65216a-2ec6-46e9-bc29-24152a2eba94 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:45.252245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65216a-2ec6-46e9-bc29-24152a2eba94 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:45.290761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ab10b-bf5d-49f4-a24f-edc23a21038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:45.291361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab10b-bf5d-49f4-a24f-edc23a21038e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:45.291667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab10b-bf5d-49f4-a24f-edc23a21038e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:45.291911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab10b-bf5d-49f4-a24f-edc23a21038e None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:45.292597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ab10b-bf5d-49f4-a24f-edc23a21038e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:45.292922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ab10b-bf5d-49f4-a24f-edc23a21038e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:45.294345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ab10b-bf5d-49f4-a24f-edc23a21038e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:45.312973 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 621/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:48:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:45.314888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad06f7-dcdb-4a95-bdf5-1dc4698d729e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:45.424202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad06f7-dcdb-4a95-bdf5-1dc4698d729e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:45.460728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262386-2553-45ae-9657-d2dfb26dd0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:45.461434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262386-2553-45ae-9657-d2dfb26dd0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:45.461800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262386-2553-45ae-9657-d2dfb26dd0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:45.462122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262386-2553-45ae-9657-d2dfb26dd0d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:45.462967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262386-2553-45ae-9657-d2dfb26dd0d0 None admin] RBAC: Adding query filter params (role.id=0905222c6f30467abc2b2a41d74fa282, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=619819f081824510a9f9e127e5070662) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:45.463278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262386-2553-45ae-9657-d2dfb26dd0d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:45.464879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262386-2553-45ae-9657-d2dfb26dd0d0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:45.471570 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 625/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:48:45 2022] GET /identity/v3/role_assignments?user.id=619819f081824510a9f9e127e5070662&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=0905222c6f30467abc2b2a41d74fa282 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:47.907131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730a35e-f1d4-491b-8b59-620158db9809 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:47.907875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730a35e-f1d4-491b-8b59-620158db9809 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:47.907875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730a35e-f1d4-491b-8b59-620158db9809 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:47.909078 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 622/1247] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:47.915118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661163ec-5191-477c-8a6a-22e849aa167f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:47.915540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661163ec-5191-477c-8a6a-22e849aa167f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:47.915671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661163ec-5191-477c-8a6a-22e849aa167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:47.922216 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:47.936415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-661163ec-5191-477c-8a6a-22e849aa167f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:47.937604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-661163ec-5191-477c-8a6a-22e849aa167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:48.015226 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 626/1248] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:48:48.308962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730a35e-f1d4-491b-8b59-620158db9809 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:48.329433 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:48.427611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730a35e-f1d4-491b-8b59-620158db9809 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:48.465208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4997b5c-9649-4302-96da-f8c3cd21b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:48.465872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4997b5c-9649-4302-96da-f8c3cd21b50b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:48.466187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4997b5c-9649-4302-96da-f8c3cd21b50b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:48.466510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4997b5c-9649-4302-96da-f8c3cd21b50b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:48.478812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4997b5c-9649-4302-96da-f8c3cd21b50b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-c4997b5c-9649-4302-96da-f8c3cd21b50b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:48:48.483921 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:48.485122 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:48.486109 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 623/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:48:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:48.491600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661163ec-5191-477c-8a6a-22e849aa167f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:48.607694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661163ec-5191-477c-8a6a-22e849aa167f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:48.640372 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:48.647922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b76300-c8cd-46b3-94a4-40141cd97a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:48.648556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b76300-c8cd-46b3-94a4-40141cd97a66 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:48.648847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b76300-c8cd-46b3-94a4-40141cd97a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:48.649115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b76300-c8cd-46b3-94a4-40141cd97a66 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:48.649913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b76300-c8cd-46b3-94a4-40141cd97a66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:48.650146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b76300-c8cd-46b3-94a4-40141cd97a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:48.651700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b76300-c8cd-46b3-94a4-40141cd97a66 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:48.661544 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 627/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:48:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:48.670062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4997b5c-9649-4302-96da-f8c3cd21b50b None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:48.758922 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:48.787212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4997b5c-9649-4302-96da-f8c3cd21b50b None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:48.823406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80bc58-410c-4341-a70c-c0e0973ab487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:48.824025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80bc58-410c-4341-a70c-c0e0973ab487 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:48.824303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80bc58-410c-4341-a70c-c0e0973ab487 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:48.824570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80bc58-410c-4341-a70c-c0e0973ab487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:48.834957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80bc58-410c-4341-a70c-c0e0973ab487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:48.836424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80bc58-410c-4341-a70c-c0e0973ab487 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-af80bc58-410c-4341-a70c-c0e0973ab487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:48.852472 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:48.853875 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:48.855054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:48.855054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:48.855054 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:48.855054 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 624/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:48.859826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b76300-c8cd-46b3-94a4-40141cd97a66 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:48.968204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b76300-c8cd-46b3-94a4-40141cd97a66 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:49.008005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcdf7e-923b-4930-a867-08c5c6c9801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:49.008722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcdf7e-923b-4930-a867-08c5c6c9801d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:49.009038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcdf7e-923b-4930-a867-08c5c6c9801d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:49.009344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcdf7e-923b-4930-a867-08c5c6c9801d None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:49.010072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcdf7e-923b-4930-a867-08c5c6c9801d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:49.010382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcdf7e-923b-4930-a867-08c5c6c9801d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:49.011951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcdf7e-923b-4930-a867-08c5c6c9801d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:49.025529 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 628/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 00:48:49.031544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80bc58-410c-4341-a70c-c0e0973ab487 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:49.135065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80bc58-410c-4341-a70c-c0e0973ab487 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:49.161095 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:49.169860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a463439-41da-45f7-86f8-33f7089cfede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:49.170576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a463439-41da-45f7-86f8-33f7089cfede None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:49.170897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a463439-41da-45f7-86f8-33f7089cfede None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:49.171177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a463439-41da-45f7-86f8-33f7089cfede None admin] PATH_INFO: `/v3/users/placement` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:49.178931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a463439-41da-45f7-86f8-33f7089cfede None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:49.180374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a463439-41da-45f7-86f8-33f7089cfede None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-0a463439-41da-45f7-86f8-33f7089cfede None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:48:49.191919 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:49.193110 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:49.194255 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:49.194255 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:49.194255 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:48:49.194255 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:48:49.194255 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:48:49.194255 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:48:49.194255 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:48:49.194255 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:48:49.194255 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:49.194255 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:49.194255 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 625/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:49.201205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcdf7e-923b-4930-a867-08c5c6c9801d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:49.260411 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:49.308418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcdf7e-923b-4930-a867-08c5c6c9801d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:49.344021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadc10-fa3a-4f60-b713-bdceacd2ca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:49.345280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadc10-fa3a-4f60-b713-bdceacd2ca8f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:49.345562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadc10-fa3a-4f60-b713-bdceacd2ca8f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:49.345848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadc10-fa3a-4f60-b713-bdceacd2ca8f None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:49.346609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aadc10-fa3a-4f60-b713-bdceacd2ca8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:49.346993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aadc10-fa3a-4f60-b713-bdceacd2ca8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:49.348670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aadc10-fa3a-4f60-b713-bdceacd2ca8f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:49.366305 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 629/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 2 00:48:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:49.372525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a463439-41da-45f7-86f8-33f7089cfede None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:49.484623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a463439-41da-45f7-86f8-33f7089cfede None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:49.523037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0ff53-4bed-403f-a17d-4960eebd2880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:49.523898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0ff53-4bed-403f-a17d-4960eebd2880 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:49.524183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0ff53-4bed-403f-a17d-4960eebd2880 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:49.524471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0ff53-4bed-403f-a17d-4960eebd2880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:49.580550 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:49.593665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0ff53-4bed-403f-a17d-4960eebd2880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:49.595775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0ff53-4bed-403f-a17d-4960eebd2880 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:49.723680 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 626/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:48:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 02 00:48:49.729709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadc10-fa3a-4f60-b713-bdceacd2ca8f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:49.837346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadc10-fa3a-4f60-b713-bdceacd2ca8f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:49.852752 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:49.880333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ea0c7-e309-43f4-9924-d1fbcc56b420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:49.880987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ea0c7-e309-43f4-9924-d1fbcc56b420 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:49.881270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ea0c7-e309-43f4-9924-d1fbcc56b420 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:49.881546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ea0c7-e309-43f4-9924-d1fbcc56b420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:49.895826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ea0c7-e309-43f4-9924-d1fbcc56b420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:49.897323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ea0c7-e309-43f4-9924-d1fbcc56b420 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b43ea0c7-e309-43f4-9924-d1fbcc56b420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:49.918535 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:49.919785 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:49.920892 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:49.920892 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:49.920892 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:49.928024 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 630/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:49.930199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0ff53-4bed-403f-a17d-4960eebd2880 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:50.021942 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:50.034723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0ff53-4bed-403f-a17d-4960eebd2880 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:50.069784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4097d-c943-48f7-be34-3bedbe44911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:50.070394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4097d-c943-48f7-be34-3bedbe44911d None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:50.070702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4097d-c943-48f7-be34-3bedbe44911d None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:50.070976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4097d-c943-48f7-be34-3bedbe44911d None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:50.071620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4097d-c943-48f7-be34-3bedbe44911d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:50.071920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4097d-c943-48f7-be34-3bedbe44911d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:50.073293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4097d-c943-48f7-be34-3bedbe44911d None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:50.085799 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 627/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:50.091685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ea0c7-e309-43f4-9924-d1fbcc56b420 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:50.193603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ea0c7-e309-43f4-9924-d1fbcc56b420 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:50.228092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b4990-9363-499f-9f07-e0097bf5d115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:50.228721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b4990-9363-499f-9f07-e0097bf5d115 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:50.229001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b4990-9363-499f-9f07-e0097bf5d115 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:50.229271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b4990-9363-499f-9f07-e0097bf5d115 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:50.237153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b4990-9363-499f-9f07-e0097bf5d115 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:50.239797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b4990-9363-499f-9f07-e0097bf5d115 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-9d7b4990-9363-499f-9f07-e0097bf5d115 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:48:50.255027 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:50.256119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:50.257162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:48:50.257162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:48:50.257162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:48:50.257162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:48:50.257162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:48:50.257162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:48:50.257162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:50.257162 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:50.257162 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 631/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:48:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:50.263460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4097d-c943-48f7-be34-3bedbe44911d None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:50.371747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4097d-c943-48f7-be34-3bedbe44911d None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:50.403981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16f206-88cc-4b8a-ae2e-ae7b4ac40d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:50.404580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16f206-88cc-4b8a-ae2e-ae7b4ac40d18 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:50.404867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16f206-88cc-4b8a-ae2e-ae7b4ac40d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:50.405142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16f206-88cc-4b8a-ae2e-ae7b4ac40d18 None admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:50.405854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16f206-88cc-4b8a-ae2e-ae7b4ac40d18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:50.406162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16f206-88cc-4b8a-ae2e-ae7b4ac40d18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:50.408176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16f206-88cc-4b8a-ae2e-ae7b4ac40d18 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:50.419537 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 628/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:48:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:50.426161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b4990-9363-499f-9f07-e0097bf5d115 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:50.453752 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:50.524472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b4990-9363-499f-9f07-e0097bf5d115 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:50.556827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ac816-d78d-4f57-9a87-1351bcda76e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:50.557684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ac816-d78d-4f57-9a87-1351bcda76e9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:50.557959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ac816-d78d-4f57-9a87-1351bcda76e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:50.558231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ac816-d78d-4f57-9a87-1351bcda76e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:50.558968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ac816-d78d-4f57-9a87-1351bcda76e9 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=619819f081824510a9f9e127e5070662) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:50.559272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ac816-d78d-4f57-9a87-1351bcda76e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:50.560705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ac816-d78d-4f57-9a87-1351bcda76e9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:50.566591 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 632/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:48:50 2022] GET /identity/v3/role_assignments?user.id=619819f081824510a9f9e127e5070662&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:52.685975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591315f-5651-4630-afef-93c7be209a9f None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:52.686528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591315f-5651-4630-afef-93c7be209a9f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:52.686528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591315f-5651-4630-afef-93c7be209a9f None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:52.687884 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 629/1261] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:52.693742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715168-44d9-428d-84ae-47a83e3f19b4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:52.694177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715168-44d9-428d-84ae-47a83e3f19b4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:52.694305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715168-44d9-428d-84ae-47a83e3f19b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:52.713793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea715168-44d9-428d-84ae-47a83e3f19b4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:52.715021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea715168-44d9-428d-84ae-47a83e3f19b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:52.780978 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 633/1262] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:48:53.045461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591315f-5651-4630-afef-93c7be209a9f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:53.056674 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:53.144938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591315f-5651-4630-afef-93c7be209a9f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:53.177428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b120-cf9e-46ef-8cc3-268197f06356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:53.178062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b120-cf9e-46ef-8cc3-268197f06356 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:53.178341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b120-cf9e-46ef-8cc3-268197f06356 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:53.178642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b120-cf9e-46ef-8cc3-268197f06356 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:53.189267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1b120-cf9e-46ef-8cc3-268197f06356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-93b1b120-cf9e-46ef-8cc3-268197f06356 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:48:53.193981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:53.195129 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:53.196009 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 630/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:48:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:53.201022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea715168-44d9-428d-84ae-47a83e3f19b4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:53.218692 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:53.296549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea715168-44d9-428d-84ae-47a83e3f19b4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:53.330228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f995a-327d-4bcc-86cf-3175f2585046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:53.330844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f995a-327d-4bcc-86cf-3175f2585046 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:53.331127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f995a-327d-4bcc-86cf-3175f2585046 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:53.331407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f995a-327d-4bcc-86cf-3175f2585046 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:53.332068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f995a-327d-4bcc-86cf-3175f2585046 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:53.332370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f995a-327d-4bcc-86cf-3175f2585046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:53.333736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f995a-327d-4bcc-86cf-3175f2585046 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:53.341478 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 634/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:48:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:53.347722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b120-cf9e-46ef-8cc3-268197f06356 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:53.410339 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:53.442759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b120-cf9e-46ef-8cc3-268197f06356 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:53.474871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5760de7-e4be-4a7a-9c16-1974825f9d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:53.475479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5760de7-e4be-4a7a-9c16-1974825f9d4e None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:53.475758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5760de7-e4be-4a7a-9c16-1974825f9d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:53.476030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5760de7-e4be-4a7a-9c16-1974825f9d4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:53.485474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5760de7-e4be-4a7a-9c16-1974825f9d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:53.487481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5760de7-e4be-4a7a-9c16-1974825f9d4e None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-e5760de7-e4be-4a7a-9c16-1974825f9d4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:53.501382 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:53.502567 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:53.503723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:53.503723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:53.503723 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:53.503723 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 631/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:53.508085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f995a-327d-4bcc-86cf-3175f2585046 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:53.587982 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:53.606583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f995a-327d-4bcc-86cf-3175f2585046 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:53.640293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763a954-eca8-4fa4-bdec-3cac2a378a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:53.640899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763a954-eca8-4fa4-bdec-3cac2a378a8b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:53.641176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763a954-eca8-4fa4-bdec-3cac2a378a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:53.641444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763a954-eca8-4fa4-bdec-3cac2a378a8b None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:53.642943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763a954-eca8-4fa4-bdec-3cac2a378a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:53.643465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763a954-eca8-4fa4-bdec-3cac2a378a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:53.645955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763a954-eca8-4fa4-bdec-3cac2a378a8b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:53.660687 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 635/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:53.667448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5760de7-e4be-4a7a-9c16-1974825f9d4e None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:53.769763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5760de7-e4be-4a7a-9c16-1974825f9d4e None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:53.788161 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:53.801834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557112d8-1598-4ba2-b129-282151f9aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:53.802449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557112d8-1598-4ba2-b129-282151f9aa59 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:53.802757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557112d8-1598-4ba2-b129-282151f9aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:53.803034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557112d8-1598-4ba2-b129-282151f9aa59 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:53.810274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557112d8-1598-4ba2-b129-282151f9aa59 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:53.811725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557112d8-1598-4ba2-b129-282151f9aa59 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-557112d8-1598-4ba2-b129-282151f9aa59 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:48:53.822854 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:53.823939 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:53.824988 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:53.824988 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:53.824988 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:48:53.824988 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:48:53.824988 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:48:53.824988 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:48:53.824988 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:48:53.824988 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:48:53.824988 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:53.824988 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:53.824988 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 632/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:53.829906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763a954-eca8-4fa4-bdec-3cac2a378a8b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:53.925771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763a954-eca8-4fa4-bdec-3cac2a378a8b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:53.958589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721e4d-25e1-4a14-8f17-bcc75bf8f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:53.960965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721e4d-25e1-4a14-8f17-bcc75bf8f5ff None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:53.961246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721e4d-25e1-4a14-8f17-bcc75bf8f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:53.961521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721e4d-25e1-4a14-8f17-bcc75bf8f5ff None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:53.962248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69721e4d-25e1-4a14-8f17-bcc75bf8f5ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:53.962554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69721e4d-25e1-4a14-8f17-bcc75bf8f5ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:53.964040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69721e4d-25e1-4a14-8f17-bcc75bf8f5ff None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:53.973732 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:53.982261 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 636/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 2 00:48:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:53.988569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557112d8-1598-4ba2-b129-282151f9aa59 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:54.091989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557112d8-1598-4ba2-b129-282151f9aa59 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:54.123180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ff728-bc64-4e53-bcd1-4e51d10470c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:54.123791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ff728-bc64-4e53-bcd1-4e51d10470c6 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:54.124067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ff728-bc64-4e53-bcd1-4e51d10470c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:54.124338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ff728-bc64-4e53-bcd1-4e51d10470c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:54.134800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ff728-bc64-4e53-bcd1-4e51d10470c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:54.136236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ff728-bc64-4e53-bcd1-4e51d10470c6 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-a08ff728-bc64-4e53-bcd1-4e51d10470c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:54.150408 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:54.151571 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:54.152694 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:54.152694 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:54.152694 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:54.152694 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 633/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:54.157925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721e4d-25e1-4a14-8f17-bcc75bf8f5ff None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:54.254228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721e4d-25e1-4a14-8f17-bcc75bf8f5ff None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:54.286856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6faf6d-8e19-447a-a0e6-1bf055ac4104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:54.287449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6faf6d-8e19-447a-a0e6-1bf055ac4104 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:54.287730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6faf6d-8e19-447a-a0e6-1bf055ac4104 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:54.288005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6faf6d-8e19-447a-a0e6-1bf055ac4104 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:54.288642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6faf6d-8e19-447a-a0e6-1bf055ac4104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:54.288944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6faf6d-8e19-447a-a0e6-1bf055ac4104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:54.290301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6faf6d-8e19-447a-a0e6-1bf055ac4104 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:54.302660 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 637/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:54.308489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ff728-bc64-4e53-bcd1-4e51d10470c6 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:54.338733 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:54.404470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ff728-bc64-4e53-bcd1-4e51d10470c6 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:54.437080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c5dff-ffba-42b9-8fb3-166b6e9aeb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:54.437687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c5dff-ffba-42b9-8fb3-166b6e9aeb48 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:54.437966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c5dff-ffba-42b9-8fb3-166b6e9aeb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:54.438237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c5dff-ffba-42b9-8fb3-166b6e9aeb48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:54.444768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c5dff-ffba-42b9-8fb3-166b6e9aeb48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:54.446221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c5dff-ffba-42b9-8fb3-166b6e9aeb48 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-1c3c5dff-ffba-42b9-8fb3-166b6e9aeb48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:48:54.457530 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:54.458657 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:54.459904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:48:54.459904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:48:54.459904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:48:54.459904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:48:54.459904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:48:54.459904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:48:54.459904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:54.459904 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:54.459904 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 634/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:48:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 02 00:48:54.464410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6faf6d-8e19-447a-a0e6-1bf055ac4104 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:54.522900 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:54.566030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6faf6d-8e19-447a-a0e6-1bf055ac4104 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:54.599399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542218b0-e777-49aa-8a00-17f8e81df521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:54.599987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542218b0-e777-49aa-8a00-17f8e81df521 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:54.600270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542218b0-e777-49aa-8a00-17f8e81df521 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:54.600545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542218b0-e777-49aa-8a00-17f8e81df521 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:54.601229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542218b0-e777-49aa-8a00-17f8e81df521 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:54.601535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542218b0-e777-49aa-8a00-17f8e81df521 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:54.602998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542218b0-e777-49aa-8a00-17f8e81df521 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:54.615534 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 638/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:48:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:54.621446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c5dff-ffba-42b9-8fb3-166b6e9aeb48 None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:54.717860 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:54.726922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c5dff-ffba-42b9-8fb3-166b6e9aeb48 None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:54.759563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58746c-5111-4edc-b0a0-3879e3cbb0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:54.760207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58746c-5111-4edc-b0a0-3879e3cbb0a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:54.760491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58746c-5111-4edc-b0a0-3879e3cbb0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:54.760767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58746c-5111-4edc-b0a0-3879e3cbb0a7 None admin] PATH_INFO: `/v3/projects/2904782f42d6469190a89864c9e71ed2/users/619819f081824510a9f9e127e5070662/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:54.762647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58746c-5111-4edc-b0a0-3879e3cbb0a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2904782f42d6469190a89864c9e71ed2, user_id=619819f081824510a9f9e127e5070662, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:54.764077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58746c-5111-4edc-b0a0-3879e3cbb0a7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:54.776250 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 635/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 2 00:48:54 2022] PUT /identity/v3/projects/2904782f42d6469190a89864c9e71ed2/users/619819f081824510a9f9e127e5070662/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:48:56.872017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d562ae-3664-4e97-bee2-47ae9a309be2 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:56.872552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d562ae-3664-4e97-bee2-47ae9a309be2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:56.872552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d562ae-3664-4e97-bee2-47ae9a309be2 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:56.873882 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 639/1274] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:48:56.879134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779193a0-dc1b-4cdc-a4cb-cb73f06fcf2a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:56.879541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779193a0-dc1b-4cdc-a4cb-cb73f06fcf2a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:56.879685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779193a0-dc1b-4cdc-a4cb-cb73f06fcf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:56.897559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-779193a0-dc1b-4cdc-a4cb-cb73f06fcf2a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:48:56.898753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-779193a0-dc1b-4cdc-a4cb-cb73f06fcf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:48:56.962148 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 636/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:48:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:48:57.232413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d562ae-3664-4e97-bee2-47ae9a309be2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:57.329920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d562ae-3664-4e97-bee2-47ae9a309be2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:57.347347 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:57.366425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958acaf-657d-4035-8774-4d2a93883e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:57.367087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958acaf-657d-4035-8774-4d2a93883e56 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:57.367366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958acaf-657d-4035-8774-4d2a93883e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:57.367636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958acaf-657d-4035-8774-4d2a93883e56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:57.377796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958acaf-657d-4035-8774-4d2a93883e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-8958acaf-657d-4035-8774-4d2a93883e56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 02 00:48:57.382469 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:57.383547 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:57.384579 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 640/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 2 00:48:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:57.389706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779193a0-dc1b-4cdc-a4cb-cb73f06fcf2a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:57.467333 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:57.485649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779193a0-dc1b-4cdc-a4cb-cb73f06fcf2a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:57.517752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad9bec-02a8-4a60-ac7f-098bb012e99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:57.518338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad9bec-02a8-4a60-ac7f-098bb012e99a None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:57.518636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad9bec-02a8-4a60-ac7f-098bb012e99a None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:57.518906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad9bec-02a8-4a60-ac7f-098bb012e99a None admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:57.519556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad9bec-02a8-4a60-ac7f-098bb012e99a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:57.519855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad9bec-02a8-4a60-ac7f-098bb012e99a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:57.521191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad9bec-02a8-4a60-ac7f-098bb012e99a None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:57.528807 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 637/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 2 00:48:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:57.535106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958acaf-657d-4035-8774-4d2a93883e56 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:57.629560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958acaf-657d-4035-8774-4d2a93883e56 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:57.674654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f872174-5c61-4e71-b5f6-4c970dcf6ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:57.675313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f872174-5c61-4e71-b5f6-4c970dcf6ecf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:57.675572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f872174-5c61-4e71-b5f6-4c970dcf6ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:57.675844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f872174-5c61-4e71-b5f6-4c970dcf6ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:57.688330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f872174-5c61-4e71-b5f6-4c970dcf6ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:57.690241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f872174-5c61-4e71-b5f6-4c970dcf6ecf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4f872174-5c61-4e71-b5f6-4c970dcf6ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:57.708565 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:57.709878 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:57.711183 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:57.711183 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:57.711183 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:57.711183 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 641/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:57.715855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad9bec-02a8-4a60-ac7f-098bb012e99a None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:57.815442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad9bec-02a8-4a60-ac7f-098bb012e99a None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:57.846899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed7334-6282-427c-b45c-375e076b1d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:57.847484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed7334-6282-427c-b45c-375e076b1d6f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:57.847759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed7334-6282-427c-b45c-375e076b1d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:57.848027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed7334-6282-427c-b45c-375e076b1d6f None admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:57.848651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed7334-6282-427c-b45c-375e076b1d6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:57.848947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed7334-6282-427c-b45c-375e076b1d6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:57.850285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed7334-6282-427c-b45c-375e076b1d6f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:57.861368 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 638/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:57.867163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f872174-5c61-4e71-b5f6-4c970dcf6ecf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:57.897922 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:57.965897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f872174-5c61-4e71-b5f6-4c970dcf6ecf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:57.999658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33455a1-c57c-441d-8997-337bfe0a7658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:58.000291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33455a1-c57c-441d-8997-337bfe0a7658 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:58.000570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33455a1-c57c-441d-8997-337bfe0a7658 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:58.000840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33455a1-c57c-441d-8997-337bfe0a7658 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:58.012334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33455a1-c57c-441d-8997-337bfe0a7658 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:58.013958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33455a1-c57c-441d-8997-337bfe0a7658 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-e33455a1-c57c-441d-8997-337bfe0a7658 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 00:48:58.026414 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:58.031637 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:58.033031 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:58.033031 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:58.033031 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 00:48:58.033031 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 00:48:58.033031 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 00:48:58.033031 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 00:48:58.033031 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 00:48:58.033031 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 00:48:58.033031 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 02 00:48:58.033031 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:48:58.033031 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 642/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:58.034458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed7334-6282-427c-b45c-375e076b1d6f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:58.037710 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:58.132509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed7334-6282-427c-b45c-375e076b1d6f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:58.164528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3d733-01fb-4d25-a202-6d1457c5708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:58.165119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3d733-01fb-4d25-a202-6d1457c5708f None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:58.165397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3d733-01fb-4d25-a202-6d1457c5708f None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:58.165666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3d733-01fb-4d25-a202-6d1457c5708f None admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:58.166381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3d733-01fb-4d25-a202-6d1457c5708f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:58.166713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3d733-01fb-4d25-a202-6d1457c5708f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:58.168128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3d733-01fb-4d25-a202-6d1457c5708f None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:58.184819 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 639/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 2 00:48:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:58.190723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33455a1-c57c-441d-8997-337bfe0a7658 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:58.277727 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:58.287641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33455a1-c57c-441d-8997-337bfe0a7658 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:58.319777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8fa0a-35bd-49fc-a1f8-ea35cba98c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:58.320365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8fa0a-35bd-49fc-a1f8-ea35cba98c17 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:58.320642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8fa0a-35bd-49fc-a1f8-ea35cba98c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:58.320911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8fa0a-35bd-49fc-a1f8-ea35cba98c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:58.388416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8fa0a-35bd-49fc-a1f8-ea35cba98c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:58.389809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8fa0a-35bd-49fc-a1f8-ea35cba98c17 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:58.473080 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:58.483327 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 643/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 2 00:48:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 02 00:48:58.489699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3d733-01fb-4d25-a202-6d1457c5708f None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:58.546400 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:58.583153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3d733-01fb-4d25-a202-6d1457c5708f None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:58.614935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe47bd6-5af1-45a2-9312-5a1f70e2498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:58.615539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe47bd6-5af1-45a2-9312-5a1f70e2498c None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:58.615814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe47bd6-5af1-45a2-9312-5a1f70e2498c None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:58.616084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe47bd6-5af1-45a2-9312-5a1f70e2498c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:58.625430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe47bd6-5af1-45a2-9312-5a1f70e2498c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:58.627584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe47bd6-5af1-45a2-9312-5a1f70e2498c None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-cbe47bd6-5af1-45a2-9312-5a1f70e2498c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 00:48:58.641304 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:58.643167 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 02 00:48:58.644327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 00:48:58.644327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 02 00:48:58.644327 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:58.644327 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 640/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:58.648527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8fa0a-35bd-49fc-a1f8-ea35cba98c17 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:58.742605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8fa0a-35bd-49fc-a1f8-ea35cba98c17 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:58.775581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0d942-960b-4874-9a7f-2bf6ef3dd60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:58.776165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0d942-960b-4874-9a7f-2bf6ef3dd60f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:58.776447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0d942-960b-4874-9a7f-2bf6ef3dd60f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:58.776717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0d942-960b-4874-9a7f-2bf6ef3dd60f None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:58.777343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0d942-960b-4874-9a7f-2bf6ef3dd60f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:58.777636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0d942-960b-4874-9a7f-2bf6ef3dd60f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:58.779030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0d942-960b-4874-9a7f-2bf6ef3dd60f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:58.790053 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 644/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 2 00:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:58.795684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe47bd6-5af1-45a2-9312-5a1f70e2498c None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:58.890817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe47bd6-5af1-45a2-9312-5a1f70e2498c None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:58.904473 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:58.924273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e075f-690f-444a-bc6b-f616e507b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:58.924954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e075f-690f-444a-bc6b-f616e507b8cc None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:58.925231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e075f-690f-444a-bc6b-f616e507b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:58.925496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e075f-690f-444a-bc6b-f616e507b8cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:58.931737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e075f-690f-444a-bc6b-f616e507b8cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:58.933421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e075f-690f-444a-bc6b-f616e507b8cc None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-c79e075f-690f-444a-bc6b-f616e507b8cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 02 00:48:58.944733 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:48:58.945779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:48:58.946953 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 00:48:58.946953 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 00:48:58.946953 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 00:48:58.946953 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 00:48:58.946953 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 00:48:58.946953 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 00:48:58.946953 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 02 00:48:58.946953 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 00:48:58.946953 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 641/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 2 00:48:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:48:58.951569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0d942-960b-4874-9a7f-2bf6ef3dd60f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:58.999981 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:59.047449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0d942-960b-4874-9a7f-2bf6ef3dd60f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:59.080291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9e105-6638-451b-90e1-14886f4b1664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:59.080883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9e105-6638-451b-90e1-14886f4b1664 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:59.081161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9e105-6638-451b-90e1-14886f4b1664 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:59.081431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9e105-6638-451b-90e1-14886f4b1664 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:59.082105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9e105-6638-451b-90e1-14886f4b1664 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:59.082408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9e105-6638-451b-90e1-14886f4b1664 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:59.083856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9e105-6638-451b-90e1-14886f4b1664 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:59.095021 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 645/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 2 00:48:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:48:59.101827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e075f-690f-444a-bc6b-f616e507b8cc None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:48:59.197998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e075f-690f-444a-bc6b-f616e507b8cc None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:48:59.229692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d01cf0-676d-4f00-b5eb-5d5edfe155b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:48:59.230272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d01cf0-676d-4f00-b5eb-5d5edfe155b7 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:48:59.230546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d01cf0-676d-4f00-b5eb-5d5edfe155b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:48:59.230846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d01cf0-676d-4f00-b5eb-5d5edfe155b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:48:59.231549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d01cf0-676d-4f00-b5eb-5d5edfe155b7 None admin] RBAC: Adding query filter params (role.id=284afd30cc464e98bd3e2b1e1c42ff7e, scope.project.id=2904782f42d6469190a89864c9e71ed2, user.id=619819f081824510a9f9e127e5070662) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:48:59.231850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d01cf0-676d-4f00-b5eb-5d5edfe155b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:48:59.233248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d01cf0-676d-4f00-b5eb-5d5edfe155b7 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:48:59.238817 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 642/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 2 00:48:59 2022] GET /identity/v3/role_assignments?user.id=619819f081824510a9f9e127e5070662&scope.project.id=2904782f42d6469190a89864c9e71ed2&role.id=284afd30cc464e98bd3e2b1e1c42ff7e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:49:01.403961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a5cc-1a52-49dd-a539-9359e5dc2510 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:01.404507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a5cc-1a52-49dd-a539-9359e5dc2510 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:01.404507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a5cc-1a52-49dd-a539-9359e5dc2510 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:01.405774 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 646/1288] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:01.411184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bb841-51b3-4ab6-9847-995a573b1022 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:01.411580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bb841-51b3-4ab6-9847-995a573b1022 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:01.411736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bb841-51b3-4ab6-9847-995a573b1022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:01.429945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-343bb841-51b3-4ab6-9847-995a573b1022 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:01.431148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-343bb841-51b3-4ab6-9847-995a573b1022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:01.459880 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:01.495147 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 643/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:49:01.763052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87a5cc-1a52-49dd-a539-9359e5dc2510 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:01.861838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87a5cc-1a52-49dd-a539-9359e5dc2510 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:01.871866 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:01.894173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d9614-3acb-44c9-a60f-015dd225ec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:01.894830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d9614-3acb-44c9-a60f-015dd225ec85 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:01.895112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d9614-3acb-44c9-a60f-015dd225ec85 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:01.895401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d9614-3acb-44c9-a60f-015dd225ec85 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:01.895960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d9614-3acb-44c9-a60f-015dd225ec85 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:01.897309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d9614-3acb-44c9-a60f-015dd225ec85 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1f9d9614-3acb-44c9-a60f-015dd225ec85 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:49:01.905720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:49:01.906961 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:49:01.908492 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 647/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 2 00:49:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:49:01.913364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bb841-51b3-4ab6-9847-995a573b1022 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:02.008375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bb841-51b3-4ab6-9847-995a573b1022 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:02.042382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1c06d-7a86-49a3-9112-f1079ab1a2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:02.042947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1c06d-7a86-49a3-9112-f1079ab1a2bc None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:02.043231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1c06d-7a86-49a3-9112-f1079ab1a2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:02.043505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1c06d-7a86-49a3-9112-f1079ab1a2bc None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:02.044125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1c06d-7a86-49a3-9112-f1079ab1a2bc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:49:02.044428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1c06d-7a86-49a3-9112-f1079ab1a2bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:02.045779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1c06d-7a86-49a3-9112-f1079ab1a2bc None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:02.051011 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 644/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 2 00:49:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:49:02.056725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d9614-3acb-44c9-a60f-015dd225ec85 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:02.154333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d9614-3acb-44c9-a60f-015dd225ec85 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:02.186893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a77dc4-a637-4445-89c1-f710c1d38f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:02.187482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a77dc4-a637-4445-89c1-f710c1d38f8c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:02.187758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a77dc4-a637-4445-89c1-f710c1d38f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:02.188028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a77dc4-a637-4445-89c1-f710c1d38f8c None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:02.188647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a77dc4-a637-4445-89c1-f710c1d38f8c None admin] RBAC: Adding query filter params (type=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:49:02.188948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a77dc4-a637-4445-89c1-f710c1d38f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:02.190331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a77dc4-a637-4445-89c1-f710c1d38f8c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:02.194522 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 648/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 2 00:49:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:49:04.341035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36532ceb-a99a-48c6-8cdf-faf753eca35e None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:04.341538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36532ceb-a99a-48c6-8cdf-faf753eca35e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:04.341538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36532ceb-a99a-48c6-8cdf-faf753eca35e None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:04.342872 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 645/1293] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:04.349373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61b0f-6232-4e19-b910-78c6e564f978 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:04.349811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61b0f-6232-4e19-b910-78c6e564f978 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:04.349909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61b0f-6232-4e19-b910-78c6e564f978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:04.367639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d1a61b0f-6232-4e19-b910-78c6e564f978 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:04.368799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d1a61b0f-6232-4e19-b910-78c6e564f978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:04.397060 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:04.434188 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 649/1294] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:49:04.704876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36532ceb-a99a-48c6-8cdf-faf753eca35e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:04.735103 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:04.802355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36532ceb-a99a-48c6-8cdf-faf753eca35e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:04.835429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f032dc3-1710-47ac-b1a0-f78699ef5661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:04.836020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f032dc3-1710-47ac-b1a0-f78699ef5661 None admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:04.836296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f032dc3-1710-47ac-b1a0-f78699ef5661 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:04.836565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f032dc3-1710-47ac-b1a0-f78699ef5661 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:04.837203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f032dc3-1710-47ac-b1a0-f78699ef5661 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:04.838544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f032dc3-1710-47ac-b1a0-f78699ef5661 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:04.852169 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 646/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 2 00:49:04 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:49:06.970533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45901cad-ddf9-4978-9435-58bfb4e50a5d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:06.971602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45901cad-ddf9-4978-9435-58bfb4e50a5d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:06.972065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45901cad-ddf9-4978-9435-58bfb4e50a5d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:06.973411 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 650/1296] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:06.978546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849701d-1a5f-435e-8fb7-88fbcde7b133 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:06.978986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849701d-1a5f-435e-8fb7-88fbcde7b133 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:06.979119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849701d-1a5f-435e-8fb7-88fbcde7b133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:06.997250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a849701d-1a5f-435e-8fb7-88fbcde7b133 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:06.998421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a849701d-1a5f-435e-8fb7-88fbcde7b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:07.069226 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 647/1297] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 02 00:49:07.335532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45901cad-ddf9-4978-9435-58bfb4e50a5d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:07.431908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45901cad-ddf9-4978-9435-58bfb4e50a5d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:07.464557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68c3de-7437-48eb-904e-8ed9348d366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:07.465167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68c3de-7437-48eb-904e-8ed9348d366d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:07.465443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68c3de-7437-48eb-904e-8ed9348d366d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:07.465709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68c3de-7437-48eb-904e-8ed9348d366d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:07.466283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68c3de-7437-48eb-904e-8ed9348d366d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:07.467668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68c3de-7437-48eb-904e-8ed9348d366d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1e68c3de-7437-48eb-904e-8ed9348d366d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:49:07.476246 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:49:07.477399 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:49:07.478360 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 651/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 2 00:49:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:49:07.483176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849701d-1a5f-435e-8fb7-88fbcde7b133 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:07.501416 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:07.578805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849701d-1a5f-435e-8fb7-88fbcde7b133 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:07.610645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fbe66-828a-4f1e-9c3c-8e90f1b6c0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:07.611189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbe66-828a-4f1e-9c3c-8e90f1b6c0eb None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:07.611470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbe66-828a-4f1e-9c3c-8e90f1b6c0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:07.612095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbe66-828a-4f1e-9c3c-8e90f1b6c0eb None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:07.612501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fbe66-828a-4f1e-9c3c-8e90f1b6c0eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:49:07.612803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fbe66-828a-4f1e-9c3c-8e90f1b6c0eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:07.614153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fbe66-828a-4f1e-9c3c-8e90f1b6c0eb None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:07.619056 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 648/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 2 00:49:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:49:07.624885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68c3de-7437-48eb-904e-8ed9348d366d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:07.660305 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:07.737201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68c3de-7437-48eb-904e-8ed9348d366d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:07.770206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6b577-4b0e-46f7-af27-5c30a23e9ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:07.770828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6b577-4b0e-46f7-af27-5c30a23e9ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:07.771104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6b577-4b0e-46f7-af27-5c30a23e9ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:07.771374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6b577-4b0e-46f7-af27-5c30a23e9ed6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:07.772067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6b577-4b0e-46f7-af27-5c30a23e9ed6 None admin] RBAC: Adding query filter params (interface=public, service_id=f48f9767351d493db9d4c36a9da4e45c, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:49:07.772372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6b577-4b0e-46f7-af27-5c30a23e9ed6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:07.773727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6b577-4b0e-46f7-af27-5c30a23e9ed6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:07.778588 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 652/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 2 00:49:07 2022] GET /identity/v3/endpoints?service_id=f48f9767351d493db9d4c36a9da4e45c&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:49:07.784316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fbe66-828a-4f1e-9c3c-8e90f1b6c0eb None admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:07.862545 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:07.880346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fbe66-828a-4f1e-9c3c-8e90f1b6c0eb None admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:07.911695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f4427-3a51-422b-bcd9-e8b7b7e2bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:07.912279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f4427-3a51-422b-bcd9-e8b7b7e2bc50 None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:07.912552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f4427-3a51-422b-bcd9-e8b7b7e2bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:07.912819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f4427-3a51-422b-bcd9-e8b7b7e2bc50 None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:07.913410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f4427-3a51-422b-bcd9-e8b7b7e2bc50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:07.914768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f4427-3a51-422b-bcd9-e8b7b7e2bc50 None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:07.921196 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 649/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 2 00:49:07 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:49:10.047876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7d5e6-2143-45e9-af3f-9897822d330b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:10.048430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7d5e6-2143-45e9-af3f-9897822d330b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:10.048430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7d5e6-2143-45e9-af3f-9897822d330b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:10.050403 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 653/1302] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:49:10.055621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db9d85-e76c-43e9-a13b-27bf2fdadf61 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:10.056047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db9d85-e76c-43e9-a13b-27bf2fdadf61 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:10.056151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db9d85-e76c-43e9-a13b-27bf2fdadf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:10.074305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-11db9d85-e76c-43e9-a13b-27bf2fdadf61 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:49:10.075496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-11db9d85-e76c-43e9-a13b-27bf2fdadf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:49:10.138234 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 650/1303] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:49:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 00:49:10.402456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7d5e6-2143-45e9-af3f-9897822d330b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:10.494818 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:10.501618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7d5e6-2143-45e9-af3f-9897822d330b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:10.533895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac30e7a-fe81-4517-8801-807d4207f68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:10.534502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac30e7a-fe81-4517-8801-807d4207f68a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:10.534808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac30e7a-fe81-4517-8801-807d4207f68a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:10.535081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac30e7a-fe81-4517-8801-807d4207f68a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:10.535654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac30e7a-fe81-4517-8801-807d4207f68a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:10.537011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac30e7a-fe81-4517-8801-807d4207f68a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1ac30e7a-fe81-4517-8801-807d4207f68a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 00:49:10.545353 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 00:49:10.546586 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 00:49:10.547700 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 654/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 2 00:49:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 00:49:10.552910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db9d85-e76c-43e9-a13b-27bf2fdadf61 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:10.624663 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:10.651653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db9d85-e76c-43e9-a13b-27bf2fdadf61 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:10.685312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff454b-6787-4798-94c3-d8016598699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:10.685915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff454b-6787-4798-94c3-d8016598699b None admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:10.686196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff454b-6787-4798-94c3-d8016598699b None admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:10.686469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff454b-6787-4798-94c3-d8016598699b None admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:10.687123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff454b-6787-4798-94c3-d8016598699b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:49:10.687430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff454b-6787-4798-94c3-d8016598699b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:10.688781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff454b-6787-4798-94c3-d8016598699b None admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:10.693805 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 651/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 2 00:49:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:49:10.699693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac30e7a-fe81-4517-8801-807d4207f68a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:49:10.796341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac30e7a-fe81-4517-8801-807d4207f68a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:49:10.829066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a49c0-4bab-43e0-881c-9d99ec27c489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:49:10.829655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a49c0-4bab-43e0-881c-9d99ec27c489 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:49:10.829935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a49c0-4bab-43e0-881c-9d99ec27c489 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:49:10.830204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a49c0-4bab-43e0-881c-9d99ec27c489 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:49:10.830914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a49c0-4bab-43e0-881c-9d99ec27c489 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:49:10.832271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a49c0-4bab-43e0-881c-9d99ec27c489 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:49:10.851507 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 655/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 00:49:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:49:20.691001 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=30 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:20.847656 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:15.836149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2c81-260a-4d02-a1a5-cf5681d9815d None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:15.838687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2c81-260a-4d02-a1a5-cf5681d9815d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:15.839471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2c81-260a-4d02-a1a5-cf5681d9815d None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:15.851618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b45ba-42c4-46c4-9660-521dd1c429d7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:15.852108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b45ba-42c4-46c4-9660-521dd1c429d7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:15.852210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b45ba-42c4-46c4-9660-521dd1c429d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:15.857942 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 652/1307] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:15 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:15.986630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ee7b45ba-42c4-46c4-9660-521dd1c429d7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:15.989906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee7b45ba-42c4-46c4-9660-521dd1c429d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:16.125215 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 656/1308] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:50:16.426853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79dd15-b411-4633-9e39-324de3b4246f None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:16.427212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79dd15-b411-4633-9e39-324de3b4246f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:16.427458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79dd15-b411-4633-9e39-324de3b4246f None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:16.428953 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 653/1309] 10.222.0.23 () {54 vars in 964 bytes} [Sun Oct 2 00:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:16.436338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139e0be-9aa3-4b2e-b415-7cc641e5cb61 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:16.436676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139e0be-9aa3-4b2e-b415-7cc641e5cb61 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:16.437062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139e0be-9aa3-4b2e-b415-7cc641e5cb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:16.519122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8139e0be-9aa3-4b2e-b415-7cc641e5cb61 None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:16.520340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8139e0be-9aa3-4b2e-b415-7cc641e5cb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:16.543033 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:16.602954 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 657/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Sun Oct 2 00:50:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:16.612673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79dd15-b411-4633-9e39-324de3b4246f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:16.614524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fe79dd15-b411-4633-9e39-324de3b4246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:16.736860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79dd15-b411-4633-9e39-324de3b4246f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:16.819381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8faf2d-13c7-4816-b395-560c8959b16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:16.819989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8faf2d-13c7-4816-b395-560c8959b16e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:16.820265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8faf2d-13c7-4816-b395-560c8959b16e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:16.820532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8faf2d-13c7-4816-b395-560c8959b16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:16.822148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0b8faf2d-13c7-4816-b395-560c8959b16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:16.881710 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:16.943556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8faf2d-13c7-4816-b395-560c8959b16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:16.945028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8faf2d-13c7-4816-b395-560c8959b16e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:16.971839 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 654/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:19.452782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9f71d-f19d-4b8f-8b4b-9ef7301717c2 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:19.453351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9f71d-f19d-4b8f-8b4b-9ef7301717c2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:19.453351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9f71d-f19d-4b8f-8b4b-9ef7301717c2 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:19.454756 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 658/1312] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:19.460339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab9b60-00a8-4963-b934-79fac1b8cf19 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:19.460750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab9b60-00a8-4963-b934-79fac1b8cf19 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:19.460941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab9b60-00a8-4963-b934-79fac1b8cf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:19.542834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b0ab9b60-00a8-4963-b934-79fac1b8cf19 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:19.544032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b0ab9b60-00a8-4963-b934-79fac1b8cf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:19.641656 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 655/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:19.924119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9f71d-f19d-4b8f-8b4b-9ef7301717c2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:19.925746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c9b9f71d-f19d-4b8f-8b4b-9ef7301717c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:20.037095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9f71d-f19d-4b8f-8b4b-9ef7301717c2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:20.115859 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:20.118332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ed8aa-cc5d-4717-b628-4a51b5055169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:20.119835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ed8aa-cc5d-4717-b628-4a51b5055169 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:20.120404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ed8aa-cc5d-4717-b628-4a51b5055169 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:20.120740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ed8aa-cc5d-4717-b628-4a51b5055169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:20.122694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fa0ed8aa-cc5d-4717-b628-4a51b5055169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:20.234531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ed8aa-cc5d-4717-b628-4a51b5055169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:20.235944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ed8aa-cc5d-4717-b628-4a51b5055169 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:20.254583 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 659/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:22.714594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08f49-946b-4c87-85fb-273cfd4cec44 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:22.715168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08f49-946b-4c87-85fb-273cfd4cec44 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:22.715168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08f49-946b-4c87-85fb-273cfd4cec44 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:22.716555 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 656/1315] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:22.721975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30565e7-db78-4800-b00b-9121672a9993 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:22.722403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30565e7-db78-4800-b00b-9121672a9993 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:22.722521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30565e7-db78-4800-b00b-9121672a9993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:22.789344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e30565e7-db78-4800-b00b-9121672a9993 None None] MFA Rules not processed for user `40bcd9aa5e344ab38aab7605ac197048`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:22.790668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e30565e7-db78-4800-b00b-9121672a9993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:22.842123 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:22.885771 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 660/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:23.177470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e08f49-946b-4c87-85fb-273cfd4cec44 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:23.179058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d1e08f49-946b-4c87-85fb-273cfd4cec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:23.189833 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:23.282088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e08f49-946b-4c87-85fb-273cfd4cec44 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:23.356344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c66cc-939d-44a1-aa3e-3fe10730bbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:23.356941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c66cc-939d-44a1-aa3e-3fe10730bbdf service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:23.357222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c66cc-939d-44a1-aa3e-3fe10730bbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:23.357493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c66cc-939d-44a1-aa3e-3fe10730bbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:23.359113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9b8c66cc-939d-44a1-aa3e-3fe10730bbdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:23.419768 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:23.467076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c66cc-939d-44a1-aa3e-3fe10730bbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:23.468524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c66cc-939d-44a1-aa3e-3fe10730bbdf service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:23.485785 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 657/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:26.209844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d017761-b3a3-4347-bfc1-3a65204f79a4 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:26.210399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d017761-b3a3-4347-bfc1-3a65204f79a4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:26.210399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d017761-b3a3-4347-bfc1-3a65204f79a4 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:26.211788 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 661/1318] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:26.217350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d72a2-3968-46f3-a53d-214e19fdba33 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:26.217729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d72a2-3968-46f3-a53d-214e19fdba33 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:26.217904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d72a2-3968-46f3-a53d-214e19fdba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:26.283471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2d1d72a2-3968-46f3-a53d-214e19fdba33 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:26.284589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2d1d72a2-3968-46f3-a53d-214e19fdba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:26.378285 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 658/1319] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:26.680755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf9620-9aba-41fc-824c-f723f4fdc9ef None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:26.681040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf9620-9aba-41fc-824c-f723f4fdc9ef None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:26.681315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf9620-9aba-41fc-824c-f723f4fdc9ef None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:26.683244 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 662/1320] 10.222.0.23 () {54 vars in 964 bytes} [Sun Oct 2 00:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:26.688916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9ca11-7d6b-4ead-b76b-e0097dfbcdce None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:26.689203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9ca11-7d6b-4ead-b76b-e0097dfbcdce None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:26.689476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9ca11-7d6b-4ead-b76b-e0097dfbcdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:26.712910 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:26.765916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b5c9ca11-7d6b-4ead-b76b-e0097dfbcdce None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:26.767137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b5c9ca11-7d6b-4ead-b76b-e0097dfbcdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:26.841023 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 659/1321] 10.222.0.23 () {58 vars in 1061 bytes} [Sun Oct 2 00:50:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:26.850063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf9620-9aba-41fc-824c-f723f4fdc9ef None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:26.851624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cecf9620-9aba-41fc-824c-f723f4fdc9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:26.952313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf9620-9aba-41fc-824c-f723f4fdc9ef None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:27.024781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf46661-c9d1-47d5-8b1f-4e3ea0f7281f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:27.025403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf46661-c9d1-47d5-8b1f-4e3ea0f7281f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:27.025674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf46661-c9d1-47d5-8b1f-4e3ea0f7281f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:27.025941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf46661-c9d1-47d5-8b1f-4e3ea0f7281f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:27.027525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9cf46661-c9d1-47d5-8b1f-4e3ea0f7281f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:27.034162 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:27.135657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf46661-c9d1-47d5-8b1f-4e3ea0f7281f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:27.137343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf46661-c9d1-47d5-8b1f-4e3ea0f7281f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:27.156378 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 663/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:30.402186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fae2b-f5eb-453e-8c8e-c8ce5106c74c None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:30.402717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fae2b-f5eb-453e-8c8e-c8ce5106c74c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:30.402717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fae2b-f5eb-453e-8c8e-c8ce5106c74c None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:30.404153 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 660/1323] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:30.409229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82ca28-8ed0-4c4f-83a1-aceab13ed5b6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:30.409613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82ca28-8ed0-4c4f-83a1-aceab13ed5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:30.409791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82ca28-8ed0-4c4f-83a1-aceab13ed5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:30.483166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fd82ca28-8ed0-4c4f-83a1-aceab13ed5b6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:30.484402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fd82ca28-8ed0-4c4f-83a1-aceab13ed5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:30.546122 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:30.589539 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 664/1324] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:30.880541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fae2b-f5eb-453e-8c8e-c8ce5106c74c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:30.882081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0b6fae2b-f5eb-453e-8c8e-c8ce5106c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:30.987562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fae2b-f5eb-453e-8c8e-c8ce5106c74c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:30.999680 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:31.060574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00436e40-82f8-45a3-ad59-ebef0a493555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:31.061175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436e40-82f8-45a3-ad59-ebef0a493555 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:31.061458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436e40-82f8-45a3-ad59-ebef0a493555 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:31.062218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436e40-82f8-45a3-ad59-ebef0a493555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:31.063340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-00436e40-82f8-45a3-ad59-ebef0a493555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:31.170618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00436e40-82f8-45a3-ad59-ebef0a493555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:31.172063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00436e40-82f8-45a3-ad59-ebef0a493555 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:31.190547 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 661/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:33.447085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561c1ee-851d-4fbb-9c9b-d86a022a036c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:33.447621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561c1ee-851d-4fbb-9c9b-d86a022a036c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:33.447766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561c1ee-851d-4fbb-9c9b-d86a022a036c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:33.449164 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 665/1326] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:33.455785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8995a-9f17-4390-aca0-b7727c981c91 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:33.456267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8995a-9f17-4390-aca0-b7727c981c91 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:33.456460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8995a-9f17-4390-aca0-b7727c981c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:33.513737 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:33.534438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5db8995a-9f17-4390-aca0-b7727c981c91 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:33.535712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5db8995a-9f17-4390-aca0-b7727c981c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:33.658951 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 662/1327] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:33.954858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561c1ee-851d-4fbb-9c9b-d86a022a036c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:33.956464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f561c1ee-851d-4fbb-9c9b-d86a022a036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:34.067085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561c1ee-851d-4fbb-9c9b-d86a022a036c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:34.142306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6fa49-e230-4136-9bf7-54638b877e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:34.142987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6fa49-e230-4136-9bf7-54638b877e8e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:34.143264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6fa49-e230-4136-9bf7-54638b877e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:34.143554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6fa49-e230-4136-9bf7-54638b877e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:34.145188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cfd6fa49-e230-4136-9bf7-54638b877e8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:34.164002 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:34.255014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6fa49-e230-4136-9bf7-54638b877e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:34.256399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6fa49-e230-4136-9bf7-54638b877e8e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:34.274419 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 666/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:36.509781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d61944-43eb-48a6-a348-971d1095dcc6 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:36.510304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d61944-43eb-48a6-a348-971d1095dcc6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:36.510304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d61944-43eb-48a6-a348-971d1095dcc6 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:36.512723 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 663/1329] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:36.518231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87085e2-b0ee-42ff-937a-43324f25e3b2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:36.518718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87085e2-b0ee-42ff-937a-43324f25e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:36.518810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87085e2-b0ee-42ff-937a-43324f25e3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:36.601013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f87085e2-b0ee-42ff-937a-43324f25e3b2 None None] MFA Rules not processed for user `40bcd9aa5e344ab38aab7605ac197048`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:36.602270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f87085e2-b0ee-42ff-937a-43324f25e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:36.666700 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:36.699893 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 667/1330] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:36.991384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d61944-43eb-48a6-a348-971d1095dcc6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:36.993118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-05d61944-43eb-48a6-a348-971d1095dcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:37.104688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d61944-43eb-48a6-a348-971d1095dcc6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:37.127394 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:37.185284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc621bb0-daf6-4c28-ad2e-dc679ad90a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:37.185889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc621bb0-daf6-4c28-ad2e-dc679ad90a15 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:37.186172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc621bb0-daf6-4c28-ad2e-dc679ad90a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:37.186430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc621bb0-daf6-4c28-ad2e-dc679ad90a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:37.188087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dc621bb0-daf6-4c28-ad2e-dc679ad90a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:37.306186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc621bb0-daf6-4c28-ad2e-dc679ad90a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:37.308260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc621bb0-daf6-4c28-ad2e-dc679ad90a15 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:37.328193 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 664/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:39.722761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa394fa-528f-4f2f-9daa-722facabc2b9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:39.723329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa394fa-528f-4f2f-9daa-722facabc2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:39.723329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa394fa-528f-4f2f-9daa-722facabc2b9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:39.724643 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 668/1332] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:39.730463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4423a-6726-4bb8-9171-438617cb2b91 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:39.731029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4423a-6726-4bb8-9171-438617cb2b91 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:39.731029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4423a-6726-4bb8-9171-438617cb2b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:39.793230 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:39.796662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-61f4423a-6726-4bb8-9171-438617cb2b91 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:39.798217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-61f4423a-6726-4bb8-9171-438617cb2b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:39.893076 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 665/1333] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:50:40.177845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa394fa-528f-4f2f-9daa-722facabc2b9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:40.179396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4fa394fa-528f-4f2f-9daa-722facabc2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:40.281489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa394fa-528f-4f2f-9daa-722facabc2b9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:40.353158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2cf60-bfc3-47f0-9441-7207f087d179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:40.353751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2cf60-bfc3-47f0-9441-7207f087d179 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:40.354024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2cf60-bfc3-47f0-9441-7207f087d179 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:40.354288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2cf60-bfc3-47f0-9441-7207f087d179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:40.356564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e7d2cf60-bfc3-47f0-9441-7207f087d179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:40.382142 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:40.464794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2cf60-bfc3-47f0-9441-7207f087d179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:40.466150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2cf60-bfc3-47f0-9441-7207f087d179 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:40.484275 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 669/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:42.660575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ff87-def2-4710-9229-c0dfaf2266a4 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:42.661170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ff87-def2-4710-9229-c0dfaf2266a4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:42.661170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ff87-def2-4710-9229-c0dfaf2266a4 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:42.662492 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 666/1335] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:42.667755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42111d45-7530-40c0-a2a7-b7fa4157e3a1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:42.668189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42111d45-7530-40c0-a2a7-b7fa4157e3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:42.668329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42111d45-7530-40c0-a2a7-b7fa4157e3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:42.733743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-42111d45-7530-40c0-a2a7-b7fa4157e3a1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:42.734888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-42111d45-7530-40c0-a2a7-b7fa4157e3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:42.806836 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:42.830084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 670/1336] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:43.116385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047ff87-def2-4710-9229-c0dfaf2266a4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:43.117941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2047ff87-def2-4710-9229-c0dfaf2266a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:43.219169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047ff87-def2-4710-9229-c0dfaf2266a4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:43.246814 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:43.290283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632ca38-026f-4dbb-bad6-f11740c90ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:43.290902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632ca38-026f-4dbb-bad6-f11740c90ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:43.291182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632ca38-026f-4dbb-bad6-f11740c90ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:43.291455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632ca38-026f-4dbb-bad6-f11740c90ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:43.293069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e632ca38-026f-4dbb-bad6-f11740c90ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:43.398622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632ca38-026f-4dbb-bad6-f11740c90ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:43.399987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632ca38-026f-4dbb-bad6-f11740c90ac3 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:43.418438 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 667/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:45.916737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d2ef-6404-4417-ae05-dc11383a423d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:45.917318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d2ef-6404-4417-ae05-dc11383a423d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:45.917318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d2ef-6404-4417-ae05-dc11383a423d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:45.919283 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 671/1338] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:45.924497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233296bf-5d1e-47c4-987e-aabfa3a46872 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:45.924883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233296bf-5d1e-47c4-987e-aabfa3a46872 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:45.925041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233296bf-5d1e-47c4-987e-aabfa3a46872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:45.992967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-233296bf-5d1e-47c4-987e-aabfa3a46872 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:45.994153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-233296bf-5d1e-47c4-987e-aabfa3a46872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:46.002878 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:46.093091 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 668/1339] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:46.374638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d2ef-6404-4417-ae05-dc11383a423d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:46.376190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-75e5d2ef-6404-4417-ae05-dc11383a423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:46.476292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d2ef-6404-4417-ae05-dc11383a423d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:46.548454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d18dd-b6d5-4d8d-8283-cb0c31a064b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:46.549051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d18dd-b6d5-4d8d-8283-cb0c31a064b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:46.549328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d18dd-b6d5-4d8d-8283-cb0c31a064b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:46.549597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d18dd-b6d5-4d8d-8283-cb0c31a064b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:46.551195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6d6d18dd-b6d5-4d8d-8283-cb0c31a064b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:46.585659 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:46.661970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d18dd-b6d5-4d8d-8283-cb0c31a064b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:46.663424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d18dd-b6d5-4d8d-8283-cb0c31a064b9 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:46.682589 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 672/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:50.828053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fe7f6-b749-4789-84f4-d98cf9c3f5ab None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:50.828640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fe7f6-b749-4789-84f4-d98cf9c3f5ab None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:50.828640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fe7f6-b749-4789-84f4-d98cf9c3f5ab None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:50.830277 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 669/1341] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:50.836559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07991d2a-5290-40a7-98f8-93853eff05bb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:50.837044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07991d2a-5290-40a7-98f8-93853eff05bb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:50.837221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07991d2a-5290-40a7-98f8-93853eff05bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:50.903821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-07991d2a-5290-40a7-98f8-93853eff05bb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:50.904917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-07991d2a-5290-40a7-98f8-93853eff05bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:50.994097 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:51.006258 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 673/1342] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:50:51.300326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fe7f6-b749-4789-84f4-d98cf9c3f5ab None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:51.301872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9a7fe7f6-b749-4789-84f4-d98cf9c3f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:51.410478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fe7f6-b749-4789-84f4-d98cf9c3f5ab None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:51.448773 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:51.485606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48897a-bec4-4ccf-95d8-7b989b62ee98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:51.486205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48897a-bec4-4ccf-95d8-7b989b62ee98 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:51.486481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48897a-bec4-4ccf-95d8-7b989b62ee98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:51.486776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48897a-bec4-4ccf-95d8-7b989b62ee98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:51.488345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2e48897a-bec4-4ccf-95d8-7b989b62ee98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:51.598648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48897a-bec4-4ccf-95d8-7b989b62ee98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:51.600020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48897a-bec4-4ccf-95d8-7b989b62ee98 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:51.618517 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 670/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:54.402835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76b688-4c27-427b-8fb3-ee1acd7a9e55 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:54.403355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76b688-4c27-427b-8fb3-ee1acd7a9e55 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:54.403355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76b688-4c27-427b-8fb3-ee1acd7a9e55 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:54.404686 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 674/1344] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:54.409903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9deaf7-531e-4a3c-974d-10396a471c48 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:54.410334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9deaf7-531e-4a3c-974d-10396a471c48 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:54.410459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9deaf7-531e-4a3c-974d-10396a471c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:54.476196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5b9deaf7-531e-4a3c-974d-10396a471c48 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:54.477396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5b9deaf7-531e-4a3c-974d-10396a471c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:54.495435 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:54.576358 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 671/1345] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:50:54.859542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76b688-4c27-427b-8fb3-ee1acd7a9e55 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:54.861074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8f76b688-4c27-427b-8fb3-ee1acd7a9e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:54.965840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76b688-4c27-427b-8fb3-ee1acd7a9e55 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:55.041438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ee347-46a5-4198-9c3c-f6e71062ef9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:55.042042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ee347-46a5-4198-9c3c-f6e71062ef9f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:55.042317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ee347-46a5-4198-9c3c-f6e71062ef9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:55.042587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ee347-46a5-4198-9c3c-f6e71062ef9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:55.044662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-839ee347-46a5-4198-9c3c-f6e71062ef9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:55.093092 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:55.160186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ee347-46a5-4198-9c3c-f6e71062ef9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:50:55.161648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ee347-46a5-4198-9c3c-f6e71062ef9f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:50:55.180747 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 675/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:50:59.301422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093441c4-17b2-4f81-90f0-cc7fbacdb9d8 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:59.301984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093441c4-17b2-4f81-90f0-cc7fbacdb9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:59.301984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093441c4-17b2-4f81-90f0-cc7fbacdb9d8 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:59.307322 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 672/1347] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:50:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:50:59.308783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86dd34-c550-4de3-9118-d9534fd36a59 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:59.309252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86dd34-c550-4de3-9118-d9534fd36a59 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:59.309370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86dd34-c550-4de3-9118-d9534fd36a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:59.382890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3e86dd34-c550-4de3-9118-d9534fd36a59 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:50:59.384094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3e86dd34-c550-4de3-9118-d9534fd36a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:59.495788 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:59.502642 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 676/1348] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:50:59.781987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093441c4-17b2-4f81-90f0-cc7fbacdb9d8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:50:59.784198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-093441c4-17b2-4f81-90f0-cc7fbacdb9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:50:59.886915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093441c4-17b2-4f81-90f0-cc7fbacdb9d8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:50:59.932793 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:50:59.958525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676b5b5-6499-4831-8df2-3635b2896cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:50:59.959144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676b5b5-6499-4831-8df2-3635b2896cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:50:59.959423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676b5b5-6499-4831-8df2-3635b2896cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:50:59.959692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676b5b5-6499-4831-8df2-3635b2896cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:50:59.961296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6676b5b5-6499-4831-8df2-3635b2896cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:00.071269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676b5b5-6499-4831-8df2-3635b2896cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:00.072955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676b5b5-6499-4831-8df2-3635b2896cd7 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:00.091656 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 673/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:04.947602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3e912-1893-43a9-8a17-dcd51951a8e9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:04.948381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3e912-1893-43a9-8a17-dcd51951a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:04.948642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3e912-1893-43a9-8a17-dcd51951a8e9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:04.950271 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 677/1350] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 00:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:04.955852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e7fa-f13e-4fb2-87ec-84f37f568676 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:04.956311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e7fa-f13e-4fb2-87ec-84f37f568676 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:04.956311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e7fa-f13e-4fb2-87ec-84f37f568676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:05.067736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fd37e7fa-f13e-4fb2-87ec-84f37f568676 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:05.069161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fd37e7fa-f13e-4fb2-87ec-84f37f568676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:05.095420 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:05.246334 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 674/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 00:51:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:09.478484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c21a5-726d-4f1c-88e6-87bce0356282 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:09.479046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c21a5-726d-4f1c-88e6-87bce0356282 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:09.479046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c21a5-726d-4f1c-88e6-87bce0356282 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:09.480401 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 678/1352] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:09.486339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcedcd-ba0e-4d9b-a495-2ada09c49565 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:09.486851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcedcd-ba0e-4d9b-a495-2ada09c49565 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:09.486939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcedcd-ba0e-4d9b-a495-2ada09c49565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:09.566566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e8dcedcd-ba0e-4d9b-a495-2ada09c49565 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:09.567937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e8dcedcd-ba0e-4d9b-a495-2ada09c49565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:09.641241 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:09.679592 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 675/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 00:51:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:11.022859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ca61-9e8e-4368-bda8-0a8a9d024616 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:11.023373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ca61-9e8e-4368-bda8-0a8a9d024616 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:11.023373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ca61-9e8e-4368-bda8-0a8a9d024616 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:11.024707 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 679/1354] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 00:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:11.029567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c363d-f1b9-4dd3-8e23-c07f004dee6a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:11.030012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c363d-f1b9-4dd3-8e23-c07f004dee6a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:11.030268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c363d-f1b9-4dd3-8e23-c07f004dee6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:11.109036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ad2c363d-f1b9-4dd3-8e23-c07f004dee6a None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:11.110279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ad2c363d-f1b9-4dd3-8e23-c07f004dee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:11.218015 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 676/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 00:51:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:51:14.917170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef48a8-3027-411e-8992-012d93b6b2f9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:14.917748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef48a8-3027-411e-8992-012d93b6b2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:14.917748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef48a8-3027-411e-8992-012d93b6b2f9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:14.919091 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 680/1356] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:14.926123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1205bf-c45d-481c-9ae1-7ef1784e9966 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:14.927581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1205bf-c45d-481c-9ae1-7ef1784e9966 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:14.928211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1205bf-c45d-481c-9ae1-7ef1784e9966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:14.981604 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:15.018975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ed1205bf-c45d-481c-9ae1-7ef1784e9966 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:15.020273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ed1205bf-c45d-481c-9ae1-7ef1784e9966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:15.129605 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 677/1357] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:15.438994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08e22-a973-4869-a4f5-fcef27e034aa None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:15.439282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08e22-a973-4869-a4f5-fcef27e034aa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:15.439560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08e22-a973-4869-a4f5-fcef27e034aa None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:15.440888 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 681/1358] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 2 00:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:15.462929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cce7ef-1344-4a3b-9aa3-adc0327635f0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:15.463408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cce7ef-1344-4a3b-9aa3-adc0327635f0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:15.464737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cce7ef-1344-4a3b-9aa3-adc0327635f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:15.548087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-75cce7ef-1344-4a3b-9aa3-adc0327635f0 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:15.549287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-75cce7ef-1344-4a3b-9aa3-adc0327635f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:15.600093 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:15.678259 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 678/1359] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 2 00:51:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:15.687092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b08e22-a973-4869-a4f5-fcef27e034aa None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:15.688582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-53b08e22-a973-4869-a4f5-fcef27e034aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:15.841209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b08e22-a973-4869-a4f5-fcef27e034aa None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:15.921172 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:15.965368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32abea9-a37f-42e7-bc36-19046f1f72e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:15.965992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abea9-a37f-42e7-bc36-19046f1f72e3 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:15.966269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abea9-a37f-42e7-bc36-19046f1f72e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:15.966539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abea9-a37f-42e7-bc36-19046f1f72e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:15.970880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b32abea9-a37f-42e7-bc36-19046f1f72e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:16.073883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32abea9-a37f-42e7-bc36-19046f1f72e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:16.075929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32abea9-a37f-42e7-bc36-19046f1f72e3 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:16.096834 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 682/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:18.526621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13726e9b-d9b4-4e5b-8521-0bb3a3d33cc6 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:18.527133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13726e9b-d9b4-4e5b-8521-0bb3a3d33cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:18.527218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13726e9b-d9b4-4e5b-8521-0bb3a3d33cc6 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:18.528723 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 679/1361] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:18.534450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb904287-e09f-4195-bada-9a9a52ba421b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:18.534988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb904287-e09f-4195-bada-9a9a52ba421b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:18.535085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb904287-e09f-4195-bada-9a9a52ba421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:18.605998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-eb904287-e09f-4195-bada-9a9a52ba421b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:18.607268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb904287-e09f-4195-bada-9a9a52ba421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:18.647461 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:18.715015 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 683/1362] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:19.008198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13726e9b-d9b4-4e5b-8521-0bb3a3d33cc6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:19.009767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-13726e9b-d9b4-4e5b-8521-0bb3a3d33cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:19.183834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13726e9b-d9b4-4e5b-8521-0bb3a3d33cc6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:19.195928 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:19.308128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca122f-da04-4f0d-9a93-f04ec2ce1551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:19.308733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca122f-da04-4f0d-9a93-f04ec2ce1551 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:19.309007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca122f-da04-4f0d-9a93-f04ec2ce1551 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:19.309279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca122f-da04-4f0d-9a93-f04ec2ce1551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:19.310919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-96ca122f-da04-4f0d-9a93-f04ec2ce1551 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:19.407438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca122f-da04-4f0d-9a93-f04ec2ce1551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:19.408979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca122f-da04-4f0d-9a93-f04ec2ce1551 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:19.428304 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 680/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:21.965384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0ff9-af46-4b25-8a7d-34821090639a None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:21.965887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0ff9-af46-4b25-8a7d-34821090639a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:21.965971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0ff9-af46-4b25-8a7d-34821090639a None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:21.971970 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 684/1364] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:21.973740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f803-5caa-4c41-9f8e-111bfdfef9ad None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:21.974164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f803-5caa-4c41-9f8e-111bfdfef9ad None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:21.975692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f803-5caa-4c41-9f8e-111bfdfef9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:22.003706 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:22.067706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-80e7f803-5caa-4c41-9f8e-111bfdfef9ad None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:22.068918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-80e7f803-5caa-4c41-9f8e-111bfdfef9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:22.202380 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 681/1365] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:22.503404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091f8b8-34c6-41df-b8cb-d48d7386efa4 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:22.503951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091f8b8-34c6-41df-b8cb-d48d7386efa4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:22.504225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091f8b8-34c6-41df-b8cb-d48d7386efa4 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:22.506614 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 685/1366] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 2 00:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:22.512462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b403b-d0dc-423c-8d59-87a02f723bff None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:22.512758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b403b-d0dc-423c-8d59-87a02f723bff None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:22.513034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b403b-d0dc-423c-8d59-87a02f723bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:22.630377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7d8b403b-d0dc-423c-8d59-87a02f723bff None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:22.630377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7d8b403b-d0dc-423c-8d59-87a02f723bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:22.686039 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:22.806732 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 682/1367] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 2 00:51:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:22.807495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091f8b8-34c6-41df-b8cb-d48d7386efa4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:22.809174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3091f8b8-34c6-41df-b8cb-d48d7386efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:23.034136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091f8b8-34c6-41df-b8cb-d48d7386efa4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:23.057243 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:23.195099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab42af-c0c5-477a-af00-c6813ba5d3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:23.196045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab42af-c0c5-477a-af00-c6813ba5d3b8 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:23.196398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab42af-c0c5-477a-af00-c6813ba5d3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:23.196823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab42af-c0c5-477a-af00-c6813ba5d3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:23.198639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-46ab42af-c0c5-477a-af00-c6813ba5d3b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:23.319778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab42af-c0c5-477a-af00-c6813ba5d3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:23.322355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab42af-c0c5-477a-af00-c6813ba5d3b8 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:23.350731 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 686/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:51:25.761682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6e82-d10c-4711-a7c9-38b35a008722 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:25.762291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6e82-d10c-4711-a7c9-38b35a008722 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:25.762591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6e82-d10c-4711-a7c9-38b35a008722 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:25.764244 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 683/1369] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:25.773507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cc0d0-86b3-425e-a7b1-f2bddc5f7ee5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:25.773507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cc0d0-86b3-425e-a7b1-f2bddc5f7ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:25.773507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cc0d0-86b3-425e-a7b1-f2bddc5f7ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:25.806163 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:25.845350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3e8cc0d0-86b3-425e-a7b1-f2bddc5f7ee5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:25.847817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3e8cc0d0-86b3-425e-a7b1-f2bddc5f7ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:25.978626 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 687/1370] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:26.417758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced6e82-d10c-4711-a7c9-38b35a008722 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:26.419555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4ced6e82-d10c-4711-a7c9-38b35a008722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:26.601435 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:26.611524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced6e82-d10c-4711-a7c9-38b35a008722 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:26.744126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc80e0-5846-4b74-b588-a95d2b6ff625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:26.744628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc80e0-5846-4b74-b588-a95d2b6ff625 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:26.744968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc80e0-5846-4b74-b588-a95d2b6ff625 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:26.745242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc80e0-5846-4b74-b588-a95d2b6ff625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:26.746943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-48fc80e0-5846-4b74-b588-a95d2b6ff625 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:26.840648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea011a-31ee-4808-b658-bafb7825dd5b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:26.841199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea011a-31ee-4808-b658-bafb7825dd5b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:26.841199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea011a-31ee-4808-b658-bafb7825dd5b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:26.842515 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 688/1371] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:51:26.846857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc80e0-5846-4b74-b588-a95d2b6ff625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:26.848420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc80e0-5846-4b74-b588-a95d2b6ff625 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:26.849322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0805d-a50f-4000-b130-cfebe56c5b5c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:26.849676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0805d-a50f-4000-b130-cfebe56c5b5c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:26.850015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0805d-a50f-4000-b130-cfebe56c5b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:26.865912 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:26.869823 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 684/1372] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:26.938462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-73b0805d-a50f-4000-b130-cfebe56c5b5c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:26.939710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-73b0805d-a50f-4000-b130-cfebe56c5b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:27.011437 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:27.064374 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 689/1373] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:27.401447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c82700-d806-4a3f-8292-a18966aaaa17 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:27.401447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c82700-d806-4a3f-8292-a18966aaaa17 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:27.401447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c82700-d806-4a3f-8292-a18966aaaa17 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:27.404727 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 685/1374] 10.222.0.23 () {54 vars in 963 bytes} [Sun Oct 2 00:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:27.409314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cac07-8f00-4462-9252-30107c09c275 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:27.409314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cac07-8f00-4462-9252-30107c09c275 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:27.409314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cac07-8f00-4462-9252-30107c09c275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:27.493695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-979cac07-8f00-4462-9252-30107c09c275 None None] MFA Rules not processed for user `c62cd9bcc90e4d6685c5d0fc1d8ceae3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:27.495090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-979cac07-8f00-4462-9252-30107c09c275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:27.578643 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 690/1375] 10.222.0.23 () {58 vars in 1060 bytes} [Sun Oct 2 00:51:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:51:27.586068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c82700-d806-4a3f-8292-a18966aaaa17 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:27.587759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-36c82700-d806-4a3f-8292-a18966aaaa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:27.705371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c82700-d806-4a3f-8292-a18966aaaa17 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:27.784769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224057b-e6d9-406a-9201-cf8905ae6352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:27.785378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224057b-e6d9-406a-9201-cf8905ae6352 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:27.785659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224057b-e6d9-406a-9201-cf8905ae6352 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:27.785929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224057b-e6d9-406a-9201-cf8905ae6352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:27.787584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9224057b-e6d9-406a-9201-cf8905ae6352 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:27.849294 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:27.909878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224057b-e6d9-406a-9201-cf8905ae6352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:27.911358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224057b-e6d9-406a-9201-cf8905ae6352 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:27.930961 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 686/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:29.082118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e92705-34fe-4ee2-a5d6-585fe65d271f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:29.082687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e92705-34fe-4ee2-a5d6-585fe65d271f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:29.082687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e92705-34fe-4ee2-a5d6-585fe65d271f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:29.084033 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 691/1377] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:29.089185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5a82-59fe-41e2-9e25-30756b74d225 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:29.089576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5a82-59fe-41e2-9e25-30756b74d225 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:29.089731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5a82-59fe-41e2-9e25-30756b74d225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:29.163197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5a8b5a82-59fe-41e2-9e25-30756b74d225 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:29.164472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5a8b5a82-59fe-41e2-9e25-30756b74d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:29.271050 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 687/1378] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:29.567468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e92705-34fe-4ee2-a5d6-585fe65d271f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:29.568994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93e92705-34fe-4ee2-a5d6-585fe65d271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:29.631693 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:29.736517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e92705-34fe-4ee2-a5d6-585fe65d271f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:29.869328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3962dc2-b070-438d-aea4-d5711fc7baeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:29.869940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3962dc2-b070-438d-aea4-d5711fc7baeb service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:29.870217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3962dc2-b070-438d-aea4-d5711fc7baeb service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:29.870963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3962dc2-b070-438d-aea4-d5711fc7baeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:29.873247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b3962dc2-b070-438d-aea4-d5711fc7baeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:29.887361 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:29.986273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3962dc2-b070-438d-aea4-d5711fc7baeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:29.989309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3962dc2-b070-438d-aea4-d5711fc7baeb service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:30.012753 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 692/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:32.387100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecbc7c-e54c-4b4e-a7e1-50eb362cb6b8 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:32.388144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecbc7c-e54c-4b4e-a7e1-50eb362cb6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:32.388630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecbc7c-e54c-4b4e-a7e1-50eb362cb6b8 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:32.396308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e0438-92f9-449e-a2ac-b4fcd6511610 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:32.397833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e0438-92f9-449e-a2ac-b4fcd6511610 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:32.398315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e0438-92f9-449e-a2ac-b4fcd6511610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:32.401975 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 688/1380] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:32 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:32.475272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2f5e0438-92f9-449e-a2ac-b4fcd6511610 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:32.476598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2f5e0438-92f9-449e-a2ac-b4fcd6511610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:32.585056 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:32.620256 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 693/1381] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:32.934737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecbc7c-e54c-4b4e-a7e1-50eb362cb6b8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:32.936280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8eecbc7c-e54c-4b4e-a7e1-50eb362cb6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:32.947367 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:33.113658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecbc7c-e54c-4b4e-a7e1-50eb362cb6b8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:33.204363 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:33.241849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caeaaf7-9066-4b4d-b3a6-d0731e6b1bb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:33.242640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeaaf7-9066-4b4d-b3a6-d0731e6b1bb6 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:33.243022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeaaf7-9066-4b4d-b3a6-d0731e6b1bb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:33.243391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeaaf7-9066-4b4d-b3a6-d0731e6b1bb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:33.245500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2caeaaf7-9066-4b4d-b3a6-d0731e6b1bb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:33.361492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caeaaf7-9066-4b4d-b3a6-d0731e6b1bb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:33.364184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caeaaf7-9066-4b4d-b3a6-d0731e6b1bb6 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:33.397584 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 689/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:35.758820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0107ab-19a5-48fd-9090-d8de116065c5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:35.759271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0107ab-19a5-48fd-9090-d8de116065c5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:35.759526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0107ab-19a5-48fd-9090-d8de116065c5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:35.760951 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 694/1383] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:35.766327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addea149-3f35-4e31-9435-81fad4e7a042 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:35.767053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addea149-3f35-4e31-9435-81fad4e7a042 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:35.767369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addea149-3f35-4e31-9435-81fad4e7a042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:35.855740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-addea149-3f35-4e31-9435-81fad4e7a042 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:35.856955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-addea149-3f35-4e31-9435-81fad4e7a042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:35.919094 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:35.974676 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 690/1384] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:36.272641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0107ab-19a5-48fd-9090-d8de116065c5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:36.275384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b0107ab-19a5-48fd-9090-d8de116065c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:36.468646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0107ab-19a5-48fd-9090-d8de116065c5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:36.534500 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:36.606921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24a76d-2466-48af-8ffe-4e19c223e054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:36.607896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a76d-2466-48af-8ffe-4e19c223e054 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:36.608585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a76d-2466-48af-8ffe-4e19c223e054 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:36.609174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a76d-2466-48af-8ffe-4e19c223e054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:36.612728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1e24a76d-2466-48af-8ffe-4e19c223e054 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:36.713660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24a76d-2466-48af-8ffe-4e19c223e054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:36.715348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24a76d-2466-48af-8ffe-4e19c223e054 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:36.734725 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 695/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:38.953926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415aa2a-914b-45be-b04e-3b40da305398 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:38.954691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415aa2a-914b-45be-b04e-3b40da305398 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:38.954691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415aa2a-914b-45be-b04e-3b40da305398 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:38.956343 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 691/1386] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:38.963515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447a7a-6af0-46bf-8bad-fc72c2454525 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:38.963996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447a7a-6af0-46bf-8bad-fc72c2454525 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:38.964318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447a7a-6af0-46bf-8bad-fc72c2454525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:39.082110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-62447a7a-6af0-46bf-8bad-fc72c2454525 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:39.083743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62447a7a-6af0-46bf-8bad-fc72c2454525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:39.118009 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:39.201966 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 696/1387] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:39.577419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415aa2a-914b-45be-b04e-3b40da305398 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:39.579371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c415aa2a-914b-45be-b04e-3b40da305398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:39.744480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415aa2a-914b-45be-b04e-3b40da305398 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:39.777941 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:39.874296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d24254-0739-4b2e-ac0b-8b277dd4c652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:39.874949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d24254-0739-4b2e-ac0b-8b277dd4c652 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:39.875241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d24254-0739-4b2e-ac0b-8b277dd4c652 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:39.875525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d24254-0739-4b2e-ac0b-8b277dd4c652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:39.878495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d1d24254-0739-4b2e-ac0b-8b277dd4c652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:39.996413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d24254-0739-4b2e-ac0b-8b277dd4c652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:39.998433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d24254-0739-4b2e-ac0b-8b277dd4c652 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:40.019936 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 692/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:42.244248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c67df-c04a-4bb0-877e-6388f4d4f0dd None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:42.244817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c67df-c04a-4bb0-877e-6388f4d4f0dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:42.244817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c67df-c04a-4bb0-877e-6388f4d4f0dd None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:42.246149 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 697/1389] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:42.252352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d1d0-d64a-4233-91cf-a5b568f78bc1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:42.252798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d1d0-d64a-4233-91cf-a5b568f78bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:42.252905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d1d0-d64a-4233-91cf-a5b568f78bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:42.301268 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:42.324508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c859d1d0-d64a-4233-91cf-a5b568f78bc1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:42.325741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c859d1d0-d64a-4233-91cf-a5b568f78bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:42.423745 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 693/1390] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:42.726807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c67df-c04a-4bb0-877e-6388f4d4f0dd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:42.728492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-230c67df-c04a-4bb0-877e-6388f4d4f0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:42.878067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c67df-c04a-4bb0-877e-6388f4d4f0dd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:42.887548 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:42.993728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73bb3d-f4ec-4d07-9d87-ebebd37a427f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:42.994330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73bb3d-f4ec-4d07-9d87-ebebd37a427f service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:42.994632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73bb3d-f4ec-4d07-9d87-ebebd37a427f service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:42.994902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73bb3d-f4ec-4d07-9d87-ebebd37a427f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:42.996468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9e73bb3d-f4ec-4d07-9d87-ebebd37a427f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:43.088802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73bb3d-f4ec-4d07-9d87-ebebd37a427f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:43.090438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73bb3d-f4ec-4d07-9d87-ebebd37a427f service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:43.109210 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 698/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:43.701122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3588e-bf27-4dcd-bbd3-4e802ef436b3 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:43.701717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3588e-bf27-4dcd-bbd3-4e802ef436b3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:43.701717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3588e-bf27-4dcd-bbd3-4e802ef436b3 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:43.703307 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 694/1392] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:43.709422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4a1f-b172-4afe-ac7a-76822b57a6f2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:43.709879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4a1f-b172-4afe-ac7a-76822b57a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:43.710000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4a1f-b172-4afe-ac7a-76822b57a6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:43.725986 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:43.777103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-57ee4a1f-b172-4afe-ac7a-76822b57a6f2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:43.778351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-57ee4a1f-b172-4afe-ac7a-76822b57a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:43.876675 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 699/1393] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:44.183541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b698e40-dad4-40d9-a838-11a648bcf862 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:44.183827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b698e40-dad4-40d9-a838-11a648bcf862 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:44.184102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b698e40-dad4-40d9-a838-11a648bcf862 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:44.185451 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 695/1394] 10.222.0.23 () {54 vars in 962 bytes} [Sun Oct 2 00:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:44.190894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a8521-729d-4e0c-ad17-b1225cb58c9e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:44.191207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a8521-729d-4e0c-ad17-b1225cb58c9e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:44.191479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a8521-729d-4e0c-ad17-b1225cb58c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:44.268228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-199a8521-729d-4e0c-ad17-b1225cb58c9e None None] MFA Rules not processed for user `7cee33d8425d4be0ba5721ec419a12e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:44.269433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-199a8521-729d-4e0c-ad17-b1225cb58c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:44.305083 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:44.347558 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 700/1395] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Oct 2 00:51:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:44.356502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b698e40-dad4-40d9-a838-11a648bcf862 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:44.358038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0b698e40-dad4-40d9-a838-11a648bcf862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:44.462833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b698e40-dad4-40d9-a838-11a648bcf862 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:44.476896 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:44.536747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a83f1d-19fb-4e9a-9cbf-a7f825676ee0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:44.537266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a83f1d-19fb-4e9a-9cbf-a7f825676ee0 service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:44.537544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a83f1d-19fb-4e9a-9cbf-a7f825676ee0 service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:44.537811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a83f1d-19fb-4e9a-9cbf-a7f825676ee0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:44.539410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c0a83f1d-19fb-4e9a-9cbf-a7f825676ee0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:44.646154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a83f1d-19fb-4e9a-9cbf-a7f825676ee0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:44.647837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a83f1d-19fb-4e9a-9cbf-a7f825676ee0 service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:44.665773 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 696/1396] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:45.340669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe6e5-f894-4d16-a144-9a0df1efcf12 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:45.341204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe6e5-f894-4d16-a144-9a0df1efcf12 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:45.341334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe6e5-f894-4d16-a144-9a0df1efcf12 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:45.342657 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 701/1397] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:45.348582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc29fa0-552f-42cd-8ed9-7579a3e5f924 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:45.349049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc29fa0-552f-42cd-8ed9-7579a3e5f924 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:45.349323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc29fa0-552f-42cd-8ed9-7579a3e5f924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:45.406712 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:45.422758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e35f6-5026-4d0b-b258-83dd8f9c1554 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:45.423566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e35f6-5026-4d0b-b258-83dd8f9c1554 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:45.423907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e35f6-5026-4d0b-b258-83dd8f9c1554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:45.424108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5cc29fa0-552f-42cd-8ed9-7579a3e5f924 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:45.425175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5cc29fa0-552f-42cd-8ed9-7579a3e5f924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:45.495727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fc5e35f6-5026-4d0b-b258-83dd8f9c1554 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:45.497064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fc5e35f6-5026-4d0b-b258-83dd8f9c1554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:45.525901 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 697/1398] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:45.590041 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 702/1399] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 00:51:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:51:45.638963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f6b4-cef2-42c1-9485-6eeb2dc60513 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:45.639281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f6b4-cef2-42c1-9485-6eeb2dc60513 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:45.639555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f6b4-cef2-42c1-9485-6eeb2dc60513 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:45.640910 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 698/1400] 10.222.0.23 () {54 vars in 943 bytes} [Sun Oct 2 00:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:45.648481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e931e-1c90-4baf-b097-d9b77bff9c06 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:45.648779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e931e-1c90-4baf-b097-d9b77bff9c06 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:45.649110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e931e-1c90-4baf-b097-d9b77bff9c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:45.718549 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:45.737023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea9e931e-1c90-4baf-b097-d9b77bff9c06 None None] MFA Rules not processed for user `a0fa4948f9b546dea031acfc0f3e3d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:45.738227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea9e931e-1c90-4baf-b097-d9b77bff9c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:45.832630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944f6b4-cef2-42c1-9485-6eeb2dc60513 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:45.834146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3944f6b4-cef2-42c1-9485-6eeb2dc60513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:45.844079 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 703/1401] 10.222.0.23 () {58 vars in 1040 bytes} [Sun Oct 2 00:51:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:45.853421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e931e-1c90-4baf-b097-d9b77bff9c06 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:45.864062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e931e-1c90-4baf-b097-d9b77bff9c06 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:45.958116 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:45.969336 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:45.976129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3032aac-ffe8-4d64-8c04-945e01d6a9df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:45.976698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3032aac-ffe8-4d64-8c04-945e01d6a9df service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:45.976870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3032aac-ffe8-4d64-8c04-945e01d6a9df service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:45.977136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3032aac-ffe8-4d64-8c04-945e01d6a9df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:45.978809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d3032aac-ffe8-4d64-8c04-945e01d6a9df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:45.997958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944f6b4-cef2-42c1-9485-6eeb2dc60513 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:46.067876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3032aac-ffe8-4d64-8c04-945e01d6a9df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:46.069474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3032aac-ffe8-4d64-8c04-945e01d6a9df service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:46.077651 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 704/1402] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 00:51:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 00:51:46.119870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27931bf3-24e5-47dd-9e0b-98dcb86e68d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:46.120476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27931bf3-24e5-47dd-9e0b-98dcb86e68d9 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:46.120754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27931bf3-24e5-47dd-9e0b-98dcb86e68d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:46.121020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27931bf3-24e5-47dd-9e0b-98dcb86e68d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:46.122679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-27931bf3-24e5-47dd-9e0b-98dcb86e68d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:46.330992 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:46.341867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27931bf3-24e5-47dd-9e0b-98dcb86e68d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:46.343534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27931bf3-24e5-47dd-9e0b-98dcb86e68d9 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:46.368141 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 699/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 00:51:48.649507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53907b-fce9-4857-9a2e-eca3ab73249d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:48.650190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53907b-fce9-4857-9a2e-eca3ab73249d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:48.650190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53907b-fce9-4857-9a2e-eca3ab73249d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:48.652040 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 705/1404] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:48.657235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e041f-f8e5-41f5-b40f-0ceba8ef8587 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:48.658279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e041f-f8e5-41f5-b40f-0ceba8ef8587 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:48.658408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e041f-f8e5-41f5-b40f-0ceba8ef8587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:48.733170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a44e041f-f8e5-41f5-b40f-0ceba8ef8587 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:48.734506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a44e041f-f8e5-41f5-b40f-0ceba8ef8587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:48.853720 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 700/1405] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:51:49.153218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53907b-fce9-4857-9a2e-eca3ab73249d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:49.154878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a53907b-fce9-4857-9a2e-eca3ab73249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:49.313334 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:49.324445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53907b-fce9-4857-9a2e-eca3ab73249d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:49.447209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705654aa-7adc-43f3-a8e7-47ba10417954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:49.447815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705654aa-7adc-43f3-a8e7-47ba10417954 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:49.448224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705654aa-7adc-43f3-a8e7-47ba10417954 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:49.448501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705654aa-7adc-43f3-a8e7-47ba10417954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:49.450132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-705654aa-7adc-43f3-a8e7-47ba10417954 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:49.558250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705654aa-7adc-43f3-a8e7-47ba10417954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:49.559917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705654aa-7adc-43f3-a8e7-47ba10417954 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:49.571264 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:49.582021 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 706/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:51:51.813709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2442-52aa-4357-ac3f-ce42569cdd45 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:51.814346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2442-52aa-4357-ac3f-ce42569cdd45 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:51.814719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2442-52aa-4357-ac3f-ce42569cdd45 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:51.820121 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 701/1407] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:51:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:51:51.821633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2405-d8d3-4c02-8555-3d9054cf7517 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:51.822079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2405-d8d3-4c02-8555-3d9054cf7517 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:51.822251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2405-d8d3-4c02-8555-3d9054cf7517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:51.903219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6edd2405-d8d3-4c02-8555-3d9054cf7517 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:51:51.904453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6edd2405-d8d3-4c02-8555-3d9054cf7517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:52.030639 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 707/1408] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:51:52.320565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd2442-52aa-4357-ac3f-ce42569cdd45 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:51:52.322097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-97dd2442-52aa-4357-ac3f-ce42569cdd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:52.398677 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:52.491465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd2442-52aa-4357-ac3f-ce42569cdd45 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:51:52.622376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9288e23-3478-4d82-9b61-e4990d647e04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:51:52.623091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288e23-3478-4d82-9b61-e4990d647e04 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:51:52.623225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288e23-3478-4d82-9b61-e4990d647e04 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:51:52.623449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288e23-3478-4d82-9b61-e4990d647e04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:51:52.625046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b9288e23-3478-4d82-9b61-e4990d647e04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:51:52.653601 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:51:52.724704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9288e23-3478-4d82-9b61-e4990d647e04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:51:52.726428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9288e23-3478-4d82-9b61-e4990d647e04 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:51:52.746630 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 702/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:02.026008 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=67 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:02.744296 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=35 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:09.533945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46733d-b2d9-4594-9ea0-8fafab4dca09 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:09.534532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46733d-b2d9-4594-9ea0-8fafab4dca09 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:09.534532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46733d-b2d9-4594-9ea0-8fafab4dca09 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:09.535898 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 708/1410] 10.222.0.23 () {54 vars in 918 bytes} [Sun Oct 2 00:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:09.541124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e3f6b-0793-4a02-82ef-be4990ae9a86 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:09.541559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e3f6b-0793-4a02-82ef-be4990ae9a86 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:09.541665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e3f6b-0793-4a02-82ef-be4990ae9a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:09.615506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f88e3f6b-0793-4a02-82ef-be4990ae9a86 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:09.616716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f88e3f6b-0793-4a02-82ef-be4990ae9a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:09.720041 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 703/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Oct 2 00:52:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:09.735250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a24eb-88f3-45ca-80e8-56d5efe97212 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:09.735524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a24eb-88f3-45ca-80e8-56d5efe97212 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:09.735800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a24eb-88f3-45ca-80e8-56d5efe97212 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:09.737154 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 709/1412] 10.222.0.23 () {54 vars in 918 bytes} [Sun Oct 2 00:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:09.744083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f8c25-2490-4eaf-98f1-2ceb429ea31d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:09.744371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f8c25-2490-4eaf-98f1-2ceb429ea31d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:09.744646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f8c25-2490-4eaf-98f1-2ceb429ea31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:09.815935 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:09.819427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f29f8c25-2490-4eaf-98f1-2ceb429ea31d None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:09.821262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f29f8c25-2490-4eaf-98f1-2ceb429ea31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:09.936694 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 704/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Oct 2 00:52:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:12.559626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3c7f-b92e-4eb4-ad2e-5315c67bae8b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:12.560188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3c7f-b92e-4eb4-ad2e-5315c67bae8b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:12.560188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3c7f-b92e-4eb4-ad2e-5315c67bae8b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:12.561489 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:12.567624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2714ad-f86f-44d5-a458-8d2613bc68b8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:12.568111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2714ad-f86f-44d5-a458-8d2613bc68b8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:12.568250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2714ad-f86f-44d5-a458-8d2613bc68b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:12.632921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9a2714ad-f86f-44d5-a458-8d2613bc68b8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:12.634123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9a2714ad-f86f-44d5-a458-8d2613bc68b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:12.686938 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:12.729310 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:13.016296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3c7f-b92e-4eb4-ad2e-5315c67bae8b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:13.017815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7ad3c7f-b92e-4eb4-ad2e-5315c67bae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:13.171110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3c7f-b92e-4eb4-ad2e-5315c67bae8b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:13.243314 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:13.284445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0fb90-5a16-4119-81db-b7a843778f3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:13.285011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0fb90-5a16-4119-81db-b7a843778f3d service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:13.285435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0fb90-5a16-4119-81db-b7a843778f3d service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:13.285861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0fb90-5a16-4119-81db-b7a843778f3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:13.287487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5e0fb90-5a16-4119-81db-b7a843778f3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:13.373850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0fb90-5a16-4119-81db-b7a843778f3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:13.375501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0fb90-5a16-4119-81db-b7a843778f3d service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:13.393482 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 711/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:14.544349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b4d24-660e-4df6-9e45-1cf4d0876da3 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:14.544883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b4d24-660e-4df6-9e45-1cf4d0876da3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:14.544883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b4d24-660e-4df6-9e45-1cf4d0876da3 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:14.546136 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:14.552871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dc37d-4f16-4197-9369-1b9f6d526cbb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:14.553340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dc37d-4f16-4197-9369-1b9f6d526cbb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:14.553448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dc37d-4f16-4197-9369-1b9f6d526cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:14.627763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cf0dc37d-4f16-4197-9369-1b9f6d526cbb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:14.628994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf0dc37d-4f16-4197-9369-1b9f6d526cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:14.655258 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:14.723404 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:52:14.885430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b4d24-660e-4df6-9e45-1cf4d0876da3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:14.887139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1c6b4d24-660e-4df6-9e45-1cf4d0876da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:15.030878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b4d24-660e-4df6-9e45-1cf4d0876da3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:15.069866 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:15.141510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868078b6-f47a-475a-9dcb-d20dfa194f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:15.142103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868078b6-f47a-475a-9dcb-d20dfa194f2a service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:15.142382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868078b6-f47a-475a-9dcb-d20dfa194f2a service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:15.142684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868078b6-f47a-475a-9dcb-d20dfa194f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:15.144278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-868078b6-f47a-475a-9dcb-d20dfa194f2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:15.237398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868078b6-f47a-475a-9dcb-d20dfa194f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:15.239702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868078b6-f47a-475a-9dcb-d20dfa194f2a service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:15.258162 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 707/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:16.406554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758c3b5-a814-4be0-9806-696faa116535 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:16.407117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758c3b5-a814-4be0-9806-696faa116535 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:16.407117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758c3b5-a814-4be0-9806-696faa116535 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:16.408414 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:16.415334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b67a8-aef3-4ce0-9e0b-d8826fd700e4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:16.415764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b67a8-aef3-4ce0-9e0b-d8826fd700e4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:16.415914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b67a8-aef3-4ce0-9e0b-d8826fd700e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:16.468977 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:16.491879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-210b67a8-aef3-4ce0-9e0b-d8826fd700e4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:16.493083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-210b67a8-aef3-4ce0-9e0b-d8826fd700e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:16.588028 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:16.742346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758c3b5-a814-4be0-9806-696faa116535 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:16.743921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5758c3b5-a814-4be0-9806-696faa116535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:16.887146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758c3b5-a814-4be0-9806-696faa116535 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:16.899911 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:16.999960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4bdca-382c-40a0-aaac-7a44e8707b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:17.000502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4bdca-382c-40a0-aaac-7a44e8707b62 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:17.000780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4bdca-382c-40a0-aaac-7a44e8707b62 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:17.001051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4bdca-382c-40a0-aaac-7a44e8707b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:17.002643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7cb4bdca-382c-40a0-aaac-7a44e8707b62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:17.090996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4bdca-382c-40a0-aaac-7a44e8707b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:17.092589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4bdca-382c-40a0-aaac-7a44e8707b62 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:17.110447 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 714/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:18.226189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bbe26-aa5d-4001-a7a5-9423bebfc5a0 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:18.226724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bbe26-aa5d-4001-a7a5-9423bebfc5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:18.226724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bbe26-aa5d-4001-a7a5-9423bebfc5a0 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:18.228026 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:18.234283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51f1ee-e1b1-4093-90a4-3cf8e48ed224 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:18.234712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51f1ee-e1b1-4093-90a4-3cf8e48ed224 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:18.234854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51f1ee-e1b1-4093-90a4-3cf8e48ed224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:18.254991 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:18.309961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3d51f1ee-e1b1-4093-90a4-3cf8e48ed224 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:18.311201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3d51f1ee-e1b1-4093-90a4-3cf8e48ed224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:18.406593 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:18.561537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bbe26-aa5d-4001-a7a5-9423bebfc5a0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:18.563074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-615bbe26-aa5d-4001-a7a5-9423bebfc5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:18.670109 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:18.705014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bbe26-aa5d-4001-a7a5-9423bebfc5a0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:18.818155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bda4c-617e-49c2-be14-a8d33cdaa486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:18.818555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bda4c-617e-49c2-be14-a8d33cdaa486 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:18.818862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bda4c-617e-49c2-be14-a8d33cdaa486 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:18.819138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bda4c-617e-49c2-be14-a8d33cdaa486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:18.820724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ed4bda4c-617e-49c2-be14-a8d33cdaa486 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:18.894222 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:18.908086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bda4c-617e-49c2-be14-a8d33cdaa486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:18.909687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bda4c-617e-49c2-be14-a8d33cdaa486 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:18.927710 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 710/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:20.037065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea9c6c-a379-4c41-a8d1-010c96341e21 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:20.037618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea9c6c-a379-4c41-a8d1-010c96341e21 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:20.037618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea9c6c-a379-4c41-a8d1-010c96341e21 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:20.038974 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:20.045028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a06a-22c2-440f-a491-e91793061b77 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:20.045453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a06a-22c2-440f-a491-e91793061b77 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:20.045576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a06a-22c2-440f-a491-e91793061b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:20.121020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1a14a06a-22c2-440f-a491-e91793061b77 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:20.122231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1a14a06a-22c2-440f-a491-e91793061b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:20.217084 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:20.365831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea9c6c-a379-4c41-a8d1-010c96341e21 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:20.367381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d2ea9c6c-a379-4c41-a8d1-010c96341e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:20.448335 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:20.516979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea9c6c-a379-4c41-a8d1-010c96341e21 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:20.627557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2126e-148f-40c0-b460-786800c0f0ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:20.628148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2126e-148f-40c0-b460-786800c0f0ea service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:20.628420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2126e-148f-40c0-b460-786800c0f0ea service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:20.628684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2126e-148f-40c0-b460-786800c0f0ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:20.630293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ef2126e-148f-40c0-b460-786800c0f0ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:20.677545 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:20.718210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2126e-148f-40c0-b460-786800c0f0ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:20.719847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2126e-148f-40c0-b460-786800c0f0ea service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:20.737117 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 717/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:21.795682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29de6a-3bc0-4112-a7ac-f1437c75c5bd None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:21.796264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29de6a-3bc0-4112-a7ac-f1437c75c5bd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:21.796264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29de6a-3bc0-4112-a7ac-f1437c75c5bd None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:21.797585 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:21.804426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1b12-7e0e-4a6d-8a52-3e79d2b40591 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:21.804899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1b12-7e0e-4a6d-8a52-3e79d2b40591 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:21.804997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1b12-7e0e-4a6d-8a52-3e79d2b40591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:21.878824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0a4c1b12-7e0e-4a6d-8a52-3e79d2b40591 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:21.880599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0a4c1b12-7e0e-4a6d-8a52-3e79d2b40591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:21.977062 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:22.125470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29de6a-3bc0-4112-a7ac-f1437c75c5bd None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:22.126933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bb29de6a-3bc0-4112-a7ac-f1437c75c5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:22.175322 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:22.270747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29de6a-3bc0-4112-a7ac-f1437c75c5bd None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:22.380649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391a9c5-5257-400c-87be-d87a71a7eff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:22.381221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a9c5-5257-400c-87be-d87a71a7eff6 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:22.381508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a9c5-5257-400c-87be-d87a71a7eff6 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:22.381783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391a9c5-5257-400c-87be-d87a71a7eff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:22.383417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c391a9c5-5257-400c-87be-d87a71a7eff6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:22.390187 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:22.471243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391a9c5-5257-400c-87be-d87a71a7eff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:22.473002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391a9c5-5257-400c-87be-d87a71a7eff6 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:22.490514 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 713/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:23.536968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f7af3-f72a-432b-b7dd-779824ea092c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:23.537554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f7af3-f72a-432b-b7dd-779824ea092c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:23.537554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f7af3-f72a-432b-b7dd-779824ea092c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:23.538926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:23.545036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63778f74-ac5d-483b-92af-1d8a74d67f77 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:23.545464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63778f74-ac5d-483b-92af-1d8a74d67f77 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:23.545572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63778f74-ac5d-483b-92af-1d8a74d67f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:23.622289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-63778f74-ac5d-483b-92af-1d8a74d67f77 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:23.623525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-63778f74-ac5d-483b-92af-1d8a74d67f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:23.693781 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:23.724211 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:23.880713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f7af3-f72a-432b-b7dd-779824ea092c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:23.882182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f25f7af3-f72a-432b-b7dd-779824ea092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:23.900532 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:24.031156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f7af3-f72a-432b-b7dd-779824ea092c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:24.117806 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:24.143553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd945dc9-0448-4959-ade3-462cb5f30af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:24.145193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd945dc9-0448-4959-ade3-462cb5f30af9 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:24.145473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd945dc9-0448-4959-ade3-462cb5f30af9 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:24.145773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd945dc9-0448-4959-ade3-462cb5f30af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:24.147448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bd945dc9-0448-4959-ade3-462cb5f30af9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:24.253617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd945dc9-0448-4959-ade3-462cb5f30af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:24.255300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd945dc9-0448-4959-ade3-462cb5f30af9 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:24.275128 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 720/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:25.329942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffad1d-06ea-4e33-ae50-497efa13a7cf None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:25.330489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffad1d-06ea-4e33-ae50-497efa13a7cf None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:25.330489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffad1d-06ea-4e33-ae50-497efa13a7cf None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:25.332631 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:52:25.339113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0c618-5ffa-487b-9f72-23f4831c5e45 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:25.339576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0c618-5ffa-487b-9f72-23f4831c5e45 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:25.339684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0c618-5ffa-487b-9f72-23f4831c5e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:25.414140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fed0c618-5ffa-487b-9f72-23f4831c5e45 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:25.415438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fed0c618-5ffa-487b-9f72-23f4831c5e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:25.457011 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:25.510760 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:25.669198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffad1d-06ea-4e33-ae50-497efa13a7cf None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:25.670752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cdffad1d-06ea-4e33-ae50-497efa13a7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:25.813570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffad1d-06ea-4e33-ae50-497efa13a7cf None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:25.869342 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:25.929975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16021c69-5e21-4aac-8f4f-0ca85b4e9ef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:25.930480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16021c69-5e21-4aac-8f4f-0ca85b4e9ef7 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:25.930792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16021c69-5e21-4aac-8f4f-0ca85b4e9ef7 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:25.931062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16021c69-5e21-4aac-8f4f-0ca85b4e9ef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:25.932665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-16021c69-5e21-4aac-8f4f-0ca85b4e9ef7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:26.021157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16021c69-5e21-4aac-8f4f-0ca85b4e9ef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:26.022777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16021c69-5e21-4aac-8f4f-0ca85b4e9ef7 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:26.040662 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 716/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:27.102622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab9ea4-09cd-4bac-8e77-0c23afea5c73 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:27.103158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab9ea4-09cd-4bac-8e77-0c23afea5c73 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:27.103158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab9ea4-09cd-4bac-8e77-0c23afea5c73 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:27.104523 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:27.110585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd98d8-9f5a-4319-a739-aae66de30d96 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:27.111043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd98d8-9f5a-4319-a739-aae66de30d96 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:27.111156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd98d8-9f5a-4319-a739-aae66de30d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:27.185203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9ddd98d8-9f5a-4319-a739-aae66de30d96 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:27.186397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9ddd98d8-9f5a-4319-a739-aae66de30d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:27.188398 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:27.283663 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:27.433275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab9ea4-09cd-4bac-8e77-0c23afea5c73 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:27.434824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d3ab9ea4-09cd-4bac-8e77-0c23afea5c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:27.581195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab9ea4-09cd-4bac-8e77-0c23afea5c73 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:27.609008 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:27.695455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da33b2-4501-411f-9bf3-71ebaae47228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:27.696055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da33b2-4501-411f-9bf3-71ebaae47228 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:27.696332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da33b2-4501-411f-9bf3-71ebaae47228 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:27.696598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da33b2-4501-411f-9bf3-71ebaae47228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:27.698183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-05da33b2-4501-411f-9bf3-71ebaae47228 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:27.785214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da33b2-4501-411f-9bf3-71ebaae47228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:27.786845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da33b2-4501-411f-9bf3-71ebaae47228 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:27.804859 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 723/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:29.905585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee75c8-1917-4224-8309-196b3b94725f None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:29.906249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee75c8-1917-4224-8309-196b3b94725f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:29.906249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee75c8-1917-4224-8309-196b3b94725f None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:29.908325 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:29.913689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a09c57-66c4-4d41-9cc2-49fc42718fe5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:29.914155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a09c57-66c4-4d41-9cc2-49fc42718fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:29.914267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a09c57-66c4-4d41-9cc2-49fc42718fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:29.954254 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:29.980295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-11a09c57-66c4-4d41-9cc2-49fc42718fe5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:29.981493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-11a09c57-66c4-4d41-9cc2-49fc42718fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:30.075375 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:30.367140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee75c8-1917-4224-8309-196b3b94725f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:30.368664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ccee75c8-1917-4224-8309-196b3b94725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:30.470198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee75c8-1917-4224-8309-196b3b94725f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:30.502252 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:30.544418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532e0bb-66e5-48d6-a056-1f85021cd393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:30.545016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e0bb-66e5-48d6-a056-1f85021cd393 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:30.545294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e0bb-66e5-48d6-a056-1f85021cd393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:30.545565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e0bb-66e5-48d6-a056-1f85021cd393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:30.547181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0532e0bb-66e5-48d6-a056-1f85021cd393 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:30.652729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532e0bb-66e5-48d6-a056-1f85021cd393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:30.654107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532e0bb-66e5-48d6-a056-1f85021cd393 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:30.675585 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 719/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:33.039474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf065e-0cf7-454e-94e5-25374dcd74a9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:33.040008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf065e-0cf7-454e-94e5-25374dcd74a9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:33.040008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf065e-0cf7-454e-94e5-25374dcd74a9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:33.041377 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:33.047244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecffc4-7226-42a0-b7f8-de3691dffe4a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:33.047773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecffc4-7226-42a0-b7f8-de3691dffe4a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:33.047773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecffc4-7226-42a0-b7f8-de3691dffe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:33.111978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-32ecffc4-7226-42a0-b7f8-de3691dffe4a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:33.113173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-32ecffc4-7226-42a0-b7f8-de3691dffe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:33.125490 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:33.208253 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:33.490030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf065e-0cf7-454e-94e5-25374dcd74a9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:33.491618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8bdf065e-0cf7-454e-94e5-25374dcd74a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:33.600452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf065e-0cf7-454e-94e5-25374dcd74a9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:33.613094 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:33.673751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83935ee0-521e-4caa-827e-76fb451cf73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:33.674350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83935ee0-521e-4caa-827e-76fb451cf73b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:33.674681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83935ee0-521e-4caa-827e-76fb451cf73b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:33.674956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83935ee0-521e-4caa-827e-76fb451cf73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:33.676546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-83935ee0-521e-4caa-827e-76fb451cf73b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:33.784945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83935ee0-521e-4caa-827e-76fb451cf73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:33.786313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83935ee0-521e-4caa-827e-76fb451cf73b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:33.804242 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 726/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:36.491313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb499de-c145-475a-ab4c-b4ebe37743a4 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:36.491930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb499de-c145-475a-ab4c-b4ebe37743a4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:36.491930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb499de-c145-475a-ab4c-b4ebe37743a4 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:36.493187 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:36.499118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f570cf9-8982-4570-bc00-c516a32fa29f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:36.499619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f570cf9-8982-4570-bc00-c516a32fa29f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:36.499750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f570cf9-8982-4570-bc00-c516a32fa29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:36.549891 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:36.569147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9f570cf9-8982-4570-bc00-c516a32fa29f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:36.570552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f570cf9-8982-4570-bc00-c516a32fa29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:36.685707 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:36.974027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb499de-c145-475a-ab4c-b4ebe37743a4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:36.975613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5cb499de-c145-475a-ab4c-b4ebe37743a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:37.078107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb499de-c145-475a-ab4c-b4ebe37743a4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:37.118017 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:37.152402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c5f89-3c59-48ff-a4b9-44e79219e941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:37.153002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c5f89-3c59-48ff-a4b9-44e79219e941 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:37.153304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c5f89-3c59-48ff-a4b9-44e79219e941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:37.153576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c5f89-3c59-48ff-a4b9-44e79219e941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:37.156101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ee9c5f89-3c59-48ff-a4b9-44e79219e941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:37.262655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c5f89-3c59-48ff-a4b9-44e79219e941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:37.264865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c5f89-3c59-48ff-a4b9-44e79219e941 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:37.285783 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 722/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:39.562890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3cf60-3821-4a56-9cf8-2055aaedf46f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:39.563439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3cf60-3821-4a56-9cf8-2055aaedf46f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:39.563439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3cf60-3821-4a56-9cf8-2055aaedf46f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:39.564789 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:39.570155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a13b-4394-488a-b6ea-503b6b099baa None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:39.570584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a13b-4394-488a-b6ea-503b6b099baa None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:39.570728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a13b-4394-488a-b6ea-503b6b099baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:39.639575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c3d6a13b-4394-488a-b6ea-503b6b099baa None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:39.640783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c3d6a13b-4394-488a-b6ea-503b6b099baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:39.662398 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:39.736634 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:40.041847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3cf60-3821-4a56-9cf8-2055aaedf46f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:40.043401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37b3cf60-3821-4a56-9cf8-2055aaedf46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:40.146269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3cf60-3821-4a56-9cf8-2055aaedf46f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:40.166269 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:40.220070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a1ec8-8e7a-4e85-a745-bdbd6059b272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:40.220740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a1ec8-8e7a-4e85-a745-bdbd6059b272 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:40.221184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a1ec8-8e7a-4e85-a745-bdbd6059b272 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:40.221622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a1ec8-8e7a-4e85-a745-bdbd6059b272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:40.224501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aa8a1ec8-8e7a-4e85-a745-bdbd6059b272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:40.338734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a1ec8-8e7a-4e85-a745-bdbd6059b272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:40.340184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a1ec8-8e7a-4e85-a745-bdbd6059b272 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:40.358839 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 729/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:42.549933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa88a2-7220-4408-9002-76c173852ca7 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:42.550512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa88a2-7220-4408-9002-76c173852ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:42.550512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa88a2-7220-4408-9002-76c173852ca7 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:42.551867 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:42.557144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a54527-c8c1-4d1f-a9e5-8d49519c5fee None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:42.557573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a54527-c8c1-4d1f-a9e5-8d49519c5fee None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:42.557693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a54527-c8c1-4d1f-a9e5-8d49519c5fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:42.621775 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:42.624492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-72a54527-c8c1-4d1f-a9e5-8d49519c5fee None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:42.626242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-72a54527-c8c1-4d1f-a9e5-8d49519c5fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:42.720782 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:43.002398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa88a2-7220-4408-9002-76c173852ca7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:43.003971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-09aa88a2-7220-4408-9002-76c173852ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:43.105096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa88a2-7220-4408-9002-76c173852ca7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:43.154623 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:43.178952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908f1c1-65d0-4de9-b535-333cecdc7c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:43.179544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908f1c1-65d0-4de9-b535-333cecdc7c81 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:43.179820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908f1c1-65d0-4de9-b535-333cecdc7c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:43.180089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908f1c1-65d0-4de9-b535-333cecdc7c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:43.181664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a908f1c1-65d0-4de9-b535-333cecdc7c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:43.288389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908f1c1-65d0-4de9-b535-333cecdc7c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:43.289748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908f1c1-65d0-4de9-b535-333cecdc7c81 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:43.307388 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 725/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:45.504105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389accdf-90be-4270-b28e-abdac02f42a0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:45.504654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389accdf-90be-4270-b28e-abdac02f42a0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:45.504654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389accdf-90be-4270-b28e-abdac02f42a0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:45.505998 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:45.511992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e33c3-dba1-4124-9a73-2b71de8cd025 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:45.512424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e33c3-dba1-4124-9a73-2b71de8cd025 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:45.512526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e33c3-dba1-4124-9a73-2b71de8cd025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:45.577230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d22e33c3-dba1-4124-9a73-2b71de8cd025 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:45.578434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d22e33c3-dba1-4124-9a73-2b71de8cd025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:45.607688 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:45.675147 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:45.958653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389accdf-90be-4270-b28e-abdac02f42a0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:45.960282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-389accdf-90be-4270-b28e-abdac02f42a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:46.066385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389accdf-90be-4270-b28e-abdac02f42a0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:46.095885 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:46.140067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969807-fb42-4d65-9a11-ee63b95b4383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:46.140687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969807-fb42-4d65-9a11-ee63b95b4383 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:46.140951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969807-fb42-4d65-9a11-ee63b95b4383 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:46.141223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969807-fb42-4d65-9a11-ee63b95b4383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:46.142835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2b969807-fb42-4d65-9a11-ee63b95b4383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:46.250938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969807-fb42-4d65-9a11-ee63b95b4383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:46.252378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969807-fb42-4d65-9a11-ee63b95b4383 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:46.270260 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 732/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:48.555484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf66314-431c-43ed-a0ad-9d7acb9ade64 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:48.555997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf66314-431c-43ed-a0ad-9d7acb9ade64 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:48.556111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf66314-431c-43ed-a0ad-9d7acb9ade64 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:48.557590 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:48.563581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15260c63-8810-408f-8edf-b3b23384d4e1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:48.564113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15260c63-8810-408f-8edf-b3b23384d4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:48.564113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15260c63-8810-408f-8edf-b3b23384d4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:48.638148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-15260c63-8810-408f-8edf-b3b23384d4e1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:48.639742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-15260c63-8810-408f-8edf-b3b23384d4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:48.648624 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:48.742951 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:49.033499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf66314-431c-43ed-a0ad-9d7acb9ade64 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:49.035115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-acf66314-431c-43ed-a0ad-9d7acb9ade64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:49.158868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf66314-431c-43ed-a0ad-9d7acb9ade64 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:49.220521 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:49.238492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a72f5c-66e3-4d65-b7aa-efeb86bd8adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:49.239054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a72f5c-66e3-4d65-b7aa-efeb86bd8adb service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:49.239330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a72f5c-66e3-4d65-b7aa-efeb86bd8adb service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:49.239599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a72f5c-66e3-4d65-b7aa-efeb86bd8adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:49.241186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-82a72f5c-66e3-4d65-b7aa-efeb86bd8adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:49.350273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a72f5c-66e3-4d65-b7aa-efeb86bd8adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:49.351769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a72f5c-66e3-4d65-b7aa-efeb86bd8adb service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:49.371076 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 728/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:51.609176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca2e94-6979-4972-915e-d7f4eb752dc8 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:51.609748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca2e94-6979-4972-915e-d7f4eb752dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:51.609999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca2e94-6979-4972-915e-d7f4eb752dc8 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:51.612140 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:52:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:51.617555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9c89-ab89-4f50-962e-d8e3ca108623 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:51.618092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9c89-ab89-4f50-962e-d8e3ca108623 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:51.618092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9c89-ab89-4f50-962e-d8e3ca108623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:51.682892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fb6c9c89-ab89-4f50-962e-d8e3ca108623 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:51.684108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fb6c9c89-ab89-4f50-962e-d8e3ca108623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:51.722099 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:51.779654 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:52.071635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca2e94-6979-4972-915e-d7f4eb752dc8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:52.073589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f2ca2e94-6979-4972-915e-d7f4eb752dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:52.175028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca2e94-6979-4972-915e-d7f4eb752dc8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:52.213103 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:52.250180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ad09a-a57e-4c6e-be10-e86464a49124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:52.250732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ad09a-a57e-4c6e-be10-e86464a49124 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:52.251010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ad09a-a57e-4c6e-be10-e86464a49124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:52.251278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ad09a-a57e-4c6e-be10-e86464a49124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:52.252855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f42ad09a-a57e-4c6e-be10-e86464a49124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:52.360676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ad09a-a57e-4c6e-be10-e86464a49124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:52.362136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ad09a-a57e-4c6e-be10-e86464a49124 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:52.379918 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 735/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:54.547337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b71d-7af2-408b-b92a-f0eaafef0b05 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:54.547915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b71d-7af2-408b-b92a-f0eaafef0b05 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:54.547915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b71d-7af2-408b-b92a-f0eaafef0b05 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:54.549219 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:54.554653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e52c29-000f-4521-b8aa-aee3c90dac96 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:54.555092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e52c29-000f-4521-b8aa-aee3c90dac96 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:54.555216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e52c29-000f-4521-b8aa-aee3c90dac96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:54.619426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e1e52c29-000f-4521-b8aa-aee3c90dac96 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:54.620629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e1e52c29-000f-4521-b8aa-aee3c90dac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:54.640532 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:54.719571 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:55.006665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85b71d-7af2-408b-b92a-f0eaafef0b05 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:55.008772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8a85b71d-7af2-408b-b92a-f0eaafef0b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:55.109160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85b71d-7af2-408b-b92a-f0eaafef0b05 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:55.173975 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:55.180990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2976a1-b335-4114-8ab9-feeabd6d32a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:55.181589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2976a1-b335-4114-8ab9-feeabd6d32a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:55.181866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2976a1-b335-4114-8ab9-feeabd6d32a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:55.182148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2976a1-b335-4114-8ab9-feeabd6d32a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:55.183740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ee2976a1-b335-4114-8ab9-feeabd6d32a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:55.294392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2976a1-b335-4114-8ab9-feeabd6d32a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:55.295786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2976a1-b335-4114-8ab9-feeabd6d32a7 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:55.314165 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 731/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:52:57.518060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c17888-e36a-4b09-9242-8b48a7334785 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:57.518650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c17888-e36a-4b09-9242-8b48a7334785 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:57.518650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c17888-e36a-4b09-9242-8b48a7334785 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:57.519980 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:52:57.525936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8e02-5d68-420e-9278-f7a3f35fb10b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:57.526355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8e02-5d68-420e-9278-f7a3f35fb10b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:57.526468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8e02-5d68-420e-9278-f7a3f35fb10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:57.592549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4c2b8e02-5d68-420e-9278-f7a3f35fb10b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:52:57.593748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4c2b8e02-5d68-420e-9278-f7a3f35fb10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:57.642413 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:57.692811 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:52:57.981322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c17888-e36a-4b09-9242-8b48a7334785 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:52:57.983024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-54c17888-e36a-4b09-9242-8b48a7334785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:58.089121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c17888-e36a-4b09-9242-8b48a7334785 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:52:58.137177 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:58.163330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a32197-dfae-4ee0-9a3c-fae76bcad390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:52:58.163939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a32197-dfae-4ee0-9a3c-fae76bcad390 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:52:58.164217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a32197-dfae-4ee0-9a3c-fae76bcad390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:52:58.164488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a32197-dfae-4ee0-9a3c-fae76bcad390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:52:58.166082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-94a32197-dfae-4ee0-9a3c-fae76bcad390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:52:58.278714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a32197-dfae-4ee0-9a3c-fae76bcad390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:52:58.280189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a32197-dfae-4ee0-9a3c-fae76bcad390 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:52:58.297905 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 738/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:53:07.691842 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=22 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:08.295742 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=66 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:18.366840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c37cb-a2a4-4875-8c04-d8434c763e29 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:18.367372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c37cb-a2a4-4875-8c04-d8434c763e29 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:18.367372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c37cb-a2a4-4875-8c04-d8434c763e29 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:18.368709 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 733/1471] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:53:18.373800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de070-6bba-405b-b564-9d5f8d880352 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:18.374249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de070-6bba-405b-b564-9d5f8d880352 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:18.374364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de070-6bba-405b-b564-9d5f8d880352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:18.441786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d19de070-6bba-405b-b564-9d5f8d880352 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:53:18.443016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d19de070-6bba-405b-b564-9d5f8d880352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:18.536413 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 739/1472] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:53:18.839196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e5b58-3473-4106-88c4-ee1281623551 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:18.839478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e5b58-3473-4106-88c4-ee1281623551 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:18.839751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e5b58-3473-4106-88c4-ee1281623551 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:18.841067 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 734/1473] 10.222.0.23 () {54 vars in 962 bytes} [Sun Oct 2 00:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:53:18.847109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341000-5c19-47d7-b5a9-3afdcb5cc170 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:18.847404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341000-5c19-47d7-b5a9-3afdcb5cc170 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:18.847677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341000-5c19-47d7-b5a9-3afdcb5cc170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:18.923750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e1341000-5c19-47d7-b5a9-3afdcb5cc170 None None] MFA Rules not processed for user `7cee33d8425d4be0ba5721ec419a12e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:53:18.924965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e1341000-5c19-47d7-b5a9-3afdcb5cc170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:18.945340 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:19.001388 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 740/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Oct 2 00:53:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:53:19.009215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e5b58-3473-4106-88c4-ee1281623551 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:53:19.010747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9c7e5b58-3473-4106-88c4-ee1281623551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:19.112295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e5b58-3473-4106-88c4-ee1281623551 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:53:19.184296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ff7b9-6f26-49a1-bb7f-f29eeb5fbed9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:53:19.184900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ff7b9-6f26-49a1-bb7f-f29eeb5fbed9 service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:19.185205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ff7b9-6f26-49a1-bb7f-f29eeb5fbed9 service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:19.185511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ff7b9-6f26-49a1-bb7f-f29eeb5fbed9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:19.187157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-927ff7b9-6f26-49a1-bb7f-f29eeb5fbed9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:19.241299 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:19.296376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ff7b9-6f26-49a1-bb7f-f29eeb5fbed9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:53:19.298471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ff7b9-6f26-49a1-bb7f-f29eeb5fbed9 service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:53:19.317151 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 735/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:53:21.581526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ca6dd-75f9-48b3-8404-fe6ba7ed0b1b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:21.582120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ca6dd-75f9-48b3-8404-fe6ba7ed0b1b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:21.582120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ca6dd-75f9-48b3-8404-fe6ba7ed0b1b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:21.583447 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 741/1476] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:53:21.588652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe0f4-fdc9-452f-aad8-275fa2ab6c17 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:21.589057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe0f4-fdc9-452f-aad8-275fa2ab6c17 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:21.589215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe0f4-fdc9-452f-aad8-275fa2ab6c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:21.656002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-782fe0f4-fdc9-452f-aad8-275fa2ab6c17 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:53:21.658117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-782fe0f4-fdc9-452f-aad8-275fa2ab6c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:21.763608 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 736/1477] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:53:22.056246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ca6dd-75f9-48b3-8404-fe6ba7ed0b1b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:53:22.057789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b05ca6dd-75f9-48b3-8404-fe6ba7ed0b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:22.199459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ca6dd-75f9-48b3-8404-fe6ba7ed0b1b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:53:22.256074 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:22.307802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc730e-232e-4e64-9868-7be4d87e2044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:53:22.308402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc730e-232e-4e64-9868-7be4d87e2044 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:22.308683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc730e-232e-4e64-9868-7be4d87e2044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:22.308952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc730e-232e-4e64-9868-7be4d87e2044 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:22.309587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc730e-232e-4e64-9868-7be4d87e2044 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:53:22.313246 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-5cdc730e-232e-4e64-9868-7be4d87e2044 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:53:22.313246 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 00:53:22.313246 n-d-master-1 devstack@keystone.service[81854]: Oct 02 00:53:22.315442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc730e-232e-4e64-9868-7be4d87e2044 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:53:22.342708 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 742/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 2 00:53:22 2022] GET /identity/v3/projects => generated 2553 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:53:24.601588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac451c2d-a3d5-491c-9380-e7748ebee21e None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:24.602210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac451c2d-a3d5-491c-9380-e7748ebee21e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:24.602210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac451c2d-a3d5-491c-9380-e7748ebee21e None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:24.603517 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 737/1479] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:53:24.609641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2663e5-9545-4f89-a50c-c1ed85c3bb56 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:24.610130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2663e5-9545-4f89-a50c-c1ed85c3bb56 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:24.610367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2663e5-9545-4f89-a50c-c1ed85c3bb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:24.685328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-be2663e5-9545-4f89-a50c-c1ed85c3bb56 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:53:24.687611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be2663e5-9545-4f89-a50c-c1ed85c3bb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:24.794158 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 743/1480] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:53:25.102185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac451c2d-a3d5-491c-9380-e7748ebee21e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:53:25.103770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ac451c2d-a3d5-491c-9380-e7748ebee21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:25.113503 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:25.269307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac451c2d-a3d5-491c-9380-e7748ebee21e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:53:25.363815 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:25.396389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03313baf-cc97-419d-8c8c-afb7e66ebdd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:53:25.396996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03313baf-cc97-419d-8c8c-afb7e66ebdd1 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:25.397274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03313baf-cc97-419d-8c8c-afb7e66ebdd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:25.397546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03313baf-cc97-419d-8c8c-afb7e66ebdd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:25.399161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-03313baf-cc97-419d-8c8c-afb7e66ebdd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:25.496302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03313baf-cc97-419d-8c8c-afb7e66ebdd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:53:25.497907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03313baf-cc97-419d-8c8c-afb7e66ebdd1 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:53:25.516737 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 738/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:53:27.917292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e48596-316f-48ed-84f0-3aebc227ddff None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:27.917839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e48596-316f-48ed-84f0-3aebc227ddff None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:27.917839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e48596-316f-48ed-84f0-3aebc227ddff None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:27.919216 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 744/1482] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:53:27.925450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8cb2f-0154-4fdb-a066-01976e7c2c61 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:27.925871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8cb2f-0154-4fdb-a066-01976e7c2c61 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:27.925992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8cb2f-0154-4fdb-a066-01976e7c2c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:27.996948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-43d8cb2f-0154-4fdb-a066-01976e7c2c61 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:53:27.998827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-43d8cb2f-0154-4fdb-a066-01976e7c2c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:28.043171 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:28.093916 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 739/1483] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:53:28.380429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e48596-316f-48ed-84f0-3aebc227ddff None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:53:28.381947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37e48596-316f-48ed-84f0-3aebc227ddff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:28.406406 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:28.484485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e48596-316f-48ed-84f0-3aebc227ddff None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:53:28.556486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33929146-8192-4cc8-b637-aa80c319af50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:53:28.557086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929146-8192-4cc8-b637-aa80c319af50 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:28.557363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929146-8192-4cc8-b637-aa80c319af50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:28.557632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929146-8192-4cc8-b637-aa80c319af50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:28.559224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-33929146-8192-4cc8-b637-aa80c319af50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:28.634783 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:28.670826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33929146-8192-4cc8-b637-aa80c319af50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:53:28.672278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33929146-8192-4cc8-b637-aa80c319af50 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:53:28.807623 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 745/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:53:31.013984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37a2c7-3b70-4652-aa0c-17f7bcfce9a4 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:31.014498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37a2c7-3b70-4652-aa0c-17f7bcfce9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:31.014645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37a2c7-3b70-4652-aa0c-17f7bcfce9a4 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:31.015981 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 740/1485] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:53:31.021386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1615ece-d3a4-4dab-9e4a-ae11e3f4cccd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:31.021790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1615ece-d3a4-4dab-9e4a-ae11e3f4cccd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:31.021933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1615ece-d3a4-4dab-9e4a-ae11e3f4cccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:31.094053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c1615ece-d3a4-4dab-9e4a-ae11e3f4cccd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:53:31.095220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c1615ece-d3a4-4dab-9e4a-ae11e3f4cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:31.191206 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 746/1486] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:53:31.480737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37a2c7-3b70-4652-aa0c-17f7bcfce9a4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:53:31.482926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9b37a2c7-3b70-4652-aa0c-17f7bcfce9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:31.583883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37a2c7-3b70-4652-aa0c-17f7bcfce9a4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:53:31.653347 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:31.655739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d44baf-9d97-41ef-8cf1-a95eb8c30539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:53:31.656355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d44baf-9d97-41ef-8cf1-a95eb8c30539 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:31.656906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d44baf-9d97-41ef-8cf1-a95eb8c30539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:31.657491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d44baf-9d97-41ef-8cf1-a95eb8c30539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:31.659518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-36d44baf-9d97-41ef-8cf1-a95eb8c30539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:31.767075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d44baf-9d97-41ef-8cf1-a95eb8c30539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:53:31.768427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d44baf-9d97-41ef-8cf1-a95eb8c30539 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:53:31.786338 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 741/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:53:34.016121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e67a-313a-4b05-9a3b-0149afebd8dc None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:34.016704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e67a-313a-4b05-9a3b-0149afebd8dc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:34.016704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e67a-313a-4b05-9a3b-0149afebd8dc None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:34.017994 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 747/1488] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:53:34.023201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b456d-2157-4a18-8c12-bff6bfae1c7b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:34.023630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b456d-2157-4a18-8c12-bff6bfae1c7b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:34.023736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b456d-2157-4a18-8c12-bff6bfae1c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:34.088276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7d6b456d-2157-4a18-8c12-bff6bfae1c7b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:53:34.089467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7d6b456d-2157-4a18-8c12-bff6bfae1c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:34.140749 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:34.183481 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 742/1489] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:53:34.480630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686e67a-313a-4b05-9a3b-0149afebd8dc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:53:34.482734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f686e67a-313a-4b05-9a3b-0149afebd8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:34.518019 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:34.585295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686e67a-313a-4b05-9a3b-0149afebd8dc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:53:34.656959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb8bb0-eb62-428c-8091-4007c10cfd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:53:34.657563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8bb0-eb62-428c-8091-4007c10cfd5c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:34.657851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8bb0-eb62-428c-8091-4007c10cfd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:34.658117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8bb0-eb62-428c-8091-4007c10cfd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:34.659751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bfcb8bb0-eb62-428c-8091-4007c10cfd5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:34.739393 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:34.769204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb8bb0-eb62-428c-8091-4007c10cfd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:53:34.770664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb8bb0-eb62-428c-8091-4007c10cfd5c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:53:34.788791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 748/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:53:37.365858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4416c9c-bb14-48b7-86f1-12cef5841430 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:37.366367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4416c9c-bb14-48b7-86f1-12cef5841430 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:37.366367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4416c9c-bb14-48b7-86f1-12cef5841430 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:37.367688 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 743/1491] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 2 00:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:53:37.373311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8aeb2-346a-45ef-bc7f-8405a4233701 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:37.373783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8aeb2-346a-45ef-bc7f-8405a4233701 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:37.373887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8aeb2-346a-45ef-bc7f-8405a4233701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:37.444517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9ff8aeb2-346a-45ef-bc7f-8405a4233701 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:53:37.445727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9ff8aeb2-346a-45ef-bc7f-8405a4233701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:37.543503 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 749/1492] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 2 00:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:53:37.837061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4416c9c-bb14-48b7-86f1-12cef5841430 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:53:37.838613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e4416c9c-bb14-48b7-86f1-12cef5841430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:37.940143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4416c9c-bb14-48b7-86f1-12cef5841430 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:53:38.013586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcf7f1-68fa-4fd4-a5e7-4aa2464d1093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:53:38.014180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcf7f1-68fa-4fd4-a5e7-4aa2464d1093 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:53:38.014458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcf7f1-68fa-4fd4-a5e7-4aa2464d1093 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:53:38.014763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcf7f1-68fa-4fd4-a5e7-4aa2464d1093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:53:38.016343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5cfcf7f1-68fa-4fd4-a5e7-4aa2464d1093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:53:38.024648 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:38.122787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcf7f1-68fa-4fd4-a5e7-4aa2464d1093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:53:38.124136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcf7f1-68fa-4fd4-a5e7-4aa2464d1093 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:53:38.143470 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 744/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:53:47.541915 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=82 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:48.141074 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=50 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:51.101839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4957bd-52cc-4ad4-8565-ab8c04fa4c18 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:51.102396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4957bd-52cc-4ad4-8565-ab8c04fa4c18 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:51.102396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4957bd-52cc-4ad4-8565-ab8c04fa4c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:51.177901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fb4957bd-52cc-4ad4-8565-ab8c04fa4c18 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:51.179389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fb4957bd-52cc-4ad4-8565-ab8c04fa4c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:51.275942 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 750/1494] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 00:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:51.283972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fccbd-b821-4c3c-a9f1-daab504b6ab4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:51.284508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fccbd-b821-4c3c-a9f1-daab504b6ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:51.284508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fccbd-b821-4c3c-a9f1-daab504b6ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:51.361425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-911fccbd-b821-4c3c-a9f1-daab504b6ab4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:51.362541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-911fccbd-b821-4c3c-a9f1-daab504b6ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:51.456847 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 745/1495] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 00:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:51.461437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4957bd-52cc-4ad4-8565-ab8c04fa4c18 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:51.462660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fb4957bd-52cc-4ad4-8565-ab8c04fa4c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:51.474148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4957bd-52cc-4ad4-8565-ab8c04fa4c18 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:51.541874 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:51.583862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cd201-407b-4ea4-8ea2-7fac7be998a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:51.584470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd201-407b-4ea4-8ea2-7fac7be998a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:51.584749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd201-407b-4ea4-8ea2-7fac7be998a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:51.585024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd201-407b-4ea4-8ea2-7fac7be998a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:51.585668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cd201-407b-4ea4-8ea2-7fac7be998a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 00:54:51.585972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cd201-407b-4ea4-8ea2-7fac7be998a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:51.587029 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-d76cd201-407b-4ea4-8ea2-7fac7be998a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:54:51.587029 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 00:54:51.587029 n-d-master-1 devstack@keystone.service[81854]: Oct 02 00:54:51.587920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cd201-407b-4ea4-8ea2-7fac7be998a6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:51.599657 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 751/1496] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 00:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:54:51.608167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fccbd-b821-4c3c-a9f1-daab504b6ab4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:51.618099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fccbd-b821-4c3c-a9f1-daab504b6ab4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:51.678767 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:51.712446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae14ae5-9709-4b93-a647-af50496e139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:51.713056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae14ae5-9709-4b93-a647-af50496e139e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:51.713342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae14ae5-9709-4b93-a647-af50496e139e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:51.713619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae14ae5-9709-4b93-a647-af50496e139e admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:51.714251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae14ae5-9709-4b93-a647-af50496e139e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:51.716182 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-cae14ae5-9709-4b93-a647-af50496e139e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:54:51.716182 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 00:54:51.716182 n-d-master-1 devstack@keystone.service[81853]: Oct 02 00:54:51.717398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae14ae5-9709-4b93-a647-af50496e139e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:51.774226 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 746/1497] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 00:54:51 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:54:51.778964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cd201-407b-4ea4-8ea2-7fac7be998a6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:51.780520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d76cd201-407b-4ea4-8ea2-7fac7be998a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:51.819895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cd201-407b-4ea4-8ea2-7fac7be998a6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:51.915113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d889be7-dae0-4998-93cc-b49b4e222a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:51.915718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d889be7-dae0-4998-93cc-b49b4e222a09 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:51.915993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d889be7-dae0-4998-93cc-b49b4e222a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:51.916260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d889be7-dae0-4998-93cc-b49b4e222a09 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:51.916905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d889be7-dae0-4998-93cc-b49b4e222a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:51.917908 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-7d889be7-dae0-4998-93cc-b49b4e222a09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:54:51.917908 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 00:54:51.917908 n-d-master-1 devstack@keystone.service[81854]: Oct 02 00:54:51.919136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d889be7-dae0-4998-93cc-b49b4e222a09 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:51.962936 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 752/1498] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 00:54:51 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 00:54:51.966992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae14ae5-9709-4b93-a647-af50496e139e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:51.968498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cae14ae5-9709-4b93-a647-af50496e139e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:52.031922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae14ae5-9709-4b93-a647-af50496e139e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:52.117205 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:52.129053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0e83d-b7aa-4330-b235-5de3a80928bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:52.129682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0e83d-b7aa-4330-b235-5de3a80928bb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:52.129958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0e83d-b7aa-4330-b235-5de3a80928bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:52.130245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0e83d-b7aa-4330-b235-5de3a80928bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:52.130933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0e83d-b7aa-4330-b235-5de3a80928bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:52.131935 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-9bd0e83d-b7aa-4330-b235-5de3a80928bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:54:52.131935 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 00:54:52.131935 n-d-master-1 devstack@keystone.service[81853]: Oct 02 00:54:52.132825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0e83d-b7aa-4330-b235-5de3a80928bb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:52.146827 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 747/1499] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 00:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:54:52.150937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d889be7-dae0-4998-93cc-b49b4e222a09 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:52.152460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7d889be7-dae0-4998-93cc-b49b4e222a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:52.164602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d889be7-dae0-4998-93cc-b49b4e222a09 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:52.190123 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:52.259409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b625b-fe32-48d1-9898-6e3c2e986361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:52.260017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b625b-fe32-48d1-9898-6e3c2e986361 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:52.260296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b625b-fe32-48d1-9898-6e3c2e986361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:52.260567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b625b-fe32-48d1-9898-6e3c2e986361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:52.261204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b625b-fe32-48d1-9898-6e3c2e986361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:52.262222 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-e61b625b-fe32-48d1-9898-6e3c2e986361 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:54:52.262222 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 00:54:52.262222 n-d-master-1 devstack@keystone.service[81854]: Oct 02 00:54:52.263139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b625b-fe32-48d1-9898-6e3c2e986361 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:52.275615 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 753/1500] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 00:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 00:54:52.279760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0e83d-b7aa-4330-b235-5de3a80928bb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:52.281800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9bd0e83d-b7aa-4330-b235-5de3a80928bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:52.314685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0e83d-b7aa-4330-b235-5de3a80928bb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:52.407352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98139e1d-ab4c-47d1-8007-f7f34e976bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:52.407992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98139e1d-ab4c-47d1-8007-f7f34e976bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:52.408267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98139e1d-ab4c-47d1-8007-f7f34e976bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:52.408534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98139e1d-ab4c-47d1-8007-f7f34e976bb5 admin admin] PATH_INFO: `/v3/projects/60698605f2f24fcdbadeb6293a55e6a9/users/84d4a235071d4d6794efd38e1ce71315/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:52.432558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98139e1d-ab4c-47d1-8007-f7f34e976bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60698605f2f24fcdbadeb6293a55e6a9, user_id=84d4a235071d4d6794efd38e1ce71315, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:52.433692 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-98139e1d-ab4c-47d1-8007-f7f34e976bb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:54:52.433692 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 00:54:52.433692 n-d-master-1 devstack@keystone.service[81853]: Oct 02 00:54:52.436153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98139e1d-ab4c-47d1-8007-f7f34e976bb5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:52.461207 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 748/1501] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 00:54:52 2022] PUT /identity/v3/projects/60698605f2f24fcdbadeb6293a55e6a9/users/84d4a235071d4d6794efd38e1ce71315/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:54:52.474920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66cd0-e3f4-4635-9605-22ef241e3ba6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:52.475257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66cd0-e3f4-4635-9605-22ef241e3ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:52.475532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66cd0-e3f4-4635-9605-22ef241e3ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:52.534793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-20c66cd0-e3f4-4635-9605-22ef241e3ba6 None None] MFA Rules not processed for user `84d4a235071d4d6794efd38e1ce71315`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:52.536021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20c66cd0-e3f4-4635-9605-22ef241e3ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:52.629608 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 754/1502] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 00:54:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:52.643749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d3b94-e72c-46f3-89c0-650befe30217 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:52.644040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d3b94-e72c-46f3-89c0-650befe30217 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:52.644320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d3b94-e72c-46f3-89c0-650befe30217 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:52.645690 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 749/1503] 10.222.0.23 () {54 vars in 963 bytes} [Sun Oct 2 00:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:54:52.650761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce17bc-5ca0-4656-88ba-1883bd368655 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:52.651044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce17bc-5ca0-4656-88ba-1883bd368655 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:52.651317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce17bc-5ca0-4656-88ba-1883bd368655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:52.684078 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:52.732371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f1ce17bc-5ca0-4656-88ba-1883bd368655 None None] MFA Rules not processed for user `c62cd9bcc90e4d6685c5d0fc1d8ceae3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:52.733527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f1ce17bc-5ca0-4656-88ba-1883bd368655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:52.814020 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 755/1504] 10.222.0.23 () {58 vars in 1060 bytes} [Sun Oct 2 00:54:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:52.821709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d3b94-e72c-46f3-89c0-650befe30217 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:52.823265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e45d3b94-e72c-46f3-89c0-650befe30217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:52.881334 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:52.934452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d3b94-e72c-46f3-89c0-650befe30217 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:53.007851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040410f-7b51-427f-8877-1ab54967617a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:53.008384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040410f-7b51-427f-8877-1ab54967617a service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:53.008661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040410f-7b51-427f-8877-1ab54967617a service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:53.008933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040410f-7b51-427f-8877-1ab54967617a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:53.010517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1040410f-7b51-427f-8877-1ab54967617a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:53.108544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040410f-7b51-427f-8877-1ab54967617a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:53.110362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040410f-7b51-427f-8877-1ab54967617a service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:53.113820 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:53.130216 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 750/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:54:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:54:53.179926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1553a-27cf-4ded-88cf-1b9804852498 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:53.180346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1553a-27cf-4ded-88cf-1b9804852498 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:53.180451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1553a-27cf-4ded-88cf-1b9804852498 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:53.181711 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 756/1506] 10.222.0.23 () {52 vars in 830 bytes} [Sun Oct 2 00:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:54:53.185359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040410f-7b51-427f-8877-1ab54967617a service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:53.186553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1040410f-7b51-427f-8877-1ab54967617a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:53.285566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040410f-7b51-427f-8877-1ab54967617a service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:53.380561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:53.381261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:53.381438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:53.381705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] PATH_INFO: `/v3/users/84d4a235071d4d6794efd38e1ce71315` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:53.394292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d4a235071d4d6794efd38e1ce71315)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:53.395335 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:54:53.395335 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 00:54:53.395335 n-d-master-1 devstack@keystone.service[81853]: Oct 02 00:54:53.396550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:53.405974 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:53.465400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d4a235071d4d6794efd38e1ce71315'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:54:53.488086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d4a235071d4d6794efd38e1ce71315'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:54:53.488535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d4a235071d4d6794efd38e1ce71315'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:54:53.498856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d4a235071d4d6794efd38e1ce71315'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:54:53.499419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d4a235071d4d6794efd38e1ce71315'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:54:53.519300 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 751/1507] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 00:54:53 2022] DELETE /identity/v3/users/84d4a235071d4d6794efd38e1ce71315 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:54:53.523646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4286-38eb-4cf7-bdca-a71375bc482c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:53.523927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4286-38eb-4cf7-bdca-a71375bc482c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:53.524196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4286-38eb-4cf7-bdca-a71375bc482c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:53.580707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5afe4286-38eb-4cf7-bdca-a71375bc482c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:54:53.581814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5afe4286-38eb-4cf7-bdca-a71375bc482c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:53.657394 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:53.670590 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 757/1508] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 00:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:54:53.681061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:53.682278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:53.780867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46916369-0d21-4d89-9832-a8088de61b4a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:53.837323 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:53.861537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e339d9-9d89-4bfa-9ac8-eaa26bf89f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:53.862142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e339d9-9d89-4bfa-9ac8-eaa26bf89f6b service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:53.862423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e339d9-9d89-4bfa-9ac8-eaa26bf89f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:53.862730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e339d9-9d89-4bfa-9ac8-eaa26bf89f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:53.864324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-95e339d9-9d89-4bfa-9ac8-eaa26bf89f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:53.975545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e339d9-9d89-4bfa-9ac8-eaa26bf89f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:53.977027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e339d9-9d89-4bfa-9ac8-eaa26bf89f6b service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:53.995141 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 752/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:54:54.354838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe4286-38eb-4cf7-bdca-a71375bc482c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:54:54.356057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5afe4286-38eb-4cf7-bdca-a71375bc482c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:54:54.367634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe4286-38eb-4cf7-bdca-a71375bc482c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:54:54.475279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:54:54.475910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:54:54.476189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:54:54.476463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] PATH_INFO: `/v3/projects/60698605f2f24fcdbadeb6293a55e6a9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:54:54.486998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60698605f2f24fcdbadeb6293a55e6a9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:54:54.488039 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 00:54:54.488039 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 00:54:54.488039 n-d-master-1 devstack@keystone.service[81854]: Oct 02 00:54:54.489247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:54:54.547526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60698605f2f24fcdbadeb6293a55e6a9', 'request_id': 'req-5ad31143-37ad-4793-afc6-2441e4125603'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:54:54.553940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60698605f2f24fcdbadeb6293a55e6a9', 'request_id': 'req-5ad31143-37ad-4793-afc6-2441e4125603'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:54:54.568186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60698605f2f24fcdbadeb6293a55e6a9', 'request_id': 'req-5ad31143-37ad-4793-afc6-2441e4125603'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:54:54.594620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] The token cache is being invalidate because project 60698605f2f24fcdbadeb6293a55e6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 00:54:54.594912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:54:54.595431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ad31143-37ad-4793-afc6-2441e4125603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 00:54:54.596789 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 758/1510] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 00:54:54 2022] DELETE /identity/v3/projects/60698605f2f24fcdbadeb6293a55e6a9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 00:55:03.992881 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=62 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:04.591956 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:15.071042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ff11-b832-4590-9c02-f08503834510 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:15.071640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ff11-b832-4590-9c02-f08503834510 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:15.071640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ff11-b832-4590-9c02-f08503834510 None None] PATH_INFO: `/v3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:15.072855 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 753/1511] 10.222.0.40 () {54 vars in 925 bytes} [Sun Oct 2 00:58:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:58:15.079635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4beadb-4055-4371-a2e0-46c850e4494c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:15.080050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4beadb-4055-4371-a2e0-46c850e4494c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:15.080183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4beadb-4055-4371-a2e0-46c850e4494c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:15.160533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ec4beadb-4055-4371-a2e0-46c850e4494c None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:15.161658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ec4beadb-4055-4371-a2e0-46c850e4494c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:15.273242 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 759/1512] 10.222.0.40 () {58 vars in 1015 bytes} [Sun Oct 2 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:17.006635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e67f0-1be0-46fb-9bd2-8426ac8721bb None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:17.007081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e67f0-1be0-46fb-9bd2-8426ac8721bb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:17.007271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e67f0-1be0-46fb-9bd2-8426ac8721bb None None] PATH_INFO: `/v3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:17.008550 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 754/1513] 10.222.0.13 () {54 vars in 925 bytes} [Sun Oct 2 00:58:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 00:58:17.014351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489acf5-e14d-42a5-be2d-bf3bbcb593bb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:17.014886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489acf5-e14d-42a5-be2d-bf3bbcb593bb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:17.014993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489acf5-e14d-42a5-be2d-bf3bbcb593bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:17.035024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6489acf5-e14d-42a5-be2d-bf3bbcb593bb None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:17.036206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6489acf5-e14d-42a5-be2d-bf3bbcb593bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:17.044626 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 760/1514] 10.222.0.13 () {58 vars in 1015 bytes} [Sun Oct 2 00:58:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:23.637840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363aab5-cf2e-4a35-ab28-56d92497c0a4 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:23.638379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363aab5-cf2e-4a35-ab28-56d92497c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:23.638580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363aab5-cf2e-4a35-ab28-56d92497c0a4 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:23.640672 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 755/1515] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 2 00:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:58:23.646674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5f15a-b170-4483-9fd4-c62ee120ccb2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:23.647177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5f15a-b170-4483-9fd4-c62ee120ccb2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:23.647291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5f15a-b170-4483-9fd4-c62ee120ccb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:23.667002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8ff5f15a-b170-4483-9fd4-c62ee120ccb2 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:23.668206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8ff5f15a-b170-4483-9fd4-c62ee120ccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:23.677140 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 761/1516] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 2 00:58:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:23.684860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363aab5-cf2e-4a35-ab28-56d92497c0a4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:23.695545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a3ef-3628-48e3-8824-cdb65dd4ffcc None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:23.695847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a3ef-3628-48e3-8824-cdb65dd4ffcc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:23.696102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a3ef-3628-48e3-8824-cdb65dd4ffcc None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:23.697492 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 762/1517] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 2 00:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:58:23.699779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363aab5-cf2e-4a35-ab28-56d92497c0a4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:23.702494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca6d1-924b-4f4d-9eb1-51d90d63ef80 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:23.702823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca6d1-924b-4f4d-9eb1-51d90d63ef80 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:23.703103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca6d1-924b-4f4d-9eb1-51d90d63ef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:23.706138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410bbb5-5f9e-4161-820f-8047bb9b5435 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:23.706774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410bbb5-5f9e-4161-820f-8047bb9b5435 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:23.707118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410bbb5-5f9e-4161-820f-8047bb9b5435 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:23.707336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410bbb5-5f9e-4161-820f-8047bb9b5435 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:23.717927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410bbb5-5f9e-4161-820f-8047bb9b5435 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:23.719559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410bbb5-5f9e-4161-820f-8047bb9b5435 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:23.722753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e22ca6d1-924b-4f4d-9eb1-51d90d63ef80 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:23.723938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e22ca6d1-924b-4f4d-9eb1-51d90d63ef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:23.729192 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 756/1518] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:23.733146 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 763/1519] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 2 00:58:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:58:23.741297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410bbb5-5f9e-4161-820f-8047bb9b5435 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:23.751920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410bbb5-5f9e-4161-820f-8047bb9b5435 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:23.757831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4009f03-b264-475b-ade1-e32078c2e8fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:23.758486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4009f03-b264-475b-ade1-e32078c2e8fb service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:23.758798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4009f03-b264-475b-ade1-e32078c2e8fb service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:23.759127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4009f03-b264-475b-ade1-e32078c2e8fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:23.768067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4009f03-b264-475b-ade1-e32078c2e8fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:23.769773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4009f03-b264-475b-ade1-e32078c2e8fb service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:23.779466 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 757/1520] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:33.717076 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:33.775497 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=12 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:45.543890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bef78-35f2-4873-9b0f-c748d4856eca None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:45.544485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bef78-35f2-4873-9b0f-c748d4856eca None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:45.544485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bef78-35f2-4873-9b0f-c748d4856eca None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:45.545800 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 764/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:58:45.551483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61073b9f-6e4c-4842-9cdc-67c0c6f4ff14 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:45.551934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61073b9f-6e4c-4842-9cdc-67c0c6f4ff14 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:45.552095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61073b9f-6e4c-4842-9cdc-67c0c6f4ff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:45.611976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-61073b9f-6e4c-4842-9cdc-67c0c6f4ff14 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:45.613082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-61073b9f-6e4c-4842-9cdc-67c0c6f4ff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:45.690075 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 758/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:45.844825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bef78-35f2-4873-9b0f-c748d4856eca None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:45.846578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fc8bef78-35f2-4873-9b0f-c748d4856eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:45.949198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bef78-35f2-4873-9b0f-c748d4856eca None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:45.956226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e3c81-95e9-467c-bbba-f8f01de61de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:45.956831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e3c81-95e9-467c-bbba-f8f01de61de4 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:45.957111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e3c81-95e9-467c-bbba-f8f01de61de4 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:45.957384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e3c81-95e9-467c-bbba-f8f01de61de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:45.965688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e3c81-95e9-467c-bbba-f8f01de61de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:45.967331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e3c81-95e9-467c-bbba-f8f01de61de4 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:45.978096 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 765/1523] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:47.062820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435abd0-943a-465a-9d5e-d1e53dc85290 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:47.063449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435abd0-943a-465a-9d5e-d1e53dc85290 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:47.063449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435abd0-943a-465a-9d5e-d1e53dc85290 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:47.064692 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 759/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 2 00:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 02 00:58:47.070784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533e513-e51c-45b8-891c-a2c59ac10c11 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:47.071222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533e513-e51c-45b8-891c-a2c59ac10c11 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:47.071397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533e513-e51c-45b8-891c-a2c59ac10c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:47.092730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7533e513-e51c-45b8-891c-a2c59ac10c11 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:47.093834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7533e513-e51c-45b8-891c-a2c59ac10c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:47.101445 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 766/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 2 00:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:47.253077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435abd0-943a-465a-9d5e-d1e53dc85290 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:47.267771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435abd0-943a-465a-9d5e-d1e53dc85290 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:47.273074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b599350-870c-4e52-9425-339420ada13c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:47.273657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599350-870c-4e52-9425-339420ada13c service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:47.273939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599350-870c-4e52-9425-339420ada13c service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:47.274211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599350-870c-4e52-9425-339420ada13c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:47.283070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b599350-870c-4e52-9425-339420ada13c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:47.284639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b599350-870c-4e52-9425-339420ada13c service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:47.293646 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 760/1526] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:51.246104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad456c-79e8-40c2-8888-b06ffa5d3b31 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:51.246678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad456c-79e8-40c2-8888-b06ffa5d3b31 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:51.246678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad456c-79e8-40c2-8888-b06ffa5d3b31 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:51.248003 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 767/1527] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:58:51.253314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1c868-df64-415f-b0b3-62bf872b0d84 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:51.253747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1c868-df64-415f-b0b3-62bf872b0d84 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:51.253895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1c868-df64-415f-b0b3-62bf872b0d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:51.273359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-12c1c868-df64-415f-b0b3-62bf872b0d84 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:51.274531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-12c1c868-df64-415f-b0b3-62bf872b0d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:51.282961 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 761/1528] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:51.578145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad456c-79e8-40c2-8888-b06ffa5d3b31 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:51.580008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7ad456c-79e8-40c2-8888-b06ffa5d3b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:51.659527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad456c-79e8-40c2-8888-b06ffa5d3b31 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:51.663129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac00768-55fa-45d6-b3b6-93cf458a06fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:51.663733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac00768-55fa-45d6-b3b6-93cf458a06fc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:51.664018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac00768-55fa-45d6-b3b6-93cf458a06fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:51.664298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac00768-55fa-45d6-b3b6-93cf458a06fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:51.674233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac00768-55fa-45d6-b3b6-93cf458a06fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:51.675747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac00768-55fa-45d6-b3b6-93cf458a06fc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:51.686069 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 768/1529] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:58:53.863265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff255172-be06-4629-af60-2332573b2ee1 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:53.863874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff255172-be06-4629-af60-2332573b2ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:53.863874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff255172-be06-4629-af60-2332573b2ee1 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:53.865156 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 762/1530] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 2 00:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:58:53.870525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b8169-96c9-4575-a7d5-d632085ddaf4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:53.870992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b8169-96c9-4575-a7d5-d632085ddaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:53.871110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b8169-96c9-4575-a7d5-d632085ddaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:53.891401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5e6b8169-96c9-4575-a7d5-d632085ddaf4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:58:53.892629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5e6b8169-96c9-4575-a7d5-d632085ddaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:53.900345 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 769/1531] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 2 00:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 00:58:54.185788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff255172-be06-4629-af60-2332573b2ee1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 00:58:54.188064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ff255172-be06-4629-af60-2332573b2ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:58:54.200607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff255172-be06-4629-af60-2332573b2ee1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 00:58:54.204173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db0d38-d1ff-4dbc-ab5d-f5adf988e7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 00:58:54.204754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0d38-d1ff-4dbc-ab5d-f5adf988e7ab service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:58:54.205029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0d38-d1ff-4dbc-ab5d-f5adf988e7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:58:54.205300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0d38-d1ff-4dbc-ab5d-f5adf988e7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:58:54.214468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db0d38-d1ff-4dbc-ab5d-f5adf988e7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 00:58:54.215943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db0d38-d1ff-4dbc-ab5d-f5adf988e7ab service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 00:58:54.225234 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 763/1532] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 00:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 00:59:03.885870 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:04.221034 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=65 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:45.439565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f8900-36ca-49cc-b6b5-70791f84ddd5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:45.440071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f8900-36ca-49cc-b6b5-70791f84ddd5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:45.440142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f8900-36ca-49cc-b6b5-70791f84ddd5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:45.441439 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 770/1533] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 00:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 00:59:45.446934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1d98-b192-42a0-8da9-72bd219350b3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 00:59:45.447351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1d98-b192-42a0-8da9-72bd219350b3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 00:59:45.447478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1d98-b192-42a0-8da9-72bd219350b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 00:59:45.466942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3a7e1d98-b192-42a0-8da9-72bd219350b3 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 00:59:45.468118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3a7e1d98-b192-42a0-8da9-72bd219350b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 00:59:45.477166 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 764/1534] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 00:59:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 00:59:55.462141 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:17.372198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064b5ea-db75-4ee2-85dd-37adca6d8db9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:17.372793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064b5ea-db75-4ee2-85dd-37adca6d8db9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:17.372793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064b5ea-db75-4ee2-85dd-37adca6d8db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:17.396151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b064b5ea-db75-4ee2-85dd-37adca6d8db9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:17.397363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b064b5ea-db75-4ee2-85dd-37adca6d8db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:17.409927 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 771/1535] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:17.428397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2bf2-7ed8-43b9-853c-7043403651ac None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:17.428969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2bf2-7ed8-43b9-853c-7043403651ac None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:17.428969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2bf2-7ed8-43b9-853c-7043403651ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:17.470504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5e4c2bf2-7ed8-43b9-853c-7043403651ac None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:17.472308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5e4c2bf2-7ed8-43b9-853c-7043403651ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:17.490625 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 765/1536] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:00:17.493313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064b5ea-db75-4ee2-85dd-37adca6d8db9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:17.513274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064b5ea-db75-4ee2-85dd-37adca6d8db9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:17.523343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9edd1f-e98f-4884-9b4a-ae1e53b5466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:17.523981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9edd1f-e98f-4884-9b4a-ae1e53b5466e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:17.524313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9edd1f-e98f-4884-9b4a-ae1e53b5466e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:17.524594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9edd1f-e98f-4884-9b4a-ae1e53b5466e admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:17.525313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9edd1f-e98f-4884-9b4a-ae1e53b5466e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:17.525618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9edd1f-e98f-4884-9b4a-ae1e53b5466e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:17.527353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9edd1f-e98f-4884-9b4a-ae1e53b5466e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:17.552432 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 772/1537] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:17.561728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c2bf2-7ed8-43b9-853c-7043403651ac None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:17.580623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacffcd-ea07-44d0-a3b8-3d31e9adcbd1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:17.581004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacffcd-ea07-44d0-a3b8-3d31e9adcbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:17.581226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacffcd-ea07-44d0-a3b8-3d31e9adcbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:17.582536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c2bf2-7ed8-43b9-853c-7043403651ac None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:17.597270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73c7b8-fab7-48c6-a92f-3ba3a2e224f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:17.598317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73c7b8-fab7-48c6-a92f-3ba3a2e224f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:17.598944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73c7b8-fab7-48c6-a92f-3ba3a2e224f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:17.599425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73c7b8-fab7-48c6-a92f-3ba3a2e224f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:17.600268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73c7b8-fab7-48c6-a92f-3ba3a2e224f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:17.602935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73c7b8-fab7-48c6-a92f-3ba3a2e224f2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:17.618266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ddacffcd-ea07-44d0-a3b8-3d31e9adcbd1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:17.619635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ddacffcd-ea07-44d0-a3b8-3d31e9adcbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:17.640595 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 773/1538] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:17.648997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad002f4-2194-41d3-a7ad-8cd64b6e6bf3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:17.649289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad002f4-2194-41d3-a7ad-8cd64b6e6bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:17.649568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad002f4-2194-41d3-a7ad-8cd64b6e6bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:17.695725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1ad002f4-2194-41d3-a7ad-8cd64b6e6bf3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:17.697067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ad002f4-2194-41d3-a7ad-8cd64b6e6bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:17.714668 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 774/1540] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:17.714884 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 766/1540] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:17 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:17.718912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad002f4-2194-41d3-a7ad-8cd64b6e6bf3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:17.724195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73c7b8-fab7-48c6-a92f-3ba3a2e224f2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:17.738113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad002f4-2194-41d3-a7ad-8cd64b6e6bf3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:17.890335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530b26c-c78d-4414-88a9-193f66ff9b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:17.891012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530b26c-c78d-4414-88a9-193f66ff9b28 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:17.891230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530b26c-c78d-4414-88a9-193f66ff9b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:17.891506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530b26c-c78d-4414-88a9-193f66ff9b28 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:17.892195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530b26c-c78d-4414-88a9-193f66ff9b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:17.894305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530b26c-c78d-4414-88a9-193f66ff9b28 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:17.919588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73c7b8-fab7-48c6-a92f-3ba3a2e224f2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:17.939824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd19a5d-134f-4ae5-9f03-a83f6fb7b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:17.940458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd19a5d-134f-4ae5-9f03-a83f6fb7b98a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:17.940740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd19a5d-134f-4ae5-9f03-a83f6fb7b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:17.941071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd19a5d-134f-4ae5-9f03-a83f6fb7b98a admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:17.941741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd19a5d-134f-4ae5-9f03-a83f6fb7b98a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:17.942048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd19a5d-134f-4ae5-9f03-a83f6fb7b98a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:17.945722 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 775/1541] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:17 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:17.947668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d293-a655-4191-b045-3013ca04575b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:17.947965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d293-a655-4191-b045-3013ca04575b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:17.948243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d293-a655-4191-b045-3013ca04575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:17.951740 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-7fd19a5d-134f-4ae5-9f03-a83f6fb7b98a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:00:17.951740 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:00:17.951740 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:00:17.952674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd19a5d-134f-4ae5-9f03-a83f6fb7b98a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:17.981350 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 767/1542] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:17.983765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272069d-3a90-471f-ad6a-2e81740d2f35 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:17.984055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272069d-3a90-471f-ad6a-2e81740d2f35 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:17.984333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272069d-3a90-471f-ad6a-2e81740d2f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:17.993575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f025d293-a655-4191-b045-3013ca04575b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:17.994825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f025d293-a655-4191-b045-3013ca04575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.019989 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 776/1543] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.020847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d293-a655-4191-b045-3013ca04575b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.036017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5272069d-3a90-471f-ad6a-2e81740d2f35 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.040664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5272069d-3a90-471f-ad6a-2e81740d2f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.043956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d293-a655-4191-b045-3013ca04575b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.060009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f608cc6-1a1f-494f-be01-80d22b37fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.060646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f608cc6-1a1f-494f-be01-80d22b37fb88 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.062849 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 768/1544] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.063493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272069d-3a90-471f-ad6a-2e81740d2f35 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.064354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f608cc6-1a1f-494f-be01-80d22b37fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.064647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f608cc6-1a1f-494f-be01-80d22b37fb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.065309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f608cc6-1a1f-494f-be01-80d22b37fb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.066975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f608cc6-1a1f-494f-be01-80d22b37fb88 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.083531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272069d-3a90-471f-ad6a-2e81740d2f35 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.094147 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 777/1545] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:18.095830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e69b5a-bd67-407b-8aad-bc900fb3d656 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.096124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e69b5a-bd67-407b-8aad-bc900fb3d656 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.096397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e69b5a-bd67-407b-8aad-bc900fb3d656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.109975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479e1a-6729-4d7f-9ce4-f5826f9ec026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.110626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479e1a-6729-4d7f-9ce4-f5826f9ec026 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.110956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479e1a-6729-4d7f-9ce4-f5826f9ec026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.111719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479e1a-6729-4d7f-9ce4-f5826f9ec026 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.112368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7479e1a-6729-4d7f-9ce4-f5826f9ec026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.114291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7479e1a-6729-4d7f-9ce4-f5826f9ec026 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.151746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-25e69b5a-bd67-407b-8aad-bc900fb3d656 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.153453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-25e69b5a-bd67-407b-8aad-bc900fb3d656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.170760 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 778/1546] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.172456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22721655-d520-4b3f-aba0-6f16b59ba6bd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.172744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22721655-d520-4b3f-aba0-6f16b59ba6bd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.173412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22721655-d520-4b3f-aba0-6f16b59ba6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.179111 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 769/1547] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:18.179935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479e1a-6729-4d7f-9ce4-f5826f9ec026 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.196332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-22721655-d520-4b3f-aba0-6f16b59ba6bd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.197571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-22721655-d520-4b3f-aba0-6f16b59ba6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.259403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479e1a-6729-4d7f-9ce4-f5826f9ec026 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.267472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6277f-f1d4-40e9-8e6b-eb125803c31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.268090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6277f-f1d4-40e9-8e6b-eb125803c31c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.269362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6277f-f1d4-40e9-8e6b-eb125803c31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.269362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6277f-f1d4-40e9-8e6b-eb125803c31c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.269362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6277f-f1d4-40e9-8e6b-eb125803c31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.272692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6277f-f1d4-40e9-8e6b-eb125803c31c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.274425 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 779/1548] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.275828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c7d0e-433b-49f9-82ea-757e29a445f1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.276108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c7d0e-433b-49f9-82ea-757e29a445f1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.276380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c7d0e-433b-49f9-82ea-757e29a445f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.288429 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 770/1549] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:18.292779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1cf7d-7b3f-4857-abf4-7a07e0b3161e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.292779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1cf7d-7b3f-4857-abf4-7a07e0b3161e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.292779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1cf7d-7b3f-4857-abf4-7a07e0b3161e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.299336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-106c7d0e-433b-49f9-82ea-757e29a445f1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.300699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-106c7d0e-433b-49f9-82ea-757e29a445f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.309172 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 780/1550] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.309826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c7d0e-433b-49f9-82ea-757e29a445f1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.312680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-19f1cf7d-7b3f-4857-abf4-7a07e0b3161e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.313913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-19f1cf7d-7b3f-4857-abf4-7a07e0b3161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.319960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c7d0e-433b-49f9-82ea-757e29a445f1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.324304 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 771/1551] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.324484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c27053-88ca-4a7a-af34-36dfbe21db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.325091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27053-88ca-4a7a-af34-36dfbe21db6a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.325370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27053-88ca-4a7a-af34-36dfbe21db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.325643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef0fe-dbf9-4e09-bcde-22556affa32b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.325744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27053-88ca-4a7a-af34-36dfbe21db6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.325930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef0fe-dbf9-4e09-bcde-22556affa32b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.326203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef0fe-dbf9-4e09-bcde-22556affa32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.326296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c27053-88ca-4a7a-af34-36dfbe21db6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:18.326581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c27053-88ca-4a7a-af34-36dfbe21db6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.328207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c27053-88ca-4a7a-af34-36dfbe21db6a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.341338 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 781/1552] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:18.341984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c27053-88ca-4a7a-af34-36dfbe21db6a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.347044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e5cef0fe-dbf9-4e09-bcde-22556affa32b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.348412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e5cef0fe-dbf9-4e09-bcde-22556affa32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.352449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c27053-88ca-4a7a-af34-36dfbe21db6a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.356461 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 772/1553] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.357608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682ea01-3a95-4dc2-b5a4-53de0bff283b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.357898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682ea01-3a95-4dc2-b5a4-53de0bff283b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.358167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682ea01-3a95-4dc2-b5a4-53de0bff283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.359268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c39df-d856-4cd0-a9ee-317106da09d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.359870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c39df-d856-4cd0-a9ee-317106da09d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.360153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c39df-d856-4cd0-a9ee-317106da09d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.360430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c39df-d856-4cd0-a9ee-317106da09d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.361249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c39df-d856-4cd0-a9ee-317106da09d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.363234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c39df-d856-4cd0-a9ee-317106da09d5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.374896 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:18.382105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b682ea01-3a95-4dc2-b5a4-53de0bff283b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.383339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b682ea01-3a95-4dc2-b5a4-53de0bff283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.388703 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 782/1554] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/users => generated 291 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:18.389585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c39df-d856-4cd0-a9ee-317106da09d5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.395140 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 773/1555] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.395943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682ea01-3a95-4dc2-b5a4-53de0bff283b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.401648 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:18.405851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682ea01-3a95-4dc2-b5a4-53de0bff283b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.407623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c39df-d856-4cd0-a9ee-317106da09d5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.413380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbef2e-c1a8-4633-97ea-892ce2154686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.413557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e2418-3c96-4fbf-8fd9-9abed8e62255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.413982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2418-3c96-4fbf-8fd9-9abed8e62255 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.414079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbef2e-c1a8-4633-97ea-892ce2154686 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.414263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2418-3c96-4fbf-8fd9-9abed8e62255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.414363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbef2e-c1a8-4633-97ea-892ce2154686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.414534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2418-3c96-4fbf-8fd9-9abed8e62255 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.414648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbef2e-c1a8-4633-97ea-892ce2154686 admin admin] PATH_INFO: `/v3/projects/a209e01efa3c4475bdbaea702bbdff5d/users/cfe9e4faf02d40e9bab7cae55a286a5c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.415210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e2418-3c96-4fbf-8fd9-9abed8e62255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:18.415514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e2418-3c96-4fbf-8fd9-9abed8e62255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.417187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e2418-3c96-4fbf-8fd9-9abed8e62255 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.429513 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 783/1556] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:18.429660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbef2e-c1a8-4633-97ea-892ce2154686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a209e01efa3c4475bdbaea702bbdff5d, user_id=cfe9e4faf02d40e9bab7cae55a286a5c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.430838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275d40-1101-4990-bfa3-7daf47b92149 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.431124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275d40-1101-4990-bfa3-7daf47b92149 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.431398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275d40-1101-4990-bfa3-7daf47b92149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.432478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbef2e-c1a8-4633-97ea-892ce2154686 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.447141 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 774/1557] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:18 2022] PUT /identity/v3/projects/a209e01efa3c4475bdbaea702bbdff5d/users/cfe9e4faf02d40e9bab7cae55a286a5c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:18.448451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b5946-aa1b-4fa0-8b18-ef6452a67a0d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.448738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b5946-aa1b-4fa0-8b18-ef6452a67a0d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.449016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b5946-aa1b-4fa0-8b18-ef6452a67a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.460135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4c275d40-1101-4990-bfa3-7daf47b92149 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.461354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4c275d40-1101-4990-bfa3-7daf47b92149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.468826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-015b5946-aa1b-4fa0-8b18-ef6452a67a0d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.470024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-015b5946-aa1b-4fa0-8b18-ef6452a67a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.520134 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 784/1558] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.524600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c275d40-1101-4990-bfa3-7daf47b92149 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.529436 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 775/1559] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.530676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20416-8ac6-478e-ad22-8f96346026b3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.530966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20416-8ac6-478e-ad22-8f96346026b3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.531242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20416-8ac6-478e-ad22-8f96346026b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.538345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c275d40-1101-4990-bfa3-7daf47b92149 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.542902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef19ad2-4829-4902-a623-c9a018db86bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.543502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef19ad2-4829-4902-a623-c9a018db86bb admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.543777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef19ad2-4829-4902-a623-c9a018db86bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.544044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef19ad2-4829-4902-a623-c9a018db86bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.544668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef19ad2-4829-4902-a623-c9a018db86bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.545674 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-5ef19ad2-4829-4902-a623-c9a018db86bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:00:18.545674 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:00:18.545674 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:00:18.546887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef19ad2-4829-4902-a623-c9a018db86bb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.550968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-22f20416-8ac6-478e-ad22-8f96346026b3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.552160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-22f20416-8ac6-478e-ad22-8f96346026b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.560159 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 776/1560] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.560772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20416-8ac6-478e-ad22-8f96346026b3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.570928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20416-8ac6-478e-ad22-8f96346026b3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.575735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24497920-9404-4f04-9cb5-71923ce7b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.576326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24497920-9404-4f04-9cb5-71923ce7b20c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.576606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24497920-9404-4f04-9cb5-71923ce7b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.576881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24497920-9404-4f04-9cb5-71923ce7b20c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.577515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24497920-9404-4f04-9cb5-71923ce7b20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.581999 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 785/1561] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:18.582167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24497920-9404-4f04-9cb5-71923ce7b20c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.582255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33560c85-d819-48c5-b765-8fd501f39c85 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.582255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33560c85-d819-48c5-b765-8fd501f39c85 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.582255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33560c85-d819-48c5-b765-8fd501f39c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.593092 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 777/1562] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:18.593092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24497920-9404-4f04-9cb5-71923ce7b20c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.602295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-33560c85-d819-48c5-b765-8fd501f39c85 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.603270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24497920-9404-4f04-9cb5-71923ce7b20c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.603522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-33560c85-d819-48c5-b765-8fd501f39c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.658806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79fdf9-65d5-4307-830a-4aa7e6300c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.659332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79fdf9-65d5-4307-830a-4aa7e6300c35 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.659616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79fdf9-65d5-4307-830a-4aa7e6300c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.659889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79fdf9-65d5-4307-830a-4aa7e6300c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.660515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79fdf9-65d5-4307-830a-4aa7e6300c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.662454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79fdf9-65d5-4307-830a-4aa7e6300c35 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.662831 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 786/1563] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.664147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6780-05a0-40b7-a42a-a4815c20fdd6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.664564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6780-05a0-40b7-a42a-a4815c20fdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.664859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6780-05a0-40b7-a42a-a4815c20fdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.691434 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 778/1564] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:18.692494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79fdf9-65d5-4307-830a-4aa7e6300c35 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.695645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-622e6780-05a0-40b7-a42a-a4815c20fdd6 None None] MFA Rules not processed for user `cfe9e4faf02d40e9bab7cae55a286a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:18.697040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-622e6780-05a0-40b7-a42a-a4815c20fdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:18.744389 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:18.744572 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:18.759897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79fdf9-65d5-4307-830a-4aa7e6300c35 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.762822 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 787/1565] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:18.763646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e6780-05a0-40b7-a42a-a4815c20fdd6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.764659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b722e-f936-4325-a961-edaabc88f5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.765264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b722e-f936-4325-a961-edaabc88f5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.765546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b722e-f936-4325-a961-edaabc88f5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.765825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b722e-f936-4325-a961-edaabc88f5b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.766654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b722e-f936-4325-a961-edaabc88f5b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:18.766965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b722e-f936-4325-a961-edaabc88f5b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.768721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b722e-f936-4325-a961-edaabc88f5b0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.774039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e6780-05a0-40b7-a42a-a4815c20fdd6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.778848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef2fc2-daef-459d-9659-fd524966a742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.779445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2fc2-daef-459d-9659-fd524966a742 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.779723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2fc2-daef-459d-9659-fd524966a742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.779992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2fc2-daef-459d-9659-fd524966a742 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.780366 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 779/1566] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:18.780635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef2fc2-daef-459d-9659-fd524966a742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:18.780937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef2fc2-daef-459d-9659-fd524966a742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.781176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b722e-f936-4325-a961-edaabc88f5b0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.782609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef2fc2-daef-459d-9659-fd524966a742 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.791374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b722e-f936-4325-a961-edaabc88f5b0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.802840 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 788/1567] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:18.802840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef2fc2-daef-459d-9659-fd524966a742 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.803104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48181581-444e-41fc-97cf-3b6d56b6b394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.803104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48181581-444e-41fc-97cf-3b6d56b6b394 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.803104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48181581-444e-41fc-97cf-3b6d56b6b394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.803104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48181581-444e-41fc-97cf-3b6d56b6b394 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.803394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48181581-444e-41fc-97cf-3b6d56b6b394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:18.803394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48181581-444e-41fc-97cf-3b6d56b6b394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.803394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48181581-444e-41fc-97cf-3b6d56b6b394 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.806201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef2fc2-daef-459d-9659-fd524966a742 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.810742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fc269-8fe2-4d0b-a5b8-882ddf151dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.811327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc269-8fe2-4d0b-a5b8-882ddf151dbd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.811605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc269-8fe2-4d0b-a5b8-882ddf151dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.811877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc269-8fe2-4d0b-a5b8-882ddf151dbd admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.812746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fc269-8fe2-4d0b-a5b8-882ddf151dbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.820052 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 780/1568] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:18.820052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48181581-444e-41fc-97cf-3b6d56b6b394 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.820291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fc269-8fe2-4d0b-a5b8-882ddf151dbd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.825429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48181581-444e-41fc-97cf-3b6d56b6b394 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.831484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f8faf-1dad-4f28-a263-e4283e669ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.832177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f8faf-1dad-4f28-a263-e4283e669ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.832491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f8faf-1dad-4f28-a263-e4283e669ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.832763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f8faf-1dad-4f28-a263-e4283e669ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.833407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f8faf-1dad-4f28-a263-e4283e669ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.835041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f8faf-1dad-4f28-a263-e4283e669ef0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.838706 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 789/1569] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:18.839544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fc269-8fe2-4d0b-a5b8-882ddf151dbd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.847860 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 781/1570] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:18.848720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f8faf-1dad-4f28-a263-e4283e669ef0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.849587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fc269-8fe2-4d0b-a5b8-882ddf151dbd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.854130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b349ecb-0661-4138-8193-19cf8c9cb2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.854851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349ecb-0661-4138-8193-19cf8c9cb2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.855120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349ecb-0661-4138-8193-19cf8c9cb2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.855390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349ecb-0661-4138-8193-19cf8c9cb2d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.856025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b349ecb-0661-4138-8193-19cf8c9cb2d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:18.856326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b349ecb-0661-4138-8193-19cf8c9cb2d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.857953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b349ecb-0661-4138-8193-19cf8c9cb2d9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.860056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f8faf-1dad-4f28-a263-e4283e669ef0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.865238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bb79d-f926-48c6-a74b-ce820d66057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.865825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bb79d-f926-48c6-a74b-ce820d66057e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.866104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bb79d-f926-48c6-a74b-ce820d66057e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.866377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bb79d-f926-48c6-a74b-ce820d66057e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.867029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bb79d-f926-48c6-a74b-ce820d66057e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.868032 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-441bb79d-f926-48c6-a74b-ce820d66057e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:00:18.868032 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:00:18.868032 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:00:18.869253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bb79d-f926-48c6-a74b-ce820d66057e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.870369 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 790/1571] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:18.871172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b349ecb-0661-4138-8193-19cf8c9cb2d9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.881867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b349ecb-0661-4138-8193-19cf8c9cb2d9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.886696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bdba7-e593-49d9-9003-8277919ed7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.887291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bdba7-e593-49d9-9003-8277919ed7de admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.887572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bdba7-e593-49d9-9003-8277919ed7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.887869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bdba7-e593-49d9-9003-8277919ed7de admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.888593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bdba7-e593-49d9-9003-8277919ed7de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.890522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bdba7-e593-49d9-9003-8277919ed7de admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.894714 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 782/1572] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:18.894714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bb79d-f926-48c6-a74b-ce820d66057e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.902347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bb79d-f926-48c6-a74b-ce820d66057e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:18.907665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357cd38-d1f2-47ee-8f8b-73fd0a0e24b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:18.908888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357cd38-d1f2-47ee-8f8b-73fd0a0e24b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:18.909231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357cd38-d1f2-47ee-8f8b-73fd0a0e24b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:18.909492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357cd38-d1f2-47ee-8f8b-73fd0a0e24b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:18.910113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357cd38-d1f2-47ee-8f8b-73fd0a0e24b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:18.912476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357cd38-d1f2-47ee-8f8b-73fd0a0e24b4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:18.921894 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 791/1573] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:18.922723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bdba7-e593-49d9-9003-8277919ed7de admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.943463 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 783/1574] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:18.943463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357cd38-d1f2-47ee-8f8b-73fd0a0e24b4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:18.991095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bdba7-e593-49d9-9003-8277919ed7de admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.005040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357cd38-d1f2-47ee-8f8b-73fd0a0e24b4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.009610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752fa2f-07f2-47a1-b7aa-53fcbeecabfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.010209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fa2f-07f2-47a1-b7aa-53fcbeecabfd admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.010488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fa2f-07f2-47a1-b7aa-53fcbeecabfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.010792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fa2f-07f2-47a1-b7aa-53fcbeecabfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.011416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752fa2f-07f2-47a1-b7aa-53fcbeecabfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.013356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752fa2f-07f2-47a1-b7aa-53fcbeecabfd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.040571 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 784/1575] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:19.043505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752fa2f-07f2-47a1-b7aa-53fcbeecabfd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.047863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fc3cd-0312-44fe-8bb7-ecc97a7ae371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.049054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc3cd-0312-44fe-8bb7-ecc97a7ae371 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.049556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc3cd-0312-44fe-8bb7-ecc97a7ae371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.049846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc3cd-0312-44fe-8bb7-ecc97a7ae371 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.050460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fc3cd-0312-44fe-8bb7-ecc97a7ae371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.052489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fc3cd-0312-44fe-8bb7-ecc97a7ae371 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.079461 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 792/1576] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:18 2022] POST /identity/v3/projects => generated 397 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:19.084157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fc3cd-0312-44fe-8bb7-ecc97a7ae371 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.104583 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:19.109203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752fa2f-07f2-47a1-b7aa-53fcbeecabfd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.117556 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:19.149033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fc3cd-0312-44fe-8bb7-ecc97a7ae371 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.153637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98eca0-0271-47ef-a4c0-32a2b54e9eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.154294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98eca0-0271-47ef-a4c0-32a2b54e9eff admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.154569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98eca0-0271-47ef-a4c0-32a2b54e9eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.154868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98eca0-0271-47ef-a4c0-32a2b54e9eff admin admin] PATH_INFO: `/v3/projects/2593cd49763c4c02ac5f7b30b03a0366/users/ae3c3aba9b784076beb1b6713a439f78/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.167757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb78380-fc68-4fcd-b0b3-9727ef9f4bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.168646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb78380-fc68-4fcd-b0b3-9727ef9f4bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.169010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb78380-fc68-4fcd-b0b3-9727ef9f4bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.169295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb78380-fc68-4fcd-b0b3-9727ef9f4bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.169944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb78380-fc68-4fcd-b0b3-9727ef9f4bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.170671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98eca0-0271-47ef-a4c0-32a2b54e9eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2593cd49763c4c02ac5f7b30b03a0366, user_id=ae3c3aba9b784076beb1b6713a439f78, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.171578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb78380-fc68-4fcd-b0b3-9727ef9f4bcc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.171744 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-2d98eca0-0271-47ef-a4c0-32a2b54e9eff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:00:19.171744 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:00:19.171744 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:00:19.174232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98eca0-0271-47ef-a4c0-32a2b54e9eff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.188328 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 785/1577] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.190728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb78380-fc68-4fcd-b0b3-9727ef9f4bcc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.192314 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 793/1578] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:19 2022] PUT /identity/v3/projects/2593cd49763c4c02ac5f7b30b03a0366/users/ae3c3aba9b784076beb1b6713a439f78/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:19.193520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98eca0-0271-47ef-a4c0-32a2b54e9eff admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.201520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb78380-fc68-4fcd-b0b3-9727ef9f4bcc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.265031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4c9d3-83c9-4f8e-baf9-5549e7b499b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.265645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4c9d3-83c9-4f8e-baf9-5549e7b499b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.266055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4c9d3-83c9-4f8e-baf9-5549e7b499b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.266339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4c9d3-83c9-4f8e-baf9-5549e7b499b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.267008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4c9d3-83c9-4f8e-baf9-5549e7b499b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.268952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4c9d3-83c9-4f8e-baf9-5549e7b499b6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.276126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98eca0-0271-47ef-a4c0-32a2b54e9eff admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.281160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1cae6-5c76-4a19-a9ff-43a92e22951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.281778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1cae6-5c76-4a19-a9ff-43a92e22951d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.282062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1cae6-5c76-4a19-a9ff-43a92e22951d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.282337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1cae6-5c76-4a19-a9ff-43a92e22951d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.283053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1cae6-5c76-4a19-a9ff-43a92e22951d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.284661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1cae6-5c76-4a19-a9ff-43a92e22951d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.295791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 794/1579] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.296578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1cae6-5c76-4a19-a9ff-43a92e22951d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.300775 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 786/1580] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:19 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:19.301621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4c9d3-83c9-4f8e-baf9-5549e7b499b6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.310659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1cae6-5c76-4a19-a9ff-43a92e22951d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.368932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7254a4e-34e1-49a5-9f1d-c97f9403656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.369174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4c9d3-83c9-4f8e-baf9-5549e7b499b6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.369543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7254a4e-34e1-49a5-9f1d-c97f9403656b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.369919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7254a4e-34e1-49a5-9f1d-c97f9403656b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.370192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7254a4e-34e1-49a5-9f1d-c97f9403656b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.370863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7254a4e-34e1-49a5-9f1d-c97f9403656b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.372844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7254a4e-34e1-49a5-9f1d-c97f9403656b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.374195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138010a5-90c5-4907-a726-ef90d2de35b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.374899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138010a5-90c5-4907-a726-ef90d2de35b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.375111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138010a5-90c5-4907-a726-ef90d2de35b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.375392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138010a5-90c5-4907-a726-ef90d2de35b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.376026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138010a5-90c5-4907-a726-ef90d2de35b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.378009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138010a5-90c5-4907-a726-ef90d2de35b2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.400071 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 795/1581] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:19 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:19.401148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7254a4e-34e1-49a5-9f1d-c97f9403656b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.405891 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 787/1582] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:19 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:19.406864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138010a5-90c5-4907-a726-ef90d2de35b2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.412467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7254a4e-34e1-49a5-9f1d-c97f9403656b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.417138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c256686-f874-4d12-9543-6b554ef57c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.417753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c256686-f874-4d12-9543-6b554ef57c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.418076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138010a5-90c5-4907-a726-ef90d2de35b2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.418205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c256686-f874-4d12-9543-6b554ef57c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.418290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c256686-f874-4d12-9543-6b554ef57c95 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.418933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c256686-f874-4d12-9543-6b554ef57c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.420868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c256686-f874-4d12-9543-6b554ef57c95 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.422576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64718e4-9b8b-4fe8-b919-14e77659e673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.423226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64718e4-9b8b-4fe8-b919-14e77659e673 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.423532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64718e4-9b8b-4fe8-b919-14e77659e673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.423816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64718e4-9b8b-4fe8-b919-14e77659e673 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.424454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64718e4-9b8b-4fe8-b919-14e77659e673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.426346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64718e4-9b8b-4fe8-b919-14e77659e673 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.443646 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 796/1583] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:19 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:19.444317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c256686-f874-4d12-9543-6b554ef57c95 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.447472 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 788/1584] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:19 2022] POST /identity/v3/users => generated 299 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:19.449291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bebd8e-4796-43c9-bba0-ed314425af58 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.449728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bebd8e-4796-43c9-bba0-ed314425af58 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.450005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bebd8e-4796-43c9-bba0-ed314425af58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.455749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c256686-f874-4d12-9543-6b554ef57c95 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.458318 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:19.460956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281da72a-f1ac-4582-8dc6-48fdb8f477cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.461557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281da72a-f1ac-4582-8dc6-48fdb8f477cd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.461837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281da72a-f1ac-4582-8dc6-48fdb8f477cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.462110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281da72a-f1ac-4582-8dc6-48fdb8f477cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.462858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281da72a-f1ac-4582-8dc6-48fdb8f477cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.464462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281da72a-f1ac-4582-8dc6-48fdb8f477cd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.466796 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:19.480296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-29bebd8e-4796-43c9-bba0-ed314425af58 None None] MFA Rules not processed for user `ae3c3aba9b784076beb1b6713a439f78`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:19.480598 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 797/1585] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.481663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281da72a-f1ac-4582-8dc6-48fdb8f477cd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.481777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-29bebd8e-4796-43c9-bba0-ed314425af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:19.494082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281da72a-f1ac-4582-8dc6-48fdb8f477cd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.498646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9a099-a104-4db7-961f-ac445ace332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.499293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9a099-a104-4db7-961f-ac445ace332b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.499577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9a099-a104-4db7-961f-ac445ace332b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.499852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9a099-a104-4db7-961f-ac445ace332b admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.500507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9a099-a104-4db7-961f-ac445ace332b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.502933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9a099-a104-4db7-961f-ac445ace332b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.516379 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 798/1586] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.516379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9a099-a104-4db7-961f-ac445ace332b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.525491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9a099-a104-4db7-961f-ac445ace332b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.530925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e58f2-3871-4b7d-824b-69ae4fd3c97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.531535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e58f2-3871-4b7d-824b-69ae4fd3c97a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.531946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e58f2-3871-4b7d-824b-69ae4fd3c97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.532231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e58f2-3871-4b7d-824b-69ae4fd3c97a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.532979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e58f2-3871-4b7d-824b-69ae4fd3c97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.535047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e58f2-3871-4b7d-824b-69ae4fd3c97a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.556860 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 799/1587] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:19 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:19.557688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e58f2-3871-4b7d-824b-69ae4fd3c97a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.563997 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 789/1588] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:19.565742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bebd8e-4796-43c9-bba0-ed314425af58 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.570068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e58f2-3871-4b7d-824b-69ae4fd3c97a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.574887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d03d67-8e6a-47e4-adc5-9f8591543b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.575625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03d67-8e6a-47e4-adc5-9f8591543b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.576045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03d67-8e6a-47e4-adc5-9f8591543b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.576329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03d67-8e6a-47e4-adc5-9f8591543b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.576424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bebd8e-4796-43c9-bba0-ed314425af58 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.576981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d03d67-8e6a-47e4-adc5-9f8591543b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.578780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d03d67-8e6a-47e4-adc5-9f8591543b56 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.581671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c093bfa-2439-4164-871e-c02812b3a88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.582275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c093bfa-2439-4164-871e-c02812b3a88f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.582551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c093bfa-2439-4164-871e-c02812b3a88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.582873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c093bfa-2439-4164-871e-c02812b3a88f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.583504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c093bfa-2439-4164-871e-c02812b3a88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.585086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c093bfa-2439-4164-871e-c02812b3a88f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.591822 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 800/1589] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.592700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d03d67-8e6a-47e4-adc5-9f8591543b56 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.595959 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 790/1590] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.596730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c093bfa-2439-4164-871e-c02812b3a88f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.602953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d03d67-8e6a-47e4-adc5-9f8591543b56 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.607451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84472233-373a-4891-af60-770ba4d16c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.607591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c093bfa-2439-4164-871e-c02812b3a88f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.608032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84472233-373a-4891-af60-770ba4d16c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.608307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84472233-373a-4891-af60-770ba4d16c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.608575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84472233-373a-4891-af60-770ba4d16c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.609207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84472233-373a-4891-af60-770ba4d16c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.610812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84472233-373a-4891-af60-770ba4d16c2a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.612328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204a613-4de0-4aea-8bf6-226f3530a755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.612930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204a613-4de0-4aea-8bf6-226f3530a755 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.613289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204a613-4de0-4aea-8bf6-226f3530a755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.613652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204a613-4de0-4aea-8bf6-226f3530a755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.614312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204a613-4de0-4aea-8bf6-226f3530a755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.615936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204a613-4de0-4aea-8bf6-226f3530a755 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.621438 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 801/1591] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.622328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84472233-373a-4891-af60-770ba4d16c2a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.627515 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 791/1592] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.628666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204a613-4de0-4aea-8bf6-226f3530a755 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.632650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84472233-373a-4891-af60-770ba4d16c2a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.637285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73198c1-08e5-46a3-89de-f94e4aa37dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.637924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73198c1-08e5-46a3-89de-f94e4aa37dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.638201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73198c1-08e5-46a3-89de-f94e4aa37dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.638471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73198c1-08e5-46a3-89de-f94e4aa37dd3 admin admin] PATH_INFO: `/v3/projects/1c93a928745c4a9cbb0abe5fceb01c2c/users/fa303d40ed4b4f20844ef7b3cb8ee103/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.638792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204a613-4de0-4aea-8bf6-226f3530a755 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.644188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463714d-5df4-467f-b2ea-d84df6d9612c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.644830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463714d-5df4-467f-b2ea-d84df6d9612c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.645114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463714d-5df4-467f-b2ea-d84df6d9612c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.645391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463714d-5df4-467f-b2ea-d84df6d9612c admin admin] PATH_INFO: `/v3/projects/2afb0399210740248eb07650b8e3bcf1/users/ce541f9934a84e06b44ae2b4a1e643f4/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.654335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73198c1-08e5-46a3-89de-f94e4aa37dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c93a928745c4a9cbb0abe5fceb01c2c, user_id=fa303d40ed4b4f20844ef7b3cb8ee103, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.657145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73198c1-08e5-46a3-89de-f94e4aa37dd3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.661385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463714d-5df4-467f-b2ea-d84df6d9612c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afb0399210740248eb07650b8e3bcf1, user_id=ce541f9934a84e06b44ae2b4a1e643f4, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.665816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463714d-5df4-467f-b2ea-d84df6d9612c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.672129 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 802/1593] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:19 2022] PUT /identity/v3/projects/1c93a928745c4a9cbb0abe5fceb01c2c/users/fa303d40ed4b4f20844ef7b3cb8ee103/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:19.672875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73198c1-08e5-46a3-89de-f94e4aa37dd3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.679803 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 792/1594] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:19 2022] PUT /identity/v3/projects/2afb0399210740248eb07650b8e3bcf1/users/ce541f9934a84e06b44ae2b4a1e643f4/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:19.680611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463714d-5df4-467f-b2ea-d84df6d9612c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.745934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463714d-5df4-467f-b2ea-d84df6d9612c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.746127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73198c1-08e5-46a3-89de-f94e4aa37dd3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.750459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8452c19-de30-4788-9095-5684c466432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.751116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c91c-864d-4538-aee3-665fa4aab518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.751239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8452c19-de30-4788-9095-5684c466432f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.751497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8452c19-de30-4788-9095-5684c466432f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.752212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c91c-864d-4538-aee3-665fa4aab518 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.752324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8452c19-de30-4788-9095-5684c466432f admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.752488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c91c-864d-4538-aee3-665fa4aab518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.752814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c91c-864d-4538-aee3-665fa4aab518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.753084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8452c19-de30-4788-9095-5684c466432f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.753478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054c91c-864d-4538-aee3-665fa4aab518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.755028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8452c19-de30-4788-9095-5684c466432f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.755128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054c91c-864d-4538-aee3-665fa4aab518 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.765133 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 803/1595] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.765133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c91c-864d-4538-aee3-665fa4aab518 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.779244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c91c-864d-4538-aee3-665fa4aab518 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.784801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a5cd6-01ae-48f1-b164-ea04f9d781d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.785469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a5cd6-01ae-48f1-b164-ea04f9d781d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.785751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a5cd6-01ae-48f1-b164-ea04f9d781d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.786028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a5cd6-01ae-48f1-b164-ea04f9d781d0 admin admin] PATH_INFO: `/v3/projects/af3ec8796ba14b1e89406feaae35940b/users/3b371cb0e74c45dc90ee593ef59dc10d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.789857 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 793/1596] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:19 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:19.790762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8452c19-de30-4788-9095-5684c466432f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.802710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a5cd6-01ae-48f1-b164-ea04f9d781d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3ec8796ba14b1e89406feaae35940b, user_id=3b371cb0e74c45dc90ee593ef59dc10d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.805467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a5cd6-01ae-48f1-b164-ea04f9d781d0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.819542 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 804/1597] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:19 2022] PUT /identity/v3/projects/af3ec8796ba14b1e89406feaae35940b/users/3b371cb0e74c45dc90ee593ef59dc10d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:19.820426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a5cd6-01ae-48f1-b164-ea04f9d781d0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.829196 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:19.857349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8452c19-de30-4788-9095-5684c466432f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.879952 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:19.884735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a5cd6-01ae-48f1-b164-ea04f9d781d0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.890782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7902b-37eb-4e68-9e4d-c071185f90c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.891467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7902b-37eb-4e68-9e4d-c071185f90c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.891753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7902b-37eb-4e68-9e4d-c071185f90c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.892023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7902b-37eb-4e68-9e4d-c071185f90c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.892922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7902b-37eb-4e68-9e4d-c071185f90c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.894538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7902b-37eb-4e68-9e4d-c071185f90c1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.904429 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 805/1598] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.905572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7902b-37eb-4e68-9e4d-c071185f90c1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:19.915408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8fef2-c4fb-410f-a1b3-9d48ba5f9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.916039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8fef2-c4fb-410f-a1b3-9d48ba5f9e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.916347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8fef2-c4fb-410f-a1b3-9d48ba5f9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.916744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8fef2-c4fb-410f-a1b3-9d48ba5f9e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.916849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7902b-37eb-4e68-9e4d-c071185f90c1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:19.917394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8fef2-c4fb-410f-a1b3-9d48ba5f9e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.919047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8fef2-c4fb-410f-a1b3-9d48ba5f9e5a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.921399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e8ea9-cc32-4caf-8c5c-dfdd5a1f58f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:19.921991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e8ea9-cc32-4caf-8c5c-dfdd5a1f58f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.922327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e8ea9-cc32-4caf-8c5c-dfdd5a1f58f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.922547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e8ea9-cc32-4caf-8c5c-dfdd5a1f58f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.923221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e8ea9-cc32-4caf-8c5c-dfdd5a1f58f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:19.925468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e8ea9-cc32-4caf-8c5c-dfdd5a1f58f4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:19.932943 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 794/1599] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.932943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052f4f9-ac1d-408b-a81f-452175ffb3f8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.932943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052f4f9-ac1d-408b-a81f-452175ffb3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.932943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052f4f9-ac1d-408b-a81f-452175ffb3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.942459 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 806/1600] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:19.942459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8f32a-f0fb-4828-b2d8-74d507cad3b1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:19.942459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8f32a-f0fb-4828-b2d8-74d507cad3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:19.942459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8f32a-f0fb-4828-b2d8-74d507cad3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:19.959822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5052f4f9-ac1d-408b-a81f-452175ffb3f8 None None] MFA Rules not processed for user `ce541f9934a84e06b44ae2b4a1e643f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:19.961104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5052f4f9-ac1d-408b-a81f-452175ffb3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:19.973635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2ee8f32a-f0fb-4828-b2d8-74d507cad3b1 None None] MFA Rules not processed for user `fa303d40ed4b4f20844ef7b3cb8ee103`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:19.974868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ee8f32a-f0fb-4828-b2d8-74d507cad3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:20.026317 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 795/1601] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:20.027335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052f4f9-ac1d-408b-a81f-452175ffb3f8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.040520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052f4f9-ac1d-408b-a81f-452175ffb3f8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.043297 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 807/1602] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:20.044103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8f32a-f0fb-4828-b2d8-74d507cad3b1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.048261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810599e8-8507-4624-a93e-015ad92da5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.049027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810599e8-8507-4624-a93e-015ad92da5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.049308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810599e8-8507-4624-a93e-015ad92da5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.049576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810599e8-8507-4624-a93e-015ad92da5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.050215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810599e8-8507-4624-a93e-015ad92da5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.051842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810599e8-8507-4624-a93e-015ad92da5c4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.055816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8f32a-f0fb-4828-b2d8-74d507cad3b1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.060838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e9c5e-553a-430c-98bf-f2b4f0a9a354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.061436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e9c5e-553a-430c-98bf-f2b4f0a9a354 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.061710 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 796/1603] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:20.061841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e9c5e-553a-430c-98bf-f2b4f0a9a354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.062010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e9c5e-553a-430c-98bf-f2b4f0a9a354 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.062755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810599e8-8507-4624-a93e-015ad92da5c4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.062952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e9c5e-553a-430c-98bf-f2b4f0a9a354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.065022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e9c5e-553a-430c-98bf-f2b4f0a9a354 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.072075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810599e8-8507-4624-a93e-015ad92da5c4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.076845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7456a2-f39d-4083-9f09-e9f80ffaa177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.077470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7456a2-f39d-4083-9f09-e9f80ffaa177 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.077702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7456a2-f39d-4083-9f09-e9f80ffaa177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.077971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7456a2-f39d-4083-9f09-e9f80ffaa177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.078631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7456a2-f39d-4083-9f09-e9f80ffaa177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.080761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7456a2-f39d-4083-9f09-e9f80ffaa177 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.091036 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 808/1604] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/users => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:20.091036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e9c5e-553a-430c-98bf-f2b4f0a9a354 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.091271 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 797/1605] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:20.091548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7456a2-f39d-4083-9f09-e9f80ffaa177 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.101203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7456a2-f39d-4083-9f09-e9f80ffaa177 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.101528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e9c5e-553a-430c-98bf-f2b4f0a9a354 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.105913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49e008-211d-4e8f-afff-c131fd7e23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.106214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efc062-8e1a-42a8-aac3-3526ca3e1d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.106719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49e008-211d-4e8f-afff-c131fd7e23d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.106890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc062-8e1a-42a8-aac3-3526ca3e1d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.107004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49e008-211d-4e8f-afff-c131fd7e23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.107173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc062-8e1a-42a8-aac3-3526ca3e1d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.107298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49e008-211d-4e8f-afff-c131fd7e23d5 admin admin] PATH_INFO: `/v3/projects/40b4d6a442124a95aa03bf76baeab06d/users/c1ab0d344e474fadb1f0d7cb10426233/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.107449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc062-8e1a-42a8-aac3-3526ca3e1d08 admin admin] PATH_INFO: `/v3/projects/ec04da7367a94b348d958c02bc64bd26/users/163dd18171f34aa0905553a38f3f3e95/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.122553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49e008-211d-4e8f-afff-c131fd7e23d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b4d6a442124a95aa03bf76baeab06d, user_id=c1ab0d344e474fadb1f0d7cb10426233, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.123851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efc062-8e1a-42a8-aac3-3526ca3e1d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec04da7367a94b348d958c02bc64bd26, user_id=163dd18171f34aa0905553a38f3f3e95, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.125252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49e008-211d-4e8f-afff-c131fd7e23d5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.126545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efc062-8e1a-42a8-aac3-3526ca3e1d08 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.138650 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 798/1606] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:20 2022] PUT /identity/v3/projects/40b4d6a442124a95aa03bf76baeab06d/users/c1ab0d344e474fadb1f0d7cb10426233/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:20.145165 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 809/1607] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:20 2022] PUT /identity/v3/projects/ec04da7367a94b348d958c02bc64bd26/users/163dd18171f34aa0905553a38f3f3e95/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:20.145343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49e008-211d-4e8f-afff-c131fd7e23d5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.145435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efc062-8e1a-42a8-aac3-3526ca3e1d08 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.167935 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:20.208851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efc062-8e1a-42a8-aac3-3526ca3e1d08 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.211179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49e008-211d-4e8f-afff-c131fd7e23d5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.213376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225bf5e-b3d1-4ea4-b12c-c6b984ef908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.213984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225bf5e-b3d1-4ea4-b12c-c6b984ef908c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.214260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225bf5e-b3d1-4ea4-b12c-c6b984ef908c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.214531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225bf5e-b3d1-4ea4-b12c-c6b984ef908c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.215180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225bf5e-b3d1-4ea4-b12c-c6b984ef908c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.215736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c551a5-4323-478e-b986-9c552438e1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.216391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c551a5-4323-478e-b986-9c552438e1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.216678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c551a5-4323-478e-b986-9c552438e1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.216959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c551a5-4323-478e-b986-9c552438e1f7 admin admin] PATH_INFO: `/v3/projects/3f840ff0244f47ed96619e4649b2b143/users/e7eb017337d54e9e890d47f3d49d4ae5/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.217082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225bf5e-b3d1-4ea4-b12c-c6b984ef908c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.232437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c551a5-4323-478e-b986-9c552438e1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f840ff0244f47ed96619e4649b2b143, user_id=e7eb017337d54e9e890d47f3d49d4ae5, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.236184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c551a5-4323-478e-b986-9c552438e1f7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.244166 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 810/1608] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:20.244956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225bf5e-b3d1-4ea4-b12c-c6b984ef908c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.254315 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 799/1609] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:20 2022] PUT /identity/v3/projects/3f840ff0244f47ed96619e4649b2b143/users/e7eb017337d54e9e890d47f3d49d4ae5/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:20.255210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c551a5-4323-478e-b986-9c552438e1f7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.266074 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:20.312822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225bf5e-b3d1-4ea4-b12c-c6b984ef908c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.323858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c551a5-4323-478e-b986-9c552438e1f7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.328431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ac8a2-1c69-4e8a-b23d-660c2fd9bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.329089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ac8a2-1c69-4e8a-b23d-660c2fd9bfea admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.329371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ac8a2-1c69-4e8a-b23d-660c2fd9bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.329641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ac8a2-1c69-4e8a-b23d-660c2fd9bfea admin admin] PATH_INFO: `/v3/projects/7d54bf67900b425cb6bb1763bb20b48e/users/56dd46649ca146ad882af8015e700e54/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.344146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ac8a2-1c69-4e8a-b23d-660c2fd9bfea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d54bf67900b425cb6bb1763bb20b48e, user_id=56dd46649ca146ad882af8015e700e54, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.347829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ac8a2-1c69-4e8a-b23d-660c2fd9bfea admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.362575 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 800/1610] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:20 2022] PUT /identity/v3/projects/7d54bf67900b425cb6bb1763bb20b48e/users/56dd46649ca146ad882af8015e700e54/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:20.363380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ac8a2-1c69-4e8a-b23d-660c2fd9bfea admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.381222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1df2d1-6027-4657-b07b-6e6389bfb066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.381841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1df2d1-6027-4657-b07b-6e6389bfb066 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.382139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1df2d1-6027-4657-b07b-6e6389bfb066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.382407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1df2d1-6027-4657-b07b-6e6389bfb066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.383086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1df2d1-6027-4657-b07b-6e6389bfb066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.385043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1df2d1-6027-4657-b07b-6e6389bfb066 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.412861 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 811/1611] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:20.412861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1df2d1-6027-4657-b07b-6e6389bfb066 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.430212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ac8a2-1c69-4e8a-b23d-660c2fd9bfea admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.459600 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:20.477563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1df2d1-6027-4657-b07b-6e6389bfb066 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.482216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fbbc7-7d7c-4fa7-b22c-d5485678de33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.482975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fbbc7-7d7c-4fa7-b22c-d5485678de33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.483262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fbbc7-7d7c-4fa7-b22c-d5485678de33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.483760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fbbc7-7d7c-4fa7-b22c-d5485678de33 admin admin] PATH_INFO: `/v3/projects/af3ec8796ba14b1e89406feaae35940b/users/3b371cb0e74c45dc90ee593ef59dc10d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.485666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fbbc7-7d7c-4fa7-b22c-d5485678de33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3ec8796ba14b1e89406feaae35940b, user_id=3b371cb0e74c45dc90ee593ef59dc10d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.488988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fbbc7-7d7c-4fa7-b22c-d5485678de33 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.489796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbeedf-58ff-4d3d-a529-775eb0168c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.490402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbeedf-58ff-4d3d-a529-775eb0168c73 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.490719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbeedf-58ff-4d3d-a529-775eb0168c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.490992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbeedf-58ff-4d3d-a529-775eb0168c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.491784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbeedf-58ff-4d3d-a529-775eb0168c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.493391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbeedf-58ff-4d3d-a529-775eb0168c73 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.499478 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 812/1612] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:20 2022] PUT /identity/v3/projects/af3ec8796ba14b1e89406feaae35940b/users/3b371cb0e74c45dc90ee593ef59dc10d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:20.500920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51364750-6507-482e-ad24-6cb44110cae1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.501212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51364750-6507-482e-ad24-6cb44110cae1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.501484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51364750-6507-482e-ad24-6cb44110cae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.506534 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 801/1613] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:20.506534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28d31-707b-46e0-bb31-5217717df932 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.506534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28d31-707b-46e0-bb31-5217717df932 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.506534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28d31-707b-46e0-bb31-5217717df932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.532301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-51364750-6507-482e-ad24-6cb44110cae1 None None] MFA Rules not processed for user `c1ab0d344e474fadb1f0d7cb10426233`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:20.534060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-51364750-6507-482e-ad24-6cb44110cae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:20.534501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-92f28d31-707b-46e0-bb31-5217717df932 None None] MFA Rules not processed for user `163dd18171f34aa0905553a38f3f3e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:20.535804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-92f28d31-707b-46e0-bb31-5217717df932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:20.563599 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:20.602718 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 813/1614] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:20.603541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51364750-6507-482e-ad24-6cb44110cae1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.612844 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 802/1615] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:20.612844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128352-9ed2-4b2c-9590-d332b4b066c1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.612844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128352-9ed2-4b2c-9590-d332b4b066c1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.612844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128352-9ed2-4b2c-9590-d332b4b066c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.640493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cb128352-9ed2-4b2c-9590-d332b4b066c1 None None] MFA Rules not processed for user `e7eb017337d54e9e890d47f3d49d4ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:20.642068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cb128352-9ed2-4b2c-9590-d332b4b066c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:20.667911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51364750-6507-482e-ad24-6cb44110cae1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.672495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff30e6d-a7f6-4f92-8270-970f59c1952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.673107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff30e6d-a7f6-4f92-8270-970f59c1952c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.673387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff30e6d-a7f6-4f92-8270-970f59c1952c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.673871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff30e6d-a7f6-4f92-8270-970f59c1952c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.674553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff30e6d-a7f6-4f92-8270-970f59c1952c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.676526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff30e6d-a7f6-4f92-8270-970f59c1952c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.703861 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 814/1616] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:20.706096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b7230-8190-46c3-9573-46f6bca8867c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.706412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b7230-8190-46c3-9573-46f6bca8867c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.706769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b7230-8190-46c3-9573-46f6bca8867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.720100 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 803/1617] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:20.722163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128352-9ed2-4b2c-9590-d332b4b066c1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.732517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128352-9ed2-4b2c-9590-d332b4b066c1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.736720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-da0b7230-8190-46c3-9573-46f6bca8867c None None] MFA Rules not processed for user `56dd46649ca146ad882af8015e700e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:20.737059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12562aaa-a92c-4048-95c6-808da428d3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.737654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562aaa-a92c-4048-95c6-808da428d3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.737937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562aaa-a92c-4048-95c6-808da428d3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.738055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-da0b7230-8190-46c3-9573-46f6bca8867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:20.738213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562aaa-a92c-4048-95c6-808da428d3f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.738872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12562aaa-a92c-4048-95c6-808da428d3f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.740787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12562aaa-a92c-4048-95c6-808da428d3f9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.764183 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 804/1618] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/users => generated 298 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:20.764183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12562aaa-a92c-4048-95c6-808da428d3f9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.771859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12562aaa-a92c-4048-95c6-808da428d3f9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.776400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2495a9-2202-48a7-ad14-711fef3309d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.777033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2495a9-2202-48a7-ad14-711fef3309d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.777311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2495a9-2202-48a7-ad14-711fef3309d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.777580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2495a9-2202-48a7-ad14-711fef3309d2 admin admin] PATH_INFO: `/v3/projects/b46004885615411c9b157fa1b309fc14/users/fd4f1f3bc32f4195a3f4c3bf6665588e/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.792539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2495a9-2202-48a7-ad14-711fef3309d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46004885615411c9b157fa1b309fc14, user_id=fd4f1f3bc32f4195a3f4c3bf6665588e, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.795248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2495a9-2202-48a7-ad14-711fef3309d2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.807291 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 815/1619] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:20.808783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4ebdf-8690-46db-b56b-f9bdd69aed71 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.809069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4ebdf-8690-46db-b56b-f9bdd69aed71 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.809344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4ebdf-8690-46db-b56b-f9bdd69aed71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.811124 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 805/1620] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:20 2022] PUT /identity/v3/projects/b46004885615411c9b157fa1b309fc14/users/fd4f1f3bc32f4195a3f4c3bf6665588e/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:20.811963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2495a9-2202-48a7-ad14-711fef3309d2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.821284 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:20.844041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-26a4ebdf-8690-46db-b56b-f9bdd69aed71 None None] MFA Rules not processed for user `3b371cb0e74c45dc90ee593ef59dc10d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:20.845366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-26a4ebdf-8690-46db-b56b-f9bdd69aed71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:20.878211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2495a9-2202-48a7-ad14-711fef3309d2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.882885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e3b7c-fa70-4aca-a416-70c456d8a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.883488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3b7c-fa70-4aca-a416-70c456d8a65c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.883769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3b7c-fa70-4aca-a416-70c456d8a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.884043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3b7c-fa70-4aca-a416-70c456d8a65c admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.884674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e3b7c-fa70-4aca-a416-70c456d8a65c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:20.885153 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:20.886575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e3b7c-fa70-4aca-a416-70c456d8a65c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:20.914333 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 806/1621] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:20.915373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e3b7c-fa70-4aca-a416-70c456d8a65c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.918763 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 816/1622] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:20.919765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4ebdf-8690-46db-b56b-f9bdd69aed71 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:20.931286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4ebdf-8690-46db-b56b-f9bdd69aed71 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.996169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e3b7c-fa70-4aca-a416-70c456d8a65c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:20.996767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea6861-9239-4b24-a753-8fbef151cbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:20.997388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6861-9239-4b24-a753-8fbef151cbaf admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:20.997669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6861-9239-4b24-a753-8fbef151cbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:20.997940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6861-9239-4b24-a753-8fbef151cbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:20.998589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea6861-9239-4b24-a753-8fbef151cbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.000229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea6861-9239-4b24-a753-8fbef151cbaf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.001185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff9524-9cea-4b40-bf1e-06132f016199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.002449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9524-9cea-4b40-bf1e-06132f016199 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.002773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9524-9cea-4b40-bf1e-06132f016199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.003047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9524-9cea-4b40-bf1e-06132f016199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.003680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff9524-9cea-4b40-bf1e-06132f016199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.005612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff9524-9cea-4b40-bf1e-06132f016199 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.015343 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 817/1623] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:21.015343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea6861-9239-4b24-a753-8fbef151cbaf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.023642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea6861-9239-4b24-a753-8fbef151cbaf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.029212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ae89b-9a9b-44fc-ab3c-415ac5287fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.029877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae89b-9a9b-44fc-ab3c-415ac5287fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.030266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae89b-9a9b-44fc-ab3c-415ac5287fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.030550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae89b-9a9b-44fc-ab3c-415ac5287fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.031249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ae89b-9a9b-44fc-ab3c-415ac5287fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.033332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ae89b-9a9b-44fc-ab3c-415ac5287fb7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.039050 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 807/1624] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:20 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:21.039050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff9524-9cea-4b40-bf1e-06132f016199 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.063049 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 818/1625] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:21.063810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ae89b-9a9b-44fc-ab3c-415ac5287fb7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.101162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff9524-9cea-4b40-bf1e-06132f016199 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.120708 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.124400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ae89b-9a9b-44fc-ab3c-415ac5287fb7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.130678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c204c19-f749-410f-b1d7-5043582be11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.131318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c204c19-f749-410f-b1d7-5043582be11d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.131770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c204c19-f749-410f-b1d7-5043582be11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.132049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c204c19-f749-410f-b1d7-5043582be11d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.132695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c204c19-f749-410f-b1d7-5043582be11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.134426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c204c19-f749-410f-b1d7-5043582be11d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.145118 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 819/1626] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:21.145771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c204c19-f749-410f-b1d7-5043582be11d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.162277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceec3f8-d322-4338-8601-24714f97663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.162911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceec3f8-d322-4338-8601-24714f97663e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.163193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceec3f8-d322-4338-8601-24714f97663e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.163465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceec3f8-d322-4338-8601-24714f97663e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.164114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceec3f8-d322-4338-8601-24714f97663e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.165708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceec3f8-d322-4338-8601-24714f97663e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.179225 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 808/1627] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:21.179225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceec3f8-d322-4338-8601-24714f97663e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.185918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceec3f8-d322-4338-8601-24714f97663e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.191368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28557ff-f33c-4a5b-adf6-a1abd377e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.191943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28557ff-f33c-4a5b-adf6-a1abd377e061 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.192224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28557ff-f33c-4a5b-adf6-a1abd377e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.192494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28557ff-f33c-4a5b-adf6-a1abd377e061 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.192670 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.193175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28557ff-f33c-4a5b-adf6-a1abd377e061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.195376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28557ff-f33c-4a5b-adf6-a1abd377e061 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.203341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c204c19-f749-410f-b1d7-5043582be11d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.208235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998a30-0774-4374-ac83-1468651ebc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.208842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998a30-0774-4374-ac83-1468651ebc0f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.209124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998a30-0774-4374-ac83-1468651ebc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.209396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998a30-0774-4374-ac83-1468651ebc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.216925 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 809/1628] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/users => generated 301 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:21.218123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35ca5-d019-4ab5-a09c-e6a73de5ea85 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.218423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35ca5-d019-4ab5-a09c-e6a73de5ea85 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.218707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35ca5-d019-4ab5-a09c-e6a73de5ea85 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.224342 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 810/1629] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 2 01:00:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:21.224986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d35ca5-d019-4ab5-a09c-e6a73de5ea85 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.238060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d35ca5-d019-4ab5-a09c-e6a73de5ea85 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.243216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db184-2e43-4072-8a02-69375860ad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.243839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db184-2e43-4072-8a02-69375860ad6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.244119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db184-2e43-4072-8a02-69375860ad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.244394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db184-2e43-4072-8a02-69375860ad6f admin admin] PATH_INFO: `/v3/projects/feda636faa4444eaa0a55f06f211cf91/users/862ded96858a40ccb1bbfac9496d26cc/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.261619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8db184-2e43-4072-8a02-69375860ad6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=feda636faa4444eaa0a55f06f211cf91, user_id=862ded96858a40ccb1bbfac9496d26cc, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.264356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8db184-2e43-4072-8a02-69375860ad6f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.266202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4998a30-0774-4374-ac83-1468651ebc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.268373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4998a30-0774-4374-ac83-1468651ebc0f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.277524 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 820/1630] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:21.278433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998a30-0774-4374-ac83-1468651ebc0f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.280544 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 811/1631] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:21 2022] PUT /identity/v3/projects/feda636faa4444eaa0a55f06f211cf91/users/862ded96858a40ccb1bbfac9496d26cc/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:21.281496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db184-2e43-4072-8a02-69375860ad6f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.289705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998a30-0774-4374-ac83-1468651ebc0f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.351081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db184-2e43-4072-8a02-69375860ad6f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.355998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15c70e-303f-4038-b21b-c1676ee17e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.356776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c70e-303f-4038-b21b-c1676ee17e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.357062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c70e-303f-4038-b21b-c1676ee17e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.357370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c70e-303f-4038-b21b-c1676ee17e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.357974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15c70e-303f-4038-b21b-c1676ee17e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.359917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15c70e-303f-4038-b21b-c1676ee17e67 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.366501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276a013-50d5-4896-964b-80743fb350c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.367337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276a013-50d5-4896-964b-80743fb350c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.367899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276a013-50d5-4896-964b-80743fb350c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.368453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276a013-50d5-4896-964b-80743fb350c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.369366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276a013-50d5-4896-964b-80743fb350c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.371800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276a013-50d5-4896-964b-80743fb350c9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.381695 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 812/1632] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/users => generated 305 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:21.382624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15c70e-303f-4038-b21b-c1676ee17e67 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.397299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15c70e-303f-4038-b21b-c1676ee17e67 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.401140 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 821/1633] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:21.401140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276a013-50d5-4896-964b-80743fb350c9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.406434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d398f59-7cf0-48d3-8390-1baa27db0aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.407467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d398f59-7cf0-48d3-8390-1baa27db0aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.407872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d398f59-7cf0-48d3-8390-1baa27db0aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.408092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d398f59-7cf0-48d3-8390-1baa27db0aa5 admin admin] PATH_INFO: `/v3/projects/b46004885615411c9b157fa1b309fc14/users/fd4f1f3bc32f4195a3f4c3bf6665588e/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.410164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d398f59-7cf0-48d3-8390-1baa27db0aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46004885615411c9b157fa1b309fc14, user_id=fd4f1f3bc32f4195a3f4c3bf6665588e, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.412908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d398f59-7cf0-48d3-8390-1baa27db0aa5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.413287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276a013-50d5-4896-964b-80743fb350c9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.418114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a70df4-f654-412b-8b98-67e16af2d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.418806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a70df4-f654-412b-8b98-67e16af2d23c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.419095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a70df4-f654-412b-8b98-67e16af2d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.419390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a70df4-f654-412b-8b98-67e16af2d23c admin admin] PATH_INFO: `/v3/projects/4be78ce7e4dc481e8246fbb44a57285d/users/3e518054978543eb83711182d3848cd3/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.425602 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 813/1634] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:21 2022] PUT /identity/v3/projects/b46004885615411c9b157fa1b309fc14/users/fd4f1f3bc32f4195a3f4c3bf6665588e/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:21.426422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d398f59-7cf0-48d3-8390-1baa27db0aa5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.440462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a70df4-f654-412b-8b98-67e16af2d23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be78ce7e4dc481e8246fbb44a57285d, user_id=3e518054978543eb83711182d3848cd3, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.443964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a70df4-f654-412b-8b98-67e16af2d23c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.459403 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 822/1635] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:21 2022] PUT /identity/v3/projects/4be78ce7e4dc481e8246fbb44a57285d/users/3e518054978543eb83711182d3848cd3/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:21.463862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40f25e-01d8-4bcf-bf08-28155b80811b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.464152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40f25e-01d8-4bcf-bf08-28155b80811b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.464433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40f25e-01d8-4bcf-bf08-28155b80811b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.495742 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.503385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d398f59-7cf0-48d3-8390-1baa27db0aa5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.509775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fd40f25e-01d8-4bcf-bf08-28155b80811b None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:21.511283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fd40f25e-01d8-4bcf-bf08-28155b80811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:21.559417 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.571921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c931da-8150-4106-91a5-838029819a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.572633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c931da-8150-4106-91a5-838029819a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.572895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c931da-8150-4106-91a5-838029819a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.573167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c931da-8150-4106-91a5-838029819a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.573950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c931da-8150-4106-91a5-838029819a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.575608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c931da-8150-4106-91a5-838029819a79 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.590084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 823/1636] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:21.590289 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 814/1637] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:21.590382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40f25e-01d8-4bcf-bf08-28155b80811b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.590473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c931da-8150-4106-91a5-838029819a79 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.600698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c931da-8150-4106-91a5-838029819a79 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.601197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40f25e-01d8-4bcf-bf08-28155b80811b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.605274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204265-caaf-4972-8a68-504de4e4f46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.605876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204265-caaf-4972-8a68-504de4e4f46a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.606199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204265-caaf-4972-8a68-504de4e4f46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.606300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c116c-e645-4661-92d8-d95032305127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.606473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204265-caaf-4972-8a68-504de4e4f46a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.606870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c116c-e645-4661-92d8-d95032305127 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.607145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7204265-caaf-4972-8a68-504de4e4f46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.607240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c116c-e645-4661-92d8-d95032305127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.607478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c116c-e645-4661-92d8-d95032305127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.608134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c116c-e645-4661-92d8-d95032305127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.608930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7204265-caaf-4972-8a68-504de4e4f46a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.609737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c116c-e645-4661-92d8-d95032305127 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.622625 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 815/1638] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:21.622625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204265-caaf-4972-8a68-504de4e4f46a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.622838 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 824/1639] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:21.623625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69443525-92ad-411c-9192-82ec06a381f2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.623916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69443525-92ad-411c-9192-82ec06a381f2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.624195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69443525-92ad-411c-9192-82ec06a381f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.631041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204265-caaf-4972-8a68-504de4e4f46a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.635612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b061039-a8ba-44ac-9b59-f9497d6ab516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.636199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061039-a8ba-44ac-9b59-f9497d6ab516 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.636480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061039-a8ba-44ac-9b59-f9497d6ab516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.636747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061039-a8ba-44ac-9b59-f9497d6ab516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.637373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b061039-a8ba-44ac-9b59-f9497d6ab516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.639011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b061039-a8ba-44ac-9b59-f9497d6ab516 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.648986 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 816/1640] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:21.649770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b061039-a8ba-44ac-9b59-f9497d6ab516 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.652394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-69443525-92ad-411c-9192-82ec06a381f2 None None] MFA Rules not processed for user `fd4f1f3bc32f4195a3f4c3bf6665588e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:21.653687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-69443525-92ad-411c-9192-82ec06a381f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:21.659310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b061039-a8ba-44ac-9b59-f9497d6ab516 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.663783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cc5bb-a771-42d3-b9ce-4dbe030a81b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.664356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc5bb-a771-42d3-b9ce-4dbe030a81b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.664635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc5bb-a771-42d3-b9ce-4dbe030a81b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.664905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc5bb-a771-42d3-b9ce-4dbe030a81b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.665527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cc5bb-a771-42d3-b9ce-4dbe030a81b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.667102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cc5bb-a771-42d3-b9ce-4dbe030a81b8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.678305 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 817/1641] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:21.681460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cc5bb-a771-42d3-b9ce-4dbe030a81b8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.691717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cc5bb-a771-42d3-b9ce-4dbe030a81b8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.697166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28be31-947f-4349-8bad-0cdc5256d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.697835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28be31-947f-4349-8bad-0cdc5256d215 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.698111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28be31-947f-4349-8bad-0cdc5256d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.698381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28be31-947f-4349-8bad-0cdc5256d215 admin admin] PATH_INFO: `/v3/projects/cae5df853f0e4bcca631f8f4fde2899d/users/a82be51edf68426c8bd773613f411299/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.712427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28be31-947f-4349-8bad-0cdc5256d215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae5df853f0e4bcca631f8f4fde2899d, user_id=a82be51edf68426c8bd773613f411299, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.715116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28be31-947f-4349-8bad-0cdc5256d215 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.725261 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 825/1642] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:21.726189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69443525-92ad-411c-9192-82ec06a381f2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.731304 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 818/1643] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:21 2022] PUT /identity/v3/projects/cae5df853f0e4bcca631f8f4fde2899d/users/a82be51edf68426c8bd773613f411299/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:21.732131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28be31-947f-4349-8bad-0cdc5256d215 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.743089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69443525-92ad-411c-9192-82ec06a381f2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.800676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28be31-947f-4349-8bad-0cdc5256d215 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.805672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.806299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.806580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.806884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] PATH_INFO: `/v3/users/56dd46649ca146ad882af8015e700e54` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.807988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dd46649ca146ad882af8015e700e54)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.809906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.813029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04c93d-fd35-43af-9483-9eec735aead4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.813646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c93d-fd35-43af-9483-9eec735aead4 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.813928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c93d-fd35-43af-9483-9eec735aead4 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.814773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c93d-fd35-43af-9483-9eec735aead4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.858064 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.860601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dd46649ca146ad882af8015e700e54'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:21.867393 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:21.876174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dd46649ca146ad882af8015e700e54'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:21.877571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dd46649ca146ad882af8015e700e54'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:21.878127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04c93d-fd35-43af-9483-9eec735aead4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.879783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04c93d-fd35-43af-9483-9eec735aead4 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.885663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dd46649ca146ad882af8015e700e54'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:21.886879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dd46649ca146ad882af8015e700e54'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:21.890046 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 826/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:21.890867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04c93d-fd35-43af-9483-9eec735aead4 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.901144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04c93d-fd35-43af-9483-9eec735aead4 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.905211 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 819/1645] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:21 2022] DELETE /identity/v3/users/56dd46649ca146ad882af8015e700e54 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:21.905211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:21.905211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:21.974251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cac9c0-013b-4e5e-8422-494e2c9c8895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.975395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cac9c0-013b-4e5e-8422-494e2c9c8895 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.975395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cac9c0-013b-4e5e-8422-494e2c9c8895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.975590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cac9c0-013b-4e5e-8422-494e2c9c8895 admin admin] PATH_INFO: `/v3/projects/8a5c33d549154bfc943a09250e484448/users/c5b747c0d24a4ab891f4e5b8e53ea707/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.979077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574ef79-0a66-4565-bae9-38cdac24595f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:21.983716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb04fc-050a-4583-aec2-967c34b7cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:21.984469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb04fc-050a-4583-aec2-967c34b7cc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:21.984820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb04fc-050a-4583-aec2-967c34b7cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:21.985261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb04fc-050a-4583-aec2-967c34b7cc9a admin admin] PATH_INFO: `/v3/projects/feda636faa4444eaa0a55f06f211cf91/users/862ded96858a40ccb1bbfac9496d26cc/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:21.987375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb04fc-050a-4583-aec2-967c34b7cc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=feda636faa4444eaa0a55f06f211cf91, user_id=862ded96858a40ccb1bbfac9496d26cc, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.990142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb04fc-050a-4583-aec2-967c34b7cc9a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:21.991080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cac9c0-013b-4e5e-8422-494e2c9c8895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5c33d549154bfc943a09250e484448, user_id=c5b747c0d24a4ab891f4e5b8e53ea707, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:21.993761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cac9c0-013b-4e5e-8422-494e2c9c8895 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.010301 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 820/1646] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:21 2022] PUT /identity/v3/projects/feda636faa4444eaa0a55f06f211cf91/users/862ded96858a40ccb1bbfac9496d26cc/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:22.010301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb04fc-050a-4583-aec2-967c34b7cc9a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.010301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2cfb04fc-050a-4583-aec2-967c34b7cc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.017849 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 827/1647] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:21 2022] PUT /identity/v3/projects/8a5c33d549154bfc943a09250e484448/users/c5b747c0d24a4ab891f4e5b8e53ea707/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:22.018762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cac9c0-013b-4e5e-8422-494e2c9c8895 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.020550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45cac9c0-013b-4e5e-8422-494e2c9c8895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.078890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb04fc-050a-4583-aec2-967c34b7cc9a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.083973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb34c2-0b96-4f46-80a0-f6dfc417c2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.084627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb34c2-0b96-4f46-80a0-f6dfc417c2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.084907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb34c2-0b96-4f46-80a0-f6dfc417c2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.085180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb34c2-0b96-4f46-80a0-f6dfc417c2a7 admin admin] PATH_INFO: `/v3/projects/40cd4cfe1abb4edfa6025ec0916332a0/users/5e87f74219ae4f6a88db3b743988f5d9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.085801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cac9c0-013b-4e5e-8422-494e2c9c8895 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.090886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cc14c-35df-441e-9801-6d212bd66609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.091541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cc14c-35df-441e-9801-6d212bd66609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.091844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cc14c-35df-441e-9801-6d212bd66609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.092118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cc14c-35df-441e-9801-6d212bd66609 admin admin] PATH_INFO: `/v3/projects/4be78ce7e4dc481e8246fbb44a57285d/users/3e518054978543eb83711182d3848cd3/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.093991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cc14c-35df-441e-9801-6d212bd66609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be78ce7e4dc481e8246fbb44a57285d, user_id=3e518054978543eb83711182d3848cd3, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:22.097180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cc14c-35df-441e-9801-6d212bd66609 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.100524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb34c2-0b96-4f46-80a0-f6dfc417c2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cd4cfe1abb4edfa6025ec0916332a0, user_id=5e87f74219ae4f6a88db3b743988f5d9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:22.103169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb34c2-0b96-4f46-80a0-f6dfc417c2a7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.108408 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 828/1648] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:22 2022] PUT /identity/v3/projects/4be78ce7e4dc481e8246fbb44a57285d/users/3e518054978543eb83711182d3848cd3/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:22.109580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cc14c-35df-441e-9801-6d212bd66609 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.111730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-af3cc14c-35df-441e-9801-6d212bd66609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.118426 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 821/1649] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:22 2022] PUT /identity/v3/projects/40cd4cfe1abb4edfa6025ec0916332a0/users/5e87f74219ae4f6a88db3b743988f5d9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:22.119618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a53ba-a87d-4c8c-b97a-9ffe4ab609f0 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.119906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a53ba-a87d-4c8c-b97a-9ffe4ab609f0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.120175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a53ba-a87d-4c8c-b97a-9ffe4ab609f0 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.121526 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 822/1650] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 2 01:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:22.122360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2926e0-0a45-4291-abc2-d5aa359b38a4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.122739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2926e0-0a45-4291-abc2-d5aa359b38a4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.122928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2926e0-0a45-4291-abc2-d5aa359b38a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.144653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2b2926e0-0a45-4291-abc2-d5aa359b38a4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:22.145849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2b2926e0-0a45-4291-abc2-d5aa359b38a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.185850 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:22.200702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cc14c-35df-441e-9801-6d212bd66609 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.211480 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:22.221560 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 823/1651] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:22.222834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e39c71-c17a-438f-84d6-709a261839f9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.223225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e39c71-c17a-438f-84d6-709a261839f9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.223502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e39c71-c17a-438f-84d6-709a261839f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.259497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b9e39c71-c17a-438f-84d6-709a261839f9 None None] MFA Rules not processed for user `862ded96858a40ccb1bbfac9496d26cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:22.260798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b9e39c71-c17a-438f-84d6-709a261839f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.263322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71646b-0684-4185-8fb9-e2c50b7933f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.263939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71646b-0684-4185-8fb9-e2c50b7933f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.264222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71646b-0684-4185-8fb9-e2c50b7933f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.264503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71646b-0684-4185-8fb9-e2c50b7933f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.265146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71646b-0684-4185-8fb9-e2c50b7933f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:22.266819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71646b-0684-4185-8fb9-e2c50b7933f4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.276885 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 829/1652] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:22.277713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71646b-0684-4185-8fb9-e2c50b7933f4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.279513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0a71646b-0684-4185-8fb9-e2c50b7933f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.291753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71646b-0684-4185-8fb9-e2c50b7933f4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.296380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709a944-0397-45de-9a65-5714149226cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.296976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709a944-0397-45de-9a65-5714149226cf admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.297253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709a944-0397-45de-9a65-5714149226cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.297523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709a944-0397-45de-9a65-5714149226cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.298162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709a944-0397-45de-9a65-5714149226cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:22.300721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709a944-0397-45de-9a65-5714149226cf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.310741 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 830/1653] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:22.311935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9cd1f-2fc2-48df-896a-0761a2567eec None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.312222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9cd1f-2fc2-48df-896a-0761a2567eec None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.312496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9cd1f-2fc2-48df-896a-0761a2567eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.330854 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 824/1654] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:22.331599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e39c71-c17a-438f-84d6-709a261839f9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.341583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e39c71-c17a-438f-84d6-709a261839f9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.345821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-94c9cd1f-2fc2-48df-896a-0761a2567eec None None] MFA Rules not processed for user `3e518054978543eb83711182d3848cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:22.346270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c9e1d-e54c-4be6-9ff0-f9ea6ba8fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.347069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-94c9cd1f-2fc2-48df-896a-0761a2567eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.347331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9e1d-e54c-4be6-9ff0-f9ea6ba8fad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.347805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9e1d-e54c-4be6-9ff0-f9ea6ba8fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.348282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9e1d-e54c-4be6-9ff0-f9ea6ba8fad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.349454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c9e1d-e54c-4be6-9ff0-f9ea6ba8fad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:22.352048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c9e1d-e54c-4be6-9ff0-f9ea6ba8fad5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.363320 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 825/1655] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:22.365352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aaedf-b765-4e92-8efd-31f4722c061a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.365635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aaedf-b765-4e92-8efd-31f4722c061a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.365938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aaedf-b765-4e92-8efd-31f4722c061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.385330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-be8aaedf-b765-4e92-8efd-31f4722c061a None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:22.386522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-be8aaedf-b765-4e92-8efd-31f4722c061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.419844 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 831/1656] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:22.420679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9cd1f-2fc2-48df-896a-0761a2567eec None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.422793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-94c9cd1f-2fc2-48df-896a-0761a2567eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.436520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9cd1f-2fc2-48df-896a-0761a2567eec None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.442028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.442674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.442953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.443234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] PATH_INFO: `/v3/users/cfe9e4faf02d40e9bab7cae55a286a5c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.444446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe9e4faf02d40e9bab7cae55a286a5c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:22.445542 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:00:22.445542 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:00:22.445542 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:00:22.446822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.458152 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 826/1657] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 2 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:22.459019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aaedf-b765-4e92-8efd-31f4722c061a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.460337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-be8aaedf-b765-4e92-8efd-31f4722c061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.506839 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:22.514641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe9e4faf02d40e9bab7cae55a286a5c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:22.517812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aaedf-b765-4e92-8efd-31f4722c061a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.521435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d31e3-d940-4dac-b525-f2582d7e5029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.522034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d31e3-d940-4dac-b525-f2582d7e5029 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.522312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d31e3-d940-4dac-b525-f2582d7e5029 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.522569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d31e3-d940-4dac-b525-f2582d7e5029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.531523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d31e3-d940-4dac-b525-f2582d7e5029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:22.533459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d31e3-d940-4dac-b525-f2582d7e5029 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.534906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe9e4faf02d40e9bab7cae55a286a5c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:22.535619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe9e4faf02d40e9bab7cae55a286a5c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:22.543204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe9e4faf02d40e9bab7cae55a286a5c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:22.543898 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 827/1658] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:22.544787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d31e3-d940-4dac-b525-f2582d7e5029 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.554326 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:22.556105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d31e3-d940-4dac-b525-f2582d7e5029 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.560421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe9e4faf02d40e9bab7cae55a286a5c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:22.561239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919fb33-7f3d-49e7-ba06-d1f83607f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.561990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919fb33-7f3d-49e7-ba06-d1f83607f590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.562270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919fb33-7f3d-49e7-ba06-d1f83607f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.563367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919fb33-7f3d-49e7-ba06-d1f83607f590 admin admin] PATH_INFO: `/v3/projects/cae5df853f0e4bcca631f8f4fde2899d/users/a82be51edf68426c8bd773613f411299/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.565190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919fb33-7f3d-49e7-ba06-d1f83607f590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae5df853f0e4bcca631f8f4fde2899d, user_id=a82be51edf68426c8bd773613f411299, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:22.568197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919fb33-7f3d-49e7-ba06-d1f83607f590 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.570130 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 832/1659] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:22 2022] DELETE /identity/v3/users/cfe9e4faf02d40e9bab7cae55a286a5c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:22.574547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.576505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.580668 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 828/1660] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:22 2022] PUT /identity/v3/projects/cae5df853f0e4bcca631f8f4fde2899d/users/a82be51edf68426c8bd773613f411299/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:22.581634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919fb33-7f3d-49e7-ba06-d1f83607f590 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.583141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2919fb33-7f3d-49e7-ba06-d1f83607f590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.663927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b8df8-3540-4e9a-897a-81da3aa92d41 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.681352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919fb33-7f3d-49e7-ba06-d1f83607f590 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.688800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e1cb-e9f2-42aa-b80c-b59b0f6faa60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.689320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e1cb-e9f2-42aa-b80c-b59b0f6faa60 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.689631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e1cb-e9f2-42aa-b80c-b59b0f6faa60 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.690520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e1cb-e9f2-42aa-b80c-b59b0f6faa60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.693778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e105e1cb-e9f2-42aa-b80c-b59b0f6faa60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.728753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1745fba-72f6-4039-ab12-f626a88ee0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.729446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1745fba-72f6-4039-ab12-f626a88ee0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.729724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1745fba-72f6-4039-ab12-f626a88ee0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.730000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1745fba-72f6-4039-ab12-f626a88ee0c6 admin admin] PATH_INFO: `/v3/projects/8a5c33d549154bfc943a09250e484448/users/c5b747c0d24a4ab891f4e5b8e53ea707/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.733098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1745fba-72f6-4039-ab12-f626a88ee0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5c33d549154bfc943a09250e484448, user_id=c5b747c0d24a4ab891f4e5b8e53ea707, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:22.738372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1745fba-72f6-4039-ab12-f626a88ee0c6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.751149 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 833/1661] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:22 2022] PUT /identity/v3/projects/8a5c33d549154bfc943a09250e484448/users/c5b747c0d24a4ab891f4e5b8e53ea707/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:22.758734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1745fba-72f6-4039-ab12-f626a88ee0c6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.758734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b1745fba-72f6-4039-ab12-f626a88ee0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.775208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e1cb-e9f2-42aa-b80c-b59b0f6faa60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:22.776848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e1cb-e9f2-42aa-b80c-b59b0f6faa60 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.788391 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 829/1662] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:22.789261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e1cb-e9f2-42aa-b80c-b59b0f6faa60 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:22.791118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e105e1cb-e9f2-42aa-b80c-b59b0f6faa60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.806768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e1cb-e9f2-42aa-b80c-b59b0f6faa60 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.832961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1745fba-72f6-4039-ab12-f626a88ee0c6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:22.838551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff367349-83ae-49d8-b547-719e9eff72a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.839253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff367349-83ae-49d8-b547-719e9eff72a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.839562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff367349-83ae-49d8-b547-719e9eff72a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.839808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff367349-83ae-49d8-b547-719e9eff72a2 admin admin] PATH_INFO: `/v3/projects/40cd4cfe1abb4edfa6025ec0916332a0/users/5e87f74219ae4f6a88db3b743988f5d9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.842132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff367349-83ae-49d8-b547-719e9eff72a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cd4cfe1abb4edfa6025ec0916332a0, user_id=5e87f74219ae4f6a88db3b743988f5d9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:22.844562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff367349-83ae-49d8-b547-719e9eff72a2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:22.867361 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 834/1663] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:22 2022] PUT /identity/v3/projects/40cd4cfe1abb4edfa6025ec0916332a0/users/5e87f74219ae4f6a88db3b743988f5d9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:22.868788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c888-af6e-4556-bea3-0ca250c30bdb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.869079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c888-af6e-4556-bea3-0ca250c30bdb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.869359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c888-af6e-4556-bea3-0ca250c30bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.889739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-21d1c888-af6e-4556-bea3-0ca250c30bdb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:22.890829 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:22.890964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-21d1c888-af6e-4556-bea3-0ca250c30bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.901406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17994ff-c89a-491b-bc9c-f3fe37b2b5ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:22.902319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17994ff-c89a-491b-bc9c-f3fe37b2b5ae service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.903626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17994ff-c89a-491b-bc9c-f3fe37b2b5ae service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.904020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17994ff-c89a-491b-bc9c-f3fe37b2b5ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:22.916541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a17994ff-c89a-491b-bc9c-f3fe37b2b5ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:22.934329 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:22.985419 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 835/1664] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:22.987631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c263def-7f55-4edd-a2d1-ace76075882e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:22.987979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c263def-7f55-4edd-a2d1-ace76075882e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:22.988259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c263def-7f55-4edd-a2d1-ace76075882e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.000504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17994ff-c89a-491b-bc9c-f3fe37b2b5ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:23.000504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17994ff-c89a-491b-bc9c-f3fe37b2b5ae service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:23.011085 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 830/1665] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:23.012444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e0e6c-79fa-456b-8b4a-10f4f3373225 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.012780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e0e6c-79fa-456b-8b4a-10f4f3373225 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.013059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e0e6c-79fa-456b-8b4a-10f4f3373225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.033414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2c263def-7f55-4edd-a2d1-ace76075882e None None] MFA Rules not processed for user `a82be51edf68426c8bd773613f411299`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:23.034872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2c263def-7f55-4edd-a2d1-ace76075882e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.046786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ff1e0e6c-79fa-456b-8b4a-10f4f3373225 None None] MFA Rules not processed for user `c5b747c0d24a4ab891f4e5b8e53ea707`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:23.048210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ff1e0e6c-79fa-456b-8b4a-10f4f3373225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.113389 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 836/1666] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:23.114943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38063f-7b31-4894-a8ae-28033b790876 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.115440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38063f-7b31-4894-a8ae-28033b790876 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.116781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38063f-7b31-4894-a8ae-28033b790876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.121417 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 831/1667] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:23.122400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e0e6c-79fa-456b-8b4a-10f4f3373225 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:23.152160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bc38063f-7b31-4894-a8ae-28033b790876 None None] MFA Rules not processed for user `5e87f74219ae4f6a88db3b743988f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:23.153948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bc38063f-7b31-4894-a8ae-28033b790876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.197515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e0e6c-79fa-456b-8b4a-10f4f3373225 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:23.203856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da78c6c-2a4b-4ea3-abf1-cd03e7bd77ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:23.204615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da78c6c-2a4b-4ea3-abf1-cd03e7bd77ab service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.204936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da78c6c-2a4b-4ea3-abf1-cd03e7bd77ab service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.205404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da78c6c-2a4b-4ea3-abf1-cd03e7bd77ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.207252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4da78c6c-2a4b-4ea3-abf1-cd03e7bd77ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.228488 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:23.232056 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 837/1668] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:23.232655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38063f-7b31-4894-a8ae-28033b790876 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:23.234001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bc38063f-7b31-4894-a8ae-28033b790876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.275149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da78c6c-2a4b-4ea3-abf1-cd03e7bd77ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:23.276862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da78c6c-2a4b-4ea3-abf1-cd03e7bd77ab service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:23.286643 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 832/1669] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:23.287598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da78c6c-2a4b-4ea3-abf1-cd03e7bd77ab service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:23.289372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4da78c6c-2a4b-4ea3-abf1-cd03e7bd77ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.294538 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:23.306624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da78c6c-2a4b-4ea3-abf1-cd03e7bd77ab service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:23.311427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38063f-7b31-4894-a8ae-28033b790876 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:23.311726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:23.312501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.313217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.313509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] PATH_INFO: `/v3/projects/7d54bf67900b425cb6bb1763bb20b48e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.315325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d54bf67900b425cb6bb1763bb20b48e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:23.316390 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:00:23.316390 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:00:23.316390 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:00:23.317779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:23.324594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa30375-b169-48cd-bac3-aefb906ffb86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:23.325220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30375-b169-48cd-bac3-aefb906ffb86 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.325500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30375-b169-48cd-bac3-aefb906ffb86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.325773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30375-b169-48cd-bac3-aefb906ffb86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.336999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa30375-b169-48cd-bac3-aefb906ffb86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:23.338445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa30375-b169-48cd-bac3-aefb906ffb86 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:23.350549 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 838/1670] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:23.351643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa30375-b169-48cd-bac3-aefb906ffb86 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:23.353408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-afa30375-b169-48cd-bac3-aefb906ffb86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.374848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa30375-b169-48cd-bac3-aefb906ffb86 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:23.392213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d54bf67900b425cb6bb1763bb20b48e', 'request_id': 'req-6f9fca77-a053-4dc1-88d4-0d803eab8c12'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.400468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d54bf67900b425cb6bb1763bb20b48e', 'request_id': 'req-6f9fca77-a053-4dc1-88d4-0d803eab8c12'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.416424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d54bf67900b425cb6bb1763bb20b48e', 'request_id': 'req-6f9fca77-a053-4dc1-88d4-0d803eab8c12'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.430218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] The token cache is being invalidate because project 7d54bf67900b425cb6bb1763bb20b48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:23.430688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.431312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.433200 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 833/1671] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:23 2022] DELETE /identity/v3/projects/7d54bf67900b425cb6bb1763bb20b48e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:23.434055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:23.435530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.447297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28d00-1519-454c-940b-d573164801be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:23.448077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28d00-1519-454c-940b-d573164801be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.448455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28d00-1519-454c-940b-d573164801be admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.448828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28d00-1519-454c-940b-d573164801be admin admin] PATH_INFO: `/v3/users/fa303d40ed4b4f20844ef7b3cb8ee103` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.450209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a28d00-1519-454c-940b-d573164801be admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa303d40ed4b4f20844ef7b3cb8ee103)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:23.452300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a28d00-1519-454c-940b-d573164801be admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:23.501464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49a28d00-1519-454c-940b-d573164801be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa303d40ed4b4f20844ef7b3cb8ee103'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.524350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fca77-a053-4dc1-88d4-0d803eab8c12 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:23.530123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806e5d3-1014-4241-b0d5-422b409e9aa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:23.530776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e5d3-1014-4241-b0d5-422b409e9aa0 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.531060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e5d3-1014-4241-b0d5-422b409e9aa0 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.531333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e5d3-1014-4241-b0d5-422b409e9aa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.533121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9806e5d3-1014-4241-b0d5-422b409e9aa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.533872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49a28d00-1519-454c-940b-d573164801be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa303d40ed4b4f20844ef7b3cb8ee103'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.534778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49a28d00-1519-454c-940b-d573164801be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa303d40ed4b4f20844ef7b3cb8ee103'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.544565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49a28d00-1519-454c-940b-d573164801be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa303d40ed4b4f20844ef7b3cb8ee103'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.555324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49a28d00-1519-454c-940b-d573164801be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa303d40ed4b4f20844ef7b3cb8ee103'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.563656 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 839/1672] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:23 2022] DELETE /identity/v3/users/fa303d40ed4b4f20844ef7b3cb8ee103 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:23.565479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28d00-1519-454c-940b-d573164801be admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:23.567138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-49a28d00-1519-454c-940b-d573164801be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.580826 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:23.606675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806e5d3-1014-4241-b0d5-422b409e9aa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:23.608452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806e5d3-1014-4241-b0d5-422b409e9aa0 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:23.622894 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 834/1673] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:23.625726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594da92-e719-4a2e-be42-92624daa89fe None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.626675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594da92-e719-4a2e-be42-92624daa89fe None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.627855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594da92-e719-4a2e-be42-92624daa89fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.659741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b594da92-e719-4a2e-be42-92624daa89fe None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:23.661737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b594da92-e719-4a2e-be42-92624daa89fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.662252 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:23.679054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28d00-1519-454c-940b-d573164801be admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:23.688480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a5014-36c5-4008-a601-704728590838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:23.691515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a5014-36c5-4008-a601-704728590838 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.692249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a5014-36c5-4008-a601-704728590838 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.693485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a5014-36c5-4008-a601-704728590838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.697570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-907a5014-36c5-4008-a601-704728590838 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.763394 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 835/1674] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:23.764912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ff70-d8b8-4e37-a16f-d6621e510419 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.765199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ff70-d8b8-4e37-a16f-d6621e510419 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.765473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ff70-d8b8-4e37-a16f-d6621e510419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.782403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a5014-36c5-4008-a601-704728590838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:23.784075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a5014-36c5-4008-a601-704728590838 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:23.786616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a176ff70-d8b8-4e37-a16f-d6621e510419 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:23.787872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a176ff70-d8b8-4e37-a16f-d6621e510419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.794372 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 840/1675] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:23 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:23.795360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a5014-36c5-4008-a601-704728590838 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:23.796123 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 836/1676] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:23.796999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176ff70-d8b8-4e37-a16f-d6621e510419 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:23.797100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-907a5014-36c5-4008-a601-704728590838 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.798252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a176ff70-d8b8-4e37-a16f-d6621e510419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.811966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a5014-36c5-4008-a601-704728590838 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:23.818273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:23.818922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176ff70-d8b8-4e37-a16f-d6621e510419 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:23.819058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.819208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.819481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] PATH_INFO: `/v3/projects/a209e01efa3c4475bdbaea702bbdff5d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.820964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a209e01efa3c4475bdbaea702bbdff5d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:23.823084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:23.824599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18613670-0ec5-4ebe-9536-92b85ecd5976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:23.825204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18613670-0ec5-4ebe-9536-92b85ecd5976 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.825488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18613670-0ec5-4ebe-9536-92b85ecd5976 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.825767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18613670-0ec5-4ebe-9536-92b85ecd5976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.827551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-18613670-0ec5-4ebe-9536-92b85ecd5976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.885168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a209e01efa3c4475bdbaea702bbdff5d', 'request_id': 'req-10ca32b7-9368-4f20-9bef-70f727c10ee8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.892818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a209e01efa3c4475bdbaea702bbdff5d', 'request_id': 'req-10ca32b7-9368-4f20-9bef-70f727c10ee8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.899585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a209e01efa3c4475bdbaea702bbdff5d', 'request_id': 'req-10ca32b7-9368-4f20-9bef-70f727c10ee8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.909473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18613670-0ec5-4ebe-9536-92b85ecd5976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:23.911239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18613670-0ec5-4ebe-9536-92b85ecd5976 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:23.915493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] The token cache is being invalidate because project a209e01efa3c4475bdbaea702bbdff5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:23.915955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.916867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-10ca32b7-9368-4f20-9bef-70f727c10ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:23.921448 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 841/1677] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:23 2022] DELETE /identity/v3/projects/a209e01efa3c4475bdbaea702bbdff5d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:23.921448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177905cb-5f6f-4db3-b6b1-682082020497 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:23.921448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177905cb-5f6f-4db3-b6b1-682082020497 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:23.921448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177905cb-5f6f-4db3-b6b1-682082020497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:23.922539 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 837/1678] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:23.922941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18613670-0ec5-4ebe-9536-92b85ecd5976 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:23.925395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-18613670-0ec5-4ebe-9536-92b85ecd5976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:23.942413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-177905cb-5f6f-4db3-b6b1-682082020497 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:23.943727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-177905cb-5f6f-4db3-b6b1-682082020497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.012483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18613670-0ec5-4ebe-9536-92b85ecd5976 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.040927 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:24.059772 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 842/1679] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:24.064429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177905cb-5f6f-4db3-b6b1-682082020497 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.066386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-177905cb-5f6f-4db3-b6b1-682082020497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.078332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177905cb-5f6f-4db3-b6b1-682082020497 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.083139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.083771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.084064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.084356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] PATH_INFO: `/v3/users/3b371cb0e74c45dc90ee593ef59dc10d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.085689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b371cb0e74c45dc90ee593ef59dc10d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.086591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47aa43a-e7a8-4644-b18b-0137f9b8801f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.087363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47aa43a-e7a8-4644-b18b-0137f9b8801f service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.087785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47aa43a-e7a8-4644-b18b-0137f9b8801f service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.087906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.088224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47aa43a-e7a8-4644-b18b-0137f9b8801f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.094732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f47aa43a-e7a8-4644-b18b-0137f9b8801f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.104092 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:24.110332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47aa43a-e7a8-4644-b18b-0137f9b8801f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.113266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47aa43a-e7a8-4644-b18b-0137f9b8801f service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.127941 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 838/1680] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:24.129289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47aa43a-e7a8-4644-b18b-0137f9b8801f service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.148616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47aa43a-e7a8-4644-b18b-0137f9b8801f service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.151417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b371cb0e74c45dc90ee593ef59dc10d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.154234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c607d-bd84-4ae9-a8d7-6628ade085fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.155332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c607d-bd84-4ae9-a8d7-6628ade085fd admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.155843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c607d-bd84-4ae9-a8d7-6628ade085fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.156185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c607d-bd84-4ae9-a8d7-6628ade085fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.157112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c607d-bd84-4ae9-a8d7-6628ade085fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:24.157476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c607d-bd84-4ae9-a8d7-6628ade085fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.159965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c607d-bd84-4ae9-a8d7-6628ade085fd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.168258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b371cb0e74c45dc90ee593ef59dc10d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.170140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b371cb0e74c45dc90ee593ef59dc10d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.176478 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 839/1681] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:24.178648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ddf8-1582-42cc-a62d-598822080f18 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.179003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ddf8-1582-42cc-a62d-598822080f18 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.179426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ddf8-1582-42cc-a62d-598822080f18 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.181421 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 840/1682] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:24.182389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7ddf8-1582-42cc-a62d-598822080f18 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.183403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b371cb0e74c45dc90ee593ef59dc10d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.184365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1bd7ddf8-1582-42cc-a62d-598822080f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.195746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b371cb0e74c45dc90ee593ef59dc10d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.203583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7ddf8-1582-42cc-a62d-598822080f18 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.206342 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 843/1683] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:24 2022] DELETE /identity/v3/users/3b371cb0e74c45dc90ee593ef59dc10d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:24.210720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:00:24.212484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.292325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ed43f-9098-4a86-8868-b1cfd9930fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.293032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ed43f-9098-4a86-8868-b1cfd9930fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.293421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ed43f-9098-4a86-8868-b1cfd9930fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.293766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ed43f-9098-4a86-8868-b1cfd9930fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.294569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ed43f-9098-4a86-8868-b1cfd9930fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.296750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ed43f-9098-4a86-8868-b1cfd9930fa6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.337368 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 841/1684] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:24 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:24.339078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b9086-68b7-4654-a4de-0d6225bd0846 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.339634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b9086-68b7-4654-a4de-0d6225bd0846 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.340005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b9086-68b7-4654-a4de-0d6225bd0846 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.341929 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 842/1685] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:24.342756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b9086-68b7-4654-a4de-0d6225bd0846 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.362549 n-d-master-1 devstack@keystone.service[81854]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 02 01:00:24.362910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.364551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.442929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b9086-68b7-4654-a4de-0d6225bd0846 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.448305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610cf69-225a-489c-9391-bb221ba45f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.449621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610cf69-225a-489c-9391-bb221ba45f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.450023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610cf69-225a-489c-9391-bb221ba45f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.450702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610cf69-225a-489c-9391-bb221ba45f4f admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.451579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610cf69-225a-489c-9391-bb221ba45f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.453091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5d206-af73-4182-bc87-e8a4ae553c8f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.453985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610cf69-225a-489c-9391-bb221ba45f4f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.487229 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 843/1686] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:24 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:24.487551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4012d-1c30-4626-89fb-a2eea2e835c6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.487798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4012d-1c30-4626-89fb-a2eea2e835c6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.488080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4012d-1c30-4626-89fb-a2eea2e835c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.493362 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:24.514142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-90e4012d-1c30-4626-89fb-a2eea2e835c6 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:24.515412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-90e4012d-1c30-4626-89fb-a2eea2e835c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.542129 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:24.542910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664a03a-4de2-43ea-a123-c5ad0d6b5858 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e87f74219ae4f6a88db3b743988f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd4cfe1abb4edfa6025ec0916332a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.543512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664a03a-4de2-43ea-a123-c5ad0d6b5858 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.543960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664a03a-4de2-43ea-a123-c5ad0d6b5858 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.544062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664a03a-4de2-43ea-a123-c5ad0d6b5858 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] PATH_INFO: `/v3/projects/ec04da7367a94b348d958c02bc64bd26` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.545197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664a03a-4de2-43ea-a123-c5ad0d6b5858 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] RBAC: Authorizing `identity:get_project(project_id=ec04da7367a94b348d958c02bc64bd26)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.547904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664a03a-4de2-43ea-a123-c5ad0d6b5858 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.549997 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 844/1687] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:00:24 2022] GET /identity/v3/projects/ec04da7367a94b348d958c02bc64bd26 => generated 379 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:24.551505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664a03a-4de2-43ea-a123-c5ad0d6b5858 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.571379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664a03a-4de2-43ea-a123-c5ad0d6b5858 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.582117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631450a-a990-4478-976e-ed0bd1d5aeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.584820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631450a-a990-4478-976e-ed0bd1d5aeee admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.585130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631450a-a990-4478-976e-ed0bd1d5aeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.585414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631450a-a990-4478-976e-ed0bd1d5aeee admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.586072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631450a-a990-4478-976e-ed0bd1d5aeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.590714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631450a-a990-4478-976e-ed0bd1d5aeee admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.614262 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 845/1688] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:24.615538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631450a-a990-4478-976e-ed0bd1d5aeee admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.617458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a631450a-a990-4478-976e-ed0bd1d5aeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.626053 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 844/1689] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:00:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:24.626053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4012d-1c30-4626-89fb-a2eea2e835c6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.626053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-90e4012d-1c30-4626-89fb-a2eea2e835c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.644258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4012d-1c30-4626-89fb-a2eea2e835c6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.651309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.652037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.652384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.652751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] PATH_INFO: `/v3/projects/af3ec8796ba14b1e89406feaae35940b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.653981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3ec8796ba14b1e89406feaae35940b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.655126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631450a-a990-4478-976e-ed0bd1d5aeee admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.656331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.660714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.661353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.661633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.661912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] PATH_INFO: `/v3/projects/1c93a928745c4a9cbb0abe5fceb01c2c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.663503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c93a928745c4a9cbb0abe5fceb01c2c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.666346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.722322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c93a928745c4a9cbb0abe5fceb01c2c', 'request_id': 'req-a547cdca-f254-478b-8fd5-a87c463728b3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.723304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3ec8796ba14b1e89406feaae35940b', 'request_id': 'req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.728835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c93a928745c4a9cbb0abe5fceb01c2c', 'request_id': 'req-a547cdca-f254-478b-8fd5-a87c463728b3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.729726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3ec8796ba14b1e89406feaae35940b', 'request_id': 'req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.736331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3ec8796ba14b1e89406feaae35940b', 'request_id': 'req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.738398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c93a928745c4a9cbb0abe5fceb01c2c', 'request_id': 'req-a547cdca-f254-478b-8fd5-a87c463728b3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.750842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] The token cache is being invalidate because project af3ec8796ba14b1e89406feaae35940b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:24.751213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.752411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.754092 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 845/1690] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:24 2022] DELETE /identity/v3/projects/af3ec8796ba14b1e89406feaae35940b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:24.754701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.754855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] The token cache is being invalidate because project 1c93a928745c4a9cbb0abe5fceb01c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:24.755150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.755782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:24.756090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.757341 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 846/1691] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:24 2022] DELETE /identity/v3/projects/1c93a928745c4a9cbb0abe5fceb01c2c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:24.761096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.762392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.822269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1e1ae-97f1-44ee-89fb-a998f4ddb656 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.831878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547cdca-f254-478b-8fd5-a87c463728b3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.837037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d26658-be1d-43c8-a557-d5ab4669dbbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.837640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d26658-be1d-43c8-a557-d5ab4669dbbb service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.837919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d26658-be1d-43c8-a557-d5ab4669dbbb service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.838191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d26658-be1d-43c8-a557-d5ab4669dbbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.839960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-43d26658-be1d-43c8-a557-d5ab4669dbbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.851164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d26658-be1d-43c8-a557-d5ab4669dbbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.852746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d26658-be1d-43c8-a557-d5ab4669dbbb service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.862135 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 847/1692] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:24.863033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d26658-be1d-43c8-a557-d5ab4669dbbb service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.864496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-43d26658-be1d-43c8-a557-d5ab4669dbbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.870723 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:24.885368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeabbb-4aea-4611-92d2-dc314d053e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.886152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeabbb-4aea-4611-92d2-dc314d053e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.886530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeabbb-4aea-4611-92d2-dc314d053e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.886931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeabbb-4aea-4611-92d2-dc314d053e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.887733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeabbb-4aea-4611-92d2-dc314d053e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.889461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeabbb-4aea-4611-92d2-dc314d053e91 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.900964 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 846/1693] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:24.901623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeabbb-4aea-4611-92d2-dc314d053e91 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:24.904761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c2eeabbb-4aea-4611-92d2-dc314d053e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:24.912753 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:24.941245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d26658-be1d-43c8-a557-d5ab4669dbbb service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:24.945980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3266cf-b11d-4595-b95f-820bc5876f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:24.946637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3266cf-b11d-4595-b95f-820bc5876f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:24.946918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3266cf-b11d-4595-b95f-820bc5876f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:24.947190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3266cf-b11d-4595-b95f-820bc5876f4b admin admin] PATH_INFO: `/v3/users/c1ab0d344e474fadb1f0d7cb10426233` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:24.948304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3266cf-b11d-4595-b95f-820bc5876f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ab0d344e474fadb1f0d7cb10426233)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:24.950254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3266cf-b11d-4595-b95f-820bc5876f4b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:24.997025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeabbb-4aea-4611-92d2-dc314d053e91 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:25.003385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2d46-8421-4fa8-9c75-f84ee4290c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:25.003511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa3266cf-b11d-4595-b95f-820bc5876f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ab0d344e474fadb1f0d7cb10426233'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.003998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2d46-8421-4fa8-9c75-f84ee4290c78 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.004277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2d46-8421-4fa8-9c75-f84ee4290c78 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.004549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2d46-8421-4fa8-9c75-f84ee4290c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.008386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-257b2d46-8421-4fa8-9c75-f84ee4290c78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.027061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa3266cf-b11d-4595-b95f-820bc5876f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ab0d344e474fadb1f0d7cb10426233'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.027965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa3266cf-b11d-4595-b95f-820bc5876f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ab0d344e474fadb1f0d7cb10426233'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.037108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa3266cf-b11d-4595-b95f-820bc5876f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ab0d344e474fadb1f0d7cb10426233'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.045623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa3266cf-b11d-4595-b95f-820bc5876f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ab0d344e474fadb1f0d7cb10426233'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.052801 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 848/1694] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:24 2022] DELETE /identity/v3/users/c1ab0d344e474fadb1f0d7cb10426233 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:25.054085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598b87b-73fd-46d4-aeb3-918c80afdd10 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.054468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598b87b-73fd-46d4-aeb3-918c80afdd10 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.054892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598b87b-73fd-46d4-aeb3-918c80afdd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.076129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0598b87b-73fd-46d4-aeb3-918c80afdd10 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:25.077704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0598b87b-73fd-46d4-aeb3-918c80afdd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.089037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b2d46-8421-4fa8-9c75-f84ee4290c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:25.091388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b2d46-8421-4fa8-9c75-f84ee4290c78 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:25.107960 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 847/1695] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:25.112430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2d46-8421-4fa8-9c75-f84ee4290c78 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:25.115114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-257b2d46-8421-4fa8-9c75-f84ee4290c78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.140813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2d46-8421-4fa8-9c75-f84ee4290c78 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:25.146576 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 849/1696] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:25.146748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68b1e4-7ba5-4970-956d-139715338435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:25.147419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598b87b-73fd-46d4-aeb3-918c80afdd10 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:25.152582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0598b87b-73fd-46d4-aeb3-918c80afdd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.153490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68b1e4-7ba5-4970-956d-139715338435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.153914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68b1e4-7ba5-4970-956d-139715338435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.154569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68b1e4-7ba5-4970-956d-139715338435 admin admin] PATH_INFO: `/v3/users/3e518054978543eb83711182d3848cd3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.158388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68b1e4-7ba5-4970-956d-139715338435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e518054978543eb83711182d3848cd3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:25.161614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68b1e4-7ba5-4970-956d-139715338435 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:25.173414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598b87b-73fd-46d4-aeb3-918c80afdd10 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:25.180779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e0ebd-9345-48d4-ad9b-1df73d3dd293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:25.182307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e0ebd-9345-48d4-ad9b-1df73d3dd293 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.182592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e0ebd-9345-48d4-ad9b-1df73d3dd293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.182898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e0ebd-9345-48d4-ad9b-1df73d3dd293 admin admin] PATH_INFO: `/v3/projects/4eb42f1f3afe4538afa3e92236d7bb93/users/e6ab81b91d8345f1890ff54f864530c5/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.212472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e0ebd-9345-48d4-ad9b-1df73d3dd293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb42f1f3afe4538afa3e92236d7bb93, user_id=e6ab81b91d8345f1890ff54f864530c5, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:25.215778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e0ebd-9345-48d4-ad9b-1df73d3dd293 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:25.222642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7f68b1e4-7ba5-4970-956d-139715338435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e518054978543eb83711182d3848cd3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.231343 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 850/1697] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:25 2022] PUT /identity/v3/projects/4eb42f1f3afe4538afa3e92236d7bb93/users/e6ab81b91d8345f1890ff54f864530c5/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:25.232686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4a6b1-cab6-4807-ac28-99659d0810af None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.233079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4a6b1-cab6-4807-ac28-99659d0810af None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.233449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4a6b1-cab6-4807-ac28-99659d0810af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.237428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7f68b1e4-7ba5-4970-956d-139715338435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e518054978543eb83711182d3848cd3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.238198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7f68b1e4-7ba5-4970-956d-139715338435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e518054978543eb83711182d3848cd3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.250775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7f68b1e4-7ba5-4970-956d-139715338435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e518054978543eb83711182d3848cd3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.250775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7f68b1e4-7ba5-4970-956d-139715338435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e518054978543eb83711182d3848cd3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.254573 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:25.257804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ccc4a6b1-cab6-4807-ac28-99659d0810af None None] MFA Rules not processed for user `ae3c3aba9b784076beb1b6713a439f78`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:25.259035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ccc4a6b1-cab6-4807-ac28-99659d0810af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.266152 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 848/1698] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:25 2022] DELETE /identity/v3/users/3e518054978543eb83711182d3848cd3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:25.266152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32efc4a-75c4-4dda-bdd3-ab39bd8d7fc0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.266152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32efc4a-75c4-4dda-bdd3-ab39bd8d7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.266152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32efc4a-75c4-4dda-bdd3-ab39bd8d7fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.290452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d32efc4a-75c4-4dda-bdd3-ab39bd8d7fc0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:25.290452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d32efc4a-75c4-4dda-bdd3-ab39bd8d7fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.300954 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:25.343937 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 851/1699] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:25.343937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88e74-75aa-44fd-ba37-b61416d4d8ae None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.343937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88e74-75aa-44fd-ba37-b61416d4d8ae None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.343937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88e74-75aa-44fd-ba37-b61416d4d8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.371668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-32a88e74-75aa-44fd-ba37-b61416d4d8ae None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:25.373167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-32a88e74-75aa-44fd-ba37-b61416d4d8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.385505 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 849/1700] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:25.387339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e254-7105-4e11-8a52-31ba8585f4c6 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.387771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e254-7105-4e11-8a52-31ba8585f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.388203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e254-7105-4e11-8a52-31ba8585f4c6 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.397507 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 850/1701] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:00:25 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:25.399472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dff66e-9e8d-4bf6-aa04-ddebede50bfa None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.399909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dff66e-9e8d-4bf6-aa04-ddebede50bfa None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.400620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dff66e-9e8d-4bf6-aa04-ddebede50bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.437006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f6dff66e-9e8d-4bf6-aa04-ddebede50bfa None None] MFA Rules not processed for user `e6ab81b91d8345f1890ff54f864530c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:25.438401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f6dff66e-9e8d-4bf6-aa04-ddebede50bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.449245 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 852/1702] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:25.450119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88e74-75aa-44fd-ba37-b61416d4d8ae None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:25.451441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-32a88e74-75aa-44fd-ba37-b61416d4d8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.518955 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 851/1703] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:25.518955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dff66e-9e8d-4bf6-aa04-ddebede50bfa None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:25.518955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f6dff66e-9e8d-4bf6-aa04-ddebede50bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.554060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88e74-75aa-44fd-ba37-b61416d4d8ae None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:25.561024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7f234-f22f-446d-add0-5843f71fefe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:25.561758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f234-f22f-446d-add0-5843f71fefe7 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.562041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f234-f22f-446d-add0-5843f71fefe7 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.562320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f234-f22f-446d-add0-5843f71fefe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.566098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bcb7f234-f22f-446d-add0-5843f71fefe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.576972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dff66e-9e8d-4bf6-aa04-ddebede50bfa None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:25.581573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:25.582104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.582389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.582697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.594542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:25.596118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:25.608621 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 852/1704] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:25.609500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:00:25.611789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.629476 n-d-master-1 devstack@keystone.service[81853]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 02 01:00:25.629875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:25.631277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.640822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7f234-f22f-446d-add0-5843f71fefe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:25.643439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7f234-f22f-446d-add0-5843f71fefe7 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:25.654280 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 853/1705] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:25.655175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7f234-f22f-446d-add0-5843f71fefe7 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:25.666956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7f234-f22f-446d-add0-5843f71fefe7 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:25.672257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17c95b-36c8-46d7-9dcb-e0972ae74434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:25.672973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17c95b-36c8-46d7-9dcb-e0972ae74434 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.673256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17c95b-36c8-46d7-9dcb-e0972ae74434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.673522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17c95b-36c8-46d7-9dcb-e0972ae74434 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.674272 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:25.674387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17c95b-36c8-46d7-9dcb-e0972ae74434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:25.674703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17c95b-36c8-46d7-9dcb-e0972ae74434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:25.677642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17c95b-36c8-46d7-9dcb-e0972ae74434 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:25.700729 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 854/1706] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:25.701591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17c95b-36c8-46d7-9dcb-e0972ae74434 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:25.704448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ca17c95b-36c8-46d7-9dcb-e0972ae74434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.720052 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:25.731161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17c95b-36c8-46d7-9dcb-e0972ae74434 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:25.741564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418afe1-11e9-443e-b7ef-5a1e866ec615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:25.742252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418afe1-11e9-443e-b7ef-5a1e866ec615 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.742540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418afe1-11e9-443e-b7ef-5a1e866ec615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.742889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418afe1-11e9-443e-b7ef-5a1e866ec615 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.743561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418afe1-11e9-443e-b7ef-5a1e866ec615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:25.745501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418afe1-11e9-443e-b7ef-5a1e866ec615 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:25.746002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8c730-10d5-40ef-94a1-d167b75a5008 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:25.751423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd3ea3-72be-4e66-89c3-a451e9b48dc8 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e87f74219ae4f6a88db3b743988f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd4cfe1abb4edfa6025ec0916332a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:25.753031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd3ea3-72be-4e66-89c3-a451e9b48dc8 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.753031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd3ea3-72be-4e66-89c3-a451e9b48dc8 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.753201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd3ea3-72be-4e66-89c3-a451e9b48dc8 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] PATH_INFO: `/v3/projects/ec04da7367a94b348d958c02bc64bd26` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.754302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd3ea3-72be-4e66-89c3-a451e9b48dc8 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] RBAC: Authorizing `identity:get_project(project_id=ec04da7367a94b348d958c02bc64bd26)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:25.756435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd3ea3-72be-4e66-89c3-a451e9b48dc8 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:25.758273 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 853/1707] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:00:25 2022] GET /identity/v3/projects/ec04da7367a94b348d958c02bc64bd26 => generated 379 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:25.759012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd3ea3-72be-4e66-89c3-a451e9b48dc8 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:25.760763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c7fd3ea3-72be-4e66-89c3-a451e9b48dc8 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.777718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd3ea3-72be-4e66-89c3-a451e9b48dc8 tempest-FlavorsAccessTestJSON-2042541756 tempest-FlavorsAccessTestJSON-2042541756-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:25.783584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:25.784981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.785276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.785676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] PATH_INFO: `/v3/projects/4be78ce7e4dc481e8246fbb44a57285d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.787600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be78ce7e4dc481e8246fbb44a57285d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:25.790011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:25.806861 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 855/1708] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:25 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:25.806861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418afe1-11e9-443e-b7ef-5a1e866ec615 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:25.851792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be78ce7e4dc481e8246fbb44a57285d', 'request_id': 'req-7a23c3a1-2bb5-4dba-ba62-320264204c03'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.858117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be78ce7e4dc481e8246fbb44a57285d', 'request_id': 'req-7a23c3a1-2bb5-4dba-ba62-320264204c03'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.866636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be78ce7e4dc481e8246fbb44a57285d', 'request_id': 'req-7a23c3a1-2bb5-4dba-ba62-320264204c03'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.882962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] The token cache is being invalidate because project 4be78ce7e4dc481e8246fbb44a57285d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:25.883492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.884213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a23c3a1-2bb5-4dba-ba62-320264204c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:25.889582 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 854/1709] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:25 2022] DELETE /identity/v3/projects/4be78ce7e4dc481e8246fbb44a57285d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:25.891589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3741b02-b986-445f-b6b6-b61620d68b63 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:25.891938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3741b02-b986-445f-b6b6-b61620d68b63 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:25.892272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3741b02-b986-445f-b6b6-b61620d68b63 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:25.894667 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 855/1710] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:25.895451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3741b02-b986-445f-b6b6-b61620d68b63 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:25.897437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f3741b02-b986-445f-b6b6-b61620d68b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:25.904871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418afe1-11e9-443e-b7ef-5a1e866ec615 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:25.999483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5386bd9-4366-41ee-b2aa-55790a469171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.000184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5386bd9-4366-41ee-b2aa-55790a469171 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.000468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5386bd9-4366-41ee-b2aa-55790a469171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.000789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5386bd9-4366-41ee-b2aa-55790a469171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.001379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5386bd9-4366-41ee-b2aa-55790a469171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.004108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5386bd9-4366-41ee-b2aa-55790a469171 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.004365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3741b02-b986-445f-b6b6-b61620d68b63 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.010701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b639cc-815e-4891-9351-c76287ce867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.011720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b639cc-815e-4891-9351-c76287ce867d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.012121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b639cc-815e-4891-9351-c76287ce867d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.012496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b639cc-815e-4891-9351-c76287ce867d admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.013374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b639cc-815e-4891-9351-c76287ce867d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.015554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b639cc-815e-4891-9351-c76287ce867d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.046883 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 856/1711] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:25 2022] POST /identity/v3/projects => generated 401 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:26.052167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2448e4-54d4-4d13-99b8-e438f1f19bc7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.052459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2448e4-54d4-4d13-99b8-e438f1f19bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.052736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2448e4-54d4-4d13-99b8-e438f1f19bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.074340 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 856/1712] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:25 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:26.082749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43e1ef-6980-47a5-ab06-e502dfbde81e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.082749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43e1ef-6980-47a5-ab06-e502dfbde81e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.082749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43e1ef-6980-47a5-ab06-e502dfbde81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.087861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea2448e4-54d4-4d13-99b8-e438f1f19bc7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:26.089269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea2448e4-54d4-4d13-99b8-e438f1f19bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.108087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ab43e1ef-6980-47a5-ab06-e502dfbde81e None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:26.109332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ab43e1ef-6980-47a5-ab06-e502dfbde81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.160523 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:26.165071 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 857/1713] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:26.166479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2448e4-54d4-4d13-99b8-e438f1f19bc7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.173825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea2448e4-54d4-4d13-99b8-e438f1f19bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.185669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2448e4-54d4-4d13-99b8-e438f1f19bc7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.190428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.191065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.191344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.191617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] PATH_INFO: `/v3/projects/40b4d6a442124a95aa03bf76baeab06d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.192718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b4d6a442124a95aa03bf76baeab06d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.194639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.195203 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 857/1714] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:00:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:26.196039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43e1ef-6980-47a5-ab06-e502dfbde81e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.197357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ab43e1ef-6980-47a5-ab06-e502dfbde81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.203922 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:26.211224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43e1ef-6980-47a5-ab06-e502dfbde81e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.216003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3559a-1617-4755-9063-86acbbaf88dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.216635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3559a-1617-4755-9063-86acbbaf88dc admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.216917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3559a-1617-4755-9063-86acbbaf88dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.217193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3559a-1617-4755-9063-86acbbaf88dc admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.217824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3559a-1617-4755-9063-86acbbaf88dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.219793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3559a-1617-4755-9063-86acbbaf88dc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.241191 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 858/1715] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:26 2022] POST /identity/v3/users => generated 301 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:26.241997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3559a-1617-4755-9063-86acbbaf88dc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.247185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b4d6a442124a95aa03bf76baeab06d', 'request_id': 'req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.251686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3559a-1617-4755-9063-86acbbaf88dc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.253478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b4d6a442124a95aa03bf76baeab06d', 'request_id': 'req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.259862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b4d6a442124a95aa03bf76baeab06d', 'request_id': 'req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.273952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] The token cache is being invalidate because project 40b4d6a442124a95aa03bf76baeab06d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:26.274254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.275262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.276784 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 858/1716] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:26 2022] DELETE /identity/v3/projects/40b4d6a442124a95aa03bf76baeab06d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:26.277541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.279428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.310980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d6fa9-616d-4ed6-b877-f614c32a4d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.311617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d6fa9-616d-4ed6-b877-f614c32a4d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.311896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d6fa9-616d-4ed6-b877-f614c32a4d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.312167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d6fa9-616d-4ed6-b877-f614c32a4d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.312807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d6fa9-616d-4ed6-b877-f614c32a4d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.315413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d6fa9-616d-4ed6-b877-f614c32a4d8a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.328513 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 859/1717] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:26.328513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09076b-b432-4e59-829a-83090c0269e1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.328513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09076b-b432-4e59-829a-83090c0269e1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.328513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09076b-b432-4e59-829a-83090c0269e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.347027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2c09076b-b432-4e59-829a-83090c0269e1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:26.348232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2c09076b-b432-4e59-829a-83090c0269e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.356021 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 860/1718] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:26.356794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09076b-b432-4e59-829a-83090c0269e1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.357981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2c09076b-b432-4e59-829a-83090c0269e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.360585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e492f9-c0f1-40e5-8bd5-3d9bae33ba08 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.366833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bae2f-08f2-45d4-ace4-14656fbfbb60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.367439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bae2f-08f2-45d4-ace4-14656fbfbb60 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.367717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bae2f-08f2-45d4-ace4-14656fbfbb60 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.367990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bae2f-08f2-45d4-ace4-14656fbfbb60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.369698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e02bae2f-08f2-45d4-ace4-14656fbfbb60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.429198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bae2f-08f2-45d4-ace4-14656fbfbb60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.430874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bae2f-08f2-45d4-ace4-14656fbfbb60 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.438281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09076b-b432-4e59-829a-83090c0269e1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.440327 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 859/1719] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:26.440961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bae2f-08f2-45d4-ace4-14656fbfbb60 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.442036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89382b3-4923-42fa-bb85-aa3b750482a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.442442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e02bae2f-08f2-45d4-ace4-14656fbfbb60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.442666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89382b3-4923-42fa-bb85-aa3b750482a5 service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.443064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89382b3-4923-42fa-bb85-aa3b750482a5 service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.443511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89382b3-4923-42fa-bb85-aa3b750482a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.445362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a89382b3-4923-42fa-bb85-aa3b750482a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.455544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bae2f-08f2-45d4-ace4-14656fbfbb60 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.459195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89382b3-4923-42fa-bb85-aa3b750482a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.460375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ac3aa-ba74-4d2c-8ae6-13da21539746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.460588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89382b3-4923-42fa-bb85-aa3b750482a5 service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.460987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ac3aa-ba74-4d2c-8ae6-13da21539746 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.461308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ac3aa-ba74-4d2c-8ae6-13da21539746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.461593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ac3aa-ba74-4d2c-8ae6-13da21539746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.462321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ac3aa-ba74-4d2c-8ae6-13da21539746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.464238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ac3aa-ba74-4d2c-8ae6-13da21539746 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.475193 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 860/1720] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:26.476188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ac3aa-ba74-4d2c-8ae6-13da21539746 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.482790 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 861/1721] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:26.483302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-535ac3aa-ba74-4d2c-8ae6-13da21539746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.485453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89382b3-4923-42fa-bb85-aa3b750482a5 service glance] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.487361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a89382b3-4923-42fa-bb85-aa3b750482a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.502275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89382b3-4923-42fa-bb85-aa3b750482a5 service glance] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.505461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ac3aa-ba74-4d2c-8ae6-13da21539746 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.508047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca742c-0d29-47b7-8228-cb659f4ca145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.509027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca742c-0d29-47b7-8228-cb659f4ca145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.509319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca742c-0d29-47b7-8228-cb659f4ca145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.509712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca742c-0d29-47b7-8228-cb659f4ca145 admin admin] PATH_INFO: `/v3/projects/0055d1a9ff6c4d6991a320051c912422/users/5e7611d1cdb649f680c813998b9e766d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.510902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.511604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.511892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.512168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] PATH_INFO: `/v3/users/a82be51edf68426c8bd773613f411299` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.513314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82be51edf68426c8bd773613f411299)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.515918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.539859 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:26.543748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca742c-0d29-47b7-8228-cb659f4ca145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0055d1a9ff6c4d6991a320051c912422, user_id=5e7611d1cdb649f680c813998b9e766d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.549840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca742c-0d29-47b7-8228-cb659f4ca145 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.581482 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 862/1722] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:26 2022] PUT /identity/v3/projects/0055d1a9ff6c4d6991a320051c912422/users/5e7611d1cdb649f680c813998b9e766d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:26.582388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca742c-0d29-47b7-8228-cb659f4ca145 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.590461 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:26.611882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82be51edf68426c8bd773613f411299'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.629978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82be51edf68426c8bd773613f411299'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.630818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82be51edf68426c8bd773613f411299'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.640830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82be51edf68426c8bd773613f411299'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.651230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82be51edf68426c8bd773613f411299'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.660505 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 861/1723] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:26 2022] DELETE /identity/v3/users/a82be51edf68426c8bd773613f411299 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:26.661872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.663594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.684952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca742c-0d29-47b7-8228-cb659f4ca145 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.747941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008ba0b-d901-4130-b5b3-536d54cd06c1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.755486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77da9d-307b-4661-9caf-c2b0d8f6a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.756349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77da9d-307b-4661-9caf-c2b0d8f6a397 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.756702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77da9d-307b-4661-9caf-c2b0d8f6a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.757071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77da9d-307b-4661-9caf-c2b0d8f6a397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.757834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77da9d-307b-4661-9caf-c2b0d8f6a397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.760838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77da9d-307b-4661-9caf-c2b0d8f6a397 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.768686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b96a41-9f56-4188-a0b5-c22ce871e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.769644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96a41-9f56-4188-a0b5-c22ce871e957 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.770031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96a41-9f56-4188-a0b5-c22ce871e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.770411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b96a41-9f56-4188-a0b5-c22ce871e957 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.771276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b96a41-9f56-4188-a0b5-c22ce871e957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:26.771653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b96a41-9f56-4188-a0b5-c22ce871e957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.773770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b96a41-9f56-4188-a0b5-c22ce871e957 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.788618 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 862/1724] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:26.793086 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 863/1725] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:26.794354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77da9d-307b-4661-9caf-c2b0d8f6a397 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.794777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b96a41-9f56-4188-a0b5-c22ce871e957 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.796673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a2b96a41-9f56-4188-a0b5-c22ce871e957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.797389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee77da9d-307b-4661-9caf-c2b0d8f6a397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.815560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b96a41-9f56-4188-a0b5-c22ce871e957 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.816182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77da9d-307b-4661-9caf-c2b0d8f6a397 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.821554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca7666-d542-4162-9ebd-1c4745db6882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.822256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca7666-d542-4162-9ebd-1c4745db6882 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.822373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.822543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca7666-d542-4162-9ebd-1c4745db6882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.822973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca7666-d542-4162-9ebd-1c4745db6882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.823285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.823656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.824027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] PATH_INFO: `/v3/users/163dd18171f34aa0905553a38f3f3e95` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.824180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca7666-d542-4162-9ebd-1c4745db6882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.825411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=163dd18171f34aa0905553a38f3f3e95)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.826795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca7666-d542-4162-9ebd-1c4745db6882 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.827662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.843625 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 864/1726] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:26.843625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca7666-d542-4162-9ebd-1c4745db6882 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.856898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca7666-d542-4162-9ebd-1c4745db6882 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:26.864329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ff130-9312-4673-81e4-2b27367daf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:26.865260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ff130-9312-4673-81e4-2b27367daf59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:26.865374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ff130-9312-4673-81e4-2b27367daf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:26.865701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ff130-9312-4673-81e4-2b27367daf59 admin admin] PATH_INFO: `/v3/projects/1906af62eccb4a4d9e533a763a3e2018/users/0533d6c52e394ecc980d67c7d985076e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:26.893178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ff130-9312-4673-81e4-2b27367daf59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1906af62eccb4a4d9e533a763a3e2018, user_id=0533d6c52e394ecc980d67c7d985076e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:26.895928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ff130-9312-4673-81e4-2b27367daf59 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:26.916004 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 865/1727] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:26 2022] PUT /identity/v3/projects/1906af62eccb4a4d9e533a763a3e2018/users/0533d6c52e394ecc980d67c7d985076e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:26.917200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ff130-9312-4673-81e4-2b27367daf59 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:26.919519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9e1ff130-9312-4673-81e4-2b27367daf59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:26.935939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '163dd18171f34aa0905553a38f3f3e95'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.966459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '163dd18171f34aa0905553a38f3f3e95'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.971795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '163dd18171f34aa0905553a38f3f3e95'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.978856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '163dd18171f34aa0905553a38f3f3e95'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:26.991714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '163dd18171f34aa0905553a38f3f3e95'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:27.000737 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 863/1728] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:26 2022] DELETE /identity/v3/users/163dd18171f34aa0905553a38f3f3e95 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:27.001971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:27.003951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.012275 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:27.098840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ff130-9312-4673-81e4-2b27367daf59 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.126205 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:27.159970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0a392-0c91-4fbc-b8c9-46df7bf31fb2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.169510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0d88d-123b-42c4-8ba9-f041d9af2358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.171547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0d88d-123b-42c4-8ba9-f041d9af2358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.172460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0d88d-123b-42c4-8ba9-f041d9af2358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.173222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0d88d-123b-42c4-8ba9-f041d9af2358 admin admin] PATH_INFO: `/v3/projects/0055d1a9ff6c4d6991a320051c912422/users/5e7611d1cdb649f680c813998b9e766d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.187344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0d88d-123b-42c4-8ba9-f041d9af2358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0055d1a9ff6c4d6991a320051c912422, user_id=5e7611d1cdb649f680c813998b9e766d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:27.189257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0d88d-123b-42c4-8ba9-f041d9af2358 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:27.214329 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 864/1729] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:27 2022] PUT /identity/v3/projects/0055d1a9ff6c4d6991a320051c912422/users/5e7611d1cdb649f680c813998b9e766d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:27.214329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b0edf-682c-473a-9c4d-580b5ea4c8be None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.214329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b0edf-682c-473a-9c4d-580b5ea4c8be None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.214329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b0edf-682c-473a-9c4d-580b5ea4c8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.244871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4f7b0edf-682c-473a-9c4d-580b5ea4c8be None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:27.246232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4f7b0edf-682c-473a-9c4d-580b5ea4c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.248845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903bb81-c56b-4792-b252-a23f7c6edba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.250008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903bb81-c56b-4792-b252-a23f7c6edba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.250619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903bb81-c56b-4792-b252-a23f7c6edba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.251113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903bb81-c56b-4792-b252-a23f7c6edba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.254023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903bb81-c56b-4792-b252-a23f7c6edba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:27.256663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903bb81-c56b-4792-b252-a23f7c6edba6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:27.308218 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 866/1730] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:26 2022] POST /identity/v3/projects => generated 387 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:27.309460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e863-a434-4fbc-a136-ee5e72bc46c2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.309746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e863-a434-4fbc-a136-ee5e72bc46c2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.310025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e863-a434-4fbc-a136-ee5e72bc46c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.336477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f938e863-a434-4fbc-a136-ee5e72bc46c2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:27.337714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f938e863-a434-4fbc-a136-ee5e72bc46c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.350788 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 865/1731] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:27.350788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b0edf-682c-473a-9c4d-580b5ea4c8be None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:27.350788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4f7b0edf-682c-473a-9c4d-580b5ea4c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.370107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b0edf-682c-473a-9c4d-580b5ea4c8be None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.417880 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 867/1732] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:27.417880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b34f-e730-4871-af4a-44395f8a2c01 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.417880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b34f-e730-4871-af4a-44395f8a2c01 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.417880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b34f-e730-4871-af4a-44395f8a2c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.447980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4438b34f-e730-4871-af4a-44395f8a2c01 None None] MFA Rules not processed for user `5e7611d1cdb649f680c813998b9e766d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:27.449183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4438b34f-e730-4871-af4a-44395f8a2c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.453391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.454439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.454861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.455871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] PATH_INFO: `/v3/projects/cae5df853f0e4bcca631f8f4fde2899d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.457068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae5df853f0e4bcca631f8f4fde2899d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:27.459187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:27.508896 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:27.519884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae5df853f0e4bcca631f8f4fde2899d', 'request_id': 'req-d551e2b5-32da-45fe-96c2-51b6eee1bdec'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:27.525936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae5df853f0e4bcca631f8f4fde2899d', 'request_id': 'req-d551e2b5-32da-45fe-96c2-51b6eee1bdec'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:27.532384 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 868/1733] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:27.533295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438b34f-e730-4871-af4a-44395f8a2c01 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:27.535310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4438b34f-e730-4871-af4a-44395f8a2c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.538539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae5df853f0e4bcca631f8f4fde2899d', 'request_id': 'req-d551e2b5-32da-45fe-96c2-51b6eee1bdec'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:27.557182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] The token cache is being invalidate because project cae5df853f0e4bcca631f8f4fde2899d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:27.557479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:27.558133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:27.560012 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 866/1734] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:27 2022] DELETE /identity/v3/projects/cae5df853f0e4bcca631f8f4fde2899d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:27.560994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:27.562326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.585032 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:27.641243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551e2b5-32da-45fe-96c2-51b6eee1bdec admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.641790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438b34f-e730-4871-af4a-44395f8a2c01 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.646121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280c631-21b7-406c-b28b-dd1b0f4c8178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.646765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280c631-21b7-406c-b28b-dd1b0f4c8178 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.647047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280c631-21b7-406c-b28b-dd1b0f4c8178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.647318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280c631-21b7-406c-b28b-dd1b0f4c8178 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.647954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280c631-21b7-406c-b28b-dd1b0f4c8178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:27.649935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280c631-21b7-406c-b28b-dd1b0f4c8178 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:27.681197 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 867/1735] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:27 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:27.681197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280c631-21b7-406c-b28b-dd1b0f4c8178 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:27.681197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2280c631-21b7-406c-b28b-dd1b0f4c8178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.722760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021794c-b9bc-4553-9b73-591f55e9012b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.723859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021794c-b9bc-4553-9b73-591f55e9012b service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.724325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021794c-b9bc-4553-9b73-591f55e9012b service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.724780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021794c-b9bc-4553-9b73-591f55e9012b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.738842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5021794c-b9bc-4553-9b73-591f55e9012b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.743576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021794c-b9bc-4553-9b73-591f55e9012b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:27.745240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021794c-b9bc-4553-9b73-591f55e9012b service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:27.746062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280c631-21b7-406c-b28b-dd1b0f4c8178 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.749645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530357af-099f-44bd-a071-69e1ffdd9114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.750249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530357af-099f-44bd-a071-69e1ffdd9114 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.750527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530357af-099f-44bd-a071-69e1ffdd9114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.750997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530357af-099f-44bd-a071-69e1ffdd9114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.754165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-530357af-099f-44bd-a071-69e1ffdd9114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.758335 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 869/1736] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:27.759240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021794c-b9bc-4553-9b73-591f55e9012b service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:27.769775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530357af-099f-44bd-a071-69e1ffdd9114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:27.771249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530357af-099f-44bd-a071-69e1ffdd9114 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:27.776824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021794c-b9bc-4553-9b73-591f55e9012b service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.781288 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 868/1737] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:27.782002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530357af-099f-44bd-a071-69e1ffdd9114 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:27.782317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fe7f7-cf88-4575-a65f-2a4465084ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.783241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe7f7-cf88-4575-a65f-2a4465084ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.783735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe7f7-cf88-4575-a65f-2a4465084ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.783843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-530357af-099f-44bd-a071-69e1ffdd9114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.784397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe7f7-cf88-4575-a65f-2a4465084ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.786523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-598fe7f7-cf88-4575-a65f-2a4465084ad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.807882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fe7f7-cf88-4575-a65f-2a4465084ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:27.811059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fe7f7-cf88-4575-a65f-2a4465084ad7 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:27.826555 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 870/1738] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:27.828067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b01daa-6e52-445b-841f-36084a22461c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.828574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b01daa-6e52-445b-841f-36084a22461c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.828927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b01daa-6e52-445b-841f-36084a22461c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.858088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a8b01daa-6e52-445b-841f-36084a22461c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:27.860653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a8b01daa-6e52-445b-841f-36084a22461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.880258 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 871/1739] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:27.881964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b01daa-6e52-445b-841f-36084a22461c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:27.890078 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:27.913283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b01daa-6e52-445b-841f-36084a22461c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.925872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530357af-099f-44bd-a071-69e1ffdd9114 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:27.932750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659ce5d-d378-4da7-b48f-32570b4cb377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.933573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659ce5d-d378-4da7-b48f-32570b4cb377 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.933878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659ce5d-d378-4da7-b48f-32570b4cb377 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.934168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659ce5d-d378-4da7-b48f-32570b4cb377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.936057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f311714-2b85-438f-a2ee-697f4b9603b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:27.936365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0659ce5d-d378-4da7-b48f-32570b4cb377 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.937163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311714-2b85-438f-a2ee-697f4b9603b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.939247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311714-2b85-438f-a2ee-697f4b9603b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.940163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311714-2b85-438f-a2ee-697f4b9603b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.941309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f311714-2b85-438f-a2ee-697f4b9603b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:27.944781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f311714-2b85-438f-a2ee-697f4b9603b3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:27.958998 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 872/1740] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:27.960198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722834a1-8cc2-4562-9613-046109ff6cc0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:27.960491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722834a1-8cc2-4562-9613-046109ff6cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:27.960765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722834a1-8cc2-4562-9613-046109ff6cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:27.984260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-722834a1-8cc2-4562-9613-046109ff6cc0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:27.985618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-722834a1-8cc2-4562-9613-046109ff6cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:27.996040 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 873/1741] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:28.000029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722834a1-8cc2-4562-9613-046109ff6cc0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.001409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-722834a1-8cc2-4562-9613-046109ff6cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:28.017629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722834a1-8cc2-4562-9613-046109ff6cc0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:28.024677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:28.025576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.025929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.026266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] PATH_INFO: `/v3/users/ce541f9934a84e06b44ae2b4a1e643f4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.027636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce541f9934a84e06b44ae2b4a1e643f4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.030536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.044604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659ce5d-d378-4da7-b48f-32570b4cb377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.046951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659ce5d-d378-4da7-b48f-32570b4cb377 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.060775 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 869/1742] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:28.061951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659ce5d-d378-4da7-b48f-32570b4cb377 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.074529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659ce5d-d378-4da7-b48f-32570b4cb377 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:28.079730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf8b2d-74c1-494c-97de-db9bdd26fefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:28.081088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf8b2d-74c1-494c-97de-db9bdd26fefb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.081458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf8b2d-74c1-494c-97de-db9bdd26fefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.081767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf8b2d-74c1-494c-97de-db9bdd26fefb admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.082584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf8b2d-74c1-494c-97de-db9bdd26fefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.084484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf8b2d-74c1-494c-97de-db9bdd26fefb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.097399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce541f9934a84e06b44ae2b4a1e643f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:28.097740 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 870/1743] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:28.098608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf8b2d-74c1-494c-97de-db9bdd26fefb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.109988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf8b2d-74c1-494c-97de-db9bdd26fefb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:28.113855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce541f9934a84e06b44ae2b4a1e643f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:28.114648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce541f9934a84e06b44ae2b4a1e643f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:28.116833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459f142-d4e6-4a7b-93ce-81ba39e85c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:28.117815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f142-d4e6-4a7b-93ce-81ba39e85c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.118099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f142-d4e6-4a7b-93ce-81ba39e85c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.118726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f142-d4e6-4a7b-93ce-81ba39e85c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.119735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459f142-d4e6-4a7b-93ce-81ba39e85c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:28.120234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459f142-d4e6-4a7b-93ce-81ba39e85c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.122951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459f142-d4e6-4a7b-93ce-81ba39e85c52 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.125070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce541f9934a84e06b44ae2b4a1e643f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:28.126159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce541f9934a84e06b44ae2b4a1e643f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:28.133045 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:28.143824 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 871/1744] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:28.143824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459f142-d4e6-4a7b-93ce-81ba39e85c52 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.143824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6459f142-d4e6-4a7b-93ce-81ba39e85c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:28.154036 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 874/1745] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:27 2022] DELETE /identity/v3/users/ce541f9934a84e06b44ae2b4a1e643f4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:28.155094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.156579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:28.159481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459f142-d4e6-4a7b-93ce-81ba39e85c52 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:28.262101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31670d72-b465-41a8-a667-0074709f08ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:28.262948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31670d72-b465-41a8-a667-0074709f08ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.263232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31670d72-b465-41a8-a667-0074709f08ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.263509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31670d72-b465-41a8-a667-0074709f08ac admin admin] PATH_INFO: `/v3/projects/1a3017966de9442aad1e7fb2c8cc57ae/users/8b7c3e6f75924533b22927dfee4465e4/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.291117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31670d72-b465-41a8-a667-0074709f08ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3017966de9442aad1e7fb2c8cc57ae, user_id=8b7c3e6f75924533b22927dfee4465e4, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.294879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31670d72-b465-41a8-a667-0074709f08ac admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.296198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0429cd-a737-4728-808f-1c497538031b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:28.319934 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 872/1746] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:28 2022] PUT /identity/v3/projects/1a3017966de9442aad1e7fb2c8cc57ae/users/8b7c3e6f75924533b22927dfee4465e4/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:28.320753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31670d72-b465-41a8-a667-0074709f08ac admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.324230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31670d72-b465-41a8-a667-0074709f08ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:28.460730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0d45d-20d6-4c03-b6ed-82bcaeec2c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:28.461597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0d45d-20d6-4c03-b6ed-82bcaeec2c79 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.461881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0d45d-20d6-4c03-b6ed-82bcaeec2c79 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.462157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0d45d-20d6-4c03-b6ed-82bcaeec2c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.464072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dbc0d45d-20d6-4c03-b6ed-82bcaeec2c79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:28.470021 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:28.496914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31670d72-b465-41a8-a667-0074709f08ac admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:28.509912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3f688-7478-40b2-8718-be167f754e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:28.510625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3f688-7478-40b2-8718-be167f754e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.510870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3f688-7478-40b2-8718-be167f754e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.511174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3f688-7478-40b2-8718-be167f754e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.511790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3f688-7478-40b2-8718-be167f754e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.515384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3f688-7478-40b2-8718-be167f754e69 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.571966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0d45d-20d6-4c03-b6ed-82bcaeec2c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.574560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0d45d-20d6-4c03-b6ed-82bcaeec2c79 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.575777 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 873/1747] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:28 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:28.577186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8b8ed-b17a-4e8a-9a14-5fd4a7594456 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.577913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8b8ed-b17a-4e8a-9a14-5fd4a7594456 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.578585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8b8ed-b17a-4e8a-9a14-5fd4a7594456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.591132 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 875/1748] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:28.592688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8c46-bd90-4075-80d5-126052a9cd9d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.593124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8c46-bd90-4075-80d5-126052a9cd9d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.593451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8c46-bd90-4075-80d5-126052a9cd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.623308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2ad8b8ed-b17a-4e8a-9a14-5fd4a7594456 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:28.624605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ad8b8ed-b17a-4e8a-9a14-5fd4a7594456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:28.637561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8f2e8c46-bd90-4075-80d5-126052a9cd9d None None] MFA Rules not processed for user `8b7c3e6f75924533b22927dfee4465e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:28.639358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8f2e8c46-bd90-4075-80d5-126052a9cd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:28.668666 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:28.744886 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 874/1749] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:28.746870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4aa8b-0fa4-4b31-b2e5-eea068b232d5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.747160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4aa8b-0fa4-4b31-b2e5-eea068b232d5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.747482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4aa8b-0fa4-4b31-b2e5-eea068b232d5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.748900 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 875/1750] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:28.750652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4aa8b-0fa4-4b31-b2e5-eea068b232d5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.759739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-afb4aa8b-0fa4-4b31-b2e5-eea068b232d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:28.774109 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 876/1751] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:28.774109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e8c46-bd90-4075-80d5-126052a9cd9d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.782638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e8c46-bd90-4075-80d5-126052a9cd9d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:28.788197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4aa8b-0fa4-4b31-b2e5-eea068b232d5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:28.788847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54279873-a59d-4cf3-9d89-a45f3444752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:28.789515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279873-a59d-4cf3-9d89-a45f3444752d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.789799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279873-a59d-4cf3-9d89-a45f3444752d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.790068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279873-a59d-4cf3-9d89-a45f3444752d admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.791154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54279873-a59d-4cf3-9d89-a45f3444752d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.793092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54279873-a59d-4cf3-9d89-a45f3444752d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.796539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:28.797439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.797927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.798393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] PATH_INFO: `/v3/projects/ec04da7367a94b348d958c02bc64bd26` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.801475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec04da7367a94b348d958c02bc64bd26)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:28.803892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:28.841424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 877/1752] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:28 2022] POST /identity/v3/users => generated 293 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:28.847722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6734e-b028-4b00-a04a-31d7b36964d1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:28.848046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6734e-b028-4b00-a04a-31d7b36964d1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:28.848283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6734e-b028-4b00-a04a-31d7b36964d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:28.887695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-00d6734e-b028-4b00-a04a-31d7b36964d1 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:28.889831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-00d6734e-b028-4b00-a04a-31d7b36964d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:28.904682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec04da7367a94b348d958c02bc64bd26', 'request_id': 'req-343f35cb-7a7e-4889-8b81-f90f64054aa7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:28.913095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec04da7367a94b348d958c02bc64bd26', 'request_id': 'req-343f35cb-7a7e-4889-8b81-f90f64054aa7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:28.927258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec04da7367a94b348d958c02bc64bd26', 'request_id': 'req-343f35cb-7a7e-4889-8b81-f90f64054aa7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:28.944776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] The token cache is being invalidate because project ec04da7367a94b348d958c02bc64bd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:28.945194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:28.945855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:28.947553 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 876/1753] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:28 2022] DELETE /identity/v3/projects/ec04da7367a94b348d958c02bc64bd26 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:28.948534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:28.949823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:28.999925 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 878/1754] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:29.000880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6734e-b028-4b00-a04a-31d7b36964d1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:29.004901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-00d6734e-b028-4b00-a04a-31d7b36964d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:29.041307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f35cb-7a7e-4889-8b81-f90f64054aa7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:29.046415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358d183-19fd-4063-b5be-2cc7a8263365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:29.047209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358d183-19fd-4063-b5be-2cc7a8263365 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:29.047573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358d183-19fd-4063-b5be-2cc7a8263365 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:29.049488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358d183-19fd-4063-b5be-2cc7a8263365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:29.050833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2358d183-19fd-4063-b5be-2cc7a8263365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:29.069893 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:29.137894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6734e-b028-4b00-a04a-31d7b36964d1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:29.144374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e3227-5041-44fc-946a-1eab4388bfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:29.145406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e3227-5041-44fc-946a-1eab4388bfac admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:29.145921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e3227-5041-44fc-946a-1eab4388bfac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:29.146504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e3227-5041-44fc-946a-1eab4388bfac admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:29.147302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e3227-5041-44fc-946a-1eab4388bfac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:29.149305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e3227-5041-44fc-946a-1eab4388bfac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:29.168280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358d183-19fd-4063-b5be-2cc7a8263365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:29.170325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358d183-19fd-4063-b5be-2cc7a8263365 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:29.182875 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 877/1755] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:29.183954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358d183-19fd-4063-b5be-2cc7a8263365 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:29.185431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2358d183-19fd-4063-b5be-2cc7a8263365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:29.186559 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 879/1756] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:28 2022] POST /identity/v3/projects => generated 389 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:29.187756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e3227-5041-44fc-946a-1eab4388bfac admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:29.192280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8f7e3227-5041-44fc-946a-1eab4388bfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:29.200934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358d183-19fd-4063-b5be-2cc7a8263365 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:29.221215 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:29.283686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e6852-f070-43e9-a26e-0945295be315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:29.284811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e6852-f070-43e9-a26e-0945295be315 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:29.284811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e6852-f070-43e9-a26e-0945295be315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:29.285005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e6852-f070-43e9-a26e-0945295be315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:29.286056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e6852-f070-43e9-a26e-0945295be315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:29.287804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e6852-f070-43e9-a26e-0945295be315 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:29.299756 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 878/1757] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:29.300651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e6852-f070-43e9-a26e-0945295be315 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:29.304299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc4e6852-f070-43e9-a26e-0945295be315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:29.313620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e3227-5041-44fc-946a-1eab4388bfac admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:29.319305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e6852-f070-43e9-a26e-0945295be315 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:29.324305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:29.325129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:29.325628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:29.325941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] PATH_INFO: `/v3/users/e6ab81b91d8345f1890ff54f864530c5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:29.326875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:29.327249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ab81b91d8345f1890ff54f864530c5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:29.327831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:29.328240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:29.328749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] PATH_INFO: `/v3/users/5e87f74219ae4f6a88db3b743988f5d9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:29.329448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:29.330891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e87f74219ae4f6a88db3b743988f5d9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:29.333567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:29.398367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ab81b91d8345f1890ff54f864530c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:29.423378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e87f74219ae4f6a88db3b743988f5d9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:29.429350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ab81b91d8345f1890ff54f864530c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:29.430523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ab81b91d8345f1890ff54f864530c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:29.444172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ab81b91d8345f1890ff54f864530c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:29.456492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e87f74219ae4f6a88db3b743988f5d9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:29.457608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e87f74219ae4f6a88db3b743988f5d9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:29.461009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ab81b91d8345f1890ff54f864530c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:29.468277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e87f74219ae4f6a88db3b743988f5d9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:29.468549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e87f74219ae4f6a88db3b743988f5d9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:29.474477 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 879/1758] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:29 2022] DELETE /identity/v3/users/e6ab81b91d8345f1890ff54f864530c5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:29.474477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:29.474791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:29.487254 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 880/1759] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:29 2022] DELETE /identity/v3/users/5e87f74219ae4f6a88db3b743988f5d9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:29.488147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:29.491881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:29.500043 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:29.586130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cb088-4394-4da6-91c7-31c34de769ad admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:29.638314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40024207-aaa3-42fe-abd5-0e36fa397b1d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:29.650856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4ff5e-eed2-40f8-93b6-f4a6c3652283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:29.651479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ff5e-eed2-40f8-93b6-f4a6c3652283 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:29.651760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ff5e-eed2-40f8-93b6-f4a6c3652283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:29.652031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ff5e-eed2-40f8-93b6-f4a6c3652283 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:29.652670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4ff5e-eed2-40f8-93b6-f4a6c3652283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:29.656204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4ff5e-eed2-40f8-93b6-f4a6c3652283 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:29.699290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b6c8a-3f7c-4e92-b906-40146892c69c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:29.699926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b6c8a-3f7c-4e92-b906-40146892c69c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:29.700208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b6c8a-3f7c-4e92-b906-40146892c69c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:29.700493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b6c8a-3f7c-4e92-b906-40146892c69c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:29.709849 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 881/1760] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:29 2022] POST /identity/v3/users => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:29.710064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-056b6c8a-3f7c-4e92-b906-40146892c69c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:29.710950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4ff5e-eed2-40f8-93b6-f4a6c3652283 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:29.712613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6bf4ff5e-eed2-40f8-93b6-f4a6c3652283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:29.727978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4ff5e-eed2-40f8-93b6-f4a6c3652283 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:29.733366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8639c-50b5-4413-843c-004077baef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:29.734268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8639c-50b5-4413-843c-004077baef0c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:29.737779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8639c-50b5-4413-843c-004077baef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:29.737779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8639c-50b5-4413-843c-004077baef0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:29.737779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8639c-50b5-4413-843c-004077baef0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:29.738245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8639c-50b5-4413-843c-004077baef0c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:29.751744 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 882/1761] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:29.753910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed7cbd-7150-48cb-8981-fd9d830a60df None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:29.754679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed7cbd-7150-48cb-8981-fd9d830a60df None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:29.755184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed7cbd-7150-48cb-8981-fd9d830a60df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:29.780632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-64ed7cbd-7150-48cb-8981-fd9d830a60df None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:29.782104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-64ed7cbd-7150-48cb-8981-fd9d830a60df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:29.800700 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 883/1762] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:29.801905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed7cbd-7150-48cb-8981-fd9d830a60df None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:29.813014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed7cbd-7150-48cb-8981-fd9d830a60df None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:29.819929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc453a16-e4cb-4fb9-a3dc-525185a35454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:29.820638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc453a16-e4cb-4fb9-a3dc-525185a35454 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:29.821045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc453a16-e4cb-4fb9-a3dc-525185a35454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:29.821771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc453a16-e4cb-4fb9-a3dc-525185a35454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:29.822694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc453a16-e4cb-4fb9-a3dc-525185a35454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:29.824413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc453a16-e4cb-4fb9-a3dc-525185a35454 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:29.827144 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:29.848656 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 884/1763] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:29.849610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc453a16-e4cb-4fb9-a3dc-525185a35454 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:29.862914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc453a16-e4cb-4fb9-a3dc-525185a35454 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:29.869835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909443a4-6f34-4d27-993a-4ce612688143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:29.870666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909443a4-6f34-4d27-993a-4ce612688143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:29.871118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909443a4-6f34-4d27-993a-4ce612688143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:29.871401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909443a4-6f34-4d27-993a-4ce612688143 admin admin] PATH_INFO: `/v3/projects/f5a069becb8642149d109f364764f114/users/994eb50d38864845a18199dd594ef47b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:29.883014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b6c8a-3f7c-4e92-b906-40146892c69c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:29.885730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b6c8a-3f7c-4e92-b906-40146892c69c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:29.893004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909443a4-6f34-4d27-993a-4ce612688143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a069becb8642149d109f364764f114, user_id=994eb50d38864845a18199dd594ef47b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:29.895971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909443a4-6f34-4d27-993a-4ce612688143 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:29.918352 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 880/1764] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:29.919327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b6c8a-3f7c-4e92-b906-40146892c69c service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:29.920032 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 885/1765] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:29 2022] PUT /identity/v3/projects/f5a069becb8642149d109f364764f114/users/994eb50d38864845a18199dd594ef47b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:29.921172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909443a4-6f34-4d27-993a-4ce612688143 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:29.924574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-056b6c8a-3f7c-4e92-b906-40146892c69c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:29.974644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b6c8a-3f7c-4e92-b906-40146892c69c service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:30.065044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909443a4-6f34-4d27-993a-4ce612688143 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:30.075730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565de46-ed6c-4857-a342-06bdcd2cdf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:30.077073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565de46-ed6c-4857-a342-06bdcd2cdf9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:30.077420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565de46-ed6c-4857-a342-06bdcd2cdf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:30.077698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565de46-ed6c-4857-a342-06bdcd2cdf9c admin admin] PATH_INFO: `/v3/projects/502fab92439d47ba935a887c56189ad1/users/bbadcc55221a4c8c9e07da910cc6170d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:30.101643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565de46-ed6c-4857-a342-06bdcd2cdf9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=502fab92439d47ba935a887c56189ad1, user_id=bbadcc55221a4c8c9e07da910cc6170d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:30.105603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565de46-ed6c-4857-a342-06bdcd2cdf9c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:30.124387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60901238-19cd-4a0a-a6b1-b8c51b67ab10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:30.126182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60901238-19cd-4a0a-a6b1-b8c51b67ab10 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:30.128416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60901238-19cd-4a0a-a6b1-b8c51b67ab10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:30.128904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60901238-19cd-4a0a-a6b1-b8c51b67ab10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:30.138284 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 886/1766] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:29 2022] PUT /identity/v3/projects/502fab92439d47ba935a887c56189ad1/users/bbadcc55221a4c8c9e07da910cc6170d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:30.141822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6d5ac-3fc5-4782-9a4e-49e727438e54 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:30.144032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6d5ac-3fc5-4782-9a4e-49e727438e54 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:30.144361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6d5ac-3fc5-4782-9a4e-49e727438e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:30.153840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60901238-19cd-4a0a-a6b1-b8c51b67ab10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:30.156685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60901238-19cd-4a0a-a6b1-b8c51b67ab10 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:30.171666 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 881/1767] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:30.172826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60901238-19cd-4a0a-a6b1-b8c51b67ab10 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:30.177959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-60901238-19cd-4a0a-a6b1-b8c51b67ab10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:30.197960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60901238-19cd-4a0a-a6b1-b8c51b67ab10 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:30.201047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2ba6d5ac-3fc5-4782-9a4e-49e727438e54 None None] MFA Rules not processed for user `994eb50d38864845a18199dd594ef47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:30.216175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2ba6d5ac-3fc5-4782-9a4e-49e727438e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:30.234368 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:30.345155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:30.346622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:30.347054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:30.347434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] PATH_INFO: `/v3/projects/40cd4cfe1abb4edfa6025ec0916332a0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:30.349133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40cd4cfe1abb4edfa6025ec0916332a0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:30.356853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:30.365971 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 887/1768] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:30.367316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6d5ac-3fc5-4782-9a4e-49e727438e54 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:30.382805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6d5ac-3fc5-4782-9a4e-49e727438e54 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:30.388320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0291b-9018-42c7-93f3-25fb743e6965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:30.388944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0291b-9018-42c7-93f3-25fb743e6965 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:30.389223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0291b-9018-42c7-93f3-25fb743e6965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:30.389495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0291b-9018-42c7-93f3-25fb743e6965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:30.395491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0291b-9018-42c7-93f3-25fb743e6965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:30.397639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0291b-9018-42c7-93f3-25fb743e6965 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:30.418701 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 888/1769] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:30.419413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0291b-9018-42c7-93f3-25fb743e6965 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:30.435428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0291b-9018-42c7-93f3-25fb743e6965 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:30.439281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40cd4cfe1abb4edfa6025ec0916332a0', 'request_id': 'req-ee6d0ef2-047b-44f5-ae57-79ac015049e3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:30.448683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40cd4cfe1abb4edfa6025ec0916332a0', 'request_id': 'req-ee6d0ef2-047b-44f5-ae57-79ac015049e3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:30.466093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40cd4cfe1abb4edfa6025ec0916332a0', 'request_id': 'req-ee6d0ef2-047b-44f5-ae57-79ac015049e3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:30.494430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] The token cache is being invalidate because project 40cd4cfe1abb4edfa6025ec0916332a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:30.494761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:30.496221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:30.497546 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:30.506198 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 882/1770] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:30 2022] DELETE /identity/v3/projects/40cd4cfe1abb4edfa6025ec0916332a0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:30.506198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:30.513190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:30.577942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f3455-ed7b-4d9b-92d6-fff8eb83526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:30.579686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3455-ed7b-4d9b-92d6-fff8eb83526b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:30.579814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3455-ed7b-4d9b-92d6-fff8eb83526b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:30.580787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3455-ed7b-4d9b-92d6-fff8eb83526b admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:30.581811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f3455-ed7b-4d9b-92d6-fff8eb83526b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:30.585515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f3455-ed7b-4d9b-92d6-fff8eb83526b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:30.626144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d0ef2-047b-44f5-ae57-79ac015049e3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:30.626818 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 889/1771] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:30 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:30.628792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d8676-7818-44ad-8cbb-1264e7b23d65 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:30.629620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d8676-7818-44ad-8cbb-1264e7b23d65 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:30.630023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d8676-7818-44ad-8cbb-1264e7b23d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:30.653378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-488d8676-7818-44ad-8cbb-1264e7b23d65 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:30.654591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-488d8676-7818-44ad-8cbb-1264e7b23d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:30.736929 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:30.746338 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 890/1772] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:30.750710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd10b52-e965-4af0-bc04-05775d3f68a1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:30.751142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd10b52-e965-4af0-bc04-05775d3f68a1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:30.751422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd10b52-e965-4af0-bc04-05775d3f68a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:30.752978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efd343-9a28-4a5b-991c-1ef904bfc951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:30.753702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd343-9a28-4a5b-991c-1ef904bfc951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:30.753935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd343-9a28-4a5b-991c-1ef904bfc951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:30.754324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd343-9a28-4a5b-991c-1ef904bfc951 admin admin] PATH_INFO: `/v3/projects/502fab92439d47ba935a887c56189ad1/users/bbadcc55221a4c8c9e07da910cc6170d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:30.763613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efd343-9a28-4a5b-991c-1ef904bfc951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502fab92439d47ba935a887c56189ad1, user_id=bbadcc55221a4c8c9e07da910cc6170d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:30.768592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efd343-9a28-4a5b-991c-1ef904bfc951 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:30.798586 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 883/1773] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:30 2022] PUT /identity/v3/projects/502fab92439d47ba935a887c56189ad1/users/bbadcc55221a4c8c9e07da910cc6170d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:30.808274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efd343-9a28-4a5b-991c-1ef904bfc951 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:30.810905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-72efd343-9a28-4a5b-991c-1ef904bfc951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:30.862532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3bd10b52-e965-4af0-bc04-05775d3f68a1 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:30.863908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3bd10b52-e965-4af0-bc04-05775d3f68a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:30.900935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efd343-9a28-4a5b-991c-1ef904bfc951 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:30.905791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba1d07-7b8e-499b-b1a5-1f49a7da4428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:30.906412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1d07-7b8e-499b-b1a5-1f49a7da4428 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:30.906735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1d07-7b8e-499b-b1a5-1f49a7da4428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:30.907004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1d07-7b8e-499b-b1a5-1f49a7da4428 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:30.907632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba1d07-7b8e-499b-b1a5-1f49a7da4428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:30.910415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba1d07-7b8e-499b-b1a5-1f49a7da4428 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:30.953398 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 884/1774] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:30 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:30.955359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeabd7-f560-4896-94e2-53b737a58fe6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:30.957267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeabd7-f560-4896-94e2-53b737a58fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:30.966761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeabd7-f560-4896-94e2-53b737a58fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:30.996747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9cdeabd7-f560-4896-94e2-53b737a58fe6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:30.997244 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 891/1775] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:30.998572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9cdeabd7-f560-4896-94e2-53b737a58fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:31.004770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071e3d6-0181-4112-929c-9f17ab985049 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:31.005160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071e3d6-0181-4112-929c-9f17ab985049 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:31.005447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071e3d6-0181-4112-929c-9f17ab985049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:31.025246 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 885/1776] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:31.025246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdeabd7-f560-4896-94e2-53b737a58fe6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:31.055603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdeabd7-f560-4896-94e2-53b737a58fe6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:31.062325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cd0b5-8a51-4fcc-a6d3-8d8f46bcf8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:31.064649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cd0b5-8a51-4fcc-a6d3-8d8f46bcf8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:31.065015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cd0b5-8a51-4fcc-a6d3-8d8f46bcf8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:31.065947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cd0b5-8a51-4fcc-a6d3-8d8f46bcf8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:31.067044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cd0b5-8a51-4fcc-a6d3-8d8f46bcf8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:31.069358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cd0b5-8a51-4fcc-a6d3-8d8f46bcf8a9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:31.077497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4071e3d6-0181-4112-929c-9f17ab985049 None None] MFA Rules not processed for user `bbadcc55221a4c8c9e07da910cc6170d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:31.078776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4071e3d6-0181-4112-929c-9f17ab985049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:31.082693 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 886/1777] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:31.083660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cd0b5-8a51-4fcc-a6d3-8d8f46bcf8a9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:31.097737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cd0b5-8a51-4fcc-a6d3-8d8f46bcf8a9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:31.103972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb69018-067f-4419-8c24-4e9687f55ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:31.104678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb69018-067f-4419-8c24-4e9687f55ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:31.112946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb69018-067f-4419-8c24-4e9687f55ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:31.113531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb69018-067f-4419-8c24-4e9687f55ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:31.114199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb69018-067f-4419-8c24-4e9687f55ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:31.114575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb69018-067f-4419-8c24-4e9687f55ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:31.116840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb69018-067f-4419-8c24-4e9687f55ef2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:31.129639 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:31.136444 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 887/1778] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:31.137942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb69018-067f-4419-8c24-4e9687f55ef2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:31.164470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb69018-067f-4419-8c24-4e9687f55ef2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:31.170537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8020-d9c0-4bfe-9129-a29ffea0ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:31.171541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8020-d9c0-4bfe-9129-a29ffea0ae64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:31.172012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8020-d9c0-4bfe-9129-a29ffea0ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:31.172494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8020-d9c0-4bfe-9129-a29ffea0ae64 admin admin] PATH_INFO: `/v3/projects/3c2bd1310ea14f57b3e68b199f9bd7ab/users/d262f343126f4ba08192d817f6c2eb84/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:31.199317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de8020-d9c0-4bfe-9129-a29ffea0ae64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2bd1310ea14f57b3e68b199f9bd7ab, user_id=d262f343126f4ba08192d817f6c2eb84, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:31.202714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de8020-d9c0-4bfe-9129-a29ffea0ae64 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:31.232647 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 888/1779] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:31 2022] PUT /identity/v3/projects/3c2bd1310ea14f57b3e68b199f9bd7ab/users/d262f343126f4ba08192d817f6c2eb84/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:31.234409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8020-d9c0-4bfe-9129-a29ffea0ae64 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:31.238293 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 892/1780] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:31.239206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071e3d6-0181-4112-929c-9f17ab985049 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:31.249869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4071e3d6-0181-4112-929c-9f17ab985049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:31.281897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071e3d6-0181-4112-929c-9f17ab985049 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:31.372667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8020-d9c0-4bfe-9129-a29ffea0ae64 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:31.380890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1307a-4de5-4300-b797-302a53de7dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:31.381593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1307a-4de5-4300-b797-302a53de7dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:31.381956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1307a-4de5-4300-b797-302a53de7dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:31.382297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1307a-4de5-4300-b797-302a53de7dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:31.383045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1307a-4de5-4300-b797-302a53de7dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:31.385069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1307a-4de5-4300-b797-302a53de7dcf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:31.420270 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 889/1781] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:31 2022] POST /identity/v3/projects => generated 395 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:31.421394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1307a-4de5-4300-b797-302a53de7dcf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:31.422401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:31.424959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:31.425759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:31.426177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] PATH_INFO: `/v3/projects/2afb0399210740248eb07650b8e3bcf1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:31.429401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2afb0399210740248eb07650b8e3bcf1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:31.436009 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:31.447952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:31.545334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1307a-4de5-4300-b797-302a53de7dcf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:31.557522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2afb0399210740248eb07650b8e3bcf1', 'request_id': 'req-142ee919-1061-4518-a18e-ea01f4042819'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:31.571194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2afb0399210740248eb07650b8e3bcf1', 'request_id': 'req-142ee919-1061-4518-a18e-ea01f4042819'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:31.582961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2afb0399210740248eb07650b8e3bcf1', 'request_id': 'req-142ee919-1061-4518-a18e-ea01f4042819'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:31.605661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] The token cache is being invalidate because project 2afb0399210740248eb07650b8e3bcf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:31.606139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:31.607473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:31.612739 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 893/1782] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:31 2022] DELETE /identity/v3/projects/2afb0399210740248eb07650b8e3bcf1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:31.612739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:31.614746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:31.683825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baf398-ee4e-44bb-859a-b75ad75c59ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:31.684518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baf398-ee4e-44bb-859a-b75ad75c59ae admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:31.687365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baf398-ee4e-44bb-859a-b75ad75c59ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:31.687664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baf398-ee4e-44bb-859a-b75ad75c59ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:31.688599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baf398-ee4e-44bb-859a-b75ad75c59ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:31.692775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baf398-ee4e-44bb-859a-b75ad75c59ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:31.716428 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 890/1783] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:31.718843 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:31.719661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baf398-ee4e-44bb-859a-b75ad75c59ae admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:31.725176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c0baf398-ee4e-44bb-859a-b75ad75c59ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:31.770823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ee919-1061-4518-a18e-ea01f4042819 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:31.778169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d998cb3-b93a-4be4-8b78-f17e09aa74a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:31.780214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d998cb3-b93a-4be4-8b78-f17e09aa74a8 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:31.781311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d998cb3-b93a-4be4-8b78-f17e09aa74a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:31.782249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d998cb3-b93a-4be4-8b78-f17e09aa74a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:31.785412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4d998cb3-b93a-4be4-8b78-f17e09aa74a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:31.899319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d998cb3-b93a-4be4-8b78-f17e09aa74a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:31.900936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d998cb3-b93a-4be4-8b78-f17e09aa74a8 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:31.915774 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 894/1784] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:31 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:31.926745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d998cb3-b93a-4be4-8b78-f17e09aa74a8 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:31.928747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4d998cb3-b93a-4be4-8b78-f17e09aa74a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:31.948693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baf398-ee4e-44bb-859a-b75ad75c59ae admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:31.955893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed0acc-5b0d-47f4-8679-64060f7e646f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:31.956711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed0acc-5b0d-47f4-8679-64060f7e646f service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:31.956895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed0acc-5b0d-47f4-8679-64060f7e646f service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:31.957224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d998cb3-b93a-4be4-8b78-f17e09aa74a8 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:31.957357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed0acc-5b0d-47f4-8679-64060f7e646f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:31.959335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-76ed0acc-5b0d-47f4-8679-64060f7e646f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:31.979501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b6339-aeb5-46e6-b41a-91ceea562705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:31.980305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b6339-aeb5-46e6-b41a-91ceea562705 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:31.980788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b6339-aeb5-46e6-b41a-91ceea562705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:31.981130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b6339-aeb5-46e6-b41a-91ceea562705 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:31.982102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b6339-aeb5-46e6-b41a-91ceea562705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:31.990058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b6339-aeb5-46e6-b41a-91ceea562705 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:32.037257 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:32.058190 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 895/1785] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:31 2022] POST /identity/v3/users => generated 298 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:32.059324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b6339-aeb5-46e6-b41a-91ceea562705 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:32.066921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1e7b6339-aeb5-46e6-b41a-91ceea562705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:32.087977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b6339-aeb5-46e6-b41a-91ceea562705 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:32.092154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed0acc-5b0d-47f4-8679-64060f7e646f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:32.097300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed0acc-5b0d-47f4-8679-64060f7e646f service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:32.101477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:32.102135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:32.102549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:32.102851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] PATH_INFO: `/v3/projects/4eb42f1f3afe4538afa3e92236d7bb93` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:32.105680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb42f1f3afe4538afa3e92236d7bb93)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:32.113302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:32.124632 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 891/1786] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:00:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:32.125279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed0acc-5b0d-47f4-8679-64060f7e646f service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:32.132632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-76ed0acc-5b0d-47f4-8679-64060f7e646f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:32.154931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed0acc-5b0d-47f4-8679-64060f7e646f service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:32.169713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:32.170945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:32.172077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:32.172459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] PATH_INFO: `/v3/users/862ded96858a40ccb1bbfac9496d26cc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:32.180268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=862ded96858a40ccb1bbfac9496d26cc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:32.182700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:32.250734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb42f1f3afe4538afa3e92236d7bb93', 'request_id': 'req-9bc13991-bda4-421a-830c-c2532b58ca75'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:32.270431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb42f1f3afe4538afa3e92236d7bb93', 'request_id': 'req-9bc13991-bda4-421a-830c-c2532b58ca75'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:32.285599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb42f1f3afe4538afa3e92236d7bb93', 'request_id': 'req-9bc13991-bda4-421a-830c-c2532b58ca75'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:32.329839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862ded96858a40ccb1bbfac9496d26cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:32.346678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] The token cache is being invalidate because project 4eb42f1f3afe4538afa3e92236d7bb93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:32.348506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:32.356975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:32.359787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862ded96858a40ccb1bbfac9496d26cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:32.360991 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 896/1787] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:32 2022] DELETE /identity/v3/projects/4eb42f1f3afe4538afa3e92236d7bb93 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:32.362177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862ded96858a40ccb1bbfac9496d26cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:32.363517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:32.368739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:32.378032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862ded96858a40ccb1bbfac9496d26cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:32.396994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862ded96858a40ccb1bbfac9496d26cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:32.421721 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 892/1788] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:32 2022] DELETE /identity/v3/users/862ded96858a40ccb1bbfac9496d26cc => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:32.422407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:32.427426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:32.486775 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:32.527908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc13991-bda4-421a-830c-c2532b58ca75 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:32.640969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14354167-b118-4926-bb54-b35062f72e5f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:32.659971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4a6e-e42e-4ae6-b77a-3f56ad36f894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:32.660783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4a6e-e42e-4ae6-b77a-3f56ad36f894 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:32.661774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4a6e-e42e-4ae6-b77a-3f56ad36f894 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:32.664067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4a6e-e42e-4ae6-b77a-3f56ad36f894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:32.667033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ffca4a6e-e42e-4ae6-b77a-3f56ad36f894 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:32.688229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf842e-48be-4ba9-b066-19584861af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:32.691242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf842e-48be-4ba9-b066-19584861af1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:32.691751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf842e-48be-4ba9-b066-19584861af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:32.692772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf842e-48be-4ba9-b066-19584861af1e admin admin] PATH_INFO: `/v3/projects/3c2bd1310ea14f57b3e68b199f9bd7ab/users/d262f343126f4ba08192d817f6c2eb84/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:32.698874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf842e-48be-4ba9-b066-19584861af1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2bd1310ea14f57b3e68b199f9bd7ab, user_id=d262f343126f4ba08192d817f6c2eb84, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:32.707451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf842e-48be-4ba9-b066-19584861af1e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:32.740429 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 897/1789] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:32 2022] PUT /identity/v3/projects/3c2bd1310ea14f57b3e68b199f9bd7ab/users/d262f343126f4ba08192d817f6c2eb84/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:32.740429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf842e-48be-4ba9-b066-19584861af1e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:32.740429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-aacf842e-48be-4ba9-b066-19584861af1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:32.791997 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:32.828885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4a6e-e42e-4ae6-b77a-3f56ad36f894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:32.832188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4a6e-e42e-4ae6-b77a-3f56ad36f894 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:32.858961 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 893/1790] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:32.859670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4a6e-e42e-4ae6-b77a-3f56ad36f894 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:32.862441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ffca4a6e-e42e-4ae6-b77a-3f56ad36f894 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:32.892236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4a6e-e42e-4ae6-b77a-3f56ad36f894 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:32.904664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf842e-48be-4ba9-b066-19584861af1e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:32.913301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d557e-8b79-4409-b49d-ea7a1b670504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:32.915071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d557e-8b79-4409-b49d-ea7a1b670504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:32.915358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d557e-8b79-4409-b49d-ea7a1b670504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:32.916562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03c6c7-29c7-4cf0-bad3-9cf29839e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:32.917018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d557e-8b79-4409-b49d-ea7a1b670504 admin admin] PATH_INFO: `/v3/users/5e7611d1cdb649f680c813998b9e766d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:32.920132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c6c7-29c7-4cf0-bad3-9cf29839e79b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:32.920132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c6c7-29c7-4cf0-bad3-9cf29839e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:32.920132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c6c7-29c7-4cf0-bad3-9cf29839e79b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:32.922636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03c6c7-29c7-4cf0-bad3-9cf29839e79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:32.922739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d557e-8b79-4409-b49d-ea7a1b670504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7611d1cdb649f680c813998b9e766d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:32.927813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d557e-8b79-4409-b49d-ea7a1b670504 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:32.929494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03c6c7-29c7-4cf0-bad3-9cf29839e79b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:33.004202 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 898/1791] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:33.007866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c320ca-36b4-4ef1-a9fe-fe452369e8a3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:33.008223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c320ca-36b4-4ef1-a9fe-fe452369e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:33.008519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c320ca-36b4-4ef1-a9fe-fe452369e8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:33.102838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-575d557e-8b79-4409-b49d-ea7a1b670504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7611d1cdb649f680c813998b9e766d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:33.132315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-29c320ca-36b4-4ef1-a9fe-fe452369e8a3 None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:33.136136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-575d557e-8b79-4409-b49d-ea7a1b670504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7611d1cdb649f680c813998b9e766d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:33.137008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-29c320ca-36b4-4ef1-a9fe-fe452369e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:33.138817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-575d557e-8b79-4409-b49d-ea7a1b670504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7611d1cdb649f680c813998b9e766d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:33.153613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-575d557e-8b79-4409-b49d-ea7a1b670504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7611d1cdb649f680c813998b9e766d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:33.197069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-575d557e-8b79-4409-b49d-ea7a1b670504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7611d1cdb649f680c813998b9e766d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:33.238432 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 894/1792] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:32 2022] DELETE /identity/v3/users/5e7611d1cdb649f680c813998b9e766d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:33.248781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105df418-eae9-4f03-b3e7-5cde84925025 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:33.248781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105df418-eae9-4f03-b3e7-5cde84925025 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:33.248781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105df418-eae9-4f03-b3e7-5cde84925025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:33.333923 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 899/1793] 10.222.0.40 () {58 vars in 1015 bytes} [Sun Oct 2 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:33.336693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c320ca-36b4-4ef1-a9fe-fe452369e8a3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:33.340063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-29c320ca-36b4-4ef1-a9fe-fe452369e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:33.364805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-105df418-eae9-4f03-b3e7-5cde84925025 None None] MFA Rules not processed for user `d262f343126f4ba08192d817f6c2eb84`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:33.366690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-105df418-eae9-4f03-b3e7-5cde84925025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:33.380534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c320ca-36b4-4ef1-a9fe-fe452369e8a3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:33.411104 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:33.496787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ce06b-3245-41f6-bd56-ba71c53688ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:33.497713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ce06b-3245-41f6-bd56-ba71c53688ac admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:33.499568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ce06b-3245-41f6-bd56-ba71c53688ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:33.499880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ce06b-3245-41f6-bd56-ba71c53688ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:33.500658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ce06b-3245-41f6-bd56-ba71c53688ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:33.504430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ce06b-3245-41f6-bd56-ba71c53688ac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:33.531069 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 900/1794] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:33.536283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ce06b-3245-41f6-bd56-ba71c53688ac admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:33.540944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-527ce06b-3245-41f6-bd56-ba71c53688ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:33.560530 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 895/1795] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:33.562739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105df418-eae9-4f03-b3e7-5cde84925025 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:33.574686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-105df418-eae9-4f03-b3e7-5cde84925025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:33.612330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105df418-eae9-4f03-b3e7-5cde84925025 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:33.627264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:33.629370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:33.629370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:33.629546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] PATH_INFO: `/v3/users/8b7c3e6f75924533b22927dfee4465e4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:33.632659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7c3e6f75924533b22927dfee4465e4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:33.639693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:33.735817 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:33.740354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ce06b-3245-41f6-bd56-ba71c53688ac admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:33.759050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbe60c-062a-438b-bf3d-7693622c58c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:33.759793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbe60c-062a-438b-bf3d-7693622c58c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:33.760177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbe60c-062a-438b-bf3d-7693622c58c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:33.760910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbe60c-062a-438b-bf3d-7693622c58c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:33.775465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7c3e6f75924533b22927dfee4465e4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:33.788395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbe60c-062a-438b-bf3d-7693622c58c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:33.790854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbe60c-062a-438b-bf3d-7693622c58c5 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:33.807593 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 901/1796] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:33.814380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbe60c-062a-438b-bf3d-7693622c58c5 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:33.816373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7c3e6f75924533b22927dfee4465e4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:33.819090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7c3e6f75924533b22927dfee4465e4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:33.837772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7c3e6f75924533b22927dfee4465e4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:33.846760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbe60c-062a-438b-bf3d-7693622c58c5 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:33.857399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7c3e6f75924533b22927dfee4465e4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:33.863435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2121df-8f4f-4b26-b907-65e32db2624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:33.864261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2121df-8f4f-4b26-b907-65e32db2624e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:33.864644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2121df-8f4f-4b26-b907-65e32db2624e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:33.865023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2121df-8f4f-4b26-b907-65e32db2624e admin admin] PATH_INFO: `/v3/projects/89a64d4589204aa4ab873fba0cd0f687/users/2dc3379a5fe444c8944f8c342aa7852e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:33.882077 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 896/1797] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:33 2022] DELETE /identity/v3/users/8b7c3e6f75924533b22927dfee4465e4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:33.884494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:33.888452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:33.907690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2121df-8f4f-4b26-b907-65e32db2624e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a64d4589204aa4ab873fba0cd0f687, user_id=2dc3379a5fe444c8944f8c342aa7852e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:33.911012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2121df-8f4f-4b26-b907-65e32db2624e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:33.932880 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 902/1798] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:33 2022] PUT /identity/v3/projects/89a64d4589204aa4ab873fba0cd0f687/users/2dc3379a5fe444c8944f8c342aa7852e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:33.933818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2121df-8f4f-4b26-b907-65e32db2624e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:33.944735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cd2121df-8f4f-4b26-b907-65e32db2624e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:34.163066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2121df-8f4f-4b26-b907-65e32db2624e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:34.183326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:34.183905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:34.184194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:34.184478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] PATH_INFO: `/v3/projects/feda636faa4444eaa0a55f06f211cf91` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:34.186115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] RBAC: Authorizing `identity:delete_project(project_id=feda636faa4444eaa0a55f06f211cf91)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:34.188272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:34.245273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce9730-7a86-4065-82ad-58744d32286b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:34.288961 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:34.302541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feda636faa4444eaa0a55f06f211cf91', 'request_id': 'req-9da1574b-a470-4bc4-a3f3-77bbf550524e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:34.317635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feda636faa4444eaa0a55f06f211cf91', 'request_id': 'req-9da1574b-a470-4bc4-a3f3-77bbf550524e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:34.333871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feda636faa4444eaa0a55f06f211cf91', 'request_id': 'req-9da1574b-a470-4bc4-a3f3-77bbf550524e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:34.354361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] The token cache is being invalidate because project feda636faa4444eaa0a55f06f211cf91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:34.354781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:34.357137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9da1574b-a470-4bc4-a3f3-77bbf550524e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:34.360178 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 903/1799] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:33 2022] DELETE /identity/v3/projects/feda636faa4444eaa0a55f06f211cf91 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:34.362242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482564dc-c01e-41e7-b2fe-c138688cc15c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:34.362377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482564dc-c01e-41e7-b2fe-c138688cc15c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:34.362632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482564dc-c01e-41e7-b2fe-c138688cc15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:34.412144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-482564dc-c01e-41e7-b2fe-c138688cc15c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:34.415947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-482564dc-c01e-41e7-b2fe-c138688cc15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:34.427851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71558b-f49f-430c-9aca-f802917d28f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:34.428496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71558b-f49f-430c-9aca-f802917d28f2 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:34.429301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71558b-f49f-430c-9aca-f802917d28f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:34.429653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71558b-f49f-430c-9aca-f802917d28f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:34.436290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee71558b-f49f-430c-9aca-f802917d28f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:34.645149 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:34.662954 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 904/1800] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:34.665626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c914a-cccd-443f-bb50-9b0519b84cae None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:34.665914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c914a-cccd-443f-bb50-9b0519b84cae None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:34.666194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c914a-cccd-443f-bb50-9b0519b84cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:34.679106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71558b-f49f-430c-9aca-f802917d28f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:34.680728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71558b-f49f-430c-9aca-f802917d28f2 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:34.711306 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 897/1801] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 828 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:34.728243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb266c5-6f21-422e-9056-72bb78fc2be7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:34.735247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb266c5-6f21-422e-9056-72bb78fc2be7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:34.735704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb266c5-6f21-422e-9056-72bb78fc2be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:34.750043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5c2c914a-cccd-443f-bb50-9b0519b84cae None None] MFA Rules not processed for user `2dc3379a5fe444c8944f8c342aa7852e`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:34.753854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5c2c914a-cccd-443f-bb50-9b0519b84cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:34.806509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3cb266c5-6f21-422e-9056-72bb78fc2be7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:34.806509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3cb266c5-6f21-422e-9056-72bb78fc2be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:34.829181 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 898/1802] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:34.832642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb266c5-6f21-422e-9056-72bb78fc2be7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:34.835447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3cb266c5-6f21-422e-9056-72bb78fc2be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:34.946929 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 905/1803] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:34 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:34.950979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8239-55b4-4d1b-bda9-9b91e236750b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:34.952834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8239-55b4-4d1b-bda9-9b91e236750b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:34.954254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8239-55b4-4d1b-bda9-9b91e236750b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:34.982849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb266c5-6f21-422e-9056-72bb78fc2be7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:35.005133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0aecd-05d9-4653-953d-51968849fb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:35.005929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0aecd-05d9-4653-953d-51968849fb67 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:35.006316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0aecd-05d9-4653-953d-51968849fb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:35.006724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0aecd-05d9-4653-953d-51968849fb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:35.009874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ddcc8239-55b4-4d1b-bda9-9b91e236750b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:35.013222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ddcc8239-55b4-4d1b-bda9-9b91e236750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:35.028850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0aecd-05d9-4653-953d-51968849fb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:35.030430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0aecd-05d9-4653-953d-51968849fb67 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:35.048584 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 906/1804] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:35.050150 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 899/1805] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:35.051930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0aecd-05d9-4653-953d-51968849fb67 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:35.061150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc8239-55b4-4d1b-bda9-9b91e236750b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:35.061150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ddcc8239-55b4-4d1b-bda9-9b91e236750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:35.093045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0aecd-05d9-4653-953d-51968849fb67 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:35.102997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc8239-55b4-4d1b-bda9-9b91e236750b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:35.117695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a60a5-4b5f-4555-ba2c-220fc40678ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:35.118584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a60a5-4b5f-4555-ba2c-220fc40678ae admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:35.119940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a60a5-4b5f-4555-ba2c-220fc40678ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:35.120899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a60a5-4b5f-4555-ba2c-220fc40678ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:35.121804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a60a5-4b5f-4555-ba2c-220fc40678ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:35.123062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a60a5-4b5f-4555-ba2c-220fc40678ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:35.123608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3002ffa-d62a-44c0-9e7b-2b4e31ba4413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:35.128383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3002ffa-d62a-44c0-9e7b-2b4e31ba4413 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:35.129068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3002ffa-d62a-44c0-9e7b-2b4e31ba4413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:35.130429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3002ffa-d62a-44c0-9e7b-2b4e31ba4413 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:35.131456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3002ffa-d62a-44c0-9e7b-2b4e31ba4413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:35.131805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a60a5-4b5f-4555-ba2c-220fc40678ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:35.144155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3002ffa-d62a-44c0-9e7b-2b4e31ba4413 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:35.190326 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 900/1806] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:35.194412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a60a5-4b5f-4555-ba2c-220fc40678ae admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:35.259172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a60a5-4b5f-4555-ba2c-220fc40678ae admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:35.291784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2776e-aff4-46b5-8eb5-4a42374b8e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:35.292283 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 907/1807] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:35 2022] POST /identity/v3/projects => generated 395 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:35.293704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2776e-aff4-46b5-8eb5-4a42374b8e09 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:35.294221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2776e-aff4-46b5-8eb5-4a42374b8e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:35.296703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3002ffa-d62a-44c0-9e7b-2b4e31ba4413 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:35.297125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2776e-aff4-46b5-8eb5-4a42374b8e09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:35.298030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2776e-aff4-46b5-8eb5-4a42374b8e09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:35.300987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2776e-aff4-46b5-8eb5-4a42374b8e09 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:35.304872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b3002ffa-d62a-44c0-9e7b-2b4e31ba4413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:35.361228 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 901/1808] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:35 2022] POST /identity/v3/projects => generated 391 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:35.366416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2776e-aff4-46b5-8eb5-4a42374b8e09 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:35.444623 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:35.498134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3002ffa-d62a-44c0-9e7b-2b4e31ba4413 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:35.616472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2776e-aff4-46b5-8eb5-4a42374b8e09 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:35.630253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418644f-942a-4311-8c11-f17f6500b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:35.631576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418644f-942a-4311-8c11-f17f6500b0ae admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:35.631861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418644f-942a-4311-8c11-f17f6500b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:35.633239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418644f-942a-4311-8c11-f17f6500b0ae admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:35.637018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418644f-942a-4311-8c11-f17f6500b0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:35.642156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418644f-942a-4311-8c11-f17f6500b0ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:35.712034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:35.715902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:35.716106 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 902/1809] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:35 2022] POST /identity/v3/users => generated 304 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:35.716764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:35.717195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] PATH_INFO: `/v3/projects/0055d1a9ff6c4d6991a320051c912422` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:35.718460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418644f-942a-4311-8c11-f17f6500b0ae admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:35.725592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0055d1a9ff6c4d6991a320051c912422)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:35.728024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:35.751138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418644f-942a-4311-8c11-f17f6500b0ae admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:35.770824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4cae6-fd72-4e78-a0bc-009bd4f095ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:35.771458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4cae6-fd72-4e78-a0bc-009bd4f095ff admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:35.771786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4cae6-fd72-4e78-a0bc-009bd4f095ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:35.772097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4cae6-fd72-4e78-a0bc-009bd4f095ff admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:35.784092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4cae6-fd72-4e78-a0bc-009bd4f095ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:35.790629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4cae6-fd72-4e78-a0bc-009bd4f095ff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:35.868100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0055d1a9ff6c4d6991a320051c912422', 'request_id': 'req-a138ad7f-060c-4dc4-b32b-172708c1d39a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:35.873797 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 903/1810] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:35 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:35.883957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4cae6-fd72-4e78-a0bc-009bd4f095ff admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:35.886126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0055d1a9ff6c4d6991a320051c912422', 'request_id': 'req-a138ad7f-060c-4dc4-b32b-172708c1d39a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:35.894139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9ea4cae6-fd72-4e78-a0bc-009bd4f095ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:35.911357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0055d1a9ff6c4d6991a320051c912422', 'request_id': 'req-a138ad7f-060c-4dc4-b32b-172708c1d39a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:35.946086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4cae6-fd72-4e78-a0bc-009bd4f095ff admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:35.946857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] The token cache is being invalidate because project 0055d1a9ff6c4d6991a320051c912422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:35.947157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:35.947893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:35.949783 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 908/1811] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:35 2022] DELETE /identity/v3/projects/0055d1a9ff6c4d6991a320051c912422 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:35.950731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:35.964274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:36.009491 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:36.126065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ad7f-060c-4dc4-b32b-172708c1d39a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:36.139174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049032f6-4b7d-4d41-ab1c-4f1e74376847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:36.139762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049032f6-4b7d-4d41-ab1c-4f1e74376847 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:36.140046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049032f6-4b7d-4d41-ab1c-4f1e74376847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:36.140309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049032f6-4b7d-4d41-ab1c-4f1e74376847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:36.140963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049032f6-4b7d-4d41-ab1c-4f1e74376847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:36.142565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049032f6-4b7d-4d41-ab1c-4f1e74376847 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:36.151579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:36.155110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:36.161724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:36.161724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] PATH_INFO: `/v3/users/994eb50d38864845a18199dd594ef47b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:36.162046 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:36.162154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=994eb50d38864845a18199dd594ef47b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:36.166717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:36.173356 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 909/1812] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:36.175768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049032f6-4b7d-4d41-ab1c-4f1e74376847 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:36.185500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-049032f6-4b7d-4d41-ab1c-4f1e74376847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:36.222440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049032f6-4b7d-4d41-ab1c-4f1e74376847 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:36.236769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795c5d6-9892-40a3-95bc-9f9d3010ac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:36.238309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c5d6-9892-40a3-95bc-9f9d3010ac01 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:36.239677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c5d6-9892-40a3-95bc-9f9d3010ac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:36.240198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c5d6-9892-40a3-95bc-9f9d3010ac01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:36.243240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795c5d6-9892-40a3-95bc-9f9d3010ac01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:36.248211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795c5d6-9892-40a3-95bc-9f9d3010ac01 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:36.282097 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 910/1813] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:36.283206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0af08d-3e77-4aaf-9ff4-09fbac0db81d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:36.284402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0af08d-3e77-4aaf-9ff4-09fbac0db81d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:36.287715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0af08d-3e77-4aaf-9ff4-09fbac0db81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:36.292852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994eb50d38864845a18199dd594ef47b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:36.323951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994eb50d38864845a18199dd594ef47b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:36.327805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994eb50d38864845a18199dd594ef47b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:36.343418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7c0af08d-3e77-4aaf-9ff4-09fbac0db81d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:36.344028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994eb50d38864845a18199dd594ef47b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:36.348922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7c0af08d-3e77-4aaf-9ff4-09fbac0db81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:36.364971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994eb50d38864845a18199dd594ef47b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:36.371782 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 911/1814] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:36.374986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0af08d-3e77-4aaf-9ff4-09fbac0db81d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:36.379412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7c0af08d-3e77-4aaf-9ff4-09fbac0db81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:36.395683 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 904/1815] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:35 2022] DELETE /identity/v3/users/994eb50d38864845a18199dd594ef47b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:36.395683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:36.396440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:36.410205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0af08d-3e77-4aaf-9ff4-09fbac0db81d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:36.565369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed402383-be43-4d81-9182-eb22726bed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:36.566308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402383-be43-4d81-9182-eb22726bed1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:36.568716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402383-be43-4d81-9182-eb22726bed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:36.569325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402383-be43-4d81-9182-eb22726bed1a admin admin] PATH_INFO: `/v3/projects/0689cfb594ea4d7b8c67766a5debfb0f/users/09c0eb3f4d194c6bb7a9cb17181af537/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:36.570509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d6a56-5e8f-447d-bb0f-a8e43028e2bd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:36.585481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6f9d4-8a6a-4d81-88f8-86e080d60f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:36.586621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6f9d4-8a6a-4d81-88f8-86e080d60f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:36.586621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6f9d4-8a6a-4d81-88f8-86e080d60f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:36.586914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6f9d4-8a6a-4d81-88f8-86e080d60f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:36.587781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6f9d4-8a6a-4d81-88f8-86e080d60f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:36.589607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6f9d4-8a6a-4d81-88f8-86e080d60f9c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:36.616805 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 905/1816] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:36.616805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461016b4-f105-4d5c-8b1f-42887e4ae228 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:36.617295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461016b4-f105-4d5c-8b1f-42887e4ae228 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:36.619176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461016b4-f105-4d5c-8b1f-42887e4ae228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:36.628368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed402383-be43-4d81-9182-eb22726bed1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0689cfb594ea4d7b8c67766a5debfb0f, user_id=09c0eb3f4d194c6bb7a9cb17181af537, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:36.637426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed402383-be43-4d81-9182-eb22726bed1a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:36.676725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-461016b4-f105-4d5c-8b1f-42887e4ae228 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:36.680684 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 912/1817] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:36 2022] PUT /identity/v3/projects/0689cfb594ea4d7b8c67766a5debfb0f/users/09c0eb3f4d194c6bb7a9cb17181af537/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:36.680684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70200-f23d-4f4e-974c-153fd66b361d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:36.680908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-461016b4-f105-4d5c-8b1f-42887e4ae228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:36.680992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70200-f23d-4f4e-974c-153fd66b361d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:36.680992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70200-f23d-4f4e-974c-153fd66b361d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:36.739211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d8b70200-f23d-4f4e-974c-153fd66b361d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:36.743083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d8b70200-f23d-4f4e-974c-153fd66b361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:36.763436 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:36.864716 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 906/1818] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:36.869563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461016b4-f105-4d5c-8b1f-42887e4ae228 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:36.881173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461016b4-f105-4d5c-8b1f-42887e4ae228 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:36.886588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a8c42-98e2-4169-be2d-3ee472f14b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:36.887323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a8c42-98e2-4169-be2d-3ee472f14b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:36.887664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a8c42-98e2-4169-be2d-3ee472f14b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:36.887901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a8c42-98e2-4169-be2d-3ee472f14b87 admin admin] PATH_INFO: `/v3/projects/250f511a81814eea86932b99c9be12d0/users/03bde131e97845fea2739c94065c227f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:36.907296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a8c42-98e2-4169-be2d-3ee472f14b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=250f511a81814eea86932b99c9be12d0, user_id=03bde131e97845fea2739c94065c227f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:36.910929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a8c42-98e2-4169-be2d-3ee472f14b87 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:36.937478 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 907/1819] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:36 2022] PUT /identity/v3/projects/250f511a81814eea86932b99c9be12d0/users/03bde131e97845fea2739c94065c227f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:36.939540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a8c42-98e2-4169-be2d-3ee472f14b87 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:37.024267 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 913/1820] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:37.026003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b70200-f23d-4f4e-974c-153fd66b361d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:37.052365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b70200-f23d-4f4e-974c-153fd66b361d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:37.110231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a8c42-98e2-4169-be2d-3ee472f14b87 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:37.122658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1c586-cacd-44e9-ade3-55063b795019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:37.123617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1c586-cacd-44e9-ade3-55063b795019 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:37.123822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1c586-cacd-44e9-ade3-55063b795019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:37.124138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1c586-cacd-44e9-ade3-55063b795019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:37.124912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1c586-cacd-44e9-ade3-55063b795019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:37.127227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1c586-cacd-44e9-ade3-55063b795019 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:37.192221 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 908/1821] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:37.193762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d5cad-919a-49e9-8615-e119d551368d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:37.194129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d5cad-919a-49e9-8615-e119d551368d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:37.194406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d5cad-919a-49e9-8615-e119d551368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:37.218380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c8746-a0f7-437d-9211-767a2788003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:37.218380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8746-a0f7-437d-9211-767a2788003a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:37.218380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8746-a0f7-437d-9211-767a2788003a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:37.219005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8746-a0f7-437d-9211-767a2788003a admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:37.219769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c8746-a0f7-437d-9211-767a2788003a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:37.220179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c8746-a0f7-437d-9211-767a2788003a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:37.222723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c8746-a0f7-437d-9211-767a2788003a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:37.239661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-563d5cad-919a-49e9-8615-e119d551368d None None] MFA Rules not processed for user `03bde131e97845fea2739c94065c227f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:37.241218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-563d5cad-919a-49e9-8615-e119d551368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:37.244874 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:37.259935 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 914/1822] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:37.261227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c8746-a0f7-437d-9211-767a2788003a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:37.264449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1f6c8746-a0f7-437d-9211-767a2788003a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:37.373138 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 909/1823] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:37.375823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d5cad-919a-49e9-8615-e119d551368d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:37.404489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c8746-a0f7-437d-9211-767a2788003a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:37.408559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d5cad-919a-49e9-8615-e119d551368d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:37.431321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa9cf4-735f-4b40-b6ed-9b33ac8653c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:37.431960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa9cf4-735f-4b40-b6ed-9b33ac8653c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:37.432242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa9cf4-735f-4b40-b6ed-9b33ac8653c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:37.432515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa9cf4-735f-4b40-b6ed-9b33ac8653c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:37.437856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511222e-b9d1-4afb-995e-05bdd196402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:37.438542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511222e-b9d1-4afb-995e-05bdd196402d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:37.441797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511222e-b9d1-4afb-995e-05bdd196402d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:37.442994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511222e-b9d1-4afb-995e-05bdd196402d admin admin] PATH_INFO: `/v3/projects/0689cfb594ea4d7b8c67766a5debfb0f/users/09c0eb3f4d194c6bb7a9cb17181af537/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:37.451230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511222e-b9d1-4afb-995e-05bdd196402d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0689cfb594ea4d7b8c67766a5debfb0f, user_id=09c0eb3f4d194c6bb7a9cb17181af537, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:37.454088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511222e-b9d1-4afb-995e-05bdd196402d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:37.461379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa9cf4-735f-4b40-b6ed-9b33ac8653c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:37.462858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa9cf4-735f-4b40-b6ed-9b33ac8653c5 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:37.517881 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 910/1824] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:37 2022] PUT /identity/v3/projects/0689cfb594ea4d7b8c67766a5debfb0f/users/09c0eb3f4d194c6bb7a9cb17181af537/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:37.521278 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 915/1825] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:37.521807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511222e-b9d1-4afb-995e-05bdd196402d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:37.524574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff827be3-f719-4a0a-bf16-9e0305e425e3 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:37.524873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff827be3-f719-4a0a-bf16-9e0305e425e3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:37.525148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff827be3-f719-4a0a-bf16-9e0305e425e3 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:37.529913 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 916/1826] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 01:00:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:37.532680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff827be3-f719-4a0a-bf16-9e0305e425e3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:37.570905 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:37.716473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511222e-b9d1-4afb-995e-05bdd196402d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:37.735325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e891f8c-9619-4f48-b4d5-45b9c01f3ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:37.735960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891f8c-9619-4f48-b4d5-45b9c01f3ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:37.736341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891f8c-9619-4f48-b4d5-45b9c01f3ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:37.736525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891f8c-9619-4f48-b4d5-45b9c01f3ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:37.738469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891f8c-9619-4f48-b4d5-45b9c01f3ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:37.740885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff827be3-f719-4a0a-bf16-9e0305e425e3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:37.743949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891f8c-9619-4f48-b4d5-45b9c01f3ef0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:37.762176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc7de2-6710-42a4-8a63-808da300d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:37.762836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7de2-6710-42a4-8a63-808da300d808 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:37.763125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7de2-6710-42a4-8a63-808da300d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:37.763436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7de2-6710-42a4-8a63-808da300d808 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:37.764068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc7de2-6710-42a4-8a63-808da300d808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:37.766085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc7de2-6710-42a4-8a63-808da300d808 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:37.841361 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 911/1827] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:37 2022] POST /identity/v3/projects => generated 409 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:37.845237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d6b6b-f640-47a9-9649-5db0afd93f86 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:37.846927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d6b6b-f640-47a9-9649-5db0afd93f86 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:37.847235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d6b6b-f640-47a9-9649-5db0afd93f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:37.855534 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 917/1828] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:37 2022] POST /identity/v3/projects => generated 393 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:37.857759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d695c07-0e7e-4acc-aaf0-d15924952de7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:37.858542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d695c07-0e7e-4acc-aaf0-d15924952de7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:37.859116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d695c07-0e7e-4acc-aaf0-d15924952de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:37.904050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4d695c07-0e7e-4acc-aaf0-d15924952de7 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:37.905964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4d695c07-0e7e-4acc-aaf0-d15924952de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:37.951850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-163d6b6b-f640-47a9-9649-5db0afd93f86 None None] MFA Rules not processed for user `09c0eb3f4d194c6bb7a9cb17181af537`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:37.956250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-163d6b6b-f640-47a9-9649-5db0afd93f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:38.207405 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 918/1829] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:38.217229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d695c07-0e7e-4acc-aaf0-d15924952de7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:38.223254 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 912/1830] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:38.224254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d6b6b-f640-47a9-9649-5db0afd93f86 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:38.278841 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:38.387058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d6b6b-f640-47a9-9649-5db0afd93f86 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:38.412765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc787f3f-7e5d-4f21-881a-4257d32ef041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:38.413891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc787f3f-7e5d-4f21-881a-4257d32ef041 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:38.415303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc787f3f-7e5d-4f21-881a-4257d32ef041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:38.415886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc787f3f-7e5d-4f21-881a-4257d32ef041 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:38.425714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc787f3f-7e5d-4f21-881a-4257d32ef041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:38.428910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc787f3f-7e5d-4f21-881a-4257d32ef041 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:38.456957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d695c07-0e7e-4acc-aaf0-d15924952de7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:38.501273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76da502-dddb-47c1-9517-e83a499109b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:38.504113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76da502-dddb-47c1-9517-e83a499109b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:38.508049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76da502-dddb-47c1-9517-e83a499109b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:38.508974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76da502-dddb-47c1-9517-e83a499109b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:38.513746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76da502-dddb-47c1-9517-e83a499109b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:38.527787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76da502-dddb-47c1-9517-e83a499109b7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:38.534292 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 913/1831] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:38 2022] POST /identity/v3/users => generated 303 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:38.538588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03270b-cac3-43b9-9f0f-3f3af24d2276 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:38.542164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03270b-cac3-43b9-9f0f-3f3af24d2276 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:38.544565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03270b-cac3-43b9-9f0f-3f3af24d2276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:38.624214 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 919/1832] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:38 2022] POST /identity/v3/users => generated 305 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:38.624214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76da502-dddb-47c1-9517-e83a499109b7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:38.644854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1c03270b-cac3-43b9-9f0f-3f3af24d2276 None None] MFA Rules not processed for user `0533d6c52e394ecc980d67c7d985076e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:38.646783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1c03270b-cac3-43b9-9f0f-3f3af24d2276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:38.650850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76da502-dddb-47c1-9517-e83a499109b7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:38.661919 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:38.664616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1a744-388b-4bb9-8c66-d2ef3f0d18b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:38.666928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1a744-388b-4bb9-8c66-d2ef3f0d18b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:38.667198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1a744-388b-4bb9-8c66-d2ef3f0d18b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:38.668091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1a744-388b-4bb9-8c66-d2ef3f0d18b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:38.669569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1a744-388b-4bb9-8c66-d2ef3f0d18b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:38.676444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1a744-388b-4bb9-8c66-d2ef3f0d18b3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:38.736826 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 920/1833] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:38 2022] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:38.736826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1a744-388b-4bb9-8c66-d2ef3f0d18b3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:38.739044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4ce1a744-388b-4bb9-8c66-d2ef3f0d18b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:38.774346 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 914/1834] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:38.775452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03270b-cac3-43b9-9f0f-3f3af24d2276 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:38.776986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1c03270b-cac3-43b9-9f0f-3f3af24d2276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:38.796557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03270b-cac3-43b9-9f0f-3f3af24d2276 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:38.889054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1a744-388b-4bb9-8c66-d2ef3f0d18b3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:38.899988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9f7f2-3399-46b3-9b8b-fb9032f4fecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:38.900767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9f7f2-3399-46b3-9b8b-fb9032f4fecc service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:38.901132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9f7f2-3399-46b3-9b8b-fb9032f4fecc service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:38.901322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9f7f2-3399-46b3-9b8b-fb9032f4fecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:38.913538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9f7f2-3399-46b3-9b8b-fb9032f4fecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:38.915737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9f7f2-3399-46b3-9b8b-fb9032f4fecc service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:38.927806 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 921/1835] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:38.928629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9f7f2-3399-46b3-9b8b-fb9032f4fecc service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:38.930109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-51b9f7f2-3399-46b3-9b8b-fb9032f4fecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:38.948854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:38.949520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:38.949805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:38.950082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] PATH_INFO: `/v3/projects/1a3017966de9442aad1e7fb2c8cc57ae` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:38.951886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3017966de9442aad1e7fb2c8cc57ae)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:38.953844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:39.057772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3017966de9442aad1e7fb2c8cc57ae', 'request_id': 'req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.067379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3017966de9442aad1e7fb2c8cc57ae', 'request_id': 'req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.069942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9f7f2-3399-46b3-9b8b-fb9032f4fecc service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:39.077401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3017966de9442aad1e7fb2c8cc57ae', 'request_id': 'req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.090185 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:39.095756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] The token cache is being invalidate because project 1a3017966de9442aad1e7fb2c8cc57ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:39.096273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.097166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.099243 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 915/1836] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:38 2022] DELETE /identity/v3/projects/1a3017966de9442aad1e7fb2c8cc57ae => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:39.100062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:39.101590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:39.152326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:39.153262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:39.153688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:39.153985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] PATH_INFO: `/v3/projects/f5a069becb8642149d109f364764f114` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:39.155800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a069becb8642149d109f364764f114)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:39.158295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:39.169370 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:39.211908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cc6f5-2f43-4bb0-ac05-16c51652a056 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:39.231474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a069becb8642149d109f364764f114', 'request_id': 'req-7ab64add-344f-4428-8e5f-95370ae3f26c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.241558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a069becb8642149d109f364764f114', 'request_id': 'req-7ab64add-344f-4428-8e5f-95370ae3f26c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.256893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a069becb8642149d109f364764f114', 'request_id': 'req-7ab64add-344f-4428-8e5f-95370ae3f26c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.278933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] The token cache is being invalidate because project f5a069becb8642149d109f364764f114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:39.280132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.282752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.285596 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 922/1837] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:38 2022] DELETE /identity/v3/projects/f5a069becb8642149d109f364764f114 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:39.290436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:39.293839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:39.311418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a92cb-41ed-4c11-ae16-d09b2bc55223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:39.311894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a92cb-41ed-4c11-ae16-d09b2bc55223 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:39.318912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a92cb-41ed-4c11-ae16-d09b2bc55223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:39.319249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a92cb-41ed-4c11-ae16-d09b2bc55223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:39.320266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a92cb-41ed-4c11-ae16-d09b2bc55223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:39.321902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a92cb-41ed-4c11-ae16-d09b2bc55223 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:39.335185 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 916/1838] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:39.336036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a92cb-41ed-4c11-ae16-d09b2bc55223 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:39.338719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-141a92cb-41ed-4c11-ae16-d09b2bc55223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:39.357237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a92cb-41ed-4c11-ae16-d09b2bc55223 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:39.364480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252f1f-aae9-4a05-9e85-81c3ecf698d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:39.365179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252f1f-aae9-4a05-9e85-81c3ecf698d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:39.365461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252f1f-aae9-4a05-9e85-81c3ecf698d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:39.365801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252f1f-aae9-4a05-9e85-81c3ecf698d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:39.366563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252f1f-aae9-4a05-9e85-81c3ecf698d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:39.368960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252f1f-aae9-4a05-9e85-81c3ecf698d5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:39.377927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab64add-344f-4428-8e5f-95370ae3f26c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:39.384752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a3deb-2862-4600-9c1f-386eb3127251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:39.385603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3deb-2862-4600-9c1f-386eb3127251 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:39.385965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3deb-2862-4600-9c1f-386eb3127251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:39.386299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3deb-2862-4600-9c1f-386eb3127251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:39.387022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a3deb-2862-4600-9c1f-386eb3127251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:39.388790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a3deb-2862-4600-9c1f-386eb3127251 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:39.397237 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 917/1839] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:39 2022] POST /identity/v3/users => generated 297 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:39.398247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252f1f-aae9-4a05-9e85-81c3ecf698d5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:39.404260 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 923/1840] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:39.404389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9e252f1f-aae9-4a05-9e85-81c3ecf698d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:39.405476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a3deb-2862-4600-9c1f-386eb3127251 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:39.417408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e87a3deb-2862-4600-9c1f-386eb3127251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:39.441963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252f1f-aae9-4a05-9e85-81c3ecf698d5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:39.453290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a3deb-2862-4600-9c1f-386eb3127251 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:39.461301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56780722-e3c2-4fd1-9ae7-1ac5812fd967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:39.461934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56780722-e3c2-4fd1-9ae7-1ac5812fd967 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:39.462219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56780722-e3c2-4fd1-9ae7-1ac5812fd967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:39.462494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56780722-e3c2-4fd1-9ae7-1ac5812fd967 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:39.463182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56780722-e3c2-4fd1-9ae7-1ac5812fd967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:39.465692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56780722-e3c2-4fd1-9ae7-1ac5812fd967 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:39.474013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:39.475550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:39.475550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:39.475550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] PATH_INFO: `/v3/users/bbadcc55221a4c8c9e07da910cc6170d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:39.476869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbadcc55221a4c8c9e07da910cc6170d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:39.488501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:39.569298 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 918/1841] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:39 2022] POST /identity/v3/projects => generated 403 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:39.571139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56780722-e3c2-4fd1-9ae7-1ac5812fd967 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:39.574755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-56780722-e3c2-4fd1-9ae7-1ac5812fd967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:39.586247 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:39.593165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbadcc55221a4c8c9e07da910cc6170d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.616717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbadcc55221a4c8c9e07da910cc6170d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.620121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbadcc55221a4c8c9e07da910cc6170d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.641063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbadcc55221a4c8c9e07da910cc6170d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.642505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbadcc55221a4c8c9e07da910cc6170d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:39.667452 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 924/1842] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:39 2022] DELETE /identity/v3/users/bbadcc55221a4c8c9e07da910cc6170d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:39.672325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:39.673999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:39.742453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56780722-e3c2-4fd1-9ae7-1ac5812fd967 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:39.810235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f10f-7d7d-4d1a-9e94-afdb4f951ee4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:39.816774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba8779-0efd-4dc3-a9bb-0c920495a2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:39.817444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba8779-0efd-4dc3-a9bb-0c920495a2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:39.817724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba8779-0efd-4dc3-a9bb-0c920495a2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:39.817997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba8779-0efd-4dc3-a9bb-0c920495a2cd admin admin] PATH_INFO: `/v3/projects/27a42aff44864ea9bba2caa1b7b557af/users/9c6949fc51cb4fd680e2cc682cb94036/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:39.844910 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:39.855012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba8779-0efd-4dc3-a9bb-0c920495a2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a42aff44864ea9bba2caa1b7b557af, user_id=9c6949fc51cb4fd680e2cc682cb94036, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:39.865209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba8779-0efd-4dc3-a9bb-0c920495a2cd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:39.868278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:39.869617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:39.870001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:39.870452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] PATH_INFO: `/v3/users/d262f343126f4ba08192d817f6c2eb84` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:39.872199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d262f343126f4ba08192d817f6c2eb84)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:39.875487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:39.890440 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 925/1843] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:39 2022] PUT /identity/v3/projects/27a42aff44864ea9bba2caa1b7b557af/users/9c6949fc51cb4fd680e2cc682cb94036/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:39.895790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba8779-0efd-4dc3-a9bb-0c920495a2cd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:39.897525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ebba8779-0efd-4dc3-a9bb-0c920495a2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:39.990423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd262f343126f4ba08192d817f6c2eb84'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:40.009103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd262f343126f4ba08192d817f6c2eb84'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:40.010421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd262f343126f4ba08192d817f6c2eb84'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:40.022503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd262f343126f4ba08192d817f6c2eb84'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:40.056594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd262f343126f4ba08192d817f6c2eb84'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:40.068271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba8779-0efd-4dc3-a9bb-0c920495a2cd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:40.073367 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 919/1844] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:39 2022] DELETE /identity/v3/users/d262f343126f4ba08192d817f6c2eb84 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:40.074873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:40.076369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:40.206096 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:40.229745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a16483-d8fc-42b3-bbac-c6bacf635e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:40.230439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a16483-d8fc-42b3-bbac-c6bacf635e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:40.230760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a16483-d8fc-42b3-bbac-c6bacf635e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:40.231037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a16483-d8fc-42b3-bbac-c6bacf635e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:40.232141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a16483-d8fc-42b3-bbac-c6bacf635e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:40.233950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a16483-d8fc-42b3-bbac-c6bacf635e68 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:40.240750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb475eca-7784-439c-b1e5-37e2643d3946 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:40.251280 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 926/1845] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:40.253765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a16483-d8fc-42b3-bbac-c6bacf635e68 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:40.256481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4397f-bb9e-4506-b069-6cf511888086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:40.257922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4397f-bb9e-4506-b069-6cf511888086 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:40.258208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4397f-bb9e-4506-b069-6cf511888086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:40.258554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4397f-bb9e-4506-b069-6cf511888086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:40.259248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-99a16483-d8fc-42b3-bbac-c6bacf635e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:40.259370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4397f-bb9e-4506-b069-6cf511888086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:40.261192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4397f-bb9e-4506-b069-6cf511888086 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:40.275789 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 920/1846] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:40.281145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4397f-bb9e-4506-b069-6cf511888086 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:40.282849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dad4397f-bb9e-4506-b069-6cf511888086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:40.296220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a16483-d8fc-42b3-bbac-c6bacf635e68 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:40.307081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4397f-bb9e-4506-b069-6cf511888086 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:40.311423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebfef7-8667-4543-9e28-a186d738bb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:40.312060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebfef7-8667-4543-9e28-a186d738bb5c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:40.312342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebfef7-8667-4543-9e28-a186d738bb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:40.312614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebfef7-8667-4543-9e28-a186d738bb5c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:40.313458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebfef7-8667-4543-9e28-a186d738bb5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:40.320123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fea912-a0b9-46e2-9cdc-0cc77c5db137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:40.320676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebfef7-8667-4543-9e28-a186d738bb5c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:40.322926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fea912-a0b9-46e2-9cdc-0cc77c5db137 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:40.324403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fea912-a0b9-46e2-9cdc-0cc77c5db137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:40.324764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fea912-a0b9-46e2-9cdc-0cc77c5db137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:40.326896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fea912-a0b9-46e2-9cdc-0cc77c5db137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:40.328978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fea912-a0b9-46e2-9cdc-0cc77c5db137 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:40.371894 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 921/1847] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:40.372848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fea912-a0b9-46e2-9cdc-0cc77c5db137 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:40.377791 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 927/1848] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:40 2022] POST /identity/v3/users => generated 308 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:40.377791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebfef7-8667-4543-9e28-a186d738bb5c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:40.378440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f7fea912-a0b9-46e2-9cdc-0cc77c5db137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:40.397335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebfef7-8667-4543-9e28-a186d738bb5c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:40.411512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695f447-e463-4967-94ed-8208a6a7d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:40.412316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695f447-e463-4967-94ed-8208a6a7d94f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:40.412602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695f447-e463-4967-94ed-8208a6a7d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:40.412958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695f447-e463-4967-94ed-8208a6a7d94f admin admin] PATH_INFO: `/v3/projects/add837b1ffcd4592bd662f6519605fc8/users/82af4233a03e4907a522e61dfcd4b3f6/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:40.416684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fea912-a0b9-46e2-9cdc-0cc77c5db137 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:40.448861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781f608-055c-45ae-b8c4-bb673be9bad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:40.449499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781f608-055c-45ae-b8c4-bb673be9bad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:40.450713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695f447-e463-4967-94ed-8208a6a7d94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=add837b1ffcd4592bd662f6519605fc8, user_id=82af4233a03e4907a522e61dfcd4b3f6, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:40.451316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781f608-055c-45ae-b8c4-bb673be9bad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:40.452346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781f608-055c-45ae-b8c4-bb673be9bad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:40.453679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695f447-e463-4967-94ed-8208a6a7d94f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:40.457162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781f608-055c-45ae-b8c4-bb673be9bad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:40.477320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781f608-055c-45ae-b8c4-bb673be9bad5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:40.497008 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 928/1849] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:40 2022] PUT /identity/v3/projects/add837b1ffcd4592bd662f6519605fc8/users/82af4233a03e4907a522e61dfcd4b3f6/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:40.498035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695f447-e463-4967-94ed-8208a6a7d94f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:40.517531 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 922/1850] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:40.519533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781f608-055c-45ae-b8c4-bb673be9bad5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:40.542305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781f608-055c-45ae-b8c4-bb673be9bad5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:40.642736 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:40.647904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695f447-e463-4967-94ed-8208a6a7d94f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:40.659255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b4dc6-6c10-45dc-a848-8dcd56631f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:40.660988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b4dc6-6c10-45dc-a848-8dcd56631f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:40.661278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b4dc6-6c10-45dc-a848-8dcd56631f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:40.662780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b4dc6-6c10-45dc-a848-8dcd56631f8b admin admin] PATH_INFO: `/v3/projects/27a42aff44864ea9bba2caa1b7b557af/users/9c6949fc51cb4fd680e2cc682cb94036/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:40.667104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b4dc6-6c10-45dc-a848-8dcd56631f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a42aff44864ea9bba2caa1b7b557af, user_id=9c6949fc51cb4fd680e2cc682cb94036, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:40.673634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b4dc6-6c10-45dc-a848-8dcd56631f8b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:40.684569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e045a-9242-4989-b744-eab367a8283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:40.685550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e045a-9242-4989-b744-eab367a8283e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:40.686123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e045a-9242-4989-b744-eab367a8283e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:40.686635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e045a-9242-4989-b744-eab367a8283e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:40.687503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e045a-9242-4989-b744-eab367a8283e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:40.689639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e045a-9242-4989-b744-eab367a8283e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:40.699023 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 929/1851] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:40 2022] PUT /identity/v3/projects/27a42aff44864ea9bba2caa1b7b557af/users/9c6949fc51cb4fd680e2cc682cb94036/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:40.705889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d31d74-3a4f-4810-bd64-b590e32fb1cb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:40.705889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d31d74-3a4f-4810-bd64-b590e32fb1cb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:40.705889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d31d74-3a4f-4810-bd64-b590e32fb1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:40.709304 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 923/1852] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:40.723730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e045a-9242-4989-b744-eab367a8283e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:40.776364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e045a-9242-4989-b744-eab367a8283e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:40.794828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-57d31d74-3a4f-4810-bd64-b590e32fb1cb None None] MFA Rules not processed for user `82af4233a03e4907a522e61dfcd4b3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:40.796052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-57d31d74-3a4f-4810-bd64-b590e32fb1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:40.968790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c117649-3595-4ff6-a0f4-7d78e74baf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:40.976149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c117649-3595-4ff6-a0f4-7d78e74baf15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:40.977357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c117649-3595-4ff6-a0f4-7d78e74baf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:40.978540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c117649-3595-4ff6-a0f4-7d78e74baf15 admin admin] PATH_INFO: `/v3/projects/971a3b910aec48df8184ce85d2ee104b/users/df350b4c21de4ff38591b461b64526d7/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:40.992144 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 930/1853] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:40 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:40.993420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d31d74-3a4f-4810-bd64-b590e32fb1cb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:40.996261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-57d31d74-3a4f-4810-bd64-b590e32fb1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:41.019265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d31d74-3a4f-4810-bd64-b590e32fb1cb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:41.026152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:41.027117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:41.029026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:41.029338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] PATH_INFO: `/v3/projects/502fab92439d47ba935a887c56189ad1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:41.032418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502fab92439d47ba935a887c56189ad1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:41.038673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:41.050896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c117649-3595-4ff6-a0f4-7d78e74baf15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971a3b910aec48df8184ce85d2ee104b, user_id=df350b4c21de4ff38591b461b64526d7, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:41.053992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c117649-3595-4ff6-a0f4-7d78e74baf15 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:41.092930 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:41.103708 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 924/1854] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:40 2022] PUT /identity/v3/projects/971a3b910aec48df8184ce85d2ee104b/users/df350b4c21de4ff38591b461b64526d7/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:41.116890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c117649-3595-4ff6-a0f4-7d78e74baf15 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:41.132136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502fab92439d47ba935a887c56189ad1', 'request_id': 'req-db49990e-6502-465e-a7fb-144a57327ec0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:41.153042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502fab92439d47ba935a887c56189ad1', 'request_id': 'req-db49990e-6502-465e-a7fb-144a57327ec0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:41.165995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502fab92439d47ba935a887c56189ad1', 'request_id': 'req-db49990e-6502-465e-a7fb-144a57327ec0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:41.194185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] The token cache is being invalidate because project 502fab92439d47ba935a887c56189ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:41.195700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:41.196972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-db49990e-6502-465e-a7fb-144a57327ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:41.205517 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 931/1855] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:40 2022] DELETE /identity/v3/projects/502fab92439d47ba935a887c56189ad1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:41.207457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd02ad-7e74-442e-9e14-0dbb6430de94 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:41.208485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd02ad-7e74-442e-9e14-0dbb6430de94 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:41.208867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd02ad-7e74-442e-9e14-0dbb6430de94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:41.248540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c117649-3595-4ff6-a0f4-7d78e74baf15 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:41.295043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a0cd02ad-7e74-442e-9e14-0dbb6430de94 None None] MFA Rules not processed for user `9c6949fc51cb4fd680e2cc682cb94036`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:41.295043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a0cd02ad-7e74-442e-9e14-0dbb6430de94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:41.343324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795c7cc-4d73-4df8-ba2a-8b068065a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:41.344636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c7cc-4d73-4df8-ba2a-8b068065a186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:41.344935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c7cc-4d73-4df8-ba2a-8b068065a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:41.345212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c7cc-4d73-4df8-ba2a-8b068065a186 admin admin] PATH_INFO: `/v3/projects/7518f1de0ef84eccaee457e1e8d83eda/users/058aa80c9ad24366be4f9e6ee9702679/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:41.372120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795c7cc-4d73-4df8-ba2a-8b068065a186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7518f1de0ef84eccaee457e1e8d83eda, user_id=058aa80c9ad24366be4f9e6ee9702679, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:41.375305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795c7cc-4d73-4df8-ba2a-8b068065a186 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:41.379887 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:41.411938 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 925/1856] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:41 2022] PUT /identity/v3/projects/7518f1de0ef84eccaee457e1e8d83eda/users/058aa80c9ad24366be4f9e6ee9702679/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:41.413591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795c7cc-4d73-4df8-ba2a-8b068065a186 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:41.419263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3795c7cc-4d73-4df8-ba2a-8b068065a186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:41.424200 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 932/1857] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:41.426351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd02ad-7e74-442e-9e14-0dbb6430de94 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:41.428449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a0cd02ad-7e74-442e-9e14-0dbb6430de94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:41.494272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd02ad-7e74-442e-9e14-0dbb6430de94 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:41.541659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795c7cc-4d73-4df8-ba2a-8b068065a186 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:41.554763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9dc35-c60c-475c-ad80-8505e685e828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:41.556140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9dc35-c60c-475c-ad80-8505e685e828 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:41.556682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9dc35-c60c-475c-ad80-8505e685e828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:41.557170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9dc35-c60c-475c-ad80-8505e685e828 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:41.558065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9dc35-c60c-475c-ad80-8505e685e828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:41.562151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9dc35-c60c-475c-ad80-8505e685e828 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:41.591977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:41.592904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:41.593255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:41.593590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] PATH_INFO: `/v3/projects/3c2bd1310ea14f57b3e68b199f9bd7ab` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:41.595669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2bd1310ea14f57b3e68b199f9bd7ab)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:41.598556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:41.664599 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 926/1858] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:41 2022] POST /identity/v3/projects => generated 407 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:41.666313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeef4b9-5e9b-4aa1-a5e9-a9fe556f2aed None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:41.666703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeef4b9-5e9b-4aa1-a5e9-a9fe556f2aed None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:41.667157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeef4b9-5e9b-4aa1-a5e9-a9fe556f2aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:41.678381 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:41.700679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2bd1310ea14f57b3e68b199f9bd7ab', 'request_id': 'req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:41.727868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2bd1310ea14f57b3e68b199f9bd7ab', 'request_id': 'req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:41.743926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2bd1310ea14f57b3e68b199f9bd7ab', 'request_id': 'req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:41.749399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-afeef4b9-5e9b-4aa1-a5e9-a9fe556f2aed None None] MFA Rules not processed for user `df350b4c21de4ff38591b461b64526d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:41.752029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-afeef4b9-5e9b-4aa1-a5e9-a9fe556f2aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:41.777081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] The token cache is being invalidate because project 3c2bd1310ea14f57b3e68b199f9bd7ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:41.777380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:41.781850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-997e1b9e-04e4-4df3-9acf-0d2a139ddaeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:41.790716 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 933/1859] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:41 2022] DELETE /identity/v3/projects/3c2bd1310ea14f57b3e68b199f9bd7ab => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:41.792446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb45b2-599f-420a-b859-72d4961faf51 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:41.792736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb45b2-599f-420a-b859-72d4961faf51 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:41.793010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb45b2-599f-420a-b859-72d4961faf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:41.820495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-63bb45b2-599f-420a-b859-72d4961faf51 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:41.822894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-63bb45b2-599f-420a-b859-72d4961faf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:41.875143 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 927/1860] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:41.876154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeef4b9-5e9b-4aa1-a5e9-a9fe556f2aed None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:41.877598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-afeef4b9-5e9b-4aa1-a5e9-a9fe556f2aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:41.933007 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 934/1861] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:41.934742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb45b2-599f-420a-b859-72d4961faf51 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:41.938377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-63bb45b2-599f-420a-b859-72d4961faf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:42.015034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeef4b9-5e9b-4aa1-a5e9-a9fe556f2aed None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:42.025246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08901b-97c9-4340-806a-06155a261636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:42.027870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08901b-97c9-4340-806a-06155a261636 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.028154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08901b-97c9-4340-806a-06155a261636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.028427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08901b-97c9-4340-806a-06155a261636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.030516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08901b-97c9-4340-806a-06155a261636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:42.032184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08901b-97c9-4340-806a-06155a261636 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:42.057659 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 928/1862] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:42.058472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08901b-97c9-4340-806a-06155a261636 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:42.061677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ab08901b-97c9-4340-806a-06155a261636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:42.084955 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:42.097185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08901b-97c9-4340-806a-06155a261636 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:42.105508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f4198-445a-49e5-aaa5-692543950917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:42.107182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb45b2-599f-420a-b859-72d4961faf51 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:42.108589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f4198-445a-49e5-aaa5-692543950917 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.108589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f4198-445a-49e5-aaa5-692543950917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.109027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f4198-445a-49e5-aaa5-692543950917 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.109687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f4198-445a-49e5-aaa5-692543950917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:42.113164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f4198-445a-49e5-aaa5-692543950917 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:42.124058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851c490-a5df-4f2a-9f9b-1e3ddfd93024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:42.124681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851c490-a5df-4f2a-9f9b-1e3ddfd93024 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.124960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851c490-a5df-4f2a-9f9b-1e3ddfd93024 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.125611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851c490-a5df-4f2a-9f9b-1e3ddfd93024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.129394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f851c490-a5df-4f2a-9f9b-1e3ddfd93024 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:42.177565 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 929/1863] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:42 2022] POST /identity/v3/users => generated 310 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:42.181213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cdcfa-38dd-4529-a683-37be54873a9b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.181729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cdcfa-38dd-4529-a683-37be54873a9b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.182004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cdcfa-38dd-4529-a683-37be54873a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.236094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f45cdcfa-38dd-4529-a683-37be54873a9b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:42.238465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f45cdcfa-38dd-4529-a683-37be54873a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:42.250862 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 930/1864] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:42.251816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cdcfa-38dd-4529-a683-37be54873a9b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:42.253886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f45cdcfa-38dd-4529-a683-37be54873a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:42.281786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cdcfa-38dd-4529-a683-37be54873a9b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:42.293212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851c490-a5df-4f2a-9f9b-1e3ddfd93024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:42.300427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc6d7c-1363-40d6-aafd-b137e37b00ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:42.301994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851c490-a5df-4f2a-9f9b-1e3ddfd93024 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:42.303601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6d7c-1363-40d6-aafd-b137e37b00ae service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.304032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6d7c-1363-40d6-aafd-b137e37b00ae service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.304314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6d7c-1363-40d6-aafd-b137e37b00ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.308795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8bdc6d7c-1363-40d6-aafd-b137e37b00ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:42.313761 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:42.339239 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 935/1865] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:42.354672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836401a-0d62-405f-89fb-892d23d9bcf6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.355284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836401a-0d62-405f-89fb-892d23d9bcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.361139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836401a-0d62-405f-89fb-892d23d9bcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.416899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4836401a-0d62-405f-89fb-892d23d9bcf6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:42.421060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4836401a-0d62-405f-89fb-892d23d9bcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:42.452424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 936/1866] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:42.453497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836401a-0d62-405f-89fb-892d23d9bcf6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:42.485246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836401a-0d62-405f-89fb-892d23d9bcf6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:42.485997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc6d7c-1363-40d6-aafd-b137e37b00ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:42.490501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc6d7c-1363-40d6-aafd-b137e37b00ae service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:42.510300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a672f49-6a73-43d3-a8de-50eb4443705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:42.511237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672f49-6a73-43d3-a8de-50eb4443705c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.512638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672f49-6a73-43d3-a8de-50eb4443705c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.513144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672f49-6a73-43d3-a8de-50eb4443705c admin admin] PATH_INFO: `/v3/projects/7518f1de0ef84eccaee457e1e8d83eda/users/058aa80c9ad24366be4f9e6ee9702679/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.515219 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 931/1867] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:42 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:42.518825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc6d7c-1363-40d6-aafd-b137e37b00ae service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:42.519867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a672f49-6a73-43d3-a8de-50eb4443705c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7518f1de0ef84eccaee457e1e8d83eda, user_id=058aa80c9ad24366be4f9e6ee9702679, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:42.524780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a672f49-6a73-43d3-a8de-50eb4443705c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:42.544824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc6d7c-1363-40d6-aafd-b137e37b00ae service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:42.551560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466e063-2d00-42ad-a3d2-ca3ee8c0af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:42.553578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e063-2d00-42ad-a3d2-ca3ee8c0af63 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.553875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e063-2d00-42ad-a3d2-ca3ee8c0af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.554153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e063-2d00-42ad-a3d2-ca3ee8c0af63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.556454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466e063-2d00-42ad-a3d2-ca3ee8c0af63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:42.559357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466e063-2d00-42ad-a3d2-ca3ee8c0af63 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:42.560442 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 937/1868] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:42 2022] PUT /identity/v3/projects/7518f1de0ef84eccaee457e1e8d83eda/users/058aa80c9ad24366be4f9e6ee9702679/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:42.561518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f6e6c-714f-457b-ac66-cf320151e8a3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.561803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f6e6c-714f-457b-ac66-cf320151e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.562079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f6e6c-714f-457b-ac66-cf320151e8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.593969 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 932/1869] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:42.595074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466e063-2d00-42ad-a3d2-ca3ee8c0af63 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:42.609599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-875f6e6c-714f-457b-ac66-cf320151e8a3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:42.611193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-875f6e6c-714f-457b-ac66-cf320151e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:42.617564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466e063-2d00-42ad-a3d2-ca3ee8c0af63 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:42.703579 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 938/1870] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:42.704769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f6e6c-714f-457b-ac66-cf320151e8a3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:42.716214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f6e6c-714f-457b-ac66-cf320151e8a3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:42.723344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55de02-48bc-4e02-bd2d-0abafc217ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:42.724366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55de02-48bc-4e02-bd2d-0abafc217ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.724803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55de02-48bc-4e02-bd2d-0abafc217ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.725423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55de02-48bc-4e02-bd2d-0abafc217ba7 admin admin] PATH_INFO: `/v3/projects/0f979977d8e341c08abbd6b80f227250/users/fc037a4fdbff45adbce4aa39d8b5d7fd/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.730822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ac69f-25de-41a9-be7f-42c63385ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:42.731713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac69f-25de-41a9-be7f-42c63385ec60 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.732002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac69f-25de-41a9-be7f-42c63385ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.732273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac69f-25de-41a9-be7f-42c63385ec60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.732988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ac69f-25de-41a9-be7f-42c63385ec60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:42.733443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ac69f-25de-41a9-be7f-42c63385ec60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:42.735259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ac69f-25de-41a9-be7f-42c63385ec60 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:42.759600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55de02-48bc-4e02-bd2d-0abafc217ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f979977d8e341c08abbd6b80f227250, user_id=fc037a4fdbff45adbce4aa39d8b5d7fd, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:42.763802 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 933/1871] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:42.763802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ac69f-25de-41a9-be7f-42c63385ec60 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:42.764503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55de02-48bc-4e02-bd2d-0abafc217ba7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:42.778682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ac69f-25de-41a9-be7f-42c63385ec60 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:42.793651 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 939/1872] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:42 2022] PUT /identity/v3/projects/0f979977d8e341c08abbd6b80f227250/users/fc037a4fdbff45adbce4aa39d8b5d7fd/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:42.795492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55de02-48bc-4e02-bd2d-0abafc217ba7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:42.864304 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:42.879999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67869f95-2e4c-4478-a86d-8656940679ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:42.880729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67869f95-2e4c-4478-a86d-8656940679ff admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.881046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67869f95-2e4c-4478-a86d-8656940679ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.881386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67869f95-2e4c-4478-a86d-8656940679ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.882447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67869f95-2e4c-4478-a86d-8656940679ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:42.882833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67869f95-2e4c-4478-a86d-8656940679ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:42.886205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67869f95-2e4c-4478-a86d-8656940679ff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:42.913168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55de02-48bc-4e02-bd2d-0abafc217ba7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:42.919298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8564e64-0583-4462-9c78-a077ec824b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:42.919922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8564e64-0583-4462-9c78-a077ec824b4c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.920206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8564e64-0583-4462-9c78-a077ec824b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.920484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8564e64-0583-4462-9c78-a077ec824b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.921473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8564e64-0583-4462-9c78-a077ec824b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:42.922236 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 934/1873] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:42.926773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8564e64-0583-4462-9c78-a077ec824b4c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:42.926925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba6d18-1200-4013-85bd-ee7398d8aeb2 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.928093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba6d18-1200-4013-85bd-ee7398d8aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.929381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba6d18-1200-4013-85bd-ee7398d8aeb2 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.933943 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 935/1874] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:00:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:42.935297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba6d18-1200-4013-85bd-ee7398d8aeb2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:42.964516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba6d18-1200-4013-85bd-ee7398d8aeb2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:42.972233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292de61-e466-4b50-8bde-8288546b7557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:42.973561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292de61-e466-4b50-8bde-8288546b7557 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:42.974027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292de61-e466-4b50-8bde-8288546b7557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:42.975669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292de61-e466-4b50-8bde-8288546b7557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:42.976945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292de61-e466-4b50-8bde-8288546b7557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:42.980927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292de61-e466-4b50-8bde-8288546b7557 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:42.990700 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 940/1875] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:42 2022] POST /identity/v3/projects => generated 359 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:42.991715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8564e64-0583-4462-9c78-a077ec824b4c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:43.007210 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 936/1876] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:43.009220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292de61-e466-4b50-8bde-8288546b7557 admin admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:00:43.070214 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:43.110710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8564e64-0583-4462-9c78-a077ec824b4c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:43.118850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcda3c1-941e-4555-a73c-754798606311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:43.119293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda3c1-941e-4555-a73c-754798606311 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:43.119579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda3c1-941e-4555-a73c-754798606311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:43.119855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda3c1-941e-4555-a73c-754798606311 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:43.120505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcda3c1-941e-4555-a73c-754798606311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:43.122463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcda3c1-941e-4555-a73c-754798606311 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:43.143562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292de61-e466-4b50-8bde-8288546b7557 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:43.179224 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 941/1877] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:42 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:43.187172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcda3c1-941e-4555-a73c-754798606311 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:43.277693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292de61-e466-4b50-8bde-8288546b7557 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:43.286772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcda3c1-941e-4555-a73c-754798606311 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:43.294548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048803a-dd12-475b-b6ba-01f44d56fa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:43.295546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048803a-dd12-475b-b6ba-01f44d56fa7b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:43.296041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048803a-dd12-475b-b6ba-01f44d56fa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:43.296496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048803a-dd12-475b-b6ba-01f44d56fa7b admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:43.297662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048803a-dd12-475b-b6ba-01f44d56fa7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:43.300216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048803a-dd12-475b-b6ba-01f44d56fa7b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:43.355196 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 942/1878] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:43 2022] POST /identity/v3/users => generated 280 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:43.355196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048803a-dd12-475b-b6ba-01f44d56fa7b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:43.358550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4048803a-dd12-475b-b6ba-01f44d56fa7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:43.373157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048803a-dd12-475b-b6ba-01f44d56fa7b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:43.379555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:43.380260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:43.380643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:43.380961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] PATH_INFO: `/v3/users/03bde131e97845fea2739c94065c227f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:43.382175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03bde131e97845fea2739c94065c227f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:43.384408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:43.423189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0af70-893a-4291-a04e-e5a29915128c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c0eb3f4d194c6bb7a9cb17181af537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0689cfb594ea4d7b8c67766a5debfb0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:43.424364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0af70-893a-4291-a04e-e5a29915128c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:43.424902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0af70-893a-4291-a04e-e5a29915128c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:43.425467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0af70-893a-4291-a04e-e5a29915128c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] PATH_INFO: `/v3/projects/89a64d4589204aa4ab873fba0cd0f687` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:43.426941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0af70-893a-4291-a04e-e5a29915128c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorizing `identity:get_project(project_id=89a64d4589204aa4ab873fba0cd0f687)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:43.431201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0af70-893a-4291-a04e-e5a29915128c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:43.434110 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 937/1879] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:00:43 2022] GET /identity/v3/projects/89a64d4589204aa4ab873fba0cd0f687 => generated 395 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:43.435474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0af70-893a-4291-a04e-e5a29915128c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:43.455143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0af70-893a-4291-a04e-e5a29915128c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:43.463046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad8913-c251-43fe-82c6-aef531933cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:43.466091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad8913-c251-43fe-82c6-aef531933cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:43.466704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad8913-c251-43fe-82c6-aef531933cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:43.467381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad8913-c251-43fe-82c6-aef531933cc7 admin admin] PATH_INFO: `/v3/projects/0f979977d8e341c08abbd6b80f227250/users/fc037a4fdbff45adbce4aa39d8b5d7fd/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:43.470705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad8913-c251-43fe-82c6-aef531933cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f979977d8e341c08abbd6b80f227250, user_id=fc037a4fdbff45adbce4aa39d8b5d7fd, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:43.477687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad8913-c251-43fe-82c6-aef531933cc7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:43.478181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03bde131e97845fea2739c94065c227f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:43.504471 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 938/1880] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:43 2022] PUT /identity/v3/projects/0f979977d8e341c08abbd6b80f227250/users/fc037a4fdbff45adbce4aa39d8b5d7fd/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:43.505499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad8913-c251-43fe-82c6-aef531933cc7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:43.513587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03bde131e97845fea2739c94065c227f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:43.521579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03bde131e97845fea2739c94065c227f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:43.531982 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:43.546582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03bde131e97845fea2739c94065c227f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:43.547301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03bde131e97845fea2739c94065c227f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:43.576188 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 943/1881] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:43 2022] DELETE /identity/v3/users/03bde131e97845fea2739c94065c227f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:43.577167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:43.578903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:43.633619 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:43.653052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad8913-c251-43fe-82c6-aef531933cc7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:43.720304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3add68-12b2-47c5-82b3-a5facc384808 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:43.726724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8d9f9-5f0e-4e27-b2ea-8f58e401325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:43.727346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8d9f9-5f0e-4e27-b2ea-8f58e401325f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:43.727685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8d9f9-5f0e-4e27-b2ea-8f58e401325f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:43.727889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8d9f9-5f0e-4e27-b2ea-8f58e401325f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:43.728640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8d9f9-5f0e-4e27-b2ea-8f58e401325f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:43.732047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8d9f9-5f0e-4e27-b2ea-8f58e401325f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:43.748063 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 944/1882] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:43.749388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e82f7-96ce-420f-9a27-98076145ec68 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:43.749677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e82f7-96ce-420f-9a27-98076145ec68 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:43.749951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e82f7-96ce-420f-9a27-98076145ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:43.770694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceda5d-63f9-43a2-9b28-ff189215d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:43.771837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceda5d-63f9-43a2-9b28-ff189215d253 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:43.772124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceda5d-63f9-43a2-9b28-ff189215d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:43.772400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceda5d-63f9-43a2-9b28-ff189215d253 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:43.773341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceda5d-63f9-43a2-9b28-ff189215d253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:43.775382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceda5d-63f9-43a2-9b28-ff189215d253 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:43.803312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f42e82f7-96ce-420f-9a27-98076145ec68 None None] MFA Rules not processed for user `fc037a4fdbff45adbce4aa39d8b5d7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:43.804702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f42e82f7-96ce-420f-9a27-98076145ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:43.822567 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 939/1883] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:43 2022] POST /identity/v3/users => generated 292 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:43.824035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5abbd-c05d-419d-94a8-3d6f2e60ce52 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:43.826898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5abbd-c05d-419d-94a8-3d6f2e60ce52 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:43.829027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5abbd-c05d-419d-94a8-3d6f2e60ce52 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:43.834453 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 940/1884] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:00:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:43.838368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2027e1-a03a-4a86-848c-d869725908dd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:43.838976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2027e1-a03a-4a86-848c-d869725908dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:43.839458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2027e1-a03a-4a86-848c-d869725908dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:43.889330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7c2027e1-a03a-4a86-848c-d869725908dd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:43.892719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c2027e1-a03a-4a86-848c-d869725908dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:43.917139 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 941/1885] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:43.918133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2027e1-a03a-4a86-848c-d869725908dd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:43.932282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2027e1-a03a-4a86-848c-d869725908dd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:43.941235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14ed0-57dd-4be4-be60-7e646ec519de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:43.941997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14ed0-57dd-4be4-be60-7e646ec519de admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:43.942374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14ed0-57dd-4be4-be60-7e646ec519de admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:43.942770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14ed0-57dd-4be4-be60-7e646ec519de admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:43.944091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c14ed0-57dd-4be4-be60-7e646ec519de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:43.946019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c14ed0-57dd-4be4-be60-7e646ec519de admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:43.984119 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 942/1886] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:43.985323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14ed0-57dd-4be4-be60-7e646ec519de admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:43.987966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f4c14ed0-57dd-4be4-be60-7e646ec519de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:44.016833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14ed0-57dd-4be4-be60-7e646ec519de admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:44.022335 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 945/1887] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:43 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:44.023321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e82f7-96ce-420f-9a27-98076145ec68 None None] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:00:44.026935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aa59e-bdab-4f2a-84f9-bfa2851e9d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:44.027840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aa59e-bdab-4f2a-84f9-bfa2851e9d02 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:44.028408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aa59e-bdab-4f2a-84f9-bfa2851e9d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:44.029075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aa59e-bdab-4f2a-84f9-bfa2851e9d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:44.029191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f42e82f7-96ce-420f-9a27-98076145ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:44.030465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58aa59e-bdab-4f2a-84f9-bfa2851e9d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:44.032777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58aa59e-bdab-4f2a-84f9-bfa2851e9d02 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:44.066907 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 943/1888] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:44.068994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aa59e-bdab-4f2a-84f9-bfa2851e9d02 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:44.072221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e58aa59e-bdab-4f2a-84f9-bfa2851e9d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:44.166379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e82f7-96ce-420f-9a27-98076145ec68 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:44.173916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f42e82f7-96ce-420f-9a27-98076145ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:44.197797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aa59e-bdab-4f2a-84f9-bfa2851e9d02 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:44.202907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c9c68-8fcd-47bc-821e-92037ffa515e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:44.203600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c9c68-8fcd-47bc-821e-92037ffa515e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:44.203883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c9c68-8fcd-47bc-821e-92037ffa515e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:44.204155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c9c68-8fcd-47bc-821e-92037ffa515e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:44.223085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c9c68-8fcd-47bc-821e-92037ffa515e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:44.225566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c9c68-8fcd-47bc-821e-92037ffa515e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:44.257893 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 944/1889] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:44.258817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c9c68-8fcd-47bc-821e-92037ffa515e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:44.280969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c9c68-8fcd-47bc-821e-92037ffa515e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:44.286501 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:44.292831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11735d57-f968-4b8f-810a-edf48437eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:44.293683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11735d57-f968-4b8f-810a-edf48437eefc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:44.293981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11735d57-f968-4b8f-810a-edf48437eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:44.294262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11735d57-f968-4b8f-810a-edf48437eefc admin admin] PATH_INFO: `/v3/projects/5f37a7d5a9874b9488057d6dceb2f481/users/5f6ee48c7cf14d97bdb3ccd46013f087/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:44.313936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11735d57-f968-4b8f-810a-edf48437eefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f37a7d5a9874b9488057d6dceb2f481, user_id=5f6ee48c7cf14d97bdb3ccd46013f087, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:44.318376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11735d57-f968-4b8f-810a-edf48437eefc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:44.320297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e82f7-96ce-420f-9a27-98076145ec68 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:44.327383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb48ff5-ebd7-4fbf-9c8f-7e9b929c24f8 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c0eb3f4d194c6bb7a9cb17181af537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0689cfb594ea4d7b8c67766a5debfb0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:44.328423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48ff5-ebd7-4fbf-9c8f-7e9b929c24f8 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:44.328801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48ff5-ebd7-4fbf-9c8f-7e9b929c24f8 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:44.329208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48ff5-ebd7-4fbf-9c8f-7e9b929c24f8 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] PATH_INFO: `/v3/projects/89a64d4589204aa4ab873fba0cd0f687` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:44.329681 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:44.331439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb48ff5-ebd7-4fbf-9c8f-7e9b929c24f8 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorizing `identity:get_project(project_id=89a64d4589204aa4ab873fba0cd0f687)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:44.334835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb48ff5-ebd7-4fbf-9c8f-7e9b929c24f8 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:44.346791 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 946/1891] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:00:44 2022] GET /identity/v3/projects/89a64d4589204aa4ab873fba0cd0f687 => generated 395 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:44.347271 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 945/1891] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:44 2022] PUT /identity/v3/projects/5f37a7d5a9874b9488057d6dceb2f481/users/5f6ee48c7cf14d97bdb3ccd46013f087/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:44.347377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb48ff5-ebd7-4fbf-9c8f-7e9b929c24f8 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:44.349203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e7e0-6deb-4e75-8821-91b1642f2938 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:44.349591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e7e0-6deb-4e75-8821-91b1642f2938 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:44.349964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e7e0-6deb-4e75-8821-91b1642f2938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:44.374826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb48ff5-ebd7-4fbf-9c8f-7e9b929c24f8 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:44.426217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5bf4e7e0-6deb-4e75-8821-91b1642f2938 None None] MFA Rules not processed for user `5f6ee48c7cf14d97bdb3ccd46013f087`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:44.428308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5bf4e7e0-6deb-4e75-8821-91b1642f2938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:44.515697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a4b44-2257-49c7-bfd5-40787ea6ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:44.516404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a4b44-2257-49c7-bfd5-40787ea6ac49 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:44.516783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a4b44-2257-49c7-bfd5-40787ea6ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:44.517369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a4b44-2257-49c7-bfd5-40787ea6ac49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:44.518918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a4b44-2257-49c7-bfd5-40787ea6ac49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:44.521071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a4b44-2257-49c7-bfd5-40787ea6ac49 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:44.535273 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 947/1892] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:44.536579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a4b44-2257-49c7-bfd5-40787ea6ac49 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:44.537984 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 946/1893] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:44.538574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-909a4b44-2257-49c7-bfd5-40787ea6ac49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:44.540229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77824c-1873-4e8b-92d7-635508851f9c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:44.540766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77824c-1873-4e8b-92d7-635508851f9c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:44.541259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77824c-1873-4e8b-92d7-635508851f9c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:44.543267 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 947/1894] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:44.544304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77824c-1873-4e8b-92d7-635508851f9c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:44.575365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77824c-1873-4e8b-92d7-635508851f9c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:44.582243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953522e4-4831-45a4-b4a2-b5db78583129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:44.584344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953522e4-4831-45a4-b4a2-b5db78583129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:44.585065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953522e4-4831-45a4-b4a2-b5db78583129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:44.585504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953522e4-4831-45a4-b4a2-b5db78583129 admin admin] PATH_INFO: `/v3/projects/70e0212c0d3e458c8efb5e70e719642b/users/8e3cf465ccb24b4e80138d178f340cd2/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:44.608487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953522e4-4831-45a4-b4a2-b5db78583129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e0212c0d3e458c8efb5e70e719642b, user_id=8e3cf465ccb24b4e80138d178f340cd2, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:44.614405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953522e4-4831-45a4-b4a2-b5db78583129 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:44.636466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a4b44-2257-49c7-bfd5-40787ea6ac49 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:44.639777 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 948/1895] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:44 2022] PUT /identity/v3/projects/70e0212c0d3e458c8efb5e70e719642b/users/8e3cf465ccb24b4e80138d178f340cd2/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:44.641081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953522e4-4831-45a4-b4a2-b5db78583129 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:44.740708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd953de0-7de4-4d17-903e-78924fcd3de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:44.741784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953de0-7de4-4d17-903e-78924fcd3de8 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:44.742071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953de0-7de4-4d17-903e-78924fcd3de8 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:44.742342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953de0-7de4-4d17-903e-78924fcd3de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:44.765946 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:44.781800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953522e4-4831-45a4-b4a2-b5db78583129 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:44.787642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4bafd-fe87-4fe6-b774-a82257956ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:44.788651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4bafd-fe87-4fe6-b774-a82257956ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:44.789029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4bafd-fe87-4fe6-b774-a82257956ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:44.789396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4bafd-fe87-4fe6-b774-a82257956ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:44.790127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4bafd-fe87-4fe6-b774-a82257956ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:44.792531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4bafd-fe87-4fe6-b774-a82257956ff2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:44.856671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd953de0-7de4-4d17-903e-78924fcd3de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:44.858312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd953de0-7de4-4d17-903e-78924fcd3de8 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:44.862797 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 949/1896] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:44 2022] POST /identity/v3/projects => generated 361 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:44.864132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4bafd-fe87-4fe6-b774-a82257956ff2 admin admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:00:44.884286 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 948/1897] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:44.885692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a057-2caf-4732-912e-86261d271f57 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:44.885986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a057-2caf-4732-912e-86261d271f57 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:44.886267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a057-2caf-4732-912e-86261d271f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:44.957833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4138a057-2caf-4732-912e-86261d271f57 None None] MFA Rules not processed for user `8e3cf465ccb24b4e80138d178f340cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:44.962875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4138a057-2caf-4732-912e-86261d271f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:45.007009 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:45.063683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4bafd-fe87-4fe6-b774-a82257956ff2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.075417 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 949/1898] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:45.076250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a057-2caf-4732-912e-86261d271f57 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.158470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a057-2caf-4732-912e-86261d271f57 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.166888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accb2d9-a2cc-4b83-b8ab-8221c77a9876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.168768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4bafd-fe87-4fe6-b774-a82257956ff2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.169447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb2d9-a2cc-4b83-b8ab-8221c77a9876 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.169754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb2d9-a2cc-4b83-b8ab-8221c77a9876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.170030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb2d9-a2cc-4b83-b8ab-8221c77a9876 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.170724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accb2d9-a2cc-4b83-b8ab-8221c77a9876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.183928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accb2d9-a2cc-4b83-b8ab-8221c77a9876 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:45.194513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8430e-015e-4a0c-8a28-2d329a30cd7c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c0eb3f4d194c6bb7a9cb17181af537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0689cfb594ea4d7b8c67766a5debfb0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.195224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8430e-015e-4a0c-8a28-2d329a30cd7c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.195507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8430e-015e-4a0c-8a28-2d329a30cd7c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.195851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8430e-015e-4a0c-8a28-2d329a30cd7c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] PATH_INFO: `/v3/projects/89a64d4589204aa4ab873fba0cd0f687` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.198865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8430e-015e-4a0c-8a28-2d329a30cd7c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorizing `identity:get_project(project_id=89a64d4589204aa4ab873fba0cd0f687)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.201093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8430e-015e-4a0c-8a28-2d329a30cd7c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:45.207300 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 950/1899] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:00:44 2022] GET /identity/v3/projects/89a64d4589204aa4ab873fba0cd0f687 => generated 395 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:45.209310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8430e-015e-4a0c-8a28-2d329a30cd7c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.232198 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 950/1900] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:45 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:45.234136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accb2d9-a2cc-4b83-b8ab-8221c77a9876 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.243979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8430e-015e-4a0c-8a28-2d329a30cd7c tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.254679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a19438-b9d1-45c8-a79d-391f80116279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.255304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a19438-b9d1-45c8-a79d-391f80116279 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.255586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a19438-b9d1-45c8-a79d-391f80116279 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.255855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a19438-b9d1-45c8-a79d-391f80116279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.257723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accb2d9-a2cc-4b83-b8ab-8221c77a9876 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.261067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-97a19438-b9d1-45c8-a79d-391f80116279 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:45.266738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a6f73-a607-4baf-a67b-47d97bc25dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.267459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a6f73-a607-4baf-a67b-47d97bc25dce admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.267573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a6f73-a607-4baf-a67b-47d97bc25dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.267791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a6f73-a607-4baf-a67b-47d97bc25dce admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.268681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a6f73-a607-4baf-a67b-47d97bc25dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.275485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a6f73-a607-4baf-a67b-47d97bc25dce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:45.332426 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 951/1901] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:45 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:45.332426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a6f73-a607-4baf-a67b-47d97bc25dce admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.347147 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:45.405806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a19438-b9d1-45c8-a79d-391f80116279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.414022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a19438-b9d1-45c8-a79d-391f80116279 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:45.450642 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 951/1902] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:45 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:45.467897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a19438-b9d1-45c8-a79d-391f80116279 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.500286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a6f73-a607-4baf-a67b-47d97bc25dce admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.505769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a19438-b9d1-45c8-a79d-391f80116279 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.522514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057d49f-2879-40af-a679-b4481784f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.522514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057d49f-2879-40af-a679-b4481784f439 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.522514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057d49f-2879-40af-a679-b4481784f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.522807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057d49f-2879-40af-a679-b4481784f439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.523285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057d49f-2879-40af-a679-b4481784f439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.524910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057d49f-2879-40af-a679-b4481784f439 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:45.526039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eafac3-3cc8-47ac-a660-79f9ec6c03c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.527020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eafac3-3cc8-47ac-a660-79f9ec6c03c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.528480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eafac3-3cc8-47ac-a660-79f9ec6c03c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.529289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eafac3-3cc8-47ac-a660-79f9ec6c03c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.530098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eafac3-3cc8-47ac-a660-79f9ec6c03c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.532274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eafac3-3cc8-47ac-a660-79f9ec6c03c8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:45.566627 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 952/1903] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:45.567551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057d49f-2879-40af-a679-b4481784f439 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.578217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a057d49f-2879-40af-a679-b4481784f439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:45.597398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057d49f-2879-40af-a679-b4481784f439 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.598632 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 952/1904] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:45 2022] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:45.599496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eafac3-3cc8-47ac-a660-79f9ec6c03c8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.606286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.607348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.608265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.608770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] PATH_INFO: `/v3/projects/250f511a81814eea86932b99c9be12d0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.611198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=250f511a81814eea86932b99c9be12d0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.614939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:45.622662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eafac3-3cc8-47ac-a660-79f9ec6c03c8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.659605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be9dad-b1e2-4be8-9890-e741c204177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.660353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be9dad-b1e2-4be8-9890-e741c204177a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.660676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be9dad-b1e2-4be8-9890-e741c204177a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.660960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be9dad-b1e2-4be8-9890-e741c204177a admin admin] PATH_INFO: `/v3/projects/3f4f3b62a1274df7b613cf46b93c6b12/users/f7ff233a16f347efb45214da0b05741c/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.724356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '250f511a81814eea86932b99c9be12d0', 'request_id': 'req-baebc9a7-8e8f-402a-b958-35ada325ed5a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:45.724547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be9dad-b1e2-4be8-9890-e741c204177a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4f3b62a1274df7b613cf46b93c6b12, user_id=f7ff233a16f347efb45214da0b05741c, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.729009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be9dad-b1e2-4be8-9890-e741c204177a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:45.732153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '250f511a81814eea86932b99c9be12d0', 'request_id': 'req-baebc9a7-8e8f-402a-b958-35ada325ed5a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:45.747821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '250f511a81814eea86932b99c9be12d0', 'request_id': 'req-baebc9a7-8e8f-402a-b958-35ada325ed5a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:45.757824 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 953/1905] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:45 2022] PUT /identity/v3/projects/3f4f3b62a1274df7b613cf46b93c6b12/users/f7ff233a16f347efb45214da0b05741c/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:45.761932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be9dad-b1e2-4be8-9890-e741c204177a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.790851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] The token cache is being invalidate because project 250f511a81814eea86932b99c9be12d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:45.791231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:45.794243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:45.802070 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 953/1906] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:45 2022] DELETE /identity/v3/projects/250f511a81814eea86932b99c9be12d0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:45.802070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.805865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:45.866878 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:45.890036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be9dad-b1e2-4be8-9890-e741c204177a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.897099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880741e-eb00-4cbc-b3b8-9160b66b5336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.898997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880741e-eb00-4cbc-b3b8-9160b66b5336 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.899358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880741e-eb00-4cbc-b3b8-9160b66b5336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.899633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880741e-eb00-4cbc-b3b8-9160b66b5336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.900374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880741e-eb00-4cbc-b3b8-9160b66b5336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.902557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880741e-eb00-4cbc-b3b8-9160b66b5336 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:45.915096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebc9a7-8e8f-402a-b958-35ada325ed5a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.917604 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 954/1907] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:45.918861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880741e-eb00-4cbc-b3b8-9160b66b5336 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.920531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c880741e-eb00-4cbc-b3b8-9160b66b5336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:45.926002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df2d05-a768-443e-95dd-9023612b915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.926833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2d05-a768-443e-95dd-9023612b915f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.927225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2d05-a768-443e-95dd-9023612b915f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.927610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2d05-a768-443e-95dd-9023612b915f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.928460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df2d05-a768-443e-95dd-9023612b915f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.930186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df2d05-a768-443e-95dd-9023612b915f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:45.939110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880741e-eb00-4cbc-b3b8-9160b66b5336 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.946665 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 954/1908] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:45.946665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df2d05-a768-443e-95dd-9023612b915f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:45.946665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-40df2d05-a768-443e-95dd-9023612b915f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:45.947901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.949151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.949370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.949654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] PATH_INFO: `/v3/users/9c6949fc51cb4fd680e2cc682cb94036` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.950835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6949fc51cb4fd680e2cc682cb94036)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.953121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:45.965121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df2d05-a768-443e-95dd-9023612b915f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:45.972635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:45.973651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:45.974072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:45.975276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] PATH_INFO: `/v3/users/82af4233a03e4907a522e61dfcd4b3f6` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:45.976962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82af4233a03e4907a522e61dfcd4b3f6)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:45.980265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:46.015197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6949fc51cb4fd680e2cc682cb94036'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.018172 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:46.048207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6949fc51cb4fd680e2cc682cb94036'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.050703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6949fc51cb4fd680e2cc682cb94036'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.059731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6949fc51cb4fd680e2cc682cb94036'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.061844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82af4233a03e4907a522e61dfcd4b3f6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.071116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6949fc51cb4fd680e2cc682cb94036'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.078728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82af4233a03e4907a522e61dfcd4b3f6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.079834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82af4233a03e4907a522e61dfcd4b3f6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.081311 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 955/1909] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:45 2022] DELETE /identity/v3/users/9c6949fc51cb4fd680e2cc682cb94036 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:46.082410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:46.084119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:46.099138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82af4233a03e4907a522e61dfcd4b3f6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.100516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82af4233a03e4907a522e61dfcd4b3f6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.135015 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 955/1910] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:45 2022] DELETE /identity/v3/users/82af4233a03e4907a522e61dfcd4b3f6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:46.136903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:46.139999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:46.217892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4667828-bd85-49d4-96ae-37a66facf67e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:46.254185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50ccce-1981-4bd5-a687-0b9272ddcf76 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:46.264305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0bdaf-4bfb-455b-ab6b-b349cd674859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:46.265158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0bdaf-4bfb-455b-ab6b-b349cd674859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:46.265547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0bdaf-4bfb-455b-ab6b-b349cd674859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:46.266156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0bdaf-4bfb-455b-ab6b-b349cd674859 admin admin] PATH_INFO: `/v3/projects/81748c367d34485094ad2f0372a4eecb/users/3714cf0fbdbe42e49339278897659010/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:46.285883 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:46.309821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0bdaf-4bfb-455b-ab6b-b349cd674859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81748c367d34485094ad2f0372a4eecb, user_id=3714cf0fbdbe42e49339278897659010, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:46.312834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0bdaf-4bfb-455b-ab6b-b349cd674859 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:46.333460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb59d6-b4a2-4681-9686-c372a468ba52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:46.335428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb59d6-b4a2-4681-9686-c372a468ba52 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:46.335761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb59d6-b4a2-4681-9686-c372a468ba52 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:46.336285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb59d6-b4a2-4681-9686-c372a468ba52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:46.338684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-48bb59d6-b4a2-4681-9686-c372a468ba52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:46.343420 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 956/1911] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:46 2022] PUT /identity/v3/projects/81748c367d34485094ad2f0372a4eecb/users/3714cf0fbdbe42e49339278897659010/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:46.344532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0bdaf-4bfb-455b-ab6b-b349cd674859 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:46.346274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-42c0bdaf-4bfb-455b-ab6b-b349cd674859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:46.472385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb59d6-b4a2-4681-9686-c372a468ba52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:46.475831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb59d6-b4a2-4681-9686-c372a468ba52 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:46.490705 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 956/1912] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:46 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:46.493084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b1b8e-d3cd-418a-ab28-a95bb72ee78d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:46.493437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b1b8e-d3cd-418a-ab28-a95bb72ee78d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:46.494017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b1b8e-d3cd-418a-ab28-a95bb72ee78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:46.497868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0bdaf-4bfb-455b-ab6b-b349cd674859 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:46.504864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3797020-dece-4635-9600-88566a67c5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:46.506261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3797020-dece-4635-9600-88566a67c5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:46.506756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3797020-dece-4635-9600-88566a67c5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:46.507199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3797020-dece-4635-9600-88566a67c5d2 admin admin] PATH_INFO: `/v3/projects/3f4f3b62a1274df7b613cf46b93c6b12/users/f7ff233a16f347efb45214da0b05741c/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:46.516076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3797020-dece-4635-9600-88566a67c5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4f3b62a1274df7b613cf46b93c6b12, user_id=f7ff233a16f347efb45214da0b05741c, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:46.517081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c11b1b8e-d3cd-418a-ab28-a95bb72ee78d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:46.518332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c11b1b8e-d3cd-418a-ab28-a95bb72ee78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:46.527280 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 957/1913] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:46.528561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b1b8e-d3cd-418a-ab28-a95bb72ee78d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:46.534873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3797020-dece-4635-9600-88566a67c5d2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:46.554815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b1b8e-d3cd-418a-ab28-a95bb72ee78d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:46.559184 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 957/1914] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:46 2022] PUT /identity/v3/projects/3f4f3b62a1274df7b613cf46b93c6b12/users/f7ff233a16f347efb45214da0b05741c/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:46.560341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3797020-dece-4635-9600-88566a67c5d2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:46.562183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d3797020-dece-4635-9600-88566a67c5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:46.590279 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:46.683148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3797020-dece-4635-9600-88566a67c5d2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:46.684011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be4e9-8873-4aab-ae37-a3215927ad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:46.685239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be4e9-8873-4aab-ae37-a3215927ad9b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:46.685668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be4e9-8873-4aab-ae37-a3215927ad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:46.686086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be4e9-8873-4aab-ae37-a3215927ad9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:46.686944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582be4e9-8873-4aab-ae37-a3215927ad9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:46.688818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582be4e9-8873-4aab-ae37-a3215927ad9b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:46.688937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:46.689941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:46.691382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:46.691709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] PATH_INFO: `/v3/projects/27a42aff44864ea9bba2caa1b7b557af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:46.693029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a42aff44864ea9bba2caa1b7b557af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:46.696276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:46.705483 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 958/1915] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:46.706800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be4e9-8873-4aab-ae37-a3215927ad9b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:46.708738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-582be4e9-8873-4aab-ae37-a3215927ad9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:46.766646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a42aff44864ea9bba2caa1b7b557af', 'request_id': 'req-ce181905-007f-49d6-86df-d8bd4f582cd1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.773864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a42aff44864ea9bba2caa1b7b557af', 'request_id': 'req-ce181905-007f-49d6-86df-d8bd4f582cd1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.776901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be4e9-8873-4aab-ae37-a3215927ad9b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:46.781511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a42aff44864ea9bba2caa1b7b557af', 'request_id': 'req-ce181905-007f-49d6-86df-d8bd4f582cd1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.801912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] The token cache is being invalidate because project 27a42aff44864ea9bba2caa1b7b557af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:46.802240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.803271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ce181905-007f-49d6-86df-d8bd4f582cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:46.808405 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 958/1916] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:46 2022] DELETE /identity/v3/projects/27a42aff44864ea9bba2caa1b7b557af => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:46.809915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a68eb-a901-44cd-86ba-9c3f06734b14 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:46.810202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a68eb-a901-44cd-86ba-9c3f06734b14 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:46.810488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a68eb-a901-44cd-86ba-9c3f06734b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:46.833807 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:46.853284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8c6a68eb-a901-44cd-86ba-9c3f06734b14 None None] MFA Rules not processed for user `f7ff233a16f347efb45214da0b05741c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:46.854517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8c6a68eb-a901-44cd-86ba-9c3f06734b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:46.876575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec5e51-26f5-4451-9b80-5c63c4144838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:46.877102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec5e51-26f5-4451-9b80-5c63c4144838 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:46.877393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec5e51-26f5-4451-9b80-5c63c4144838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:46.877703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec5e51-26f5-4451-9b80-5c63c4144838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:46.883476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-acec5e51-26f5-4451-9b80-5c63c4144838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:46.977009 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 959/1917] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:46.979500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9bdaf-01a7-4d2f-b958-3fce5e74db59 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:46.979945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9bdaf-01a7-4d2f-b958-3fce5e74db59 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:46.980409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9bdaf-01a7-4d2f-b958-3fce5e74db59 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:46.982550 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 960/1918] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:00:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:46.983446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9bdaf-01a7-4d2f-b958-3fce5e74db59 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:46.985610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f7c9bdaf-01a7-4d2f-b958-3fce5e74db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:47.011225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec5e51-26f5-4451-9b80-5c63c4144838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:47.012701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec5e51-26f5-4451-9b80-5c63c4144838 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:47.028338 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 959/1919] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:47.029710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296c122-6c06-4794-9abd-d56e4d6f64d6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:47.030003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296c122-6c06-4794-9abd-d56e4d6f64d6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:47.030287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296c122-6c06-4794-9abd-d56e4d6f64d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:47.048240 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:47.063823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c296c122-6c06-4794-9abd-d56e4d6f64d6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:47.065990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c296c122-6c06-4794-9abd-d56e4d6f64d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:47.075783 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 960/1920] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:47.076499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296c122-6c06-4794-9abd-d56e4d6f64d6 None None] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:00:47.077838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c296c122-6c06-4794-9abd-d56e4d6f64d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:47.130918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9bdaf-01a7-4d2f-b958-3fce5e74db59 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:47.141033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f93a26-2edf-4a1e-94e7-edf1155f9b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:47.141763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f93a26-2edf-4a1e-94e7-edf1155f9b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:47.142048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f93a26-2edf-4a1e-94e7-edf1155f9b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:47.142320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f93a26-2edf-4a1e-94e7-edf1155f9b7d admin admin] PATH_INFO: `/v3/projects/81748c367d34485094ad2f0372a4eecb/users/3714cf0fbdbe42e49339278897659010/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:47.147559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f93a26-2edf-4a1e-94e7-edf1155f9b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81748c367d34485094ad2f0372a4eecb, user_id=3714cf0fbdbe42e49339278897659010, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:47.152096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f93a26-2edf-4a1e-94e7-edf1155f9b7d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:47.171167 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 961/1921] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:46 2022] PUT /identity/v3/projects/81748c367d34485094ad2f0372a4eecb/users/3714cf0fbdbe42e49339278897659010/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:47.172469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f93a26-2edf-4a1e-94e7-edf1155f9b7d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:47.174693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-05f93a26-2edf-4a1e-94e7-edf1155f9b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:47.188067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296c122-6c06-4794-9abd-d56e4d6f64d6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:47.190018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c296c122-6c06-4794-9abd-d56e4d6f64d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:47.284298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296c122-6c06-4794-9abd-d56e4d6f64d6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:47.289760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f93a26-2edf-4a1e-94e7-edf1155f9b7d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:47.303221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba782c5b-f71e-4d51-a4d2-053cecad916b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:47.304127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba782c5b-f71e-4d51-a4d2-053cecad916b service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:47.304587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba782c5b-f71e-4d51-a4d2-053cecad916b service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:47.305076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba782c5b-f71e-4d51-a4d2-053cecad916b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:47.313046 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:47.447476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba782c5b-f71e-4d51-a4d2-053cecad916b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:47.449285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba782c5b-f71e-4d51-a4d2-053cecad916b service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:47.467907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8db02c-7fd6-4a21-a243-6d520e36ca4b tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c0eb3f4d194c6bb7a9cb17181af537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0689cfb594ea4d7b8c67766a5debfb0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:47.468490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8db02c-7fd6-4a21-a243-6d520e36ca4b tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:47.468777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8db02c-7fd6-4a21-a243-6d520e36ca4b tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:47.469058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8db02c-7fd6-4a21-a243-6d520e36ca4b tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] PATH_INFO: `/v3/projects/89a64d4589204aa4ab873fba0cd0f687` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:47.473867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8db02c-7fd6-4a21-a243-6d520e36ca4b tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorizing `identity:get_project(project_id=89a64d4589204aa4ab873fba0cd0f687)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:47.476166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8db02c-7fd6-4a21-a243-6d520e36ca4b tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:47.481408 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 962/1922] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:47.482918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd64377-12f3-4020-b739-9f8d62c27d6f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:47.483211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd64377-12f3-4020-b739-9f8d62c27d6f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:47.483504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd64377-12f3-4020-b739-9f8d62c27d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:47.492282 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 961/1923] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:00:47 2022] GET /identity/v3/projects/89a64d4589204aa4ab873fba0cd0f687 => generated 395 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:47.502390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f057-9183-4d94-b753-40327c63aa9a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:47.506911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f057-9183-4d94-b753-40327c63aa9a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:47.507223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f057-9183-4d94-b753-40327c63aa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:47.531698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6cd64377-12f3-4020-b739-9f8d62c27d6f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:47.533408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6cd64377-12f3-4020-b739-9f8d62c27d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:47.590111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8fb1f057-9183-4d94-b753-40327c63aa9a None None] MFA Rules not processed for user `3714cf0fbdbe42e49339278897659010`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:47.591619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8fb1f057-9183-4d94-b753-40327c63aa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:47.685430 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:47.718326 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 963/1924] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:47.720591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd64377-12f3-4020-b739-9f8d62c27d6f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:47.724244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6cd64377-12f3-4020-b739-9f8d62c27d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:47.745855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd64377-12f3-4020-b739-9f8d62c27d6f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:47.754978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:47.755733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:47.756023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:47.756301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] PATH_INFO: `/v3/projects/add837b1ffcd4592bd662f6519605fc8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:47.758515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=add837b1ffcd4592bd662f6519605fc8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:47.761495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:47.791558 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 962/1925] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:47.792572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1f057-9183-4d94-b753-40327c63aa9a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:47.807697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1f057-9183-4d94-b753-40327c63aa9a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:47.813395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c2c5-bc0a-41c0-af2b-9415572fd735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:47.815640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c2c5-bc0a-41c0-af2b-9415572fd735 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:47.816182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c2c5-bc0a-41c0-af2b-9415572fd735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:47.816478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c2c5-bc0a-41c0-af2b-9415572fd735 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:47.817299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189c2c5-bc0a-41c0-af2b-9415572fd735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:47.817674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189c2c5-bc0a-41c0-af2b-9415572fd735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:47.820005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189c2c5-bc0a-41c0-af2b-9415572fd735 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:47.846154 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 963/1926] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:47.851992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c2c5-bc0a-41c0-af2b-9415572fd735 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:47.860114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add837b1ffcd4592bd662f6519605fc8', 'request_id': 'req-13350232-ec8a-419d-a111-dae357299e3c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:47.870718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add837b1ffcd4592bd662f6519605fc8', 'request_id': 'req-13350232-ec8a-419d-a111-dae357299e3c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:47.880226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add837b1ffcd4592bd662f6519605fc8', 'request_id': 'req-13350232-ec8a-419d-a111-dae357299e3c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:47.883822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c2c5-bc0a-41c0-af2b-9415572fd735 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:47.907580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] The token cache is being invalidate because project add837b1ffcd4592bd662f6519605fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:47.907968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:47.909063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:47.912516 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 964/1927] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:47 2022] DELETE /identity/v3/projects/add837b1ffcd4592bd662f6519605fc8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:47.919635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:47.921158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:48.004381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35948150-9846-427f-b4f2-3b7f570ada03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:48.005006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35948150-9846-427f-b4f2-3b7f570ada03 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:48.005286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35948150-9846-427f-b4f2-3b7f570ada03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:48.005558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35948150-9846-427f-b4f2-3b7f570ada03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:48.006207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35948150-9846-427f-b4f2-3b7f570ada03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:48.009329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35948150-9846-427f-b4f2-3b7f570ada03 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:48.065021 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 964/1928] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:47 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:48.065276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350232-ec8a-419d-a111-dae357299e3c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:48.067219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35948150-9846-427f-b4f2-3b7f570ada03 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:48.076483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-35948150-9846-427f-b4f2-3b7f570ada03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:48.131409 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:48.212717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:48.213899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:48.214533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:48.215059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] PATH_INFO: `/v3/users/fc037a4fdbff45adbce4aa39d8b5d7fd` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:48.217049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc037a4fdbff45adbce4aa39d8b5d7fd)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:48.219850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:48.255208 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:48.263575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35948150-9846-427f-b4f2-3b7f570ada03 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:48.269425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7a6db-6728-40a8-a51a-43c3124ba261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:48.270051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7a6db-6728-40a8-a51a-43c3124ba261 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:48.270375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7a6db-6728-40a8-a51a-43c3124ba261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:48.270678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7a6db-6728-40a8-a51a-43c3124ba261 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:48.271934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7a6db-6728-40a8-a51a-43c3124ba261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:48.275102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7a6db-6728-40a8-a51a-43c3124ba261 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:48.283122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc037a4fdbff45adbce4aa39d8b5d7fd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:48.302997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc037a4fdbff45adbce4aa39d8b5d7fd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:48.303851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc037a4fdbff45adbce4aa39d8b5d7fd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:48.314325 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 965/1929] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:48 2022] POST /identity/v3/users => generated 291 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:00:48.319186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7a6db-6728-40a8-a51a-43c3124ba261 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:48.320534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc037a4fdbff45adbce4aa39d8b5d7fd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:48.321315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc037a4fdbff45adbce4aa39d8b5d7fd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:48.325918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8ef7a6db-6728-40a8-a51a-43c3124ba261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:48.357993 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 965/1930] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:47 2022] DELETE /identity/v3/users/fc037a4fdbff45adbce4aa39d8b5d7fd => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:48.359528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:48.365974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:48.457235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7a6db-6728-40a8-a51a-43c3124ba261 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:48.505250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27154b1-a7ce-4fed-a78d-1e6bd1b98cc3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:48.520553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a705f65-b696-4bcd-bdb9-35aab1db5d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:48.521355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705f65-b696-4bcd-bdb9-35aab1db5d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:48.521587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705f65-b696-4bcd-bdb9-35aab1db5d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:48.521873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705f65-b696-4bcd-bdb9-35aab1db5d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:48.522900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a705f65-b696-4bcd-bdb9-35aab1db5d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:48.524565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a705f65-b696-4bcd-bdb9-35aab1db5d5b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:48.557678 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 966/1931] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:48.557678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a9d1f-b424-411e-9339-bd9a89a598d0 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:48.557678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a9d1f-b424-411e-9339-bd9a89a598d0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:48.557678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a9d1f-b424-411e-9339-bd9a89a598d0 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:48.557678 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 967/1932] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:48.561633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a9d1f-b424-411e-9339-bd9a89a598d0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:48.591296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a9d1f-b424-411e-9339-bd9a89a598d0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:48.591716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99926ba5-b9b6-4955-97d5-fff5d80a6a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:48.592417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99926ba5-b9b6-4955-97d5-fff5d80a6a19 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:48.592856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99926ba5-b9b6-4955-97d5-fff5d80a6a19 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:48.593215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99926ba5-b9b6-4955-97d5-fff5d80a6a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:48.595322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-99926ba5-b9b6-4955-97d5-fff5d80a6a19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:48.604905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa73ea-944e-4351-af3a-8fd2178754e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:48.605902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa73ea-944e-4351-af3a-8fd2178754e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:48.606407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa73ea-944e-4351-af3a-8fd2178754e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:48.606896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa73ea-944e-4351-af3a-8fd2178754e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:48.607736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa73ea-944e-4351-af3a-8fd2178754e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:48.613167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa73ea-944e-4351-af3a-8fd2178754e4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:48.638788 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 968/1933] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:48.644689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa73ea-944e-4351-af3a-8fd2178754e4 admin admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:00:48.650789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-60aa73ea-944e-4351-af3a-8fd2178754e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:48.676442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa73ea-944e-4351-af3a-8fd2178754e4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:48.677372 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:48.678336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-60aa73ea-944e-4351-af3a-8fd2178754e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:48.716917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99926ba5-b9b6-4955-97d5-fff5d80a6a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:48.720856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99926ba5-b9b6-4955-97d5-fff5d80a6a19 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:48.741908 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 966/1934] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:48.743067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99926ba5-b9b6-4955-97d5-fff5d80a6a19 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:48.756607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99926ba5-b9b6-4955-97d5-fff5d80a6a19 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:48.764200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340d27-9a5e-4511-8562-17718e1eaab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:48.765545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340d27-9a5e-4511-8562-17718e1eaab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:48.766031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340d27-9a5e-4511-8562-17718e1eaab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:48.766651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340d27-9a5e-4511-8562-17718e1eaab7 admin admin] PATH_INFO: `/v3/projects/9663524075c44863b570a2d5e000f84e/users/aa80a55b982c4d6aa4e8797582409699/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:48.804397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8340d27-9a5e-4511-8562-17718e1eaab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9663524075c44863b570a2d5e000f84e, user_id=aa80a55b982c4d6aa4e8797582409699, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:48.805056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa73ea-944e-4351-af3a-8fd2178754e4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:48.810126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8340d27-9a5e-4511-8562-17718e1eaab7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:48.819206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677b039-29a6-444c-89ad-4df2342d9a9d tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c0eb3f4d194c6bb7a9cb17181af537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0689cfb594ea4d7b8c67766a5debfb0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:48.819921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b039-29a6-444c-89ad-4df2342d9a9d tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:48.820202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b039-29a6-444c-89ad-4df2342d9a9d tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:48.821136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b039-29a6-444c-89ad-4df2342d9a9d tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] PATH_INFO: `/v3/projects/89a64d4589204aa4ab873fba0cd0f687` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:48.821759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677b039-29a6-444c-89ad-4df2342d9a9d tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorizing `identity:get_project(project_id=89a64d4589204aa4ab873fba0cd0f687)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:48.823918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677b039-29a6-444c-89ad-4df2342d9a9d tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:48.827720 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 969/1935] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:00:48 2022] GET /identity/v3/projects/89a64d4589204aa4ab873fba0cd0f687 => generated 395 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:48.844795 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 967/1936] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:48 2022] PUT /identity/v3/projects/9663524075c44863b570a2d5e000f84e/users/aa80a55b982c4d6aa4e8797582409699/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:48.856393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d881e0-6f8b-4d0b-a9ab-1fac2514cb38 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:48.856702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d881e0-6f8b-4d0b-a9ab-1fac2514cb38 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:48.856927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d881e0-6f8b-4d0b-a9ab-1fac2514cb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:48.898355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a1d881e0-6f8b-4d0b-a9ab-1fac2514cb38 None None] MFA Rules not processed for user `aa80a55b982c4d6aa4e8797582409699`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:48.899636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1d881e0-6f8b-4d0b-a9ab-1fac2514cb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:48.921340 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:49.015194 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 970/1937] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:49.020401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340d27-9a5e-4511-8562-17718e1eaab7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:49.110352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340d27-9a5e-4511-8562-17718e1eaab7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:49.117933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a4142-62af-4932-946f-9ebcbc8a4018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:49.118776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a4142-62af-4932-946f-9ebcbc8a4018 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.119106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a4142-62af-4932-946f-9ebcbc8a4018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.119377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a4142-62af-4932-946f-9ebcbc8a4018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:49.120083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a4142-62af-4932-946f-9ebcbc8a4018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:49.122241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a4142-62af-4932-946f-9ebcbc8a4018 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:49.144437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d881e0-6f8b-4d0b-a9ab-1fac2514cb38 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:49.146943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1d881e0-6f8b-4d0b-a9ab-1fac2514cb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:49.168460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d881e0-6f8b-4d0b-a9ab-1fac2514cb38 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:49.178926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 968/1938] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:49 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:00:49.180653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a4142-62af-4932-946f-9ebcbc8a4018 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:49.180846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:49.181472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.181752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.182027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] PATH_INFO: `/v3/users/5f6ee48c7cf14d97bdb3ccd46013f087` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:49.183427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6ee48c7cf14d97bdb3ccd46013f087)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:49.185679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:49.273081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6ee48c7cf14d97bdb3ccd46013f087'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.312064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6ee48c7cf14d97bdb3ccd46013f087'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.313248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6ee48c7cf14d97bdb3ccd46013f087'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.329913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6ee48c7cf14d97bdb3ccd46013f087'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.331281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6ee48c7cf14d97bdb3ccd46013f087'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.353033 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 971/1939] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:49 2022] DELETE /identity/v3/users/5f6ee48c7cf14d97bdb3ccd46013f087 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:49.354662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:49.356764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:49.382642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a4142-62af-4932-946f-9ebcbc8a4018 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:49.472625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd72dff-dc2e-46b3-9c98-98f8b02d29a4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:49.480201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:49.480977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.481630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.481801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] PATH_INFO: `/v3/projects/0f979977d8e341c08abbd6b80f227250` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:49.483500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f979977d8e341c08abbd6b80f227250)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:49.488356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:49.532921 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:49.552297 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:49.577839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f979977d8e341c08abbd6b80f227250', 'request_id': 'req-a3f39b7e-f457-43e5-ad0d-794642238845'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.582142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c892a-c86d-454d-abfd-173e45157801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:49.583746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c892a-c86d-454d-abfd-173e45157801 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.585584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f979977d8e341c08abbd6b80f227250', 'request_id': 'req-a3f39b7e-f457-43e5-ad0d-794642238845'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.586045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c892a-c86d-454d-abfd-173e45157801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.586534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c892a-c86d-454d-abfd-173e45157801 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:49.587525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c892a-c86d-454d-abfd-173e45157801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:49.592941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c892a-c86d-454d-abfd-173e45157801 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:49.593416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f979977d8e341c08abbd6b80f227250', 'request_id': 'req-a3f39b7e-f457-43e5-ad0d-794642238845'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.618800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] The token cache is being invalidate because project 0f979977d8e341c08abbd6b80f227250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:49.619506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.620041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3f39b7e-f457-43e5-ad0d-794642238845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.626329 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 972/1940] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:49 2022] DELETE /identity/v3/projects/0f979977d8e341c08abbd6b80f227250 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:49.629340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a7c05-2450-4d23-8c7b-84369492628f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.629733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a7c05-2450-4d23-8c7b-84369492628f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.630105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a7c05-2450-4d23-8c7b-84369492628f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:49.641367 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 969/1941] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:49 2022] POST /identity/v3/users => generated 298 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:49.642442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c892a-c86d-454d-abfd-173e45157801 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:49.645532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c16c892a-c86d-454d-abfd-173e45157801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:49.653919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-292a7c05-2450-4d23-8c7b-84369492628f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:49.655451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-292a7c05-2450-4d23-8c7b-84369492628f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:49.664425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c892a-c86d-454d-abfd-173e45157801 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:49.736287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41743b-d0fd-4482-a3de-1d5c64739028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:49.737517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41743b-d0fd-4482-a3de-1d5c64739028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.737771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41743b-d0fd-4482-a3de-1d5c64739028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.739451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41743b-d0fd-4482-a3de-1d5c64739028 admin admin] PATH_INFO: `/v3/users/8e3cf465ccb24b4e80138d178f340cd2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:49.742270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41743b-d0fd-4482-a3de-1d5c64739028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3cf465ccb24b4e80138d178f340cd2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:49.745035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41743b-d0fd-4482-a3de-1d5c64739028 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:49.754878 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 973/1942] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:49.756719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca3c4-c8d6-44bb-a457-855250446664 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.757229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca3c4-c8d6-44bb-a457-855250446664 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.757698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca3c4-c8d6-44bb-a457-855250446664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:49.792603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-518ca3c4-c8d6-44bb-a457-855250446664 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:49.796420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-518ca3c4-c8d6-44bb-a457-855250446664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:49.816864 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 974/1943] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:49.818313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92206-ea4e-444a-85ae-fa5e169d1d4e None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.818846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92206-ea4e-444a-85ae-fa5e169d1d4e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.819221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92206-ea4e-444a-85ae-fa5e169d1d4e None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:49.821031 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 975/1944] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:49.822103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db92206-ea4e-444a-85ae-fa5e169d1d4e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:49.824204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5db92206-ea4e-444a-85ae-fa5e169d1d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:49.838719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee41743b-d0fd-4482-a3de-1d5c64739028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3cf465ccb24b4e80138d178f340cd2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.850667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db92206-ea4e-444a-85ae-fa5e169d1d4e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:49.854169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee41743b-d0fd-4482-a3de-1d5c64739028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3cf465ccb24b4e80138d178f340cd2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.855012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee41743b-d0fd-4482-a3de-1d5c64739028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3cf465ccb24b4e80138d178f340cd2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.856749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710f855-dd5b-4309-a4c2-28fed630d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:49.858103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710f855-dd5b-4309-a4c2-28fed630d978 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.858379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710f855-dd5b-4309-a4c2-28fed630d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.858744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710f855-dd5b-4309-a4c2-28fed630d978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:49.860014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710f855-dd5b-4309-a4c2-28fed630d978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:49.864636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710f855-dd5b-4309-a4c2-28fed630d978 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:49.869134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee41743b-d0fd-4482-a3de-1d5c64739028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3cf465ccb24b4e80138d178f340cd2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.882798 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 976/1945] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:49.884240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e037dd2-f7c1-4cf8-8f2f-d8791152e606 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.884527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e037dd2-f7c1-4cf8-8f2f-d8791152e606 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.886067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e037dd2-f7c1-4cf8-8f2f-d8791152e606 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:49.890576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee41743b-d0fd-4482-a3de-1d5c64739028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3cf465ccb24b4e80138d178f340cd2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:49.891565 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 977/1946] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 01:00:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:00:49.892878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e037dd2-f7c1-4cf8-8f2f-d8791152e606 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:49.896066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2e037dd2-f7c1-4cf8-8f2f-d8791152e606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:49.899449 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 970/1947] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:49 2022] DELETE /identity/v3/users/8e3cf465ccb24b4e80138d178f340cd2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:49.900837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdba2e5-070b-447b-9480-f9bc3d265395 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.901124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdba2e5-070b-447b-9480-f9bc3d265395 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.901406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdba2e5-070b-447b-9480-f9bc3d265395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:49.934999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9fdba2e5-070b-447b-9480-f9bc3d265395 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:49.936983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9fdba2e5-070b-447b-9480-f9bc3d265395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:49.993137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e037dd2-f7c1-4cf8-8f2f-d8791152e606 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:49.997535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5231395-51c4-47f6-bd45-0f32cc302ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:49.998157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5231395-51c4-47f6-bd45-0f32cc302ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:49.998440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5231395-51c4-47f6-bd45-0f32cc302ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:49.998786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5231395-51c4-47f6-bd45-0f32cc302ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:50.000976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d5231395-51c4-47f6-bd45-0f32cc302ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:50.048196 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:50.091706 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 971/1948] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:50.095994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdba2e5-070b-447b-9480-f9bc3d265395 None None] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:00:50.099263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9fdba2e5-070b-447b-9480-f9bc3d265395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:50.132295 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:50.143919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5231395-51c4-47f6-bd45-0f32cc302ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:50.146154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5231395-51c4-47f6-bd45-0f32cc302ef2 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:50.159462 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 978/1949] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:50.160339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5231395-51c4-47f6-bd45-0f32cc302ef2 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:50.162484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d5231395-51c4-47f6-bd45-0f32cc302ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:50.177186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5231395-51c4-47f6-bd45-0f32cc302ef2 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:50.188242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304fc85-179f-478f-b08b-33ab4b9a4431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:50.188931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304fc85-179f-478f-b08b-33ab4b9a4431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:50.189394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304fc85-179f-478f-b08b-33ab4b9a4431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:50.190862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304fc85-179f-478f-b08b-33ab4b9a4431 admin admin] PATH_INFO: `/v3/projects/d08741b6addc4ad08cf25437f55b8d3b/users/1ed14feef0fd460ea3967896cfdf4af3/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:50.216484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304fc85-179f-478f-b08b-33ab4b9a4431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08741b6addc4ad08cf25437f55b8d3b, user_id=1ed14feef0fd460ea3967896cfdf4af3, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:50.225823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304fc85-179f-478f-b08b-33ab4b9a4431 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:50.242070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdba2e5-070b-447b-9480-f9bc3d265395 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:50.243390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9fdba2e5-070b-447b-9480-f9bc3d265395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:50.246758 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 979/1950] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:50 2022] PUT /identity/v3/projects/d08741b6addc4ad08cf25437f55b8d3b/users/1ed14feef0fd460ea3967896cfdf4af3/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:50.248448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c5ae1-0085-463e-b1e5-8421cffc1547 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:50.248858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c5ae1-0085-463e-b1e5-8421cffc1547 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:50.249230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c5ae1-0085-463e-b1e5-8421cffc1547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:50.295615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-925c5ae1-0085-463e-b1e5-8421cffc1547 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:50.297362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-925c5ae1-0085-463e-b1e5-8421cffc1547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:50.372789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdba2e5-070b-447b-9480-f9bc3d265395 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:50.423474 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 980/1951] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:50.429580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587523aa-3513-426f-88a4-b16f43877fd7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:50.429887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587523aa-3513-426f-88a4-b16f43877fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:50.436050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587523aa-3513-426f-88a4-b16f43877fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:50.468468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79b946-fabd-4c6f-90a4-824a1b1b7949 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c0eb3f4d194c6bb7a9cb17181af537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0689cfb594ea4d7b8c67766a5debfb0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:50.469695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b946-fabd-4c6f-90a4-824a1b1b7949 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:50.470186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b946-fabd-4c6f-90a4-824a1b1b7949 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:50.470723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b946-fabd-4c6f-90a4-824a1b1b7949 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] PATH_INFO: `/v3/projects/971a3b910aec48df8184ce85d2ee104b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:50.475148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79b946-fabd-4c6f-90a4-824a1b1b7949 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorizing `identity:get_project(project_id=971a3b910aec48df8184ce85d2ee104b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:50.480997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-587523aa-3513-426f-88a4-b16f43877fd7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:50.482226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-587523aa-3513-426f-88a4-b16f43877fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:50.484863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79b946-fabd-4c6f-90a4-824a1b1b7949 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:50.492598 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 972/1952] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:00:50 2022] GET /identity/v3/projects/971a3b910aec48df8184ce85d2ee104b => generated 393 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:50.493682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79b946-fabd-4c6f-90a4-824a1b1b7949 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:50.617895 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:50.640889 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 981/1953] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:50.642528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587523aa-3513-426f-88a4-b16f43877fd7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:50.659658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587523aa-3513-426f-88a4-b16f43877fd7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:50.671850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c79806-a978-4a1c-a622-af45bc5a0c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:50.672507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c79806-a978-4a1c-a622-af45bc5a0c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:50.672745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c79806-a978-4a1c-a622-af45bc5a0c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:50.673020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c79806-a978-4a1c-a622-af45bc5a0c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:50.673666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c79806-a978-4a1c-a622-af45bc5a0c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:50.675798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c79806-a978-4a1c-a622-af45bc5a0c99 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:50.688158 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 982/1954] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:50.688989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79b946-fabd-4c6f-90a4-824a1b1b7949 tempest-FlavorsAccessNegativeTestJSON-1140128359 tempest-FlavorsAccessNegativeTestJSON-1140128359-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:50.689105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c79806-a978-4a1c-a622-af45bc5a0c99 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:50.691251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-31c79806-a978-4a1c-a622-af45bc5a0c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:50.696632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e3df3-c7f2-4392-90bc-337c7ca6c093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:50.697503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e3df3-c7f2-4392-90bc-337c7ca6c093 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:50.697996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e3df3-c7f2-4392-90bc-337c7ca6c093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:50.698532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e3df3-c7f2-4392-90bc-337c7ca6c093 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:50.701141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e3df3-c7f2-4392-90bc-337c7ca6c093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:50.701141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e3df3-c7f2-4392-90bc-337c7ca6c093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:50.708433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e3df3-c7f2-4392-90bc-337c7ca6c093 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:50.727490 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 973/1955] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:50.727490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e3df3-c7f2-4392-90bc-337c7ca6c093 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:50.731100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c79806-a978-4a1c-a622-af45bc5a0c99 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:50.747247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5f318-fb97-40bc-8937-cfe0058881e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:50.749255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5f318-fb97-40bc-8937-cfe0058881e1 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:50.749761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5f318-fb97-40bc-8937-cfe0058881e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:50.759730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5f318-fb97-40bc-8937-cfe0058881e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:50.779740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5f318-fb97-40bc-8937-cfe0058881e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:50.781720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5f318-fb97-40bc-8937-cfe0058881e1 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:50.794849 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 983/1956] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:50.795771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5f318-fb97-40bc-8937-cfe0058881e1 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:50.797202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8aa5f318-fb97-40bc-8937-cfe0058881e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:50.864752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5f318-fb97-40bc-8937-cfe0058881e1 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:50.865524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e3df3-c7f2-4392-90bc-337c7ca6c093 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:50.874514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49b5ff-d413-42a7-8b0a-c2a7aea47add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:50.876094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49b5ff-d413-42a7-8b0a-c2a7aea47add service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:50.876226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:50.876656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49b5ff-d413-42a7-8b0a-c2a7aea47add service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:50.877060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:50.877228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49b5ff-d413-42a7-8b0a-c2a7aea47add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:50.877523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:50.878569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] PATH_INFO: `/v3/users/2dc3379a5fe444c8944f8c342aa7852e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:50.881478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc3379a5fe444c8944f8c342aa7852e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:50.886564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:50.918015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49b5ff-d413-42a7-8b0a-c2a7aea47add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:50.922828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49b5ff-d413-42a7-8b0a-c2a7aea47add service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:50.956801 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 974/1957] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:50.959047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49b5ff-d413-42a7-8b0a-c2a7aea47add service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:50.990560 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:51.008279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49b5ff-d413-42a7-8b0a-c2a7aea47add service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:51.019767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858a3b6-f91f-4d80-a861-898234fea5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:51.020846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858a3b6-f91f-4d80-a861-898234fea5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:51.021133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858a3b6-f91f-4d80-a861-898234fea5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:51.021412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858a3b6-f91f-4d80-a861-898234fea5a4 admin admin] PATH_INFO: `/v3/projects/d08741b6addc4ad08cf25437f55b8d3b/users/1ed14feef0fd460ea3967896cfdf4af3/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:51.027836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858a3b6-f91f-4d80-a861-898234fea5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08741b6addc4ad08cf25437f55b8d3b, user_id=1ed14feef0fd460ea3967896cfdf4af3, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:51.031641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858a3b6-f91f-4d80-a861-898234fea5a4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:51.035238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc3379a5fe444c8944f8c342aa7852e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.059632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc3379a5fe444c8944f8c342aa7852e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.060569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc3379a5fe444c8944f8c342aa7852e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.072047 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 975/1958] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:50 2022] PUT /identity/v3/projects/d08741b6addc4ad08cf25437f55b8d3b/users/1ed14feef0fd460ea3967896cfdf4af3/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:51.073871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858a3b6-f91f-4d80-a861-898234fea5a4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:51.077814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f858a3b6-f91f-4d80-a861-898234fea5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:51.088150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc3379a5fe444c8944f8c342aa7852e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.089605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc3379a5fe444c8944f8c342aa7852e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.120872 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 984/1959] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:50 2022] DELETE /identity/v3/users/2dc3379a5fe444c8944f8c342aa7852e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:51.122739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:51.124859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:51.189145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858a3b6-f91f-4d80-a861-898234fea5a4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:51.232975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ca742-32be-4b35-9748-393b2cee9e56 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:51.244151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:51.244818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:51.245102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:51.245380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] PATH_INFO: `/v3/projects/5f37a7d5a9874b9488057d6dceb2f481` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:51.254531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f37a7d5a9874b9488057d6dceb2f481)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:51.259004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:51.335352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b33a4-6eaa-4a41-a0e7-35043f187f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:51.336313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b33a4-6eaa-4a41-a0e7-35043f187f28 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:51.338477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b33a4-6eaa-4a41-a0e7-35043f187f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:51.339167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b33a4-6eaa-4a41-a0e7-35043f187f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:51.339900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f37a7d5a9874b9488057d6dceb2f481', 'request_id': 'req-caedfb6e-44b9-473c-b01c-b111e3c65521'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.341119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b33a4-6eaa-4a41-a0e7-35043f187f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:51.348471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b33a4-6eaa-4a41-a0e7-35043f187f28 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:51.353303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f37a7d5a9874b9488057d6dceb2f481', 'request_id': 'req-caedfb6e-44b9-473c-b01c-b111e3c65521'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.360378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f37a7d5a9874b9488057d6dceb2f481', 'request_id': 'req-caedfb6e-44b9-473c-b01c-b111e3c65521'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.382200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] The token cache is being invalidate because project 5f37a7d5a9874b9488057d6dceb2f481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:51.382572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.383843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-caedfb6e-44b9-473c-b01c-b111e3c65521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.387642 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 985/1960] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:51 2022] DELETE /identity/v3/projects/5f37a7d5a9874b9488057d6dceb2f481 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:51.388951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991024-a0c8-4bee-b943-15db8d0efa1a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:51.389242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991024-a0c8-4bee-b943-15db8d0efa1a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:51.389516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991024-a0c8-4bee-b943-15db8d0efa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:51.397451 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:51.426837 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 976/1961] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:51 2022] POST /identity/v3/projects => generated 403 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:51.428315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d1dc9-2ec7-456c-ab69-f4884386b1e2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:51.428652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d1dc9-2ec7-456c-ab69-f4884386b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:51.429043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d1dc9-2ec7-456c-ab69-f4884386b1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:51.455861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e6991024-a0c8-4bee-b943-15db8d0efa1a None None] MFA Rules not processed for user `1ed14feef0fd460ea3967896cfdf4af3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:51.457369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e6991024-a0c8-4bee-b943-15db8d0efa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:51.461847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-456d1dc9-2ec7-456c-ab69-f4884386b1e2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:51.463130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-456d1dc9-2ec7-456c-ab69-f4884386b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:51.510194 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:51.563172 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 977/1962] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:51.564474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d1dc9-2ec7-456c-ab69-f4884386b1e2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:51.566503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-456d1dc9-2ec7-456c-ab69-f4884386b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:51.581559 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 986/1963] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:51.582809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6991024-a0c8-4bee-b943-15db8d0efa1a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:51.590582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d1dc9-2ec7-456c-ab69-f4884386b1e2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:51.594323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e6991024-a0c8-4bee-b943-15db8d0efa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:51.597284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:51.597945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:51.598232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:51.598510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] PATH_INFO: `/v3/users/f7ff233a16f347efb45214da0b05741c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:51.599788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ff233a16f347efb45214da0b05741c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:51.601930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:51.614634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6991024-a0c8-4bee-b943-15db8d0efa1a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:51.628641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:51.630310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:51.630982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:51.631438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] PATH_INFO: `/v3/projects/70e0212c0d3e458c8efb5e70e719642b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:51.632899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e0212c0d3e458c8efb5e70e719642b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:51.635114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:51.680751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ff233a16f347efb45214da0b05741c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.696914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ff233a16f347efb45214da0b05741c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.697992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ff233a16f347efb45214da0b05741c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.710115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ff233a16f347efb45214da0b05741c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.717196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e0212c0d3e458c8efb5e70e719642b', 'request_id': 'req-71f9ee35-679d-4fd7-b276-fd6cf02fc445'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.722530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ff233a16f347efb45214da0b05741c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.724873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e0212c0d3e458c8efb5e70e719642b', 'request_id': 'req-71f9ee35-679d-4fd7-b276-fd6cf02fc445'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.731725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e0212c0d3e458c8efb5e70e719642b', 'request_id': 'req-71f9ee35-679d-4fd7-b276-fd6cf02fc445'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.738962 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 978/1964] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:51 2022] DELETE /identity/v3/users/f7ff233a16f347efb45214da0b05741c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:51.740126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:51.744636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:51.755653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] The token cache is being invalidate because project 70e0212c0d3e458c8efb5e70e719642b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:51.757571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.758993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:51.766115 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 987/1965] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:51 2022] DELETE /identity/v3/projects/70e0212c0d3e458c8efb5e70e719642b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:51.769239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:51.770383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:51.857702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9ee35-679d-4fd7-b276-fd6cf02fc445 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:51.876750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343e176-d98e-4dae-ae83-0d456659e2f8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:51.884011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2a62c-4a87-4498-b0be-192b8b024b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:51.885501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2a62c-4a87-4498-b0be-192b8b024b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:51.885964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2a62c-4a87-4498-b0be-192b8b024b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:51.886310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2a62c-4a87-4498-b0be-192b8b024b64 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:51.887328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2a62c-4a87-4498-b0be-192b8b024b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:51.890872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2a62c-4a87-4498-b0be-192b8b024b64 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:51.908959 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:51.927681 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 979/1966] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:51 2022] POST /identity/v3/users => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:51.928735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2a62c-4a87-4498-b0be-192b8b024b64 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:51.932719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8ff2a62c-4a87-4498-b0be-192b8b024b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:51.950775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31626-c8db-422e-9748-9bbea5898c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:51.951707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31626-c8db-422e-9748-9bbea5898c8b service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:51.951950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31626-c8db-422e-9748-9bbea5898c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:51.952230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31626-c8db-422e-9748-9bbea5898c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:51.954854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8bb31626-c8db-422e-9748-9bbea5898c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:51.974747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb31626-c8db-422e-9748-9bbea5898c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:51.977121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb31626-c8db-422e-9748-9bbea5898c8b service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:51.998629 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 988/1967] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:52.007052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31626-c8db-422e-9748-9bbea5898c8b service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:52.010915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8bb31626-c8db-422e-9748-9bbea5898c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.048672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31626-c8db-422e-9748-9bbea5898c8b service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:52.063548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:52.064265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:52.064554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:52.065084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] PATH_INFO: `/v3/users/3714cf0fbdbe42e49339278897659010` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:52.067126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3714cf0fbdbe42e49339278897659010)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:52.069091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:52.072266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2a62c-4a87-4498-b0be-192b8b024b64 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:52.072476 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:52.080595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe957f8-645c-4ca7-9a2f-2fbb58d81f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:52.082303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe957f8-645c-4ca7-9a2f-2fbb58d81f66 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:52.082867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe957f8-645c-4ca7-9a2f-2fbb58d81f66 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:52.083243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe957f8-645c-4ca7-9a2f-2fbb58d81f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:52.090251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-efe957f8-645c-4ca7-9a2f-2fbb58d81f66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.175636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3714cf0fbdbe42e49339278897659010'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.196628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe957f8-645c-4ca7-9a2f-2fbb58d81f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:52.198391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe957f8-645c-4ca7-9a2f-2fbb58d81f66 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:52.198582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3714cf0fbdbe42e49339278897659010'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.199401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3714cf0fbdbe42e49339278897659010'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.209570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3714cf0fbdbe42e49339278897659010'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.210309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3714cf0fbdbe42e49339278897659010'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.223240 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 980/1968] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:52.224910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43dfa2-ba26-4f47-887e-590b92158bc0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:52.225328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43dfa2-ba26-4f47-887e-590b92158bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:52.225608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43dfa2-ba26-4f47-887e-590b92158bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:52.227802 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 989/1969] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:51 2022] DELETE /identity/v3/users/3714cf0fbdbe42e49339278897659010 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:52.230006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:52.233228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.286301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9b43dfa2-ba26-4f47-887e-590b92158bc0 None None] MFA Rules not processed for user `058aa80c9ad24366be4f9e6ee9702679`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:52.287826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b43dfa2-ba26-4f47-887e-590b92158bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.369427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f9867-0ef6-4303-9a8e-daed8a2b905e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:52.384048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61165d-054d-4c0f-82ff-400d82d0c557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:52.385116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61165d-054d-4c0f-82ff-400d82d0c557 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:52.385344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61165d-054d-4c0f-82ff-400d82d0c557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:52.386803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61165d-054d-4c0f-82ff-400d82d0c557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:52.387471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61165d-054d-4c0f-82ff-400d82d0c557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:52.392563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61165d-054d-4c0f-82ff-400d82d0c557 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:52.420824 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 990/1970] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:52.421541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61165d-054d-4c0f-82ff-400d82d0c557 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:52.427676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6f61165d-054d-4c0f-82ff-400d82d0c557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.443903 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 981/1971] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:52 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:52.444874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43dfa2-ba26-4f47-887e-590b92158bc0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:52.458966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b43dfa2-ba26-4f47-887e-590b92158bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.461937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61165d-054d-4c0f-82ff-400d82d0c557 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:52.476540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:52.477224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:52.478157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:52.480591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] PATH_INFO: `/v3/projects/3f4f3b62a1274df7b613cf46b93c6b12` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:52.489041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4f3b62a1274df7b613cf46b93c6b12)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:52.492438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43dfa2-ba26-4f47-887e-590b92158bc0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:52.492975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:52.505962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:52.516057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:52.516344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:52.516623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] PATH_INFO: `/v3/users/aa80a55b982c4d6aa4e8797582409699` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:52.521817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa80a55b982c4d6aa4e8797582409699)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:52.525574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:52.555170 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:52.571280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4f3b62a1274df7b613cf46b93c6b12', 'request_id': 'req-8f5b26c0-ebfe-44ba-9f63-99f799183075'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.579777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4f3b62a1274df7b613cf46b93c6b12', 'request_id': 'req-8f5b26c0-ebfe-44ba-9f63-99f799183075'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.589478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4f3b62a1274df7b613cf46b93c6b12', 'request_id': 'req-8f5b26c0-ebfe-44ba-9f63-99f799183075'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.604165 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:52.616640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] The token cache is being invalidate because project 3f4f3b62a1274df7b613cf46b93c6b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:52.619578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.622326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.627330 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 991/1972] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:52 2022] DELETE /identity/v3/projects/3f4f3b62a1274df7b613cf46b93c6b12 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:52.627330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:52.629695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.639836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa80a55b982c4d6aa4e8797582409699'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.657820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa80a55b982c4d6aa4e8797582409699'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.658929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa80a55b982c4d6aa4e8797582409699'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.668243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa80a55b982c4d6aa4e8797582409699'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.687162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa80a55b982c4d6aa4e8797582409699'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.701577 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 982/1973] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:52 2022] DELETE /identity/v3/users/aa80a55b982c4d6aa4e8797582409699 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:52.702358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:52.704551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.771564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b26c0-ebfe-44ba-9f63-99f799183075 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:52.813193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eb821-ea76-4185-951a-8c76a923cba8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:52.821507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb007b6-4358-4335-ad3b-1e89fa53286c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:52.822129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb007b6-4358-4335-ad3b-1e89fa53286c service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:52.822470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb007b6-4358-4335-ad3b-1e89fa53286c service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:52.822786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb007b6-4358-4335-ad3b-1e89fa53286c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:52.824537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2fb007b6-4358-4335-ad3b-1e89fa53286c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.851565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f9e2-c7aa-4598-ac6f-a9ab8834da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:52.852564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f9e2-c7aa-4598-ac6f-a9ab8834da96 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:52.853067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f9e2-c7aa-4598-ac6f-a9ab8834da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:52.853489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f9e2-c7aa-4598-ac6f-a9ab8834da96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:52.854276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815f9e2-c7aa-4598-ac6f-a9ab8834da96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:52.856394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815f9e2-c7aa-4598-ac6f-a9ab8834da96 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:52.869398 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 992/1974] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:52.870640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f9e2-c7aa-4598-ac6f-a9ab8834da96 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:52.872681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8815f9e2-c7aa-4598-ac6f-a9ab8834da96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.887273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f9e2-c7aa-4598-ac6f-a9ab8834da96 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:52.896012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb007b6-4358-4335-ad3b-1e89fa53286c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:52.896893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:52.897643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb007b6-4358-4335-ad3b-1e89fa53286c service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:52.897873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:52.898374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:52.898838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] PATH_INFO: `/v3/projects/89a64d4589204aa4ab873fba0cd0f687` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:52.900186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a64d4589204aa4ab873fba0cd0f687)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:52.902390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:52.908587 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 983/1975] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:52 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:52.910664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3aaea-df3d-4825-9246-292b42651d45 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:52.910956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3aaea-df3d-4825-9246-292b42651d45 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:52.911228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3aaea-df3d-4825-9246-292b42651d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:52.932819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ada3aaea-df3d-4825-9246-292b42651d45 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:52.934022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ada3aaea-df3d-4825-9246-292b42651d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.945444 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 984/1976] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:52.947226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27032e-5a2a-426b-ac3b-9d5bc9c8aeaa None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:52.947654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27032e-5a2a-426b-ac3b-9d5bc9c8aeaa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:52.948125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27032e-5a2a-426b-ac3b-9d5bc9c8aeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:52.973321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dd27032e-5a2a-426b-ac3b-9d5bc9c8aeaa None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:52.975614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dd27032e-5a2a-426b-ac3b-9d5bc9c8aeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:52.982085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a64d4589204aa4ab873fba0cd0f687', 'request_id': 'req-c5b49651-44c1-45eb-ae8d-c8186f27ead2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:52.988311 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:52.993050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a64d4589204aa4ab873fba0cd0f687', 'request_id': 'req-c5b49651-44c1-45eb-ae8d-c8186f27ead2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.006225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a64d4589204aa4ab873fba0cd0f687', 'request_id': 'req-c5b49651-44c1-45eb-ae8d-c8186f27ead2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.021276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] The token cache is being invalidate because project 89a64d4589204aa4ab873fba0cd0f687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:53.021724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.022497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.027253 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 993/1977] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:52 2022] DELETE /identity/v3/projects/89a64d4589204aa4ab873fba0cd0f687 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:53.027253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:53.027253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.053994 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 985/1978] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:53.053994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27032e-5a2a-426b-ac3b-9d5bc9c8aeaa None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:53.053994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dd27032e-5a2a-426b-ac3b-9d5bc9c8aeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.065466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27032e-5a2a-426b-ac3b-9d5bc9c8aeaa None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:53.067674 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:53.070669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0a216-fb11-44a1-b023-60d12ff35682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:53.071715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a216-fb11-44a1-b023-60d12ff35682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:53.071997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a216-fb11-44a1-b023-60d12ff35682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:53.072283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a216-fb11-44a1-b023-60d12ff35682 admin admin] PATH_INFO: `/v3/projects/8e5d1e400600432aa47a56ccf42109ce/users/a57f3a9e39de4ba0801d6b449d2cc986/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:53.093605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0a216-fb11-44a1-b023-60d12ff35682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5d1e400600432aa47a56ccf42109ce, user_id=a57f3a9e39de4ba0801d6b449d2cc986, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:53.097484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0a216-fb11-44a1-b023-60d12ff35682 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:53.115551 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 986/1979] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:53 2022] PUT /identity/v3/projects/8e5d1e400600432aa47a56ccf42109ce/users/a57f3a9e39de4ba0801d6b449d2cc986/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:53.115946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b49651-44c1-45eb-ae8d-c8186f27ead2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:53.119760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0a216-fb11-44a1-b023-60d12ff35682 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:53.121530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b0c0a216-fb11-44a1-b023-60d12ff35682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.185568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:53.186418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:53.186798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:53.187144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] PATH_INFO: `/v3/projects/81748c367d34485094ad2f0372a4eecb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:53.188335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81748c367d34485094ad2f0372a4eecb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:53.190704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:53.201164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0a216-fb11-44a1-b023-60d12ff35682 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:53.207713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f79c3f-a191-4af0-81ba-18be562d89fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:53.208472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f79c3f-a191-4af0-81ba-18be562d89fb service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:53.208760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f79c3f-a191-4af0-81ba-18be562d89fb service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:53.209101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f79c3f-a191-4af0-81ba-18be562d89fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:53.211023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20f79c3f-a191-4af0-81ba-18be562d89fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.245839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81748c367d34485094ad2f0372a4eecb', 'request_id': 'req-a885015b-b30a-4bbc-ac83-7b9049e56931'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.251570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81748c367d34485094ad2f0372a4eecb', 'request_id': 'req-a885015b-b30a-4bbc-ac83-7b9049e56931'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.258573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81748c367d34485094ad2f0372a4eecb', 'request_id': 'req-a885015b-b30a-4bbc-ac83-7b9049e56931'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.274442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] The token cache is being invalidate because project 81748c367d34485094ad2f0372a4eecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:53.274765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.275710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a885015b-b30a-4bbc-ac83-7b9049e56931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.281089 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 994/1980] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:53 2022] DELETE /identity/v3/projects/81748c367d34485094ad2f0372a4eecb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:53.281089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdec220-a638-43e7-88a5-238f1b57fae5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:53.281089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdec220-a638-43e7-88a5-238f1b57fae5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:53.281089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdec220-a638-43e7-88a5-238f1b57fae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:53.288923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f79c3f-a191-4af0-81ba-18be562d89fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:53.290128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f79c3f-a191-4af0-81ba-18be562d89fb service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:53.300873 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 987/1981] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:53 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:53.301700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f79c3f-a191-4af0-81ba-18be562d89fb service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:53.302171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1cdec220-a638-43e7-88a5-238f1b57fae5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:53.303102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20f79c3f-a191-4af0-81ba-18be562d89fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.303391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1cdec220-a638-43e7-88a5-238f1b57fae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.320599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f79c3f-a191-4af0-81ba-18be562d89fb service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:53.358564 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:53.386865 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 995/1982] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:53.387938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdec220-a638-43e7-88a5-238f1b57fae5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:53.389411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1cdec220-a638-43e7-88a5-238f1b57fae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.396121 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:53.457825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9306226-6690-4233-9dd9-da5c2d3c079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:53.458640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9306226-6690-4233-9dd9-da5c2d3c079a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:53.459725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9306226-6690-4233-9dd9-da5c2d3c079a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:53.460157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9306226-6690-4233-9dd9-da5c2d3c079a admin admin] PATH_INFO: `/v3/users/09c0eb3f4d194c6bb7a9cb17181af537` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:53.463375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9306226-6690-4233-9dd9-da5c2d3c079a admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c0eb3f4d194c6bb7a9cb17181af537)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:53.465708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9306226-6690-4233-9dd9-da5c2d3c079a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:53.505331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdec220-a638-43e7-88a5-238f1b57fae5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:53.511173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ab8bc-bfbf-477b-a1b0-467e93412b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:53.512118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ab8bc-bfbf-477b-a1b0-467e93412b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:53.512639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ab8bc-bfbf-477b-a1b0-467e93412b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:53.513464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ab8bc-bfbf-477b-a1b0-467e93412b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:53.516126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-911ab8bc-bfbf-477b-a1b0-467e93412b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.541000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9306226-6690-4233-9dd9-da5c2d3c079a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c0eb3f4d194c6bb7a9cb17181af537'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.557365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ab8bc-bfbf-477b-a1b0-467e93412b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:53.558957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ab8bc-bfbf-477b-a1b0-467e93412b26 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:53.559899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9306226-6690-4233-9dd9-da5c2d3c079a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c0eb3f4d194c6bb7a9cb17181af537'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.560987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9306226-6690-4233-9dd9-da5c2d3c079a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c0eb3f4d194c6bb7a9cb17181af537'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.572226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9306226-6690-4233-9dd9-da5c2d3c079a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c0eb3f4d194c6bb7a9cb17181af537'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.572602 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 996/1983] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:53.574065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66de29-df45-4b2d-a509-bf15f9b6b703 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:53.574354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66de29-df45-4b2d-a509-bf15f9b6b703 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:53.574639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66de29-df45-4b2d-a509-bf15f9b6b703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:53.581655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9306226-6690-4233-9dd9-da5c2d3c079a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c0eb3f4d194c6bb7a9cb17181af537'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:53.600627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3b66de29-df45-4b2d-a509-bf15f9b6b703 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:53.601866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3b66de29-df45-4b2d-a509-bf15f9b6b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.605289 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 988/1984] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:53 2022] DELETE /identity/v3/users/09c0eb3f4d194c6bb7a9cb17181af537 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:53.621823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a43ab-4a4a-476d-8858-8c92be29b656 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:53.622134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a43ab-4a4a-476d-8858-8c92be29b656 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:53.622414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a43ab-4a4a-476d-8858-8c92be29b656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:53.677757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8b6a43ab-4a4a-476d-8858-8c92be29b656 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:53.681286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8b6a43ab-4a4a-476d-8858-8c92be29b656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.802484 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 997/1985] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:53.803023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66de29-df45-4b2d-a509-bf15f9b6b703 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:53.807720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3b66de29-df45-4b2d-a509-bf15f9b6b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.817726 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 989/1986] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:53.826832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511efa-3ebb-41c4-bd10-f36619a5bbfc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:53.827247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511efa-3ebb-41c4-bd10-f36619a5bbfc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:53.827620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511efa-3ebb-41c4-bd10-f36619a5bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:53.828881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66de29-df45-4b2d-a509-bf15f9b6b703 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:53.836177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed79b1-58bf-4651-9a8c-2d74646a9eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:53.836852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed79b1-58bf-4651-9a8c-2d74646a9eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:53.837140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed79b1-58bf-4651-9a8c-2d74646a9eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:53.837419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed79b1-58bf-4651-9a8c-2d74646a9eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:53.838089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed79b1-58bf-4651-9a8c-2d74646a9eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:53.838654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed79b1-58bf-4651-9a8c-2d74646a9eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:53.840838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed79b1-58bf-4651-9a8c-2d74646a9eb6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:53.862694 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 998/1987] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:53.863102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d6511efa-3ebb-41c4-bd10-f36619a5bbfc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:53.864420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6511efa-3ebb-41c4-bd10-f36619a5bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.864953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed79b1-58bf-4651-9a8c-2d74646a9eb6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:53.879078 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 990/1988] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:00:53.879078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6511efa-3ebb-41c4-bd10-f36619a5bbfc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:53.879078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6511efa-3ebb-41c4-bd10-f36619a5bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:53.879437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed79b1-58bf-4651-9a8c-2d74646a9eb6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:53.886542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d4f39-3338-4264-ba04-135c234f4c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:53.887325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d4f39-3338-4264-ba04-135c234f4c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:53.887646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d4f39-3338-4264-ba04-135c234f4c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:53.887817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d4f39-3338-4264-ba04-135c234f4c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:53.888696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d4f39-3338-4264-ba04-135c234f4c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:53.891998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d4f39-3338-4264-ba04-135c234f4c42 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:53.940048 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 999/1989] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:53 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:53.941597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d4f39-3338-4264-ba04-135c234f4c42 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:53.981005 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:54.018482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6511efa-3ebb-41c4-bd10-f36619a5bbfc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:54.069727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d4f39-3338-4264-ba04-135c234f4c42 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:54.075241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7694fe-747f-450f-a1f4-bc0e9b5592a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:54.076727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7694fe-747f-450f-a1f4-bc0e9b5592a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:54.076727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7694fe-747f-450f-a1f4-bc0e9b5592a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:54.077215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7694fe-747f-450f-a1f4-bc0e9b5592a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:54.078362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7694fe-747f-450f-a1f4-bc0e9b5592a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:54.078743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7694fe-747f-450f-a1f4-bc0e9b5592a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:54.097600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7694fe-747f-450f-a1f4-bc0e9b5592a2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:54.144731 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1000/1990] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:54.146428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7694fe-747f-450f-a1f4-bc0e9b5592a2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:54.152492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789e6b1-423a-4970-9e49-6535eee80ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:54.153117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789e6b1-423a-4970-9e49-6535eee80ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:54.153398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789e6b1-423a-4970-9e49-6535eee80ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:54.153685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789e6b1-423a-4970-9e49-6535eee80ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:54.157024 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:54.161534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7694fe-747f-450f-a1f4-bc0e9b5592a2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:54.168101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3103c34-9780-426e-bc58-ea9562a785e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:54.168275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789e6b1-423a-4970-9e49-6535eee80ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:54.169074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103c34-9780-426e-bc58-ea9562a785e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:54.169504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103c34-9780-426e-bc58-ea9562a785e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:54.169927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103c34-9780-426e-bc58-ea9562a785e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:54.170048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789e6b1-423a-4970-9e49-6535eee80ab8 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:54.170769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3103c34-9780-426e-bc58-ea9562a785e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:54.172793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3103c34-9780-426e-bc58-ea9562a785e1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:54.195272 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 991/1991] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:54.196186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789e6b1-423a-4970-9e49-6535eee80ab8 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:54.209721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789e6b1-423a-4970-9e49-6535eee80ab8 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:54.224874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e1312-1d8d-4a60-9c2f-25051a1cd350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:54.225633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1312-1d8d-4a60-9c2f-25051a1cd350 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:54.225985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1312-1d8d-4a60-9c2f-25051a1cd350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:54.226405 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1001/1992] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:54 2022] POST /identity/v3/users => generated 296 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:54.226772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1312-1d8d-4a60-9c2f-25051a1cd350 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:54.230497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e1312-1d8d-4a60-9c2f-25051a1cd350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:54.230712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3103c34-9780-426e-bc58-ea9562a785e1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:54.232873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e1312-1d8d-4a60-9c2f-25051a1cd350 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:54.247306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3103c34-9780-426e-bc58-ea9562a785e1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:54.253583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06de2-4ffd-40c5-8acb-98994855a205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:54.254322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06de2-4ffd-40c5-8acb-98994855a205 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:54.254730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06de2-4ffd-40c5-8acb-98994855a205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:54.255579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06de2-4ffd-40c5-8acb-98994855a205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:54.255788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b06de2-4ffd-40c5-8acb-98994855a205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:54.258689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b06de2-4ffd-40c5-8acb-98994855a205 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:54.280695 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1002/1993] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:54.281943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06de2-4ffd-40c5-8acb-98994855a205 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:54.292083 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 992/1994] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:54 2022] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:54.299002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e1312-1d8d-4a60-9c2f-25051a1cd350 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:54.300492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06de2-4ffd-40c5-8acb-98994855a205 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:54.304509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-321e1312-1d8d-4a60-9c2f-25051a1cd350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:54.428937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e1312-1d8d-4a60-9c2f-25051a1cd350 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:54.434406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b0e98-ecd4-4b6a-8ca4-22381663ca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:54.435135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0e98-ecd4-4b6a-8ca4-22381663ca69 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:54.435447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:54.435591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0e98-ecd4-4b6a-8ca4-22381663ca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:54.435971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0e98-ecd4-4b6a-8ca4-22381663ca69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:54.436076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:54.436356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:54.436783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] PATH_INFO: `/v3/projects/0689cfb594ea4d7b8c67766a5debfb0f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:54.436897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b0e98-ecd4-4b6a-8ca4-22381663ca69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:54.437969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0689cfb594ea4d7b8c67766a5debfb0f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:54.440277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b0e98-ecd4-4b6a-8ca4-22381663ca69 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:54.440542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:54.466809 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1003/1995] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:54.471351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b0e98-ecd4-4b6a-8ca4-22381663ca69 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:54.498616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b0e98-ecd4-4b6a-8ca4-22381663ca69 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:54.517432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0689cfb594ea4d7b8c67766a5debfb0f', 'request_id': 'req-024610b5-c3ec-4fa3-8925-78f9f724af8f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:54.567276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0689cfb594ea4d7b8c67766a5debfb0f', 'request_id': 'req-024610b5-c3ec-4fa3-8925-78f9f724af8f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:54.575384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0689cfb594ea4d7b8c67766a5debfb0f', 'request_id': 'req-024610b5-c3ec-4fa3-8925-78f9f724af8f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:54.600571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] The token cache is being invalidate because project 0689cfb594ea4d7b8c67766a5debfb0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:54.602391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:54.606051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:54.608873 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 993/1996] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:54 2022] DELETE /identity/v3/projects/0689cfb594ea4d7b8c67766a5debfb0f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:54.609604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:54.613728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:54.627856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7dc79-9aa1-427f-84fd-70ece8cc8e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:54.629720 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:54.630518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7dc79-9aa1-427f-84fd-70ece8cc8e42 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:54.631143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7dc79-9aa1-427f-84fd-70ece8cc8e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:54.631621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7dc79-9aa1-427f-84fd-70ece8cc8e42 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:54.633921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7dc79-9aa1-427f-84fd-70ece8cc8e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:54.637005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7dc79-9aa1-427f-84fd-70ece8cc8e42 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:54.684982 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1004/1997] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:54 2022] POST /identity/v3/users => generated 305 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:54.686024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7dc79-9aa1-427f-84fd-70ece8cc8e42 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:54.688325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d4b7dc79-9aa1-427f-84fd-70ece8cc8e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:54.717468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7dc79-9aa1-427f-84fd-70ece8cc8e42 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:54.724107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:54.725054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:54.725638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:54.726079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] PATH_INFO: `/v3/projects/9663524075c44863b570a2d5e000f84e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:54.727798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9663524075c44863b570a2d5e000f84e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:54.730123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:54.782241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024610b5-c3ec-4fa3-8925-78f9f724af8f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:54.790657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808395fa-2298-4938-9094-87bb33749be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:54.793275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808395fa-2298-4938-9094-87bb33749be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:54.794305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808395fa-2298-4938-9094-87bb33749be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:54.794903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808395fa-2298-4938-9094-87bb33749be8 admin admin] PATH_INFO: `/v3/projects/db6033bb398f44bb8482a8dce6acb55a/users/ff89a664966144fa9e1103705953a91f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:54.819082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808395fa-2298-4938-9094-87bb33749be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6033bb398f44bb8482a8dce6acb55a, user_id=ff89a664966144fa9e1103705953a91f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:54.822842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808395fa-2298-4938-9094-87bb33749be8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:54.843646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9663524075c44863b570a2d5e000f84e', 'request_id': 'req-b713d06f-e56c-4cca-b8cf-615378efbfcc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:54.846969 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 994/1998] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:54 2022] PUT /identity/v3/projects/db6033bb398f44bb8482a8dce6acb55a/users/ff89a664966144fa9e1103705953a91f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:54.851261 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:54.852679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9663524075c44863b570a2d5e000f84e', 'request_id': 'req-b713d06f-e56c-4cca-b8cf-615378efbfcc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:54.854215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808395fa-2298-4938-9094-87bb33749be8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:54.858816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-808395fa-2298-4938-9094-87bb33749be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:54.866935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9663524075c44863b570a2d5e000f84e', 'request_id': 'req-b713d06f-e56c-4cca-b8cf-615378efbfcc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:54.916648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] The token cache is being invalidate because project 9663524075c44863b570a2d5e000f84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:54.916949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:54.918071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:54.920316 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1005/1999] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:54 2022] DELETE /identity/v3/projects/9663524075c44863b570a2d5e000f84e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:54.921203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:54.922564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:54.964005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808395fa-2298-4938-9094-87bb33749be8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:54.973583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:54.974308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:54.974561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:54.974873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] PATH_INFO: `/v3/users/df350b4c21de4ff38591b461b64526d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:54.976681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df350b4c21de4ff38591b461b64526d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:54.981557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:55.077808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df350b4c21de4ff38591b461b64526d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:55.080841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d06f-e56c-4cca-b8cf-615378efbfcc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:55.090197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb7815-03ca-41be-b4ea-5e0c3c20da32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:55.090850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb7815-03ca-41be-b4ea-5e0c3c20da32 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:55.092046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb7815-03ca-41be-b4ea-5e0c3c20da32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:55.093860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb7815-03ca-41be-b4ea-5e0c3c20da32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:55.094735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb7815-03ca-41be-b4ea-5e0c3c20da32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:55.098476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb7815-03ca-41be-b4ea-5e0c3c20da32 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:55.101992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df350b4c21de4ff38591b461b64526d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:55.102793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df350b4c21de4ff38591b461b64526d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:55.122318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df350b4c21de4ff38591b461b64526d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:55.129779 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1006/2000] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:55.132150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526571-677d-4ceb-bdf7-704f8348fc5d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:55.133154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526571-677d-4ceb-bdf7-704f8348fc5d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:55.133693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526571-677d-4ceb-bdf7-704f8348fc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:55.137857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df350b4c21de4ff38591b461b64526d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:55.149097 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 995/2001] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:54 2022] DELETE /identity/v3/users/df350b4c21de4ff38591b461b64526d7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:55.150223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:55.156064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:55.177290 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:55.211016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f9526571-677d-4ceb-bdf7-704f8348fc5d None None] MFA Rules not processed for user `ff89a664966144fa9e1103705953a91f`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:55.212652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f9526571-677d-4ceb-bdf7-704f8348fc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:55.324291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb06d8-fb4e-4c68-8b96-02f7973a874e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:55.337320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:55.337983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:55.338386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:55.338686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] PATH_INFO: `/v3/users/1ed14feef0fd460ea3967896cfdf4af3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:55.342363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed14feef0fd460ea3967896cfdf4af3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:55.350109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:55.358720 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1007/2002] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:55.358720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526571-677d-4ceb-bdf7-704f8348fc5d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:55.358720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f9526571-677d-4ceb-bdf7-704f8348fc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:55.406620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526571-677d-4ceb-bdf7-704f8348fc5d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:55.418933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1625d0-ad1b-49ca-8f56-8dd8ffa55261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:55.419556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1625d0-ad1b-49ca-8f56-8dd8ffa55261 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:55.419843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1625d0-ad1b-49ca-8f56-8dd8ffa55261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:55.420692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1625d0-ad1b-49ca-8f56-8dd8ffa55261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:55.420785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1625d0-ad1b-49ca-8f56-8dd8ffa55261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:55.422352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1625d0-ad1b-49ca-8f56-8dd8ffa55261 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:55.427920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed14feef0fd460ea3967896cfdf4af3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:55.438421 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1008/2003] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:55.439300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1625d0-ad1b-49ca-8f56-8dd8ffa55261 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:55.443134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0a1625d0-ad1b-49ca-8f56-8dd8ffa55261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:55.469735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1625d0-ad1b-49ca-8f56-8dd8ffa55261 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:55.480233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aedfd-402b-4bd7-8311-7a2f7afe418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:55.483819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aedfd-402b-4bd7-8311-7a2f7afe418d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:55.484102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aedfd-402b-4bd7-8311-7a2f7afe418d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:55.484374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aedfd-402b-4bd7-8311-7a2f7afe418d admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:55.485035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aedfd-402b-4bd7-8311-7a2f7afe418d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:55.486031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed14feef0fd460ea3967896cfdf4af3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:55.486975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed14feef0fd460ea3967896cfdf4af3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:55.493024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aedfd-402b-4bd7-8311-7a2f7afe418d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:55.508810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed14feef0fd460ea3967896cfdf4af3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:55.529070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed14feef0fd460ea3967896cfdf4af3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:55.568026 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 996/2004] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:55 2022] DELETE /identity/v3/users/1ed14feef0fd460ea3967896cfdf4af3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:55.569027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:55.572769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:55.601388 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1009/2005] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:55 2022] POST /identity/v3/projects => generated 391 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:55.605218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aedfd-402b-4bd7-8311-7a2f7afe418d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:55.607588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-243aedfd-402b-4bd7-8311-7a2f7afe418d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:55.737397 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:55.796764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aedfd-402b-4bd7-8311-7a2f7afe418d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:55.804580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42714a8d-cb95-4447-935d-799aa609b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:55.805383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42714a8d-cb95-4447-935d-799aa609b910 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:55.805743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42714a8d-cb95-4447-935d-799aa609b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:55.806103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42714a8d-cb95-4447-935d-799aa609b910 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:55.806897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42714a8d-cb95-4447-935d-799aa609b910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:55.809275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42714a8d-cb95-4447-935d-799aa609b910 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:55.853566 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1010/2006] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:55 2022] POST /identity/v3/users => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:55.854740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f2eb4-d358-48c9-9fdc-1d86c42e5f6c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:55.855384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42714a8d-cb95-4447-935d-799aa609b910 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:55.865488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b809a8-a25d-4fc4-9d20-b813155b7853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:55.866593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b809a8-a25d-4fc4-9d20-b813155b7853 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:55.867074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b809a8-a25d-4fc4-9d20-b813155b7853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:55.867648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b809a8-a25d-4fc4-9d20-b813155b7853 admin admin] PATH_INFO: `/v3/projects/c2a8a7039164415c9e24560176720a9a/users/7fd71817eafa4b4cbbac7c2a6bbfb105/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:55.868134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42714a8d-cb95-4447-935d-799aa609b910 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:55.874718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b296b0-4fed-4e4f-8404-9f8873fbf0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:55.875461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b296b0-4fed-4e4f-8404-9f8873fbf0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:55.875814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b296b0-4fed-4e4f-8404-9f8873fbf0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:55.876197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b296b0-4fed-4e4f-8404-9f8873fbf0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:55.876923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b296b0-4fed-4e4f-8404-9f8873fbf0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:55.879670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b296b0-4fed-4e4f-8404-9f8873fbf0a2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:55.891673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b809a8-a25d-4fc4-9d20-b813155b7853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a8a7039164415c9e24560176720a9a, user_id=7fd71817eafa4b4cbbac7c2a6bbfb105, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:55.896078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b809a8-a25d-4fc4-9d20-b813155b7853 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:55.901550 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1011/2007] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:55.903488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b296b0-4fed-4e4f-8404-9f8873fbf0a2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:55.918538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b296b0-4fed-4e4f-8404-9f8873fbf0a2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:55.934989 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 997/2008] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:55 2022] PUT /identity/v3/projects/c2a8a7039164415c9e24560176720a9a/users/7fd71817eafa4b4cbbac7c2a6bbfb105/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:55.937113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de3663-4618-407d-9b1b-fc9297bc795c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:55.937405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de3663-4618-407d-9b1b-fc9297bc795c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:55.937686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de3663-4618-407d-9b1b-fc9297bc795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:56.001424 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:56.021128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f4de3663-4618-407d-9b1b-fc9297bc795c None None] MFA Rules not processed for user `7fd71817eafa4b4cbbac7c2a6bbfb105`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:56.022577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f4de3663-4618-407d-9b1b-fc9297bc795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:56.025155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d04c4f-b41d-49bb-9c7f-1e0b38b7b116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:56.026499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d04c4f-b41d-49bb-9c7f-1e0b38b7b116 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:56.026837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d04c4f-b41d-49bb-9c7f-1e0b38b7b116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:56.027318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d04c4f-b41d-49bb-9c7f-1e0b38b7b116 admin admin] PATH_INFO: `/v3/projects/fbc822d1d0cb4333b8e4c9cd7956df19/users/011bf08f7d2547028c02580e158ee850/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:56.059577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d04c4f-b41d-49bb-9c7f-1e0b38b7b116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc822d1d0cb4333b8e4c9cd7956df19, user_id=011bf08f7d2547028c02580e158ee850, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:56.062293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d04c4f-b41d-49bb-9c7f-1e0b38b7b116 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:56.085404 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1012/2009] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:55 2022] PUT /identity/v3/projects/fbc822d1d0cb4333b8e4c9cd7956df19/users/011bf08f7d2547028c02580e158ee850/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:56.089009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d04c4f-b41d-49bb-9c7f-1e0b38b7b116 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:56.124471 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 998/2010] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:55 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:56.130355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de3663-4618-407d-9b1b-fc9297bc795c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:56.150310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de3663-4618-407d-9b1b-fc9297bc795c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:56.192810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d04c4f-b41d-49bb-9c7f-1e0b38b7b116 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:56.207463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e653-35f3-49c6-993d-51f6a3e21b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:56.208144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e653-35f3-49c6-993d-51f6a3e21b03 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:56.208504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e653-35f3-49c6-993d-51f6a3e21b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:56.208781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e653-35f3-49c6-993d-51f6a3e21b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:56.209569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275e653-35f3-49c6-993d-51f6a3e21b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:56.211314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275e653-35f3-49c6-993d-51f6a3e21b03 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:56.247518 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1013/2011] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:00:56.249117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e653-35f3-49c6-993d-51f6a3e21b03 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:56.260826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e653-35f3-49c6-993d-51f6a3e21b03 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:56.270105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61447f-96ea-4855-b280-f09b2467bdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:56.271011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61447f-96ea-4855-b280-f09b2467bdd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:56.271318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61447f-96ea-4855-b280-f09b2467bdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:56.271721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61447f-96ea-4855-b280-f09b2467bdd3 admin admin] PATH_INFO: `/v3/projects/fbc822d1d0cb4333b8e4c9cd7956df19/users/011bf08f7d2547028c02580e158ee850/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:56.274356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f69c15-c9d1-4142-b75b-3a5283f25adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:56.274509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61447f-96ea-4855-b280-f09b2467bdd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc822d1d0cb4333b8e4c9cd7956df19, user_id=011bf08f7d2547028c02580e158ee850, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:56.277183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f69c15-c9d1-4142-b75b-3a5283f25adf admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:56.277355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61447f-96ea-4855-b280-f09b2467bdd3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:56.277560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f69c15-c9d1-4142-b75b-3a5283f25adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:56.278152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f69c15-c9d1-4142-b75b-3a5283f25adf admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:56.279025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f69c15-c9d1-4142-b75b-3a5283f25adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:56.282862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f69c15-c9d1-4142-b75b-3a5283f25adf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:56.294640 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1014/2012] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:56 2022] PUT /identity/v3/projects/fbc822d1d0cb4333b8e4c9cd7956df19/users/011bf08f7d2547028c02580e158ee850/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:56.305167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7529-7db2-4e69-9c6e-98799a4d476f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:56.305789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7529-7db2-4e69-9c6e-98799a4d476f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:56.306296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7529-7db2-4e69-9c6e-98799a4d476f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:56.334649 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 999/2013] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:56 2022] POST /identity/v3/projects => generated 407 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:56.337528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f69c15-c9d1-4142-b75b-3a5283f25adf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:56.376240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a1bc7529-7db2-4e69-9c6e-98799a4d476f None None] MFA Rules not processed for user `011bf08f7d2547028c02580e158ee850`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:56.377581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1bc7529-7db2-4e69-9c6e-98799a4d476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:56.399876 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:56.485302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f69c15-c9d1-4142-b75b-3a5283f25adf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:56.499943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f4608-ac11-461e-b4a5-c018d7557278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:56.501573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f4608-ac11-461e-b4a5-c018d7557278 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:56.501853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f4608-ac11-461e-b4a5-c018d7557278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:56.502139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f4608-ac11-461e-b4a5-c018d7557278 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:56.505531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f4608-ac11-461e-b4a5-c018d7557278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:56.507531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f4608-ac11-461e-b4a5-c018d7557278 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:56.523888 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1015/2014] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:56.539782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc7529-7db2-4e69-9c6e-98799a4d476f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:56.543473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1bc7529-7db2-4e69-9c6e-98799a4d476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:56.586469 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1000/2015] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:56 2022] POST /identity/v3/users => generated 310 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:56.588913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f4608-ac11-461e-b4a5-c018d7557278 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:56.604070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f4608-ac11-461e-b4a5-c018d7557278 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:56.615009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37394655-061c-4ac7-8005-8f9884a81bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:56.616395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37394655-061c-4ac7-8005-8f9884a81bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:56.616784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37394655-061c-4ac7-8005-8f9884a81bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:56.618700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37394655-061c-4ac7-8005-8f9884a81bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:56.619987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37394655-061c-4ac7-8005-8f9884a81bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:56.622021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37394655-061c-4ac7-8005-8f9884a81bfe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:56.645423 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1001/2016] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:56.647390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37394655-061c-4ac7-8005-8f9884a81bfe admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:56.649712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37394655-061c-4ac7-8005-8f9884a81bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:56.661880 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:56.669778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37394655-061c-4ac7-8005-8f9884a81bfe admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:56.678526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:56.679889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:56.680245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:56.680894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] PATH_INFO: `/v3/projects/971a3b910aec48df8184ce85d2ee104b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:56.682459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] RBAC: Authorizing `identity:delete_project(project_id=971a3b910aec48df8184ce85d2ee104b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:56.686573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:56.754800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc7529-7db2-4e69-9c6e-98799a4d476f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:56.772371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971a3b910aec48df8184ce85d2ee104b', 'request_id': 'req-62871f6e-932f-4e04-8be3-3b4d7fb217df'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:56.779318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971a3b910aec48df8184ce85d2ee104b', 'request_id': 'req-62871f6e-932f-4e04-8be3-3b4d7fb217df'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:56.794056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971a3b910aec48df8184ce85d2ee104b', 'request_id': 'req-62871f6e-932f-4e04-8be3-3b4d7fb217df'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:56.817673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] The token cache is being invalidate because project 971a3b910aec48df8184ce85d2ee104b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:56.818952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:56.820026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:56.831284 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1002/2017] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:56 2022] DELETE /identity/v3/projects/971a3b910aec48df8184ce85d2ee104b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:56.831284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:56.831284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:56.900849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e240f-1229-42d3-aec7-fb8fb603cd67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:56.901419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e240f-1229-42d3-aec7-fb8fb603cd67 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:56.901793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e240f-1229-42d3-aec7-fb8fb603cd67 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:56.902296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e240f-1229-42d3-aec7-fb8fb603cd67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:56.904493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-df7e240f-1229-42d3-aec7-fb8fb603cd67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:56.917702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62871f6e-932f-4e04-8be3-3b4d7fb217df admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:56.924771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a43102-61ab-42ac-bc01-2118c761ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:56.925494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a43102-61ab-42ac-bc01-2118c761ed81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:56.925772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a43102-61ab-42ac-bc01-2118c761ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:56.926043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a43102-61ab-42ac-bc01-2118c761ed81 admin admin] PATH_INFO: `/v3/projects/887fd1b4361349e1b37401466ed27c4a/users/f6af507fe81746019f8b6477895d9c01/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:56.948153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a43102-61ab-42ac-bc01-2118c761ed81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=887fd1b4361349e1b37401466ed27c4a, user_id=f6af507fe81746019f8b6477895d9c01, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:56.951694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a43102-61ab-42ac-bc01-2118c761ed81 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:56.981934 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:56.989648 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1003/2018] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:56 2022] PUT /identity/v3/projects/887fd1b4361349e1b37401466ed27c4a/users/f6af507fe81746019f8b6477895d9c01/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:56.991642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaab6b-23d3-45b4-ae59-bf409792d0bd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:56.992213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaab6b-23d3-45b4-ae59-bf409792d0bd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:56.992494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaab6b-23d3-45b4-ae59-bf409792d0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:57.010735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e240f-1229-42d3-aec7-fb8fb603cd67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:57.013106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e240f-1229-42d3-aec7-fb8fb603cd67 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:57.014014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7adaab6b-23d3-45b4-ae59-bf409792d0bd None None] MFA Rules not processed for user `0533d6c52e394ecc980d67c7d985076e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:57.015251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7adaab6b-23d3-45b4-ae59-bf409792d0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:57.029424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1016/2019] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:57.035024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f693568-7d5f-4e43-9775-b57168faa5e6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:57.035024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f693568-7d5f-4e43-9775-b57168faa5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:57.035269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f693568-7d5f-4e43-9775-b57168faa5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:57.068697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2f693568-7d5f-4e43-9775-b57168faa5e6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:57.072232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2f693568-7d5f-4e43-9775-b57168faa5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:57.092839 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1004/2020] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:57.092839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaab6b-23d3-45b4-ae59-bf409792d0bd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:57.092839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7adaab6b-23d3-45b4-ae59-bf409792d0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:57.109248 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:57.202680 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1017/2021] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:57.202680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f693568-7d5f-4e43-9775-b57168faa5e6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:57.211571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaab6b-23d3-45b4-ae59-bf409792d0bd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:57.232302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:57.232733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f693568-7d5f-4e43-9775-b57168faa5e6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:57.233839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:57.234386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:57.235310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] PATH_INFO: `/v3/projects/d08741b6addc4ad08cf25437f55b8d3b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:57.237176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08741b6addc4ad08cf25437f55b8d3b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:57.240619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e919a-fff5-4dfc-bae7-fdaf03606b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:57.240885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:57.241245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e919a-fff5-4dfc-bae7-fdaf03606b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:57.241522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e919a-fff5-4dfc-bae7-fdaf03606b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:57.241792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e919a-fff5-4dfc-bae7-fdaf03606b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:57.242444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e919a-fff5-4dfc-bae7-fdaf03606b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:57.244071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e919a-fff5-4dfc-bae7-fdaf03606b8b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:57.259355 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1018/2022] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:57.261072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07584-de0d-4c45-8aa4-72d280b995a1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:57.261559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07584-de0d-4c45-8aa4-72d280b995a1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:57.262298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07584-de0d-4c45-8aa4-72d280b995a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:57.291102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-80f07584-de0d-4c45-8aa4-72d280b995a1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:57.292837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-80f07584-de0d-4c45-8aa4-72d280b995a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:57.318025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08741b6addc4ad08cf25437f55b8d3b', 'request_id': 'req-34a0dc78-1cd3-43f1-be7d-024cfefea418'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:57.333570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08741b6addc4ad08cf25437f55b8d3b', 'request_id': 'req-34a0dc78-1cd3-43f1-be7d-024cfefea418'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:57.341946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08741b6addc4ad08cf25437f55b8d3b', 'request_id': 'req-34a0dc78-1cd3-43f1-be7d-024cfefea418'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:57.359641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] The token cache is being invalidate because project d08741b6addc4ad08cf25437f55b8d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:57.360012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:57.361058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:57.365444 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1005/2023] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:57 2022] DELETE /identity/v3/projects/d08741b6addc4ad08cf25437f55b8d3b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:57.366220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:57.367648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:57.422680 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1019/2024] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:57.425177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f7f3-1b7a-4a91-9923-50b10a5666c8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:57.426529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f7f3-1b7a-4a91-9923-50b10a5666c8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:57.426529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f7f3-1b7a-4a91-9923-50b10a5666c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:57.460041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b8f8f7f3-1b7a-4a91-9923-50b10a5666c8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:57.461705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b8f8f7f3-1b7a-4a91-9923-50b10a5666c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:57.480886 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1020/2025] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:57.481530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8f7f3-1b7a-4a91-9923-50b10a5666c8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:57.501915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8f7f3-1b7a-4a91-9923-50b10a5666c8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:57.508180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c5fc-87cf-450e-9eee-5db05f86acfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:57.509884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c5fc-87cf-450e-9eee-5db05f86acfb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:57.510326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c5fc-87cf-450e-9eee-5db05f86acfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:57.510867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c5fc-87cf-450e-9eee-5db05f86acfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:57.512492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449c5fc-87cf-450e-9eee-5db05f86acfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:57.513273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449c5fc-87cf-450e-9eee-5db05f86acfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:57.515253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449c5fc-87cf-450e-9eee-5db05f86acfb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:57.522497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0dc78-1cd3-43f1-be7d-024cfefea418 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:57.542044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29904f5-2203-4d49-8668-cbb47f17ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:57.547643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29904f5-2203-4d49-8668-cbb47f17ec27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:57.548072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29904f5-2203-4d49-8668-cbb47f17ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:57.550025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29904f5-2203-4d49-8668-cbb47f17ec27 admin admin] PATH_INFO: `/v3/projects/887fd1b4361349e1b37401466ed27c4a/users/f6af507fe81746019f8b6477895d9c01/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:57.558877 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1021/2026] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:57.559126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29904f5-2203-4d49-8668-cbb47f17ec27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=887fd1b4361349e1b37401466ed27c4a, user_id=f6af507fe81746019f8b6477895d9c01, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:57.560697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8194a9-e62e-4438-80dd-c285b7a69380 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:57.560985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8194a9-e62e-4438-80dd-c285b7a69380 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:57.561260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8194a9-e62e-4438-80dd-c285b7a69380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:57.573583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29904f5-2203-4d49-8668-cbb47f17ec27 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:57.599055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-de8194a9-e62e-4438-80dd-c285b7a69380 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:57.600711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-de8194a9-e62e-4438-80dd-c285b7a69380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:57.620171 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1006/2027] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:57 2022] PUT /identity/v3/projects/887fd1b4361349e1b37401466ed27c4a/users/f6af507fe81746019f8b6477895d9c01/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:57.627216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29904f5-2203-4d49-8668-cbb47f17ec27 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:57.693970 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:57.722495 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:57.725168 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1022/2028] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:57.728357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2047b-0f8d-4aa5-acaf-5b59dc7c2cb5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:57.728641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2047b-0f8d-4aa5-acaf-5b59dc7c2cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:57.728915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2047b-0f8d-4aa5-acaf-5b59dc7c2cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:57.772403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29904f5-2203-4d49-8668-cbb47f17ec27 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:57.787346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba53c9-c0ba-447f-91f7-35e3f5bf5633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:57.788091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba53c9-c0ba-447f-91f7-35e3f5bf5633 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:57.788409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba53c9-c0ba-447f-91f7-35e3f5bf5633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:57.788646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba53c9-c0ba-447f-91f7-35e3f5bf5633 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:57.789354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba53c9-c0ba-447f-91f7-35e3f5bf5633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:57.821148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4cf2047b-0f8d-4aa5-acaf-5b59dc7c2cb5 None None] MFA Rules not processed for user `f6af507fe81746019f8b6477895d9c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:57.824808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4cf2047b-0f8d-4aa5-acaf-5b59dc7c2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:57.834442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba53c9-c0ba-447f-91f7-35e3f5bf5633 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:57.891164 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1007/2029] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:57 2022] POST /identity/v3/projects => generated 387 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:57.893712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba53c9-c0ba-447f-91f7-35e3f5bf5633 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:57.941188 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1023/2030] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:57.943768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2047b-0f8d-4aa5-acaf-5b59dc7c2cb5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:57.963659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2047b-0f8d-4aa5-acaf-5b59dc7c2cb5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:57.995456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba53c9-c0ba-447f-91f7-35e3f5bf5633 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.001569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9162d38-4d6b-4461-ad86-f2fd5d154a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.002566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9162d38-4d6b-4461-ad86-f2fd5d154a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.002880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9162d38-4d6b-4461-ad86-f2fd5d154a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.003334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9162d38-4d6b-4461-ad86-f2fd5d154a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.004011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9162d38-4d6b-4461-ad86-f2fd5d154a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:00:58.004316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9162d38-4d6b-4461-ad86-f2fd5d154a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.006519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9162d38-4d6b-4461-ad86-f2fd5d154a4a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.021645 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1008/2031] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:00:58.022797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9162d38-4d6b-4461-ad86-f2fd5d154a4a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.037246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdba420-c459-4a97-99b0-809a85982e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.037964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdba420-c459-4a97-99b0-809a85982e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.038306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9162d38-4d6b-4461-ad86-f2fd5d154a4a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.038443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdba420-c459-4a97-99b0-809a85982e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.038746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdba420-c459-4a97-99b0-809a85982e27 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.039531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdba420-c459-4a97-99b0-809a85982e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.041629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdba420-c459-4a97-99b0-809a85982e27 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.043610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.044311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.044658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.045000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] PATH_INFO: `/v3/users/7fd71817eafa4b4cbbac7c2a6bbfb105` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.046202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd71817eafa4b4cbbac7c2a6bbfb105)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.048654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.066740 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1024/2032] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:57 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:58.067679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdba420-c459-4a97-99b0-809a85982e27 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.079349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdba420-c459-4a97-99b0-809a85982e27 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.087799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89b024-d85f-4f1c-a83f-1759d1dad8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.088678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89b024-d85f-4f1c-a83f-1759d1dad8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.088940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89b024-d85f-4f1c-a83f-1759d1dad8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.089217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89b024-d85f-4f1c-a83f-1759d1dad8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.089861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89b024-d85f-4f1c-a83f-1759d1dad8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.092640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89b024-d85f-4f1c-a83f-1759d1dad8c4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.107355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd71817eafa4b4cbbac7c2a6bbfb105'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:58.122937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd71817eafa4b4cbbac7c2a6bbfb105'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:58.123998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd71817eafa4b4cbbac7c2a6bbfb105'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:58.130348 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1025/2033] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:58 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:58.131384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89b024-d85f-4f1c-a83f-1759d1dad8c4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.136332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bb89b024-d85f-4f1c-a83f-1759d1dad8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:58.136672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd71817eafa4b4cbbac7c2a6bbfb105'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:58.147965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd71817eafa4b4cbbac7c2a6bbfb105'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:58.157421 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1009/2034] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:58 2022] DELETE /identity/v3/users/7fd71817eafa4b4cbbac7c2a6bbfb105 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:58.163589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.165236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:58.218012 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:58.218782 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:58.242194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89b024-d85f-4f1c-a83f-1759d1dad8c4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.268592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1f15d-038d-4945-ad9b-cfb95e0ae068 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.274625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9978597-f2ff-4e0e-8447-f86544acffea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.275273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9978597-f2ff-4e0e-8447-f86544acffea admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.275554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9978597-f2ff-4e0e-8447-f86544acffea admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.275823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9978597-f2ff-4e0e-8447-f86544acffea admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.276463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9978597-f2ff-4e0e-8447-f86544acffea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.278735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9978597-f2ff-4e0e-8447-f86544acffea admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.310500 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1010/2035] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:58 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:58.311922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcfffb-2f1e-47d8-92c7-3673aa1bbed3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.312707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcfffb-2f1e-47d8-92c7-3673aa1bbed3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.313187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcfffb-2f1e-47d8-92c7-3673aa1bbed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.330694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c26987-bc8c-4786-ac84-dc1b1808f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.331717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c26987-bc8c-4786-ac84-dc1b1808f65f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.331834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c26987-bc8c-4786-ac84-dc1b1808f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.332179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c26987-bc8c-4786-ac84-dc1b1808f65f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.332899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c26987-bc8c-4786-ac84-dc1b1808f65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.334923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c26987-bc8c-4786-ac84-dc1b1808f65f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.339637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-02bcfffb-2f1e-47d8-92c7-3673aa1bbed3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:58.344668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-02bcfffb-2f1e-47d8-92c7-3673aa1bbed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:58.350704 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1026/2036] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:58.351935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c26987-bc8c-4786-ac84-dc1b1808f65f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.362749 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1011/2037] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:58.363689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcfffb-2f1e-47d8-92c7-3673aa1bbed3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.373523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c26987-bc8c-4786-ac84-dc1b1808f65f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.380626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46deeca-0b6d-4a2a-a14a-c3a3af6db588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.381248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcfffb-2f1e-47d8-92c7-3673aa1bbed3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.381365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46deeca-0b6d-4a2a-a14a-c3a3af6db588 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.381648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46deeca-0b6d-4a2a-a14a-c3a3af6db588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.382024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46deeca-0b6d-4a2a-a14a-c3a3af6db588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.382893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46deeca-0b6d-4a2a-a14a-c3a3af6db588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.384977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46deeca-0b6d-4a2a-a14a-c3a3af6db588 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.387120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e1400-a739-406d-a908-ad7709f134be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.388351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e1400-a739-406d-a908-ad7709f134be admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.388683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e1400-a739-406d-a908-ad7709f134be admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.388956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e1400-a739-406d-a908-ad7709f134be admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.389752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e1400-a739-406d-a908-ad7709f134be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.392054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e1400-a739-406d-a908-ad7709f134be admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.400543 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1027/2038] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:58.401667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46deeca-0b6d-4a2a-a14a-c3a3af6db588 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.404020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d46deeca-0b6d-4a2a-a14a-c3a3af6db588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:58.416864 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1012/2039] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:58.422004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e1400-a739-406d-a908-ad7709f134be admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.448566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e1400-a739-406d-a908-ad7709f134be admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.453566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4acdb-27ef-4ce8-8bb0-eae847f1176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.454188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4acdb-27ef-4ce8-8bb0-eae847f1176d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.454472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4acdb-27ef-4ce8-8bb0-eae847f1176d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.454780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4acdb-27ef-4ce8-8bb0-eae847f1176d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.455557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4acdb-27ef-4ce8-8bb0-eae847f1176d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.460926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4acdb-27ef-4ce8-8bb0-eae847f1176d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.476501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46deeca-0b6d-4a2a-a14a-c3a3af6db588 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.479016 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1013/2040] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:58.479870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4acdb-27ef-4ce8-8bb0-eae847f1176d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.483689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f967fb-f9d2-4aa5-8cfe-46beb90d37bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.484687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f967fb-f9d2-4aa5-8cfe-46beb90d37bc service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.485298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f967fb-f9d2-4aa5-8cfe-46beb90d37bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.491126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f967fb-f9d2-4aa5-8cfe-46beb90d37bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.501322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4acdb-27ef-4ce8-8bb0-eae847f1176d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.509198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f967fb-f9d2-4aa5-8cfe-46beb90d37bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.510170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bcae2-b9e7-445d-85b0-3e0c670bac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.511564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bcae2-b9e7-445d-85b0-3e0c670bac44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.512091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f967fb-f9d2-4aa5-8cfe-46beb90d37bc service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.512559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bcae2-b9e7-445d-85b0-3e0c670bac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.513399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bcae2-b9e7-445d-85b0-3e0c670bac44 admin admin] PATH_INFO: `/v3/projects/3164d697b687493cb2ef10c500dbcace/users/29b93436efc3428f85b0f59dea7c3724/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.523985 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1028/2041] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:00:58.525473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f967fb-f9d2-4aa5-8cfe-46beb90d37bc service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.536636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f967fb-f9d2-4aa5-8cfe-46beb90d37bc service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.551300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784aa52-eebf-4e38-9bed-582888a61a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.552262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784aa52-eebf-4e38-9bed-582888a61a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.552926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bcae2-b9e7-445d-85b0-3e0c670bac44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3164d697b687493cb2ef10c500dbcace, user_id=29b93436efc3428f85b0f59dea7c3724, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.553626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784aa52-eebf-4e38-9bed-582888a61a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.554083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784aa52-eebf-4e38-9bed-582888a61a93 admin admin] PATH_INFO: `/v3/projects/51df90dbb0ac462890b5797af9ccf3b4/users/cbc3d3505371450e8d6caaa8b7c5dfd0/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.560946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bcae2-b9e7-445d-85b0-3e0c670bac44 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.601992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784aa52-eebf-4e38-9bed-582888a61a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51df90dbb0ac462890b5797af9ccf3b4, user_id=cbc3d3505371450e8d6caaa8b7c5dfd0, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.609358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784aa52-eebf-4e38-9bed-582888a61a93 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:58.618049 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1014/2042] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:58 2022] PUT /identity/v3/projects/3164d697b687493cb2ef10c500dbcace/users/29b93436efc3428f85b0f59dea7c3724/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:58.619769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0109a9-d0fc-4e88-bf9f-8e72e064cebf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.620218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0109a9-d0fc-4e88-bf9f-8e72e064cebf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.620502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0109a9-d0fc-4e88-bf9f-8e72e064cebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.647478 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1029/2043] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:00:58 2022] PUT /identity/v3/projects/51df90dbb0ac462890b5797af9ccf3b4/users/cbc3d3505371450e8d6caaa8b7c5dfd0/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:58.649300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d211c15-92fc-4dd6-9921-06c7bf01fd4a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.649660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d211c15-92fc-4dd6-9921-06c7bf01fd4a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.650005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d211c15-92fc-4dd6-9921-06c7bf01fd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.675751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5f0109a9-d0fc-4e88-bf9f-8e72e064cebf None None] MFA Rules not processed for user `29b93436efc3428f85b0f59dea7c3724`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:58.683081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5f0109a9-d0fc-4e88-bf9f-8e72e064cebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:58.686820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3d211c15-92fc-4dd6-9921-06c7bf01fd4a None None] MFA Rules not processed for user `cbc3d3505371450e8d6caaa8b7c5dfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:58.688377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3d211c15-92fc-4dd6-9921-06c7bf01fd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:58.761971 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:58.823409 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1030/2044] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:58.826847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d211c15-92fc-4dd6-9921-06c7bf01fd4a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.849808 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1015/2045] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:58.851971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0109a9-d0fc-4e88-bf9f-8e72e064cebf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:58.956524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d211c15-92fc-4dd6-9921-06c7bf01fd4a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:58.980986 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:58.984483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e046c15-d6b3-4289-8e40-76cb4adb080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:58.985277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e046c15-d6b3-4289-8e40-76cb4adb080b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:58.985649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e046c15-d6b3-4289-8e40-76cb4adb080b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:58.985765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e046c15-d6b3-4289-8e40-76cb4adb080b admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:58.986889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e046c15-d6b3-4289-8e40-76cb4adb080b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:58.992885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e046c15-d6b3-4289-8e40-76cb4adb080b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:59.005008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0109a9-d0fc-4e88-bf9f-8e72e064cebf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:59.017344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f731c-e09c-4284-a8cf-22391b4f7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:59.018404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f731c-e09c-4284-a8cf-22391b4f7255 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:59.018916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f731c-e09c-4284-a8cf-22391b4f7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:59.019897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f731c-e09c-4284-a8cf-22391b4f7255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:59.021343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f731c-e09c-4284-a8cf-22391b4f7255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:59.024254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f731c-e09c-4284-a8cf-22391b4f7255 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:59.042642 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1031/2046] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:58 2022] POST /identity/v3/projects => generated 397 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:59.043500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e046c15-d6b3-4289-8e40-76cb4adb080b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:59.050492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8e046c15-d6b3-4289-8e40-76cb4adb080b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:59.084239 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1016/2047] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:00:58 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:59.086236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f731c-e09c-4284-a8cf-22391b4f7255 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:59.269902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e046c15-d6b3-4289-8e40-76cb4adb080b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:59.300574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f731c-e09c-4284-a8cf-22391b4f7255 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:59.314719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359ddf7-02c1-412f-aa87-3516461df747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:59.316308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ddf7-02c1-412f-aa87-3516461df747 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:59.317946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ddf7-02c1-412f-aa87-3516461df747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:59.318380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ddf7-02c1-412f-aa87-3516461df747 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:59.320049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359ddf7-02c1-412f-aa87-3516461df747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:59.325077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359ddf7-02c1-412f-aa87-3516461df747 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:59.376567 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1017/2048] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:59 2022] POST /identity/v3/users => generated 305 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:59.381533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359ddf7-02c1-412f-aa87-3516461df747 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:59.403351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359ddf7-02c1-412f-aa87-3516461df747 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:59.419339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cff3ca-6749-4481-a31a-4b6f4872b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:59.420291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:59.421194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cff3ca-6749-4481-a31a-4b6f4872b47c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:59.422179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cff3ca-6749-4481-a31a-4b6f4872b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:59.423066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:59.423325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cff3ca-6749-4481-a31a-4b6f4872b47c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:59.425458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:59.425956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] PATH_INFO: `/v3/projects/c2a8a7039164415c9e24560176720a9a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:59.427040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cff3ca-6749-4481-a31a-4b6f4872b47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:59.428688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a8a7039164415c9e24560176720a9a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:59.431895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cff3ca-6749-4481-a31a-4b6f4872b47c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:59.433679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:59.502071 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1018/2049] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:00:59 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:00:59.502071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fbfbe-c4ad-4e64-b13c-651d982ae62e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:59.505822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fbfbe-c4ad-4e64-b13c-651d982ae62e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:59.507406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fbfbe-c4ad-4e64-b13c-651d982ae62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:59.517570 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:59.570399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f02fbfbe-c4ad-4e64-b13c-651d982ae62e None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:00:59.573703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f02fbfbe-c4ad-4e64-b13c-651d982ae62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:59.576409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a8a7039164415c9e24560176720a9a', 'request_id': 'req-53a52cc5-2fcd-40a1-9f2b-21f40658051c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:59.588912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a8a7039164415c9e24560176720a9a', 'request_id': 'req-53a52cc5-2fcd-40a1-9f2b-21f40658051c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:59.597630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a8a7039164415c9e24560176720a9a', 'request_id': 'req-53a52cc5-2fcd-40a1-9f2b-21f40658051c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:59.651949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] The token cache is being invalidate because project c2a8a7039164415c9e24560176720a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:00:59.653386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:59.655069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:00:59.661301 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1032/2050] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:00:59 2022] DELETE /identity/v3/projects/c2a8a7039164415c9e24560176720a9a => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:00:59.662717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:59.670287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:59.738001 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1019/2051] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:00:59.739087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fbfbe-c4ad-4e64-b13c-651d982ae62e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:59.743158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f02fbfbe-c4ad-4e64-b13c-651d982ae62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:59.862198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a52cc5-2fcd-40a1-9f2b-21f40658051c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:59.880608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e524a32-e71c-4da0-8dd8-51925b633eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:59.881246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e524a32-e71c-4da0-8dd8-51925b633eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:59.881527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e524a32-e71c-4da0-8dd8-51925b633eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:59.884628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e524a32-e71c-4da0-8dd8-51925b633eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:59.886465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e524a32-e71c-4da0-8dd8-51925b633eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:59.901454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e524a32-e71c-4da0-8dd8-51925b633eeb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:59.955427 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1033/2052] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:00:59.957129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e524a32-e71c-4da0-8dd8-51925b633eeb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:00:59.963917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4e524a32-e71c-4da0-8dd8-51925b633eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:00:59.973884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fbfbe-c4ad-4e64-b13c-651d982ae62e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:00:59.985813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551edeb7-2de5-4961-9b54-61a1d7506402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:00:59.987088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551edeb7-2de5-4961-9b54-61a1d7506402 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:00:59.987371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551edeb7-2de5-4961-9b54-61a1d7506402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:00:59.987642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551edeb7-2de5-4961-9b54-61a1d7506402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:00:59.988302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551edeb7-2de5-4961-9b54-61a1d7506402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:00:59.989946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551edeb7-2de5-4961-9b54-61a1d7506402 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:00:59.997062 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:00.003292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e524a32-e71c-4da0-8dd8-51925b633eeb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:00.013127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:00.013971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:00.014920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:00.015310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] PATH_INFO: `/v3/users/f6af507fe81746019f8b6477895d9c01` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:00.017008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6af507fe81746019f8b6477895d9c01)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:00.019744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:00.020398 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1020/2053] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:00.021399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551edeb7-2de5-4961-9b54-61a1d7506402 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:00.027795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-551edeb7-2de5-4961-9b54-61a1d7506402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:00.041676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551edeb7-2de5-4961-9b54-61a1d7506402 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:00.045583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda20fc-aad8-4b50-8e40-553863b97c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:00.046197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda20fc-aad8-4b50-8e40-553863b97c61 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:00.046478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda20fc-aad8-4b50-8e40-553863b97c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:00.046781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda20fc-aad8-4b50-8e40-553863b97c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:00.056447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda20fc-aad8-4b50-8e40-553863b97c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:00.057902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda20fc-aad8-4b50-8e40-553863b97c61 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:00.069003 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1021/2054] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:00.069847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda20fc-aad8-4b50-8e40-553863b97c61 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:00.102268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda20fc-aad8-4b50-8e40-553863b97c61 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:00.109302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6af507fe81746019f8b6477895d9c01'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:00.112373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8c60-5821-4a68-b2a9-e1a13c5466bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:00.113071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8c60-5821-4a68-b2a9-e1a13c5466bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:00.113351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8c60-5821-4a68-b2a9-e1a13c5466bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:00.113619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8c60-5821-4a68-b2a9-e1a13c5466bb admin admin] PATH_INFO: `/v3/projects/c59c4ea4eea04c318bacbfd5520f2fc2/users/b5fc87239b7c47c5a61057c09540b64f/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:00.136300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6af507fe81746019f8b6477895d9c01'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:00.137661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6af507fe81746019f8b6477895d9c01'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:00.150287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6af507fe81746019f8b6477895d9c01'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:00.151841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6af507fe81746019f8b6477895d9c01'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:00.155842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d8c60-5821-4a68-b2a9-e1a13c5466bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59c4ea4eea04c318bacbfd5520f2fc2, user_id=b5fc87239b7c47c5a61057c09540b64f, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:00.167324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d8c60-5821-4a68-b2a9-e1a13c5466bb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:00.188133 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1022/2055] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:00 2022] PUT /identity/v3/projects/c59c4ea4eea04c318bacbfd5520f2fc2/users/b5fc87239b7c47c5a61057c09540b64f/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:00.190447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8c60-5821-4a68-b2a9-e1a13c5466bb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:00.192964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-654d8c60-5821-4a68-b2a9-e1a13c5466bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:00.199913 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1034/2056] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:00:59 2022] DELETE /identity/v3/users/f6af507fe81746019f8b6477895d9c01 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:00.203912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:00.205585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:00.235021 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:00.291419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8c60-5821-4a68-b2a9-e1a13c5466bb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:00.309016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e432fd6-bcb3-491c-8142-af4744906e8e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:00.316391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81733248-90b6-4446-bb94-c77bd3d2a77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:00.317509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81733248-90b6-4446-bb94-c77bd3d2a77f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:00.317509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81733248-90b6-4446-bb94-c77bd3d2a77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:00.317856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81733248-90b6-4446-bb94-c77bd3d2a77f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:00.319028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81733248-90b6-4446-bb94-c77bd3d2a77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:00.321230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81733248-90b6-4446-bb94-c77bd3d2a77f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:00.336773 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1035/2057] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:00.340950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81733248-90b6-4446-bb94-c77bd3d2a77f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:00.359373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81733248-90b6-4446-bb94-c77bd3d2a77f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:00.368520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdcead-8194-4c32-842c-4df131b2c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:00.369302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdcead-8194-4c32-842c-4df131b2c7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:00.369486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdcead-8194-4c32-842c-4df131b2c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:00.369765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdcead-8194-4c32-842c-4df131b2c7d4 admin admin] PATH_INFO: `/v3/projects/cf36e46c224a4caaa2076c4a9446929d/users/54ece7b3f74e450aaa1595e606638524/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:00.370536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f655da3-9933-49b6-80f3-08cdca8ba213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:00.371522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f655da3-9933-49b6-80f3-08cdca8ba213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:00.372184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f655da3-9933-49b6-80f3-08cdca8ba213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:00.372736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f655da3-9933-49b6-80f3-08cdca8ba213 admin admin] PATH_INFO: `/v3/projects/c59c4ea4eea04c318bacbfd5520f2fc2/users/b5fc87239b7c47c5a61057c09540b64f/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:00.375998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f655da3-9933-49b6-80f3-08cdca8ba213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59c4ea4eea04c318bacbfd5520f2fc2, user_id=b5fc87239b7c47c5a61057c09540b64f, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:00.380713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f655da3-9933-49b6-80f3-08cdca8ba213 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:00.389314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdcead-8194-4c32-842c-4df131b2c7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf36e46c224a4caaa2076c4a9446929d, user_id=54ece7b3f74e450aaa1595e606638524, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:00.392506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdcead-8194-4c32-842c-4df131b2c7d4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:00.415015 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1036/2058] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:00 2022] PUT /identity/v3/projects/c59c4ea4eea04c318bacbfd5520f2fc2/users/b5fc87239b7c47c5a61057c09540b64f/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:00.417252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d66b5-3eec-424c-90a0-a3f48d6be3bf None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:00.417589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d66b5-3eec-424c-90a0-a3f48d6be3bf None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:00.417996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d66b5-3eec-424c-90a0-a3f48d6be3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:00.428809 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1023/2059] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:00 2022] PUT /identity/v3/projects/cf36e46c224a4caaa2076c4a9446929d/users/54ece7b3f74e450aaa1595e606638524/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:00.433470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdcead-8194-4c32-842c-4df131b2c7d4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:00.471506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b01d66b5-3eec-424c-90a0-a3f48d6be3bf None None] MFA Rules not processed for user `b5fc87239b7c47c5a61057c09540b64f`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:00.473296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b01d66b5-3eec-424c-90a0-a3f48d6be3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:00.573537 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:00.601286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdcead-8194-4c32-842c-4df131b2c7d4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:00.615439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60172a5-293a-4770-92f5-a835010c244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:00.616249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60172a5-293a-4770-92f5-a835010c244a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:00.616530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60172a5-293a-4770-92f5-a835010c244a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:00.617475 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1037/2060] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:00.617812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60172a5-293a-4770-92f5-a835010c244a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:00.618931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d66b5-3eec-424c-90a0-a3f48d6be3bf None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:00.619898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60172a5-293a-4770-92f5-a835010c244a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:00.620445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b01d66b5-3eec-424c-90a0-a3f48d6be3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:00.622867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60172a5-293a-4770-92f5-a835010c244a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:00.659017 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1024/2061] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:00.659984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60172a5-293a-4770-92f5-a835010c244a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:00.685888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60172a5-293a-4770-92f5-a835010c244a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:00.699143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544fad5-b061-4740-bc1e-296df9a45499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:00.701287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544fad5-b061-4740-bc1e-296df9a45499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:00.701538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544fad5-b061-4740-bc1e-296df9a45499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:00.701821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544fad5-b061-4740-bc1e-296df9a45499 admin admin] PATH_INFO: `/v3/projects/cf36e46c224a4caaa2076c4a9446929d/users/54ece7b3f74e450aaa1595e606638524/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:00.706614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544fad5-b061-4740-bc1e-296df9a45499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf36e46c224a4caaa2076c4a9446929d, user_id=54ece7b3f74e450aaa1595e606638524, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:00.713271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544fad5-b061-4740-bc1e-296df9a45499 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:00.747993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d66b5-3eec-424c-90a0-a3f48d6be3bf None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:00.748196 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1025/2062] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:00 2022] PUT /identity/v3/projects/cf36e46c224a4caaa2076c4a9446929d/users/54ece7b3f74e450aaa1595e606638524/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:00.749986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a58f85-9391-4476-b147-2892fa0f3bd4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:00.750277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a58f85-9391-4476-b147-2892fa0f3bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:00.750554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a58f85-9391-4476-b147-2892fa0f3bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:00.782850 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:00.823556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d6a58f85-9391-4476-b147-2892fa0f3bd4 None None] MFA Rules not processed for user `54ece7b3f74e450aaa1595e606638524`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:00.824812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6a58f85-9391-4476-b147-2892fa0f3bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:00.889056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0185f-a73c-4e9c-8ee6-d98c5a516436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:00.889677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0185f-a73c-4e9c-8ee6-d98c5a516436 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:00.889957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0185f-a73c-4e9c-8ee6-d98c5a516436 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:00.890229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0185f-a73c-4e9c-8ee6-d98c5a516436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:00.896051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dea0185f-a73c-4e9c-8ee6-d98c5a516436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:01.023427 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1026/2063] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:01.024387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a58f85-9391-4476-b147-2892fa0f3bd4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:01.026020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6a58f85-9391-4476-b147-2892fa0f3bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:01.046442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a58f85-9391-4476-b147-2892fa0f3bd4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:01.054497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af68d5-49af-4f0e-96c8-1a1fa7a0fa3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:01.055631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af68d5-49af-4f0e-96c8-1a1fa7a0fa3c service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:01.056224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af68d5-49af-4f0e-96c8-1a1fa7a0fa3c service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:01.057039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af68d5-49af-4f0e-96c8-1a1fa7a0fa3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:01.060439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d4af68d5-49af-4f0e-96c8-1a1fa7a0fa3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:01.084330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0185f-a73c-4e9c-8ee6-d98c5a516436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:01.088053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0185f-a73c-4e9c-8ee6-d98c5a516436 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:01.111097 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1038/2064] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:01.112391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0185f-a73c-4e9c-8ee6-d98c5a516436 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:01.116828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dea0185f-a73c-4e9c-8ee6-d98c5a516436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:01.182734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af68d5-49af-4f0e-96c8-1a1fa7a0fa3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:01.184000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af68d5-49af-4f0e-96c8-1a1fa7a0fa3c service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:01.199380 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1027/2065] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:01.313379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0185f-a73c-4e9c-8ee6-d98c5a516436 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:01.333124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:01.333840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:01.334061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:01.334336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] PATH_INFO: `/v3/projects/887fd1b4361349e1b37401466ed27c4a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:01.341479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=887fd1b4361349e1b37401466ed27c4a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:01.343492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:01.480582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887fd1b4361349e1b37401466ed27c4a', 'request_id': 'req-b48683eb-1990-4a42-9d19-f0dba3753a41'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:01.496076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887fd1b4361349e1b37401466ed27c4a', 'request_id': 'req-b48683eb-1990-4a42-9d19-f0dba3753a41'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:01.497378 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:01.508668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887fd1b4361349e1b37401466ed27c4a', 'request_id': 'req-b48683eb-1990-4a42-9d19-f0dba3753a41'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:01.531773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] The token cache is being invalidate because project 887fd1b4361349e1b37401466ed27c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:01.532073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:01.535122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b48683eb-1990-4a42-9d19-f0dba3753a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:01.536661 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1039/2066] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:01 2022] DELETE /identity/v3/projects/887fd1b4361349e1b37401466ed27c4a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:01.540881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af68d5-49af-4f0e-96c8-1a1fa7a0fa3c service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:01.549649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044987f9-aaba-480b-b2e7-69f21983f7cd None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:01.549834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044987f9-aaba-480b-b2e7-69f21983f7cd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:01.550193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044987f9-aaba-480b-b2e7-69f21983f7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:01.563401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af68d5-49af-4f0e-96c8-1a1fa7a0fa3c service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:01.584566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-044987f9-aaba-480b-b2e7-69f21983f7cd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:01.585885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-044987f9-aaba-480b-b2e7-69f21983f7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:01.701619 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:01.724955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c194a8-ae66-4a7e-9401-a5474dc46a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:01.725691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c194a8-ae66-4a7e-9401-a5474dc46a3a service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:01.726025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c194a8-ae66-4a7e-9401-a5474dc46a3a service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:01.728025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c194a8-ae66-4a7e-9401-a5474dc46a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:01.730438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-85c194a8-ae66-4a7e-9401-a5474dc46a3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:01.764501 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1040/2067] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:01.773639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda4310-4025-46fe-bc3d-c1497eb9ce56 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:01.775121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda4310-4025-46fe-bc3d-c1497eb9ce56 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:01.777687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda4310-4025-46fe-bc3d-c1497eb9ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:01.843084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0cda4310-4025-46fe-bc3d-c1497eb9ce56 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:01.845570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0cda4310-4025-46fe-bc3d-c1497eb9ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:01.873853 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1041/2068] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:01.874805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda4310-4025-46fe-bc3d-c1497eb9ce56 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:01.891444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda4310-4025-46fe-bc3d-c1497eb9ce56 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:01.904512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c194a8-ae66-4a7e-9401-a5474dc46a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:01.907638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c194a8-ae66-4a7e-9401-a5474dc46a3a service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:01.914903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611d2d5-62c9-464a-b995-7226cbc50a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:01.915798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d2d5-62c9-464a-b995-7226cbc50a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:01.916093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d2d5-62c9-464a-b995-7226cbc50a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:01.916367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d2d5-62c9-464a-b995-7226cbc50a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:01.917031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611d2d5-62c9-464a-b995-7226cbc50a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:01.917337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611d2d5-62c9-464a-b995-7226cbc50a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:01.918999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611d2d5-62c9-464a-b995-7226cbc50a8f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:01.937728 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1028/2069] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:01.945093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171f657-c002-4093-b35d-e3104fbfb666 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:01.945305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171f657-c002-4093-b35d-e3104fbfb666 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:01.945595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171f657-c002-4093-b35d-e3104fbfb666 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:01.948102 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1029/2070] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:01:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:01:01.948561 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1042/2071] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:01:01.954471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171f657-c002-4093-b35d-e3104fbfb666 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:01.956236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d334fd-090b-42cc-9d09-45d397f844d6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:01.956583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d334fd-090b-42cc-9d09-45d397f844d6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:01.956780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d334fd-090b-42cc-9d09-45d397f844d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:02.002051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-00d334fd-090b-42cc-9d09-45d397f844d6 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:02.003793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-00d334fd-090b-42cc-9d09-45d397f844d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:02.018450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171f657-c002-4093-b35d-e3104fbfb666 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:02.032650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd17f4b-333d-4a8b-9b62-d5a522cdd4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:02.033406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd17f4b-333d-4a8b-9b62-d5a522cdd4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:02.033696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd17f4b-333d-4a8b-9b62-d5a522cdd4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:02.035401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd17f4b-333d-4a8b-9b62-d5a522cdd4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:02.037606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd17f4b-333d-4a8b-9b62-d5a522cdd4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:02.055148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd17f4b-333d-4a8b-9b62-d5a522cdd4a1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:02.117414 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1030/2072] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:01 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:02.118327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd17f4b-333d-4a8b-9b62-d5a522cdd4a1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:02.157942 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1043/2073] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:01:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:02.205480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d334fd-090b-42cc-9d09-45d397f844d6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:02.207475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-00d334fd-090b-42cc-9d09-45d397f844d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:02.231234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d334fd-090b-42cc-9d09-45d397f844d6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:02.262052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd17f4b-333d-4a8b-9b62-d5a522cdd4a1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:02.276422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b0a2-5162-4e4d-a611-f9c6704c50a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:02.276984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b0a2-5162-4e4d-a611-f9c6704c50a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:02.277336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b0a2-5162-4e4d-a611-f9c6704c50a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:02.277682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b0a2-5162-4e4d-a611-f9c6704c50a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:02.278536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6b0a2-5162-4e4d-a611-f9c6704c50a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:02.280789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6b0a2-5162-4e4d-a611-f9c6704c50a9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:02.323513 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1031/2074] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:02 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:02.324726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b0a2-5162-4e4d-a611-f9c6704c50a9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:02.340161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b0a2-5162-4e4d-a611-f9c6704c50a9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:02.346379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a9595-5882-45ee-a344-77d3b4a9c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:02.347494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a9595-5882-45ee-a344-77d3b4a9c65c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:02.349155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a9595-5882-45ee-a344-77d3b4a9c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:02.349870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a9595-5882-45ee-a344-77d3b4a9c65c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:02.350626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a9595-5882-45ee-a344-77d3b4a9c65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:02.352289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a9595-5882-45ee-a344-77d3b4a9c65c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:02.380428 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1032/2075] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:01:02.381468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a9595-5882-45ee-a344-77d3b4a9c65c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:02.383123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83379714-87e3-4b4d-aa8e-c8c51b415c62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:02.385288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379714-87e3-4b4d-aa8e-c8c51b415c62 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:02.386257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379714-87e3-4b4d-aa8e-c8c51b415c62 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:02.386810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379714-87e3-4b4d-aa8e-c8c51b415c62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:02.396250 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:02.404621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a9595-5882-45ee-a344-77d3b4a9c65c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:02.420778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bf46a-49cd-444b-b329-4e3859ebabec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:02.421664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bf46a-49cd-444b-b329-4e3859ebabec admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:02.422053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bf46a-49cd-444b-b329-4e3859ebabec admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:02.422513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bf46a-49cd-444b-b329-4e3859ebabec admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:02.423490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bf46a-49cd-444b-b329-4e3859ebabec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:02.428790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bf46a-49cd-444b-b329-4e3859ebabec admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:02.432045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83379714-87e3-4b4d-aa8e-c8c51b415c62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:02.434298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83379714-87e3-4b4d-aa8e-c8c51b415c62 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:02.459024 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1033/2076] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:02.460041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bf46a-49cd-444b-b329-4e3859ebabec admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:02.469186 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1044/2077] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:01:02.479288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bf46a-49cd-444b-b329-4e3859ebabec admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:02.485229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fb4f4-52f0-4f49-87c1-ecbd8faaea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:02.486797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fb4f4-52f0-4f49-87c1-ecbd8faaea79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:02.487205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fb4f4-52f0-4f49-87c1-ecbd8faaea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:02.487784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fb4f4-52f0-4f49-87c1-ecbd8faaea79 admin admin] PATH_INFO: `/v3/projects/683c16b60ba34123bf0175396dffaf83/users/c42d04f7289e49ef950eeaf764c91216/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:02.531662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fb4f4-52f0-4f49-87c1-ecbd8faaea79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683c16b60ba34123bf0175396dffaf83, user_id=c42d04f7289e49ef950eeaf764c91216, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:02.543666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fb4f4-52f0-4f49-87c1-ecbd8faaea79 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:02.574022 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1034/2078] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:02 2022] PUT /identity/v3/projects/683c16b60ba34123bf0175396dffaf83/users/c42d04f7289e49ef950eeaf764c91216/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:02.584535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f856f-3537-4e20-9426-c59355be7fbb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:02.585602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f856f-3537-4e20-9426-c59355be7fbb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:02.585941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f856f-3537-4e20-9426-c59355be7fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:02.668942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-426f856f-3537-4e20-9426-c59355be7fbb None None] MFA Rules not processed for user `c42d04f7289e49ef950eeaf764c91216`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:02.670449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-426f856f-3537-4e20-9426-c59355be7fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:02.727047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fb4f4-52f0-4f49-87c1-ecbd8faaea79 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:02.731522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-597fb4f4-52f0-4f49-87c1-ecbd8faaea79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:02.765411 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:02.875350 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1045/2079] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:02.877810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f856f-3537-4e20-9426-c59355be7fbb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:02.932169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fb4f4-52f0-4f49-87c1-ecbd8faaea79 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:02.947412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9152-e8aa-4d03-b57e-8483bc50a4cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:02.948058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9152-e8aa-4d03-b57e-8483bc50a4cb service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:02.948332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9152-e8aa-4d03-b57e-8483bc50a4cb service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:02.948629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9152-e8aa-4d03-b57e-8483bc50a4cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:02.956838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-748d9152-e8aa-4d03-b57e-8483bc50a4cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:03.035820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f856f-3537-4e20-9426-c59355be7fbb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:03.054378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5a7e6-3657-4227-b1d7-49348cf321e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:03.054954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5a7e6-3657-4227-b1d7-49348cf321e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:03.055241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5a7e6-3657-4227-b1d7-49348cf321e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:03.055516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5a7e6-3657-4227-b1d7-49348cf321e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:03.057056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5a7e6-3657-4227-b1d7-49348cf321e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:03.059064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5a7e6-3657-4227-b1d7-49348cf321e5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:03.133462 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1046/2080] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:02 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:03.137678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5a7e6-3657-4227-b1d7-49348cf321e5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:03.138686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d9152-e8aa-4d03-b57e-8483bc50a4cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:03.140460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d9152-e8aa-4d03-b57e-8483bc50a4cb service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:03.163993 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1035/2081] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:02 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:01:03.252021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5a7e6-3657-4227-b1d7-49348cf321e5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:03.257448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9152-e8aa-4d03-b57e-8483bc50a4cb service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:03.268032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddb80b-8444-4454-b375-58e36dc1787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:03.269160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb80b-8444-4454-b375-58e36dc1787a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:03.269542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb80b-8444-4454-b375-58e36dc1787a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:03.269934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb80b-8444-4454-b375-58e36dc1787a admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:03.270782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddb80b-8444-4454-b375-58e36dc1787a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:03.272856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddb80b-8444-4454-b375-58e36dc1787a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:03.285085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9152-e8aa-4d03-b57e-8483bc50a4cb service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:03.323156 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:03.341152 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1047/2082] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:03 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:01:03.342750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddb80b-8444-4454-b375-58e36dc1787a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:03.373865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddb80b-8444-4454-b375-58e36dc1787a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:03.385583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6d607-de06-4576-952a-8cc662a3e23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:03.386309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6d607-de06-4576-952a-8cc662a3e23a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:03.386733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6d607-de06-4576-952a-8cc662a3e23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:03.387082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6d607-de06-4576-952a-8cc662a3e23a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:03.387802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6d607-de06-4576-952a-8cc662a3e23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:03.389476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6d607-de06-4576-952a-8cc662a3e23a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:03.414809 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1048/2083] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:03.418177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6d607-de06-4576-952a-8cc662a3e23a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:03.448239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6d607-de06-4576-952a-8cc662a3e23a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:03.464646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d12bd3-1bb3-4873-a5f1-a3725fc804ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:03.465206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12bd3-1bb3-4873-a5f1-a3725fc804ac service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:03.465501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12bd3-1bb3-4873-a5f1-a3725fc804ac service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:03.465752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e071-80af-4e3f-9520-3b9874e4a682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:03.465895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12bd3-1bb3-4873-a5f1-a3725fc804ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:03.466551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e071-80af-4e3f-9520-3b9874e4a682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:03.467279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e071-80af-4e3f-9520-3b9874e4a682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:03.467630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e071-80af-4e3f-9520-3b9874e4a682 admin admin] PATH_INFO: `/v3/projects/6cdc0650facb49ac86c4f8f79c2751f8/users/2ed7e34ffe4e4c8a9cdf075805bb1e49/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:03.468874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-60d12bd3-1bb3-4873-a5f1-a3725fc804ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:03.488942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515e071-80af-4e3f-9520-3b9874e4a682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdc0650facb49ac86c4f8f79c2751f8, user_id=2ed7e34ffe4e4c8a9cdf075805bb1e49, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:03.492253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515e071-80af-4e3f-9520-3b9874e4a682 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:03.514448 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1049/2084] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:03 2022] PUT /identity/v3/projects/6cdc0650facb49ac86c4f8f79c2751f8/users/2ed7e34ffe4e4c8a9cdf075805bb1e49/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:03.515929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5254c0-032b-462b-955a-d9b93f4b9a6b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:03.516215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5254c0-032b-462b-955a-d9b93f4b9a6b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:03.516491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5254c0-032b-462b-955a-d9b93f4b9a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:03.536692 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:03.558227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d12bd3-1bb3-4873-a5f1-a3725fc804ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:03.560470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d12bd3-1bb3-4873-a5f1-a3725fc804ac service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:03.575386 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1036/2085] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:01:03.576488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d12bd3-1bb3-4873-a5f1-a3725fc804ac service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:03.577713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1e5254c0-032b-462b-955a-d9b93f4b9a6b None None] MFA Rules not processed for user `a57f3a9e39de4ba0801d6b449d2cc986`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:03.580430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1e5254c0-032b-462b-955a-d9b93f4b9a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:03.591333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d12bd3-1bb3-4873-a5f1-a3725fc804ac service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:03.690653 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1050/2086] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:03.698420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5254c0-032b-462b-955a-d9b93f4b9a6b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:03.701018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1e5254c0-032b-462b-955a-d9b93f4b9a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:03.708657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e5e6a-8f43-44b3-94d9-75443ac68484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:03.709281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e5e6a-8f43-44b3-94d9-75443ac68484 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:03.709564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e5e6a-8f43-44b3-94d9-75443ac68484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:03.709844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e5e6a-8f43-44b3-94d9-75443ac68484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:03.710550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e5e6a-8f43-44b3-94d9-75443ac68484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:03.712253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e5e6a-8f43-44b3-94d9-75443ac68484 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:03.718393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5254c0-032b-462b-955a-d9b93f4b9a6b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:03.733304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6d0f-de7a-4018-be5d-c75b242f4495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:03.734109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6d0f-de7a-4018-be5d-c75b242f4495 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:03.734250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6d0f-de7a-4018-be5d-c75b242f4495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:03.734654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6d0f-de7a-4018-be5d-c75b242f4495 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:03.735306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b6d0f-de7a-4018-be5d-c75b242f4495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:03.737733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b6d0f-de7a-4018-be5d-c75b242f4495 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:03.741382 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1037/2087] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:03.747515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e5e6a-8f43-44b3-94d9-75443ac68484 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:03.765981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e5e6a-8f43-44b3-94d9-75443ac68484 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:03.771974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dde31-73b9-4096-ba81-09630353b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:03.772628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dde31-73b9-4096-ba81-09630353b5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:03.772910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dde31-73b9-4096-ba81-09630353b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:03.773193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dde31-73b9-4096-ba81-09630353b5ab admin admin] PATH_INFO: `/v3/projects/6cdc0650facb49ac86c4f8f79c2751f8/users/2ed7e34ffe4e4c8a9cdf075805bb1e49/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:03.780203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dde31-73b9-4096-ba81-09630353b5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdc0650facb49ac86c4f8f79c2751f8, user_id=2ed7e34ffe4e4c8a9cdf075805bb1e49, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:03.784890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dde31-73b9-4096-ba81-09630353b5ab admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:03.793742 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1051/2088] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:03 2022] POST /identity/v3/projects => generated 403 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:03.794936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6d0f-de7a-4018-be5d-c75b242f4495 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:03.809706 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1038/2089] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:03 2022] PUT /identity/v3/projects/6cdc0650facb49ac86c4f8f79c2751f8/users/2ed7e34ffe4e4c8a9cdf075805bb1e49/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:03.821988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a173755-d5cd-43f2-a918-9b9280c64eee None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:03.822158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a173755-d5cd-43f2-a918-9b9280c64eee None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:03.822444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a173755-d5cd-43f2-a918-9b9280c64eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:03.893069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6d0f-de7a-4018-be5d-c75b242f4495 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:03.901974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3a173755-d5cd-43f2-a918-9b9280c64eee None None] MFA Rules not processed for user `2ed7e34ffe4e4c8a9cdf075805bb1e49`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:03.903377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a173755-d5cd-43f2-a918-9b9280c64eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:03.940888 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:04.010642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433acdf-0012-4346-92f0-3ffc30d0da52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:04.011373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433acdf-0012-4346-92f0-3ffc30d0da52 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:04.011729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433acdf-0012-4346-92f0-3ffc30d0da52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:04.012178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433acdf-0012-4346-92f0-3ffc30d0da52 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:04.012902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433acdf-0012-4346-92f0-3ffc30d0da52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:04.015312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433acdf-0012-4346-92f0-3ffc30d0da52 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:04.073323 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1052/2090] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:03 2022] POST /identity/v3/users => generated 308 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:04.081044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433acdf-0012-4346-92f0-3ffc30d0da52 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:04.095531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433acdf-0012-4346-92f0-3ffc30d0da52 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:04.099992 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1039/2091] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:04.114293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f071a5-31b6-4c9d-b1e3-7b5ab525f11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:04.115081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f4f5-917c-413d-9221-ea2897761a47 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:04.115231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f071a5-31b6-4c9d-b1e3-7b5ab525f11a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:04.115336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f4f5-917c-413d-9221-ea2897761a47 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:04.115430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f4f5-917c-413d-9221-ea2897761a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:04.115686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f071a5-31b6-4c9d-b1e3-7b5ab525f11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:04.116275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f071a5-31b6-4c9d-b1e3-7b5ab525f11a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:04.116806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f071a5-31b6-4c9d-b1e3-7b5ab525f11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:04.118710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f071a5-31b6-4c9d-b1e3-7b5ab525f11a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:04.142536 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1053/2092] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:04.148505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f071a5-31b6-4c9d-b1e3-7b5ab525f11a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:04.172465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6464f4f5-917c-413d-9221-ea2897761a47 None None] MFA Rules not processed for user `c42d04f7289e49ef950eeaf764c91216`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:04.175875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6464f4f5-917c-413d-9221-ea2897761a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:04.179228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f071a5-31b6-4c9d-b1e3-7b5ab525f11a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:04.193852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2984ac8-b728-40fc-8e6d-87a851aa09cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:04.196992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2984ac8-b728-40fc-8e6d-87a851aa09cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:04.197520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2984ac8-b728-40fc-8e6d-87a851aa09cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:04.198693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2984ac8-b728-40fc-8e6d-87a851aa09cd admin admin] PATH_INFO: `/v3/projects/a16b9aa6d2554d8cb4e28054471540a9/users/70fe400d80644e1fb248bb41017394a7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:04.226793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2984ac8-b728-40fc-8e6d-87a851aa09cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16b9aa6d2554d8cb4e28054471540a9, user_id=70fe400d80644e1fb248bb41017394a7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:04.232160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2984ac8-b728-40fc-8e6d-87a851aa09cd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:04.260022 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:04.269869 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1054/2093] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:04 2022] PUT /identity/v3/projects/a16b9aa6d2554d8cb4e28054471540a9/users/70fe400d80644e1fb248bb41017394a7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:04.282004 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1040/2094] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:04.291560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2984ac8-b728-40fc-8e6d-87a851aa09cd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:04.395316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2984ac8-b728-40fc-8e6d-87a851aa09cd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:04.406788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d8152-c39b-4267-8f9f-30634f305b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:04.409177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d8152-c39b-4267-8f9f-30634f305b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:04.409702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d8152-c39b-4267-8f9f-30634f305b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:04.410326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d8152-c39b-4267-8f9f-30634f305b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:04.411257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d8152-c39b-4267-8f9f-30634f305b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:04.413290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d8152-c39b-4267-8f9f-30634f305b4c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:04.440358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464f4f5-917c-413d-9221-ea2897761a47 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:04.449131 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1055/2095] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:04.453289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464f4f5-917c-413d-9221-ea2897761a47 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:04.463728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de58842-9d1d-4c1b-a322-026d5106286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:04.464410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58842-9d1d-4c1b-a322-026d5106286d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:04.464696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58842-9d1d-4c1b-a322-026d5106286d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:04.465055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58842-9d1d-4c1b-a322-026d5106286d admin admin] PATH_INFO: `/v3/projects/a16b9aa6d2554d8cb4e28054471540a9/users/70fe400d80644e1fb248bb41017394a7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:04.467503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de58842-9d1d-4c1b-a322-026d5106286d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16b9aa6d2554d8cb4e28054471540a9, user_id=70fe400d80644e1fb248bb41017394a7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:04.470970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de58842-9d1d-4c1b-a322-026d5106286d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:04.487805 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1041/2096] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:04 2022] PUT /identity/v3/projects/a16b9aa6d2554d8cb4e28054471540a9/users/70fe400d80644e1fb248bb41017394a7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:04.603325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d8152-c39b-4267-8f9f-30634f305b4c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:04.728939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d8152-c39b-4267-8f9f-30634f305b4c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:04.780558 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:04.862923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76340d6d-f77e-46e2-bfbd-ef89c78872ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:04.863543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340d6d-f77e-46e2-bfbd-ef89c78872ea service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:04.863821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340d6d-f77e-46e2-bfbd-ef89c78872ea service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:04.864089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340d6d-f77e-46e2-bfbd-ef89c78872ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:04.953348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76340d6d-f77e-46e2-bfbd-ef89c78872ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:04.955111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76340d6d-f77e-46e2-bfbd-ef89c78872ea service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:04.985392 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1056/2097] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:05.588717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4150a6-09e4-4cfc-8366-5d93f78e88df None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:05.589206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4150a6-09e4-4cfc-8366-5d93f78e88df None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:05.589351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4150a6-09e4-4cfc-8366-5d93f78e88df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:05.611908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76340d6d-f77e-46e2-bfbd-ef89c78872ea service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:05.614006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-76340d6d-f77e-46e2-bfbd-ef89c78872ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:05.643257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4d4150a6-09e4-4cfc-8366-5d93f78e88df None None] MFA Rules not processed for user `c42d04f7289e49ef950eeaf764c91216`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:05.646760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4d4150a6-09e4-4cfc-8366-5d93f78e88df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:05.676589 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1042/2098] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:05.776270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76340d6d-f77e-46e2-bfbd-ef89c78872ea service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:05.797453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:05.798407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:05.799470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:05.809730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] PATH_INFO: `/v3/users/cbc3d3505371450e8d6caaa8b7c5dfd0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:05.814137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc3d3505371450e8d6caaa8b7c5dfd0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:05.821382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:05.917099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc3d3505371450e8d6caaa8b7c5dfd0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:05.945343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc3d3505371450e8d6caaa8b7c5dfd0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:05.946084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc3d3505371450e8d6caaa8b7c5dfd0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:05.948780 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:05.964327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc3d3505371450e8d6caaa8b7c5dfd0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:05.964974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc3d3505371450e8d6caaa8b7c5dfd0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:05.991153 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1057/2099] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:05 2022] DELETE /identity/v3/users/cbc3d3505371450e8d6caaa8b7c5dfd0 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:06.003138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f02f3-2579-4727-9611-14b68c385757 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:06.003534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f02f3-2579-4727-9611-14b68c385757 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:06.004314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f02f3-2579-4727-9611-14b68c385757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:06.047432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e10f02f3-2579-4727-9611-14b68c385757 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:06.058416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e10f02f3-2579-4727-9611-14b68c385757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:06.133806 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1043/2100] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:06.148554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:06.150138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:06.269170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15455718-3acc-4394-9bb6-3c49ca3aa4f7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:06.281887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425fc09-e560-4cd7-a800-3190c8e38d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:06.282577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425fc09-e560-4cd7-a800-3190c8e38d7d service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:06.282902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425fc09-e560-4cd7-a800-3190c8e38d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:06.283621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425fc09-e560-4cd7-a800-3190c8e38d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:06.297212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425fc09-e560-4cd7-a800-3190c8e38d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:06.298982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425fc09-e560-4cd7-a800-3190c8e38d7d service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:06.318935 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1058/2101] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:06.955291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f02f3-2579-4727-9611-14b68c385757 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:06.957506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e10f02f3-2579-4727-9611-14b68c385757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:07.025345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f02f3-2579-4727-9611-14b68c385757 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:07.035109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:07.035779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:07.037070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:07.037702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] PATH_INFO: `/v3/projects/51df90dbb0ac462890b5797af9ccf3b4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:07.039208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51df90dbb0ac462890b5797af9ccf3b4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:07.042059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:07.163321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51df90dbb0ac462890b5797af9ccf3b4', 'request_id': 'req-7b000e00-b020-4ec7-a164-3cb31906c324'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:07.181480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51df90dbb0ac462890b5797af9ccf3b4', 'request_id': 'req-7b000e00-b020-4ec7-a164-3cb31906c324'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:07.194113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51df90dbb0ac462890b5797af9ccf3b4', 'request_id': 'req-7b000e00-b020-4ec7-a164-3cb31906c324'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:07.223779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] The token cache is being invalidate because project 51df90dbb0ac462890b5797af9ccf3b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:07.224302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:07.225733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:07.234059 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1044/2102] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:06 2022] DELETE /identity/v3/projects/51df90dbb0ac462890b5797af9ccf3b4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:07.237547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425fc09-e560-4cd7-a800-3190c8e38d7d service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:07.249144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425fc09-e560-4cd7-a800-3190c8e38d7d service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:07.353392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:07.354226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:07.355472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:07.355953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] PATH_INFO: `/v3/users/b5fc87239b7c47c5a61057c09540b64f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:07.358122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5fc87239b7c47c5a61057c09540b64f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:07.360523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:07.471383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5fc87239b7c47c5a61057c09540b64f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:07.523550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5fc87239b7c47c5a61057c09540b64f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:07.527109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5fc87239b7c47c5a61057c09540b64f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:07.550479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5fc87239b7c47c5a61057c09540b64f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:07.551862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5fc87239b7c47c5a61057c09540b64f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:07.654413 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1059/2103] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:07 2022] DELETE /identity/v3/users/b5fc87239b7c47c5a61057c09540b64f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:08.330006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:08.333716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:08.360181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b000e00-b020-4ec7-a164-3cb31906c324 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:08.444329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:08.446392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:08.465710 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:08.490867 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:08.503627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c219c7-8f55-46c6-a11a-a2a0ef7c800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:08.505678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c219c7-8f55-46c6-a11a-a2a0ef7c800a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:08.507686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c219c7-8f55-46c6-a11a-a2a0ef7c800a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:08.508410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c219c7-8f55-46c6-a11a-a2a0ef7c800a admin admin] PATH_INFO: `/v3/users/29b93436efc3428f85b0f59dea7c3724` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:08.512142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c219c7-8f55-46c6-a11a-a2a0ef7c800a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b93436efc3428f85b0f59dea7c3724)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:08.520220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c219c7-8f55-46c6-a11a-a2a0ef7c800a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:08.643751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b7c219c7-8f55-46c6-a11a-a2a0ef7c800a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b93436efc3428f85b0f59dea7c3724'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:08.653500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0efa63-26df-4bb1-b938-19ba96bc4b6e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:08.659669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:08.660344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:08.660623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:08.660778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b7c219c7-8f55-46c6-a11a-a2a0ef7c800a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b93436efc3428f85b0f59dea7c3724'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:08.660886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] PATH_INFO: `/v3/projects/c59c4ea4eea04c318bacbfd5520f2fc2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:08.661950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b7c219c7-8f55-46c6-a11a-a2a0ef7c800a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b93436efc3428f85b0f59dea7c3724'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:08.662181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c59c4ea4eea04c318bacbfd5520f2fc2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:08.664306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:08.674844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b7c219c7-8f55-46c6-a11a-a2a0ef7c800a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b93436efc3428f85b0f59dea7c3724'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:08.693508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b7c219c7-8f55-46c6-a11a-a2a0ef7c800a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b93436efc3428f85b0f59dea7c3724'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:08.709486 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1045/2104] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:08 2022] DELETE /identity/v3/users/29b93436efc3428f85b0f59dea7c3724 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:08.714860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c472b-034a-429a-8670-57b4c6e54dcc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:08.715442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c472b-034a-429a-8670-57b4c6e54dcc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:08.717088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c472b-034a-429a-8670-57b4c6e54dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:08.748338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59c4ea4eea04c318bacbfd5520f2fc2', 'request_id': 'req-b898a918-8d93-4234-9eca-24bfa4bccaee'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:08.756891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-844c472b-034a-429a-8670-57b4c6e54dcc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:08.757969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59c4ea4eea04c318bacbfd5520f2fc2', 'request_id': 'req-b898a918-8d93-4234-9eca-24bfa4bccaee'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:08.762628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-844c472b-034a-429a-8670-57b4c6e54dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:08.765273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59c4ea4eea04c318bacbfd5520f2fc2', 'request_id': 'req-b898a918-8d93-4234-9eca-24bfa4bccaee'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:08.799284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] The token cache is being invalidate because project c59c4ea4eea04c318bacbfd5520f2fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:08.800363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:08.801363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b898a918-8d93-4234-9eca-24bfa4bccaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:08.804234 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1060/2105] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:08 2022] DELETE /identity/v3/projects/c59c4ea4eea04c318bacbfd5520f2fc2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:08.811152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906159aa-3185-489f-863a-eccd7bcae1d6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:08.814684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906159aa-3185-489f-863a-eccd7bcae1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:08.815121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906159aa-3185-489f-863a-eccd7bcae1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:08.884258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-906159aa-3185-489f-863a-eccd7bcae1d6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:08.886392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-906159aa-3185-489f-863a-eccd7bcae1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:08.887110 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1046/2106] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:08.903565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c472b-034a-429a-8670-57b4c6e54dcc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:08.904150 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1061/2107] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:08.905165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-844c472b-034a-429a-8670-57b4c6e54dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:08.915760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94fee-498d-405c-845b-32cebe154a2e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:08.916207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94fee-498d-405c-845b-32cebe154a2e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:08.917290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94fee-498d-405c-845b-32cebe154a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:08.962192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0ca94fee-498d-405c-845b-32cebe154a2e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:08.966053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0ca94fee-498d-405c-845b-32cebe154a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:08.993467 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1062/2108] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:08.995018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94fee-498d-405c-845b-32cebe154a2e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:09.021453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94fee-498d-405c-845b-32cebe154a2e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:09.026906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad88479-5072-44a0-a6bb-e8f219cf6134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:09.028090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad88479-5072-44a0-a6bb-e8f219cf6134 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:09.028090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad88479-5072-44a0-a6bb-e8f219cf6134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:09.028309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad88479-5072-44a0-a6bb-e8f219cf6134 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:09.028961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad88479-5072-44a0-a6bb-e8f219cf6134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:09.029328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad88479-5072-44a0-a6bb-e8f219cf6134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:09.031374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad88479-5072-44a0-a6bb-e8f219cf6134 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:09.051676 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1063/2109] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:09.051878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c472b-034a-429a-8670-57b4c6e54dcc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:09.053347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad88479-5072-44a0-a6bb-e8f219cf6134 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:09.058986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63387d-4fc4-435c-a168-d17831f38aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:09.059805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63387d-4fc4-435c-a168-d17831f38aba service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:09.060183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63387d-4fc4-435c-a168-d17831f38aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:09.060640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63387d-4fc4-435c-a168-d17831f38aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:09.065695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad88479-5072-44a0-a6bb-e8f219cf6134 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:09.072475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137b606-99b9-4dbd-ad9a-db2279847cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:09.074008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137b606-99b9-4dbd-ad9a-db2279847cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:09.074008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137b606-99b9-4dbd-ad9a-db2279847cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:09.074221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137b606-99b9-4dbd-ad9a-db2279847cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:09.075086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137b606-99b9-4dbd-ad9a-db2279847cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:09.081678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137b606-99b9-4dbd-ad9a-db2279847cb9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:09.112851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63387d-4fc4-435c-a168-d17831f38aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:09.117042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63387d-4fc4-435c-a168-d17831f38aba service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:09.129310 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1047/2110] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:09.156768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63387d-4fc4-435c-a168-d17831f38aba service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:09.159320 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1064/2111] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:09 2022] POST /identity/v3/projects => generated 409 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:09.172227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63387d-4fc4-435c-a168-d17831f38aba service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:09.218361 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:09.289791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150a80b-5581-4fd7-8947-d706c8dc3bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:09.290804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150a80b-5581-4fd7-8947-d706c8dc3bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:09.291084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150a80b-5581-4fd7-8947-d706c8dc3bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:09.291356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150a80b-5581-4fd7-8947-d706c8dc3bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:09.292282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150a80b-5581-4fd7-8947-d706c8dc3bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:09.294591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150a80b-5581-4fd7-8947-d706c8dc3bb1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:09.328198 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1048/2112] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:09 2022] POST /identity/v3/users => generated 305 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:09.334177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137b606-99b9-4dbd-ad9a-db2279847cb9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:09.352702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137b606-99b9-4dbd-ad9a-db2279847cb9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:09.359323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b644c16-d764-49f6-b233-288ecfe75de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:09.360044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b644c16-d764-49f6-b233-288ecfe75de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:09.360941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b644c16-d764-49f6-b233-288ecfe75de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:09.361288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b644c16-d764-49f6-b233-288ecfe75de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:09.362466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b644c16-d764-49f6-b233-288ecfe75de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:09.364749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b644c16-d764-49f6-b233-288ecfe75de3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:09.379762 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1065/2113] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:09.383153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150a80b-5581-4fd7-8947-d706c8dc3bb1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:09.398777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150a80b-5581-4fd7-8947-d706c8dc3bb1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:09.407843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c607e-1899-4382-be9c-fad52dfb1e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:09.408800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c607e-1899-4382-be9c-fad52dfb1e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:09.409344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c607e-1899-4382-be9c-fad52dfb1e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:09.409974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c607e-1899-4382-be9c-fad52dfb1e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:09.410901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c607e-1899-4382-be9c-fad52dfb1e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:09.413243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c607e-1899-4382-be9c-fad52dfb1e15 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:09.443340 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1049/2114] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:01:09.448262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b644c16-d764-49f6-b233-288ecfe75de3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:09.470699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b644c16-d764-49f6-b233-288ecfe75de3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:09.497818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8357cff-226d-49ab-9f10-0ed341569a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:09.502555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8357cff-226d-49ab-9f10-0ed341569a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:09.502901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8357cff-226d-49ab-9f10-0ed341569a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:09.503178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8357cff-226d-49ab-9f10-0ed341569a1c admin admin] PATH_INFO: `/v3/projects/a863fa9ef38b471dbb866f81c6fb0b37/users/292ec7b4a0074e398d23452899458532/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:09.559463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8357cff-226d-49ab-9f10-0ed341569a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a863fa9ef38b471dbb866f81c6fb0b37, user_id=292ec7b4a0074e398d23452899458532, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:09.570217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8357cff-226d-49ab-9f10-0ed341569a1c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:09.614653 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1066/2115] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:09 2022] PUT /identity/v3/projects/a863fa9ef38b471dbb866f81c6fb0b37/users/292ec7b4a0074e398d23452899458532/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:09.627009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecd5b0-2e20-4490-957e-46ec0cc19504 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:09.627617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecd5b0-2e20-4490-957e-46ec0cc19504 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:09.628180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecd5b0-2e20-4490-957e-46ec0cc19504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:09.691719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-73ecd5b0-2e20-4490-957e-46ec0cc19504 None None] MFA Rules not processed for user `292ec7b4a0074e398d23452899458532`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:09.692956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-73ecd5b0-2e20-4490-957e-46ec0cc19504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:09.789959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8357cff-226d-49ab-9f10-0ed341569a1c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:09.792303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d8357cff-226d-49ab-9f10-0ed341569a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:09.840023 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:09.870031 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1050/2116] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:09 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:09.878974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecd5b0-2e20-4490-957e-46ec0cc19504 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:09.996091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8357cff-226d-49ab-9f10-0ed341569a1c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:10.000414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecd5b0-2e20-4490-957e-46ec0cc19504 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:10.006108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:10.007790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:10.008083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:10.008832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] PATH_INFO: `/v3/projects/3164d697b687493cb2ef10c500dbcace` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:10.010266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3164d697b687493cb2ef10c500dbcace)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:10.013166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac9ed4-e664-4dbf-9449-3bd58eb827cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:10.013788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac9ed4-e664-4dbf-9449-3bd58eb827cd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:10.014070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac9ed4-e664-4dbf-9449-3bd58eb827cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:10.014341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac9ed4-e664-4dbf-9449-3bd58eb827cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:10.015127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:10.017340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac9ed4-e664-4dbf-9449-3bd58eb827cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:10.019242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac9ed4-e664-4dbf-9449-3bd58eb827cd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:10.062181 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1051/2117] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:09 2022] POST /identity/v3/projects => generated 411 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:01:10.067022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac9ed4-e664-4dbf-9449-3bd58eb827cd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:10.088804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3164d697b687493cb2ef10c500dbcace', 'request_id': 'req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:10.093737 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:10.103622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3164d697b687493cb2ef10c500dbcace', 'request_id': 'req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:10.121554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3164d697b687493cb2ef10c500dbcace', 'request_id': 'req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:10.143757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] The token cache is being invalidate because project 3164d697b687493cb2ef10c500dbcace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:10.144062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:10.146228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:10.147801 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1067/2118] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:09 2022] DELETE /identity/v3/projects/3164d697b687493cb2ef10c500dbcace => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:10.154127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:10.155573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:10.195938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac9ed4-e664-4dbf-9449-3bd58eb827cd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:10.293841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1916e1-01f1-4aba-9fa6-59a1e30d20f1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:10.299913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:10.302577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:10.303133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:10.303506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] PATH_INFO: `/v3/users/54ece7b3f74e450aaa1595e606638524` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:10.312137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912330a-cbbe-45c2-8c05-424d1168a970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:10.314428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912330a-cbbe-45c2-8c05-424d1168a970 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:10.314995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912330a-cbbe-45c2-8c05-424d1168a970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:10.315279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912330a-cbbe-45c2-8c05-424d1168a970 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:10.315954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912330a-cbbe-45c2-8c05-424d1168a970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:10.317995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912330a-cbbe-45c2-8c05-424d1168a970 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:10.320942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ece7b3f74e450aaa1595e606638524)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:10.327110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:10.375499 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1052/2119] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:10 2022] POST /identity/v3/users => generated 312 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:10.379066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912330a-cbbe-45c2-8c05-424d1168a970 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:10.382025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a912330a-cbbe-45c2-8c05-424d1168a970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:10.400455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912330a-cbbe-45c2-8c05-424d1168a970 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:10.408312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e838f97-a130-4288-85cf-39c7bd24f9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:10.409085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e838f97-a130-4288-85cf-39c7bd24f9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:10.409483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e838f97-a130-4288-85cf-39c7bd24f9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:10.409833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e838f97-a130-4288-85cf-39c7bd24f9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:10.410682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e838f97-a130-4288-85cf-39c7bd24f9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:10.425013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e838f97-a130-4288-85cf-39c7bd24f9d7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:10.440403 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1053/2120] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:10.444981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e838f97-a130-4288-85cf-39c7bd24f9d7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:10.466870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e838f97-a130-4288-85cf-39c7bd24f9d7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:10.476807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb678a-ac20-4a90-8465-c17612bd31bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:10.479209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb678a-ac20-4a90-8465-c17612bd31bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:10.480766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb678a-ac20-4a90-8465-c17612bd31bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:10.482244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb678a-ac20-4a90-8465-c17612bd31bc admin admin] PATH_INFO: `/v3/projects/0c71e34633874d01965f644532086b7b/users/b8cea6fc9a4c4efc8f7c4de0b132f58e/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:10.482549 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:10.490255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ece7b3f74e450aaa1595e606638524'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:10.516132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ece7b3f74e450aaa1595e606638524'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:10.517473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ece7b3f74e450aaa1595e606638524'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:10.531023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ece7b3f74e450aaa1595e606638524'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:10.532869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ece7b3f74e450aaa1595e606638524'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:10.554772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb678a-ac20-4a90-8465-c17612bd31bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c71e34633874d01965f644532086b7b, user_id=b8cea6fc9a4c4efc8f7c4de0b132f58e, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:10.558832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb678a-ac20-4a90-8465-c17612bd31bc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:10.566131 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1068/2121] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:10 2022] DELETE /identity/v3/users/54ece7b3f74e450aaa1595e606638524 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:10.614057 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1054/2122] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:10 2022] PUT /identity/v3/projects/0c71e34633874d01965f644532086b7b/users/b8cea6fc9a4c4efc8f7c4de0b132f58e/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:10.617724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:10.619607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:10.769843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb678a-ac20-4a90-8465-c17612bd31bc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:10.771905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-15cb678a-ac20-4a90-8465-c17612bd31bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:10.810160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c6ee7-6918-4956-9c05-cb59b427eea3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:10.997007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0db70-5918-47af-81e2-934f07fd7be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:10.997631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0db70-5918-47af-81e2-934f07fd7be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:10.997914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0db70-5918-47af-81e2-934f07fd7be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:10.998452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0db70-5918-47af-81e2-934f07fd7be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:10.999147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0db70-5918-47af-81e2-934f07fd7be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:11.000925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0db70-5918-47af-81e2-934f07fd7be2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:11.029364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb678a-ac20-4a90-8465-c17612bd31bc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:11.036080 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1069/2123] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:11.038939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ef865-bb80-46e1-8a34-5e2da44aaafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:11.039519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0db70-5918-47af-81e2-934f07fd7be2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:11.039860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef865-bb80-46e1-8a34-5e2da44aaafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:11.040325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef865-bb80-46e1-8a34-5e2da44aaafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:11.040748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef865-bb80-46e1-8a34-5e2da44aaafc admin admin] PATH_INFO: `/v3/users/ff89a664966144fa9e1103705953a91f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:11.043301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ef865-bb80-46e1-8a34-5e2da44aaafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff89a664966144fa9e1103705953a91f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:11.046240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ef865-bb80-46e1-8a34-5e2da44aaafc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:11.071913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0db70-5918-47af-81e2-934f07fd7be2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:11.088213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01ba82-0bcb-40a6-b39a-a97c80181c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:11.089353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01ba82-0bcb-40a6-b39a-a97c80181c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:11.089637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01ba82-0bcb-40a6-b39a-a97c80181c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:11.089911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01ba82-0bcb-40a6-b39a-a97c80181c8a admin admin] PATH_INFO: `/v3/projects/0c71e34633874d01965f644532086b7b/users/b8cea6fc9a4c4efc8f7c4de0b132f58e/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:11.094145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01ba82-0bcb-40a6-b39a-a97c80181c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c71e34633874d01965f644532086b7b, user_id=b8cea6fc9a4c4efc8f7c4de0b132f58e, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:11.099815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01ba82-0bcb-40a6-b39a-a97c80181c8a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:11.132567 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:11.159000 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1070/2124] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:11 2022] PUT /identity/v3/projects/0c71e34633874d01965f644532086b7b/users/b8cea6fc9a4c4efc8f7c4de0b132f58e/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:11.172689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bb056-b18a-4292-8efc-3a549465cf65 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:11.172988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bb056-b18a-4292-8efc-3a549465cf65 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:11.173271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bb056-b18a-4292-8efc-3a549465cf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:11.233411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e1ef865-bb80-46e1-8a34-5e2da44aaafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff89a664966144fa9e1103705953a91f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:11.274995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e1ef865-bb80-46e1-8a34-5e2da44aaafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff89a664966144fa9e1103705953a91f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:11.276563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e1ef865-bb80-46e1-8a34-5e2da44aaafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff89a664966144fa9e1103705953a91f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:11.288563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d09bb056-b18a-4292-8efc-3a549465cf65 None None] MFA Rules not processed for user `b8cea6fc9a4c4efc8f7c4de0b132f58e`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:11.289485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e1ef865-bb80-46e1-8a34-5e2da44aaafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff89a664966144fa9e1103705953a91f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:11.289783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d09bb056-b18a-4292-8efc-3a549465cf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:11.318418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e1ef865-bb80-46e1-8a34-5e2da44aaafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff89a664966144fa9e1103705953a91f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:11.344928 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1055/2125] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:10 2022] DELETE /identity/v3/users/ff89a664966144fa9e1103705953a91f => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:11.349847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b04652-f4eb-44a7-8aef-13479fcba1f0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:11.350310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b04652-f4eb-44a7-8aef-13479fcba1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:11.350622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b04652-f4eb-44a7-8aef-13479fcba1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:11.413713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-25b04652-f4eb-44a7-8aef-13479fcba1f0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:11.420020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-25b04652-f4eb-44a7-8aef-13479fcba1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:11.452066 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:11.595152 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1071/2126] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:11.597551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bb056-b18a-4292-8efc-3a549465cf65 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:11.601972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d09bb056-b18a-4292-8efc-3a549465cf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:11.659664 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1056/2127] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:11.673003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b04652-f4eb-44a7-8aef-13479fcba1f0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:11.674776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-25b04652-f4eb-44a7-8aef-13479fcba1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:11.846092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b04652-f4eb-44a7-8aef-13479fcba1f0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:11.855748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e90ec0-75f2-4d3a-bd3a-0458ce471b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:11.856644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bb056-b18a-4292-8efc-3a549465cf65 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:11.857433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e90ec0-75f2-4d3a-bd3a-0458ce471b7c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:11.857718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e90ec0-75f2-4d3a-bd3a-0458ce471b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:11.857986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e90ec0-75f2-4d3a-bd3a-0458ce471b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:11.880066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e90ec0-75f2-4d3a-bd3a-0458ce471b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:11.882163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e90ec0-75f2-4d3a-bd3a-0458ce471b7c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:11.921754 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1057/2128] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:11.923361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e90ec0-75f2-4d3a-bd3a-0458ce471b7c service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:11.928320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-48e90ec0-75f2-4d3a-bd3a-0458ce471b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:11.981473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e90ec0-75f2-4d3a-bd3a-0458ce471b7c service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:11.998717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:12.000135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:12.001153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:12.004850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] PATH_INFO: `/v3/projects/cf36e46c224a4caaa2076c4a9446929d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:12.007331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf36e46c224a4caaa2076c4a9446929d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:12.009707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:12.077421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0b50c-7720-4b83-8579-b65bf0b3340e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:12.078506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b50c-7720-4b83-8579-b65bf0b3340e service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:12.078924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b50c-7720-4b83-8579-b65bf0b3340e service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:12.079273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b50c-7720-4b83-8579-b65bf0b3340e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:12.082148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-47d0b50c-7720-4b83-8579-b65bf0b3340e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:12.096944 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:12.114516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf36e46c224a4caaa2076c4a9446929d', 'request_id': 'req-3c204809-2034-4933-8773-89ea21aa8118'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:12.122360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf36e46c224a4caaa2076c4a9446929d', 'request_id': 'req-3c204809-2034-4933-8773-89ea21aa8118'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:12.144651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf36e46c224a4caaa2076c4a9446929d', 'request_id': 'req-3c204809-2034-4933-8773-89ea21aa8118'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:12.175200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] The token cache is being invalidate because project cf36e46c224a4caaa2076c4a9446929d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:12.175839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:12.179259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:12.184041 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1058/2129] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:11 2022] DELETE /identity/v3/projects/cf36e46c224a4caaa2076c4a9446929d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:12.185721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:12.190141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:12.257755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0b50c-7720-4b83-8579-b65bf0b3340e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:12.259702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0b50c-7720-4b83-8579-b65bf0b3340e service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:12.285191 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1072/2130] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:12.288605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310a53-fa4b-48f5-a940-dbaaafafa67e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:12.288605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310a53-fa4b-48f5-a940-dbaaafafa67e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:12.290765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310a53-fa4b-48f5-a940-dbaaafafa67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:12.347479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0a310a53-fa4b-48f5-a940-dbaaafafa67e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:12.350104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0a310a53-fa4b-48f5-a940-dbaaafafa67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:12.376532 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:12.389849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c204809-2034-4933-8773-89ea21aa8118 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:12.406192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfeaab-04bf-4c4d-bfa7-47ee2cf12d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:12.407907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfeaab-04bf-4c4d-bfa7-47ee2cf12d60 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:12.408769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfeaab-04bf-4c4d-bfa7-47ee2cf12d60 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:12.409785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfeaab-04bf-4c4d-bfa7-47ee2cf12d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:12.416437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93dfeaab-04bf-4c4d-bfa7-47ee2cf12d60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:12.536912 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1073/2131] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:12.536912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a310a53-fa4b-48f5-a940-dbaaafafa67e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:12.537524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0a310a53-fa4b-48f5-a940-dbaaafafa67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:12.580319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a310a53-fa4b-48f5-a940-dbaaafafa67e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:12.596552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:12.597884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:12.599349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:12.599701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] PATH_INFO: `/v3/projects/db6033bb398f44bb8482a8dce6acb55a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:12.601317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfeaab-04bf-4c4d-bfa7-47ee2cf12d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:12.602389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6033bb398f44bb8482a8dce6acb55a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:12.604104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfeaab-04bf-4c4d-bfa7-47ee2cf12d60 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:12.608219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:12.635813 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1059/2132] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:12 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:12.639611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24f0a4-edec-4c7e-a762-0a0a02e6cd3b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:12.639611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24f0a4-edec-4c7e-a762-0a0a02e6cd3b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:12.639611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24f0a4-edec-4c7e-a762-0a0a02e6cd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:12.711350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cb24f0a4-edec-4c7e-a762-0a0a02e6cd3b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:12.715453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cb24f0a4-edec-4c7e-a762-0a0a02e6cd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:12.769416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6033bb398f44bb8482a8dce6acb55a', 'request_id': 'req-66f7529c-51af-451b-b9aa-38f457d455e8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:12.797134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6033bb398f44bb8482a8dce6acb55a', 'request_id': 'req-66f7529c-51af-451b-b9aa-38f457d455e8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:12.819972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6033bb398f44bb8482a8dce6acb55a', 'request_id': 'req-66f7529c-51af-451b-b9aa-38f457d455e8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:12.839820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] The token cache is being invalidate because project db6033bb398f44bb8482a8dce6acb55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:12.840053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:12.842513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:12.845996 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1074/2133] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:12 2022] DELETE /identity/v3/projects/db6033bb398f44bb8482a8dce6acb55a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:12.846629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:12.849659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:12.855256 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:12.880832 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1060/2134] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:12.882734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24f0a4-edec-4c7e-a762-0a0a02e6cd3b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:12.884289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cb24f0a4-edec-4c7e-a762-0a0a02e6cd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:12.898840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24f0a4-edec-4c7e-a762-0a0a02e6cd3b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:12.904941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:12.905936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:12.906460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:12.907270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] PATH_INFO: `/v3/users/011bf08f7d2547028c02580e158ee850` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:12.908786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011bf08f7d2547028c02580e158ee850)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:12.911170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:13.008449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011bf08f7d2547028c02580e158ee850'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:13.044635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7529c-51af-451b-b9aa-38f457d455e8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:13.056001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011bf08f7d2547028c02580e158ee850'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:13.057594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011bf08f7d2547028c02580e158ee850'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:13.061056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a8e9a-3649-485d-982d-7a177b5b832d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:13.061740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8e9a-3649-485d-982d-7a177b5b832d service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:13.062063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8e9a-3649-485d-982d-7a177b5b832d service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:13.062273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8e9a-3649-485d-982d-7a177b5b832d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:13.077589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-277a8e9a-3649-485d-982d-7a177b5b832d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:13.084306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011bf08f7d2547028c02580e158ee850'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:13.116920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011bf08f7d2547028c02580e158ee850'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:13.147530 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1061/2135] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:12 2022] DELETE /identity/v3/users/011bf08f7d2547028c02580e158ee850 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:13.148504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:13.158669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:13.197277 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:13.269001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a8e9a-3649-485d-982d-7a177b5b832d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:13.270690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a8e9a-3649-485d-982d-7a177b5b832d service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:13.291754 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1075/2136] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:12 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:13.310191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78072658-8cc4-4cca-a7fe-4755b01bfde2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:13.328766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61504b-724b-4f0d-8db2-a0ca885d6c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:13.329516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61504b-724b-4f0d-8db2-a0ca885d6c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:13.329955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61504b-724b-4f0d-8db2-a0ca885d6c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:13.330134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61504b-724b-4f0d-8db2-a0ca885d6c41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:13.330876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61504b-724b-4f0d-8db2-a0ca885d6c41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:13.331501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61504b-724b-4f0d-8db2-a0ca885d6c41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:13.332980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61504b-724b-4f0d-8db2-a0ca885d6c41 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:13.361761 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1062/2137] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:13.366212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a8e9a-3649-485d-982d-7a177b5b832d service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:13.383586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a8e9a-3649-485d-982d-7a177b5b832d service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:13.401720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4957caf-f006-4c40-a04c-122af4eb9373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:13.402290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957caf-f006-4c40-a04c-122af4eb9373 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:13.402441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957caf-f006-4c40-a04c-122af4eb9373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:13.402822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957caf-f006-4c40-a04c-122af4eb9373 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:13.403487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4957caf-f006-4c40-a04c-122af4eb9373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:13.405424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4957caf-f006-4c40-a04c-122af4eb9373 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:13.467595 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1076/2138] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:13 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:13.471426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61504b-724b-4f0d-8db2-a0ca885d6c41 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:13.504695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4957caf-f006-4c40-a04c-122af4eb9373 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:13.505479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61504b-724b-4f0d-8db2-a0ca885d6c41 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:13.508422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d4957caf-f006-4c40-a04c-122af4eb9373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:13.747305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f24242-92f9-42d9-a59d-573f80af84a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:13.748252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f24242-92f9-42d9-a59d-573f80af84a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:13.748720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f24242-92f9-42d9-a59d-573f80af84a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:13.749216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f24242-92f9-42d9-a59d-573f80af84a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:13.750097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f24242-92f9-42d9-a59d-573f80af84a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:13.755642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f24242-92f9-42d9-a59d-573f80af84a1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:13.777506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4957caf-f006-4c40-a04c-122af4eb9373 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:13.782798 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:13.785172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2bcd5-be95-4a7d-95cc-705f0aebcb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:13.785826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2bcd5-be95-4a7d-95cc-705f0aebcb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:13.786357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2bcd5-be95-4a7d-95cc-705f0aebcb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:13.786525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2bcd5-be95-4a7d-95cc-705f0aebcb1a admin admin] PATH_INFO: `/v3/users/292ec7b4a0074e398d23452899458532` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:13.787931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2bcd5-be95-4a7d-95cc-705f0aebcb1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=292ec7b4a0074e398d23452899458532)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:13.791835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2bcd5-be95-4a7d-95cc-705f0aebcb1a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:13.818202 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1063/2139] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:13 2022] POST /identity/v3/users => generated 288 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:01:13.822902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f24242-92f9-42d9-a59d-573f80af84a1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:13.857336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f24242-92f9-42d9-a59d-573f80af84a1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:13.865867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-32e2bcd5-be95-4a7d-95cc-705f0aebcb1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292ec7b4a0074e398d23452899458532'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:13.881041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee97c4-6d29-4eb2-aef3-672c6d39b0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:13.881812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee97c4-6d29-4eb2-aef3-672c6d39b0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:13.882177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee97c4-6d29-4eb2-aef3-672c6d39b0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:13.882521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee97c4-6d29-4eb2-aef3-672c6d39b0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:13.883217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-32e2bcd5-be95-4a7d-95cc-705f0aebcb1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292ec7b4a0074e398d23452899458532'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:13.883343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee97c4-6d29-4eb2-aef3-672c6d39b0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:13.884381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-32e2bcd5-be95-4a7d-95cc-705f0aebcb1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292ec7b4a0074e398d23452899458532'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:13.886104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee97c4-6d29-4eb2-aef3-672c6d39b0b1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:13.895962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-32e2bcd5-be95-4a7d-95cc-705f0aebcb1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292ec7b4a0074e398d23452899458532'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:13.897193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-32e2bcd5-be95-4a7d-95cc-705f0aebcb1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292ec7b4a0074e398d23452899458532'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:13.926938 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1064/2140] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:13.929183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee97c4-6d29-4eb2-aef3-672c6d39b0b1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:13.931122 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1077/2141] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:13 2022] DELETE /identity/v3/users/292ec7b4a0074e398d23452899458532 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:13.934386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-36ee97c4-6d29-4eb2-aef3-672c6d39b0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:13.936365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4d76-21e2-409b-8a24-6e5667342e2f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:13.936774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4d76-21e2-409b-8a24-6e5667342e2f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:13.937180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4d76-21e2-409b-8a24-6e5667342e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:13.975439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7adb4d76-21e2-409b-8a24-6e5667342e2f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:13.978104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7adb4d76-21e2-409b-8a24-6e5667342e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:13.980652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee97c4-6d29-4eb2-aef3-672c6d39b0b1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:14.051026 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:14.110206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acec7-2539-4761-a0a9-baca90afe215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:14.111302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acec7-2539-4761-a0a9-baca90afe215 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:14.111586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acec7-2539-4761-a0a9-baca90afe215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:14.111858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acec7-2539-4761-a0a9-baca90afe215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:14.112523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36acec7-2539-4761-a0a9-baca90afe215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:14.124668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36acec7-2539-4761-a0a9-baca90afe215 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:14.174283 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1065/2142] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:14.180761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acec7-2539-4761-a0a9-baca90afe215 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:14.196938 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1078/2143] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:14.239032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb4d76-21e2-409b-8a24-6e5667342e2f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:14.240770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7adb4d76-21e2-409b-8a24-6e5667342e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:14.244855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acec7-2539-4761-a0a9-baca90afe215 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:14.266925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7629c0-ddbb-43e8-af70-86e51a744df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:14.267887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7629c0-ddbb-43e8-af70-86e51a744df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:14.268367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7629c0-ddbb-43e8-af70-86e51a744df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:14.268791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7629c0-ddbb-43e8-af70-86e51a744df6 admin admin] PATH_INFO: `/v3/projects/70953149f0ef4187a6f173e1a4ebdd88/users/6424959c14254c8a957a34e4914aa889/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:14.325136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7629c0-ddbb-43e8-af70-86e51a744df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70953149f0ef4187a6f173e1a4ebdd88, user_id=6424959c14254c8a957a34e4914aa889, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:14.330709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7629c0-ddbb-43e8-af70-86e51a744df6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:14.362684 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1066/2144] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:14 2022] PUT /identity/v3/projects/70953149f0ef4187a6f173e1a4ebdd88/users/6424959c14254c8a957a34e4914aa889/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:14.371625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871c7b5-117d-4afc-a791-613f22657909 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:14.372142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871c7b5-117d-4afc-a791-613f22657909 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:14.372583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871c7b5-117d-4afc-a791-613f22657909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:14.443898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb4d76-21e2-409b-8a24-6e5667342e2f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:14.498397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d871c7b5-117d-4afc-a791-613f22657909 None None] MFA Rules not processed for user `6424959c14254c8a957a34e4914aa889`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:14.502318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d871c7b5-117d-4afc-a791-613f22657909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:14.606067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d766f86-7141-4347-ad64-362650ee1b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:14.606774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d766f86-7141-4347-ad64-362650ee1b8c service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:14.608262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d766f86-7141-4347-ad64-362650ee1b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:14.608552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d766f86-7141-4347-ad64-362650ee1b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:14.761730 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1067/2145] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:14.764742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac76f0-e124-4e85-a40b-eb2b73f952b6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:14.765030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac76f0-e124-4e85-a40b-eb2b73f952b6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:14.765761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac76f0-e124-4e85-a40b-eb2b73f952b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:14.809602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d766f86-7141-4347-ad64-362650ee1b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:14.813984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d766f86-7141-4347-ad64-362650ee1b8c service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:14.818805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-38ac76f0-e124-4e85-a40b-eb2b73f952b6 None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:14.822112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-38ac76f0-e124-4e85-a40b-eb2b73f952b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:14.836950 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1079/2146] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:14.838995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d766f86-7141-4347-ad64-362650ee1b8c service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:14.839720 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1068/2147] 10.222.0.13 () {58 vars in 1015 bytes} [Sun Oct 2 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:14.851236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac76f0-e124-4e85-a40b-eb2b73f952b6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:14.854651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-38ac76f0-e124-4e85-a40b-eb2b73f952b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:14.877331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d766f86-7141-4347-ad64-362650ee1b8c service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:14.893662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac76f0-e124-4e85-a40b-eb2b73f952b6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:14.893881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c263a-91eb-4880-9afa-1d2d70a08d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:14.894522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c263a-91eb-4880-9afa-1d2d70a08d1d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:14.894828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c263a-91eb-4880-9afa-1d2d70a08d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:14.895100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c263a-91eb-4880-9afa-1d2d70a08d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:14.897019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c263a-91eb-4880-9afa-1d2d70a08d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:14.900001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c263a-91eb-4880-9afa-1d2d70a08d1d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:14.907208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:14.907988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:14.908330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:14.908606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] PATH_INFO: `/v3/projects/fbc822d1d0cb4333b8e4c9cd7956df19` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:14.912333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc822d1d0cb4333b8e4c9cd7956df19)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:14.930638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:14.980922 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=4,keystone:SELECT=94,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:14.998820 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1080/2148] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:14 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:14.999948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c263a-91eb-4880-9afa-1d2d70a08d1d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:15.006737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc822d1d0cb4333b8e4c9cd7956df19', 'request_id': 'req-93cf20f8-663f-4212-9601-89f33870dcaf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:15.015019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc822d1d0cb4333b8e4c9cd7956df19', 'request_id': 'req-93cf20f8-663f-4212-9601-89f33870dcaf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:15.021403 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:15.025360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc822d1d0cb4333b8e4c9cd7956df19', 'request_id': 'req-93cf20f8-663f-4212-9601-89f33870dcaf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:15.065900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] The token cache is being invalidate because project fbc822d1d0cb4333b8e4c9cd7956df19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:15.066541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:15.070559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:15.073562 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1069/2149] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:14 2022] DELETE /identity/v3/projects/fbc822d1d0cb4333b8e4c9cd7956df19 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:15.074846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:15.079527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:15.107170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c263a-91eb-4880-9afa-1d2d70a08d1d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:15.112259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bfbde-a60b-4ea6-bdac-12b3c3890174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:15.113329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bfbde-a60b-4ea6-bdac-12b3c3890174 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:15.113463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bfbde-a60b-4ea6-bdac-12b3c3890174 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:15.113987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bfbde-a60b-4ea6-bdac-12b3c3890174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:15.116906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bc7bfbde-a60b-4ea6-bdac-12b3c3890174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:15.131817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bfbde-a60b-4ea6-bdac-12b3c3890174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:15.133378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bfbde-a60b-4ea6-bdac-12b3c3890174 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:15.157700 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1081/2150] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:15.159142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e484c8b-f6e9-41fb-a29b-8ab9245f71bc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:15.159532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e484c8b-f6e9-41fb-a29b-8ab9245f71bc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:15.159989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e484c8b-f6e9-41fb-a29b-8ab9245f71bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:15.189289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5e484c8b-f6e9-41fb-a29b-8ab9245f71bc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:15.190733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5e484c8b-f6e9-41fb-a29b-8ab9245f71bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:15.256637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf20f8-663f-4212-9601-89f33870dcaf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:15.272206 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1082/2151] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:15.279682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e484c8b-f6e9-41fb-a29b-8ab9245f71bc None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:15.281203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5e484c8b-f6e9-41fb-a29b-8ab9245f71bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:15.317124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e484c8b-f6e9-41fb-a29b-8ab9245f71bc None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:15.333114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:15.333767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:15.334211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:15.334310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] PATH_INFO: `/v3/users/ae3c3aba9b784076beb1b6713a439f78` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:15.345607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3c3aba9b784076beb1b6713a439f78)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:15.347726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:15.436946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3c3aba9b784076beb1b6713a439f78'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:15.457357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56f01e-edef-4da3-8789-3268d222b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:15.458004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56f01e-edef-4da3-8789-3268d222b75c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:15.458508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56f01e-edef-4da3-8789-3268d222b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:15.458833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56f01e-edef-4da3-8789-3268d222b75c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:15.460133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56f01e-edef-4da3-8789-3268d222b75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:15.464725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56f01e-edef-4da3-8789-3268d222b75c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:15.466574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3c3aba9b784076beb1b6713a439f78'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:15.468616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3c3aba9b784076beb1b6713a439f78'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:15.524188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3c3aba9b784076beb1b6713a439f78'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:15.526544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3c3aba9b784076beb1b6713a439f78'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:15.538118 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1070/2152] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:15 2022] POST /identity/v3/users => generated 293 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:15.554176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3f1a-646e-4ed2-94b8-5ca6819ff682 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:15.554473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3f1a-646e-4ed2-94b8-5ca6819ff682 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:15.554924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3f1a-646e-4ed2-94b8-5ca6819ff682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:15.561785 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1083/2153] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:15 2022] DELETE /identity/v3/users/ae3c3aba9b784076beb1b6713a439f78 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:15.562884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:15.568364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:15.626985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2b6c3f1a-646e-4ed2-94b8-5ca6819ff682 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:15.630853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2b6c3f1a-646e-4ed2-94b8-5ca6819ff682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:15.663104 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:15.771234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf99721-d2c6-4eb6-b464-183f98af3072 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:15.782774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf8511-28ec-473b-9941-7203bdceabc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:15.783641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8511-28ec-473b-9941-7203bdceabc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:15.784278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8511-28ec-473b-9941-7203bdceabc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:15.793902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8511-28ec-473b-9941-7203bdceabc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:15.797844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf8511-28ec-473b-9941-7203bdceabc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:15.801437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf8511-28ec-473b-9941-7203bdceabc9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:15.819249 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1084/2154] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:15.827740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf6a6-45c8-4424-b0ea-91726f268b91 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:15.828523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf6a6-45c8-4424-b0ea-91726f268b91 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:15.829393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf6a6-45c8-4424-b0ea-91726f268b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:15.853827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e3caf6a6-45c8-4424-b0ea-91726f268b91 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:15.855245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e3caf6a6-45c8-4424-b0ea-91726f268b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:15.858519 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:15.887923 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1085/2155] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:15.887923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caf6a6-45c8-4424-b0ea-91726f268b91 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:15.897730 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1071/2156] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:15.898963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c3f1a-646e-4ed2-94b8-5ca6819ff682 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:15.918071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c3f1a-646e-4ed2-94b8-5ca6819ff682 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:15.919328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caf6a6-45c8-4424-b0ea-91726f268b91 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:15.933863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b5148-a528-4737-b015-8b3dd5209135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:15.934405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b5148-a528-4737-b015-8b3dd5209135 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:15.934708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b5148-a528-4737-b015-8b3dd5209135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:15.935035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b5148-a528-4737-b015-8b3dd5209135 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:15.936027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b5148-a528-4737-b015-8b3dd5209135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:15.936135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b5148-a528-4737-b015-8b3dd5209135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:15.938504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b5148-a528-4737-b015-8b3dd5209135 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:15.952326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b831b7f-7ba6-4d8d-b33f-1c4a14bc08ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:15.955825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b831b7f-7ba6-4d8d-b33f-1c4a14bc08ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:15.956126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b831b7f-7ba6-4d8d-b33f-1c4a14bc08ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:15.959540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b831b7f-7ba6-4d8d-b33f-1c4a14bc08ec admin admin] PATH_INFO: `/v3/projects/3924f1976a89436d89cc1f64cb0aed1b/users/c4cd52ee54374ddc9462acbfd80af32d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:15.973904 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1072/2157] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:15.980422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b5148-a528-4737-b015-8b3dd5209135 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:15.982160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-202b5148-a528-4737-b015-8b3dd5209135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:16.004223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b831b7f-7ba6-4d8d-b33f-1c4a14bc08ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3924f1976a89436d89cc1f64cb0aed1b, user_id=c4cd52ee54374ddc9462acbfd80af32d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:16.011356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b831b7f-7ba6-4d8d-b33f-1c4a14bc08ec admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:16.028975 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1086/2158] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:15 2022] PUT /identity/v3/projects/3924f1976a89436d89cc1f64cb0aed1b/users/c4cd52ee54374ddc9462acbfd80af32d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:16.030423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b831b7f-7ba6-4d8d-b33f-1c4a14bc08ec admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:16.131710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b5148-a528-4737-b015-8b3dd5209135 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:16.247725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b831b7f-7ba6-4d8d-b33f-1c4a14bc08ec admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:16.261776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e293-8d73-4114-b10f-877bed9bb8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:16.262415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e293-8d73-4114-b10f-877bed9bb8dd admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:16.262719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e293-8d73-4114-b10f-877bed9bb8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:16.263001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e293-8d73-4114-b10f-877bed9bb8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:16.263737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53e293-8d73-4114-b10f-877bed9bb8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:16.268088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53e293-8d73-4114-b10f-877bed9bb8dd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:16.288303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bf988-8de5-471e-9c04-919c86451814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:16.289033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bf988-8de5-471e-9c04-919c86451814 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:16.289319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bf988-8de5-471e-9c04-919c86451814 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:16.289599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bf988-8de5-471e-9c04-919c86451814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:16.331070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bf988-8de5-471e-9c04-919c86451814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:16.332630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bf988-8de5-471e-9c04-919c86451814 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:16.337054 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1087/2159] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:16 2022] POST /identity/v3/projects => generated 395 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:16.337592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e293-8d73-4114-b10f-877bed9bb8dd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:16.370395 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1073/2160] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:16.371401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bf988-8de5-471e-9c04-919c86451814 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:16.437129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bf988-8de5-471e-9c04-919c86451814 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:16.479547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e293-8d73-4114-b10f-877bed9bb8dd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:16.489899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358007b-74b6-49c8-9365-a4a9ba8bfa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:16.490541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358007b-74b6-49c8-9365-a4a9ba8bfa39 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:16.490881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358007b-74b6-49c8-9365-a4a9ba8bfa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:16.491154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358007b-74b6-49c8-9365-a4a9ba8bfa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:16.491802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358007b-74b6-49c8-9365-a4a9ba8bfa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:16.493475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358007b-74b6-49c8-9365-a4a9ba8bfa39 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:16.518366 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1088/2161] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:16.520295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358007b-74b6-49c8-9365-a4a9ba8bfa39 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:16.547707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358007b-74b6-49c8-9365-a4a9ba8bfa39 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:16.563864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24eb29-2c9f-4eb6-93bf-e625fb682f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:16.564555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24eb29-2c9f-4eb6-93bf-e625fb682f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:16.570815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24eb29-2c9f-4eb6-93bf-e625fb682f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:16.571167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24eb29-2c9f-4eb6-93bf-e625fb682f41 admin admin] PATH_INFO: `/v3/projects/3924f1976a89436d89cc1f64cb0aed1b/users/c4cd52ee54374ddc9462acbfd80af32d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:16.579176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24eb29-2c9f-4eb6-93bf-e625fb682f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3924f1976a89436d89cc1f64cb0aed1b, user_id=c4cd52ee54374ddc9462acbfd80af32d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:16.581891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24eb29-2c9f-4eb6-93bf-e625fb682f41 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:16.611992 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1089/2162] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:16 2022] PUT /identity/v3/projects/3924f1976a89436d89cc1f64cb0aed1b/users/c4cd52ee54374ddc9462acbfd80af32d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:16.626736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd2603-2b95-44c1-accb-4b5808f229a5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:16.627006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd2603-2b95-44c1-accb-4b5808f229a5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:16.627233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd2603-2b95-44c1-accb-4b5808f229a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:16.636087 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:16.684371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1796c3-440c-4b7c-a12d-27652c0e6383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:16.687014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1796c3-440c-4b7c-a12d-27652c0e6383 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:16.687457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1796c3-440c-4b7c-a12d-27652c0e6383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:16.688656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1796c3-440c-4b7c-a12d-27652c0e6383 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:16.692347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1796c3-440c-4b7c-a12d-27652c0e6383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:16.693404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-91fd2603-2b95-44c1-accb-4b5808f229a5 None None] MFA Rules not processed for user `c4cd52ee54374ddc9462acbfd80af32d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:16.694720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-91fd2603-2b95-44c1-accb-4b5808f229a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:16.698128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1796c3-440c-4b7c-a12d-27652c0e6383 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:16.757277 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1074/2163] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:16 2022] POST /identity/v3/users => generated 298 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:16.760978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1796c3-440c-4b7c-a12d-27652c0e6383 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:16.800873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1796c3-440c-4b7c-a12d-27652c0e6383 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:16.855687 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1090/2164] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:16.871249 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:16.903294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164489-3465-4723-8d35-f57828719ce0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:16.903294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164489-3465-4723-8d35-f57828719ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:16.903777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164489-3465-4723-8d35-f57828719ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:16.988956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bcf7a-8106-4b3b-9a7a-ae5ce1d4fb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:16.989592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bcf7a-8106-4b3b-9a7a-ae5ce1d4fb89 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:16.989870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bcf7a-8106-4b3b-9a7a-ae5ce1d4fb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:16.990141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bcf7a-8106-4b3b-9a7a-ae5ce1d4fb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:16.996638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bcf7a-8106-4b3b-9a7a-ae5ce1d4fb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:16.999947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bcf7a-8106-4b3b-9a7a-ae5ce1d4fb89 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:17.013216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fe164489-3465-4723-8d35-f57828719ce0 None None] MFA Rules not processed for user `70fe400d80644e1fb248bb41017394a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:17.015140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fe164489-3465-4723-8d35-f57828719ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:17.040172 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1075/2165] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:17.046635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bcf7a-8106-4b3b-9a7a-ae5ce1d4fb89 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:17.052973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6f4bcf7a-8106-4b3b-9a7a-ae5ce1d4fb89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:17.088992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bcf7a-8106-4b3b-9a7a-ae5ce1d4fb89 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:17.104114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:17.104768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:17.106340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:17.106657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] PATH_INFO: `/v3/projects/a863fa9ef38b471dbb866f81c6fb0b37` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:17.112363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a863fa9ef38b471dbb866f81c6fb0b37)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:17.115025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:17.215867 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1091/2166] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:16 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:17.218172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a863fa9ef38b471dbb866f81c6fb0b37', 'request_id': 'req-c3f5e79c-5c95-4dc0-8f33-0488708dc383'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:17.223582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe164489-3465-4723-8d35-f57828719ce0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:17.224996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fe164489-3465-4723-8d35-f57828719ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:17.236910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a863fa9ef38b471dbb866f81c6fb0b37', 'request_id': 'req-c3f5e79c-5c95-4dc0-8f33-0488708dc383'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:17.251687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a863fa9ef38b471dbb866f81c6fb0b37', 'request_id': 'req-c3f5e79c-5c95-4dc0-8f33-0488708dc383'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:17.276097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] The token cache is being invalidate because project a863fa9ef38b471dbb866f81c6fb0b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:17.276921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:17.277839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:17.280310 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1076/2167] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:17 2022] DELETE /identity/v3/projects/a863fa9ef38b471dbb866f81c6fb0b37 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:17.282267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:17.284305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:17.399226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe164489-3465-4723-8d35-f57828719ce0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:17.414467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5e79c-5c95-4dc0-8f33-0488708dc383 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:17.417503 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:17.428389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:17.429083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:17.429364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:17.429639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] PATH_INFO: `/v3/users/e7eb017337d54e9e890d47f3d49d4ae5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:17.431767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7eb017337d54e9e890d47f3d49d4ae5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:17.434208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:17.555362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662679c-e9b7-402c-97f7-aaef1740397b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:17.556047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662679c-e9b7-402c-97f7-aaef1740397b service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:17.557584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662679c-e9b7-402c-97f7-aaef1740397b service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:17.558621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662679c-e9b7-402c-97f7-aaef1740397b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:17.563121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a662679c-e9b7-402c-97f7-aaef1740397b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:17.591648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7eb017337d54e9e890d47f3d49d4ae5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:17.597228 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:17.629641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7eb017337d54e9e890d47f3d49d4ae5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:17.634666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7eb017337d54e9e890d47f3d49d4ae5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:17.659744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7eb017337d54e9e890d47f3d49d4ae5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:17.686757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7eb017337d54e9e890d47f3d49d4ae5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:17.709390 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1077/2168] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:17 2022] DELETE /identity/v3/users/e7eb017337d54e9e890d47f3d49d4ae5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:17.710435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:17.713087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:17.715714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662679c-e9b7-402c-97f7-aaef1740397b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:17.718018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662679c-e9b7-402c-97f7-aaef1740397b service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:17.744765 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1092/2169] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:17.745647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662679c-e9b7-402c-97f7-aaef1740397b service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:17.749408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a662679c-e9b7-402c-97f7-aaef1740397b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:17.785781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662679c-e9b7-402c-97f7-aaef1740397b service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:17.868596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d823b0-48d7-4dac-8ad0-4eade0bf5150 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:17.893181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9243f-ce6c-4084-a7c1-bedb62e98825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:17.894337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9243f-ce6c-4084-a7c1-bedb62e98825 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:17.894673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9243f-ce6c-4084-a7c1-bedb62e98825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:17.894960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9243f-ce6c-4084-a7c1-bedb62e98825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:17.911957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9243f-ce6c-4084-a7c1-bedb62e98825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:17.917991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9243f-ce6c-4084-a7c1-bedb62e98825 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:17.951788 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1078/2170] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:17.952764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9243f-ce6c-4084-a7c1-bedb62e98825 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:17.955419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a1f9243f-ce6c-4084-a7c1-bedb62e98825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:17.957568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52400-a551-40a5-bd92-19ca810e4bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:17.958814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52400-a551-40a5-bd92-19ca810e4bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:17.959865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52400-a551-40a5-bd92-19ca810e4bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:17.960352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52400-a551-40a5-bd92-19ca810e4bd3 admin admin] PATH_INFO: `/v3/users/b8cea6fc9a4c4efc8f7c4de0b132f58e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:17.972948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52400-a551-40a5-bd92-19ca810e4bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8cea6fc9a4c4efc8f7c4de0b132f58e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:17.974402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9243f-ce6c-4084-a7c1-bedb62e98825 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:17.978168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52400-a551-40a5-bd92-19ca810e4bd3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:17.981563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:17.982551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:17.982954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:17.983235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] PATH_INFO: `/v3/projects/2593cd49763c4c02ac5f7b30b03a0366` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:17.984595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2593cd49763c4c02ac5f7b30b03a0366)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:17.987043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:18.079674 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:18.082872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57c52400-a551-40a5-bd92-19ca810e4bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8cea6fc9a4c4efc8f7c4de0b132f58e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.100114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57c52400-a551-40a5-bd92-19ca810e4bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8cea6fc9a4c4efc8f7c4de0b132f58e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.101181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57c52400-a551-40a5-bd92-19ca810e4bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8cea6fc9a4c4efc8f7c4de0b132f58e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.111959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57c52400-a551-40a5-bd92-19ca810e4bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8cea6fc9a4c4efc8f7c4de0b132f58e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.112910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57c52400-a551-40a5-bd92-19ca810e4bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8cea6fc9a4c4efc8f7c4de0b132f58e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.125512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2593cd49763c4c02ac5f7b30b03a0366', 'request_id': 'req-db6b45ba-6892-4df5-a5c0-b0216b526941'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.132575 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1093/2171] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:17 2022] DELETE /identity/v3/users/b8cea6fc9a4c4efc8f7c4de0b132f58e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:18.134263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8134-4223-4f21-90f8-7df96e764eae None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:18.134775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8134-4223-4f21-90f8-7df96e764eae None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:18.135123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8134-4223-4f21-90f8-7df96e764eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:18.154131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2593cd49763c4c02ac5f7b30b03a0366', 'request_id': 'req-db6b45ba-6892-4df5-a5c0-b0216b526941'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.166751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c13c8134-4223-4f21-90f8-7df96e764eae None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:18.167711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2593cd49763c4c02ac5f7b30b03a0366', 'request_id': 'req-db6b45ba-6892-4df5-a5c0-b0216b526941'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.167991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c13c8134-4223-4f21-90f8-7df96e764eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:18.194424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] The token cache is being invalidate because project 2593cd49763c4c02ac5f7b30b03a0366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:18.194760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.196263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.201311 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1079/2172] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:17 2022] DELETE /identity/v3/projects/2593cd49763c4c02ac5f7b30b03a0366 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:18.201311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:18.203479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:18.310188 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1094/2173] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:18.311235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c8134-4223-4f21-90f8-7df96e764eae None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:18.313632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c13c8134-4223-4f21-90f8-7df96e764eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:18.337915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c8134-4223-4f21-90f8-7df96e764eae None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:18.352439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3b314-a2e0-4378-b1ec-16cd2bb46996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:18.353117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3b314-a2e0-4378-b1ec-16cd2bb46996 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:18.353395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3b314-a2e0-4378-b1ec-16cd2bb46996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:18.353665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3b314-a2e0-4378-b1ec-16cd2bb46996 admin admin] PATH_INFO: `/v3/projects/9de523ba73a54067a287aa17f43cec20/users/6d9e1b41a5ce40c292c45ab1bfacb020/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:18.363582 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:18.399973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3b314-a2e0-4378-b1ec-16cd2bb46996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de523ba73a54067a287aa17f43cec20, user_id=6d9e1b41a5ce40c292c45ab1bfacb020, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:18.403964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3b314-a2e0-4378-b1ec-16cd2bb46996 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:18.430036 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1095/2174] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:18 2022] PUT /identity/v3/projects/9de523ba73a54067a287aa17f43cec20/users/6d9e1b41a5ce40c292c45ab1bfacb020/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:18.432609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b45ba-6892-4df5-a5c0-b0216b526941 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:18.432925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3b314-a2e0-4378-b1ec-16cd2bb46996 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:18.443243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-95e3b314-a2e0-4378-b1ec-16cd2bb46996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:18.566654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3b314-a2e0-4378-b1ec-16cd2bb46996 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:18.573252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:18.574318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:18.574919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:18.575422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] PATH_INFO: `/v3/users/fd4f1f3bc32f4195a3f4c3bf6665588e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:18.577249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4f1f3bc32f4195a3f4c3bf6665588e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:18.580793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:18.603093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b24fb1-b56f-4668-ac37-3888ecb0479b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:18.603716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b24fb1-b56f-4668-ac37-3888ecb0479b service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:18.605819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b24fb1-b56f-4668-ac37-3888ecb0479b service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:18.606058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b24fb1-b56f-4668-ac37-3888ecb0479b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:18.612860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-97b24fb1-b56f-4668-ac37-3888ecb0479b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:18.644600 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:18.657307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4f1f3bc32f4195a3f4c3bf6665588e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.686186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4f1f3bc32f4195a3f4c3bf6665588e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.688809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4f1f3bc32f4195a3f4c3bf6665588e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.699504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4f1f3bc32f4195a3f4c3bf6665588e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.700412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4f1f3bc32f4195a3f4c3bf6665588e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:18.714026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b24fb1-b56f-4668-ac37-3888ecb0479b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:18.718052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b24fb1-b56f-4668-ac37-3888ecb0479b service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:18.724034 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1096/2175] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:18 2022] DELETE /identity/v3/users/fd4f1f3bc32f4195a3f4c3bf6665588e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:18.725273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:18.726747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:18.744542 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1080/2176] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:18.747629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b15f2d-b195-4b2c-adfe-ef70be1f13bf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:18.748125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b15f2d-b195-4b2c-adfe-ef70be1f13bf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:18.748585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b15f2d-b195-4b2c-adfe-ef70be1f13bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:18.806810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894a19-6604-4bcd-aba3-5f0d05aefe96 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:18.807627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b0b15f2d-b195-4b2c-adfe-ef70be1f13bf None None] MFA Rules not processed for user `6d9e1b41a5ce40c292c45ab1bfacb020`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:18.810069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b0b15f2d-b195-4b2c-adfe-ef70be1f13bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:18.811550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94335eb5-4b4c-4c1c-96ff-b7f55cd38d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:18.812597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94335eb5-4b4c-4c1c-96ff-b7f55cd38d51 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:18.813245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94335eb5-4b4c-4c1c-96ff-b7f55cd38d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:18.813620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94335eb5-4b4c-4c1c-96ff-b7f55cd38d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:18.816918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-94335eb5-4b4c-4c1c-96ff-b7f55cd38d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:19.005565 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1081/2177] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:19.006977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b15f2d-b195-4b2c-adfe-ef70be1f13bf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:19.007933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94335eb5-4b4c-4c1c-96ff-b7f55cd38d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:19.009400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94335eb5-4b4c-4c1c-96ff-b7f55cd38d51 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:19.012141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b0b15f2d-b195-4b2c-adfe-ef70be1f13bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:19.039690 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1097/2178] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:19.051445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b15f2d-b195-4b2c-adfe-ef70be1f13bf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:19.063678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b79b64-e1e2-421e-a60f-b37091ac5bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:19.064416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79b64-e1e2-421e-a60f-b37091ac5bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:19.064810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79b64-e1e2-421e-a60f-b37091ac5bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:19.065087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79b64-e1e2-421e-a60f-b37091ac5bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:19.066754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b79b64-e1e2-421e-a60f-b37091ac5bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:19.071848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b79b64-e1e2-421e-a60f-b37091ac5bb3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:19.090968 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:19.125636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94335eb5-4b4c-4c1c-96ff-b7f55cd38d51 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:19.127208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-94335eb5-4b4c-4c1c-96ff-b7f55cd38d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:19.130518 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1082/2179] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:19 2022] POST /identity/v3/projects => generated 395 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:19.133710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b79b64-e1e2-421e-a60f-b37091ac5bb3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:19.151658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94335eb5-4b4c-4c1c-96ff-b7f55cd38d51 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:19.214017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b79b64-e1e2-421e-a60f-b37091ac5bb3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:19.220709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa468b-f3f9-4912-9fa6-2923f68cdbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:19.221566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa468b-f3f9-4912-9fa6-2923f68cdbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:19.221910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa468b-f3f9-4912-9fa6-2923f68cdbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:19.222190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa468b-f3f9-4912-9fa6-2923f68cdbf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:19.222929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa468b-f3f9-4912-9fa6-2923f68cdbf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:19.225241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa468b-f3f9-4912-9fa6-2923f68cdbf6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:19.260177 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1083/2180] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:19 2022] POST /identity/v3/users => generated 304 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:01:19.263773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa468b-f3f9-4912-9fa6-2923f68cdbf6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:19.278382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa468b-f3f9-4912-9fa6-2923f68cdbf6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:19.285049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa82d55-0a7c-4ee7-9223-231b4ad77c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:19.286164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa82d55-0a7c-4ee7-9223-231b4ad77c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:19.286447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa82d55-0a7c-4ee7-9223-231b4ad77c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:19.286867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa82d55-0a7c-4ee7-9223-231b4ad77c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:19.287850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa82d55-0a7c-4ee7-9223-231b4ad77c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:19.289661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa82d55-0a7c-4ee7-9223-231b4ad77c5a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:19.294809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7934b4-dd3d-440f-ae68-75389022231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:19.295815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7934b4-dd3d-440f-ae68-75389022231f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:19.295929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7934b4-dd3d-440f-ae68-75389022231f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:19.296120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7934b4-dd3d-440f-ae68-75389022231f admin admin] PATH_INFO: `/v3/users/6424959c14254c8a957a34e4914aa889` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:19.298417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7934b4-dd3d-440f-ae68-75389022231f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6424959c14254c8a957a34e4914aa889)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:19.303540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7934b4-dd3d-440f-ae68-75389022231f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:19.309084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1084/2181] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:19.314479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa82d55-0a7c-4ee7-9223-231b4ad77c5a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:19.341271 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:19.345359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa82d55-0a7c-4ee7-9223-231b4ad77c5a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:19.358126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deea4b-5861-40a6-8855-5131b3f17d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:19.358833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deea4b-5861-40a6-8855-5131b3f17d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:19.369198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deea4b-5861-40a6-8855-5131b3f17d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:19.369792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deea4b-5861-40a6-8855-5131b3f17d3a admin admin] PATH_INFO: `/v3/projects/0438136621b848869d0b8468d2a09f0e/users/5e328b177ea3416a8acb95585c3afa30/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:19.398131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deea4b-5861-40a6-8855-5131b3f17d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0438136621b848869d0b8468d2a09f0e, user_id=5e328b177ea3416a8acb95585c3afa30, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:19.402906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deea4b-5861-40a6-8855-5131b3f17d3a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:19.433647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e7934b4-dd3d-440f-ae68-75389022231f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6424959c14254c8a957a34e4914aa889'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:19.443974 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1085/2182] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:19 2022] PUT /identity/v3/projects/0438136621b848869d0b8468d2a09f0e/users/5e328b177ea3416a8acb95585c3afa30/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:19.447843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deea4b-5861-40a6-8855-5131b3f17d3a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:19.481857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e7934b4-dd3d-440f-ae68-75389022231f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6424959c14254c8a957a34e4914aa889'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:19.482669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e7934b4-dd3d-440f-ae68-75389022231f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6424959c14254c8a957a34e4914aa889'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:19.496290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e7934b4-dd3d-440f-ae68-75389022231f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6424959c14254c8a957a34e4914aa889'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:19.496932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e7934b4-dd3d-440f-ae68-75389022231f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6424959c14254c8a957a34e4914aa889'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:19.547596 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1098/2183] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:19 2022] DELETE /identity/v3/users/6424959c14254c8a957a34e4914aa889 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:19.549284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192f70-949c-4a3d-bd75-2345336e8ce4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:19.549577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192f70-949c-4a3d-bd75-2345336e8ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:19.549850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192f70-949c-4a3d-bd75-2345336e8ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:19.584730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deea4b-5861-40a6-8855-5131b3f17d3a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:19.624288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b9192f70-949c-4a3d-bd75-2345336e8ce4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:19.625963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b9192f70-949c-4a3d-bd75-2345336e8ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:19.689932 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:19.721474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5be9a5-d9bd-490e-b9af-1fd834418000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:19.722906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5be9a5-d9bd-490e-b9af-1fd834418000 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:19.723879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5be9a5-d9bd-490e-b9af-1fd834418000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:19.724671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5be9a5-d9bd-490e-b9af-1fd834418000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:19.725786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5be9a5-d9bd-490e-b9af-1fd834418000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:19.727746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5be9a5-d9bd-490e-b9af-1fd834418000 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:19.746068 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1086/2184] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:19.750266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5be9a5-d9bd-490e-b9af-1fd834418000 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:19.756348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ae5be9a5-d9bd-490e-b9af-1fd834418000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:19.774160 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1099/2185] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:19.779948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5be9a5-d9bd-490e-b9af-1fd834418000 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:19.787593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dcb42-7e69-4f08-b8b7-618edfa55acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:19.788766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcb42-7e69-4f08-b8b7-618edfa55acc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:19.789221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcb42-7e69-4f08-b8b7-618edfa55acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:19.789569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcb42-7e69-4f08-b8b7-618edfa55acc admin admin] PATH_INFO: `/v3/projects/0438136621b848869d0b8468d2a09f0e/users/5e328b177ea3416a8acb95585c3afa30/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:19.791823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dcb42-7e69-4f08-b8b7-618edfa55acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0438136621b848869d0b8468d2a09f0e, user_id=5e328b177ea3416a8acb95585c3afa30, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:19.797619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dcb42-7e69-4f08-b8b7-618edfa55acc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:19.827891 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1087/2186] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:19 2022] PUT /identity/v3/projects/0438136621b848869d0b8468d2a09f0e/users/5e328b177ea3416a8acb95585c3afa30/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:19.831050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da086a86-88fd-49ed-9922-d924823e7d58 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:19.831578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da086a86-88fd-49ed-9922-d924823e7d58 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:19.832107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da086a86-88fd-49ed-9922-d924823e7d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:19.841293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dcb42-7e69-4f08-b8b7-618edfa55acc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:19.845403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bb5dcb42-7e69-4f08-b8b7-618edfa55acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:19.892830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-da086a86-88fd-49ed-9922-d924823e7d58 None None] MFA Rules not processed for user `5e328b177ea3416a8acb95585c3afa30`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:19.894339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-da086a86-88fd-49ed-9922-d924823e7d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:19.995550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dcb42-7e69-4f08-b8b7-618edfa55acc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:20.009903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2f142-d91d-4fe5-b5ea-9bd5a5427b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:20.010776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2f142-d91d-4fe5-b5ea-9bd5a5427b22 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:20.011329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2f142-d91d-4fe5-b5ea-9bd5a5427b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:20.011926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2f142-d91d-4fe5-b5ea-9bd5a5427b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:20.078202 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1100/2187] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:20.079640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da086a86-88fd-49ed-9922-d924823e7d58 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:20.081025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-da086a86-88fd-49ed-9922-d924823e7d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:20.113128 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:20.176095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2f142-d91d-4fe5-b5ea-9bd5a5427b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:20.179578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2f142-d91d-4fe5-b5ea-9bd5a5427b22 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:20.202579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da086a86-88fd-49ed-9922-d924823e7d58 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:20.205685 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1088/2188] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:20.209385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d021-168c-4e1b-b747-74fc0e2e03b0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:20.209698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d021-168c-4e1b-b747-74fc0e2e03b0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:20.210056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d021-168c-4e1b-b747-74fc0e2e03b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:20.210646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:20.211798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:20.212357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:20.212897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] PATH_INFO: `/v3/projects/0c71e34633874d01965f644532086b7b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:20.214569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c71e34633874d01965f644532086b7b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:20.216948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:20.256628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e2f4d021-168c-4e1b-b747-74fc0e2e03b0 None None] MFA Rules not processed for user `6d9e1b41a5ce40c292c45ab1bfacb020`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:20.261715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e2f4d021-168c-4e1b-b747-74fc0e2e03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:20.341713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c71e34633874d01965f644532086b7b', 'request_id': 'req-6e19f1fa-b953-4251-987d-891f912f39b1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:20.360502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c71e34633874d01965f644532086b7b', 'request_id': 'req-6e19f1fa-b953-4251-987d-891f912f39b1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:20.376525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c71e34633874d01965f644532086b7b', 'request_id': 'req-6e19f1fa-b953-4251-987d-891f912f39b1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:20.400846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] The token cache is being invalidate because project 0c71e34633874d01965f644532086b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:20.401699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:20.403239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e19f1fa-b953-4251-987d-891f912f39b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:20.407929 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1101/2189] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:20 2022] DELETE /identity/v3/projects/0c71e34633874d01965f644532086b7b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:20.412823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3a432-c3e4-4587-b3fe-86c3f8119db4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:20.413886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3a432-c3e4-4587-b3fe-86c3f8119db4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:20.414810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3a432-c3e4-4587-b3fe-86c3f8119db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:20.445144 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1089/2190] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:20.467210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bdd3a432-c3e4-4587-b3fe-86c3f8119db4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:20.469890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bdd3a432-c3e4-4587-b3fe-86c3f8119db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:20.559463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4d021-168c-4e1b-b747-74fc0e2e03b0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:20.561199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e2f4d021-168c-4e1b-b747-74fc0e2e03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:20.593660 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1102/2191] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:20.595674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32db1-d07f-4008-8b52-0db4b56a16e4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:20.596172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32db1-d07f-4008-8b52-0db4b56a16e4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:20.596817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32db1-d07f-4008-8b52-0db4b56a16e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:20.631110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-52a32db1-d07f-4008-8b52-0db4b56a16e4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:20.633177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-52a32db1-d07f-4008-8b52-0db4b56a16e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:20.642957 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:20.674185 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1103/2192] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:20.674185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a32db1-d07f-4008-8b52-0db4b56a16e4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:20.678899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-52a32db1-d07f-4008-8b52-0db4b56a16e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:20.699361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a32db1-d07f-4008-8b52-0db4b56a16e4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:20.712459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:20.713598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:20.714026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:20.715237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] PATH_INFO: `/v3/projects/b46004885615411c9b157fa1b309fc14` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:20.716547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46004885615411c9b157fa1b309fc14)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:20.720559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:20.768138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4d021-168c-4e1b-b747-74fc0e2e03b0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:20.778567 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:20.797652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46004885615411c9b157fa1b309fc14', 'request_id': 'req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:20.805496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46004885615411c9b157fa1b309fc14', 'request_id': 'req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:20.817505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46004885615411c9b157fa1b309fc14', 'request_id': 'req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:20.846362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] The token cache is being invalidate because project b46004885615411c9b157fa1b309fc14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:20.846803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:20.847870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:20.853550 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1104/2193] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:20 2022] DELETE /identity/v3/projects/b46004885615411c9b157fa1b309fc14 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:20.854452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:20.856942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:20.897262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc627ac-6412-4c6c-b476-c6e7f6d2e847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:20.898236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc627ac-6412-4c6c-b476-c6e7f6d2e847 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:20.898799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc627ac-6412-4c6c-b476-c6e7f6d2e847 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:20.898959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc627ac-6412-4c6c-b476-c6e7f6d2e847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:20.902104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8dc627ac-6412-4c6c-b476-c6e7f6d2e847 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:20.950716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c04ebb-1b84-4f5e-8c9d-a8ebbd290262 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:20.957048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d5ca2-f051-4818-956b-ad29ceb2fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:20.958330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d5ca2-f051-4818-956b-ad29ceb2fa1d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:20.958716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d5ca2-f051-4818-956b-ad29ceb2fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:20.959336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d5ca2-f051-4818-956b-ad29ceb2fa1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:20.960108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d5ca2-f051-4818-956b-ad29ceb2fa1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:20.960624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d5ca2-f051-4818-956b-ad29ceb2fa1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:20.962466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d5ca2-f051-4818-956b-ad29ceb2fa1d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:20.983116 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1105/2194] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:20.985279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e65da-ea09-4471-9125-8166546cdc3f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:20.985685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e65da-ea09-4471-9125-8166546cdc3f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:20.986052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e65da-ea09-4471-9125-8166546cdc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:20.996140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc627ac-6412-4c6c-b476-c6e7f6d2e847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:20.997744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc627ac-6412-4c6c-b476-c6e7f6d2e847 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:21.009889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0f7e65da-ea09-4471-9125-8166546cdc3f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:21.011294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0f7e65da-ea09-4471-9125-8166546cdc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:21.018793 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1090/2195] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:20 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:01:21.020343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc627ac-6412-4c6c-b476-c6e7f6d2e847 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:21.026918 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1106/2196] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:21.027934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e65da-ea09-4471-9125-8166546cdc3f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:21.028885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8dc627ac-6412-4c6c-b476-c6e7f6d2e847 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:21.043654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e65da-ea09-4471-9125-8166546cdc3f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:21.055846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b6f1-0eb2-494c-8053-0f68c129e4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:21.058118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b6f1-0eb2-494c-8053-0f68c129e4ea admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.058513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b6f1-0eb2-494c-8053-0f68c129e4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.059672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc627ac-6412-4c6c-b476-c6e7f6d2e847 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:21.060335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b6f1-0eb2-494c-8053-0f68c129e4ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.060837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b6f1-0eb2-494c-8053-0f68c129e4ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:21.064131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b6f1-0eb2-494c-8053-0f68c129e4ea admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:21.085132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:21.085885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.086167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.086448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] PATH_INFO: `/v3/projects/3f840ff0244f47ed96619e4649b2b143` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.088220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f840ff0244f47ed96619e4649b2b143)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:21.091104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:21.116187 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1107/2197] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:21 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:21.117970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13251d39-b9a7-4ef5-8fa5-6ef2ff0bb8f7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.122007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13251d39-b9a7-4ef5-8fa5-6ef2ff0bb8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.122204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13251d39-b9a7-4ef5-8fa5-6ef2ff0bb8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.163179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-13251d39-b9a7-4ef5-8fa5-6ef2ff0bb8f7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:21.165167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-13251d39-b9a7-4ef5-8fa5-6ef2ff0bb8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:21.182160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f840ff0244f47ed96619e4649b2b143', 'request_id': 'req-f5b40b50-ea47-4530-81ea-00c95b9bf769'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:21.191533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f840ff0244f47ed96619e4649b2b143', 'request_id': 'req-f5b40b50-ea47-4530-81ea-00c95b9bf769'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:21.193480 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:21.206062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f840ff0244f47ed96619e4649b2b143', 'request_id': 'req-f5b40b50-ea47-4530-81ea-00c95b9bf769'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:21.227230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] The token cache is being invalidate because project 3f840ff0244f47ed96619e4649b2b143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:21.229334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:21.231347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5b40b50-ea47-4530-81ea-00c95b9bf769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:21.233492 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1091/2198] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:21 2022] DELETE /identity/v3/projects/3f840ff0244f47ed96619e4649b2b143 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:21.236303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30404b8b-4ac1-4e1b-abad-893918fb8385 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.236921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30404b8b-4ac1-4e1b-abad-893918fb8385 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.238644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30404b8b-4ac1-4e1b-abad-893918fb8385 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.241406 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1092/2199] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 01:01:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:01:21.242677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30404b8b-4ac1-4e1b-abad-893918fb8385 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:21.245032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-30404b8b-4ac1-4e1b-abad-893918fb8385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:21.245303 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1108/2200] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:21.246450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13251d39-b9a7-4ef5-8fa5-6ef2ff0bb8f7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:21.247861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-13251d39-b9a7-4ef5-8fa5-6ef2ff0bb8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:21.264841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13251d39-b9a7-4ef5-8fa5-6ef2ff0bb8f7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:21.266996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30404b8b-4ac1-4e1b-abad-893918fb8385 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:21.272140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:21.272961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.273328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.273697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] PATH_INFO: `/v3/users/c5b747c0d24a4ab891f4e5b8e53ea707` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.275034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb6bcd-af3b-4100-b252-92e0417de02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:21.276087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb6bcd-af3b-4100-b252-92e0417de02a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.276336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b747c0d24a4ab891f4e5b8e53ea707)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:21.276671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb6bcd-af3b-4100-b252-92e0417de02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.277159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb6bcd-af3b-4100-b252-92e0417de02a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.277948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb6bcd-af3b-4100-b252-92e0417de02a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:21.278760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:21.281710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb6bcd-af3b-4100-b252-92e0417de02a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:21.345313 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:21.356871 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1093/2201] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:21 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:21.360617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb6bcd-af3b-4100-b252-92e0417de02a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:21.380431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb6bcd-af3b-4100-b252-92e0417de02a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:21.380631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b747c0d24a4ab891f4e5b8e53ea707'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:21.387202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8b7d7-c54a-49ce-97ad-4fc321f7f7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:21.387875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b7d7-c54a-49ce-97ad-4fc321f7f7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.388214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b7d7-c54a-49ce-97ad-4fc321f7f7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.388425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b7d7-c54a-49ce-97ad-4fc321f7f7f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.389082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8b7d7-c54a-49ce-97ad-4fc321f7f7f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:21.389514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8b7d7-c54a-49ce-97ad-4fc321f7f7f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:21.392481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8b7d7-c54a-49ce-97ad-4fc321f7f7f0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:21.419191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b747c0d24a4ab891f4e5b8e53ea707'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:21.419426 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1094/2202] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:21.419536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b747c0d24a4ab891f4e5b8e53ea707'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:21.419629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce90e53-b7d5-4fbc-bf4f-346767e939ea None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.419629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce90e53-b7d5-4fbc-bf4f-346767e939ea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.419629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce90e53-b7d5-4fbc-bf4f-346767e939ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.428196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b747c0d24a4ab891f4e5b8e53ea707'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:21.428974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b747c0d24a4ab891f4e5b8e53ea707'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:21.455912 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1109/2203] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:21 2022] DELETE /identity/v3/users/c5b747c0d24a4ab891f4e5b8e53ea707 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:21.459784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:21.462404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:21.470930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5ce90e53-b7d5-4fbc-bf4f-346767e939ea None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:21.472711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5ce90e53-b7d5-4fbc-bf4f-346767e939ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:21.595235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926f089-73a6-4fa9-8158-73110ad3d673 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:21.601313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573055f-4698-4be7-b4de-6ae08c3cd141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:21.602091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573055f-4698-4be7-b4de-6ae08c3cd141 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.602300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573055f-4698-4be7-b4de-6ae08c3cd141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.602574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573055f-4698-4be7-b4de-6ae08c3cd141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.603268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573055f-4698-4be7-b4de-6ae08c3cd141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:21.604900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573055f-4698-4be7-b4de-6ae08c3cd141 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:21.620796 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1110/2204] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:21.622021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573055f-4698-4be7-b4de-6ae08c3cd141 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:21.624203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a573055f-4698-4be7-b4de-6ae08c3cd141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:21.643208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573055f-4698-4be7-b4de-6ae08c3cd141 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:21.648995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972f06-ef5d-49fa-ae21-ff66a1f7de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:21.649619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972f06-ef5d-49fa-ae21-ff66a1f7de20 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.650080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972f06-ef5d-49fa-ae21-ff66a1f7de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.650229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972f06-ef5d-49fa-ae21-ff66a1f7de20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.650971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972f06-ef5d-49fa-ae21-ff66a1f7de20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:21.653096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972f06-ef5d-49fa-ae21-ff66a1f7de20 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:21.701185 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1111/2205] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:21 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:21.713101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972f06-ef5d-49fa-ae21-ff66a1f7de20 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:21.721453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-37972f06-ef5d-49fa-ae21-ff66a1f7de20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:21.723358 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1095/2206] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:21.726989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce90e53-b7d5-4fbc-bf4f-346767e939ea None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:21.784810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce90e53-b7d5-4fbc-bf4f-346767e939ea None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:21.949857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972f06-ef5d-49fa-ae21-ff66a1f7de20 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:21.954804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23fe01-a846-4617-a6fd-f8961ecc798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:21.955448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fe01-a846-4617-a6fd-f8961ecc798e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.955731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fe01-a846-4617-a6fd-f8961ecc798e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.956007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fe01-a846-4617-a6fd-f8961ecc798e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.956675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23fe01-a846-4617-a6fd-f8961ecc798e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:21.958314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23fe01-a846-4617-a6fd-f8961ecc798e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:21.980160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:21.980826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:21.981521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:21.981521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] PATH_INFO: `/v3/projects/70953149f0ef4187a6f173e1a4ebdd88` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:21.984433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=70953149f0ef4187a6f173e1a4ebdd88)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:21.993260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:22.012666 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1096/2207] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:22.016989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23fe01-a846-4617-a6fd-f8961ecc798e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:22.021368 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:22.038273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23fe01-a846-4617-a6fd-f8961ecc798e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:22.056871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec58a09-49a0-4dba-9ec9-82942ab91eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:22.057505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec58a09-49a0-4dba-9ec9-82942ab91eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:22.057791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec58a09-49a0-4dba-9ec9-82942ab91eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:22.058072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec58a09-49a0-4dba-9ec9-82942ab91eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:22.060418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec58a09-49a0-4dba-9ec9-82942ab91eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:22.063623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec58a09-49a0-4dba-9ec9-82942ab91eb7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:22.104760 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1097/2208] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:22 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:22.110591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec58a09-49a0-4dba-9ec9-82942ab91eb7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:22.136012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec58a09-49a0-4dba-9ec9-82942ab91eb7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:22.156884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70953149f0ef4187a6f173e1a4ebdd88', 'request_id': 'req-7cdf680d-c597-438e-9a97-59a2992fa0ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:22.180354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70953149f0ef4187a6f173e1a4ebdd88', 'request_id': 'req-7cdf680d-c597-438e-9a97-59a2992fa0ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:22.201005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70953149f0ef4187a6f173e1a4ebdd88', 'request_id': 'req-7cdf680d-c597-438e-9a97-59a2992fa0ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:22.242299 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:22.243642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] The token cache is being invalidate because project 70953149f0ef4187a6f173e1a4ebdd88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:22.244139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:22.244961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:22.246697 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1112/2209] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:21 2022] DELETE /identity/v3/projects/70953149f0ef4187a6f173e1a4ebdd88 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:22.247611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:22.250711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:22.297638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7a3ff-a2c0-43e1-b926-301be6042c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:22.298396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7a3ff-a2c0-43e1-b926-301be6042c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:22.298558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7a3ff-a2c0-43e1-b926-301be6042c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:22.298905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7a3ff-a2c0-43e1-b926-301be6042c2e admin admin] PATH_INFO: `/v3/projects/ff4b7bbc5d074b34b5f1c3c88d0a01fb/users/85df35ef26914607834c5353899750ea/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:22.318022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7a3ff-a2c0-43e1-b926-301be6042c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4b7bbc5d074b34b5f1c3c88d0a01fb, user_id=85df35ef26914607834c5353899750ea, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:22.321113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7a3ff-a2c0-43e1-b926-301be6042c2e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:22.337873 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1098/2210] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:22 2022] PUT /identity/v3/projects/ff4b7bbc5d074b34b5f1c3c88d0a01fb/users/85df35ef26914607834c5353899750ea/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:22.338906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7a3ff-a2c0-43e1-b926-301be6042c2e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:22.348891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a5b7a3ff-a2c0-43e1-b926-301be6042c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:22.397988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf680d-c597-438e-9a97-59a2992fa0ef admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:22.494338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39cb47-fe7c-4e7b-9691-c21dc0ce8893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:22.495082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39cb47-fe7c-4e7b-9691-c21dc0ce8893 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:22.495443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39cb47-fe7c-4e7b-9691-c21dc0ce8893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:22.495793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39cb47-fe7c-4e7b-9691-c21dc0ce8893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:22.496552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39cb47-fe7c-4e7b-9691-c21dc0ce8893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:22.496874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7a3ff-a2c0-43e1-b926-301be6042c2e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:22.498301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39cb47-fe7c-4e7b-9691-c21dc0ce8893 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:22.503539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b91ec9-ff0e-4da8-be5f-6e0ad5b15a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:22.504571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91ec9-ff0e-4da8-be5f-6e0ad5b15a3d service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:22.504571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91ec9-ff0e-4da8-be5f-6e0ad5b15a3d service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:22.504817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91ec9-ff0e-4da8-be5f-6e0ad5b15a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:22.506562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c5b91ec9-ff0e-4da8-be5f-6e0ad5b15a3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:22.509729 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1113/2211] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:22.510633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39cb47-fe7c-4e7b-9691-c21dc0ce8893 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:22.512949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6e39cb47-fe7c-4e7b-9691-c21dc0ce8893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:22.527610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b91ec9-ff0e-4da8-be5f-6e0ad5b15a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:22.529297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39cb47-fe7c-4e7b-9691-c21dc0ce8893 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:22.529554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b91ec9-ff0e-4da8-be5f-6e0ad5b15a3d service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:22.535382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:22.537079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:22.537620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:22.538109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] PATH_INFO: `/v3/users/c4cd52ee54374ddc9462acbfd80af32d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:22.539551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4cd52ee54374ddc9462acbfd80af32d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:22.541873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:22.542381 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1099/2212] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:22.543693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56540ec2-d83e-42e4-a4aa-c9e188a4e9cc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:22.543978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56540ec2-d83e-42e4-a4aa-c9e188a4e9cc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:22.544250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56540ec2-d83e-42e4-a4aa-c9e188a4e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:22.576576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-56540ec2-d83e-42e4-a4aa-c9e188a4e9cc None None] MFA Rules not processed for user `85df35ef26914607834c5353899750ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:22.578979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-56540ec2-d83e-42e4-a4aa-c9e188a4e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:22.602216 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:22.609036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4cd52ee54374ddc9462acbfd80af32d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:22.626833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4cd52ee54374ddc9462acbfd80af32d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:22.627579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4cd52ee54374ddc9462acbfd80af32d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:22.635913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4cd52ee54374ddc9462acbfd80af32d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:22.636892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4cd52ee54374ddc9462acbfd80af32d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:22.657303 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1114/2213] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:22 2022] DELETE /identity/v3/users/c4cd52ee54374ddc9462acbfd80af32d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:22.658809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:22.662409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:22.680400 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1100/2214] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:22.684546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56540ec2-d83e-42e4-a4aa-c9e188a4e9cc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:22.686505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-56540ec2-d83e-42e4-a4aa-c9e188a4e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:22.727410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56540ec2-d83e-42e4-a4aa-c9e188a4e9cc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:22.768433 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:22.782626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1bf18-53f3-4482-8526-38f579aca6e5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:22.790013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e56fe-74fa-41e0-88f9-93d95e17e245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:22.790736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e56fe-74fa-41e0-88f9-93d95e17e245 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:22.791020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e56fe-74fa-41e0-88f9-93d95e17e245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:22.791298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e56fe-74fa-41e0-88f9-93d95e17e245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:22.791957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e56fe-74fa-41e0-88f9-93d95e17e245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:22.794442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e56fe-74fa-41e0-88f9-93d95e17e245 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:22.807003 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1115/2215] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:22.811346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e56fe-74fa-41e0-88f9-93d95e17e245 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:22.824186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e56fe-74fa-41e0-88f9-93d95e17e245 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:22.834023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84ef68-33a3-43bc-9a9c-68ec5a5e292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:22.834947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84ef68-33a3-43bc-9a9c-68ec5a5e292a admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:22.835296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84ef68-33a3-43bc-9a9c-68ec5a5e292a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:22.835792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84ef68-33a3-43bc-9a9c-68ec5a5e292a admin admin] PATH_INFO: `/v3/projects/06355d5cf4f64541a8e33af5361bc573/users/08fcf70237244474b32f904af76a4e96/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:22.857279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e485f7-e2b9-496a-9c8e-8e85c0e6d81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:22.857776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84ef68-33a3-43bc-9a9c-68ec5a5e292a admin admin] RBAC: Authorizing `identity:create_grant(project_id=06355d5cf4f64541a8e33af5361bc573, user_id=08fcf70237244474b32f904af76a4e96, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:22.858882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e485f7-e2b9-496a-9c8e-8e85c0e6d81e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:22.859312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e485f7-e2b9-496a-9c8e-8e85c0e6d81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:22.859844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e485f7-e2b9-496a-9c8e-8e85c0e6d81e admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:22.860898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e485f7-e2b9-496a-9c8e-8e85c0e6d81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:22.861227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84ef68-33a3-43bc-9a9c-68ec5a5e292a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:22.882695 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1116/2216] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:22 2022] PUT /identity/v3/projects/06355d5cf4f64541a8e33af5361bc573/users/08fcf70237244474b32f904af76a4e96/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:22.883548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84ef68-33a3-43bc-9a9c-68ec5a5e292a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:22.884556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e485f7-e2b9-496a-9c8e-8e85c0e6d81e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:22.895958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6d84ef68-33a3-43bc-9a9c-68ec5a5e292a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:22.962440 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1101/2217] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:22 2022] POST /identity/v3/projects => generated 377 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:01:22.964357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013d8ac-26af-4d5c-95c2-234312809bd2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:22.972022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013d8ac-26af-4d5c-95c2-234312809bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:22.972768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013d8ac-26af-4d5c-95c2-234312809bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:23.014384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3013d8ac-26af-4d5c-95c2-234312809bd2 None None] MFA Rules not processed for user `08fcf70237244474b32f904af76a4e96`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:23.016536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3013d8ac-26af-4d5c-95c2-234312809bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:23.048246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84ef68-33a3-43bc-9a9c-68ec5a5e292a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:23.127757 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:23.199491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:23.201510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:23.203002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:23.203291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] PATH_INFO: `/v3/projects/8a5c33d549154bfc943a09250e484448` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:23.205095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5c33d549154bfc943a09250e484448)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:23.208574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:23.211089 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1102/2218] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:23.212375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013d8ac-26af-4d5c-95c2-234312809bd2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:23.231492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013d8ac-26af-4d5c-95c2-234312809bd2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:23.238444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11b541-4d12-4739-afd9-6122812dcbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:23.239155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11b541-4d12-4739-afd9-6122812dcbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:23.239442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11b541-4d12-4739-afd9-6122812dcbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:23.239722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11b541-4d12-4739-afd9-6122812dcbe9 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:23.240515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11b541-4d12-4739-afd9-6122812dcbe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:23.243301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11b541-4d12-4739-afd9-6122812dcbe9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:23.296682 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1103/2219] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:23 2022] POST /identity/v3/users => generated 295 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:23.297647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11b541-4d12-4739-afd9-6122812dcbe9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:23.312409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11b541-4d12-4739-afd9-6122812dcbe9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:23.374792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5c33d549154bfc943a09250e484448', 'request_id': 'req-e3b96693-6cfc-4c03-b911-2c35362decac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:23.397144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5c33d549154bfc943a09250e484448', 'request_id': 'req-e3b96693-6cfc-4c03-b911-2c35362decac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:23.412807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5c33d549154bfc943a09250e484448', 'request_id': 'req-e3b96693-6cfc-4c03-b911-2c35362decac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:23.425047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8497a6-980f-43fb-a154-a89d18cb506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:23.426686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8497a6-980f-43fb-a154-a89d18cb506b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:23.427290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8497a6-980f-43fb-a154-a89d18cb506b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:23.428062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8497a6-980f-43fb-a154-a89d18cb506b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:23.431359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8497a6-980f-43fb-a154-a89d18cb506b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:23.438337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8497a6-980f-43fb-a154-a89d18cb506b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:23.443731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] The token cache is being invalidate because project 8a5c33d549154bfc943a09250e484448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:23.444108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:23.448108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:23.451948 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1117/2220] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:22 2022] DELETE /identity/v3/projects/8a5c33d549154bfc943a09250e484448 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:23.454588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:23.462747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:23.529800 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1104/2221] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:23 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:23.533451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8497a6-980f-43fb-a154-a89d18cb506b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:23.545217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b96693-6cfc-4c03-b911-2c35362decac admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:23.549875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2e8497a6-980f-43fb-a154-a89d18cb506b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:23.560710 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:23.700132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8497a6-980f-43fb-a154-a89d18cb506b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:23.712285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74951097-1b2b-4e8d-a4f2-dad9c20e18ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:23.713775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951097-1b2b-4e8d-a4f2-dad9c20e18ae admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:23.714072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951097-1b2b-4e8d-a4f2-dad9c20e18ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:23.714347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951097-1b2b-4e8d-a4f2-dad9c20e18ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:23.715182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74951097-1b2b-4e8d-a4f2-dad9c20e18ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:23.717584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74951097-1b2b-4e8d-a4f2-dad9c20e18ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:23.742437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:23.747623 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1105/2222] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:23.749150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88405c52-928d-4eb3-b9d6-42eb76cfae09 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:23.751984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:23.752930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:23.753100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] PATH_INFO: `/v3/projects/3924f1976a89436d89cc1f64cb0aed1b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:23.763805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88405c52-928d-4eb3-b9d6-42eb76cfae09 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:23.764130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88405c52-928d-4eb3-b9d6-42eb76cfae09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:23.766717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3924f1976a89436d89cc1f64cb0aed1b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:23.772645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:23.825041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-88405c52-928d-4eb3-b9d6-42eb76cfae09 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:23.826507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-88405c52-928d-4eb3-b9d6-42eb76cfae09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:23.857188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3924f1976a89436d89cc1f64cb0aed1b', 'request_id': 'req-f7eae194-4699-4fae-bdee-cf85f1afbd59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:23.867388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3924f1976a89436d89cc1f64cb0aed1b', 'request_id': 'req-f7eae194-4699-4fae-bdee-cf85f1afbd59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:23.877756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3924f1976a89436d89cc1f64cb0aed1b', 'request_id': 'req-f7eae194-4699-4fae-bdee-cf85f1afbd59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:23.895759 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:23.911067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] The token cache is being invalidate because project 3924f1976a89436d89cc1f64cb0aed1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:23.912705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:23.916118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:23.919847 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1118/2223] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:23 2022] DELETE /identity/v3/projects/3924f1976a89436d89cc1f64cb0aed1b => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:23.922206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:23.927788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:23.955836 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1106/2224] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:23.956674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88405c52-928d-4eb3-b9d6-42eb76cfae09 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:23.971629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-88405c52-928d-4eb3-b9d6-42eb76cfae09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:23.996209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88405c52-928d-4eb3-b9d6-42eb76cfae09 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:24.008279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b1e9f-755c-4e98-b177-3562d33b9cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:24.008964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b1e9f-755c-4e98-b177-3562d33b9cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.009241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b1e9f-755c-4e98-b177-3562d33b9cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.009512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b1e9f-755c-4e98-b177-3562d33b9cca admin admin] PATH_INFO: `/v3/projects/4b23486512c747eb8056cd09047996a4/users/19e19fadf1ce42c9a6903b062e83a681/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.040863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b1e9f-755c-4e98-b177-3562d33b9cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b23486512c747eb8056cd09047996a4, user_id=19e19fadf1ce42c9a6903b062e83a681, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:24.043398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b1e9f-755c-4e98-b177-3562d33b9cca admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:24.067837 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1107/2225] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:23 2022] PUT /identity/v3/projects/4b23486512c747eb8056cd09047996a4/users/19e19fadf1ce42c9a6903b062e83a681/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:24.072956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4da96-ffc4-45d6-9d99-3c107c60d8b5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.073245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4da96-ffc4-45d6-9d99-3c107c60d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.073790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4da96-ffc4-45d6-9d99-3c107c60d8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.118027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae194-4699-4fae-bdee-cf85f1afbd59 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:24.126505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b2e4da96-ffc4-45d6-9d99-3c107c60d8b5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:24.130163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b2e4da96-ffc4-45d6-9d99-3c107c60d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:24.232389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826059b-53f8-46ea-8be4-e2405faaf2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:24.234074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826059b-53f8-46ea-8be4-e2405faaf2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.234493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826059b-53f8-46ea-8be4-e2405faaf2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.234954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826059b-53f8-46ea-8be4-e2405faaf2b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.236093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826059b-53f8-46ea-8be4-e2405faaf2b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:24.239464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826059b-53f8-46ea-8be4-e2405faaf2b1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:24.274022 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1119/2226] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:23 2022] POST /identity/v3/users => generated 297 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:24.275839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a9136-22a6-4439-8d0e-cb72f93b7b8b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.276585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a9136-22a6-4439-8d0e-cb72f93b7b8b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.277019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a9136-22a6-4439-8d0e-cb72f93b7b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.282423 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1108/2227] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:24.283391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4da96-ffc4-45d6-9d99-3c107c60d8b5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:24.316633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4da96-ffc4-45d6-9d99-3c107c60d8b5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:24.327034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c76a9136-22a6-4439-8d0e-cb72f93b7b8b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:24.328519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c76a9136-22a6-4439-8d0e-cb72f93b7b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:24.330435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3e460-fa08-4e19-906a-94c94f16b658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:24.331112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e460-fa08-4e19-906a-94c94f16b658 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.331400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e460-fa08-4e19-906a-94c94f16b658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.331676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e460-fa08-4e19-906a-94c94f16b658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.332449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3e460-fa08-4e19-906a-94c94f16b658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:24.338465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3e460-fa08-4e19-906a-94c94f16b658 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:24.344438 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1120/2228] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:24.345202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a9136-22a6-4439-8d0e-cb72f93b7b8b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:24.356791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1109/2229] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:24.356791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065fe3-6fed-4a9f-84cc-9a9d013348a2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.356791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065fe3-6fed-4a9f-84cc-9a9d013348a2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.357072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065fe3-6fed-4a9f-84cc-9a9d013348a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.360862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a9136-22a6-4439-8d0e-cb72f93b7b8b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:24.366845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad91fd-2758-4bd4-acd6-a833d701132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:24.367463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad91fd-2758-4bd4-acd6-a833d701132f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.367745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad91fd-2758-4bd4-acd6-a833d701132f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.368015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad91fd-2758-4bd4-acd6-a833d701132f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.369337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad91fd-2758-4bd4-acd6-a833d701132f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:24.370337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad91fd-2758-4bd4-acd6-a833d701132f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:24.388963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8e065fe3-6fed-4a9f-84cc-9a9d013348a2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:24.391710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8e065fe3-6fed-4a9f-84cc-9a9d013348a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:24.401249 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1110/2230] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:24.409997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e065fe3-6fed-4a9f-84cc-9a9d013348a2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:24.411307 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1121/2231] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:24.412428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad91fd-2758-4bd4-acd6-a833d701132f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:24.415116 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:24.426661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e065fe3-6fed-4a9f-84cc-9a9d013348a2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:24.432325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc5cd4-c792-4b6d-88be-decfd88e782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:24.432954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc5cd4-c792-4b6d-88be-decfd88e782c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.433240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc5cd4-c792-4b6d-88be-decfd88e782c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.433514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc5cd4-c792-4b6d-88be-decfd88e782c admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.434425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc5cd4-c792-4b6d-88be-decfd88e782c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:24.434542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc5cd4-c792-4b6d-88be-decfd88e782c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:24.437212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc5cd4-c792-4b6d-88be-decfd88e782c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:24.439311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad91fd-2758-4bd4-acd6-a833d701132f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:24.445609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c568075-99b4-4401-b62a-0864aaaaf953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:24.446631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c568075-99b4-4401-b62a-0864aaaaf953 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.447100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c568075-99b4-4401-b62a-0864aaaaf953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.448261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c568075-99b4-4401-b62a-0864aaaaf953 admin admin] PATH_INFO: `/v3/projects/4b23486512c747eb8056cd09047996a4/users/19e19fadf1ce42c9a6903b062e83a681/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.452416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c568075-99b4-4401-b62a-0864aaaaf953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b23486512c747eb8056cd09047996a4, user_id=19e19fadf1ce42c9a6903b062e83a681, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:24.456793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c568075-99b4-4401-b62a-0864aaaaf953 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:24.460715 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1111/2232] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:24.461849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc5cd4-c792-4b6d-88be-decfd88e782c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:24.491284 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1122/2233] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:24 2022] PUT /identity/v3/projects/4b23486512c747eb8056cd09047996a4/users/19e19fadf1ce42c9a6903b062e83a681/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:24.492557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c568075-99b4-4401-b62a-0864aaaaf953 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:24.494852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc5cd4-c792-4b6d-88be-decfd88e782c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:24.620631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00372e-660c-4bc0-b7c2-69e69a3d8a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:24.620631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00372e-660c-4bc0-b7c2-69e69a3d8a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.620631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00372e-660c-4bc0-b7c2-69e69a3d8a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.620631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00372e-660c-4bc0-b7c2-69e69a3d8a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.621057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00372e-660c-4bc0-b7c2-69e69a3d8a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:24.621057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00372e-660c-4bc0-b7c2-69e69a3d8a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:24.622007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00372e-660c-4bc0-b7c2-69e69a3d8a39 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:24.642524 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1112/2234] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:24.643596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00372e-660c-4bc0-b7c2-69e69a3d8a39 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:24.644469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c568075-99b4-4401-b62a-0864aaaaf953 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:24.655018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88f210-ba16-46db-953d-7e04956f83b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:24.656700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88f210-ba16-46db-953d-7e04956f83b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.657354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88f210-ba16-46db-953d-7e04956f83b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.658093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88f210-ba16-46db-953d-7e04956f83b2 admin admin] PATH_INFO: `/v3/projects/089a714eb84b4730bd7b012e1cf22d74/users/b6a6cc8512c14be7be41eb4814cd3448/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.660495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00372e-660c-4bc0-b7c2-69e69a3d8a39 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:24.669246 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:24.670263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdbd4d-42ad-48b3-9dde-fc828b1d03b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:24.672069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdbd4d-42ad-48b3-9dde-fc828b1d03b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.672986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdbd4d-42ad-48b3-9dde-fc828b1d03b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.673279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdbd4d-42ad-48b3-9dde-fc828b1d03b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.674937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdbd4d-42ad-48b3-9dde-fc828b1d03b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:24.681555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdbd4d-42ad-48b3-9dde-fc828b1d03b4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:24.683070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88f210-ba16-46db-953d-7e04956f83b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=089a714eb84b4730bd7b012e1cf22d74, user_id=b6a6cc8512c14be7be41eb4814cd3448, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:24.688371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88f210-ba16-46db-953d-7e04956f83b2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:24.721135 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1123/2235] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:24 2022] PUT /identity/v3/projects/089a714eb84b4730bd7b012e1cf22d74/users/b6a6cc8512c14be7be41eb4814cd3448/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:24.729743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0fb76-fb18-440c-9da4-30850c7ef596 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.729743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0fb76-fb18-440c-9da4-30850c7ef596 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.729743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0fb76-fb18-440c-9da4-30850c7ef596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.732398 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1113/2236] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:24 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:24.734053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdbd4d-42ad-48b3-9dde-fc828b1d03b4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:24.778937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-98c0fb76-fb18-440c-9da4-30850c7ef596 None None] MFA Rules not processed for user `19e19fadf1ce42c9a6903b062e83a681`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:24.781530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-98c0fb76-fb18-440c-9da4-30850c7ef596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:24.826520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdbd4d-42ad-48b3-9dde-fc828b1d03b4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:24.838917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afe6f0-ef1c-40f2-8165-6f765ad87ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:24.841250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afe6f0-ef1c-40f2-8165-6f765ad87ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:24.842301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afe6f0-ef1c-40f2-8165-6f765ad87ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:24.842683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afe6f0-ef1c-40f2-8165-6f765ad87ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:24.844480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afe6f0-ef1c-40f2-8165-6f765ad87ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:24.851030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afe6f0-ef1c-40f2-8165-6f765ad87ce9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:24.900947 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1124/2237] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:24.902345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0fb76-fb18-440c-9da4-30850c7ef596 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:24.912750 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1114/2238] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:24 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:24.912750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afe6f0-ef1c-40f2-8165-6f765ad87ce9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:24.918015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0fb76-fb18-440c-9da4-30850c7ef596 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.033925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde2473-6c2c-4cdd-9930-2fcc3685e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.035827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2473-6c2c-4cdd-9930-2fcc3685e9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.036609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2473-6c2c-4cdd-9930-2fcc3685e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.037122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2473-6c2c-4cdd-9930-2fcc3685e9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.038227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde2473-6c2c-4cdd-9930-2fcc3685e9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.040367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde2473-6c2c-4cdd-9930-2fcc3685e9e9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.047208 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:25.058812 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1125/2239] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:25.060215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde2473-6c2c-4cdd-9930-2fcc3685e9e9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:25.064509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4bde2473-6c2c-4cdd-9930-2fcc3685e9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:25.086560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afe6f0-ef1c-40f2-8165-6f765ad87ce9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.094089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7069a-6829-4221-8f8d-0b972e313265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.095016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7069a-6829-4221-8f8d-0b972e313265 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.095445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7069a-6829-4221-8f8d-0b972e313265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.095868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7069a-6829-4221-8f8d-0b972e313265 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.096681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7069a-6829-4221-8f8d-0b972e313265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.099814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7069a-6829-4221-8f8d-0b972e313265 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.141777 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1115/2240] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:24 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:25.143844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7069a-6829-4221-8f8d-0b972e313265 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:25.168162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7069a-6829-4221-8f8d-0b972e313265 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.177329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a66c1e-6653-4769-af5c-6942aa75efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.177985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a66c1e-6653-4769-af5c-6942aa75efb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.178282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a66c1e-6653-4769-af5c-6942aa75efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.178609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a66c1e-6653-4769-af5c-6942aa75efb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.181179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a66c1e-6653-4769-af5c-6942aa75efb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.185291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a66c1e-6653-4769-af5c-6942aa75efb4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.195366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde2473-6c2c-4cdd-9930-2fcc3685e9e9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.205578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a99816-190d-450b-b525-9cfec3fd2fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.207724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99816-190d-450b-b525-9cfec3fd2fdd service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.208603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99816-190d-450b-b525-9cfec3fd2fdd service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.209428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99816-190d-450b-b525-9cfec3fd2fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.213502 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1116/2241] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:25 2022] POST /identity/v3/users => generated 297 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:25.214476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a66c1e-6653-4769-af5c-6942aa75efb4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:25.216794 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:25.226733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a66c1e-6653-4769-af5c-6942aa75efb4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.240813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe27c-36a4-4c6f-9c6d-3c17e1c058ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.241808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe27c-36a4-4c6f-9c6d-3c17e1c058ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.243004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe27c-36a4-4c6f-9c6d-3c17e1c058ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.243299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe27c-36a4-4c6f-9c6d-3c17e1c058ac admin admin] PATH_INFO: `/v3/projects/089a714eb84b4730bd7b012e1cf22d74/users/b6a6cc8512c14be7be41eb4814cd3448/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.249293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fe27c-36a4-4c6f-9c6d-3c17e1c058ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=089a714eb84b4730bd7b012e1cf22d74, user_id=b6a6cc8512c14be7be41eb4814cd3448, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.256771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fe27c-36a4-4c6f-9c6d-3c17e1c058ac admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.301008 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1117/2242] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:25 2022] PUT /identity/v3/projects/089a714eb84b4730bd7b012e1cf22d74/users/b6a6cc8512c14be7be41eb4814cd3448/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:25.301008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe27c-36a4-4c6f-9c6d-3c17e1c058ac admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:25.365563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a99816-190d-450b-b525-9cfec3fd2fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.368005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a99816-190d-450b-b525-9cfec3fd2fdd service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.383622 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1126/2243] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:25.386045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a99816-190d-450b-b525-9cfec3fd2fdd service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:25.402701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a99816-190d-450b-b525-9cfec3fd2fdd service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.418538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe27c-36a4-4c6f-9c6d-3c17e1c058ac admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.427098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4408b10-bd5e-4b43-9926-f89401e65f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.428202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4408b10-bd5e-4b43-9926-f89401e65f9a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.428619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4408b10-bd5e-4b43-9926-f89401e65f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.429048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4408b10-bd5e-4b43-9926-f89401e65f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.429948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4408b10-bd5e-4b43-9926-f89401e65f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.432292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4408b10-bd5e-4b43-9926-f89401e65f9a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.475303 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1118/2244] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:25.479127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fb706-22a1-4384-bc85-a447547efe32 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.479422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fb706-22a1-4384-bc85-a447547efe32 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.479701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fb706-22a1-4384-bc85-a447547efe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.535188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30685c-bc1d-4eab-9840-7e9e42661420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.535922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30685c-bc1d-4eab-9840-7e9e42661420 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.536294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30685c-bc1d-4eab-9840-7e9e42661420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.540858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30685c-bc1d-4eab-9840-7e9e42661420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.542088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30685c-bc1d-4eab-9840-7e9e42661420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.546372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f57fb706-22a1-4384-bc85-a447547efe32 None None] MFA Rules not processed for user `b6a6cc8512c14be7be41eb4814cd3448`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:25.547490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30685c-bc1d-4eab-9840-7e9e42661420 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.549364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f57fb706-22a1-4384-bc85-a447547efe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:25.580320 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1127/2245] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:25.581530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30685c-bc1d-4eab-9840-7e9e42661420 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:25.600155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30685c-bc1d-4eab-9840-7e9e42661420 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.607761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ea563-9ad6-4b94-97a6-827e9d55e53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.609758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ea563-9ad6-4b94-97a6-827e9d55e53e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.610048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ea563-9ad6-4b94-97a6-827e9d55e53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.610324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ea563-9ad6-4b94-97a6-827e9d55e53e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.611951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ea563-9ad6-4b94-97a6-827e9d55e53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.613583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ea563-9ad6-4b94-97a6-827e9d55e53e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.635449 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1128/2246] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:25.635449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ea563-9ad6-4b94-97a6-827e9d55e53e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:25.662560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ea563-9ad6-4b94-97a6-827e9d55e53e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.672309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b29928-5e37-47c7-a7d2-1179b97c8673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.672734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b29928-5e37-47c7-a7d2-1179b97c8673 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.673017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b29928-5e37-47c7-a7d2-1179b97c8673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.673366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b29928-5e37-47c7-a7d2-1179b97c8673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.674024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b29928-5e37-47c7-a7d2-1179b97c8673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.675689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b29928-5e37-47c7-a7d2-1179b97c8673 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.688638 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1129/2247] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:25.690127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b29928-5e37-47c7-a7d2-1179b97c8673 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:25.697150 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1119/2248] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:25.697150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fb706-22a1-4384-bc85-a447547efe32 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:25.704632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b29928-5e37-47c7-a7d2-1179b97c8673 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.711153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2822ef9-4682-4a34-984a-6c3f79ef8f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.712225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2822ef9-4682-4a34-984a-6c3f79ef8f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.712660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2822ef9-4682-4a34-984a-6c3f79ef8f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.713375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2822ef9-4682-4a34-984a-6c3f79ef8f41 admin admin] PATH_INFO: `/v3/projects/ffe656702bb24b6a9b459ff1b19a0d8c/users/6da1976f703f402788953f3332a281de/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.722838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fb706-22a1-4384-bc85-a447547efe32 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:25.730462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d229aa-d161-418e-bb3f-b859b309fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:25.731332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d229aa-d161-418e-bb3f-b859b309fdaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.733517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d229aa-d161-418e-bb3f-b859b309fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.734299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d229aa-d161-418e-bb3f-b859b309fdaa admin admin] PATH_INFO: `/v3/projects/6607b8bcaa24471c9e46646a05f63b02/users/a764702c84aa4c6c96efb18eb4708cb2/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.756658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2822ef9-4682-4a34-984a-6c3f79ef8f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe656702bb24b6a9b459ff1b19a0d8c, user_id=6da1976f703f402788953f3332a281de, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.762036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2822ef9-4682-4a34-984a-6c3f79ef8f41 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.770624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d229aa-d161-418e-bb3f-b859b309fdaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6607b8bcaa24471c9e46646a05f63b02, user_id=a764702c84aa4c6c96efb18eb4708cb2, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:25.773704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d229aa-d161-418e-bb3f-b859b309fdaa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:25.788693 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1120/2249] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:25 2022] PUT /identity/v3/projects/6607b8bcaa24471c9e46646a05f63b02/users/a764702c84aa4c6c96efb18eb4708cb2/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:25.794528 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1130/2250] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:25 2022] PUT /identity/v3/projects/ffe656702bb24b6a9b459ff1b19a0d8c/users/6da1976f703f402788953f3332a281de/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:25.810172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baa9b0-9d07-4a3e-bf11-aa901d3c7455 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.810309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914151a-972d-40d0-b897-3119497e0759 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:25.810461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baa9b0-9d07-4a3e-bf11-aa901d3c7455 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.810592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914151a-972d-40d0-b897-3119497e0759 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:25.810784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914151a-972d-40d0-b897-3119497e0759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.818902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baa9b0-9d07-4a3e-bf11-aa901d3c7455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:25.831072 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:25.863834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e0baa9b0-9d07-4a3e-bf11-aa901d3c7455 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:25.866842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0baa9b0-9d07-4a3e-bf11-aa901d3c7455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:25.904882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9914151a-972d-40d0-b897-3119497e0759 None None] MFA Rules not processed for user `a764702c84aa4c6c96efb18eb4708cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:25.906324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9914151a-972d-40d0-b897-3119497e0759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:26.040257 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:26.057780 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1121/2251] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:26.058778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baa9b0-9d07-4a3e-bf11-aa901d3c7455 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:26.061930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0baa9b0-9d07-4a3e-bf11-aa901d3c7455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:26.086372 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1131/2252] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:26.087517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914151a-972d-40d0-b897-3119497e0759 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:26.104317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914151a-972d-40d0-b897-3119497e0759 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:26.113035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716c3f-8d50-4364-96fe-0771541db213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:26.113755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716c3f-8d50-4364-96fe-0771541db213 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:26.114420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716c3f-8d50-4364-96fe-0771541db213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:26.114847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716c3f-8d50-4364-96fe-0771541db213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:26.115562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7716c3f-8d50-4364-96fe-0771541db213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:26.117659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7716c3f-8d50-4364-96fe-0771541db213 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:26.163418 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1132/2253] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:26 2022] POST /identity/v3/projects => generated 393 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:26.165210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716c3f-8d50-4364-96fe-0771541db213 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:26.169333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b7716c3f-8d50-4364-96fe-0771541db213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:26.180923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baa9b0-9d07-4a3e-bf11-aa901d3c7455 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:26.308983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716c3f-8d50-4364-96fe-0771541db213 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:26.319174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667e1dd-d303-4a4a-bc38-5778cdfa89bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:26.319809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667e1dd-d303-4a4a-bc38-5778cdfa89bd service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:26.320151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667e1dd-d303-4a4a-bc38-5778cdfa89bd service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:26.320260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d577-7dbf-46c2-8461-cb030c88a3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:26.320487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667e1dd-d303-4a4a-bc38-5778cdfa89bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:26.320760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d577-7dbf-46c2-8461-cb030c88a3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:26.321038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d577-7dbf-46c2-8461-cb030c88a3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:26.321308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d577-7dbf-46c2-8461-cb030c88a3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:26.447379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304d577-7dbf-46c2-8461-cb030c88a3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:26.455672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304d577-7dbf-46c2-8461-cb030c88a3e5 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:26.456559 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:26.469917 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1133/2254] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:26.470793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d577-7dbf-46c2-8461-cb030c88a3e5 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:26.484232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d577-7dbf-46c2-8461-cb030c88a3e5 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:26.491293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82332cd2-a643-4558-8d5f-ea685c2704aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:26.492176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82332cd2-a643-4558-8d5f-ea685c2704aa admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:26.492458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82332cd2-a643-4558-8d5f-ea685c2704aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:26.492728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82332cd2-a643-4558-8d5f-ea685c2704aa admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:26.493484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82332cd2-a643-4558-8d5f-ea685c2704aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:26.495995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82332cd2-a643-4558-8d5f-ea685c2704aa admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:26.528439 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1134/2255] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:26 2022] POST /identity/v3/users => generated 303 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:26.533628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667e1dd-d303-4a4a-bc38-5778cdfa89bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:26.535290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82332cd2-a643-4558-8d5f-ea685c2704aa admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:26.536031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667e1dd-d303-4a4a-bc38-5778cdfa89bd service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:26.552819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82332cd2-a643-4558-8d5f-ea685c2704aa admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:26.554127 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1122/2256] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:26.574464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dadf3d-9fa4-4542-902f-b6e568218b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:26.575353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dadf3d-9fa4-4542-902f-b6e568218b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:26.575544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dadf3d-9fa4-4542-902f-b6e568218b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:26.575818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dadf3d-9fa4-4542-902f-b6e568218b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:26.581346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dadf3d-9fa4-4542-902f-b6e568218b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:26.590863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dadf3d-9fa4-4542-902f-b6e568218b64 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:26.607626 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1135/2257] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:26.612814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667e1dd-d303-4a4a-bc38-5778cdfa89bd service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:26.626513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667e1dd-d303-4a4a-bc38-5778cdfa89bd service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:26.633160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5d4d0-be21-4747-9509-e44ea25f94a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:26.634521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5d4d0-be21-4747-9509-e44ea25f94a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:26.635011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5d4d0-be21-4747-9509-e44ea25f94a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:26.635432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5d4d0-be21-4747-9509-e44ea25f94a7 admin admin] PATH_INFO: `/v3/projects/9210ae54a655486cba42c67014703646/users/a3e3eca4ccb940cdb3152cf8b3174ff0/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:26.653948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5d4d0-be21-4747-9509-e44ea25f94a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9210ae54a655486cba42c67014703646, user_id=a3e3eca4ccb940cdb3152cf8b3174ff0, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:26.657897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5d4d0-be21-4747-9509-e44ea25f94a7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:26.682203 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1123/2258] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:26 2022] PUT /identity/v3/projects/9210ae54a655486cba42c67014703646/users/a3e3eca4ccb940cdb3152cf8b3174ff0/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:26.686343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dadf3d-9fa4-4542-902f-b6e568218b64 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:26.705796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dadf3d-9fa4-4542-902f-b6e568218b64 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:26.862780 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:26.914780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939dc1f-30b7-4169-b244-50cce14ae9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:26.915693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939dc1f-30b7-4169-b244-50cce14ae9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:26.916163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939dc1f-30b7-4169-b244-50cce14ae9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:26.916580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939dc1f-30b7-4169-b244-50cce14ae9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:26.918146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939dc1f-30b7-4169-b244-50cce14ae9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:26.920197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939dc1f-30b7-4169-b244-50cce14ae9b0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:26.950174 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1136/2259] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:26.951275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5d4d0-be21-4747-9509-e44ea25f94a7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:26.977763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5d4d0-be21-4747-9509-e44ea25f94a7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:26.990565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a31ef-9137-4960-8085-aee347c5b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:26.991269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a31ef-9137-4960-8085-aee347c5b2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:26.991549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a31ef-9137-4960-8085-aee347c5b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:26.991810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a31ef-9137-4960-8085-aee347c5b2b1 admin admin] PATH_INFO: `/v3/projects/9210ae54a655486cba42c67014703646/users/a3e3eca4ccb940cdb3152cf8b3174ff0/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:26.996501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a31ef-9137-4960-8085-aee347c5b2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9210ae54a655486cba42c67014703646, user_id=a3e3eca4ccb940cdb3152cf8b3174ff0, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:27.000096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a31ef-9137-4960-8085-aee347c5b2b1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:27.039887 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1124/2260] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:26 2022] PUT /identity/v3/projects/9210ae54a655486cba42c67014703646/users/a3e3eca4ccb940cdb3152cf8b3174ff0/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:27.046483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de90729-b086-443d-a81b-d5a595fa8e30 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:27.046892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de90729-b086-443d-a81b-d5a595fa8e30 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:27.047124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de90729-b086-443d-a81b-d5a595fa8e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:27.109399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a31ef-9137-4960-8085-aee347c5b2b1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:27.123195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4de90729-b086-443d-a81b-d5a595fa8e30 None None] MFA Rules not processed for user `a3e3eca4ccb940cdb3152cf8b3174ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:27.127704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4de90729-b086-443d-a81b-d5a595fa8e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:27.271348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a31ef-9137-4960-8085-aee347c5b2b1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:27.277649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:27.278516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:27.278844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:27.279119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] PATH_INFO: `/v3/users/85df35ef26914607834c5353899750ea` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:27.280515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85df35ef26914607834c5353899750ea)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:27.282828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:27.353591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85df35ef26914607834c5353899750ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:27.368289 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1137/2261] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:27.380864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85df35ef26914607834c5353899750ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:27.381627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85df35ef26914607834c5353899750ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:27.391326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85df35ef26914607834c5353899750ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:27.401391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85df35ef26914607834c5353899750ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:27.414766 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1125/2262] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:27 2022] DELETE /identity/v3/users/85df35ef26914607834c5353899750ea => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:27.419079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330d06-d1bf-4583-b6a6-72157d48d3af None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:27.419366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330d06-d1bf-4583-b6a6-72157d48d3af None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:27.419647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330d06-d1bf-4583-b6a6-72157d48d3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:27.471921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-69330d06-d1bf-4583-b6a6-72157d48d3af None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:27.475904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-69330d06-d1bf-4583-b6a6-72157d48d3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:27.565736 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1138/2263] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:27.577842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:27.579324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:27.619377 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:27.676464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330d06-d1bf-4583-b6a6-72157d48d3af None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:27.678764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-69330d06-d1bf-4583-b6a6-72157d48d3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:27.698134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330d06-d1bf-4583-b6a6-72157d48d3af None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:27.706788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:27.707586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:27.708114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:27.708558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] PATH_INFO: `/v3/users/a764702c84aa4c6c96efb18eb4708cb2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:27.710586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a764702c84aa4c6c96efb18eb4708cb2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:27.715386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:27.725027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc4950-426d-4e9d-90fa-9b4bedba7476 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:27.735609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf474060-222d-483c-a430-1d8a43d44cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:27.736253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf474060-222d-483c-a430-1d8a43d44cca service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:27.736537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf474060-222d-483c-a430-1d8a43d44cca service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:27.736853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf474060-222d-483c-a430-1d8a43d44cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:27.751721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf474060-222d-483c-a430-1d8a43d44cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:27.753711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf474060-222d-483c-a430-1d8a43d44cca service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:27.770539 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1126/2264] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:01:27.794558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a764702c84aa4c6c96efb18eb4708cb2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:27.806665 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:27.818902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a764702c84aa4c6c96efb18eb4708cb2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:27.819690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a764702c84aa4c6c96efb18eb4708cb2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:27.830940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a764702c84aa4c6c96efb18eb4708cb2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:27.832177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a764702c84aa4c6c96efb18eb4708cb2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:27.857116 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1139/2265] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:27 2022] DELETE /identity/v3/users/a764702c84aa4c6c96efb18eb4708cb2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:27.864464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe3b3f-f277-46b2-978b-76161957e8c4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:27.866177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe3b3f-f277-46b2-978b-76161957e8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:27.866694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe3b3f-f277-46b2-978b-76161957e8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:27.902054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-aefe3b3f-f277-46b2-978b-76161957e8c4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:27.903935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aefe3b3f-f277-46b2-978b-76161957e8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:28.006107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:28.008475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:28.050956 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1127/2266] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:28.061959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe3b3f-f277-46b2-978b-76161957e8c4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:28.063364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aefe3b3f-f277-46b2-978b-76161957e8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:28.113483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11578085-0d83-4083-8372-ba1c638de625 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:28.124523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e212a-7a19-43eb-8341-00140597d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:28.125397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e212a-7a19-43eb-8341-00140597d2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:28.125712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e212a-7a19-43eb-8341-00140597d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:28.125987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e212a-7a19-43eb-8341-00140597d2ba admin admin] PATH_INFO: `/v3/users/08fcf70237244474b32f904af76a4e96` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:28.128286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e212a-7a19-43eb-8341-00140597d2ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=08fcf70237244474b32f904af76a4e96)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:28.130557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e212a-7a19-43eb-8341-00140597d2ba admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:28.138378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe3b3f-f277-46b2-978b-76161957e8c4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:28.142938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d798d-ed55-4e8e-ac02-c84acc3a01a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:28.143557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d798d-ed55-4e8e-ac02-c84acc3a01a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:28.143834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d798d-ed55-4e8e-ac02-c84acc3a01a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:28.144104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d798d-ed55-4e8e-ac02-c84acc3a01a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:28.154487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d798d-ed55-4e8e-ac02-c84acc3a01a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:28.156937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d798d-ed55-4e8e-ac02-c84acc3a01a5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:28.167907 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1128/2267] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:01:28.168827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d798d-ed55-4e8e-ac02-c84acc3a01a5 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:28.170169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e32d798d-ed55-4e8e-ac02-c84acc3a01a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:28.183463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d798d-ed55-4e8e-ac02-c84acc3a01a5 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:28.188913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:28.189671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:28.190000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:28.190280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] PATH_INFO: `/v3/projects/ff4b7bbc5d074b34b5f1c3c88d0a01fb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:28.191564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4b7bbc5d074b34b5f1c3c88d0a01fb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:28.193467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:28.197807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e20e212a-7a19-43eb-8341-00140597d2ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08fcf70237244474b32f904af76a4e96'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.225956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e20e212a-7a19-43eb-8341-00140597d2ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08fcf70237244474b32f904af76a4e96'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.227641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e20e212a-7a19-43eb-8341-00140597d2ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08fcf70237244474b32f904af76a4e96'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.242086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e20e212a-7a19-43eb-8341-00140597d2ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08fcf70237244474b32f904af76a4e96'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.244831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e20e212a-7a19-43eb-8341-00140597d2ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08fcf70237244474b32f904af76a4e96'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.254501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4b7bbc5d074b34b5f1c3c88d0a01fb', 'request_id': 'req-dda201dd-8294-446e-92ff-3809ffdfbf6a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.262353 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:28.266495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4b7bbc5d074b34b5f1c3c88d0a01fb', 'request_id': 'req-dda201dd-8294-446e-92ff-3809ffdfbf6a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.276746 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1140/2268] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:28 2022] DELETE /identity/v3/users/08fcf70237244474b32f904af76a4e96 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:28.277883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4b7bbc5d074b34b5f1c3c88d0a01fb', 'request_id': 'req-dda201dd-8294-446e-92ff-3809ffdfbf6a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.282143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b6f1b-01f6-4917-a27a-3285900d971b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:28.282946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b6f1b-01f6-4917-a27a-3285900d971b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:28.284319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b6f1b-01f6-4917-a27a-3285900d971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:28.297531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] The token cache is being invalidate because project ff4b7bbc5d074b34b5f1c3c88d0a01fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:28.297531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.298428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.300658 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1129/2269] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:28 2022] DELETE /identity/v3/projects/ff4b7bbc5d074b34b5f1c3c88d0a01fb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:28.305160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:28.306970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:28.311093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e84b6f1b-01f6-4917-a27a-3285900d971b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:28.312819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e84b6f1b-01f6-4917-a27a-3285900d971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:28.398943 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:28.432164 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1141/2270] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:28.450340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b6f1b-01f6-4917-a27a-3285900d971b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:28.453130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda201dd-8294-446e-92ff-3809ffdfbf6a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:28.453337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e84b6f1b-01f6-4917-a27a-3285900d971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:28.460166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7953116-72a3-461e-a0f1-dc709ede8f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:28.461561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7953116-72a3-461e-a0f1-dc709ede8f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:28.462075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7953116-72a3-461e-a0f1-dc709ede8f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:28.462550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7953116-72a3-461e-a0f1-dc709ede8f0a admin admin] PATH_INFO: `/v3/users/19e19fadf1ce42c9a6903b062e83a681` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:28.464500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7953116-72a3-461e-a0f1-dc709ede8f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e19fadf1ce42c9a6903b062e83a681)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:28.468027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7953116-72a3-461e-a0f1-dc709ede8f0a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:28.553425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b6f1b-01f6-4917-a27a-3285900d971b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:28.559325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b6e02-8416-4fca-b6e3-5617dab3bb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:28.560336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b6e02-8416-4fca-b6e3-5617dab3bb14 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:28.560763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b6e02-8416-4fca-b6e3-5617dab3bb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:28.561977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b6e02-8416-4fca-b6e3-5617dab3bb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:28.573934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b6e02-8416-4fca-b6e3-5617dab3bb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:28.575847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b6e02-8416-4fca-b6e3-5617dab3bb14 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:28.577658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f7953116-72a3-461e-a0f1-dc709ede8f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e19fadf1ce42c9a6903b062e83a681'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.590044 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1142/2271] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:28.591776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3431-ad77-4fdd-ba3d-b8c7990b47d0 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:28.592378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3431-ad77-4fdd-ba3d-b8c7990b47d0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:28.593059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3431-ad77-4fdd-ba3d-b8c7990b47d0 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:28.596919 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1143/2272] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 01:01:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:01:28.599053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a3431-ad77-4fdd-ba3d-b8c7990b47d0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:28.601335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-875a3431-ad77-4fdd-ba3d-b8c7990b47d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:28.607572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f7953116-72a3-461e-a0f1-dc709ede8f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e19fadf1ce42c9a6903b062e83a681'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.609199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f7953116-72a3-461e-a0f1-dc709ede8f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e19fadf1ce42c9a6903b062e83a681'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.624625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f7953116-72a3-461e-a0f1-dc709ede8f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e19fadf1ce42c9a6903b062e83a681'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.624778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a3431-ad77-4fdd-ba3d-b8c7990b47d0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:28.631681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:28.632318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:28.632595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:28.633104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] PATH_INFO: `/v3/projects/6607b8bcaa24471c9e46646a05f63b02` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:28.635036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6607b8bcaa24471c9e46646a05f63b02)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:28.637195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:28.640912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f7953116-72a3-461e-a0f1-dc709ede8f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e19fadf1ce42c9a6903b062e83a681'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.666706 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1130/2273] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:28 2022] DELETE /identity/v3/users/19e19fadf1ce42c9a6903b062e83a681 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:28.670170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152cd54-0530-44dc-b41c-4d3a37b626e4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:28.670514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152cd54-0530-44dc-b41c-4d3a37b626e4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:28.672674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152cd54-0530-44dc-b41c-4d3a37b626e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:28.724588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d152cd54-0530-44dc-b41c-4d3a37b626e4 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:28.727199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d152cd54-0530-44dc-b41c-4d3a37b626e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:28.750357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6607b8bcaa24471c9e46646a05f63b02', 'request_id': 'req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.764850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6607b8bcaa24471c9e46646a05f63b02', 'request_id': 'req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.775781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6607b8bcaa24471c9e46646a05f63b02', 'request_id': 'req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.806496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] The token cache is being invalidate because project 6607b8bcaa24471c9e46646a05f63b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:28.806496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.807859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:28.813630 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1144/2274] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:28 2022] DELETE /identity/v3/projects/6607b8bcaa24471c9e46646a05f63b02 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:28.816276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:28.818981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:28.855903 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:28.873907 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1131/2275] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:28.929331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152cd54-0530-44dc-b41c-4d3a37b626e4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:28.931844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d152cd54-0530-44dc-b41c-4d3a37b626e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:28.959052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152cd54-0530-44dc-b41c-4d3a37b626e4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:28.971171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a1948-c9c4-4585-8e97-de05d588e9e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:28.971806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a1948-c9c4-4585-8e97-de05d588e9e7 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:28.972088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a1948-c9c4-4585-8e97-de05d588e9e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:28.972363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a1948-c9c4-4585-8e97-de05d588e9e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:28.975632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23446c-e8d0-4eb4-9486-b2e821d62b5c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:28.999304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:29.000754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:29.001101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:29.004040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] PATH_INFO: `/v3/users/a3e3eca4ccb940cdb3152cf8b3174ff0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:29.004870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a1948-c9c4-4585-8e97-de05d588e9e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:29.005959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e3eca4ccb940cdb3152cf8b3174ff0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:29.010995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a1948-c9c4-4585-8e97-de05d588e9e7 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:29.011965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:29.041626 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1132/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:01:29.057391 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:29.115370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e3eca4ccb940cdb3152cf8b3174ff0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.136931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e3eca4ccb940cdb3152cf8b3174ff0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.138236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e3eca4ccb940cdb3152cf8b3174ff0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.149439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e3eca4ccb940cdb3152cf8b3174ff0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.150282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e3eca4ccb940cdb3152cf8b3174ff0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:29.180259 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1145/2277] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:28 2022] DELETE /identity/v3/users/a3e3eca4ccb940cdb3152cf8b3174ff0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:29.678321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a1948-c9c4-4585-8e97-de05d588e9e7 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:29.680529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-916a1948-c9c4-4585-8e97-de05d588e9e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:29.698929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a1948-c9c4-4585-8e97-de05d588e9e7 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:29.876562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:29.877616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:29.878100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:29.879236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] PATH_INFO: `/v3/projects/06355d5cf4f64541a8e33af5361bc573` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:29.882254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06355d5cf4f64541a8e33af5361bc573)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:29.886371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.054043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06355d5cf4f64541a8e33af5361bc573', 'request_id': 'req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.063517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06355d5cf4f64541a8e33af5361bc573', 'request_id': 'req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.074693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06355d5cf4f64541a8e33af5361bc573', 'request_id': 'req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.106781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] The token cache is being invalidate because project 06355d5cf4f64541a8e33af5361bc573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:30.107654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.109186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.112638 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1133/2278] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:29 2022] DELETE /identity/v3/projects/06355d5cf4f64541a8e33af5361bc573 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:30.116494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.119675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:30.145667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aba98-57c3-42f0-b658-945dcd3588fb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.240859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137be49-605f-4594-bc99-cb96036015ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:30.241517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137be49-605f-4594-bc99-cb96036015ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.248045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137be49-605f-4594-bc99-cb96036015ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.249044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137be49-605f-4594-bc99-cb96036015ed admin admin] PATH_INFO: `/v3/users/b6a6cc8512c14be7be41eb4814cd3448` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.251704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137be49-605f-4594-bc99-cb96036015ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a6cc8512c14be7be41eb4814cd3448)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:30.254477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137be49-605f-4594-bc99-cb96036015ed admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.270662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.272215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:30.298930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e9649-5689-4e54-bcb3-f5f86baba2f5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.363390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:30.363390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.363390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.363390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] PATH_INFO: `/v3/projects/4b23486512c747eb8056cd09047996a4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.364629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b23486512c747eb8056cd09047996a4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:30.366752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.449476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1137be49-605f-4594-bc99-cb96036015ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a6cc8512c14be7be41eb4814cd3448'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.462898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b23486512c747eb8056cd09047996a4', 'request_id': 'req-6463bcbf-e379-4868-8d66-c2a8eb225870'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.474941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b23486512c747eb8056cd09047996a4', 'request_id': 'req-6463bcbf-e379-4868-8d66-c2a8eb225870'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.475488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1137be49-605f-4594-bc99-cb96036015ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a6cc8512c14be7be41eb4814cd3448'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.476393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1137be49-605f-4594-bc99-cb96036015ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a6cc8512c14be7be41eb4814cd3448'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.486201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b23486512c747eb8056cd09047996a4', 'request_id': 'req-6463bcbf-e379-4868-8d66-c2a8eb225870'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.490783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1137be49-605f-4594-bc99-cb96036015ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a6cc8512c14be7be41eb4814cd3448'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.491934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1137be49-605f-4594-bc99-cb96036015ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a6cc8512c14be7be41eb4814cd3448'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.506112 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:30.513269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] The token cache is being invalidate because project 4b23486512c747eb8056cd09047996a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:30.513917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.517422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.518659 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1146/2279] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:30 2022] DELETE /identity/v3/users/b6a6cc8512c14be7be41eb4814cd3448 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:30.523551 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1134/2280] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:30 2022] DELETE /identity/v3/projects/4b23486512c747eb8056cd09047996a4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:30.527215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6644a6-dc37-4b15-b979-505e0f7a41f5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.527622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6644a6-dc37-4b15-b979-505e0f7a41f5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.528014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6644a6-dc37-4b15-b979-505e0f7a41f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.563889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1e6644a6-dc37-4b15-b979-505e0f7a41f5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:30.566126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1e6644a6-dc37-4b15-b979-505e0f7a41f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:30.596365 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:30.603232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.606217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:30.711814 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1147/2281] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:30.713384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afd604-ef81-4904-9fb3-e96c87c9636e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.713602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afd604-ef81-4904-9fb3-e96c87c9636e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.714122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afd604-ef81-4904-9fb3-e96c87c9636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.743122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463bcbf-e379-4868-8d66-c2a8eb225870 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.749454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:30.751197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.751490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.751766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] PATH_INFO: `/v3/projects/9210ae54a655486cba42c67014703646` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.753162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9210ae54a655486cba42c67014703646)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:30.756957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.758688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a9afd604-ef81-4904-9fb3-e96c87c9636e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:30.759844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a9afd604-ef81-4904-9fb3-e96c87c9636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:30.779219 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1148/2282] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:30.780427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afd604-ef81-4904-9fb3-e96c87c9636e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.800483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afd604-ef81-4904-9fb3-e96c87c9636e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.815997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205796f-daad-419d-af1d-fcf9b3bffd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:30.816616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205796f-daad-419d-af1d-fcf9b3bffd4a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.816894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205796f-daad-419d-af1d-fcf9b3bffd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.817173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205796f-daad-419d-af1d-fcf9b3bffd4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.817825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205796f-daad-419d-af1d-fcf9b3bffd4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:30.818131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205796f-daad-419d-af1d-fcf9b3bffd4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:30.819769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205796f-daad-419d-af1d-fcf9b3bffd4a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:30.830399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9210ae54a655486cba42c67014703646', 'request_id': 'req-08a4d385-c56c-4a26-a935-cbc63e3bc982'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.839459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9210ae54a655486cba42c67014703646', 'request_id': 'req-08a4d385-c56c-4a26-a935-cbc63e3bc982'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.865141 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1149/2283] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:30.866015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205796f-daad-419d-af1d-fcf9b3bffd4a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:30.876009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9210ae54a655486cba42c67014703646', 'request_id': 'req-08a4d385-c56c-4a26-a935-cbc63e3bc982'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.887331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205796f-daad-419d-af1d-fcf9b3bffd4a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:30.894564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] The token cache is being invalidate because project 9210ae54a655486cba42c67014703646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:30.895220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.897198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08a4d385-c56c-4a26-a935-cbc63e3bc982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:30.908009 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1135/2284] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:30 2022] DELETE /identity/v3/projects/9210ae54a655486cba42c67014703646 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:30.914346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc411b1a-f444-4e8e-a383-0e57fcdad9c8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:30.914660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc411b1a-f444-4e8e-a383-0e57fcdad9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:30.916396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc411b1a-f444-4e8e-a383-0e57fcdad9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:30.963009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cc411b1a-f444-4e8e-a383-0e57fcdad9c8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:30.979643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc411b1a-f444-4e8e-a383-0e57fcdad9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:31.033624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4bfb8-43e0-4598-8f44-423f61131a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:31.035464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4bfb8-43e0-4598-8f44-423f61131a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.035902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4bfb8-43e0-4598-8f44-423f61131a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.036844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4bfb8-43e0-4598-8f44-423f61131a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.038091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4bfb8-43e0-4598-8f44-423f61131a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:31.041542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4bfb8-43e0-4598-8f44-423f61131a23 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:31.080965 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1136/2285] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:31.094360 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1150/2286] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:30 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:31.095985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219c4f-8700-46b6-89d1-747177abecd7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.096346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219c4f-8700-46b6-89d1-747177abecd7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.096690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219c4f-8700-46b6-89d1-747177abecd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.099141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4bfb8-43e0-4598-8f44-423f61131a23 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:31.103919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c2f4bfb8-43e0-4598-8f44-423f61131a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:31.145591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-54219c4f-8700-46b6-89d1-747177abecd7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:31.146842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-54219c4f-8700-46b6-89d1-747177abecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:31.223250 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:31.274718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4bfb8-43e0-4598-8f44-423f61131a23 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:31.287454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b36b49-1e8b-405a-b5a2-24886e084031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:31.287729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36b49-1e8b-405a-b5a2-24886e084031 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.287947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36b49-1e8b-405a-b5a2-24886e084031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.288220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36b49-1e8b-405a-b5a2-24886e084031 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.288865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b36b49-1e8b-405a-b5a2-24886e084031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:31.290853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b36b49-1e8b-405a-b5a2-24886e084031 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:31.304341 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1137/2287] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:31.318748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54219c4f-8700-46b6-89d1-747177abecd7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:31.324206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54219c4f-8700-46b6-89d1-747177abecd7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:31.338539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e7d2-08f2-4ca1-8655-402760f4423a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:31.339273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e7d2-08f2-4ca1-8655-402760f4423a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.339550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e7d2-08f2-4ca1-8655-402760f4423a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.339833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e7d2-08f2-4ca1-8655-402760f4423a admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.340500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79e7d2-08f2-4ca1-8655-402760f4423a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:31.340806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79e7d2-08f2-4ca1-8655-402760f4423a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:31.343048 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1151/2288] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:31 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:31.344944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79e7d2-08f2-4ca1-8655-402760f4423a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:31.346831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b36b49-1e8b-405a-b5a2-24886e084031 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:31.367922 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1138/2289] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:31.371891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e7d2-08f2-4ca1-8655-402760f4423a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:31.376902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b36b49-1e8b-405a-b5a2-24886e084031 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:31.385792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e7d2-08f2-4ca1-8655-402760f4423a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:31.392275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed27b95-c273-46bb-bffb-808e643374c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:31.392924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed27b95-c273-46bb-bffb-808e643374c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.393208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed27b95-c273-46bb-bffb-808e643374c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.393487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed27b95-c273-46bb-bffb-808e643374c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.394185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed27b95-c273-46bb-bffb-808e643374c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:31.395037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f755d-b507-4178-9a7c-3cf0d3f90c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:31.395780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f755d-b507-4178-9a7c-3cf0d3f90c51 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.396131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f755d-b507-4178-9a7c-3cf0d3f90c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.396834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f755d-b507-4178-9a7c-3cf0d3f90c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.397288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f755d-b507-4178-9a7c-3cf0d3f90c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:31.398084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed27b95-c273-46bb-bffb-808e643374c2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:31.400744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f755d-b507-4178-9a7c-3cf0d3f90c51 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:31.423191 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1152/2290] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:31.425827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed27b95-c273-46bb-bffb-808e643374c2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:31.440324 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:31.468770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed27b95-c273-46bb-bffb-808e643374c2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:31.469862 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1139/2291] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:31 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:31.473295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f755d-b507-4178-9a7c-3cf0d3f90c51 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:31.627775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17d711-052a-4bd6-b321-8afa1a74890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:31.629961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17d711-052a-4bd6-b321-8afa1a74890e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.630795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17d711-052a-4bd6-b321-8afa1a74890e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.631601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17d711-052a-4bd6-b321-8afa1a74890e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.634058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17d711-052a-4bd6-b321-8afa1a74890e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:31.638904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17d711-052a-4bd6-b321-8afa1a74890e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:31.653410 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1153/2292] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:31.659778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17d711-052a-4bd6-b321-8afa1a74890e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:31.667927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f755d-b507-4178-9a7c-3cf0d3f90c51 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:31.690253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9102c-ed26-4f79-9dea-5a0685600649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:31.691926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9102c-ed26-4f79-9dea-5a0685600649 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.692177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9102c-ed26-4f79-9dea-5a0685600649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.692552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9102c-ed26-4f79-9dea-5a0685600649 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.693303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9102c-ed26-4f79-9dea-5a0685600649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:31.699329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9102c-ed26-4f79-9dea-5a0685600649 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:31.705231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17d711-052a-4bd6-b321-8afa1a74890e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:31.721450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc41fe-8ed8-403b-97e4-c7bfae5d9e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:31.722683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc41fe-8ed8-403b-97e4-c7bfae5d9e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.724836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc41fe-8ed8-403b-97e4-c7bfae5d9e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.725249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc41fe-8ed8-403b-97e4-c7bfae5d9e30 admin admin] PATH_INFO: `/v3/projects/c0e072a3f56045949210c8d4452298ce/users/739083b66f9b433889944e555b0aef23/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.761303 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1140/2293] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:31 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:31.763508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9102c-ed26-4f79-9dea-5a0685600649 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:31.768052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20c9102c-ed26-4f79-9dea-5a0685600649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:31.770833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc41fe-8ed8-403b-97e4-c7bfae5d9e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e072a3f56045949210c8d4452298ce, user_id=739083b66f9b433889944e555b0aef23, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:31.776400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc41fe-8ed8-403b-97e4-c7bfae5d9e30 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:31.785893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9102c-ed26-4f79-9dea-5a0685600649 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:31.798526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:31.799283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.799568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.799844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] PATH_INFO: `/v3/projects/089a714eb84b4730bd7b012e1cf22d74` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.801043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=089a714eb84b4730bd7b012e1cf22d74)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:31.813365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:31.813568 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1154/2294] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:31 2022] PUT /identity/v3/projects/c0e072a3f56045949210c8d4452298ce/users/739083b66f9b433889944e555b0aef23/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:31.816033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc41fe-8ed8-403b-97e4-c7bfae5d9e30 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:31.893023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '089a714eb84b4730bd7b012e1cf22d74', 'request_id': 'req-4380ba63-1451-441a-99e3-5442105bd98e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:31.902492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc41fe-8ed8-403b-97e4-c7bfae5d9e30 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:31.918638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '089a714eb84b4730bd7b012e1cf22d74', 'request_id': 'req-4380ba63-1451-441a-99e3-5442105bd98e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:31.931278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '089a714eb84b4730bd7b012e1cf22d74', 'request_id': 'req-4380ba63-1451-441a-99e3-5442105bd98e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:31.965368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] The token cache is being invalidate because project 089a714eb84b4730bd7b012e1cf22d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:31.965523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:31.966867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4380ba63-1451-441a-99e3-5442105bd98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:31.968840 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1141/2295] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:31 2022] DELETE /identity/v3/projects/089a714eb84b4730bd7b012e1cf22d74 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:31.974769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b56fe-84cf-4a63-b567-7bdb34472612 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.974769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b56fe-84cf-4a63-b567-7bdb34472612 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.974769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b56fe-84cf-4a63-b567-7bdb34472612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.992050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf00848-6283-4d2f-9603-f1b925d963c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:31.992606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf00848-6283-4d2f-9603-f1b925d963c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:31.992885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf00848-6283-4d2f-9603-f1b925d963c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:31.993157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf00848-6283-4d2f-9603-f1b925d963c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:31.993875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf00848-6283-4d2f-9603-f1b925d963c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:31.996585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf00848-6283-4d2f-9603-f1b925d963c9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:32.019449 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1155/2296] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:32.019449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762e8b2-01f9-4e86-8c44-685a4007a17e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.019745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762e8b2-01f9-4e86-8c44-685a4007a17e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.019837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762e8b2-01f9-4e86-8c44-685a4007a17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.022250 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:32.038029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea3b56fe-84cf-4a63-b567-7bdb34472612 None None] MFA Rules not processed for user `739083b66f9b433889944e555b0aef23`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:32.039721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea3b56fe-84cf-4a63-b567-7bdb34472612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:32.056376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3762e8b2-01f9-4e86-8c44-685a4007a17e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:32.057522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3762e8b2-01f9-4e86-8c44-685a4007a17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:32.068516 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1156/2297] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:32.070271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762e8b2-01f9-4e86-8c44-685a4007a17e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:32.073433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3762e8b2-01f9-4e86-8c44-685a4007a17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:32.102105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762e8b2-01f9-4e86-8c44-685a4007a17e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:32.114651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadaf20-7a03-469e-96d5-0083e3bd2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:32.115686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadaf20-7a03-469e-96d5-0083e3bd2953 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.116195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadaf20-7a03-469e-96d5-0083e3bd2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.116691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadaf20-7a03-469e-96d5-0083e3bd2953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.117829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadaf20-7a03-469e-96d5-0083e3bd2953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:32.119853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadaf20-7a03-469e-96d5-0083e3bd2953 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:32.129062 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:32.141121 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1157/2298] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:32.143072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd01fe-b907-45a6-86d0-f54a20651649 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.143357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd01fe-b907-45a6-86d0-f54a20651649 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.143699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd01fe-b907-45a6-86d0-f54a20651649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.162820 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1142/2299] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:32.163787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b56fe-84cf-4a63-b567-7bdb34472612 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:32.176105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f1cd01fe-b907-45a6-86d0-f54a20651649 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:32.177828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f1cd01fe-b907-45a6-86d0-f54a20651649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:32.178784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b56fe-84cf-4a63-b567-7bdb34472612 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:32.191583 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1158/2300] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:32.192528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd01fe-b907-45a6-86d0-f54a20651649 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:32.194258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f1cd01fe-b907-45a6-86d0-f54a20651649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:32.207941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1239aea-9db3-49aa-b99f-9f88d6f874df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:32.208351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239aea-9db3-49aa-b99f-9f88d6f874df admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.208640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239aea-9db3-49aa-b99f-9f88d6f874df admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.209396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239aea-9db3-49aa-b99f-9f88d6f874df admin admin] PATH_INFO: `/v3/projects/8fa7bf422e16441498c97377ae1b7a85/users/9632b1b483dd442f88e8898ef29eb257/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.219529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd01fe-b907-45a6-86d0-f54a20651649 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:32.227764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f177f2d-cf0d-4f77-b076-9ff7acff78ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:32.228838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177f2d-cf0d-4f77-b076-9ff7acff78ad admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.229216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177f2d-cf0d-4f77-b076-9ff7acff78ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.230001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177f2d-cf0d-4f77-b076-9ff7acff78ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.230970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f177f2d-cf0d-4f77-b076-9ff7acff78ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:32.242242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f177f2d-cf0d-4f77-b076-9ff7acff78ad admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:32.251829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1239aea-9db3-49aa-b99f-9f88d6f874df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa7bf422e16441498c97377ae1b7a85, user_id=9632b1b483dd442f88e8898ef29eb257, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:32.255516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1239aea-9db3-49aa-b99f-9f88d6f874df admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:32.288344 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1143/2301] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:32 2022] PUT /identity/v3/projects/8fa7bf422e16441498c97377ae1b7a85/users/9632b1b483dd442f88e8898ef29eb257/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:32.289578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1239aea-9db3-49aa-b99f-9f88d6f874df admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:32.299334 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1159/2302] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:32 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:32.300855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e64b1-bc0d-4b9f-bee0-ce8a2162fef8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.301212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e64b1-bc0d-4b9f-bee0-ce8a2162fef8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.301785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e64b1-bc0d-4b9f-bee0-ce8a2162fef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.351263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8a5e64b1-bc0d-4b9f-bee0-ce8a2162fef8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:32.352508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8a5e64b1-bc0d-4b9f-bee0-ce8a2162fef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:32.440829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1239aea-9db3-49aa-b99f-9f88d6f874df admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:32.496397 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1160/2303] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:32.497194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e64b1-bc0d-4b9f-bee0-ce8a2162fef8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:32.525613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e64b1-bc0d-4b9f-bee0-ce8a2162fef8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:32.538127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d49ce9-51c8-4710-92f0-31ea864c0241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:32.538841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d49ce9-51c8-4710-92f0-31ea864c0241 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.539292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d49ce9-51c8-4710-92f0-31ea864c0241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.539844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d49ce9-51c8-4710-92f0-31ea864c0241 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.541383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d49ce9-51c8-4710-92f0-31ea864c0241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:32.544667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d49ce9-51c8-4710-92f0-31ea864c0241 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:32.566198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ff345-2a26-45a4-83a4-e221a024767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:32.567501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ff345-2a26-45a4-83a4-e221a024767d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.568294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ff345-2a26-45a4-83a4-e221a024767d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.568814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ff345-2a26-45a4-83a4-e221a024767d admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.571115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ff345-2a26-45a4-83a4-e221a024767d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:32.572163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ff345-2a26-45a4-83a4-e221a024767d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:32.574244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ff345-2a26-45a4-83a4-e221a024767d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:32.593876 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1161/2304] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:32 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:32.595364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d49ce9-51c8-4710-92f0-31ea864c0241 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:32.600239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-58d49ce9-51c8-4710-92f0-31ea864c0241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:32.605701 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1144/2305] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:32.606911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ff345-2a26-45a4-83a4-e221a024767d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:32.634929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ff345-2a26-45a4-83a4-e221a024767d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:32.667107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8ca6-d058-46d3-9b9a-9ec95d8af2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:32.667746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8ca6-d058-46d3-9b9a-9ec95d8af2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.668114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8ca6-d058-46d3-9b9a-9ec95d8af2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.668294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8ca6-d058-46d3-9b9a-9ec95d8af2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.668992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be8ca6-d058-46d3-9b9a-9ec95d8af2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:32.671231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be8ca6-d058-46d3-9b9a-9ec95d8af2f1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:32.700944 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1145/2306] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:32.700944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8ca6-d058-46d3-9b9a-9ec95d8af2f1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:32.719934 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:32.731593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d49ce9-51c8-4710-92f0-31ea864c0241 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:32.734271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8ca6-d058-46d3-9b9a-9ec95d8af2f1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:32.738069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188460ac-4ac0-48d5-9ce3-b247fcc7db73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:32.738908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188460ac-4ac0-48d5-9ce3-b247fcc7db73 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.739283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188460ac-4ac0-48d5-9ce3-b247fcc7db73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.740329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188460ac-4ac0-48d5-9ce3-b247fcc7db73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.745533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703f7e6-9442-4067-b891-051bf0eeb256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:32.746171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703f7e6-9442-4067-b891-051bf0eeb256 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.746455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703f7e6-9442-4067-b891-051bf0eeb256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.746756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703f7e6-9442-4067-b891-051bf0eeb256 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.747465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703f7e6-9442-4067-b891-051bf0eeb256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:32.749507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703f7e6-9442-4067-b891-051bf0eeb256 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:32.756158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188460ac-4ac0-48d5-9ce3-b247fcc7db73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:32.757552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188460ac-4ac0-48d5-9ce3-b247fcc7db73 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:32.770284 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1162/2307] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:32.771507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188460ac-4ac0-48d5-9ce3-b247fcc7db73 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:32.784077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188460ac-4ac0-48d5-9ce3-b247fcc7db73 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:32.787818 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1146/2308] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:32 2022] POST /identity/v3/projects => generated 389 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:32.788773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703f7e6-9442-4067-b891-051bf0eeb256 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:32.872496 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:32.899581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e847ed-9ff3-4a00-8952-fe5f7c2a853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:32.900373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e847ed-9ff3-4a00-8952-fe5f7c2a853e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.900977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e847ed-9ff3-4a00-8952-fe5f7c2a853e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.901232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e847ed-9ff3-4a00-8952-fe5f7c2a853e admin admin] PATH_INFO: `/v3/projects/0109446141724cb18793396cffef0f5d/users/bfabe41ff3a6492b95dfcff64ffc38d1/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.933887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e847ed-9ff3-4a00-8952-fe5f7c2a853e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0109446141724cb18793396cffef0f5d, user_id=bfabe41ff3a6492b95dfcff64ffc38d1, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:32.937416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703f7e6-9442-4067-b891-051bf0eeb256 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:32.940986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e847ed-9ff3-4a00-8952-fe5f7c2a853e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:32.944402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e77ecf-225b-44b3-9617-d3038733671b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:32.945213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e77ecf-225b-44b3-9617-d3038733671b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:32.945499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e77ecf-225b-44b3-9617-d3038733671b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:32.945869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e77ecf-225b-44b3-9617-d3038733671b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:32.946900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e77ecf-225b-44b3-9617-d3038733671b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:32.949862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e77ecf-225b-44b3-9617-d3038733671b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:32.964742 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1163/2309] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:32 2022] PUT /identity/v3/projects/0109446141724cb18793396cffef0f5d/users/bfabe41ff3a6492b95dfcff64ffc38d1/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:32.965923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e847ed-9ff3-4a00-8952-fe5f7c2a853e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:33.016263 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1147/2310] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:32 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:33.020281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e77ecf-225b-44b3-9617-d3038733671b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:33.041758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e77ecf-225b-44b3-9617-d3038733671b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:33.128629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e847ed-9ff3-4a00-8952-fe5f7c2a853e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:33.137965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd844c5b-eeab-4a9b-b2e7-32f9ba78ace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:33.140140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd844c5b-eeab-4a9b-b2e7-32f9ba78ace0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:33.140975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd844c5b-eeab-4a9b-b2e7-32f9ba78ace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:33.142323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd844c5b-eeab-4a9b-b2e7-32f9ba78ace0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:33.143289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd844c5b-eeab-4a9b-b2e7-32f9ba78ace0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:33.146105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd844c5b-eeab-4a9b-b2e7-32f9ba78ace0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:33.166543 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1164/2311] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:33.169285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd844c5b-eeab-4a9b-b2e7-32f9ba78ace0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:33.175840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3b5a6-9146-4b25-9dfe-7b700a690f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:33.176598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3b5a6-9146-4b25-9dfe-7b700a690f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:33.176999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3b5a6-9146-4b25-9dfe-7b700a690f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:33.180128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3b5a6-9146-4b25-9dfe-7b700a690f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:33.181101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3b5a6-9146-4b25-9dfe-7b700a690f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:33.182931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3b5a6-9146-4b25-9dfe-7b700a690f45 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:33.195341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd844c5b-eeab-4a9b-b2e7-32f9ba78ace0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:33.207971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92128263-ca97-4a2e-bb55-28d86343ab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:33.209037 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1148/2312] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:33.209320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92128263-ca97-4a2e-bb55-28d86343ab73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:33.209779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92128263-ca97-4a2e-bb55-28d86343ab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:33.210203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3b5a6-9146-4b25-9dfe-7b700a690f45 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:33.210932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92128263-ca97-4a2e-bb55-28d86343ab73 admin admin] PATH_INFO: `/v3/projects/0109446141724cb18793396cffef0f5d/users/bfabe41ff3a6492b95dfcff64ffc38d1/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:33.213256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92128263-ca97-4a2e-bb55-28d86343ab73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0109446141724cb18793396cffef0f5d, user_id=bfabe41ff3a6492b95dfcff64ffc38d1, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:33.218204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92128263-ca97-4a2e-bb55-28d86343ab73 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:33.221882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3b5a6-9146-4b25-9dfe-7b700a690f45 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:33.226997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0c938-1849-438e-89eb-2d05c1948960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:33.227723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0c938-1849-438e-89eb-2d05c1948960 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:33.228103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0c938-1849-438e-89eb-2d05c1948960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:33.228472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0c938-1849-438e-89eb-2d05c1948960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:33.229324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0c938-1849-438e-89eb-2d05c1948960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:33.231092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0c938-1849-438e-89eb-2d05c1948960 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:33.233985 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1165/2313] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:33 2022] PUT /identity/v3/projects/0109446141724cb18793396cffef0f5d/users/bfabe41ff3a6492b95dfcff64ffc38d1/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:33.244099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2446-f31f-4e7e-a3c3-c365058956f6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:33.245023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2446-f31f-4e7e-a3c3-c365058956f6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:33.245452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2446-f31f-4e7e-a3c3-c365058956f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:33.245647 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1149/2314] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:33.250253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0c938-1849-438e-89eb-2d05c1948960 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:33.263296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0c938-1849-438e-89eb-2d05c1948960 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:33.291430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d50c2446-f31f-4e7e-a3c3-c365058956f6 None None] MFA Rules not processed for user `bfabe41ff3a6492b95dfcff64ffc38d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:33.293235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d50c2446-f31f-4e7e-a3c3-c365058956f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:33.345921 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:33.355688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f5fca-111f-40e0-9068-d73e9263be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:33.356492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5fca-111f-40e0-9068-d73e9263be95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:33.356991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5fca-111f-40e0-9068-d73e9263be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:33.357817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5fca-111f-40e0-9068-d73e9263be95 admin admin] PATH_INFO: `/v3/projects/ccda90f956d541b38c3e71181f397da9/users/db88db7d7835406a91b0c0817126419a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:33.378369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f5fca-111f-40e0-9068-d73e9263be95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccda90f956d541b38c3e71181f397da9, user_id=db88db7d7835406a91b0c0817126419a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:33.382541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f5fca-111f-40e0-9068-d73e9263be95 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:33.393893 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1166/2315] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:33.425187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae1139-3b4e-420d-b133-dfd30997356c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:33.428207 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1150/2316] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:33 2022] PUT /identity/v3/projects/ccda90f956d541b38c3e71181f397da9/users/db88db7d7835406a91b0c0817126419a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:33.429043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae1139-3b4e-420d-b133-dfd30997356c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:33.429718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b10a0-cba8-433d-a6b4-ac07dae8f2c7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:33.430008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b10a0-cba8-433d-a6b4-ac07dae8f2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:33.430221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae1139-3b4e-420d-b133-dfd30997356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:33.430331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b10a0-cba8-433d-a6b4-ac07dae8f2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:33.478294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fd5b10a0-cba8-433d-a6b4-ac07dae8f2c7 None None] MFA Rules not processed for user `db88db7d7835406a91b0c0817126419a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:33.479589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fd5b10a0-cba8-433d-a6b4-ac07dae8f2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:33.513520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d2ae1139-3b4e-420d-b133-dfd30997356c None None] MFA Rules not processed for user `739083b66f9b433889944e555b0aef23`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:33.520692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d2ae1139-3b4e-420d-b133-dfd30997356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:33.637786 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:33.668249 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1167/2317] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:33.676396 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1151/2318] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:33.680971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae1139-3b4e-420d-b133-dfd30997356c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:33.694726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b10a0-cba8-433d-a6b4-ac07dae8f2c7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:33.705904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fd5b10a0-cba8-433d-a6b4-ac07dae8f2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:33.867272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae1139-3b4e-420d-b133-dfd30997356c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:33.883077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdc12e-f7bc-4c81-ac15-0291807b5b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:33.886453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc12e-f7bc-4c81-ac15-0291807b5b24 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:33.887246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc12e-f7bc-4c81-ac15-0291807b5b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:33.887538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc12e-f7bc-4c81-ac15-0291807b5b24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:33.888798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdc12e-f7bc-4c81-ac15-0291807b5b24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:33.894837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdc12e-f7bc-4c81-ac15-0291807b5b24 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:33.919244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b10a0-cba8-433d-a6b4-ac07dae8f2c7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:33.932259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd3c2b-e610-4f12-aa5e-82b082c5213f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:33.933456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3c2b-e610-4f12-aa5e-82b082c5213f service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:33.934000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3c2b-e610-4f12-aa5e-82b082c5213f service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:33.934510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3c2b-e610-4f12-aa5e-82b082c5213f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:33.957482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd3c2b-e610-4f12-aa5e-82b082c5213f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:33.966635 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1168/2319] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:33 2022] POST /identity/v3/projects => generated 389 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:33.973853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdc12e-f7bc-4c81-ac15-0291807b5b24 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:33.979555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd3c2b-e610-4f12-aa5e-82b082c5213f service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:34.009775 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1152/2320] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:34.114914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdc12e-f7bc-4c81-ac15-0291807b5b24 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:34.120331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92174b-527c-4102-9a60-2b75e9591eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:34.120963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92174b-527c-4102-9a60-2b75e9591eea admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:34.121250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92174b-527c-4102-9a60-2b75e9591eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:34.121523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92174b-527c-4102-9a60-2b75e9591eea admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:34.122165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92174b-527c-4102-9a60-2b75e9591eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:34.125120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92174b-527c-4102-9a60-2b75e9591eea admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:34.156374 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1169/2321] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:33 2022] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:34.160025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd3c2b-e610-4f12-aa5e-82b082c5213f service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:34.172730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd3c2b-e610-4f12-aa5e-82b082c5213f service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:34.179696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5696-a814-489c-b145-60dc2556ae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:34.180371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5696-a814-489c-b145-60dc2556ae2f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:34.180705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5696-a814-489c-b145-60dc2556ae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:34.181030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5696-a814-489c-b145-60dc2556ae2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:34.181747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec5696-a814-489c-b145-60dc2556ae2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:34.183505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec5696-a814-489c-b145-60dc2556ae2f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:34.203285 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1153/2322] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:34.207923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92174b-527c-4102-9a60-2b75e9591eea admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:34.220738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92174b-527c-4102-9a60-2b75e9591eea admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:34.227677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589c5c-691c-4d9f-9f5a-83988cdce68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:34.228369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589c5c-691c-4d9f-9f5a-83988cdce68e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:34.228651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589c5c-691c-4d9f-9f5a-83988cdce68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:34.229073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589c5c-691c-4d9f-9f5a-83988cdce68e admin admin] PATH_INFO: `/v3/projects/91376eda082f416a8db90b79d1f90b44/users/26f84cba21224ece90597a70548be27c/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:34.255060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589c5c-691c-4d9f-9f5a-83988cdce68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=91376eda082f416a8db90b79d1f90b44, user_id=26f84cba21224ece90597a70548be27c, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:34.257855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589c5c-691c-4d9f-9f5a-83988cdce68e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:34.283046 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1170/2323] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:34 2022] PUT /identity/v3/projects/91376eda082f416a8db90b79d1f90b44/users/26f84cba21224ece90597a70548be27c/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:34.283915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5696-a814-489c-b145-60dc2556ae2f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:34.298471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5696-a814-489c-b145-60dc2556ae2f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:34.356618 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:34.380111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50491154-db8b-44d9-978c-0003102f9784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:34.381105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491154-db8b-44d9-978c-0003102f9784 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:34.381609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491154-db8b-44d9-978c-0003102f9784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:34.382068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491154-db8b-44d9-978c-0003102f9784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:34.382943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50491154-db8b-44d9-978c-0003102f9784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:34.384940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50491154-db8b-44d9-978c-0003102f9784 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:34.400267 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1154/2324] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:01:34.405238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589c5c-691c-4d9f-9f5a-83988cdce68e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:34.422239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589c5c-691c-4d9f-9f5a-83988cdce68e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:34.430987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bccacd-0be1-4235-a5dc-8365e447651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:34.432268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bccacd-0be1-4235-a5dc-8365e447651d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:34.432774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bccacd-0be1-4235-a5dc-8365e447651d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:34.433230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bccacd-0be1-4235-a5dc-8365e447651d admin admin] PATH_INFO: `/v3/projects/91376eda082f416a8db90b79d1f90b44/users/26f84cba21224ece90597a70548be27c/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:34.435661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bccacd-0be1-4235-a5dc-8365e447651d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91376eda082f416a8db90b79d1f90b44, user_id=26f84cba21224ece90597a70548be27c, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:34.439964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bccacd-0be1-4235-a5dc-8365e447651d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:34.457703 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1171/2325] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:34 2022] PUT /identity/v3/projects/91376eda082f416a8db90b79d1f90b44/users/26f84cba21224ece90597a70548be27c/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:34.469890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d3b10-ef21-4037-9f15-59e0c491c2bd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:34.470488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d3b10-ef21-4037-9f15-59e0c491c2bd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:34.470985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d3b10-ef21-4037-9f15-59e0c491c2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:34.513907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-779d3b10-ef21-4037-9f15-59e0c491c2bd None None] MFA Rules not processed for user `26f84cba21224ece90597a70548be27c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:34.516268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-779d3b10-ef21-4037-9f15-59e0c491c2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:34.623389 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1155/2326] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:34.642848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf881-7120-480b-8584-0aadcbfbbc2b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:34.643741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf881-7120-480b-8584-0aadcbfbbc2b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:34.645231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf881-7120-480b-8584-0aadcbfbbc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:34.818931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-985bf881-7120-480b-8584-0aadcbfbbc2b None None] MFA Rules not processed for user `db88db7d7835406a91b0c0817126419a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:34.820830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-985bf881-7120-480b-8584-0aadcbfbbc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:34.858419 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:34.927348 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1172/2327] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:35.072240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d3b10-ef21-4037-9f15-59e0c491c2bd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:35.229301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d3b10-ef21-4037-9f15-59e0c491c2bd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:35.249311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634e92d-8002-4def-8acd-35d9af1a29c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:35.249932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e92d-8002-4def-8acd-35d9af1a29c9 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:35.250224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e92d-8002-4def-8acd-35d9af1a29c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:35.250689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e92d-8002-4def-8acd-35d9af1a29c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:35.263921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634e92d-8002-4def-8acd-35d9af1a29c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:35.266738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634e92d-8002-4def-8acd-35d9af1a29c9 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:35.280665 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1156/2328] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:37.616117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632bb4-0660-4dbb-8ecc-fb459520aedb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:37.617380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632bb4-0660-4dbb-8ecc-fb459520aedb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:37.617889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632bb4-0660-4dbb-8ecc-fb459520aedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:37.655208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ea632bb4-0660-4dbb-8ecc-fb459520aedb None None] MFA Rules not processed for user `c42d04f7289e49ef950eeaf764c91216`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:37.656815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ea632bb4-0660-4dbb-8ecc-fb459520aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:37.821029 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1173/2329] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:40.518643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b152a-992e-4ec2-b28d-a21fa1636c03 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:40.519196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b152a-992e-4ec2-b28d-a21fa1636c03 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:40.524588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b152a-992e-4ec2-b28d-a21fa1636c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:40.583712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b49b152a-992e-4ec2-b28d-a21fa1636c03 None None] MFA Rules not processed for user `6da1976f703f402788953f3332a281de`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:40.586136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b49b152a-992e-4ec2-b28d-a21fa1636c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:40.675189 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:40.761098 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1157/2330] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:40.766298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea632bb4-0660-4dbb-8ecc-fb459520aedb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:40.767807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ea632bb4-0660-4dbb-8ecc-fb459520aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:40.928058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea632bb4-0660-4dbb-8ecc-fb459520aedb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:40.940951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa682e98-aa1f-4045-b074-ee0ec6c5f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:40.941915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa682e98-aa1f-4045-b074-ee0ec6c5f6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:40.942386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa682e98-aa1f-4045-b074-ee0ec6c5f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:40.942867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa682e98-aa1f-4045-b074-ee0ec6c5f6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:40.943693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa682e98-aa1f-4045-b074-ee0ec6c5f6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:40.945796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa682e98-aa1f-4045-b074-ee0ec6c5f6f7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:41.041459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b152a-992e-4ec2-b28d-a21fa1636c03 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:41.045273 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1174/2331] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:40 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:41.080508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b152a-992e-4ec2-b28d-a21fa1636c03 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:41.221708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62229105-6932-44a1-8576-edf4d496d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:41.222343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62229105-6932-44a1-8576-edf4d496d29f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:41.222641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62229105-6932-44a1-8576-edf4d496d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:41.222922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62229105-6932-44a1-8576-edf4d496d29f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:41.226919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62229105-6932-44a1-8576-edf4d496d29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:41.232225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62229105-6932-44a1-8576-edf4d496d29f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:41.268142 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1158/2332] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:41 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:01:41.271981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa682e98-aa1f-4045-b074-ee0ec6c5f6f7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:41.285182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa682e98-aa1f-4045-b074-ee0ec6c5f6f7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:41.298081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b0873-ebd3-4305-928f-3ddbabbbc07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:41.299048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b0873-ebd3-4305-928f-3ddbabbbc07b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:41.301577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b0873-ebd3-4305-928f-3ddbabbbc07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:41.302019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b0873-ebd3-4305-928f-3ddbabbbc07b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:41.302918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b0873-ebd3-4305-928f-3ddbabbbc07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:41.308458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b0873-ebd3-4305-928f-3ddbabbbc07b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:41.347695 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1175/2333] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:41.352584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62229105-6932-44a1-8576-edf4d496d29f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:41.375467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62229105-6932-44a1-8576-edf4d496d29f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:41.391568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127a03c-4612-4fed-9b42-6dba9cce4e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:41.400657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a03c-4612-4fed-9b42-6dba9cce4e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:41.402401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a03c-4612-4fed-9b42-6dba9cce4e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:41.402886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a03c-4612-4fed-9b42-6dba9cce4e19 admin admin] PATH_INFO: `/v3/projects/e61468cee3c24c7e84784b9ac94d2681/users/07119428c22c4a28b61ba8137655e716/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:41.430003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127a03c-4612-4fed-9b42-6dba9cce4e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61468cee3c24c7e84784b9ac94d2681, user_id=07119428c22c4a28b61ba8137655e716, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:41.433617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127a03c-4612-4fed-9b42-6dba9cce4e19 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:41.459716 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1159/2334] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:41 2022] PUT /identity/v3/projects/e61468cee3c24c7e84784b9ac94d2681/users/07119428c22c4a28b61ba8137655e716/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:41.464275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b0873-ebd3-4305-928f-3ddbabbbc07b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:41.487219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b0873-ebd3-4305-928f-3ddbabbbc07b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:41.618699 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:41.636213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524848f-e406-4dd2-a0a3-ced3122d7000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:41.637191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524848f-e406-4dd2-a0a3-ced3122d7000 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:41.637191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524848f-e406-4dd2-a0a3-ced3122d7000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:41.637425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524848f-e406-4dd2-a0a3-ced3122d7000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:41.638132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524848f-e406-4dd2-a0a3-ced3122d7000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:41.640060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524848f-e406-4dd2-a0a3-ced3122d7000 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:41.676513 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1176/2335] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:01:41.679575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127a03c-4612-4fed-9b42-6dba9cce4e19 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:41.713008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127a03c-4612-4fed-9b42-6dba9cce4e19 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:41.729621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83186e-5be5-4f1d-8e22-9eb32631b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:41.730809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83186e-5be5-4f1d-8e22-9eb32631b038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:41.732458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83186e-5be5-4f1d-8e22-9eb32631b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:41.732943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83186e-5be5-4f1d-8e22-9eb32631b038 admin admin] PATH_INFO: `/v3/projects/e61468cee3c24c7e84784b9ac94d2681/users/07119428c22c4a28b61ba8137655e716/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:41.762681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83186e-5be5-4f1d-8e22-9eb32631b038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61468cee3c24c7e84784b9ac94d2681, user_id=07119428c22c4a28b61ba8137655e716, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:41.770947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83186e-5be5-4f1d-8e22-9eb32631b038 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:41.802117 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1160/2336] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:41 2022] PUT /identity/v3/projects/e61468cee3c24c7e84784b9ac94d2681/users/07119428c22c4a28b61ba8137655e716/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:43.692997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524848f-e406-4dd2-a0a3-ced3122d7000 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:43.695660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4524848f-e406-4dd2-a0a3-ced3122d7000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:43.718058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524848f-e406-4dd2-a0a3-ced3122d7000 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:43.872933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:43.873459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:43.873742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:43.874112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] PATH_INFO: `/v3/users/a57f3a9e39de4ba0801d6b449d2cc986` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:43.875389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57f3a9e39de4ba0801d6b449d2cc986)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:43.877341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:43.990368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57f3a9e39de4ba0801d6b449d2cc986'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:44.022547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57f3a9e39de4ba0801d6b449d2cc986'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:44.024407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57f3a9e39de4ba0801d6b449d2cc986'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:44.051971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57f3a9e39de4ba0801d6b449d2cc986'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:44.055954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57f3a9e39de4ba0801d6b449d2cc986'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:44.098184 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1177/2337] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:43 2022] DELETE /identity/v3/users/a57f3a9e39de4ba0801d6b449d2cc986 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:45.086053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83186e-5be5-4f1d-8e22-9eb32631b038 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:45.087841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb83186e-5be5-4f1d-8e22-9eb32631b038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:45.125769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83186e-5be5-4f1d-8e22-9eb32631b038 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:45.259390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:45.260412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:45.260916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:45.261404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] PATH_INFO: `/v3/projects/8e5d1e400600432aa47a56ccf42109ce` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:45.265215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5d1e400600432aa47a56ccf42109ce)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:45.267862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:45.361501 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:45.408807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5d1e400600432aa47a56ccf42109ce', 'request_id': 'req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:45.443192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5d1e400600432aa47a56ccf42109ce', 'request_id': 'req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:45.465343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5d1e400600432aa47a56ccf42109ce', 'request_id': 'req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:45.509196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] The token cache is being invalidate because project 8e5d1e400600432aa47a56ccf42109ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:45.509697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:45.515338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:45.521886 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1161/2338] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:45 2022] DELETE /identity/v3/projects/8e5d1e400600432aa47a56ccf42109ce => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:45.525803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:45.548805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd801e9e-b680-431f-b4c7-f0dcabdcaf06 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:45.742441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3e762-3612-4ad7-a443-1dcb338dad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:45.743400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3e762-3612-4ad7-a443-1dcb338dad7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:45.743907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3e762-3612-4ad7-a443-1dcb338dad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:45.744401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3e762-3612-4ad7-a443-1dcb338dad7b admin admin] PATH_INFO: `/v3/users/70fe400d80644e1fb248bb41017394a7` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:45.748808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3e762-3612-4ad7-a443-1dcb338dad7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=70fe400d80644e1fb248bb41017394a7)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:45.751175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3e762-3612-4ad7-a443-1dcb338dad7b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:45.789811 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:45.891607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3eb3e762-3612-4ad7-a443-1dcb338dad7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70fe400d80644e1fb248bb41017394a7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:45.922939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3eb3e762-3612-4ad7-a443-1dcb338dad7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70fe400d80644e1fb248bb41017394a7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:45.923811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3eb3e762-3612-4ad7-a443-1dcb338dad7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70fe400d80644e1fb248bb41017394a7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:45.939428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3eb3e762-3612-4ad7-a443-1dcb338dad7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70fe400d80644e1fb248bb41017394a7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:45.940096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3eb3e762-3612-4ad7-a443-1dcb338dad7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70fe400d80644e1fb248bb41017394a7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:45.975229 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1178/2339] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:45 2022] DELETE /identity/v3/users/70fe400d80644e1fb248bb41017394a7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:46.977900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:46.979537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:47.014157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324c0b-c1e8-4576-82ab-f1f4acb72c4b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:47.141905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:47.143074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:47.143558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:47.145540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] PATH_INFO: `/v3/projects/a16b9aa6d2554d8cb4e28054471540a9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:47.146822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16b9aa6d2554d8cb4e28054471540a9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:47.149394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:47.289834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16b9aa6d2554d8cb4e28054471540a9', 'request_id': 'req-eedf711e-5b6c-4d1a-a76d-889c741a8643'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:47.301775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16b9aa6d2554d8cb4e28054471540a9', 'request_id': 'req-eedf711e-5b6c-4d1a-a76d-889c741a8643'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:47.320322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16b9aa6d2554d8cb4e28054471540a9', 'request_id': 'req-eedf711e-5b6c-4d1a-a76d-889c741a8643'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:47.369302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] The token cache is being invalidate because project a16b9aa6d2554d8cb4e28054471540a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:47.369604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:47.372123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eedf711e-5b6c-4d1a-a76d-889c741a8643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:47.380241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5ca91-6999-42bc-a849-aadd32d23937 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:47.380720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5ca91-6999-42bc-a849-aadd32d23937 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:47.380980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5ca91-6999-42bc-a849-aadd32d23937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:47.383695 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1162/2340] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:46 2022] DELETE /identity/v3/projects/a16b9aa6d2554d8cb4e28054471540a9 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:47.409618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-eac5ca91-6999-42bc-a849-aadd32d23937 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:47.411165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eac5ca91-6999-42bc-a849-aadd32d23937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:47.536315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa8108-b0f6-4f83-ac0f-1e9f011aab7a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:47.536818 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1179/2341] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:47.536999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa8108-b0f6-4f83-ac0f-1e9f011aab7a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:47.536999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa8108-b0f6-4f83-ac0f-1e9f011aab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:47.605821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0caa8108-b0f6-4f83-ac0f-1e9f011aab7a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:47.610933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0caa8108-b0f6-4f83-ac0f-1e9f011aab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:47.660486 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1163/2342] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:47.664545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5ca91-6999-42bc-a849-aadd32d23937 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:47.681145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5ca91-6999-42bc-a849-aadd32d23937 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:47.699381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d457a-e2ba-4a15-8c30-30e7047b994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:47.700080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d457a-e2ba-4a15-8c30-30e7047b994e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:47.700356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d457a-e2ba-4a15-8c30-30e7047b994e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:47.700630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d457a-e2ba-4a15-8c30-30e7047b994e admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:47.701408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d457a-e2ba-4a15-8c30-30e7047b994e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:47.701718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d457a-e2ba-4a15-8c30-30e7047b994e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:47.703392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d457a-e2ba-4a15-8c30-30e7047b994e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:47.763933 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1180/2343] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:47.768189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa8108-b0f6-4f83-ac0f-1e9f011aab7a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:47.787176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa8108-b0f6-4f83-ac0f-1e9f011aab7a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:47.799080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658ceac-09f7-44a8-adbf-959198d4af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:47.799719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658ceac-09f7-44a8-adbf-959198d4af28 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:47.800001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658ceac-09f7-44a8-adbf-959198d4af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:47.805292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658ceac-09f7-44a8-adbf-959198d4af28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:47.806394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658ceac-09f7-44a8-adbf-959198d4af28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:47.808590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658ceac-09f7-44a8-adbf-959198d4af28 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:47.884891 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1164/2344] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:47 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:47.888367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d457a-e2ba-4a15-8c30-30e7047b994e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:47.910094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d457a-e2ba-4a15-8c30-30e7047b994e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:48.110162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081b255-8385-42f6-8609-2ef90d586648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:48.111811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081b255-8385-42f6-8609-2ef90d586648 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:48.112098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081b255-8385-42f6-8609-2ef90d586648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:48.112442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081b255-8385-42f6-8609-2ef90d586648 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:48.113509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081b255-8385-42f6-8609-2ef90d586648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:48.116848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081b255-8385-42f6-8609-2ef90d586648 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:48.161141 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1181/2345] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:47 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:48.165562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658ceac-09f7-44a8-adbf-959198d4af28 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:48.187326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658ceac-09f7-44a8-adbf-959198d4af28 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:48.207806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770c34c-d41a-4ffb-bce0-d514c16150d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:48.208445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c34c-d41a-4ffb-bce0-d514c16150d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:48.208727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c34c-d41a-4ffb-bce0-d514c16150d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:48.209000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c34c-d41a-4ffb-bce0-d514c16150d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:48.209670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770c34c-d41a-4ffb-bce0-d514c16150d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:48.211413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770c34c-d41a-4ffb-bce0-d514c16150d4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:48.236886 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1165/2346] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:48.240684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081b255-8385-42f6-8609-2ef90d586648 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:48.257729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081b255-8385-42f6-8609-2ef90d586648 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:48.264455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ad043-7498-4d8e-8f8f-1492deed8332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:48.265235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad043-7498-4d8e-8f8f-1492deed8332 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:48.265783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad043-7498-4d8e-8f8f-1492deed8332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:48.266231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad043-7498-4d8e-8f8f-1492deed8332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:48.267135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ad043-7498-4d8e-8f8f-1492deed8332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:48.276714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ad043-7498-4d8e-8f8f-1492deed8332 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:48.278962 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:48.310515 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1182/2347] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:48.310742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770c34c-d41a-4ffb-bce0-d514c16150d4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:48.324113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770c34c-d41a-4ffb-bce0-d514c16150d4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:48.332383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d35a6d-fd60-47cd-b3fd-0a7a38f9f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:48.333186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35a6d-fd60-47cd-b3fd-0a7a38f9f940 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:48.333574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35a6d-fd60-47cd-b3fd-0a7a38f9f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:48.333953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35a6d-fd60-47cd-b3fd-0a7a38f9f940 admin admin] PATH_INFO: `/v3/projects/2134c2d6449647069d1da3a7ed02d53c/users/c5237194d1c9473e8fc696a3068b80b3/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:48.355809 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:48.359929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d35a6d-fd60-47cd-b3fd-0a7a38f9f940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2134c2d6449647069d1da3a7ed02d53c, user_id=c5237194d1c9473e8fc696a3068b80b3, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:48.365548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d35a6d-fd60-47cd-b3fd-0a7a38f9f940 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:48.410143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b4ac9-74d1-48c9-af0b-7c1d48d33d72 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:48.411150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b4ac9-74d1-48c9-af0b-7c1d48d33d72 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:48.411637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b4ac9-74d1-48c9-af0b-7c1d48d33d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:48.415746 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1166/2348] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:48 2022] PUT /identity/v3/projects/2134c2d6449647069d1da3a7ed02d53c/users/c5237194d1c9473e8fc696a3068b80b3/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:48.445796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-329b4ac9-74d1-48c9-af0b-7c1d48d33d72 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:48.447813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-329b4ac9-74d1-48c9-af0b-7c1d48d33d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:48.601547 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1183/2349] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:48.748322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d35a6d-fd60-47cd-b3fd-0a7a38f9f940 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:48.750252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a0d35a6d-fd60-47cd-b3fd-0a7a38f9f940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:48.858225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d35a6d-fd60-47cd-b3fd-0a7a38f9f940 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:48.864413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeb5fd-293d-4a3c-b94c-2fd82a1d9f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:48.865059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeb5fd-293d-4a3c-b94c-2fd82a1d9f17 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:48.865343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeb5fd-293d-4a3c-b94c-2fd82a1d9f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:48.865617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeb5fd-293d-4a3c-b94c-2fd82a1d9f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:48.879180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeb5fd-293d-4a3c-b94c-2fd82a1d9f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:48.880654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeb5fd-293d-4a3c-b94c-2fd82a1d9f17 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:48.896088 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1167/2350] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:49.595519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b4ac9-74d1-48c9-af0b-7c1d48d33d72 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:49.597254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-329b4ac9-74d1-48c9-af0b-7c1d48d33d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:49.618869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b4ac9-74d1-48c9-af0b-7c1d48d33d72 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:49.633253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:49.634102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:49.634494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:49.634924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] PATH_INFO: `/v3/users/6d9e1b41a5ce40c292c45ab1bfacb020` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:49.644488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9e1b41a5ce40c292c45ab1bfacb020)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:49.649016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:49.765062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9e1b41a5ce40c292c45ab1bfacb020'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:49.797459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9e1b41a5ce40c292c45ab1bfacb020'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:49.798865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9e1b41a5ce40c292c45ab1bfacb020'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:49.811735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9e1b41a5ce40c292c45ab1bfacb020'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:49.824535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9e1b41a5ce40c292c45ab1bfacb020'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:49.853287 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1184/2351] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:49 2022] DELETE /identity/v3/users/6d9e1b41a5ce40c292c45ab1bfacb020 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:49.857817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a8f95-5331-410d-a8f6-4ee4f76c7f17 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:49.859126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a8f95-5331-410d-a8f6-4ee4f76c7f17 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:49.859798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a8f95-5331-410d-a8f6-4ee4f76c7f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:49.893155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2d7a8f95-5331-410d-a8f6-4ee4f76c7f17 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:49.901176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d7a8f95-5331-410d-a8f6-4ee4f76c7f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:50.044864 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1168/2352] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:50.078768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:50.081066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:50.233214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e0f06-654f-4f7b-ac72-e04431018ecc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:50.260449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7e645-b10f-46bb-bae1-a487fa8dda57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:50.260449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7e645-b10f-46bb-bae1-a487fa8dda57 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:50.260449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7e645-b10f-46bb-bae1-a487fa8dda57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:50.260449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7e645-b10f-46bb-bae1-a487fa8dda57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:50.283829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7e645-b10f-46bb-bae1-a487fa8dda57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:50.287947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7e645-b10f-46bb-bae1-a487fa8dda57 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:50.312528 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1185/2353] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:51.804017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a8f95-5331-410d-a8f6-4ee4f76c7f17 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:51.807255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d7a8f95-5331-410d-a8f6-4ee4f76c7f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:51.861438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a8f95-5331-410d-a8f6-4ee4f76c7f17 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:51.887628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:51.890755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:51.891449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:51.898019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] PATH_INFO: `/v3/projects/9de523ba73a54067a287aa17f43cec20` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:51.901695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de523ba73a54067a287aa17f43cec20)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:51.908952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:52.075628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de523ba73a54067a287aa17f43cec20', 'request_id': 'req-29fd5717-ab8c-4269-927e-a19914352d12'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:52.091926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de523ba73a54067a287aa17f43cec20', 'request_id': 'req-29fd5717-ab8c-4269-927e-a19914352d12'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:52.109403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de523ba73a54067a287aa17f43cec20', 'request_id': 'req-29fd5717-ab8c-4269-927e-a19914352d12'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:52.138329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] The token cache is being invalidate because project 9de523ba73a54067a287aa17f43cec20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:52.140406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:52.142104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29fd5717-ab8c-4269-927e-a19914352d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:52.147728 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1169/2354] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:51 2022] DELETE /identity/v3/projects/9de523ba73a54067a287aa17f43cec20 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:52.152333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7e645-b10f-46bb-bae1-a487fa8dda57 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:52.164171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7e645-b10f-46bb-bae1-a487fa8dda57 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:52.174728 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:52.258094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b29f5-8375-41bd-a7e8-65a112f72b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:52.258799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b29f5-8375-41bd-a7e8-65a112f72b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:52.259251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b29f5-8375-41bd-a7e8-65a112f72b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:52.260082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b29f5-8375-41bd-a7e8-65a112f72b97 admin admin] PATH_INFO: `/v3/users/5e328b177ea3416a8acb95585c3afa30` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:52.262796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b29f5-8375-41bd-a7e8-65a112f72b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e328b177ea3416a8acb95585c3afa30)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:52.264970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b29f5-8375-41bd-a7e8-65a112f72b97 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:52.353598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d34b29f5-8375-41bd-a7e8-65a112f72b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e328b177ea3416a8acb95585c3afa30'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:52.380896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d34b29f5-8375-41bd-a7e8-65a112f72b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e328b177ea3416a8acb95585c3afa30'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:52.383010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d34b29f5-8375-41bd-a7e8-65a112f72b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e328b177ea3416a8acb95585c3afa30'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:52.401962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d34b29f5-8375-41bd-a7e8-65a112f72b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e328b177ea3416a8acb95585c3afa30'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:52.403554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d34b29f5-8375-41bd-a7e8-65a112f72b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e328b177ea3416a8acb95585c3afa30'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:52.428280 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1186/2355] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:52 2022] DELETE /identity/v3/users/5e328b177ea3416a8acb95585c3afa30 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:53.326030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7724-9485-4775-9a22-e4e94184aea5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:53.326575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7724-9485-4775-9a22-e4e94184aea5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:53.327023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7724-9485-4775-9a22-e4e94184aea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:53.424724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-396a7724-9485-4775-9a22-e4e94184aea5 None None] MFA Rules not processed for user `07119428c22c4a28b61ba8137655e716`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:53.426186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-396a7724-9485-4775-9a22-e4e94184aea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:53.440849 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:53.620443 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1170/2356] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:53.627265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af828d-d93d-40b7-b83c-f22441081186 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:53.627821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af828d-d93d-40b7-b83c-f22441081186 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:53.627821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af828d-d93d-40b7-b83c-f22441081186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:53.669459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-63af828d-d93d-40b7-b83c-f22441081186 None None] MFA Rules not processed for user `6da1976f703f402788953f3332a281de`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:53.672228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-63af828d-d93d-40b7-b83c-f22441081186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:53.783493 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1187/2357] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:53.795523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a7724-9485-4775-9a22-e4e94184aea5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:53.797786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-396a7724-9485-4775-9a22-e4e94184aea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:54.008663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a7724-9485-4775-9a22-e4e94184aea5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:54.015971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50c603-16e4-43f7-b052-5ec56402c7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:54.016705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50c603-16e4-43f7-b052-5ec56402c7c8 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:54.017096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50c603-16e4-43f7-b052-5ec56402c7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:54.017501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50c603-16e4-43f7-b052-5ec56402c7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:54.022985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8a50c603-16e4-43f7-b052-5ec56402c7c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:54.044208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50c603-16e4-43f7-b052-5ec56402c7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:54.046219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50c603-16e4-43f7-b052-5ec56402c7c8 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:54.083207 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1171/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:54.534957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af828d-d93d-40b7-b83c-f22441081186 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:54.537106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-63af828d-d93d-40b7-b83c-f22441081186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:54.610417 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:54.653398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af828d-d93d-40b7-b83c-f22441081186 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:54.658539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:54.659181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:54.659634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:54.660052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] PATH_INFO: `/v3/projects/0438136621b848869d0b8468d2a09f0e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:54.661362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0438136621b848869d0b8468d2a09f0e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:54.663548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:54.723979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0438136621b848869d0b8468d2a09f0e', 'request_id': 'req-af8aec4e-7849-41e8-bb55-a7a9e705fad1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:54.731102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0438136621b848869d0b8468d2a09f0e', 'request_id': 'req-af8aec4e-7849-41e8-bb55-a7a9e705fad1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:54.738317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0438136621b848869d0b8468d2a09f0e', 'request_id': 'req-af8aec4e-7849-41e8-bb55-a7a9e705fad1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:54.759367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] The token cache is being invalidate because project 0438136621b848869d0b8468d2a09f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:01:54.760200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:54.761161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af8aec4e-7849-41e8-bb55-a7a9e705fad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:54.763576 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1188/2359] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:01:54 2022] DELETE /identity/v3/projects/0438136621b848869d0b8468d2a09f0e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:54.768213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08d11-51fc-4e65-ba76-45a193f1ab69 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:54.768718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08d11-51fc-4e65-ba76-45a193f1ab69 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:54.769085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08d11-51fc-4e65-ba76-45a193f1ab69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:54.796420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7ab08d11-51fc-4e65-ba76-45a193f1ab69 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:54.797833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7ab08d11-51fc-4e65-ba76-45a193f1ab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:54.894320 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1172/2360] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:01:54.903391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38671a1-c8a6-43a3-b1cd-50be34ac4d17 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:54.903995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38671a1-c8a6-43a3-b1cd-50be34ac4d17 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:54.904387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38671a1-c8a6-43a3-b1cd-50be34ac4d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:54.935182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7bddc-6ce0-406a-87fc-afe2645a4e20 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:54.935182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7bddc-6ce0-406a-87fc-afe2645a4e20 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:54.935182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7bddc-6ce0-406a-87fc-afe2645a4e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:54.998712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e38671a1-c8a6-43a3-b1cd-50be34ac4d17 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:55.001530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e38671a1-c8a6-43a3-b1cd-50be34ac4d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:55.040281 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1189/2361] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:55.045690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38671a1-c8a6-43a3-b1cd-50be34ac4d17 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:55.068592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1bd7bddc-6ce0-406a-87fc-afe2645a4e20 None None] MFA Rules not processed for user `9632b1b483dd442f88e8898ef29eb257`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:55.070981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1bd7bddc-6ce0-406a-87fc-afe2645a4e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:55.072683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38671a1-c8a6-43a3-b1cd-50be34ac4d17 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:55.082175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826686a-0583-4d60-99a0-bd75de5fb0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:55.084473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826686a-0583-4d60-99a0-bd75de5fb0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.085127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826686a-0583-4d60-99a0-bd75de5fb0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.085503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826686a-0583-4d60-99a0-bd75de5fb0b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.086859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826686a-0583-4d60-99a0-bd75de5fb0b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:01:55.087269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826686a-0583-4d60-99a0-bd75de5fb0b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:55.089230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826686a-0583-4d60-99a0-bd75de5fb0b9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:55.100874 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:55.106247 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1190/2362] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:01:55.108055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1801bed-5cf1-46c7-8254-c0ae6684b3ab None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.108344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1801bed-5cf1-46c7-8254-c0ae6684b3ab None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.108620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1801bed-5cf1-46c7-8254-c0ae6684b3ab None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.110940 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1191/2363] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:01:55.111752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1801bed-5cf1-46c7-8254-c0ae6684b3ab None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:55.128598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1801bed-5cf1-46c7-8254-c0ae6684b3ab None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:55.134813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2442380-c7e4-4bcd-b35c-34ceeb6f1f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:55.135493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2442380-c7e4-4bcd-b35c-34ceeb6f1f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.135993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2442380-c7e4-4bcd-b35c-34ceeb6f1f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.136334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2442380-c7e4-4bcd-b35c-34ceeb6f1f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.137764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2442380-c7e4-4bcd-b35c-34ceeb6f1f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:55.139953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2442380-c7e4-4bcd-b35c-34ceeb6f1f17 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:55.194307 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1192/2364] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:55 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:55.196742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60a74-3ddc-456e-b616-84aadaf9b93c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.197265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60a74-3ddc-456e-b616-84aadaf9b93c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.197742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60a74-3ddc-456e-b616-84aadaf9b93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.249077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4fd60a74-3ddc-456e-b616-84aadaf9b93c None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:55.252034 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1173/2365] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:55.252170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4fd60a74-3ddc-456e-b616-84aadaf9b93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:55.253251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7bddc-6ce0-406a-87fc-afe2645a4e20 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:55.273105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7bddc-6ce0-406a-87fc-afe2645a4e20 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:55.425751 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1193/2366] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:55.427114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd60a74-3ddc-456e-b616-84aadaf9b93c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:55.430416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4fd60a74-3ddc-456e-b616-84aadaf9b93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:55.445122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc48d4b-78f9-471e-8725-23f11be4c6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:55.446108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc48d4b-78f9-471e-8725-23f11be4c6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.447841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc48d4b-78f9-471e-8725-23f11be4c6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.448453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc48d4b-78f9-471e-8725-23f11be4c6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.451549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc48d4b-78f9-471e-8725-23f11be4c6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:55.456617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc48d4b-78f9-471e-8725-23f11be4c6d6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:55.505939 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1174/2367] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:55 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:55.510692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc48d4b-78f9-471e-8725-23f11be4c6d6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:55.516955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7dc48d4b-78f9-471e-8725-23f11be4c6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:55.524033 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:55.550191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc48d4b-78f9-471e-8725-23f11be4c6d6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:55.554317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf0a64-965b-4e2c-96e1-7692396d8dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:55.556572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf0a64-965b-4e2c-96e1-7692396d8dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.556937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf0a64-965b-4e2c-96e1-7692396d8dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.557287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf0a64-965b-4e2c-96e1-7692396d8dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.566299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf0a64-965b-4e2c-96e1-7692396d8dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:55.567961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf0a64-965b-4e2c-96e1-7692396d8dc4 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:55.580666 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1175/2368] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:55.581121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf0a64-965b-4e2c-96e1-7692396d8dc4 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:55.601127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf0a64-965b-4e2c-96e1-7692396d8dc4 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:55.614078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd60a74-3ddc-456e-b616-84aadaf9b93c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:55.618591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e56ae-1db0-40aa-b736-c396d2767639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:55.618843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e56ae-1db0-40aa-b736-c396d2767639 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.620812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e56ae-1db0-40aa-b736-c396d2767639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.621123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e56ae-1db0-40aa-b736-c396d2767639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.621590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eaba7-d1f0-48a3-9660-a3ffccebe88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:55.622366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eaba7-d1f0-48a3-9660-a3ffccebe88d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.622685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eaba7-d1f0-48a3-9660-a3ffccebe88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.622937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eaba7-d1f0-48a3-9660-a3ffccebe88d admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.623054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e56ae-1db0-40aa-b736-c396d2767639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:55.623578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877eaba7-d1f0-48a3-9660-a3ffccebe88d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:55.625478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877eaba7-d1f0-48a3-9660-a3ffccebe88d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:55.626368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e56ae-1db0-40aa-b736-c396d2767639 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:55.665746 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1176/2369] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:55.667755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e56ae-1db0-40aa-b736-c396d2767639 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:55.692313 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1194/2370] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:55 2022] POST /identity/v3/projects => generated 383 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:55.696412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eaba7-d1f0-48a3-9660-a3ffccebe88d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:55.702264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e56ae-1db0-40aa-b736-c396d2767639 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:55.847431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eaba7-d1f0-48a3-9660-a3ffccebe88d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:55.862897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8a795-62d1-404d-abe3-b34be00d8956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:55.863526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a795-62d1-404d-abe3-b34be00d8956 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.863804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a795-62d1-404d-abe3-b34be00d8956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.864073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a795-62d1-404d-abe3-b34be00d8956 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.864714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8a795-62d1-404d-abe3-b34be00d8956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:55.867263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8a795-62d1-404d-abe3-b34be00d8956 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:55.877480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1a611-ecec-4112-b598-a1dcf7de4c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:55.879243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1a611-ecec-4112-b598-a1dcf7de4c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.879675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1a611-ecec-4112-b598-a1dcf7de4c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.880362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1a611-ecec-4112-b598-a1dcf7de4c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.881176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1a611-ecec-4112-b598-a1dcf7de4c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:55.899365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1a611-ecec-4112-b598-a1dcf7de4c33 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:55.925614 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1195/2371] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:55 2022] POST /identity/v3/users => generated 298 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:01:55.929217 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1177/2372] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:55.930280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1a611-ecec-4112-b598-a1dcf7de4c33 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:55.932687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8a795-62d1-404d-abe3-b34be00d8956 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:55.965319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8a795-62d1-404d-abe3-b34be00d8956 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:55.965594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1a611-ecec-4112-b598-a1dcf7de4c33 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:55.975791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e1d41-2166-4b96-9c63-bfb992133661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:55.976174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e1d41-2166-4b96-9c63-bfb992133661 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.976323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e1d41-2166-4b96-9c63-bfb992133661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.976587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e1d41-2166-4b96-9c63-bfb992133661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.977243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e1d41-2166-4b96-9c63-bfb992133661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:55.978931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e1d41-2166-4b96-9c63-bfb992133661 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:55.980581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87b924-fbe8-410a-9733-9b84ab68da01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:55.981173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87b924-fbe8-410a-9733-9b84ab68da01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:55.981448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87b924-fbe8-410a-9733-9b84ab68da01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:55.984348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87b924-fbe8-410a-9733-9b84ab68da01 admin admin] PATH_INFO: `/v3/projects/95833dc0b2b343f4910fe902f4a2a45f/users/7c7418b6f7d147e59b613468cdfc02d6/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:55.999944 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1196/2373] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:01:56.001626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e1d41-2166-4b96-9c63-bfb992133661 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:56.020647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e1d41-2166-4b96-9c63-bfb992133661 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:56.035282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87b924-fbe8-410a-9733-9b84ab68da01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95833dc0b2b343f4910fe902f4a2a45f, user_id=7c7418b6f7d147e59b613468cdfc02d6, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:56.038377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d777629-95d9-4b5d-a116-7405b67dcb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:56.039221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d777629-95d9-4b5d-a116-7405b67dcb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:56.039502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d777629-95d9-4b5d-a116-7405b67dcb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:56.039774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d777629-95d9-4b5d-a116-7405b67dcb23 admin admin] PATH_INFO: `/v3/projects/6171032b9ce640a9a8a216c9d8bcd374/users/34b19eb53fc54117ae00503af9d1b411/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:56.040252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87b924-fbe8-410a-9733-9b84ab68da01 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:56.046635 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:56.073534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d777629-95d9-4b5d-a116-7405b67dcb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6171032b9ce640a9a8a216c9d8bcd374, user_id=34b19eb53fc54117ae00503af9d1b411, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:56.076742 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1178/2374] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:55 2022] PUT /identity/v3/projects/95833dc0b2b343f4910fe902f4a2a45f/users/7c7418b6f7d147e59b613468cdfc02d6/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:56.076886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d777629-95d9-4b5d-a116-7405b67dcb23 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:56.082339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388eae-d373-4831-bbb6-0344985bd61b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:56.085313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388eae-d373-4831-bbb6-0344985bd61b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:56.086210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388eae-d373-4831-bbb6-0344985bd61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:56.101720 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1197/2375] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:56 2022] PUT /identity/v3/projects/6171032b9ce640a9a8a216c9d8bcd374/users/34b19eb53fc54117ae00503af9d1b411/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:56.106350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d777629-95d9-4b5d-a116-7405b67dcb23 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:56.205890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c4388eae-d373-4831-bbb6-0344985bd61b None None] MFA Rules not processed for user `7c7418b6f7d147e59b613468cdfc02d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:56.209095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c4388eae-d373-4831-bbb6-0344985bd61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:56.220679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d777629-95d9-4b5d-a116-7405b67dcb23 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:56.232913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73540354-001e-4acc-9ee4-a72f90ba27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:56.233646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73540354-001e-4acc-9ee4-a72f90ba27c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:56.233925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73540354-001e-4acc-9ee4-a72f90ba27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:56.234194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73540354-001e-4acc-9ee4-a72f90ba27c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:56.234880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73540354-001e-4acc-9ee4-a72f90ba27c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:56.239823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73540354-001e-4acc-9ee4-a72f90ba27c8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:56.258997 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1198/2376] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:56.263564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73540354-001e-4acc-9ee4-a72f90ba27c8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:56.282974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73540354-001e-4acc-9ee4-a72f90ba27c8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:56.296714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c6a75-1ced-4a82-b2e5-b324c90df482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:56.297396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c6a75-1ced-4a82-b2e5-b324c90df482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:56.297694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c6a75-1ced-4a82-b2e5-b324c90df482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:56.298042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c6a75-1ced-4a82-b2e5-b324c90df482 admin admin] PATH_INFO: `/v3/projects/6171032b9ce640a9a8a216c9d8bcd374/users/34b19eb53fc54117ae00503af9d1b411/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:56.302443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c6a75-1ced-4a82-b2e5-b324c90df482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6171032b9ce640a9a8a216c9d8bcd374, user_id=34b19eb53fc54117ae00503af9d1b411, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:56.307571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c6a75-1ced-4a82-b2e5-b324c90df482 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:56.316421 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:56.335143 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1199/2377] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:56 2022] PUT /identity/v3/projects/6171032b9ce640a9a8a216c9d8bcd374/users/34b19eb53fc54117ae00503af9d1b411/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:01:56.405355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c6a75-1ced-4a82-b2e5-b324c90df482 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:56.405569 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1179/2378] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:56.586882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c6a75-1ced-4a82-b2e5-b324c90df482 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:56.601648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2dfe0-7f97-4914-962a-eeb2a956a031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:56.602662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2dfe0-7f97-4914-962a-eeb2a956a031 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:56.602962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2dfe0-7f97-4914-962a-eeb2a956a031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:56.603239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2dfe0-7f97-4914-962a-eeb2a956a031 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:56.604041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2dfe0-7f97-4914-962a-eeb2a956a031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:56.609931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2dfe0-7f97-4914-962a-eeb2a956a031 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:56.732278 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1200/2379] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:01:56 2022] POST /identity/v3/projects => generated 377 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:01:56.733123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4388eae-d373-4831-bbb6-0344985bd61b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:56.747497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4388eae-d373-4831-bbb6-0344985bd61b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:56.938540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64331918-ba53-45dc-b11d-e6d6c0a254ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:56.939216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331918-ba53-45dc-b11d-e6d6c0a254ac admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:56.946493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331918-ba53-45dc-b11d-e6d6c0a254ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:56.946875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331918-ba53-45dc-b11d-e6d6c0a254ac admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:56.950582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64331918-ba53-45dc-b11d-e6d6c0a254ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:56.957220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64331918-ba53-45dc-b11d-e6d6c0a254ac admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:57.014141 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1180/2380] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:01:56 2022] POST /identity/v3/users => generated 295 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:01:57.014439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2dfe0-7f97-4914-962a-eeb2a956a031 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:57.031292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2dfe0-7f97-4914-962a-eeb2a956a031 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:57.044095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab809f1-5118-423a-9798-50bcbfb961cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:57.054635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab809f1-5118-423a-9798-50bcbfb961cb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.054635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab809f1-5118-423a-9798-50bcbfb961cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.054635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab809f1-5118-423a-9798-50bcbfb961cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.054635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab809f1-5118-423a-9798-50bcbfb961cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:57.054635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab809f1-5118-423a-9798-50bcbfb961cb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:57.102635 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1201/2381] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:57.103827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64331918-ba53-45dc-b11d-e6d6c0a254ac admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:57.119641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64331918-ba53-45dc-b11d-e6d6c0a254ac admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:57.138507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c5b87-1d54-4888-84d4-7e011b234119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:57.139607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c5b87-1d54-4888-84d4-7e011b234119 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.139607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c5b87-1d54-4888-84d4-7e011b234119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.139837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c5b87-1d54-4888-84d4-7e011b234119 admin admin] PATH_INFO: `/v3/projects/ee64ea4e184c4c98b4c5f5963d79e178/users/9746fa619b9545d5bb797ceb9b44230a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.211284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c5b87-1d54-4888-84d4-7e011b234119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee64ea4e184c4c98b4c5f5963d79e178, user_id=9746fa619b9545d5bb797ceb9b44230a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:57.214431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c5b87-1d54-4888-84d4-7e011b234119 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:57.246162 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1181/2382] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:57 2022] PUT /identity/v3/projects/ee64ea4e184c4c98b4c5f5963d79e178/users/9746fa619b9545d5bb797ceb9b44230a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:57.250278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab809f1-5118-423a-9798-50bcbfb961cb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:57.265840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab809f1-5118-423a-9798-50bcbfb961cb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:57.401350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c5b87-1d54-4888-84d4-7e011b234119 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:57.404250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c14c5b87-1d54-4888-84d4-7e011b234119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:57.481330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1def1-88ab-4a37-b6a6-c51fa008b83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:57.482023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1def1-88ab-4a37-b6a6-c51fa008b83e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.482306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1def1-88ab-4a37-b6a6-c51fa008b83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.482576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1def1-88ab-4a37-b6a6-c51fa008b83e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.483412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1def1-88ab-4a37-b6a6-c51fa008b83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:57.484993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1def1-88ab-4a37-b6a6-c51fa008b83e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:57.515698 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1202/2383] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:01:57.516661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1def1-88ab-4a37-b6a6-c51fa008b83e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:57.538067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1def1-88ab-4a37-b6a6-c51fa008b83e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:57.557660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662342c-140f-4240-ad94-28f1961526c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:57.559048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662342c-140f-4240-ad94-28f1961526c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.559356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662342c-140f-4240-ad94-28f1961526c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.559806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662342c-140f-4240-ad94-28f1961526c3 admin admin] PATH_INFO: `/v3/projects/ee64ea4e184c4c98b4c5f5963d79e178/users/9746fa619b9545d5bb797ceb9b44230a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.562299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662342c-140f-4240-ad94-28f1961526c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee64ea4e184c4c98b4c5f5963d79e178, user_id=9746fa619b9545d5bb797ceb9b44230a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:57.563414 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:57.565713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662342c-140f-4240-ad94-28f1961526c3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:57.602443 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1203/2384] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:01:57 2022] PUT /identity/v3/projects/ee64ea4e184c4c98b4c5f5963d79e178/users/9746fa619b9545d5bb797ceb9b44230a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:57.606026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316cc0-bad4-4850-8f93-a82aa275e4fb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.606314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316cc0-bad4-4850-8f93-a82aa275e4fb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.606587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316cc0-bad4-4850-8f93-a82aa275e4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.669471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c5b87-1d54-4888-84d4-7e011b234119 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:57.675772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-86316cc0-bad4-4850-8f93-a82aa275e4fb None None] MFA Rules not processed for user `9746fa619b9545d5bb797ceb9b44230a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:57.677506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-86316cc0-bad4-4850-8f93-a82aa275e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:57.797526 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:57.856150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221fc1-9c95-4f81-95f9-de4d3aebe0b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:57.860119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221fc1-9c95-4f81-95f9-de4d3aebe0b9 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:57.861040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221fc1-9c95-4f81-95f9-de4d3aebe0b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:57.861540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221fc1-9c95-4f81-95f9-de4d3aebe0b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:57.863920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8a221fc1-9c95-4f81-95f9-de4d3aebe0b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:57.888482 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1204/2385] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:01:58.124261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a221fc1-9c95-4f81-95f9-de4d3aebe0b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:58.131585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a221fc1-9c95-4f81-95f9-de4d3aebe0b9 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:58.162560 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1182/2386] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:57 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:58.482630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86316cc0-bad4-4850-8f93-a82aa275e4fb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:58.484433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-86316cc0-bad4-4850-8f93-a82aa275e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:58.503517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86316cc0-bad4-4850-8f93-a82aa275e4fb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:58.511319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49515b6e-efb8-4a0f-b675-2230fae1894f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:58.514356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49515b6e-efb8-4a0f-b675-2230fae1894f service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:58.515155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49515b6e-efb8-4a0f-b675-2230fae1894f service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:58.515717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49515b6e-efb8-4a0f-b675-2230fae1894f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:58.527181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49515b6e-efb8-4a0f-b675-2230fae1894f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:58.529845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49515b6e-efb8-4a0f-b675-2230fae1894f service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:58.551029 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1205/2387] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:01:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:01:59.361462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221fc1-9c95-4f81-95f9-de4d3aebe0b9 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:01:59.567520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221fc1-9c95-4f81-95f9-de4d3aebe0b9 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:01:59.586249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:01:59.586946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:59.587224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:59.587499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] PATH_INFO: `/v3/users/7c7418b6f7d147e59b613468cdfc02d6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:59.588846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c7418b6f7d147e59b613468cdfc02d6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:01:59.591136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:01:59.663879 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:59.717638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c7418b6f7d147e59b613468cdfc02d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:59.748385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c7418b6f7d147e59b613468cdfc02d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:59.749152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c7418b6f7d147e59b613468cdfc02d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:59.765391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c7418b6f7d147e59b613468cdfc02d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:59.802327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c7418b6f7d147e59b613468cdfc02d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:01:59.829072 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1183/2388] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:01:59 2022] DELETE /identity/v3/users/7c7418b6f7d147e59b613468cdfc02d6 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:01:59.833819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acadf1f-4e2f-4bbf-b6a9-0c77c1639b34 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:01:59.834740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acadf1f-4e2f-4bbf-b6a9-0c77c1639b34 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:01:59.835242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acadf1f-4e2f-4bbf-b6a9-0c77c1639b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:01:59.887861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1acadf1f-4e2f-4bbf-b6a9-0c77c1639b34 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:01:59.894365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1acadf1f-4e2f-4bbf-b6a9-0c77c1639b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:01:59.993443 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1206/2389] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:00.029042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:00.030681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:00.271879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079303a5-9a7a-4f61-a41e-71afda393800 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:00.278155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ebdab-c44b-40cc-8ad8-582862ac307b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:00.279016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ebdab-c44b-40cc-8ad8-582862ac307b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:00.279377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ebdab-c44b-40cc-8ad8-582862ac307b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:00.279854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ebdab-c44b-40cc-8ad8-582862ac307b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:00.305377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ebdab-c44b-40cc-8ad8-582862ac307b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:00.307180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ebdab-c44b-40cc-8ad8-582862ac307b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:00.350082 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1184/2390] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:01.280722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5088d-7d97-4b04-b409-d9b8a5f8b700 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:01.281325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5088d-7d97-4b04-b409-d9b8a5f8b700 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:01.281325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5088d-7d97-4b04-b409-d9b8a5f8b700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:01.356216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5cb5088d-7d97-4b04-b409-d9b8a5f8b700 None None] MFA Rules not processed for user `c5237194d1c9473e8fc696a3068b80b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:01.357820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5cb5088d-7d97-4b04-b409-d9b8a5f8b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:01.519884 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1207/2391] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:01.534555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ebdab-c44b-40cc-8ad8-582862ac307b service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:01.535938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a39ebdab-c44b-40cc-8ad8-582862ac307b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:01.692361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ebdab-c44b-40cc-8ad8-582862ac307b service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:01.710763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a3cb8-3f99-4de0-a9e2-4c78219578d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:01.712529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3cb8-3f99-4de0-a9e2-4c78219578d8 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:01.713600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3cb8-3f99-4de0-a9e2-4c78219578d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:01.715288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3cb8-3f99-4de0-a9e2-4c78219578d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:01.735615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a3cb8-3f99-4de0-a9e2-4c78219578d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:01.741083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a3cb8-3f99-4de0-a9e2-4c78219578d8 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:01.781719 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1185/2392] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:02.365530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5088d-7d97-4b04-b409-d9b8a5f8b700 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:02.367087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5cb5088d-7d97-4b04-b409-d9b8a5f8b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:02.399988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5088d-7d97-4b04-b409-d9b8a5f8b700 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:02.405380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:02.406262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:02.406550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:02.406854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] PATH_INFO: `/v3/projects/95833dc0b2b343f4910fe902f4a2a45f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:02.408543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95833dc0b2b343f4910fe902f4a2a45f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:02.410639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:02.540963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95833dc0b2b343f4910fe902f4a2a45f', 'request_id': 'req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:02.544615 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:02.558883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95833dc0b2b343f4910fe902f4a2a45f', 'request_id': 'req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:02.568459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95833dc0b2b343f4910fe902f4a2a45f', 'request_id': 'req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:02.598963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] The token cache is being invalidate because project 95833dc0b2b343f4910fe902f4a2a45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:02.599647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:02.600480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:02.602907 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1208/2393] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:02 2022] DELETE /identity/v3/projects/95833dc0b2b343f4910fe902f4a2a45f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:02.607693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a3cb8-3f99-4de0-a9e2-4c78219578d8 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:02.632017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a3cb8-3f99-4de0-a9e2-4c78219578d8 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:02.702958 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:02.803215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7a4de-dd98-46d7-987e-f5bd998ff9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:02.803977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7a4de-dd98-46d7-987e-f5bd998ff9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:02.804295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7a4de-dd98-46d7-987e-f5bd998ff9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:02.804763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7a4de-dd98-46d7-987e-f5bd998ff9f4 admin admin] PATH_INFO: `/v3/users/9746fa619b9545d5bb797ceb9b44230a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:02.807244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7a4de-dd98-46d7-987e-f5bd998ff9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9746fa619b9545d5bb797ceb9b44230a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:02.809762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7a4de-dd98-46d7-987e-f5bd998ff9f4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:02.912485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aca7a4de-dd98-46d7-987e-f5bd998ff9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9746fa619b9545d5bb797ceb9b44230a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:02.937682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aca7a4de-dd98-46d7-987e-f5bd998ff9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9746fa619b9545d5bb797ceb9b44230a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:02.938971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aca7a4de-dd98-46d7-987e-f5bd998ff9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9746fa619b9545d5bb797ceb9b44230a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:02.973318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aca7a4de-dd98-46d7-987e-f5bd998ff9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9746fa619b9545d5bb797ceb9b44230a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:02.997795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aca7a4de-dd98-46d7-987e-f5bd998ff9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9746fa619b9545d5bb797ceb9b44230a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:03.012969 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1186/2394] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:02 2022] DELETE /identity/v3/users/9746fa619b9545d5bb797ceb9b44230a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:04.577329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:04.579914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:04.631570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcfd3c-8e27-4a81-8bef-83f3ca540193 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:04.777113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:04.778230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:04.779497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:04.779925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] PATH_INFO: `/v3/projects/ee64ea4e184c4c98b4c5f5963d79e178` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:04.781296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee64ea4e184c4c98b4c5f5963d79e178)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:04.783515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:04.864646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee64ea4e184c4c98b4c5f5963d79e178', 'request_id': 'req-48124546-8dac-4786-b26f-6fcd844dc4f7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:04.872478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee64ea4e184c4c98b4c5f5963d79e178', 'request_id': 'req-48124546-8dac-4786-b26f-6fcd844dc4f7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:04.880380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee64ea4e184c4c98b4c5f5963d79e178', 'request_id': 'req-48124546-8dac-4786-b26f-6fcd844dc4f7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:04.901147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] The token cache is being invalidate because project ee64ea4e184c4c98b4c5f5963d79e178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:04.902275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:04.905993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-48124546-8dac-4786-b26f-6fcd844dc4f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:04.918029 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1209/2395] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:04 2022] DELETE /identity/v3/projects/ee64ea4e184c4c98b4c5f5963d79e178 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:04.919952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ca3c1-a0ae-425d-923a-e3e2bce03724 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:04.920497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ca3c1-a0ae-425d-923a-e3e2bce03724 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:04.920497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ca3c1-a0ae-425d-923a-e3e2bce03724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:04.959847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b29ca3c1-a0ae-425d-923a-e3e2bce03724 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:04.961199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b29ca3c1-a0ae-425d-923a-e3e2bce03724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:05.098759 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1187/2396] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:05.101440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9793e73-43e2-44bc-aade-062df42f40b0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:05.102237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9793e73-43e2-44bc-aade-062df42f40b0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:05.102688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9793e73-43e2-44bc-aade-062df42f40b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:05.171546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e9793e73-43e2-44bc-aade-062df42f40b0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:05.174290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e9793e73-43e2-44bc-aade-062df42f40b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:05.196295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ca3c1-a0ae-425d-923a-e3e2bce03724 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:05.210680 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1210/2397] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:05.215073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ca3c1-a0ae-425d-923a-e3e2bce03724 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:05.220860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac6569-98b1-4dac-9a4c-57a8cf5631e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:05.221578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac6569-98b1-4dac-9a4c-57a8cf5631e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:05.221925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac6569-98b1-4dac-9a4c-57a8cf5631e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:05.222265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac6569-98b1-4dac-9a4c-57a8cf5631e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:05.224472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac6569-98b1-4dac-9a4c-57a8cf5631e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:05.224851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac6569-98b1-4dac-9a4c-57a8cf5631e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:05.227142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac6569-98b1-4dac-9a4c-57a8cf5631e5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:05.254659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9793e73-43e2-44bc-aade-062df42f40b0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:05.263739 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1188/2398] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:02:05.267691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9793e73-43e2-44bc-aade-062df42f40b0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:05.273696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe577273-611b-4cf9-a815-7f1cde67f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:05.274488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577273-611b-4cf9-a815-7f1cde67f2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:05.274895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577273-611b-4cf9-a815-7f1cde67f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:05.275263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577273-611b-4cf9-a815-7f1cde67f2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:05.276003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe577273-611b-4cf9-a815-7f1cde67f2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:05.278759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe577273-611b-4cf9-a815-7f1cde67f2a2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:05.331431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac6569-98b1-4dac-9a4c-57a8cf5631e5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:05.342971 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1211/2399] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:05 2022] POST /identity/v3/projects => generated 395 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:05.346219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac6569-98b1-4dac-9a4c-57a8cf5631e5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:05.415836 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:05.478871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1b765-0424-4590-b596-05231f81c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:05.480274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1b765-0424-4590-b596-05231f81c2aa admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:05.480734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1b765-0424-4590-b596-05231f81c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:05.481134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1b765-0424-4590-b596-05231f81c2aa admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:05.481849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1b765-0424-4590-b596-05231f81c2aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:05.485208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1b765-0424-4590-b596-05231f81c2aa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:05.536404 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1189/2400] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:05 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:05.540728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe577273-611b-4cf9-a815-7f1cde67f2a2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:05.556019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe577273-611b-4cf9-a815-7f1cde67f2a2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:05.566416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f7577-972c-4e4e-9ee4-2e3d08a1968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:05.571083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f7577-972c-4e4e-9ee4-2e3d08a1968a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:05.571363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f7577-972c-4e4e-9ee4-2e3d08a1968a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:05.571779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f7577-972c-4e4e-9ee4-2e3d08a1968a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:05.572522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f7577-972c-4e4e-9ee4-2e3d08a1968a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:05.576319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f7577-972c-4e4e-9ee4-2e3d08a1968a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:05.596056 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1212/2401] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:05.596838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1b765-0424-4590-b596-05231f81c2aa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:05.608275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1b765-0424-4590-b596-05231f81c2aa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:05.627838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74c31c-8bd3-42d5-9bdf-b1db62b896fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:05.628469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74c31c-8bd3-42d5-9bdf-b1db62b896fd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:05.628759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74c31c-8bd3-42d5-9bdf-b1db62b896fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:05.629022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74c31c-8bd3-42d5-9bdf-b1db62b896fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:05.633385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74c31c-8bd3-42d5-9bdf-b1db62b896fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:05.641525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74c31c-8bd3-42d5-9bdf-b1db62b896fd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:05.674322 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1190/2402] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:02:05.680819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f7577-972c-4e4e-9ee4-2e3d08a1968a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:05.700428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f7577-972c-4e4e-9ee4-2e3d08a1968a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:05.717372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1a3ab-da86-4905-ae3e-5eb6e8de11a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:05.718326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1a3ab-da86-4905-ae3e-5eb6e8de11a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:05.718985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1a3ab-da86-4905-ae3e-5eb6e8de11a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:05.719444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1a3ab-da86-4905-ae3e-5eb6e8de11a5 admin admin] PATH_INFO: `/v3/projects/b94d90c894bf4eac916e2ff32975efcd/users/25fbb294f2064ce386c25ce5e371a1dc/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:05.744223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1a3ab-da86-4905-ae3e-5eb6e8de11a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94d90c894bf4eac916e2ff32975efcd, user_id=25fbb294f2064ce386c25ce5e371a1dc, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:05.750367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1a3ab-da86-4905-ae3e-5eb6e8de11a5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:05.799030 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1213/2403] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:05 2022] PUT /identity/v3/projects/b94d90c894bf4eac916e2ff32975efcd/users/25fbb294f2064ce386c25ce5e371a1dc/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:05.799178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b52633-4ef8-4e36-97cc-f8cd787285bd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:05.799795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b52633-4ef8-4e36-97cc-f8cd787285bd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:05.799795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b52633-4ef8-4e36-97cc-f8cd787285bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:05.835432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-50b52633-4ef8-4e36-97cc-f8cd787285bd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:05.841721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-50b52633-4ef8-4e36-97cc-f8cd787285bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:05.978978 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1191/2404] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:06.004810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1a3ab-da86-4905-ae3e-5eb6e8de11a5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:06.008623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-15e1a3ab-da86-4905-ae3e-5eb6e8de11a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:06.024917 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:06.030189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc3e8-db2d-4b17-831b-c1b61195b355 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:06.030636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc3e8-db2d-4b17-831b-c1b61195b355 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:06.031472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc3e8-db2d-4b17-831b-c1b61195b355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:06.093547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0e7cc3e8-db2d-4b17-831b-c1b61195b355 None None] MFA Rules not processed for user `db88db7d7835406a91b0c0817126419a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:06.094937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0e7cc3e8-db2d-4b17-831b-c1b61195b355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:06.168135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1a3ab-da86-4905-ae3e-5eb6e8de11a5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:06.173127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436ea93-76fe-4872-99a1-5c706eaee9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:06.174083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ea93-76fe-4872-99a1-5c706eaee9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:06.174624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ea93-76fe-4872-99a1-5c706eaee9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:06.175122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ea93-76fe-4872-99a1-5c706eaee9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:06.191478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436ea93-76fe-4872-99a1-5c706eaee9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:06.193629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436ea93-76fe-4872-99a1-5c706eaee9f3 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:06.208621 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1214/2405] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:06.240230 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1192/2406] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:06.591603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a452-7f6f-4d11-a567-30fbe9b66ad2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:06.592168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a452-7f6f-4d11-a567-30fbe9b66ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:06.592655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a452-7f6f-4d11-a567-30fbe9b66ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:06.629762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b3f7a452-7f6f-4d11-a567-30fbe9b66ad2 None None] MFA Rules not processed for user `34b19eb53fc54117ae00503af9d1b411`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:06.632120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b3f7a452-7f6f-4d11-a567-30fbe9b66ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:06.731301 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1215/2407] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:06.740869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cc3e8-db2d-4b17-831b-c1b61195b355 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:06.743548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0e7cc3e8-db2d-4b17-831b-c1b61195b355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:06.902659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cc3e8-db2d-4b17-831b-c1b61195b355 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:06.909155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f36eb-a740-449e-849b-954a6b9192d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:06.911151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f36eb-a740-449e-849b-954a6b9192d9 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:06.911773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f36eb-a740-449e-849b-954a6b9192d9 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:06.912189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f36eb-a740-449e-849b-954a6b9192d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:06.935432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f36eb-a740-449e-849b-954a6b9192d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:06.937121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f36eb-a740-449e-849b-954a6b9192d9 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:06.943314 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:06.970559 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1193/2408] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:02:08.367570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a452-7f6f-4d11-a567-30fbe9b66ad2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:08.372473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b3f7a452-7f6f-4d11-a567-30fbe9b66ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:08.652725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a452-7f6f-4d11-a567-30fbe9b66ad2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:08.679134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c513daf-93f4-4697-ab7a-bbbd8e5da4c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:08.680846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513daf-93f4-4697-ab7a-bbbd8e5da4c6 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:08.687897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513daf-93f4-4697-ab7a-bbbd8e5da4c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:08.688341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513daf-93f4-4697-ab7a-bbbd8e5da4c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:08.691072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3c513daf-93f4-4697-ab7a-bbbd8e5da4c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:08.932070 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:09.176175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c513daf-93f4-4697-ab7a-bbbd8e5da4c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:09.181879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c513daf-93f4-4697-ab7a-bbbd8e5da4c6 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:09.238217 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1216/2409] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 871 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:13.844544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97e5fb-7737-4dfc-9f01-dcd01bcc2166 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:13.845182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97e5fb-7737-4dfc-9f01-dcd01bcc2166 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:13.845182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97e5fb-7737-4dfc-9f01-dcd01bcc2166 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:13.847148 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1194/2410] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 01:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:02:13.864703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75de2e-b799-4f4f-b025-f9b496446316 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:13.865640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75de2e-b799-4f4f-b025-f9b496446316 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:13.866104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75de2e-b799-4f4f-b025-f9b496446316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:13.908616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cf75de2e-b799-4f4f-b025-f9b496446316 None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:13.915343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cf75de2e-b799-4f4f-b025-f9b496446316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:13.936765 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1217/2411] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:02:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:14.473806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97e5fb-7737-4dfc-9f01-dcd01bcc2166 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:14.476047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-af97e5fb-7737-4dfc-9f01-dcd01bcc2166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:14.493996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97e5fb-7737-4dfc-9f01-dcd01bcc2166 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:14.509683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1cea-5aff-4c74-bc58-73e38a590ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:14.510346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1cea-5aff-4c74-bc58-73e38a590ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:14.510690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1cea-5aff-4c74-bc58-73e38a590ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:14.510953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1cea-5aff-4c74-bc58-73e38a590ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:14.544106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b1cea-5aff-4c74-bc58-73e38a590ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:14.564200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b1cea-5aff-4c74-bc58-73e38a590ea3 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:14.584101 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1195/2412] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:15.106402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75de2e-b799-4f4f-b025-f9b496446316 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:15.108327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cf75de2e-b799-4f4f-b025-f9b496446316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:15.320918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75de2e-b799-4f4f-b025-f9b496446316 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:15.335486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b36303-a465-43c9-ad4b-b16f734ee404 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:15.336282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36303-a465-43c9-ad4b-b16f734ee404 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:15.336692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36303-a465-43c9-ad4b-b16f734ee404 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:15.337027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36303-a465-43c9-ad4b-b16f734ee404 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:15.349348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-70b36303-a465-43c9-ad4b-b16f734ee404 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:15.387450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b36303-a465-43c9-ad4b-b16f734ee404 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:15.389485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b36303-a465-43c9-ad4b-b16f734ee404 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:15.418443 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1218/2413] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:15.979741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1b097-52c1-47c9-9385-ee61dcc386eb None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:15.980632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1b097-52c1-47c9-9385-ee61dcc386eb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:15.981113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1b097-52c1-47c9-9385-ee61dcc386eb None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:15.982955 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1196/2414] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 01:02:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:02:15.990064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59966fbe-656a-441d-80b3-8bd92a0368f8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:15.990741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59966fbe-656a-441d-80b3-8bd92a0368f8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:15.991248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59966fbe-656a-441d-80b3-8bd92a0368f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:16.031511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-59966fbe-656a-441d-80b3-8bd92a0368f8 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:16.033177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-59966fbe-656a-441d-80b3-8bd92a0368f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:16.063621 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1219/2415] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:02:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:16.144742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1b097-52c1-47c9-9385-ee61dcc386eb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:16.163794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1b097-52c1-47c9-9385-ee61dcc386eb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:16.183276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44df3e-7d6f-4314-98fb-de07d4c8b38a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:16.183952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44df3e-7d6f-4314-98fb-de07d4c8b38a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:16.183952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44df3e-7d6f-4314-98fb-de07d4c8b38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:16.185268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece653b6-7175-4ae2-8602-6b3a42502962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:16.186950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece653b6-7175-4ae2-8602-6b3a42502962 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:16.187686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece653b6-7175-4ae2-8602-6b3a42502962 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:16.188059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece653b6-7175-4ae2-8602-6b3a42502962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:16.208440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece653b6-7175-4ae2-8602-6b3a42502962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:16.208440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece653b6-7175-4ae2-8602-6b3a42502962 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:16.224355 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1197/2416] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:16.260509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bc44df3e-7d6f-4314-98fb-de07d4c8b38a None None] MFA Rules not processed for user `25fbb294f2064ce386c25ce5e371a1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:16.262246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bc44df3e-7d6f-4314-98fb-de07d4c8b38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:16.448659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece653b6-7175-4ae2-8602-6b3a42502962 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:16.466684 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1220/2417] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:16.476767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece653b6-7175-4ae2-8602-6b3a42502962 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:16.477790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c07f06-79c1-46a2-b6cd-a99d11a10741 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:16.478078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c07f06-79c1-46a2-b6cd-a99d11a10741 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:16.478351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c07f06-79c1-46a2-b6cd-a99d11a10741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:16.497035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bd58f-9d03-45a5-81ba-14f541a40e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:16.498053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bd58f-9d03-45a5-81ba-14f541a40e8a service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:16.498554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bd58f-9d03-45a5-81ba-14f541a40e8a service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:16.499068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bd58f-9d03-45a5-81ba-14f541a40e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:16.502189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8b2bd58f-9d03-45a5-81ba-14f541a40e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:16.539843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-93c07f06-79c1-46a2-b6cd-a99d11a10741 None None] MFA Rules not processed for user `25fbb294f2064ce386c25ce5e371a1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:16.541707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-93c07f06-79c1-46a2-b6cd-a99d11a10741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:16.551264 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1221/2418] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:16.777434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bd58f-9d03-45a5-81ba-14f541a40e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:16.779102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bd58f-9d03-45a5-81ba-14f541a40e8a service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:16.816241 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1198/2419] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:02:18.237075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c07f06-79c1-46a2-b6cd-a99d11a10741 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:18.270451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c07f06-79c1-46a2-b6cd-a99d11a10741 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:18.302249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bbe85-24ab-4492-9ef0-7d5adf7668ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:18.303290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bbe85-24ab-4492-9ef0-7d5adf7668ee service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:18.303725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bbe85-24ab-4492-9ef0-7d5adf7668ee service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:18.304534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bbe85-24ab-4492-9ef0-7d5adf7668ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:18.325766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bbe85-24ab-4492-9ef0-7d5adf7668ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:18.327723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bbe85-24ab-4492-9ef0-7d5adf7668ee service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:18.361014 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1222/2420] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:18 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:21.111976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7e87e-d12b-4e2f-aefe-6317782edbdd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:21.112548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7e87e-d12b-4e2f-aefe-6317782edbdd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:21.112548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7e87e-d12b-4e2f-aefe-6317782edbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:21.135858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dce7e87e-d12b-4e2f-aefe-6317782edbdd None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:21.137098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dce7e87e-d12b-4e2f-aefe-6317782edbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:21.252796 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1199/2421] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:02:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:21.324706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bbe85-24ab-4492-9ef0-7d5adf7668ee service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:21.326375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-318bbe85-24ab-4492-9ef0-7d5adf7668ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:21.351609 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:21.433486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bbe85-24ab-4492-9ef0-7d5adf7668ee service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:21.441487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472126e7-a974-4060-b3b7-755ecc57bfe6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:21.444077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472126e7-a974-4060-b3b7-755ecc57bfe6 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:21.445166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472126e7-a974-4060-b3b7-755ecc57bfe6 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:21.445683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472126e7-a974-4060-b3b7-755ecc57bfe6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:21.462353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472126e7-a974-4060-b3b7-755ecc57bfe6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:21.465328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472126e7-a974-4060-b3b7-755ecc57bfe6 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:21.475571 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1223/2422] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:02:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:02:23.345082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7e87e-d12b-4e2f-aefe-6317782edbdd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:23.347175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dce7e87e-d12b-4e2f-aefe-6317782edbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:23.378793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7e87e-d12b-4e2f-aefe-6317782edbdd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:23.388393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0ad5f-7186-49d6-a175-af1f6a397b6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:23.389031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0ad5f-7186-49d6-a175-af1f6a397b6f service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:23.389526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0ad5f-7186-49d6-a175-af1f6a397b6f service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:23.389986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0ad5f-7186-49d6-a175-af1f6a397b6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:23.393869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e7f0ad5f-7186-49d6-a175-af1f6a397b6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:23.623428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0ad5f-7186-49d6-a175-af1f6a397b6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:23.625103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0ad5f-7186-49d6-a175-af1f6a397b6f service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:23.671797 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1200/2423] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:28.298429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08108798-46f4-45af-943c-f62f0c494801 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:28.299680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08108798-46f4-45af-943c-f62f0c494801 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:28.300477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08108798-46f4-45af-943c-f62f0c494801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:28.330410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-08108798-46f4-45af-943c-f62f0c494801 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:28.332610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-08108798-46f4-45af-943c-f62f0c494801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:28.360526 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1224/2424] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:28.371303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0ad5f-7186-49d6-a175-af1f6a397b6f service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:28.392493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0ad5f-7186-49d6-a175-af1f6a397b6f service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:28.398123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a904aa-4867-483e-a1c6-fd340fa5741b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:28.400228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a904aa-4867-483e-a1c6-fd340fa5741b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:28.402365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a904aa-4867-483e-a1c6-fd340fa5741b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:28.403096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a904aa-4867-483e-a1c6-fd340fa5741b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:28.414004 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:28.420949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a904aa-4867-483e-a1c6-fd340fa5741b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:28.422777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a904aa-4867-483e-a1c6-fd340fa5741b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:28.443683 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1201/2425] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:36.247855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08108798-46f4-45af-943c-f62f0c494801 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:36.259717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08108798-46f4-45af-943c-f62f0c494801 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:36.265851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f632c-a4b7-49c9-991f-906e56b0189c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:36.266461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f632c-a4b7-49c9-991f-906e56b0189c service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:36.266775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f632c-a4b7-49c9-991f-906e56b0189c service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:36.267052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f632c-a4b7-49c9-991f-906e56b0189c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:36.268913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-159f632c-a4b7-49c9-991f-906e56b0189c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:36.335400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f632c-a4b7-49c9-991f-906e56b0189c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:36.338343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f632c-a4b7-49c9-991f-906e56b0189c service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:36.349025 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1225/2426] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:38.378910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e8a1-eeb1-411e-8d91-4e73bae7f11d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:38.379799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e8a1-eeb1-411e-8d91-4e73bae7f11d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:38.380241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e8a1-eeb1-411e-8d91-4e73bae7f11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:38.409756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3b60e8a1-eeb1-411e-8d91-4e73bae7f11d None None] MFA Rules not processed for user `25fbb294f2064ce386c25ce5e371a1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:38.411427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3b60e8a1-eeb1-411e-8d91-4e73bae7f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:38.421045 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1202/2427] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:40.117082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5361c4-23e1-4511-9e37-75e680f1dd20 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:40.118040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5361c4-23e1-4511-9e37-75e680f1dd20 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:40.118135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5361c4-23e1-4511-9e37-75e680f1dd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:40.157458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7d5361c4-23e1-4511-9e37-75e680f1dd20 None None] MFA Rules not processed for user `9632b1b483dd442f88e8898ef29eb257`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:40.159486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7d5361c4-23e1-4511-9e37-75e680f1dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:40.173184 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1226/2428] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:40.522001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60e8a1-eeb1-411e-8d91-4e73bae7f11d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:40.523563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3b60e8a1-eeb1-411e-8d91-4e73bae7f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:40.541560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60e8a1-eeb1-411e-8d91-4e73bae7f11d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:40.556597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de2976-6b20-4ddf-b739-6ccf116bd763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:40.559310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de2976-6b20-4ddf-b739-6ccf116bd763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:40.560727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de2976-6b20-4ddf-b739-6ccf116bd763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:40.561328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de2976-6b20-4ddf-b739-6ccf116bd763 admin admin] PATH_INFO: `/v3/users/db88db7d7835406a91b0c0817126419a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:40.564066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de2976-6b20-4ddf-b739-6ccf116bd763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db88db7d7835406a91b0c0817126419a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:40.569555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de2976-6b20-4ddf-b739-6ccf116bd763 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:40.638066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5361c4-23e1-4511-9e37-75e680f1dd20 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:40.639545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7d5361c4-23e1-4511-9e37-75e680f1dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:40.657956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9de2976-6b20-4ddf-b739-6ccf116bd763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db88db7d7835406a91b0c0817126419a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:40.660580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5361c4-23e1-4511-9e37-75e680f1dd20 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:40.670537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:40.671463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:40.671997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:40.672846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] PATH_INFO: `/v3/users/c5237194d1c9473e8fc696a3068b80b3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:40.675633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5237194d1c9473e8fc696a3068b80b3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:40.677798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:40.711119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9de2976-6b20-4ddf-b739-6ccf116bd763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db88db7d7835406a91b0c0817126419a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:40.713066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9de2976-6b20-4ddf-b739-6ccf116bd763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db88db7d7835406a91b0c0817126419a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:40.735853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9de2976-6b20-4ddf-b739-6ccf116bd763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db88db7d7835406a91b0c0817126419a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:40.754325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9de2976-6b20-4ddf-b739-6ccf116bd763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db88db7d7835406a91b0c0817126419a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:40.766709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5237194d1c9473e8fc696a3068b80b3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:40.775627 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1203/2429] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:40 2022] DELETE /identity/v3/users/db88db7d7835406a91b0c0817126419a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:40.781338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10735c-60fb-49b5-bfb0-2a8223426b96 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:40.781842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10735c-60fb-49b5-bfb0-2a8223426b96 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:40.782265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10735c-60fb-49b5-bfb0-2a8223426b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:40.802549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5237194d1c9473e8fc696a3068b80b3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:40.803265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5237194d1c9473e8fc696a3068b80b3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:40.826119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5237194d1c9473e8fc696a3068b80b3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:40.827430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5237194d1c9473e8fc696a3068b80b3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:40.831572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4c10735c-60fb-49b5-bfb0-2a8223426b96 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:40.834908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4c10735c-60fb-49b5-bfb0-2a8223426b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:40.844317 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:40.851887 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1227/2430] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:40 2022] DELETE /identity/v3/users/c5237194d1c9473e8fc696a3068b80b3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:40.959087 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1204/2431] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:40.986477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:40.988074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:41.077660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b187d5d-9cfc-4a62-bd40-51f6aed739b0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:41.081442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14710c8b-63ad-4c0d-a572-22978bcb3ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:41.082348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14710c8b-63ad-4c0d-a572-22978bcb3ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:41.082805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14710c8b-63ad-4c0d-a572-22978bcb3ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:41.093180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14710c8b-63ad-4c0d-a572-22978bcb3ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:41.181489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14710c8b-63ad-4c0d-a572-22978bcb3ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:41.182741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14710c8b-63ad-4c0d-a572-22978bcb3ac8 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:41.194237 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1228/2432] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:41.365055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10735c-60fb-49b5-bfb0-2a8223426b96 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:41.367243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4c10735c-60fb-49b5-bfb0-2a8223426b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:41.396147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10735c-60fb-49b5-bfb0-2a8223426b96 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:41.403890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:41.405132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:41.405506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:41.406193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] PATH_INFO: `/v3/projects/2134c2d6449647069d1da3a7ed02d53c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:41.407647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2134c2d6449647069d1da3a7ed02d53c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:41.424416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:41.488012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2134c2d6449647069d1da3a7ed02d53c', 'request_id': 'req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.495057 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:41.495862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2134c2d6449647069d1da3a7ed02d53c', 'request_id': 'req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.505687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2134c2d6449647069d1da3a7ed02d53c', 'request_id': 'req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.517881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14710c8b-63ad-4c0d-a572-22978bcb3ac8 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:41.519723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-14710c8b-63ad-4c0d-a572-22978bcb3ac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:41.525174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] The token cache is being invalidate because project 2134c2d6449647069d1da3a7ed02d53c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:41.525655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.526192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f71c4b5b-98d2-4e4f-bbbf-c9e964db1dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.528891 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1205/2433] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:41 2022] DELETE /identity/v3/projects/2134c2d6449647069d1da3a7ed02d53c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:41.533756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe4dcf-4793-4b7a-8c04-825f040b01c1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:41.534223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe4dcf-4793-4b7a-8c04-825f040b01c1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:41.534651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe4dcf-4793-4b7a-8c04-825f040b01c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:41.556715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14710c8b-63ad-4c0d-a572-22978bcb3ac8 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:41.558224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bffe4dcf-4793-4b7a-8c04-825f040b01c1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:41.559784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bffe4dcf-4793-4b7a-8c04-825f040b01c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:41.645662 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1206/2434] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:41.647297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c0854-4df3-4581-93df-b45ca5fa17a6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:41.649138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c0854-4df3-4581-93df-b45ca5fa17a6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:41.651029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c0854-4df3-4581-93df-b45ca5fa17a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:41.663628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:41.668238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:41.669586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:41.670061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] PATH_INFO: `/v3/projects/ccda90f956d541b38c3e71181f397da9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:41.673907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccda90f956d541b38c3e71181f397da9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:41.677874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:41.704634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-383c0854-4df3-4581-93df-b45ca5fa17a6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:41.706083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-383c0854-4df3-4581-93df-b45ca5fa17a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:41.724654 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1207/2435] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:41.725940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c0854-4df3-4581-93df-b45ca5fa17a6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:41.744350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c0854-4df3-4581-93df-b45ca5fa17a6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:41.756161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8104e4b-b533-43c4-bf26-257be58d3fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:41.757928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8104e4b-b533-43c4-bf26-257be58d3fda admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:41.759418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8104e4b-b533-43c4-bf26-257be58d3fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:41.760037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8104e4b-b533-43c4-bf26-257be58d3fda admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:41.760923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8104e4b-b533-43c4-bf26-257be58d3fda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:41.761389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8104e4b-b533-43c4-bf26-257be58d3fda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:41.763543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8104e4b-b533-43c4-bf26-257be58d3fda admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:41.783968 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1208/2436] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:02:41.785311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8104e4b-b533-43c4-bf26-257be58d3fda admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:41.816334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8104e4b-b533-43c4-bf26-257be58d3fda admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:41.841924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccda90f956d541b38c3e71181f397da9', 'request_id': 'req-7b8f1bae-c495-445f-b890-23b42fd8ca52'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.845972 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:41.866513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccda90f956d541b38c3e71181f397da9', 'request_id': 'req-7b8f1bae-c495-445f-b890-23b42fd8ca52'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.907225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccda90f956d541b38c3e71181f397da9', 'request_id': 'req-7b8f1bae-c495-445f-b890-23b42fd8ca52'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.934884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] The token cache is being invalidate because project ccda90f956d541b38c3e71181f397da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:41.935922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.939934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:41.942125 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1229/2437] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:41 2022] DELETE /identity/v3/projects/ccda90f956d541b38c3e71181f397da9 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:02:41.946552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:41.948353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430944ac-fd50-4362-9122-91c698536da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:41.952196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430944ac-fd50-4362-9122-91c698536da7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:41.952489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430944ac-fd50-4362-9122-91c698536da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:41.952768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430944ac-fd50-4362-9122-91c698536da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:41.953421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430944ac-fd50-4362-9122-91c698536da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:41.955418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430944ac-fd50-4362-9122-91c698536da7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:41.956571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:41.986430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1bae-c495-445f-b890-23b42fd8ca52 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:41.995564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:41.996491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:41.996916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:41.997938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] PATH_INFO: `/v3/users/26f84cba21224ece90597a70548be27c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:41.999582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f84cba21224ece90597a70548be27c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.006129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.028598 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1209/2438] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:41 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:42.031916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430944ac-fd50-4362-9122-91c698536da7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.035390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-430944ac-fd50-4362-9122-91c698536da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:42.101894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f84cba21224ece90597a70548be27c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.124086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f84cba21224ece90597a70548be27c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.124973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f84cba21224ece90597a70548be27c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.130156 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:42.137372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f84cba21224ece90597a70548be27c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.139667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f84cba21224ece90597a70548be27c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.170285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430944ac-fd50-4362-9122-91c698536da7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.186144 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1230/2439] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:41 2022] DELETE /identity/v3/users/26f84cba21224ece90597a70548be27c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:42.191818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56781-119d-4610-91a0-c29f1262c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.192594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56781-119d-4610-91a0-c29f1262c8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.192771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56781-119d-4610-91a0-c29f1262c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.193012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56781-119d-4610-91a0-c29f1262c8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.194435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f56781-119d-4610-91a0-c29f1262c8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.196522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f56781-119d-4610-91a0-c29f1262c8a7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.263485 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1210/2440] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:42 2022] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:42.268923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.270630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:42.434368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdfbc9-5f0a-4cd0-ae57-36069da8addc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.445049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65097bb3-025c-4086-9e2b-0683e6bf5c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.446069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65097bb3-025c-4086-9e2b-0683e6bf5c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.446445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65097bb3-025c-4086-9e2b-0683e6bf5c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.447839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65097bb3-025c-4086-9e2b-0683e6bf5c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.447839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65097bb3-025c-4086-9e2b-0683e6bf5c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.449638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65097bb3-025c-4086-9e2b-0683e6bf5c80 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.473681 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1231/2441] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:42.474628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56781-119d-4610-91a0-c29f1262c8a7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.495262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56781-119d-4610-91a0-c29f1262c8a7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.505335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adadd21-7077-4574-ba5f-3de1b8ae53ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.505952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adadd21-7077-4574-ba5f-3de1b8ae53ff admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.506714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adadd21-7077-4574-ba5f-3de1b8ae53ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.506714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adadd21-7077-4574-ba5f-3de1b8ae53ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.507332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adadd21-7077-4574-ba5f-3de1b8ae53ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.529882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adadd21-7077-4574-ba5f-3de1b8ae53ff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.548604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65097bb3-025c-4086-9e2b-0683e6bf5c80 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.556716 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1211/2442] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:42.562530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65097bb3-025c-4086-9e2b-0683e6bf5c80 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.573148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ab8bb-2c30-4f94-b4aa-dfa846a77fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.574011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ab8bb-2c30-4f94-b4aa-dfa846a77fef admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.574294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ab8bb-2c30-4f94-b4aa-dfa846a77fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.574573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ab8bb-2c30-4f94-b4aa-dfa846a77fef admin admin] PATH_INFO: `/v3/projects/6de56413032b40df98e028d42179977d/users/e7a94e3bcf294afc9a33e907fd5205ee/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.609040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ab8bb-2c30-4f94-b4aa-dfa846a77fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de56413032b40df98e028d42179977d, user_id=e7a94e3bcf294afc9a33e907fd5205ee, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.612522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ab8bb-2c30-4f94-b4aa-dfa846a77fef admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.636059 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1232/2443] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:42 2022] PUT /identity/v3/projects/6de56413032b40df98e028d42179977d/users/e7a94e3bcf294afc9a33e907fd5205ee/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:42.647415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc3f61-49c2-4012-bb69-f5c4d3129526 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.647994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc3f61-49c2-4012-bb69-f5c4d3129526 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.649076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc3f61-49c2-4012-bb69-f5c4d3129526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.718483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a7dc3f61-49c2-4012-bb69-f5c4d3129526 None None] MFA Rules not processed for user `e7a94e3bcf294afc9a33e907fd5205ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:42.720800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a7dc3f61-49c2-4012-bb69-f5c4d3129526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:42.755339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ab8bb-2c30-4f94-b4aa-dfa846a77fef admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.757656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-409ab8bb-2c30-4f94-b4aa-dfa846a77fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:42.796563 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:42.868543 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1212/2444] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:42.879180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ab8bb-2c30-4f94-b4aa-dfa846a77fef admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:42.885152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc3f61-49c2-4012-bb69-f5c4d3129526 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:42.887191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a7dc3f61-49c2-4012-bb69-f5c4d3129526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:42.887914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:42.889413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:42.889757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:42.890100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] PATH_INFO: `/v3/projects/91376eda082f416a8db90b79d1f90b44` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:42.891766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91376eda082f416a8db90b79d1f90b44)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:42.897253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:42.992394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91376eda082f416a8db90b79d1f90b44', 'request_id': 'req-9ee62273-097e-46b5-84cb-d12735162e80'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.998868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91376eda082f416a8db90b79d1f90b44', 'request_id': 'req-9ee62273-097e-46b5-84cb-d12735162e80'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:42.999813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc3f61-49c2-4012-bb69-f5c4d3129526 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:43.006761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91376eda082f416a8db90b79d1f90b44', 'request_id': 'req-9ee62273-097e-46b5-84cb-d12735162e80'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:43.023048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] The token cache is being invalidate because project 91376eda082f416a8db90b79d1f90b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:43.023410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:43.024860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9ee62273-097e-46b5-84cb-d12735162e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:43.030719 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1233/2445] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:42 2022] DELETE /identity/v3/projects/91376eda082f416a8db90b79d1f90b44 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:02:43.033370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9c2f-95ea-4b11-969b-3a7256821a37 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:43.033651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9c2f-95ea-4b11-969b-3a7256821a37 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:43.033932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9c2f-95ea-4b11-969b-3a7256821a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:43.091007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-33be9c2f-95ea-4b11-969b-3a7256821a37 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:43.092381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-33be9c2f-95ea-4b11-969b-3a7256821a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:43.134887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff888906-38a7-4cf0-b8bb-ed09e9ae6575 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:43.135785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888906-38a7-4cf0-b8bb-ed09e9ae6575 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:43.136087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888906-38a7-4cf0-b8bb-ed09e9ae6575 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:43.136445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888906-38a7-4cf0-b8bb-ed09e9ae6575 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:43.140755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ff888906-38a7-4cf0-b8bb-ed09e9ae6575 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:43.176167 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:43.209276 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1234/2446] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:43.218319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a3473-6ea5-47a2-9969-cbec2bc28f85 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:43.218909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a3473-6ea5-47a2-9969-cbec2bc28f85 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:43.220016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a3473-6ea5-47a2-9969-cbec2bc28f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:43.228053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff888906-38a7-4cf0-b8bb-ed09e9ae6575 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:43.231368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff888906-38a7-4cf0-b8bb-ed09e9ae6575 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:43.245743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c03a3473-6ea5-47a2-9969-cbec2bc28f85 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:43.247370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c03a3473-6ea5-47a2-9969-cbec2bc28f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:43.248502 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1213/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:43.283441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff888906-38a7-4cf0-b8bb-ed09e9ae6575 service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:43.283626 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1235/2448] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:43.306367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff888906-38a7-4cf0-b8bb-ed09e9ae6575 service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:43.313179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f858a5-d19b-4be0-a343-82af0c94ae06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:43.313991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f858a5-d19b-4be0-a343-82af0c94ae06 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:43.314307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f858a5-d19b-4be0-a343-82af0c94ae06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:43.314587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f858a5-d19b-4be0-a343-82af0c94ae06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:43.315288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f858a5-d19b-4be0-a343-82af0c94ae06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:43.315598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f858a5-d19b-4be0-a343-82af0c94ae06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:43.317213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f858a5-d19b-4be0-a343-82af0c94ae06 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:43.338364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a3473-6ea5-47a2-9969-cbec2bc28f85 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:43.342691 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1214/2449] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:02:43.351623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a3473-6ea5-47a2-9969-cbec2bc28f85 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:43.358134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b306fd-f86d-46c9-a45e-86421346edcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:43.358837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b306fd-f86d-46c9-a45e-86421346edcd admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:43.359135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b306fd-f86d-46c9-a45e-86421346edcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:43.359409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b306fd-f86d-46c9-a45e-86421346edcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:43.360056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b306fd-f86d-46c9-a45e-86421346edcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:43.363680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b306fd-f86d-46c9-a45e-86421346edcd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:43.410053 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1236/2450] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:43 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:43.411353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f858a5-d19b-4be0-a343-82af0c94ae06 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:43.423463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f858a5-d19b-4be0-a343-82af0c94ae06 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:43.482808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b77fd-21b4-40c7-b0dc-610f7ee9e47f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:43.483098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b77fd-21b4-40c7-b0dc-610f7ee9e47f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:43.483381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b77fd-21b4-40c7-b0dc-610f7ee9e47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:43.514561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0c5b77fd-21b4-40c7-b0dc-610f7ee9e47f None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:43.515823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0c5b77fd-21b4-40c7-b0dc-610f7ee9e47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:43.535184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e5ac9-68a3-47ab-8140-5ed01cecaf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:43.535810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e5ac9-68a3-47ab-8140-5ed01cecaf6e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:43.536094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e5ac9-68a3-47ab-8140-5ed01cecaf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:43.536378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e5ac9-68a3-47ab-8140-5ed01cecaf6e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:43.537032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e5ac9-68a3-47ab-8140-5ed01cecaf6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:43.540457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e5ac9-68a3-47ab-8140-5ed01cecaf6e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:43.579767 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:43.604127 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1215/2451] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:43 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:02:43.609076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e5ac9-68a3-47ab-8140-5ed01cecaf6e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:43.637241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e5ac9-68a3-47ab-8140-5ed01cecaf6e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:43.654794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed446-b352-45c5-975e-d4cbeef03a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:43.655591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed446-b352-45c5-975e-d4cbeef03a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:43.655967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed446-b352-45c5-975e-d4cbeef03a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:43.657479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed446-b352-45c5-975e-d4cbeef03a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:43.658354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed446-b352-45c5-975e-d4cbeef03a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:43.664632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed446-b352-45c5-975e-d4cbeef03a46 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:43.687058 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1237/2452] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:43.696343 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1216/2453] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:43.698319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b77fd-21b4-40c7-b0dc-610f7ee9e47f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:43.702408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed446-b352-45c5-975e-d4cbeef03a46 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:43.705693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-adaed446-b352-45c5-975e-d4cbeef03a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:43.720495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b77fd-21b4-40c7-b0dc-610f7ee9e47f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:43.730888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24564615-36f2-436e-aa02-3cb5db923e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:43.731831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564615-36f2-436e-aa02-3cb5db923e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:43.732399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564615-36f2-436e-aa02-3cb5db923e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:43.732847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564615-36f2-436e-aa02-3cb5db923e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:43.733703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24564615-36f2-436e-aa02-3cb5db923e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:43.736139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24564615-36f2-436e-aa02-3cb5db923e87 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:43.759832 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1238/2454] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:43.761029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24564615-36f2-436e-aa02-3cb5db923e87 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:43.786181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24564615-36f2-436e-aa02-3cb5db923e87 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:43.799011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b7bba-8064-430b-8f24-769957b1a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:43.801793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b7bba-8064-430b-8f24-769957b1a1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:43.802168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b7bba-8064-430b-8f24-769957b1a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:43.805626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b7bba-8064-430b-8f24-769957b1a1ee admin admin] PATH_INFO: `/v3/projects/c2953e9d791647b581579764a0cc9132/users/22b93021138b404a875daf73cc9dd2d4/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:43.842304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b7bba-8064-430b-8f24-769957b1a1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2953e9d791647b581579764a0cc9132, user_id=22b93021138b404a875daf73cc9dd2d4, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:43.844581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b7bba-8064-430b-8f24-769957b1a1ee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:43.873263 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1239/2455] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:43 2022] PUT /identity/v3/projects/c2953e9d791647b581579764a0cc9132/users/22b93021138b404a875daf73cc9dd2d4/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:43.873513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed446-b352-45c5-975e-d4cbeef03a46 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:43.880247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a618-86bc-400a-a055-8daa6b0a9f1a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:43.880565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a618-86bc-400a-a055-8daa6b0a9f1a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:43.880851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a618-86bc-400a-a055-8daa6b0a9f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:43.950835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fa82a618-86bc-400a-a055-8daa6b0a9f1a None None] MFA Rules not processed for user `22b93021138b404a875daf73cc9dd2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:43.952843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fa82a618-86bc-400a-a055-8daa6b0a9f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:44.006359 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:44.055741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e420d1-a4b1-42c7-b4ab-9740005a39a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:44.056460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e420d1-a4b1-42c7-b4ab-9740005a39a6 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:44.057835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e420d1-a4b1-42c7-b4ab-9740005a39a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:44.059699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e420d1-a4b1-42c7-b4ab-9740005a39a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:44.136383 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1240/2456] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:44.137848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82a618-86bc-400a-a055-8daa6b0a9f1a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:44.156894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e420d1-a4b1-42c7-b4ab-9740005a39a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:44.159847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e420d1-a4b1-42c7-b4ab-9740005a39a6 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:44.174345 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1217/2457] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:02:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:02:44.253887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82a618-86bc-400a-a055-8daa6b0a9f1a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:44.253887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aaeb2-a4cf-4dc9-80a5-911c9cf56da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:44.253887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aaeb2-a4cf-4dc9-80a5-911c9cf56da7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:44.253887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aaeb2-a4cf-4dc9-80a5-911c9cf56da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:44.254447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aaeb2-a4cf-4dc9-80a5-911c9cf56da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:44.254447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aaeb2-a4cf-4dc9-80a5-911c9cf56da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:44.254447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aaeb2-a4cf-4dc9-80a5-911c9cf56da7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:44.306485 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1241/2458] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:44 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:44.313350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e420d1-a4b1-42c7-b4ab-9740005a39a6 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:44.336916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c2742-9b18-403b-8b7d-98b522154922 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:44.342452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c2742-9b18-403b-8b7d-98b522154922 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:44.342768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c2742-9b18-403b-8b7d-98b522154922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:44.354377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e420d1-a4b1-42c7-b4ab-9740005a39a6 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:44.417778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-543c2742-9b18-403b-8b7d-98b522154922 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:44.419031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-543c2742-9b18-403b-8b7d-98b522154922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:44.433779 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:44.510460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21266cdb-d0df-4d9e-91d2-9df21a0ab78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:44.511128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21266cdb-d0df-4d9e-91d2-9df21a0ab78d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:44.511410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21266cdb-d0df-4d9e-91d2-9df21a0ab78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:44.511745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21266cdb-d0df-4d9e-91d2-9df21a0ab78d admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:44.513192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21266cdb-d0df-4d9e-91d2-9df21a0ab78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:44.515881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21266cdb-d0df-4d9e-91d2-9df21a0ab78d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:44.545818 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1242/2459] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:44.548429 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1218/2460] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:44 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:44.549767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c2742-9b18-403b-8b7d-98b522154922 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:44.562775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21266cdb-d0df-4d9e-91d2-9df21a0ab78d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:44.563377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c2742-9b18-403b-8b7d-98b522154922 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:44.569737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa0f4f-8db1-43b2-8525-cf697ce78eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:44.571271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0f4f-8db1-43b2-8525-cf697ce78eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:44.571602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0f4f-8db1-43b2-8525-cf697ce78eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:44.571886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0f4f-8db1-43b2-8525-cf697ce78eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:44.572600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa0f4f-8db1-43b2-8525-cf697ce78eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:44.576238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa0f4f-8db1-43b2-8525-cf697ce78eb1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:44.590176 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1243/2461] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:44.595359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa0f4f-8db1-43b2-8525-cf697ce78eb1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:44.623336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa0f4f-8db1-43b2-8525-cf697ce78eb1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:44.637030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf6f1f-5a4a-481e-bd10-2533ba67e43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:44.638098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf6f1f-5a4a-481e-bd10-2533ba67e43f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:44.640218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf6f1f-5a4a-481e-bd10-2533ba67e43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:44.641443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf6f1f-5a4a-481e-bd10-2533ba67e43f admin admin] PATH_INFO: `/v3/projects/dc018690319a4f47a98a3998ced9652c/users/b1e6a033eda84c5d8a8cf27a3d38a4aa/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:44.683622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf6f1f-5a4a-481e-bd10-2533ba67e43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc018690319a4f47a98a3998ced9652c, user_id=b1e6a033eda84c5d8a8cf27a3d38a4aa, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:44.687885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf6f1f-5a4a-481e-bd10-2533ba67e43f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:44.722946 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1244/2462] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:44 2022] PUT /identity/v3/projects/dc018690319a4f47a98a3998ced9652c/users/b1e6a033eda84c5d8a8cf27a3d38a4aa/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:44.727719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf6f1f-5a4a-481e-bd10-2533ba67e43f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:44.727935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21266cdb-d0df-4d9e-91d2-9df21a0ab78d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:44.739006 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:44.856604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf6f1f-5a4a-481e-bd10-2533ba67e43f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:44.866405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ad982-1b9b-476e-8720-dadd32c830d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:44.867799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ad982-1b9b-476e-8720-dadd32c830d4 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:44.868082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ad982-1b9b-476e-8720-dadd32c830d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:44.868338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ad982-1b9b-476e-8720-dadd32c830d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:44.869848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf54817-473d-4687-8364-89492346a00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:44.870558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf54817-473d-4687-8364-89492346a00e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:44.871013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf54817-473d-4687-8364-89492346a00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:44.871532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf54817-473d-4687-8364-89492346a00e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:44.872060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf54817-473d-4687-8364-89492346a00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:44.875356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf54817-473d-4687-8364-89492346a00e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:44.909102 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1245/2463] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:44.913427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf54817-473d-4687-8364-89492346a00e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:44.977879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf54817-473d-4687-8364-89492346a00e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:44.994004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c674fdf-9e2e-470d-a47a-f98a8f742ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:44.995409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674fdf-9e2e-470d-a47a-f98a8f742ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:44.996518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674fdf-9e2e-470d-a47a-f98a8f742ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:44.996965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674fdf-9e2e-470d-a47a-f98a8f742ca0 admin admin] PATH_INFO: `/v3/projects/dc018690319a4f47a98a3998ced9652c/users/b1e6a033eda84c5d8a8cf27a3d38a4aa/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:45.002694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c674fdf-9e2e-470d-a47a-f98a8f742ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc018690319a4f47a98a3998ced9652c, user_id=b1e6a033eda84c5d8a8cf27a3d38a4aa, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:45.013163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ad982-1b9b-476e-8720-dadd32c830d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:45.014213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c674fdf-9e2e-470d-a47a-f98a8f742ca0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:45.017064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ad982-1b9b-476e-8720-dadd32c830d4 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:45.036587 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1219/2464] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:02:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:02:45.036900 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1246/2465] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:44 2022] PUT /identity/v3/projects/dc018690319a4f47a98a3998ced9652c/users/b1e6a033eda84c5d8a8cf27a3d38a4aa/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:45.051296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d78da6-5a27-4c2a-8fa9-2ac8cd21eb18 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:45.055475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d78da6-5a27-4c2a-8fa9-2ac8cd21eb18 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:45.056024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d78da6-5a27-4c2a-8fa9-2ac8cd21eb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:45.120124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b4bb-59fc-4997-a19e-032fce3cde8e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:45.120525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b4bb-59fc-4997-a19e-032fce3cde8e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:45.120874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b4bb-59fc-4997-a19e-032fce3cde8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:45.131501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-62d78da6-5a27-4c2a-8fa9-2ac8cd21eb18 None None] MFA Rules not processed for user `b1e6a033eda84c5d8a8cf27a3d38a4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:45.134505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62d78da6-5a27-4c2a-8fa9-2ac8cd21eb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:45.167261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7269b4bb-59fc-4997-a19e-032fce3cde8e None None] MFA Rules not processed for user `6da1976f703f402788953f3332a281de`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:45.169097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7269b4bb-59fc-4997-a19e-032fce3cde8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:45.267484 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1220/2466] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:45.285037 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1247/2467] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:45.706590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d78da6-5a27-4c2a-8fa9-2ac8cd21eb18 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:45.708181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62d78da6-5a27-4c2a-8fa9-2ac8cd21eb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:45.749607 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:45.788673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d78da6-5a27-4c2a-8fa9-2ac8cd21eb18 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:45.795569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab36e5d-d503-4e39-a1f2-3884a55a9d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:45.796270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab36e5d-d503-4e39-a1f2-3884a55a9d69 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:45.796627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab36e5d-d503-4e39-a1f2-3884a55a9d69 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:45.796971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab36e5d-d503-4e39-a1f2-3884a55a9d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:45.807251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab36e5d-d503-4e39-a1f2-3884a55a9d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:45.809137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab36e5d-d503-4e39-a1f2-3884a55a9d69 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:45.820417 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1221/2468] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:47.674053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b4bb-59fc-4997-a19e-032fce3cde8e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:47.696294 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:47.802111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b4bb-59fc-4997-a19e-032fce3cde8e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:47.816027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:47.817385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:47.817385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:47.817385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] PATH_INFO: `/v3/users/22b93021138b404a875daf73cc9dd2d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:47.818850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b93021138b404a875daf73cc9dd2d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:47.821828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:47.921139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b93021138b404a875daf73cc9dd2d4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:47.942223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b93021138b404a875daf73cc9dd2d4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:47.944028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b93021138b404a875daf73cc9dd2d4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:47.978782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b93021138b404a875daf73cc9dd2d4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:47.979464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b93021138b404a875daf73cc9dd2d4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:47.997698 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1248/2469] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:47 2022] DELETE /identity/v3/users/22b93021138b404a875daf73cc9dd2d4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:48.004517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc34d-5077-4f10-83ac-79a92edc3af0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:48.005059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc34d-5077-4f10-83ac-79a92edc3af0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:48.005156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc34d-5077-4f10-83ac-79a92edc3af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:48.048350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9b4dc34d-5077-4f10-83ac-79a92edc3af0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:48.049578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b4dc34d-5077-4f10-83ac-79a92edc3af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:48.191281 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1222/2470] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:48.202718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:48.204512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:48.314524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee88b8-1131-4386-bed0-cbb159a4f724 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:48.321232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb36f4-eceb-4f07-82c6-2ed653432800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:48.322010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb36f4-eceb-4f07-82c6-2ed653432800 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:48.322292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb36f4-eceb-4f07-82c6-2ed653432800 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:48.322746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb36f4-eceb-4f07-82c6-2ed653432800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:48.353048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb36f4-eceb-4f07-82c6-2ed653432800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:48.354545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb36f4-eceb-4f07-82c6-2ed653432800 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:48.373309 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1249/2471] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:49.531154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dc34d-5077-4f10-83ac-79a92edc3af0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:49.537148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b4dc34d-5077-4f10-83ac-79a92edc3af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:49.582797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dc34d-5077-4f10-83ac-79a92edc3af0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:49.605232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:49.606092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:49.606514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:49.606952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] PATH_INFO: `/v3/projects/c2953e9d791647b581579764a0cc9132` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:49.609678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2953e9d791647b581579764a0cc9132)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:49.613933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:49.715919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2953e9d791647b581579764a0cc9132', 'request_id': 'req-3c25dd25-ae62-482d-8e44-be6058b3c66b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:49.736236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2953e9d791647b581579764a0cc9132', 'request_id': 'req-3c25dd25-ae62-482d-8e44-be6058b3c66b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:49.743990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2953e9d791647b581579764a0cc9132', 'request_id': 'req-3c25dd25-ae62-482d-8e44-be6058b3c66b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:49.769513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] The token cache is being invalidate because project c2953e9d791647b581579764a0cc9132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:49.769815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:49.770855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:49.774926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1223/2472] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:49 2022] DELETE /identity/v3/projects/c2953e9d791647b581579764a0cc9132 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:49.778716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb36f4-eceb-4f07-82c6-2ed653432800 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:49.794806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb36f4-eceb-4f07-82c6-2ed653432800 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:49.855831 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:49.944690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aaec54-e2bb-4a9c-9b27-9288324cafb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:49.946129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaec54-e2bb-4a9c-9b27-9288324cafb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:49.946561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaec54-e2bb-4a9c-9b27-9288324cafb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:49.947136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaec54-e2bb-4a9c-9b27-9288324cafb9 admin admin] PATH_INFO: `/v3/users/b1e6a033eda84c5d8a8cf27a3d38a4aa` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:49.951447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aaec54-e2bb-4a9c-9b27-9288324cafb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e6a033eda84c5d8a8cf27a3d38a4aa)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:49.960471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aaec54-e2bb-4a9c-9b27-9288324cafb9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:50.126198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25aaec54-e2bb-4a9c-9b27-9288324cafb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e6a033eda84c5d8a8cf27a3d38a4aa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:50.166561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25aaec54-e2bb-4a9c-9b27-9288324cafb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e6a033eda84c5d8a8cf27a3d38a4aa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:50.168035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25aaec54-e2bb-4a9c-9b27-9288324cafb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e6a033eda84c5d8a8cf27a3d38a4aa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:50.184548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25aaec54-e2bb-4a9c-9b27-9288324cafb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e6a033eda84c5d8a8cf27a3d38a4aa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:50.185376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25aaec54-e2bb-4a9c-9b27-9288324cafb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e6a033eda84c5d8a8cf27a3d38a4aa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:50.225284 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1250/2473] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:49 2022] DELETE /identity/v3/users/b1e6a033eda84c5d8a8cf27a3d38a4aa => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:51.404573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:51.406341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:51.434943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25dd25-ae62-482d-8e44-be6058b3c66b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:51.550770 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:51.628901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:51.628901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:51.628901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:51.628901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] PATH_INFO: `/v3/projects/dc018690319a4f47a98a3998ced9652c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:51.631726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc018690319a4f47a98a3998ced9652c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:51.634934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:51.749627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc018690319a4f47a98a3998ced9652c', 'request_id': 'req-bfe6e287-9c09-447e-8dbd-7b671993e65f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:51.769771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc018690319a4f47a98a3998ced9652c', 'request_id': 'req-bfe6e287-9c09-447e-8dbd-7b671993e65f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:51.784588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc018690319a4f47a98a3998ced9652c', 'request_id': 'req-bfe6e287-9c09-447e-8dbd-7b671993e65f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:51.809777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] The token cache is being invalidate because project dc018690319a4f47a98a3998ced9652c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:51.810133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:51.812551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfe6e287-9c09-447e-8dbd-7b671993e65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:51.818413 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1224/2474] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:51 2022] DELETE /identity/v3/projects/dc018690319a4f47a98a3998ced9652c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:51.824411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8146fe-e231-4012-b18a-3937b695d93c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:51.824894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8146fe-e231-4012-b18a-3937b695d93c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:51.824894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8146fe-e231-4012-b18a-3937b695d93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:51.864016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0f8146fe-e231-4012-b18a-3937b695d93c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:51.865734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0f8146fe-e231-4012-b18a-3937b695d93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:52.019979 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1251/2475] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:52.027654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e127-5e5d-4e7e-9930-aeccd7c78cc1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:52.028204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e127-5e5d-4e7e-9930-aeccd7c78cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:52.028642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e127-5e5d-4e7e-9930-aeccd7c78cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:52.094662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4137e127-5e5d-4e7e-9930-aeccd7c78cc1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:52.094662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4137e127-5e5d-4e7e-9930-aeccd7c78cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:52.104548 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1225/2476] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:52.105068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8146fe-e231-4012-b18a-3937b695d93c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:52.116391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8146fe-e231-4012-b18a-3937b695d93c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:52.121744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6bb12-faf8-4bd3-9a11-8dc89974f351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:52.122359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6bb12-faf8-4bd3-9a11-8dc89974f351 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:52.122660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6bb12-faf8-4bd3-9a11-8dc89974f351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:52.122934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6bb12-faf8-4bd3-9a11-8dc89974f351 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:52.123888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6bb12-faf8-4bd3-9a11-8dc89974f351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:52.124327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6bb12-faf8-4bd3-9a11-8dc89974f351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:52.125929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6bb12-faf8-4bd3-9a11-8dc89974f351 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:52.140026 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1252/2477] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:02:52.144307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e127-5e5d-4e7e-9930-aeccd7c78cc1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:52.155753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e127-5e5d-4e7e-9930-aeccd7c78cc1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:52.161191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b73e2-10d8-4040-8a85-bca7dd63ebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:52.161815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b73e2-10d8-4040-8a85-bca7dd63ebaa admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:52.162099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b73e2-10d8-4040-8a85-bca7dd63ebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:52.162375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b73e2-10d8-4040-8a85-bca7dd63ebaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:52.163054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b73e2-10d8-4040-8a85-bca7dd63ebaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:52.165777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b73e2-10d8-4040-8a85-bca7dd63ebaa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:52.205851 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1226/2478] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:52 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:52.212979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6bb12-faf8-4bd3-9a11-8dc89974f351 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:52.238584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6bb12-faf8-4bd3-9a11-8dc89974f351 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:52.321965 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:52.401833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f58879-4746-4e70-a439-832b300d0f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:52.402504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f58879-4746-4e70-a439-832b300d0f39 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:52.403432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f58879-4746-4e70-a439-832b300d0f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:52.403766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f58879-4746-4e70-a439-832b300d0f39 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:52.404456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f58879-4746-4e70-a439-832b300d0f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:52.407143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f58879-4746-4e70-a439-832b300d0f39 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:52.473878 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1253/2479] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:52 2022] POST /identity/v3/users => generated 289 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:52.482144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b73e2-10d8-4040-8a85-bca7dd63ebaa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:52.499720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b73e2-10d8-4040-8a85-bca7dd63ebaa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:52.525164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc01fb-bf2a-4466-9dc7-d3ae8d0108e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:52.526865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc01fb-bf2a-4466-9dc7-d3ae8d0108e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:52.527229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc01fb-bf2a-4466-9dc7-d3ae8d0108e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:52.527576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc01fb-bf2a-4466-9dc7-d3ae8d0108e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:52.529334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc01fb-bf2a-4466-9dc7-d3ae8d0108e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:52.534367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc01fb-bf2a-4466-9dc7-d3ae8d0108e3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:52.560903 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1227/2480] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:52.564725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f58879-4746-4e70-a439-832b300d0f39 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:52.578531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f58879-4746-4e70-a439-832b300d0f39 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:52.584477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8ab5c-4ef2-4105-8256-16f704354f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:52.586445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8ab5c-4ef2-4105-8256-16f704354f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:52.587010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8ab5c-4ef2-4105-8256-16f704354f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:52.587507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8ab5c-4ef2-4105-8256-16f704354f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:52.588430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8ab5c-4ef2-4105-8256-16f704354f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:52.590686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8ab5c-4ef2-4105-8256-16f704354f79 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:52.604748 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1254/2481] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:52.609209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc01fb-bf2a-4466-9dc7-d3ae8d0108e3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:52.620190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc01fb-bf2a-4466-9dc7-d3ae8d0108e3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:52.625091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c714ff-aba8-4266-9ea3-4f8eac9cf65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:52.625763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c714ff-aba8-4266-9ea3-4f8eac9cf65c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:52.626038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c714ff-aba8-4266-9ea3-4f8eac9cf65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:52.626312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c714ff-aba8-4266-9ea3-4f8eac9cf65c admin admin] PATH_INFO: `/v3/projects/0fd660a90be5405e87ff60814f9649d0/users/9c45885a45664da09722d33b2de4f17c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:52.659746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c714ff-aba8-4266-9ea3-4f8eac9cf65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd660a90be5405e87ff60814f9649d0, user_id=9c45885a45664da09722d33b2de4f17c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:52.664988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c714ff-aba8-4266-9ea3-4f8eac9cf65c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:52.690669 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1228/2482] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:52 2022] PUT /identity/v3/projects/0fd660a90be5405e87ff60814f9649d0/users/9c45885a45664da09722d33b2de4f17c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:52.699363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f15fe-0b09-4ee0-9fed-1a817745a475 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:52.699655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f15fe-0b09-4ee0-9fed-1a817745a475 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:52.699935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f15fe-0b09-4ee0-9fed-1a817745a475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:52.771823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-041f15fe-0b09-4ee0-9fed-1a817745a475 None None] MFA Rules not processed for user `9c45885a45664da09722d33b2de4f17c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:52.778415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-041f15fe-0b09-4ee0-9fed-1a817745a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:52.886641 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1255/2483] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:52.889313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c714ff-aba8-4266-9ea3-4f8eac9cf65c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:52.976763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c714ff-aba8-4266-9ea3-4f8eac9cf65c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:52.981943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bab4c-e516-4e14-afb3-a3f69138ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:52.983273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bab4c-e516-4e14-afb3-a3f69138ae11 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:52.983620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bab4c-e516-4e14-afb3-a3f69138ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:52.983930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bab4c-e516-4e14-afb3-a3f69138ae11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:52.984608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bab4c-e516-4e14-afb3-a3f69138ae11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:52.986770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bab4c-e516-4e14-afb3-a3f69138ae11 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:53.005634 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:53.068934 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1229/2484] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:52 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:53.073220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f15fe-0b09-4ee0-9fed-1a817745a475 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:53.093040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f15fe-0b09-4ee0-9fed-1a817745a475 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:53.259259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758ca98-9ca2-4cdf-850f-66c39007478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:53.259912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758ca98-9ca2-4cdf-850f-66c39007478b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:53.260194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758ca98-9ca2-4cdf-850f-66c39007478b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:53.260470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758ca98-9ca2-4cdf-850f-66c39007478b admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:53.261110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758ca98-9ca2-4cdf-850f-66c39007478b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:53.263080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758ca98-9ca2-4cdf-850f-66c39007478b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:53.318242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bab4c-e516-4e14-afb3-a3f69138ae11 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:53.335138 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1256/2485] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:53 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:53.340387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bab4c-e516-4e14-afb3-a3f69138ae11 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:53.346086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea008ee1-b120-48d1-8735-e23e148206df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:53.361337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea008ee1-b120-48d1-8735-e23e148206df admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:53.365752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea008ee1-b120-48d1-8735-e23e148206df admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:53.366033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea008ee1-b120-48d1-8735-e23e148206df admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:53.367102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea008ee1-b120-48d1-8735-e23e148206df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:53.368766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea008ee1-b120-48d1-8735-e23e148206df admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:53.389345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758ca98-9ca2-4cdf-850f-66c39007478b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:53.389734 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1230/2486] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:53.404412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758ca98-9ca2-4cdf-850f-66c39007478b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:53.412745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91883de-bb27-4104-b4a5-d1a91e6fba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:53.413966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91883de-bb27-4104-b4a5-d1a91e6fba46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:53.414247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91883de-bb27-4104-b4a5-d1a91e6fba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:53.414523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91883de-bb27-4104-b4a5-d1a91e6fba46 admin admin] PATH_INFO: `/v3/projects/e34265f07cc84c6ab09be62868e54763/users/dfa23c1c3c804e17b09e45a0bf5f44f5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:53.449059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91883de-bb27-4104-b4a5-d1a91e6fba46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e34265f07cc84c6ab09be62868e54763, user_id=dfa23c1c3c804e17b09e45a0bf5f44f5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:53.451888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91883de-bb27-4104-b4a5-d1a91e6fba46 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:53.485952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea008ee1-b120-48d1-8735-e23e148206df admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:53.486455 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1257/2487] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:53 2022] PUT /identity/v3/projects/e34265f07cc84c6ab09be62868e54763/users/dfa23c1c3c804e17b09e45a0bf5f44f5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:02:53.500907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea008ee1-b120-48d1-8735-e23e148206df admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:53.607634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb444a8-5cb8-466f-ac4b-c0ecf3104325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:53.608273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb444a8-5cb8-466f-ac4b-c0ecf3104325 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:53.608657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb444a8-5cb8-466f-ac4b-c0ecf3104325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:53.608957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb444a8-5cb8-466f-ac4b-c0ecf3104325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:53.610041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb444a8-5cb8-466f-ac4b-c0ecf3104325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:53.612092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb444a8-5cb8-466f-ac4b-c0ecf3104325 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:53.636829 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1231/2488] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:02:53.638047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91883de-bb27-4104-b4a5-d1a91e6fba46 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:53.652896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91883de-bb27-4104-b4a5-d1a91e6fba46 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:53.658152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadc151-79de-4e56-9f21-017198556ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:53.659173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc151-79de-4e56-9f21-017198556ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:53.659616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc151-79de-4e56-9f21-017198556ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:53.660038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc151-79de-4e56-9f21-017198556ccd admin admin] PATH_INFO: `/v3/projects/e34265f07cc84c6ab09be62868e54763/users/dfa23c1c3c804e17b09e45a0bf5f44f5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:53.662345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadc151-79de-4e56-9f21-017198556ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e34265f07cc84c6ab09be62868e54763, user_id=dfa23c1c3c804e17b09e45a0bf5f44f5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:53.665943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadc151-79de-4e56-9f21-017198556ccd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:53.670557 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:53.693534 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1258/2489] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:53 2022] PUT /identity/v3/projects/e34265f07cc84c6ab09be62868e54763/users/dfa23c1c3c804e17b09e45a0bf5f44f5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:53.711701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4bc9-3d25-4336-9fae-06f10bc36418 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:53.712342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4bc9-3d25-4336-9fae-06f10bc36418 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:53.712634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4bc9-3d25-4336-9fae-06f10bc36418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:53.751479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-97eb4bc9-3d25-4336-9fae-06f10bc36418 None None] MFA Rules not processed for user `dfa23c1c3c804e17b09e45a0bf5f44f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:53.752741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-97eb4bc9-3d25-4336-9fae-06f10bc36418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:53.785196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e999835-bda5-403d-ae23-e2d599abfe13 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:53.785196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e999835-bda5-403d-ae23-e2d599abfe13 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:53.785196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e999835-bda5-403d-ae23-e2d599abfe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:53.827371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9e999835-bda5-403d-ae23-e2d599abfe13 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:53.828620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9e999835-bda5-403d-ae23-e2d599abfe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:53.942045 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1232/2490] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:53.955559 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1259/2491] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:02:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:53.983620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb4bc9-3d25-4336-9fae-06f10bc36418 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:53.985435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-97eb4bc9-3d25-4336-9fae-06f10bc36418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:54.052797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e999835-bda5-403d-ae23-e2d599abfe13 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:54.061498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9e999835-bda5-403d-ae23-e2d599abfe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:54.156960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb4bc9-3d25-4336-9fae-06f10bc36418 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:54.167057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259317-76c4-4f71-950f-65eaf59881f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:54.167726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259317-76c4-4f71-950f-65eaf59881f3 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:54.167989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259317-76c4-4f71-950f-65eaf59881f3 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:54.168265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259317-76c4-4f71-950f-65eaf59881f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:54.175089 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:54.177825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21259317-76c4-4f71-950f-65eaf59881f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:54.182094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e999835-bda5-403d-ae23-e2d599abfe13 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:54.182277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21259317-76c4-4f71-950f-65eaf59881f3 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:54.185460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae0d51-8a8e-44d8-8c62-2319e2561891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:54.186789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0d51-8a8e-44d8-8c62-2319e2561891 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:54.187138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0d51-8a8e-44d8-8c62-2319e2561891 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:54.187628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0d51-8a8e-44d8-8c62-2319e2561891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:54.198144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae0d51-8a8e-44d8-8c62-2319e2561891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:54.198787 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1233/2492] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:02:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:02:54.199773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae0d51-8a8e-44d8-8c62-2319e2561891 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:54.211207 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1260/2493] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:54.346185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259317-76c4-4f71-950f-65eaf59881f3 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:54.347848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-21259317-76c4-4f71-950f-65eaf59881f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:54.435972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259317-76c4-4f71-950f-65eaf59881f3 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:54.440984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:54.441637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:54.441973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:54.442252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] PATH_INFO: `/v3/users/e7a94e3bcf294afc9a33e907fd5205ee` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:54.443443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a94e3bcf294afc9a33e907fd5205ee)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:54.451365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:54.544070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a94e3bcf294afc9a33e907fd5205ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:54.560595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a94e3bcf294afc9a33e907fd5205ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:54.561431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a94e3bcf294afc9a33e907fd5205ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:54.572649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a94e3bcf294afc9a33e907fd5205ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:54.583670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a94e3bcf294afc9a33e907fd5205ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:54.593791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1234/2494] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:54 2022] DELETE /identity/v3/users/e7a94e3bcf294afc9a33e907fd5205ee => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:54.598243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb379ff-1040-4784-bbe1-52fa891e8f8d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:54.598534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb379ff-1040-4784-bbe1-52fa891e8f8d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:54.598835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb379ff-1040-4784-bbe1-52fa891e8f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:54.628651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bdb379ff-1040-4784-bbe1-52fa891e8f8d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:54.629885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bdb379ff-1040-4784-bbe1-52fa891e8f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:54.756098 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1261/2495] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:54.767330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:54.768897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:54.854883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090b430-5b45-4dae-85e6-c122610146cb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:54.859819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83dafd-e59a-448c-bd6d-c35c43354d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:54.860126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83dafd-e59a-448c-bd6d-c35c43354d9c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:54.860412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83dafd-e59a-448c-bd6d-c35c43354d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:54.860700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83dafd-e59a-448c-bd6d-c35c43354d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:54.872758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83dafd-e59a-448c-bd6d-c35c43354d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:54.874234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83dafd-e59a-448c-bd6d-c35c43354d9c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:54.886631 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1235/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:55.067573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb379ff-1040-4784-bbe1-52fa891e8f8d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:55.069020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bdb379ff-1040-4784-bbe1-52fa891e8f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:55.083334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb379ff-1040-4784-bbe1-52fa891e8f8d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:55.095414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:55.096076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:55.096361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:55.096638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] PATH_INFO: `/v3/users/9c45885a45664da09722d33b2de4f17c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:55.097801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c45885a45664da09722d33b2de4f17c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:55.099822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:55.187351 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:55.255398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c45885a45664da09722d33b2de4f17c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:55.299165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c45885a45664da09722d33b2de4f17c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:55.302700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c45885a45664da09722d33b2de4f17c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:55.328465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c45885a45664da09722d33b2de4f17c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:55.329765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c45885a45664da09722d33b2de4f17c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:55.422411 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1262/2497] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:55 2022] DELETE /identity/v3/users/9c45885a45664da09722d33b2de4f17c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:55.426901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb41869-c6ac-4dc8-a6af-e95dc6ed46e2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:55.427182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb41869-c6ac-4dc8-a6af-e95dc6ed46e2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:55.427461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb41869-c6ac-4dc8-a6af-e95dc6ed46e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:55.453712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bfb41869-c6ac-4dc8-a6af-e95dc6ed46e2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:55.455398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bfb41869-c6ac-4dc8-a6af-e95dc6ed46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:55.473256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:55.475057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:55.481834 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:55.586701 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1236/2498] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:55.606951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb41869-c6ac-4dc8-a6af-e95dc6ed46e2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:55.611851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bfb41869-c6ac-4dc8-a6af-e95dc6ed46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:55.643450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617f68-d0b9-43d9-ad8f-1cb61b3adc98 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:55.655081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:55.656246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:55.657211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:55.657642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] PATH_INFO: `/v3/projects/6de56413032b40df98e028d42179977d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:55.659490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de56413032b40df98e028d42179977d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:55.663673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:55.707430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb41869-c6ac-4dc8-a6af-e95dc6ed46e2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:55.720789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0224c-092e-43cc-8560-729c019306ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:55.720789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0224c-092e-43cc-8560-729c019306ef service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:55.720789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0224c-092e-43cc-8560-729c019306ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:55.720789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0224c-092e-43cc-8560-729c019306ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:55.738570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0224c-092e-43cc-8560-729c019306ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:55.740043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0224c-092e-43cc-8560-729c019306ef service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:55.746005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de56413032b40df98e028d42179977d', 'request_id': 'req-74962fce-8b8a-47a2-b722-d91f66918066'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:55.759484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de56413032b40df98e028d42179977d', 'request_id': 'req-74962fce-8b8a-47a2-b722-d91f66918066'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:55.769818 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1237/2499] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:02:55.770834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de56413032b40df98e028d42179977d', 'request_id': 'req-74962fce-8b8a-47a2-b722-d91f66918066'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:55.799019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] The token cache is being invalidate because project 6de56413032b40df98e028d42179977d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:55.799601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:55.800502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74962fce-8b8a-47a2-b722-d91f66918066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:55.806857 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1263/2500] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:55 2022] DELETE /identity/v3/projects/6de56413032b40df98e028d42179977d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:55.814195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cd11b-7655-4c4b-a0ef-b18510d91bfe None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:55.814711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cd11b-7655-4c4b-a0ef-b18510d91bfe None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:55.815088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cd11b-7655-4c4b-a0ef-b18510d91bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:55.837223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-463cd11b-7655-4c4b-a0ef-b18510d91bfe None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:55.838655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-463cd11b-7655-4c4b-a0ef-b18510d91bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:55.921880 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1238/2501] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:55.929495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa49dd7-bc88-461f-a957-3527f90234ac None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:55.929927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa49dd7-bc88-461f-a957-3527f90234ac None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:55.930672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa49dd7-bc88-461f-a957-3527f90234ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:55.983690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5aa49dd7-bc88-461f-a957-3527f90234ac None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:55.987612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5aa49dd7-bc88-461f-a957-3527f90234ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:56.006247 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1264/2502] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:56.010777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cd11b-7655-4c4b-a0ef-b18510d91bfe None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:56.022350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cd11b-7655-4c4b-a0ef-b18510d91bfe None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:56.029456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef25da-5f19-42fc-85c7-67e45198f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:56.030756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef25da-5f19-42fc-85c7-67e45198f817 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:56.031146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef25da-5f19-42fc-85c7-67e45198f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:56.031543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef25da-5f19-42fc-85c7-67e45198f817 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:56.032433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef25da-5f19-42fc-85c7-67e45198f817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:56.032845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef25da-5f19-42fc-85c7-67e45198f817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:56.034892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef25da-5f19-42fc-85c7-67e45198f817 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:56.051205 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1239/2503] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:02:56.056097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa49dd7-bc88-461f-a957-3527f90234ac None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:56.068089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa49dd7-bc88-461f-a957-3527f90234ac None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:56.077770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7ab93-c812-45b7-8100-52a99abd55e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:56.078625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7ab93-c812-45b7-8100-52a99abd55e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:56.079086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7ab93-c812-45b7-8100-52a99abd55e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:56.079550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7ab93-c812-45b7-8100-52a99abd55e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:56.080895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7ab93-c812-45b7-8100-52a99abd55e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:56.083307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7ab93-c812-45b7-8100-52a99abd55e8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:56.113911 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:56.125638 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1265/2504] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:56 2022] POST /identity/v3/projects => generated 363 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:56.129899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef25da-5f19-42fc-85c7-67e45198f817 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:56.144105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef25da-5f19-42fc-85c7-67e45198f817 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:56.204934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7ab93-c812-45b7-8100-52a99abd55e8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:56.206497 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:56.209356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2ae7ab93-c812-45b7-8100-52a99abd55e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:56.229477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667956f-c588-432b-b3cc-35b9e20f4973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:56.230222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667956f-c588-432b-b3cc-35b9e20f4973 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:56.230666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667956f-c588-432b-b3cc-35b9e20f4973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:56.231253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667956f-c588-432b-b3cc-35b9e20f4973 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:56.232787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667956f-c588-432b-b3cc-35b9e20f4973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:56.235371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667956f-c588-432b-b3cc-35b9e20f4973 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:56.268394 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1240/2505] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:56 2022] POST /identity/v3/users => generated 282 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:56.269378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667956f-c588-432b-b3cc-35b9e20f4973 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:56.282855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667956f-c588-432b-b3cc-35b9e20f4973 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:56.290324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8216a8-936e-4708-970b-eccf7552c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:56.291074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8216a8-936e-4708-970b-eccf7552c477 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:56.291759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8216a8-936e-4708-970b-eccf7552c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:56.292232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8216a8-936e-4708-970b-eccf7552c477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:56.293064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8216a8-936e-4708-970b-eccf7552c477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:56.295166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8216a8-936e-4708-970b-eccf7552c477 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:56.311431 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1241/2506] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:56.315457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8216a8-936e-4708-970b-eccf7552c477 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:56.326587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7ab93-c812-45b7-8100-52a99abd55e8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:56.329058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8216a8-936e-4708-970b-eccf7552c477 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:56.333316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:56.334065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:56.334416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:56.334928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] PATH_INFO: `/v3/projects/0fd660a90be5405e87ff60814f9649d0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:56.336597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e47742-9b3c-49f7-b19e-1596da56f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:56.336963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd660a90be5405e87ff60814f9649d0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:56.337563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e47742-9b3c-49f7-b19e-1596da56f5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:56.337995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e47742-9b3c-49f7-b19e-1596da56f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:56.338475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e47742-9b3c-49f7-b19e-1596da56f5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:56.341837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:56.342353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e47742-9b3c-49f7-b19e-1596da56f5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:56.345215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e47742-9b3c-49f7-b19e-1596da56f5f8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:56.363702 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1242/2507] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:02:56.368327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e47742-9b3c-49f7-b19e-1596da56f5f8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:56.383934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e47742-9b3c-49f7-b19e-1596da56f5f8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:56.390335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084eae64-f4b3-407e-8e27-d2e63e56f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:56.391196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eae64-f4b3-407e-8e27-d2e63e56f4be admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:56.391478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eae64-f4b3-407e-8e27-d2e63e56f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:56.392229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eae64-f4b3-407e-8e27-d2e63e56f4be admin admin] PATH_INFO: `/v3/projects/4ad7cba3465048b195bfe5d870860bdf/users/0db18eb48be64e72a9419d4e7452ca5b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:56.412852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084eae64-f4b3-407e-8e27-d2e63e56f4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad7cba3465048b195bfe5d870860bdf, user_id=0db18eb48be64e72a9419d4e7452ca5b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:56.416146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084eae64-f4b3-407e-8e27-d2e63e56f4be admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:56.423969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd660a90be5405e87ff60814f9649d0', 'request_id': 'req-9be09cf0-52be-4afc-bd41-04e4c3213a7c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:56.435982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd660a90be5405e87ff60814f9649d0', 'request_id': 'req-9be09cf0-52be-4afc-bd41-04e4c3213a7c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:56.445018 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1243/2508] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:56 2022] PUT /identity/v3/projects/4ad7cba3465048b195bfe5d870860bdf/users/0db18eb48be64e72a9419d4e7452ca5b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:02:56.446584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd660a90be5405e87ff60814f9649d0', 'request_id': 'req-9be09cf0-52be-4afc-bd41-04e4c3213a7c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:56.453644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c144c-5bc8-4fae-9253-c31fea1af35f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:56.454072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c144c-5bc8-4fae-9253-c31fea1af35f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:56.454453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c144c-5bc8-4fae-9253-c31fea1af35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:56.462827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] The token cache is being invalidate because project 0fd660a90be5405e87ff60814f9649d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:56.463518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:56.464454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:56.470657 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1266/2509] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:56 2022] DELETE /identity/v3/projects/0fd660a90be5405e87ff60814f9649d0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:02:56.471786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:56.473523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:56.502279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6a3c144c-5bc8-4fae-9253-c31fea1af35f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:56.503523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6a3c144c-5bc8-4fae-9253-c31fea1af35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:56.615085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09cf0-52be-4afc-bd41-04e4c3213a7c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:56.639022 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1244/2510] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:56.651096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c144c-5bc8-4fae-9253-c31fea1af35f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:56.653142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6a3c144c-5bc8-4fae-9253-c31fea1af35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:56.666946 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:56.702082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6e75c-a00e-407f-b2b8-d701d24da95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:56.702791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6e75c-a00e-407f-b2b8-d701d24da95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:56.703073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6e75c-a00e-407f-b2b8-d701d24da95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:56.703344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6e75c-a00e-407f-b2b8-d701d24da95d admin admin] PATH_INFO: `/v3/users/dfa23c1c3c804e17b09e45a0bf5f44f5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:56.704808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6e75c-a00e-407f-b2b8-d701d24da95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa23c1c3c804e17b09e45a0bf5f44f5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:56.707006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6e75c-a00e-407f-b2b8-d701d24da95d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:56.752898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c144c-5bc8-4fae-9253-c31fea1af35f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:56.759490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb10d1-ba6d-48e5-a64f-ac62a95cab01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:56.760168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb10d1-ba6d-48e5-a64f-ac62a95cab01 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:56.760457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb10d1-ba6d-48e5-a64f-ac62a95cab01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:56.760840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb10d1-ba6d-48e5-a64f-ac62a95cab01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:56.787424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1ad6e75c-a00e-407f-b2b8-d701d24da95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa23c1c3c804e17b09e45a0bf5f44f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:56.793245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb10d1-ba6d-48e5-a64f-ac62a95cab01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:56.795220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb10d1-ba6d-48e5-a64f-ac62a95cab01 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:56.809266 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1245/2511] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:02:56.831606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1ad6e75c-a00e-407f-b2b8-d701d24da95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa23c1c3c804e17b09e45a0bf5f44f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:56.832560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1ad6e75c-a00e-407f-b2b8-d701d24da95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa23c1c3c804e17b09e45a0bf5f44f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:56.848057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1ad6e75c-a00e-407f-b2b8-d701d24da95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa23c1c3c804e17b09e45a0bf5f44f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:56.848789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1ad6e75c-a00e-407f-b2b8-d701d24da95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa23c1c3c804e17b09e45a0bf5f44f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:56.874143 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1267/2512] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:02:56 2022] DELETE /identity/v3/users/dfa23c1c3c804e17b09e45a0bf5f44f5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:57.482492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb10d1-ba6d-48e5-a64f-ac62a95cab01 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:57.497070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb10d1-ba6d-48e5-a64f-ac62a95cab01 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:57.547233 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:57.613090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:57.614109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:57.615314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:57.617571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] PATH_INFO: `/v3/projects/e34265f07cc84c6ab09be62868e54763` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:57.619756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e34265f07cc84c6ab09be62868e54763)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:57.622320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:57.685092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e34265f07cc84c6ab09be62868e54763', 'request_id': 'req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:57.699874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e34265f07cc84c6ab09be62868e54763', 'request_id': 'req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:57.709937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e34265f07cc84c6ab09be62868e54763', 'request_id': 'req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:57.732836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] The token cache is being invalidate because project e34265f07cc84c6ab09be62868e54763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:02:57.733636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:57.735822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2602e7cb-cb18-4eeb-9c6a-a9a97a3aaa90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:02:57.738676 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1246/2513] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:02:57 2022] DELETE /identity/v3/projects/e34265f07cc84c6ab09be62868e54763 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:57.745180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42a41f-ab0f-4b23-8a59-5db2b8102104 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:57.746199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42a41f-ab0f-4b23-8a59-5db2b8102104 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:57.746781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42a41f-ab0f-4b23-8a59-5db2b8102104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:57.777884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4d42a41f-ab0f-4b23-8a59-5db2b8102104 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:57.779667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4d42a41f-ab0f-4b23-8a59-5db2b8102104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:57.875776 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1268/2514] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:57.885907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9a258-8e4d-4c67-bc12-4ceb37ff5097 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:57.886269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9a258-8e4d-4c67-bc12-4ceb37ff5097 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:57.886547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9a258-8e4d-4c67-bc12-4ceb37ff5097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:57.910158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cde9a258-8e4d-4c67-bc12-4ceb37ff5097 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:57.911619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cde9a258-8e4d-4c67-bc12-4ceb37ff5097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:57.921129 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1247/2515] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:57.925602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42a41f-ab0f-4b23-8a59-5db2b8102104 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:57.937388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42a41f-ab0f-4b23-8a59-5db2b8102104 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:57.952352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e6b01-a2db-4f46-a508-6fc2455734ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:57.952977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6b01-a2db-4f46-a508-6fc2455734ee admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:57.953255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6b01-a2db-4f46-a508-6fc2455734ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:57.953527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6b01-a2db-4f46-a508-6fc2455734ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:57.954181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e6b01-a2db-4f46-a508-6fc2455734ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:02:57.954487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e6b01-a2db-4f46-a508-6fc2455734ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:57.956114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e6b01-a2db-4f46-a508-6fc2455734ee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:58.003318 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1269/2516] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:02:58.005920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9a258-8e4d-4c67-bc12-4ceb37ff5097 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:58.017127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9a258-8e4d-4c67-bc12-4ceb37ff5097 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:58.023168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f738447-1062-4056-97a4-f1181a730cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:58.024019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f738447-1062-4056-97a4-f1181a730cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:58.024922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f738447-1062-4056-97a4-f1181a730cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:58.025215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f738447-1062-4056-97a4-f1181a730cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:58.025863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f738447-1062-4056-97a4-f1181a730cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:58.029518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f738447-1062-4056-97a4-f1181a730cb6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:58.075191 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1248/2517] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:58 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:58.079555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e6b01-a2db-4f46-a508-6fc2455734ee admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:58.098360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e6b01-a2db-4f46-a508-6fc2455734ee admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:58.196979 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:58.223781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5fa6d-d0b6-4a4f-97c3-97144318067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:58.224541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5fa6d-d0b6-4a4f-97c3-97144318067c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:58.224964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5fa6d-d0b6-4a4f-97c3-97144318067c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:58.225339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5fa6d-d0b6-4a4f-97c3-97144318067c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:58.227376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5fa6d-d0b6-4a4f-97c3-97144318067c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:58.230992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5fa6d-d0b6-4a4f-97c3-97144318067c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:58.268901 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1270/2518] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:58 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:58.274548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f738447-1062-4056-97a4-f1181a730cb6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:58.292760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f738447-1062-4056-97a4-f1181a730cb6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:58.309801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425412b4-935d-4ca2-88b4-e5b726feb2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:58.311095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425412b4-935d-4ca2-88b4-e5b726feb2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:58.311528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425412b4-935d-4ca2-88b4-e5b726feb2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:58.311977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425412b4-935d-4ca2-88b4-e5b726feb2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:58.313053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425412b4-935d-4ca2-88b4-e5b726feb2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:58.314888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425412b4-935d-4ca2-88b4-e5b726feb2a4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:58.348368 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1249/2519] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:58.353309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5fa6d-d0b6-4a4f-97c3-97144318067c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:58.370046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5fa6d-d0b6-4a4f-97c3-97144318067c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:58.384265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1c5ee-acad-4681-9e21-b642c6c7f545 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:58.384929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1c5ee-acad-4681-9e21-b642c6c7f545 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:58.385373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1c5ee-acad-4681-9e21-b642c6c7f545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:58.391695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d823259-f95c-496d-ba06-1c66641bb433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:58.394882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d823259-f95c-496d-ba06-1c66641bb433 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:58.395448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d823259-f95c-496d-ba06-1c66641bb433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:58.396464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d823259-f95c-496d-ba06-1c66641bb433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:58.397889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d823259-f95c-496d-ba06-1c66641bb433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:58.405821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d823259-f95c-496d-ba06-1c66641bb433 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:58.421657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-deb1c5ee-acad-4681-9e21-b642c6c7f545 None None] MFA Rules not processed for user `0533d6c52e394ecc980d67c7d985076e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:58.424228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-deb1c5ee-acad-4681-9e21-b642c6c7f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:58.446385 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1271/2520] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:58.454508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d823259-f95c-496d-ba06-1c66641bb433 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:58.482771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d823259-f95c-496d-ba06-1c66641bb433 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:58.505857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3656163-203a-4cbc-8e2d-a4247061ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:58.508290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656163-203a-4cbc-8e2d-a4247061ccf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:58.510415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656163-203a-4cbc-8e2d-a4247061ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:58.511281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656163-203a-4cbc-8e2d-a4247061ccf3 admin admin] PATH_INFO: `/v3/projects/2ad32ba8ecd94ce6a63b80885bfd9b43/users/39155d87c91f4ec48011aff0457ea412/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:58.539279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3656163-203a-4cbc-8e2d-a4247061ccf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad32ba8ecd94ce6a63b80885bfd9b43, user_id=39155d87c91f4ec48011aff0457ea412, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:58.542412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3656163-203a-4cbc-8e2d-a4247061ccf3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:58.573196 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1272/2521] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:58 2022] PUT /identity/v3/projects/2ad32ba8ecd94ce6a63b80885bfd9b43/users/39155d87c91f4ec48011aff0457ea412/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:58.575779 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1250/2522] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:58 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:02:58.586361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af37fe-cdec-4d60-bcd8-70671366ee5f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:58.592931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af37fe-cdec-4d60-bcd8-70671366ee5f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:58.593482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af37fe-cdec-4d60-bcd8-70671366ee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:58.657890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f4af37fe-cdec-4d60-bcd8-70671366ee5f None None] MFA Rules not processed for user `39155d87c91f4ec48011aff0457ea412`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:58.659530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f4af37fe-cdec-4d60-bcd8-70671366ee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:58.779596 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1273/2523] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:02:58.784070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1c5ee-acad-4681-9e21-b642c6c7f545 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:58.802396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1c5ee-acad-4681-9e21-b642c6c7f545 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:58.848265 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:58.904131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff76a4-8a8c-40e7-bd5f-66ce22fc1dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:58.905863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff76a4-8a8c-40e7-bd5f-66ce22fc1dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:58.906243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff76a4-8a8c-40e7-bd5f-66ce22fc1dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:58.906626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff76a4-8a8c-40e7-bd5f-66ce22fc1dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:58.907513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff76a4-8a8c-40e7-bd5f-66ce22fc1dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:58.909699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff76a4-8a8c-40e7-bd5f-66ce22fc1dd0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:58.993042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af37fe-cdec-4d60-bcd8-70671366ee5f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:58.994808 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1251/2524] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:02:58 2022] POST /identity/v3/projects => generated 395 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:59.012668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af37fe-cdec-4d60-bcd8-70671366ee5f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:59.136308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093a78f-fc18-4e7f-a54f-3ae440ae7fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:59.137399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093a78f-fc18-4e7f-a54f-3ae440ae7fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:59.140287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093a78f-fc18-4e7f-a54f-3ae440ae7fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:59.140675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093a78f-fc18-4e7f-a54f-3ae440ae7fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:59.141956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093a78f-fc18-4e7f-a54f-3ae440ae7fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:59.145629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093a78f-fc18-4e7f-a54f-3ae440ae7fd3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:59.197921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff76a4-8a8c-40e7-bd5f-66ce22fc1dd0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:59.202733 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1274/2525] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:02:58 2022] POST /identity/v3/users => generated 304 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:02:59.221611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff76a4-8a8c-40e7-bd5f-66ce22fc1dd0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:59.228517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c23dc-78b1-4ba9-b9e2-596714bae7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:59.229146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c23dc-78b1-4ba9-b9e2-596714bae7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:59.229449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c23dc-78b1-4ba9-b9e2-596714bae7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:59.229698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c23dc-78b1-4ba9-b9e2-596714bae7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:59.230507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c23dc-78b1-4ba9-b9e2-596714bae7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:59.232899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c23dc-78b1-4ba9-b9e2-596714bae7ac admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:59.248030 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1252/2526] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:59.251978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093a78f-fc18-4e7f-a54f-3ae440ae7fd3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:59.264914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093a78f-fc18-4e7f-a54f-3ae440ae7fd3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:59.270317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56293d62-92e7-42bc-9f53-7cdfb58c9474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:59.271358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56293d62-92e7-42bc-9f53-7cdfb58c9474 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:59.271358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56293d62-92e7-42bc-9f53-7cdfb58c9474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:59.271601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56293d62-92e7-42bc-9f53-7cdfb58c9474 admin admin] PATH_INFO: `/v3/projects/def80b25e55c4d0ca6571fe855fb8abf/users/6bd2a529a71f49718a4e842f6e6bef78/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:59.290727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56293d62-92e7-42bc-9f53-7cdfb58c9474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def80b25e55c4d0ca6571fe855fb8abf, user_id=6bd2a529a71f49718a4e842f6e6bef78, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:59.293726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56293d62-92e7-42bc-9f53-7cdfb58c9474 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:59.296264 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:59.323178 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1275/2527] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:59 2022] PUT /identity/v3/projects/def80b25e55c4d0ca6571fe855fb8abf/users/6bd2a529a71f49718a4e842f6e6bef78/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:59.326926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c23dc-78b1-4ba9-b9e2-596714bae7ac admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:59.340580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c23dc-78b1-4ba9-b9e2-596714bae7ac admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:59.456485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9273a-a512-4417-8f00-a7c7c1d161a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:59.457324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9273a-a512-4417-8f00-a7c7c1d161a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:59.457707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9273a-a512-4417-8f00-a7c7c1d161a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:59.458083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9273a-a512-4417-8f00-a7c7c1d161a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:59.458919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9273a-a512-4417-8f00-a7c7c1d161a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:59.464369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9273a-a512-4417-8f00-a7c7c1d161a6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:59.478280 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1253/2528] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:02:59.482242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56293d62-92e7-42bc-9f53-7cdfb58c9474 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:02:59.495133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56293d62-92e7-42bc-9f53-7cdfb58c9474 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:02:59.503518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffc1a1-8602-4fd6-8073-b74394a6892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:02:59.504357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffc1a1-8602-4fd6-8073-b74394a6892f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:59.504661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffc1a1-8602-4fd6-8073-b74394a6892f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:59.504963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffc1a1-8602-4fd6-8073-b74394a6892f admin admin] PATH_INFO: `/v3/projects/def80b25e55c4d0ca6571fe855fb8abf/users/6bd2a529a71f49718a4e842f6e6bef78/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:59.512127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffc1a1-8602-4fd6-8073-b74394a6892f admin admin] RBAC: Authorizing `identity:create_grant(project_id=def80b25e55c4d0ca6571fe855fb8abf, user_id=6bd2a529a71f49718a4e842f6e6bef78, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:02:59.515168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffc1a1-8602-4fd6-8073-b74394a6892f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:02:59.528502 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1276/2529] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:02:59 2022] PUT /identity/v3/projects/def80b25e55c4d0ca6571fe855fb8abf/users/6bd2a529a71f49718a4e842f6e6bef78/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:02:59.539615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101f7b-85ef-46fe-b67b-74223dd1609e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:02:59.539935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101f7b-85ef-46fe-b67b-74223dd1609e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:02:59.540404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101f7b-85ef-46fe-b67b-74223dd1609e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:02:59.611928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-04101f7b-85ef-46fe-b67b-74223dd1609e None None] MFA Rules not processed for user `6bd2a529a71f49718a4e842f6e6bef78`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:02:59.614358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-04101f7b-85ef-46fe-b67b-74223dd1609e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:02:59.784134 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1254/2530] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:00.541509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffc1a1-8602-4fd6-8073-b74394a6892f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:00.548228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e7ffc1a1-8602-4fd6-8073-b74394a6892f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:00.735852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffc1a1-8602-4fd6-8073-b74394a6892f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:00.751711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54eab-08bd-4adf-b14a-356d0b449532 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:00.753576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54eab-08bd-4adf-b14a-356d0b449532 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:00.753954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54eab-08bd-4adf-b14a-356d0b449532 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:00.754351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54eab-08bd-4adf-b14a-356d0b449532 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:00.769390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a54eab-08bd-4adf-b14a-356d0b449532 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:00.773634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a54eab-08bd-4adf-b14a-356d0b449532 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:00.812295 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1277/2531] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:00 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:01.963910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04101f7b-85ef-46fe-b67b-74223dd1609e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:02.048356 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:02.134401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04101f7b-85ef-46fe-b67b-74223dd1609e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:02.140827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:02.141849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:02.143145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:02.143617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] PATH_INFO: `/v3/users/39155d87c91f4ec48011aff0457ea412` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:02.145465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] RBAC: Authorizing `identity:delete_user(user_id=39155d87c91f4ec48011aff0457ea412)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:02.148878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:02.219699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39155d87c91f4ec48011aff0457ea412'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:02.236341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39155d87c91f4ec48011aff0457ea412'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:02.247644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39155d87c91f4ec48011aff0457ea412'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:02.264127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39155d87c91f4ec48011aff0457ea412'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:02.275964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39155d87c91f4ec48011aff0457ea412'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:02.286915 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1255/2532] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:01 2022] DELETE /identity/v3/users/39155d87c91f4ec48011aff0457ea412 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:02.292004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f7f8e-2653-4311-a7ef-a17d5bb87070 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:02.292471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f7f8e-2653-4311-a7ef-a17d5bb87070 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:02.292737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f7f8e-2653-4311-a7ef-a17d5bb87070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:02.327476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-631f7f8e-2653-4311-a7ef-a17d5bb87070 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:02.330480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-631f7f8e-2653-4311-a7ef-a17d5bb87070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:02.478332 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1278/2533] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:02.555690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:02.557131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:02.708826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3dae-8f9a-4ec0-a359-a1c7cb34196b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:02.719420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1355f-0f8f-40ff-977e-e4c35c3d8bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:02.720306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1355f-0f8f-40ff-977e-e4c35c3d8bfa service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:02.720874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1355f-0f8f-40ff-977e-e4c35c3d8bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:02.721349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1355f-0f8f-40ff-977e-e4c35c3d8bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:02.753800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1355f-0f8f-40ff-977e-e4c35c3d8bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:02.756792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1355f-0f8f-40ff-977e-e4c35c3d8bfa service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:02.782397 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1256/2534] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:04.329878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f7f8e-2653-4311-a7ef-a17d5bb87070 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:04.331413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-631f7f8e-2653-4311-a7ef-a17d5bb87070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:04.352915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f7f8e-2653-4311-a7ef-a17d5bb87070 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:04.380632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:04.383133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:04.383691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:04.384109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] PATH_INFO: `/v3/projects/2ad32ba8ecd94ce6a63b80885bfd9b43` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:04.386177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad32ba8ecd94ce6a63b80885bfd9b43)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:04.392643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:04.563727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad32ba8ecd94ce6a63b80885bfd9b43', 'request_id': 'req-dbfff833-7ab2-46eb-a403-daeedc6ef240'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.582147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad32ba8ecd94ce6a63b80885bfd9b43', 'request_id': 'req-dbfff833-7ab2-46eb-a403-daeedc6ef240'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.588334 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:04.598588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad32ba8ecd94ce6a63b80885bfd9b43', 'request_id': 'req-dbfff833-7ab2-46eb-a403-daeedc6ef240'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.626769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] The token cache is being invalidate because project 2ad32ba8ecd94ce6a63b80885bfd9b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:04.627102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.627986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.630234 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1279/2535] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:04 2022] DELETE /identity/v3/projects/2ad32ba8ecd94ce6a63b80885bfd9b43 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:04.634993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1355f-0f8f-40ff-977e-e4c35c3d8bfa service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:04.650366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1355f-0f8f-40ff-977e-e4c35c3d8bfa service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:04.753604 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:04.792771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ed36e-9c86-4ec9-ae1c-99b217386a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:04.793451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ed36e-9c86-4ec9-ae1c-99b217386a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:04.795812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ed36e-9c86-4ec9-ae1c-99b217386a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:04.797935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ed36e-9c86-4ec9-ae1c-99b217386a73 admin admin] PATH_INFO: `/v3/users/6bd2a529a71f49718a4e842f6e6bef78` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:04.802521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ed36e-9c86-4ec9-ae1c-99b217386a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd2a529a71f49718a4e842f6e6bef78)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:04.810532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ed36e-9c86-4ec9-ae1c-99b217386a73 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:04.905276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec8ed36e-9c86-4ec9-ae1c-99b217386a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd2a529a71f49718a4e842f6e6bef78'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.949282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec8ed36e-9c86-4ec9-ae1c-99b217386a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd2a529a71f49718a4e842f6e6bef78'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.954004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec8ed36e-9c86-4ec9-ae1c-99b217386a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd2a529a71f49718a4e842f6e6bef78'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.971234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec8ed36e-9c86-4ec9-ae1c-99b217386a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd2a529a71f49718a4e842f6e6bef78'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.987587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec8ed36e-9c86-4ec9-ae1c-99b217386a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd2a529a71f49718a4e842f6e6bef78'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:04.995667 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1257/2536] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:04 2022] DELETE /identity/v3/users/6bd2a529a71f49718a4e842f6e6bef78 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:03:05.755256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:05.765048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:05.788520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfff833-7ab2-46eb-a403-daeedc6ef240 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:05.985398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:05.986409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:05.986795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:05.987507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] PATH_INFO: `/v3/projects/def80b25e55c4d0ca6571fe855fb8abf` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:05.989010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def80b25e55c4d0ca6571fe855fb8abf)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:05.991501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:06.128306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def80b25e55c4d0ca6571fe855fb8abf', 'request_id': 'req-eeb6bcf2-8e3d-4fea-a43f-918deee95230'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:06.154517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def80b25e55c4d0ca6571fe855fb8abf', 'request_id': 'req-eeb6bcf2-8e3d-4fea-a43f-918deee95230'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:06.179268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def80b25e55c4d0ca6571fe855fb8abf', 'request_id': 'req-eeb6bcf2-8e3d-4fea-a43f-918deee95230'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:06.202445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] The token cache is being invalidate because project def80b25e55c4d0ca6571fe855fb8abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:06.203160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:06.204058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eeb6bcf2-8e3d-4fea-a43f-918deee95230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:06.206812 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1280/2537] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:05 2022] DELETE /identity/v3/projects/def80b25e55c4d0ca6571fe855fb8abf => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:06.212059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a6776-2272-43b2-906f-f79cda729068 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:06.213263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a6776-2272-43b2-906f-f79cda729068 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:06.213815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a6776-2272-43b2-906f-f79cda729068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.240221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bf1a6776-2272-43b2-906f-f79cda729068 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:06.242755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bf1a6776-2272-43b2-906f-f79cda729068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:06.376386 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1258/2538] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:06.385103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f55c-2bb9-4191-99ac-ca8a2b5fdf48 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:06.385674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f55c-2bb9-4191-99ac-ca8a2b5fdf48 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:06.385951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f55c-2bb9-4191-99ac-ca8a2b5fdf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.429760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1dd5f55c-2bb9-4191-99ac-ca8a2b5fdf48 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:06.433137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1dd5f55c-2bb9-4191-99ac-ca8a2b5fdf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:06.457504 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1281/2539] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:06.461592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a6776-2272-43b2-906f-f79cda729068 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:06.480813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a6776-2272-43b2-906f-f79cda729068 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:06.495027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac97e62-4108-423d-b03d-603f1d2709a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:06.495696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac97e62-4108-423d-b03d-603f1d2709a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:06.496803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac97e62-4108-423d-b03d-603f1d2709a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:06.498204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac97e62-4108-423d-b03d-603f1d2709a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.498997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac97e62-4108-423d-b03d-603f1d2709a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:03:06.499314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac97e62-4108-423d-b03d-603f1d2709a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:06.505790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac97e62-4108-423d-b03d-603f1d2709a8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:06.540393 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1259/2540] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:03:06.544790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5f55c-2bb9-4191-99ac-ca8a2b5fdf48 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:06.557382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5f55c-2bb9-4191-99ac-ca8a2b5fdf48 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:06.574236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267fd49-4bd3-434e-b1ca-bfc761cc7ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:06.574920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267fd49-4bd3-434e-b1ca-bfc761cc7ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:06.575200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267fd49-4bd3-434e-b1ca-bfc761cc7ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:06.575470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267fd49-4bd3-434e-b1ca-bfc761cc7ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.576276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267fd49-4bd3-434e-b1ca-bfc761cc7ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:06.578204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267fd49-4bd3-434e-b1ca-bfc761cc7ddb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:06.644945 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1282/2541] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:06 2022] POST /identity/v3/projects => generated 395 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:06.650280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac97e62-4108-423d-b03d-603f1d2709a8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:06.665133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac97e62-4108-423d-b03d-603f1d2709a8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:06.839127 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:06.863780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a2782-070c-4953-8aac-dbfc94735075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:06.867144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a2782-070c-4953-8aac-dbfc94735075 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:06.867803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a2782-070c-4953-8aac-dbfc94735075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:06.868285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a2782-070c-4953-8aac-dbfc94735075 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.869905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a2782-070c-4953-8aac-dbfc94735075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:06.875190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a2782-070c-4953-8aac-dbfc94735075 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:06.948877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267fd49-4bd3-434e-b1ca-bfc761cc7ddb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:06.950243 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1260/2542] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:06 2022] POST /identity/v3/users => generated 298 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:06.963486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267fd49-4bd3-434e-b1ca-bfc761cc7ddb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:06.980751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c52be-f852-424f-9563-73fb0831aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:06.980945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c52be-f852-424f-9563-73fb0831aa82 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:06.981055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c52be-f852-424f-9563-73fb0831aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:06.981317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c52be-f852-424f-9563-73fb0831aa82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:06.981955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c52be-f852-424f-9563-73fb0831aa82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:06.983580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c52be-f852-424f-9563-73fb0831aa82 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:07.042423 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1283/2543] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:07.046938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a2782-070c-4953-8aac-dbfc94735075 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:07.060032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a2782-070c-4953-8aac-dbfc94735075 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:07.078520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935a9de-6293-48c8-bfb2-6b52eddc98bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:07.079239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935a9de-6293-48c8-bfb2-6b52eddc98bb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:07.079533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935a9de-6293-48c8-bfb2-6b52eddc98bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:07.079812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935a9de-6293-48c8-bfb2-6b52eddc98bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:07.080489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935a9de-6293-48c8-bfb2-6b52eddc98bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:07.095735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935a9de-6293-48c8-bfb2-6b52eddc98bb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:07.121269 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1261/2544] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:07.123214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c52be-f852-424f-9563-73fb0831aa82 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:07.137115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c52be-f852-424f-9563-73fb0831aa82 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:07.148339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf063e-4867-4285-ba20-c9fc844321ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:07.149723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf063e-4867-4285-ba20-c9fc844321ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:07.150341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf063e-4867-4285-ba20-c9fc844321ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:07.150705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf063e-4867-4285-ba20-c9fc844321ef admin admin] PATH_INFO: `/v3/projects/4b8fabf5bc8740b09c77687c9d4e1e77/users/d44f8d053e07440699d217cd63c94d0d/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:07.188499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf063e-4867-4285-ba20-c9fc844321ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8fabf5bc8740b09c77687c9d4e1e77, user_id=d44f8d053e07440699d217cd63c94d0d, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:07.191226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf063e-4867-4285-ba20-c9fc844321ef admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:07.211278 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1284/2545] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:07 2022] PUT /identity/v3/projects/4b8fabf5bc8740b09c77687c9d4e1e77/users/d44f8d053e07440699d217cd63c94d0d/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:03:07.216050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdab1b4-569f-4c55-97ae-cd43c9a9666a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:07.216567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdab1b4-569f-4c55-97ae-cd43c9a9666a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:07.216567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdab1b4-569f-4c55-97ae-cd43c9a9666a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:07.243487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ebdab1b4-569f-4c55-97ae-cd43c9a9666a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:07.245031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ebdab1b4-569f-4c55-97ae-cd43c9a9666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:07.320035 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1262/2546] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:03:07.403515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf063e-4867-4285-ba20-c9fc844321ef admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:07.405907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5acf063e-4867-4285-ba20-c9fc844321ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:07.430929 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:07.499677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf063e-4867-4285-ba20-c9fc844321ef admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:07.503921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ef912-747c-4f57-aaa5-fcddbe816227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:07.504657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef912-747c-4f57-aaa5-fcddbe816227 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:07.505008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef912-747c-4f57-aaa5-fcddbe816227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:07.505377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef912-747c-4f57-aaa5-fcddbe816227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:07.515727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ef912-747c-4f57-aaa5-fcddbe816227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:07.517262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ef912-747c-4f57-aaa5-fcddbe816227 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:07.529993 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1285/2547] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:08.766192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cd5e5-f2b1-46f8-b5c4-6666aadfdf3f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:08.766698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cd5e5-f2b1-46f8-b5c4-6666aadfdf3f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:08.766814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cd5e5-f2b1-46f8-b5c4-6666aadfdf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:08.846405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cc3cd5e5-f2b1-46f8-b5c4-6666aadfdf3f None None] MFA Rules not processed for user `0db18eb48be64e72a9419d4e7452ca5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:08.848606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc3cd5e5-f2b1-46f8-b5c4-6666aadfdf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:08.942654 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1263/2548] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:09.629736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ef912-747c-4f57-aaa5-fcddbe816227 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:09.634477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ba3ef912-747c-4f57-aaa5-fcddbe816227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:09.809414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ef912-747c-4f57-aaa5-fcddbe816227 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:09.827491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5ea74-eb01-4150-a7fe-5c235cf7b872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:09.828132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5ea74-eb01-4150-a7fe-5c235cf7b872 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:09.828410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5ea74-eb01-4150-a7fe-5c235cf7b872 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:09.828678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5ea74-eb01-4150-a7fe-5c235cf7b872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:09.844862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5ea74-eb01-4150-a7fe-5c235cf7b872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:09.847776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5ea74-eb01-4150-a7fe-5c235cf7b872 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:09.871012 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1286/2549] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:14.721191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743e7c2-aec5-4b62-89c7-9520ee58eb02 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:14.721772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743e7c2-aec5-4b62-89c7-9520ee58eb02 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:14.721772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743e7c2-aec5-4b62-89c7-9520ee58eb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:14.754324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e743e7c2-aec5-4b62-89c7-9520ee58eb02 None None] MFA Rules not processed for user `0db18eb48be64e72a9419d4e7452ca5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:14.757013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e743e7c2-aec5-4b62-89c7-9520ee58eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:14.774147 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1264/2550] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:15.422086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609270e7-5018-4c0e-a2d4-d6ab702818aa None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:15.422941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609270e7-5018-4c0e-a2d4-d6ab702818aa None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:15.423636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609270e7-5018-4c0e-a2d4-d6ab702818aa None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:15.426943 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1287/2551] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 01:03:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:03:15.433544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762c12-a368-4f45-a5ed-6fe5335b729e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:15.434380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762c12-a368-4f45-a5ed-6fe5335b729e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:15.434958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762c12-a368-4f45-a5ed-6fe5335b729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:15.471098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-05762c12-a368-4f45-a5ed-6fe5335b729e None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:15.472471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-05762c12-a368-4f45-a5ed-6fe5335b729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:15.487347 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1265/2552] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:15.527226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609270e7-5018-4c0e-a2d4-d6ab702818aa None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:15.531375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-609270e7-5018-4c0e-a2d4-d6ab702818aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:15.555029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609270e7-5018-4c0e-a2d4-d6ab702818aa None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:15.559751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864bb7f-a13a-4dd1-b976-5bda6a77e47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:15.560688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bb7f-a13a-4dd1-b976-5bda6a77e47a service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:15.561227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bb7f-a13a-4dd1-b976-5bda6a77e47a service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:15.561942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bb7f-a13a-4dd1-b976-5bda6a77e47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:15.581108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864bb7f-a13a-4dd1-b976-5bda6a77e47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:15.583134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864bb7f-a13a-4dd1-b976-5bda6a77e47a service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:15.605077 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1288/2553] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:15.748241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d575-08f9-47e3-a34e-a93db6516cc6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:15.748747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d575-08f9-47e3-a34e-a93db6516cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:15.748870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d575-08f9-47e3-a34e-a93db6516cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:15.796301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-87e7d575-08f9-47e3-a34e-a93db6516cc6 None None] MFA Rules not processed for user `d44f8d053e07440699d217cd63c94d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:15.797773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-87e7d575-08f9-47e3-a34e-a93db6516cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:15.856285 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:15.878833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf4f42-ef97-4c9e-8620-bdef1b2ebccd None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:15.879420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf4f42-ef97-4c9e-8620-bdef1b2ebccd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:15.879883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf4f42-ef97-4c9e-8620-bdef1b2ebccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:15.890741 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1266/2554] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:15.894207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7d575-08f9-47e3-a34e-a93db6516cc6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:15.905131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d5bf4f42-ef97-4c9e-8620-bdef1b2ebccd None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:15.906490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d5bf4f42-ef97-4c9e-8620-bdef1b2ebccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:15.913581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7d575-08f9-47e3-a34e-a93db6516cc6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:15.915678 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1289/2555] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:15.921283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99c5e7-3850-431f-98e2-183dbe96d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:15.921993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c5e7-3850-431f-98e2-183dbe96d38d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:15.922347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c5e7-3850-431f-98e2-183dbe96d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:15.922647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c5e7-3850-431f-98e2-183dbe96d38d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:15.923294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99c5e7-3850-431f-98e2-183dbe96d38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:15.926526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99c5e7-3850-431f-98e2-183dbe96d38d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:15.937304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf4f42-ef97-4c9e-8620-bdef1b2ebccd None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:15.952328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf4f42-ef97-4c9e-8620-bdef1b2ebccd None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:15.957298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47880176-8be6-46f0-a1c2-67f87e50b5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:15.958122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880176-8be6-46f0-a1c2-67f87e50b5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:15.967829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880176-8be6-46f0-a1c2-67f87e50b5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:15.968058 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1267/2556] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:15 2022] POST /identity/v3/projects => generated 397 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:15.968164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880176-8be6-46f0-a1c2-67f87e50b5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:15.968720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99c5e7-3850-431f-98e2-183dbe96d38d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:15.982510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47880176-8be6-46f0-a1c2-67f87e50b5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:15.984294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47880176-8be6-46f0-a1c2-67f87e50b5c8 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:16.002668 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1290/2557] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:16.073437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99c5e7-3850-431f-98e2-183dbe96d38d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:16.078859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13ca90-17b7-4c2d-bfe3-385ad28a608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:16.079517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13ca90-17b7-4c2d-bfe3-385ad28a608a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:16.079796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13ca90-17b7-4c2d-bfe3-385ad28a608a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:16.080090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13ca90-17b7-4c2d-bfe3-385ad28a608a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:16.080732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13ca90-17b7-4c2d-bfe3-385ad28a608a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:16.082701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13ca90-17b7-4c2d-bfe3-385ad28a608a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:16.115585 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1268/2558] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:15 2022] POST /identity/v3/users => generated 305 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:16.119481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47880176-8be6-46f0-a1c2-67f87e50b5c8 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:16.134182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47880176-8be6-46f0-a1c2-67f87e50b5c8 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:16.139104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcc365-e31f-4466-bc2a-6a4237190c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:16.139718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc365-e31f-4466-bc2a-6a4237190c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:16.139997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc365-e31f-4466-bc2a-6a4237190c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:16.140273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc365-e31f-4466-bc2a-6a4237190c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:16.140922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcc365-e31f-4466-bc2a-6a4237190c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:16.142552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcc365-e31f-4466-bc2a-6a4237190c43 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:16.155500 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1291/2559] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:03:16.160604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13ca90-17b7-4c2d-bfe3-385ad28a608a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:16.175892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13ca90-17b7-4c2d-bfe3-385ad28a608a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:16.185054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a923bd-1f66-4cfa-8d7c-e116424b27d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:16.186023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a923bd-1f66-4cfa-8d7c-e116424b27d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:16.186309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a923bd-1f66-4cfa-8d7c-e116424b27d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:16.186582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a923bd-1f66-4cfa-8d7c-e116424b27d5 admin admin] PATH_INFO: `/v3/projects/5c4654e2b3724c2f900bc56dc6bcc035/users/cdd115ff0dd34262be2dc29b9cdb55e0/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:16.205506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a923bd-1f66-4cfa-8d7c-e116424b27d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4654e2b3724c2f900bc56dc6bcc035, user_id=cdd115ff0dd34262be2dc29b9cdb55e0, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:16.207861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a923bd-1f66-4cfa-8d7c-e116424b27d5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:16.226095 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1269/2560] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:16 2022] PUT /identity/v3/projects/5c4654e2b3724c2f900bc56dc6bcc035/users/cdd115ff0dd34262be2dc29b9cdb55e0/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:03:16.227694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcc365-e31f-4466-bc2a-6a4237190c43 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:16.238934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcc365-e31f-4466-bc2a-6a4237190c43 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:16.317193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce44e0-1d6d-4285-9454-12b66a3cd8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:16.318044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce44e0-1d6d-4285-9454-12b66a3cd8ca admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:16.318966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce44e0-1d6d-4285-9454-12b66a3cd8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:16.319461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce44e0-1d6d-4285-9454-12b66a3cd8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:16.320224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce44e0-1d6d-4285-9454-12b66a3cd8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:16.321960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce44e0-1d6d-4285-9454-12b66a3cd8ca admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:16.323965 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:16.355837 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1292/2561] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:16.357006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a923bd-1f66-4cfa-8d7c-e116424b27d5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:16.371232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a923bd-1f66-4cfa-8d7c-e116424b27d5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:16.375977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13cf3a-d88c-46db-bb89-8e42c115ed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:16.376648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13cf3a-d88c-46db-bb89-8e42c115ed36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:16.376926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13cf3a-d88c-46db-bb89-8e42c115ed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:16.377205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13cf3a-d88c-46db-bb89-8e42c115ed36 admin admin] PATH_INFO: `/v3/projects/5c4654e2b3724c2f900bc56dc6bcc035/users/cdd115ff0dd34262be2dc29b9cdb55e0/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:16.379241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13cf3a-d88c-46db-bb89-8e42c115ed36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4654e2b3724c2f900bc56dc6bcc035, user_id=cdd115ff0dd34262be2dc29b9cdb55e0, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:16.382812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13cf3a-d88c-46db-bb89-8e42c115ed36 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:16.409113 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1270/2562] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:16 2022] PUT /identity/v3/projects/5c4654e2b3724c2f900bc56dc6bcc035/users/cdd115ff0dd34262be2dc29b9cdb55e0/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:23.742825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5880366-1b7c-448f-a82b-79e666b43cd6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:23.744974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5880366-1b7c-448f-a82b-79e666b43cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:23.745417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5880366-1b7c-448f-a82b-79e666b43cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:23.783337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13cf3a-d88c-46db-bb89-8e42c115ed36 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:23.786130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a13cf3a-d88c-46db-bb89-8e42c115ed36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:23.812635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d5880366-1b7c-448f-a82b-79e666b43cd6 None None] MFA Rules not processed for user `cdd115ff0dd34262be2dc29b9cdb55e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:23.814346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d5880366-1b7c-448f-a82b-79e666b43cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:23.933851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13cf3a-d88c-46db-bb89-8e42c115ed36 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:23.959341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62263b76-c99d-4290-afb6-6f8526bf3f4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:23.960191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62263b76-c99d-4290-afb6-6f8526bf3f4d service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:23.960722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62263b76-c99d-4290-afb6-6f8526bf3f4d service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:23.963573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62263b76-c99d-4290-afb6-6f8526bf3f4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:23.967512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62263b76-c99d-4290-afb6-6f8526bf3f4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:23.993988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62263b76-c99d-4290-afb6-6f8526bf3f4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:23.996024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62263b76-c99d-4290-afb6-6f8526bf3f4d service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:24.003208 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:24.014555 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1293/2563] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:23 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:24.023024 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1271/2564] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:03:24.096090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6b0a-131e-449d-90ad-a16f4353a082 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:24.096742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6b0a-131e-449d-90ad-a16f4353a082 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:24.097187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6b0a-131e-449d-90ad-a16f4353a082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:24.127651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a1dd6b0a-131e-449d-90ad-a16f4353a082 None None] MFA Rules not processed for user `d44f8d053e07440699d217cd63c94d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:24.129024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1dd6b0a-131e-449d-90ad-a16f4353a082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:24.249180 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1294/2565] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:24.905005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50d401-9c7f-43b6-86e0-fce65a1a32c3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:24.905887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50d401-9c7f-43b6-86e0-fce65a1a32c3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:24.906319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50d401-9c7f-43b6-86e0-fce65a1a32c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:24.928623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dc50d401-9c7f-43b6-86e0-fce65a1a32c3 None None] MFA Rules not processed for user `739083b66f9b433889944e555b0aef23`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:24.930319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dc50d401-9c7f-43b6-86e0-fce65a1a32c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:25.025025 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1272/2566] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:25.498813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd6b0a-131e-449d-90ad-a16f4353a082 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:25.501123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1dd6b0a-131e-449d-90ad-a16f4353a082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:25.606872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd6b0a-131e-449d-90ad-a16f4353a082 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:25.612954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994a25d-d70c-4a4d-b4f5-2c35917c1d51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:25.613731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994a25d-d70c-4a4d-b4f5-2c35917c1d51 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:25.614120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994a25d-d70c-4a4d-b4f5-2c35917c1d51 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:25.615186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994a25d-d70c-4a4d-b4f5-2c35917c1d51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:25.639324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994a25d-d70c-4a4d-b4f5-2c35917c1d51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:25.640605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994a25d-d70c-4a4d-b4f5-2c35917c1d51 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:25.657254 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1295/2567] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:25 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:30.684068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50d401-9c7f-43b6-86e0-fce65a1a32c3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:30.710623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50d401-9c7f-43b6-86e0-fce65a1a32c3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:30.719797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f7c72-1954-451e-a238-310988df6f33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:30.720431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f7c72-1954-451e-a238-310988df6f33 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:30.721412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f7c72-1954-451e-a238-310988df6f33 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:30.737355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f7c72-1954-451e-a238-310988df6f33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:30.740757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a28f7c72-1954-451e-a238-310988df6f33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:30.760086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f7c72-1954-451e-a238-310988df6f33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:30.762406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f7c72-1954-451e-a238-310988df6f33 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:30.777637 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1273/2568] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:35.651645 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:40.771040 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=31 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:45.094191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76a55-45d8-42fe-a5dd-4d1c2b4aa5da None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:45.095402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76a55-45d8-42fe-a5dd-4d1c2b4aa5da None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:45.095972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76a55-45d8-42fe-a5dd-4d1c2b4aa5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:45.117463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a4c76a55-45d8-42fe-a5dd-4d1c2b4aa5da None None] MFA Rules not processed for user `6da1976f703f402788953f3332a281de`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:45.118988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a4c76a55-45d8-42fe-a5dd-4d1c2b4aa5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:45.178665 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1296/2569] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:48.249915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f7c72-1954-451e-a238-310988df6f33 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:48.264183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f7c72-1954-451e-a238-310988df6f33 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:48.270310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca31544-3888-477e-b19c-8f40e9c1ede2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:48.271115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca31544-3888-477e-b19c-8f40e9c1ede2 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:48.271404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca31544-3888-477e-b19c-8f40e9c1ede2 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:48.271682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca31544-3888-477e-b19c-8f40e9c1ede2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:48.281152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca31544-3888-477e-b19c-8f40e9c1ede2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:48.283325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca31544-3888-477e-b19c-8f40e9c1ede2 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:48.295701 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1274/2570] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:55.169215 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=25 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:57.408396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c76a55-45d8-42fe-a5dd-4d1c2b4aa5da None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:57.411331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a4c76a55-45d8-42fe-a5dd-4d1c2b4aa5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:57.519579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c76a55-45d8-42fe-a5dd-4d1c2b4aa5da None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:57.525621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:57.526337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:57.526563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:57.527144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] PATH_INFO: `/v3/users/c42d04f7289e49ef950eeaf764c91216` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:57.528481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42d04f7289e49ef950eeaf764c91216)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:57.530613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:57.608761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42d04f7289e49ef950eeaf764c91216'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:57.629111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42d04f7289e49ef950eeaf764c91216'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:57.630315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42d04f7289e49ef950eeaf764c91216'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:57.639240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42d04f7289e49ef950eeaf764c91216'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:57.640243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42d04f7289e49ef950eeaf764c91216'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:57.657897 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1297/2571] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:57 2022] DELETE /identity/v3/users/c42d04f7289e49ef950eeaf764c91216 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:57.662088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae5988-ba13-4578-8323-53b742e8f11a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:57.663037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae5988-ba13-4578-8323-53b742e8f11a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:57.663291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae5988-ba13-4578-8323-53b742e8f11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:57.688167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fdae5988-ba13-4578-8323-53b742e8f11a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:57.689680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fdae5988-ba13-4578-8323-53b742e8f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:57.762390 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1275/2572] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:57.775163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:57.776763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:57.859270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a1d56-6041-4aa4-bc79-5e2457e7c634 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:57.865188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f772641-cc42-48d5-b480-49024db7ce21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:57.866173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772641-cc42-48d5-b480-49024db7ce21 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:57.866832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772641-cc42-48d5-b480-49024db7ce21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:57.867309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772641-cc42-48d5-b480-49024db7ce21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:57.880449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f772641-cc42-48d5-b480-49024db7ce21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:57.882752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f772641-cc42-48d5-b480-49024db7ce21 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:57.897795 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1298/2573] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:03:58.350660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae5988-ba13-4578-8323-53b742e8f11a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:58.352000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fdae5988-ba13-4578-8323-53b742e8f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:58.368220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae5988-ba13-4578-8323-53b742e8f11a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:58.375106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:58.375747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:58.376026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:58.376295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] PATH_INFO: `/v3/projects/683c16b60ba34123bf0175396dffaf83` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:58.377618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=683c16b60ba34123bf0175396dffaf83)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:58.380642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:58.490300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683c16b60ba34123bf0175396dffaf83', 'request_id': 'req-0caa1f68-36b8-49b5-b147-2e19c32b7a65'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:58.497833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683c16b60ba34123bf0175396dffaf83', 'request_id': 'req-0caa1f68-36b8-49b5-b147-2e19c32b7a65'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:58.505513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683c16b60ba34123bf0175396dffaf83', 'request_id': 'req-0caa1f68-36b8-49b5-b147-2e19c32b7a65'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:58.520584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] The token cache is being invalidate because project 683c16b60ba34123bf0175396dffaf83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:58.521168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:58.522014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:58.523617 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1276/2574] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:58 2022] DELETE /identity/v3/projects/683c16b60ba34123bf0175396dffaf83 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:58.528157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f772641-cc42-48d5-b480-49024db7ce21 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:58.539384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f772641-cc42-48d5-b480-49024db7ce21 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:58.573062 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:58.630900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b59650-3054-45fa-afdd-fcd829a83f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:58.631820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b59650-3054-45fa-afdd-fcd829a83f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:58.632446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b59650-3054-45fa-afdd-fcd829a83f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:58.634142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b59650-3054-45fa-afdd-fcd829a83f27 admin admin] PATH_INFO: `/v3/users/2ed7e34ffe4e4c8a9cdf075805bb1e49` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:58.635667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b59650-3054-45fa-afdd-fcd829a83f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed7e34ffe4e4c8a9cdf075805bb1e49)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:58.637908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b59650-3054-45fa-afdd-fcd829a83f27 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:58.763142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b0b59650-3054-45fa-afdd-fcd829a83f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed7e34ffe4e4c8a9cdf075805bb1e49'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:58.785769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b0b59650-3054-45fa-afdd-fcd829a83f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed7e34ffe4e4c8a9cdf075805bb1e49'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:58.786556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b0b59650-3054-45fa-afdd-fcd829a83f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed7e34ffe4e4c8a9cdf075805bb1e49'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:58.795891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b0b59650-3054-45fa-afdd-fcd829a83f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed7e34ffe4e4c8a9cdf075805bb1e49'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:58.796583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b0b59650-3054-45fa-afdd-fcd829a83f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed7e34ffe4e4c8a9cdf075805bb1e49'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:58.812067 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1299/2575] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:03:58 2022] DELETE /identity/v3/users/2ed7e34ffe4e4c8a9cdf075805bb1e49 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:59.035250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:59.038155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:59.060166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1f68-36b8-49b5-b147-2e19c32b7a65 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:59.165618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:59.166560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:59.166973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:59.167416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] PATH_INFO: `/v3/projects/6cdc0650facb49ac86c4f8f79c2751f8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:59.168973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdc0650facb49ac86c4f8f79c2751f8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:59.171929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:59.189143 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:59.248633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdc0650facb49ac86c4f8f79c2751f8', 'request_id': 'req-76828dce-e525-4abc-b730-a973ae0eeb17'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:59.256998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdc0650facb49ac86c4f8f79c2751f8', 'request_id': 'req-76828dce-e525-4abc-b730-a973ae0eeb17'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:59.264917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdc0650facb49ac86c4f8f79c2751f8', 'request_id': 'req-76828dce-e525-4abc-b730-a973ae0eeb17'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:59.285281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] The token cache is being invalidate because project 6cdc0650facb49ac86c4f8f79c2751f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:03:59.286185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:59.287089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76828dce-e525-4abc-b730-a973ae0eeb17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:03:59.293956 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1277/2576] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:03:59 2022] DELETE /identity/v3/projects/6cdc0650facb49ac86c4f8f79c2751f8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:59.295713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201448-bd99-42e1-a438-815869e154e3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:59.296234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201448-bd99-42e1-a438-815869e154e3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:59.296698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201448-bd99-42e1-a438-815869e154e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:59.355581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bf201448-bd99-42e1-a438-815869e154e3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:59.359771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bf201448-bd99-42e1-a438-815869e154e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:59.449998 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1300/2577] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:59.458429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda71b4-d167-4789-ac46-9690da75c37f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:59.458737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda71b4-d167-4789-ac46-9690da75c37f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:59.459009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda71b4-d167-4789-ac46-9690da75c37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:59.481608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bcda71b4-d167-4789-ac46-9690da75c37f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:59.482859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bcda71b4-d167-4789-ac46-9690da75c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:59.496276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf201448-bd99-42e1-a438-815869e154e3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:59.501156 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1278/2578] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:59.507148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf201448-bd99-42e1-a438-815869e154e3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:59.512018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971798a-3049-42e1-a2dc-96c54fc23d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:59.512625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971798a-3049-42e1-a2dc-96c54fc23d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:59.512893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971798a-3049-42e1-a2dc-96c54fc23d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:59.513163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971798a-3049-42e1-a2dc-96c54fc23d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:59.513803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971798a-3049-42e1-a2dc-96c54fc23d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:03:59.514165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971798a-3049-42e1-a2dc-96c54fc23d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:59.515877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971798a-3049-42e1-a2dc-96c54fc23d7b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:59.532983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda71b4-d167-4789-ac46-9690da75c37f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:59.538881 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1301/2579] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:03:59.542560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda71b4-d167-4789-ac46-9690da75c37f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:59.553091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cec40a-d2a7-4aa2-8ce3-398ec25e4679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:59.554519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cec40a-d2a7-4aa2-8ce3-398ec25e4679 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:59.555025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cec40a-d2a7-4aa2-8ce3-398ec25e4679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:59.555466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cec40a-d2a7-4aa2-8ce3-398ec25e4679 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:59.556262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cec40a-d2a7-4aa2-8ce3-398ec25e4679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:59.559220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cec40a-d2a7-4aa2-8ce3-398ec25e4679 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:59.592582 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1279/2580] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:59 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:59.597982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971798a-3049-42e1-a2dc-96c54fc23d7b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:59.612687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971798a-3049-42e1-a2dc-96c54fc23d7b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:59.649109 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:59.688905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4fd5b-3fc9-40ac-a4cc-99728cb24dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:59.689479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4fd5b-3fc9-40ac-a4cc-99728cb24dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:59.689956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4fd5b-3fc9-40ac-a4cc-99728cb24dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:59.690239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4fd5b-3fc9-40ac-a4cc-99728cb24dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:59.691661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4fd5b-3fc9-40ac-a4cc-99728cb24dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:59.694658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4fd5b-3fc9-40ac-a4cc-99728cb24dd4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:59.723496 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1302/2581] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:03:59 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:03:59.726930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cec40a-d2a7-4aa2-8ce3-398ec25e4679 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:59.740436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cec40a-d2a7-4aa2-8ce3-398ec25e4679 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:59.748756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc9a3-2670-4519-b30b-c51c45704068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:59.749492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc9a3-2670-4519-b30b-c51c45704068 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:59.749874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc9a3-2670-4519-b30b-c51c45704068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:59.750248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc9a3-2670-4519-b30b-c51c45704068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:59.751047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fc9a3-2670-4519-b30b-c51c45704068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:59.752917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fc9a3-2670-4519-b30b-c51c45704068 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:59.765414 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1280/2582] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:03:59.769673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4fd5b-3fc9-40ac-a4cc-99728cb24dd4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:59.779936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4fd5b-3fc9-40ac-a4cc-99728cb24dd4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:59.784681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bd14c-01d3-4d80-9a82-530844d789b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:59.785288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bd14c-01d3-4d80-9a82-530844d789b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:59.785569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bd14c-01d3-4d80-9a82-530844d789b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:59.785843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bd14c-01d3-4d80-9a82-530844d789b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:59.786484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bd14c-01d3-4d80-9a82-530844d789b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:59.788116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bd14c-01d3-4d80-9a82-530844d789b7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:59.802076 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1303/2583] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:03:59.803908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc9a3-2670-4519-b30b-c51c45704068 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:03:59.814806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc9a3-2670-4519-b30b-c51c45704068 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:03:59.820297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6353d4f-87ef-47b5-9ea7-746e8c46a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:03:59.820956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6353d4f-87ef-47b5-9ea7-746e8c46a7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:59.821235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6353d4f-87ef-47b5-9ea7-746e8c46a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:59.821599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6353d4f-87ef-47b5-9ea7-746e8c46a7fe admin admin] PATH_INFO: `/v3/projects/70c6b40e739146e8b98b38971b879e85/users/c076d9dc75a7400f87b480d2b18dcc14/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:59.837273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6353d4f-87ef-47b5-9ea7-746e8c46a7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c6b40e739146e8b98b38971b879e85, user_id=c076d9dc75a7400f87b480d2b18dcc14, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:03:59.840450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6353d4f-87ef-47b5-9ea7-746e8c46a7fe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:03:59.854369 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1281/2584] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:03:59 2022] PUT /identity/v3/projects/70c6b40e739146e8b98b38971b879e85/users/c076d9dc75a7400f87b480d2b18dcc14/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:03:59.867099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a0f3-984f-4523-aa90-a5ae4e10394e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:03:59.867392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a0f3-984f-4523-aa90-a5ae4e10394e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:03:59.867672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a0f3-984f-4523-aa90-a5ae4e10394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:03:59.901790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8b17a0f3-984f-4523-aa90-a5ae4e10394e None None] MFA Rules not processed for user `c076d9dc75a7400f87b480d2b18dcc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:03:59.903720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8b17a0f3-984f-4523-aa90-a5ae4e10394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:03:59.984275 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1304/2585] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:03:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:03:59.989298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6353d4f-87ef-47b5-9ea7-746e8c46a7fe admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:00.072160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6353d4f-87ef-47b5-9ea7-746e8c46a7fe admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:00.077691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c4a5c-1c4a-4fda-aced-b99810194daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:00.078331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4a5c-1c4a-4fda-aced-b99810194daf admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:00.078645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4a5c-1c4a-4fda-aced-b99810194daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:00.079226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4a5c-1c4a-4fda-aced-b99810194daf admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:00.079934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c4a5c-1c4a-4fda-aced-b99810194daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:00.082482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c4a5c-1c4a-4fda-aced-b99810194daf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:00.111868 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1282/2586] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:03:59 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:00.116745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17a0f3-984f-4523-aa90-a5ae4e10394e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:00.131784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17a0f3-984f-4523-aa90-a5ae4e10394e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:00.202755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166052cb-beb4-4123-a0b6-35a5f9a180bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:00.203367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166052cb-beb4-4123-a0b6-35a5f9a180bb admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:00.203644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166052cb-beb4-4123-a0b6-35a5f9a180bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:00.203912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166052cb-beb4-4123-a0b6-35a5f9a180bb admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:00.204536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166052cb-beb4-4123-a0b6-35a5f9a180bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:00.206487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166052cb-beb4-4123-a0b6-35a5f9a180bb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:00.233326 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1305/2587] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:00 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:00.237219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c4a5c-1c4a-4fda-aced-b99810194daf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:00.251248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c4a5c-1c4a-4fda-aced-b99810194daf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:00.256712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca67314-33c0-48e0-aa39-637822f8003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:00.257644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67314-33c0-48e0-aa39-637822f8003e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:00.258129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67314-33c0-48e0-aa39-637822f8003e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:00.258680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67314-33c0-48e0-aa39-637822f8003e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:00.259543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca67314-33c0-48e0-aa39-637822f8003e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:00.262044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca67314-33c0-48e0-aa39-637822f8003e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:00.280879 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1283/2588] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:00.287891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166052cb-beb4-4123-a0b6-35a5f9a180bb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:00.299199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166052cb-beb4-4123-a0b6-35a5f9a180bb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:00.304911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b386a0-b2d3-49b4-87e3-ed0fb1fe25ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:00.305668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b386a0-b2d3-49b4-87e3-ed0fb1fe25ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:00.305836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b386a0-b2d3-49b4-87e3-ed0fb1fe25ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:00.306103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b386a0-b2d3-49b4-87e3-ed0fb1fe25ab admin admin] PATH_INFO: `/v3/projects/c00db8f12f03444aa2bb0ac6a276666c/users/22ed94252c1e406aaafefab6edd128fe/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:00.324231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b386a0-b2d3-49b4-87e3-ed0fb1fe25ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00db8f12f03444aa2bb0ac6a276666c, user_id=22ed94252c1e406aaafefab6edd128fe, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:00.327126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b386a0-b2d3-49b4-87e3-ed0fb1fe25ab admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:00.343062 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1306/2589] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:00 2022] PUT /identity/v3/projects/c00db8f12f03444aa2bb0ac6a276666c/users/22ed94252c1e406aaafefab6edd128fe/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:00.346912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca67314-33c0-48e0-aa39-637822f8003e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:00.359318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca67314-33c0-48e0-aa39-637822f8003e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:00.369361 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:00.444359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21fc78-0fc5-4a94-b134-4203cbed5915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:00.444983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21fc78-0fc5-4a94-b134-4203cbed5915 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:00.445298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21fc78-0fc5-4a94-b134-4203cbed5915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:00.445592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21fc78-0fc5-4a94-b134-4203cbed5915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:00.446245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21fc78-0fc5-4a94-b134-4203cbed5915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:00.447889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21fc78-0fc5-4a94-b134-4203cbed5915 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:00.464587 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1284/2590] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:00.465788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b386a0-b2d3-49b4-87e3-ed0fb1fe25ab admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:00.471342 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:00.479185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b386a0-b2d3-49b4-87e3-ed0fb1fe25ab admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:00.488857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26175e48-3170-411d-b1ea-06fdd0a35fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:00.489677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175e48-3170-411d-b1ea-06fdd0a35fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:00.490483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175e48-3170-411d-b1ea-06fdd0a35fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:00.490867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175e48-3170-411d-b1ea-06fdd0a35fcd admin admin] PATH_INFO: `/v3/projects/c00db8f12f03444aa2bb0ac6a276666c/users/22ed94252c1e406aaafefab6edd128fe/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:00.493030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26175e48-3170-411d-b1ea-06fdd0a35fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00db8f12f03444aa2bb0ac6a276666c, user_id=22ed94252c1e406aaafefab6edd128fe, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:00.497335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26175e48-3170-411d-b1ea-06fdd0a35fcd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:00.511744 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1307/2591] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:00 2022] PUT /identity/v3/projects/c00db8f12f03444aa2bb0ac6a276666c/users/22ed94252c1e406aaafefab6edd128fe/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:04:00.524763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99dcf-6712-47e9-9795-70f607d9803c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:00.525324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99dcf-6712-47e9-9795-70f607d9803c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:00.525831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99dcf-6712-47e9-9795-70f607d9803c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:00.573701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-79c99dcf-6712-47e9-9795-70f607d9803c None None] MFA Rules not processed for user `22ed94252c1e406aaafefab6edd128fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:00.575990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79c99dcf-6712-47e9-9795-70f607d9803c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:00.662764 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1285/2592] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:00.673434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4dc32-90d1-4bf1-87f9-1458ad4e403e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:00.674028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4dc32-90d1-4bf1-87f9-1458ad4e403e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:00.674028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4dc32-90d1-4bf1-87f9-1458ad4e403e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:00.697262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fae4dc32-90d1-4bf1-87f9-1458ad4e403e None None] MFA Rules not processed for user `c076d9dc75a7400f87b480d2b18dcc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:00.698645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fae4dc32-90d1-4bf1-87f9-1458ad4e403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:00.808010 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1308/2593] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:00.872552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99dcf-6712-47e9-9795-70f607d9803c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:00.875123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79c99dcf-6712-47e9-9795-70f607d9803c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:00.997099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99dcf-6712-47e9-9795-70f607d9803c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:01.007201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aab41-ef62-4fb2-aac1-c7b7c5237542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:01.007824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aab41-ef62-4fb2-aac1-c7b7c5237542 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:01.008100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aab41-ef62-4fb2-aac1-c7b7c5237542 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:01.008373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aab41-ef62-4fb2-aac1-c7b7c5237542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:01.017757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aab41-ef62-4fb2-aac1-c7b7c5237542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:01.019939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aab41-ef62-4fb2-aac1-c7b7c5237542 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:01.030686 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1286/2594] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:01.705303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4dc32-90d1-4bf1-87f9-1458ad4e403e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:01.707556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fae4dc32-90d1-4bf1-87f9-1458ad4e403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:01.795565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4dc32-90d1-4bf1-87f9-1458ad4e403e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:01.802076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16a1c0-80bc-4899-80d6-9226c2c46a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:01.802770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16a1c0-80bc-4899-80d6-9226c2c46a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:01.803053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16a1c0-80bc-4899-80d6-9226c2c46a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:01.803357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16a1c0-80bc-4899-80d6-9226c2c46a64 admin admin] PATH_INFO: `/v3/users/25fbb294f2064ce386c25ce5e371a1dc` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:01.804488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16a1c0-80bc-4899-80d6-9226c2c46a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25fbb294f2064ce386c25ce5e371a1dc)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:01.806543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16a1c0-80bc-4899-80d6-9226c2c46a64 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:01.881977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aa16a1c0-80bc-4899-80d6-9226c2c46a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25fbb294f2064ce386c25ce5e371a1dc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:01.912101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aa16a1c0-80bc-4899-80d6-9226c2c46a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25fbb294f2064ce386c25ce5e371a1dc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:01.913411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aa16a1c0-80bc-4899-80d6-9226c2c46a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25fbb294f2064ce386c25ce5e371a1dc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:01.924336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aa16a1c0-80bc-4899-80d6-9226c2c46a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25fbb294f2064ce386c25ce5e371a1dc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:01.925542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aa16a1c0-80bc-4899-80d6-9226c2c46a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25fbb294f2064ce386c25ce5e371a1dc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:01.946445 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1309/2595] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:01 2022] DELETE /identity/v3/users/25fbb294f2064ce386c25ce5e371a1dc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:02.166816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aab41-ef62-4fb2-aac1-c7b7c5237542 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:02.185748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aab41-ef62-4fb2-aac1-c7b7c5237542 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:02.210422 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:02.268531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:02.269488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:02.270087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:02.270333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] PATH_INFO: `/v3/projects/b94d90c894bf4eac916e2ff32975efcd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:02.271804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94d90c894bf4eac916e2ff32975efcd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:02.274023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:02.330319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94d90c894bf4eac916e2ff32975efcd', 'request_id': 'req-7375b128-eaba-48e3-a5be-ab1ed80388f1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:02.335863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94d90c894bf4eac916e2ff32975efcd', 'request_id': 'req-7375b128-eaba-48e3-a5be-ab1ed80388f1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:02.341990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94d90c894bf4eac916e2ff32975efcd', 'request_id': 'req-7375b128-eaba-48e3-a5be-ab1ed80388f1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:02.355011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] The token cache is being invalidate because project b94d90c894bf4eac916e2ff32975efcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:02.355304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:02.355933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7375b128-eaba-48e3-a5be-ab1ed80388f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:02.357412 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1287/2596] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:02 2022] DELETE /identity/v3/projects/b94d90c894bf4eac916e2ff32975efcd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:02.362413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d6de6-11b5-43cd-b08f-736ab718208f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:02.363326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d6de6-11b5-43cd-b08f-736ab718208f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:02.363562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d6de6-11b5-43cd-b08f-736ab718208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:02.383065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-229d6de6-11b5-43cd-b08f-736ab718208f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:02.384273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-229d6de6-11b5-43cd-b08f-736ab718208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:02.392410 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:02.444397 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1310/2597] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:02.451882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9a9c2-e462-4989-8697-d7c32d7d2199 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:02.452188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9a9c2-e462-4989-8697-d7c32d7d2199 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:02.452478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9a9c2-e462-4989-8697-d7c32d7d2199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:02.472436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-34c9a9c2-e462-4989-8697-d7c32d7d2199 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:02.473658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-34c9a9c2-e462-4989-8697-d7c32d7d2199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:02.481449 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1288/2598] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:02.485651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d6de6-11b5-43cd-b08f-736ab718208f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:02.496442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d6de6-11b5-43cd-b08f-736ab718208f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:02.500964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1f53-0c8b-445c-acc3-85f92cc0afec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:02.501555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1f53-0c8b-445c-acc3-85f92cc0afec admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:02.501833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1f53-0c8b-445c-acc3-85f92cc0afec admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:02.502105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1f53-0c8b-445c-acc3-85f92cc0afec admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:02.502800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1f53-0c8b-445c-acc3-85f92cc0afec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:04:02.503139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1f53-0c8b-445c-acc3-85f92cc0afec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:02.504822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1f53-0c8b-445c-acc3-85f92cc0afec admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:02.516088 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1311/2599] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:02.520262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9a9c2-e462-4989-8697-d7c32d7d2199 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:02.529262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9a9c2-e462-4989-8697-d7c32d7d2199 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:02.533872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8a03a-802f-4edf-92bf-6da343756cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:02.535006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a03a-802f-4edf-92bf-6da343756cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:02.535287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a03a-802f-4edf-92bf-6da343756cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:02.535563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a03a-802f-4edf-92bf-6da343756cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:02.536193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8a03a-802f-4edf-92bf-6da343756cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:02.538082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8a03a-802f-4edf-92bf-6da343756cc6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:02.569457 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1289/2600] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:02 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:02.570530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1f53-0c8b-445c-acc3-85f92cc0afec admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:02.581834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1f53-0c8b-445c-acc3-85f92cc0afec admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:02.648581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccbb75-8bf8-49bf-a731-1ada3a5c4f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:02.649193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccbb75-8bf8-49bf-a731-1ada3a5c4f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:02.649472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccbb75-8bf8-49bf-a731-1ada3a5c4f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:02.649748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccbb75-8bf8-49bf-a731-1ada3a5c4f54 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:02.654097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cccbb75-8bf8-49bf-a731-1ada3a5c4f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:02.656087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cccbb75-8bf8-49bf-a731-1ada3a5c4f54 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:02.678991 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1312/2601] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:02 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:04:02.683442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8a03a-802f-4edf-92bf-6da343756cc6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:02.694558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8a03a-802f-4edf-92bf-6da343756cc6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:02.699180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964a4a-ad7f-4136-9209-367e30e73257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:02.699794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964a4a-ad7f-4136-9209-367e30e73257 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:02.700066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964a4a-ad7f-4136-9209-367e30e73257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:02.700337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964a4a-ad7f-4136-9209-367e30e73257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:02.700982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1964a4a-ad7f-4136-9209-367e30e73257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:02.702570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1964a4a-ad7f-4136-9209-367e30e73257 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:02.713589 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1290/2602] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:02.717573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccbb75-8bf8-49bf-a731-1ada3a5c4f54 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:02.729205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccbb75-8bf8-49bf-a731-1ada3a5c4f54 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:02.736271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569dd79-8f0e-4c36-978e-9d997c5bf418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:02.736964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569dd79-8f0e-4c36-978e-9d997c5bf418 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:02.737248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569dd79-8f0e-4c36-978e-9d997c5bf418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:02.737547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569dd79-8f0e-4c36-978e-9d997c5bf418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:02.742213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569dd79-8f0e-4c36-978e-9d997c5bf418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:02.743867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569dd79-8f0e-4c36-978e-9d997c5bf418 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:02.756404 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1313/2603] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:02.761024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964a4a-ad7f-4136-9209-367e30e73257 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:02.774171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964a4a-ad7f-4136-9209-367e30e73257 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:02.779313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79d1f3-7133-4568-9441-cd88451aef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:02.779982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79d1f3-7133-4568-9441-cd88451aef59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:02.780937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79d1f3-7133-4568-9441-cd88451aef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:02.780937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79d1f3-7133-4568-9441-cd88451aef59 admin admin] PATH_INFO: `/v3/projects/64100f586037490fa194996c7c160628/users/2841e887f45d4f46af80665b781893e7/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:02.797712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79d1f3-7133-4568-9441-cd88451aef59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64100f586037490fa194996c7c160628, user_id=2841e887f45d4f46af80665b781893e7, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:02.800249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79d1f3-7133-4568-9441-cd88451aef59 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:02.817672 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1291/2604] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:02 2022] PUT /identity/v3/projects/64100f586037490fa194996c7c160628/users/2841e887f45d4f46af80665b781893e7/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:02.887082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7ff68-001f-4f72-bc81-c98659083e55 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:02.887369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7ff68-001f-4f72-bc81-c98659083e55 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:02.887635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7ff68-001f-4f72-bc81-c98659083e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:02.918932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c9f7ff68-001f-4f72-bc81-c98659083e55 None None] MFA Rules not processed for user `2841e887f45d4f46af80665b781893e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:02.920288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c9f7ff68-001f-4f72-bc81-c98659083e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:03.001640 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1314/2605] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:03.033245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79d1f3-7133-4568-9441-cd88451aef59 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:03.036201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5f79d1f3-7133-4568-9441-cd88451aef59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:03.093184 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:03.127428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79d1f3-7133-4568-9441-cd88451aef59 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:03.134510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3cec1-9374-4f72-9411-56e6bc6193e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:03.135333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3cec1-9374-4f72-9411-56e6bc6193e0 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:03.135630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3cec1-9374-4f72-9411-56e6bc6193e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:03.135960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3cec1-9374-4f72-9411-56e6bc6193e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:03.145811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3cec1-9374-4f72-9411-56e6bc6193e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:03.148231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3cec1-9374-4f72-9411-56e6bc6193e0 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:03.161981 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1292/2606] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:03.483798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7ff68-001f-4f72-bc81-c98659083e55 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:03.492935 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:03.554749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7ff68-001f-4f72-bc81-c98659083e55 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:03.560099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:03.560784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:03.561070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:03.561349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] PATH_INFO: `/v3/users/2841e887f45d4f46af80665b781893e7` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:03.562705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2841e887f45d4f46af80665b781893e7)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:03.565177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:03.622979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2841e887f45d4f46af80665b781893e7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:03.636160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2841e887f45d4f46af80665b781893e7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:03.636920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2841e887f45d4f46af80665b781893e7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:03.644917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2841e887f45d4f46af80665b781893e7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:03.645719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2841e887f45d4f46af80665b781893e7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:03.658768 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1315/2607] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:03 2022] DELETE /identity/v3/users/2841e887f45d4f46af80665b781893e7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:03.663541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85dfc3-4a0e-42a9-b1fa-14288de570c7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:03.664044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85dfc3-4a0e-42a9-b1fa-14288de570c7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:03.664160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85dfc3-4a0e-42a9-b1fa-14288de570c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:03.683574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4e85dfc3-4a0e-42a9-b1fa-14288de570c7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:03.684829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4e85dfc3-4a0e-42a9-b1fa-14288de570c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:03.745826 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1293/2608] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:03.756457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:03.757898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:03.818263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412c4e-5bcc-43bb-be59-38fa0d6d24c8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:03.821928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7f129-13c6-406c-ac9a-e81bc9715e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:03.822532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7f129-13c6-406c-ac9a-e81bc9715e26 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:03.822842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7f129-13c6-406c-ac9a-e81bc9715e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:03.823116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7f129-13c6-406c-ac9a-e81bc9715e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:03.832258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7f129-13c6-406c-ac9a-e81bc9715e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:03.833687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7f129-13c6-406c-ac9a-e81bc9715e26 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:03.845047 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1316/2609] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:04.609687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85dfc3-4a0e-42a9-b1fa-14288de570c7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:04.609687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4e85dfc3-4a0e-42a9-b1fa-14288de570c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:04.622931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85dfc3-4a0e-42a9-b1fa-14288de570c7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:04.642633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:04.642890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:04.643264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:04.643763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] PATH_INFO: `/v3/projects/64100f586037490fa194996c7c160628` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:04.645096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64100f586037490fa194996c7c160628)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:04.648379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:04.705041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64100f586037490fa194996c7c160628', 'request_id': 'req-c19f775f-1ef0-4544-8810-27aaf8e276e2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:04.711969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64100f586037490fa194996c7c160628', 'request_id': 'req-c19f775f-1ef0-4544-8810-27aaf8e276e2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:04.720053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64100f586037490fa194996c7c160628', 'request_id': 'req-c19f775f-1ef0-4544-8810-27aaf8e276e2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:04.745794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] The token cache is being invalidate because project 64100f586037490fa194996c7c160628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:04.746204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:04.747063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c19f775f-1ef0-4544-8810-27aaf8e276e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:04.749303 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1294/2610] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:04 2022] DELETE /identity/v3/projects/64100f586037490fa194996c7c160628 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:04.756678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d02a-4f0c-4cb2-a650-350cfa8fbd81 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:04.757226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d02a-4f0c-4cb2-a650-350cfa8fbd81 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:04.757226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d02a-4f0c-4cb2-a650-350cfa8fbd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:04.779855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-23e5d02a-4f0c-4cb2-a650-350cfa8fbd81 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:04.781659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-23e5d02a-4f0c-4cb2-a650-350cfa8fbd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:04.819478 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:04.886652 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1317/2611] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:04:04.893309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dcb69-9b7d-4bda-b034-651ddb0bd4dd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:04.894116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dcb69-9b7d-4bda-b034-651ddb0bd4dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:04.894400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dcb69-9b7d-4bda-b034-651ddb0bd4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:04.919377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f07dcb69-9b7d-4bda-b034-651ddb0bd4dd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:04.920297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f07dcb69-9b7d-4bda-b034-651ddb0bd4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:04.935325 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1295/2612] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:04.936825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5d02a-4f0c-4cb2-a650-350cfa8fbd81 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:04.947943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5d02a-4f0c-4cb2-a650-350cfa8fbd81 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:04.952893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616c495-d3fe-432c-8702-60510dfc3f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:04.953757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616c495-d3fe-432c-8702-60510dfc3f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:04.954105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616c495-d3fe-432c-8702-60510dfc3f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:04.954485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616c495-d3fe-432c-8702-60510dfc3f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:04.955236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616c495-d3fe-432c-8702-60510dfc3f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:04:04.955611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616c495-d3fe-432c-8702-60510dfc3f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:04.957869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616c495-d3fe-432c-8702-60510dfc3f99 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:04.981904 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1318/2613] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:04.986322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dcb69-9b7d-4bda-b034-651ddb0bd4dd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:05.004174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dcb69-9b7d-4bda-b034-651ddb0bd4dd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:05.012760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69c0c9-0e5b-4e2a-9039-bad8787fd44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:05.013380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c0c9-0e5b-4e2a-9039-bad8787fd44b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:05.013677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c0c9-0e5b-4e2a-9039-bad8787fd44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:05.013938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c0c9-0e5b-4e2a-9039-bad8787fd44b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:05.014583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69c0c9-0e5b-4e2a-9039-bad8787fd44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:05.016668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69c0c9-0e5b-4e2a-9039-bad8787fd44b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:05.056358 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1296/2614] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:04 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:05.056550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616c495-d3fe-432c-8702-60510dfc3f99 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:05.070653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616c495-d3fe-432c-8702-60510dfc3f99 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:05.142350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60059e2-3044-4c65-9c1f-7387281db0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:05.143375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60059e2-3044-4c65-9c1f-7387281db0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:05.144422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60059e2-3044-4c65-9c1f-7387281db0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:05.144761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60059e2-3044-4c65-9c1f-7387281db0d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:05.145706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60059e2-3044-4c65-9c1f-7387281db0d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:05.147675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60059e2-3044-4c65-9c1f-7387281db0d1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:05.174297 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1319/2615] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:05 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:04:05.179070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69c0c9-0e5b-4e2a-9039-bad8787fd44b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:05.191982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69c0c9-0e5b-4e2a-9039-bad8787fd44b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:05.200569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97bbb1-ca4a-4630-9ab4-89d3469a6153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:05.201219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97bbb1-ca4a-4630-9ab4-89d3469a6153 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:05.201499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97bbb1-ca4a-4630-9ab4-89d3469a6153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:05.201948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97bbb1-ca4a-4630-9ab4-89d3469a6153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:05.203002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97bbb1-ca4a-4630-9ab4-89d3469a6153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:05.204596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97bbb1-ca4a-4630-9ab4-89d3469a6153 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:05.223520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60059e2-3044-4c65-9c1f-7387281db0d1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:05.227683 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1297/2616] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:05.235987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60059e2-3044-4c65-9c1f-7387281db0d1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:05.242646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ba406-1125-4e03-961b-d6a380ee97c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:05.244414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba406-1125-4e03-961b-d6a380ee97c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:05.244934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba406-1125-4e03-961b-d6a380ee97c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:05.245462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba406-1125-4e03-961b-d6a380ee97c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:05.246486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ba406-1125-4e03-961b-d6a380ee97c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:05.249841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ba406-1125-4e03-961b-d6a380ee97c2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:05.263204 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1320/2617] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:05.267626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97bbb1-ca4a-4630-9ab4-89d3469a6153 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:05.279535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97bbb1-ca4a-4630-9ab4-89d3469a6153 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:05.285406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd98694-e875-4506-806f-d3d4927b5036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:05.286332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd98694-e875-4506-806f-d3d4927b5036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:05.286753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd98694-e875-4506-806f-d3d4927b5036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:05.287197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd98694-e875-4506-806f-d3d4927b5036 admin admin] PATH_INFO: `/v3/projects/73b489bd5bcd454da7e49c89f35f711f/users/30185488a8864d5abae55abd94a7322e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:05.299846 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:05.305489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd98694-e875-4506-806f-d3d4927b5036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b489bd5bcd454da7e49c89f35f711f, user_id=30185488a8864d5abae55abd94a7322e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:05.309712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd98694-e875-4506-806f-d3d4927b5036 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:05.327612 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1298/2618] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:05 2022] PUT /identity/v3/projects/73b489bd5bcd454da7e49c89f35f711f/users/30185488a8864d5abae55abd94a7322e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:05.338340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f3ae-0174-45df-81ce-1931bccb9051 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:05.338659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f3ae-0174-45df-81ce-1931bccb9051 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:05.338942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f3ae-0174-45df-81ce-1931bccb9051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:05.368655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0351f3ae-0174-45df-81ce-1931bccb9051 None None] MFA Rules not processed for user `30185488a8864d5abae55abd94a7322e`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:05.369791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0351f3ae-0174-45df-81ce-1931bccb9051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:05.446756 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1321/2619] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:05.458565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777c34-4566-4da4-a110-aa9e6a8ffcba None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:05.458947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777c34-4566-4da4-a110-aa9e6a8ffcba None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:05.459181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777c34-4566-4da4-a110-aa9e6a8ffcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:05.479851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-08777c34-4566-4da4-a110-aa9e6a8ffcba None None] MFA Rules not processed for user `30185488a8864d5abae55abd94a7322e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:05.481136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-08777c34-4566-4da4-a110-aa9e6a8ffcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:05.489672 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1299/2620] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:05.501609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351f3ae-0174-45df-81ce-1931bccb9051 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:05.503217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0351f3ae-0174-45df-81ce-1931bccb9051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:05.538074 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:05.595207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351f3ae-0174-45df-81ce-1931bccb9051 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:05.603647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80e665-005d-4a48-bc68-4fd4c99d717c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:05.604554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e665-005d-4a48-bc68-4fd4c99d717c service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:05.605077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e665-005d-4a48-bc68-4fd4c99d717c service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:05.605698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e665-005d-4a48-bc68-4fd4c99d717c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:05.617128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80e665-005d-4a48-bc68-4fd4c99d717c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:05.619192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80e665-005d-4a48-bc68-4fd4c99d717c service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:05.633655 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1322/2621] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:07.137972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96fcf4-6c04-4f79-bb61-1ae6f41eb446 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:07.138693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96fcf4-6c04-4f79-bb61-1ae6f41eb446 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:07.139061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96fcf4-6c04-4f79-bb61-1ae6f41eb446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:07.164062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9c96fcf4-6c04-4f79-bb61-1ae6f41eb446 None None] MFA Rules not processed for user `d44f8d053e07440699d217cd63c94d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:07.165662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c96fcf4-6c04-4f79-bb61-1ae6f41eb446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:07.225555 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1300/2622] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:07 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:15.628215 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=22 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:17.217929 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:18.215520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80e665-005d-4a48-bc68-4fd4c99d717c service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:18.223242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-de80e665-005d-4a48-bc68-4fd4c99d717c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:18.241605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80e665-005d-4a48-bc68-4fd4c99d717c service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:18.249162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701acde-ab41-452c-993e-4af0b9d43439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:18.249162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701acde-ab41-452c-993e-4af0b9d43439 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:18.249162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701acde-ab41-452c-993e-4af0b9d43439 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:18.249524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701acde-ab41-452c-993e-4af0b9d43439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:18.251153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d701acde-ab41-452c-993e-4af0b9d43439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:18.325179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701acde-ab41-452c-993e-4af0b9d43439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:18.326823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701acde-ab41-452c-993e-4af0b9d43439 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:18.337289 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1323/2623] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:18.771159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e042767-dea9-4d68-8469-d3a290e01ecd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:18.771730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e042767-dea9-4d68-8469-d3a290e01ecd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:18.771730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e042767-dea9-4d68-8469-d3a290e01ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:18.791247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3e042767-dea9-4d68-8469-d3a290e01ecd None None] MFA Rules not processed for user `c076d9dc75a7400f87b480d2b18dcc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:18.792450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3e042767-dea9-4d68-8469-d3a290e01ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:18.850251 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1301/2624] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:23.752990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22fc20-ede7-4561-8c86-24f014a830b3 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:23.753839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22fc20-ede7-4561-8c86-24f014a830b3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:23.754265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22fc20-ede7-4561-8c86-24f014a830b3 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:23.756354 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1324/2625] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 01:04:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:04:23.813508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f82ce-5c08-44cd-8631-b41ded51056f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:23.814567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f82ce-5c08-44cd-8631-b41ded51056f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:23.815136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f82ce-5c08-44cd-8631-b41ded51056f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:23.842151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-521f82ce-5c08-44cd-8631-b41ded51056f None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:23.843729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-521f82ce-5c08-44cd-8631-b41ded51056f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:23.936945 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1302/2626] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:04:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:23.960978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22fc20-ede7-4561-8c86-24f014a830b3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:23.962991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cc22fc20-ede7-4561-8c86-24f014a830b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:23.982700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22fc20-ede7-4561-8c86-24f014a830b3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:23.989498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d7666-8cd5-47e3-a6aa-250062d6ee5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:23.990323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d7666-8cd5-47e3-a6aa-250062d6ee5d service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:23.991676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d7666-8cd5-47e3-a6aa-250062d6ee5d service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:23.992166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d7666-8cd5-47e3-a6aa-250062d6ee5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:24.008342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d7666-8cd5-47e3-a6aa-250062d6ee5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:24.010064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d7666-8cd5-47e3-a6aa-250062d6ee5d service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:24.024966 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1325/2627] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:27.686589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f82ce-5c08-44cd-8631-b41ded51056f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:27.688381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-521f82ce-5c08-44cd-8631-b41ded51056f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:27.773687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f82ce-5c08-44cd-8631-b41ded51056f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:27.778572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:27.779235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:27.779516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:27.779794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] PATH_INFO: `/v3/users/0533d6c52e394ecc980d67c7d985076e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:27.780921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0533d6c52e394ecc980d67c7d985076e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:27.783022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:27.836995 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:27.840201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0533d6c52e394ecc980d67c7d985076e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:27.853928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0533d6c52e394ecc980d67c7d985076e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:27.854772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0533d6c52e394ecc980d67c7d985076e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:27.862813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0533d6c52e394ecc980d67c7d985076e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:27.872393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0533d6c52e394ecc980d67c7d985076e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:27.879805 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1303/2628] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:27 2022] DELETE /identity/v3/users/0533d6c52e394ecc980d67c7d985076e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:28.063972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d7666-8cd5-47e3-a6aa-250062d6ee5d service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:28.082428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d7666-8cd5-47e3-a6aa-250062d6ee5d service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:28.153766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:28.154395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:28.154711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:28.154989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] PATH_INFO: `/v3/projects/1906af62eccb4a4d9e533a763a3e2018` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:28.156347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1906af62eccb4a4d9e533a763a3e2018)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:28.158954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:28.216918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1906af62eccb4a4d9e533a763a3e2018', 'request_id': 'req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.223469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1906af62eccb4a4d9e533a763a3e2018', 'request_id': 'req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.229876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1906af62eccb4a4d9e533a763a3e2018', 'request_id': 'req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.245938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] The token cache is being invalidate because project 1906af62eccb4a4d9e533a763a3e2018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:28.246568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.248372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.251128 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1326/2629] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:28 2022] DELETE /identity/v3/projects/1906af62eccb4a4d9e533a763a3e2018 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:28.255929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:28.257956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:28.285395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deb4e8-26f4-433d-8f12-b7df396a0094 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:28.343413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf0306-beab-490e-9246-353d22709809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:28.344058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf0306-beab-490e-9246-353d22709809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:28.344338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf0306-beab-490e-9246-353d22709809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:28.344613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf0306-beab-490e-9246-353d22709809 admin admin] PATH_INFO: `/v3/users/058aa80c9ad24366be4f9e6ee9702679` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:28.346386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf0306-beab-490e-9246-353d22709809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=058aa80c9ad24366be4f9e6ee9702679)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:28.348385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf0306-beab-490e-9246-353d22709809 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:28.400266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-19cf0306-beab-490e-9246-353d22709809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058aa80c9ad24366be4f9e6ee9702679'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.412846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-19cf0306-beab-490e-9246-353d22709809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058aa80c9ad24366be4f9e6ee9702679'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.413575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-19cf0306-beab-490e-9246-353d22709809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058aa80c9ad24366be4f9e6ee9702679'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.423450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-19cf0306-beab-490e-9246-353d22709809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058aa80c9ad24366be4f9e6ee9702679'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.431343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-19cf0306-beab-490e-9246-353d22709809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058aa80c9ad24366be4f9e6ee9702679'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.437802 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1304/2630] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:28 2022] DELETE /identity/v3/users/058aa80c9ad24366be4f9e6ee9702679 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:28.623658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:28.624800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:28.644038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ecd9d-e278-4bbd-bcd0-dc5c6ffdbb83 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:28.654480 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:28.710859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:28.711721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:28.711876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:28.712050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] PATH_INFO: `/v3/projects/7518f1de0ef84eccaee457e1e8d83eda` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:28.713211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7518f1de0ef84eccaee457e1e8d83eda)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:28.715175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:28.769237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7518f1de0ef84eccaee457e1e8d83eda', 'request_id': 'req-bef848ae-d994-461f-9e4c-365ee35b1a62'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.776704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7518f1de0ef84eccaee457e1e8d83eda', 'request_id': 'req-bef848ae-d994-461f-9e4c-365ee35b1a62'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.783959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7518f1de0ef84eccaee457e1e8d83eda', 'request_id': 'req-bef848ae-d994-461f-9e4c-365ee35b1a62'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.797195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] The token cache is being invalidate because project 7518f1de0ef84eccaee457e1e8d83eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:28.797448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.798051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bef848ae-d994-461f-9e4c-365ee35b1a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:28.799774 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1327/2631] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:28 2022] DELETE /identity/v3/projects/7518f1de0ef84eccaee457e1e8d83eda => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:28.804727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8163bd4-4524-4995-8d5c-1d6f6533aa08 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:28.805269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8163bd4-4524-4995-8d5c-1d6f6533aa08 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:28.805269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8163bd4-4524-4995-8d5c-1d6f6533aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:28.826258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d8163bd4-4524-4995-8d5c-1d6f6533aa08 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:28.827510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d8163bd4-4524-4995-8d5c-1d6f6533aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:28.863906 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:28.892469 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1305/2632] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:28.901263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d93869-5593-4a9b-8f52-694f1a5a2d2a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:28.901548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d93869-5593-4a9b-8f52-694f1a5a2d2a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:28.901825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d93869-5593-4a9b-8f52-694f1a5a2d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:28.921834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-73d93869-5593-4a9b-8f52-694f1a5a2d2a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:28.923094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-73d93869-5593-4a9b-8f52-694f1a5a2d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:28.935373 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1328/2633] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:28.936597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8163bd4-4524-4995-8d5c-1d6f6533aa08 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:28.947748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8163bd4-4524-4995-8d5c-1d6f6533aa08 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:28.954394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52488675-502f-4eb1-8803-4b522c4a7179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:28.955041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52488675-502f-4eb1-8803-4b522c4a7179 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:28.955499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52488675-502f-4eb1-8803-4b522c4a7179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:28.955617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52488675-502f-4eb1-8803-4b522c4a7179 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:28.956264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52488675-502f-4eb1-8803-4b522c4a7179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:04:28.956570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52488675-502f-4eb1-8803-4b522c4a7179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:28.958197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52488675-502f-4eb1-8803-4b522c4a7179 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:28.980719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d93869-5593-4a9b-8f52-694f1a5a2d2a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:28.982446 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1306/2634] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:04:28.991318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d93869-5593-4a9b-8f52-694f1a5a2d2a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:28.997009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebbead-9121-4f51-a3bb-1d5341625700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:28.997618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebbead-9121-4f51-a3bb-1d5341625700 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:28.997897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebbead-9121-4f51-a3bb-1d5341625700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:28.998168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebbead-9121-4f51-a3bb-1d5341625700 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:28.998847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebbead-9121-4f51-a3bb-1d5341625700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:29.000740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebbead-9121-4f51-a3bb-1d5341625700 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:29.029682 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1329/2635] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:28 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:29.034110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52488675-502f-4eb1-8803-4b522c4a7179 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:29.044356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52488675-502f-4eb1-8803-4b522c4a7179 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:29.103984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a67a0b-5a0e-4163-8d50-4cd803da439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:29.104602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67a0b-5a0e-4163-8d50-4cd803da439a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.104883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67a0b-5a0e-4163-8d50-4cd803da439a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.105156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67a0b-5a0e-4163-8d50-4cd803da439a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.105793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a67a0b-5a0e-4163-8d50-4cd803da439a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:29.107790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a67a0b-5a0e-4163-8d50-4cd803da439a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:29.130097 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1307/2636] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:29 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:29.134253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebbead-9121-4f51-a3bb-1d5341625700 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:29.144406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebbead-9121-4f51-a3bb-1d5341625700 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:29.149145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e9776-548e-4ac1-980c-3992105f0b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:29.149721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9776-548e-4ac1-980c-3992105f0b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.149997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9776-548e-4ac1-980c-3992105f0b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.150268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9776-548e-4ac1-980c-3992105f0b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.150938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e9776-548e-4ac1-980c-3992105f0b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:29.152572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e9776-548e-4ac1-980c-3992105f0b22 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:29.162758 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1330/2637] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:29.166999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a67a0b-5a0e-4163-8d50-4cd803da439a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:29.178049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a67a0b-5a0e-4163-8d50-4cd803da439a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:29.182927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c22d33-7873-43eb-8022-996f90284155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:29.183529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22d33-7873-43eb-8022-996f90284155 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.183833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22d33-7873-43eb-8022-996f90284155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.184109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22d33-7873-43eb-8022-996f90284155 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.184752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c22d33-7873-43eb-8022-996f90284155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:29.186352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c22d33-7873-43eb-8022-996f90284155 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:29.197926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1308/2638] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:29.202183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e9776-548e-4ac1-980c-3992105f0b22 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:29.212502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e9776-548e-4ac1-980c-3992105f0b22 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:29.217334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d8511-2fc9-4332-b898-6139a2023fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:29.217983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8511-2fc9-4332-b898-6139a2023fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.218261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8511-2fc9-4332-b898-6139a2023fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.218533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8511-2fc9-4332-b898-6139a2023fbf admin admin] PATH_INFO: `/v3/projects/0860aeb7708d4fd8a341e9ba0e36edf7/users/3fce043f23844debb1521fc81f33def7/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.233442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d8511-2fc9-4332-b898-6139a2023fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0860aeb7708d4fd8a341e9ba0e36edf7, user_id=3fce043f23844debb1521fc81f33def7, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:29.236154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d8511-2fc9-4332-b898-6139a2023fbf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:29.250215 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1331/2639] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:29 2022] PUT /identity/v3/projects/0860aeb7708d4fd8a341e9ba0e36edf7/users/3fce043f23844debb1521fc81f33def7/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:29.260666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19294-1dfd-4b61-8970-4a614acfc0c2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.260953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19294-1dfd-4b61-8970-4a614acfc0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.261232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19294-1dfd-4b61-8970-4a614acfc0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.290380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-73b19294-1dfd-4b61-8970-4a614acfc0c2 None None] MFA Rules not processed for user `3fce043f23844debb1521fc81f33def7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:29.291859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-73b19294-1dfd-4b61-8970-4a614acfc0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:29.367905 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1309/2640] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:29.372637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d8511-2fc9-4332-b898-6139a2023fbf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:29.415284 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:29.438211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d8511-2fc9-4332-b898-6139a2023fbf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:29.443128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecafe07-6b1e-4530-ac64-39f5d5220c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:29.443739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecafe07-6b1e-4530-ac64-39f5d5220c45 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.444023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecafe07-6b1e-4530-ac64-39f5d5220c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.444300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecafe07-6b1e-4530-ac64-39f5d5220c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.444943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecafe07-6b1e-4530-ac64-39f5d5220c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:29.446880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecafe07-6b1e-4530-ac64-39f5d5220c45 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:29.475961 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1332/2641] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:29 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:04:29.479995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b19294-1dfd-4b61-8970-4a614acfc0c2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:29.491375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b19294-1dfd-4b61-8970-4a614acfc0c2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:29.526500 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:29.557222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efe167-d236-4b03-9ac9-f6a71418dfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:29.558120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe167-d236-4b03-9ac9-f6a71418dfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.558404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe167-d236-4b03-9ac9-f6a71418dfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.558706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe167-d236-4b03-9ac9-f6a71418dfe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.559333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efe167-d236-4b03-9ac9-f6a71418dfe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:29.561250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efe167-d236-4b03-9ac9-f6a71418dfe2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:29.591220 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1310/2642] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:29 2022] POST /identity/v3/users => generated 308 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:29.595261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecafe07-6b1e-4530-ac64-39f5d5220c45 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:29.606002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecafe07-6b1e-4530-ac64-39f5d5220c45 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:29.612451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6327f-c765-43f4-986f-7fd4895c64bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:29.613224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6327f-c765-43f4-986f-7fd4895c64bf admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.613504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6327f-c765-43f4-986f-7fd4895c64bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.613777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6327f-c765-43f4-986f-7fd4895c64bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.614425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6327f-c765-43f4-986f-7fd4895c64bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:29.616061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6327f-c765-43f4-986f-7fd4895c64bf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:29.626956 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1333/2643] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:29.631404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efe167-d236-4b03-9ac9-f6a71418dfe2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:29.644522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efe167-d236-4b03-9ac9-f6a71418dfe2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:29.649177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c2774-9fe8-431c-987e-898ca40f97fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:29.649838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c2774-9fe8-431c-987e-898ca40f97fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.650115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c2774-9fe8-431c-987e-898ca40f97fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.650387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c2774-9fe8-431c-987e-898ca40f97fe admin admin] PATH_INFO: `/v3/projects/38be01e8870946c793ab7d7fe7e8ffef/users/a11b067a724a418f99854f61699811d8/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.666927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c2774-9fe8-431c-987e-898ca40f97fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=38be01e8870946c793ab7d7fe7e8ffef, user_id=a11b067a724a418f99854f61699811d8, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:29.670196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c2774-9fe8-431c-987e-898ca40f97fe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:29.684992 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1311/2644] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:29 2022] PUT /identity/v3/projects/38be01e8870946c793ab7d7fe7e8ffef/users/a11b067a724a418f99854f61699811d8/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:29.688952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6327f-c765-43f4-986f-7fd4895c64bf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:29.698858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6327f-c765-43f4-986f-7fd4895c64bf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:29.759110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdd127-0558-481e-9133-2048121e084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:29.760147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd127-0558-481e-9133-2048121e084c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.760147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd127-0558-481e-9133-2048121e084c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.761121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd127-0558-481e-9133-2048121e084c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.761254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdd127-0558-481e-9133-2048121e084c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:29.767249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdd127-0558-481e-9133-2048121e084c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:29.775978 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1334/2645] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:29.780038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c2774-9fe8-431c-987e-898ca40f97fe admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:29.791600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c2774-9fe8-431c-987e-898ca40f97fe admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:29.796630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc5700-eed7-4b23-9b70-dd22aaa1ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:29.797234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5700-eed7-4b23-9b70-dd22aaa1ba7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.797473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5700-eed7-4b23-9b70-dd22aaa1ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.797867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5700-eed7-4b23-9b70-dd22aaa1ba7c admin admin] PATH_INFO: `/v3/projects/38be01e8870946c793ab7d7fe7e8ffef/users/a11b067a724a418f99854f61699811d8/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.800589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc5700-eed7-4b23-9b70-dd22aaa1ba7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38be01e8870946c793ab7d7fe7e8ffef, user_id=a11b067a724a418f99854f61699811d8, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:29.804198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc5700-eed7-4b23-9b70-dd22aaa1ba7c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:29.817682 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1312/2646] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:29 2022] PUT /identity/v3/projects/38be01e8870946c793ab7d7fe7e8ffef/users/a11b067a724a418f99854f61699811d8/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:29.828960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56799e9e-c44b-46af-94a4-3546bec97eb2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:29.829264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56799e9e-c44b-46af-94a4-3546bec97eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:29.829521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56799e9e-c44b-46af-94a4-3546bec97eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:29.859005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-56799e9e-c44b-46af-94a4-3546bec97eb2 None None] MFA Rules not processed for user `a11b067a724a418f99854f61699811d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:29.860211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-56799e9e-c44b-46af-94a4-3546bec97eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:29.936902 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1335/2647] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:29 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:29.947662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc5700-eed7-4b23-9b70-dd22aaa1ba7c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:29.949402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7ebc5700-eed7-4b23-9b70-dd22aaa1ba7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:30.026899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc5700-eed7-4b23-9b70-dd22aaa1ba7c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:30.032563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405bf51-c4ea-44fc-8792-a8f8e340913a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:30.033797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405bf51-c4ea-44fc-8792-a8f8e340913a service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:30.034084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405bf51-c4ea-44fc-8792-a8f8e340913a service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:30.034354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405bf51-c4ea-44fc-8792-a8f8e340913a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:30.043732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405bf51-c4ea-44fc-8792-a8f8e340913a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:30.046096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405bf51-c4ea-44fc-8792-a8f8e340913a service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:30.057859 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1313/2648] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:29 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:30.107475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56799e9e-c44b-46af-94a4-3546bec97eb2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:30.108956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-56799e9e-c44b-46af-94a4-3546bec97eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:30.126559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56799e9e-c44b-46af-94a4-3546bec97eb2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:30.132634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e5ea0-ae12-48c2-9937-1cfaa36272f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:30.133376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e5ea0-ae12-48c2-9937-1cfaa36272f0 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:30.133663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e5ea0-ae12-48c2-9937-1cfaa36272f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:30.133941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e5ea0-ae12-48c2-9937-1cfaa36272f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:30.165195 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:30.193989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e5ea0-ae12-48c2-9937-1cfaa36272f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:30.195624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e5ea0-ae12-48c2-9937-1cfaa36272f0 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:30.205038 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1336/2649] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:30 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:30.509458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405bf51-c4ea-44fc-8792-a8f8e340913a service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:30.571663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405bf51-c4ea-44fc-8792-a8f8e340913a service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:30.576160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:30.576776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:30.577053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:30.577321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] PATH_INFO: `/v3/users/3fce043f23844debb1521fc81f33def7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:30.578408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fce043f23844debb1521fc81f33def7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:30.581149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:30.596519 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:30.631714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fce043f23844debb1521fc81f33def7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:30.643884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fce043f23844debb1521fc81f33def7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:30.644745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fce043f23844debb1521fc81f33def7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:30.653191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fce043f23844debb1521fc81f33def7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:30.662774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fce043f23844debb1521fc81f33def7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:30.671133 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1314/2650] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:30 2022] DELETE /identity/v3/users/3fce043f23844debb1521fc81f33def7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:30.676337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6c6be-60bc-4805-920d-749ad11a3a2b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:30.676702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6c6be-60bc-4805-920d-749ad11a3a2b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:30.677049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6c6be-60bc-4805-920d-749ad11a3a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:30.697622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6ee6c6be-60bc-4805-920d-749ad11a3a2b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:30.698857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6ee6c6be-60bc-4805-920d-749ad11a3a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:30.766463 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1337/2651] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:04:30.775078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:30.776666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:30.869254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7b359-45fd-4f9d-9af3-ccf9c17bd95e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:30.873247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14b712-f814-4645-80f4-dac37585fcd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:30.874088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14b712-f814-4645-80f4-dac37585fcd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:30.874375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14b712-f814-4645-80f4-dac37585fcd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:30.874671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14b712-f814-4645-80f4-dac37585fcd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:30.888272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14b712-f814-4645-80f4-dac37585fcd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:30.889646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14b712-f814-4645-80f4-dac37585fcd6 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:30.900825 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1315/2652] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:31.290533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6c6be-60bc-4805-920d-749ad11a3a2b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:31.292601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6ee6c6be-60bc-4805-920d-749ad11a3a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:31.318114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6c6be-60bc-4805-920d-749ad11a3a2b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:31.323847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:31.324692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:31.325136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:31.325659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] PATH_INFO: `/v3/projects/0860aeb7708d4fd8a341e9ba0e36edf7` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:31.327271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0860aeb7708d4fd8a341e9ba0e36edf7)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:31.329743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:31.385801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0860aeb7708d4fd8a341e9ba0e36edf7', 'request_id': 'req-14db989b-fcb0-4284-96aa-d39b25af4435'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:31.392982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0860aeb7708d4fd8a341e9ba0e36edf7', 'request_id': 'req-14db989b-fcb0-4284-96aa-d39b25af4435'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:31.399473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0860aeb7708d4fd8a341e9ba0e36edf7', 'request_id': 'req-14db989b-fcb0-4284-96aa-d39b25af4435'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:31.415488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] The token cache is being invalidate because project 0860aeb7708d4fd8a341e9ba0e36edf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:31.415842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:31.416470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:31.421299 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1338/2653] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:31 2022] DELETE /identity/v3/projects/0860aeb7708d4fd8a341e9ba0e36edf7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:31.422125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14b712-f814-4645-80f4-dac37585fcd6 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:31.436266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14b712-f814-4645-80f4-dac37585fcd6 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:31.504678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eae007-75e7-4612-8ead-8c63e1ec1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:31.505609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae007-75e7-4612-8ead-8c63e1ec1c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:31.506105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae007-75e7-4612-8ead-8c63e1ec1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:31.506327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae007-75e7-4612-8ead-8c63e1ec1c96 admin admin] PATH_INFO: `/v3/users/a11b067a724a418f99854f61699811d8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:31.508034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eae007-75e7-4612-8ead-8c63e1ec1c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11b067a724a418f99854f61699811d8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:31.510287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eae007-75e7-4612-8ead-8c63e1ec1c96 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:31.605986 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:31.629790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55eae007-75e7-4612-8ead-8c63e1ec1c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11b067a724a418f99854f61699811d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:31.668221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55eae007-75e7-4612-8ead-8c63e1ec1c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11b067a724a418f99854f61699811d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:31.669231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55eae007-75e7-4612-8ead-8c63e1ec1c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11b067a724a418f99854f61699811d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:31.682966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55eae007-75e7-4612-8ead-8c63e1ec1c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11b067a724a418f99854f61699811d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:31.708851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55eae007-75e7-4612-8ead-8c63e1ec1c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11b067a724a418f99854f61699811d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:31.728115 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1316/2654] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:31 2022] DELETE /identity/v3/users/a11b067a724a418f99854f61699811d8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:32.099737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:32.101782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:32.146655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db989b-fcb0-4284-96aa-d39b25af4435 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:32.203295 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:32.212410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:32.213144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:32.213641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:32.214132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] PATH_INFO: `/v3/projects/38be01e8870946c793ab7d7fe7e8ffef` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:32.215587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38be01e8870946c793ab7d7fe7e8ffef)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:32.217559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:32.277651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38be01e8870946c793ab7d7fe7e8ffef', 'request_id': 'req-b22fc06c-4734-44c9-b097-5c5faea02a79'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:32.285648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38be01e8870946c793ab7d7fe7e8ffef', 'request_id': 'req-b22fc06c-4734-44c9-b097-5c5faea02a79'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:32.294083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38be01e8870946c793ab7d7fe7e8ffef', 'request_id': 'req-b22fc06c-4734-44c9-b097-5c5faea02a79'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:32.310383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] The token cache is being invalidate because project 38be01e8870946c793ab7d7fe7e8ffef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:32.310708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:32.311358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b22fc06c-4734-44c9-b097-5c5faea02a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:32.314744 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1339/2655] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:32 2022] DELETE /identity/v3/projects/38be01e8870946c793ab7d7fe7e8ffef => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:32.318923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d1c8f-1177-41cc-8931-4652b500ebb6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:32.319472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d1c8f-1177-41cc-8931-4652b500ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:32.319472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d1c8f-1177-41cc-8931-4652b500ebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:32.341902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1f7d1c8f-1177-41cc-8931-4652b500ebb6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:32.343163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f7d1c8f-1177-41cc-8931-4652b500ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:32.412696 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1317/2656] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:32.420474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7508-3c7d-4015-b32c-8d67cf5cdff3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:32.420759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7508-3c7d-4015-b32c-8d67cf5cdff3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:32.421036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7508-3c7d-4015-b32c-8d67cf5cdff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:32.442484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-220d7508-3c7d-4015-b32c-8d67cf5cdff3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:32.443822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-220d7508-3c7d-4015-b32c-8d67cf5cdff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:32.451724 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1340/2657] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:32.456137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d1c8f-1177-41cc-8931-4652b500ebb6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:32.465979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d1c8f-1177-41cc-8931-4652b500ebb6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:32.473096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceb205-e2eb-40a8-b250-51248bab4ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:32.473906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb205-e2eb-40a8-b250-51248bab4ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:32.474568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb205-e2eb-40a8-b250-51248bab4ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:32.474836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb205-e2eb-40a8-b250-51248bab4ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:32.476831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceb205-e2eb-40a8-b250-51248bab4ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:04:32.477235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceb205-e2eb-40a8-b250-51248bab4ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:32.479381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceb205-e2eb-40a8-b250-51248bab4ba3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:32.508588 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1318/2658] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:04:32.512972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d7508-3c7d-4015-b32c-8d67cf5cdff3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:32.524982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d7508-3c7d-4015-b32c-8d67cf5cdff3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:32.530696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2022f-ff6e-458b-b3ea-d6a0797325a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:32.531304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2022f-ff6e-458b-b3ea-d6a0797325a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:32.531693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2022f-ff6e-458b-b3ea-d6a0797325a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:32.532052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2022f-ff6e-458b-b3ea-d6a0797325a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:32.532741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2022f-ff6e-458b-b3ea-d6a0797325a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:32.535623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2022f-ff6e-458b-b3ea-d6a0797325a2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:32.566683 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1341/2659] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:32 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:04:32.569789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceb205-e2eb-40a8-b250-51248bab4ba3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:32.579829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceb205-e2eb-40a8-b250-51248bab4ba3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:32.644309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e7936-4e90-404d-b109-3cb7b93db373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:32.645297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e7936-4e90-404d-b109-3cb7b93db373 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:32.645582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e7936-4e90-404d-b109-3cb7b93db373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:32.645582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e7936-4e90-404d-b109-3cb7b93db373 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:32.645582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e7936-4e90-404d-b109-3cb7b93db373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:32.645582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e7936-4e90-404d-b109-3cb7b93db373 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:32.681579 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1319/2660] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:32 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:32.682435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2022f-ff6e-458b-b3ea-d6a0797325a2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:32.694459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2022f-ff6e-458b-b3ea-d6a0797325a2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:32.698835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c886bcb-501b-4f90-a736-206f7ce3eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:32.699511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c886bcb-501b-4f90-a736-206f7ce3eabe admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:32.699850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c886bcb-501b-4f90-a736-206f7ce3eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:32.700206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c886bcb-501b-4f90-a736-206f7ce3eabe admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:32.700910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c886bcb-501b-4f90-a736-206f7ce3eabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:32.702591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c886bcb-501b-4f90-a736-206f7ce3eabe admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:32.714289 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1342/2661] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:04:32.718037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e7936-4e90-404d-b109-3cb7b93db373 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:32.728745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e7936-4e90-404d-b109-3cb7b93db373 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:32.734175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63e72a-818a-4168-b35c-58e046289ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:32.734909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e72a-818a-4168-b35c-58e046289ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:32.735118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e72a-818a-4168-b35c-58e046289ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:32.735392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e72a-818a-4168-b35c-58e046289ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:32.736273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63e72a-818a-4168-b35c-58e046289ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:32.738677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63e72a-818a-4168-b35c-58e046289ff8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:32.751668 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1320/2662] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:32.756599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c886bcb-501b-4f90-a736-206f7ce3eabe admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:32.768732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c886bcb-501b-4f90-a736-206f7ce3eabe admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:32.773917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75212a-157c-4686-b0fa-5c1cb45cbfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:32.774718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75212a-157c-4686-b0fa-5c1cb45cbfd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:32.775055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75212a-157c-4686-b0fa-5c1cb45cbfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:32.775413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75212a-157c-4686-b0fa-5c1cb45cbfd5 admin admin] PATH_INFO: `/v3/projects/35c16b79603b4d0ebfcedf43ca0d28d4/users/933764526662412b85aeb96abcf12c45/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:32.795271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75212a-157c-4686-b0fa-5c1cb45cbfd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c16b79603b4d0ebfcedf43ca0d28d4, user_id=933764526662412b85aeb96abcf12c45, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:32.797996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75212a-157c-4686-b0fa-5c1cb45cbfd5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:32.824341 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1343/2663] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:32 2022] PUT /identity/v3/projects/35c16b79603b4d0ebfcedf43ca0d28d4/users/933764526662412b85aeb96abcf12c45/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:04:32.826854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d5bd1-08f2-4118-9739-0fe89682b4fd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:32.827146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d5bd1-08f2-4118-9739-0fe89682b4fd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:32.827418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d5bd1-08f2-4118-9739-0fe89682b4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:32.860123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b49d5bd1-08f2-4118-9739-0fe89682b4fd None None] MFA Rules not processed for user `933764526662412b85aeb96abcf12c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:32.862873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b49d5bd1-08f2-4118-9739-0fe89682b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:32.874981 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:33.001713 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1321/2664] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:33.007608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75212a-157c-4686-b0fa-5c1cb45cbfd5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:33.084089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75212a-157c-4686-b0fa-5c1cb45cbfd5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:33.089986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8eb94-00cc-483c-8d99-52ef0f64c62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:33.090775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8eb94-00cc-483c-8d99-52ef0f64c62b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:33.091201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8eb94-00cc-483c-8d99-52ef0f64c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:33.091736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8eb94-00cc-483c-8d99-52ef0f64c62b admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:33.092490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8eb94-00cc-483c-8d99-52ef0f64c62b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:33.095029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8eb94-00cc-483c-8d99-52ef0f64c62b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:33.130554 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1344/2665] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:33 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:33.132566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d5bd1-08f2-4118-9739-0fe89682b4fd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:33.145148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d5bd1-08f2-4118-9739-0fe89682b4fd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:33.244671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138bf2f-0e6f-4798-ac45-ac08703da5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:33.245410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138bf2f-0e6f-4798-ac45-ac08703da5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:33.245843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138bf2f-0e6f-4798-ac45-ac08703da5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:33.245959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138bf2f-0e6f-4798-ac45-ac08703da5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:33.246536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138bf2f-0e6f-4798-ac45-ac08703da5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:33.248577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138bf2f-0e6f-4798-ac45-ac08703da5c5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:33.277851 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1322/2666] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:33 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:33.279686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8eb94-00cc-483c-8d99-52ef0f64c62b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:33.291161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8eb94-00cc-483c-8d99-52ef0f64c62b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:33.296450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b55c9-b41f-4ca5-b753-17c4127b9ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:33.297074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b55c9-b41f-4ca5-b753-17c4127b9ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:33.297705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b55c9-b41f-4ca5-b753-17c4127b9ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:33.297705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b55c9-b41f-4ca5-b753-17c4127b9ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:33.298242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b55c9-b41f-4ca5-b753-17c4127b9ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:33.300668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b55c9-b41f-4ca5-b753-17c4127b9ba0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:33.302279 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:33.319914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138bf2f-0e6f-4798-ac45-ac08703da5c5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:33.326222 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1345/2667] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:33.334311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138bf2f-0e6f-4798-ac45-ac08703da5c5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:33.341852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d58ded-0791-4e43-8298-52aacc27a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:33.343325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58ded-0791-4e43-8298-52aacc27a298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:33.343893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58ded-0791-4e43-8298-52aacc27a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:33.344615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58ded-0791-4e43-8298-52aacc27a298 admin admin] PATH_INFO: `/v3/projects/a09cfc659bfe4c1892639819bd8c0eac/users/faaa714fbbb444b6a00239dd6bfd8721/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:33.375334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d58ded-0791-4e43-8298-52aacc27a298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09cfc659bfe4c1892639819bd8c0eac, user_id=faaa714fbbb444b6a00239dd6bfd8721, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:33.379382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d58ded-0791-4e43-8298-52aacc27a298 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:33.396689 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1323/2668] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:33 2022] PUT /identity/v3/projects/a09cfc659bfe4c1892639819bd8c0eac/users/faaa714fbbb444b6a00239dd6bfd8721/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:33.400472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b55c9-b41f-4ca5-b753-17c4127b9ba0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:33.411909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b55c9-b41f-4ca5-b753-17c4127b9ba0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:33.488937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5c7ae-842c-483e-8d16-ca6eb2a979be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:33.489864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c7ae-842c-483e-8d16-ca6eb2a979be admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:33.491266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c7ae-842c-483e-8d16-ca6eb2a979be admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:33.491695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c7ae-842c-483e-8d16-ca6eb2a979be admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:33.493061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5c7ae-842c-483e-8d16-ca6eb2a979be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:33.494628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5c7ae-842c-483e-8d16-ca6eb2a979be admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:33.513522 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1346/2669] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:33.517114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d58ded-0791-4e43-8298-52aacc27a298 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:33.557296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d58ded-0791-4e43-8298-52aacc27a298 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:33.571383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97eb7-f31e-4c33-895e-dc1a53e97162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:33.573236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97eb7-f31e-4c33-895e-dc1a53e97162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:33.576295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97eb7-f31e-4c33-895e-dc1a53e97162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:33.576607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97eb7-f31e-4c33-895e-dc1a53e97162 admin admin] PATH_INFO: `/v3/projects/a09cfc659bfe4c1892639819bd8c0eac/users/faaa714fbbb444b6a00239dd6bfd8721/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:33.582031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf97eb7-f31e-4c33-895e-dc1a53e97162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09cfc659bfe4c1892639819bd8c0eac, user_id=faaa714fbbb444b6a00239dd6bfd8721, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:33.593723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf97eb7-f31e-4c33-895e-dc1a53e97162 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:33.623510 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1324/2670] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:33 2022] PUT /identity/v3/projects/a09cfc659bfe4c1892639819bd8c0eac/users/faaa714fbbb444b6a00239dd6bfd8721/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:33.626504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c0f3-b122-4ef8-a6ec-0d0d8ee9ca9c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:33.627468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c0f3-b122-4ef8-a6ec-0d0d8ee9ca9c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:33.627822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c0f3-b122-4ef8-a6ec-0d0d8ee9ca9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:33.659241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6ea8c0f3-b122-4ef8-a6ec-0d0d8ee9ca9c None None] MFA Rules not processed for user `faaa714fbbb444b6a00239dd6bfd8721`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:33.660498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6ea8c0f3-b122-4ef8-a6ec-0d0d8ee9ca9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:33.750576 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1347/2671] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:04:33.887025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97eb7-f31e-4c33-895e-dc1a53e97162 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:33.888828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-faf97eb7-f31e-4c33-895e-dc1a53e97162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:34.001161 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:34.019425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97eb7-f31e-4c33-895e-dc1a53e97162 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:34.024995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0a6d1-91a5-4469-8ff6-2bca8f7b40d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:34.025755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a6d1-91a5-4469-8ff6-2bca8f7b40d5 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:34.026108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a6d1-91a5-4469-8ff6-2bca8f7b40d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:34.026447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a6d1-91a5-4469-8ff6-2bca8f7b40d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:34.035826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0a6d1-91a5-4469-8ff6-2bca8f7b40d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:34.037534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0a6d1-91a5-4469-8ff6-2bca8f7b40d5 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:34.047193 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1325/2672] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:34.486811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8c0f3-b122-4ef8-a6ec-0d0d8ee9ca9c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:34.549535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8c0f3-b122-4ef8-a6ec-0d0d8ee9ca9c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:34.553993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:34.554655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:34.554958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:34.555215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] PATH_INFO: `/v3/users/933764526662412b85aeb96abcf12c45` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:34.556361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=933764526662412b85aeb96abcf12c45)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:34.558568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:34.581400 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:34.610383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933764526662412b85aeb96abcf12c45'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:34.623729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933764526662412b85aeb96abcf12c45'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:34.624474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933764526662412b85aeb96abcf12c45'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:34.633140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933764526662412b85aeb96abcf12c45'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:34.633759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933764526662412b85aeb96abcf12c45'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:34.646945 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1348/2673] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:34 2022] DELETE /identity/v3/users/933764526662412b85aeb96abcf12c45 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:34.651686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90735df1-6b70-442a-9c9a-4465776445ac None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:34.652252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90735df1-6b70-442a-9c9a-4465776445ac None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:34.652252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90735df1-6b70-442a-9c9a-4465776445ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:34.674649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-90735df1-6b70-442a-9c9a-4465776445ac None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:34.675454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-90735df1-6b70-442a-9c9a-4465776445ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:34.755501 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1326/2674] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:34.765028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:34.766894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:34.842231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f590e6-025f-4390-857b-71ba39017b32 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:34.847636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c39cc-57a7-4508-9ee7-7930b7fd85fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:34.848309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c39cc-57a7-4508-9ee7-7930b7fd85fd service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:34.848591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c39cc-57a7-4508-9ee7-7930b7fd85fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:34.848870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c39cc-57a7-4508-9ee7-7930b7fd85fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:34.863758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c39cc-57a7-4508-9ee7-7930b7fd85fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:34.865742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c39cc-57a7-4508-9ee7-7930b7fd85fd service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:34.886661 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1349/2675] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:04:35.503490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90735df1-6b70-442a-9c9a-4465776445ac None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:35.506284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-90735df1-6b70-442a-9c9a-4465776445ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:35.522100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90735df1-6b70-442a-9c9a-4465776445ac None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:35.541870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:35.542523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:35.542862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:35.543245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] PATH_INFO: `/v3/projects/35c16b79603b4d0ebfcedf43ca0d28d4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:35.544497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c16b79603b4d0ebfcedf43ca0d28d4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:35.546450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:35.600035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c16b79603b4d0ebfcedf43ca0d28d4', 'request_id': 'req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:35.605619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c16b79603b4d0ebfcedf43ca0d28d4', 'request_id': 'req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:35.612011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c16b79603b4d0ebfcedf43ca0d28d4', 'request_id': 'req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:35.624560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] The token cache is being invalidate because project 35c16b79603b4d0ebfcedf43ca0d28d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:35.624799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:35.625393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:35.627444 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1327/2676] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:35 2022] DELETE /identity/v3/projects/35c16b79603b4d0ebfcedf43ca0d28d4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:35.632757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c39cc-57a7-4508-9ee7-7930b7fd85fd service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:35.643502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c39cc-57a7-4508-9ee7-7930b7fd85fd service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:35.715210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d31126-bfaa-45a7-873b-daf1258813f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:35.715865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d31126-bfaa-45a7-873b-daf1258813f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:35.716143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d31126-bfaa-45a7-873b-daf1258813f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:35.716417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d31126-bfaa-45a7-873b-daf1258813f2 admin admin] PATH_INFO: `/v3/users/faaa714fbbb444b6a00239dd6bfd8721` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:35.717545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d31126-bfaa-45a7-873b-daf1258813f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faaa714fbbb444b6a00239dd6bfd8721)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:35.719525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d31126-bfaa-45a7-873b-daf1258813f2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:35.765791 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:35.772384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c6d31126-bfaa-45a7-873b-daf1258813f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faaa714fbbb444b6a00239dd6bfd8721'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:35.787606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c6d31126-bfaa-45a7-873b-daf1258813f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faaa714fbbb444b6a00239dd6bfd8721'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:35.788383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c6d31126-bfaa-45a7-873b-daf1258813f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faaa714fbbb444b6a00239dd6bfd8721'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:35.796206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c6d31126-bfaa-45a7-873b-daf1258813f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faaa714fbbb444b6a00239dd6bfd8721'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:35.797110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c6d31126-bfaa-45a7-873b-daf1258813f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faaa714fbbb444b6a00239dd6bfd8721'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:35.810836 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1350/2677] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:35 2022] DELETE /identity/v3/users/faaa714fbbb444b6a00239dd6bfd8721 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:36.234183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:36.235685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:36.249247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127913-5b0b-4bab-8e6b-e06df7c58a3d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:36.320123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:36.320769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:36.321047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:36.321325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] PATH_INFO: `/v3/projects/a09cfc659bfe4c1892639819bd8c0eac` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:36.323016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09cfc659bfe4c1892639819bd8c0eac)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:36.325049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:36.337676 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:36.379149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09cfc659bfe4c1892639819bd8c0eac', 'request_id': 'req-cde3e9d0-c883-4801-839b-2c519424b256'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:36.386396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09cfc659bfe4c1892639819bd8c0eac', 'request_id': 'req-cde3e9d0-c883-4801-839b-2c519424b256'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:36.394197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09cfc659bfe4c1892639819bd8c0eac', 'request_id': 'req-cde3e9d0-c883-4801-839b-2c519424b256'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:36.407659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] The token cache is being invalidate because project a09cfc659bfe4c1892639819bd8c0eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:36.408946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:36.409180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cde3e9d0-c883-4801-839b-2c519424b256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:36.415339 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1328/2678] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:36 2022] DELETE /identity/v3/projects/a09cfc659bfe4c1892639819bd8c0eac => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:36.416340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e72373-a774-4c7d-b9c3-e9d13c36248c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:36.416631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e72373-a774-4c7d-b9c3-e9d13c36248c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:36.416934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e72373-a774-4c7d-b9c3-e9d13c36248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:36.441507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-56e72373-a774-4c7d-b9c3-e9d13c36248c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:36.443150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-56e72373-a774-4c7d-b9c3-e9d13c36248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:36.512811 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1351/2679] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:36.522225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c5b34-551b-4861-ae76-7b341e7bb1d9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:36.523042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c5b34-551b-4861-ae76-7b341e7bb1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:36.523487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c5b34-551b-4861-ae76-7b341e7bb1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:36.545048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bf9c5b34-551b-4861-ae76-7b341e7bb1d9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:36.546273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bf9c5b34-551b-4861-ae76-7b341e7bb1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:36.554915 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1329/2680] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:36.559493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e72373-a774-4c7d-b9c3-e9d13c36248c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:36.569782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e72373-a774-4c7d-b9c3-e9d13c36248c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:36.574443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa7c44-4cc5-47f2-877e-f72a63ac8e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:36.575088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa7c44-4cc5-47f2-877e-f72a63ac8e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:36.575376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa7c44-4cc5-47f2-877e-f72a63ac8e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:36.575649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa7c44-4cc5-47f2-877e-f72a63ac8e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:36.576306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa7c44-4cc5-47f2-877e-f72a63ac8e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:04:36.576611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa7c44-4cc5-47f2-877e-f72a63ac8e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:36.578218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa7c44-4cc5-47f2-877e-f72a63ac8e16 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:36.591175 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1352/2681] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:36.596309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c5b34-551b-4861-ae76-7b341e7bb1d9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:36.607017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c5b34-551b-4861-ae76-7b341e7bb1d9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:36.613032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa4ea2-5a92-4d5f-9397-686f71c6224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:36.613650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa4ea2-5a92-4d5f-9397-686f71c6224d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:36.613930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa4ea2-5a92-4d5f-9397-686f71c6224d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:36.614202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa4ea2-5a92-4d5f-9397-686f71c6224d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:36.615002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa4ea2-5a92-4d5f-9397-686f71c6224d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:36.616918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa4ea2-5a92-4d5f-9397-686f71c6224d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:36.646400 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1330/2682] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:36 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:36.651100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa7c44-4cc5-47f2-877e-f72a63ac8e16 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:36.663316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa7c44-4cc5-47f2-877e-f72a63ac8e16 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:36.726063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee78772-124a-4d42-a46d-6ddc4222053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:36.726586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78772-124a-4d42-a46d-6ddc4222053f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:36.726945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78772-124a-4d42-a46d-6ddc4222053f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:36.727166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78772-124a-4d42-a46d-6ddc4222053f admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:36.727813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee78772-124a-4d42-a46d-6ddc4222053f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:36.729765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee78772-124a-4d42-a46d-6ddc4222053f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:36.757019 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1353/2683] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:36 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:36.763793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa4ea2-5a92-4d5f-9397-686f71c6224d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:36.793675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa4ea2-5a92-4d5f-9397-686f71c6224d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:36.800137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d52b39-a89f-4f69-ab25-de9ad26f5f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:36.800891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52b39-a89f-4f69-ab25-de9ad26f5f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:36.801276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52b39-a89f-4f69-ab25-de9ad26f5f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:36.802385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52b39-a89f-4f69-ab25-de9ad26f5f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:36.803577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d52b39-a89f-4f69-ab25-de9ad26f5f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:36.805585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d52b39-a89f-4f69-ab25-de9ad26f5f80 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:36.828396 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1331/2684] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:36.833901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee78772-124a-4d42-a46d-6ddc4222053f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:36.844058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee78772-124a-4d42-a46d-6ddc4222053f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:36.853708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0e40d-fb3f-4055-bc46-fbbf88402439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:36.854445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e40d-fb3f-4055-bc46-fbbf88402439 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:36.854829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e40d-fb3f-4055-bc46-fbbf88402439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:36.855181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e40d-fb3f-4055-bc46-fbbf88402439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:36.855931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0e40d-fb3f-4055-bc46-fbbf88402439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:36.857585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0e40d-fb3f-4055-bc46-fbbf88402439 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:36.873973 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1354/2685] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:36.879419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d52b39-a89f-4f69-ab25-de9ad26f5f80 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:36.891045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d52b39-a89f-4f69-ab25-de9ad26f5f80 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:36.896804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d10f0-0209-4ecc-a7bd-5817a808d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:36.897475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d10f0-0209-4ecc-a7bd-5817a808d1c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:36.897785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d10f0-0209-4ecc-a7bd-5817a808d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:36.898254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d10f0-0209-4ecc-a7bd-5817a808d1c1 admin admin] PATH_INFO: `/v3/projects/984818c380b3442fad6e35f7c9918fb0/users/fbe774479db84bc091c2c8ce9167d57d/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:36.913704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d10f0-0209-4ecc-a7bd-5817a808d1c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984818c380b3442fad6e35f7c9918fb0, user_id=fbe774479db84bc091c2c8ce9167d57d, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:36.916413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d10f0-0209-4ecc-a7bd-5817a808d1c1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:36.930521 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1332/2686] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:36 2022] PUT /identity/v3/projects/984818c380b3442fad6e35f7c9918fb0/users/fbe774479db84bc091c2c8ce9167d57d/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:04:36.943525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704deb1-e6ed-46e9-910e-8e96d3620966 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:36.943806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704deb1-e6ed-46e9-910e-8e96d3620966 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:36.944079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704deb1-e6ed-46e9-910e-8e96d3620966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:36.975452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4704deb1-e6ed-46e9-910e-8e96d3620966 None None] MFA Rules not processed for user `fbe774479db84bc091c2c8ce9167d57d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:36.976712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4704deb1-e6ed-46e9-910e-8e96d3620966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:36.994654 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:37.061169 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1355/2687] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:37.062659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d10f0-0209-4ecc-a7bd-5817a808d1c1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:37.155771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d10f0-0209-4ecc-a7bd-5817a808d1c1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:37.165651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8804b-66e9-4cd4-9d64-2e501e703f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:37.165651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8804b-66e9-4cd4-9d64-2e501e703f94 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.167020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8804b-66e9-4cd4-9d64-2e501e703f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.167338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8804b-66e9-4cd4-9d64-2e501e703f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.168144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8804b-66e9-4cd4-9d64-2e501e703f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:37.170093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8804b-66e9-4cd4-9d64-2e501e703f94 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:37.200838 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1333/2688] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:37 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:37.205273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704deb1-e6ed-46e9-910e-8e96d3620966 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:37.216621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704deb1-e6ed-46e9-910e-8e96d3620966 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:37.273571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986649b-aff2-4965-83d7-5e429829b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:37.274101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986649b-aff2-4965-83d7-5e429829b5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.274383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986649b-aff2-4965-83d7-5e429829b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.274692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986649b-aff2-4965-83d7-5e429829b5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.275329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986649b-aff2-4965-83d7-5e429829b5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:37.277268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986649b-aff2-4965-83d7-5e429829b5e9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:37.300185 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1356/2689] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:37 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:37.304609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8804b-66e9-4cd4-9d64-2e501e703f94 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:37.316131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8804b-66e9-4cd4-9d64-2e501e703f94 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:37.320717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c754d2-a57a-4e4b-a642-7dcbdbf1c9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:37.321318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c754d2-a57a-4e4b-a642-7dcbdbf1c9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.321598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c754d2-a57a-4e4b-a642-7dcbdbf1c9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.321871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c754d2-a57a-4e4b-a642-7dcbdbf1c9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.322507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c754d2-a57a-4e4b-a642-7dcbdbf1c9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:37.324133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c754d2-a57a-4e4b-a642-7dcbdbf1c9b6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:37.334966 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1334/2690] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:37.340523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986649b-aff2-4965-83d7-5e429829b5e9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:37.351100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986649b-aff2-4965-83d7-5e429829b5e9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:37.357487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439eca37-8cf7-44cf-8c17-e75678418a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:37.358136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eca37-8cf7-44cf-8c17-e75678418a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.358414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eca37-8cf7-44cf-8c17-e75678418a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.358720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eca37-8cf7-44cf-8c17-e75678418a01 admin admin] PATH_INFO: `/v3/projects/7c055652c55140f185626029343a766d/users/1f7b954ccb104aca8351faf992a042a5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.373794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439eca37-8cf7-44cf-8c17-e75678418a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c055652c55140f185626029343a766d, user_id=1f7b954ccb104aca8351faf992a042a5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:37.376488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439eca37-8cf7-44cf-8c17-e75678418a01 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:37.392082 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1357/2691] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:37 2022] PUT /identity/v3/projects/7c055652c55140f185626029343a766d/users/1f7b954ccb104aca8351faf992a042a5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:37.396544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c754d2-a57a-4e4b-a642-7dcbdbf1c9b6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:37.406890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c754d2-a57a-4e4b-a642-7dcbdbf1c9b6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:37.414910 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:37.465644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41279d5b-853b-43f4-adf8-399d041f8f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:37.466306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41279d5b-853b-43f4-adf8-399d041f8f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.466937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41279d5b-853b-43f4-adf8-399d041f8f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.467222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41279d5b-853b-43f4-adf8-399d041f8f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.467874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41279d5b-853b-43f4-adf8-399d041f8f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:37.469502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41279d5b-853b-43f4-adf8-399d041f8f67 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:37.482853 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1335/2692] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:37.484079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439eca37-8cf7-44cf-8c17-e75678418a01 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:37.495536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439eca37-8cf7-44cf-8c17-e75678418a01 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:37.500296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecec12-1b93-43c4-b935-57af473e76ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:37.500954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecec12-1b93-43c4-b935-57af473e76ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.501291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecec12-1b93-43c4-b935-57af473e76ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.501519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecec12-1b93-43c4-b935-57af473e76ba admin admin] PATH_INFO: `/v3/projects/7c055652c55140f185626029343a766d/users/1f7b954ccb104aca8351faf992a042a5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.504438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecec12-1b93-43c4-b935-57af473e76ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c055652c55140f185626029343a766d, user_id=1f7b954ccb104aca8351faf992a042a5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:37.507090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecec12-1b93-43c4-b935-57af473e76ba admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:37.517839 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1358/2693] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:37 2022] PUT /identity/v3/projects/7c055652c55140f185626029343a766d/users/1f7b954ccb104aca8351faf992a042a5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:37.527914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07441e-c39f-4a44-b32f-c26bf6207105 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.528142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07441e-c39f-4a44-b32f-c26bf6207105 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.528421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07441e-c39f-4a44-b32f-c26bf6207105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.556540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3e07441e-c39f-4a44-b32f-c26bf6207105 None None] MFA Rules not processed for user `1f7b954ccb104aca8351faf992a042a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:37.557993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3e07441e-c39f-4a44-b32f-c26bf6207105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:37.625472 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1336/2694] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:37.632295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecec12-1b93-43c4-b935-57af473e76ba admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:37.642589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecec12-1b93-43c4-b935-57af473e76ba admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:37.647109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286b9dc-b8c5-434e-9d8d-b18b2f65a72e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:37.647694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b9dc-b8c5-434e-9d8d-b18b2f65a72e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.647972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b9dc-b8c5-434e-9d8d-b18b2f65a72e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.648247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b9dc-b8c5-434e-9d8d-b18b2f65a72e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.648886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286b9dc-b8c5-434e-9d8d-b18b2f65a72e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:04:37.649186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286b9dc-b8c5-434e-9d8d-b18b2f65a72e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:37.650804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286b9dc-b8c5-434e-9d8d-b18b2f65a72e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:37.663088 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1359/2695] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:37.667281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07441e-c39f-4a44-b32f-c26bf6207105 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:37.676995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07441e-c39f-4a44-b32f-c26bf6207105 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:37.681943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52194b-2cd3-41ce-be93-b4209509ba57 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:37.682537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52194b-2cd3-41ce-be93-b4209509ba57 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.682853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52194b-2cd3-41ce-be93-b4209509ba57 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.683154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52194b-2cd3-41ce-be93-b4209509ba57 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.683799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52194b-2cd3-41ce-be93-b4209509ba57 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:37.685711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52194b-2cd3-41ce-be93-b4209509ba57 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:37.713324 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1337/2696] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:37 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:37.717565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286b9dc-b8c5-434e-9d8d-b18b2f65a72e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:37.727954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286b9dc-b8c5-434e-9d8d-b18b2f65a72e tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:37.774393 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:37.784961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64012f19-1519-4777-9796-f7f6a83d1810 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:37.785494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64012f19-1519-4777-9796-f7f6a83d1810 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.785781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64012f19-1519-4777-9796-f7f6a83d1810 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.786134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64012f19-1519-4777-9796-f7f6a83d1810 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.786825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64012f19-1519-4777-9796-f7f6a83d1810 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:04:37.787134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64012f19-1519-4777-9796-f7f6a83d1810 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:37.788757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64012f19-1519-4777-9796-f7f6a83d1810 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:37.804302 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1360/2697] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:37.811995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52194b-2cd3-41ce-be93-b4209509ba57 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:37.813948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2f52194b-2cd3-41ce-be93-b4209509ba57 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:37.900363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52194b-2cd3-41ce-be93-b4209509ba57 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:37.906785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd24ebc-dbfb-499c-983c-92e547290bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:37.907405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd24ebc-dbfb-499c-983c-92e547290bd3 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.907684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd24ebc-dbfb-499c-983c-92e547290bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.908603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd24ebc-dbfb-499c-983c-92e547290bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.916198 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:37.919076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd24ebc-dbfb-499c-983c-92e547290bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:37.921964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd24ebc-dbfb-499c-983c-92e547290bd3 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:37.932701 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1338/2698] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:37.949783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e21da-ca8d-4d55-b2ba-d47a09a09ef9 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.950069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e21da-ca8d-4d55-b2ba-d47a09a09ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.950477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e21da-ca8d-4d55-b2ba-d47a09a09ef9 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.951741 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1361/2699] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:04:37.956960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd24ebc-dbfb-499c-983c-92e547290bd3 service nova] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:04:37.968793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd24ebc-dbfb-499c-983c-92e547290bd3 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:37.979772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd24ebc-dbfb-499c-983c-92e547290bd3 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:37.987856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600f335-c3e5-40f8-b125-b200a7c1a9e2 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:37.988489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600f335-c3e5-40f8-b125-b200a7c1a9e2 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:37.988774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600f335-c3e5-40f8-b125-b200a7c1a9e2 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:37.989047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600f335-c3e5-40f8-b125-b200a7c1a9e2 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/projects/7705fae231a044baa1e171de04cca409` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:37.990168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600f335-c3e5-40f8-b125-b200a7c1a9e2 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:get_project(project_id=7705fae231a044baa1e171de04cca409)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:37.992448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600f335-c3e5-40f8-b125-b200a7c1a9e2 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:37.994105 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1339/2700] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:04:37 2022] GET /identity/v3/projects/7705fae231a044baa1e171de04cca409 => generated 371 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:38.134710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0579d89-c811-4867-a31e-e2d060e24d11 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:38.135764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0579d89-c811-4867-a31e-e2d060e24d11 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:38.136050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0579d89-c811-4867-a31e-e2d060e24d11 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:38.137664 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1362/2701] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:04:38.143611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600f335-c3e5-40f8-b125-b200a7c1a9e2 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:04:38.156625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600f335-c3e5-40f8-b125-b200a7c1a9e2 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:38.167293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600f335-c3e5-40f8-b125-b200a7c1a9e2 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:38.171998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8c53d-a724-4359-8107-210312b80ce1 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:38.172626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8c53d-a724-4359-8107-210312b80ce1 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:38.172911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8c53d-a724-4359-8107-210312b80ce1 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:38.173215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8c53d-a724-4359-8107-210312b80ce1 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/projects/7705fae231a044baa1e171de04cca409` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:38.174626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8c53d-a724-4359-8107-210312b80ce1 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:get_project(project_id=7705fae231a044baa1e171de04cca409)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:38.176691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8c53d-a724-4359-8107-210312b80ce1 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:38.178354 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1340/2702] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:04:38 2022] GET /identity/v3/projects/7705fae231a044baa1e171de04cca409 => generated 371 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:38.224986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0579d89-c811-4867-a31e-e2d060e24d11 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:38.237513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0579d89-c811-4867-a31e-e2d060e24d11 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:38.241878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a53e1-b1a1-462d-977c-b088140357da tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:38.242466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a53e1-b1a1-462d-977c-b088140357da tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:38.242784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a53e1-b1a1-462d-977c-b088140357da tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:38.243060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a53e1-b1a1-462d-977c-b088140357da tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:38.243704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a53e1-b1a1-462d-977c-b088140357da tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:04:38.244009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a53e1-b1a1-462d-977c-b088140357da tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:38.245584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a53e1-b1a1-462d-977c-b088140357da tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:38.262964 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1363/2703] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:38.264333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8c53d-a724-4359-8107-210312b80ce1 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:38.277506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8c53d-a724-4359-8107-210312b80ce1 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:38.282226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3454e0-6486-4c31-887b-12d19181584c tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:38.283620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3454e0-6486-4c31-887b-12d19181584c tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:38.284356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3454e0-6486-4c31-887b-12d19181584c tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:38.284634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3454e0-6486-4c31-887b-12d19181584c tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:38.285297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3454e0-6486-4c31-887b-12d19181584c tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:38.287276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3454e0-6486-4c31-887b-12d19181584c tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:38.312045 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1341/2704] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:38 2022] POST /identity/v3/users => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:38.316901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a53e1-b1a1-462d-977c-b088140357da tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:38.327171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a53e1-b1a1-462d-977c-b088140357da tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:38.333038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316d9a6-4b07-4627-9c6b-2813544ada52 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:38.333644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316d9a6-4b07-4627-9c6b-2813544ada52 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:38.333925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316d9a6-4b07-4627-9c6b-2813544ada52 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:38.334203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316d9a6-4b07-4627-9c6b-2813544ada52 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:38.334915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316d9a6-4b07-4627-9c6b-2813544ada52 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:04:38.335224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316d9a6-4b07-4627-9c6b-2813544ada52 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:38.336837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316d9a6-4b07-4627-9c6b-2813544ada52 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:38.348899 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1364/2705] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:38.367135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8259-822a-4466-9ddc-a0ca19eb7c2d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:38.367427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8259-822a-4466-9ddc-a0ca19eb7c2d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:38.367723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8259-822a-4466-9ddc-a0ca19eb7c2d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:38.369065 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1342/2706] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:04:38.373604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316d9a6-4b07-4627-9c6b-2813544ada52 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:04:38.387067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316d9a6-4b07-4627-9c6b-2813544ada52 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:38.396582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316d9a6-4b07-4627-9c6b-2813544ada52 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:38.401547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b0956-9ab3-4780-8ad4-389c52834149 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:38.402177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b0956-9ab3-4780-8ad4-389c52834149 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:38.402485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b0956-9ab3-4780-8ad4-389c52834149 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:38.402791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b0956-9ab3-4780-8ad4-389c52834149 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/projects/7705fae231a044baa1e171de04cca409` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:38.403941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b0956-9ab3-4780-8ad4-389c52834149 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:get_project(project_id=7705fae231a044baa1e171de04cca409)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:38.406020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b0956-9ab3-4780-8ad4-389c52834149 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:38.407726 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1365/2707] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:04:38 2022] GET /identity/v3/projects/7705fae231a044baa1e171de04cca409 => generated 371 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:38.552368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120753b-6b52-49dd-9a51-174f516a29d5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:38.552656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120753b-6b52-49dd-9a51-174f516a29d5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:38.552933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120753b-6b52-49dd-9a51-174f516a29d5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:38.554259 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1343/2708] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:04:38.559928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b0956-9ab3-4780-8ad4-389c52834149 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:04:38.581549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b0956-9ab3-4780-8ad4-389c52834149 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:38.591414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b0956-9ab3-4780-8ad4-389c52834149 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:38.596171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5e447-4bd9-4b4a-9722-7bb769effe35 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:38.596914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5e447-4bd9-4b4a-9722-7bb769effe35 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:38.597232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5e447-4bd9-4b4a-9722-7bb769effe35 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:38.597574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5e447-4bd9-4b4a-9722-7bb769effe35 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/projects/7705fae231a044baa1e171de04cca409` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:38.599104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5e447-4bd9-4b4a-9722-7bb769effe35 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:get_project(project_id=7705fae231a044baa1e171de04cca409)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:38.601219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5e447-4bd9-4b4a-9722-7bb769effe35 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:38.603277 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1366/2709] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:04:38 2022] GET /identity/v3/projects/7705fae231a044baa1e171de04cca409 => generated 371 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:38.636821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120753b-6b52-49dd-9a51-174f516a29d5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:38.650886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120753b-6b52-49dd-9a51-174f516a29d5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:38.657090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:38.657944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:38.658387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:38.658796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/users/363fc8ffd3164fd0b9a4df84a1cec92b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:38.674470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:delete_user(user_id=363fc8ffd3164fd0b9a4df84a1cec92b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:38.676469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:38.724611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363fc8ffd3164fd0b9a4df84a1cec92b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:38.744455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363fc8ffd3164fd0b9a4df84a1cec92b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:38.745230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363fc8ffd3164fd0b9a4df84a1cec92b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:38.755224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363fc8ffd3164fd0b9a4df84a1cec92b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:38.774275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363fc8ffd3164fd0b9a4df84a1cec92b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:38.790709 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1344/2710] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:38 2022] DELETE /identity/v3/users/363fc8ffd3164fd0b9a4df84a1cec92b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:38.790912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5e447-4bd9-4b4a-9722-7bb769effe35 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:38.792115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2bc5e447-4bd9-4b4a-9722-7bb769effe35 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:38.815906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5e447-4bd9-4b4a-9722-7bb769effe35 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:38.898402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b954ccb104aca8351faf992a042a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c055652c55140f185626029343a766d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:38.899080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:38.899363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:38.899642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] PATH_INFO: `/v3/projects/7705fae231a044baa1e171de04cca409` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:38.900777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7705fae231a044baa1e171de04cca409)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:38.902729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:38.955916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7705fae231a044baa1e171de04cca409', 'request_id': 'req-a68dbfea-5243-41b8-ac88-8e0e94d418e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:38.966466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7705fae231a044baa1e171de04cca409', 'request_id': 'req-a68dbfea-5243-41b8-ac88-8e0e94d418e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:38.974696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7705fae231a044baa1e171de04cca409', 'request_id': 'req-a68dbfea-5243-41b8-ac88-8e0e94d418e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:38.992898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] The token cache is being invalidate because project 7705fae231a044baa1e171de04cca409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:38.993239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:38.993902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a68dbfea-5243-41b8-ac88-8e0e94d418e0 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:38.999798 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1367/2711] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:38 2022] DELETE /identity/v3/projects/7705fae231a044baa1e171de04cca409 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:39.001429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:39.003875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:39.091370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4acfd-f79a-4261-b5e6-7bf9fda9dde4 tempest-QuotasAdminTestV236-765276088 tempest-QuotasAdminTestV236-765276088-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:39.130433 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:39.171416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deef290-86ae-4d18-a657-dfacb5133b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:39.172063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef290-86ae-4d18-a657-dfacb5133b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:39.172509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef290-86ae-4d18-a657-dfacb5133b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:39.172689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef290-86ae-4d18-a657-dfacb5133b38 admin admin] PATH_INFO: `/v3/users/fbe774479db84bc091c2c8ce9167d57d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:39.174088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deef290-86ae-4d18-a657-dfacb5133b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe774479db84bc091c2c8ce9167d57d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:39.176288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deef290-86ae-4d18-a657-dfacb5133b38 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:39.315726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9deef290-86ae-4d18-a657-dfacb5133b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe774479db84bc091c2c8ce9167d57d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:39.366038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9deef290-86ae-4d18-a657-dfacb5133b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe774479db84bc091c2c8ce9167d57d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:39.367126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9deef290-86ae-4d18-a657-dfacb5133b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe774479db84bc091c2c8ce9167d57d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:39.385927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db27d-9a8e-4322-8c9e-4a96eb509de1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:39.386173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db27d-9a8e-4322-8c9e-4a96eb509de1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:39.386520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db27d-9a8e-4322-8c9e-4a96eb509de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:39.389249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9deef290-86ae-4d18-a657-dfacb5133b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe774479db84bc091c2c8ce9167d57d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:39.398423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9deef290-86ae-4d18-a657-dfacb5133b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe774479db84bc091c2c8ce9167d57d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:39.411792 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1345/2712] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:39 2022] DELETE /identity/v3/users/fbe774479db84bc091c2c8ce9167d57d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:39.420027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a9526-1889-4f55-be97-a5eccda127ab None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:39.423219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a9526-1889-4f55-be97-a5eccda127ab None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:39.424589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a9526-1889-4f55-be97-a5eccda127ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:39.451925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-874db27d-9a8e-4322-8c9e-4a96eb509de1 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:39.461122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-874db27d-9a8e-4322-8c9e-4a96eb509de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:39.505029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b01a9526-1889-4f55-be97-a5eccda127ab None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:39.509243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b01a9526-1889-4f55-be97-a5eccda127ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:39.546717 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:39.597531 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1368/2713] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:04:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:04:39.672769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db27d-9a8e-4322-8c9e-4a96eb509de1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:39.675437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-874db27d-9a8e-4322-8c9e-4a96eb509de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:39.693191 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1346/2714] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:39.702754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a9526-1889-4f55-be97-a5eccda127ab None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:39.704605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b01a9526-1889-4f55-be97-a5eccda127ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:39.800825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db27d-9a8e-4322-8c9e-4a96eb509de1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:39.803732 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:39.810233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a9526-1889-4f55-be97-a5eccda127ab None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:39.811308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28e2be-9ef6-4951-8691-ec3093ddf789 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:39.812192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28e2be-9ef6-4951-8691-ec3093ddf789 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:39.813328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28e2be-9ef6-4951-8691-ec3093ddf789 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:39.813328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28e2be-9ef6-4951-8691-ec3093ddf789 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:39.820091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1c296-bd67-4ac3-8ca5-800f29943816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:39.825581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28e2be-9ef6-4951-8691-ec3093ddf789 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:39.827568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28e2be-9ef6-4951-8691-ec3093ddf789 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:39.827716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1c296-bd67-4ac3-8ca5-800f29943816 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:39.828033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1c296-bd67-4ac3-8ca5-800f29943816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:39.829344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1c296-bd67-4ac3-8ca5-800f29943816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:39.844077 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1369/2715] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:04:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:04:39.859316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1c296-bd67-4ac3-8ca5-800f29943816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:39.862777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1c296-bd67-4ac3-8ca5-800f29943816 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:39.875978 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1347/2716] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:40.672652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28e2be-9ef6-4951-8691-ec3093ddf789 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:40.674996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3d28e2be-9ef6-4951-8691-ec3093ddf789 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:40.708373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28e2be-9ef6-4951-8691-ec3093ddf789 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:40.722959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:40.723644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:40.723920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:40.724212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] PATH_INFO: `/v3/projects/984818c380b3442fad6e35f7c9918fb0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:40.728552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=984818c380b3442fad6e35f7c9918fb0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:40.730508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:40.882685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '984818c380b3442fad6e35f7c9918fb0', 'request_id': 'req-16aa5cc6-b17c-4193-82ff-2945a3a66142'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:40.896371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '984818c380b3442fad6e35f7c9918fb0', 'request_id': 'req-16aa5cc6-b17c-4193-82ff-2945a3a66142'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:40.962131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '984818c380b3442fad6e35f7c9918fb0', 'request_id': 'req-16aa5cc6-b17c-4193-82ff-2945a3a66142'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:40.983375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2801b-44e0-4c12-b69e-4ee99290a46e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:40.983817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2801b-44e0-4c12-b69e-4ee99290a46e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:40.983924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2801b-44e0-4c12-b69e-4ee99290a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:41.013164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d9d2801b-44e0-4c12-b69e-4ee99290a46e None None] MFA Rules not processed for user `c076d9dc75a7400f87b480d2b18dcc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:41.015113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d9d2801b-44e0-4c12-b69e-4ee99290a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:41.033485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] The token cache is being invalidate because project 984818c380b3442fad6e35f7c9918fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:41.037467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:41.039102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:41.043148 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1370/2717] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:40 2022] DELETE /identity/v3/projects/984818c380b3442fad6e35f7c9918fb0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:41.049716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:41.056218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:41.092614 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1348/2718] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:41.209383 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:41.249266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5cc6-b17c-4193-82ff-2945a3a66142 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:41.265417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953dc75-0ea4-43b9-8433-cc7581f49d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:41.266075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953dc75-0ea4-43b9-8433-cc7581f49d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:41.266360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953dc75-0ea4-43b9-8433-cc7581f49d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:41.266661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953dc75-0ea4-43b9-8433-cc7581f49d7e admin admin] PATH_INFO: `/v3/users/1f7b954ccb104aca8351faf992a042a5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:41.268380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953dc75-0ea4-43b9-8433-cc7581f49d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7b954ccb104aca8351faf992a042a5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:41.270356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953dc75-0ea4-43b9-8433-cc7581f49d7e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:41.357935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8953dc75-0ea4-43b9-8433-cc7581f49d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7b954ccb104aca8351faf992a042a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:41.380773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8953dc75-0ea4-43b9-8433-cc7581f49d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7b954ccb104aca8351faf992a042a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:41.381824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8953dc75-0ea4-43b9-8433-cc7581f49d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7b954ccb104aca8351faf992a042a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:41.401806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8953dc75-0ea4-43b9-8433-cc7581f49d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7b954ccb104aca8351faf992a042a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:41.402902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8953dc75-0ea4-43b9-8433-cc7581f49d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7b954ccb104aca8351faf992a042a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:41.429445 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1371/2719] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:41 2022] DELETE /identity/v3/users/1f7b954ccb104aca8351faf992a042a5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:41.843708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2801b-44e0-4c12-b69e-4ee99290a46e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:41.870438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2801b-44e0-4c12-b69e-4ee99290a46e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:42.036968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:42.037638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:42.037855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:42.038131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] PATH_INFO: `/v3/projects/7c055652c55140f185626029343a766d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:42.040812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c055652c55140f185626029343a766d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:42.043137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:42.159380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c055652c55140f185626029343a766d', 'request_id': 'req-be8f95cb-8191-4835-8a75-7eca733a584b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:42.196650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c055652c55140f185626029343a766d', 'request_id': 'req-be8f95cb-8191-4835-8a75-7eca733a584b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:42.230719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c055652c55140f185626029343a766d', 'request_id': 'req-be8f95cb-8191-4835-8a75-7eca733a584b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:42.269572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] The token cache is being invalidate because project 7c055652c55140f185626029343a766d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:42.269875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:42.272609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be8f95cb-8191-4835-8a75-7eca733a584b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:42.279549 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1349/2720] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:41 2022] DELETE /identity/v3/projects/7c055652c55140f185626029343a766d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:42.285604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5341-f264-4683-9da4-4c582d36dbcf None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:42.286922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5341-f264-4683-9da4-4c582d36dbcf None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:42.287584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5341-f264-4683-9da4-4c582d36dbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:42.364305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5c7a5341-f264-4683-9da4-4c582d36dbcf None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:42.365547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5c7a5341-f264-4683-9da4-4c582d36dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:42.516692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880752a5-19f8-45eb-aea5-2dbe486c52a3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:42.518675 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1372/2721] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:42.522656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880752a5-19f8-45eb-aea5-2dbe486c52a3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:42.523060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880752a5-19f8-45eb-aea5-2dbe486c52a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:42.577964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-880752a5-19f8-45eb-aea5-2dbe486c52a3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:42.579293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-880752a5-19f8-45eb-aea5-2dbe486c52a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:42.594650 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1350/2722] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:42.597898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a5341-f264-4683-9da4-4c582d36dbcf None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:42.609209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a5341-f264-4683-9da4-4c582d36dbcf None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:42.624709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ba437-63be-4ca1-88bf-04b4f80f7ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:42.625339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ba437-63be-4ca1-88bf-04b4f80f7ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:42.625615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ba437-63be-4ca1-88bf-04b4f80f7ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:42.625881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ba437-63be-4ca1-88bf-04b4f80f7ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:42.626628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ba437-63be-4ca1-88bf-04b4f80f7ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:04:42.626951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ba437-63be-4ca1-88bf-04b4f80f7ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:42.628834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ba437-63be-4ca1-88bf-04b4f80f7ef2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:42.650772 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1373/2723] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:42.654715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880752a5-19f8-45eb-aea5-2dbe486c52a3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:42.665428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880752a5-19f8-45eb-aea5-2dbe486c52a3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:42.672686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d602e-c7d9-4301-bd18-39ea5c6d1335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:42.673739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d602e-c7d9-4301-bd18-39ea5c6d1335 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:42.674163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d602e-c7d9-4301-bd18-39ea5c6d1335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:42.674746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d602e-c7d9-4301-bd18-39ea5c6d1335 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:42.675611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d602e-c7d9-4301-bd18-39ea5c6d1335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:42.677828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d602e-c7d9-4301-bd18-39ea5c6d1335 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:42.742654 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:42.754652 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1351/2724] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:42 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:42.759391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ba437-63be-4ca1-88bf-04b4f80f7ef2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:42.777656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ba437-63be-4ca1-88bf-04b4f80f7ef2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:42.909494 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:42.919480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3b78-a161-4b54-b474-89064a7e4dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:42.921550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3b78-a161-4b54-b474-89064a7e4dde admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:42.922168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3b78-a161-4b54-b474-89064a7e4dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:42.922785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3b78-a161-4b54-b474-89064a7e4dde admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:42.924488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f3b78-a161-4b54-b474-89064a7e4dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:42.926551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f3b78-a161-4b54-b474-89064a7e4dde admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:42.951941 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1374/2725] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:42 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:42.955809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d602e-c7d9-4301-bd18-39ea5c6d1335 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:42.974202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d602e-c7d9-4301-bd18-39ea5c6d1335 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:42.988208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5169514-f010-4b9b-98b0-ee62eb7c113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:42.990035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5169514-f010-4b9b-98b0-ee62eb7c113f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:42.990848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5169514-f010-4b9b-98b0-ee62eb7c113f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:42.992021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5169514-f010-4b9b-98b0-ee62eb7c113f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:42.993340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5169514-f010-4b9b-98b0-ee62eb7c113f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:42.998454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5169514-f010-4b9b-98b0-ee62eb7c113f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:43.020426 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1352/2726] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:43.025143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3b78-a161-4b54-b474-89064a7e4dde admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:43.041918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3b78-a161-4b54-b474-89064a7e4dde admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:43.056297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3a553-6506-4b54-a201-7a95c94a88ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:43.057327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3a553-6506-4b54-a201-7a95c94a88ee admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:43.058183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3a553-6506-4b54-a201-7a95c94a88ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:43.058578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3a553-6506-4b54-a201-7a95c94a88ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:43.059862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3a553-6506-4b54-a201-7a95c94a88ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:43.062162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3a553-6506-4b54-a201-7a95c94a88ee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:43.081188 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1375/2727] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:43.087141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5169514-f010-4b9b-98b0-ee62eb7c113f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:43.100533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5169514-f010-4b9b-98b0-ee62eb7c113f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:43.109797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc6e87-4669-4077-9cde-3cd84ecb5b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:43.110533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc6e87-4669-4077-9cde-3cd84ecb5b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:43.111369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc6e87-4669-4077-9cde-3cd84ecb5b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:43.111750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc6e87-4669-4077-9cde-3cd84ecb5b0f admin admin] PATH_INFO: `/v3/projects/b0ce2e8af02c45ad944c5c987f48415a/users/747cf596ed8b41f4b6b81c0833a870d1/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:43.143549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc6e87-4669-4077-9cde-3cd84ecb5b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ce2e8af02c45ad944c5c987f48415a, user_id=747cf596ed8b41f4b6b81c0833a870d1, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:43.150947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc6e87-4669-4077-9cde-3cd84ecb5b0f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:43.194180 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1353/2728] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:43 2022] PUT /identity/v3/projects/b0ce2e8af02c45ad944c5c987f48415a/users/747cf596ed8b41f4b6b81c0833a870d1/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:43.194411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ae96-07e2-4552-ab19-6c9cdf7fb825 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:43.194411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ae96-07e2-4552-ab19-6c9cdf7fb825 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:43.194411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ae96-07e2-4552-ab19-6c9cdf7fb825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:43.228040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ab71ae96-07e2-4552-ab19-6c9cdf7fb825 None None] MFA Rules not processed for user `747cf596ed8b41f4b6b81c0833a870d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:43.229471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ab71ae96-07e2-4552-ab19-6c9cdf7fb825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:43.349517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc6e87-4669-4077-9cde-3cd84ecb5b0f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:43.349651 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1376/2729] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:04:43.423026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc6e87-4669-4077-9cde-3cd84ecb5b0f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:43.453119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe57bcd-39d5-4100-97d0-7a16f792ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:43.453119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe57bcd-39d5-4100-97d0-7a16f792ea91 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:43.453119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe57bcd-39d5-4100-97d0-7a16f792ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:43.453119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe57bcd-39d5-4100-97d0-7a16f792ea91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:43.454080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe57bcd-39d5-4100-97d0-7a16f792ea91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:43.457377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe57bcd-39d5-4100-97d0-7a16f792ea91 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:43.528140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71ae96-07e2-4552-ab19-6c9cdf7fb825 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:43.535851 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1354/2730] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:43 2022] POST /identity/v3/projects => generated 393 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:43.549834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71ae96-07e2-4552-ab19-6c9cdf7fb825 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:43.730834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f09ef0-1e2d-43c9-bc7d-63a74e160627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:43.731466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f09ef0-1e2d-43c9-bc7d-63a74e160627 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:43.731745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f09ef0-1e2d-43c9-bc7d-63a74e160627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:43.732027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f09ef0-1e2d-43c9-bc7d-63a74e160627 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:43.732687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f09ef0-1e2d-43c9-bc7d-63a74e160627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:43.743586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f09ef0-1e2d-43c9-bc7d-63a74e160627 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:43.816210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe57bcd-39d5-4100-97d0-7a16f792ea91 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:43.817992 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1377/2731] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:43 2022] POST /identity/v3/users => generated 303 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:04:43.843990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe57bcd-39d5-4100-97d0-7a16f792ea91 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:43.867377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078c940-9bf2-46bb-a55c-c8a76e3a22e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:43.870000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078c940-9bf2-46bb-a55c-c8a76e3a22e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:43.870461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078c940-9bf2-46bb-a55c-c8a76e3a22e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:43.871212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078c940-9bf2-46bb-a55c-c8a76e3a22e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:43.873029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078c940-9bf2-46bb-a55c-c8a76e3a22e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:43.878636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078c940-9bf2-46bb-a55c-c8a76e3a22e1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:43.911842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f09ef0-1e2d-43c9-bc7d-63a74e160627 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:43.913613 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1355/2732] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:43.927250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f09ef0-1e2d-43c9-bc7d-63a74e160627 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:43.943547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83836703-dc70-4eb0-b54a-f091751e8121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:43.944585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83836703-dc70-4eb0-b54a-f091751e8121 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:43.944873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83836703-dc70-4eb0-b54a-f091751e8121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:43.945160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83836703-dc70-4eb0-b54a-f091751e8121 admin admin] PATH_INFO: `/v3/projects/f9a29b38fac64544ba9e9e78cb3f54c9/users/e97042f2ec084ddabe60b05d9f274366/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:43.995234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83836703-dc70-4eb0-b54a-f091751e8121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a29b38fac64544ba9e9e78cb3f54c9, user_id=e97042f2ec084ddabe60b05d9f274366, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:44.006270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83836703-dc70-4eb0-b54a-f091751e8121 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:44.042661 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1378/2733] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:43 2022] PUT /identity/v3/projects/f9a29b38fac64544ba9e9e78cb3f54c9/users/e97042f2ec084ddabe60b05d9f274366/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:04:44.047114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078c940-9bf2-46bb-a55c-c8a76e3a22e1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:44.062667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078c940-9bf2-46bb-a55c-c8a76e3a22e1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:44.258691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be01cb0-b38c-46b0-b042-45d13bb02f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:44.259418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be01cb0-b38c-46b0-b042-45d13bb02f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:44.259711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be01cb0-b38c-46b0-b042-45d13bb02f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:44.260070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be01cb0-b38c-46b0-b042-45d13bb02f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:44.260738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be01cb0-b38c-46b0-b042-45d13bb02f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:44.262677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be01cb0-b38c-46b0-b042-45d13bb02f65 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:44.281698 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1356/2734] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:44.287039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83836703-dc70-4eb0-b54a-f091751e8121 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:44.298179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83836703-dc70-4eb0-b54a-f091751e8121 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:44.308894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637753-62ca-4562-b652-2818dbdc2b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:44.309588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637753-62ca-4562-b652-2818dbdc2b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:44.309883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637753-62ca-4562-b652-2818dbdc2b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:44.310155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637753-62ca-4562-b652-2818dbdc2b49 admin admin] PATH_INFO: `/v3/projects/f9a29b38fac64544ba9e9e78cb3f54c9/users/e97042f2ec084ddabe60b05d9f274366/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:44.323431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12637753-62ca-4562-b652-2818dbdc2b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a29b38fac64544ba9e9e78cb3f54c9, user_id=e97042f2ec084ddabe60b05d9f274366, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:44.326584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12637753-62ca-4562-b652-2818dbdc2b49 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:44.342540 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1379/2735] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:44 2022] PUT /identity/v3/projects/f9a29b38fac64544ba9e9e78cb3f54c9/users/e97042f2ec084ddabe60b05d9f274366/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:04:44.356472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aefe7f-1f2a-4a48-9a3a-8522d5b9b9d6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:44.356996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aefe7f-1f2a-4a48-9a3a-8522d5b9b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:44.357563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aefe7f-1f2a-4a48-9a3a-8522d5b9b9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:44.409942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e0aefe7f-1f2a-4a48-9a3a-8522d5b9b9d6 None None] MFA Rules not processed for user `e97042f2ec084ddabe60b05d9f274366`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:44.411479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0aefe7f-1f2a-4a48-9a3a-8522d5b9b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:44.466413 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:44.640569 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1357/2736] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:44 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:04:44.661612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637753-62ca-4562-b652-2818dbdc2b49 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:44.663502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-12637753-62ca-4562-b652-2818dbdc2b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:44.712545 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:44.805684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637753-62ca-4562-b652-2818dbdc2b49 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:44.821024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f10013-a9ba-4be2-adaa-bfc1ed0e3f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:44.821820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f10013-a9ba-4be2-adaa-bfc1ed0e3f86 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:44.822105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f10013-a9ba-4be2-adaa-bfc1ed0e3f86 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:44.822391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f10013-a9ba-4be2-adaa-bfc1ed0e3f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:44.862672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f10013-a9ba-4be2-adaa-bfc1ed0e3f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:44.887691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f10013-a9ba-4be2-adaa-bfc1ed0e3f86 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:44.954033 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1380/2737] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:45.740393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aefe7f-1f2a-4a48-9a3a-8522d5b9b9d6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:45.766673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aefe7f-1f2a-4a48-9a3a-8522d5b9b9d6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:45.793582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a24b84-f638-4c99-be94-919bcb4aa269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:45.794272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a24b84-f638-4c99-be94-919bcb4aa269 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:45.794561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a24b84-f638-4c99-be94-919bcb4aa269 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:45.795692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a24b84-f638-4c99-be94-919bcb4aa269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:45.903041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a24b84-f638-4c99-be94-919bcb4aa269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:45.905925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a24b84-f638-4c99-be94-919bcb4aa269 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:45.965058 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1358/2738] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:45.990668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f10013-a9ba-4be2-adaa-bfc1ed0e3f86 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:46.158702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f10013-a9ba-4be2-adaa-bfc1ed0e3f86 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:46.167314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:46.168079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:46.168460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:46.168843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] PATH_INFO: `/v3/users/747cf596ed8b41f4b6b81c0833a870d1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:46.170109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747cf596ed8b41f4b6b81c0833a870d1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:46.172983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:46.241289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747cf596ed8b41f4b6b81c0833a870d1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:46.264763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747cf596ed8b41f4b6b81c0833a870d1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:46.265505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747cf596ed8b41f4b6b81c0833a870d1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:46.279337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747cf596ed8b41f4b6b81c0833a870d1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:46.280034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747cf596ed8b41f4b6b81c0833a870d1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:46.306461 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1381/2739] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:45 2022] DELETE /identity/v3/users/747cf596ed8b41f4b6b81c0833a870d1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:46.310211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483519ce-547e-45db-bc4b-262c02f93c25 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:46.310835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483519ce-547e-45db-bc4b-262c02f93c25 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:46.311056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483519ce-547e-45db-bc4b-262c02f93c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:46.347898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-483519ce-547e-45db-bc4b-262c02f93c25 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:46.349169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-483519ce-547e-45db-bc4b-262c02f93c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:46.524839 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1359/2740] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:46.536096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:46.537584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:46.598982 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:46.674468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5415f-2f9f-4704-8c93-92a3df9f2d33 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:46.682681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ac2ca-8406-4b84-bd4f-59bd6607d5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:46.683326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ac2ca-8406-4b84-bd4f-59bd6607d5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:46.683605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ac2ca-8406-4b84-bd4f-59bd6607d5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:46.683880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ac2ca-8406-4b84-bd4f-59bd6607d5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:46.703849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ac2ca-8406-4b84-bd4f-59bd6607d5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:46.707720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ac2ca-8406-4b84-bd4f-59bd6607d5d4 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:46.746168 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1382/2741] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:47.662280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483519ce-547e-45db-bc4b-262c02f93c25 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:47.664556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-483519ce-547e-45db-bc4b-262c02f93c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:47.692084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483519ce-547e-45db-bc4b-262c02f93c25 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:47.726216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:47.727064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:47.727444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:47.727882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] PATH_INFO: `/v3/projects/b0ce2e8af02c45ad944c5c987f48415a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:47.731315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ce2e8af02c45ad944c5c987f48415a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:47.735130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:48.071421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ce2e8af02c45ad944c5c987f48415a', 'request_id': 'req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:48.077194 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:48.089475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ce2e8af02c45ad944c5c987f48415a', 'request_id': 'req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:48.101204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ce2e8af02c45ad944c5c987f48415a', 'request_id': 'req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:48.134703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] The token cache is being invalidate because project b0ce2e8af02c45ad944c5c987f48415a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:48.135010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:48.136380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:48.137985 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1360/2742] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:47 2022] DELETE /identity/v3/projects/b0ce2e8af02c45ad944c5c987f48415a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:48.142248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ac2ca-8406-4b84-bd4f-59bd6607d5d4 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:48.156279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ac2ca-8406-4b84-bd4f-59bd6607d5d4 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:48.326692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a802ade-75f7-4971-a217-0e37b9514f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:48.327861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a802ade-75f7-4971-a217-0e37b9514f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:48.328164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a802ade-75f7-4971-a217-0e37b9514f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:48.328588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a802ade-75f7-4971-a217-0e37b9514f67 admin admin] PATH_INFO: `/v3/users/e97042f2ec084ddabe60b05d9f274366` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:48.334157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a802ade-75f7-4971-a217-0e37b9514f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97042f2ec084ddabe60b05d9f274366)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:48.341610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a802ade-75f7-4971-a217-0e37b9514f67 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:48.485225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4a802ade-75f7-4971-a217-0e37b9514f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97042f2ec084ddabe60b05d9f274366'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:48.534778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4a802ade-75f7-4971-a217-0e37b9514f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97042f2ec084ddabe60b05d9f274366'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:48.535834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4a802ade-75f7-4971-a217-0e37b9514f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97042f2ec084ddabe60b05d9f274366'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:48.545689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4a802ade-75f7-4971-a217-0e37b9514f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97042f2ec084ddabe60b05d9f274366'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:48.547110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4a802ade-75f7-4971-a217-0e37b9514f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97042f2ec084ddabe60b05d9f274366'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:48.583526 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1383/2743] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:04:48 2022] DELETE /identity/v3/users/e97042f2ec084ddabe60b05d9f274366 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:50.311475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:50.313133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:50.344286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64f6d9-073d-4b71-aefc-ee94b2faf00d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:50.525354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:50.527101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:50.528009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:50.528287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] PATH_INFO: `/v3/projects/f9a29b38fac64544ba9e9e78cb3f54c9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:50.529779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a29b38fac64544ba9e9e78cb3f54c9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:50.532058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:50.654182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a29b38fac64544ba9e9e78cb3f54c9', 'request_id': 'req-984df8d5-6e09-4404-b5f7-73a81a8dd659'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:50.672713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a29b38fac64544ba9e9e78cb3f54c9', 'request_id': 'req-984df8d5-6e09-4404-b5f7-73a81a8dd659'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:50.694284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a29b38fac64544ba9e9e78cb3f54c9', 'request_id': 'req-984df8d5-6e09-4404-b5f7-73a81a8dd659'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:50.729404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] The token cache is being invalidate because project f9a29b38fac64544ba9e9e78cb3f54c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:04:50.729756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:50.730951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-984df8d5-6e09-4404-b5f7-73a81a8dd659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:04:50.734819 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1361/2744] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:04:50 2022] DELETE /identity/v3/projects/f9a29b38fac64544ba9e9e78cb3f54c9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:50.740382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c36606-9bae-4efe-8c7b-5270fd82aa37 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:50.740894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c36606-9bae-4efe-8c7b-5270fd82aa37 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:50.741006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c36606-9bae-4efe-8c7b-5270fd82aa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:50.779215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e3c36606-9bae-4efe-8c7b-5270fd82aa37 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:50.786686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e3c36606-9bae-4efe-8c7b-5270fd82aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:50.919523 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:50.972380 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1384/2745] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:50.974371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff15cf-06de-45b1-ba06-ef9effe11077 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:50.974900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff15cf-06de-45b1-ba06-ef9effe11077 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:50.975360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff15cf-06de-45b1-ba06-ef9effe11077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:51.024876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1bff15cf-06de-45b1-ba06-ef9effe11077 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:51.032521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1bff15cf-06de-45b1-ba06-ef9effe11077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:51.054179 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1362/2746] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:51.058613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c36606-9bae-4efe-8c7b-5270fd82aa37 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:51.074766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c36606-9bae-4efe-8c7b-5270fd82aa37 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:51.075600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce68f31-3486-431a-90d4-1a80fe738106 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:51.075884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce68f31-3486-431a-90d4-1a80fe738106 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:51.076159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce68f31-3486-431a-90d4-1a80fe738106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:51.097764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781b40-5b98-444a-b218-10d9089bb2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:51.098654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781b40-5b98-444a-b218-10d9089bb2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:51.098654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781b40-5b98-444a-b218-10d9089bb2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:51.099184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781b40-5b98-444a-b218-10d9089bb2d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:51.100118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2781b40-5b98-444a-b218-10d9089bb2d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:04:51.100580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2781b40-5b98-444a-b218-10d9089bb2d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:51.102356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2781b40-5b98-444a-b218-10d9089bb2d1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:51.109906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6ce68f31-3486-431a-90d4-1a80fe738106 None None] MFA Rules not processed for user `739083b66f9b433889944e555b0aef23`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:51.111795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ce68f31-3486-431a-90d4-1a80fe738106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:51.141683 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1385/2747] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:04:51.146852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781b40-5b98-444a-b218-10d9089bb2d1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:51.185009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781b40-5b98-444a-b218-10d9089bb2d1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:51.190822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446d208-751a-4ab1-9257-eea009e70a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:51.191441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446d208-751a-4ab1-9257-eea009e70a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:51.191722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446d208-751a-4ab1-9257-eea009e70a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:51.192001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446d208-751a-4ab1-9257-eea009e70a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:51.192652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446d208-751a-4ab1-9257-eea009e70a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:51.194643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446d208-751a-4ab1-9257-eea009e70a7b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:51.248011 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1363/2748] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:04:51.252944 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1386/2749] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:51 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:51.257276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce68f31-3486-431a-90d4-1a80fe738106 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:51.276839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce68f31-3486-431a-90d4-1a80fe738106 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:51.288035 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:51.425619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0d4fc-c50b-49f5-8313-b6e5695aa281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:51.426311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0d4fc-c50b-49f5-8313-b6e5695aa281 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:51.426521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0d4fc-c50b-49f5-8313-b6e5695aa281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:51.426817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0d4fc-c50b-49f5-8313-b6e5695aa281 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:51.427509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0d4fc-c50b-49f5-8313-b6e5695aa281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:51.434920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0d4fc-c50b-49f5-8313-b6e5695aa281 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:51.476216 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1364/2750] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:51 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:51.480266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446d208-751a-4ab1-9257-eea009e70a7b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:51.501621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446d208-751a-4ab1-9257-eea009e70a7b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:51.524693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc2b8c-48d9-49f3-ac50-b212a4ae4271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:51.525363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2b8c-48d9-49f3-ac50-b212a4ae4271 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:51.525551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2b8c-48d9-49f3-ac50-b212a4ae4271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:51.525858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2b8c-48d9-49f3-ac50-b212a4ae4271 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:51.526628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc2b8c-48d9-49f3-ac50-b212a4ae4271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:51.528358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc2b8c-48d9-49f3-ac50-b212a4ae4271 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:51.563038 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1387/2751] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:51.564072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0d4fc-c50b-49f5-8313-b6e5695aa281 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:51.583616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0d4fc-c50b-49f5-8313-b6e5695aa281 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:51.606660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87454e11-1c22-4e89-b6c2-318f8533b0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:51.607549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454e11-1c22-4e89-b6c2-318f8533b0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:51.608014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454e11-1c22-4e89-b6c2-318f8533b0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:51.608436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454e11-1c22-4e89-b6c2-318f8533b0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:51.609245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87454e11-1c22-4e89-b6c2-318f8533b0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:51.611596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87454e11-1c22-4e89-b6c2-318f8533b0b2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:51.658999 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1365/2752] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:51.665919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc2b8c-48d9-49f3-ac50-b212a4ae4271 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:51.685135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc2b8c-48d9-49f3-ac50-b212a4ae4271 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:51.699638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db584c-5746-4221-bc2f-dc02a642aad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:51.700314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db584c-5746-4221-bc2f-dc02a642aad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:51.700598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db584c-5746-4221-bc2f-dc02a642aad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:51.700874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db584c-5746-4221-bc2f-dc02a642aad2 admin admin] PATH_INFO: `/v3/projects/56d7664bcbb0489c83d28d36c57dc80f/users/8151aecbbb284b71ba3fb42de244b870/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:51.732465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db584c-5746-4221-bc2f-dc02a642aad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d7664bcbb0489c83d28d36c57dc80f, user_id=8151aecbbb284b71ba3fb42de244b870, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:51.736470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db584c-5746-4221-bc2f-dc02a642aad2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:51.791257 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1388/2753] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:51 2022] PUT /identity/v3/projects/56d7664bcbb0489c83d28d36c57dc80f/users/8151aecbbb284b71ba3fb42de244b870/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:51.796179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e21d3-33a1-4a1c-bddd-3632f5ea4efc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:51.796468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e21d3-33a1-4a1c-bddd-3632f5ea4efc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:51.796739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e21d3-33a1-4a1c-bddd-3632f5ea4efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:51.850978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-466e21d3-33a1-4a1c-bddd-3632f5ea4efc None None] MFA Rules not processed for user `8151aecbbb284b71ba3fb42de244b870`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:51.852439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-466e21d3-33a1-4a1c-bddd-3632f5ea4efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:51.986318 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1366/2754] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:51.987956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db584c-5746-4221-bc2f-dc02a642aad2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:52.099162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db584c-5746-4221-bc2f-dc02a642aad2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:52.111198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11715216-d610-47e1-b54d-6e4aa349a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:52.112504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11715216-d610-47e1-b54d-6e4aa349a2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:52.112880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11715216-d610-47e1-b54d-6e4aa349a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:52.113842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11715216-d610-47e1-b54d-6e4aa349a2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:52.114651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11715216-d610-47e1-b54d-6e4aa349a2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:52.117897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11715216-d610-47e1-b54d-6e4aa349a2a7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:52.181119 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1389/2755] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:04:51 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:52.185738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e21d3-33a1-4a1c-bddd-3632f5ea4efc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:52.203968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e21d3-33a1-4a1c-bddd-3632f5ea4efc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:52.311973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18e48e-fae6-4c63-9a01-9857e9ff9f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:52.314030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e48e-fae6-4c63-9a01-9857e9ff9f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:52.316126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e48e-fae6-4c63-9a01-9857e9ff9f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:52.316808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e48e-fae6-4c63-9a01-9857e9ff9f16 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:52.318973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18e48e-fae6-4c63-9a01-9857e9ff9f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:52.324061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18e48e-fae6-4c63-9a01-9857e9ff9f16 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:52.375872 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1367/2756] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:04:52 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:04:52.377374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11715216-d610-47e1-b54d-6e4aa349a2a7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:52.405867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11715216-d610-47e1-b54d-6e4aa349a2a7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:52.416398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e4ae5-d2f0-4dc8-a003-90fe877ea760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:52.417024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e4ae5-d2f0-4dc8-a003-90fe877ea760 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:52.417302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e4ae5-d2f0-4dc8-a003-90fe877ea760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:52.417570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e4ae5-d2f0-4dc8-a003-90fe877ea760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:52.418221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e4ae5-d2f0-4dc8-a003-90fe877ea760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:52.420483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e4ae5-d2f0-4dc8-a003-90fe877ea760 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:52.457515 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1390/2757] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:52.461767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18e48e-fae6-4c63-9a01-9857e9ff9f16 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:52.482236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18e48e-fae6-4c63-9a01-9857e9ff9f16 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:52.505891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342207-41c3-4ac2-9f46-bd849dddd520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:52.506584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342207-41c3-4ac2-9f46-bd849dddd520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:52.506888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342207-41c3-4ac2-9f46-bd849dddd520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:52.507166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342207-41c3-4ac2-9f46-bd849dddd520 admin admin] PATH_INFO: `/v3/projects/8b7495c8392c44dca7ae422e6baef9df/users/5851ca8b4b5f4a50b52d37b17ee3d443/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:52.529937 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:52.587611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39342207-41c3-4ac2-9f46-bd849dddd520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7495c8392c44dca7ae422e6baef9df, user_id=5851ca8b4b5f4a50b52d37b17ee3d443, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:52.604116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39342207-41c3-4ac2-9f46-bd849dddd520 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:52.675043 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1368/2758] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:52 2022] PUT /identity/v3/projects/8b7495c8392c44dca7ae422e6baef9df/users/5851ca8b4b5f4a50b52d37b17ee3d443/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:52.680253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e4ae5-d2f0-4dc8-a003-90fe877ea760 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:52.697933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e4ae5-d2f0-4dc8-a003-90fe877ea760 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:52.796333 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:52.840778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b15e59-0579-443b-973c-cfb4a3dbbe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:52.841311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b15e59-0579-443b-973c-cfb4a3dbbe7e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:52.841591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b15e59-0579-443b-973c-cfb4a3dbbe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:52.841862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b15e59-0579-443b-973c-cfb4a3dbbe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:52.842508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b15e59-0579-443b-973c-cfb4a3dbbe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:52.844151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b15e59-0579-443b-973c-cfb4a3dbbe7e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:52.871550 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1391/2759] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:04:52.872385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342207-41c3-4ac2-9f46-bd849dddd520 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:52.902474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342207-41c3-4ac2-9f46-bd849dddd520 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:52.940986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8a9dc-b656-435b-846e-c6d26c566730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:52.944690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a9dc-b656-435b-846e-c6d26c566730 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:52.945001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a9dc-b656-435b-846e-c6d26c566730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:52.949867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a9dc-b656-435b-846e-c6d26c566730 admin admin] PATH_INFO: `/v3/projects/8b7495c8392c44dca7ae422e6baef9df/users/5851ca8b4b5f4a50b52d37b17ee3d443/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:52.959464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8a9dc-b656-435b-846e-c6d26c566730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7495c8392c44dca7ae422e6baef9df, user_id=5851ca8b4b5f4a50b52d37b17ee3d443, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:52.962158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8a9dc-b656-435b-846e-c6d26c566730 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:53.046879 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1369/2760] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:04:52 2022] PUT /identity/v3/projects/8b7495c8392c44dca7ae422e6baef9df/users/5851ca8b4b5f4a50b52d37b17ee3d443/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:04:53.049193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a97d8d-a596-4dc0-ae9f-0ea11e0ee1f3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:53.049604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a97d8d-a596-4dc0-ae9f-0ea11e0ee1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:53.050002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a97d8d-a596-4dc0-ae9f-0ea11e0ee1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:53.119368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b7a97d8d-a596-4dc0-ae9f-0ea11e0ee1f3 None None] MFA Rules not processed for user `5851ca8b4b5f4a50b52d37b17ee3d443`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:53.120750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b7a97d8d-a596-4dc0-ae9f-0ea11e0ee1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:53.355994 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1392/2761] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:53.357133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2d2d3-6ba1-4923-9711-ae5e8ad9a120 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:53.357422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2d2d3-6ba1-4923-9711-ae5e8ad9a120 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:53.357696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2d2d3-6ba1-4923-9711-ae5e8ad9a120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:53.430300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e2d2d2d3-6ba1-4923-9711-ae5e8ad9a120 None None] MFA Rules not processed for user `8151aecbbb284b71ba3fb42de244b870`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:53.439657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e2d2d2d3-6ba1-4923-9711-ae5e8ad9a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:53.636164 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1370/2762] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:04:53.648242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a97d8d-a596-4dc0-ae9f-0ea11e0ee1f3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:04:53.649654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b7a97d8d-a596-4dc0-ae9f-0ea11e0ee1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:53.838348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a97d8d-a596-4dc0-ae9f-0ea11e0ee1f3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:04:53.850181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00743d6b-c8f3-4637-8758-6d0fb94c5e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:04:53.850959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743d6b-c8f3-4637-8758-6d0fb94c5e56 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:53.851365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743d6b-c8f3-4637-8758-6d0fb94c5e56 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:53.851656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743d6b-c8f3-4637-8758-6d0fb94c5e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:53.865486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00743d6b-c8f3-4637-8758-6d0fb94c5e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:04:53.867675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00743d6b-c8f3-4637-8758-6d0fb94c5e56 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:04:53.881577 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1393/2763] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:04:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:04:55.003900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8b186-099e-4d3d-af63-8768a6e674fb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:04:55.004932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8b186-099e-4d3d-af63-8768a6e674fb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:04:55.011498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8b186-099e-4d3d-af63-8768a6e674fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:04:55.059676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d8c8b186-099e-4d3d-af63-8768a6e674fb None None] MFA Rules not processed for user `d44f8d053e07440699d217cd63c94d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:04:55.083195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d8c8b186-099e-4d3d-af63-8768a6e674fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:04:55.274545 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1371/2764] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:04:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:03.876067 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=75 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:05.036786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dca526-2c95-4b2d-8d08-2de78ffb3b5e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:05.038273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dca526-2c95-4b2d-8d08-2de78ffb3b5e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:05.038744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dca526-2c95-4b2d-8d08-2de78ffb3b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:05.065584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c0dca526-2c95-4b2d-8d08-2de78ffb3b5e None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:05.068392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c0dca526-2c95-4b2d-8d08-2de78ffb3b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:05.164238 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1394/2765] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:05:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:05.193575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8b186-099e-4d3d-af63-8768a6e674fb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:05.195265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d8c8b186-099e-4d3d-af63-8768a6e674fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:05.269695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8b186-099e-4d3d-af63-8768a6e674fb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:05.274829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee28856-7d3c-4ddb-b067-a65a9ed9eebc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:05.275377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee28856-7d3c-4ddb-b067-a65a9ed9eebc service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:05.275652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee28856-7d3c-4ddb-b067-a65a9ed9eebc service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:05.275923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee28856-7d3c-4ddb-b067-a65a9ed9eebc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:05.284595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee28856-7d3c-4ddb-b067-a65a9ed9eebc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:05.286186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee28856-7d3c-4ddb-b067-a65a9ed9eebc service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:05.294328 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1372/2766] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:05:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:12.954093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581052-7e6c-429a-898f-a5081eb0ef0e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:12.954737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581052-7e6c-429a-898f-a5081eb0ef0e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:12.954737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581052-7e6c-429a-898f-a5081eb0ef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:12.980904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-77581052-7e6c-429a-898f-a5081eb0ef0e None None] MFA Rules not processed for user `c076d9dc75a7400f87b480d2b18dcc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:12.982027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-77581052-7e6c-429a-898f-a5081eb0ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:13.040241 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1395/2767] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:15.291014 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:23.033654 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=50 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:26.398649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee28856-7d3c-4ddb-b067-a65a9ed9eebc service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:26.400410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4ee28856-7d3c-4ddb-b067-a65a9ed9eebc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:26.563375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee28856-7d3c-4ddb-b067-a65a9ed9eebc service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:26.575003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec0857-9c1e-4352-960c-d646f3b03d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:26.576765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0857-9c1e-4352-960c-d646f3b03d7c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:26.577062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0857-9c1e-4352-960c-d646f3b03d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:26.577340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0857-9c1e-4352-960c-d646f3b03d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:26.585479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f9ec0857-9c1e-4352-960c-d646f3b03d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:26.612103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec0857-9c1e-4352-960c-d646f3b03d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:26.619700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec0857-9c1e-4352-960c-d646f3b03d7c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:26.635557 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1373/2768] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:05:27.633674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77581052-7e6c-429a-898f-a5081eb0ef0e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:27.636066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-77581052-7e6c-429a-898f-a5081eb0ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:27.681286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77581052-7e6c-429a-898f-a5081eb0ef0e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:27.706019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd14b7-0386-4504-b76a-4a4668df5a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:27.708502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd14b7-0386-4504-b76a-4a4668df5a10 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:27.708995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd14b7-0386-4504-b76a-4a4668df5a10 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:27.709432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd14b7-0386-4504-b76a-4a4668df5a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:27.740812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd14b7-0386-4504-b76a-4a4668df5a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:27.748040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd14b7-0386-4504-b76a-4a4668df5a10 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:27.774424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1396/2769] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:05:28.568710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f522-4c27-4fc6-b3aa-6952b219873a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:28.569580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f522-4c27-4fc6-b3aa-6952b219873a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:28.570010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f522-4c27-4fc6-b3aa-6952b219873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:28.607347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1250f522-4c27-4fc6-b3aa-6952b219873a None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:28.608849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1250f522-4c27-4fc6-b3aa-6952b219873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:28.642060 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1374/2770] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:28.646037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd14b7-0386-4504-b76a-4a4668df5a10 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:28.667373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd14b7-0386-4504-b76a-4a4668df5a10 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:28.679210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f291853-a463-454c-8fdb-844cd9d7c3cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:28.680026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f291853-a463-454c-8fdb-844cd9d7c3cb service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:28.680461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f291853-a463-454c-8fdb-844cd9d7c3cb service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:28.680899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f291853-a463-454c-8fdb-844cd9d7c3cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:28.704462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f291853-a463-454c-8fdb-844cd9d7c3cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:28.706777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f291853-a463-454c-8fdb-844cd9d7c3cb service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:28.733659 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1397/2771] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:05:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:29.822922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250f522-4c27-4fc6-b3aa-6952b219873a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:29.840257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250f522-4c27-4fc6-b3aa-6952b219873a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:29.851902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326dae-2f12-4881-b1df-3ffc8fa68545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:29.852938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326dae-2f12-4881-b1df-3ffc8fa68545 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:29.853491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326dae-2f12-4881-b1df-3ffc8fa68545 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:29.853999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326dae-2f12-4881-b1df-3ffc8fa68545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:29.861023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e7326dae-2f12-4881-b1df-3ffc8fa68545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:29.914141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7326dae-2f12-4881-b1df-3ffc8fa68545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:29.921571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7326dae-2f12-4881-b1df-3ffc8fa68545 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:29.961707 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1375/2772] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:05:34.735168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cf3de-a7dd-4944-92e2-0008de9ee682 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:34.735717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cf3de-a7dd-4944-92e2-0008de9ee682 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:34.735717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cf3de-a7dd-4944-92e2-0008de9ee682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:34.767543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-537cf3de-a7dd-4944-92e2-0008de9ee682 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:34.769350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-537cf3de-a7dd-4944-92e2-0008de9ee682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:34.781020 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1398/2773] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:05:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:34.794852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326dae-2f12-4881-b1df-3ffc8fa68545 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:34.817924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326dae-2f12-4881-b1df-3ffc8fa68545 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:34.823816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33523805-227a-4dfc-a3cd-fdd57bdddd43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:34.824929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33523805-227a-4dfc-a3cd-fdd57bdddd43 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:34.825664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33523805-227a-4dfc-a3cd-fdd57bdddd43 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:34.826279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33523805-227a-4dfc-a3cd-fdd57bdddd43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:34.843708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33523805-227a-4dfc-a3cd-fdd57bdddd43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:34.846074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33523805-227a-4dfc-a3cd-fdd57bdddd43 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:34.858166 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1376/2774] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:05:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:37.709533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cf3de-a7dd-4944-92e2-0008de9ee682 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:37.715301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-537cf3de-a7dd-4944-92e2-0008de9ee682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:37.928945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cf3de-a7dd-4944-92e2-0008de9ee682 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:37.939335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a1d19-61a5-46d2-b850-64a9e8509874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:37.939335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1d19-61a5-46d2-b850-64a9e8509874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:37.939662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1d19-61a5-46d2-b850-64a9e8509874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:37.939786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1d19-61a5-46d2-b850-64a9e8509874 admin admin] PATH_INFO: `/v3/users/0db18eb48be64e72a9419d4e7452ca5b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:37.944701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a1d19-61a5-46d2-b850-64a9e8509874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db18eb48be64e72a9419d4e7452ca5b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:37.989267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a1d19-61a5-46d2-b850-64a9e8509874 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:38.096557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-898a1d19-61a5-46d2-b850-64a9e8509874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db18eb48be64e72a9419d4e7452ca5b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:38.151657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-898a1d19-61a5-46d2-b850-64a9e8509874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db18eb48be64e72a9419d4e7452ca5b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:38.155172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-898a1d19-61a5-46d2-b850-64a9e8509874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db18eb48be64e72a9419d4e7452ca5b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:38.194680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-898a1d19-61a5-46d2-b850-64a9e8509874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db18eb48be64e72a9419d4e7452ca5b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:38.195226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-898a1d19-61a5-46d2-b850-64a9e8509874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db18eb48be64e72a9419d4e7452ca5b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:38.225552 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1399/2775] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:05:37 2022] DELETE /identity/v3/users/0db18eb48be64e72a9419d4e7452ca5b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:38.487764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33523805-227a-4dfc-a3cd-fdd57bdddd43 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:38.504191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33523805-227a-4dfc-a3cd-fdd57bdddd43 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:38.622917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:38.623547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:38.623829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:38.624155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] PATH_INFO: `/v3/projects/4ad7cba3465048b195bfe5d870860bdf` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:38.626099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad7cba3465048b195bfe5d870860bdf)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:38.628207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:38.774410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad7cba3465048b195bfe5d870860bdf', 'request_id': 'req-0946a0be-89b8-4344-b915-90b49551553a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:38.800315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad7cba3465048b195bfe5d870860bdf', 'request_id': 'req-0946a0be-89b8-4344-b915-90b49551553a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:38.811518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad7cba3465048b195bfe5d870860bdf', 'request_id': 'req-0946a0be-89b8-4344-b915-90b49551553a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:38.831044 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:38.841386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] The token cache is being invalidate because project 4ad7cba3465048b195bfe5d870860bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:05:38.842280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:38.843361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0946a0be-89b8-4344-b915-90b49551553a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:38.846804 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1377/2776] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:38 2022] DELETE /identity/v3/projects/4ad7cba3465048b195bfe5d870860bdf => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:38.851478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea97f2-a349-4409-a464-172972f07f96 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:38.852689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea97f2-a349-4409-a464-172972f07f96 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:38.853189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea97f2-a349-4409-a464-172972f07f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:38.878466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-91ea97f2-a349-4409-a464-172972f07f96 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:38.880325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-91ea97f2-a349-4409-a464-172972f07f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:38.980074 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:39.011461 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1400/2777] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:39.019861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc45014-c1d2-4182-ad9d-dd29b5dab22a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:39.020772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc45014-c1d2-4182-ad9d-dd29b5dab22a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:39.021281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc45014-c1d2-4182-ad9d-dd29b5dab22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:39.050019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1fc45014-c1d2-4182-ad9d-dd29b5dab22a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:39.051496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1fc45014-c1d2-4182-ad9d-dd29b5dab22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:39.064589 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1378/2778] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:39.071490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea97f2-a349-4409-a464-172972f07f96 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:39.111446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea97f2-a349-4409-a464-172972f07f96 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:39.139762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe200fb-82d3-4070-a6db-807fbbaf1bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:39.142046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe200fb-82d3-4070-a6db-807fbbaf1bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:39.143581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe200fb-82d3-4070-a6db-807fbbaf1bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:39.145016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe200fb-82d3-4070-a6db-807fbbaf1bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:39.145768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe200fb-82d3-4070-a6db-807fbbaf1bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:05:39.147230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe200fb-82d3-4070-a6db-807fbbaf1bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:39.152379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe200fb-82d3-4070-a6db-807fbbaf1bd7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:39.191967 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1401/2779] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:05:39.200996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc45014-c1d2-4182-ad9d-dd29b5dab22a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:39.217525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc45014-c1d2-4182-ad9d-dd29b5dab22a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:39.247563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b5cb-244a-448b-afe5-292c9df39465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:39.249075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b5cb-244a-448b-afe5-292c9df39465 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:39.249852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b5cb-244a-448b-afe5-292c9df39465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:39.253952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b5cb-244a-448b-afe5-292c9df39465 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:39.254889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686b5cb-244a-448b-afe5-292c9df39465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:39.260663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686b5cb-244a-448b-afe5-292c9df39465 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:39.342566 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1379/2780] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:05:39 2022] POST /identity/v3/projects => generated 389 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:39.359736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe200fb-82d3-4070-a6db-807fbbaf1bd7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:39.382474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe200fb-82d3-4070-a6db-807fbbaf1bd7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:39.466188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292a13-ef4f-4bcf-9057-a58ca794fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:39.467219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292a13-ef4f-4bcf-9057-a58ca794fc40 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:39.467690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292a13-ef4f-4bcf-9057-a58ca794fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:39.468120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292a13-ef4f-4bcf-9057-a58ca794fc40 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:39.469109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b292a13-ef4f-4bcf-9057-a58ca794fc40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:39.471705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b292a13-ef4f-4bcf-9057-a58ca794fc40 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:39.554120 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1402/2781] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:05:39 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:39.558463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b5cb-244a-448b-afe5-292c9df39465 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:39.580757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b5cb-244a-448b-afe5-292c9df39465 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:39.603803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b09cd1-ef13-4b7c-88ca-9920441ea996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:39.610461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09cd1-ef13-4b7c-88ca-9920441ea996 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:39.611140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09cd1-ef13-4b7c-88ca-9920441ea996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:39.611532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09cd1-ef13-4b7c-88ca-9920441ea996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:39.618486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b09cd1-ef13-4b7c-88ca-9920441ea996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:39.620500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b09cd1-ef13-4b7c-88ca-9920441ea996 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:39.653261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292a13-ef4f-4bcf-9057-a58ca794fc40 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:39.663048 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1380/2782] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:05:39.675282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292a13-ef4f-4bcf-9057-a58ca794fc40 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:39.692037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa36f-ae53-4273-b509-1092573c5d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:39.695106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa36f-ae53-4273-b509-1092573c5d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:39.695386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa36f-ae53-4273-b509-1092573c5d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:39.695661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa36f-ae53-4273-b509-1092573c5d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:39.696479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fa36f-ae53-4273-b509-1092573c5d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:39.700451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fa36f-ae53-4273-b509-1092573c5d88 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:39.721177 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1403/2783] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:05:39.724766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b09cd1-ef13-4b7c-88ca-9920441ea996 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:39.743129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b09cd1-ef13-4b7c-88ca-9920441ea996 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:39.754263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eeef6-c381-4378-bebd-d1de1e5dbefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:39.754982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eeef6-c381-4378-bebd-d1de1e5dbefc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:39.755396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eeef6-c381-4378-bebd-d1de1e5dbefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:39.755681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eeef6-c381-4378-bebd-d1de1e5dbefc admin admin] PATH_INFO: `/v3/projects/2b6dd9c628eb4be5b48c28a1192e16c1/users/c4c8a46a0556407f9956cbd1ffd75c7e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:39.791844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0eeef6-c381-4378-bebd-d1de1e5dbefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6dd9c628eb4be5b48c28a1192e16c1, user_id=c4c8a46a0556407f9956cbd1ffd75c7e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:39.795719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0eeef6-c381-4378-bebd-d1de1e5dbefc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:39.824187 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1381/2784] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:39 2022] PUT /identity/v3/projects/2b6dd9c628eb4be5b48c28a1192e16c1/users/c4c8a46a0556407f9956cbd1ffd75c7e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:39.829366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cf805-2251-4c96-8e4e-163d13accd15 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:39.830177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cf805-2251-4c96-8e4e-163d13accd15 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:39.832992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cf805-2251-4c96-8e4e-163d13accd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:39.874791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-249cf805-2251-4c96-8e4e-163d13accd15 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:39.876747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-249cf805-2251-4c96-8e4e-163d13accd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:39.982272 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1404/2785] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:39.992669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eeef6-c381-4378-bebd-d1de1e5dbefc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:39.995114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ae0eeef6-c381-4378-bebd-d1de1e5dbefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:40.092108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eeef6-c381-4378-bebd-d1de1e5dbefc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:40.096429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173384c0-a2c0-46b1-ba05-b6b59d925209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:40.097307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173384c0-a2c0-46b1-ba05-b6b59d925209 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:40.097799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173384c0-a2c0-46b1-ba05-b6b59d925209 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:40.098262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173384c0-a2c0-46b1-ba05-b6b59d925209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:40.116439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173384c0-a2c0-46b1-ba05-b6b59d925209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:40.118318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173384c0-a2c0-46b1-ba05-b6b59d925209 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:40.145854 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1382/2786] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:05:40.534767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cf805-2251-4c96-8e4e-163d13accd15 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:40.536230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-249cf805-2251-4c96-8e4e-163d13accd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:40.572436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cf805-2251-4c96-8e4e-163d13accd15 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:40.579619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:40.580833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:40.581273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:40.581918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] PATH_INFO: `/v3/users/8151aecbbb284b71ba3fb42de244b870` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:40.583340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8151aecbbb284b71ba3fb42de244b870)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:40.585467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:40.658500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8151aecbbb284b71ba3fb42de244b870'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.660464 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:40.681752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8151aecbbb284b71ba3fb42de244b870'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.683483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8151aecbbb284b71ba3fb42de244b870'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.714774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8151aecbbb284b71ba3fb42de244b870'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.716051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8151aecbbb284b71ba3fb42de244b870'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:40.757128 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1405/2787] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:05:40 2022] DELETE /identity/v3/users/8151aecbbb284b71ba3fb42de244b870 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:05:40.758203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab92c9-7715-4a01-abf6-621479784b6b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:40.758805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab92c9-7715-4a01-abf6-621479784b6b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:40.758805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab92c9-7715-4a01-abf6-621479784b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:40.787470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3fab92c9-7715-4a01-abf6-621479784b6b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:40.793675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3fab92c9-7715-4a01-abf6-621479784b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:40.941380 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1383/2788] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:40.952078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:40.955019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:41.081609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265302f4-3867-4924-9a63-0a51d711c580 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.085640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e3951-1299-469c-967c-bfde294f54db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.086250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3951-1299-469c-967c-bfde294f54db service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.086670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3951-1299-469c-967c-bfde294f54db service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.087003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3951-1299-469c-967c-bfde294f54db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.100993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e3951-1299-469c-967c-bfde294f54db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.102826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e3951-1299-469c-967c-bfde294f54db service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.131002 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1406/2789] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:05:41.590841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab92c9-7715-4a01-abf6-621479784b6b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:41.592633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3fab92c9-7715-4a01-abf6-621479784b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:41.611212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab92c9-7715-4a01-abf6-621479784b6b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:41.628403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:41.629325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:41.629788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:41.630226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] PATH_INFO: `/v3/projects/56d7664bcbb0489c83d28d36c57dc80f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:41.631785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d7664bcbb0489c83d28d36c57dc80f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:41.634031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:41.811118 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:41.910049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d7664bcbb0489c83d28d36c57dc80f', 'request_id': 'req-aa8681ba-81b2-4450-91b4-26d386aa3d0b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:41.929098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d7664bcbb0489c83d28d36c57dc80f', 'request_id': 'req-aa8681ba-81b2-4450-91b4-26d386aa3d0b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:41.952023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d7664bcbb0489c83d28d36c57dc80f', 'request_id': 'req-aa8681ba-81b2-4450-91b4-26d386aa3d0b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:42.020574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] The token cache is being invalidate because project 56d7664bcbb0489c83d28d36c57dc80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:05:42.023806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:42.026514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:42.030798 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1384/2790] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:41 2022] DELETE /identity/v3/projects/56d7664bcbb0489c83d28d36c57dc80f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:05:42.035177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e3951-1299-469c-967c-bfde294f54db service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:42.057421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e3951-1299-469c-967c-bfde294f54db service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:42.235251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccbb64-0c6e-4070-9fbf-b6738cf98123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:42.236341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccbb64-0c6e-4070-9fbf-b6738cf98123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:42.236859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccbb64-0c6e-4070-9fbf-b6738cf98123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:42.237340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccbb64-0c6e-4070-9fbf-b6738cf98123 admin admin] PATH_INFO: `/v3/users/5851ca8b4b5f4a50b52d37b17ee3d443` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:42.243702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccbb64-0c6e-4070-9fbf-b6738cf98123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5851ca8b4b5f4a50b52d37b17ee3d443)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:42.246196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccbb64-0c6e-4070-9fbf-b6738cf98123 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:42.447200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-38ccbb64-0c6e-4070-9fbf-b6738cf98123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5851ca8b4b5f4a50b52d37b17ee3d443'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:42.514014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-38ccbb64-0c6e-4070-9fbf-b6738cf98123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5851ca8b4b5f4a50b52d37b17ee3d443'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:42.515167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-38ccbb64-0c6e-4070-9fbf-b6738cf98123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5851ca8b4b5f4a50b52d37b17ee3d443'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:42.527498 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:42.539370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-38ccbb64-0c6e-4070-9fbf-b6738cf98123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5851ca8b4b5f4a50b52d37b17ee3d443'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:42.547457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-38ccbb64-0c6e-4070-9fbf-b6738cf98123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5851ca8b4b5f4a50b52d37b17ee3d443'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:42.596568 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1407/2791] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:05:42 2022] DELETE /identity/v3/users/5851ca8b4b5f4a50b52d37b17ee3d443 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:43.976613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:43.978161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:43.997998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8681ba-81b2-4450-91b4-26d386aa3d0b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:44.209674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:44.210591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:44.211089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:44.211514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] PATH_INFO: `/v3/projects/8b7495c8392c44dca7ae422e6baef9df` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:44.212853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7495c8392c44dca7ae422e6baef9df)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:44.215815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:44.313129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7495c8392c44dca7ae422e6baef9df', 'request_id': 'req-0e225b0a-f378-4ddb-b5b3-92b70306a839'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:44.321966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7495c8392c44dca7ae422e6baef9df', 'request_id': 'req-0e225b0a-f378-4ddb-b5b3-92b70306a839'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:44.334150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7495c8392c44dca7ae422e6baef9df', 'request_id': 'req-0e225b0a-f378-4ddb-b5b3-92b70306a839'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:44.366915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] The token cache is being invalidate because project 8b7495c8392c44dca7ae422e6baef9df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:05:44.367155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:44.367686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0e225b0a-f378-4ddb-b5b3-92b70306a839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:05:44.369839 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1385/2792] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:05:43 2022] DELETE /identity/v3/projects/8b7495c8392c44dca7ae422e6baef9df => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:44.377383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa520b-8dcf-4358-8aa6-3c4c1dd4634d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:44.378309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa520b-8dcf-4358-8aa6-3c4c1dd4634d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:44.378895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa520b-8dcf-4358-8aa6-3c4c1dd4634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:44.417723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c3fa520b-8dcf-4358-8aa6-3c4c1dd4634d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:44.422080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c3fa520b-8dcf-4358-8aa6-3c4c1dd4634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:44.575635 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1408/2793] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:44.583625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b3e7-0239-469e-a379-db3eb5c8a96a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:44.583975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b3e7-0239-469e-a379-db3eb5c8a96a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:44.584330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b3e7-0239-469e-a379-db3eb5c8a96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:44.613253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cdd5b3e7-0239-469e-a379-db3eb5c8a96a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:44.614499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cdd5b3e7-0239-469e-a379-db3eb5c8a96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:44.623570 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1386/2794] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:44.630633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa520b-8dcf-4358-8aa6-3c4c1dd4634d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:44.642064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa520b-8dcf-4358-8aa6-3c4c1dd4634d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:44.648560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74556fce-4f03-48de-bc2b-71ad75e21652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:44.649453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556fce-4f03-48de-bc2b-71ad75e21652 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:44.649743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556fce-4f03-48de-bc2b-71ad75e21652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:44.650026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556fce-4f03-48de-bc2b-71ad75e21652 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:44.650749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74556fce-4f03-48de-bc2b-71ad75e21652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:05:44.651056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74556fce-4f03-48de-bc2b-71ad75e21652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:44.652814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74556fce-4f03-48de-bc2b-71ad75e21652 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:44.666662 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1409/2795] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:05:44.670812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5b3e7-0239-469e-a379-db3eb5c8a96a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:44.693671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5b3e7-0239-469e-a379-db3eb5c8a96a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:44.705026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464d124-15a8-41fc-b6c6-66821d36f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:44.705658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464d124-15a8-41fc-b6c6-66821d36f7cf admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:44.705942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464d124-15a8-41fc-b6c6-66821d36f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:44.706221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464d124-15a8-41fc-b6c6-66821d36f7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:44.706917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464d124-15a8-41fc-b6c6-66821d36f7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:44.708853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464d124-15a8-41fc-b6c6-66821d36f7cf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:44.776339 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1387/2796] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:05:44 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:44.778714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74556fce-4f03-48de-bc2b-71ad75e21652 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:44.800251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74556fce-4f03-48de-bc2b-71ad75e21652 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:44.925251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea4d5f-4c47-400f-8b3c-e57319f8b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:44.926341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea4d5f-4c47-400f-8b3c-e57319f8b554 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:44.927545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea4d5f-4c47-400f-8b3c-e57319f8b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:44.927836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea4d5f-4c47-400f-8b3c-e57319f8b554 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:44.928731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea4d5f-4c47-400f-8b3c-e57319f8b554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:44.931538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea4d5f-4c47-400f-8b3c-e57319f8b554 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:45.038160 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1410/2797] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:05:44 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:05:45.050441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464d124-15a8-41fc-b6c6-66821d36f7cf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:45.079765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464d124-15a8-41fc-b6c6-66821d36f7cf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:45.100468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cab84a-ac0d-4ad8-b583-09b931f3e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:45.101106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cab84a-ac0d-4ad8-b583-09b931f3e199 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:45.101393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cab84a-ac0d-4ad8-b583-09b931f3e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:45.101393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cab84a-ac0d-4ad8-b583-09b931f3e199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:45.101393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cab84a-ac0d-4ad8-b583-09b931f3e199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:45.115812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cab84a-ac0d-4ad8-b583-09b931f3e199 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:45.173978 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1388/2798] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:05:45.176885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea4d5f-4c47-400f-8b3c-e57319f8b554 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:45.212011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea4d5f-4c47-400f-8b3c-e57319f8b554 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:45.258425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe3cd6-52c6-4db0-a8be-f6d3bcd25e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:45.262157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe3cd6-52c6-4db0-a8be-f6d3bcd25e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:45.262446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe3cd6-52c6-4db0-a8be-f6d3bcd25e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:45.267852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe3cd6-52c6-4db0-a8be-f6d3bcd25e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:45.268665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe3cd6-52c6-4db0-a8be-f6d3bcd25e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:45.270290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe3cd6-52c6-4db0-a8be-f6d3bcd25e8a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:45.323782 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1411/2799] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:45.325702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cab84a-ac0d-4ad8-b583-09b931f3e199 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:45.352617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cab84a-ac0d-4ad8-b583-09b931f3e199 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:45.369854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f069c-f506-4438-ae1f-894d106bc46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:45.370482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f069c-f506-4438-ae1f-894d106bc46f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:45.385695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f069c-f506-4438-ae1f-894d106bc46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:45.387594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f069c-f506-4438-ae1f-894d106bc46f admin admin] PATH_INFO: `/v3/projects/7c58ca9b345e41538c7adb8abde0773f/users/d141ea927c214f978ffdc50892a0dc3c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:45.428966 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:45.443681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f069c-f506-4438-ae1f-894d106bc46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c58ca9b345e41538c7adb8abde0773f, user_id=d141ea927c214f978ffdc50892a0dc3c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:45.448494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f069c-f506-4438-ae1f-894d106bc46f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:45.493364 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1389/2800] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:45 2022] PUT /identity/v3/projects/7c58ca9b345e41538c7adb8abde0773f/users/d141ea927c214f978ffdc50892a0dc3c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:45.497256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb4b5-ca8d-4ca2-9c6b-dae3af58653f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:45.497256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb4b5-ca8d-4ca2-9c6b-dae3af58653f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:45.497256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb4b5-ca8d-4ca2-9c6b-dae3af58653f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:45.585530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-119cb4b5-ca8d-4ca2-9c6b-dae3af58653f None None] MFA Rules not processed for user `d141ea927c214f978ffdc50892a0dc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:45.585738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-119cb4b5-ca8d-4ca2-9c6b-dae3af58653f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:45.794543 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:45.880995 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1412/2801] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:45.956001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f069c-f506-4438-ae1f-894d106bc46f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:45.958061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-408f069c-f506-4438-ae1f-894d106bc46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:46.121431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f069c-f506-4438-ae1f-894d106bc46f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:46.133851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d742a-d822-4de2-b919-8fb18c5ba44c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:46.134498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d742a-d822-4de2-b919-8fb18c5ba44c service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:46.134983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d742a-d822-4de2-b919-8fb18c5ba44c service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:46.135380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d742a-d822-4de2-b919-8fb18c5ba44c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:46.155636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d742a-d822-4de2-b919-8fb18c5ba44c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:46.157755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d742a-d822-4de2-b919-8fb18c5ba44c service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:46.181849 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1390/2802] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:05:47.519923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56d73-2717-4ba2-b987-1a8dbba01e3d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:47.521027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56d73-2717-4ba2-b987-1a8dbba01e3d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:47.522440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56d73-2717-4ba2-b987-1a8dbba01e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:47.547993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-52d56d73-2717-4ba2-b987-1a8dbba01e3d None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:47.549664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-52d56d73-2717-4ba2-b987-1a8dbba01e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:47.698428 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1413/2803] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:47.702591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d742a-d822-4de2-b919-8fb18c5ba44c service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:47.705086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-123d742a-d822-4de2-b919-8fb18c5ba44c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:47.903361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d742a-d822-4de2-b919-8fb18c5ba44c service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:47.917041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0756b9f-2428-4b14-8075-da4b561cf460 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:47.917930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756b9f-2428-4b14-8075-da4b561cf460 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:47.918391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756b9f-2428-4b14-8075-da4b561cf460 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:47.918881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756b9f-2428-4b14-8075-da4b561cf460 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:47.940824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0756b9f-2428-4b14-8075-da4b561cf460 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:47.942743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0756b9f-2428-4b14-8075-da4b561cf460 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:47.970176 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1391/2804] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:05:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:05:48.862449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be22d7-05f3-45ce-9be7-2b720cded6f1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:48.864661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be22d7-05f3-45ce-9be7-2b720cded6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:48.865115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be22d7-05f3-45ce-9be7-2b720cded6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:48.925954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-45be22d7-05f3-45ce-9be7-2b720cded6f1 None None] MFA Rules not processed for user `c076d9dc75a7400f87b480d2b18dcc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:48.929956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-45be22d7-05f3-45ce-9be7-2b720cded6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:49.119972 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1414/2805] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:50.211810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0756b9f-2428-4b14-8075-da4b561cf460 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:50.213289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a0756b9f-2428-4b14-8075-da4b561cf460 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:50.373937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0756b9f-2428-4b14-8075-da4b561cf460 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:50.386111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be22d7-05f3-45ce-9be7-2b720cded6f1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:50.387539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-45be22d7-05f3-45ce-9be7-2b720cded6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:50.396028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc640-24d6-4ea0-a6ea-952c6b506c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:50.396675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc640-24d6-4ea0-a6ea-952c6b506c76 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:50.396956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc640-24d6-4ea0-a6ea-952c6b506c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:50.397235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc640-24d6-4ea0-a6ea-952c6b506c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:50.404734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-76bfc640-24d6-4ea0-a6ea-952c6b506c76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:50.438462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfc640-24d6-4ea0-a6ea-952c6b506c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:50.440295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfc640-24d6-4ea0-a6ea-952c6b506c76 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:50.462825 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1392/2806] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:05:50.464407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944c6f8-ee69-4bd2-9860-8b8e87dc7bc9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:50.465653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944c6f8-ee69-4bd2-9860-8b8e87dc7bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:50.466163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944c6f8-ee69-4bd2-9860-8b8e87dc7bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:50.517320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a944c6f8-ee69-4bd2-9860-8b8e87dc7bc9 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:50.519367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a944c6f8-ee69-4bd2-9860-8b8e87dc7bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:50.552295 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1393/2807] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:05:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:50.560026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be22d7-05f3-45ce-9be7-2b720cded6f1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:50.569480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bff76d-dc25-48b1-b365-370855bcaef4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:50.571390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944c6f8-ee69-4bd2-9860-8b8e87dc7bc9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:50.582307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bff76d-dc25-48b1-b365-370855bcaef4 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:50.584212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bff76d-dc25-48b1-b365-370855bcaef4 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:50.584718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bff76d-dc25-48b1-b365-370855bcaef4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:50.588923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944c6f8-ee69-4bd2-9860-8b8e87dc7bc9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:50.590666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-10bff76d-dc25-48b1-b365-370855bcaef4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:50.613071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bff76d-dc25-48b1-b365-370855bcaef4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:50.615193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765e5e0-f4fb-400a-84d7-c9e8506b2859 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:50.615368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bff76d-dc25-48b1-b365-370855bcaef4 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:50.616316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765e5e0-f4fb-400a-84d7-c9e8506b2859 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:50.616739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765e5e0-f4fb-400a-84d7-c9e8506b2859 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:50.617021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765e5e0-f4fb-400a-84d7-c9e8506b2859 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:50.647900 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1415/2808] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:05:50.651748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765e5e0-f4fb-400a-84d7-c9e8506b2859 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:50.657036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765e5e0-f4fb-400a-84d7-c9e8506b2859 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:50.673723 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1394/2809] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:05:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:51.220589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef21b94-5298-4522-b38a-c744b1a9d421 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:51.221092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef21b94-5298-4522-b38a-c744b1a9d421 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:51.221572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef21b94-5298-4522-b38a-c744b1a9d421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:51.306681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2ef21b94-5298-4522-b38a-c744b1a9d421 None None] MFA Rules not processed for user `c4c8a46a0556407f9956cbd1ffd75c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:51.308437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2ef21b94-5298-4522-b38a-c744b1a9d421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:51.364445 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:51.549953 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1416/2810] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:51.554742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765e5e0-f4fb-400a-84d7-c9e8506b2859 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:51.556698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8765e5e0-f4fb-400a-84d7-c9e8506b2859 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:51.568856 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:51.743247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765e5e0-f4fb-400a-84d7-c9e8506b2859 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:51.754934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a55da-1dd6-4024-9d88-7fca54614400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:51.757740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a55da-1dd6-4024-9d88-7fca54614400 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:51.758297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a55da-1dd6-4024-9d88-7fca54614400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:51.759812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a55da-1dd6-4024-9d88-7fca54614400 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:51.761339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a55da-1dd6-4024-9d88-7fca54614400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:51.768387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a55da-1dd6-4024-9d88-7fca54614400 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:51.909283 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1395/2811] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:05:51 2022] POST /identity/v3/projects => generated 387 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:51.931647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef21b94-5298-4522-b38a-c744b1a9d421 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:51.980555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef21b94-5298-4522-b38a-c744b1a9d421 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.209343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505ad5d-d364-4c7f-96ed-c003c7adbd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.210624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505ad5d-d364-4c7f-96ed-c003c7adbd8e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.210915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505ad5d-d364-4c7f-96ed-c003c7adbd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.211191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505ad5d-d364-4c7f-96ed-c003c7adbd8e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.211831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505ad5d-d364-4c7f-96ed-c003c7adbd8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.213774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505ad5d-d364-4c7f-96ed-c003c7adbd8e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.273504 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1417/2812] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:05:51 2022] POST /identity/v3/users => generated 300 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:05:52.274807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a55da-1dd6-4024-9d88-7fca54614400 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.293643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a55da-1dd6-4024-9d88-7fca54614400 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.321209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3daf2-306a-4773-8379-b9bffad30bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.324390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3daf2-306a-4773-8379-b9bffad30bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.328519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3daf2-306a-4773-8379-b9bffad30bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.328963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3daf2-306a-4773-8379-b9bffad30bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.330114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3daf2-306a-4773-8379-b9bffad30bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.338202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3daf2-306a-4773-8379-b9bffad30bd5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.392156 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1396/2813] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:52.393711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505ad5d-d364-4c7f-96ed-c003c7adbd8e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.415422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505ad5d-d364-4c7f-96ed-c003c7adbd8e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.431315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcee847-1d73-496c-8b3f-6e031b5ea510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.432122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcee847-1d73-496c-8b3f-6e031b5ea510 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.438359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcee847-1d73-496c-8b3f-6e031b5ea510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.438912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcee847-1d73-496c-8b3f-6e031b5ea510 admin admin] PATH_INFO: `/v3/projects/6632fafd2c174cebae2ddd00f1c95d77/users/5d5e0832ad9f4cd8959259bd5251f3f9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.479814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcee847-1d73-496c-8b3f-6e031b5ea510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6632fafd2c174cebae2ddd00f1c95d77, user_id=5d5e0832ad9f4cd8959259bd5251f3f9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.500322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcee847-1d73-496c-8b3f-6e031b5ea510 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.541519 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1418/2814] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:52 2022] PUT /identity/v3/projects/6632fafd2c174cebae2ddd00f1c95d77/users/5d5e0832ad9f4cd8959259bd5251f3f9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:52.545494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3daf2-306a-4773-8379-b9bffad30bd5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.564550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3daf2-306a-4773-8379-b9bffad30bd5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.717506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4959e1-d081-4472-937f-5717838f4ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.719158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4959e1-d081-4472-937f-5717838f4ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.719918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4959e1-d081-4472-937f-5717838f4ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.720410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4959e1-d081-4472-937f-5717838f4ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.721373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4959e1-d081-4472-937f-5717838f4ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.723262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4959e1-d081-4472-937f-5717838f4ca7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.738757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950ba17-7d87-4208-bf95-d7bd4cc488db None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.739705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950ba17-7d87-4208-bf95-d7bd4cc488db None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.740219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950ba17-7d87-4208-bf95-d7bd4cc488db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.773963 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1397/2815] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:05:52.777398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4959e1-d081-4472-937f-5717838f4ca7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:52.798999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b950ba17-7d87-4208-bf95-d7bd4cc488db None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:52.800990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b950ba17-7d87-4208-bf95-d7bd4cc488db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:52.809862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4959e1-d081-4472-937f-5717838f4ca7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:52.825064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbe01-6598-4f0b-aa21-39cebb5d62ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:52.826161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbe01-6598-4f0b-aa21-39cebb5d62ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:52.826729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbe01-6598-4f0b-aa21-39cebb5d62ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:52.827224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbe01-6598-4f0b-aa21-39cebb5d62ad admin admin] PATH_INFO: `/v3/projects/6632fafd2c174cebae2ddd00f1c95d77/users/5d5e0832ad9f4cd8959259bd5251f3f9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:52.833116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edbe01-6598-4f0b-aa21-39cebb5d62ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6632fafd2c174cebae2ddd00f1c95d77, user_id=5d5e0832ad9f4cd8959259bd5251f3f9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:52.837456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edbe01-6598-4f0b-aa21-39cebb5d62ad admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:52.869587 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1398/2816] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:05:52 2022] PUT /identity/v3/projects/6632fafd2c174cebae2ddd00f1c95d77/users/5d5e0832ad9f4cd8959259bd5251f3f9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:05:52.909483 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1419/2817] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:05:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:52.941249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbe01-6598-4f0b-aa21-39cebb5d62ad admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:53.182127 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:53.190510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbe01-6598-4f0b-aa21-39cebb5d62ad admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:53.198129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b37f0-0f93-401f-93e0-297ed05919ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:53.200439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b37f0-0f93-401f-93e0-297ed05919ee service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:53.201058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b37f0-0f93-401f-93e0-297ed05919ee service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:53.201569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b37f0-0f93-401f-93e0-297ed05919ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:53.334784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b37f0-0f93-401f-93e0-297ed05919ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:53.336422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b37f0-0f93-401f-93e0-297ed05919ee service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:53.355507 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1399/2818] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:05:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:53.905844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e2e2d-43c3-4e35-9666-3feceecf9c05 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:53.906801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e2e2d-43c3-4e35-9666-3feceecf9c05 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:53.907373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e2e2d-43c3-4e35-9666-3feceecf9c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:53.939947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-938e2e2d-43c3-4e35-9666-3feceecf9c05 None None] MFA Rules not processed for user `d141ea927c214f978ffdc50892a0dc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:53.941642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-938e2e2d-43c3-4e35-9666-3feceecf9c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:53.999119 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:54.086547 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1420/2819] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:55.610427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6e2f-7853-4ec0-99d0-f1896a9e9cab None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:55.610927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6e2f-7853-4ec0-99d0-f1896a9e9cab None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:55.611129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6e2f-7853-4ec0-99d0-f1896a9e9cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:55.689299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a65a6e2f-7853-4ec0-99d0-f1896a9e9cab None None] MFA Rules not processed for user `d141ea927c214f978ffdc50892a0dc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:55.690546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a65a6e2f-7853-4ec0-99d0-f1896a9e9cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:55.716060 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1400/2820] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:05:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:05:58.878805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf9641-6520-4bde-9273-20e5e04d5ea7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:58.879670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf9641-6520-4bde-9273-20e5e04d5ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:58.880101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf9641-6520-4bde-9273-20e5e04d5ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:58.912890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5cbf9641-6520-4bde-9273-20e5e04d5ea7 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:05:58.915727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5cbf9641-6520-4bde-9273-20e5e04d5ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:58.941660 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1421/2821] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:05:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:05:58.949426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a6e2f-7853-4ec0-99d0-f1896a9e9cab None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:58.972024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a6e2f-7853-4ec0-99d0-f1896a9e9cab None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:58.981848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8994ae5-b46b-42c9-a3f9-05c447c2eb9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:58.982753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8994ae5-b46b-42c9-a3f9-05c447c2eb9e service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:58.983194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8994ae5-b46b-42c9-a3f9-05c447c2eb9e service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:58.983620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8994ae5-b46b-42c9-a3f9-05c447c2eb9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.005668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8994ae5-b46b-42c9-a3f9-05c447c2eb9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.007706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8994ae5-b46b-42c9-a3f9-05c447c2eb9e service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.025936 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1401/2822] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:59.622282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf9641-6520-4bde-9273-20e5e04d5ea7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:05:59.624191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5cbf9641-6520-4bde-9273-20e5e04d5ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:59.768050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf9641-6520-4bde-9273-20e5e04d5ea7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:05:59.782513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2f8dc-c6c9-42d9-9d77-6b3c9134ec3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:05:59.783410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f8dc-c6c9-42d9-9d77-6b3c9134ec3e service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:05:59.783703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f8dc-c6c9-42d9-9d77-6b3c9134ec3e service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:05:59.784067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f8dc-c6c9-42d9-9d77-6b3c9134ec3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:05:59.787174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2de2f8dc-c6c9-42d9-9d77-6b3c9134ec3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:05:59.804180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2f8dc-c6c9-42d9-9d77-6b3c9134ec3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:05:59.806898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2f8dc-c6c9-42d9-9d77-6b3c9134ec3e service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:05:59.830018 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1422/2823] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:05:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:02.909530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8994ae5-b46b-42c9-a3f9-05c447c2eb9e service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:02.912527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e8994ae5-b46b-42c9-a3f9-05c447c2eb9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:03.087904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8994ae5-b46b-42c9-a3f9-05c447c2eb9e service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:03.095288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:03.096250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:03.096698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:03.097142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] PATH_INFO: `/v3/users/9632b1b483dd442f88e8898ef29eb257` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:03.098578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9632b1b483dd442f88e8898ef29eb257)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:03.102740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:03.185535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9632b1b483dd442f88e8898ef29eb257'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:03.221300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9632b1b483dd442f88e8898ef29eb257'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:03.223711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9632b1b483dd442f88e8898ef29eb257'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:03.244839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9632b1b483dd442f88e8898ef29eb257'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:03.260995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9632b1b483dd442f88e8898ef29eb257'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:03.276160 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1402/2824] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:02 2022] DELETE /identity/v3/users/9632b1b483dd442f88e8898ef29eb257 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:03.816682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2f8dc-c6c9-42d9-9d77-6b3c9134ec3e service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:03.830285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2f8dc-c6c9-42d9-9d77-6b3c9134ec3e service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:03.990568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:03.991302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:03.991777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:03.992398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] PATH_INFO: `/v3/projects/8fa7bf422e16441498c97377ae1b7a85` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:03.999004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa7bf422e16441498c97377ae1b7a85)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:04.001840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:04.107719 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:04.113086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa7bf422e16441498c97377ae1b7a85', 'request_id': 'req-603116d2-01c2-42e2-bcdf-a38c7fc24c92'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.129008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa7bf422e16441498c97377ae1b7a85', 'request_id': 'req-603116d2-01c2-42e2-bcdf-a38c7fc24c92'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.146025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa7bf422e16441498c97377ae1b7a85', 'request_id': 'req-603116d2-01c2-42e2-bcdf-a38c7fc24c92'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.191004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] The token cache is being invalidate because project 8fa7bf422e16441498c97377ae1b7a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:04.191004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.193593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-603116d2-01c2-42e2-bcdf-a38c7fc24c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.196761 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1423/2825] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:03 2022] DELETE /identity/v3/projects/8fa7bf422e16441498c97377ae1b7a85 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:04.202123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:04.210956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:04.225503 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:04.239368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bdc03-3c02-4bd5-a57f-e129faade717 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:04.357653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:04.358538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:04.358943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:04.359219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] PATH_INFO: `/v3/users/34b19eb53fc54117ae00503af9d1b411` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:04.362170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b19eb53fc54117ae00503af9d1b411)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:04.364215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:04.467087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b19eb53fc54117ae00503af9d1b411'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.488554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b19eb53fc54117ae00503af9d1b411'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.489471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b19eb53fc54117ae00503af9d1b411'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.503891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b19eb53fc54117ae00503af9d1b411'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.520849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b19eb53fc54117ae00503af9d1b411'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:04.530873 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1403/2826] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:04 2022] DELETE /identity/v3/users/34b19eb53fc54117ae00503af9d1b411 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:05.129820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460c655-bdb0-4fe9-9b17-84237f82ff21 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:05.130332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460c655-bdb0-4fe9-9b17-84237f82ff21 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:05.130442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460c655-bdb0-4fe9-9b17-84237f82ff21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:05.167790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e460c655-bdb0-4fe9-9b17-84237f82ff21 None None] MFA Rules not processed for user `5d5e0832ad9f4cd8959259bd5251f3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:05.169126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e460c655-bdb0-4fe9-9b17-84237f82ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:05.253580 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1424/2827] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:05.265251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:05.266816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:05.399009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a121f-7e51-4308-867c-7158c0c88a8d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:05.405070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9439ab2-cfcc-486e-bb89-ae870556215d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:05.405788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9439ab2-cfcc-486e-bb89-ae870556215d service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:05.406317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9439ab2-cfcc-486e-bb89-ae870556215d service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:05.406691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9439ab2-cfcc-486e-bb89-ae870556215d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:05.409595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e9439ab2-cfcc-486e-bb89-ae870556215d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:05.428142 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:05.479992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9439ab2-cfcc-486e-bb89-ae870556215d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:05.481471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9439ab2-cfcc-486e-bb89-ae870556215d service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:05.493079 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1404/2828] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:05.985671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460c655-bdb0-4fe9-9b17-84237f82ff21 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:05.987160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e460c655-bdb0-4fe9-9b17-84237f82ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:06.109519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460c655-bdb0-4fe9-9b17-84237f82ff21 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.128210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.130256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.130858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.130858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] PATH_INFO: `/v3/projects/6171032b9ce640a9a8a216c9d8bcd374` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.133585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6171032b9ce640a9a8a216c9d8bcd374)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.138066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.231247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6171032b9ce640a9a8a216c9d8bcd374', 'request_id': 'req-8a850283-1bad-4810-a423-1c348b2c3502'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:06.241082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6171032b9ce640a9a8a216c9d8bcd374', 'request_id': 'req-8a850283-1bad-4810-a423-1c348b2c3502'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:06.251495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6171032b9ce640a9a8a216c9d8bcd374', 'request_id': 'req-8a850283-1bad-4810-a423-1c348b2c3502'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:06.254464 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:06.292068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] The token cache is being invalidate because project 6171032b9ce640a9a8a216c9d8bcd374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:06.293382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:06.295165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8a850283-1bad-4810-a423-1c348b2c3502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:06.298494 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1425/2829] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:05 2022] DELETE /identity/v3/projects/6171032b9ce640a9a8a216c9d8bcd374 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:06.303975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923616-2a47-4ccc-a141-da8b2e3870f4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.304494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923616-2a47-4ccc-a141-da8b2e3870f4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.304700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923616-2a47-4ccc-a141-da8b2e3870f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.337384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-85923616-2a47-4ccc-a141-da8b2e3870f4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:06.339706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-85923616-2a47-4ccc-a141-da8b2e3870f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:06.444847 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1405/2830] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:06:06.446282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c7f01-4663-43da-a3fc-edc8423bddcd None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.446557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c7f01-4663-43da-a3fc-edc8423bddcd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.446942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c7f01-4663-43da-a3fc-edc8423bddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.477100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d54c7f01-4663-43da-a3fc-edc8423bddcd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:06.480404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d54c7f01-4663-43da-a3fc-edc8423bddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:06.498659 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1426/2831] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:06.503772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85923616-2a47-4ccc-a141-da8b2e3870f4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.514816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85923616-2a47-4ccc-a141-da8b2e3870f4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.520683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1152699-de36-40c6-92b0-163c553e3872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.521300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152699-de36-40c6-92b0-163c553e3872 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.521576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152699-de36-40c6-92b0-163c553e3872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.521846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152699-de36-40c6-92b0-163c553e3872 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.522499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1152699-de36-40c6-92b0-163c553e3872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:06:06.523168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1152699-de36-40c6-92b0-163c553e3872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.524936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1152699-de36-40c6-92b0-163c553e3872 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.540388 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1406/2832] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:06:06.548367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c7f01-4663-43da-a3fc-edc8423bddcd None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.560881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c7f01-4663-43da-a3fc-edc8423bddcd None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.568230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa3767-d47a-48ee-9d50-146f80003889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.569165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa3767-d47a-48ee-9d50-146f80003889 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.569641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa3767-d47a-48ee-9d50-146f80003889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.570108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa3767-d47a-48ee-9d50-146f80003889 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.571086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa3767-d47a-48ee-9d50-146f80003889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.573269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa3767-d47a-48ee-9d50-146f80003889 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.629844 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1427/2833] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:06 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:06.633034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1152699-de36-40c6-92b0-163c553e3872 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.646153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa3767-d47a-48ee-9d50-146f80003889 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.654522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-83aa3767-d47a-48ee-9d50-146f80003889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:06.662315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1152699-de36-40c6-92b0-163c553e3872 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.762377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf378c93-38ed-4948-98cb-03fde836ed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.764247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378c93-38ed-4948-98cb-03fde836ed15 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.764533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378c93-38ed-4948-98cb-03fde836ed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.766335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378c93-38ed-4948-98cb-03fde836ed15 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.768090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf378c93-38ed-4948-98cb-03fde836ed15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.771461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf378c93-38ed-4948-98cb-03fde836ed15 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.791422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa3767-d47a-48ee-9d50-146f80003889 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.818090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0869037-7afe-4b6d-a363-e892837b6d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.820100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0869037-7afe-4b6d-a363-e892837b6d29 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.821240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0869037-7afe-4b6d-a363-e892837b6d29 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.821980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0869037-7afe-4b6d-a363-e892837b6d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.826220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c0869037-7afe-4b6d-a363-e892837b6d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:06.829626 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1407/2834] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:06 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:06.833391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf378c93-38ed-4948-98cb-03fde836ed15 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.847176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0869037-7afe-4b6d-a363-e892837b6d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.847587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf378c93-38ed-4948-98cb-03fde836ed15 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.850532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0869037-7afe-4b6d-a363-e892837b6d29 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.855795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c6c72-770e-4e4e-8d13-eb99c8ba7d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.856901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c6c72-770e-4e4e-8d13-eb99c8ba7d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.857537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c6c72-770e-4e4e-8d13-eb99c8ba7d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.858084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c6c72-770e-4e4e-8d13-eb99c8ba7d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.859955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c6c72-770e-4e4e-8d13-eb99c8ba7d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.861964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c6c72-770e-4e4e-8d13-eb99c8ba7d9c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.865150 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1428/2835] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:06.881603 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1408/2836] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:06.881820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0869037-7afe-4b6d-a363-e892837b6d29 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.893161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0869037-7afe-4b6d-a363-e892837b6d29 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.899068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1dcfe-0a48-473b-9744-9e0ca445d41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.899691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1dcfe-0a48-473b-9744-9e0ca445d41a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.899969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1dcfe-0a48-473b-9744-9e0ca445d41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.900239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1dcfe-0a48-473b-9744-9e0ca445d41a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.901045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1dcfe-0a48-473b-9744-9e0ca445d41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.902841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1dcfe-0a48-473b-9744-9e0ca445d41a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:06.918977 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1429/2837] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:06.920651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c6c72-770e-4e4e-8d13-eb99c8ba7d9c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:06.937244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c6c72-770e-4e4e-8d13-eb99c8ba7d9c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:06.947042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02075a48-5cdd-47a2-932e-8950bad51794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:06.947838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02075a48-5cdd-47a2-932e-8950bad51794 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:06.948296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02075a48-5cdd-47a2-932e-8950bad51794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:06.948726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02075a48-5cdd-47a2-932e-8950bad51794 admin admin] PATH_INFO: `/v3/projects/171d6e6675244130be822a3a69c6fe2e/users/a0d9202ae84a4b5d90d136dcc0046695/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:06.988084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02075a48-5cdd-47a2-932e-8950bad51794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=171d6e6675244130be822a3a69c6fe2e, user_id=a0d9202ae84a4b5d90d136dcc0046695, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:06.992298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02075a48-5cdd-47a2-932e-8950bad51794 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:07.012842 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:07.028961 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1409/2838] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:06 2022] PUT /identity/v3/projects/171d6e6675244130be822a3a69c6fe2e/users/a0d9202ae84a4b5d90d136dcc0046695/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:07.029929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757aced-2d35-462f-bfea-01abad2644b1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:07.030223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757aced-2d35-462f-bfea-01abad2644b1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:07.030678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757aced-2d35-462f-bfea-01abad2644b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:07.064681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a757aced-2d35-462f-bfea-01abad2644b1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:07.065943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a757aced-2d35-462f-bfea-01abad2644b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:07.155468 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1430/2839] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:06:07.165363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02075a48-5cdd-47a2-932e-8950bad51794 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:07.167193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-02075a48-5cdd-47a2-932e-8950bad51794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:07.267570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02075a48-5cdd-47a2-932e-8950bad51794 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:07.278999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f27831-7480-4ea4-868a-b1d77eb6423c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:07.279828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f27831-7480-4ea4-868a-b1d77eb6423c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:07.280248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f27831-7480-4ea4-868a-b1d77eb6423c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:07.281176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f27831-7480-4ea4-868a-b1d77eb6423c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:07.297867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f27831-7480-4ea4-868a-b1d77eb6423c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:07.300152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f27831-7480-4ea4-868a-b1d77eb6423c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:07.315675 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1410/2840] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:11.769744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757aced-2d35-462f-bfea-01abad2644b1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:11.773126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a757aced-2d35-462f-bfea-01abad2644b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:11.802091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757aced-2d35-462f-bfea-01abad2644b1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:11.813247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:11.814489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:11.815724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:11.816100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] PATH_INFO: `/v3/users/30185488a8864d5abae55abd94a7322e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:11.818374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30185488a8864d5abae55abd94a7322e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:11.826712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:11.930185 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:DELETE=6,keystone:SELECT=92 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:11.972278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30185488a8864d5abae55abd94a7322e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:11.997488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30185488a8864d5abae55abd94a7322e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:11.998367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30185488a8864d5abae55abd94a7322e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:12.014241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30185488a8864d5abae55abd94a7322e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:12.015014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30185488a8864d5abae55abd94a7322e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:12.043648 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1431/2841] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:11 2022] DELETE /identity/v3/users/30185488a8864d5abae55abd94a7322e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:12.049470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a43a1-55d3-4dd2-83ea-9d594c2b2dd0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:12.049929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a43a1-55d3-4dd2-83ea-9d594c2b2dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:12.050305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a43a1-55d3-4dd2-83ea-9d594c2b2dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:12.075271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-382a43a1-55d3-4dd2-83ea-9d594c2b2dd0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:12.080772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-382a43a1-55d3-4dd2-83ea-9d594c2b2dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:12.169382 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1411/2842] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:12.210700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:12.213104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:12.372582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02abc1-fed6-4489-89fe-d55c9177b469 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:12.378685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982744cc-8092-4e54-9e3c-82d4cd7aa438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:12.379953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982744cc-8092-4e54-9e3c-82d4cd7aa438 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:12.380480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982744cc-8092-4e54-9e3c-82d4cd7aa438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:12.381815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982744cc-8092-4e54-9e3c-82d4cd7aa438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:12.395077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982744cc-8092-4e54-9e3c-82d4cd7aa438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:12.397684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982744cc-8092-4e54-9e3c-82d4cd7aa438 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:12.425528 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1432/2843] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:13.407594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086f997-4565-431a-b1bc-709fa9e9497d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:13.408169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086f997-4565-431a-b1bc-709fa9e9497d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:13.408169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086f997-4565-431a-b1bc-709fa9e9497d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:13.454954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9086f997-4565-431a-b1bc-709fa9e9497d None None] MFA Rules not processed for user `c076d9dc75a7400f87b480d2b18dcc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:13.456806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9086f997-4565-431a-b1bc-709fa9e9497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:13.567915 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1412/2844] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:13.665948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982744cc-8092-4e54-9e3c-82d4cd7aa438 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:13.668418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-982744cc-8092-4e54-9e3c-82d4cd7aa438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:13.694962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982744cc-8092-4e54-9e3c-82d4cd7aa438 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:13.703846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:13.709465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:13.709623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:13.709853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] PATH_INFO: `/v3/projects/73b489bd5bcd454da7e49c89f35f711f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:13.713073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b489bd5bcd454da7e49c89f35f711f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:13.721884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:13.859290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b489bd5bcd454da7e49c89f35f711f', 'request_id': 'req-25fef01c-24bf-4ed5-a2b4-299209bd663b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:13.866275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b489bd5bcd454da7e49c89f35f711f', 'request_id': 'req-25fef01c-24bf-4ed5-a2b4-299209bd663b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:13.873407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b489bd5bcd454da7e49c89f35f711f', 'request_id': 'req-25fef01c-24bf-4ed5-a2b4-299209bd663b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:13.908326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] The token cache is being invalidate because project 73b489bd5bcd454da7e49c89f35f711f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:13.908639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:13.911148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25fef01c-24bf-4ed5-a2b4-299209bd663b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:13.918382 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1433/2845] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:13 2022] DELETE /identity/v3/projects/73b489bd5bcd454da7e49c89f35f711f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:13.919420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe17a6-13c4-47cb-b170-72893d1e3643 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:13.919702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe17a6-13c4-47cb-b170-72893d1e3643 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:13.919977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe17a6-13c4-47cb-b170-72893d1e3643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:13.989791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f5fe17a6-13c4-47cb-b170-72893d1e3643 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:13.991049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f5fe17a6-13c4-47cb-b170-72893d1e3643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:14.133423 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:14.184595 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1413/2846] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:06:14.194190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9f56-54a5-43bc-93a4-d7b121979297 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:14.194476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9f56-54a5-43bc-93a4-d7b121979297 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:14.194779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9f56-54a5-43bc-93a4-d7b121979297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:14.225682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4bdf9f56-54a5-43bc-93a4-d7b121979297 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:14.227424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4bdf9f56-54a5-43bc-93a4-d7b121979297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:14.239894 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1434/2847] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:14.244097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe17a6-13c4-47cb-b170-72893d1e3643 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:14.276358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe17a6-13c4-47cb-b170-72893d1e3643 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:14.284901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe139e-0f32-4032-af38-c2aa2fd60c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:14.287880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe139e-0f32-4032-af38-c2aa2fd60c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:14.288464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe139e-0f32-4032-af38-c2aa2fd60c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:14.288919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe139e-0f32-4032-af38-c2aa2fd60c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:14.290068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe139e-0f32-4032-af38-c2aa2fd60c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:06:14.290520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe139e-0f32-4032-af38-c2aa2fd60c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:14.292346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe139e-0f32-4032-af38-c2aa2fd60c13 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:14.313043 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1414/2848] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:06:14.317029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf9f56-54a5-43bc-93a4-d7b121979297 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:14.345538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf9f56-54a5-43bc-93a4-d7b121979297 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:14.361079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54332fd3-69b1-4390-a11f-8b0a203638c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:14.361990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332fd3-69b1-4390-a11f-8b0a203638c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:14.362437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332fd3-69b1-4390-a11f-8b0a203638c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:14.362774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332fd3-69b1-4390-a11f-8b0a203638c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:14.363402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54332fd3-69b1-4390-a11f-8b0a203638c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:14.365850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54332fd3-69b1-4390-a11f-8b0a203638c8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:14.429765 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1435/2849] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:14 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:14.433846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe139e-0f32-4032-af38-c2aa2fd60c13 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:14.448462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe139e-0f32-4032-af38-c2aa2fd60c13 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:14.578902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9cb4a-669b-4058-ac6b-ec8ab229770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:14.579612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9cb4a-669b-4058-ac6b-ec8ab229770b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:14.579962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9cb4a-669b-4058-ac6b-ec8ab229770b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:14.580791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9cb4a-669b-4058-ac6b-ec8ab229770b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:14.581917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9cb4a-669b-4058-ac6b-ec8ab229770b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:14.592061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9cb4a-669b-4058-ac6b-ec8ab229770b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:14.668156 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1415/2850] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:14 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:14.669441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54332fd3-69b1-4390-a11f-8b0a203638c8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:14.682322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54332fd3-69b1-4390-a11f-8b0a203638c8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:14.709532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d58427-cdf0-451e-b522-76b21b8a5edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:14.710244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d58427-cdf0-451e-b522-76b21b8a5edf admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:14.710666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d58427-cdf0-451e-b522-76b21b8a5edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:14.710988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d58427-cdf0-451e-b522-76b21b8a5edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:14.711966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d58427-cdf0-451e-b522-76b21b8a5edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:14.713911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d58427-cdf0-451e-b522-76b21b8a5edf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:14.716330 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:14.739181 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1436/2851] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:14.743066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9cb4a-669b-4058-ac6b-ec8ab229770b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:14.761892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9cb4a-669b-4058-ac6b-ec8ab229770b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:14.782800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61045312-f28e-4786-95dc-3c8b4a18f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:14.783963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045312-f28e-4786-95dc-3c8b4a18f393 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:14.784255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045312-f28e-4786-95dc-3c8b4a18f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:14.784535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045312-f28e-4786-95dc-3c8b4a18f393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:14.785201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61045312-f28e-4786-95dc-3c8b4a18f393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:14.788363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61045312-f28e-4786-95dc-3c8b4a18f393 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:14.822307 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1416/2852] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:14.823714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d58427-cdf0-451e-b522-76b21b8a5edf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:14.837593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d58427-cdf0-451e-b522-76b21b8a5edf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:14.853082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98e7d3-8280-457f-b707-85e1acf1e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:14.854018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e7d3-8280-457f-b707-85e1acf1e3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:14.854446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e7d3-8280-457f-b707-85e1acf1e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:14.854946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e7d3-8280-457f-b707-85e1acf1e3d2 admin admin] PATH_INFO: `/v3/projects/7607431e4506494bb3a9060bd3d168e9/users/cdcd84fe261f41a89278587ca4432474/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:14.895480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98e7d3-8280-457f-b707-85e1acf1e3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7607431e4506494bb3a9060bd3d168e9, user_id=cdcd84fe261f41a89278587ca4432474, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:14.899520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98e7d3-8280-457f-b707-85e1acf1e3d2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:14.944700 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1437/2853] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:14 2022] PUT /identity/v3/projects/7607431e4506494bb3a9060bd3d168e9/users/cdcd84fe261f41a89278587ca4432474/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:06:14.946520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd300fb1-2e45-4162-803b-1499560f717a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:14.947211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd300fb1-2e45-4162-803b-1499560f717a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:14.947472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd300fb1-2e45-4162-803b-1499560f717a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:15.025037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bd300fb1-2e45-4162-803b-1499560f717a None None] MFA Rules not processed for user `cdcd84fe261f41a89278587ca4432474`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:15.035960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bd300fb1-2e45-4162-803b-1499560f717a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:15.247660 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1417/2854] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:16.548161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98e7d3-8280-457f-b707-85e1acf1e3d2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:16.554090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8d98e7d3-8280-457f-b707-85e1acf1e3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:16.791901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98e7d3-8280-457f-b707-85e1acf1e3d2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:16.823954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803f0a1-3208-4f9c-a289-f3208fb4d497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:16.824583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803f0a1-3208-4f9c-a289-f3208fb4d497 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:16.829140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803f0a1-3208-4f9c-a289-f3208fb4d497 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:16.829643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803f0a1-3208-4f9c-a289-f3208fb4d497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:16.884707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803f0a1-3208-4f9c-a289-f3208fb4d497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:16.886330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803f0a1-3208-4f9c-a289-f3208fb4d497 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:16.923709 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1438/2855] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:17.005596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd300fb1-2e45-4162-803b-1499560f717a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:17.007865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bd300fb1-2e45-4162-803b-1499560f717a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:17.187259 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:17.204223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd300fb1-2e45-4162-803b-1499560f717a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:17.208210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd192-6f40-426c-ad63-b4da2402ad64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:17.209091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd192-6f40-426c-ad63-b4da2402ad64 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:17.209383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd192-6f40-426c-ad63-b4da2402ad64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:17.209664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd192-6f40-426c-ad63-b4da2402ad64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:17.211771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-98ecd192-6f40-426c-ad63-b4da2402ad64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:17.225733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecd192-6f40-426c-ad63-b4da2402ad64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:17.227552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecd192-6f40-426c-ad63-b4da2402ad64 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:17.240290 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1418/2856] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:17.480454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493138a-a190-4066-a9e8-ae36234ef3ff None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:17.481002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493138a-a190-4066-a9e8-ae36234ef3ff None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:17.482046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493138a-a190-4066-a9e8-ae36234ef3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:17.525054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7493138a-a190-4066-a9e8-ae36234ef3ff None None] MFA Rules not processed for user `a0d9202ae84a4b5d90d136dcc0046695`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:17.527029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7493138a-a190-4066-a9e8-ae36234ef3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:17.681516 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1439/2857] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:18.072845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd192-6f40-426c-ad63-b4da2402ad64 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:18.074310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-98ecd192-6f40-426c-ad63-b4da2402ad64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:18.108258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd192-6f40-426c-ad63-b4da2402ad64 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:18.115685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9261f83-ed8a-4052-b446-c969572df0c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:18.117774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9261f83-ed8a-4052-b446-c969572df0c4 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:18.118471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9261f83-ed8a-4052-b446-c969572df0c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:18.118929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9261f83-ed8a-4052-b446-c969572df0c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:18.130292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9261f83-ed8a-4052-b446-c969572df0c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:18.132504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9261f83-ed8a-4052-b446-c969572df0c4 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:18.145634 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1419/2858] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:23.116874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493138a-a190-4066-a9e8-ae36234ef3ff None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:23.237192 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:23.283083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493138a-a190-4066-a9e8-ae36234ef3ff None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:23.296407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:23.299769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:23.300677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:23.301481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] PATH_INFO: `/v3/users/cdcd84fe261f41a89278587ca4432474` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:23.321988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdcd84fe261f41a89278587ca4432474)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:23.326623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:23.467770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdcd84fe261f41a89278587ca4432474'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:23.495323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdcd84fe261f41a89278587ca4432474'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:23.497322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdcd84fe261f41a89278587ca4432474'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:23.514661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdcd84fe261f41a89278587ca4432474'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:23.515608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdcd84fe261f41a89278587ca4432474'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:23.548667 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1440/2859] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:23 2022] DELETE /identity/v3/users/cdcd84fe261f41a89278587ca4432474 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:23.549487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86abfd0-f142-4428-a15a-e84e06db1208 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:23.549986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86abfd0-f142-4428-a15a-e84e06db1208 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:23.550089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86abfd0-f142-4428-a15a-e84e06db1208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:23.611196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b86abfd0-f142-4428-a15a-e84e06db1208 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:23.612443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b86abfd0-f142-4428-a15a-e84e06db1208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:23.745559 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1420/2860] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:06:23.758054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:23.760964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:23.917723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ef85e-f8bb-4067-8d5c-780de5c3a629 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:23.927514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e17bc-29f3-46d7-951f-9e37c7901c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:23.928239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e17bc-29f3-46d7-951f-9e37c7901c0b service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:23.928521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e17bc-29f3-46d7-951f-9e37c7901c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:23.928796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e17bc-29f3-46d7-951f-9e37c7901c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:23.954790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e17bc-29f3-46d7-951f-9e37c7901c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:23.956719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e17bc-29f3-46d7-951f-9e37c7901c0b service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:23.991424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1441/2861] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:24.533444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86abfd0-f142-4428-a15a-e84e06db1208 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:24.535154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b86abfd0-f142-4428-a15a-e84e06db1208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:24.567483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86abfd0-f142-4428-a15a-e84e06db1208 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:24.581226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:24.581911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:24.582354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:24.582710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] PATH_INFO: `/v3/projects/7607431e4506494bb3a9060bd3d168e9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:24.584197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7607431e4506494bb3a9060bd3d168e9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:24.586621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:24.694435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7607431e4506494bb3a9060bd3d168e9', 'request_id': 'req-d9589bd6-37f1-4e76-909d-1f76b17ba33c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:24.702980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7607431e4506494bb3a9060bd3d168e9', 'request_id': 'req-d9589bd6-37f1-4e76-909d-1f76b17ba33c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:24.732955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7607431e4506494bb3a9060bd3d168e9', 'request_id': 'req-d9589bd6-37f1-4e76-909d-1f76b17ba33c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:24.776184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] The token cache is being invalidate because project 7607431e4506494bb3a9060bd3d168e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:24.776510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:24.777926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9589bd6-37f1-4e76-909d-1f76b17ba33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:24.780850 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1421/2862] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:24 2022] DELETE /identity/v3/projects/7607431e4506494bb3a9060bd3d168e9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:24.785763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a170-0216-48f5-b77a-7a3e0a2ec6bb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:24.786284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a170-0216-48f5-b77a-7a3e0a2ec6bb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:24.786284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a170-0216-48f5-b77a-7a3e0a2ec6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:24.844976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6f21a170-0216-48f5-b77a-7a3e0a2ec6bb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:24.846239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6f21a170-0216-48f5-b77a-7a3e0a2ec6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:25.015616 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1442/2863] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:25.019493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355287-c300-4d1f-b17b-cf79a614c3b4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:25.019779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355287-c300-4d1f-b17b-cf79a614c3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:25.020054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355287-c300-4d1f-b17b-cf79a614c3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:25.066737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-46355287-c300-4d1f-b17b-cf79a614c3b4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:25.068121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-46355287-c300-4d1f-b17b-cf79a614c3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:25.092721 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1422/2864] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:25.096129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21a170-0216-48f5-b77a-7a3e0a2ec6bb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:25.116987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21a170-0216-48f5-b77a-7a3e0a2ec6bb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:25.127388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcee1e-4090-464d-a051-eb3f62e1250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:25.127729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcee1e-4090-464d-a051-eb3f62e1250b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:25.128254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcee1e-4090-464d-a051-eb3f62e1250b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:25.128254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcee1e-4090-464d-a051-eb3f62e1250b admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:25.129097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcee1e-4090-464d-a051-eb3f62e1250b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:06:25.129290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcee1e-4090-464d-a051-eb3f62e1250b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:25.130886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcee1e-4090-464d-a051-eb3f62e1250b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:25.145824 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:25.172669 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1443/2865] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:06:25.173104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46355287-c300-4d1f-b17b-cf79a614c3b4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:25.205411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46355287-c300-4d1f-b17b-cf79a614c3b4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:25.224939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3472d0-22a8-41b4-be76-a9614319513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:25.226071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3472d0-22a8-41b4-be76-a9614319513f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:25.226756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3472d0-22a8-41b4-be76-a9614319513f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:25.227226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3472d0-22a8-41b4-be76-a9614319513f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:25.228321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3472d0-22a8-41b4-be76-a9614319513f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:25.238201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3472d0-22a8-41b4-be76-a9614319513f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:25.306219 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1423/2866] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:25 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:25.310838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcee1e-4090-464d-a051-eb3f62e1250b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:25.326438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcee1e-4090-464d-a051-eb3f62e1250b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:25.416608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32111e43-c5ae-4529-8897-fed60f30ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:25.417388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32111e43-c5ae-4529-8897-fed60f30ba66 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:25.417768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32111e43-c5ae-4529-8897-fed60f30ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:25.418194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32111e43-c5ae-4529-8897-fed60f30ba66 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:25.418965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32111e43-c5ae-4529-8897-fed60f30ba66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:25.421609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32111e43-c5ae-4529-8897-fed60f30ba66 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:25.464370 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1444/2867] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:25 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:25.469072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3472d0-22a8-41b4-be76-a9614319513f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:25.489009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3472d0-22a8-41b4-be76-a9614319513f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:25.494069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47091068-3dae-4b4b-b0ce-53d29cf2a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:25.494729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47091068-3dae-4b4b-b0ce-53d29cf2a3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:25.495008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47091068-3dae-4b4b-b0ce-53d29cf2a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:25.495279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47091068-3dae-4b4b-b0ce-53d29cf2a3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:25.495932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47091068-3dae-4b4b-b0ce-53d29cf2a3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:25.497529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47091068-3dae-4b4b-b0ce-53d29cf2a3d3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:25.513883 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1424/2868] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:25.515977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32111e43-c5ae-4529-8897-fed60f30ba66 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:25.529838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32111e43-c5ae-4529-8897-fed60f30ba66 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:25.544117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbca876-0e2b-4bf3-b532-ff507d8cd5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:25.544793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbca876-0e2b-4bf3-b532-ff507d8cd5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:25.545010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbca876-0e2b-4bf3-b532-ff507d8cd5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:25.545386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbca876-0e2b-4bf3-b532-ff507d8cd5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:25.546787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbca876-0e2b-4bf3-b532-ff507d8cd5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:25.548705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbca876-0e2b-4bf3-b532-ff507d8cd5d3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:25.573212 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1445/2869] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:06:25.579556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47091068-3dae-4b4b-b0ce-53d29cf2a3d3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:25.601859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47091068-3dae-4b4b-b0ce-53d29cf2a3d3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:25.607270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ea2bb-b6ea-479e-9e47-6b185cef57d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:25.608245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea2bb-b6ea-479e-9e47-6b185cef57d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:25.608810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea2bb-b6ea-479e-9e47-6b185cef57d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:25.609281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea2bb-b6ea-479e-9e47-6b185cef57d3 admin admin] PATH_INFO: `/v3/projects/623198b17e814ea3be67bc7ef7ef3573/users/43e29b47ea5a4003be7398acbd7c78d9/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:25.623889 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:25.628823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ea2bb-b6ea-479e-9e47-6b185cef57d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623198b17e814ea3be67bc7ef7ef3573, user_id=43e29b47ea5a4003be7398acbd7c78d9, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:25.633626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ea2bb-b6ea-479e-9e47-6b185cef57d3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:25.669196 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1425/2870] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:25 2022] PUT /identity/v3/projects/623198b17e814ea3be67bc7ef7ef3573/users/43e29b47ea5a4003be7398acbd7c78d9/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:25.669625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acdb4a-6f48-49d1-8b3a-e44939ab56de None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:25.669625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acdb4a-6f48-49d1-8b3a-e44939ab56de None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:25.669625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acdb4a-6f48-49d1-8b3a-e44939ab56de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:25.704343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-32acdb4a-6f48-49d1-8b3a-e44939ab56de None None] MFA Rules not processed for user `43e29b47ea5a4003be7398acbd7c78d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:25.706102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-32acdb4a-6f48-49d1-8b3a-e44939ab56de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:25.865454 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1446/2871] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:06:26.600582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ea2bb-b6ea-479e-9e47-6b185cef57d3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:26.603403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b5ea2bb-b6ea-479e-9e47-6b185cef57d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:26.753973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ea2bb-b6ea-479e-9e47-6b185cef57d3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:26.763942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f920a-4111-4632-ab69-8eda05d35ad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:26.765163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f920a-4111-4632-ab69-8eda05d35ad9 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:26.765490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f920a-4111-4632-ab69-8eda05d35ad9 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:26.765945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f920a-4111-4632-ab69-8eda05d35ad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:26.781162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f920a-4111-4632-ab69-8eda05d35ad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:26.785469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f920a-4111-4632-ab69-8eda05d35ad9 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:26.798458 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1426/2872] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:26.896057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acdb4a-6f48-49d1-8b3a-e44939ab56de None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:27.001849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acdb4a-6f48-49d1-8b3a-e44939ab56de None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:27.007226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:27.007937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:27.008476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:27.008815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] PATH_INFO: `/v3/users/43e29b47ea5a4003be7398acbd7c78d9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:27.010751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e29b47ea5a4003be7398acbd7c78d9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:27.012901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:27.018119 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:27.082839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e29b47ea5a4003be7398acbd7c78d9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:27.101860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e29b47ea5a4003be7398acbd7c78d9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:27.102984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e29b47ea5a4003be7398acbd7c78d9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:27.116436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e29b47ea5a4003be7398acbd7c78d9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:27.117182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e29b47ea5a4003be7398acbd7c78d9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:27.140743 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1447/2873] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:26 2022] DELETE /identity/v3/users/43e29b47ea5a4003be7398acbd7c78d9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:27.144751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8cc0a-ce18-4fc3-9f95-9b70400992de None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:27.145035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8cc0a-ce18-4fc3-9f95-9b70400992de None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:27.145298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8cc0a-ce18-4fc3-9f95-9b70400992de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:27.176540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-71c8cc0a-ce18-4fc3-9f95-9b70400992de None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:27.179437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-71c8cc0a-ce18-4fc3-9f95-9b70400992de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:27.264262 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1427/2874] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:27.275560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:27.277512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:27.354631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d534a7-2538-4e7a-98b9-6f976fce3bc9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:27.360281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f08706-f25a-4853-8614-555d21ebd8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:27.360935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08706-f25a-4853-8614-555d21ebd8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:27.360935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08706-f25a-4853-8614-555d21ebd8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:27.361497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08706-f25a-4853-8614-555d21ebd8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:27.372961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f08706-f25a-4853-8614-555d21ebd8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:27.375646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f08706-f25a-4853-8614-555d21ebd8b7 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:27.387932 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1448/2875] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:27.509007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1442cf-bd31-4912-a7ca-9677f5990ef8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:27.509292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1442cf-bd31-4912-a7ca-9677f5990ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:27.509571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1442cf-bd31-4912-a7ca-9677f5990ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:27.536559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7f1442cf-bd31-4912-a7ca-9677f5990ef8 None None] MFA Rules not processed for user `6da1976f703f402788953f3332a281de`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:27.537813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7f1442cf-bd31-4912-a7ca-9677f5990ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:27.644170 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1428/2876] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:27.998088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f08706-f25a-4853-8614-555d21ebd8b7 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:28.000268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d4f08706-f25a-4853-8614-555d21ebd8b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:28.021763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f08706-f25a-4853-8614-555d21ebd8b7 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:28.036946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:28.037821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:28.038255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:28.038750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] PATH_INFO: `/v3/projects/623198b17e814ea3be67bc7ef7ef3573` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:28.041368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623198b17e814ea3be67bc7ef7ef3573)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:28.048741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:28.155029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623198b17e814ea3be67bc7ef7ef3573', 'request_id': 'req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:28.171165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623198b17e814ea3be67bc7ef7ef3573', 'request_id': 'req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:28.197920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623198b17e814ea3be67bc7ef7ef3573', 'request_id': 'req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:28.237442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] The token cache is being invalidate because project 623198b17e814ea3be67bc7ef7ef3573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:28.237935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:28.246251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e5eaf68-19d8-4eaa-ac03-43f6dc31b2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:28.252355 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1449/2877] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:27 2022] DELETE /identity/v3/projects/623198b17e814ea3be67bc7ef7ef3573 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:28.259191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a653e3-787a-4a1b-8a16-2f305ec2c313 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:28.264611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a653e3-787a-4a1b-8a16-2f305ec2c313 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:28.265272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a653e3-787a-4a1b-8a16-2f305ec2c313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:28.372106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-31a653e3-787a-4a1b-8a16-2f305ec2c313 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:28.373368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31a653e3-787a-4a1b-8a16-2f305ec2c313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:28.413800 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:28.541932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090771-dcff-4f20-8b2f-393301f6ab57 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:28.542225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090771-dcff-4f20-8b2f-393301f6ab57 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:28.542503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090771-dcff-4f20-8b2f-393301f6ab57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:28.545411 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1429/2878] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:28.578715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-11090771-dcff-4f20-8b2f-393301f6ab57 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:28.580092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-11090771-dcff-4f20-8b2f-393301f6ab57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:28.609163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a653e3-787a-4a1b-8a16-2f305ec2c313 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:28.618978 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1450/2879] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:28.642389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a653e3-787a-4a1b-8a16-2f305ec2c313 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:28.657103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733966e-0106-4406-ab8b-efe49fcd462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:28.658576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733966e-0106-4406-ab8b-efe49fcd462d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:28.659269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733966e-0106-4406-ab8b-efe49fcd462d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:28.659721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733966e-0106-4406-ab8b-efe49fcd462d admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:28.660705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733966e-0106-4406-ab8b-efe49fcd462d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:06:28.663126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733966e-0106-4406-ab8b-efe49fcd462d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:28.668215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733966e-0106-4406-ab8b-efe49fcd462d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:28.697881 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1430/2880] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:06:28.702951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11090771-dcff-4f20-8b2f-393301f6ab57 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:28.708107 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:28.716644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11090771-dcff-4f20-8b2f-393301f6ab57 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:28.725117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2779b7f-ea57-4c2c-95c0-d00558f50915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:28.725967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779b7f-ea57-4c2c-95c0-d00558f50915 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:28.726536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779b7f-ea57-4c2c-95c0-d00558f50915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:28.727017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779b7f-ea57-4c2c-95c0-d00558f50915 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:28.727822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2779b7f-ea57-4c2c-95c0-d00558f50915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:28.730315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2779b7f-ea57-4c2c-95c0-d00558f50915 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:28.782407 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1451/2881] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:28 2022] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:28.787319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733966e-0106-4406-ab8b-efe49fcd462d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:28.799891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733966e-0106-4406-ab8b-efe49fcd462d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:28.983880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1263f0a-ffc4-4fc7-a427-a3ba5c87ddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:28.985316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1263f0a-ffc4-4fc7-a427-a3ba5c87ddd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:28.988744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1263f0a-ffc4-4fc7-a427-a3ba5c87ddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:28.991626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1263f0a-ffc4-4fc7-a427-a3ba5c87ddd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:28.993164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1263f0a-ffc4-4fc7-a427-a3ba5c87ddd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:28.996464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1263f0a-ffc4-4fc7-a427-a3ba5c87ddd3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:29.053164 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1431/2882] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:28 2022] POST /identity/v3/users => generated 295 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:29.057869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2779b7f-ea57-4c2c-95c0-d00558f50915 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:29.085410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2779b7f-ea57-4c2c-95c0-d00558f50915 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:29.108035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8a8d6-c032-4557-af97-8095cef475a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:29.110635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8a8d6-c032-4557-af97-8095cef475a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:29.111637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8a8d6-c032-4557-af97-8095cef475a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:29.113154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8a8d6-c032-4557-af97-8095cef475a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:29.113992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8a8d6-c032-4557-af97-8095cef475a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:29.120739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8a8d6-c032-4557-af97-8095cef475a4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:29.158900 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1452/2883] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:29.159638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1263f0a-ffc4-4fc7-a427-a3ba5c87ddd3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:29.174529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1263f0a-ffc4-4fc7-a427-a3ba5c87ddd3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:29.188801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27895e02-9cf3-477a-9262-4d876d3b67ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:29.189785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895e02-9cf3-477a-9262-4d876d3b67ba admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:29.190310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895e02-9cf3-477a-9262-4d876d3b67ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:29.190871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895e02-9cf3-477a-9262-4d876d3b67ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:29.191869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27895e02-9cf3-477a-9262-4d876d3b67ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:29.197391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27895e02-9cf3-477a-9262-4d876d3b67ba admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:29.257894 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1432/2884] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:29.258129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8a8d6-c032-4557-af97-8095cef475a4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:29.270210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8a8d6-c032-4557-af97-8095cef475a4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:29.285565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0035b7-81d2-4946-975d-6865ddaf7fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:29.286235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0035b7-81d2-4946-975d-6865ddaf7fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:29.286800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0035b7-81d2-4946-975d-6865ddaf7fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:29.287242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0035b7-81d2-4946-975d-6865ddaf7fe3 admin admin] PATH_INFO: `/v3/projects/2de604b2fe4141ddab1c3bd993ee32a7/users/56797e6a3e434d4b816fde3bd2ff0d59/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:29.321250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0035b7-81d2-4946-975d-6865ddaf7fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de604b2fe4141ddab1c3bd993ee32a7, user_id=56797e6a3e434d4b816fde3bd2ff0d59, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:29.324404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0035b7-81d2-4946-975d-6865ddaf7fe3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:29.360040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0524-f9a9-4c28-9afb-021f991b9293 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:29.360698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0524-f9a9-4c28-9afb-021f991b9293 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:29.361029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0524-f9a9-4c28-9afb-021f991b9293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:29.364597 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1453/2885] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:29 2022] PUT /identity/v3/projects/2de604b2fe4141ddab1c3bd993ee32a7/users/56797e6a3e434d4b816fde3bd2ff0d59/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:29.386993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2e9e0524-f9a9-4c28-9afb-021f991b9293 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:29.389768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2e9e0524-f9a9-4c28-9afb-021f991b9293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:29.478747 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1433/2886] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:29.487291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0035b7-81d2-4946-975d-6865ddaf7fe3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:29.489065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0d0035b7-81d2-4946-975d-6865ddaf7fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:29.608632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0035b7-81d2-4946-975d-6865ddaf7fe3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:29.613726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888fbb4-74f1-449e-bf62-532377d8e4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:29.614735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888fbb4-74f1-449e-bf62-532377d8e4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:29.615141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888fbb4-74f1-449e-bf62-532377d8e4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:29.615429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888fbb4-74f1-449e-bf62-532377d8e4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:29.627912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888fbb4-74f1-449e-bf62-532377d8e4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:29.629659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888fbb4-74f1-449e-bf62-532377d8e4e0 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:29.644449 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1454/2887] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:32.933992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65941c7-8023-4867-9d1f-8b36b43aab5c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:32.933992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65941c7-8023-4867-9d1f-8b36b43aab5c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:32.933992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65941c7-8023-4867-9d1f-8b36b43aab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:32.993310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a65941c7-8023-4867-9d1f-8b36b43aab5c None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:33.000246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a65941c7-8023-4867-9d1f-8b36b43aab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:33.071006 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:33.156811 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1434/2888] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:33.165652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888fbb4-74f1-449e-bf62-532377d8e4e0 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:33.168270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a888fbb4-74f1-449e-bf62-532377d8e4e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:33.461977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888fbb4-74f1-449e-bf62-532377d8e4e0 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:33.485914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866748a2-2c45-42fa-9d6e-f6ad6d4b2de4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:33.486825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866748a2-2c45-42fa-9d6e-f6ad6d4b2de4 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:33.487151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866748a2-2c45-42fa-9d6e-f6ad6d4b2de4 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:33.487437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866748a2-2c45-42fa-9d6e-f6ad6d4b2de4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:33.514639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866748a2-2c45-42fa-9d6e-f6ad6d4b2de4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:33.516578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866748a2-2c45-42fa-9d6e-f6ad6d4b2de4 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:33.550545 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1455/2889] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:06:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:35.927085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65941c7-8023-4867-9d1f-8b36b43aab5c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:35.928734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a65941c7-8023-4867-9d1f-8b36b43aab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:36.194443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65941c7-8023-4867-9d1f-8b36b43aab5c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:36.211386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c438b38-568a-4971-a581-01e93a32464a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:36.212187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438b38-568a-4971-a581-01e93a32464a service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:36.212610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438b38-568a-4971-a581-01e93a32464a service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:36.212974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438b38-568a-4971-a581-01e93a32464a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:36.220391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0c438b38-568a-4971-a581-01e93a32464a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:36.369205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c438b38-568a-4971-a581-01e93a32464a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:36.371042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c438b38-568a-4971-a581-01e93a32464a service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:36.394009 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1435/2890] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:38.868681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae71ba-101e-4b4d-9c49-28dd992141a1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:38.869168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae71ba-101e-4b4d-9c49-28dd992141a1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:38.869390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae71ba-101e-4b4d-9c49-28dd992141a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:38.932765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a1ae71ba-101e-4b4d-9c49-28dd992141a1 None None] MFA Rules not processed for user `56797e6a3e434d4b816fde3bd2ff0d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:38.935403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1ae71ba-101e-4b4d-9c49-28dd992141a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:39.010218 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:39.155014 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1456/2891] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:40.624337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c438b38-568a-4971-a581-01e93a32464a service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:40.638519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c438b38-568a-4971-a581-01e93a32464a service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:40.658643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614962fb-50e5-4b14-a249-daa9e19c702b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:40.660356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614962fb-50e5-4b14-a249-daa9e19c702b service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:40.661164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614962fb-50e5-4b14-a249-daa9e19c702b service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:40.661863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614962fb-50e5-4b14-a249-daa9e19c702b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:40.699903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614962fb-50e5-4b14-a249-daa9e19c702b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:40.702343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614962fb-50e5-4b14-a249-daa9e19c702b service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:40.750572 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1436/2892] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:46.369651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250054-644b-466b-bb87-c6cc7f581c57 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:46.370584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250054-644b-466b-bb87-c6cc7f581c57 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:46.371081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250054-644b-466b-bb87-c6cc7f581c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:46.416520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8c250054-644b-466b-bb87-c6cc7f581c57 None None] MFA Rules not processed for user `739083b66f9b433889944e555b0aef23`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:46.417708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8c250054-644b-466b-bb87-c6cc7f581c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:46.449697 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1457/2893] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:49.231464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614962fb-50e5-4b14-a249-daa9e19c702b service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:49.233168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-614962fb-50e5-4b14-a249-daa9e19c702b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:49.360148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c250054-644b-466b-bb87-c6cc7f581c57 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:49.362148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8c250054-644b-466b-bb87-c6cc7f581c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:49.416362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c250054-644b-466b-bb87-c6cc7f581c57 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:49.433309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ed290-8281-4db6-93e4-dbea7f9e476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:49.435252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ed290-8281-4db6-93e4-dbea7f9e476d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:49.435805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ed290-8281-4db6-93e4-dbea7f9e476d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:49.436791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ed290-8281-4db6-93e4-dbea7f9e476d admin admin] PATH_INFO: `/v3/users/a0d9202ae84a4b5d90d136dcc0046695` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:49.438428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ed290-8281-4db6-93e4-dbea7f9e476d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d9202ae84a4b5d90d136dcc0046695)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:49.440849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ed290-8281-4db6-93e4-dbea7f9e476d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:49.460168 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:49.488552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614962fb-50e5-4b14-a249-daa9e19c702b service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:49.501165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236a8b3-9b1b-4e37-bfa8-245d08eea05d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:49.503069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a8b3-9b1b-4e37-bfa8-245d08eea05d service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:49.503834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a8b3-9b1b-4e37-bfa8-245d08eea05d service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:49.504296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a8b3-9b1b-4e37-bfa8-245d08eea05d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:49.506339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3236a8b3-9b1b-4e37-bfa8-245d08eea05d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:49.553175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236a8b3-9b1b-4e37-bfa8-245d08eea05d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:49.554876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236a8b3-9b1b-4e37-bfa8-245d08eea05d service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:49.557895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ce9ed290-8281-4db6-93e4-dbea7f9e476d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d9202ae84a4b5d90d136dcc0046695'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:49.588691 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1437/2894] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:49.600479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ce9ed290-8281-4db6-93e4-dbea7f9e476d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d9202ae84a4b5d90d136dcc0046695'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:49.601639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ce9ed290-8281-4db6-93e4-dbea7f9e476d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d9202ae84a4b5d90d136dcc0046695'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:49.622758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ce9ed290-8281-4db6-93e4-dbea7f9e476d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d9202ae84a4b5d90d136dcc0046695'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:49.624957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ce9ed290-8281-4db6-93e4-dbea7f9e476d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d9202ae84a4b5d90d136dcc0046695'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:49.654656 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1458/2895] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:49 2022] DELETE /identity/v3/users/a0d9202ae84a4b5d90d136dcc0046695 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:06:50.318986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236a8b3-9b1b-4e37-bfa8-245d08eea05d service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:50.342099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236a8b3-9b1b-4e37-bfa8-245d08eea05d service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:50.501715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:50.503322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:50.504925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:50.505435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] PATH_INFO: `/v3/projects/171d6e6675244130be822a3a69c6fe2e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:50.513167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=171d6e6675244130be822a3a69c6fe2e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:50.516594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:50.644618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171d6e6675244130be822a3a69c6fe2e', 'request_id': 'req-85be96b4-bd80-4bde-ab92-294fecde78ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:50.661782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171d6e6675244130be822a3a69c6fe2e', 'request_id': 'req-85be96b4-bd80-4bde-ab92-294fecde78ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:50.673134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171d6e6675244130be822a3a69c6fe2e', 'request_id': 'req-85be96b4-bd80-4bde-ab92-294fecde78ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:50.722766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] The token cache is being invalidate because project 171d6e6675244130be822a3a69c6fe2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:50.723071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:50.724453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-85be96b4-bd80-4bde-ab92-294fecde78ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:50.726720 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1438/2896] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:50 2022] DELETE /identity/v3/projects/171d6e6675244130be822a3a69c6fe2e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:50.732128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9ca0e-0c8a-4a3a-9b9f-fc430c62b07c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:50.733749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9ca0e-0c8a-4a3a-9b9f-fc430c62b07c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:50.734310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9ca0e-0c8a-4a3a-9b9f-fc430c62b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:50.798219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-30a9ca0e-0c8a-4a3a-9b9f-fc430c62b07c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:50.801193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-30a9ca0e-0c8a-4a3a-9b9f-fc430c62b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:50.927671 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1459/2897] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:50.937163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c1130-a551-46ba-835c-d3bd77e23934 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:50.937853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c1130-a551-46ba-835c-d3bd77e23934 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:50.938105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c1130-a551-46ba-835c-d3bd77e23934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:50.990394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cc6c1130-a551-46ba-835c-d3bd77e23934 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:50.999460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc6c1130-a551-46ba-835c-d3bd77e23934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:51.022843 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1439/2898] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:51.027364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9ca0e-0c8a-4a3a-9b9f-fc430c62b07c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:51.041473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9ca0e-0c8a-4a3a-9b9f-fc430c62b07c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:51.087005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac607c43-48e7-4c2a-aed5-1aacebb15bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:51.089247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac607c43-48e7-4c2a-aed5-1aacebb15bec admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:51.089763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac607c43-48e7-4c2a-aed5-1aacebb15bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:51.090054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac607c43-48e7-4c2a-aed5-1aacebb15bec admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:51.091688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac607c43-48e7-4c2a-aed5-1aacebb15bec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:06:51.092054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac607c43-48e7-4c2a-aed5-1aacebb15bec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:51.095237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac607c43-48e7-4c2a-aed5-1aacebb15bec admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:51.118039 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1460/2899] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:06:51.125111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c1130-a551-46ba-835c-d3bd77e23934 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:51.156592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c1130-a551-46ba-835c-d3bd77e23934 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:51.167958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6081-2fea-4c4a-834d-e50a9734219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:51.168706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6081-2fea-4c4a-834d-e50a9734219f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:51.171162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6081-2fea-4c4a-834d-e50a9734219f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:51.171470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6081-2fea-4c4a-834d-e50a9734219f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:51.172175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c6081-2fea-4c4a-834d-e50a9734219f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:51.176179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c6081-2fea-4c4a-834d-e50a9734219f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:51.263076 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1440/2900] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:51 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:51.266960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac607c43-48e7-4c2a-aed5-1aacebb15bec admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:51.278306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac607c43-48e7-4c2a-aed5-1aacebb15bec admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:51.314428 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:51.432745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408418d3-d74d-4a03-b010-e127b89babab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:51.433382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408418d3-d74d-4a03-b010-e127b89babab admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:51.433918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408418d3-d74d-4a03-b010-e127b89babab admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:51.434191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408418d3-d74d-4a03-b010-e127b89babab admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:51.440784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408418d3-d74d-4a03-b010-e127b89babab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:51.444212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408418d3-d74d-4a03-b010-e127b89babab admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:51.486906 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1461/2901] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:51 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:51.492382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6081-2fea-4c4a-834d-e50a9734219f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:51.516157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6081-2fea-4c4a-834d-e50a9734219f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:51.526045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121d660-8aaf-4888-937c-7b1ddd7ee916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:51.526721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121d660-8aaf-4888-937c-7b1ddd7ee916 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:51.527000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121d660-8aaf-4888-937c-7b1ddd7ee916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:51.527273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121d660-8aaf-4888-937c-7b1ddd7ee916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:51.527938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121d660-8aaf-4888-937c-7b1ddd7ee916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:51.529550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121d660-8aaf-4888-937c-7b1ddd7ee916 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:51.552817 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1441/2902] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:51.556602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408418d3-d74d-4a03-b010-e127b89babab admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:51.570059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408418d3-d74d-4a03-b010-e127b89babab admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:51.578250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507f0bb-e817-43c4-ae9b-1a2201b38397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:51.579095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507f0bb-e817-43c4-ae9b-1a2201b38397 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:51.579477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507f0bb-e817-43c4-ae9b-1a2201b38397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:51.580254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507f0bb-e817-43c4-ae9b-1a2201b38397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:51.581034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507f0bb-e817-43c4-ae9b-1a2201b38397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:51.583431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507f0bb-e817-43c4-ae9b-1a2201b38397 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:51.603917 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1462/2903] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:51.607970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121d660-8aaf-4888-937c-7b1ddd7ee916 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:51.620737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121d660-8aaf-4888-937c-7b1ddd7ee916 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:51.634795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd6f00-ec4a-4450-88c3-9b2390a0bbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:51.636154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6f00-ec4a-4450-88c3-9b2390a0bbea admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:51.636744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6f00-ec4a-4450-88c3-9b2390a0bbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:51.638157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6f00-ec4a-4450-88c3-9b2390a0bbea admin admin] PATH_INFO: `/v3/projects/d05742589bcb42e4883dfc9a7200764d/users/3dee19f767eb48239c77830d28ca6c61/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:51.668421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd6f00-ec4a-4450-88c3-9b2390a0bbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05742589bcb42e4883dfc9a7200764d, user_id=3dee19f767eb48239c77830d28ca6c61, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:51.671988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd6f00-ec4a-4450-88c3-9b2390a0bbea admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:51.697955 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1442/2904] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:51 2022] PUT /identity/v3/projects/d05742589bcb42e4883dfc9a7200764d/users/3dee19f767eb48239c77830d28ca6c61/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:51.777968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a1055-5b1f-4b26-a0a6-c38b42670128 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:51.778552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a1055-5b1f-4b26-a0a6-c38b42670128 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:51.778552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a1055-5b1f-4b26-a0a6-c38b42670128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:51.816917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cb1a1055-5b1f-4b26-a0a6-c38b42670128 None None] MFA Rules not processed for user `3dee19f767eb48239c77830d28ca6c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:51.818230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cb1a1055-5b1f-4b26-a0a6-c38b42670128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:52.043890 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1463/2905] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:52.817105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd6f00-ec4a-4450-88c3-9b2390a0bbea admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:52.821242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4afd6f00-ec4a-4450-88c3-9b2390a0bbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:52.862215 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:53.015159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd6f00-ec4a-4450-88c3-9b2390a0bbea admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:53.028608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94de96-a10e-41ae-85f8-984f952f2a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:53.029513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94de96-a10e-41ae-85f8-984f952f2a98 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:53.030828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94de96-a10e-41ae-85f8-984f952f2a98 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:53.031474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94de96-a10e-41ae-85f8-984f952f2a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:53.042472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94de96-a10e-41ae-85f8-984f952f2a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:53.044437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94de96-a10e-41ae-85f8-984f952f2a98 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:53.056583 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1443/2906] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:53.751881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a1055-5b1f-4b26-a0a6-c38b42670128 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:53.758682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cb1a1055-5b1f-4b26-a0a6-c38b42670128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:53.974258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a1055-5b1f-4b26-a0a6-c38b42670128 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:53.988107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e56e5b-6e4a-4ace-a357-71dc65a4cacc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:53.992925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e56e5b-6e4a-4ace-a357-71dc65a4cacc service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:53.993489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e56e5b-6e4a-4ace-a357-71dc65a4cacc service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:53.994206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e56e5b-6e4a-4ace-a357-71dc65a4cacc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:54.001085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f0e56e5b-6e4a-4ace-a357-71dc65a4cacc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:54.106329 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:54.140890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e56e5b-6e4a-4ace-a357-71dc65a4cacc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:54.143108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e56e5b-6e4a-4ace-a357-71dc65a4cacc service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:54.156352 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1464/2907] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:54.682547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94de96-a10e-41ae-85f8-984f952f2a98 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:54.851629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94de96-a10e-41ae-85f8-984f952f2a98 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:54.869879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:54.870986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:54.871486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:54.871972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] PATH_INFO: `/v3/users/3dee19f767eb48239c77830d28ca6c61` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:54.875424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dee19f767eb48239c77830d28ca6c61)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:54.878289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:54.995111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dee19f767eb48239c77830d28ca6c61'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:55.012639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dee19f767eb48239c77830d28ca6c61'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:55.019647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dee19f767eb48239c77830d28ca6c61'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:55.033174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dee19f767eb48239c77830d28ca6c61'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:55.045842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dee19f767eb48239c77830d28ca6c61'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:55.055122 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1444/2908] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:06:54 2022] DELETE /identity/v3/users/3dee19f767eb48239c77830d28ca6c61 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:55.061113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866fa4-f70c-4dc1-9846-df7e24335f2c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:55.062301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866fa4-f70c-4dc1-9846-df7e24335f2c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:55.065209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866fa4-f70c-4dc1-9846-df7e24335f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:55.154181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-44866fa4-f70c-4dc1-9846-df7e24335f2c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:55.172177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-44866fa4-f70c-4dc1-9846-df7e24335f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:55.357286 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1465/2909] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:55.378505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:55.380426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:55.447539 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:55.578192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488356c-b2a0-48f3-9372-ec423cb4fab5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:55.585817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801722a-0685-47f0-ae50-7016c1863119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:55.588443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801722a-0685-47f0-ae50-7016c1863119 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:55.589117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801722a-0685-47f0-ae50-7016c1863119 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:55.589993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801722a-0685-47f0-ae50-7016c1863119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:55.616623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801722a-0685-47f0-ae50-7016c1863119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:55.618966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801722a-0685-47f0-ae50-7016c1863119 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:55.643078 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1445/2910] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:56.072951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44866fa4-f70c-4dc1-9846-df7e24335f2c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:56.074583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-44866fa4-f70c-4dc1-9846-df7e24335f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:56.097030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44866fa4-f70c-4dc1-9846-df7e24335f2c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:56.102423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:56.103311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:56.103773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:56.104305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] PATH_INFO: `/v3/projects/d05742589bcb42e4883dfc9a7200764d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:56.105816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05742589bcb42e4883dfc9a7200764d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:56.109330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:56.190406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05742589bcb42e4883dfc9a7200764d', 'request_id': 'req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:56.204621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05742589bcb42e4883dfc9a7200764d', 'request_id': 'req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:56.214135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05742589bcb42e4883dfc9a7200764d', 'request_id': 'req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:56.230696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] The token cache is being invalidate because project d05742589bcb42e4883dfc9a7200764d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:06:56.230696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:56.231911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a96ba57-8190-4cfb-89c1-065ca5ca58bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:06:56.238002 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1466/2911] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:06:56 2022] DELETE /identity/v3/projects/d05742589bcb42e4883dfc9a7200764d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:56.239727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca9275-0a32-47d7-957d-7a01f84a9fc5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:56.240185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca9275-0a32-47d7-957d-7a01f84a9fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:56.240439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca9275-0a32-47d7-957d-7a01f84a9fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:56.304406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c8ca9275-0a32-47d7-957d-7a01f84a9fc5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:56.314838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8ca9275-0a32-47d7-957d-7a01f84a9fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:56.457085 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1446/2912] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:56.465046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db458e7-4718-4357-b5b1-0e6b3315860f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:56.465447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db458e7-4718-4357-b5b1-0e6b3315860f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:56.465831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db458e7-4718-4357-b5b1-0e6b3315860f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:56.504789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4db458e7-4718-4357-b5b1-0e6b3315860f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:56.508161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4db458e7-4718-4357-b5b1-0e6b3315860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:56.525076 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1467/2913] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:56.525883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca9275-0a32-47d7-957d-7a01f84a9fc5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:56.545005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca9275-0a32-47d7-957d-7a01f84a9fc5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:56.555849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2251cf-d2c1-45fa-b08d-d8c09d001657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:56.556552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2251cf-d2c1-45fa-b08d-d8c09d001657 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:56.556820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2251cf-d2c1-45fa-b08d-d8c09d001657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:56.557092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2251cf-d2c1-45fa-b08d-d8c09d001657 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:56.557755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2251cf-d2c1-45fa-b08d-d8c09d001657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:06:56.558060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2251cf-d2c1-45fa-b08d-d8c09d001657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:56.560416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2251cf-d2c1-45fa-b08d-d8c09d001657 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:56.582165 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1447/2914] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:06:56.586856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db458e7-4718-4357-b5b1-0e6b3315860f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:56.596573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db458e7-4718-4357-b5b1-0e6b3315860f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:56.611101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153079-6074-4201-8fde-6ac55776f796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:56.615351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153079-6074-4201-8fde-6ac55776f796 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:56.615938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153079-6074-4201-8fde-6ac55776f796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:56.616403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153079-6074-4201-8fde-6ac55776f796 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:56.617575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40153079-6074-4201-8fde-6ac55776f796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:56.642883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40153079-6074-4201-8fde-6ac55776f796 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:56.648558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff457-e136-4711-9872-a12a201db3e4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:56.648878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff457-e136-4711-9872-a12a201db3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:56.649119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff457-e136-4711-9872-a12a201db3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:56.685025 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1468/2915] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:06:56 2022] POST /identity/v3/projects => generated 397 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:06:56.689537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153079-6074-4201-8fde-6ac55776f796 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:56.689879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-de3ff457-e136-4711-9872-a12a201db3e4 None None] MFA Rules not processed for user `c4c8a46a0556407f9956cbd1ffd75c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:56.691277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de3ff457-e136-4711-9872-a12a201db3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:56.790892 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:56.817457 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1448/2916] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:56.819576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506190a0-2490-46c2-997f-6fdc1fb573ed None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:56.819967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506190a0-2490-46c2-997f-6fdc1fb573ed None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:56.820890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506190a0-2490-46c2-997f-6fdc1fb573ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:56.845388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153079-6074-4201-8fde-6ac55776f796 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:56.845668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-506190a0-2490-46c2-997f-6fdc1fb573ed None None] MFA Rules not processed for user `c4c8a46a0556407f9956cbd1ffd75c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:56.847080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-506190a0-2490-46c2-997f-6fdc1fb573ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:56.855843 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1449/2917] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:56.864921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b61a07-1de9-42c6-90e0-3288d1773ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:56.865749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61a07-1de9-42c6-90e0-3288d1773ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:56.866192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61a07-1de9-42c6-90e0-3288d1773ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:56.866813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61a07-1de9-42c6-90e0-3288d1773ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:56.867960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b61a07-1de9-42c6-90e0-3288d1773ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:56.870731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b61a07-1de9-42c6-90e0-3288d1773ea2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:56.912918 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1469/2918] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:06:56 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:06:56.917063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506190a0-2490-46c2-997f-6fdc1fb573ed None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:56.929380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506190a0-2490-46c2-997f-6fdc1fb573ed None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:56.936241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32d2a-88d6-4dfd-b87e-cc491124eaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:56.937016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32d2a-88d6-4dfd-b87e-cc491124eaab admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:56.937404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32d2a-88d6-4dfd-b87e-cc491124eaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:56.937775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32d2a-88d6-4dfd-b87e-cc491124eaab admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:56.938926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd32d2a-88d6-4dfd-b87e-cc491124eaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:56.940791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd32d2a-88d6-4dfd-b87e-cc491124eaab admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:56.956893 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1450/2919] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:56.960619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b61a07-1de9-42c6-90e0-3288d1773ea2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:56.981122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b61a07-1de9-42c6-90e0-3288d1773ea2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:56.993067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed49cdb-ccbf-4d5b-8cf2-a4cca0ca8e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:56.993983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49cdb-ccbf-4d5b-8cf2-a4cca0ca8e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:56.994471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49cdb-ccbf-4d5b-8cf2-a4cca0ca8e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:56.995061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49cdb-ccbf-4d5b-8cf2-a4cca0ca8e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:56.996025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed49cdb-ccbf-4d5b-8cf2-a4cca0ca8e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:57.000372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed49cdb-ccbf-4d5b-8cf2-a4cca0ca8e5b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:57.019105 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1470/2920] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:06:57.023020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32d2a-88d6-4dfd-b87e-cc491124eaab admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:57.035235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32d2a-88d6-4dfd-b87e-cc491124eaab admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:57.044865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7854317-f442-4011-ab63-053c6eb20d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:57.046525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7854317-f442-4011-ab63-053c6eb20d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:57.046843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7854317-f442-4011-ab63-053c6eb20d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:57.048351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7854317-f442-4011-ab63-053c6eb20d53 admin admin] PATH_INFO: `/v3/projects/815dc360b4004abfb574f4fb4a8bc3a7/users/992fb97f8ca443a9ae617e5209246994/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:57.097888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7854317-f442-4011-ab63-053c6eb20d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815dc360b4004abfb574f4fb4a8bc3a7, user_id=992fb97f8ca443a9ae617e5209246994, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:57.107639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7854317-f442-4011-ab63-053c6eb20d53 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:57.154071 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1451/2921] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:06:57 2022] PUT /identity/v3/projects/815dc360b4004abfb574f4fb4a8bc3a7/users/992fb97f8ca443a9ae617e5209246994/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:06:57.156352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191d6d2-e7dd-4b70-b068-c44780512b62 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:57.156847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191d6d2-e7dd-4b70-b068-c44780512b62 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:57.157198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191d6d2-e7dd-4b70-b068-c44780512b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:57.250973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1191d6d2-e7dd-4b70-b068-c44780512b62 None None] MFA Rules not processed for user `992fb97f8ca443a9ae617e5209246994`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:57.252758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1191d6d2-e7dd-4b70-b068-c44780512b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:57.382925 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1471/2922] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:06:58.081732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7854317-f442-4011-ab63-053c6eb20d53 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:58.084194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d7854317-f442-4011-ab63-053c6eb20d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:58.111793 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:58.340464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7854317-f442-4011-ab63-053c6eb20d53 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:58.363066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c70ee-8579-4ae2-8b1d-bf262a3b8e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:58.364609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c70ee-8579-4ae2-8b1d-bf262a3b8e00 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:58.365032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c70ee-8579-4ae2-8b1d-bf262a3b8e00 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:58.365323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c70ee-8579-4ae2-8b1d-bf262a3b8e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:58.390628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c70ee-8579-4ae2-8b1d-bf262a3b8e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:58.392688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c70ee-8579-4ae2-8b1d-bf262a3b8e00 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:58.410390 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1452/2923] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:58 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:06:58.571631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f91d-d4ae-4a6e-948c-53fed5696e25 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:58.572204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f91d-d4ae-4a6e-948c-53fed5696e25 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:58.572204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f91d-d4ae-4a6e-948c-53fed5696e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:58.618477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-17e2f91d-d4ae-4a6e-948c-53fed5696e25 None None] MFA Rules not processed for user `992fb97f8ca443a9ae617e5209246994`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:06:58.627815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-17e2f91d-d4ae-4a6e-948c-53fed5696e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:58.654470 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1472/2924] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:06:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:06:59.732624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c70ee-8579-4ae2-8b1d-bf262a3b8e00 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:06:59.734843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-914c70ee-8579-4ae2-8b1d-bf262a3b8e00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:59.834686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c70ee-8579-4ae2-8b1d-bf262a3b8e00 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:06:59.865038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d34d3-be0d-4170-969e-f0f4a27c3af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:06:59.866215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d34d3-be0d-4170-969e-f0f4a27c3af1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:06:59.867665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d34d3-be0d-4170-969e-f0f4a27c3af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:06:59.868855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d34d3-be0d-4170-969e-f0f4a27c3af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:06:59.874952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e47d34d3-be0d-4170-969e-f0f4a27c3af1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:06:59.903014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d34d3-be0d-4170-969e-f0f4a27c3af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:06:59.905299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d34d3-be0d-4170-969e-f0f4a27c3af1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:06:59.929496 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1453/2925] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:06:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:00.911003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2f91d-d4ae-4a6e-948c-53fed5696e25 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:01.043815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2f91d-d4ae-4a6e-948c-53fed5696e25 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:01.067007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:01.067779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:01.068173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:01.068520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] PATH_INFO: `/v3/users/992fb97f8ca443a9ae617e5209246994` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:01.069674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=992fb97f8ca443a9ae617e5209246994)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:01.071774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:01.139802 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:01.151250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '992fb97f8ca443a9ae617e5209246994'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:01.169396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '992fb97f8ca443a9ae617e5209246994'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:01.171884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '992fb97f8ca443a9ae617e5209246994'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:01.180537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '992fb97f8ca443a9ae617e5209246994'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:01.181365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '992fb97f8ca443a9ae617e5209246994'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:01.198252 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1473/2926] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:07:00 2022] DELETE /identity/v3/users/992fb97f8ca443a9ae617e5209246994 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:07:01.202591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd9d0-28ea-4224-a55e-7be6d766222e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:01.203119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd9d0-28ea-4224-a55e-7be6d766222e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:01.203229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd9d0-28ea-4224-a55e-7be6d766222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:01.224260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8badd9d0-28ea-4224-a55e-7be6d766222e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:01.225490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8badd9d0-28ea-4224-a55e-7be6d766222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:01.302173 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1454/2927] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:01.323599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:01.325312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:01.398727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f5369-502d-40b1-856d-e03827b5ae84 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:01.403059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7718d-3817-4441-998b-85cc761caa21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:01.403690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7718d-3817-4441-998b-85cc761caa21 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:01.404180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7718d-3817-4441-998b-85cc761caa21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:01.404672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7718d-3817-4441-998b-85cc761caa21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:01.415743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7718d-3817-4441-998b-85cc761caa21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:01.417264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7718d-3817-4441-998b-85cc761caa21 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:01.428279 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1474/2928] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:02.046623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badd9d0-28ea-4224-a55e-7be6d766222e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:02.048199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8badd9d0-28ea-4224-a55e-7be6d766222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:02.081205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badd9d0-28ea-4224-a55e-7be6d766222e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:02.087315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:02.088121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:02.088407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:02.088674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] PATH_INFO: `/v3/projects/815dc360b4004abfb574f4fb4a8bc3a7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:02.090028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=815dc360b4004abfb574f4fb4a8bc3a7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:02.092289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:02.137405 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:02.148565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815dc360b4004abfb574f4fb4a8bc3a7', 'request_id': 'req-0c9bca73-2860-410b-88f7-3ad63244cbc1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:02.154854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815dc360b4004abfb574f4fb4a8bc3a7', 'request_id': 'req-0c9bca73-2860-410b-88f7-3ad63244cbc1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:02.161528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815dc360b4004abfb574f4fb4a8bc3a7', 'request_id': 'req-0c9bca73-2860-410b-88f7-3ad63244cbc1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:02.176161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] The token cache is being invalidate because project 815dc360b4004abfb574f4fb4a8bc3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:07:02.176463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:02.177120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c9bca73-2860-410b-88f7-3ad63244cbc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:02.178646 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1455/2929] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:02 2022] DELETE /identity/v3/projects/815dc360b4004abfb574f4fb4a8bc3a7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:07:02.183703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a18e-ba5b-4afe-aafe-410332241af7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:02.184476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a18e-ba5b-4afe-aafe-410332241af7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:02.184795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a18e-ba5b-4afe-aafe-410332241af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:02.205966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3aa1a18e-ba5b-4afe-aafe-410332241af7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:02.207201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3aa1a18e-ba5b-4afe-aafe-410332241af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:02.268836 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1475/2930] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:02.276906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dff73-b49b-4757-8bf4-a256ae564607 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:02.277426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dff73-b49b-4757-8bf4-a256ae564607 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:02.277426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dff73-b49b-4757-8bf4-a256ae564607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:02.299155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-aa6dff73-b49b-4757-8bf4-a256ae564607 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:02.300795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aa6dff73-b49b-4757-8bf4-a256ae564607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:02.317042 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1456/2931] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:02.317523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1a18e-ba5b-4afe-aafe-410332241af7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:02.329496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1a18e-ba5b-4afe-aafe-410332241af7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:02.334706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93a540-c5ed-41d3-9f92-7af4cb8fb436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:02.335324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93a540-c5ed-41d3-9f92-7af4cb8fb436 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:02.335731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93a540-c5ed-41d3-9f92-7af4cb8fb436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:02.335999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93a540-c5ed-41d3-9f92-7af4cb8fb436 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:02.337583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93a540-c5ed-41d3-9f92-7af4cb8fb436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:07:02.337583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93a540-c5ed-41d3-9f92-7af4cb8fb436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:02.338709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93a540-c5ed-41d3-9f92-7af4cb8fb436 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:02.351139 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1476/2932] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:07:02.356903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dff73-b49b-4757-8bf4-a256ae564607 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:02.368220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dff73-b49b-4757-8bf4-a256ae564607 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:02.375821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765aa77-77c5-48a4-9d2f-8a64494c8964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:02.376493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765aa77-77c5-48a4-9d2f-8a64494c8964 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:02.376775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765aa77-77c5-48a4-9d2f-8a64494c8964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:02.377048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765aa77-77c5-48a4-9d2f-8a64494c8964 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:02.377694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765aa77-77c5-48a4-9d2f-8a64494c8964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:02.379975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765aa77-77c5-48a4-9d2f-8a64494c8964 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:02.422748 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1457/2933] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:07:02 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:07:02.423937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93a540-c5ed-41d3-9f92-7af4cb8fb436 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:02.437161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93a540-c5ed-41d3-9f92-7af4cb8fb436 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:02.501666 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:02.518802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54d034-f999-45c2-99e9-534c235b848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:02.519418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d034-f999-45c2-99e9-534c235b848e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:02.519710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d034-f999-45c2-99e9-534c235b848e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:02.520077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d034-f999-45c2-99e9-534c235b848e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:02.520731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54d034-f999-45c2-99e9-534c235b848e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:02.523093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54d034-f999-45c2-99e9-534c235b848e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:02.554950 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1477/2934] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:07:02 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:07:02.556083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765aa77-77c5-48a4-9d2f-8a64494c8964 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:02.570222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765aa77-77c5-48a4-9d2f-8a64494c8964 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:02.575255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103d6be-cc7b-4535-bf1f-76c0a0546f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:02.575974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103d6be-cc7b-4535-bf1f-76c0a0546f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:02.576540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103d6be-cc7b-4535-bf1f-76c0a0546f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:02.576649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103d6be-cc7b-4535-bf1f-76c0a0546f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:02.577268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103d6be-cc7b-4535-bf1f-76c0a0546f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:02.578897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103d6be-cc7b-4535-bf1f-76c0a0546f4d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:02.589934 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1458/2935] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:07:02.593850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54d034-f999-45c2-99e9-534c235b848e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:02.603917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54d034-f999-45c2-99e9-534c235b848e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:02.610148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96596e-0f5f-4419-b496-ccea351e3b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:02.610886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96596e-0f5f-4419-b496-ccea351e3b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:02.611229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96596e-0f5f-4419-b496-ccea351e3b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:02.611566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96596e-0f5f-4419-b496-ccea351e3b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:02.612357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96596e-0f5f-4419-b496-ccea351e3b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:02.614022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96596e-0f5f-4419-b496-ccea351e3b06 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:02.625267 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1478/2936] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:07:02.629818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103d6be-cc7b-4535-bf1f-76c0a0546f4d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:02.640982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103d6be-cc7b-4535-bf1f-76c0a0546f4d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:02.645654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65a3b9-4a0b-4751-b0f5-65e4af96242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:02.646312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65a3b9-4a0b-4751-b0f5-65e4af96242b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:02.646606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65a3b9-4a0b-4751-b0f5-65e4af96242b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:02.646900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65a3b9-4a0b-4751-b0f5-65e4af96242b admin admin] PATH_INFO: `/v3/projects/8639be724fdc4c128da53dd69fbbc356/users/ddc06a9186b9434d86d5815276c9b51d/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:02.662898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65a3b9-4a0b-4751-b0f5-65e4af96242b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8639be724fdc4c128da53dd69fbbc356, user_id=ddc06a9186b9434d86d5815276c9b51d, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:02.665602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65a3b9-4a0b-4751-b0f5-65e4af96242b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:02.680061 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1459/2937] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:07:02 2022] PUT /identity/v3/projects/8639be724fdc4c128da53dd69fbbc356/users/ddc06a9186b9434d86d5815276c9b51d/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:07:02.686962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca430a-cdb4-4209-ad21-339f0cd18dac None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:02.687260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca430a-cdb4-4209-ad21-339f0cd18dac None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:02.687538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca430a-cdb4-4209-ad21-339f0cd18dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:02.709654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ebca430a-cdb4-4209-ad21-339f0cd18dac None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:02.710924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ebca430a-cdb4-4209-ad21-339f0cd18dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:02.775907 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1479/2938] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:02.786534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65a3b9-4a0b-4751-b0f5-65e4af96242b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:02.788471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4c65a3b9-4a0b-4751-b0f5-65e4af96242b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:02.849902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65a3b9-4a0b-4751-b0f5-65e4af96242b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:02.853805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cc6fc-72ea-487a-9ae7-071bf858b502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:02.854426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc6fc-72ea-487a-9ae7-071bf858b502 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:02.854753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc6fc-72ea-487a-9ae7-071bf858b502 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:02.855036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc6fc-72ea-487a-9ae7-071bf858b502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:02.866361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cc6fc-72ea-487a-9ae7-071bf858b502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:02.867864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cc6fc-72ea-487a-9ae7-071bf858b502 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:02.879992 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1460/2939] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:02.970143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca430a-cdb4-4209-ad21-339f0cd18dac None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:02.971943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ebca430a-cdb4-4209-ad21-339f0cd18dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:02.990833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca430a-cdb4-4209-ad21-339f0cd18dac None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:02.999512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8735200-3afb-436f-a524-50519518acdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:03.000548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8735200-3afb-436f-a524-50519518acdf service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:03.000873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8735200-3afb-436f-a524-50519518acdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:03.001984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8735200-3afb-436f-a524-50519518acdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:03.003902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a8735200-3afb-436f-a524-50519518acdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:03.015430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8735200-3afb-436f-a524-50519518acdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:03.016879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8735200-3afb-436f-a524-50519518acdf service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:03.026825 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1480/2940] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:04.313115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0de7a8-4bc9-4351-977a-0e4d461d2e8d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:04.313710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0de7a8-4bc9-4351-977a-0e4d461d2e8d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:04.313998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0de7a8-4bc9-4351-977a-0e4d461d2e8d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:04.318012 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1461/2941] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 2 01:07:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:07:04.323991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a0bd5-ad6d-4f7d-9ef2-04880a21085f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:04.324505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a0bd5-ad6d-4f7d-9ef2-04880a21085f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:04.324505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a0bd5-ad6d-4f7d-9ef2-04880a21085f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:04.357654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2b1a0bd5-ad6d-4f7d-9ef2-04880a21085f None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:04.359266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2b1a0bd5-ad6d-4f7d-9ef2-04880a21085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:04.513569 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1481/2942] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:07:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:04.522273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0de7a8-4bc9-4351-977a-0e4d461d2e8d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:04.539550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0de7a8-4bc9-4351-977a-0e4d461d2e8d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:04.544600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1af836-6808-4d35-a4bf-7d8bcafeb94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:04.546969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1af836-6808-4d35-a4bf-7d8bcafeb94c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:04.547497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1af836-6808-4d35-a4bf-7d8bcafeb94c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:04.547982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1af836-6808-4d35-a4bf-7d8bcafeb94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:04.567795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1af836-6808-4d35-a4bf-7d8bcafeb94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:04.571924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1af836-6808-4d35-a4bf-7d8bcafeb94c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:04.600259 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1462/2943] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:09.349631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a0bd5-ad6d-4f7d-9ef2-04880a21085f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:09.352014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2b1a0bd5-ad6d-4f7d-9ef2-04880a21085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:09.384030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a0bd5-ad6d-4f7d-9ef2-04880a21085f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:09.397849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10a8af-8695-464c-8719-05cc9b79f904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:09.399576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10a8af-8695-464c-8719-05cc9b79f904 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:09.403101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10a8af-8695-464c-8719-05cc9b79f904 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:09.403440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10a8af-8695-464c-8719-05cc9b79f904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:09.414913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1c10a8af-8695-464c-8719-05cc9b79f904 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:09.440954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10a8af-8695-464c-8719-05cc9b79f904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:09.443025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10a8af-8695-464c-8719-05cc9b79f904 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:09.465945 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1482/2944] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:10.182549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00918aa9-e18b-452a-8714-d806e8b07af5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:10.183113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00918aa9-e18b-452a-8714-d806e8b07af5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:10.183246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00918aa9-e18b-452a-8714-d806e8b07af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:10.272316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-00918aa9-e18b-452a-8714-d806e8b07af5 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:10.287743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-00918aa9-e18b-452a-8714-d806e8b07af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:10.527752 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:10.588350 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1463/2945] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:07:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:10.611415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10a8af-8695-464c-8719-05cc9b79f904 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:10.612970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1c10a8af-8695-464c-8719-05cc9b79f904 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:10.727854 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:10.821301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10a8af-8695-464c-8719-05cc9b79f904 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:10.834192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead37aac-7548-4f9d-b500-66933801bc42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:10.834426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead37aac-7548-4f9d-b500-66933801bc42 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:10.834860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead37aac-7548-4f9d-b500-66933801bc42 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:10.835238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead37aac-7548-4f9d-b500-66933801bc42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:10.865350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead37aac-7548-4f9d-b500-66933801bc42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:10.873499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead37aac-7548-4f9d-b500-66933801bc42 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:10.922972 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1483/2946] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:07:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:14.468372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43035c-ee0f-4437-b657-8f167d272001 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:14.469039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43035c-ee0f-4437-b657-8f167d272001 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:14.469141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43035c-ee0f-4437-b657-8f167d272001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:14.557475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fe43035c-ee0f-4437-b657-8f167d272001 None None] MFA Rules not processed for user `ddc06a9186b9434d86d5815276c9b51d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:14.580793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fe43035c-ee0f-4437-b657-8f167d272001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:14.916788 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1464/2947] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:14.932712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead37aac-7548-4f9d-b500-66933801bc42 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:14.935433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ead37aac-7548-4f9d-b500-66933801bc42 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:14.975207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead37aac-7548-4f9d-b500-66933801bc42 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:14.991546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54273e3-d318-481b-8a2b-457ba862f7b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:14.992508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54273e3-d318-481b-8a2b-457ba862f7b7 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:14.993073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54273e3-d318-481b-8a2b-457ba862f7b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:14.993519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54273e3-d318-481b-8a2b-457ba862f7b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:15.017855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54273e3-d318-481b-8a2b-457ba862f7b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:15.019844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54273e3-d318-481b-8a2b-457ba862f7b7 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:15.035366 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1484/2948] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:16.253077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43035c-ee0f-4437-b657-8f167d272001 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:16.277507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43035c-ee0f-4437-b657-8f167d272001 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:16.307029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aab692-bef9-4fce-b8ec-69ddfbed35a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:16.308061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aab692-bef9-4fce-b8ec-69ddfbed35a2 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:16.311810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aab692-bef9-4fce-b8ec-69ddfbed35a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:16.313259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aab692-bef9-4fce-b8ec-69ddfbed35a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:16.318389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-17aab692-bef9-4fce-b8ec-69ddfbed35a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:16.518533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aab692-bef9-4fce-b8ec-69ddfbed35a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:16.531658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aab692-bef9-4fce-b8ec-69ddfbed35a2 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:16.565411 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1465/2949] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:18.575521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54273e3-d318-481b-8a2b-457ba862f7b7 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:18.578803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c54273e3-d318-481b-8a2b-457ba862f7b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:18.825588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54273e3-d318-481b-8a2b-457ba862f7b7 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:18.862988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03637f48-130b-4e15-8874-d72dba8bd8f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:18.870393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03637f48-130b-4e15-8874-d72dba8bd8f1 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:18.870926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03637f48-130b-4e15-8874-d72dba8bd8f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:18.871367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03637f48-130b-4e15-8874-d72dba8bd8f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:18.878881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-03637f48-130b-4e15-8874-d72dba8bd8f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:18.915610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03637f48-130b-4e15-8874-d72dba8bd8f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:18.918213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03637f48-130b-4e15-8874-d72dba8bd8f1 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:18.956375 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1485/2950] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:19.824834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aab692-bef9-4fce-b8ec-69ddfbed35a2 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:19.869117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aab692-bef9-4fce-b8ec-69ddfbed35a2 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:19.894522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b219f-3b41-426f-86e4-f49f95626237 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:19.895185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b219f-3b41-426f-86e4-f49f95626237 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:19.895471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b219f-3b41-426f-86e4-f49f95626237 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:19.895746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b219f-3b41-426f-86e4-f49f95626237 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:19.903347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-814b219f-3b41-426f-86e4-f49f95626237 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:19.984668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b219f-3b41-426f-86e4-f49f95626237 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:19.992714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b219f-3b41-426f-86e4-f49f95626237 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:20.044726 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1466/2951] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:20.553421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03637f48-130b-4e15-8874-d72dba8bd8f1 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:20.574122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03637f48-130b-4e15-8874-d72dba8bd8f1 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:20.592370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af8340-8c3a-4b35-98ac-c9864b693c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:20.592669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af8340-8c3a-4b35-98ac-c9864b693c33 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:20.597078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af8340-8c3a-4b35-98ac-c9864b693c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:20.597359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af8340-8c3a-4b35-98ac-c9864b693c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:20.604457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e5af8340-8c3a-4b35-98ac-c9864b693c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:20.649075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af8340-8c3a-4b35-98ac-c9864b693c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:20.652582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af8340-8c3a-4b35-98ac-c9864b693c33 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:20.689266 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1486/2952] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:21.599575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923accea-3bb4-4ab7-872a-7a34329cef17 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:21.600170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923accea-3bb4-4ab7-872a-7a34329cef17 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:21.600170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923accea-3bb4-4ab7-872a-7a34329cef17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:21.632045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-923accea-3bb4-4ab7-872a-7a34329cef17 None None] MFA Rules not processed for user `ddc06a9186b9434d86d5815276c9b51d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:21.634419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-923accea-3bb4-4ab7-872a-7a34329cef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:21.698925 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1467/2953] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:28.740247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af8340-8c3a-4b35-98ac-c9864b693c33 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:28.742737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e5af8340-8c3a-4b35-98ac-c9864b693c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:28.798739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af8340-8c3a-4b35-98ac-c9864b693c33 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:28.814573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a064ae8-6cbf-4ad7-b6e7-9b0ebf054def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:28.815248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064ae8-6cbf-4ad7-b6e7-9b0ebf054def admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:28.815532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064ae8-6cbf-4ad7-b6e7-9b0ebf054def admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:28.815811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064ae8-6cbf-4ad7-b6e7-9b0ebf054def admin admin] PATH_INFO: `/v3/users/56797e6a3e434d4b816fde3bd2ff0d59` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:28.821184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a064ae8-6cbf-4ad7-b6e7-9b0ebf054def admin admin] RBAC: Authorizing `identity:delete_user(user_id=56797e6a3e434d4b816fde3bd2ff0d59)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:28.830183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a064ae8-6cbf-4ad7-b6e7-9b0ebf054def admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:28.948118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0a064ae8-6cbf-4ad7-b6e7-9b0ebf054def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56797e6a3e434d4b816fde3bd2ff0d59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:28.990098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0a064ae8-6cbf-4ad7-b6e7-9b0ebf054def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56797e6a3e434d4b816fde3bd2ff0d59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:28.993700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0a064ae8-6cbf-4ad7-b6e7-9b0ebf054def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56797e6a3e434d4b816fde3bd2ff0d59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:29.013892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0a064ae8-6cbf-4ad7-b6e7-9b0ebf054def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56797e6a3e434d4b816fde3bd2ff0d59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:29.014970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0a064ae8-6cbf-4ad7-b6e7-9b0ebf054def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56797e6a3e434d4b816fde3bd2ff0d59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:29.028507 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:29.053445 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1487/2954] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:07:28 2022] DELETE /identity/v3/users/56797e6a3e434d4b816fde3bd2ff0d59 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:07:29.771753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923accea-3bb4-4ab7-872a-7a34329cef17 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:29.810201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923accea-3bb4-4ab7-872a-7a34329cef17 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:29.905164 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:29.929532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:29.949335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:29.950822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:29.951304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] PATH_INFO: `/v3/projects/2de604b2fe4141ddab1c3bd993ee32a7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:29.955113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de604b2fe4141ddab1c3bd993ee32a7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:29.960824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:30.090588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de604b2fe4141ddab1c3bd993ee32a7', 'request_id': 'req-b1b23207-1b74-4856-95cf-824d56bcd00c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:30.108112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de604b2fe4141ddab1c3bd993ee32a7', 'request_id': 'req-b1b23207-1b74-4856-95cf-824d56bcd00c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:30.126127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de604b2fe4141ddab1c3bd993ee32a7', 'request_id': 'req-b1b23207-1b74-4856-95cf-824d56bcd00c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:30.156270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] The token cache is being invalidate because project 2de604b2fe4141ddab1c3bd993ee32a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:07:30.156667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:30.161171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1b23207-1b74-4856-95cf-824d56bcd00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:30.169282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6833-cdaf-4d6b-b31e-756c3082828e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:30.169851 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1468/2955] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:29 2022] DELETE /identity/v3/projects/2de604b2fe4141ddab1c3bd993ee32a7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:07:30.170861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6833-cdaf-4d6b-b31e-756c3082828e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:30.171311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c6833-cdaf-4d6b-b31e-756c3082828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:30.221635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-338c6833-cdaf-4d6b-b31e-756c3082828e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:30.222925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-338c6833-cdaf-4d6b-b31e-756c3082828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:30.401824 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1488/2956] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:07:30.410862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fda9b-6100-4896-a5b0-7d41f6f1b1d9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:30.411146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fda9b-6100-4896-a5b0-7d41f6f1b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:30.411425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fda9b-6100-4896-a5b0-7d41f6f1b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:30.471322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-701fda9b-6100-4896-a5b0-7d41f6f1b1d9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:30.479364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-701fda9b-6100-4896-a5b0-7d41f6f1b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:30.493983 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1469/2957] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:30.495426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c6833-cdaf-4d6b-b31e-756c3082828e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:30.507104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c6833-cdaf-4d6b-b31e-756c3082828e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:30.521793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f7473-a77c-4cbb-a974-b65c91f977d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:30.522505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f7473-a77c-4cbb-a974-b65c91f977d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:30.522883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f7473-a77c-4cbb-a974-b65c91f977d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:30.523223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f7473-a77c-4cbb-a974-b65c91f977d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:30.523947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f7473-a77c-4cbb-a974-b65c91f977d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:07:30.524482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f7473-a77c-4cbb-a974-b65c91f977d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:30.526400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f7473-a77c-4cbb-a974-b65c91f977d4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:30.553793 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1489/2958] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:07:30.555084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fda9b-6100-4896-a5b0-7d41f6f1b1d9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:30.577234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fda9b-6100-4896-a5b0-7d41f6f1b1d9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:30.597501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a8c8a-4261-4322-b032-db667f20581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:30.600402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a8c8a-4261-4322-b032-db667f20581a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:30.600692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a8c8a-4261-4322-b032-db667f20581a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:30.602550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a8c8a-4261-4322-b032-db667f20581a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:30.605906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a8c8a-4261-4322-b032-db667f20581a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:30.618902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a8c8a-4261-4322-b032-db667f20581a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:30.725806 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1470/2959] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:07:30 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:07:30.727036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f7473-a77c-4cbb-a974-b65c91f977d4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:30.743280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f7473-a77c-4cbb-a974-b65c91f977d4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:30.922761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ae03f-ebb4-4ae7-a550-0e6f7b009563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:30.923423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ae03f-ebb4-4ae7-a550-0e6f7b009563 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:30.923716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ae03f-ebb4-4ae7-a550-0e6f7b009563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:30.923986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ae03f-ebb4-4ae7-a550-0e6f7b009563 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:30.924637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ae03f-ebb4-4ae7-a550-0e6f7b009563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:30.926659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ae03f-ebb4-4ae7-a550-0e6f7b009563 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:30.979507 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1490/2960] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:07:30 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:07:30.982391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a8c8a-4261-4322-b032-db667f20581a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:30.994828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a8c8a-4261-4322-b032-db667f20581a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:31.000595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b57e14-6854-476e-9d2b-912b5e4deb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:31.001536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b57e14-6854-476e-9d2b-912b5e4deb61 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:31.002010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b57e14-6854-476e-9d2b-912b5e4deb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:31.002436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b57e14-6854-476e-9d2b-912b5e4deb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:31.003277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b57e14-6854-476e-9d2b-912b5e4deb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:31.005447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b57e14-6854-476e-9d2b-912b5e4deb61 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:31.025900 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1471/2961] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:07:31.027222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ae03f-ebb4-4ae7-a550-0e6f7b009563 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:31.039302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ae03f-ebb4-4ae7-a550-0e6f7b009563 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:31.047988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba36ee-841d-480d-96bf-72c7cb53daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:31.048955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba36ee-841d-480d-96bf-72c7cb53daa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:31.049237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba36ee-841d-480d-96bf-72c7cb53daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:31.049517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba36ee-841d-480d-96bf-72c7cb53daa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:31.051648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba36ee-841d-480d-96bf-72c7cb53daa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:31.056642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba36ee-841d-480d-96bf-72c7cb53daa9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:31.109406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b57e14-6854-476e-9d2b-912b5e4deb61 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:31.118420 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1491/2962] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:07:31.125278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b57e14-6854-476e-9d2b-912b5e4deb61 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:31.136195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0b0ad-94ae-467a-a719-3dfcb515727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:31.138056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0b0ad-94ae-467a-a719-3dfcb515727f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:31.138345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0b0ad-94ae-467a-a719-3dfcb515727f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:31.138636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0b0ad-94ae-467a-a719-3dfcb515727f admin admin] PATH_INFO: `/v3/projects/54fc9ec957ec4fa8a613c8f90a5a6bc5/users/26941bac262b4d78a1dc6f5f07c29b91/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:31.177544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0b0ad-94ae-467a-a719-3dfcb515727f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fc9ec957ec4fa8a613c8f90a5a6bc5, user_id=26941bac262b4d78a1dc6f5f07c29b91, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:31.181829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0b0ad-94ae-467a-a719-3dfcb515727f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:31.211102 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1472/2963] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:07:31 2022] PUT /identity/v3/projects/54fc9ec957ec4fa8a613c8f90a5a6bc5/users/26941bac262b4d78a1dc6f5f07c29b91/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:07:31.216221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5632fd2-8b74-4ea7-9ab5-9fce1be17380 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:31.216735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5632fd2-8b74-4ea7-9ab5-9fce1be17380 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:31.216844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5632fd2-8b74-4ea7-9ab5-9fce1be17380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:31.257328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c5632fd2-8b74-4ea7-9ab5-9fce1be17380 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:31.259289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c5632fd2-8b74-4ea7-9ab5-9fce1be17380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:31.410247 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1492/2964] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:31.423628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0b0ad-94ae-467a-a719-3dfcb515727f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:31.426989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0bb0b0ad-94ae-467a-a719-3dfcb515727f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:31.575329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0b0ad-94ae-467a-a719-3dfcb515727f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:31.597795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949c505-cf10-4d2c-8c3a-557bf97777c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:31.599303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949c505-cf10-4d2c-8c3a-557bf97777c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:31.600358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949c505-cf10-4d2c-8c3a-557bf97777c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:31.600744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949c505-cf10-4d2c-8c3a-557bf97777c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:31.621501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949c505-cf10-4d2c-8c3a-557bf97777c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:31.625871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949c505-cf10-4d2c-8c3a-557bf97777c2 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:31.652377 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1473/2965] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:41.381894 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:41.645122 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:48.821963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53c7a2-c427-4e62-a7b1-b36bcbb6adcd None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:48.822527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53c7a2-c427-4e62-a7b1-b36bcbb6adcd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:48.822527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53c7a2-c427-4e62-a7b1-b36bcbb6adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:48.846105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fe53c7a2-c427-4e62-a7b1-b36bcbb6adcd None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:48.847344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fe53c7a2-c427-4e62-a7b1-b36bcbb6adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:48.928632 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1493/2966] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:07:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:48.957759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949c505-cf10-4d2c-8c3a-557bf97777c2 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:48.959967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a949c505-cf10-4d2c-8c3a-557bf97777c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:49.081895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949c505-cf10-4d2c-8c3a-557bf97777c2 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:49.087541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738356e-d6f7-47c3-9971-cc54bc3117a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:49.088536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738356e-d6f7-47c3-9971-cc54bc3117a8 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:49.088912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738356e-d6f7-47c3-9971-cc54bc3117a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:49.089326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738356e-d6f7-47c3-9971-cc54bc3117a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:49.100025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738356e-d6f7-47c3-9971-cc54bc3117a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:49.105074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738356e-d6f7-47c3-9971-cc54bc3117a8 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:49.130463 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1474/2967] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:07:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:51.612128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa0e0-c441-4672-8b28-5996c8d8961e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:51.613224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa0e0-c441-4672-8b28-5996c8d8961e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:51.613992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa0e0-c441-4672-8b28-5996c8d8961e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:51.760782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ddafa0e0-c441-4672-8b28-5996c8d8961e None None] MFA Rules not processed for user `26941bac262b4d78a1dc6f5f07c29b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:51.762212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ddafa0e0-c441-4672-8b28-5996c8d8961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:51.958007 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1494/2968] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:51.962054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e43cd-268c-4481-9180-143e1c5c183f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:51.962555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e43cd-268c-4481-9180-143e1c5c183f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:51.962555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e43cd-268c-4481-9180-143e1c5c183f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:52.029345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-136e43cd-268c-4481-9180-143e1c5c183f None None] MFA Rules not processed for user `26941bac262b4d78a1dc6f5f07c29b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:52.036018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-136e43cd-268c-4481-9180-143e1c5c183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:52.069661 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1475/2969] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:52.086113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafa0e0-c441-4672-8b28-5996c8d8961e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:52.088741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ddafa0e0-c441-4672-8b28-5996c8d8961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:52.281915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafa0e0-c441-4672-8b28-5996c8d8961e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:52.298155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376cd17-1f40-4d7c-a694-bb5c8d763094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:52.301040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376cd17-1f40-4d7c-a694-bb5c8d763094 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:52.301336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376cd17-1f40-4d7c-a694-bb5c8d763094 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:52.301614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376cd17-1f40-4d7c-a694-bb5c8d763094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:52.322873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376cd17-1f40-4d7c-a694-bb5c8d763094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:52.324641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376cd17-1f40-4d7c-a694-bb5c8d763094 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:52.347664 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1495/2970] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:54.962888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e43cd-268c-4481-9180-143e1c5c183f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:54.994433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e43cd-268c-4481-9180-143e1c5c183f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:55.033973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44219d79-f3a8-449a-af07-c36be57a0818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:55.037980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44219d79-f3a8-449a-af07-c36be57a0818 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:55.038701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44219d79-f3a8-449a-af07-c36be57a0818 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:55.039167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44219d79-f3a8-449a-af07-c36be57a0818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:55.043445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-44219d79-f3a8-449a-af07-c36be57a0818 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:55.259931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44219d79-f3a8-449a-af07-c36be57a0818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:55.261994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44219d79-f3a8-449a-af07-c36be57a0818 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:55.303079 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1476/2971] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:55.817196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376cd17-1f40-4d7c-a694-bb5c8d763094 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:55.818871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1376cd17-1f40-4d7c-a694-bb5c8d763094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:55.852261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376cd17-1f40-4d7c-a694-bb5c8d763094 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:55.871131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:55.872143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:55.872623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:55.873428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] PATH_INFO: `/v3/users/c076d9dc75a7400f87b480d2b18dcc14` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:55.876842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c076d9dc75a7400f87b480d2b18dcc14)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:55.881674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:55.936726 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:56.028455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c076d9dc75a7400f87b480d2b18dcc14'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:56.084855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c076d9dc75a7400f87b480d2b18dcc14'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:56.086525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c076d9dc75a7400f87b480d2b18dcc14'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:56.117177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c076d9dc75a7400f87b480d2b18dcc14'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:56.117967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c076d9dc75a7400f87b480d2b18dcc14'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:56.158042 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1496/2972] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:07:55 2022] DELETE /identity/v3/users/c076d9dc75a7400f87b480d2b18dcc14 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:07:56.159161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d3139-c27c-4c74-8b52-526560f145ef None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:56.160589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d3139-c27c-4c74-8b52-526560f145ef None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:56.160878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d3139-c27c-4c74-8b52-526560f145ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:56.223798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea4d3139-c27c-4c74-8b52-526560f145ef None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:56.227830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea4d3139-c27c-4c74-8b52-526560f145ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:56.445201 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1477/2973] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:07:56.453865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:56.456883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:56.620770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b404e51-ef81-40bf-8490-90ed79390b79 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:56.633524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a548ab-7b04-4a62-ac6a-be9babeeafce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:56.633982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a548ab-7b04-4a62-ac6a-be9babeeafce service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:56.634250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a548ab-7b04-4a62-ac6a-be9babeeafce service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:56.634523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a548ab-7b04-4a62-ac6a-be9babeeafce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:56.663748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a548ab-7b04-4a62-ac6a-be9babeeafce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:56.665222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a548ab-7b04-4a62-ac6a-be9babeeafce service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:56.687953 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1497/2974] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:07:57.138257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d3139-c27c-4c74-8b52-526560f145ef None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:57.140643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea4d3139-c27c-4c74-8b52-526560f145ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:57.175383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d3139-c27c-4c74-8b52-526560f145ef None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:57.200375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:57.203248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:57.205100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:57.205568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] PATH_INFO: `/v3/projects/70c6b40e739146e8b98b38971b879e85` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:57.209009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c6b40e739146e8b98b38971b879e85)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:57.215576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:57.267694 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:57.362440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c6b40e739146e8b98b38971b879e85', 'request_id': 'req-637aa9f0-8c84-4a54-9557-576a6a8fbb16'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:57.380853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c6b40e739146e8b98b38971b879e85', 'request_id': 'req-637aa9f0-8c84-4a54-9557-576a6a8fbb16'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:57.402413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c6b40e739146e8b98b38971b879e85', 'request_id': 'req-637aa9f0-8c84-4a54-9557-576a6a8fbb16'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:57.448367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] The token cache is being invalidate because project 70c6b40e739146e8b98b38971b879e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:07:57.449212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:57.454373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:57.459546 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1478/2975] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:57 2022] DELETE /identity/v3/projects/70c6b40e739146e8b98b38971b879e85 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:07:57.463430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a548ab-7b04-4a62-ac6a-be9babeeafce service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:57.482060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a548ab-7b04-4a62-ac6a-be9babeeafce service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:57.736796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5404f7-a5a0-47c3-995a-16974222ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:57.737367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5404f7-a5a0-47c3-995a-16974222ffce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:57.737644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5404f7-a5a0-47c3-995a-16974222ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:57.737917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5404f7-a5a0-47c3-995a-16974222ffce admin admin] PATH_INFO: `/v3/users/22ed94252c1e406aaafefab6edd128fe` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:57.743940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5404f7-a5a0-47c3-995a-16974222ffce admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ed94252c1e406aaafefab6edd128fe)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:57.745920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5404f7-a5a0-47c3-995a-16974222ffce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:57.856896 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:57.880272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2c5404f7-a5a0-47c3-995a-16974222ffce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ed94252c1e406aaafefab6edd128fe'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:57.912007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2c5404f7-a5a0-47c3-995a-16974222ffce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ed94252c1e406aaafefab6edd128fe'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:57.913261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2c5404f7-a5a0-47c3-995a-16974222ffce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ed94252c1e406aaafefab6edd128fe'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:57.928028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2c5404f7-a5a0-47c3-995a-16974222ffce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ed94252c1e406aaafefab6edd128fe'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:57.929074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2c5404f7-a5a0-47c3-995a-16974222ffce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ed94252c1e406aaafefab6edd128fe'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:57.956219 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1498/2976] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:07:57 2022] DELETE /identity/v3/users/22ed94252c1e406aaafefab6edd128fe => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:07:58.405727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:58.407362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:58.450644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637aa9f0-8c84-4a54-9557-576a6a8fbb16 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:58.645253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:58.645881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:58.646364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:58.646871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] PATH_INFO: `/v3/projects/c00db8f12f03444aa2bb0ac6a276666c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:58.648204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00db8f12f03444aa2bb0ac6a276666c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:58.650291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:58.821581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00db8f12f03444aa2bb0ac6a276666c', 'request_id': 'req-6ec1e77a-bb69-44c2-8237-4473cb55e838'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:58.833622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00db8f12f03444aa2bb0ac6a276666c', 'request_id': 'req-6ec1e77a-bb69-44c2-8237-4473cb55e838'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:58.915407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00db8f12f03444aa2bb0ac6a276666c', 'request_id': 'req-6ec1e77a-bb69-44c2-8237-4473cb55e838'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:58.969120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] The token cache is being invalidate because project c00db8f12f03444aa2bb0ac6a276666c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:07:58.970269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:58.979164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ec1e77a-bb69-44c2-8237-4473cb55e838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:07:58.981564 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1479/2977] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:07:58 2022] DELETE /identity/v3/projects/c00db8f12f03444aa2bb0ac6a276666c => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:07:58.987954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d84e-d00a-4f15-b1a8-3831802e1789 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:58.988533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d84e-d00a-4f15-b1a8-3831802e1789 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:58.988533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d84e-d00a-4f15-b1a8-3831802e1789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:59.026771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2209d84e-d00a-4f15-b1a8-3831802e1789 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:59.029149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2209d84e-d00a-4f15-b1a8-3831802e1789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:59.168771 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1499/2978] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:07:59.168971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ae73f-b83e-40e7-b4c0-fe5f323469a7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:59.169349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ae73f-b83e-40e7-b4c0-fe5f323469a7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:59.169616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ae73f-b83e-40e7-b4c0-fe5f323469a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:59.219938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0c0ae73f-b83e-40e7-b4c0-fe5f323469a7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:59.221162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0c0ae73f-b83e-40e7-b4c0-fe5f323469a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:59.241574 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1480/2979] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:07:59.245621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d84e-d00a-4f15-b1a8-3831802e1789 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:59.258772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d84e-d00a-4f15-b1a8-3831802e1789 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:59.270108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44d357-6915-448a-a6c7-eef09e862702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:59.270861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44d357-6915-448a-a6c7-eef09e862702 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:59.271352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44d357-6915-448a-a6c7-eef09e862702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:59.271627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44d357-6915-448a-a6c7-eef09e862702 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:59.272271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44d357-6915-448a-a6c7-eef09e862702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:07:59.273473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44d357-6915-448a-a6c7-eef09e862702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:59.274212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44d357-6915-448a-a6c7-eef09e862702 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:59.296749 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1500/2980] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:07:59.297448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ae73f-b83e-40e7-b4c0-fe5f323469a7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:59.308693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ae73f-b83e-40e7-b4c0-fe5f323469a7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:59.323069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf07b-f322-4241-89f5-6a635abad52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:59.323692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf07b-f322-4241-89f5-6a635abad52b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:59.323968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf07b-f322-4241-89f5-6a635abad52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:59.324241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf07b-f322-4241-89f5-6a635abad52b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:59.324886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bf07b-f322-4241-89f5-6a635abad52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:59.331618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bf07b-f322-4241-89f5-6a635abad52b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:59.408307 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1481/2981] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:07:59 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:07:59.410352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44d357-6915-448a-a6c7-eef09e862702 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:59.429118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44d357-6915-448a-a6c7-eef09e862702 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:59.527415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75898260-382e-40ed-99fb-9638b422ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:59.529264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75898260-382e-40ed-99fb-9638b422ccf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:59.529588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75898260-382e-40ed-99fb-9638b422ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:59.529865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75898260-382e-40ed-99fb-9638b422ccf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:59.530506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75898260-382e-40ed-99fb-9638b422ccf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:59.532489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75898260-382e-40ed-99fb-9638b422ccf3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:59.580206 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1501/2982] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:07:59 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:07:59.580904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf07b-f322-4241-89f5-6a635abad52b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:59.587717 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:59.598795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf07b-f322-4241-89f5-6a635abad52b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:59.606967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6db95-c213-4668-b9ae-d69c0732de31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:59.609479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6db95-c213-4668-b9ae-d69c0732de31 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:59.610065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6db95-c213-4668-b9ae-d69c0732de31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:59.611070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6db95-c213-4668-b9ae-d69c0732de31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:59.612080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6db95-c213-4668-b9ae-d69c0732de31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:59.613885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6db95-c213-4668-b9ae-d69c0732de31 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:59.633145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75898260-382e-40ed-99fb-9638b422ccf3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:59.640553 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1482/2983] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:07:59.644947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75898260-382e-40ed-99fb-9638b422ccf3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:59.650454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43f922-711d-4753-ba48-d9f6b38537e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:59.651298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43f922-711d-4753-ba48-d9f6b38537e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:59.651770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43f922-711d-4753-ba48-d9f6b38537e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:59.652579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43f922-711d-4753-ba48-d9f6b38537e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:59.653407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43f922-711d-4753-ba48-d9f6b38537e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:59.655302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43f922-711d-4753-ba48-d9f6b38537e1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:59.680576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6db95-c213-4668-b9ae-d69c0732de31 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:07:59.694320 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1502/2984] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:07:59.709055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6db95-c213-4668-b9ae-d69c0732de31 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:07:59.727927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64926fd8-a5ee-4cde-b4dc-a08972032240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:07:59.728864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64926fd8-a5ee-4cde-b4dc-a08972032240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:59.730379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64926fd8-a5ee-4cde-b4dc-a08972032240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:59.731578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64926fd8-a5ee-4cde-b4dc-a08972032240 admin admin] PATH_INFO: `/v3/projects/76dd02a5b3d346168e6dde74ddb4d3e0/users/a8ae1a9c7c164923840b20e32c471cf3/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:59.772375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64926fd8-a5ee-4cde-b4dc-a08972032240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dd02a5b3d346168e6dde74ddb4d3e0, user_id=a8ae1a9c7c164923840b20e32c471cf3, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:07:59.775651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64926fd8-a5ee-4cde-b4dc-a08972032240 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:07:59.796508 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1483/2985] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:07:59 2022] PUT /identity/v3/projects/76dd02a5b3d346168e6dde74ddb4d3e0/users/a8ae1a9c7c164923840b20e32c471cf3/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:07:59.802679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742563fd-512f-4ccf-8628-0d6c3860c3ea None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:07:59.802977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742563fd-512f-4ccf-8628-0d6c3860c3ea None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:07:59.803405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742563fd-512f-4ccf-8628-0d6c3860c3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:07:59.839634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-742563fd-512f-4ccf-8628-0d6c3860c3ea None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:07:59.841422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-742563fd-512f-4ccf-8628-0d6c3860c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:07:59.859450 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:00.029141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64926fd8-a5ee-4cde-b4dc-a08972032240 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:00.030462 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1503/2986] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:00.031527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-64926fd8-a5ee-4cde-b4dc-a08972032240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:00.233519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64926fd8-a5ee-4cde-b4dc-a08972032240 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:00.253278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726ba1e-49ed-4da6-969a-412b64fbff96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:00.255577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726ba1e-49ed-4da6-969a-412b64fbff96 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:00.256963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726ba1e-49ed-4da6-969a-412b64fbff96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:00.258316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726ba1e-49ed-4da6-969a-412b64fbff96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:00.280286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726ba1e-49ed-4da6-969a-412b64fbff96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:00.282038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726ba1e-49ed-4da6-969a-412b64fbff96 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:00.322564 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1484/2987] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:08:01.913856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742563fd-512f-4ccf-8628-0d6c3860c3ea None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:01.915584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-742563fd-512f-4ccf-8628-0d6c3860c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:01.945754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742563fd-512f-4ccf-8628-0d6c3860c3ea None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:01.962089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd4e91-6fe6-4ec2-98fe-f954c5203399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:01.965864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd4e91-6fe6-4ec2-98fe-f954c5203399 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:01.974812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd4e91-6fe6-4ec2-98fe-f954c5203399 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:01.975624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd4e91-6fe6-4ec2-98fe-f954c5203399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:01.978081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eccd4e91-6fe6-4ec2-98fe-f954c5203399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:02.223059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd4e91-6fe6-4ec2-98fe-f954c5203399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:02.224468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd4e91-6fe6-4ec2-98fe-f954c5203399 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:02.242336 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1504/2988] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:08:02.337071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726ba1e-49ed-4da6-969a-412b64fbff96 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:02.346990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726ba1e-49ed-4da6-969a-412b64fbff96 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:02.360573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072df79-09f0-4f49-81d4-21b4823a5d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:02.364045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072df79-09f0-4f49-81d4-21b4823a5d2a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:02.364329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072df79-09f0-4f49-81d4-21b4823a5d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:02.364609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072df79-09f0-4f49-81d4-21b4823a5d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:02.372919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4072df79-09f0-4f49-81d4-21b4823a5d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:02.405478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072df79-09f0-4f49-81d4-21b4823a5d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:02.407382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072df79-09f0-4f49-81d4-21b4823a5d2a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:02.438058 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1485/2989] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:08:08.646366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d713594-f629-4170-adc7-a21d4f163959 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:08.647429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d713594-f629-4170-adc7-a21d4f163959 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:08.647891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d713594-f629-4170-adc7-a21d4f163959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:08.715591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3d713594-f629-4170-adc7-a21d4f163959 None None] MFA Rules not processed for user `a8ae1a9c7c164923840b20e32c471cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:08.718389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3d713594-f629-4170-adc7-a21d4f163959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:08.881393 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1505/2990] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:08.882975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072df79-09f0-4f49-81d4-21b4823a5d2a service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:08.903496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072df79-09f0-4f49-81d4-21b4823a5d2a service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:08.915952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed581c-3996-4e53-a6a1-401a295a36ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:08.916678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed581c-3996-4e53-a6a1-401a295a36ca admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:08.917023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed581c-3996-4e53-a6a1-401a295a36ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:08.917669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed581c-3996-4e53-a6a1-401a295a36ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:08.919537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed581c-3996-4e53-a6a1-401a295a36ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:08.922366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed581c-3996-4e53-a6a1-401a295a36ca admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:09.039268 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1486/2991] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:08:08 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:08:09.041361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d713594-f629-4170-adc7-a21d4f163959 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:09.062206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d713594-f629-4170-adc7-a21d4f163959 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:09.133738 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:09.183303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a804659-c6f2-4ffc-a997-bdf917459b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:09.183921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a804659-c6f2-4ffc-a997-bdf917459b6e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:09.184202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a804659-c6f2-4ffc-a997-bdf917459b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:09.184480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a804659-c6f2-4ffc-a997-bdf917459b6e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:09.185141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a804659-c6f2-4ffc-a997-bdf917459b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:09.187476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a804659-c6f2-4ffc-a997-bdf917459b6e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:09.226888 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1506/2992] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:08:09 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:08:09.230485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed581c-3996-4e53-a6a1-401a295a36ca admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:09.247600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed581c-3996-4e53-a6a1-401a295a36ca admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:09.262027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe98f-a3ba-4348-aafd-f4a234436a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:09.262677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe98f-a3ba-4348-aafd-f4a234436a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:09.262969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe98f-a3ba-4348-aafd-f4a234436a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:09.263240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe98f-a3ba-4348-aafd-f4a234436a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:09.263952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fe98f-a3ba-4348-aafd-f4a234436a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:09.265568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fe98f-a3ba-4348-aafd-f4a234436a6d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:09.293634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a804659-c6f2-4ffc-a997-bdf917459b6e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:09.299614 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1487/2993] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:08:09.310543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a804659-c6f2-4ffc-a997-bdf917459b6e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:09.322799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f90372-d0b9-42fc-933b-b703498366a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:09.324600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f90372-d0b9-42fc-933b-b703498366a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:09.325116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f90372-d0b9-42fc-933b-b703498366a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:09.325592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f90372-d0b9-42fc-933b-b703498366a5 admin admin] PATH_INFO: `/v3/projects/2025441a9e3a4e848c695b77bb33b9e2/users/f13f3cf87e5148cf9ba45f4d24961f6e/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:09.355431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f90372-d0b9-42fc-933b-b703498366a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2025441a9e3a4e848c695b77bb33b9e2, user_id=f13f3cf87e5148cf9ba45f4d24961f6e, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:09.359159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f90372-d0b9-42fc-933b-b703498366a5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:09.383446 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1507/2994] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:08:09 2022] PUT /identity/v3/projects/2025441a9e3a4e848c695b77bb33b9e2/users/f13f3cf87e5148cf9ba45f4d24961f6e/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:08:09.384834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe98f-a3ba-4348-aafd-f4a234436a6d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:09.399815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe98f-a3ba-4348-aafd-f4a234436a6d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:09.556585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b655ba8-7361-4028-8f61-ecebf8422894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:09.557095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b655ba8-7361-4028-8f61-ecebf8422894 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:09.557441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b655ba8-7361-4028-8f61-ecebf8422894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:09.557788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b655ba8-7361-4028-8f61-ecebf8422894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:09.558554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b655ba8-7361-4028-8f61-ecebf8422894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:09.561364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b655ba8-7361-4028-8f61-ecebf8422894 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:09.599788 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1488/2995] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:08:09.604723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f90372-d0b9-42fc-933b-b703498366a5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:09.619765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f90372-d0b9-42fc-933b-b703498366a5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:09.649633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe42d1-0c9a-44f6-a6d1-ad55a6524018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:09.652014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe42d1-0c9a-44f6-a6d1-ad55a6524018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:09.652534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe42d1-0c9a-44f6-a6d1-ad55a6524018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:09.653017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe42d1-0c9a-44f6-a6d1-ad55a6524018 admin admin] PATH_INFO: `/v3/projects/2025441a9e3a4e848c695b77bb33b9e2/users/f13f3cf87e5148cf9ba45f4d24961f6e/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:09.656029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe42d1-0c9a-44f6-a6d1-ad55a6524018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2025441a9e3a4e848c695b77bb33b9e2, user_id=f13f3cf87e5148cf9ba45f4d24961f6e, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:09.659040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe42d1-0c9a-44f6-a6d1-ad55a6524018 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:09.678069 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1508/2996] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:08:09 2022] PUT /identity/v3/projects/2025441a9e3a4e848c695b77bb33b9e2/users/f13f3cf87e5148cf9ba45f4d24961f6e/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:08:19.506767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389633a-aae9-4e22-81d7-ef8365996489 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:19.507753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389633a-aae9-4e22-81d7-ef8365996489 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:19.508268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389633a-aae9-4e22-81d7-ef8365996489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:19.582092 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:19.602833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1389633a-aae9-4e22-81d7-ef8365996489 None None] MFA Rules not processed for user `f13f3cf87e5148cf9ba45f4d24961f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:19.606834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1389633a-aae9-4e22-81d7-ef8365996489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:19.671155 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=28,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:19.829153 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1489/2997] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:20.973569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe42d1-0c9a-44f6-a6d1-ad55a6524018 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:20.977421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e9fe42d1-0c9a-44f6-a6d1-ad55a6524018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:21.189185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe42d1-0c9a-44f6-a6d1-ad55a6524018 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:21.196833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcbb3b-cc53-4316-a536-25a0874d917a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:21.198043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcbb3b-cc53-4316-a536-25a0874d917a service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:21.198800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcbb3b-cc53-4316-a536-25a0874d917a service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:21.199481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcbb3b-cc53-4316-a536-25a0874d917a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:21.306319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcbb3b-cc53-4316-a536-25a0874d917a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:21.308531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcbb3b-cc53-4316-a536-25a0874d917a service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:21.322577 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1509/2998] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:08:24.123872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389633a-aae9-4e22-81d7-ef8365996489 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:24.144731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389633a-aae9-4e22-81d7-ef8365996489 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:24.152493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204e85a-d220-46a7-9a9e-edb27d4995aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:24.153128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204e85a-d220-46a7-9a9e-edb27d4995aa service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:24.153409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204e85a-d220-46a7-9a9e-edb27d4995aa service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:24.153782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204e85a-d220-46a7-9a9e-edb27d4995aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:24.156935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4204e85a-d220-46a7-9a9e-edb27d4995aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:24.255939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204e85a-d220-46a7-9a9e-edb27d4995aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:24.258516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204e85a-d220-46a7-9a9e-edb27d4995aa service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:24.307968 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1490/2999] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:24 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:08:26.923516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224af06-cbad-4adc-8b0f-43b5965d6a65 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:26.924408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224af06-cbad-4adc-8b0f-43b5965d6a65 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:26.924872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224af06-cbad-4adc-8b0f-43b5965d6a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:26.954539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b224af06-cbad-4adc-8b0f-43b5965d6a65 None None] MFA Rules not processed for user `a8ae1a9c7c164923840b20e32c471cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:26.956212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b224af06-cbad-4adc-8b0f-43b5965d6a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:26.989999 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1510/3000] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:27.080195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204e85a-d220-46a7-9a9e-edb27d4995aa service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:27.081596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4204e85a-d220-46a7-9a9e-edb27d4995aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:27.160756 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:27.177957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204e85a-d220-46a7-9a9e-edb27d4995aa service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:27.183154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48ccfa-e343-42bd-a98d-ca684791efb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:27.183756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48ccfa-e343-42bd-a98d-ca684791efb9 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:27.184036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48ccfa-e343-42bd-a98d-ca684791efb9 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:27.184310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48ccfa-e343-42bd-a98d-ca684791efb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:27.186157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5c48ccfa-e343-42bd-a98d-ca684791efb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:27.198080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48ccfa-e343-42bd-a98d-ca684791efb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:27.199718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48ccfa-e343-42bd-a98d-ca684791efb9 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:27.210782 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1491/3001] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:08:31.382963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a30a6-316c-4925-a211-84f0fedc1936 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:31.383495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a30a6-316c-4925-a211-84f0fedc1936 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:31.383495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a30a6-316c-4925-a211-84f0fedc1936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:31.414945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c25a30a6-316c-4925-a211-84f0fedc1936 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:31.416155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c25a30a6-316c-4925-a211-84f0fedc1936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:31.458305 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:31.476383 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1511/3002] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:31.490536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48ccfa-e343-42bd-a98d-ca684791efb9 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:31.492184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5c48ccfa-e343-42bd-a98d-ca684791efb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:31.563669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48ccfa-e343-42bd-a98d-ca684791efb9 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:31.569268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1143a4-9ef9-4941-b153-34d8ef17124b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:31.569879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1143a4-9ef9-4941-b153-34d8ef17124b service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:31.570178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1143a4-9ef9-4941-b153-34d8ef17124b service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:31.570435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1143a4-9ef9-4941-b153-34d8ef17124b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:31.578968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1143a4-9ef9-4941-b153-34d8ef17124b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:31.580561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1143a4-9ef9-4941-b153-34d8ef17124b service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:31.588867 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1492/3003] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:08:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:08:32.565460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40796394-a40e-434b-82f8-74421f1ca601 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:32.566002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40796394-a40e-434b-82f8-74421f1ca601 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:32.566143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40796394-a40e-434b-82f8-74421f1ca601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:32.595566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-40796394-a40e-434b-82f8-74421f1ca601 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:32.596796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-40796394-a40e-434b-82f8-74421f1ca601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:32.605774 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1512/3004] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:08:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:32.621589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1143a4-9ef9-4941-b153-34d8ef17124b service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:32.635450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1143a4-9ef9-4941-b153-34d8ef17124b service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:32.647472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e485d-81c9-4cf7-9d18-b145ae87b495 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:32.648164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e485d-81c9-4cf7-9d18-b145ae87b495 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:32.648523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e485d-81c9-4cf7-9d18-b145ae87b495 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:32.648886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e485d-81c9-4cf7-9d18-b145ae87b495 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:32.657832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e485d-81c9-4cf7-9d18-b145ae87b495 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:32.659584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e485d-81c9-4cf7-9d18-b145ae87b495 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:32.669402 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1493/3005] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:08:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:08:33.240844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7db54-db2c-44c4-ae16-a7bed642bec3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:33.241202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7db54-db2c-44c4-ae16-a7bed642bec3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:33.241485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7db54-db2c-44c4-ae16-a7bed642bec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:33.265586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-55e7db54-db2c-44c4-ae16-a7bed642bec3 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:33.267284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-55e7db54-db2c-44c4-ae16-a7bed642bec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:33.280680 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1513/3006] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:08:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:33.294864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e485d-81c9-4cf7-9d18-b145ae87b495 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:33.305660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e485d-81c9-4cf7-9d18-b145ae87b495 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:33.312161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f954a-847a-47d8-b414-bf282fd0d513 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:33.313028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f954a-847a-47d8-b414-bf282fd0d513 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:33.313308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f954a-847a-47d8-b414-bf282fd0d513 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:33.313582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f954a-847a-47d8-b414-bf282fd0d513 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:33.322650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f954a-847a-47d8-b414-bf282fd0d513 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:33.324400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f954a-847a-47d8-b414-bf282fd0d513 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:33.333581 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1494/3007] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:08:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:08:37.041484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7db54-db2c-44c4-ae16-a7bed642bec3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:37.065518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7db54-db2c-44c4-ae16-a7bed642bec3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:37.072926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915026d-38bf-45e0-9e8a-5d9e3beea7e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:37.073784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915026d-38bf-45e0-9e8a-5d9e3beea7e6 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:37.074152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915026d-38bf-45e0-9e8a-5d9e3beea7e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:37.074430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915026d-38bf-45e0-9e8a-5d9e3beea7e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:37.077586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6915026d-38bf-45e0-9e8a-5d9e3beea7e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:37.092423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915026d-38bf-45e0-9e8a-5d9e3beea7e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:37.094242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915026d-38bf-45e0-9e8a-5d9e3beea7e6 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:37.105937 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1514/3008] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:08:43.330173 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=53 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:45.756391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f954a-847a-47d8-b414-bf282fd0d513 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:45.758225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7d0f954a-847a-47d8-b414-bf282fd0d513 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:45.946876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f954a-847a-47d8-b414-bf282fd0d513 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:45.955023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cb75a-9f15-4b09-9fb6-bacb8d92100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:45.956020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cb75a-9f15-4b09-9fb6-bacb8d92100c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:45.956544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cb75a-9f15-4b09-9fb6-bacb8d92100c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:45.957079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cb75a-9f15-4b09-9fb6-bacb8d92100c admin admin] PATH_INFO: `/v3/users/26941bac262b4d78a1dc6f5f07c29b91` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:45.958817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cb75a-9f15-4b09-9fb6-bacb8d92100c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26941bac262b4d78a1dc6f5f07c29b91)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:45.967189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cb75a-9f15-4b09-9fb6-bacb8d92100c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:46.086938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ac4cb75a-9f15-4b09-9fb6-bacb8d92100c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26941bac262b4d78a1dc6f5f07c29b91'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:46.103089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ac4cb75a-9f15-4b09-9fb6-bacb8d92100c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26941bac262b4d78a1dc6f5f07c29b91'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:46.103866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ac4cb75a-9f15-4b09-9fb6-bacb8d92100c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26941bac262b4d78a1dc6f5f07c29b91'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:46.124713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ac4cb75a-9f15-4b09-9fb6-bacb8d92100c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26941bac262b4d78a1dc6f5f07c29b91'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:46.137549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ac4cb75a-9f15-4b09-9fb6-bacb8d92100c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26941bac262b4d78a1dc6f5f07c29b91'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:46.147504 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1495/3009] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:08:45 2022] DELETE /identity/v3/users/26941bac262b4d78a1dc6f5f07c29b91 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:08:46.811526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915026d-38bf-45e0-9e8a-5d9e3beea7e6 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:46.830266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915026d-38bf-45e0-9e8a-5d9e3beea7e6 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:46.994449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:46.996420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:46.996420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:46.996420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] PATH_INFO: `/v3/projects/54fc9ec957ec4fa8a613c8f90a5a6bc5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:46.997490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fc9ec957ec4fa8a613c8f90a5a6bc5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:47.003045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:47.142132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'request_id': 'req-eafe03da-8e88-4d71-a5e3-d246cb923ff9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:47.161359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'request_id': 'req-eafe03da-8e88-4d71-a5e3-d246cb923ff9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:47.173556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fc9ec957ec4fa8a613c8f90a5a6bc5', 'request_id': 'req-eafe03da-8e88-4d71-a5e3-d246cb923ff9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:47.224294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] The token cache is being invalidate because project 54fc9ec957ec4fa8a613c8f90a5a6bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:08:47.224598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:47.226099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eafe03da-8e88-4d71-a5e3-d246cb923ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:47.228275 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1515/3010] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:08:46 2022] DELETE /identity/v3/projects/54fc9ec957ec4fa8a613c8f90a5a6bc5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:08:47.234220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b50eb7-d050-4391-a8a5-f3ab87834eb9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:47.235107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b50eb7-d050-4391-a8a5-f3ab87834eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:47.235595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b50eb7-d050-4391-a8a5-f3ab87834eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:47.364564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-45b50eb7-d050-4391-a8a5-f3ab87834eb9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:47.367558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45b50eb7-d050-4391-a8a5-f3ab87834eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:47.389147 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:47.567227 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1496/3011] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:47.575045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d792e85-1988-4f8c-86fd-dbc4da7dacc9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:47.575541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d792e85-1988-4f8c-86fd-dbc4da7dacc9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:47.576129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d792e85-1988-4f8c-86fd-dbc4da7dacc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:47.617720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8d792e85-1988-4f8c-86fd-dbc4da7dacc9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:47.619477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8d792e85-1988-4f8c-86fd-dbc4da7dacc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:47.634082 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1516/3012] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:47.636054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b50eb7-d050-4391-a8a5-f3ab87834eb9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:47.651662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b50eb7-d050-4391-a8a5-f3ab87834eb9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:47.657808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7bbfd-98a7-4dd0-8d2a-cfdaa277d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:47.658730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7bbfd-98a7-4dd0-8d2a-cfdaa277d927 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:47.659786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7bbfd-98a7-4dd0-8d2a-cfdaa277d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:47.659786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7bbfd-98a7-4dd0-8d2a-cfdaa277d927 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:47.660355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7bbfd-98a7-4dd0-8d2a-cfdaa277d927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:08:47.660994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7bbfd-98a7-4dd0-8d2a-cfdaa277d927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:47.663021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7bbfd-98a7-4dd0-8d2a-cfdaa277d927 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:47.679363 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1497/3013] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:08:47.684244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d792e85-1988-4f8c-86fd-dbc4da7dacc9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:47.696213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d792e85-1988-4f8c-86fd-dbc4da7dacc9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:47.703048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43368987-7d50-4753-9899-2761df035ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:47.703920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43368987-7d50-4753-9899-2761df035ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:47.704349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43368987-7d50-4753-9899-2761df035ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:47.705719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43368987-7d50-4753-9899-2761df035ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:47.705719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43368987-7d50-4753-9899-2761df035ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:47.708311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43368987-7d50-4753-9899-2761df035ff4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:47.754517 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1517/3014] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:08:47 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:08:47.756467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7bbfd-98a7-4dd0-8d2a-cfdaa277d927 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:47.769577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7bbfd-98a7-4dd0-8d2a-cfdaa277d927 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:47.901359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31812a-0e98-4643-a603-f9d4fb2c7c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:47.901995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31812a-0e98-4643-a603-f9d4fb2c7c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:47.903197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31812a-0e98-4643-a603-f9d4fb2c7c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:47.903490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31812a-0e98-4643-a603-f9d4fb2c7c03 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:47.904875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31812a-0e98-4643-a603-f9d4fb2c7c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:47.908084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31812a-0e98-4643-a603-f9d4fb2c7c03 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:47.984206 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1498/3015] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:08:47 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:08:47.988816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43368987-7d50-4753-9899-2761df035ff4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:48.002114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43368987-7d50-4753-9899-2761df035ff4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:48.015904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c3d0-73be-4726-9451-edc85c7125a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:48.016900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c3d0-73be-4726-9451-edc85c7125a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:48.017265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c3d0-73be-4726-9451-edc85c7125a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:48.017731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c3d0-73be-4726-9451-edc85c7125a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:48.019339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c3d0-73be-4726-9451-edc85c7125a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:48.032444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c3d0-73be-4726-9451-edc85c7125a4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:48.050652 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1518/3016] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:08:48.054780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31812a-0e98-4643-a603-f9d4fb2c7c03 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:48.067422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31812a-0e98-4643-a603-f9d4fb2c7c03 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:48.072552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c7e1d-f922-4609-a0ba-119aa7d7526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:48.073238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7e1d-f922-4609-a0ba-119aa7d7526c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:48.073594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7e1d-f922-4609-a0ba-119aa7d7526c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:48.073929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7e1d-f922-4609-a0ba-119aa7d7526c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:48.074686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c7e1d-f922-4609-a0ba-119aa7d7526c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:48.076913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c7e1d-f922-4609-a0ba-119aa7d7526c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:48.090662 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1499/3017] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:08:48.095489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c3d0-73be-4726-9451-edc85c7125a4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:48.110768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c3d0-73be-4726-9451-edc85c7125a4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:48.116947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124bc53-b25d-4663-b19a-16bf7b46c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:48.117629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124bc53-b25d-4663-b19a-16bf7b46c5fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:48.118110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124bc53-b25d-4663-b19a-16bf7b46c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:48.118592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124bc53-b25d-4663-b19a-16bf7b46c5fc admin admin] PATH_INFO: `/v3/projects/f9954f609dd340fa9e1ebbb77a5dff3f/users/991f58b08b8e46f1a3fbbfa14d4fd23c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:48.134826 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:48.148676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124bc53-b25d-4663-b19a-16bf7b46c5fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9954f609dd340fa9e1ebbb77a5dff3f, user_id=991f58b08b8e46f1a3fbbfa14d4fd23c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:48.159325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124bc53-b25d-4663-b19a-16bf7b46c5fc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:48.181160 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1519/3018] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:08:48 2022] PUT /identity/v3/projects/f9954f609dd340fa9e1ebbb77a5dff3f/users/991f58b08b8e46f1a3fbbfa14d4fd23c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:08:48.186978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef73608-2601-45b5-a4ca-2054769c3ed0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:48.186978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef73608-2601-45b5-a4ca-2054769c3ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:48.187297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef73608-2601-45b5-a4ca-2054769c3ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:48.215639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cef73608-2601-45b5-a4ca-2054769c3ed0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:48.217475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cef73608-2601-45b5-a4ca-2054769c3ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:48.221200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff042-2cbf-4014-8e04-4aefc30f85d5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:48.222322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff042-2cbf-4014-8e04-4aefc30f85d5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:48.222750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff042-2cbf-4014-8e04-4aefc30f85d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:48.247936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-81aff042-2cbf-4014-8e04-4aefc30f85d5 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:48.249458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-81aff042-2cbf-4014-8e04-4aefc30f85d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:48.303835 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1500/3019] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:48.314954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef73608-2601-45b5-a4ca-2054769c3ed0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:48.316371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cef73608-2601-45b5-a4ca-2054769c3ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:48.330202 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1520/3020] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:48.363940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aff042-2cbf-4014-8e04-4aefc30f85d5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:48.365862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-81aff042-2cbf-4014-8e04-4aefc30f85d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:48.366367 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:48.405329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef73608-2601-45b5-a4ca-2054769c3ed0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:48.409591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c99ad0-f180-4b4c-81d7-e56a819163b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:48.410201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c99ad0-f180-4b4c-81d7-e56a819163b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:48.410699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c99ad0-f180-4b4c-81d7-e56a819163b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:48.411182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c99ad0-f180-4b4c-81d7-e56a819163b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:48.423464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c99ad0-f180-4b4c-81d7-e56a819163b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:48.424934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c99ad0-f180-4b4c-81d7-e56a819163b0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:48.436066 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1501/3021] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:08:48.460014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aff042-2cbf-4014-8e04-4aefc30f85d5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:48.465473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d486ea-5607-49bf-937d-52155d051634 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:48.466112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d486ea-5607-49bf-937d-52155d051634 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:48.466407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d486ea-5607-49bf-937d-52155d051634 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:48.467307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d486ea-5607-49bf-937d-52155d051634 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:48.476590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d486ea-5607-49bf-937d-52155d051634 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:48.478269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d486ea-5607-49bf-937d-52155d051634 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:48.487858 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1521/3022] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:08:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:08:48.715953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4f48a-5c1b-4be3-980d-8275c81589ae None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:48.716312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4f48a-5c1b-4be3-980d-8275c81589ae None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:48.716680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4f48a-5c1b-4be3-980d-8275c81589ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:48.740297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4cd4f48a-5c1b-4be3-980d-8275c81589ae None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:48.741513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4cd4f48a-5c1b-4be3-980d-8275c81589ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:48.751429 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1502/3023] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:48.766093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d486ea-5607-49bf-937d-52155d051634 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:48.777400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d486ea-5607-49bf-937d-52155d051634 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:48.783133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75599-c057-4bba-ba42-4312aeed2d89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:48.783789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75599-c057-4bba-ba42-4312aeed2d89 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:48.784113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75599-c057-4bba-ba42-4312aeed2d89 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:48.784373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75599-c057-4bba-ba42-4312aeed2d89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:48.809201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b75599-c057-4bba-ba42-4312aeed2d89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:48.811262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b75599-c057-4bba-ba42-4312aeed2d89 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:48.843075 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1522/3024] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:08:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:08:48.852524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4f48a-5c1b-4be3-980d-8275c81589ae None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:48.854806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4cd4f48a-5c1b-4be3-980d-8275c81589ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:48.872593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4f48a-5c1b-4be3-980d-8275c81589ae None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:48.880402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a4298-f0c7-4b95-94f3-79005e6ed3ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:48.882041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4298-f0c7-4b95-94f3-79005e6ed3ae service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:48.882494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4298-f0c7-4b95-94f3-79005e6ed3ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:48.883005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4298-f0c7-4b95-94f3-79005e6ed3ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:48.886030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e48a4298-f0c7-4b95-94f3-79005e6ed3ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:49.031839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a4298-f0c7-4b95-94f3-79005e6ed3ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:49.034417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a4298-f0c7-4b95-94f3-79005e6ed3ae service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:49.054974 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1503/3025] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:08:49.083124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbca9a5-d6bd-4737-89a8-5f2e8f21b8e0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:49.083664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbca9a5-d6bd-4737-89a8-5f2e8f21b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:49.083664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbca9a5-d6bd-4737-89a8-5f2e8f21b8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:49.123904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-efbca9a5-d6bd-4737-89a8-5f2e8f21b8e0 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:49.125184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-efbca9a5-d6bd-4737-89a8-5f2e8f21b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:49.144053 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1523/3026] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:08:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:49.163441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a4298-f0c7-4b95-94f3-79005e6ed3ae service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:49.178199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a4298-f0c7-4b95-94f3-79005e6ed3ae service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:49.184576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b69b6a-805a-450e-8b0e-3b84f5c2f181 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:49.185289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b69b6a-805a-450e-8b0e-3b84f5c2f181 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:49.186373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b69b6a-805a-450e-8b0e-3b84f5c2f181 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:49.186683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b69b6a-805a-450e-8b0e-3b84f5c2f181 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:49.196796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b69b6a-805a-450e-8b0e-3b84f5c2f181 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:49.198544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b69b6a-805a-450e-8b0e-3b84f5c2f181 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:49.208580 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1504/3027] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:08:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:08:49.347103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbca9a5-d6bd-4737-89a8-5f2e8f21b8e0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:49.349352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-efbca9a5-d6bd-4737-89a8-5f2e8f21b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:49.376999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbca9a5-d6bd-4737-89a8-5f2e8f21b8e0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:49.384052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:49.386336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:49.386912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:49.387447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] PATH_INFO: `/v3/users/d141ea927c214f978ffdc50892a0dc3c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:49.391865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d141ea927c214f978ffdc50892a0dc3c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:49.395942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:49.503844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd141ea927c214f978ffdc50892a0dc3c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:49.506286 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:49.540060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd141ea927c214f978ffdc50892a0dc3c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:49.540872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd141ea927c214f978ffdc50892a0dc3c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:49.559059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd141ea927c214f978ffdc50892a0dc3c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:49.560656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd141ea927c214f978ffdc50892a0dc3c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:49.596052 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1524/3028] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:08:49 2022] DELETE /identity/v3/users/d141ea927c214f978ffdc50892a0dc3c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:08:49.600951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca8d44-0414-4da8-8f24-d69e727a74dd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:49.601461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca8d44-0414-4da8-8f24-d69e727a74dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:49.601620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca8d44-0414-4da8-8f24-d69e727a74dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:49.627456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3dca8d44-0414-4da8-8f24-d69e727a74dd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:49.629163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3dca8d44-0414-4da8-8f24-d69e727a74dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:49.726152 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1505/3029] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:49.767364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:49.769261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:49.872604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3cbcb-fc5c-45f9-bba3-bd81634abf22 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:49.883287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd98398-6bc2-46c2-8472-ca1e56996a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:49.884124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98398-6bc2-46c2-8472-ca1e56996a59 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:49.884989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98398-6bc2-46c2-8472-ca1e56996a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:49.886149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98398-6bc2-46c2-8472-ca1e56996a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:49.901434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd98398-6bc2-46c2-8472-ca1e56996a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:49.903436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd98398-6bc2-46c2-8472-ca1e56996a59 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:49.916046 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1525/3030] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:08:50.662422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca8d44-0414-4da8-8f24-d69e727a74dd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:50.667985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3dca8d44-0414-4da8-8f24-d69e727a74dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:50.689072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca8d44-0414-4da8-8f24-d69e727a74dd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:50.694187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:50.694908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:50.695191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:50.695464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] PATH_INFO: `/v3/projects/7c58ca9b345e41538c7adb8abde0773f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:50.696617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c58ca9b345e41538c7adb8abde0773f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:50.699101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:50.761206 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:50.780595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c58ca9b345e41538c7adb8abde0773f', 'request_id': 'req-fcf50326-25e6-47ce-9bfc-af9cba8000b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:50.789995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c58ca9b345e41538c7adb8abde0773f', 'request_id': 'req-fcf50326-25e6-47ce-9bfc-af9cba8000b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:50.798893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c58ca9b345e41538c7adb8abde0773f', 'request_id': 'req-fcf50326-25e6-47ce-9bfc-af9cba8000b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:50.825377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] The token cache is being invalidate because project 7c58ca9b345e41538c7adb8abde0773f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:08:50.826010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:50.828090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fcf50326-25e6-47ce-9bfc-af9cba8000b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:08:50.831346 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1506/3031] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:08:50 2022] DELETE /identity/v3/projects/7c58ca9b345e41538c7adb8abde0773f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:08:50.836343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37491c-537d-4ee9-88ba-9c9eff2c4698 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:50.836841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37491c-537d-4ee9-88ba-9c9eff2c4698 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:50.837403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37491c-537d-4ee9-88ba-9c9eff2c4698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:50.862261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2d37491c-537d-4ee9-88ba-9c9eff2c4698 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:50.864071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2d37491c-537d-4ee9-88ba-9c9eff2c4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:50.979480 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1526/3032] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:50.979687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaecfab-28a9-4385-b6f3-5bc4e88397f2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:50.979687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaecfab-28a9-4385-b6f3-5bc4e88397f2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:50.979687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaecfab-28a9-4385-b6f3-5bc4e88397f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:51.018026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ffaecfab-28a9-4385-b6f3-5bc4e88397f2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:51.019396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ffaecfab-28a9-4385-b6f3-5bc4e88397f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:51.032455 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1507/3033] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:51.036766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37491c-537d-4ee9-88ba-9c9eff2c4698 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:51.050824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37491c-537d-4ee9-88ba-9c9eff2c4698 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:51.056476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448ab6b-6438-46b4-a224-2979f3c4236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:51.057275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448ab6b-6438-46b4-a224-2979f3c4236d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:51.058208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448ab6b-6438-46b4-a224-2979f3c4236d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:51.058208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448ab6b-6438-46b4-a224-2979f3c4236d admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:51.058822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448ab6b-6438-46b4-a224-2979f3c4236d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:08:51.059342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448ab6b-6438-46b4-a224-2979f3c4236d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:51.061568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448ab6b-6438-46b4-a224-2979f3c4236d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:51.078489 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1527/3034] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:08:51.083506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaecfab-28a9-4385-b6f3-5bc4e88397f2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:51.094881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaecfab-28a9-4385-b6f3-5bc4e88397f2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:51.101514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8cdc7-903e-4ca3-8821-35d801027ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:51.102638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cdc7-903e-4ca3-8821-35d801027ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:51.102638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cdc7-903e-4ca3-8821-35d801027ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:51.102890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cdc7-903e-4ca3-8821-35d801027ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:51.103475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8cdc7-903e-4ca3-8821-35d801027ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:51.106005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8cdc7-903e-4ca3-8821-35d801027ea6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:51.146681 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1508/3035] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:08:51 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:08:51.150994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448ab6b-6438-46b4-a224-2979f3c4236d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:51.166943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448ab6b-6438-46b4-a224-2979f3c4236d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:51.277535 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:51.291758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d89613-fe52-4e1f-bc13-86a9ce95c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:51.293504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d89613-fe52-4e1f-bc13-86a9ce95c29c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:51.293799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d89613-fe52-4e1f-bc13-86a9ce95c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:51.294086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d89613-fe52-4e1f-bc13-86a9ce95c29c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:51.297144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d89613-fe52-4e1f-bc13-86a9ce95c29c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:51.300217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d89613-fe52-4e1f-bc13-86a9ce95c29c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:51.335951 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1528/3036] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:08:51 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:08:51.339095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8cdc7-903e-4ca3-8821-35d801027ea6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:51.358957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8cdc7-903e-4ca3-8821-35d801027ea6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:51.367417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160107d-1f66-4230-85a4-950d83576782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:51.368209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160107d-1f66-4230-85a4-950d83576782 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:51.368614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160107d-1f66-4230-85a4-950d83576782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:51.369108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160107d-1f66-4230-85a4-950d83576782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:51.369869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160107d-1f66-4230-85a4-950d83576782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:51.374553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160107d-1f66-4230-85a4-950d83576782 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:51.402019 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1509/3037] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:08:51.407114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d89613-fe52-4e1f-bc13-86a9ce95c29c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:51.425928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d89613-fe52-4e1f-bc13-86a9ce95c29c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:51.443712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aeb0d4-ae31-4de7-8bea-21784c534a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:51.444369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeb0d4-ae31-4de7-8bea-21784c534a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:51.444717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeb0d4-ae31-4de7-8bea-21784c534a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:51.445020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeb0d4-ae31-4de7-8bea-21784c534a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:51.447290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aeb0d4-ae31-4de7-8bea-21784c534a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:51.453093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aeb0d4-ae31-4de7-8bea-21784c534a35 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:51.493274 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1529/3038] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:08:51.497589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160107d-1f66-4230-85a4-950d83576782 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:51.523737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160107d-1f66-4230-85a4-950d83576782 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:51.537697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac95fa-9d21-4d00-91ff-358adf49220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:51.540097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac95fa-9d21-4d00-91ff-358adf49220b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:51.541008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac95fa-9d21-4d00-91ff-358adf49220b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:51.541644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac95fa-9d21-4d00-91ff-358adf49220b admin admin] PATH_INFO: `/v3/projects/719a4300966d4b9bbab4b7acea400a07/users/5791be8e4cc8487b87389d46e9f8f980/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:51.577119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac95fa-9d21-4d00-91ff-358adf49220b admin admin] RBAC: Authorizing `identity:create_grant(project_id=719a4300966d4b9bbab4b7acea400a07, user_id=5791be8e4cc8487b87389d46e9f8f980, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:51.581027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac95fa-9d21-4d00-91ff-358adf49220b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:51.610281 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1510/3039] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:08:51 2022] PUT /identity/v3/projects/719a4300966d4b9bbab4b7acea400a07/users/5791be8e4cc8487b87389d46e9f8f980/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:08:51.620993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9c81-a2c6-415b-88ac-793ef242932d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:51.621367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9c81-a2c6-415b-88ac-793ef242932d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:51.621758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9c81-a2c6-415b-88ac-793ef242932d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:51.684310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-427e9c81-a2c6-415b-88ac-793ef242932d None None] MFA Rules not processed for user `5791be8e4cc8487b87389d46e9f8f980`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:51.688222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-427e9c81-a2c6-415b-88ac-793ef242932d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:51.879018 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1530/3040] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:52.106147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac95fa-9d21-4d00-91ff-358adf49220b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:52.108987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-12ac95fa-9d21-4d00-91ff-358adf49220b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:52.332369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac95fa-9d21-4d00-91ff-358adf49220b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:52.349996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d7911-5328-4152-80b2-a91b7a423e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:52.350717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7911-5328-4152-80b2-a91b7a423e59 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:52.351121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7911-5328-4152-80b2-a91b7a423e59 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:52.351669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7911-5328-4152-80b2-a91b7a423e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:52.364716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d7911-5328-4152-80b2-a91b7a423e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:52.368265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d7911-5328-4152-80b2-a91b7a423e59 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:52.414008 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1511/3041] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:08:54.517420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648d59c-b15a-45a2-ba2f-ba69c40c2abe None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:54.517911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648d59c-b15a-45a2-ba2f-ba69c40c2abe None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:54.518032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648d59c-b15a-45a2-ba2f-ba69c40c2abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:54.615976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2648d59c-b15a-45a2-ba2f-ba69c40c2abe None None] MFA Rules not processed for user `991f58b08b8e46f1a3fbbfa14d4fd23c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:54.618032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2648d59c-b15a-45a2-ba2f-ba69c40c2abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:54.803732 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1531/3042] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:54.815599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480f0b-8da7-454c-aa1e-82e28f73f975 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:54.816145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480f0b-8da7-454c-aa1e-82e28f73f975 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:54.816145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480f0b-8da7-454c-aa1e-82e28f73f975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:54.840259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ef480f0b-8da7-454c-aa1e-82e28f73f975 None None] MFA Rules not processed for user `991f58b08b8e46f1a3fbbfa14d4fd23c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:08:54.841409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ef480f0b-8da7-454c-aa1e-82e28f73f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:08:54.853410 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1512/3043] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:08:55.307873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648d59c-b15a-45a2-ba2f-ba69c40c2abe None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:55.323516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648d59c-b15a-45a2-ba2f-ba69c40c2abe None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:55.332179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ca8b1-4b22-4fe1-8387-7ff1b0a88115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:55.333145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ca8b1-4b22-4fe1-8387-7ff1b0a88115 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:55.333500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ca8b1-4b22-4fe1-8387-7ff1b0a88115 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:55.333863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ca8b1-4b22-4fe1-8387-7ff1b0a88115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:55.344005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ca8b1-4b22-4fe1-8387-7ff1b0a88115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:55.345738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ca8b1-4b22-4fe1-8387-7ff1b0a88115 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:08:55.355932 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1532/3044] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:08:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:08:59.662098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef480f0b-8da7-454c-aa1e-82e28f73f975 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:08:59.750325 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:59.903288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef480f0b-8da7-454c-aa1e-82e28f73f975 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:08:59.918330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:08:59.919178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:08:59.919402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:08:59.920068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] PATH_INFO: `/v3/users/5791be8e4cc8487b87389d46e9f8f980` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:08:59.923196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5791be8e4cc8487b87389d46e9f8f980)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:08:59.928712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:00.035303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5791be8e4cc8487b87389d46e9f8f980'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:00.068552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5791be8e4cc8487b87389d46e9f8f980'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:00.069317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5791be8e4cc8487b87389d46e9f8f980'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:00.083318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5791be8e4cc8487b87389d46e9f8f980'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:00.106331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5791be8e4cc8487b87389d46e9f8f980'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:00.132344 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1513/3045] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:08:59 2022] DELETE /identity/v3/users/5791be8e4cc8487b87389d46e9f8f980 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:00.137455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b91125-4f03-4798-97b1-aff8b5687935 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:00.138357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b91125-4f03-4798-97b1-aff8b5687935 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:00.139386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b91125-4f03-4798-97b1-aff8b5687935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:00.174957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-34b91125-4f03-4798-97b1-aff8b5687935 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:00.176511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-34b91125-4f03-4798-97b1-aff8b5687935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:00.250061 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:00.321433 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1533/3046] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:00.329346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:00.331157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:00.576715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef77b1-f6e7-4cff-a0be-951981ff74f0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:00.608485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59e94e-8b49-40d6-9f41-6159078b6acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:00.610544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59e94e-8b49-40d6-9f41-6159078b6acf service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:00.612071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59e94e-8b49-40d6-9f41-6159078b6acf service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:00.613624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59e94e-8b49-40d6-9f41-6159078b6acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:00.638894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59e94e-8b49-40d6-9f41-6159078b6acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:00.641744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59e94e-8b49-40d6-9f41-6159078b6acf service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:00.734178 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1514/3047] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:01.246950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b91125-4f03-4798-97b1-aff8b5687935 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:01.249443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-34b91125-4f03-4798-97b1-aff8b5687935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:01.269926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b91125-4f03-4798-97b1-aff8b5687935 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:01.276218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:01.276908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:01.277187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:01.277459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] PATH_INFO: `/v3/projects/719a4300966d4b9bbab4b7acea400a07` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:01.278918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=719a4300966d4b9bbab4b7acea400a07)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:01.282046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:01.373345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719a4300966d4b9bbab4b7acea400a07', 'request_id': 'req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:01.401038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719a4300966d4b9bbab4b7acea400a07', 'request_id': 'req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:01.418976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719a4300966d4b9bbab4b7acea400a07', 'request_id': 'req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:01.455371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] The token cache is being invalidate because project 719a4300966d4b9bbab4b7acea400a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:09:01.455664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:01.456528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a83e8ca-d19a-44a4-aff5-972e4bcf5238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:01.458306 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1534/3048] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:09:01 2022] DELETE /identity/v3/projects/719a4300966d4b9bbab4b7acea400a07 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:01.468682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa3347-b6e0-43b0-97ed-65374fc7d582 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:01.469014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa3347-b6e0-43b0-97ed-65374fc7d582 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:01.469492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa3347-b6e0-43b0-97ed-65374fc7d582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:01.497741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dffa3347-b6e0-43b0-97ed-65374fc7d582 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:01.500757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dffa3347-b6e0-43b0-97ed-65374fc7d582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:01.533046 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:01.671337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae820-8a7f-4430-ae66-387b0e70858f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:01.671572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae820-8a7f-4430-ae66-387b0e70858f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:01.672044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae820-8a7f-4430-ae66-387b0e70858f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:01.676093 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1515/3049] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:01.710860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c58ae820-8a7f-4430-ae66-387b0e70858f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:01.712423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c58ae820-8a7f-4430-ae66-387b0e70858f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:01.735634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa3347-b6e0-43b0-97ed-65374fc7d582 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:01.741851 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1535/3050] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:01.750694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa3347-b6e0-43b0-97ed-65374fc7d582 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:01.765065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2157e-33f6-47e2-a0a6-e2d607e307b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:01.766030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2157e-33f6-47e2-a0a6-e2d607e307b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:01.766535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2157e-33f6-47e2-a0a6-e2d607e307b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:01.766993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2157e-33f6-47e2-a0a6-e2d607e307b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:01.767952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2157e-33f6-47e2-a0a6-e2d607e307b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:09:01.768436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2157e-33f6-47e2-a0a6-e2d607e307b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:01.770297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2157e-33f6-47e2-a0a6-e2d607e307b5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:01.810439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae820-8a7f-4430-ae66-387b0e70858f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:01.818570 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1516/3051] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:01.826826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae820-8a7f-4430-ae66-387b0e70858f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:01.853106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5c542-5ebe-447d-a494-ebdf7b31aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:01.856186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5c542-5ebe-447d-a494-ebdf7b31aa26 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:01.857226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5c542-5ebe-447d-a494-ebdf7b31aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:01.858991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5c542-5ebe-447d-a494-ebdf7b31aa26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:01.862128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5c542-5ebe-447d-a494-ebdf7b31aa26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:01.865194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5c542-5ebe-447d-a494-ebdf7b31aa26 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:01.940701 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1536/3052] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:09:01 2022] POST /identity/v3/projects => generated 395 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:01.944103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2157e-33f6-47e2-a0a6-e2d607e307b5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:01.960973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2157e-33f6-47e2-a0a6-e2d607e307b5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:02.162108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12edd30-749a-48c3-b816-6565ffc26ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:02.163220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12edd30-749a-48c3-b816-6565ffc26ebc admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:02.164522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12edd30-749a-48c3-b816-6565ffc26ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:02.165432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12edd30-749a-48c3-b816-6565ffc26ebc admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:02.167319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12edd30-749a-48c3-b816-6565ffc26ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:02.173429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12edd30-749a-48c3-b816-6565ffc26ebc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:02.231702 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1517/3053] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:09:01 2022] POST /identity/v3/users => generated 298 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:02.237147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5c542-5ebe-447d-a494-ebdf7b31aa26 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:02.249845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5c542-5ebe-447d-a494-ebdf7b31aa26 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:02.255871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945d421-80b1-4628-9d8a-0b3717c9f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:02.256823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945d421-80b1-4628-9d8a-0b3717c9f14f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:02.258085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945d421-80b1-4628-9d8a-0b3717c9f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:02.258537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945d421-80b1-4628-9d8a-0b3717c9f14f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:02.259413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945d421-80b1-4628-9d8a-0b3717c9f14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:02.261476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945d421-80b1-4628-9d8a-0b3717c9f14f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:02.280512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12edd30-749a-48c3-b816-6565ffc26ebc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:02.289296 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1537/3054] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:09:02.317190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12edd30-749a-48c3-b816-6565ffc26ebc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:02.330467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ee94a-55c8-4a82-9cd9-7831aecfc65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:02.333006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ee94a-55c8-4a82-9cd9-7831aecfc65e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:02.333889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ee94a-55c8-4a82-9cd9-7831aecfc65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:02.334734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ee94a-55c8-4a82-9cd9-7831aecfc65e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:02.337570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ee94a-55c8-4a82-9cd9-7831aecfc65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:02.342910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ee94a-55c8-4a82-9cd9-7831aecfc65e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:02.377237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945d421-80b1-4628-9d8a-0b3717c9f14f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:02.377770 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1518/3055] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:09:02.393199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945d421-80b1-4628-9d8a-0b3717c9f14f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:02.408416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e33906-c87c-4d4a-8036-763b5258f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:02.409123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33906-c87c-4d4a-8036-763b5258f7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:02.409407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33906-c87c-4d4a-8036-763b5258f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:02.409687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33906-c87c-4d4a-8036-763b5258f7b2 admin admin] PATH_INFO: `/v3/projects/ba074ad312cf49778a1df7150186f8bc/users/8d5c11eb2c6546fa81a3972df28dd594/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:02.448188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e33906-c87c-4d4a-8036-763b5258f7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba074ad312cf49778a1df7150186f8bc, user_id=8d5c11eb2c6546fa81a3972df28dd594, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:02.458047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e33906-c87c-4d4a-8036-763b5258f7b2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:02.493628 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1538/3056] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:09:02 2022] PUT /identity/v3/projects/ba074ad312cf49778a1df7150186f8bc/users/8d5c11eb2c6546fa81a3972df28dd594/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:02.497619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f5ab2-0560-4dc9-9e19-5e5c457da2bc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:02.498511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f5ab2-0560-4dc9-9e19-5e5c457da2bc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:02.498655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f5ab2-0560-4dc9-9e19-5e5c457da2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:02.559806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea2f5ab2-0560-4dc9-9e19-5e5c457da2bc None None] MFA Rules not processed for user `8d5c11eb2c6546fa81a3972df28dd594`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:02.563657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea2f5ab2-0560-4dc9-9e19-5e5c457da2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:02.760143 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1519/3057] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:02.779917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37c04e-f570-42ea-b711-bcf93068bf90 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:02.780511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37c04e-f570-42ea-b711-bcf93068bf90 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:02.782248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37c04e-f570-42ea-b711-bcf93068bf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:02.878207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9f37c04e-f570-42ea-b711-bcf93068bf90 None None] MFA Rules not processed for user `8d5c11eb2c6546fa81a3972df28dd594`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:02.879687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9f37c04e-f570-42ea-b711-bcf93068bf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:02.917644 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1539/3058] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:02.937412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f5ab2-0560-4dc9-9e19-5e5c457da2bc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:02.944515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea2f5ab2-0560-4dc9-9e19-5e5c457da2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:02.999009 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:03.127546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f5ab2-0560-4dc9-9e19-5e5c457da2bc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:03.159557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41e21d-171f-40db-ae81-d2afc5691fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:03.162055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41e21d-171f-40db-ae81-d2afc5691fb7 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:03.165442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41e21d-171f-40db-ae81-d2afc5691fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:03.165830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41e21d-171f-40db-ae81-d2afc5691fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:03.195636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41e21d-171f-40db-ae81-d2afc5691fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:03.197580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41e21d-171f-40db-ae81-d2afc5691fb7 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:03.244618 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1520/3059] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:02 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:03.304092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb354f-f59d-4894-8fe7-2e6488d0d128 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:03.304728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb354f-f59d-4894-8fe7-2e6488d0d128 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:03.304728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb354f-f59d-4894-8fe7-2e6488d0d128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:03.365063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-94fb354f-f59d-4894-8fe7-2e6488d0d128 None None] MFA Rules not processed for user `8d5c11eb2c6546fa81a3972df28dd594`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:03.369474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-94fb354f-f59d-4894-8fe7-2e6488d0d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:03.436942 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1540/3060] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:03.463759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28fba0-ea55-4281-aeae-37ff3b0112ed None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:03.464114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28fba0-ea55-4281-aeae-37ff3b0112ed None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:03.464318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28fba0-ea55-4281-aeae-37ff3b0112ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:03.511628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6e28fba0-ea55-4281-aeae-37ff3b0112ed None None] MFA Rules not processed for user `8d5c11eb2c6546fa81a3972df28dd594`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:03.515171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6e28fba0-ea55-4281-aeae-37ff3b0112ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:03.538220 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1521/3061] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:03.576022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272918f6-9d06-4ec6-8ef5-4e3120e38dea None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:03.577010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272918f6-9d06-4ec6-8ef5-4e3120e38dea None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:03.577908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272918f6-9d06-4ec6-8ef5-4e3120e38dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:03.607077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-272918f6-9d06-4ec6-8ef5-4e3120e38dea None None] MFA Rules not processed for user `8d5c11eb2c6546fa81a3972df28dd594`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:03.608937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-272918f6-9d06-4ec6-8ef5-4e3120e38dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:03.618183 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1541/3062] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:03.654293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f8f3-3b43-4d7d-854c-378a94d748f3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:03.654650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f8f3-3b43-4d7d-854c-378a94d748f3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:03.654956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f8f3-3b43-4d7d-854c-378a94d748f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:03.694144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1f28f8f3-3b43-4d7d-854c-378a94d748f3 None None] MFA Rules not processed for user `8d5c11eb2c6546fa81a3972df28dd594`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:03.696218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f28f8f3-3b43-4d7d-854c-378a94d748f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:03.713059 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1522/3063] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:03.741469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272918f6-9d06-4ec6-8ef5-4e3120e38dea None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:03.824808 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:03.880907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272918f6-9d06-4ec6-8ef5-4e3120e38dea None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:03.900544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27515775-1110-42ab-b9ed-fdda91f546f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:03.901349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515775-1110-42ab-b9ed-fdda91f546f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:03.905187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515775-1110-42ab-b9ed-fdda91f546f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:03.905750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515775-1110-42ab-b9ed-fdda91f546f6 admin admin] PATH_INFO: `/v3/users/8d5c11eb2c6546fa81a3972df28dd594` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:03.908632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27515775-1110-42ab-b9ed-fdda91f546f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5c11eb2c6546fa81a3972df28dd594)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:03.916399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27515775-1110-42ab-b9ed-fdda91f546f6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:04.030718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-27515775-1110-42ab-b9ed-fdda91f546f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5c11eb2c6546fa81a3972df28dd594'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:04.041574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28f8f3-3b43-4d7d-854c-378a94d748f3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:04.043279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f28f8f3-3b43-4d7d-854c-378a94d748f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:04.048176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-27515775-1110-42ab-b9ed-fdda91f546f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5c11eb2c6546fa81a3972df28dd594'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:04.050060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-27515775-1110-42ab-b9ed-fdda91f546f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5c11eb2c6546fa81a3972df28dd594'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:04.059480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-27515775-1110-42ab-b9ed-fdda91f546f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5c11eb2c6546fa81a3972df28dd594'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:04.060292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-27515775-1110-42ab-b9ed-fdda91f546f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5c11eb2c6546fa81a3972df28dd594'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:04.072172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28f8f3-3b43-4d7d-854c-378a94d748f3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:04.086385 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1542/3064] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:09:03 2022] DELETE /identity/v3/users/8d5c11eb2c6546fa81a3972df28dd594 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:04.093537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d6194-e039-44b0-8ce0-a8a10921f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:04.094069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285352-ab17-4b18-956c-4a7b2d64ed87 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:04.094195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d6194-e039-44b0-8ce0-a8a10921f5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:04.094449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d6194-e039-44b0-8ce0-a8a10921f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:04.094748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d6194-e039-44b0-8ce0-a8a10921f5ba admin admin] PATH_INFO: `/v3/users/739083b66f9b433889944e555b0aef23` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:04.095757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285352-ab17-4b18-956c-4a7b2d64ed87 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:04.096133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285352-ab17-4b18-956c-4a7b2d64ed87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:04.100679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d6194-e039-44b0-8ce0-a8a10921f5ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=739083b66f9b433889944e555b0aef23)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:04.103388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d6194-e039-44b0-8ce0-a8a10921f5ba admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:04.132016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2e285352-ab17-4b18-956c-4a7b2d64ed87 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:04.133728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2e285352-ab17-4b18-956c-4a7b2d64ed87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:04.212893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e40d6194-e039-44b0-8ce0-a8a10921f5ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '739083b66f9b433889944e555b0aef23'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:04.238364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e40d6194-e039-44b0-8ce0-a8a10921f5ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '739083b66f9b433889944e555b0aef23'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:04.239384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e40d6194-e039-44b0-8ce0-a8a10921f5ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '739083b66f9b433889944e555b0aef23'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:04.245326 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1543/3065] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:04.254285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e40d6194-e039-44b0-8ce0-a8a10921f5ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '739083b66f9b433889944e555b0aef23'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:04.266914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e40d6194-e039-44b0-8ce0-a8a10921f5ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '739083b66f9b433889944e555b0aef23'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:04.277198 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1523/3066] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:09:04 2022] DELETE /identity/v3/users/739083b66f9b433889944e555b0aef23 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:09:04.281147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe1de-e768-4baf-9937-81d7b44fcaf6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:04.281147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe1de-e768-4baf-9937-81d7b44fcaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:04.281591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe1de-e768-4baf-9937-81d7b44fcaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:04.282277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e285352-ab17-4b18-956c-4a7b2d64ed87 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:04.286722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2e285352-ab17-4b18-956c-4a7b2d64ed87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:04.317068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a9cbe1de-e768-4baf-9937-81d7b44fcaf6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:04.321620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a9cbe1de-e768-4baf-9937-81d7b44fcaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:04.379502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e285352-ab17-4b18-956c-4a7b2d64ed87 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:04.408566 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:04.484068 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1524/3067] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:04.493266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2923eab-11c4-40c7-a3a6-20b284897345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:04.494165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923eab-11c4-40c7-a3a6-20b284897345 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:04.494617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923eab-11c4-40c7-a3a6-20b284897345 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:04.495000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923eab-11c4-40c7-a3a6-20b284897345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:04.508249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2923eab-11c4-40c7-a3a6-20b284897345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:04.510519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2923eab-11c4-40c7-a3a6-20b284897345 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:04.525402 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1544/3068] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:04.596213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe1de-e768-4baf-9937-81d7b44fcaf6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:04.613714 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:04.623615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe1de-e768-4baf-9937-81d7b44fcaf6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:04.634466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56c5d8-4f1f-40b2-9804-e0a6884c9417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:04.635372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56c5d8-4f1f-40b2-9804-e0a6884c9417 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:04.637014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56c5d8-4f1f-40b2-9804-e0a6884c9417 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:04.637604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56c5d8-4f1f-40b2-9804-e0a6884c9417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:04.659330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56c5d8-4f1f-40b2-9804-e0a6884c9417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:04.661151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56c5d8-4f1f-40b2-9804-e0a6884c9417 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:04.678019 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1525/3069] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:05.637209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2923eab-11c4-40c7-a3a6-20b284897345 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:05.640115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e2923eab-11c4-40c7-a3a6-20b284897345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:05.659435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2923eab-11c4-40c7-a3a6-20b284897345 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:05.668382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:05.669419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:05.670975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:05.671920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] PATH_INFO: `/v3/projects/c0e072a3f56045949210c8d4452298ce` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:05.674892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e072a3f56045949210c8d4452298ce)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:05.677087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:05.765456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e072a3f56045949210c8d4452298ce', 'request_id': 'req-ca229732-7a49-427e-b406-ed7b2aa935bd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:05.773401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e072a3f56045949210c8d4452298ce', 'request_id': 'req-ca229732-7a49-427e-b406-ed7b2aa935bd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:05.782148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e072a3f56045949210c8d4452298ce', 'request_id': 'req-ca229732-7a49-427e-b406-ed7b2aa935bd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:05.805562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] The token cache is being invalidate because project c0e072a3f56045949210c8d4452298ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:09:05.806451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:05.808389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:05.812830 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1545/3070] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:09:05 2022] DELETE /identity/v3/projects/c0e072a3f56045949210c8d4452298ce => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:05.817085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56c5d8-4f1f-40b2-9804-e0a6884c9417 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:05.832733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56c5d8-4f1f-40b2-9804-e0a6884c9417 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:05.887125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:05.889218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:05.930405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a62244-3643-4365-b6f7-fb09a2e5fe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:05.931551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a62244-3643-4365-b6f7-fb09a2e5fe5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:05.931929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a62244-3643-4365-b6f7-fb09a2e5fe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:05.932336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a62244-3643-4365-b6f7-fb09a2e5fe5d admin admin] PATH_INFO: `/v3/users/bfabe41ff3a6492b95dfcff64ffc38d1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:05.933815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a62244-3643-4365-b6f7-fb09a2e5fe5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfabe41ff3a6492b95dfcff64ffc38d1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:05.936560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a62244-3643-4365-b6f7-fb09a2e5fe5d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:06.039324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d2a62244-3643-4365-b6f7-fb09a2e5fe5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfabe41ff3a6492b95dfcff64ffc38d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.043562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca229732-7a49-427e-b406-ed7b2aa935bd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:06.049689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:06.050516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.050764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.051072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] PATH_INFO: `/v3/projects/ba074ad312cf49778a1df7150186f8bc` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.052221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba074ad312cf49778a1df7150186f8bc)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:06.054235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:06.069094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d2a62244-3643-4365-b6f7-fb09a2e5fe5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfabe41ff3a6492b95dfcff64ffc38d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.070687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d2a62244-3643-4365-b6f7-fb09a2e5fe5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfabe41ff3a6492b95dfcff64ffc38d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.081435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d2a62244-3643-4365-b6f7-fb09a2e5fe5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfabe41ff3a6492b95dfcff64ffc38d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.091061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d2a62244-3643-4365-b6f7-fb09a2e5fe5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfabe41ff3a6492b95dfcff64ffc38d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.109101 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1526/3071] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:09:05 2022] DELETE /identity/v3/users/bfabe41ff3a6492b95dfcff64ffc38d1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:06.111004 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:06.115435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba074ad312cf49778a1df7150186f8bc', 'request_id': 'req-4b41ee3d-40ec-484e-b67f-c1aa996058ac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.122504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba074ad312cf49778a1df7150186f8bc', 'request_id': 'req-4b41ee3d-40ec-484e-b67f-c1aa996058ac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.133538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba074ad312cf49778a1df7150186f8bc', 'request_id': 'req-4b41ee3d-40ec-484e-b67f-c1aa996058ac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.163483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] The token cache is being invalidate because project ba074ad312cf49778a1df7150186f8bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:09:06.163802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.167585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b41ee3d-40ec-484e-b67f-c1aa996058ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.175512 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1546/3072] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:09:05 2022] DELETE /identity/v3/projects/ba074ad312cf49778a1df7150186f8bc => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:09:06.177282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378bdb-7d39-4ee9-aea0-c78bc21f1e03 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.177593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378bdb-7d39-4ee9-aea0-c78bc21f1e03 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.177944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378bdb-7d39-4ee9-aea0-c78bc21f1e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.226718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-62378bdb-7d39-4ee9-aea0-c78bc21f1e03 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:06.227881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62378bdb-7d39-4ee9-aea0-c78bc21f1e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:06.318020 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1527/3073] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:06.325315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c2f0-25ba-4e80-97d9-fea0498830c1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.325596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c2f0-25ba-4e80-97d9-fea0498830c1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.326038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c2f0-25ba-4e80-97d9-fea0498830c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.354187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3433c2f0-25ba-4e80-97d9-fea0498830c1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:06.354187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3433c2f0-25ba-4e80-97d9-fea0498830c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:06.364714 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1547/3074] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:06.368941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378bdb-7d39-4ee9-aea0-c78bc21f1e03 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:06.384508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378bdb-7d39-4ee9-aea0-c78bc21f1e03 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:06.392197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7304-b0a6-490b-afd7-ca600deeb90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:06.392920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7304-b0a6-490b-afd7-ca600deeb90c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.393268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7304-b0a6-490b-afd7-ca600deeb90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.393603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7304-b0a6-490b-afd7-ca600deeb90c admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.394335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7304-b0a6-490b-afd7-ca600deeb90c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:09:06.395601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7304-b0a6-490b-afd7-ca600deeb90c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:06.397682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7304-b0a6-490b-afd7-ca600deeb90c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:06.413528 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:06.419741 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1528/3075] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:06.421308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433c2f0-25ba-4e80-97d9-fea0498830c1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:06.432912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433c2f0-25ba-4e80-97d9-fea0498830c1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:06.442653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7304-b0a6-490b-afd7-ca600deeb90c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:06.444778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4efd7304-b0a6-490b-afd7-ca600deeb90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:06.450327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fc5db-5bcd-49ba-ad13-2b74cc575b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:06.451070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc5db-5bcd-49ba-ad13-2b74cc575b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.451345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc5db-5bcd-49ba-ad13-2b74cc575b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.451628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc5db-5bcd-49ba-ad13-2b74cc575b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.452345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fc5db-5bcd-49ba-ad13-2b74cc575b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:06.454262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fc5db-5bcd-49ba-ad13-2b74cc575b90 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:06.502407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7304-b0a6-490b-afd7-ca600deeb90c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:06.511191 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1548/3076] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:09:06 2022] POST /identity/v3/projects => generated 393 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:06.512455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:06.513102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.513376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.513758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] PATH_INFO: `/v3/projects/0109446141724cb18793396cffef0f5d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.515101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0109446141724cb18793396cffef0f5d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:06.516417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fc5db-5bcd-49ba-ad13-2b74cc575b90 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:06.518054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:06.589634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0109446141724cb18793396cffef0f5d', 'request_id': 'req-6012b8c5-991c-427d-9db9-5c8193759214'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.598824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0109446141724cb18793396cffef0f5d', 'request_id': 'req-6012b8c5-991c-427d-9db9-5c8193759214'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.606781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0109446141724cb18793396cffef0f5d', 'request_id': 'req-6012b8c5-991c-427d-9db9-5c8193759214'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.625273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] The token cache is being invalidate because project 0109446141724cb18793396cffef0f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:09:06.625899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.627239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6012b8c5-991c-427d-9db9-5c8193759214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:06.630698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fc5db-5bcd-49ba-ad13-2b74cc575b90 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:06.647631 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1529/3077] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:09:06 2022] DELETE /identity/v3/projects/0109446141724cb18793396cffef0f5d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:09:06.649309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a392a-0046-45b7-b23b-7ddac9121d82 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.649618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a392a-0046-45b7-b23b-7ddac9121d82 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.650335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a392a-0046-45b7-b23b-7ddac9121d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.689524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-154a392a-0046-45b7-b23b-7ddac9121d82 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:06.690892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-154a392a-0046-45b7-b23b-7ddac9121d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:06.774282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12187-a55c-4b04-980e-ebb4d38c4eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:06.775376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12187-a55c-4b04-980e-ebb4d38c4eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.775723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12187-a55c-4b04-980e-ebb4d38c4eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.776064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12187-a55c-4b04-980e-ebb4d38c4eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.776978 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1530/3078] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:06.777106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c12187-a55c-4b04-980e-ebb4d38c4eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:06.784168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c12187-a55c-4b04-980e-ebb4d38c4eb6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:06.786756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e350b-c163-48e5-8590-7be60e24003e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.787446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e350b-c163-48e5-8590-7be60e24003e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.787936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e350b-c163-48e5-8590-7be60e24003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.820856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c01e350b-c163-48e5-8590-7be60e24003e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:06.822369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c01e350b-c163-48e5-8590-7be60e24003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:06.830281 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1549/3079] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:09:06 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:06.836611 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1531/3080] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:06.836835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12187-a55c-4b04-980e-ebb4d38c4eb6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:06.836835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-29c12187-a55c-4b04-980e-ebb4d38c4eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:06.838919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e350b-c163-48e5-8590-7be60e24003e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:06.851465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12187-a55c-4b04-980e-ebb4d38c4eb6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:06.858516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60e9da-01ce-46ca-9fed-2d0374b31e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:06.859239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e9da-01ce-46ca-9fed-2d0374b31e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.859519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e9da-01ce-46ca-9fed-2d0374b31e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.859794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e9da-01ce-46ca-9fed-2d0374b31e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.860398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e350b-c163-48e5-8590-7be60e24003e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:06.860552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60e9da-01ce-46ca-9fed-2d0374b31e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:06.862262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60e9da-01ce-46ca-9fed-2d0374b31e2c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:06.867103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81c5a-0a06-402a-8256-9ecb8b0df1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:06.868915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81c5a-0a06-402a-8256-9ecb8b0df1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.870040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81c5a-0a06-402a-8256-9ecb8b0df1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.871141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81c5a-0a06-402a-8256-9ecb8b0df1d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.872080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a81c5a-0a06-402a-8256-9ecb8b0df1d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:09:06.872626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a81c5a-0a06-402a-8256-9ecb8b0df1d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:06.874956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a81c5a-0a06-402a-8256-9ecb8b0df1d9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:06.877571 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1550/3081] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:09:06.878587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60e9da-01ce-46ca-9fed-2d0374b31e2c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:06.892220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60e9da-01ce-46ca-9fed-2d0374b31e2c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:06.896599 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1532/3082] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:06.898073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81c5a-0a06-402a-8256-9ecb8b0df1d9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:06.904640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee69314-b7a8-4edd-9045-fdaa1f0cf0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:06.906523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee69314-b7a8-4edd-9045-fdaa1f0cf0de admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.908047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee69314-b7a8-4edd-9045-fdaa1f0cf0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.908353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee69314-b7a8-4edd-9045-fdaa1f0cf0de admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.909128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee69314-b7a8-4edd-9045-fdaa1f0cf0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:06.913100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee69314-b7a8-4edd-9045-fdaa1f0cf0de admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:06.919688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81c5a-0a06-402a-8256-9ecb8b0df1d9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:06.936446 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1551/3083] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:09:06.936986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b402fe-defd-4cfd-8cd6-56d11811a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:06.937365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee69314-b7a8-4edd-9045-fdaa1f0cf0de admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:06.939352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b402fe-defd-4cfd-8cd6-56d11811a2af admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.940101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b402fe-defd-4cfd-8cd6-56d11811a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.940857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b402fe-defd-4cfd-8cd6-56d11811a2af admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.942107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b402fe-defd-4cfd-8cd6-56d11811a2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:06.944698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b402fe-defd-4cfd-8cd6-56d11811a2af admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:06.950773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee69314-b7a8-4edd-9045-fdaa1f0cf0de admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:06.960174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f77111-c113-4c7d-b98a-a797e6f81d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:06.964216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77111-c113-4c7d-b98a-a797e6f81d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:06.966632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77111-c113-4c7d-b98a-a797e6f81d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:06.967652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77111-c113-4c7d-b98a-a797e6f81d4e admin admin] PATH_INFO: `/v3/projects/2b2d3a5d2c4f4761b3bb73e4967ed345/users/df46881c91e8419e84b8679ad474ba44/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:06.988865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f77111-c113-4c7d-b98a-a797e6f81d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2d3a5d2c4f4761b3bb73e4967ed345, user_id=df46881c91e8419e84b8679ad474ba44, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:06.992119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f77111-c113-4c7d-b98a-a797e6f81d4e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:06.996222 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:06.997842 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1533/3084] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:09:06 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:07.001162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b402fe-defd-4cfd-8cd6-56d11811a2af admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:07.010831 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1552/3085] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:09:06 2022] PUT /identity/v3/projects/2b2d3a5d2c4f4761b3bb73e4967ed345/users/df46881c91e8419e84b8679ad474ba44/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:07.017176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d774c-48e7-4a1b-8966-4747de24bbb7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:07.018113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d774c-48e7-4a1b-8966-4747de24bbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:07.018952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d774c-48e7-4a1b-8966-4747de24bbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:07.041462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-682d774c-48e7-4a1b-8966-4747de24bbb7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:07.043100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-682d774c-48e7-4a1b-8966-4747de24bbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:07.066916 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:07.112048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b402fe-defd-4cfd-8cd6-56d11811a2af admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:07.136332 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1553/3086] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:09:07.143210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d774c-48e7-4a1b-8966-4747de24bbb7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:07.144782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-682d774c-48e7-4a1b-8966-4747de24bbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:07.194443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b041cc-374e-4320-a6a2-19e91017cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:07.195170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b041cc-374e-4320-a6a2-19e91017cf47 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:07.195547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b041cc-374e-4320-a6a2-19e91017cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:07.195921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b041cc-374e-4320-a6a2-19e91017cf47 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:07.196670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b041cc-374e-4320-a6a2-19e91017cf47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:07.198914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b041cc-374e-4320-a6a2-19e91017cf47 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:07.232322 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1534/3087] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:09:07 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:09:07.235821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b041cc-374e-4320-a6a2-19e91017cf47 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:07.239332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d774c-48e7-4a1b-8966-4747de24bbb7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:07.248418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6719c24-dcf3-4d80-a36f-9e113651fe46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:07.249490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6719c24-dcf3-4d80-a36f-9e113651fe46 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:07.249490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6719c24-dcf3-4d80-a36f-9e113651fe46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:07.249723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6719c24-dcf3-4d80-a36f-9e113651fe46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:07.254350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b041cc-374e-4320-a6a2-19e91017cf47 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:07.260764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1045d-f608-49dc-ad5d-a0a62b3554e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:07.261246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6719c24-dcf3-4d80-a36f-9e113651fe46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:07.261644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1045d-f608-49dc-ad5d-a0a62b3554e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:07.262030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1045d-f608-49dc-ad5d-a0a62b3554e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:07.262450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1045d-f608-49dc-ad5d-a0a62b3554e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:07.262725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6719c24-dcf3-4d80-a36f-9e113651fe46 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:07.263378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1045d-f608-49dc-ad5d-a0a62b3554e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:07.265145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1045d-f608-49dc-ad5d-a0a62b3554e7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:07.275111 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1554/3088] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:07.278721 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1535/3089] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:09:07.283417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6719c24-dcf3-4d80-a36f-9e113651fe46 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:07.300239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6719c24-dcf3-4d80-a36f-9e113651fe46 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:07.308955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a46b64-bc4d-415c-a5e5-c5c016fc77e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:07.310117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46b64-bc4d-415c-a5e5-c5c016fc77e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:07.310524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46b64-bc4d-415c-a5e5-c5c016fc77e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:07.311025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46b64-bc4d-415c-a5e5-c5c016fc77e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:07.312031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a46b64-bc4d-415c-a5e5-c5c016fc77e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:07.315476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a46b64-bc4d-415c-a5e5-c5c016fc77e7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:07.330719 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1555/3090] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:09:07.338692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1045d-f608-49dc-ad5d-a0a62b3554e7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:07.350194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1045d-f608-49dc-ad5d-a0a62b3554e7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:07.356256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb03926-5d60-4cb6-a6e9-fdf9679eb540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:07.357048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03926-5d60-4cb6-a6e9-fdf9679eb540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:07.358449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03926-5d60-4cb6-a6e9-fdf9679eb540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:07.359006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03926-5d60-4cb6-a6e9-fdf9679eb540 admin admin] PATH_INFO: `/v3/projects/0783778e63cb4dc9b9912ea45e97f080/users/a3efc71478164255ad465405d84b39d0/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:07.379453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb03926-5d60-4cb6-a6e9-fdf9679eb540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0783778e63cb4dc9b9912ea45e97f080, user_id=a3efc71478164255ad465405d84b39d0, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:07.382858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb03926-5d60-4cb6-a6e9-fdf9679eb540 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:07.402518 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1536/3091] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:09:07 2022] PUT /identity/v3/projects/0783778e63cb4dc9b9912ea45e97f080/users/a3efc71478164255ad465405d84b39d0/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:07.414713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d28c55-8c34-4716-a2d5-d41c44d8f9f7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:07.415206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d28c55-8c34-4716-a2d5-d41c44d8f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:07.415443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d28c55-8c34-4716-a2d5-d41c44d8f9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:07.450316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-25d28c55-8c34-4716-a2d5-d41c44d8f9f7 None None] MFA Rules not processed for user `a3efc71478164255ad465405d84b39d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:07.451597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-25d28c55-8c34-4716-a2d5-d41c44d8f9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:07.579323 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1556/3092] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:07.579969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb03926-5d60-4cb6-a6e9-fdf9679eb540 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:07.704578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb03926-5d60-4cb6-a6e9-fdf9679eb540 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:07.714817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca96a4b-9963-45ab-94f4-eabcbbe49f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:07.715540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96a4b-9963-45ab-94f4-eabcbbe49f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:07.715896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96a4b-9963-45ab-94f4-eabcbbe49f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:07.716637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96a4b-9963-45ab-94f4-eabcbbe49f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:07.718258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca96a4b-9963-45ab-94f4-eabcbbe49f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:07.720708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca96a4b-9963-45ab-94f4-eabcbbe49f3c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:07.786103 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1537/3093] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:09:07 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:07.787128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d28c55-8c34-4716-a2d5-d41c44d8f9f7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:07.807464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d28c55-8c34-4716-a2d5-d41c44d8f9f7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:07.839330 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:07.908668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f4f01-56ff-4e13-a587-d4255695ba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:07.909230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f4f01-56ff-4e13-a587-d4255695ba3c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:07.909624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f4f01-56ff-4e13-a587-d4255695ba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:07.910446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f4f01-56ff-4e13-a587-d4255695ba3c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:07.910887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f4f01-56ff-4e13-a587-d4255695ba3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:07.913131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f4f01-56ff-4e13-a587-d4255695ba3c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:07.949144 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1557/3094] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:09:07 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:09:07.953370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca96a4b-9963-45ab-94f4-eabcbbe49f3c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:07.968432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca96a4b-9963-45ab-94f4-eabcbbe49f3c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:07.973769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4672-80b6-4cd5-949f-89df2d51e6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:07.974515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4672-80b6-4cd5-949f-89df2d51e6bd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:07.974898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4672-80b6-4cd5-949f-89df2d51e6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:07.975248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4672-80b6-4cd5-949f-89df2d51e6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:07.976563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4672-80b6-4cd5-949f-89df2d51e6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:07.977753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4672-80b6-4cd5-949f-89df2d51e6bd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:07.993533 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1538/3095] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:09:07.998181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f4f01-56ff-4e13-a587-d4255695ba3c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:08.009211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f4f01-56ff-4e13-a587-d4255695ba3c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:08.015360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96588114-88c9-43db-9b1d-9229e9f94d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:08.015971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96588114-88c9-43db-9b1d-9229e9f94d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:08.016251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96588114-88c9-43db-9b1d-9229e9f94d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:08.016633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96588114-88c9-43db-9b1d-9229e9f94d98 admin admin] PATH_INFO: `/v3/projects/f893e4d3c7e8413796a49852b3d941e8/users/11027cbf508a47d7be66532597f628cc/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:08.035905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96588114-88c9-43db-9b1d-9229e9f94d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f893e4d3c7e8413796a49852b3d941e8, user_id=11027cbf508a47d7be66532597f628cc, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:08.039386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96588114-88c9-43db-9b1d-9229e9f94d98 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:08.058495 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1558/3096] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:09:07 2022] PUT /identity/v3/projects/f893e4d3c7e8413796a49852b3d941e8/users/11027cbf508a47d7be66532597f628cc/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:08.060389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4672-80b6-4cd5-949f-89df2d51e6bd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:08.073086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4672-80b6-4cd5-949f-89df2d51e6bd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:08.101402 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:08.161806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac041c-ac2a-4b0e-9e7f-ff040533c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:08.162829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac041c-ac2a-4b0e-9e7f-ff040533c860 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:08.163308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac041c-ac2a-4b0e-9e7f-ff040533c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:08.163803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac041c-ac2a-4b0e-9e7f-ff040533c860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:08.164807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac041c-ac2a-4b0e-9e7f-ff040533c860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:08.166773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac041c-ac2a-4b0e-9e7f-ff040533c860 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:08.186834 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1539/3097] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:09:08.189303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96588114-88c9-43db-9b1d-9229e9f94d98 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:08.201496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96588114-88c9-43db-9b1d-9229e9f94d98 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:08.208360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e893b8-327d-4024-8408-44d06781cc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:08.209864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e893b8-327d-4024-8408-44d06781cc13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:08.210149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e893b8-327d-4024-8408-44d06781cc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:08.210830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e893b8-327d-4024-8408-44d06781cc13 admin admin] PATH_INFO: `/v3/projects/f893e4d3c7e8413796a49852b3d941e8/users/11027cbf508a47d7be66532597f628cc/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:08.213024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e893b8-327d-4024-8408-44d06781cc13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f893e4d3c7e8413796a49852b3d941e8, user_id=11027cbf508a47d7be66532597f628cc, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:08.215750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e893b8-327d-4024-8408-44d06781cc13 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:08.231115 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1559/3098] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:09:08 2022] PUT /identity/v3/projects/f893e4d3c7e8413796a49852b3d941e8/users/11027cbf508a47d7be66532597f628cc/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:08.242345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c8778-2813-4b33-b411-566a87ef96ba None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:08.243028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c8778-2813-4b33-b411-566a87ef96ba None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:08.243523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c8778-2813-4b33-b411-566a87ef96ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:08.275752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-756c8778-2813-4b33-b411-566a87ef96ba None None] MFA Rules not processed for user `11027cbf508a47d7be66532597f628cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:08.277553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-756c8778-2813-4b33-b411-566a87ef96ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:08.410650 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1540/3099] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:08.413175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e893b8-327d-4024-8408-44d06781cc13 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:08.428023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e893b8-327d-4024-8408-44d06781cc13 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:08.439824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160f6ca-24b1-4a88-8950-2c10ee2ca96f tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:08.440453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160f6ca-24b1-4a88-8950-2c10ee2ca96f tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:08.440733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160f6ca-24b1-4a88-8950-2c10ee2ca96f tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:08.441005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160f6ca-24b1-4a88-8950-2c10ee2ca96f tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:08.441795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160f6ca-24b1-4a88-8950-2c10ee2ca96f tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:09:08.441949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160f6ca-24b1-4a88-8950-2c10ee2ca96f tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:08.443575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160f6ca-24b1-4a88-8950-2c10ee2ca96f tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:08.476867 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1560/3100] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:08.477994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c8778-2813-4b33-b411-566a87ef96ba None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:08.491656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c8778-2813-4b33-b411-566a87ef96ba None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:08.501935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e940852-64ea-4121-8817-9e23c81e4787 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:08.502720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e940852-64ea-4121-8817-9e23c81e4787 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:08.504404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e940852-64ea-4121-8817-9e23c81e4787 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:08.504767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e940852-64ea-4121-8817-9e23c81e4787 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:08.505806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e940852-64ea-4121-8817-9e23c81e4787 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:08.511768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e940852-64ea-4121-8817-9e23c81e4787 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:08.564120 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1541/3101] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:09:08 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:08.568997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160f6ca-24b1-4a88-8950-2c10ee2ca96f tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:08.584331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160f6ca-24b1-4a88-8950-2c10ee2ca96f tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:08.739549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5e7cb-5dfc-41f4-b125-4bc69f0762ca tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:08.740332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5e7cb-5dfc-41f4-b125-4bc69f0762ca tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:08.740726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5e7cb-5dfc-41f4-b125-4bc69f0762ca tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:08.741070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5e7cb-5dfc-41f4-b125-4bc69f0762ca tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:08.741923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5e7cb-5dfc-41f4-b125-4bc69f0762ca tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:09:08.742351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5e7cb-5dfc-41f4-b125-4bc69f0762ca tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:08.747012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5e7cb-5dfc-41f4-b125-4bc69f0762ca tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:08.787717 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1561/3102] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:09:08.799606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e940852-64ea-4121-8817-9e23c81e4787 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:08.801584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2e940852-64ea-4121-8817-9e23c81e4787 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:08.902170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e940852-64ea-4121-8817-9e23c81e4787 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:08.908907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c29d9-8c37-4292-afa6-1c50febe95f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:08.909544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c29d9-8c37-4292-afa6-1c50febe95f5 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:08.909828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c29d9-8c37-4292-afa6-1c50febe95f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:08.910089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c29d9-8c37-4292-afa6-1c50febe95f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:08.920945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c29d9-8c37-4292-afa6-1c50febe95f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:08.923994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c29d9-8c37-4292-afa6-1c50febe95f5 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:08.932322 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:08.949710 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1542/3103] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:08.979947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013cb44-e13b-45b0-b8b7-aefa04a212a1 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:08.980241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013cb44-e13b-45b0-b8b7-aefa04a212a1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:08.980541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013cb44-e13b-45b0-b8b7-aefa04a212a1 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:08.982316 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1562/3104] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:09:08.989033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c29d9-8c37-4292-afa6-1c50febe95f5 service nova] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:09:09.006978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c29d9-8c37-4292-afa6-1c50febe95f5 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:09.032549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c29d9-8c37-4292-afa6-1c50febe95f5 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:09.042642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1dd2-85f3-4771-9d44-c20122ef1f07 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:09.044256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1dd2-85f3-4771-9d44-c20122ef1f07 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:09.045769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1dd2-85f3-4771-9d44-c20122ef1f07 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:09.046302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1dd2-85f3-4771-9d44-c20122ef1f07 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/projects/ed6f8f8b2adf42e8969ca74f151330b3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:09.048442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea1dd2-85f3-4771-9d44-c20122ef1f07 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:get_project(project_id=ed6f8f8b2adf42e8969ca74f151330b3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:09.051860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea1dd2-85f3-4771-9d44-c20122ef1f07 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:09.081422 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1543/3105] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:09:08 2022] GET /identity/v3/projects/ed6f8f8b2adf42e8969ca74f151330b3 => generated 369 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:09.334474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5bf76-0f74-40ce-a723-8f3e5bf7d327 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:09.334794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5bf76-0f74-40ce-a723-8f3e5bf7d327 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:09.335849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5bf76-0f74-40ce-a723-8f3e5bf7d327 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:09.337219 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1563/3106] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:09:09.342833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1dd2-85f3-4771-9d44-c20122ef1f07 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:09:09.372337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1dd2-85f3-4771-9d44-c20122ef1f07 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:09.406625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1dd2-85f3-4771-9d44-c20122ef1f07 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:09.446734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb0386-004d-4693-adfd-15fbb725cfee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:09.449902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0386-004d-4693-adfd-15fbb725cfee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:09.450375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0386-004d-4693-adfd-15fbb725cfee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:09.450966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0386-004d-4693-adfd-15fbb725cfee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/projects/ed6f8f8b2adf42e8969ca74f151330b3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:09.456960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb0386-004d-4693-adfd-15fbb725cfee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:get_project(project_id=ed6f8f8b2adf42e8969ca74f151330b3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:09.465603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb0386-004d-4693-adfd-15fbb725cfee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:09.469387 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1544/3107] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:09:09 2022] GET /identity/v3/projects/ed6f8f8b2adf42e8969ca74f151330b3 => generated 369 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:09.560342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5bf76-0f74-40ce-a723-8f3e5bf7d327 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:09.599202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5bf76-0f74-40ce-a723-8f3e5bf7d327 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:09.611582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d2cc9-6e36-468f-a148-419bde5a23f5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:09.612676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2cc9-6e36-468f-a148-419bde5a23f5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:09.613156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2cc9-6e36-468f-a148-419bde5a23f5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:09.613453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2cc9-6e36-468f-a148-419bde5a23f5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:09.614103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d2cc9-6e36-468f-a148-419bde5a23f5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:09:09.614511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d2cc9-6e36-468f-a148-419bde5a23f5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:09.620051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d2cc9-6e36-468f-a148-419bde5a23f5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:09.671613 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1564/3108] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:09.693039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb0386-004d-4693-adfd-15fbb725cfee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:09.722344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb0386-004d-4693-adfd-15fbb725cfee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:09.742036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a68d8-03bd-42cb-8205-753a11619cee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:09.742769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a68d8-03bd-42cb-8205-753a11619cee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:09.743168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a68d8-03bd-42cb-8205-753a11619cee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:09.743540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a68d8-03bd-42cb-8205-753a11619cee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:09.744318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a68d8-03bd-42cb-8205-753a11619cee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:09.752697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a68d8-03bd-42cb-8205-753a11619cee tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:09.802454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d2cc9-6e36-468f-a148-419bde5a23f5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:09.814338 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1545/3109] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:09:09 2022] POST /identity/v3/users => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:09.818578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d2cc9-6e36-468f-a148-419bde5a23f5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:09.834512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc49dd-32f6-4e15-b34e-4f497338321c tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:09.835777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc49dd-32f6-4e15-b34e-4f497338321c tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:09.836245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc49dd-32f6-4e15-b34e-4f497338321c tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:09.836785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc49dd-32f6-4e15-b34e-4f497338321c tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:09.837745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc49dd-32f6-4e15-b34e-4f497338321c tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:09:09.838228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc49dd-32f6-4e15-b34e-4f497338321c tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:09.840527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc49dd-32f6-4e15-b34e-4f497338321c tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:09.877596 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1565/3110] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:09.911418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d9588-9de7-4258-8db5-25f3ff148f42 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:09.911982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d9588-9de7-4258-8db5-25f3ff148f42 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:09.912514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d9588-9de7-4258-8db5-25f3ff148f42 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:09.914093 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1546/3111] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:09:09.922893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc49dd-32f6-4e15-b34e-4f497338321c tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:09:09.925767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fecc49dd-32f6-4e15-b34e-4f497338321c tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:09.964605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc49dd-32f6-4e15-b34e-4f497338321c tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:09.984106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc49dd-32f6-4e15-b34e-4f497338321c tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:09.989916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cb6cf-929b-4b0f-a5c0-6d6f3395a07e tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:09.990712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cb6cf-929b-4b0f-a5c0-6d6f3395a07e tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:09.991097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cb6cf-929b-4b0f-a5c0-6d6f3395a07e tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:09.991346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cb6cf-929b-4b0f-a5c0-6d6f3395a07e tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/projects/ed6f8f8b2adf42e8969ca74f151330b3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:09.992874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cb6cf-929b-4b0f-a5c0-6d6f3395a07e tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:get_project(project_id=ed6f8f8b2adf42e8969ca74f151330b3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:09.995426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cb6cf-929b-4b0f-a5c0-6d6f3395a07e tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:09.997708 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1566/3112] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:09:09 2022] GET /identity/v3/projects/ed6f8f8b2adf42e8969ca74f151330b3 => generated 369 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:10.160148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9fb76-cc57-4f0b-9b51-75a73434f3ed None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:10.160669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9fb76-cc57-4f0b-9b51-75a73434f3ed None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:10.160669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9fb76-cc57-4f0b-9b51-75a73434f3ed None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:10.162230 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1547/3113] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:09:10.168728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cb6cf-929b-4b0f-a5c0-6d6f3395a07e tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:09:10.215537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cb6cf-929b-4b0f-a5c0-6d6f3395a07e tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:10.227673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cb6cf-929b-4b0f-a5c0-6d6f3395a07e tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:10.233779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c845e37-722b-476b-909f-f6ccd529cfb0 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:10.236157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845e37-722b-476b-909f-f6ccd529cfb0 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:10.236805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845e37-722b-476b-909f-f6ccd529cfb0 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:10.237381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845e37-722b-476b-909f-f6ccd529cfb0 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/projects/ed6f8f8b2adf42e8969ca74f151330b3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:10.239091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c845e37-722b-476b-909f-f6ccd529cfb0 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:get_project(project_id=ed6f8f8b2adf42e8969ca74f151330b3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:10.241426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c845e37-722b-476b-909f-f6ccd529cfb0 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:10.243516 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1567/3114] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:09:10 2022] GET /identity/v3/projects/ed6f8f8b2adf42e8969ca74f151330b3 => generated 369 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:10.285240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9fb76-cc57-4f0b-9b51-75a73434f3ed None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:10.302147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9fb76-cc57-4f0b-9b51-75a73434f3ed None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:10.308847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:10.309669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:10.310061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:10.311115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/users/663c32ffbf804a4bb2833cc3eb798a7d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:10.370011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:delete_user(user_id=663c32ffbf804a4bb2833cc3eb798a7d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:10.377453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:10.494298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663c32ffbf804a4bb2833cc3eb798a7d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:10.523844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663c32ffbf804a4bb2833cc3eb798a7d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:10.526350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663c32ffbf804a4bb2833cc3eb798a7d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:10.546064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663c32ffbf804a4bb2833cc3eb798a7d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:10.559765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663c32ffbf804a4bb2833cc3eb798a7d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:10.571498 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1548/3115] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:09:10 2022] DELETE /identity/v3/users/663c32ffbf804a4bb2833cc3eb798a7d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:10.576808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c845e37-722b-476b-909f-f6ccd529cfb0 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:10.586902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0c845e37-722b-476b-909f-f6ccd529cfb0 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:10.630239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c845e37-722b-476b-909f-f6ccd529cfb0 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:10.646049 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:10.782528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11027cbf508a47d7be66532597f628cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f893e4d3c7e8413796a49852b3d941e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:10.783867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:10.784382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:10.785408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] PATH_INFO: `/v3/projects/ed6f8f8b2adf42e8969ca74f151330b3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:10.787743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ed6f8f8b2adf42e8969ca74f151330b3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:10.793740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:10.871395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6f8f8b2adf42e8969ca74f151330b3', 'request_id': 'req-c08d5131-3901-4fa0-9751-cd15009ae2e5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:10.879291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6f8f8b2adf42e8969ca74f151330b3', 'request_id': 'req-c08d5131-3901-4fa0-9751-cd15009ae2e5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:10.891552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6f8f8b2adf42e8969ca74f151330b3', 'request_id': 'req-c08d5131-3901-4fa0-9751-cd15009ae2e5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:10.914571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] The token cache is being invalidate because project ed6f8f8b2adf42e8969ca74f151330b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:09:10.915096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:10.916183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c08d5131-3901-4fa0-9751-cd15009ae2e5 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:10.919323 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1568/3116] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:09:10 2022] DELETE /identity/v3/projects/ed6f8f8b2adf42e8969ca74f151330b3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:10.926934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:10.929715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:11.095988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86888f-4352-4383-b094-8f80e80f7d00 tempest-QuotasAdminTestV257-845773578 tempest-QuotasAdminTestV257-845773578-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:11.152167 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:11.236079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:11.236813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:11.237193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:11.237526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] PATH_INFO: `/v3/users/a3efc71478164255ad465405d84b39d0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:11.239124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3efc71478164255ad465405d84b39d0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:11.241784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:11.323770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3efc71478164255ad465405d84b39d0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:11.350512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3efc71478164255ad465405d84b39d0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:11.351830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3efc71478164255ad465405d84b39d0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:11.365787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3efc71478164255ad465405d84b39d0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:11.377716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3efc71478164255ad465405d84b39d0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:11.387068 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1549/3117] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:09:10 2022] DELETE /identity/v3/users/a3efc71478164255ad465405d84b39d0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:09:11.392927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a4c2-e47d-4697-824e-4498162fd3ed None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:11.393246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a4c2-e47d-4697-824e-4498162fd3ed None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:11.393636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a4c2-e47d-4697-824e-4498162fd3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:11.423563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7db8a4c2-e47d-4697-824e-4498162fd3ed None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:11.425091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7db8a4c2-e47d-4697-824e-4498162fd3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:11.512117 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1569/3118] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:11.523932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:11.525979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:11.696162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf81a6-e617-459a-af72-c542ea10fa23 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:11.709761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf648fe1-5b34-451e-a8e0-cee9d2bb06ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:11.710628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf648fe1-5b34-451e-a8e0-cee9d2bb06ce service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:11.710995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf648fe1-5b34-451e-a8e0-cee9d2bb06ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:11.711330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf648fe1-5b34-451e-a8e0-cee9d2bb06ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:11.735881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf648fe1-5b34-451e-a8e0-cee9d2bb06ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:11.738315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf648fe1-5b34-451e-a8e0-cee9d2bb06ce service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:11.765885 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1550/3119] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:12.067025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bfe92-9931-44ca-9366-15d35b4f8f2b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:12.068319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bfe92-9931-44ca-9366-15d35b4f8f2b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:12.068944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bfe92-9931-44ca-9366-15d35b4f8f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:12.099914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fc6bfe92-9931-44ca-9366-15d35b4f8f2b None None] MFA Rules not processed for user `d44f8d053e07440699d217cd63c94d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:12.101367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fc6bfe92-9931-44ca-9366-15d35b4f8f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:12.169278 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:12.213508 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1570/3120] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:12.485426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf648fe1-5b34-451e-a8e0-cee9d2bb06ce service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:12.487089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf648fe1-5b34-451e-a8e0-cee9d2bb06ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:12.507506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf648fe1-5b34-451e-a8e0-cee9d2bb06ce service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:12.518919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:12.519662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:12.520012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:12.520360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] PATH_INFO: `/v3/projects/0783778e63cb4dc9b9912ea45e97f080` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:12.524861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0783778e63cb4dc9b9912ea45e97f080)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:12.527017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:12.650927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0783778e63cb4dc9b9912ea45e97f080', 'request_id': 'req-4201294d-3f5a-49d5-b003-cad9cdcd7be8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:12.654819 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:12.672022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0783778e63cb4dc9b9912ea45e97f080', 'request_id': 'req-4201294d-3f5a-49d5-b003-cad9cdcd7be8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:12.693835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0783778e63cb4dc9b9912ea45e97f080', 'request_id': 'req-4201294d-3f5a-49d5-b003-cad9cdcd7be8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:12.738832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] The token cache is being invalidate because project 0783778e63cb4dc9b9912ea45e97f080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:09:12.739555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:12.740916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:12.749710 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1551/3121] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:09:12 2022] DELETE /identity/v3/projects/0783778e63cb4dc9b9912ea45e97f080 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:12.750503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bfe92-9931-44ca-9366-15d35b4f8f2b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:12.779047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bfe92-9931-44ca-9366-15d35b4f8f2b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:12.973732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa717fd-e4d7-4ade-9c43-fa946c227821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:12.975935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa717fd-e4d7-4ade-9c43-fa946c227821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:12.976981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa717fd-e4d7-4ade-9c43-fa946c227821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:12.977301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa717fd-e4d7-4ade-9c43-fa946c227821 admin admin] PATH_INFO: `/v3/users/11027cbf508a47d7be66532597f628cc` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:12.983596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa717fd-e4d7-4ade-9c43-fa946c227821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11027cbf508a47d7be66532597f628cc)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:12.989023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa717fd-e4d7-4ade-9c43-fa946c227821 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:13.086526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fa717fd-e4d7-4ade-9c43-fa946c227821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11027cbf508a47d7be66532597f628cc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:13.118395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fa717fd-e4d7-4ade-9c43-fa946c227821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11027cbf508a47d7be66532597f628cc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:13.120785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fa717fd-e4d7-4ade-9c43-fa946c227821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11027cbf508a47d7be66532597f628cc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:13.164020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fa717fd-e4d7-4ade-9c43-fa946c227821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11027cbf508a47d7be66532597f628cc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:13.165483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fa717fd-e4d7-4ade-9c43-fa946c227821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11027cbf508a47d7be66532597f628cc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:13.193277 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1571/3122] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:09:12 2022] DELETE /identity/v3/users/11027cbf508a47d7be66532597f628cc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:13.898653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:13.900586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:13.941212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201294d-3f5a-49d5-b003-cad9cdcd7be8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:14.124593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:14.125647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:14.126444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:14.126444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] PATH_INFO: `/v3/projects/f893e4d3c7e8413796a49852b3d941e8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:14.129036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f893e4d3c7e8413796a49852b3d941e8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:14.131994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:14.254044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f893e4d3c7e8413796a49852b3d941e8', 'request_id': 'req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:14.301268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f893e4d3c7e8413796a49852b3d941e8', 'request_id': 'req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:14.314560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f893e4d3c7e8413796a49852b3d941e8', 'request_id': 'req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:14.366167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] The token cache is being invalidate because project f893e4d3c7e8413796a49852b3d941e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:09:14.366685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:14.371321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5617d4c8-f9a1-4528-a822-182eb5c3d7b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:14.380429 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1552/3123] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:09:13 2022] DELETE /identity/v3/projects/f893e4d3c7e8413796a49852b3d941e8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:14.382118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480cd1-32af-4e37-922c-705b50a9318f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:14.382592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480cd1-32af-4e37-922c-705b50a9318f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:14.382730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480cd1-32af-4e37-922c-705b50a9318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:14.421640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ed480cd1-32af-4e37-922c-705b50a9318f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:14.424280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ed480cd1-32af-4e37-922c-705b50a9318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:14.528418 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1572/3124] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:14.536358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f16f-1029-48ab-96d5-d9a4d85d2f5b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:14.536642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f16f-1029-48ab-96d5-d9a4d85d2f5b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:14.536920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f16f-1029-48ab-96d5-d9a4d85d2f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:14.569181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1ac2f16f-1029-48ab-96d5-d9a4d85d2f5b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:14.571323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ac2f16f-1029-48ab-96d5-d9a4d85d2f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:14.597453 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1553/3125] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:14.602452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480cd1-32af-4e37-922c-705b50a9318f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:14.608661 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:14.618816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480cd1-32af-4e37-922c-705b50a9318f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:14.631701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542ba64-6638-44df-8239-ddbb89931a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:14.633308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542ba64-6638-44df-8239-ddbb89931a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:14.633775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542ba64-6638-44df-8239-ddbb89931a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:14.634266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542ba64-6638-44df-8239-ddbb89931a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:14.635171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542ba64-6638-44df-8239-ddbb89931a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:09:14.635698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542ba64-6638-44df-8239-ddbb89931a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:14.640223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542ba64-6638-44df-8239-ddbb89931a80 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:14.671453 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1573/3126] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:14.675609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2f16f-1029-48ab-96d5-d9a4d85d2f5b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:14.689571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2f16f-1029-48ab-96d5-d9a4d85d2f5b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:14.696887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b080b-749a-4850-9427-37b105aab272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:14.697618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b080b-749a-4850-9427-37b105aab272 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:14.698555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b080b-749a-4850-9427-37b105aab272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:14.698893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b080b-749a-4850-9427-37b105aab272 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:14.699828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b080b-749a-4850-9427-37b105aab272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:14.705013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b080b-749a-4850-9427-37b105aab272 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:14.749178 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1554/3127] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:09:14 2022] POST /identity/v3/projects => generated 391 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:14.753064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542ba64-6638-44df-8239-ddbb89931a80 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:14.770097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542ba64-6638-44df-8239-ddbb89931a80 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:14.860729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7f378-daba-4b8b-ab16-9f0239a66bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:14.861461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f378-daba-4b8b-ab16-9f0239a66bde admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:14.861833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f378-daba-4b8b-ab16-9f0239a66bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:14.862201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f378-daba-4b8b-ab16-9f0239a66bde admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:14.863000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7f378-daba-4b8b-ab16-9f0239a66bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:14.865779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7f378-daba-4b8b-ab16-9f0239a66bde admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:14.907076 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1574/3128] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:09:14 2022] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:14.908705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b080b-749a-4850-9427-37b105aab272 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:14.923106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b080b-749a-4850-9427-37b105aab272 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:14.930556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c41e9-69ea-46ca-91d9-6ac42b2c27ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:14.931355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c41e9-69ea-46ca-91d9-6ac42b2c27ec admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:14.931724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c41e9-69ea-46ca-91d9-6ac42b2c27ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:14.932370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c41e9-69ea-46ca-91d9-6ac42b2c27ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:14.933717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c41e9-69ea-46ca-91d9-6ac42b2c27ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:14.936480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c41e9-69ea-46ca-91d9-6ac42b2c27ec admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:14.949453 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1555/3129] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:09:14.954505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7f378-daba-4b8b-ab16-9f0239a66bde admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:14.980641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28066a34-99d9-456e-b7d6-fda825b5eae6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:14.981356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28066a34-99d9-456e-b7d6-fda825b5eae6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:14.981696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28066a34-99d9-456e-b7d6-fda825b5eae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:14.984343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7f378-daba-4b8b-ab16-9f0239a66bde admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:14.993248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c0c8b-3e39-4896-939c-fef64e984526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:14.994419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c0c8b-3e39-4896-939c-fef64e984526 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:14.994805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c0c8b-3e39-4896-939c-fef64e984526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:14.995322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c0c8b-3e39-4896-939c-fef64e984526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:14.996119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c0c8b-3e39-4896-939c-fef64e984526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:14.999625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c0c8b-3e39-4896-939c-fef64e984526 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:15.023909 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1575/3130] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:09:15.024825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-28066a34-99d9-456e-b7d6-fda825b5eae6 None None] MFA Rules not processed for user `df46881c91e8419e84b8679ad474ba44`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:15.025071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c0c8b-3e39-4896-939c-fef64e984526 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:15.026884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28066a34-99d9-456e-b7d6-fda825b5eae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:15.039476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c0c8b-3e39-4896-939c-fef64e984526 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:15.048695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260de93-7e10-4d00-af9f-a42d7d232bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:15.048912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260de93-7e10-4d00-af9f-a42d7d232bde admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:15.049294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260de93-7e10-4d00-af9f-a42d7d232bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:15.049679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260de93-7e10-4d00-af9f-a42d7d232bde admin admin] PATH_INFO: `/v3/projects/352d900890d9490c9ab92fdc7c889532/users/7736193e78da4210ad696e5e61ca088c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:15.051337 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:15.071838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260de93-7e10-4d00-af9f-a42d7d232bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=352d900890d9490c9ab92fdc7c889532, user_id=7736193e78da4210ad696e5e61ca088c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:15.075632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260de93-7e10-4d00-af9f-a42d7d232bde admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:15.098674 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1576/3131] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:09:15 2022] PUT /identity/v3/projects/352d900890d9490c9ab92fdc7c889532/users/7736193e78da4210ad696e5e61ca088c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:15.109749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef7b2-6bc7-4664-a63b-8643dc39b0b8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:15.110038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef7b2-6bc7-4664-a63b-8643dc39b0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:15.110533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef7b2-6bc7-4664-a63b-8643dc39b0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:15.148469 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1556/3132] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:15.159333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702b2b-7de6-40b9-8810-49bbf5716aa7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:15.159765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702b2b-7de6-40b9-8810-49bbf5716aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:15.160168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702b2b-7de6-40b9-8810-49bbf5716aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:15.160540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-703ef7b2-6bc7-4664-a63b-8643dc39b0b8 None None] MFA Rules not processed for user `7736193e78da4210ad696e5e61ca088c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:15.161797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-703ef7b2-6bc7-4664-a63b-8643dc39b0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:15.191124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fa702b2b-7de6-40b9-8810-49bbf5716aa7 None None] MFA Rules not processed for user `df46881c91e8419e84b8679ad474ba44`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:15.192884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fa702b2b-7de6-40b9-8810-49bbf5716aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:15.283923 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1557/3133] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:09:15.292619 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1577/3134] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:09:15.299683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa702b2b-7de6-40b9-8810-49bbf5716aa7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:15.315639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ef7b2-6bc7-4664-a63b-8643dc39b0b8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:15.317364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-703ef7b2-6bc7-4664-a63b-8643dc39b0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:15.408759 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:15.463412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa702b2b-7de6-40b9-8810-49bbf5716aa7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:15.474353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8b141-bb12-49ec-9446-8c78d90b97e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:15.475425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8b141-bb12-49ec-9446-8c78d90b97e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:15.475839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8b141-bb12-49ec-9446-8c78d90b97e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:15.477484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8b141-bb12-49ec-9446-8c78d90b97e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:15.478153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8b141-bb12-49ec-9446-8c78d90b97e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:15.479838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ef7b2-6bc7-4664-a63b-8643dc39b0b8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:15.485263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8b141-bb12-49ec-9446-8c78d90b97e0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:15.498407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e241a1-252e-4e29-903b-76ed8bfc2f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:15.499205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e241a1-252e-4e29-903b-76ed8bfc2f0e service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:15.499704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e241a1-252e-4e29-903b-76ed8bfc2f0e service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:15.501571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e241a1-252e-4e29-903b-76ed8bfc2f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:15.527281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e241a1-252e-4e29-903b-76ed8bfc2f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:15.532310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e241a1-252e-4e29-903b-76ed8bfc2f0e service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:15.561261 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1578/3135] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:15 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:09:15.565027 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1558/3136] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:09:15 2022] POST /identity/v3/projects => generated 391 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:15.566508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8b141-bb12-49ec-9446-8c78d90b97e0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:15.739681 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:15.770635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8b141-bb12-49ec-9446-8c78d90b97e0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:15.784953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930df31-2b51-42d0-8564-c263a7d8069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:15.788316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930df31-2b51-42d0-8564-c263a7d8069a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:15.788613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930df31-2b51-42d0-8564-c263a7d8069a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:15.789048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930df31-2b51-42d0-8564-c263a7d8069a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:15.789863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930df31-2b51-42d0-8564-c263a7d8069a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:15.797188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930df31-2b51-42d0-8564-c263a7d8069a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:15.879905 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1559/3137] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:09:15 2022] POST /identity/v3/users => generated 302 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:15.883989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e241a1-252e-4e29-903b-76ed8bfc2f0e service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:15.898354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e241a1-252e-4e29-903b-76ed8bfc2f0e service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:15.904811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd10b0-5906-4e80-8844-5b8ab0ff1d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:15.910093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd10b0-5906-4e80-8844-5b8ab0ff1d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:15.910412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd10b0-5906-4e80-8844-5b8ab0ff1d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:15.913043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd10b0-5906-4e80-8844-5b8ab0ff1d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:15.913774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd10b0-5906-4e80-8844-5b8ab0ff1d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:15.917962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd10b0-5906-4e80-8844-5b8ab0ff1d83 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:15.944585 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1579/3138] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:09:15.949075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930df31-2b51-42d0-8564-c263a7d8069a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:15.965711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930df31-2b51-42d0-8564-c263a7d8069a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:15.979247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacad86-80c3-42fc-b701-c8be41b89535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:15.980689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacad86-80c3-42fc-b701-c8be41b89535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:15.981171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacad86-80c3-42fc-b701-c8be41b89535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:15.981515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacad86-80c3-42fc-b701-c8be41b89535 admin admin] PATH_INFO: `/v3/projects/4bda47c12c134b48bed286a205e88e3e/users/be7b7c6ca9d84c19884aeeb452fe9909/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:16.004852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacad86-80c3-42fc-b701-c8be41b89535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bda47c12c134b48bed286a205e88e3e, user_id=be7b7c6ca9d84c19884aeeb452fe9909, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:16.008024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacad86-80c3-42fc-b701-c8be41b89535 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:16.049309 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1560/3139] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:09:15 2022] PUT /identity/v3/projects/4bda47c12c134b48bed286a205e88e3e/users/be7b7c6ca9d84c19884aeeb452fe9909/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:16.053249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd10b0-5906-4e80-8844-5b8ab0ff1d83 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:16.071930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd10b0-5906-4e80-8844-5b8ab0ff1d83 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:16.177557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4ed70-21e9-4681-8e27-2f9bb5b0ea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:16.178494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4ed70-21e9-4681-8e27-2f9bb5b0ea98 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:16.178802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4ed70-21e9-4681-8e27-2f9bb5b0ea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:16.179122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4ed70-21e9-4681-8e27-2f9bb5b0ea98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:16.179790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4ed70-21e9-4681-8e27-2f9bb5b0ea98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:16.183170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4ed70-21e9-4681-8e27-2f9bb5b0ea98 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:16.218631 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1580/3140] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:09:16.222824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacad86-80c3-42fc-b701-c8be41b89535 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:16.236438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacad86-80c3-42fc-b701-c8be41b89535 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:16.245393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb822c0-d743-4c8e-a7e0-8865646aaf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:16.246240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb822c0-d743-4c8e-a7e0-8865646aaf21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:16.246519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb822c0-d743-4c8e-a7e0-8865646aaf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:16.246945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb822c0-d743-4c8e-a7e0-8865646aaf21 admin admin] PATH_INFO: `/v3/projects/4bda47c12c134b48bed286a205e88e3e/users/be7b7c6ca9d84c19884aeeb452fe9909/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:16.250380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb822c0-d743-4c8e-a7e0-8865646aaf21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bda47c12c134b48bed286a205e88e3e, user_id=be7b7c6ca9d84c19884aeeb452fe9909, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:16.253337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb822c0-d743-4c8e-a7e0-8865646aaf21 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:16.276374 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1561/3141] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:09:16 2022] PUT /identity/v3/projects/4bda47c12c134b48bed286a205e88e3e/users/be7b7c6ca9d84c19884aeeb452fe9909/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:16.278960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda6ab-c11b-48f9-8f28-adbee8578e48 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:16.279763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda6ab-c11b-48f9-8f28-adbee8578e48 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:16.280069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda6ab-c11b-48f9-8f28-adbee8578e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:16.322854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0fcda6ab-c11b-48f9-8f28-adbee8578e48 None None] MFA Rules not processed for user `be7b7c6ca9d84c19884aeeb452fe9909`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:16.324087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0fcda6ab-c11b-48f9-8f28-adbee8578e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:16.434671 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1581/3142] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:16.449280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4b98-cac3-4a42-8dc2-fb5dd04fce59 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:16.450936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4b98-cac3-4a42-8dc2-fb5dd04fce59 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:16.451362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4b98-cac3-4a42-8dc2-fb5dd04fce59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:16.492762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-62ee4b98-cac3-4a42-8dc2-fb5dd04fce59 None None] MFA Rules not processed for user `7736193e78da4210ad696e5e61ca088c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:16.493587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62ee4b98-cac3-4a42-8dc2-fb5dd04fce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:16.602671 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1562/3143] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:16.613868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcda6ab-c11b-48f9-8f28-adbee8578e48 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:16.655010 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:16.750659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a33e77-2f71-4f79-917e-b16117b5d2a3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:16.750996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a33e77-2f71-4f79-917e-b16117b5d2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:16.751327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a33e77-2f71-4f79-917e-b16117b5d2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:16.789647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-16a33e77-2f71-4f79-917e-b16117b5d2a3 None None] MFA Rules not processed for user `df46881c91e8419e84b8679ad474ba44`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:16.791015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-16a33e77-2f71-4f79-917e-b16117b5d2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:16.834230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcda6ab-c11b-48f9-8f28-adbee8578e48 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:16.857225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b40865-1b40-4a82-bbaf-038b07eeaf02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:16.858765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40865-1b40-4a82-bbaf-038b07eeaf02 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:16.859007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40865-1b40-4a82-bbaf-038b07eeaf02 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:16.859282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40865-1b40-4a82-bbaf-038b07eeaf02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:16.885823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b40865-1b40-4a82-bbaf-038b07eeaf02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:16.887478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b40865-1b40-4a82-bbaf-038b07eeaf02 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:16.906734 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1582/3144] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:17.000721 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1563/3145] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:20.313044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbdd41-723e-46f9-8202-0f8247a320e2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:20.313460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbdd41-723e-46f9-8202-0f8247a320e2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:20.314073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbdd41-723e-46f9-8202-0f8247a320e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:20.366566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1dcbdd41-723e-46f9-8202-0f8247a320e2 None None] MFA Rules not processed for user `991f58b08b8e46f1a3fbbfa14d4fd23c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:20.369277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1dcbdd41-723e-46f9-8202-0f8247a320e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:20.482283 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1583/3146] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:26.949441 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=72,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:30.461265 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=46 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:39.206685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a33e77-2f71-4f79-917e-b16117b5d2a3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:39.221538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a33e77-2f71-4f79-917e-b16117b5d2a3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:39.227769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeb495-7819-4e32-80be-3fc2e406c95e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:39.228768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeb495-7819-4e32-80be-3fc2e406c95e service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:39.229106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeb495-7819-4e32-80be-3fc2e406c95e service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:39.229469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeb495-7819-4e32-80be-3fc2e406c95e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:39.239336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeb495-7819-4e32-80be-3fc2e406c95e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:39.241322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeb495-7819-4e32-80be-3fc2e406c95e service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:39.268173 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1564/3147] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:39 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:39.292791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5d0e0-6f1e-426b-8946-1a50f55d13d0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:39.293251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5d0e0-6f1e-426b-8946-1a50f55d13d0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:39.293326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5d0e0-6f1e-426b-8946-1a50f55d13d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:39.329535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3cf5d0e0-6f1e-426b-8946-1a50f55d13d0 None None] MFA Rules not processed for user `7736193e78da4210ad696e5e61ca088c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:39.337937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3cf5d0e0-6f1e-426b-8946-1a50f55d13d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:39.363209 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1584/3148] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:49.249661 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:49.310813 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:50.522796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeb495-7819-4e32-80be-3fc2e406c95e service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:50.524324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7bdeb495-7819-4e32-80be-3fc2e406c95e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:50.612570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5d0e0-6f1e-426b-8946-1a50f55d13d0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:50.614097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3cf5d0e0-6f1e-426b-8946-1a50f55d13d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:50.671609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeb495-7819-4e32-80be-3fc2e406c95e service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:50.677902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82988251-a9c7-4323-8f4a-f14deefa3467 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:50.679610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82988251-a9c7-4323-8f4a-f14deefa3467 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:50.680144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82988251-a9c7-4323-8f4a-f14deefa3467 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:50.680571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82988251-a9c7-4323-8f4a-f14deefa3467 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:50.683134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-82988251-a9c7-4323-8f4a-f14deefa3467 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:50.700653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82988251-a9c7-4323-8f4a-f14deefa3467 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:50.704270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82988251-a9c7-4323-8f4a-f14deefa3467 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:50.725494 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1565/3149] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:50.742916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5d0e0-6f1e-426b-8946-1a50f55d13d0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:50.749273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabf600-4d3b-41bf-bc3e-3808d0d3ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:50.749993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabf600-4d3b-41bf-bc3e-3808d0d3ccac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:50.750275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabf600-4d3b-41bf-bc3e-3808d0d3ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:50.750546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabf600-4d3b-41bf-bc3e-3808d0d3ccac admin admin] PATH_INFO: `/v3/users/ddc06a9186b9434d86d5815276c9b51d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:50.751737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabf600-4d3b-41bf-bc3e-3808d0d3ccac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc06a9186b9434d86d5815276c9b51d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:50.753780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabf600-4d3b-41bf-bc3e-3808d0d3ccac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:50.855043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fbabf600-4d3b-41bf-bc3e-3808d0d3ccac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc06a9186b9434d86d5815276c9b51d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:50.870401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fbabf600-4d3b-41bf-bc3e-3808d0d3ccac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc06a9186b9434d86d5815276c9b51d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:50.871968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fbabf600-4d3b-41bf-bc3e-3808d0d3ccac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc06a9186b9434d86d5815276c9b51d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:50.892603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fbabf600-4d3b-41bf-bc3e-3808d0d3ccac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc06a9186b9434d86d5815276c9b51d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:50.893393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fbabf600-4d3b-41bf-bc3e-3808d0d3ccac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc06a9186b9434d86d5815276c9b51d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:50.933289 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1585/3150] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:09:50 2022] DELETE /identity/v3/users/ddc06a9186b9434d86d5815276c9b51d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:51.206146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82988251-a9c7-4323-8f4a-f14deefa3467 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:51.220023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82988251-a9c7-4323-8f4a-f14deefa3467 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:51.374948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:51.377640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:51.378096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:51.379270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] PATH_INFO: `/v3/projects/8639be724fdc4c128da53dd69fbbc356` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:51.384404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8639be724fdc4c128da53dd69fbbc356)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:51.392839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:51.495654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8639be724fdc4c128da53dd69fbbc356', 'request_id': 'req-4363d8fa-9c6e-4898-bd80-4530e0430f73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:51.504958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8639be724fdc4c128da53dd69fbbc356', 'request_id': 'req-4363d8fa-9c6e-4898-bd80-4530e0430f73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:51.513435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8639be724fdc4c128da53dd69fbbc356', 'request_id': 'req-4363d8fa-9c6e-4898-bd80-4530e0430f73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:51.532298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] The token cache is being invalidate because project 8639be724fdc4c128da53dd69fbbc356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:09:51.533267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:51.534126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4363d8fa-9c6e-4898-bd80-4530e0430f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:09:51.540725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc79e-7d49-4700-a43c-f45bf31977f2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:51.541012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc79e-7d49-4700-a43c-f45bf31977f2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:51.543214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc79e-7d49-4700-a43c-f45bf31977f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:51.546340 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1566/3151] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:09:51 2022] DELETE /identity/v3/projects/8639be724fdc4c128da53dd69fbbc356 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:51.578411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a6cdc79e-7d49-4700-a43c-f45bf31977f2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:51.585050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a6cdc79e-7d49-4700-a43c-f45bf31977f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:51.689363 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1586/3152] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:51.699609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf048-ac89-47c6-85ba-87c29068cbc4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:51.699891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf048-ac89-47c6-85ba-87c29068cbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:51.700162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf048-ac89-47c6-85ba-87c29068cbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:51.720985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-43baf048-ac89-47c6-85ba-87c29068cbc4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:51.723051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-43baf048-ac89-47c6-85ba-87c29068cbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:51.738557 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1567/3153] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:51.739494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdc79e-7d49-4700-a43c-f45bf31977f2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:51.752337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdc79e-7d49-4700-a43c-f45bf31977f2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:51.758740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec8f5b-228a-4f41-bd78-64802589f089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:51.759737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec8f5b-228a-4f41-bd78-64802589f089 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:51.760166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec8f5b-228a-4f41-bd78-64802589f089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:51.760585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec8f5b-228a-4f41-bd78-64802589f089 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:51.761392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec8f5b-228a-4f41-bd78-64802589f089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:09:51.761830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec8f5b-228a-4f41-bd78-64802589f089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:51.764424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec8f5b-228a-4f41-bd78-64802589f089 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:51.787565 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1587/3154] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:09:51.791747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4bd04-8a8c-40eb-8525-6c5ccf4188e7 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:51.792034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4bd04-8a8c-40eb-8525-6c5ccf4188e7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:51.792534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4bd04-8a8c-40eb-8525-6c5ccf4188e7 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:51.794056 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1568/3155] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:09:51.795079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec8f5b-228a-4f41-bd78-64802589f089 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:51.801814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f050d-6281-4b90-9645-5efe894cb83b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:51.802973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f050d-6281-4b90-9645-5efe894cb83b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:51.803581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f050d-6281-4b90-9645-5efe894cb83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:51.810297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec8f5b-228a-4f41-bd78-64802589f089 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:51.817780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedb68e-1117-457e-b3f0-49ab6451fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:51.820560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb68e-1117-457e-b3f0-49ab6451fe41 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:51.821224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb68e-1117-457e-b3f0-49ab6451fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:51.821656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb68e-1117-457e-b3f0-49ab6451fe41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:51.822774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedb68e-1117-457e-b3f0-49ab6451fe41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:51.825244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedb68e-1117-457e-b3f0-49ab6451fe41 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:51.835349 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:51.843279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d45f050d-6281-4b90-9645-5efe894cb83b None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:51.845672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d45f050d-6281-4b90-9645-5efe894cb83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:51.864976 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:51.898806 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1588/3156] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:09:51 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:51.903061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedb68e-1117-457e-b3f0-49ab6451fe41 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:51.962683 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1569/3157] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:51.989457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f050d-6281-4b90-9645-5efe894cb83b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:51.991994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d45f050d-6281-4b90-9645-5efe894cb83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:51.999332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedb68e-1117-457e-b3f0-49ab6451fe41 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:52.005717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cb4ed-ad5a-406c-85c7-ca0925e8f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:52.006810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb4ed-ad5a-406c-85c7-ca0925e8f88f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:52.006977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb4ed-ad5a-406c-85c7-ca0925e8f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:52.007761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb4ed-ad5a-406c-85c7-ca0925e8f88f admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:52.008529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cb4ed-ad5a-406c-85c7-ca0925e8f88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:52.008895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f050d-6281-4b90-9645-5efe894cb83b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:52.011427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cb4ed-ad5a-406c-85c7-ca0925e8f88f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:52.064179 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1589/3158] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:09:51 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:09:52.068287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cb4ed-ad5a-406c-85c7-ca0925e8f88f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:52.073199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d095cb-751f-450d-9292-d1fe9d08f526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:52.074070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d095cb-751f-450d-9292-d1fe9d08f526 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:52.074403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d095cb-751f-450d-9292-d1fe9d08f526 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:52.074771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d095cb-751f-450d-9292-d1fe9d08f526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:52.084052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d095cb-751f-450d-9292-d1fe9d08f526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:52.085758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d095cb-751f-450d-9292-d1fe9d08f526 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:52.093730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cb4ed-ad5a-406c-85c7-ca0925e8f88f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:52.105027 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1570/3159] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:09:52.111748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe2443-a899-4ab7-a8c2-a5873b425002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:52.112380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe2443-a899-4ab7-a8c2-a5873b425002 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:52.112664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe2443-a899-4ab7-a8c2-a5873b425002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:52.112939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe2443-a899-4ab7-a8c2-a5873b425002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:52.113988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe2443-a899-4ab7-a8c2-a5873b425002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:52.115651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe2443-a899-4ab7-a8c2-a5873b425002 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:52.130175 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1590/3160] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:09:52.133943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d095cb-751f-450d-9292-d1fe9d08f526 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:52.148119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d095cb-751f-450d-9292-d1fe9d08f526 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:52.154846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a5e25-ea70-4acc-b24b-6201cd0be746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:52.155727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5e25-ea70-4acc-b24b-6201cd0be746 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:52.156015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5e25-ea70-4acc-b24b-6201cd0be746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:52.156296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5e25-ea70-4acc-b24b-6201cd0be746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:52.156977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a5e25-ea70-4acc-b24b-6201cd0be746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:52.158630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a5e25-ea70-4acc-b24b-6201cd0be746 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:52.179264 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1571/3161] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:09:52.183263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe2443-a899-4ab7-a8c2-a5873b425002 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:52.194674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe2443-a899-4ab7-a8c2-a5873b425002 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:52.199658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f2483-aa4a-40a5-8671-f777007ff780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:52.200438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f2483-aa4a-40a5-8671-f777007ff780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:52.201291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f2483-aa4a-40a5-8671-f777007ff780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:52.202045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f2483-aa4a-40a5-8671-f777007ff780 admin admin] PATH_INFO: `/v3/projects/918bcae48ada42b48ffd801791f5df22/users/214ad89f7fde4314a25b19d1e3479e9f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:52.218522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f2483-aa4a-40a5-8671-f777007ff780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918bcae48ada42b48ffd801791f5df22, user_id=214ad89f7fde4314a25b19d1e3479e9f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:52.221999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f2483-aa4a-40a5-8671-f777007ff780 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:52.241213 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1591/3162] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:09:52 2022] PUT /identity/v3/projects/918bcae48ada42b48ffd801791f5df22/users/214ad89f7fde4314a25b19d1e3479e9f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:09:52.242683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba261-ccc7-4a70-b86b-2a7a8bb64d7c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:52.242936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba261-ccc7-4a70-b86b-2a7a8bb64d7c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:52.243212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba261-ccc7-4a70-b86b-2a7a8bb64d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:52.266142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-de4ba261-ccc7-4a70-b86b-2a7a8bb64d7c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:09:52.267842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de4ba261-ccc7-4a70-b86b-2a7a8bb64d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:09:52.341043 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1572/3163] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:09:52.351229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f2483-aa4a-40a5-8671-f777007ff780 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:09:52.416606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f2483-aa4a-40a5-8671-f777007ff780 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:09:52.421069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4db99-c7eb-48fc-ab0d-e272732a777a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:09:52.421803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4db99-c7eb-48fc-ab0d-e272732a777a service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:09:52.422152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4db99-c7eb-48fc-ab0d-e272732a777a service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:09:52.423938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4db99-c7eb-48fc-ab0d-e272732a777a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:09:52.439230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4db99-c7eb-48fc-ab0d-e272732a777a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:09:52.441140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4db99-c7eb-48fc-ab0d-e272732a777a service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:09:52.456424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1592/3164] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:02.332037 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=75 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:02.447925 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:05.120452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469b4f5-8b62-4486-8991-ffa0c690eeb5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:05.120860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469b4f5-8b62-4486-8991-ffa0c690eeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:05.121050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469b4f5-8b62-4486-8991-ffa0c690eeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:05.186773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3469b4f5-8b62-4486-8991-ffa0c690eeb5 None None] MFA Rules not processed for user `214ad89f7fde4314a25b19d1e3479e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:05.188941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3469b4f5-8b62-4486-8991-ffa0c690eeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:05.287368 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1573/3165] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:05.420407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4db99-c7eb-48fc-ab0d-e272732a777a service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:05.422455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-39c4db99-c7eb-48fc-ab0d-e272732a777a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:05.528689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4db99-c7eb-48fc-ab0d-e272732a777a service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:05.534794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34771-75d2-4a4a-89a5-855bca680047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:05.535677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34771-75d2-4a4a-89a5-855bca680047 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:05.535677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34771-75d2-4a4a-89a5-855bca680047 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:05.535987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34771-75d2-4a4a-89a5-855bca680047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:05.547506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34771-75d2-4a4a-89a5-855bca680047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:05.549722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34771-75d2-4a4a-89a5-855bca680047 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:05.564919 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1593/3166] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:08.209176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469b4f5-8b62-4486-8991-ffa0c690eeb5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:08.215482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3469b4f5-8b62-4486-8991-ffa0c690eeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:08.243650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469b4f5-8b62-4486-8991-ffa0c690eeb5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:08.250701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f08e28-8bf8-42f7-8204-402fc3c31315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:08.251537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f08e28-8bf8-42f7-8204-402fc3c31315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:08.251914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f08e28-8bf8-42f7-8204-402fc3c31315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:08.252285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f08e28-8bf8-42f7-8204-402fc3c31315 admin admin] PATH_INFO: `/v3/users/991f58b08b8e46f1a3fbbfa14d4fd23c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:08.253579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f08e28-8bf8-42f7-8204-402fc3c31315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=991f58b08b8e46f1a3fbbfa14d4fd23c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:08.256410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f08e28-8bf8-42f7-8204-402fc3c31315 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:08.366418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-86f08e28-8bf8-42f7-8204-402fc3c31315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991f58b08b8e46f1a3fbbfa14d4fd23c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:08.388262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-86f08e28-8bf8-42f7-8204-402fc3c31315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991f58b08b8e46f1a3fbbfa14d4fd23c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:08.389806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-86f08e28-8bf8-42f7-8204-402fc3c31315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991f58b08b8e46f1a3fbbfa14d4fd23c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:08.415551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-86f08e28-8bf8-42f7-8204-402fc3c31315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991f58b08b8e46f1a3fbbfa14d4fd23c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:08.428552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-86f08e28-8bf8-42f7-8204-402fc3c31315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991f58b08b8e46f1a3fbbfa14d4fd23c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:08.457220 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1574/3167] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:10:08 2022] DELETE /identity/v3/users/991f58b08b8e46f1a3fbbfa14d4fd23c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:08.771587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34771-75d2-4a4a-89a5-855bca680047 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:08.799334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34771-75d2-4a4a-89a5-855bca680047 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:08.882740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:08.883633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:08.883949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:08.884325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] PATH_INFO: `/v3/projects/f9954f609dd340fa9e1ebbb77a5dff3f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:08.885581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9954f609dd340fa9e1ebbb77a5dff3f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:08.887679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:08.929885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4fe3d-c2c2-4efb-a799-b98d050f0d96 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:08.931046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4fe3d-c2c2-4efb-a799-b98d050f0d96 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:08.931673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4fe3d-c2c2-4efb-a799-b98d050f0d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:08.978073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-63a4fe3d-c2c2-4efb-a799-b98d050f0d96 None None] MFA Rules not processed for user `214ad89f7fde4314a25b19d1e3479e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:08.978730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-63a4fe3d-c2c2-4efb-a799-b98d050f0d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:08.979478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'request_id': 'req-d581bc36-232e-4bfc-af51-13e10d315101'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:08.997204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'request_id': 'req-d581bc36-232e-4bfc-af51-13e10d315101'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:09.006951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9954f609dd340fa9e1ebbb77a5dff3f', 'request_id': 'req-d581bc36-232e-4bfc-af51-13e10d315101'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:09.029552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] The token cache is being invalidate because project f9954f609dd340fa9e1ebbb77a5dff3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:10:09.030570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:09.035090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d581bc36-232e-4bfc-af51-13e10d315101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:09.039712 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1594/3168] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:10:08 2022] DELETE /identity/v3/projects/f9954f609dd340fa9e1ebbb77a5dff3f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:09.045120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07fd15-1dd6-49d4-85fb-584a9d64b8c6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:09.046317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07fd15-1dd6-49d4-85fb-584a9d64b8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:09.047046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07fd15-1dd6-49d4-85fb-584a9d64b8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:09.050093 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1575/3169] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:09.073816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fa07fd15-1dd6-49d4-85fb-584a9d64b8c6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:09.075070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fa07fd15-1dd6-49d4-85fb-584a9d64b8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:09.100601 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:09.195831 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1595/3170] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:09.204388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ba97-248b-43f0-9ba8-3aaf10317085 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:09.204683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ba97-248b-43f0-9ba8-3aaf10317085 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:09.204966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ba97-248b-43f0-9ba8-3aaf10317085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:09.219994 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:09.232685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cdf2ba97-248b-43f0-9ba8-3aaf10317085 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:09.233995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cdf2ba97-248b-43f0-9ba8-3aaf10317085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:09.252949 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1576/3171] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:09.257902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07fd15-1dd6-49d4-85fb-584a9d64b8c6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:09.280026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07fd15-1dd6-49d4-85fb-584a9d64b8c6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:09.287465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc722-e6f8-4d62-9ae6-63c97c630126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:09.288182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc722-e6f8-4d62-9ae6-63c97c630126 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:09.288440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc722-e6f8-4d62-9ae6-63c97c630126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:09.288756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc722-e6f8-4d62-9ae6-63c97c630126 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:09.289447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc722-e6f8-4d62-9ae6-63c97c630126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:10:09.289753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc722-e6f8-4d62-9ae6-63c97c630126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:09.291774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc722-e6f8-4d62-9ae6-63c97c630126 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:09.309338 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1596/3172] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:10:09.310888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2ba97-248b-43f0-9ba8-3aaf10317085 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:09.320933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2ba97-248b-43f0-9ba8-3aaf10317085 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:09.326115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6bc79-ba64-4687-86c6-fb71104e9dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:09.327660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6bc79-ba64-4687-86c6-fb71104e9dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:09.328171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6bc79-ba64-4687-86c6-fb71104e9dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:09.328669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6bc79-ba64-4687-86c6-fb71104e9dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:09.329505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6bc79-ba64-4687-86c6-fb71104e9dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:09.331990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6bc79-ba64-4687-86c6-fb71104e9dbb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:09.378386 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1577/3173] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:10:09 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:10:09.382452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc722-e6f8-4d62-9ae6-63c97c630126 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:09.395003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc722-e6f8-4d62-9ae6-63c97c630126 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:09.464696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e771780-0c0d-4753-9c65-a0b62b00d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:09.465491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e771780-0c0d-4753-9c65-a0b62b00d317 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:09.465718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e771780-0c0d-4753-9c65-a0b62b00d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:09.466058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e771780-0c0d-4753-9c65-a0b62b00d317 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:09.466799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e771780-0c0d-4753-9c65-a0b62b00d317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:09.470878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e771780-0c0d-4753-9c65-a0b62b00d317 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:09.509834 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1597/3174] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:10:09 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:10:09.515206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6bc79-ba64-4687-86c6-fb71104e9dbb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:09.540220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6bc79-ba64-4687-86c6-fb71104e9dbb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:09.549591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f018a00-f93d-4b16-90c6-b0dbb6608054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:09.550527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f018a00-f93d-4b16-90c6-b0dbb6608054 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:09.550831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f018a00-f93d-4b16-90c6-b0dbb6608054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:09.551108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f018a00-f93d-4b16-90c6-b0dbb6608054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:09.551762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f018a00-f93d-4b16-90c6-b0dbb6608054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:09.553405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f018a00-f93d-4b16-90c6-b0dbb6608054 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:09.567005 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1578/3175] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:10:09.569912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e771780-0c0d-4753-9c65-a0b62b00d317 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:09.584153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e771780-0c0d-4753-9c65-a0b62b00d317 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:09.592949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219483b-a25a-488d-bd3f-69de2eae5e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:09.594201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219483b-a25a-488d-bd3f-69de2eae5e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:09.594889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219483b-a25a-488d-bd3f-69de2eae5e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:09.595338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219483b-a25a-488d-bd3f-69de2eae5e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:09.596560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219483b-a25a-488d-bd3f-69de2eae5e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:09.598777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219483b-a25a-488d-bd3f-69de2eae5e23 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:09.621379 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1598/3176] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:10:09.622850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f018a00-f93d-4b16-90c6-b0dbb6608054 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:09.635607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f018a00-f93d-4b16-90c6-b0dbb6608054 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:09.641401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ec9d8-01b6-4b4f-8ce3-7c5c5ff803f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:09.644509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec9d8-01b6-4b4f-8ce3-7c5c5ff803f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:09.644970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec9d8-01b6-4b4f-8ce3-7c5c5ff803f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:09.645387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec9d8-01b6-4b4f-8ce3-7c5c5ff803f3 admin admin] PATH_INFO: `/v3/projects/3c94ca45e7684b3c818871e232e08342/users/66a9d6a142d444be90b2101f23603522/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:09.665666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ec9d8-01b6-4b4f-8ce3-7c5c5ff803f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c94ca45e7684b3c818871e232e08342, user_id=66a9d6a142d444be90b2101f23603522, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:09.669369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ec9d8-01b6-4b4f-8ce3-7c5c5ff803f3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:09.687249 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1579/3177] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:10:09 2022] PUT /identity/v3/projects/3c94ca45e7684b3c818871e232e08342/users/66a9d6a142d444be90b2101f23603522/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:09.692725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353459e7-7055-4418-beca-198786714fce None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:09.693014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353459e7-7055-4418-beca-198786714fce None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:09.693291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353459e7-7055-4418-beca-198786714fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:09.721720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-353459e7-7055-4418-beca-198786714fce None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:09.723003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-353459e7-7055-4418-beca-198786714fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:09.819436 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1599/3178] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:10:09.831374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ec9d8-01b6-4b4f-8ce3-7c5c5ff803f3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:09.833914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ae2ec9d8-01b6-4b4f-8ce3-7c5c5ff803f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:09.904148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ec9d8-01b6-4b4f-8ce3-7c5c5ff803f3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:09.908731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3177135-71b2-4032-9aa4-bac86587f319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:09.909351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3177135-71b2-4032-9aa4-bac86587f319 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:09.909634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3177135-71b2-4032-9aa4-bac86587f319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:09.909922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3177135-71b2-4032-9aa4-bac86587f319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:09.923702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3177135-71b2-4032-9aa4-bac86587f319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:09.927435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3177135-71b2-4032-9aa4-bac86587f319 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:09.955767 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1580/3179] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:13.251486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353459e7-7055-4418-beca-198786714fce None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:13.253650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-353459e7-7055-4418-beca-198786714fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:13.271254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353459e7-7055-4418-beca-198786714fce None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:13.293379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:13.294268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:13.298053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:13.298451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] PATH_INFO: `/v3/users/7736193e78da4210ad696e5e61ca088c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:13.300425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7736193e78da4210ad696e5e61ca088c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:13.311396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:13.365287 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:13.442529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7736193e78da4210ad696e5e61ca088c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:13.472064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7736193e78da4210ad696e5e61ca088c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:13.472854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7736193e78da4210ad696e5e61ca088c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:13.485767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7736193e78da4210ad696e5e61ca088c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:13.486429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7736193e78da4210ad696e5e61ca088c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:13.523012 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1600/3180] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:10:13 2022] DELETE /identity/v3/users/7736193e78da4210ad696e5e61ca088c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:13.526986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0c274-e3be-40af-99cf-8c19878f6554 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:13.527822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0c274-e3be-40af-99cf-8c19878f6554 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:13.528272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0c274-e3be-40af-99cf-8c19878f6554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:13.591284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4ad0c274-e3be-40af-99cf-8c19878f6554 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:13.595518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4ad0c274-e3be-40af-99cf-8c19878f6554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:13.704710 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1581/3181] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:13.719324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:13.721173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:13.845034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90153fac-41f7-4946-b383-6f380fcfd516 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:13.854780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106e953-456c-41c2-96fd-c783cd670d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:13.855633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106e953-456c-41c2-96fd-c783cd670d64 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:13.855989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106e953-456c-41c2-96fd-c783cd670d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:13.856331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106e953-456c-41c2-96fd-c783cd670d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:13.871296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106e953-456c-41c2-96fd-c783cd670d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:13.879387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106e953-456c-41c2-96fd-c783cd670d64 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:13.895679 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1601/3182] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:14.677554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0c274-e3be-40af-99cf-8c19878f6554 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:14.681429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4ad0c274-e3be-40af-99cf-8c19878f6554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:14.715401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0c274-e3be-40af-99cf-8c19878f6554 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:14.733676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:14.734900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:14.735422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:14.736055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] PATH_INFO: `/v3/projects/352d900890d9490c9ab92fdc7c889532` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:14.745061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352d900890d9490c9ab92fdc7c889532)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:14.758240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:14.921101 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:14.933803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352d900890d9490c9ab92fdc7c889532', 'request_id': 'req-2820ac84-557e-437c-9645-812a090936b4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:14.948518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352d900890d9490c9ab92fdc7c889532', 'request_id': 'req-2820ac84-557e-437c-9645-812a090936b4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:14.964961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352d900890d9490c9ab92fdc7c889532', 'request_id': 'req-2820ac84-557e-437c-9645-812a090936b4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:15.002910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] The token cache is being invalidate because project 352d900890d9490c9ab92fdc7c889532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:10:15.003215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:15.013725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:15.016549 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1582/3183] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:10:14 2022] DELETE /identity/v3/projects/352d900890d9490c9ab92fdc7c889532 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:15.021138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106e953-456c-41c2-96fd-c783cd670d64 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:15.063422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106e953-456c-41c2-96fd-c783cd670d64 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:15.220020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:15.220685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:15.220969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:15.221236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] PATH_INFO: `/v3/users/be7b7c6ca9d84c19884aeeb452fe9909` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:15.222439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7b7c6ca9d84c19884aeeb452fe9909)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:15.224665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:15.321402 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:15.346819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7b7c6ca9d84c19884aeeb452fe9909'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:15.369184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7b7c6ca9d84c19884aeeb452fe9909'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:15.370891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7b7c6ca9d84c19884aeeb452fe9909'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:15.387284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7b7c6ca9d84c19884aeeb452fe9909'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:15.387966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7b7c6ca9d84c19884aeeb452fe9909'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:15.403502 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1602/3184] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:10:15 2022] DELETE /identity/v3/users/be7b7c6ca9d84c19884aeeb452fe9909 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:16.030353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:16.032655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:16.091103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:16.092756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:16.195231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820ac84-557e-437c-9645-812a090936b4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:16.258782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe1d1b-92f8-4cb1-9e87-7d712976c0fe admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:16.279414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:16.281246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:16.281883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:16.282366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] PATH_INFO: `/v3/projects/4bda47c12c134b48bed286a205e88e3e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:16.283849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bda47c12c134b48bed286a205e88e3e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:16.286137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:16.297357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddbb22-e172-4a5c-9ed0-cd10f0f0a861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:16.298000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddbb22-e172-4a5c-9ed0-cd10f0f0a861 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:16.298286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddbb22-e172-4a5c-9ed0-cd10f0f0a861 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:16.298563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddbb22-e172-4a5c-9ed0-cd10f0f0a861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:16.301468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e6ddbb22-e172-4a5c-9ed0-cd10f0f0a861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:16.340275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddbb22-e172-4a5c-9ed0-cd10f0f0a861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:16.341767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddbb22-e172-4a5c-9ed0-cd10f0f0a861 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:16.361004 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1583/3185] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:16.401996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bda47c12c134b48bed286a205e88e3e', 'request_id': 'req-2191f442-09b7-444d-9e4f-ca03b7f78d0e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:16.409792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bda47c12c134b48bed286a205e88e3e', 'request_id': 'req-2191f442-09b7-444d-9e4f-ca03b7f78d0e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:16.423653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bda47c12c134b48bed286a205e88e3e', 'request_id': 'req-2191f442-09b7-444d-9e4f-ca03b7f78d0e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:16.450056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] The token cache is being invalidate because project 4bda47c12c134b48bed286a205e88e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:10:16.450435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:16.453639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2191f442-09b7-444d-9e4f-ca03b7f78d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:16.455376 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1603/3186] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:10:16 2022] DELETE /identity/v3/projects/4bda47c12c134b48bed286a205e88e3e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:16.464887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d514c-70a7-472f-aa0e-f100e01f33de None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:16.465176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d514c-70a7-472f-aa0e-f100e01f33de None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:16.465892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d514c-70a7-472f-aa0e-f100e01f33de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:16.507734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b24d514c-70a7-472f-aa0e-f100e01f33de None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:16.508940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b24d514c-70a7-472f-aa0e-f100e01f33de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:16.609886 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1584/3187] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:16.617772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662114a-bde2-4f8e-be29-6aba8f8c7aba None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:16.618728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662114a-bde2-4f8e-be29-6aba8f8c7aba None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:16.619159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662114a-bde2-4f8e-be29-6aba8f8c7aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:16.652095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9662114a-bde2-4f8e-be29-6aba8f8c7aba None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:16.653594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9662114a-bde2-4f8e-be29-6aba8f8c7aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:16.668088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d514c-70a7-472f-aa0e-f100e01f33de None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:16.674673 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1604/3188] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:16.678818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d514c-70a7-472f-aa0e-f100e01f33de None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:16.685694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2364f-7341-42da-81c0-b4ab253d8d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:16.686920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2364f-7341-42da-81c0-b4ab253d8d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:16.687399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2364f-7341-42da-81c0-b4ab253d8d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:16.687826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2364f-7341-42da-81c0-b4ab253d8d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:16.690957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2364f-7341-42da-81c0-b4ab253d8d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:10:16.691679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2364f-7341-42da-81c0-b4ab253d8d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:16.693498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2364f-7341-42da-81c0-b4ab253d8d78 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:16.728773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662114a-bde2-4f8e-be29-6aba8f8c7aba None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:16.734792 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1585/3189] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:10:16.739106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662114a-bde2-4f8e-be29-6aba8f8c7aba None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:16.746340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ececd7-77f3-4735-aa4c-9f08685950ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:16.747248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ececd7-77f3-4735-aa4c-9f08685950ba admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:16.747699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ececd7-77f3-4735-aa4c-9f08685950ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:16.748180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ececd7-77f3-4735-aa4c-9f08685950ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:16.749165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ececd7-77f3-4735-aa4c-9f08685950ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:16.751436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ececd7-77f3-4735-aa4c-9f08685950ba admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:16.802816 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1605/3190] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:10:16 2022] POST /identity/v3/projects => generated 393 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:10:16.804318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2364f-7341-42da-81c0-b4ab253d8d78 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:16.830829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2364f-7341-42da-81c0-b4ab253d8d78 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:16.858933 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:16.956156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e72e7e-aba0-49d0-b5ec-5d2d31ba6436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:16.956789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e72e7e-aba0-49d0-b5ec-5d2d31ba6436 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:16.957162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e72e7e-aba0-49d0-b5ec-5d2d31ba6436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:16.957440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e72e7e-aba0-49d0-b5ec-5d2d31ba6436 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:16.958534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e72e7e-aba0-49d0-b5ec-5d2d31ba6436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:16.960300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e72e7e-aba0-49d0-b5ec-5d2d31ba6436 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:17.014103 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1586/3191] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:10:16 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:10:17.014860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ececd7-77f3-4735-aa4c-9f08685950ba admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:17.036525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ececd7-77f3-4735-aa4c-9f08685950ba admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:17.041833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552bce4-04bf-46cd-962f-b5c24569d402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:17.042439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552bce4-04bf-46cd-962f-b5c24569d402 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:17.044097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552bce4-04bf-46cd-962f-b5c24569d402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:17.044377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552bce4-04bf-46cd-962f-b5c24569d402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:17.045050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552bce4-04bf-46cd-962f-b5c24569d402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:17.047698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552bce4-04bf-46cd-962f-b5c24569d402 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:17.088319 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1606/3192] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:10:17.093234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e72e7e-aba0-49d0-b5ec-5d2d31ba6436 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:17.116079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e72e7e-aba0-49d0-b5ec-5d2d31ba6436 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:17.131651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468baea1-9deb-4999-8b57-5e9a228fa5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:17.134188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468baea1-9deb-4999-8b57-5e9a228fa5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:17.134768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468baea1-9deb-4999-8b57-5e9a228fa5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:17.135212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468baea1-9deb-4999-8b57-5e9a228fa5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:17.139425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468baea1-9deb-4999-8b57-5e9a228fa5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:17.141390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468baea1-9deb-4999-8b57-5e9a228fa5d9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:17.169452 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1587/3193] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:10:17.173424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552bce4-04bf-46cd-962f-b5c24569d402 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:17.196042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552bce4-04bf-46cd-962f-b5c24569d402 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:17.203981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832310c-25af-4439-a2e6-45419ef9a291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:17.205251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832310c-25af-4439-a2e6-45419ef9a291 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:17.205251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832310c-25af-4439-a2e6-45419ef9a291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:17.205519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832310c-25af-4439-a2e6-45419ef9a291 admin admin] PATH_INFO: `/v3/projects/43ccfc72930a48ed8a9578968a8e0ee0/users/c6bc89a846ec4240bd21f1052b90be8f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:17.209433 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:17.243912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832310c-25af-4439-a2e6-45419ef9a291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ccfc72930a48ed8a9578968a8e0ee0, user_id=c6bc89a846ec4240bd21f1052b90be8f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:17.250799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832310c-25af-4439-a2e6-45419ef9a291 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:17.292822 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1607/3194] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:10:17 2022] PUT /identity/v3/projects/43ccfc72930a48ed8a9578968a8e0ee0/users/c6bc89a846ec4240bd21f1052b90be8f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:17.293678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0da85-f035-48fc-8fa0-c05b6aae7393 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:17.294145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0da85-f035-48fc-8fa0-c05b6aae7393 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:17.294429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0da85-f035-48fc-8fa0-c05b6aae7393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:17.349140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2ae0da85-f035-48fc-8fa0-c05b6aae7393 None None] MFA Rules not processed for user `c6bc89a846ec4240bd21f1052b90be8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:17.350471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ae0da85-f035-48fc-8fa0-c05b6aae7393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:17.502831 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1588/3195] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:17.507290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832310c-25af-4439-a2e6-45419ef9a291 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:17.654672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832310c-25af-4439-a2e6-45419ef9a291 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:17.668683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d7870-f49e-41bd-94dd-1b845fb18e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:17.669462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d7870-f49e-41bd-94dd-1b845fb18e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:17.669862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d7870-f49e-41bd-94dd-1b845fb18e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:17.670285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d7870-f49e-41bd-94dd-1b845fb18e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:17.671846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d7870-f49e-41bd-94dd-1b845fb18e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:17.674481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d7870-f49e-41bd-94dd-1b845fb18e70 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:17.767380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0da85-f035-48fc-8fa0-c05b6aae7393 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:17.772666 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1608/3196] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:10:17 2022] POST /identity/v3/projects => generated 391 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:10:17.791526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0da85-f035-48fc-8fa0-c05b6aae7393 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:17.964487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaf9c5-00b9-4782-8360-4f3318041c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:17.965395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaf9c5-00b9-4782-8360-4f3318041c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:17.965973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaf9c5-00b9-4782-8360-4f3318041c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:17.966411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaf9c5-00b9-4782-8360-4f3318041c04 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:17.967270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aaf9c5-00b9-4782-8360-4f3318041c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:17.969414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aaf9c5-00b9-4782-8360-4f3318041c04 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:18.025372 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1589/3197] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:10:17 2022] POST /identity/v3/users => generated 302 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:10:18.029740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d7870-f49e-41bd-94dd-1b845fb18e70 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:18.045239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d7870-f49e-41bd-94dd-1b845fb18e70 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:18.060318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a82e5f-d52b-4157-873b-048c00d437b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:18.063171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a82e5f-d52b-4157-873b-048c00d437b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:18.063466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a82e5f-d52b-4157-873b-048c00d437b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:18.063741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a82e5f-d52b-4157-873b-048c00d437b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:18.072464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a82e5f-d52b-4157-873b-048c00d437b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:18.074305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a82e5f-d52b-4157-873b-048c00d437b0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:18.093678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaf9c5-00b9-4782-8360-4f3318041c04 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:18.095009 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1609/3198] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:10:18.125882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaf9c5-00b9-4782-8360-4f3318041c04 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:18.147640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2def8b9-d720-43db-9b85-cd377a2c17d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:18.148327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2def8b9-d720-43db-9b85-cd377a2c17d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:18.148603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2def8b9-d720-43db-9b85-cd377a2c17d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:18.149446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2def8b9-d720-43db-9b85-cd377a2c17d4 admin admin] PATH_INFO: `/v3/projects/2dc820cc8c734b3985bbdf16e536ee32/users/2c4c54d93fc64eec927c536e58ac2042/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:18.183560 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:18.199213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2def8b9-d720-43db-9b85-cd377a2c17d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc820cc8c734b3985bbdf16e536ee32, user_id=2c4c54d93fc64eec927c536e58ac2042, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:18.207227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2def8b9-d720-43db-9b85-cd377a2c17d4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:18.256668 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1590/3199] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:10:18 2022] PUT /identity/v3/projects/2dc820cc8c734b3985bbdf16e536ee32/users/2c4c54d93fc64eec927c536e58ac2042/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:18.258485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a82e5f-d52b-4157-873b-048c00d437b0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:18.279385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a82e5f-d52b-4157-873b-048c00d437b0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:18.469341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70e123-472e-44be-a4d3-445374eb4766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:18.469976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70e123-472e-44be-a4d3-445374eb4766 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:18.470289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70e123-472e-44be-a4d3-445374eb4766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:18.470821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70e123-472e-44be-a4d3-445374eb4766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:18.471483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70e123-472e-44be-a4d3-445374eb4766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:18.475322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70e123-472e-44be-a4d3-445374eb4766 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:18.521968 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1610/3200] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:10:18.524734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2def8b9-d720-43db-9b85-cd377a2c17d4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:18.550359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2def8b9-d720-43db-9b85-cd377a2c17d4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:18.561794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7c2e7-1932-4978-8aad-0ab30ca751cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:18.564768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7c2e7-1932-4978-8aad-0ab30ca751cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:18.565228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7c2e7-1932-4978-8aad-0ab30ca751cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:18.565733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7c2e7-1932-4978-8aad-0ab30ca751cc admin admin] PATH_INFO: `/v3/projects/2dc820cc8c734b3985bbdf16e536ee32/users/2c4c54d93fc64eec927c536e58ac2042/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:18.572128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7c2e7-1932-4978-8aad-0ab30ca751cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc820cc8c734b3985bbdf16e536ee32, user_id=2c4c54d93fc64eec927c536e58ac2042, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:18.577987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7c2e7-1932-4978-8aad-0ab30ca751cc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:18.610012 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1591/3201] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:10:18 2022] PUT /identity/v3/projects/2dc820cc8c734b3985bbdf16e536ee32/users/2c4c54d93fc64eec927c536e58ac2042/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:18.621704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3828312-2faf-4081-8fbf-614fdec28318 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:18.621994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3828312-2faf-4081-8fbf-614fdec28318 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:18.622274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3828312-2faf-4081-8fbf-614fdec28318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:18.726135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d3828312-2faf-4081-8fbf-614fdec28318 None None] MFA Rules not processed for user `2c4c54d93fc64eec927c536e58ac2042`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:18.728704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d3828312-2faf-4081-8fbf-614fdec28318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:18.742631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f574c07-df77-462f-b45c-84e439ae246c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:18.743916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f574c07-df77-462f-b45c-84e439ae246c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:18.744241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f574c07-df77-462f-b45c-84e439ae246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:18.814033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1f574c07-df77-462f-b45c-84e439ae246c None None] MFA Rules not processed for user `66a9d6a142d444be90b2101f23603522`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:18.816688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f574c07-df77-462f-b45c-84e439ae246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:18.824999 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:18.914168 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1611/3202] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:18.927142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab1d2-e63e-4d20-820f-5fb9d4780b60 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:18.927806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab1d2-e63e-4d20-820f-5fb9d4780b60 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:18.935864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ab1d2-e63e-4d20-820f-5fb9d4780b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:18.981771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a94ab1d2-e63e-4d20-820f-5fb9d4780b60 None None] MFA Rules not processed for user `c6bc89a846ec4240bd21f1052b90be8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:18.983145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a94ab1d2-e63e-4d20-820f-5fb9d4780b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:18.987511 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1592/3203] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:19.062796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f574c07-df77-462f-b45c-84e439ae246c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:19.063896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f574c07-df77-462f-b45c-84e439ae246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:19.077554 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1612/3204] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:19.135251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f574c07-df77-462f-b45c-84e439ae246c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:19.139560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dbc48-47a2-4326-8f14-674260321e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:19.140347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dbc48-47a2-4326-8f14-674260321e35 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:19.140726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dbc48-47a2-4326-8f14-674260321e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:19.141486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dbc48-47a2-4326-8f14-674260321e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:19.142988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3e0dbc48-47a2-4326-8f14-674260321e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:19.316105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dbc48-47a2-4326-8f14-674260321e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:19.318048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dbc48-47a2-4326-8f14-674260321e35 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:19.335567 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1593/3205] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:10:19.461820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ab1d2-e63e-4d20-820f-5fb9d4780b60 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:19.481447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ab1d2-e63e-4d20-820f-5fb9d4780b60 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:19.485778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9824c68-91bd-40f1-bec6-1c60071610e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:19.486675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824c68-91bd-40f1-bec6-1c60071610e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:19.487103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824c68-91bd-40f1-bec6-1c60071610e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:19.487537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824c68-91bd-40f1-bec6-1c60071610e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:19.493329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e9824c68-91bd-40f1-bec6-1c60071610e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:19.512562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9824c68-91bd-40f1-bec6-1c60071610e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:19.514047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9824c68-91bd-40f1-bec6-1c60071610e9 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:19.533501 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1613/3206] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:19.817760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dbc48-47a2-4326-8f14-674260321e35 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:19.818804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3e0dbc48-47a2-4326-8f14-674260321e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:19.843695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dbc48-47a2-4326-8f14-674260321e35 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:19.858645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e038f4-47f2-435e-830d-dcb07ae31e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:19.859405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e038f4-47f2-435e-830d-dcb07ae31e52 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:19.859706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e038f4-47f2-435e-830d-dcb07ae31e52 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:19.860059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e038f4-47f2-435e-830d-dcb07ae31e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:19.866978 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:19.880463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e038f4-47f2-435e-830d-dcb07ae31e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:19.882312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e038f4-47f2-435e-830d-dcb07ae31e52 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:19.907560 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1594/3207] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:20.159518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9824c68-91bd-40f1-bec6-1c60071610e9 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:20.177989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9824c68-91bd-40f1-bec6-1c60071610e9 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:20.189948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcedbee-68fb-410a-890a-94009f0d2a9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:20.191999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcedbee-68fb-410a-890a-94009f0d2a9b service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:20.192893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcedbee-68fb-410a-890a-94009f0d2a9b service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:20.193181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcedbee-68fb-410a-890a-94009f0d2a9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:20.205669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcedbee-68fb-410a-890a-94009f0d2a9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:20.207555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcedbee-68fb-410a-890a-94009f0d2a9b service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:20.244940 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1614/3208] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:24.574963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be042-2323-473e-b72b-8939bb6aa64b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:24.576255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be042-2323-473e-b72b-8939bb6aa64b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:24.576821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be042-2323-473e-b72b-8939bb6aa64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:24.611092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-199be042-2323-473e-b72b-8939bb6aa64b None None] MFA Rules not processed for user `66a9d6a142d444be90b2101f23603522`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:24.612715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-199be042-2323-473e-b72b-8939bb6aa64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:24.622289 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1595/3209] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:26.426143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcedbee-68fb-410a-890a-94009f0d2a9b service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:26.444586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcedbee-68fb-410a-890a-94009f0d2a9b service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:26.451058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b694e-1d84-4011-904f-7f25b8cfc25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:26.452900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b694e-1d84-4011-904f-7f25b8cfc25b service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:26.453460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b694e-1d84-4011-904f-7f25b8cfc25b service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:26.455205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b694e-1d84-4011-904f-7f25b8cfc25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:26.461268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-092b694e-1d84-4011-904f-7f25b8cfc25b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:26.480726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b694e-1d84-4011-904f-7f25b8cfc25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:26.482458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b694e-1d84-4011-904f-7f25b8cfc25b service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:26.496098 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1615/3210] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:27.027538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199be042-2323-473e-b72b-8939bb6aa64b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:27.029413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-199be042-2323-473e-b72b-8939bb6aa64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:27.054657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199be042-2323-473e-b72b-8939bb6aa64b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:27.063227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01e3eb-b39b-44e1-b0bf-7c0033d63b9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:27.065004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01e3eb-b39b-44e1-b0bf-7c0033d63b9a service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:27.065529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01e3eb-b39b-44e1-b0bf-7c0033d63b9a service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:27.066006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01e3eb-b39b-44e1-b0bf-7c0033d63b9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:27.079412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01e3eb-b39b-44e1-b0bf-7c0033d63b9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:27.081429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01e3eb-b39b-44e1-b0bf-7c0033d63b9a service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:27.109590 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1596/3211] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:29.174151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b694e-1d84-4011-904f-7f25b8cfc25b service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:29.188804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b694e-1d84-4011-904f-7f25b8cfc25b service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:29.210061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8e22b-3a06-491f-a8e0-ff991fb1b062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:29.210061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8e22b-3a06-491f-a8e0-ff991fb1b062 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:29.210240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8e22b-3a06-491f-a8e0-ff991fb1b062 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:29.210429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8e22b-3a06-491f-a8e0-ff991fb1b062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:29.216225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-15c8e22b-3a06-491f-a8e0-ff991fb1b062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:29.265477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8e22b-3a06-491f-a8e0-ff991fb1b062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:29.267893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8e22b-3a06-491f-a8e0-ff991fb1b062 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:29.306112 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1616/3212] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:32.150767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01e3eb-b39b-44e1-b0bf-7c0033d63b9a service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:32.173528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01e3eb-b39b-44e1-b0bf-7c0033d63b9a service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:32.187509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea9766-f6ae-4fa9-99c9-e78ba3d10379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:32.188145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea9766-f6ae-4fa9-99c9-e78ba3d10379 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:32.188587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea9766-f6ae-4fa9-99c9-e78ba3d10379 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:32.189008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea9766-f6ae-4fa9-99c9-e78ba3d10379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:32.203377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-35ea9766-f6ae-4fa9-99c9-e78ba3d10379 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:32.349413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea9766-f6ae-4fa9-99c9-e78ba3d10379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:32.351703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea9766-f6ae-4fa9-99c9-e78ba3d10379 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:32.379567 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1597/3213] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:34.256793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8e22b-3a06-491f-a8e0-ff991fb1b062 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:34.258804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-15c8e22b-3a06-491f-a8e0-ff991fb1b062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:34.389857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8e22b-3a06-491f-a8e0-ff991fb1b062 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:34.394915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:34.395432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:34.395713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:34.395988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] PATH_INFO: `/v3/users/6da1976f703f402788953f3332a281de` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:34.397165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da1976f703f402788953f3332a281de)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:34.406457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:34.449858 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:34.504179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da1976f703f402788953f3332a281de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:34.518976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da1976f703f402788953f3332a281de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:34.520190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da1976f703f402788953f3332a281de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:34.534720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da1976f703f402788953f3332a281de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:34.536894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da1976f703f402788953f3332a281de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:34.582425 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1617/3214] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:10:34 2022] DELETE /identity/v3/users/6da1976f703f402788953f3332a281de => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:35.055595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea9766-f6ae-4fa9-99c9-e78ba3d10379 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:35.071079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea9766-f6ae-4fa9-99c9-e78ba3d10379 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:35.136477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:35.137125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:35.137412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:35.137688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] PATH_INFO: `/v3/projects/ffe656702bb24b6a9b459ff1b19a0d8c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:35.138868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe656702bb24b6a9b459ff1b19a0d8c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:35.141993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:35.205566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'request_id': 'req-413b5fc2-ece7-42ce-a891-0bba5a05a70b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.212063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'request_id': 'req-413b5fc2-ece7-42ce-a891-0bba5a05a70b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.220565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe656702bb24b6a9b459ff1b19a0d8c', 'request_id': 'req-413b5fc2-ece7-42ce-a891-0bba5a05a70b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.234016 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:35.240090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] The token cache is being invalidate because project ffe656702bb24b6a9b459ff1b19a0d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:10:35.240578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.241629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.246729 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1598/3215] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:10:35 2022] DELETE /identity/v3/projects/ffe656702bb24b6a9b459ff1b19a0d8c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:35.247985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:35.250628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:35.264581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebdecb-d344-4d2d-9f86-78b2c2aa6adc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:35.325447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad700f05-1f7e-4b01-9662-f2dab12db61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:35.326084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad700f05-1f7e-4b01-9662-f2dab12db61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:35.326363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad700f05-1f7e-4b01-9662-f2dab12db61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:35.327220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad700f05-1f7e-4b01-9662-f2dab12db61b admin admin] PATH_INFO: `/v3/users/07119428c22c4a28b61ba8137655e716` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:35.328568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad700f05-1f7e-4b01-9662-f2dab12db61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=07119428c22c4a28b61ba8137655e716)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:35.330632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad700f05-1f7e-4b01-9662-f2dab12db61b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:35.395583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ad700f05-1f7e-4b01-9662-f2dab12db61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07119428c22c4a28b61ba8137655e716'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.415617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ad700f05-1f7e-4b01-9662-f2dab12db61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07119428c22c4a28b61ba8137655e716'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.416653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ad700f05-1f7e-4b01-9662-f2dab12db61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07119428c22c4a28b61ba8137655e716'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.431371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ad700f05-1f7e-4b01-9662-f2dab12db61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07119428c22c4a28b61ba8137655e716'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.432338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ad700f05-1f7e-4b01-9662-f2dab12db61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07119428c22c4a28b61ba8137655e716'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.459120 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1618/3216] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:10:35 2022] DELETE /identity/v3/users/07119428c22c4a28b61ba8137655e716 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:35.659452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:35.661474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:35.678266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b5fc2-ece7-42ce-a891-0bba5a05a70b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:35.791770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:35.792715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:35.793018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:35.793387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] PATH_INFO: `/v3/projects/e61468cee3c24c7e84784b9ac94d2681` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:35.794746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61468cee3c24c7e84784b9ac94d2681)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:35.798101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:35.873207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61468cee3c24c7e84784b9ac94d2681', 'request_id': 'req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.881240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61468cee3c24c7e84784b9ac94d2681', 'request_id': 'req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.891335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61468cee3c24c7e84784b9ac94d2681', 'request_id': 'req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.914152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] The token cache is being invalidate because project e61468cee3c24c7e84784b9ac94d2681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:10:35.914922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.916029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34edbc6f-b6fd-4ad9-84fd-13cafdaec9ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:10:35.919284 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1599/3217] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:10:35 2022] DELETE /identity/v3/projects/e61468cee3c24c7e84784b9ac94d2681 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:35.924513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8780-313b-4c7e-8ebc-a66918e472b5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:35.924808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8780-313b-4c7e-8ebc-a66918e472b5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:35.925085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8780-313b-4c7e-8ebc-a66918e472b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:35.960102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f12e8780-313b-4c7e-8ebc-a66918e472b5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:35.965540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f12e8780-313b-4c7e-8ebc-a66918e472b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:35.994193 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:36.051335 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1619/3218] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:36.059420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef4246-66ef-47c0-9b43-163ac569496f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:36.060003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef4246-66ef-47c0-9b43-163ac569496f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:36.060003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef4246-66ef-47c0-9b43-163ac569496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:36.090415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-95ef4246-66ef-47c0-9b43-163ac569496f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:36.091579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-95ef4246-66ef-47c0-9b43-163ac569496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:36.100901 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1600/3219] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:36.105114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e8780-313b-4c7e-8ebc-a66918e472b5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:36.134941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e8780-313b-4c7e-8ebc-a66918e472b5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:36.155094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46426e-5f2c-49f5-a752-ddd8ed5fd683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:36.156091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46426e-5f2c-49f5-a752-ddd8ed5fd683 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:36.156834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46426e-5f2c-49f5-a752-ddd8ed5fd683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:36.156834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46426e-5f2c-49f5-a752-ddd8ed5fd683 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:36.157325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46426e-5f2c-49f5-a752-ddd8ed5fd683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:10:36.157633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46426e-5f2c-49f5-a752-ddd8ed5fd683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:36.159738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46426e-5f2c-49f5-a752-ddd8ed5fd683 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:36.183022 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1620/3220] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:10:36.187041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef4246-66ef-47c0-9b43-163ac569496f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:36.198482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef4246-66ef-47c0-9b43-163ac569496f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:36.211328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b23a7c-920d-42fa-9d07-db2cc0347632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:36.211873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b23a7c-920d-42fa-9d07-db2cc0347632 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:36.212149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b23a7c-920d-42fa-9d07-db2cc0347632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:36.212404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b23a7c-920d-42fa-9d07-db2cc0347632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:36.213130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b23a7c-920d-42fa-9d07-db2cc0347632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:36.215353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b23a7c-920d-42fa-9d07-db2cc0347632 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:36.255557 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1601/3221] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:10:36 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:10:36.263038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46426e-5f2c-49f5-a752-ddd8ed5fd683 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:36.277901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46426e-5f2c-49f5-a752-ddd8ed5fd683 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:36.391924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fcfcb-9e83-4e3e-ac6c-66d3b66e2ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:36.393299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fcfcb-9e83-4e3e-ac6c-66d3b66e2ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:36.393594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fcfcb-9e83-4e3e-ac6c-66d3b66e2ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:36.393923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fcfcb-9e83-4e3e-ac6c-66d3b66e2ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:36.395187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fcfcb-9e83-4e3e-ac6c-66d3b66e2ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:36.398200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fcfcb-9e83-4e3e-ac6c-66d3b66e2ec6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:36.436896 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1621/3222] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:10:36 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:10:36.438500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b23a7c-920d-42fa-9d07-db2cc0347632 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:36.451049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b23a7c-920d-42fa-9d07-db2cc0347632 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:36.466409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd8c75-8d7d-4d9c-ae83-47e06d0ebcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:36.468120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd8c75-8d7d-4d9c-ae83-47e06d0ebcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:36.469607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd8c75-8d7d-4d9c-ae83-47e06d0ebcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:36.470093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd8c75-8d7d-4d9c-ae83-47e06d0ebcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:36.472430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd8c75-8d7d-4d9c-ae83-47e06d0ebcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:36.475048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd8c75-8d7d-4d9c-ae83-47e06d0ebcb4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:36.493899 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1602/3223] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:10:36.497826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fcfcb-9e83-4e3e-ac6c-66d3b66e2ec6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:36.513007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fcfcb-9e83-4e3e-ac6c-66d3b66e2ec6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:36.518935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a089466-9b55-41cf-ba6a-60e37efc990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:36.519802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089466-9b55-41cf-ba6a-60e37efc990c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:36.520206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089466-9b55-41cf-ba6a-60e37efc990c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:36.520554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089466-9b55-41cf-ba6a-60e37efc990c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:36.521618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a089466-9b55-41cf-ba6a-60e37efc990c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:36.523406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a089466-9b55-41cf-ba6a-60e37efc990c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:36.539410 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1622/3224] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:10:36.543183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd8c75-8d7d-4d9c-ae83-47e06d0ebcb4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:36.555948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd8c75-8d7d-4d9c-ae83-47e06d0ebcb4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:36.564939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea65e1e-6ee3-435e-b930-0f069e9f9c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:36.565974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65e1e-6ee3-435e-b930-0f069e9f9c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:36.566268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65e1e-6ee3-435e-b930-0f069e9f9c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:36.566545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65e1e-6ee3-435e-b930-0f069e9f9c63 admin admin] PATH_INFO: `/v3/projects/c1893a97eaf94d85b113cb3d03c3ef85/users/49da406fdd2e4aa980c1a7343af9a321/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:36.594991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea65e1e-6ee3-435e-b930-0f069e9f9c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1893a97eaf94d85b113cb3d03c3ef85, user_id=49da406fdd2e4aa980c1a7343af9a321, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:36.599456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea65e1e-6ee3-435e-b930-0f069e9f9c63 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:36.632313 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1603/3225] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:10:36 2022] PUT /identity/v3/projects/c1893a97eaf94d85b113cb3d03c3ef85/users/49da406fdd2e4aa980c1a7343af9a321/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:10:36.633784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb3a44-a316-485e-8940-77e7f9ebc399 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:36.634075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb3a44-a316-485e-8940-77e7f9ebc399 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:36.634358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb3a44-a316-485e-8940-77e7f9ebc399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:36.697130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1deb3a44-a316-485e-8940-77e7f9ebc399 None None] MFA Rules not processed for user `49da406fdd2e4aa980c1a7343af9a321`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:36.698574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1deb3a44-a316-485e-8940-77e7f9ebc399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:36.787991 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1623/3226] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:36.791809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea65e1e-6ee3-435e-b930-0f069e9f9c63 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:36.856908 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:36.927492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea65e1e-6ee3-435e-b930-0f069e9f9c63 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:36.932841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a62e51-2830-4c29-9576-d62d26d32399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:36.933829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a62e51-2830-4c29-9576-d62d26d32399 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:36.934201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a62e51-2830-4c29-9576-d62d26d32399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:36.934569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a62e51-2830-4c29-9576-d62d26d32399 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:36.935565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a62e51-2830-4c29-9576-d62d26d32399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:36.938464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a62e51-2830-4c29-9576-d62d26d32399 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:36.995521 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1604/3227] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:10:36 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:10:37.000520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb3a44-a316-485e-8940-77e7f9ebc399 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:37.017998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb3a44-a316-485e-8940-77e7f9ebc399 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:37.062994 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:37.197255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6025b-f491-4318-9faa-43871f8c9d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:37.197913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6025b-f491-4318-9faa-43871f8c9d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:37.198196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6025b-f491-4318-9faa-43871f8c9d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:37.198470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6025b-f491-4318-9faa-43871f8c9d12 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:37.199163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6025b-f491-4318-9faa-43871f8c9d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:37.201102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6025b-f491-4318-9faa-43871f8c9d12 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:37.233738 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1624/3228] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:10:36 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:10:37.238464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a62e51-2830-4c29-9576-d62d26d32399 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:37.255046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a62e51-2830-4c29-9576-d62d26d32399 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:37.260947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f11c1e-78c5-4330-942f-aeb78f61e935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:37.261554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11c1e-78c5-4330-942f-aeb78f61e935 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:37.261881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11c1e-78c5-4330-942f-aeb78f61e935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:37.262203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11c1e-78c5-4330-942f-aeb78f61e935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:37.262844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f11c1e-78c5-4330-942f-aeb78f61e935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:37.264512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f11c1e-78c5-4330-942f-aeb78f61e935 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:37.278432 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1605/3229] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:10:37.283046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6025b-f491-4318-9faa-43871f8c9d12 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:37.293473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6025b-f491-4318-9faa-43871f8c9d12 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:37.298623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d872-497c-4165-a5c3-3b150664c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:37.299298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d872-497c-4165-a5c3-3b150664c7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:37.299577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d872-497c-4165-a5c3-3b150664c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:37.299852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d872-497c-4165-a5c3-3b150664c7a5 admin admin] PATH_INFO: `/v3/projects/4a7b906ed9b1454e9f30feddabead478/users/1b7bf570c28b4238bc7da539255d9e3d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:37.318197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9d872-497c-4165-a5c3-3b150664c7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7b906ed9b1454e9f30feddabead478, user_id=1b7bf570c28b4238bc7da539255d9e3d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:37.321148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9d872-497c-4165-a5c3-3b150664c7a5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:37.337997 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1625/3230] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:10:37 2022] PUT /identity/v3/projects/4a7b906ed9b1454e9f30feddabead478/users/1b7bf570c28b4238bc7da539255d9e3d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:37.343180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f11c1e-78c5-4330-942f-aeb78f61e935 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:37.353562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f11c1e-78c5-4330-942f-aeb78f61e935 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:37.430004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b370a0-397d-4001-9b4e-8057309ef2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:37.430572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b370a0-397d-4001-9b4e-8057309ef2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:37.430882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b370a0-397d-4001-9b4e-8057309ef2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:37.431169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b370a0-397d-4001-9b4e-8057309ef2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:37.431922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b370a0-397d-4001-9b4e-8057309ef2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:37.433685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b370a0-397d-4001-9b4e-8057309ef2e5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:37.451626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d872-497c-4165-a5c3-3b150664c7a5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:37.458949 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1606/3231] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:10:37.463140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d872-497c-4165-a5c3-3b150664c7a5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:37.469689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d5949-caf8-4038-bcdf-8eda4e907b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:37.470356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d5949-caf8-4038-bcdf-8eda4e907b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:37.470663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d5949-caf8-4038-bcdf-8eda4e907b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:37.470941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d5949-caf8-4038-bcdf-8eda4e907b9c admin admin] PATH_INFO: `/v3/projects/4a7b906ed9b1454e9f30feddabead478/users/1b7bf570c28b4238bc7da539255d9e3d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:37.472851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d5949-caf8-4038-bcdf-8eda4e907b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7b906ed9b1454e9f30feddabead478, user_id=1b7bf570c28b4238bc7da539255d9e3d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:37.475792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d5949-caf8-4038-bcdf-8eda4e907b9c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:37.495644 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1626/3232] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:10:37 2022] PUT /identity/v3/projects/4a7b906ed9b1454e9f30feddabead478/users/1b7bf570c28b4238bc7da539255d9e3d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:10:37.498050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e887-e76e-46ce-8eb4-f7f0233f518b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:37.498437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e887-e76e-46ce-8eb4-f7f0233f518b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:37.499435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e887-e76e-46ce-8eb4-f7f0233f518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:37.536616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-eb71e887-e76e-46ce-8eb4-f7f0233f518b None None] MFA Rules not processed for user `1b7bf570c28b4238bc7da539255d9e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:37.537879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb71e887-e76e-46ce-8eb4-f7f0233f518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:37.632483 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1607/3233] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:37.644596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7ba3b-039c-48b9-8693-2699d3dbd971 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:37.645510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7ba3b-039c-48b9-8693-2699d3dbd971 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:37.646089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7ba3b-039c-48b9-8693-2699d3dbd971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:37.671520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-56a7ba3b-039c-48b9-8693-2699d3dbd971 None None] MFA Rules not processed for user `49da406fdd2e4aa980c1a7343af9a321`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:37.673074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-56a7ba3b-039c-48b9-8693-2699d3dbd971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:37.759779 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1627/3234] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:10:37.772050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71e887-e76e-46ce-8eb4-f7f0233f518b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:37.774240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb71e887-e76e-46ce-8eb4-f7f0233f518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:37.799959 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:37.871911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71e887-e76e-46ce-8eb4-f7f0233f518b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:37.892311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8a37b-9b46-4be7-8937-3968cdee6670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:37.892730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8a37b-9b46-4be7-8937-3968cdee6670 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:37.893019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8a37b-9b46-4be7-8937-3968cdee6670 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:37.893292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8a37b-9b46-4be7-8937-3968cdee6670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:37.904572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8a37b-9b46-4be7-8937-3968cdee6670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:37.906590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8a37b-9b46-4be7-8937-3968cdee6670 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:37.918844 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1608/3235] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:40.875695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58161cd-7001-4afd-b496-7e207bd4f6b7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:40.876260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58161cd-7001-4afd-b496-7e207bd4f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:40.876260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58161cd-7001-4afd-b496-7e207bd4f6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:40.896848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f58161cd-7001-4afd-b496-7e207bd4f6b7 None None] MFA Rules not processed for user `a8ae1a9c7c164923840b20e32c471cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:40.898074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f58161cd-7001-4afd-b496-7e207bd4f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:40.956833 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1628/3236] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:47.914822 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=25 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:49.456366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7980b-a762-4402-922a-e2ad4a4a2b14 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:49.457055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7980b-a762-4402-922a-e2ad4a4a2b14 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:49.457055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7980b-a762-4402-922a-e2ad4a4a2b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:49.488680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-67b7980b-a762-4402-922a-e2ad4a4a2b14 None None] MFA Rules not processed for user `df46881c91e8419e84b8679ad474ba44`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:10:49.490394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-67b7980b-a762-4402-922a-e2ad4a4a2b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:49.574929 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1609/3237] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:10:50.835676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58161cd-7001-4afd-b496-7e207bd4f6b7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:50.838634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f58161cd-7001-4afd-b496-7e207bd4f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:50.869800 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:50.957804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58161cd-7001-4afd-b496-7e207bd4f6b7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:50.972672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e26a7-517c-4513-8f28-6c012233825e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:50.973570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e26a7-517c-4513-8f28-6c012233825e service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:50.973977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e26a7-517c-4513-8f28-6c012233825e service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:50.974372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e26a7-517c-4513-8f28-6c012233825e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:50.976861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ed3e26a7-517c-4513-8f28-6c012233825e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:51.002192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e26a7-517c-4513-8f28-6c012233825e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:51.004174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e26a7-517c-4513-8f28-6c012233825e service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:51.017369 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1629/3238] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:10:53.813043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7980b-a762-4402-922a-e2ad4a4a2b14 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:10:53.816002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-67b7980b-a762-4402-922a-e2ad4a4a2b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:53.933850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7980b-a762-4402-922a-e2ad4a4a2b14 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:10:53.942819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ac2b-bd5c-474f-9b26-930bdb991617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:10:53.943980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ac2b-bd5c-474f-9b26-930bdb991617 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:10:53.944468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ac2b-bd5c-474f-9b26-930bdb991617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:10:53.945387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ac2b-bd5c-474f-9b26-930bdb991617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:10:53.947551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5949ac2b-bd5c-474f-9b26-930bdb991617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:10:53.964679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ac2b-bd5c-474f-9b26-930bdb991617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:10:53.966299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ac2b-bd5c-474f-9b26-930bdb991617 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:10:53.980799 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1610/3239] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:10:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:11:01.011252 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=24 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:02.195390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e26a7-517c-4513-8f28-6c012233825e service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:02.211470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e26a7-517c-4513-8f28-6c012233825e service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:02.229743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046828c1-c8a0-43ba-8fcb-087101128f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:02.230537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046828c1-c8a0-43ba-8fcb-087101128f5f service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:02.230914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046828c1-c8a0-43ba-8fcb-087101128f5f service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:02.231258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046828c1-c8a0-43ba-8fcb-087101128f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:02.237992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-046828c1-c8a0-43ba-8fcb-087101128f5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:02.253166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046828c1-c8a0-43ba-8fcb-087101128f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:02.255560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046828c1-c8a0-43ba-8fcb-087101128f5f service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:02.272090 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1630/3240] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:11:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:11:02.333995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f95c1-ba53-4f93-973f-52280a8c32f7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:02.334507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f95c1-ba53-4f93-973f-52280a8c32f7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:02.334924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f95c1-ba53-4f93-973f-52280a8c32f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:02.402209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9d1f95c1-ba53-4f93-973f-52280a8c32f7 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:02.427378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9d1f95c1-ba53-4f93-973f-52280a8c32f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:02.567623 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1611/3241] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:11:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:02.628846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046828c1-c8a0-43ba-8fcb-087101128f5f service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:02.630351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-046828c1-c8a0-43ba-8fcb-087101128f5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:02.736596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046828c1-c8a0-43ba-8fcb-087101128f5f service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:02.742123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5cb01-b9ed-48a1-bcc5-e7a7790781e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:02.742941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5cb01-b9ed-48a1-bcc5-e7a7790781e4 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:02.743287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5cb01-b9ed-48a1-bcc5-e7a7790781e4 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:02.743624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5cb01-b9ed-48a1-bcc5-e7a7790781e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:02.753996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5cb01-b9ed-48a1-bcc5-e7a7790781e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:02.755710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5cb01-b9ed-48a1-bcc5-e7a7790781e4 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:02.768521 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1631/3242] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:11:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:11:12.567202 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:12.762740 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=47 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:13.665266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f95c1-ba53-4f93-973f-52280a8c32f7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:13.667333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9d1f95c1-ba53-4f93-973f-52280a8c32f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:13.696630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f95c1-ba53-4f93-973f-52280a8c32f7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:13.712195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dec19d-6f9b-4588-97c3-49f8cc49afb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:13.713097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dec19d-6f9b-4588-97c3-49f8cc49afb0 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:13.713384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dec19d-6f9b-4588-97c3-49f8cc49afb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:13.713661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dec19d-6f9b-4588-97c3-49f8cc49afb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:13.721239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-86dec19d-6f9b-4588-97c3-49f8cc49afb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:13.755223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dec19d-6f9b-4588-97c3-49f8cc49afb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:13.756861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dec19d-6f9b-4588-97c3-49f8cc49afb0 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:13.790185 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1612/3243] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:11:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:11:23.221254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5cb01-b9ed-48a1-bcc5-e7a7790781e4 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:23.223310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-80f5cb01-b9ed-48a1-bcc5-e7a7790781e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:23.239482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5cb01-b9ed-48a1-bcc5-e7a7790781e4 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:23.244465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf79ad-1e9d-4da4-a4d3-ccb784421924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:23.246214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf79ad-1e9d-4da4-a4d3-ccb784421924 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:23.247144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf79ad-1e9d-4da4-a4d3-ccb784421924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:23.247922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf79ad-1e9d-4da4-a4d3-ccb784421924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:23.251786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a7cf79ad-1e9d-4da4-a4d3-ccb784421924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:23.262411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf79ad-1e9d-4da4-a4d3-ccb784421924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:23.263936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf79ad-1e9d-4da4-a4d3-ccb784421924 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:23.274526 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1632/3244] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:11:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:11:23.772758 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:24.851444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dec19d-6f9b-4588-97c3-49f8cc49afb0 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:24.862638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dec19d-6f9b-4588-97c3-49f8cc49afb0 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:24.866566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c121ec-ceaa-4783-8ed8-d3a293167085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:24.867273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c121ec-ceaa-4783-8ed8-d3a293167085 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:24.867626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c121ec-ceaa-4783-8ed8-d3a293167085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:24.867995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c121ec-ceaa-4783-8ed8-d3a293167085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:24.870679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-25c121ec-ceaa-4783-8ed8-d3a293167085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:24.949443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf79ad-1e9d-4da4-a4d3-ccb784421924 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:24.965032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c121ec-ceaa-4783-8ed8-d3a293167085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:24.965483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf79ad-1e9d-4da4-a4d3-ccb784421924 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:24.967448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c121ec-ceaa-4783-8ed8-d3a293167085 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:24.975683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7657c6-0861-4ca5-af6f-a30c7231099e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:24.976303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7657c6-0861-4ca5-af6f-a30c7231099e service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:24.976763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7657c6-0861-4ca5-af6f-a30c7231099e service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:24.977042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7657c6-0861-4ca5-af6f-a30c7231099e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:24.981771 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1613/3245] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:11:24.993027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7657c6-0861-4ca5-af6f-a30c7231099e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:24.994717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7657c6-0861-4ca5-af6f-a30c7231099e service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:25.005293 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1633/3246] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:11:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:11:25.590247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508b6d9-5c20-4445-848e-0f6538c64051 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:25.590776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508b6d9-5c20-4445-848e-0f6538c64051 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:25.591423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508b6d9-5c20-4445-848e-0f6538c64051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:25.628837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8508b6d9-5c20-4445-848e-0f6538c64051 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:25.630368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8508b6d9-5c20-4445-848e-0f6538c64051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:25.663106 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1614/3247] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:25.668192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7657c6-0861-4ca5-af6f-a30c7231099e service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:25.699686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7657c6-0861-4ca5-af6f-a30c7231099e service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:25.713473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e9bc1-2241-4840-bd02-404111e06e5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:25.715581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e9bc1-2241-4840-bd02-404111e06e5f service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:25.717145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e9bc1-2241-4840-bd02-404111e06e5f service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:25.717437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e9bc1-2241-4840-bd02-404111e06e5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:25.737868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e9bc1-2241-4840-bd02-404111e06e5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:25.739511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e9bc1-2241-4840-bd02-404111e06e5f service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:25.761651 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1634/3248] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:11:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:11:28.532078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508b6d9-5c20-4445-848e-0f6538c64051 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:28.533698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8508b6d9-5c20-4445-848e-0f6538c64051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:28.563738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508b6d9-5c20-4445-848e-0f6538c64051 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:28.576705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:28.579508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:28.581654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:28.582993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] PATH_INFO: `/v3/users/a8ae1a9c7c164923840b20e32c471cf3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:28.585361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ae1a9c7c164923840b20e32c471cf3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:28.592630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:28.699882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ae1a9c7c164923840b20e32c471cf3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:28.728111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ae1a9c7c164923840b20e32c471cf3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:28.729569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ae1a9c7c164923840b20e32c471cf3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:28.746558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ae1a9c7c164923840b20e32c471cf3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:28.774075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ae1a9c7c164923840b20e32c471cf3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:28.795601 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1615/3249] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:11:28 2022] DELETE /identity/v3/users/a8ae1a9c7c164923840b20e32c471cf3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:11:29.137887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e9bc1-2241-4840-bd02-404111e06e5f service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:29.188231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e9bc1-2241-4840-bd02-404111e06e5f service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:29.320452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:29.321267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:29.321711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:29.322162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] PATH_INFO: `/v3/projects/76dd02a5b3d346168e6dde74ddb4d3e0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:29.323894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76dd02a5b3d346168e6dde74ddb4d3e0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:29.326654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:29.492892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76dd02a5b3d346168e6dde74ddb4d3e0', 'request_id': 'req-474f918b-2298-4ce1-a1dc-31a7af893406'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:29.507655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76dd02a5b3d346168e6dde74ddb4d3e0', 'request_id': 'req-474f918b-2298-4ce1-a1dc-31a7af893406'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:29.524701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76dd02a5b3d346168e6dde74ddb4d3e0', 'request_id': 'req-474f918b-2298-4ce1-a1dc-31a7af893406'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:29.554953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] The token cache is being invalidate because project 76dd02a5b3d346168e6dde74ddb4d3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:11:29.555360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:29.556166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:29.560672 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1635/3250] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:11:29 2022] DELETE /identity/v3/projects/76dd02a5b3d346168e6dde74ddb4d3e0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:11:29.564414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:29.566421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:29.588357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9d453-291f-4047-b840-197538e847ed admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:29.714257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4558dc8-52f4-4ed8-a11d-c5d0725499bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:29.715390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4558dc8-52f4-4ed8-a11d-c5d0725499bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:29.715892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4558dc8-52f4-4ed8-a11d-c5d0725499bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:29.716365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4558dc8-52f4-4ed8-a11d-c5d0725499bd admin admin] PATH_INFO: `/v3/users/f13f3cf87e5148cf9ba45f4d24961f6e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:29.718269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4558dc8-52f4-4ed8-a11d-c5d0725499bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13f3cf87e5148cf9ba45f4d24961f6e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:29.721515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4558dc8-52f4-4ed8-a11d-c5d0725499bd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:29.723735 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:29.875828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c4558dc8-52f4-4ed8-a11d-c5d0725499bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13f3cf87e5148cf9ba45f4d24961f6e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:29.897226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c4558dc8-52f4-4ed8-a11d-c5d0725499bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13f3cf87e5148cf9ba45f4d24961f6e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:29.898238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c4558dc8-52f4-4ed8-a11d-c5d0725499bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13f3cf87e5148cf9ba45f4d24961f6e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:29.909961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c4558dc8-52f4-4ed8-a11d-c5d0725499bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13f3cf87e5148cf9ba45f4d24961f6e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:29.920800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c4558dc8-52f4-4ed8-a11d-c5d0725499bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13f3cf87e5148cf9ba45f4d24961f6e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:29.933338 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1616/3251] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:11:29 2022] DELETE /identity/v3/users/f13f3cf87e5148cf9ba45f4d24961f6e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:11:30.362078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:30.364733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:30.386808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f918b-2298-4ce1-a1dc-31a7af893406 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:30.493287 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:30.511678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:30.512828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:30.513490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:30.513975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] PATH_INFO: `/v3/projects/2025441a9e3a4e848c695b77bb33b9e2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:30.516777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2025441a9e3a4e848c695b77bb33b9e2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:30.519368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:30.612930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2025441a9e3a4e848c695b77bb33b9e2', 'request_id': 'req-e4e2f053-058b-4cdf-89e1-6aa7757150b9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:30.627248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2025441a9e3a4e848c695b77bb33b9e2', 'request_id': 'req-e4e2f053-058b-4cdf-89e1-6aa7757150b9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:30.645938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2025441a9e3a4e848c695b77bb33b9e2', 'request_id': 'req-e4e2f053-058b-4cdf-89e1-6aa7757150b9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:30.666837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] The token cache is being invalidate because project 2025441a9e3a4e848c695b77bb33b9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:11:30.671293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:30.672845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e4e2f053-058b-4cdf-89e1-6aa7757150b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:30.674625 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1636/3252] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:11:30 2022] DELETE /identity/v3/projects/2025441a9e3a4e848c695b77bb33b9e2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:11:30.679664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07763f67-8af2-48b0-b152-b095f7711988 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:30.680477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07763f67-8af2-48b0-b152-b095f7711988 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:30.680929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07763f67-8af2-48b0-b152-b095f7711988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:30.731813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-07763f67-8af2-48b0-b152-b095f7711988 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:30.733169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-07763f67-8af2-48b0-b152-b095f7711988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:30.881502 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1617/3253] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:30.896240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e67fc2-91f6-4ea5-af11-bc81a5832d75 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:30.897064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e67fc2-91f6-4ea5-af11-bc81a5832d75 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:30.897064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e67fc2-91f6-4ea5-af11-bc81a5832d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:30.951308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-66e67fc2-91f6-4ea5-af11-bc81a5832d75 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:30.952553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-66e67fc2-91f6-4ea5-af11-bc81a5832d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:30.992058 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1637/3254] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:30.992495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07763f67-8af2-48b0-b152-b095f7711988 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:31.010902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07763f67-8af2-48b0-b152-b095f7711988 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:31.028497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ce19c-df5f-40c9-9316-59d7667a6054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:31.029132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ce19c-df5f-40c9-9316-59d7667a6054 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:31.029601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ce19c-df5f-40c9-9316-59d7667a6054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:31.030018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ce19c-df5f-40c9-9316-59d7667a6054 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:31.030961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ce19c-df5f-40c9-9316-59d7667a6054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:11:31.031913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ce19c-df5f-40c9-9316-59d7667a6054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:31.033712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ce19c-df5f-40c9-9316-59d7667a6054 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:31.074747 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1618/3255] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:11:31.080247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e67fc2-91f6-4ea5-af11-bc81a5832d75 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:31.094421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e67fc2-91f6-4ea5-af11-bc81a5832d75 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:31.107481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa2934-bfe0-4171-9b0b-454e520a3620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:31.108232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2934-bfe0-4171-9b0b-454e520a3620 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:31.108555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2934-bfe0-4171-9b0b-454e520a3620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:31.108883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2934-bfe0-4171-9b0b-454e520a3620 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:31.109626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa2934-bfe0-4171-9b0b-454e520a3620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:31.115920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa2934-bfe0-4171-9b0b-454e520a3620 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:31.185520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ce19c-df5f-40c9-9316-59d7667a6054 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:31.186176 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1638/3256] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:11:31 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:11:31.213214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ce19c-df5f-40c9-9316-59d7667a6054 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:31.377792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982434c7-1bec-4d49-a377-452a66b40407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:31.378429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982434c7-1bec-4d49-a377-452a66b40407 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:31.378742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982434c7-1bec-4d49-a377-452a66b40407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:31.379059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982434c7-1bec-4d49-a377-452a66b40407 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:31.379751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982434c7-1bec-4d49-a377-452a66b40407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:31.383585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982434c7-1bec-4d49-a377-452a66b40407 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:31.413111 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:31.431853 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1619/3257] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:11:31 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:11:31.436347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa2934-bfe0-4171-9b0b-454e520a3620 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:31.451667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa2934-bfe0-4171-9b0b-454e520a3620 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:31.471354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34788c56-410a-4977-a509-8248520268ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:31.473405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34788c56-410a-4977-a509-8248520268ab admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:31.473851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34788c56-410a-4977-a509-8248520268ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:31.474282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34788c56-410a-4977-a509-8248520268ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:31.476383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34788c56-410a-4977-a509-8248520268ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:31.480578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34788c56-410a-4977-a509-8248520268ab admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:31.507855 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1639/3258] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:11:31.511834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982434c7-1bec-4d49-a377-452a66b40407 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:31.529166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982434c7-1bec-4d49-a377-452a66b40407 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:31.539559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc575c9-14c1-4a87-82e0-378eaad9e73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:31.540502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc575c9-14c1-4a87-82e0-378eaad9e73c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:31.540890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc575c9-14c1-4a87-82e0-378eaad9e73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:31.541270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc575c9-14c1-4a87-82e0-378eaad9e73c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:31.542057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc575c9-14c1-4a87-82e0-378eaad9e73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:31.544478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc575c9-14c1-4a87-82e0-378eaad9e73c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:31.569111 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1620/3259] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:11:31.575631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34788c56-410a-4977-a509-8248520268ab admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:31.603367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34788c56-410a-4977-a509-8248520268ab admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:31.618493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354db4c-d33c-478f-b32b-d3047e37acaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:31.620385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354db4c-d33c-478f-b32b-d3047e37acaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:31.621475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354db4c-d33c-478f-b32b-d3047e37acaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:31.627726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354db4c-d33c-478f-b32b-d3047e37acaf admin admin] PATH_INFO: `/v3/projects/9231cac91fd14f51a4efc95c84202419/users/8cd2ad37e9b844ac8b7632fd9291023a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:31.670304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354db4c-d33c-478f-b32b-d3047e37acaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9231cac91fd14f51a4efc95c84202419, user_id=8cd2ad37e9b844ac8b7632fd9291023a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:31.677226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354db4c-d33c-478f-b32b-d3047e37acaf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:31.704035 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1640/3260] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:11:31 2022] PUT /identity/v3/projects/9231cac91fd14f51a4efc95c84202419/users/8cd2ad37e9b844ac8b7632fd9291023a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:11:31.722413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139f6f-7ee0-4a7c-9997-1e76bc99234d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:31.722971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139f6f-7ee0-4a7c-9997-1e76bc99234d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:31.723079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139f6f-7ee0-4a7c-9997-1e76bc99234d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:31.745872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9b139f6f-7ee0-4a7c-9997-1e76bc99234d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:31.747255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b139f6f-7ee0-4a7c-9997-1e76bc99234d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:31.820942 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1621/3261] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:31.828302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354db4c-d33c-478f-b32b-d3047e37acaf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:31.831155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0354db4c-d33c-478f-b32b-d3047e37acaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:31.970970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354db4c-d33c-478f-b32b-d3047e37acaf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:31.977527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2097c0f-f41c-445f-9018-0005dc7c0c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:31.980033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2097c0f-f41c-445f-9018-0005dc7c0c7c service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:31.980847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2097c0f-f41c-445f-9018-0005dc7c0c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:31.981477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2097c0f-f41c-445f-9018-0005dc7c0c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:32.009064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2097c0f-f41c-445f-9018-0005dc7c0c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:32.012498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2097c0f-f41c-445f-9018-0005dc7c0c7c service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:32.032276 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1641/3262] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:11:38.185898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139f6f-7ee0-4a7c-9997-1e76bc99234d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:38.188209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b139f6f-7ee0-4a7c-9997-1e76bc99234d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:38.208965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139f6f-7ee0-4a7c-9997-1e76bc99234d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:38.220099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:38.222111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ce6b-6e16-4d3e-8649-3a60004a960a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:38.222695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ce6b-6e16-4d3e-8649-3a60004a960a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:38.222695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ce6b-6e16-4d3e-8649-3a60004a960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:38.227919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:38.228198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:38.230763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] PATH_INFO: `/v3/users/d44f8d053e07440699d217cd63c94d0d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:38.233126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d44f8d053e07440699d217cd63c94d0d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:38.236073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:38.247792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c379ce6b-6e16-4d3e-8649-3a60004a960a None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:38.249509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c379ce6b-6e16-4d3e-8649-3a60004a960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:38.272150 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:38.313444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd44f8d053e07440699d217cd63c94d0d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:38.329383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd44f8d053e07440699d217cd63c94d0d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:38.330224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd44f8d053e07440699d217cd63c94d0d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:38.341558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd44f8d053e07440699d217cd63c94d0d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:38.351989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd44f8d053e07440699d217cd63c94d0d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:38.353635 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1642/3263] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:38.368264 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1622/3264] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:11:38 2022] DELETE /identity/v3/users/d44f8d053e07440699d217cd63c94d0d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:11:38.378666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379ce6b-6e16-4d3e-8649-3a60004a960a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:38.382121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c379ce6b-6e16-4d3e-8649-3a60004a960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:38.508417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379ce6b-6e16-4d3e-8649-3a60004a960a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:38.604875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:38.606931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:38.665905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76181ee0-6f5e-4bdc-9daf-5e4a16467f6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:38.668533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181ee0-6f5e-4bdc-9daf-5e4a16467f6c service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:38.670532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181ee0-6f5e-4bdc-9daf-5e4a16467f6c service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:38.670695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181ee0-6f5e-4bdc-9daf-5e4a16467f6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:38.728335 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:38.733772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c9969-0e7e-45f3-88f1-107a4cc17db0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:38.742262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:38.743835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:38.743835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:38.744043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] PATH_INFO: `/v3/projects/4b8fabf5bc8740b09c77687c9d4e1e77` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:38.745077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8fabf5bc8740b09c77687c9d4e1e77)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:38.747650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:38.782202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76181ee0-6f5e-4bdc-9daf-5e4a16467f6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:38.783819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76181ee0-6f5e-4bdc-9daf-5e4a16467f6c service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:38.807031 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1643/3265] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:11:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:11:38.847518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8fabf5bc8740b09c77687c9d4e1e77', 'request_id': 'req-5d2b02ca-abc7-425d-b55b-da6af1a92098'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:38.864912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8fabf5bc8740b09c77687c9d4e1e77', 'request_id': 'req-5d2b02ca-abc7-425d-b55b-da6af1a92098'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:38.878769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8fabf5bc8740b09c77687c9d4e1e77', 'request_id': 'req-5d2b02ca-abc7-425d-b55b-da6af1a92098'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:38.931936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] The token cache is being invalidate because project 4b8fabf5bc8740b09c77687c9d4e1e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:11:38.932924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:38.933618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5d2b02ca-abc7-425d-b55b-da6af1a92098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:38.940086 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1623/3266] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:11:38 2022] DELETE /identity/v3/projects/4b8fabf5bc8740b09c77687c9d4e1e77 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:11:38.941018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76181ee0-6f5e-4bdc-9daf-5e4a16467f6c service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:38.961389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76181ee0-6f5e-4bdc-9daf-5e4a16467f6c service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:38.972471 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:39.091236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:39.092211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:39.092724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:39.093081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] PATH_INFO: `/v3/users/cdd115ff0dd34262be2dc29b9cdb55e0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:39.095711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd115ff0dd34262be2dc29b9cdb55e0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:39.098646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:39.211306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd115ff0dd34262be2dc29b9cdb55e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:39.255722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd115ff0dd34262be2dc29b9cdb55e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:39.259695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd115ff0dd34262be2dc29b9cdb55e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:39.285572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd115ff0dd34262be2dc29b9cdb55e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:39.286359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd115ff0dd34262be2dc29b9cdb55e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:39.337929 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1644/3267] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:11:38 2022] DELETE /identity/v3/users/cdd115ff0dd34262be2dc29b9cdb55e0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:11:39.448487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c9c6-3cab-4df8-a826-c155dd991b7b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:39.449499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c9c6-3cab-4df8-a826-c155dd991b7b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:39.449999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c9c6-3cab-4df8-a826-c155dd991b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:39.480203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c839c9c6-3cab-4df8-a826-c155dd991b7b None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:39.481796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c839c9c6-3cab-4df8-a826-c155dd991b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:39.578201 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1624/3268] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:39.581986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:39.584805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:39.618062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839c9c6-3cab-4df8-a826-c155dd991b7b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:39.621072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c839c9c6-3cab-4df8-a826-c155dd991b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:39.736111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d886ec-8e2a-416c-9a23-a15daae9c5d7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:39.743804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbe286-fc76-4d43-9857-f0505498462d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:39.744581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe286-fc76-4d43-9857-f0505498462d service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:39.744922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe286-fc76-4d43-9857-f0505498462d service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:39.745339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe286-fc76-4d43-9857-f0505498462d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:39.760688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbe286-fc76-4d43-9857-f0505498462d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:39.762770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbe286-fc76-4d43-9857-f0505498462d service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:39.774010 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1645/3269] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:11:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:11:39.865823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839c9c6-3cab-4df8-a826-c155dd991b7b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:39.879292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:39.879954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:39.880238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:39.880518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] PATH_INFO: `/v3/projects/5c4654e2b3724c2f900bc56dc6bcc035` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:39.882651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4654e2b3724c2f900bc56dc6bcc035)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:39.887224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:39.965464 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:39.987318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4654e2b3724c2f900bc56dc6bcc035', 'request_id': 'req-1098c594-6f23-4c78-bda9-3dce33cca6ca'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:39.997972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4654e2b3724c2f900bc56dc6bcc035', 'request_id': 'req-1098c594-6f23-4c78-bda9-3dce33cca6ca'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:40.006127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4654e2b3724c2f900bc56dc6bcc035', 'request_id': 'req-1098c594-6f23-4c78-bda9-3dce33cca6ca'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:40.041490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] The token cache is being invalidate because project 5c4654e2b3724c2f900bc56dc6bcc035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:11:40.041814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:40.045503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1098c594-6f23-4c78-bda9-3dce33cca6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:11:40.050968 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1625/3270] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:11:39 2022] DELETE /identity/v3/projects/5c4654e2b3724c2f900bc56dc6bcc035 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:11:40.056148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbba77-7d98-4666-ac96-ac729a881dad None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.065390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbba77-7d98-4666-ac96-ac729a881dad None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.065832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbba77-7d98-4666-ac96-ac729a881dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.117400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cafbba77-7d98-4666-ac96-ac729a881dad None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:40.118769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cafbba77-7d98-4666-ac96-ac729a881dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:40.147555 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:40.159390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc54ad6-2d2f-4474-ab83-33cdff218c0f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.159680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc54ad6-2d2f-4474-ab83-33cdff218c0f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.159970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc54ad6-2d2f-4474-ab83-33cdff218c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.208957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9cc54ad6-2d2f-4474-ab83-33cdff218c0f None None] MFA Rules not processed for user `8cd2ad37e9b844ac8b7632fd9291023a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:40.210328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9cc54ad6-2d2f-4474-ab83-33cdff218c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:40.248257 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1646/3271] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:40.261291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e25b7-f405-431b-ac54-405e5931b927 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.261887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e25b7-f405-431b-ac54-405e5931b927 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.261887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e25b7-f405-431b-ac54-405e5931b927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.297732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5b6e25b7-f405-431b-ac54-405e5931b927 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:40.300414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5b6e25b7-f405-431b-ac54-405e5931b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:40.313082 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1647/3272] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:40.317581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e25b7-f405-431b-ac54-405e5931b927 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:40.334254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e25b7-f405-431b-ac54-405e5931b927 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:40.339047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00341c7-40e8-46a4-9705-18c513009b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:40.339779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00341c7-40e8-46a4-9705-18c513009b98 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.340058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00341c7-40e8-46a4-9705-18c513009b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.340332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00341c7-40e8-46a4-9705-18c513009b98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.340981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00341c7-40e8-46a4-9705-18c513009b98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:11:40.341285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00341c7-40e8-46a4-9705-18c513009b98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:40.344131 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1626/3273] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:40.345279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00341c7-40e8-46a4-9705-18c513009b98 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:40.356093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37a30-1616-4c7b-8172-29d5861d64e0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.356378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37a30-1616-4c7b-8172-29d5861d64e0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.356651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37a30-1616-4c7b-8172-29d5861d64e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.373648 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1648/3274] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:11:40.382462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00341c7-40e8-46a4-9705-18c513009b98 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:40.384275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d0c37a30-1616-4c7b-8172-29d5861d64e0 None None] MFA Rules not processed for user `8cd2ad37e9b844ac8b7632fd9291023a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:40.386039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d0c37a30-1616-4c7b-8172-29d5861d64e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:40.397937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00341c7-40e8-46a4-9705-18c513009b98 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:40.404350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcc776-3861-498e-be55-a57a7f0aac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:40.405232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcc776-3861-498e-be55-a57a7f0aac26 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.405606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcc776-3861-498e-be55-a57a7f0aac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.405996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcc776-3861-498e-be55-a57a7f0aac26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.407263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcc776-3861-498e-be55-a57a7f0aac26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:40.409326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcc776-3861-498e-be55-a57a7f0aac26 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:40.411074 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1627/3275] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:40.422364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c37a30-1616-4c7b-8172-29d5861d64e0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:40.425737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d0c37a30-1616-4c7b-8172-29d5861d64e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:40.470354 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1649/3276] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:11:40 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:11:40.471427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcc776-3861-498e-be55-a57a7f0aac26 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:40.583523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcc776-3861-498e-be55-a57a7f0aac26 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:40.586650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c37a30-1616-4c7b-8172-29d5861d64e0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:40.589272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1275a-fe6c-4f58-b975-e30f19a02c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:40.590125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1275a-fe6c-4f58-b975-e30f19a02c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.590592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1275a-fe6c-4f58-b975-e30f19a02c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.591015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1275a-fe6c-4f58-b975-e30f19a02c6d admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.591749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1275a-fe6c-4f58-b975-e30f19a02c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:40.595131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1275a-fe6c-4f58-b975-e30f19a02c6d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:40.657925 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1650/3277] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:11:40 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:11:40.662982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1275a-fe6c-4f58-b975-e30f19a02c6d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:40.681031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1275a-fe6c-4f58-b975-e30f19a02c6d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:40.688990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ea535-e38a-4b1a-9311-c18747065e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:40.689666 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:40.689952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ea535-e38a-4b1a-9311-c18747065e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.691487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ea535-e38a-4b1a-9311-c18747065e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.691779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ea535-e38a-4b1a-9311-c18747065e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.694758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ea535-e38a-4b1a-9311-c18747065e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:40.696628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ea535-e38a-4b1a-9311-c18747065e3d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:40.725795 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1651/3278] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:11:40.727053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ea535-e38a-4b1a-9311-c18747065e3d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:40.732743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cef8f-4bb3-42ae-a17e-9501e161e70b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:40.733369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cef8f-4bb3-42ae-a17e-9501e161e70b service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.733651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cef8f-4bb3-42ae-a17e-9501e161e70b service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.734162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cef8f-4bb3-42ae-a17e-9501e161e70b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.739754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ea535-e38a-4b1a-9311-c18747065e3d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:40.748637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6403-afd5-4e99-b13b-3f02e9985056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:40.750208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6403-afd5-4e99-b13b-3f02e9985056 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.750903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6403-afd5-4e99-b13b-3f02e9985056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.751276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6403-afd5-4e99-b13b-3f02e9985056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.752115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b6403-afd5-4e99-b13b-3f02e9985056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:40.753981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b6403-afd5-4e99-b13b-3f02e9985056 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:40.788456 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1652/3279] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:11:40.789425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6403-afd5-4e99-b13b-3f02e9985056 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:40.808971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6403-afd5-4e99-b13b-3f02e9985056 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:40.814619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe61ea-286e-407c-a919-81b150d42895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:40.815297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe61ea-286e-407c-a919-81b150d42895 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.815575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe61ea-286e-407c-a919-81b150d42895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.815853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe61ea-286e-407c-a919-81b150d42895 admin admin] PATH_INFO: `/v3/projects/d565120ddfb84f22ad17d8dd0f9c35fa/users/daade8c46ae44a4b81bafa442b6037f4/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.840552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe61ea-286e-407c-a919-81b150d42895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d565120ddfb84f22ad17d8dd0f9c35fa, user_id=daade8c46ae44a4b81bafa442b6037f4, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:40.843483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe61ea-286e-407c-a919-81b150d42895 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:40.862640 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1653/3280] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:11:40 2022] PUT /identity/v3/projects/d565120ddfb84f22ad17d8dd0f9c35fa/users/daade8c46ae44a4b81bafa442b6037f4/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:11:40.873170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521ab7-9575-43d3-9b08-46a2a91cd053 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:40.873489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521ab7-9575-43d3-9b08-46a2a91cd053 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:40.873739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521ab7-9575-43d3-9b08-46a2a91cd053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:40.879135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cef8f-4bb3-42ae-a17e-9501e161e70b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:40.886991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cef8f-4bb3-42ae-a17e-9501e161e70b service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:40.901189 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1628/3281] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:11:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:11:40.982892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-28521ab7-9575-43d3-9b08-46a2a91cd053 None None] MFA Rules not processed for user `daade8c46ae44a4b81bafa442b6037f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:40.983892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-28521ab7-9575-43d3-9b08-46a2a91cd053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:41.005103 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:41.116183 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1654/3282] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:41.121516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cef8f-4bb3-42ae-a17e-9501e161e70b service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:41.136848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cef8f-4bb3-42ae-a17e-9501e161e70b service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:41.224195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e5fd0-b51f-4bc9-b34e-751627a4b1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:41.225598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e5fd0-b51f-4bc9-b34e-751627a4b1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:41.226071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e5fd0-b51f-4bc9-b34e-751627a4b1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:41.226491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e5fd0-b51f-4bc9-b34e-751627a4b1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:41.227410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e5fd0-b51f-4bc9-b34e-751627a4b1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:41.230197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e5fd0-b51f-4bc9-b34e-751627a4b1a8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:41.274207 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1629/3283] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:11:41 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:11:41.275788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28521ab7-9575-43d3-9b08-46a2a91cd053 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:41.308195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28521ab7-9575-43d3-9b08-46a2a91cd053 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:41.399260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9a8b5-7b6c-4a96-9324-a05ba3eae98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:41.400173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a8b5-7b6c-4a96-9324-a05ba3eae98d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:41.400595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a8b5-7b6c-4a96-9324-a05ba3eae98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:41.400991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a8b5-7b6c-4a96-9324-a05ba3eae98d admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:41.401930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9a8b5-7b6c-4a96-9324-a05ba3eae98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:41.410327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9a8b5-7b6c-4a96-9324-a05ba3eae98d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:41.462846 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1655/3284] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:11:41 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:11:41.466806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e5fd0-b51f-4bc9-b34e-751627a4b1a8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:41.481527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e5fd0-b51f-4bc9-b34e-751627a4b1a8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:41.497837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a465d4-5faf-4bfb-b636-ffd238990843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:41.498555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a465d4-5faf-4bfb-b636-ffd238990843 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:41.499451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a465d4-5faf-4bfb-b636-ffd238990843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:41.500419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a465d4-5faf-4bfb-b636-ffd238990843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:41.503237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a465d4-5faf-4bfb-b636-ffd238990843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:41.505888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a465d4-5faf-4bfb-b636-ffd238990843 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:41.526812 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1630/3285] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:11:41.528915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9a8b5-7b6c-4a96-9324-a05ba3eae98d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:41.548712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9a8b5-7b6c-4a96-9324-a05ba3eae98d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:41.560749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc26bbc-0eac-4ab4-84ec-922598752cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:41.561719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc26bbc-0eac-4ab4-84ec-922598752cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:41.563866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc26bbc-0eac-4ab4-84ec-922598752cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:41.564328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc26bbc-0eac-4ab4-84ec-922598752cdb admin admin] PATH_INFO: `/v3/projects/eb9a0ffa5fc74000836f096c478319eb/users/f175c7c95670489281ab0368dec8b016/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:41.600987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc26bbc-0eac-4ab4-84ec-922598752cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9a0ffa5fc74000836f096c478319eb, user_id=f175c7c95670489281ab0368dec8b016, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:41.603979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc26bbc-0eac-4ab4-84ec-922598752cdb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:41.650309 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1656/3286] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:11:41 2022] PUT /identity/v3/projects/eb9a0ffa5fc74000836f096c478319eb/users/f175c7c95670489281ab0368dec8b016/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:11:41.654262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a465d4-5faf-4bfb-b636-ffd238990843 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:41.682553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a465d4-5faf-4bfb-b636-ffd238990843 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:41.827033 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:41.840872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe2c08-9ac1-4c5a-8495-0d8989b0c633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:41.841958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2c08-9ac1-4c5a-8495-0d8989b0c633 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:41.842307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2c08-9ac1-4c5a-8495-0d8989b0c633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:41.842675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2c08-9ac1-4c5a-8495-0d8989b0c633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:41.843328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe2c08-9ac1-4c5a-8495-0d8989b0c633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:41.845780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe2c08-9ac1-4c5a-8495-0d8989b0c633 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:41.863268 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1631/3287] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:11:41.866919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc26bbc-0eac-4ab4-84ec-922598752cdb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:41.881099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc26bbc-0eac-4ab4-84ec-922598752cdb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:41.896907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5edfd-506a-4f79-8cd6-48c79c658435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:41.897594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5edfd-506a-4f79-8cd6-48c79c658435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:41.897880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5edfd-506a-4f79-8cd6-48c79c658435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:41.898153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5edfd-506a-4f79-8cd6-48c79c658435 admin admin] PATH_INFO: `/v3/projects/eb9a0ffa5fc74000836f096c478319eb/users/f175c7c95670489281ab0368dec8b016/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:41.901028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5edfd-506a-4f79-8cd6-48c79c658435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9a0ffa5fc74000836f096c478319eb, user_id=f175c7c95670489281ab0368dec8b016, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:41.903767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5edfd-506a-4f79-8cd6-48c79c658435 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:41.918530 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1657/3288] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:11:41 2022] PUT /identity/v3/projects/eb9a0ffa5fc74000836f096c478319eb/users/f175c7c95670489281ab0368dec8b016/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:11:41.930068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c5ea8-84ff-42a7-b0c6-ab8d2cc4902c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:41.930364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c5ea8-84ff-42a7-b0c6-ab8d2cc4902c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:41.930787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c5ea8-84ff-42a7-b0c6-ab8d2cc4902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:41.961672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-357c5ea8-84ff-42a7-b0c6-ab8d2cc4902c None None] MFA Rules not processed for user `f175c7c95670489281ab0368dec8b016`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:41.963187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-357c5ea8-84ff-42a7-b0c6-ab8d2cc4902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:42.097890 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1632/3289] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:42.103748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d5f3-9715-4e16-b5a8-374fd9542a0c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:42.103997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d5f3-9715-4e16-b5a8-374fd9542a0c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:42.104274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d5f3-9715-4e16-b5a8-374fd9542a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:42.145015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3bf8d5f3-9715-4e16-b5a8-374fd9542a0c None None] MFA Rules not processed for user `daade8c46ae44a4b81bafa442b6037f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:11:42.159710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3bf8d5f3-9715-4e16-b5a8-374fd9542a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:42.279944 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1658/3290] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:11:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:11:42.290244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c5ea8-84ff-42a7-b0c6-ab8d2cc4902c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:42.413992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c5ea8-84ff-42a7-b0c6-ab8d2cc4902c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:42.425717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873767af-7493-46a9-b032-d476fc9015d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:42.426440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873767af-7493-46a9-b032-d476fc9015d2 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:42.429775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873767af-7493-46a9-b032-d476fc9015d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:42.429949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873767af-7493-46a9-b032-d476fc9015d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:42.448113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873767af-7493-46a9-b032-d476fc9015d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:42.449739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873767af-7493-46a9-b032-d476fc9015d2 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:42.463912 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1633/3291] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:11:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:11:52.266908 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:52.458481 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=72 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:54.122980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8d5f3-9715-4e16-b5a8-374fd9542a0c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:11:54.125127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3bf8d5f3-9715-4e16-b5a8-374fd9542a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:54.198480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8d5f3-9715-4e16-b5a8-374fd9542a0c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:11:54.216219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298c0cf-9fb8-45b7-a9bd-b440481bf2a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:11:54.217290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c0cf-9fb8-45b7-a9bd-b440481bf2a3 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:11:54.218188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c0cf-9fb8-45b7-a9bd-b440481bf2a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:11:54.218683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c0cf-9fb8-45b7-a9bd-b440481bf2a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:11:54.220754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2298c0cf-9fb8-45b7-a9bd-b440481bf2a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:11:54.362331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298c0cf-9fb8-45b7-a9bd-b440481bf2a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:11:54.364256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298c0cf-9fb8-45b7-a9bd-b440481bf2a3 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:11:54.393434 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1659/3292] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:11:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:00.817369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873767af-7493-46a9-b032-d476fc9015d2 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:00.831256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873767af-7493-46a9-b032-d476fc9015d2 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:00.839346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774605-da63-4f44-9fec-2cd347f517b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:00.840223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774605-da63-4f44-9fec-2cd347f517b3 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:00.840672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774605-da63-4f44-9fec-2cd347f517b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:00.841488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774605-da63-4f44-9fec-2cd347f517b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:00.851530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774605-da63-4f44-9fec-2cd347f517b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:00.853242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774605-da63-4f44-9fec-2cd347f517b3 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:00.869124 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1634/3293] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:01.232679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38588-ec4c-4edb-a1a3-78d21a81ad1b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:01.233285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38588-ec4c-4edb-a1a3-78d21a81ad1b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:01.233285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38588-ec4c-4edb-a1a3-78d21a81ad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:01.253693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-57d38588-ec4c-4edb-a1a3-78d21a81ad1b None None] MFA Rules not processed for user `daade8c46ae44a4b81bafa442b6037f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:01.254943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-57d38588-ec4c-4edb-a1a3-78d21a81ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:01.262030 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1660/3294] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:03.192817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde36461-93e2-4e78-8239-05f9cefb27ef None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:03.193729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde36461-93e2-4e78-8239-05f9cefb27ef None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:03.194185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde36461-93e2-4e78-8239-05f9cefb27ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:03.196011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3877f2-4887-4be8-96f9-a38be6a5a9dc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:03.196852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3877f2-4887-4be8-96f9-a38be6a5a9dc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:03.197660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3877f2-4887-4be8-96f9-a38be6a5a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:03.220552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cde36461-93e2-4e78-8239-05f9cefb27ef None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:03.222055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cde36461-93e2-4e78-8239-05f9cefb27ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:03.239210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-de3877f2-4887-4be8-96f9-a38be6a5a9dc None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:03.241426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-de3877f2-4887-4be8-96f9-a38be6a5a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:03.337506 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1635/3295] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:03.358507 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1661/3296] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:12:03.416507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde36461-93e2-4e78-8239-05f9cefb27ef None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:03.417978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cde36461-93e2-4e78-8239-05f9cefb27ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:03.420358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3877f2-4887-4be8-96f9-a38be6a5a9dc None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:03.422024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-de3877f2-4887-4be8-96f9-a38be6a5a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:03.554693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3877f2-4887-4be8-96f9-a38be6a5a9dc None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:03.563682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451e531-24c4-42cb-8b6c-aea3d6a1c085 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:03.564661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451e531-24c4-42cb-8b6c-aea3d6a1c085 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:03.565128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451e531-24c4-42cb-8b6c-aea3d6a1c085 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:03.565591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451e531-24c4-42cb-8b6c-aea3d6a1c085 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:03.578714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451e531-24c4-42cb-8b6c-aea3d6a1c085 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:03.581494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451e531-24c4-42cb-8b6c-aea3d6a1c085 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:03.592873 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1662/3297] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:12:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:12:03.607113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde36461-93e2-4e78-8239-05f9cefb27ef None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:03.625174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4108052-7f49-4fd2-b857-1ad97fa1fae8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:03.625962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108052-7f49-4fd2-b857-1ad97fa1fae8 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:03.626124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108052-7f49-4fd2-b857-1ad97fa1fae8 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:03.626836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108052-7f49-4fd2-b857-1ad97fa1fae8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:03.668398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4108052-7f49-4fd2-b857-1ad97fa1fae8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:03.670036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4108052-7f49-4fd2-b857-1ad97fa1fae8 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:03.697079 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1636/3298] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:12:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:12:09.701698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451e531-24c4-42cb-8b6c-aea3d6a1c085 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:09.722010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451e531-24c4-42cb-8b6c-aea3d6a1c085 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:09.736096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344479ed-bae4-44f5-931d-017594812cb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:09.736634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344479ed-bae4-44f5-931d-017594812cb6 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:09.736919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344479ed-bae4-44f5-931d-017594812cb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:09.737193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344479ed-bae4-44f5-931d-017594812cb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:09.742531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-344479ed-bae4-44f5-931d-017594812cb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:09.771875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344479ed-bae4-44f5-931d-017594812cb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:09.773554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344479ed-bae4-44f5-931d-017594812cb6 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:09.797153 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1663/3299] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:11.541704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4108052-7f49-4fd2-b857-1ad97fa1fae8 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:11.544367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b4108052-7f49-4fd2-b857-1ad97fa1fae8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:11.731429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4108052-7f49-4fd2-b857-1ad97fa1fae8 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:11.770084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13a828-a3b0-4ef2-942d-3bf285f11966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:11.773020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a828-a3b0-4ef2-942d-3bf285f11966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:11.774461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a828-a3b0-4ef2-942d-3bf285f11966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:11.775176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a828-a3b0-4ef2-942d-3bf285f11966 admin admin] PATH_INFO: `/v3/users/214ad89f7fde4314a25b19d1e3479e9f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:11.779490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13a828-a3b0-4ef2-942d-3bf285f11966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=214ad89f7fde4314a25b19d1e3479e9f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:11.785133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13a828-a3b0-4ef2-942d-3bf285f11966 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:11.847837 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:11.910731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f13a828-a3b0-4ef2-942d-3bf285f11966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214ad89f7fde4314a25b19d1e3479e9f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:11.944569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f13a828-a3b0-4ef2-942d-3bf285f11966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214ad89f7fde4314a25b19d1e3479e9f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:11.951167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f13a828-a3b0-4ef2-942d-3bf285f11966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214ad89f7fde4314a25b19d1e3479e9f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:11.981194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f13a828-a3b0-4ef2-942d-3bf285f11966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214ad89f7fde4314a25b19d1e3479e9f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:12.004910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f13a828-a3b0-4ef2-942d-3bf285f11966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214ad89f7fde4314a25b19d1e3479e9f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:12.024583 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1637/3300] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:12:11 2022] DELETE /identity/v3/users/214ad89f7fde4314a25b19d1e3479e9f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:12.674664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344479ed-bae4-44f5-931d-017594812cb6 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:12.694113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344479ed-bae4-44f5-931d-017594812cb6 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:12.725689 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:12.838232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:12.839439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:12.839935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:12.840581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] PATH_INFO: `/v3/projects/918bcae48ada42b48ffd801791f5df22` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:12.842130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=918bcae48ada42b48ffd801791f5df22)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:12.845743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:12.914413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918bcae48ada42b48ffd801791f5df22', 'request_id': 'req-ab171455-26f0-4ae8-b2e3-8e0b61902b14'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:12.927922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918bcae48ada42b48ffd801791f5df22', 'request_id': 'req-ab171455-26f0-4ae8-b2e3-8e0b61902b14'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:12.944628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918bcae48ada42b48ffd801791f5df22', 'request_id': 'req-ab171455-26f0-4ae8-b2e3-8e0b61902b14'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:13.006310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] The token cache is being invalidate because project 918bcae48ada42b48ffd801791f5df22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:12:13.006803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:13.011760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab171455-26f0-4ae8-b2e3-8e0b61902b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:13.020550 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1664/3301] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:12 2022] DELETE /identity/v3/projects/918bcae48ada42b48ffd801791f5df22 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:13.025392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19dbe6-d2a4-4b35-b47b-edfbe58874fd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:13.026204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19dbe6-d2a4-4b35-b47b-edfbe58874fd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:13.026712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19dbe6-d2a4-4b35-b47b-edfbe58874fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:13.084451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cc19dbe6-d2a4-4b35-b47b-edfbe58874fd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:13.090131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc19dbe6-d2a4-4b35-b47b-edfbe58874fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:13.333999 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1638/3302] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:13.341939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305e8e-3b9e-4278-a37e-72f72fc095ca None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:13.342564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305e8e-3b9e-4278-a37e-72f72fc095ca None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:13.342981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305e8e-3b9e-4278-a37e-72f72fc095ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:13.408274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-93305e8e-3b9e-4278-a37e-72f72fc095ca None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:13.416413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-93305e8e-3b9e-4278-a37e-72f72fc095ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:13.455123 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1665/3303] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:13.460373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19dbe6-d2a4-4b35-b47b-edfbe58874fd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:13.477802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19dbe6-d2a4-4b35-b47b-edfbe58874fd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:13.492386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6683d-4252-4179-bda7-b33727e763d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:13.495218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6683d-4252-4179-bda7-b33727e763d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:13.495514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6683d-4252-4179-bda7-b33727e763d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:13.497440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6683d-4252-4179-bda7-b33727e763d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:13.498003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6683d-4252-4179-bda7-b33727e763d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:12:13.498326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6683d-4252-4179-bda7-b33727e763d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:13.504433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6683d-4252-4179-bda7-b33727e763d1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:13.537165 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1639/3304] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:13.541195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93305e8e-3b9e-4278-a37e-72f72fc095ca None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:13.555421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93305e8e-3b9e-4278-a37e-72f72fc095ca None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:13.588816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d2698-7bc3-4c79-bb8b-52834ff14bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:13.591088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d2698-7bc3-4c79-bb8b-52834ff14bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:13.592023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d2698-7bc3-4c79-bb8b-52834ff14bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:13.592499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d2698-7bc3-4c79-bb8b-52834ff14bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:13.594003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d2698-7bc3-4c79-bb8b-52834ff14bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:13.597081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d2698-7bc3-4c79-bb8b-52834ff14bd2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:13.667254 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1666/3305] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:12:13 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:13.669023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6683d-4252-4179-bda7-b33727e763d1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:13.690200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6683d-4252-4179-bda7-b33727e763d1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:13.868895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e03ff-7e43-4a68-a47a-45fafe8c1b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:13.869572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e03ff-7e43-4a68-a47a-45fafe8c1b1b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:13.870914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e03ff-7e43-4a68-a47a-45fafe8c1b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:13.873303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e03ff-7e43-4a68-a47a-45fafe8c1b1b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:13.875681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e03ff-7e43-4a68-a47a-45fafe8c1b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:13.885138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e03ff-7e43-4a68-a47a-45fafe8c1b1b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:13.988725 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1640/3306] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:12:13 2022] POST /identity/v3/users => generated 290 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:13.992880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d2698-7bc3-4c79-bb8b-52834ff14bd2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:14.014841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d2698-7bc3-4c79-bb8b-52834ff14bd2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:14.034287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8ec74-1dcf-4af0-afb2-73c9d072a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:14.036253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8ec74-1dcf-4af0-afb2-73c9d072a7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:14.037952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8ec74-1dcf-4af0-afb2-73c9d072a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:14.038246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8ec74-1dcf-4af0-afb2-73c9d072a7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:14.038961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8ec74-1dcf-4af0-afb2-73c9d072a7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:14.046482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8ec74-1dcf-4af0-afb2-73c9d072a7f0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:14.081181 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1667/3307] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:12:14.082834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e03ff-7e43-4a68-a47a-45fafe8c1b1b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:14.094297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e03ff-7e43-4a68-a47a-45fafe8c1b1b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:14.109805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d5479-af48-496f-bb5c-69762af965a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:14.111206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d5479-af48-496f-bb5c-69762af965a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:14.111377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d5479-af48-496f-bb5c-69762af965a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:14.111714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d5479-af48-496f-bb5c-69762af965a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:14.112353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d5479-af48-496f-bb5c-69762af965a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:14.117701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d5479-af48-496f-bb5c-69762af965a8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:14.149316 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1641/3308] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:12:14.150543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8ec74-1dcf-4af0-afb2-73c9d072a7f0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:14.163153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8ec74-1dcf-4af0-afb2-73c9d072a7f0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:14.176408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79382ba9-fb88-4639-943e-c134098f8385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:14.177462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382ba9-fb88-4639-943e-c134098f8385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:14.177891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382ba9-fb88-4639-943e-c134098f8385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:14.178187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382ba9-fb88-4639-943e-c134098f8385 admin admin] PATH_INFO: `/v3/projects/447cbc915a47450c8bc98a83e919310a/users/ef737c7d2aa247388c88fc2ad7ea5748/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:14.213186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79382ba9-fb88-4639-943e-c134098f8385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447cbc915a47450c8bc98a83e919310a, user_id=ef737c7d2aa247388c88fc2ad7ea5748, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:14.221066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79382ba9-fb88-4639-943e-c134098f8385 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:14.251707 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1668/3309] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:12:14 2022] PUT /identity/v3/projects/447cbc915a47450c8bc98a83e919310a/users/ef737c7d2aa247388c88fc2ad7ea5748/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:14.253339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae9aaa-b153-4d3e-87f0-a41590003bad None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:14.253638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae9aaa-b153-4d3e-87f0-a41590003bad None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:14.253936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae9aaa-b153-4d3e-87f0-a41590003bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:14.297485 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:14.311527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dfae9aaa-b153-4d3e-87f0-a41590003bad None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:14.313476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dfae9aaa-b153-4d3e-87f0-a41590003bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:14.453660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79382ba9-fb88-4639-943e-c134098f8385 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:14.463277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-79382ba9-fb88-4639-943e-c134098f8385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:14.499304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79382ba9-fb88-4639-943e-c134098f8385 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:14.502475 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1642/3310] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:14.510645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af31c78-e1dd-47bb-b2b3-893a77d8810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:14.511469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af31c78-e1dd-47bb-b2b3-893a77d8810f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:14.511847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af31c78-e1dd-47bb-b2b3-893a77d8810f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:14.512216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af31c78-e1dd-47bb-b2b3-893a77d8810f admin admin] PATH_INFO: `/v3/users/49da406fdd2e4aa980c1a7343af9a321` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:14.513753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af31c78-e1dd-47bb-b2b3-893a77d8810f admin admin] RBAC: Authorizing `identity:delete_user(user_id=49da406fdd2e4aa980c1a7343af9a321)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:14.520311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af31c78-e1dd-47bb-b2b3-893a77d8810f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:14.522117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae9aaa-b153-4d3e-87f0-a41590003bad None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:14.529577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dfae9aaa-b153-4d3e-87f0-a41590003bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:14.854440 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:14.893281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1af31c78-e1dd-47bb-b2b3-893a77d8810f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49da406fdd2e4aa980c1a7343af9a321'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:14.953349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1af31c78-e1dd-47bb-b2b3-893a77d8810f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49da406fdd2e4aa980c1a7343af9a321'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:14.955102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1af31c78-e1dd-47bb-b2b3-893a77d8810f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49da406fdd2e4aa980c1a7343af9a321'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:14.971415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae9aaa-b153-4d3e-87f0-a41590003bad None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:14.995023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1af31c78-e1dd-47bb-b2b3-893a77d8810f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49da406fdd2e4aa980c1a7343af9a321'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:14.995898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1af31c78-e1dd-47bb-b2b3-893a77d8810f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49da406fdd2e4aa980c1a7343af9a321'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:15.004176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc7c18-3219-4194-bee9-588d1e8c285f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:15.004858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc7c18-3219-4194-bee9-588d1e8c285f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:15.019893 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1669/3311] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:12:14 2022] DELETE /identity/v3/users/49da406fdd2e4aa980c1a7343af9a321 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:15.020104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc7c18-3219-4194-bee9-588d1e8c285f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:15.020104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc7c18-3219-4194-bee9-588d1e8c285f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:15.026817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be514987-4f94-49a7-908e-03ff88f82787 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:15.029186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be514987-4f94-49a7-908e-03ff88f82787 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:15.029709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be514987-4f94-49a7-908e-03ff88f82787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:15.030349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cebc7c18-3219-4194-bee9-588d1e8c285f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:15.076400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc7c18-3219-4194-bee9-588d1e8c285f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:15.079909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc7c18-3219-4194-bee9-588d1e8c285f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:15.093529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-be514987-4f94-49a7-908e-03ff88f82787 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:15.097074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-be514987-4f94-49a7-908e-03ff88f82787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:15.144706 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1643/3312] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:15.347759 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1670/3313] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:15.355137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc7c18-3219-4194-bee9-588d1e8c285f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:15.356719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cebc7c18-3219-4194-bee9-588d1e8c285f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:15.390453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc7c18-3219-4194-bee9-588d1e8c285f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:15.651279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4714a5-b678-4652-a236-814f7e58ac2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:15.652639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4714a5-b678-4652-a236-814f7e58ac2b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:15.663065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4714a5-b678-4652-a236-814f7e58ac2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:15.663548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4714a5-b678-4652-a236-814f7e58ac2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:15.690526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4714a5-b678-4652-a236-814f7e58ac2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:15.692422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4714a5-b678-4652-a236-814f7e58ac2b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:15.718658 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1644/3314] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:16.928035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be514987-4f94-49a7-908e-03ff88f82787 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:16.931304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-be514987-4f94-49a7-908e-03ff88f82787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:16.952848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be514987-4f94-49a7-908e-03ff88f82787 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:17.037457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:17.038004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:17.047103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:17.047436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] PATH_INFO: `/v3/projects/c1893a97eaf94d85b113cb3d03c3ef85` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:17.053961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1893a97eaf94d85b113cb3d03c3ef85)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:17.055943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:17.206516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1893a97eaf94d85b113cb3d03c3ef85', 'request_id': 'req-d77b631a-c5c0-42fe-9e59-3838438a2b1d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:17.222280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1893a97eaf94d85b113cb3d03c3ef85', 'request_id': 'req-d77b631a-c5c0-42fe-9e59-3838438a2b1d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:17.240958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1893a97eaf94d85b113cb3d03c3ef85', 'request_id': 'req-d77b631a-c5c0-42fe-9e59-3838438a2b1d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:17.273556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] The token cache is being invalidate because project c1893a97eaf94d85b113cb3d03c3ef85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:12:17.274259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:17.275828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:17.282193 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1671/3315] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:16 2022] DELETE /identity/v3/projects/c1893a97eaf94d85b113cb3d03c3ef85 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:17.287236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4714a5-b678-4652-a236-814f7e58ac2b service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:17.304988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4714a5-b678-4652-a236-814f7e58ac2b service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:17.487981 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:17.524538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f03d29-fd0d-44b0-b499-17a3ba1d02d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:17.525527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f03d29-fd0d-44b0-b499-17a3ba1d02d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:17.525811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f03d29-fd0d-44b0-b499-17a3ba1d02d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:17.526084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f03d29-fd0d-44b0-b499-17a3ba1d02d6 admin admin] PATH_INFO: `/v3/users/1b7bf570c28b4238bc7da539255d9e3d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:17.527255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f03d29-fd0d-44b0-b499-17a3ba1d02d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7bf570c28b4238bc7da539255d9e3d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:17.529213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f03d29-fd0d-44b0-b499-17a3ba1d02d6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:17.702161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-73f03d29-fd0d-44b0-b499-17a3ba1d02d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7bf570c28b4238bc7da539255d9e3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:17.748358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-73f03d29-fd0d-44b0-b499-17a3ba1d02d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7bf570c28b4238bc7da539255d9e3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:17.749912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-73f03d29-fd0d-44b0-b499-17a3ba1d02d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7bf570c28b4238bc7da539255d9e3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:17.773550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-73f03d29-fd0d-44b0-b499-17a3ba1d02d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7bf570c28b4238bc7da539255d9e3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:17.789911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-73f03d29-fd0d-44b0-b499-17a3ba1d02d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7bf570c28b4238bc7da539255d9e3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:17.830652 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1645/3316] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:12:17 2022] DELETE /identity/v3/users/1b7bf570c28b4238bc7da539255d9e3d => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:19.179949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:19.181410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:19.209376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b631a-c5c0-42fe-9e59-3838438a2b1d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:19.296850 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:19.355570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:19.356224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:19.356496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:19.356767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] PATH_INFO: `/v3/projects/4a7b906ed9b1454e9f30feddabead478` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:19.361905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7b906ed9b1454e9f30feddabead478)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:19.364112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:19.483100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7b906ed9b1454e9f30feddabead478', 'request_id': 'req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:19.508310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7b906ed9b1454e9f30feddabead478', 'request_id': 'req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:19.522319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7b906ed9b1454e9f30feddabead478', 'request_id': 'req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:19.552007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] The token cache is being invalidate because project 4a7b906ed9b1454e9f30feddabead478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:12:19.552422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:19.554185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1e4ad071-9988-41c9-bfbe-ce8851c8c74a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:19.561197 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1672/3317] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:19 2022] DELETE /identity/v3/projects/4a7b906ed9b1454e9f30feddabead478 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:19.563828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a18ee-8f99-4282-af12-ffbc8931c71a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:19.564955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a18ee-8f99-4282-af12-ffbc8931c71a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:19.565258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a18ee-8f99-4282-af12-ffbc8931c71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:19.609103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8e7a18ee-8f99-4282-af12-ffbc8931c71a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:19.613156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8e7a18ee-8f99-4282-af12-ffbc8931c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:19.712598 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1646/3318] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:19.719939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2286ed3-8598-4b22-8a02-88a19d11ef9c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:19.721153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2286ed3-8598-4b22-8a02-88a19d11ef9c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:19.721524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2286ed3-8598-4b22-8a02-88a19d11ef9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:19.759551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d2286ed3-8598-4b22-8a02-88a19d11ef9c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:19.760853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d2286ed3-8598-4b22-8a02-88a19d11ef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:19.771022 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1673/3319] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:19.776457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a18ee-8f99-4282-af12-ffbc8931c71a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:19.806532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a18ee-8f99-4282-af12-ffbc8931c71a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:19.827298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2aec3-30d6-4b7d-86d2-a2ba18d73eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:19.827927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2aec3-30d6-4b7d-86d2-a2ba18d73eec admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:19.828205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2aec3-30d6-4b7d-86d2-a2ba18d73eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:19.828479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2aec3-30d6-4b7d-86d2-a2ba18d73eec admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:19.829152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2aec3-30d6-4b7d-86d2-a2ba18d73eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:12:19.829481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2aec3-30d6-4b7d-86d2-a2ba18d73eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:19.832225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2aec3-30d6-4b7d-86d2-a2ba18d73eec admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:19.850503 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1647/3320] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:19.854673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2286ed3-8598-4b22-8a02-88a19d11ef9c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:19.874793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2286ed3-8598-4b22-8a02-88a19d11ef9c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:19.902626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988c7e3-2025-43ff-9c9c-0f68487d97b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:19.904831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c7e3-2025-43ff-9c9c-0f68487d97b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:19.916372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c7e3-2025-43ff-9c9c-0f68487d97b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:19.916372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c7e3-2025-43ff-9c9c-0f68487d97b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:19.916372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988c7e3-2025-43ff-9c9c-0f68487d97b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:19.916372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988c7e3-2025-43ff-9c9c-0f68487d97b5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:20.015415 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1674/3321] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:12:19 2022] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:12:20.019495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2aec3-30d6-4b7d-86d2-a2ba18d73eec admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:20.035856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2aec3-30d6-4b7d-86d2-a2ba18d73eec admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:20.243217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3785d5-2d0d-4949-96a3-8bae7c7cdccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:20.244250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3785d5-2d0d-4949-96a3-8bae7c7cdccd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:20.244536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3785d5-2d0d-4949-96a3-8bae7c7cdccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:20.244813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3785d5-2d0d-4949-96a3-8bae7c7cdccd admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:20.245469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3785d5-2d0d-4949-96a3-8bae7c7cdccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:20.248477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3785d5-2d0d-4949-96a3-8bae7c7cdccd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:20.274172 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:20.308181 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1648/3322] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:12:20 2022] POST /identity/v3/users => generated 295 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:20.309680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988c7e3-2025-43ff-9c9c-0f68487d97b5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:20.333482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988c7e3-2025-43ff-9c9c-0f68487d97b5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:20.365566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcd2b5-c691-4ce0-a46e-c3164a136369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:20.368798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd2b5-c691-4ce0-a46e-c3164a136369 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:20.369402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd2b5-c691-4ce0-a46e-c3164a136369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:20.375077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd2b5-c691-4ce0-a46e-c3164a136369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:20.379519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcd2b5-c691-4ce0-a46e-c3164a136369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:20.393757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcd2b5-c691-4ce0-a46e-c3164a136369 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:20.443709 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1675/3323] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:12:20.444742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3785d5-2d0d-4949-96a3-8bae7c7cdccd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:20.466762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3785d5-2d0d-4949-96a3-8bae7c7cdccd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:20.487758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f0f7b-bd56-4fca-9e74-3b004c0acea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:20.488412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f0f7b-bd56-4fca-9e74-3b004c0acea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:20.488699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f0f7b-bd56-4fca-9e74-3b004c0acea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:20.488979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f0f7b-bd56-4fca-9e74-3b004c0acea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:20.489650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f0f7b-bd56-4fca-9e74-3b004c0acea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:20.491456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f0f7b-bd56-4fca-9e74-3b004c0acea5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:20.530706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcd2b5-c691-4ce0-a46e-c3164a136369 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:20.531400 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1649/3324] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:12:20.537419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcd2b5-c691-4ce0-a46e-c3164a136369 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:20.553203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8890b-2957-4e5a-a7e9-5896c2b176bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:20.553949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8890b-2957-4e5a-a7e9-5896c2b176bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:20.554238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8890b-2957-4e5a-a7e9-5896c2b176bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:20.554518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8890b-2957-4e5a-a7e9-5896c2b176bc admin admin] PATH_INFO: `/v3/projects/5718ec2e31884cf4aa08f61348463aa1/users/6101c2fe10bb4064a119057c1d17adae/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:20.590094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8890b-2957-4e5a-a7e9-5896c2b176bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5718ec2e31884cf4aa08f61348463aa1, user_id=6101c2fe10bb4064a119057c1d17adae, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:20.592945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8890b-2957-4e5a-a7e9-5896c2b176bc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:20.633373 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1676/3325] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:12:20 2022] PUT /identity/v3/projects/5718ec2e31884cf4aa08f61348463aa1/users/6101c2fe10bb4064a119057c1d17adae/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:20.635845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50fb1f-9568-4dbf-bd63-f01af3a9d3f3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:20.636314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50fb1f-9568-4dbf-bd63-f01af3a9d3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:20.636501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50fb1f-9568-4dbf-bd63-f01af3a9d3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:20.684799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7c50fb1f-9568-4dbf-bd63-f01af3a9d3f3 None None] MFA Rules not processed for user `6101c2fe10bb4064a119057c1d17adae`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:20.686132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c50fb1f-9568-4dbf-bd63-f01af3a9d3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:20.975326 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1650/3326] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:12:20.979980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8890b-2957-4e5a-a7e9-5896c2b176bc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:21.121071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8890b-2957-4e5a-a7e9-5896c2b176bc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:21.135935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84409f94-8a15-4375-af95-42baafc7f9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:21.138773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409f94-8a15-4375-af95-42baafc7f9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:21.139579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409f94-8a15-4375-af95-42baafc7f9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:21.143046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409f94-8a15-4375-af95-42baafc7f9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:21.144483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84409f94-8a15-4375-af95-42baafc7f9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:21.149266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84409f94-8a15-4375-af95-42baafc7f9f1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:21.168164 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:21.240136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50fb1f-9568-4dbf-bd63-f01af3a9d3f3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:21.249911 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1677/3327] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:12:20 2022] POST /identity/v3/projects => generated 391 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:21.258172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50fb1f-9568-4dbf-bd63-f01af3a9d3f3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:21.487029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2844-0cf4-41d0-81d2-b7899b5ae700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:21.487878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2844-0cf4-41d0-81d2-b7899b5ae700 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:21.488269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2844-0cf4-41d0-81d2-b7899b5ae700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:21.488656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2844-0cf4-41d0-81d2-b7899b5ae700 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:21.489936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2844-0cf4-41d0-81d2-b7899b5ae700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:21.497231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2844-0cf4-41d0-81d2-b7899b5ae700 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:21.567819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84409f94-8a15-4375-af95-42baafc7f9f1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:21.578550 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1651/3328] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:12:21 2022] POST /identity/v3/users => generated 302 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:12:21.590716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84409f94-8a15-4375-af95-42baafc7f9f1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:21.599283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3834774-538c-4044-993b-2051f31554af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:21.604966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834774-538c-4044-993b-2051f31554af admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:21.606829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834774-538c-4044-993b-2051f31554af admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:21.607238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834774-538c-4044-993b-2051f31554af admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:21.608274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3834774-538c-4044-993b-2051f31554af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:21.610276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3834774-538c-4044-993b-2051f31554af admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:21.633296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2844-0cf4-41d0-81d2-b7899b5ae700 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:21.645367 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1678/3329] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:12:21.647342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2844-0cf4-41d0-81d2-b7899b5ae700 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:21.654811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b8a93-a423-4a04-9889-52588c06ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:21.657065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b8a93-a423-4a04-9889-52588c06ce8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:21.659283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b8a93-a423-4a04-9889-52588c06ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:21.659867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b8a93-a423-4a04-9889-52588c06ce8a admin admin] PATH_INFO: `/v3/projects/c3e42a55d5a24780aeeefd075120c1ef/users/a89041e621f643389b328f8b8e177c9b/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:21.711998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b8a93-a423-4a04-9889-52588c06ce8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e42a55d5a24780aeeefd075120c1ef, user_id=a89041e621f643389b328f8b8e177c9b, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:21.727151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b8a93-a423-4a04-9889-52588c06ce8a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:21.800329 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1652/3330] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:12:21 2022] PUT /identity/v3/projects/c3e42a55d5a24780aeeefd075120c1ef/users/a89041e621f643389b328f8b8e177c9b/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:21.804889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3834774-538c-4044-993b-2051f31554af admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:21.827770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3834774-538c-4044-993b-2051f31554af admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:22.103958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf16e97-36d8-4c4d-bf20-246cdf618cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:22.104602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf16e97-36d8-4c4d-bf20-246cdf618cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:22.104884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf16e97-36d8-4c4d-bf20-246cdf618cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:22.105153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf16e97-36d8-4c4d-bf20-246cdf618cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:22.105814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf16e97-36d8-4c4d-bf20-246cdf618cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:22.107454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf16e97-36d8-4c4d-bf20-246cdf618cf4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:22.153028 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1679/3331] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:12:22.154263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b8a93-a423-4a04-9889-52588c06ce8a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:22.176963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b8a93-a423-4a04-9889-52588c06ce8a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:22.182664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ad30a-9244-47b9-9ae3-a86603025d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:22.183358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ad30a-9244-47b9-9ae3-a86603025d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:22.188520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ad30a-9244-47b9-9ae3-a86603025d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:22.188816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ad30a-9244-47b9-9ae3-a86603025d21 admin admin] PATH_INFO: `/v3/projects/c3e42a55d5a24780aeeefd075120c1ef/users/a89041e621f643389b328f8b8e177c9b/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:22.191281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ad30a-9244-47b9-9ae3-a86603025d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e42a55d5a24780aeeefd075120c1ef, user_id=a89041e621f643389b328f8b8e177c9b, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:22.199105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ad30a-9244-47b9-9ae3-a86603025d21 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:22.233142 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1653/3332] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:12:22 2022] PUT /identity/v3/projects/c3e42a55d5a24780aeeefd075120c1ef/users/a89041e621f643389b328f8b8e177c9b/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:22.249219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104c49c-3f3a-4ac5-bf9b-6f2d4f4d8ecf None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:22.249509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104c49c-3f3a-4ac5-bf9b-6f2d4f4d8ecf None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:22.249787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104c49c-3f3a-4ac5-bf9b-6f2d4f4d8ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:22.336444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f104c49c-3f3a-4ac5-bf9b-6f2d4f4d8ecf None None] MFA Rules not processed for user `a89041e621f643389b328f8b8e177c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:22.337668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f104c49c-3f3a-4ac5-bf9b-6f2d4f4d8ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:22.576500 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1680/3333] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:12:22.947057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ad30a-9244-47b9-9ae3-a86603025d21 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:23.017307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0e9ad30a-9244-47b9-9ae3-a86603025d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:23.172848 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:23.335549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ad30a-9244-47b9-9ae3-a86603025d21 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:23.358147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2930644-46fe-4b0b-9480-55155d4b5d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:23.358821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2930644-46fe-4b0b-9480-55155d4b5d09 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:23.359110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2930644-46fe-4b0b-9480-55155d4b5d09 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:23.359379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2930644-46fe-4b0b-9480-55155d4b5d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:23.395879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2930644-46fe-4b0b-9480-55155d4b5d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:23.397521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2930644-46fe-4b0b-9480-55155d4b5d09 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:23.434188 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1654/3334] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:22 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:24.946407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104c49c-3f3a-4ac5-bf9b-6f2d4f4d8ecf None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:24.977968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104c49c-3f3a-4ac5-bf9b-6f2d4f4d8ecf None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:24.999375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b497f-5dba-4acb-9b08-e3ed13e95620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:25.000189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b497f-5dba-4acb-9b08-e3ed13e95620 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:25.002814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b497f-5dba-4acb-9b08-e3ed13e95620 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:25.003219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b497f-5dba-4acb-9b08-e3ed13e95620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:25.135118 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:25.138968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b497f-5dba-4acb-9b08-e3ed13e95620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:25.140859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b497f-5dba-4acb-9b08-e3ed13e95620 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:25.155013 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1681/3335] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:25.207009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2930644-46fe-4b0b-9480-55155d4b5d09 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:25.451100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2930644-46fe-4b0b-9480-55155d4b5d09 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:25.457929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:25.459051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:25.459612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:25.460110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] PATH_INFO: `/v3/users/6101c2fe10bb4064a119057c1d17adae` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:25.461654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6101c2fe10bb4064a119057c1d17adae)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:25.464674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:25.557728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6101c2fe10bb4064a119057c1d17adae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:25.576308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6101c2fe10bb4064a119057c1d17adae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:25.577209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6101c2fe10bb4064a119057c1d17adae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:25.593965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6101c2fe10bb4064a119057c1d17adae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:25.607614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6101c2fe10bb4064a119057c1d17adae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:25.625179 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1655/3336] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:12:25 2022] DELETE /identity/v3/users/6101c2fe10bb4064a119057c1d17adae => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:25.630217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3498e-5e89-42a7-934e-d0bd26dfdab3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:25.630509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3498e-5e89-42a7-934e-d0bd26dfdab3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:25.630838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3498e-5e89-42a7-934e-d0bd26dfdab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:25.700886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-51d3498e-5e89-42a7-934e-d0bd26dfdab3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:25.705093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-51d3498e-5e89-42a7-934e-d0bd26dfdab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:25.919795 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1682/3337] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:25.937446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:25.939735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:26.040884 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:26.139788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebe94d-af7f-4210-b4ce-003df8afbaf3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:26.151293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac88f4b-d239-4eae-add4-33e27cd4f2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:26.152562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac88f4b-d239-4eae-add4-33e27cd4f2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:26.153022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac88f4b-d239-4eae-add4-33e27cd4f2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:26.153472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac88f4b-d239-4eae-add4-33e27cd4f2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:26.176009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac88f4b-d239-4eae-add4-33e27cd4f2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:26.177741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac88f4b-d239-4eae-add4-33e27cd4f2b2 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:26.196772 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1656/3338] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:26.597182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b192-a18f-4ccc-be2c-0a127f297aaf None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:26.598150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b192-a18f-4ccc-be2c-0a127f297aaf None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:26.600390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b192-a18f-4ccc-be2c-0a127f297aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:26.621847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-eaa1b192-a18f-4ccc-be2c-0a127f297aaf None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:26.623540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eaa1b192-a18f-4ccc-be2c-0a127f297aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:26.729222 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1683/3339] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:12:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:12:26.743685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac88f4b-d239-4eae-add4-33e27cd4f2b2 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:26.745767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cac88f4b-d239-4eae-add4-33e27cd4f2b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:26.872769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1b192-a18f-4ccc-be2c-0a127f297aaf None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:26.875298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eaa1b192-a18f-4ccc-be2c-0a127f297aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:26.925571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1b192-a18f-4ccc-be2c-0a127f297aaf None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:26.944420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:26.945337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:26.947536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:26.950265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] PATH_INFO: `/v3/projects/5718ec2e31884cf4aa08f61348463aa1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:26.952170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5718ec2e31884cf4aa08f61348463aa1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:26.981663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:27.098647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac88f4b-d239-4eae-add4-33e27cd4f2b2 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:27.105876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044922f-fd7c-409b-adbd-e5f5dfd737f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:27.106960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044922f-fd7c-409b-adbd-e5f5dfd737f2 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:27.107460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044922f-fd7c-409b-adbd-e5f5dfd737f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:27.108131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044922f-fd7c-409b-adbd-e5f5dfd737f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:27.124830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044922f-fd7c-409b-adbd-e5f5dfd737f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:27.127884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044922f-fd7c-409b-adbd-e5f5dfd737f2 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:27.152562 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1657/3340] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:12:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:12:27.163665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5718ec2e31884cf4aa08f61348463aa1', 'request_id': 'req-92557547-6d71-4f1b-a0f5-390fd6e399d2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:27.181458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5718ec2e31884cf4aa08f61348463aa1', 'request_id': 'req-92557547-6d71-4f1b-a0f5-390fd6e399d2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:27.215366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5718ec2e31884cf4aa08f61348463aa1', 'request_id': 'req-92557547-6d71-4f1b-a0f5-390fd6e399d2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:27.261817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] The token cache is being invalidate because project 5718ec2e31884cf4aa08f61348463aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:12:27.262161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:27.265038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-92557547-6d71-4f1b-a0f5-390fd6e399d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:27.272003 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1684/3341] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:26 2022] DELETE /identity/v3/projects/5718ec2e31884cf4aa08f61348463aa1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:27.276026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044922f-fd7c-409b-adbd-e5f5dfd737f2 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:27.291791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044922f-fd7c-409b-adbd-e5f5dfd737f2 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:27.445359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6e2d1-fffe-406a-a64a-77d36721e3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:27.446043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e2d1-fffe-406a-a64a-77d36721e3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:27.446356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e2d1-fffe-406a-a64a-77d36721e3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:27.449056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e2d1-fffe-406a-a64a-77d36721e3c9 admin admin] PATH_INFO: `/v3/users/a89041e621f643389b328f8b8e177c9b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:27.450569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6e2d1-fffe-406a-a64a-77d36721e3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89041e621f643389b328f8b8e177c9b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:27.458755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6e2d1-fffe-406a-a64a-77d36721e3c9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:27.596204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ec6e2d1-fffe-406a-a64a-77d36721e3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89041e621f643389b328f8b8e177c9b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:27.654430 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:27.668607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b22c-4b76-42fe-ba99-74b8b187354c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:27.670829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b22c-4b76-42fe-ba99-74b8b187354c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:27.671589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b22c-4b76-42fe-ba99-74b8b187354c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:27.685089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ec6e2d1-fffe-406a-a64a-77d36721e3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89041e621f643389b328f8b8e177c9b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:27.686060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ec6e2d1-fffe-406a-a64a-77d36721e3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89041e621f643389b328f8b8e177c9b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:27.706974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ec6e2d1-fffe-406a-a64a-77d36721e3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89041e621f643389b328f8b8e177c9b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:27.727703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ec6e2d1-fffe-406a-a64a-77d36721e3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89041e621f643389b328f8b8e177c9b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:27.753629 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1658/3342] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:12:27 2022] DELETE /identity/v3/users/a89041e621f643389b328f8b8e177c9b => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:27.771640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2776b22c-4b76-42fe-ba99-74b8b187354c None None] MFA Rules not processed for user `ef737c7d2aa247388c88fc2ad7ea5748`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:27.772912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2776b22c-4b76-42fe-ba99-74b8b187354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:27.827696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527b7cc-0901-4974-9383-428318946038 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:27.827968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527b7cc-0901-4974-9383-428318946038 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:27.828241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527b7cc-0901-4974-9383-428318946038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:27.858225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8527b7cc-0901-4974-9383-428318946038 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:27.859008 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:27.867078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8527b7cc-0901-4974-9383-428318946038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:27.989533 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1685/3343] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:12:27.991118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776b22c-4b76-42fe-ba99-74b8b187354c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:27.995363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2776b22c-4b76-42fe-ba99-74b8b187354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:28.014730 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1659/3344] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:12:28.029847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527b7cc-0901-4974-9383-428318946038 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:28.032092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8527b7cc-0901-4974-9383-428318946038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:28.159271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776b22c-4b76-42fe-ba99-74b8b187354c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:28.164369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bfd95-a479-47d1-89f0-e0c4a1c75181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:28.164983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bfd95-a479-47d1-89f0-e0c4a1c75181 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:28.165263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bfd95-a479-47d1-89f0-e0c4a1c75181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:28.165536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bfd95-a479-47d1-89f0-e0c4a1c75181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:28.166201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bfd95-a479-47d1-89f0-e0c4a1c75181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:28.168451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bfd95-a479-47d1-89f0-e0c4a1c75181 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:28.202767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527b7cc-0901-4974-9383-428318946038 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:28.212544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fe4aa-4283-4e35-a8d5-89d8fd53a575 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:28.213377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe4aa-4283-4e35-a8d5-89d8fd53a575 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:28.213800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe4aa-4283-4e35-a8d5-89d8fd53a575 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:28.214092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe4aa-4283-4e35-a8d5-89d8fd53a575 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:28.232559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fe4aa-4283-4e35-a8d5-89d8fd53a575 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:28.234452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fe4aa-4283-4e35-a8d5-89d8fd53a575 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:28.239984 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1686/3345] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:12:27 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:28.244072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bfd95-a479-47d1-89f0-e0c4a1c75181 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:28.259833 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1660/3346] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:12:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:12:28.374691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bfd95-a479-47d1-89f0-e0c4a1c75181 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:28.393977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb44a9c-e944-4d22-9e1c-a4bd2e120a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:28.394220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb44a9c-e944-4d22-9e1c-a4bd2e120a2b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:28.394448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb44a9c-e944-4d22-9e1c-a4bd2e120a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:28.394657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb44a9c-e944-4d22-9e1c-a4bd2e120a2b admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:28.395824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb44a9c-e944-4d22-9e1c-a4bd2e120a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:28.397993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb44a9c-e944-4d22-9e1c-a4bd2e120a2b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:28.489830 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1687/3347] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:12:28 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:28.493590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fe4aa-4283-4e35-a8d5-89d8fd53a575 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:28.520705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fe4aa-4283-4e35-a8d5-89d8fd53a575 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:28.534493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba2162-3d48-4ee1-a543-9de0bca6928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:28.535174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba2162-3d48-4ee1-a543-9de0bca6928f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:28.535458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba2162-3d48-4ee1-a543-9de0bca6928f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:28.535814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba2162-3d48-4ee1-a543-9de0bca6928f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:28.536472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba2162-3d48-4ee1-a543-9de0bca6928f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:28.538081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba2162-3d48-4ee1-a543-9de0bca6928f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:28.566987 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1661/3348] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:12:28.573838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb44a9c-e944-4d22-9e1c-a4bd2e120a2b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:28.602205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb44a9c-e944-4d22-9e1c-a4bd2e120a2b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:28.631590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e26d80-1a90-4438-9425-c35a3aeb640f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:28.633097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e26d80-1a90-4438-9425-c35a3aeb640f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:28.641719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e26d80-1a90-4438-9425-c35a3aeb640f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:28.642304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e26d80-1a90-4438-9425-c35a3aeb640f admin admin] PATH_INFO: `/v3/projects/8d17afac888c409caeae7a34bb8ed044/users/f74f0c5c99a14332bc3224b7400f4587/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:28.707627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e26d80-1a90-4438-9425-c35a3aeb640f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d17afac888c409caeae7a34bb8ed044, user_id=f74f0c5c99a14332bc3224b7400f4587, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:28.711020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e26d80-1a90-4438-9425-c35a3aeb640f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:28.746894 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1688/3349] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:12:28 2022] PUT /identity/v3/projects/8d17afac888c409caeae7a34bb8ed044/users/f74f0c5c99a14332bc3224b7400f4587/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:28.750328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba2162-3d48-4ee1-a543-9de0bca6928f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:28.769727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba2162-3d48-4ee1-a543-9de0bca6928f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:28.790753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246902a-fed6-4b87-8c57-d1d851e95cec None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:28.791082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246902a-fed6-4b87-8c57-d1d851e95cec None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:28.791318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246902a-fed6-4b87-8c57-d1d851e95cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:28.802786 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:28.832945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9246902a-fed6-4b87-8c57-d1d851e95cec None None] MFA Rules not processed for user `8cd2ad37e9b844ac8b7632fd9291023a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:28.839333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9246902a-fed6-4b87-8c57-d1d851e95cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:29.015764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75f81-d674-4f28-9fe2-1a8e4553fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:29.016408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75f81-d674-4f28-9fe2-1a8e4553fe12 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:29.016694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75f81-d674-4f28-9fe2-1a8e4553fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:29.016969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75f81-d674-4f28-9fe2-1a8e4553fe12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:29.018190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d75f81-d674-4f28-9fe2-1a8e4553fe12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:29.025587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d75f81-d674-4f28-9fe2-1a8e4553fe12 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:29.030285 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:29.061290 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1662/3350] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:12:29.063285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75f81-d674-4f28-9fe2-1a8e4553fe12 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:29.069641 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1689/3351] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:12:29.069641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246902a-fed6-4b87-8c57-d1d851e95cec None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:29.074855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-56d75f81-d674-4f28-9fe2-1a8e4553fe12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:29.098229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246902a-fed6-4b87-8c57-d1d851e95cec None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:29.104502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bf840-d45e-4b89-890e-70ac2f81cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:29.105449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bf840-d45e-4b89-890e-70ac2f81cb77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:29.106067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bf840-d45e-4b89-890e-70ac2f81cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:29.107091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bf840-d45e-4b89-890e-70ac2f81cb77 admin admin] PATH_INFO: `/v3/projects/8d17afac888c409caeae7a34bb8ed044/users/f74f0c5c99a14332bc3224b7400f4587/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:29.109323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bf840-d45e-4b89-890e-70ac2f81cb77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d17afac888c409caeae7a34bb8ed044, user_id=f74f0c5c99a14332bc3224b7400f4587, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:29.114001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bf840-d45e-4b89-890e-70ac2f81cb77 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:29.121762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75f81-d674-4f28-9fe2-1a8e4553fe12 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:29.145730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:29.146697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:29.146975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:29.147156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] PATH_INFO: `/v3/projects/c3e42a55d5a24780aeeefd075120c1ef` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:29.148343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e42a55d5a24780aeeefd075120c1ef)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:29.150574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:29.150830 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1690/3352] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:12:29 2022] PUT /identity/v3/projects/8d17afac888c409caeae7a34bb8ed044/users/f74f0c5c99a14332bc3224b7400f4587/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:29.342089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e42a55d5a24780aeeefd075120c1ef', 'request_id': 'req-24ee5626-6a24-4ed0-b262-ccf586d094d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:29.363934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e42a55d5a24780aeeefd075120c1ef', 'request_id': 'req-24ee5626-6a24-4ed0-b262-ccf586d094d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:29.383954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e42a55d5a24780aeeefd075120c1ef', 'request_id': 'req-24ee5626-6a24-4ed0-b262-ccf586d094d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:29.413478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] The token cache is being invalidate because project c3e42a55d5a24780aeeefd075120c1ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:12:29.413821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:29.416483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-24ee5626-6a24-4ed0-b262-ccf586d094d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:29.426542 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1663/3353] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:29 2022] DELETE /identity/v3/projects/c3e42a55d5a24780aeeefd075120c1ef => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:29.426963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f5509-3bce-4f88-8702-b49cfb3c0fd7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:29.427751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f5509-3bce-4f88-8702-b49cfb3c0fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:29.427751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f5509-3bce-4f88-8702-b49cfb3c0fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:29.488936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-255f5509-3bce-4f88-8702-b49cfb3c0fd7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:29.490171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-255f5509-3bce-4f88-8702-b49cfb3c0fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:29.683306 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1691/3354] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:29.773777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035b13-0c85-4227-8332-8c81af4fc879 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:29.774209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035b13-0c85-4227-8332-8c81af4fc879 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:29.774376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035b13-0c85-4227-8332-8c81af4fc879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:29.831729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-06035b13-0c85-4227-8332-8c81af4fc879 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:29.839515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-06035b13-0c85-4227-8332-8c81af4fc879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:29.865725 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1664/3355] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:29.870306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f5509-3bce-4f88-8702-b49cfb3c0fd7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:29.886146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f5509-3bce-4f88-8702-b49cfb3c0fd7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:29.902199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1a12c-8d6a-45bb-8201-1dab0ffcf016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:29.909947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1a12c-8d6a-45bb-8201-1dab0ffcf016 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:29.910306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1a12c-8d6a-45bb-8201-1dab0ffcf016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:29.910589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1a12c-8d6a-45bb-8201-1dab0ffcf016 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:29.911646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1a12c-8d6a-45bb-8201-1dab0ffcf016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:12:29.911646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1a12c-8d6a-45bb-8201-1dab0ffcf016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:29.913267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1a12c-8d6a-45bb-8201-1dab0ffcf016 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:29.948494 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1692/3356] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:29.949521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06035b13-0c85-4227-8332-8c81af4fc879 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:29.970299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06035b13-0c85-4227-8332-8c81af4fc879 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:29.993297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14ec18-b6e2-469b-b394-7e2cf8d775f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:29.995370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14ec18-b6e2-469b-b394-7e2cf8d775f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:29.995849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14ec18-b6e2-469b-b394-7e2cf8d775f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:29.997871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14ec18-b6e2-469b-b394-7e2cf8d775f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:29.999303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14ec18-b6e2-469b-b394-7e2cf8d775f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:30.001736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14ec18-b6e2-469b-b394-7e2cf8d775f5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:30.060605 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1665/3357] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:12:29 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:12:30.061886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1a12c-8d6a-45bb-8201-1dab0ffcf016 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:30.085348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1a12c-8d6a-45bb-8201-1dab0ffcf016 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:30.362666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7136a-9528-4ac6-864d-e658d079f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:30.363462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7136a-9528-4ac6-864d-e658d079f36e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:30.363749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7136a-9528-4ac6-864d-e658d079f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:30.364027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7136a-9528-4ac6-864d-e658d079f36e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:30.365176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7136a-9528-4ac6-864d-e658d079f36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:30.371542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7136a-9528-4ac6-864d-e658d079f36e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:30.423874 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1693/3358] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:12:30 2022] POST /identity/v3/users => generated 286 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:30.425371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14ec18-b6e2-469b-b394-7e2cf8d775f5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:30.462316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14ec18-b6e2-469b-b394-7e2cf8d775f5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:30.489218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e7d48-0032-4723-af2e-0a565cba9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:30.489857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e7d48-0032-4723-af2e-0a565cba9063 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:30.490141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e7d48-0032-4723-af2e-0a565cba9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:30.490422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e7d48-0032-4723-af2e-0a565cba9063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:30.491114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e7d48-0032-4723-af2e-0a565cba9063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:30.492972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e7d48-0032-4723-af2e-0a565cba9063 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:30.553810 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1666/3359] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:12:30.558180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7136a-9528-4ac6-864d-e658d079f36e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:30.589702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7136a-9528-4ac6-864d-e658d079f36e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:30.615774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715fe71-58a3-4f3c-8d2e-ed9f691d0fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:30.616399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715fe71-58a3-4f3c-8d2e-ed9f691d0fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:30.616677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715fe71-58a3-4f3c-8d2e-ed9f691d0fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:30.616954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715fe71-58a3-4f3c-8d2e-ed9f691d0fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:30.617604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715fe71-58a3-4f3c-8d2e-ed9f691d0fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:30.619239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715fe71-58a3-4f3c-8d2e-ed9f691d0fe0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:30.655124 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1694/3360] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:12:30.659542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e7d48-0032-4723-af2e-0a565cba9063 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:30.671271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e7d48-0032-4723-af2e-0a565cba9063 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:30.687979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38423d4e-7374-4574-9cb6-c99b39e53a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:30.691478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38423d4e-7374-4574-9cb6-c99b39e53a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:30.693794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38423d4e-7374-4574-9cb6-c99b39e53a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:30.694378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38423d4e-7374-4574-9cb6-c99b39e53a28 admin admin] PATH_INFO: `/v3/projects/9e9e2d25b8474e309cf3bd16da20ebd4/users/2b19f386d4a54363b88ddcd5c9c4e496/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:30.745102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38423d4e-7374-4574-9cb6-c99b39e53a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9e2d25b8474e309cf3bd16da20ebd4, user_id=2b19f386d4a54363b88ddcd5c9c4e496, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:30.750114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38423d4e-7374-4574-9cb6-c99b39e53a28 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:30.778010 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1667/3361] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:12:30 2022] PUT /identity/v3/projects/9e9e2d25b8474e309cf3bd16da20ebd4/users/2b19f386d4a54363b88ddcd5c9c4e496/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:30.789510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b900af-0093-42a0-b705-f12eb242f80f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:30.790050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b900af-0093-42a0-b705-f12eb242f80f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:30.791161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b900af-0093-42a0-b705-f12eb242f80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:30.802009 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:30.864039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-68b900af-0093-42a0-b705-f12eb242f80f None None] MFA Rules not processed for user `2b19f386d4a54363b88ddcd5c9c4e496`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:30.870859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-68b900af-0093-42a0-b705-f12eb242f80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:30.987677 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1695/3362] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:31.228651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38423d4e-7374-4574-9cb6-c99b39e53a28 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:31.230752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-38423d4e-7374-4574-9cb6-c99b39e53a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:31.377746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38423d4e-7374-4574-9cb6-c99b39e53a28 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:31.383341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e20429-fe57-4af7-b6a6-88f853dd63c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:31.383980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e20429-fe57-4af7-b6a6-88f853dd63c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:31.384261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e20429-fe57-4af7-b6a6-88f853dd63c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:31.384538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e20429-fe57-4af7-b6a6-88f853dd63c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:31.386295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28e20429-fe57-4af7-b6a6-88f853dd63c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:31.400341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e20429-fe57-4af7-b6a6-88f853dd63c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:31.402592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e20429-fe57-4af7-b6a6-88f853dd63c6 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:31.415682 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1668/3363] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:32.356316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b900af-0093-42a0-b705-f12eb242f80f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:32.359628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-68b900af-0093-42a0-b705-f12eb242f80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:32.543188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b900af-0093-42a0-b705-f12eb242f80f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:32.568703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f919e1f-44e6-4fa3-8692-68181aab7781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:32.570811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919e1f-44e6-4fa3-8692-68181aab7781 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:32.573877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919e1f-44e6-4fa3-8692-68181aab7781 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:32.574170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919e1f-44e6-4fa3-8692-68181aab7781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:32.607379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f919e1f-44e6-4fa3-8692-68181aab7781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:32.609011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f919e1f-44e6-4fa3-8692-68181aab7781 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:32.623961 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1696/3364] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:35.061709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403179-82c5-4c1e-9e85-08d0f888e2b4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:35.062280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403179-82c5-4c1e-9e85-08d0f888e2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:35.062280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403179-82c5-4c1e-9e85-08d0f888e2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:35.160252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d6403179-82c5-4c1e-9e85-08d0f888e2b4 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:35.164691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6403179-82c5-4c1e-9e85-08d0f888e2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:35.251008 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:35.519584 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1669/3365] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:35.553165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f919e1f-44e6-4fa3-8692-68181aab7781 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:35.555436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3f919e1f-44e6-4fa3-8692-68181aab7781 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:35.818500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f919e1f-44e6-4fa3-8692-68181aab7781 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:35.834131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb3c33-9e6d-448e-973a-b2473b11767c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:35.834855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3c33-9e6d-448e-973a-b2473b11767c service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:35.835215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3c33-9e6d-448e-973a-b2473b11767c service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:35.835500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3c33-9e6d-448e-973a-b2473b11767c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:35.859698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb3c33-9e6d-448e-973a-b2473b11767c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:35.862639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb3c33-9e6d-448e-973a-b2473b11767c service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:35.882460 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1697/3366] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:12:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:12:41.368502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6403179-82c5-4c1e-9e85-08d0f888e2b4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:41.368502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6403179-82c5-4c1e-9e85-08d0f888e2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:41.599772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6403179-82c5-4c1e-9e85-08d0f888e2b4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:41.617234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:41.620759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:41.622328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:41.622915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] PATH_INFO: `/v3/users/daade8c46ae44a4b81bafa442b6037f4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:41.624366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daade8c46ae44a4b81bafa442b6037f4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:41.632971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:41.830911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daade8c46ae44a4b81bafa442b6037f4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:41.901303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daade8c46ae44a4b81bafa442b6037f4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:41.902223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daade8c46ae44a4b81bafa442b6037f4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:41.938726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daade8c46ae44a4b81bafa442b6037f4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:41.967383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daade8c46ae44a4b81bafa442b6037f4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:42.013791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1670/3367] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:12:41 2022] DELETE /identity/v3/users/daade8c46ae44a4b81bafa442b6037f4 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:42.015501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c907651-679f-485e-a5f4-830b0756b82b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:42.015950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c907651-679f-485e-a5f4-830b0756b82b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:42.016046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c907651-679f-485e-a5f4-830b0756b82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:42.042917 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:42.049814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7c907651-679f-485e-a5f4-830b0756b82b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:42.055550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7c907651-679f-485e-a5f4-830b0756b82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:42.237444 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1698/3368] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:42.261274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:42.263905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:42.421985 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:42.462769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c74b8b-7724-467d-afaa-574bb853ee31 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:42.475318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36fc1e-3de1-4495-9a0c-37d24c522826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:42.480831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36fc1e-3de1-4495-9a0c-37d24c522826 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:42.481041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36fc1e-3de1-4495-9a0c-37d24c522826 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:42.481468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36fc1e-3de1-4495-9a0c-37d24c522826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:42.518165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36fc1e-3de1-4495-9a0c-37d24c522826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:42.524590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36fc1e-3de1-4495-9a0c-37d24c522826 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:42.558457 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1671/3369] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:42.632626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514fa7a-5e66-4179-b6fb-e8c1fdb5987b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:42.633183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514fa7a-5e66-4179-b6fb-e8c1fdb5987b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:42.633680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514fa7a-5e66-4179-b6fb-e8c1fdb5987b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:42.674082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3514fa7a-5e66-4179-b6fb-e8c1fdb5987b None None] MFA Rules not processed for user `df46881c91e8419e84b8679ad474ba44`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:42.677510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3514fa7a-5e66-4179-b6fb-e8c1fdb5987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:42.820517 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1699/3370] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:42.853425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc9f3-b530-44fa-bcf4-06926b7301fa None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:42.853706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc9f3-b530-44fa-bcf4-06926b7301fa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:42.853996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc9f3-b530-44fa-bcf4-06926b7301fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:42.913474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-364dc9f3-b530-44fa-bcf4-06926b7301fa None None] MFA Rules not processed for user `f74f0c5c99a14332bc3224b7400f4587`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:42.914764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-364dc9f3-b530-44fa-bcf4-06926b7301fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:43.123769 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1672/3371] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:43.135111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514fa7a-5e66-4179-b6fb-e8c1fdb5987b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:43.137251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3514fa7a-5e66-4179-b6fb-e8c1fdb5987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:43.309965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514fa7a-5e66-4179-b6fb-e8c1fdb5987b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:43.317880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2fec2-2df2-4b09-bac2-6b390e2a38ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:43.318521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2fec2-2df2-4b09-bac2-6b390e2a38ce service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:43.321628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2fec2-2df2-4b09-bac2-6b390e2a38ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:43.321925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2fec2-2df2-4b09-bac2-6b390e2a38ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:43.326263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e5c2fec2-2df2-4b09-bac2-6b390e2a38ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:43.499901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2fec2-2df2-4b09-bac2-6b390e2a38ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:43.501526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2fec2-2df2-4b09-bac2-6b390e2a38ce service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:43.522593 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1700/3372] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:43.732756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dc9f3-b530-44fa-bcf4-06926b7301fa None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:43.734965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-364dc9f3-b530-44fa-bcf4-06926b7301fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:43.768806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dc9f3-b530-44fa-bcf4-06926b7301fa None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:43.785944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:43.786860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:43.792925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:43.793444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] PATH_INFO: `/v3/projects/d565120ddfb84f22ad17d8dd0f9c35fa` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:43.798880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d565120ddfb84f22ad17d8dd0f9c35fa)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:43.811946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:44.003717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'request_id': 'req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:44.032511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'request_id': 'req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:44.161427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd565120ddfb84f22ad17d8dd0f9c35fa', 'request_id': 'req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:44.221179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] The token cache is being invalidate because project d565120ddfb84f22ad17d8dd0f9c35fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:12:44.222425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:44.225008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:44.231316 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1673/3373] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:43 2022] DELETE /identity/v3/projects/d565120ddfb84f22ad17d8dd0f9c35fa => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:44.235257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2fec2-2df2-4b09-bac2-6b390e2a38ce service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:44.263977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2fec2-2df2-4b09-bac2-6b390e2a38ce service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:44.289336 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:44.463973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:44.464813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:44.465185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:44.465554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] PATH_INFO: `/v3/users/f175c7c95670489281ab0368dec8b016` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:44.467121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f175c7c95670489281ab0368dec8b016)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:44.471196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:44.589066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f175c7c95670489281ab0368dec8b016'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:44.628557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f175c7c95670489281ab0368dec8b016'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:44.629420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f175c7c95670489281ab0368dec8b016'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:44.645824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f175c7c95670489281ab0368dec8b016'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:44.646617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f175c7c95670489281ab0368dec8b016'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:44.681687 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1701/3374] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:12:44 2022] DELETE /identity/v3/users/f175c7c95670489281ab0368dec8b016 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:45.181236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:45.183946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:45.208486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f0e5d-4911-4cbc-8119-f84da02ec4f3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:45.299827 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:45.316222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76418ec6-a2aa-4a09-a97f-1978d5bf28fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:45.317272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76418ec6-a2aa-4a09-a97f-1978d5bf28fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:45.318123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76418ec6-a2aa-4a09-a97f-1978d5bf28fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:45.318820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76418ec6-a2aa-4a09-a97f-1978d5bf28fb admin admin] PATH_INFO: `/v3/users/2b19f386d4a54363b88ddcd5c9c4e496` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:45.320973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76418ec6-a2aa-4a09-a97f-1978d5bf28fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b19f386d4a54363b88ddcd5c9c4e496)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:45.324566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76418ec6-a2aa-4a09-a97f-1978d5bf28fb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:45.443098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76418ec6-a2aa-4a09-a97f-1978d5bf28fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b19f386d4a54363b88ddcd5c9c4e496'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:45.484764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76418ec6-a2aa-4a09-a97f-1978d5bf28fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b19f386d4a54363b88ddcd5c9c4e496'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:45.485946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76418ec6-a2aa-4a09-a97f-1978d5bf28fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b19f386d4a54363b88ddcd5c9c4e496'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:45.511086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76418ec6-a2aa-4a09-a97f-1978d5bf28fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b19f386d4a54363b88ddcd5c9c4e496'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:45.536918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:45.539029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:45.545388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76418ec6-a2aa-4a09-a97f-1978d5bf28fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b19f386d4a54363b88ddcd5c9c4e496'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:45.565853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99499-ee66-4f19-97f1-0401312780f7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:45.580425 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1674/3375] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:12:45 2022] DELETE /identity/v3/users/2b19f386d4a54363b88ddcd5c9c4e496 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:45.586167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f322a-9c83-4b41-aeb8-2c2450c5a171 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:45.586591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f322a-9c83-4b41-aeb8-2c2450c5a171 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:45.589858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f322a-9c83-4b41-aeb8-2c2450c5a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:45.660576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0b4f322a-9c83-4b41-aeb8-2c2450c5a171 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:45.670929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b4f322a-9c83-4b41-aeb8-2c2450c5a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:45.744963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:45.745898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:45.746342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:45.746795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] PATH_INFO: `/v3/projects/eb9a0ffa5fc74000836f096c478319eb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:45.748113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9a0ffa5fc74000836f096c478319eb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:45.750201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:45.859178 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:45.894638 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1675/3376] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:45.902658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f322a-9c83-4b41-aeb8-2c2450c5a171 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:45.904350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b4f322a-9c83-4b41-aeb8-2c2450c5a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:45.914121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9a0ffa5fc74000836f096c478319eb', 'request_id': 'req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:45.939043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9a0ffa5fc74000836f096c478319eb', 'request_id': 'req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:45.981687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9a0ffa5fc74000836f096c478319eb', 'request_id': 'req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:46.010261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] The token cache is being invalidate because project eb9a0ffa5fc74000836f096c478319eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:12:46.010653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:46.011262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ec28aa1b-b5ad-4fb0-a04d-a4a1b50456ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:46.016025 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1702/3377] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:45 2022] DELETE /identity/v3/projects/eb9a0ffa5fc74000836f096c478319eb => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:46.018369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9264-1751-45cd-ba0f-2c4b94687e92 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:46.018712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9264-1751-45cd-ba0f-2c4b94687e92 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:46.018990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9264-1751-45cd-ba0f-2c4b94687e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:46.075190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-66bc9264-1751-45cd-ba0f-2c4b94687e92 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:46.076412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-66bc9264-1751-45cd-ba0f-2c4b94687e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:46.104862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f322a-9c83-4b41-aeb8-2c2450c5a171 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:46.193381 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:46.262092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfc1fb-58ab-4465-ac70-a3524bb99f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:46.263050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc1fb-58ab-4465-ac70-a3524bb99f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:46.263497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc1fb-58ab-4465-ac70-a3524bb99f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:46.263920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc1fb-58ab-4465-ac70-a3524bb99f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:46.271355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-05cfc1fb-58ab-4465-ac70-a3524bb99f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:46.300620 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1703/3378] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:46.308219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3f713-c77e-42a9-90e6-45d60ab7041e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:46.308514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3f713-c77e-42a9-90e6-45d60ab7041e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:46.308798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3f713-c77e-42a9-90e6-45d60ab7041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:46.361023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fad3f713-c77e-42a9-90e6-45d60ab7041e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:46.366463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fad3f713-c77e-42a9-90e6-45d60ab7041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:46.415117 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1704/3379] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:12:46.418300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3f713-c77e-42a9-90e6-45d60ab7041e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:46.449231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3f713-c77e-42a9-90e6-45d60ab7041e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:46.463532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18decfcf-50a9-4997-b671-ed3fc49d497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:46.466434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18decfcf-50a9-4997-b671-ed3fc49d497d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:46.466852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18decfcf-50a9-4997-b671-ed3fc49d497d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:46.470084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18decfcf-50a9-4997-b671-ed3fc49d497d admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:46.472016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18decfcf-50a9-4997-b671-ed3fc49d497d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:12:46.472335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18decfcf-50a9-4997-b671-ed3fc49d497d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:46.476935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18decfcf-50a9-4997-b671-ed3fc49d497d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:46.489013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfc1fb-58ab-4465-ac70-a3524bb99f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:46.490829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfc1fb-58ab-4465-ac70-a3524bb99f2d service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:46.504779 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1705/3380] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:46.509580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18decfcf-50a9-4997-b671-ed3fc49d497d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:46.526160 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1676/3381] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:12:46.580715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18decfcf-50a9-4997-b671-ed3fc49d497d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:46.598875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451954c8-8095-4fd9-bab7-bc5d387c9974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:46.600746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451954c8-8095-4fd9-bab7-bc5d387c9974 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:46.601307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451954c8-8095-4fd9-bab7-bc5d387c9974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:46.601307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451954c8-8095-4fd9-bab7-bc5d387c9974 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:46.604806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451954c8-8095-4fd9-bab7-bc5d387c9974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:46.611664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451954c8-8095-4fd9-bab7-bc5d387c9974 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:46.717248 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1706/3382] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:12:46 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:46.721871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfc1fb-58ab-4465-ac70-a3524bb99f2d service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:46.734112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfc1fb-58ab-4465-ac70-a3524bb99f2d service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:46.938281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8f71d-d19e-4b95-95fc-bb5b939e5ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:46.938955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f71d-d19e-4b95-95fc-bb5b939e5ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:46.939792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f71d-d19e-4b95-95fc-bb5b939e5ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:46.940250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f71d-d19e-4b95-95fc-bb5b939e5ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:46.940908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8f71d-d19e-4b95-95fc-bb5b939e5ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:46.945065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8f71d-d19e-4b95-95fc-bb5b939e5ee9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:47.043110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451954c8-8095-4fd9-bab7-bc5d387c9974 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:47.045873 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1677/3383] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:12:46 2022] POST /identity/v3/users => generated 287 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:47.061085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451954c8-8095-4fd9-bab7-bc5d387c9974 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:47.099083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c048-3502-4c3a-b809-b2723c01ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:47.099938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c048-3502-4c3a-b809-b2723c01ab01 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:47.100556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c048-3502-4c3a-b809-b2723c01ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:47.101030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c048-3502-4c3a-b809-b2723c01ab01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:47.102051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0c048-3502-4c3a-b809-b2723c01ab01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:47.104299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0c048-3502-4c3a-b809-b2723c01ab01 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:47.144210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8f71d-d19e-4b95-95fc-bb5b939e5ee9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:47.154067 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1707/3384] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:12:47.165264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8f71d-d19e-4b95-95fc-bb5b939e5ee9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:47.171043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9e379-dae3-4066-866b-ba887bde09e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:47.171920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9e379-dae3-4066-866b-ba887bde09e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:47.172443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9e379-dae3-4066-866b-ba887bde09e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:47.172882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9e379-dae3-4066-866b-ba887bde09e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:47.173750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9e379-dae3-4066-866b-ba887bde09e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:47.180718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9e379-dae3-4066-866b-ba887bde09e6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:47.195810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c048-3502-4c3a-b809-b2723c01ab01 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:47.200540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dfb0c048-3502-4c3a-b809-b2723c01ab01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:47.227707 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1678/3385] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:12:47.232805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9e379-dae3-4066-866b-ba887bde09e6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:47.233847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c048-3502-4c3a-b809-b2723c01ab01 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:47.257581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:47.258245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:47.258531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:47.258865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] PATH_INFO: `/v3/projects/9e9e2d25b8474e309cf3bd16da20ebd4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:47.268802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9e2d25b8474e309cf3bd16da20ebd4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:47.271466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:47.282270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9e379-dae3-4066-866b-ba887bde09e6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:47.306249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efa2ed-2a21-45a4-a74c-53bb7e696828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:47.310446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efa2ed-2a21-45a4-a74c-53bb7e696828 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:47.310774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efa2ed-2a21-45a4-a74c-53bb7e696828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:47.311062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efa2ed-2a21-45a4-a74c-53bb7e696828 admin admin] PATH_INFO: `/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe/users/28ea28ea5c424453a4b517f186f8771f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:47.367564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efa2ed-2a21-45a4-a74c-53bb7e696828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90c45c027914ec6bdb0aafec3d30fbe, user_id=28ea28ea5c424453a4b517f186f8771f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:47.375081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efa2ed-2a21-45a4-a74c-53bb7e696828 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:47.410132 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1679/3386] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:12:47 2022] PUT /identity/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe/users/28ea28ea5c424453a4b517f186f8771f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:47.421679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf1e96-de0a-4742-b0c1-9c0965d3f5f6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:47.421970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf1e96-de0a-4742-b0c1-9c0965d3f5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:47.422251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf1e96-de0a-4742-b0c1-9c0965d3f5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:47.441831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9e2d25b8474e309cf3bd16da20ebd4', 'request_id': 'req-19e42880-cd40-4393-ba1a-6a076f3ea9bd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:47.461167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9e2d25b8474e309cf3bd16da20ebd4', 'request_id': 'req-19e42880-cd40-4393-ba1a-6a076f3ea9bd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:47.462580 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:47.475582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9e2d25b8474e309cf3bd16da20ebd4', 'request_id': 'req-19e42880-cd40-4393-ba1a-6a076f3ea9bd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:47.505690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] The token cache is being invalidate because project 9e9e2d25b8474e309cf3bd16da20ebd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:12:47.505985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:47.508960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19e42880-cd40-4393-ba1a-6a076f3ea9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:47.514825 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1708/3387] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:47 2022] DELETE /identity/v3/projects/9e9e2d25b8474e309cf3bd16da20ebd4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:47.519878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06ef58-bda4-471e-a4cf-7d02a6629f6b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:47.522325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06ef58-bda4-471e-a4cf-7d02a6629f6b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:47.522682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06ef58-bda4-471e-a4cf-7d02a6629f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:47.567592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5a06ef58-bda4-471e-a4cf-7d02a6629f6b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:47.569020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b2bf1e96-de0a-4742-b0c1-9c0965d3f5f6 None None] MFA Rules not processed for user `28ea28ea5c424453a4b517f186f8771f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:47.571690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5a06ef58-bda4-471e-a4cf-7d02a6629f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:47.578538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b2bf1e96-de0a-4742-b0c1-9c0965d3f5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:47.669346 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:47.803738 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1709/3388] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:47.808577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21356bdb-a29d-4f4d-a193-49d5f623829a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:47.808879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21356bdb-a29d-4f4d-a193-49d5f623829a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:47.809151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21356bdb-a29d-4f4d-a193-49d5f623829a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:47.838559 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1680/3389] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:12:47.839567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf1e96-de0a-4742-b0c1-9c0965d3f5f6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:47.846729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b2bf1e96-de0a-4742-b0c1-9c0965d3f5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:47.884804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-21356bdb-a29d-4f4d-a193-49d5f623829a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:47.890789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-21356bdb-a29d-4f4d-a193-49d5f623829a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:47.898980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf1e96-de0a-4742-b0c1-9c0965d3f5f6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:47.915542 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1710/3390] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:47.919216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21356bdb-a29d-4f4d-a193-49d5f623829a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:47.925764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ad2c-0d08-477c-84aa-a3ecaabedaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:47.926462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ad2c-0d08-477c-84aa-a3ecaabedaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:47.926771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ad2c-0d08-477c-84aa-a3ecaabedaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:47.927041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ad2c-0d08-477c-84aa-a3ecaabedaf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:47.927686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6ad2c-0d08-477c-84aa-a3ecaabedaf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:47.929626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6ad2c-0d08-477c-84aa-a3ecaabedaf8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:47.942938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21356bdb-a29d-4f4d-a193-49d5f623829a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:48.039684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98468f46-372d-497f-9e67-ff72cf8d585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:48.040626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98468f46-372d-497f-9e67-ff72cf8d585c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:48.041780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98468f46-372d-497f-9e67-ff72cf8d585c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:48.042428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98468f46-372d-497f-9e67-ff72cf8d585c admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:48.043719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98468f46-372d-497f-9e67-ff72cf8d585c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:12:48.046074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98468f46-372d-497f-9e67-ff72cf8d585c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:48.059899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98468f46-372d-497f-9e67-ff72cf8d585c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:48.073428 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1681/3391] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:12:47 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:48.077232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ad2c-0d08-477c-84aa-a3ecaabedaf8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:48.080995 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1711/3392] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:12:48.085667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98468f46-372d-497f-9e67-ff72cf8d585c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:48.107361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98468f46-372d-497f-9e67-ff72cf8d585c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:48.223911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ad2c-0d08-477c-84aa-a3ecaabedaf8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:48.228904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfc684-6abc-49df-9dd3-950077ad8fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:48.229699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfc684-6abc-49df-9dd3-950077ad8fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:48.229984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfc684-6abc-49df-9dd3-950077ad8fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:48.230253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfc684-6abc-49df-9dd3-950077ad8fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:48.230927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfc684-6abc-49df-9dd3-950077ad8fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:48.234834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfc684-6abc-49df-9dd3-950077ad8fb9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:48.235001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde692d5-fad5-4bfe-ad4d-36d42e28e060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:48.235621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde692d5-fad5-4bfe-ad4d-36d42e28e060 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:48.235909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde692d5-fad5-4bfe-ad4d-36d42e28e060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:48.236238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde692d5-fad5-4bfe-ad4d-36d42e28e060 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:48.237335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde692d5-fad5-4bfe-ad4d-36d42e28e060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:48.246290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde692d5-fad5-4bfe-ad4d-36d42e28e060 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:48.293375 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1712/3393] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:12:48 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:48.299126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfc684-6abc-49df-9dd3-950077ad8fb9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:48.342139 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1682/3394] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:12:48 2022] POST /identity/v3/users => generated 294 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:48.344165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde692d5-fad5-4bfe-ad4d-36d42e28e060 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:48.369360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde692d5-fad5-4bfe-ad4d-36d42e28e060 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:48.424569 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:48.456720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfc684-6abc-49df-9dd3-950077ad8fb9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:48.471669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972129ac-fdbf-4dd9-9dee-5a0a6b46e03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:48.476537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972129ac-fdbf-4dd9-9dee-5a0a6b46e03a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:48.476816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972129ac-fdbf-4dd9-9dee-5a0a6b46e03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:48.477086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972129ac-fdbf-4dd9-9dee-5a0a6b46e03a admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:48.479773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972129ac-fdbf-4dd9-9dee-5a0a6b46e03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:48.483905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972129ac-fdbf-4dd9-9dee-5a0a6b46e03a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:48.522972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8079b4a-dc9d-49bf-bc5d-5ba73ace6a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:48.523617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8079b4a-dc9d-49bf-bc5d-5ba73ace6a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:48.524067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8079b4a-dc9d-49bf-bc5d-5ba73ace6a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:48.524347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8079b4a-dc9d-49bf-bc5d-5ba73ace6a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:48.525085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8079b4a-dc9d-49bf-bc5d-5ba73ace6a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:48.545048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8079b4a-dc9d-49bf-bc5d-5ba73ace6a3a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:48.548091 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1713/3395] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:12:48 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:48.551975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972129ac-fdbf-4dd9-9dee-5a0a6b46e03a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:48.578304 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1683/3396] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:12:48.581304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8079b4a-dc9d-49bf-bc5d-5ba73ace6a3a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:48.581879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972129ac-fdbf-4dd9-9dee-5a0a6b46e03a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:48.609235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953ee01-93d4-41e9-b955-7578b0077978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:48.610098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953ee01-93d4-41e9-b955-7578b0077978 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:48.610570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953ee01-93d4-41e9-b955-7578b0077978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:48.610881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953ee01-93d4-41e9-b955-7578b0077978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:48.611978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953ee01-93d4-41e9-b955-7578b0077978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:48.615254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953ee01-93d4-41e9-b955-7578b0077978 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:48.635655 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1714/3397] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:12:48.636712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953ee01-93d4-41e9-b955-7578b0077978 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:48.637002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8079b4a-dc9d-49bf-bc5d-5ba73ace6a3a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:48.654201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953ee01-93d4-41e9-b955-7578b0077978 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:48.660911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e511-9643-4dc2-a9a6-f9f0deefe5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:48.661301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e511-9643-4dc2-a9a6-f9f0deefe5af admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:48.661581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e511-9643-4dc2-a9a6-f9f0deefe5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:48.661855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e511-9643-4dc2-a9a6-f9f0deefe5af admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:48.662367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bf9b8-9608-41c5-90eb-41acf59a3dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:48.662572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929e511-9643-4dc2-a9a6-f9f0deefe5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:48.663400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bf9b8-9608-41c5-90eb-41acf59a3dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:48.663832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bf9b8-9608-41c5-90eb-41acf59a3dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:48.664282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929e511-9643-4dc2-a9a6-f9f0deefe5af admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:48.664587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bf9b8-9608-41c5-90eb-41acf59a3dd3 admin admin] PATH_INFO: `/v3/projects/64d0f84268064fee9e3e98b52b0afa47/users/e3a00c84e1594562accf151a27682ce0/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:48.689063 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1715/3398] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:12:48.690291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e511-9643-4dc2-a9a6-f9f0deefe5af admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:48.707606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e511-9643-4dc2-a9a6-f9f0deefe5af admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:48.719762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bf9b8-9608-41c5-90eb-41acf59a3dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f84268064fee9e3e98b52b0afa47, user_id=e3a00c84e1594562accf151a27682ce0, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:48.723112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4ca4-df80-4569-9190-1274e30c31b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:48.723304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bf9b8-9608-41c5-90eb-41acf59a3dd3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:48.724760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4ca4-df80-4569-9190-1274e30c31b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:48.725348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4ca4-df80-4569-9190-1274e30c31b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:48.725769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4ca4-df80-4569-9190-1274e30c31b5 admin admin] PATH_INFO: `/v3/projects/84d961145cab4eeaac0e4da70bbe6ac4/users/12255be27c014647bdda3a2b8c654816/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:48.750207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b4ca4-df80-4569-9190-1274e30c31b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d961145cab4eeaac0e4da70bbe6ac4, user_id=12255be27c014647bdda3a2b8c654816, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:48.761897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b4ca4-df80-4569-9190-1274e30c31b5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:48.782142 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1684/3399] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:12:48 2022] PUT /identity/v3/projects/64d0f84268064fee9e3e98b52b0afa47/users/e3a00c84e1594562accf151a27682ce0/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:48.787983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bf9b8-9608-41c5-90eb-41acf59a3dd3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:48.788725 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1716/3400] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:12:48 2022] PUT /identity/v3/projects/84d961145cab4eeaac0e4da70bbe6ac4/users/12255be27c014647bdda3a2b8c654816/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:48.790357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cf69c-de29-4578-822e-27837c6391a1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:48.792210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cf69c-de29-4578-822e-27837c6391a1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:48.792667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cf69c-de29-4578-822e-27837c6391a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:48.795401 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:48.829301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-da5cf69c-de29-4578-822e-27837c6391a1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:48.832494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-da5cf69c-de29-4578-822e-27837c6391a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:48.999940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bf9b8-9608-41c5-90eb-41acf59a3dd3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:49.013120 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1717/3401] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:12:49.015297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c9c5b-707a-4bc0-84a7-6bfdd71360bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:49.015942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c9c5b-707a-4bc0-84a7-6bfdd71360bc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:49.016226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c9c5b-707a-4bc0-84a7-6bfdd71360bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:49.016501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c9c5b-707a-4bc0-84a7-6bfdd71360bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:49.017166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c9c5b-707a-4bc0-84a7-6bfdd71360bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:49.019629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c9c5b-707a-4bc0-84a7-6bfdd71360bc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:49.027576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cf69c-de29-4578-822e-27837c6391a1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:49.031507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-da5cf69c-de29-4578-822e-27837c6391a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:49.090969 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1685/3402] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:12:49.092212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c9c5b-707a-4bc0-84a7-6bfdd71360bc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:49.122308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c9c5b-707a-4bc0-84a7-6bfdd71360bc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:49.138988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56830b10-e947-4a7e-8e7c-c3c86bb4161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:49.139677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830b10-e947-4a7e-8e7c-c3c86bb4161a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:49.139959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830b10-e947-4a7e-8e7c-c3c86bb4161a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:49.140238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830b10-e947-4a7e-8e7c-c3c86bb4161a admin admin] PATH_INFO: `/v3/projects/64d0f84268064fee9e3e98b52b0afa47/users/e3a00c84e1594562accf151a27682ce0/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:49.142281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56830b10-e947-4a7e-8e7c-c3c86bb4161a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f84268064fee9e3e98b52b0afa47, user_id=e3a00c84e1594562accf151a27682ce0, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:49.150932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56830b10-e947-4a7e-8e7c-c3c86bb4161a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:49.177362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cf69c-de29-4578-822e-27837c6391a1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:49.182047 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1686/3403] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:12:49 2022] PUT /identity/v3/projects/64d0f84268064fee9e3e98b52b0afa47/users/e3a00c84e1594562accf151a27682ce0/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:49.192969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cfa7d-35b5-477a-9e19-a6a558a34eeb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:49.193257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cfa7d-35b5-477a-9e19-a6a558a34eeb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:49.193536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cfa7d-35b5-477a-9e19-a6a558a34eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:49.255195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c72cfa7d-35b5-477a-9e19-a6a558a34eeb None None] MFA Rules not processed for user `e3a00c84e1594562accf151a27682ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:12:49.256458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c72cfa7d-35b5-477a-9e19-a6a558a34eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:49.337622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589b045-041e-49b2-b03b-49454af4be85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:49.337885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589b045-041e-49b2-b03b-49454af4be85 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:49.338103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589b045-041e-49b2-b03b-49454af4be85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:49.338379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589b045-041e-49b2-b03b-49454af4be85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:49.352882 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:49.445858 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1687/3404] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:12:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:12:49.456074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cfa7d-35b5-477a-9e19-a6a558a34eeb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:49.482872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cfa7d-35b5-477a-9e19-a6a558a34eeb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:49.504678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9e62e-4922-4cea-9ea3-ab1b7595030b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:49.507699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e62e-4922-4cea-9ea3-ab1b7595030b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:49.507983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e62e-4922-4cea-9ea3-ab1b7595030b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:49.508260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e62e-4922-4cea-9ea3-ab1b7595030b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:49.508951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9e62e-4922-4cea-9ea3-ab1b7595030b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:12:49.509260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9e62e-4922-4cea-9ea3-ab1b7595030b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:49.525428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9e62e-4922-4cea-9ea3-ab1b7595030b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:49.539747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589b045-041e-49b2-b03b-49454af4be85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:49.541831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589b045-041e-49b2-b03b-49454af4be85 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:49.566930 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1688/3405] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:49.571232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9e62e-4922-4cea-9ea3-ab1b7595030b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:49.590867 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1718/3406] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:49.604349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9e62e-4922-4cea-9ea3-ab1b7595030b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:49.616298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5fee5-604d-424e-aee7-5721a928f61c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:49.617154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5fee5-604d-424e-aee7-5721a928f61c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:49.617449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5fee5-604d-424e-aee7-5721a928f61c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:49.617728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5fee5-604d-424e-aee7-5721a928f61c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:49.618371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5fee5-604d-424e-aee7-5721a928f61c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:49.623106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5fee5-604d-424e-aee7-5721a928f61c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:49.680286 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1689/3407] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:12:49 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:49.681537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589b045-041e-49b2-b03b-49454af4be85 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:49.704310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589b045-041e-49b2-b03b-49454af4be85 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:49.918633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22a2aa-e906-4cb5-83fd-d6f4dffe155e tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:49.919906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22a2aa-e906-4cb5-83fd-d6f4dffe155e tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:49.921330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22a2aa-e906-4cb5-83fd-d6f4dffe155e tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:49.922644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22a2aa-e906-4cb5-83fd-d6f4dffe155e tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:49.925058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22a2aa-e906-4cb5-83fd-d6f4dffe155e tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:12:49.926507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22a2aa-e906-4cb5-83fd-d6f4dffe155e tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:49.928906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22a2aa-e906-4cb5-83fd-d6f4dffe155e tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:49.957521 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1719/3408] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:51.257811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5fee5-604d-424e-aee7-5721a928f61c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:51.260110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f6b5fee5-604d-424e-aee7-5721a928f61c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:51.391323 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:51.461997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5fee5-604d-424e-aee7-5721a928f61c tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:51.472070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c441e-5717-47ad-9fef-69dd347f0e32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:51.472916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c441e-5717-47ad-9fef-69dd347f0e32 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:51.473296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c441e-5717-47ad-9fef-69dd347f0e32 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:51.473645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c441e-5717-47ad-9fef-69dd347f0e32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:51.503909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c441e-5717-47ad-9fef-69dd347f0e32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:51.505740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c441e-5717-47ad-9fef-69dd347f0e32 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:51.532500 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1690/3409] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:12:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:12:51.571102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803af0f-e7d0-4b01-b52f-ad287b485b4c None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:51.571619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803af0f-e7d0-4b01-b52f-ad287b485b4c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:51.571784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803af0f-e7d0-4b01-b52f-ad287b485b4c None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:51.573207 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1720/3410] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:12:51.582484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c441e-5717-47ad-9fef-69dd347f0e32 service nova] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:12:51.604041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c441e-5717-47ad-9fef-69dd347f0e32 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:51.639984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c441e-5717-47ad-9fef-69dd347f0e32 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:51.659596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed74c41-c363-448b-a6f3-2e38a19af3cf tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:51.662543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed74c41-c363-448b-a6f3-2e38a19af3cf tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:51.664818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed74c41-c363-448b-a6f3-2e38a19af3cf tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:51.665571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed74c41-c363-448b-a6f3-2e38a19af3cf tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/a813c098daec4a96a86d76386e0b81af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:51.669443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed74c41-c363-448b-a6f3-2e38a19af3cf tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:get_project(project_id=a813c098daec4a96a86d76386e0b81af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:51.681333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed74c41-c363-448b-a6f3-2e38a19af3cf tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:51.687570 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1691/3411] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:12:51 2022] GET /identity/v3/projects/a813c098daec4a96a86d76386e0b81af => generated 369 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:52.257451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f68f2-b678-4a4d-ab7f-03fec9151a93 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:52.257814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f68f2-b678-4a4d-ab7f-03fec9151a93 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:52.258012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f68f2-b678-4a4d-ab7f-03fec9151a93 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:52.259736 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1721/3412] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:12:52.264992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed74c41-c363-448b-a6f3-2e38a19af3cf tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:12:52.282047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed74c41-c363-448b-a6f3-2e38a19af3cf tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:52.293926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed74c41-c363-448b-a6f3-2e38a19af3cf tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:52.301038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae23041-0f3d-472a-a4cc-014f30659b68 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:52.301457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae23041-0f3d-472a-a4cc-014f30659b68 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:52.301751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae23041-0f3d-472a-a4cc-014f30659b68 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:52.302179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae23041-0f3d-472a-a4cc-014f30659b68 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/a813c098daec4a96a86d76386e0b81af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:52.304525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae23041-0f3d-472a-a4cc-014f30659b68 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:get_project(project_id=a813c098daec4a96a86d76386e0b81af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:52.306630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae23041-0f3d-472a-a4cc-014f30659b68 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:52.308692 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1692/3413] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:12:52 2022] GET /identity/v3/projects/a813c098daec4a96a86d76386e0b81af => generated 369 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:53.247705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de61093-8135-4e39-9ea4-095c3202d277 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:53.248536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de61093-8135-4e39-9ea4-095c3202d277 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:53.248536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de61093-8135-4e39-9ea4-095c3202d277 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:53.249736 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1722/3414] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:12:53.260453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae23041-0f3d-472a-a4cc-014f30659b68 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:12:53.291975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae23041-0f3d-472a-a4cc-014f30659b68 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:53.325411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae23041-0f3d-472a-a4cc-014f30659b68 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:53.343301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9700b8-174c-463f-b076-252102bef471 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:53.345516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9700b8-174c-463f-b076-252102bef471 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:53.355044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9700b8-174c-463f-b076-252102bef471 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:53.355996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9700b8-174c-463f-b076-252102bef471 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/a813c098daec4a96a86d76386e0b81af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:53.362086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9700b8-174c-463f-b076-252102bef471 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:get_project(project_id=a813c098daec4a96a86d76386e0b81af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:53.364592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9700b8-174c-463f-b076-252102bef471 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:53.388529 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1693/3415] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:12:53 2022] GET /identity/v3/projects/a813c098daec4a96a86d76386e0b81af => generated 369 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:53.413889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de61093-8135-4e39-9ea4-095c3202d277 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:53.445398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de61093-8135-4e39-9ea4-095c3202d277 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:53.459960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:53.460818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:53.461281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:53.461710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/a813c098daec4a96a86d76386e0b81af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:53.463908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a813c098daec4a96a86d76386e0b81af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:53.471386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:53.632724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a813c098daec4a96a86d76386e0b81af', 'request_id': 'req-ae703262-73b4-4cb1-9c1c-756854a87c40'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:53.652652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a813c098daec4a96a86d76386e0b81af', 'request_id': 'req-ae703262-73b4-4cb1-9c1c-756854a87c40'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:53.663733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a813c098daec4a96a86d76386e0b81af', 'request_id': 'req-ae703262-73b4-4cb1-9c1c-756854a87c40'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:53.698377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] The token cache is being invalidate because project a813c098daec4a96a86d76386e0b81af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:12:53.698710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:53.699798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:53.703149 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1723/3416] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:53 2022] DELETE /identity/v3/projects/a813c098daec4a96a86d76386e0b81af => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:53.978088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f9447-41c7-47f2-b58c-c8419ba3ffbc None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:53.978379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f9447-41c7-47f2-b58c-c8419ba3ffbc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:53.978690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f9447-41c7-47f2-b58c-c8419ba3ffbc None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:53.982311 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1694/3417] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:12:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:12:53.988674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:12:53.990321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:54.072418 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:54.299662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:54.303063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:54.525383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae703262-73b4-4cb1-9c1c-756854a87c40 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:54.543832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdccf5-12b9-4d4d-9ba6-b067ea41d6cc tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:54.544879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdccf5-12b9-4d4d-9ba6-b067ea41d6cc tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:54.545355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdccf5-12b9-4d4d-9ba6-b067ea41d6cc tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:54.545789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdccf5-12b9-4d4d-9ba6-b067ea41d6cc tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:54.547148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdccf5-12b9-4d4d-9ba6-b067ea41d6cc tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:get_project(project_id=e90c45c027914ec6bdb0aafec3d30fbe)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:54.554443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdccf5-12b9-4d4d-9ba6-b067ea41d6cc tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:54.563010 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1724/3418] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:12:53 2022] GET /identity/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe => generated 373 bytes in 575 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:54.586848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f9447-41c7-47f2-b58c-c8419ba3ffbc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:54.611876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f9447-41c7-47f2-b58c-c8419ba3ffbc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:54.629270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181ebfc-5ab6-4afd-8bc4-8b8995b6fa28 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:54.629937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ebfc-5ab6-4afd-8bc4-8b8995b6fa28 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:54.630226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ebfc-5ab6-4afd-8bc4-8b8995b6fa28 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:54.630502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ebfc-5ab6-4afd-8bc4-8b8995b6fa28 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:54.631199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181ebfc-5ab6-4afd-8bc4-8b8995b6fa28 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:12:54.631509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181ebfc-5ab6-4afd-8bc4-8b8995b6fa28 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:54.636050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181ebfc-5ab6-4afd-8bc4-8b8995b6fa28 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:54.678761 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1695/3419] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:54.682783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdccf5-12b9-4d4d-9ba6-b067ea41d6cc tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:54.706922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdccf5-12b9-4d4d-9ba6-b067ea41d6cc tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:54.725522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9241d-d6da-4f1e-9f1b-14058946255d tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:54.727380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9241d-d6da-4f1e-9f1b-14058946255d tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:54.727818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9241d-d6da-4f1e-9f1b-14058946255d tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:54.728688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9241d-d6da-4f1e-9f1b-14058946255d tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:54.730829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9241d-d6da-4f1e-9f1b-14058946255d tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:54.737810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9241d-d6da-4f1e-9f1b-14058946255d tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:54.834651 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1725/3420] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:12:54 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:54.838164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181ebfc-5ab6-4afd-8bc4-8b8995b6fa28 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:54.851221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181ebfc-5ab6-4afd-8bc4-8b8995b6fa28 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:54.999430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f11c3-6ed5-4caf-aafd-45305e2572ca tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:55.000124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f11c3-6ed5-4caf-aafd-45305e2572ca tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:55.000389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f11c3-6ed5-4caf-aafd-45305e2572ca tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:55.000670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f11c3-6ed5-4caf-aafd-45305e2572ca tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:55.001324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f11c3-6ed5-4caf-aafd-45305e2572ca tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:12:55.001628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f11c3-6ed5-4caf-aafd-45305e2572ca tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:55.004298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f11c3-6ed5-4caf-aafd-45305e2572ca tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:55.048499 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1696/3421] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:12:55.553440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59b13-0c62-4850-b232-baf6c0849e65 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:55.555105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59b13-0c62-4850-b232-baf6c0849e65 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:55.555472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59b13-0c62-4850-b232-baf6c0849e65 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:55.557520 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1726/3422] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:12:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:12:55.578978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f11c3-6ed5-4caf-aafd-45305e2572ca tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:12:55.584353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bc4f11c3-6ed5-4caf-aafd-45305e2572ca tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:55.801258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f11c3-6ed5-4caf-aafd-45305e2572ca tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:55.828447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f11c3-6ed5-4caf-aafd-45305e2572ca tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:55.844442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd2737-6ee4-4f46-b7ee-ef7958f9a7eb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:55.845119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd2737-6ee4-4f46-b7ee-ef7958f9a7eb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:55.845404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd2737-6ee4-4f46-b7ee-ef7958f9a7eb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:55.846250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd2737-6ee4-4f46-b7ee-ef7958f9a7eb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/c4de1add8ea74350b8c11b9e50d29a33` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:55.847433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd2737-6ee4-4f46-b7ee-ef7958f9a7eb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:get_project(project_id=c4de1add8ea74350b8c11b9e50d29a33)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:55.850157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd2737-6ee4-4f46-b7ee-ef7958f9a7eb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:55.856718 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1697/3423] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:12:55 2022] GET /identity/v3/projects/c4de1add8ea74350b8c11b9e50d29a33 => generated 371 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:56.096492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7c87-453a-453a-9697-041deaef3c35 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:56.096845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7c87-453a-453a-9697-041deaef3c35 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:56.097130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7c87-453a-453a-9697-041deaef3c35 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:56.098808 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1727/3424] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:12:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:12:56.117009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd2737-6ee4-4f46-b7ee-ef7958f9a7eb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:12:56.128501 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:56.150886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd2737-6ee4-4f46-b7ee-ef7958f9a7eb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:56.180423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd2737-6ee4-4f46-b7ee-ef7958f9a7eb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:56.193954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fb47c-843c-4d83-bc7c-656cb7866e7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:56.196888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fb47c-843c-4d83-bc7c-656cb7866e7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:56.197382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fb47c-843c-4d83-bc7c-656cb7866e7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:56.197820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fb47c-843c-4d83-bc7c-656cb7866e7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/c4de1add8ea74350b8c11b9e50d29a33` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:56.200554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fb47c-843c-4d83-bc7c-656cb7866e7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:get_project(project_id=c4de1add8ea74350b8c11b9e50d29a33)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:56.203389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fb47c-843c-4d83-bc7c-656cb7866e7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:56.213455 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1698/3425] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:12:56 2022] GET /identity/v3/projects/c4de1add8ea74350b8c11b9e50d29a33 => generated 371 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:56.346347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d7c87-453a-453a-9697-041deaef3c35 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:56.406292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d7c87-453a-453a-9697-041deaef3c35 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:56.414076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bb039-36f3-47b9-8702-6f403c0c7775 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:56.415054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bb039-36f3-47b9-8702-6f403c0c7775 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:56.415505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bb039-36f3-47b9-8702-6f403c0c7775 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:56.415945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bb039-36f3-47b9-8702-6f403c0c7775 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:56.416849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bb039-36f3-47b9-8702-6f403c0c7775 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:12:56.417335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bb039-36f3-47b9-8702-6f403c0c7775 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:56.420362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bb039-36f3-47b9-8702-6f403c0c7775 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:56.440780 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1728/3426] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:56.445673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fb47c-843c-4d83-bc7c-656cb7866e7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:56.459418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fb47c-843c-4d83-bc7c-656cb7866e7b tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:56.469818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893f35c-ca84-43f3-a983-f811419e7ade tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:56.472713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893f35c-ca84-43f3-a983-f811419e7ade tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:56.473166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893f35c-ca84-43f3-a983-f811419e7ade tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:56.475836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893f35c-ca84-43f3-a983-f811419e7ade tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:56.476826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893f35c-ca84-43f3-a983-f811419e7ade tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:56.479818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893f35c-ca84-43f3-a983-f811419e7ade tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:56.551744 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1699/3427] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:12:56 2022] POST /identity/v3/users => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:12:56.557498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bb039-36f3-47b9-8702-6f403c0c7775 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:56.577169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bb039-36f3-47b9-8702-6f403c0c7775 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:56.619449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520daa95-130c-4534-820f-9ece9e4a4888 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:56.620232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520daa95-130c-4534-820f-9ece9e4a4888 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:56.620721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520daa95-130c-4534-820f-9ece9e4a4888 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:56.621288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520daa95-130c-4534-820f-9ece9e4a4888 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:56.622076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520daa95-130c-4534-820f-9ece9e4a4888 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:12:56.622491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520daa95-130c-4534-820f-9ece9e4a4888 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:56.624457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520daa95-130c-4534-820f-9ece9e4a4888 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:56.732494 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1729/3428] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:57.241089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2a52b-fb16-48dc-9e4f-2e58334a06ff None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:57.241636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2a52b-fb16-48dc-9e4f-2e58334a06ff None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:57.241913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2a52b-fb16-48dc-9e4f-2e58334a06ff None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:57.243789 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1700/3429] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:12:57.259846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520daa95-130c-4534-820f-9ece9e4a4888 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:12:57.288169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520daa95-130c-4534-820f-9ece9e4a4888 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:57.319958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520daa95-130c-4534-820f-9ece9e4a4888 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:57.342029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a97151-7adc-4384-8e85-e97a9bac66da tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:57.342480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a97151-7adc-4384-8e85-e97a9bac66da tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:57.342869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a97151-7adc-4384-8e85-e97a9bac66da tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:57.343205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a97151-7adc-4384-8e85-e97a9bac66da tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/c4de1add8ea74350b8c11b9e50d29a33` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:57.346746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a97151-7adc-4384-8e85-e97a9bac66da tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:get_project(project_id=c4de1add8ea74350b8c11b9e50d29a33)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:57.351649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a97151-7adc-4384-8e85-e97a9bac66da tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:57.365580 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1730/3430] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:12:57 2022] GET /identity/v3/projects/c4de1add8ea74350b8c11b9e50d29a33 => generated 371 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:57.810353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c1325-d38d-46b4-ba44-26f8075722a9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:57.810842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c1325-d38d-46b4-ba44-26f8075722a9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:57.811393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c1325-d38d-46b4-ba44-26f8075722a9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:57.813258 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1701/3431] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:12:57.829240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a97151-7adc-4384-8e85-e97a9bac66da tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:12:57.858187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a97151-7adc-4384-8e85-e97a9bac66da tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:57.875025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a97151-7adc-4384-8e85-e97a9bac66da tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:57.886862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a04f5-4236-4a39-8ecb-91548d375ffb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:57.887611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a04f5-4236-4a39-8ecb-91548d375ffb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:57.889250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a04f5-4236-4a39-8ecb-91548d375ffb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:57.890025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a04f5-4236-4a39-8ecb-91548d375ffb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/c4de1add8ea74350b8c11b9e50d29a33` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:57.898561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a04f5-4236-4a39-8ecb-91548d375ffb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:get_project(project_id=c4de1add8ea74350b8c11b9e50d29a33)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:57.902014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a04f5-4236-4a39-8ecb-91548d375ffb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:57.909458 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1731/3432] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:12:57 2022] GET /identity/v3/projects/c4de1add8ea74350b8c11b9e50d29a33 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:12:57.948201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c1325-d38d-46b4-ba44-26f8075722a9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:57.972977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c1325-d38d-46b4-ba44-26f8075722a9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:57.982193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c6a3b-626b-43d3-9d6c-929df1c0a5b3 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:57.983332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c6a3b-626b-43d3-9d6c-929df1c0a5b3 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:57.983874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c6a3b-626b-43d3-9d6c-929df1c0a5b3 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:57.984378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c6a3b-626b-43d3-9d6c-929df1c0a5b3 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/users/64d757fc80fe46fb829870edabeed2cc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:58.025432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c6a3b-626b-43d3-9d6c-929df1c0a5b3 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:delete_user(user_id=64d757fc80fe46fb829870edabeed2cc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:58.030466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c6a3b-626b-43d3-9d6c-929df1c0a5b3 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:58.130370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b2c6a3b-626b-43d3-9d6c-929df1c0a5b3 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d757fc80fe46fb829870edabeed2cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:58.154582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b2c6a3b-626b-43d3-9d6c-929df1c0a5b3 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d757fc80fe46fb829870edabeed2cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:58.156943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b2c6a3b-626b-43d3-9d6c-929df1c0a5b3 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d757fc80fe46fb829870edabeed2cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:58.185250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b2c6a3b-626b-43d3-9d6c-929df1c0a5b3 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d757fc80fe46fb829870edabeed2cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:58.195507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b2c6a3b-626b-43d3-9d6c-929df1c0a5b3 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d757fc80fe46fb829870edabeed2cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:58.211462 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1702/3433] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:12:57 2022] DELETE /identity/v3/users/64d757fc80fe46fb829870edabeed2cc => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:58.212878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a04f5-4236-4a39-8ecb-91548d375ffb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:58.214811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-631a04f5-4236-4a39-8ecb-91548d375ffb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:58.242903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a04f5-4236-4a39-8ecb-91548d375ffb tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:58.388501 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:58.435100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:58.442336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:58.442934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:58.443858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/c4de1add8ea74350b8c11b9e50d29a33` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:58.449521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c4de1add8ea74350b8c11b9e50d29a33)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:58.460665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:58.599688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4de1add8ea74350b8c11b9e50d29a33', 'request_id': 'req-ac10899b-3670-4add-8243-9a00f293b39f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:58.615174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4de1add8ea74350b8c11b9e50d29a33', 'request_id': 'req-ac10899b-3670-4add-8243-9a00f293b39f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:58.643659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4de1add8ea74350b8c11b9e50d29a33', 'request_id': 'req-ac10899b-3670-4add-8243-9a00f293b39f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:58.698315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] The token cache is being invalidate because project c4de1add8ea74350b8c11b9e50d29a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:12:58.698651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:58.700221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:12:58.710442 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1732/3434] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:12:58 2022] DELETE /identity/v3/projects/c4de1add8ea74350b8c11b9e50d29a33 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:12:59.249527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3899-bbc5-42b3-85ed-acc251270412 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:59.250023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3899-bbc5-42b3-85ed-acc251270412 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:59.250125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3899-bbc5-42b3-85ed-acc251270412 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:59.251451 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1703/3435] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:12:59.261683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:12:59.264010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:59.432827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:12:59.448763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:12:59.639891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10899b-3670-4add-8243-9a00f293b39f tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:12:59.651364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc973c4-c141-480c-b144-3d244708d692 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:12:59.652284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc973c4-c141-480c-b144-3d244708d692 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:12:59.652575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc973c4-c141-480c-b144-3d244708d692 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:12:59.652851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc973c4-c141-480c-b144-3d244708d692 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:12:59.656628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc973c4-c141-480c-b144-3d244708d692 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:get_project(project_id=e90c45c027914ec6bdb0aafec3d30fbe)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:12:59.661880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc973c4-c141-480c-b144-3d244708d692 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:12:59.704849 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1733/3436] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:12:59 2022] GET /identity/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe => generated 373 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:13:00.162645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b84af-f663-42ce-b5a8-d69d88f0d81d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:00.163549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b84af-f663-42ce-b5a8-d69d88f0d81d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:00.164670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b84af-f663-42ce-b5a8-d69d88f0d81d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:00.169441 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1704/3437] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:13:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:13:00.181829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc973c4-c141-480c-b144-3d244708d692 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:13:00.204367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc973c4-c141-480c-b144-3d244708d692 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:00.234712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc973c4-c141-480c-b144-3d244708d692 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:00.259913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a8993-d92a-4799-a6c3-dd261c18aaf5 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:00.260592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a8993-d92a-4799-a6c3-dd261c18aaf5 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:00.260871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a8993-d92a-4799-a6c3-dd261c18aaf5 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:00.261144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a8993-d92a-4799-a6c3-dd261c18aaf5 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:00.265785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a8993-d92a-4799-a6c3-dd261c18aaf5 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:get_project(project_id=e90c45c027914ec6bdb0aafec3d30fbe)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:00.276639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a8993-d92a-4799-a6c3-dd261c18aaf5 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:00.316191 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1734/3438] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:13:00 2022] GET /identity/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe => generated 373 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:01.593721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508293d-9b73-4653-8d2b-f929e877d728 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:01.594780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508293d-9b73-4653-8d2b-f929e877d728 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:01.595450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508293d-9b73-4653-8d2b-f929e877d728 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:01.597690 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1705/3439] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:13:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:13:01.604200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a8993-d92a-4799-a6c3-dd261c18aaf5 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:13:01.647935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a8993-d92a-4799-a6c3-dd261c18aaf5 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:01.668725 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:01.698924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a8993-d92a-4799-a6c3-dd261c18aaf5 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:01.717242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eb9ff-4a21-4bb9-b32d-4f07eb1714c7 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a00c84e1594562accf151a27682ce0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f84268064fee9e3e98b52b0afa47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:01.717895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb9ff-4a21-4bb9-b32d-4f07eb1714c7 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:01.718173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb9ff-4a21-4bb9-b32d-4f07eb1714c7 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:01.718444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb9ff-4a21-4bb9-b32d-4f07eb1714c7 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] PATH_INFO: `/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:01.735547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eb9ff-4a21-4bb9-b32d-4f07eb1714c7 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorizing `identity:get_project(project_id=e90c45c027914ec6bdb0aafec3d30fbe)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:01.737744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eb9ff-4a21-4bb9-b32d-4f07eb1714c7 tempest-QuotasAdminTestJSON-1835025999 tempest-QuotasAdminTestJSON-1835025999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:01.739881 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1735/3440] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:13:01 2022] GET /identity/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe => generated 373 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:02.572311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508293d-9b73-4653-8d2b-f929e877d728 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:02.575038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b508293d-9b73-4653-8d2b-f929e877d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:02.858360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508293d-9b73-4653-8d2b-f929e877d728 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:02.875438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:02.876603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:02.878304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:02.878871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] PATH_INFO: `/v3/users/28ea28ea5c424453a4b517f186f8771f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:02.882911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ea28ea5c424453a4b517f186f8771f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:02.885149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:03.015333 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=80,keystone:INSERT=4,keystone:DELETE=16 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:03.030983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ea28ea5c424453a4b517f186f8771f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:03.082999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ea28ea5c424453a4b517f186f8771f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:03.084741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ea28ea5c424453a4b517f186f8771f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:03.105378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ea28ea5c424453a4b517f186f8771f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:03.132214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ea28ea5c424453a4b517f186f8771f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:03.161352 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1706/3441] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:02 2022] DELETE /identity/v3/users/28ea28ea5c424453a4b517f186f8771f => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:03.166343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd01213-18d2-4266-96f5-4366f9805c62 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:03.167241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd01213-18d2-4266-96f5-4366f9805c62 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:03.167800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd01213-18d2-4266-96f5-4366f9805c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:03.223338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3dd01213-18d2-4266-96f5-4366f9805c62 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:03.232196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3dd01213-18d2-4266-96f5-4366f9805c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:03.468515 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1736/3442] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:03.492841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:03.495178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:03.654747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce466-2444-47e3-979f-31986d9bb3cc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:03.655164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce466-2444-47e3-979f-31986d9bb3cc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:03.655650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce466-2444-47e3-979f-31986d9bb3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:03.720464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07177ce1-b658-4ae6-8104-ffa0fd035e2a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:03.746245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826236c-8dc1-4746-a893-5f4ecb3f25a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:03.747198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826236c-8dc1-4746-a893-5f4ecb3f25a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:03.748055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826236c-8dc1-4746-a893-5f4ecb3f25a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:03.748055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826236c-8dc1-4746-a893-5f4ecb3f25a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:03.759732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f43ce466-2444-47e3-979f-31986d9bb3cc None None] MFA Rules not processed for user `12255be27c014647bdda3a2b8c654816`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:03.761004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f43ce466-2444-47e3-979f-31986d9bb3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:03.782018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826236c-8dc1-4746-a893-5f4ecb3f25a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:03.787298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826236c-8dc1-4746-a893-5f4ecb3f25a7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:03.818642 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1707/3443] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:04.019534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826236c-8dc1-4746-a893-5f4ecb3f25a7 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:04.021135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e826236c-8dc1-4746-a893-5f4ecb3f25a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:04.041653 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1737/3444] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:04.210700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826236c-8dc1-4746-a893-5f4ecb3f25a7 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:04.230872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605914ac-721a-4eb8-8d68-ff5d4526a7b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:04.231509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605914ac-721a-4eb8-8d68-ff5d4526a7b7 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:04.231790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605914ac-721a-4eb8-8d68-ff5d4526a7b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:04.232064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605914ac-721a-4eb8-8d68-ff5d4526a7b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:04.255429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605914ac-721a-4eb8-8d68-ff5d4526a7b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:04.255677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ce466-2444-47e3-979f-31986d9bb3cc None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:04.257099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f43ce466-2444-47e3-979f-31986d9bb3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:04.257331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605914ac-721a-4eb8-8d68-ff5d4526a7b7 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:04.281358 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1708/3445] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:13:04.363019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ce466-2444-47e3-979f-31986d9bb3cc None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:04.378247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf64d8a-98d6-40b4-94cf-cc90c073236f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:04.378972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf64d8a-98d6-40b4-94cf-cc90c073236f service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:04.379278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf64d8a-98d6-40b4-94cf-cc90c073236f service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:04.379784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf64d8a-98d6-40b4-94cf-cc90c073236f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:04.382659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ddf64d8a-98d6-40b4-94cf-cc90c073236f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:04.412250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf64d8a-98d6-40b4-94cf-cc90c073236f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:04.416541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf64d8a-98d6-40b4-94cf-cc90c073236f service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:04.450650 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1738/3446] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:04.696888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605914ac-721a-4eb8-8d68-ff5d4526a7b7 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:04.712751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605914ac-721a-4eb8-8d68-ff5d4526a7b7 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:04.717155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ab604-a8cf-43c0-bc85-d70e46bdc700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:04.718080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ab604-a8cf-43c0-bc85-d70e46bdc700 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:04.718573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ab604-a8cf-43c0-bc85-d70e46bdc700 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:04.719096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ab604-a8cf-43c0-bc85-d70e46bdc700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:04.721051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-106ab604-a8cf-43c0-bc85-d70e46bdc700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:04.732830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ab604-a8cf-43c0-bc85-d70e46bdc700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:04.734826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ab604-a8cf-43c0-bc85-d70e46bdc700 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:04.758519 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1709/3447] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:05.323162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf64d8a-98d6-40b4-94cf-cc90c073236f service glance] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:05.323162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ddf64d8a-98d6-40b4-94cf-cc90c073236f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:05.390186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf64d8a-98d6-40b4-94cf-cc90c073236f service glance] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:05.409953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844511d-1029-400f-a9ef-a9aeeca6d172 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:05.410512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844511d-1029-400f-a9ef-a9aeeca6d172 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:05.410645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844511d-1029-400f-a9ef-a9aeeca6d172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:05.415679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:05.417275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:05.418494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:05.419634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] PATH_INFO: `/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:05.423562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90c45c027914ec6bdb0aafec3d30fbe)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:05.430802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:05.461033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1844511d-1029-400f-a9ef-a9aeeca6d172 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:05.468633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1844511d-1029-400f-a9ef-a9aeeca6d172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:05.475149 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:05.556740 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:05.628006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90c45c027914ec6bdb0aafec3d30fbe', 'request_id': 'req-66ab02a1-7e44-4205-a723-ee32701eac58'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:05.646250 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1710/3448] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:13:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:13:05.659412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844511d-1029-400f-a9ef-a9aeeca6d172 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:05.661786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1844511d-1029-400f-a9ef-a9aeeca6d172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:05.675016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90c45c027914ec6bdb0aafec3d30fbe', 'request_id': 'req-66ab02a1-7e44-4205-a723-ee32701eac58'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:05.706033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90c45c027914ec6bdb0aafec3d30fbe', 'request_id': 'req-66ab02a1-7e44-4205-a723-ee32701eac58'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:05.743675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] The token cache is being invalidate because project e90c45c027914ec6bdb0aafec3d30fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:05.744024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:05.755994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:05.758012 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1739/3449] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:05 2022] DELETE /identity/v3/projects/e90c45c027914ec6bdb0aafec3d30fbe => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:05.762284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:05.766039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:05.927704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab02a1-7e44-4205-a723-ee32701eac58 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:05.948772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f35d4e-3050-49b4-b589-2879e4e61dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:05.953416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f35d4e-3050-49b4-b589-2879e4e61dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:05.953916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f35d4e-3050-49b4-b589-2879e4e61dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:05.954057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f35d4e-3050-49b4-b589-2879e4e61dec admin admin] PATH_INFO: `/v3/users/e3a00c84e1594562accf151a27682ce0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:05.964072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844511d-1029-400f-a9ef-a9aeeca6d172 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:05.983167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f35d4e-3050-49b4-b589-2879e4e61dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a00c84e1594562accf151a27682ce0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:05.991398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f35d4e-3050-49b4-b589-2879e4e61dec admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:06.181933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8f35d4e-3050-49b4-b589-2879e4e61dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a00c84e1594562accf151a27682ce0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:06.227559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8f35d4e-3050-49b4-b589-2879e4e61dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a00c84e1594562accf151a27682ce0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:06.228890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8f35d4e-3050-49b4-b589-2879e4e61dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a00c84e1594562accf151a27682ce0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:06.244497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aca82-0689-4a92-8491-88a3f4302dc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:06.248037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aca82-0689-4a92-8491-88a3f4302dc7 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:06.248632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aca82-0689-4a92-8491-88a3f4302dc7 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:06.248915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aca82-0689-4a92-8491-88a3f4302dc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:06.259453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-300aca82-0689-4a92-8491-88a3f4302dc7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:06.260450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8f35d4e-3050-49b4-b589-2879e4e61dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a00c84e1594562accf151a27682ce0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:06.261821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8f35d4e-3050-49b4-b589-2879e4e61dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a00c84e1594562accf151a27682ce0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:06.291195 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1740/3450] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:05 2022] DELETE /identity/v3/users/e3a00c84e1594562accf151a27682ce0 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:13:06.492608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aca82-0689-4a92-8491-88a3f4302dc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:06.497158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aca82-0689-4a92-8491-88a3f4302dc7 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:06.524652 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1711/3451] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:13:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 866 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:13:08.208841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32c5c-882c-4722-9ebc-c4136e3a8b7d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:08.209399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32c5c-882c-4722-9ebc-c4136e3a8b7d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:08.209399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32c5c-882c-4722-9ebc-c4136e3a8b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:08.241968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aca82-0689-4a92-8491-88a3f4302dc7 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:08.243417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-300aca82-0689-4a92-8491-88a3f4302dc7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:08.269449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-11d32c5c-882c-4722-9ebc-c4136e3a8b7d None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:08.270996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-11d32c5c-882c-4722-9ebc-c4136e3a8b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:08.276796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aca82-0689-4a92-8491-88a3f4302dc7 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:08.287988 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:08.322825 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:08.398745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:08.399796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:08.400082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:08.400396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] PATH_INFO: `/v3/projects/64d0f84268064fee9e3e98b52b0afa47` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:08.401545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d0f84268064fee9e3e98b52b0afa47)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:08.403943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:08.420033 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1741/3452] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:13:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:08.442100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d32c5c-882c-4722-9ebc-c4136e3a8b7d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:08.443774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-11d32c5c-882c-4722-9ebc-c4136e3a8b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:08.513453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d0f84268064fee9e3e98b52b0afa47', 'request_id': 'req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:08.526180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d0f84268064fee9e3e98b52b0afa47', 'request_id': 'req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:08.542668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d0f84268064fee9e3e98b52b0afa47', 'request_id': 'req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:08.581434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] The token cache is being invalidate because project 64d0f84268064fee9e3e98b52b0afa47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:08.581734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:08.583554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dbe4e543-90a8-4d12-b4e2-a3eeecd77f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:08.594633 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1712/3453] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:08 2022] DELETE /identity/v3/projects/64d0f84268064fee9e3e98b52b0afa47 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:08.601735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad0d5-a8e1-49e1-9ddf-48d67f99adfa None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:08.602037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad0d5-a8e1-49e1-9ddf-48d67f99adfa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:08.602381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad0d5-a8e1-49e1-9ddf-48d67f99adfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:08.602861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d32c5c-882c-4722-9ebc-c4136e3a8b7d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:08.671937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f39ad0d5-a8e1-49e1-9ddf-48d67f99adfa None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:08.674476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f39ad0d5-a8e1-49e1-9ddf-48d67f99adfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:08.788864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f791e-5a51-46ab-9ac6-5b21f8835455 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:08.789535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f791e-5a51-46ab-9ac6-5b21f8835455 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:08.789880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f791e-5a51-46ab-9ac6-5b21f8835455 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:08.790501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f791e-5a51-46ab-9ac6-5b21f8835455 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:08.795355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-785f791e-5a51-46ab-9ac6-5b21f8835455 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:08.862880 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1713/3454] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:08.865139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7a95-08fd-4069-932d-f640753a4987 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:08.865453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7a95-08fd-4069-932d-f640753a4987 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:08.865894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7a95-08fd-4069-932d-f640753a4987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:08.923225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-28eb7a95-08fd-4069-932d-f640753a4987 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:08.925134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28eb7a95-08fd-4069-932d-f640753a4987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:08.956823 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1714/3455] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:08.963758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb7a95-08fd-4069-932d-f640753a4987 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:09.006029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb7a95-08fd-4069-932d-f640753a4987 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:09.022380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718292d-6541-4c92-8412-b4396377ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:09.024370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718292d-6541-4c92-8412-b4396377ec84 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:09.025686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718292d-6541-4c92-8412-b4396377ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:09.026925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718292d-6541-4c92-8412-b4396377ec84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:09.028115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718292d-6541-4c92-8412-b4396377ec84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:13:09.029126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718292d-6541-4c92-8412-b4396377ec84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:09.033909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718292d-6541-4c92-8412-b4396377ec84 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:09.039620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f791e-5a51-46ab-9ac6-5b21f8835455 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:09.041271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f791e-5a51-46ab-9ac6-5b21f8835455 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:09.083175 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1742/3456] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:13:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:13:09.083634 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1715/3457] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:09.091098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f791e-5a51-46ab-9ac6-5b21f8835455 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:09.110229 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:09.132542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f791e-5a51-46ab-9ac6-5b21f8835455 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:09.145617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5e7f-da8a-4cd4-9c29-55d233cf2507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:09.146459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5e7f-da8a-4cd4-9c29-55d233cf2507 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:09.146809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5e7f-da8a-4cd4-9c29-55d233cf2507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:09.147153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5e7f-da8a-4cd4-9c29-55d233cf2507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:09.147790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb5e7f-da8a-4cd4-9c29-55d233cf2507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:09.154019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb5e7f-da8a-4cd4-9c29-55d233cf2507 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:09.233358 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1743/3458] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:13:09 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:09.238270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718292d-6541-4c92-8412-b4396377ec84 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:09.259998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718292d-6541-4c92-8412-b4396377ec84 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:09.391518 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:09.443994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a79d-ea76-431a-9bc9-ab2aba32cb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:09.446762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a79d-ea76-431a-9bc9-ab2aba32cb99 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:09.447823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a79d-ea76-431a-9bc9-ab2aba32cb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:09.448140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a79d-ea76-431a-9bc9-ab2aba32cb99 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:09.453562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174a79d-ea76-431a-9bc9-ab2aba32cb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:09.458592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174a79d-ea76-431a-9bc9-ab2aba32cb99 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:09.518811 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1716/3459] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:13:09 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:09.528134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5e7f-da8a-4cd4-9c29-55d233cf2507 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:09.557262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5e7f-da8a-4cd4-9c29-55d233cf2507 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:09.576714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd198ed5-480a-459c-ad38-06cb13712491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:09.577261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198ed5-480a-459c-ad38-06cb13712491 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:09.577551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198ed5-480a-459c-ad38-06cb13712491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:09.577819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198ed5-480a-459c-ad38-06cb13712491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:09.578480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd198ed5-480a-459c-ad38-06cb13712491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:09.589687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd198ed5-480a-459c-ad38-06cb13712491 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:09.636778 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1744/3460] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:09.641730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a79d-ea76-431a-9bc9-ab2aba32cb99 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:09.654830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a79d-ea76-431a-9bc9-ab2aba32cb99 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:09.659936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeb297-fb9b-49dd-96f6-f52373b6f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:09.660560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb297-fb9b-49dd-96f6-f52373b6f29f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:09.660976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb297-fb9b-49dd-96f6-f52373b6f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:09.661435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb297-fb9b-49dd-96f6-f52373b6f29f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:09.662088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeb297-fb9b-49dd-96f6-f52373b6f29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:09.664266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeb297-fb9b-49dd-96f6-f52373b6f29f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:09.685655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd198ed5-480a-459c-ad38-06cb13712491 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:09.686168 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1717/3461] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:09.722011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd198ed5-480a-459c-ad38-06cb13712491 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:09.734300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e7e42-7691-4068-ab9a-8d1faa4d0afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:09.736926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7e42-7691-4068-ab9a-8d1faa4d0afd admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:09.737795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7e42-7691-4068-ab9a-8d1faa4d0afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:09.738581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7e42-7691-4068-ab9a-8d1faa4d0afd admin admin] PATH_INFO: `/v3/projects/9001930303b447988a8c81589f00f57b/users/02ae887cc9d3447193a64c784ba4b855/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:09.795495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e7e42-7691-4068-ab9a-8d1faa4d0afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9001930303b447988a8c81589f00f57b, user_id=02ae887cc9d3447193a64c784ba4b855, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:09.801238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e7e42-7691-4068-ab9a-8d1faa4d0afd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:09.851644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2820a-c128-44c1-83dc-1d27ca0b2a4e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:09.851944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2820a-c128-44c1-83dc-1d27ca0b2a4e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:09.852203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2820a-c128-44c1-83dc-1d27ca0b2a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:09.860403 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1745/3462] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:13:09 2022] PUT /identity/v3/projects/9001930303b447988a8c81589f00f57b/users/02ae887cc9d3447193a64c784ba4b855/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:09.891330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-98c2820a-c128-44c1-83dc-1d27ca0b2a4e None None] MFA Rules not processed for user `02ae887cc9d3447193a64c784ba4b855`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:09.894349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-98c2820a-c128-44c1-83dc-1d27ca0b2a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:10.094719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e7e42-7691-4068-ab9a-8d1faa4d0afd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:10.095053 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1718/3463] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:10.249953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e7e42-7691-4068-ab9a-8d1faa4d0afd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:10.277746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c3d85-09fd-4670-ac06-bb99accadf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:10.278383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c3d85-09fd-4670-ac06-bb99accadf40 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:10.279397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c3d85-09fd-4670-ac06-bb99accadf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:10.279676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c3d85-09fd-4670-ac06-bb99accadf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:10.280366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c3d85-09fd-4670-ac06-bb99accadf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:10.282290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c3d85-09fd-4670-ac06-bb99accadf40 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:10.416997 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1746/3464] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:13:10 2022] POST /identity/v3/projects => generated 383 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:10.421021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2820a-c128-44c1-83dc-1d27ca0b2a4e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:10.439110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2820a-c128-44c1-83dc-1d27ca0b2a4e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:10.622730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f616f-ab77-4400-b9d1-194d20db777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:10.623373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f616f-ab77-4400-b9d1-194d20db777a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:10.623653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f616f-ab77-4400-b9d1-194d20db777a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:10.623926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f616f-ab77-4400-b9d1-194d20db777a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:10.631006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f616f-ab77-4400-b9d1-194d20db777a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:10.633285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f616f-ab77-4400-b9d1-194d20db777a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:10.693527 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1719/3465] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:13:10 2022] POST /identity/v3/users => generated 298 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:10.694698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c3d85-09fd-4670-ac06-bb99accadf40 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:10.715924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c3d85-09fd-4670-ac06-bb99accadf40 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:10.731785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067623-822c-4d32-96f4-42529445d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:10.739267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067623-822c-4d32-96f4-42529445d2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:10.740044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067623-822c-4d32-96f4-42529445d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:10.740476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067623-822c-4d32-96f4-42529445d2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:10.741669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55067623-822c-4d32-96f4-42529445d2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:10.744439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55067623-822c-4d32-96f4-42529445d2f1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:10.766643 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1747/3466] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:10.772082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f616f-ab77-4400-b9d1-194d20db777a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:10.789840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f616f-ab77-4400-b9d1-194d20db777a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:10.805462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b872321-a1c9-41b1-bee5-2d4c0d9a4afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:10.806248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b872321-a1c9-41b1-bee5-2d4c0d9a4afc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:10.806632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b872321-a1c9-41b1-bee5-2d4c0d9a4afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:10.807015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b872321-a1c9-41b1-bee5-2d4c0d9a4afc admin admin] PATH_INFO: `/v3/projects/c2495bfe90ec43589c31a005cadd2906/users/13a287b00a25481a9a5e5db9d8dd9c4b/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:10.844257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b872321-a1c9-41b1-bee5-2d4c0d9a4afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2495bfe90ec43589c31a005cadd2906, user_id=13a287b00a25481a9a5e5db9d8dd9c4b, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:10.851855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b872321-a1c9-41b1-bee5-2d4c0d9a4afc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:10.885867 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1720/3467] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:13:10 2022] PUT /identity/v3/projects/c2495bfe90ec43589c31a005cadd2906/users/13a287b00a25481a9a5e5db9d8dd9c4b/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:10.889378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067623-822c-4d32-96f4-42529445d2f1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:10.904798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067623-822c-4d32-96f4-42529445d2f1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:11.048916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d145eb6-957c-4c9f-9a43-078f7fc0f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:11.051963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d145eb6-957c-4c9f-9a43-078f7fc0f5ef admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:11.052419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d145eb6-957c-4c9f-9a43-078f7fc0f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:11.066712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d145eb6-957c-4c9f-9a43-078f7fc0f5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:11.070370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d145eb6-957c-4c9f-9a43-078f7fc0f5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:11.073410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d145eb6-957c-4c9f-9a43-078f7fc0f5ef admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:11.095144 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1748/3468] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:11.100238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b872321-a1c9-41b1-bee5-2d4c0d9a4afc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:11.133169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b872321-a1c9-41b1-bee5-2d4c0d9a4afc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:11.149896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858362f-3add-4aca-9ecf-effd35954bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:11.150637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858362f-3add-4aca-9ecf-effd35954bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:11.150933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858362f-3add-4aca-9ecf-effd35954bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:11.151236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858362f-3add-4aca-9ecf-effd35954bc4 admin admin] PATH_INFO: `/v3/projects/c2495bfe90ec43589c31a005cadd2906/users/13a287b00a25481a9a5e5db9d8dd9c4b/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:11.159717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858362f-3add-4aca-9ecf-effd35954bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2495bfe90ec43589c31a005cadd2906, user_id=13a287b00a25481a9a5e5db9d8dd9c4b, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:11.162180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858362f-3add-4aca-9ecf-effd35954bc4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:11.178130 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:11.209844 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1721/3469] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:13:11 2022] PUT /identity/v3/projects/c2495bfe90ec43589c31a005cadd2906/users/13a287b00a25481a9a5e5db9d8dd9c4b/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:11.229169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcf593-0cac-49f8-99e4-a3a4d4cdb6b4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:11.230367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcf593-0cac-49f8-99e4-a3a4d4cdb6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:11.230671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcf593-0cac-49f8-99e4-a3a4d4cdb6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:11.300173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-07dcf593-0cac-49f8-99e4-a3a4d4cdb6b4 None None] MFA Rules not processed for user `13a287b00a25481a9a5e5db9d8dd9c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:11.302275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-07dcf593-0cac-49f8-99e4-a3a4d4cdb6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:11.314889 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:11.509474 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1749/3470] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:11.514585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858362f-3add-4aca-9ecf-effd35954bc4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:11.516968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6858362f-3add-4aca-9ecf-effd35954bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:11.772775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858362f-3add-4aca-9ecf-effd35954bc4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:11.780547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2ab5-c9b4-45f5-bbcc-c99d77732578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:11.781408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2ab5-c9b4-45f5-bbcc-c99d77732578 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:11.781861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2ab5-c9b4-45f5-bbcc-c99d77732578 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:11.782309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2ab5-c9b4-45f5-bbcc-c99d77732578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:11.795441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff2ab5-c9b4-45f5-bbcc-c99d77732578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:11.797589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff2ab5-c9b4-45f5-bbcc-c99d77732578 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:11.874454 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1722/3471] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:11.887970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907dc4b-8ec4-41e7-af67-74044937238f None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:11.888418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907dc4b-8ec4-41e7-af67-74044937238f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:11.888594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907dc4b-8ec4-41e7-af67-74044937238f None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:11.891056 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1750/3472] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:13:11.900994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2ab5-c9b4-45f5-bbcc-c99d77732578 service nova] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:13:11.925995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2ab5-c9b4-45f5-bbcc-c99d77732578 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:11.949322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2ab5-c9b4-45f5-bbcc-c99d77732578 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:11.984936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f45e5c-02d3-480f-ae0f-ec3375aa92c8 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a287b00a25481a9a5e5db9d8dd9c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2495bfe90ec43589c31a005cadd2906', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:11.985930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f45e5c-02d3-480f-ae0f-ec3375aa92c8 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:11.986095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f45e5c-02d3-480f-ae0f-ec3375aa92c8 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:11.987090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f45e5c-02d3-480f-ae0f-ec3375aa92c8 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] PATH_INFO: `/v3/projects/9001930303b447988a8c81589f00f57b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:11.989114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f45e5c-02d3-480f-ae0f-ec3375aa92c8 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorizing `identity:get_project(project_id=9001930303b447988a8c81589f00f57b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:11.994406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f45e5c-02d3-480f-ae0f-ec3375aa92c8 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:11.996589 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1723/3473] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:13:11 2022] GET /identity/v3/projects/9001930303b447988a8c81589f00f57b => generated 381 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:12.078666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17bf57-ba1a-4556-8dc0-c1d61d8e08b4 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:12.078666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17bf57-ba1a-4556-8dc0-c1d61d8e08b4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:12.078666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17bf57-ba1a-4556-8dc0-c1d61d8e08b4 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:12.078666 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1751/3474] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:13:12.098781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f45e5c-02d3-480f-ae0f-ec3375aa92c8 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:13:12.125335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f45e5c-02d3-480f-ae0f-ec3375aa92c8 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:12.144252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f45e5c-02d3-480f-ae0f-ec3375aa92c8 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:12.155204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a9e33-9966-424f-a55c-36a440201042 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a287b00a25481a9a5e5db9d8dd9c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2495bfe90ec43589c31a005cadd2906', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:12.157280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a9e33-9966-424f-a55c-36a440201042 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:12.157928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a9e33-9966-424f-a55c-36a440201042 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:12.158629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a9e33-9966-424f-a55c-36a440201042 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] PATH_INFO: `/v3/projects/9001930303b447988a8c81589f00f57b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:12.162087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a9e33-9966-424f-a55c-36a440201042 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorizing `identity:get_project(project_id=9001930303b447988a8c81589f00f57b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:12.166384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a9e33-9966-424f-a55c-36a440201042 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:12.169112 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1724/3475] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:13:12 2022] GET /identity/v3/projects/9001930303b447988a8c81589f00f57b => generated 381 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:12.360462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a120-12f3-4737-b4fe-7843085ac71a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:12.361048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a120-12f3-4737-b4fe-7843085ac71a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:12.361048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a120-12f3-4737-b4fe-7843085ac71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:12.418527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0ee6a120-12f3-4737-b4fe-7843085ac71a None None] MFA Rules not processed for user `02ae887cc9d3447193a64c784ba4b855`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:12.421029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0ee6a120-12f3-4737-b4fe-7843085ac71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:12.573729 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1752/3476] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:12.586998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a9e33-9966-424f-a55c-36a440201042 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:12.605247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a9e33-9966-424f-a55c-36a440201042 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:12.617352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e0d55-a61d-4823-88bc-82860108fa12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:12.617963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e0d55-a61d-4823-88bc-82860108fa12 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:12.618242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e0d55-a61d-4823-88bc-82860108fa12 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:12.620550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e0d55-a61d-4823-88bc-82860108fa12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:12.648022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e0d55-a61d-4823-88bc-82860108fa12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:12.652256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e0d55-a61d-4823-88bc-82860108fa12 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:12.692976 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1725/3477] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:17.118131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6a120-12f3-4737-b4fe-7843085ac71a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:17.120325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0ee6a120-12f3-4737-b4fe-7843085ac71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:17.276749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6a120-12f3-4737-b4fe-7843085ac71a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:17.292928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078662c-98b3-4836-84c7-b1945f39652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:17.294687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078662c-98b3-4836-84c7-b1945f39652c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:17.295192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078662c-98b3-4836-84c7-b1945f39652c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:17.295693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078662c-98b3-4836-84c7-b1945f39652c admin admin] PATH_INFO: `/v3/users/12255be27c014647bdda3a2b8c654816` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:17.298793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078662c-98b3-4836-84c7-b1945f39652c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12255be27c014647bdda3a2b8c654816)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:17.309122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078662c-98b3-4836-84c7-b1945f39652c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:17.461771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0078662c-98b3-4836-84c7-b1945f39652c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12255be27c014647bdda3a2b8c654816'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:17.465280 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:17.486905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0078662c-98b3-4836-84c7-b1945f39652c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12255be27c014647bdda3a2b8c654816'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:17.487732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0078662c-98b3-4836-84c7-b1945f39652c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12255be27c014647bdda3a2b8c654816'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:17.508548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0078662c-98b3-4836-84c7-b1945f39652c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12255be27c014647bdda3a2b8c654816'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:17.510086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0078662c-98b3-4836-84c7-b1945f39652c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12255be27c014647bdda3a2b8c654816'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:17.534820 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1753/3478] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:17 2022] DELETE /identity/v3/users/12255be27c014647bdda3a2b8c654816 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:18.294230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e0d55-a61d-4823-88bc-82860108fa12 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:18.341045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e0d55-a61d-4823-88bc-82860108fa12 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:18.539381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:18.540145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:18.540478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:18.540792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] PATH_INFO: `/v3/projects/84d961145cab4eeaac0e4da70bbe6ac4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:18.542025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d961145cab4eeaac0e4da70bbe6ac4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:18.544108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:18.686334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d961145cab4eeaac0e4da70bbe6ac4', 'request_id': 'req-54796ce3-4105-40f1-a6fb-5d0cc9d07221'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:18.688689 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:18.703717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d961145cab4eeaac0e4da70bbe6ac4', 'request_id': 'req-54796ce3-4105-40f1-a6fb-5d0cc9d07221'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:18.727856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d961145cab4eeaac0e4da70bbe6ac4', 'request_id': 'req-54796ce3-4105-40f1-a6fb-5d0cc9d07221'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:18.758838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] The token cache is being invalidate because project 84d961145cab4eeaac0e4da70bbe6ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:18.761852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:18.767408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54796ce3-4105-40f1-a6fb-5d0cc9d07221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:18.771747 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1726/3479] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:18 2022] DELETE /identity/v3/projects/84d961145cab4eeaac0e4da70bbe6ac4 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:18.776944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf968c-45f5-417e-9160-27ca3aae0f06 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:18.777564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf968c-45f5-417e-9160-27ca3aae0f06 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:18.777564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf968c-45f5-417e-9160-27ca3aae0f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:18.806129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1bdf968c-45f5-417e-9160-27ca3aae0f06 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:18.807431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1bdf968c-45f5-417e-9160-27ca3aae0f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:19.019387 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1754/3480] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:19.021418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de9ec9-9248-42c0-a3c2-252d522bab6c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:19.021790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de9ec9-9248-42c0-a3c2-252d522bab6c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:19.022020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de9ec9-9248-42c0-a3c2-252d522bab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:19.088865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-64de9ec9-9248-42c0-a3c2-252d522bab6c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:19.092080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-64de9ec9-9248-42c0-a3c2-252d522bab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:19.117960 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1727/3481] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:19.122624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf968c-45f5-417e-9160-27ca3aae0f06 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:19.136107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf968c-45f5-417e-9160-27ca3aae0f06 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:19.162998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2cae-71fc-418c-9875-b3dd9d1b20e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:19.163756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2cae-71fc-418c-9875-b3dd9d1b20e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:19.164048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2cae-71fc-418c-9875-b3dd9d1b20e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:19.164345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2cae-71fc-418c-9875-b3dd9d1b20e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:19.165099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2cae-71fc-418c-9875-b3dd9d1b20e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:13:19.165872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2cae-71fc-418c-9875-b3dd9d1b20e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:19.192141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2cae-71fc-418c-9875-b3dd9d1b20e7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:19.226367 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1755/3482] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:19.228055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de9ec9-9248-42c0-a3c2-252d522bab6c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:19.247462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de9ec9-9248-42c0-a3c2-252d522bab6c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:19.263164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05ffd3-0cae-4030-a2b8-fafb694a5ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:19.264578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05ffd3-0cae-4030-a2b8-fafb694a5ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:19.266400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05ffd3-0cae-4030-a2b8-fafb694a5ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:19.266715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05ffd3-0cae-4030-a2b8-fafb694a5ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:19.269829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05ffd3-0cae-4030-a2b8-fafb694a5ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:19.277003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05ffd3-0cae-4030-a2b8-fafb694a5ba6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:19.372467 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1728/3483] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:13:19 2022] POST /identity/v3/projects => generated 397 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:19.373365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2cae-71fc-418c-9875-b3dd9d1b20e7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:19.392444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2cae-71fc-418c-9875-b3dd9d1b20e7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:19.553795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354af147-6b66-4a42-a9ff-44029cedd1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:19.554714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354af147-6b66-4a42-a9ff-44029cedd1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:19.555060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354af147-6b66-4a42-a9ff-44029cedd1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:19.555399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354af147-6b66-4a42-a9ff-44029cedd1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:19.556268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354af147-6b66-4a42-a9ff-44029cedd1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:19.559474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354af147-6b66-4a42-a9ff-44029cedd1b9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:19.642382 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1756/3484] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:13:19 2022] POST /identity/v3/users => generated 299 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:13:19.647474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05ffd3-0cae-4030-a2b8-fafb694a5ba6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:19.663702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05ffd3-0cae-4030-a2b8-fafb694a5ba6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:19.680424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe6afa-d758-4d4d-91be-9e8f95035051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:19.684038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe6afa-d758-4d4d-91be-9e8f95035051 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:19.685065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe6afa-d758-4d4d-91be-9e8f95035051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:19.687521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe6afa-d758-4d4d-91be-9e8f95035051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:19.688691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe6afa-d758-4d4d-91be-9e8f95035051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:19.699874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe6afa-d758-4d4d-91be-9e8f95035051 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:19.744287 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1729/3485] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:19.748614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354af147-6b66-4a42-a9ff-44029cedd1b9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:19.765615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354af147-6b66-4a42-a9ff-44029cedd1b9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:19.774082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50cf37-ea2d-4606-bfa0-24a52621d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:19.774796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cf37-ea2d-4606-bfa0-24a52621d57f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:19.775131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cf37-ea2d-4606-bfa0-24a52621d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:19.775433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cf37-ea2d-4606-bfa0-24a52621d57f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:19.776106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50cf37-ea2d-4606-bfa0-24a52621d57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:19.777822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50cf37-ea2d-4606-bfa0-24a52621d57f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:19.819323 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1757/3486] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:19.819929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe6afa-d758-4d4d-91be-9e8f95035051 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:19.834525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe6afa-d758-4d4d-91be-9e8f95035051 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:19.858258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a32f-9d48-400c-a780-12c240f1797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:19.860542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a32f-9d48-400c-a780-12c240f1797d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:19.860840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a32f-9d48-400c-a780-12c240f1797d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:19.861121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a32f-9d48-400c-a780-12c240f1797d admin admin] PATH_INFO: `/v3/projects/4ac1963b4bf54123b0483de45b6617ea/users/eb1045d1468b4a2f814930f5ace5c2ef/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:19.918283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7a32f-9d48-400c-a780-12c240f1797d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac1963b4bf54123b0483de45b6617ea, user_id=eb1045d1468b4a2f814930f5ace5c2ef, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:19.921855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7a32f-9d48-400c-a780-12c240f1797d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:19.962225 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1730/3487] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:13:19 2022] PUT /identity/v3/projects/4ac1963b4bf54123b0483de45b6617ea/users/eb1045d1468b4a2f814930f5ace5c2ef/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:13:19.967734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b0456-54b9-47da-bd64-2dd75bbcb68b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:19.968286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b0456-54b9-47da-bd64-2dd75bbcb68b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:19.968565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b0456-54b9-47da-bd64-2dd75bbcb68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:20.012241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-197b0456-54b9-47da-bd64-2dd75bbcb68b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:20.013471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-197b0456-54b9-47da-bd64-2dd75bbcb68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:20.104140 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:20.156061 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1758/3488] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:20.170389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a32f-9d48-400c-a780-12c240f1797d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:20.172297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3aa7a32f-9d48-400c-a780-12c240f1797d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:20.354015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a32f-9d48-400c-a780-12c240f1797d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:20.366318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4743e-99d1-40cc-b11c-bd586683f8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:20.367284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4743e-99d1-40cc-b11c-bd586683f8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:20.372469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4743e-99d1-40cc-b11c-bd586683f8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:20.374480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4743e-99d1-40cc-b11c-bd586683f8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:20.406621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4743e-99d1-40cc-b11c-bd586683f8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:20.409337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4743e-99d1-40cc-b11c-bd586683f8e9 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:20.433805 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1731/3489] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:21.264016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942200-c4e5-4057-85b8-1249d891305e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:21.264615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942200-c4e5-4057-85b8-1249d891305e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:21.264615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942200-c4e5-4057-85b8-1249d891305e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:21.287351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a4942200-c4e5-4057-85b8-1249d891305e None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:21.289434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a4942200-c4e5-4057-85b8-1249d891305e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:21.451287 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1759/3490] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:21.466019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4743e-99d1-40cc-b11c-bd586683f8e9 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:21.467462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-16e4743e-99d1-40cc-b11c-bd586683f8e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:21.589292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4743e-99d1-40cc-b11c-bd586683f8e9 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:21.597804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca947f-aae2-41b5-8953-504e0fbc506e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:21.598833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca947f-aae2-41b5-8953-504e0fbc506e service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:21.599178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca947f-aae2-41b5-8953-504e0fbc506e service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:21.599457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca947f-aae2-41b5-8953-504e0fbc506e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:21.614340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca947f-aae2-41b5-8953-504e0fbc506e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:21.617878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca947f-aae2-41b5-8953-504e0fbc506e service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:21.633806 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1732/3491] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:13:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:13:22.256755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a4244-0f56-4a5a-8335-e552f84099f0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:22.257503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a4244-0f56-4a5a-8335-e552f84099f0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:22.257983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a4244-0f56-4a5a-8335-e552f84099f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:22.295635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-003a4244-0f56-4a5a-8335-e552f84099f0 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:22.297714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-003a4244-0f56-4a5a-8335-e552f84099f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:22.353787 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1760/3492] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:22.354318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca947f-aae2-41b5-8953-504e0fbc506e service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:22.369291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca947f-aae2-41b5-8953-504e0fbc506e service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:22.395728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44ae3c-8e2e-4d56-9e71-be0226176ccd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:22.400104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44ae3c-8e2e-4d56-9e71-be0226176ccd service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:22.401139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44ae3c-8e2e-4d56-9e71-be0226176ccd service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:22.401424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44ae3c-8e2e-4d56-9e71-be0226176ccd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:22.419504 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:22.429828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44ae3c-8e2e-4d56-9e71-be0226176ccd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:22.435001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44ae3c-8e2e-4d56-9e71-be0226176ccd service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:22.463095 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1733/3493] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:13:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:13:23.156160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb50ad7-703b-48db-a498-d980edcad714 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:23.156160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb50ad7-703b-48db-a498-d980edcad714 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:23.156343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb50ad7-703b-48db-a498-d980edcad714 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:23.157762 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1761/3494] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:13:23.173244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44ae3c-8e2e-4d56-9e71-be0226176ccd service swift] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:13:23.175309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc44ae3c-8e2e-4d56-9e71-be0226176ccd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:23.378009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44ae3c-8e2e-4d56-9e71-be0226176ccd service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:23.379630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc44ae3c-8e2e-4d56-9e71-be0226176ccd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:23.573744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44ae3c-8e2e-4d56-9e71-be0226176ccd service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:23.581366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1093d3-f0fe-4cb7-8642-37af86806d86 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a287b00a25481a9a5e5db9d8dd9c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2495bfe90ec43589c31a005cadd2906', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:23.582585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1093d3-f0fe-4cb7-8642-37af86806d86 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:23.583466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1093d3-f0fe-4cb7-8642-37af86806d86 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:23.583982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1093d3-f0fe-4cb7-8642-37af86806d86 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] PATH_INFO: `/v3/projects/9001930303b447988a8c81589f00f57b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:23.585568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1093d3-f0fe-4cb7-8642-37af86806d86 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorizing `identity:get_project(project_id=9001930303b447988a8c81589f00f57b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:23.607914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1093d3-f0fe-4cb7-8642-37af86806d86 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:23.654472 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1734/3495] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:13:23 2022] GET /identity/v3/projects/9001930303b447988a8c81589f00f57b => generated 381 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:23.844046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec568b27-c29c-4348-862e-1640ac2316e2 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:23.844620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec568b27-c29c-4348-862e-1640ac2316e2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:23.844620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec568b27-c29c-4348-862e-1640ac2316e2 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:23.845900 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1762/3496] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:13:23.851108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1093d3-f0fe-4cb7-8642-37af86806d86 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:13:23.879884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1093d3-f0fe-4cb7-8642-37af86806d86 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:23.899983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1093d3-f0fe-4cb7-8642-37af86806d86 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:23.909540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b714a-0423-494e-a392-f38cf130bade tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a287b00a25481a9a5e5db9d8dd9c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2495bfe90ec43589c31a005cadd2906', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:23.911401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b714a-0423-494e-a392-f38cf130bade tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:23.912321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b714a-0423-494e-a392-f38cf130bade tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:23.912670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b714a-0423-494e-a392-f38cf130bade tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] PATH_INFO: `/v3/projects/9001930303b447988a8c81589f00f57b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:23.915222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b714a-0423-494e-a392-f38cf130bade tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorizing `identity:get_project(project_id=9001930303b447988a8c81589f00f57b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:23.920919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b714a-0423-494e-a392-f38cf130bade tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:23.930575 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1735/3497] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:13:23 2022] GET /identity/v3/projects/9001930303b447988a8c81589f00f57b => generated 381 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:24.158503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b710-2fbc-4e50-8e4a-8ed3a659c2ea None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:24.159204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b710-2fbc-4e50-8e4a-8ed3a659c2ea None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:24.160007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b710-2fbc-4e50-8e4a-8ed3a659c2ea None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:24.161561 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1763/3498] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:13:24.168089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b714a-0423-494e-a392-f38cf130bade tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:13:24.169900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f0b714a-0423-494e-a392-f38cf130bade tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:24.203771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b714a-0423-494e-a392-f38cf130bade tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:24.229598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b714a-0423-494e-a392-f38cf130bade tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:24.244358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fea672-a55e-4442-afcc-e6f218807a28 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a287b00a25481a9a5e5db9d8dd9c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2495bfe90ec43589c31a005cadd2906', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:24.245270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea672-a55e-4442-afcc-e6f218807a28 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:24.245855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea672-a55e-4442-afcc-e6f218807a28 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:24.246616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea672-a55e-4442-afcc-e6f218807a28 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] PATH_INFO: `/v3/projects/9001930303b447988a8c81589f00f57b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:24.249863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fea672-a55e-4442-afcc-e6f218807a28 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorizing `identity:get_project(project_id=9001930303b447988a8c81589f00f57b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:24.255696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fea672-a55e-4442-afcc-e6f218807a28 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:24.260337 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1736/3499] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:13:24 2022] GET /identity/v3/projects/9001930303b447988a8c81589f00f57b => generated 381 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:24.501655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21647f9-5c13-4c18-972f-c726fa294724 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:24.501941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21647f9-5c13-4c18-972f-c726fa294724 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:24.502281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21647f9-5c13-4c18-972f-c726fa294724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:24.539399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e21647f9-5c13-4c18-972f-c726fa294724 None None] MFA Rules not processed for user `02ae887cc9d3447193a64c784ba4b855`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:24.541186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e21647f9-5c13-4c18-972f-c726fa294724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:24.708807 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1764/3500] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:26.054966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064e25-dcb8-4d26-8b09-e5edb5e695d2 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:26.055486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064e25-dcb8-4d26-8b09-e5edb5e695d2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:26.055486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064e25-dcb8-4d26-8b09-e5edb5e695d2 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:26.056831 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1737/3501] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:13:26.070496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21647f9-5c13-4c18-972f-c726fa294724 None None] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:13:26.091593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21647f9-5c13-4c18-972f-c726fa294724 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:26.119630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21647f9-5c13-4c18-972f-c726fa294724 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:26.138515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b83f9-cee9-4047-8b62-7fd80c744f4f tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a287b00a25481a9a5e5db9d8dd9c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2495bfe90ec43589c31a005cadd2906', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:26.139520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b83f9-cee9-4047-8b62-7fd80c744f4f tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:26.139961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b83f9-cee9-4047-8b62-7fd80c744f4f tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:26.140962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b83f9-cee9-4047-8b62-7fd80c744f4f tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] PATH_INFO: `/v3/projects/9001930303b447988a8c81589f00f57b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:26.142674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b83f9-cee9-4047-8b62-7fd80c744f4f tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorizing `identity:get_project(project_id=9001930303b447988a8c81589f00f57b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:26.150900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b83f9-cee9-4047-8b62-7fd80c744f4f tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:26.154820 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1765/3502] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:13:26 2022] GET /identity/v3/projects/9001930303b447988a8c81589f00f57b => generated 381 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:26.330619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f399ff-db0a-4a2a-a5a3-ef313c6a1e69 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:26.330904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f399ff-db0a-4a2a-a5a3-ef313c6a1e69 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:26.331342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f399ff-db0a-4a2a-a5a3-ef313c6a1e69 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:26.333661 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1738/3503] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:13:26.339140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b83f9-cee9-4047-8b62-7fd80c744f4f tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:13:26.380014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b83f9-cee9-4047-8b62-7fd80c744f4f tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:26.399521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b83f9-cee9-4047-8b62-7fd80c744f4f tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:26.415602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d3262-3264-49ab-8ebd-02cce9f10e7a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a287b00a25481a9a5e5db9d8dd9c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2495bfe90ec43589c31a005cadd2906', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:26.416171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d3262-3264-49ab-8ebd-02cce9f10e7a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:26.416652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d3262-3264-49ab-8ebd-02cce9f10e7a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:26.417102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d3262-3264-49ab-8ebd-02cce9f10e7a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] PATH_INFO: `/v3/projects/9001930303b447988a8c81589f00f57b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:26.418527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d3262-3264-49ab-8ebd-02cce9f10e7a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorizing `identity:get_project(project_id=9001930303b447988a8c81589f00f57b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:26.421039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d3262-3264-49ab-8ebd-02cce9f10e7a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:26.435072 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1766/3504] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:13:26 2022] GET /identity/v3/projects/9001930303b447988a8c81589f00f57b => generated 381 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:26.497010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d126d5-b402-4b1d-bd99-bfe6b5588a13 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:26.497292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d126d5-b402-4b1d-bd99-bfe6b5588a13 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:26.497574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d126d5-b402-4b1d-bd99-bfe6b5588a13 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:26.501328 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1739/3505] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:13:26.510441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d3262-3264-49ab-8ebd-02cce9f10e7a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:13:26.538717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d3262-3264-49ab-8ebd-02cce9f10e7a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:26.549315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d3262-3264-49ab-8ebd-02cce9f10e7a tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:26.566978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd23172-3b19-4589-9b1e-f68835edb5d2 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a287b00a25481a9a5e5db9d8dd9c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2495bfe90ec43589c31a005cadd2906', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:26.567643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd23172-3b19-4589-9b1e-f68835edb5d2 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:26.568560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd23172-3b19-4589-9b1e-f68835edb5d2 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:26.568850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd23172-3b19-4589-9b1e-f68835edb5d2 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] PATH_INFO: `/v3/projects/9001930303b447988a8c81589f00f57b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:26.578699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd23172-3b19-4589-9b1e-f68835edb5d2 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorizing `identity:get_project(project_id=9001930303b447988a8c81589f00f57b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:26.581064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd23172-3b19-4589-9b1e-f68835edb5d2 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:26.594865 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1767/3506] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:13:26 2022] GET /identity/v3/projects/9001930303b447988a8c81589f00f57b => generated 381 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:26.729867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cbad0-5ce5-4ddd-abb5-670ef3d6707a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:26.730507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cbad0-5ce5-4ddd-abb5-670ef3d6707a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:26.731004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cbad0-5ce5-4ddd-abb5-670ef3d6707a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:26.765910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-927cbad0-5ce5-4ddd-abb5-670ef3d6707a None None] MFA Rules not processed for user `02ae887cc9d3447193a64c784ba4b855`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:26.769614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-927cbad0-5ce5-4ddd-abb5-670ef3d6707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:26.791603 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1740/3507] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:28.892157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd23172-3b19-4589-9b1e-f68835edb5d2 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:28.894184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cdd23172-3b19-4589-9b1e-f68835edb5d2 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:28.921747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd23172-3b19-4589-9b1e-f68835edb5d2 tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:28.932263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909becad-61bb-42f5-b701-7bed325c40a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:28.933448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909becad-61bb-42f5-b701-7bed325c40a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:28.934060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909becad-61bb-42f5-b701-7bed325c40a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:28.934565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909becad-61bb-42f5-b701-7bed325c40a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:28.941236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-909becad-61bb-42f5-b701-7bed325c40a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:28.970585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909becad-61bb-42f5-b701-7bed325c40a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:28.973312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909becad-61bb-42f5-b701-7bed325c40a8 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:29.000702 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1768/3508] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:29.036235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc816d76-aaad-46cd-8fb9-d99f7497289e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:29.036883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc816d76-aaad-46cd-8fb9-d99f7497289e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:29.037189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc816d76-aaad-46cd-8fb9-d99f7497289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:29.077580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bc816d76-aaad-46cd-8fb9-d99f7497289e None None] MFA Rules not processed for user `eb1045d1468b4a2f814930f5ace5c2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:29.079318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bc816d76-aaad-46cd-8fb9-d99f7497289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:29.205212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b8e8-844d-4054-84fe-cb0b710ecbaf None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:29.206003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b8e8-844d-4054-84fe-cb0b710ecbaf None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:29.206460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b8e8-844d-4054-84fe-cb0b710ecbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:29.229625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bfc2b8e8-844d-4054-84fe-cb0b710ecbaf None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:29.231327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bfc2b8e8-844d-4054-84fe-cb0b710ecbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:29.244250 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1769/3509] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:29.258126 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:29.265211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2b8e8-844d-4054-84fe-cb0b710ecbaf None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:29.286327 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1741/3510] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:29.288890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552273a4-b4e0-4ae9-aaa3-0b7fc0904d12 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:29.289348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552273a4-b4e0-4ae9-aaa3-0b7fc0904d12 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:29.289785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552273a4-b4e0-4ae9-aaa3-0b7fc0904d12 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:29.292214 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1742/3511] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:13:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:13:29.297134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2b8e8-844d-4054-84fe-cb0b710ecbaf None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:29.301368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eede70-5b7d-40e6-8eaa-83a159b66cc0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:29.302263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eede70-5b7d-40e6-8eaa-83a159b66cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:29.304336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4d556-1106-4f4a-9080-237d58a2fa27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:29.304914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eede70-5b7d-40e6-8eaa-83a159b66cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:29.305512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4d556-1106-4f4a-9080-237d58a2fa27 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:29.305969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4d556-1106-4f4a-9080-237d58a2fa27 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:29.306362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4d556-1106-4f4a-9080-237d58a2fa27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:29.318388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4d556-1106-4f4a-9080-237d58a2fa27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:29.320478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4d556-1106-4f4a-9080-237d58a2fa27 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:29.355858 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1770/3512] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:13:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:13:29.356948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4d556-1106-4f4a-9080-237d58a2fa27 service swift] Authenticating service token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:13:29.384150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4d556-1106-4f4a-9080-237d58a2fa27 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:29.396613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b5eede70-5b7d-40e6-8eaa-83a159b66cc0 None None] MFA Rules not processed for user `eb1045d1468b4a2f814930f5ace5c2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:29.398016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b5eede70-5b7d-40e6-8eaa-83a159b66cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:29.415979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4d556-1106-4f4a-9080-237d58a2fa27 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:29.421328 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1743/3513] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:29.435911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ab0e2-626b-4852-bb94-aee15ef0557e tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a287b00a25481a9a5e5db9d8dd9c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2495bfe90ec43589c31a005cadd2906', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:29.436776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ab0e2-626b-4852-bb94-aee15ef0557e tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:29.438203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ab0e2-626b-4852-bb94-aee15ef0557e tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:29.438652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ab0e2-626b-4852-bb94-aee15ef0557e tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] PATH_INFO: `/v3/projects/9001930303b447988a8c81589f00f57b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:29.441398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ab0e2-626b-4852-bb94-aee15ef0557e tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorizing `identity:get_project(project_id=9001930303b447988a8c81589f00f57b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:29.443868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ab0e2-626b-4852-bb94-aee15ef0557e tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:29.446304 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1771/3514] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:13:29 2022] GET /identity/v3/projects/9001930303b447988a8c81589f00f57b => generated 381 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:29.952414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eede70-5b7d-40e6-8eaa-83a159b66cc0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:29.976693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eede70-5b7d-40e6-8eaa-83a159b66cc0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:30.001658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565c713-0acc-4e78-8e09-2cbda6ac303b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:30.002194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c713-0acc-4e78-8e09-2cbda6ac303b service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:30.002523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c713-0acc-4e78-8e09-2cbda6ac303b service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:30.002874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c713-0acc-4e78-8e09-2cbda6ac303b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:30.024033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ab0e2-626b-4852-bb94-aee15ef0557e tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:30.025971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a43ab0e2-626b-4852-bb94-aee15ef0557e tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:30.045215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565c713-0acc-4e78-8e09-2cbda6ac303b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:30.047548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565c713-0acc-4e78-8e09-2cbda6ac303b service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:30.075840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ab0e2-626b-4852-bb94-aee15ef0557e tempest-QuotasAdminNegativeTest-1817123633 tempest-QuotasAdminNegativeTest-1817123633-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:30.076319 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1744/3515] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:30.087156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:30.088184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:30.088687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:30.089190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] PATH_INFO: `/v3/users/02ae887cc9d3447193a64c784ba4b855` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:30.090622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ae887cc9d3447193a64c784ba4b855)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:30.092757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:30.096698 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:30.221703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ae887cc9d3447193a64c784ba4b855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:30.259773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ae887cc9d3447193a64c784ba4b855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:30.260696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ae887cc9d3447193a64c784ba4b855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:30.277407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ae887cc9d3447193a64c784ba4b855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:30.278753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ae887cc9d3447193a64c784ba4b855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:30.302844 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1772/3516] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:30 2022] DELETE /identity/v3/users/02ae887cc9d3447193a64c784ba4b855 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:13:30.307555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e08a5-d7e7-4eed-a4fe-c28be3918131 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:30.308432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e08a5-d7e7-4eed-a4fe-c28be3918131 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:30.309131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e08a5-d7e7-4eed-a4fe-c28be3918131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:30.348144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a96e08a5-d7e7-4eed-a4fe-c28be3918131 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:30.351099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a96e08a5-d7e7-4eed-a4fe-c28be3918131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:30.532498 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1745/3517] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:13:30.545548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:30.547369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:30.713099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd556-fe17-46fd-91b1-197392d6caf4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:30.717487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f98335-eb78-4cef-9262-8a00d0a215f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:30.718630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f98335-eb78-4cef-9262-8a00d0a215f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:30.719020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f98335-eb78-4cef-9262-8a00d0a215f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:30.720337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f98335-eb78-4cef-9262-8a00d0a215f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:30.732430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f98335-eb78-4cef-9262-8a00d0a215f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:30.734029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f98335-eb78-4cef-9262-8a00d0a215f6 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:30.749439 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1773/3518] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:31.324488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e08a5-d7e7-4eed-a4fe-c28be3918131 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:31.326313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a96e08a5-d7e7-4eed-a4fe-c28be3918131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:31.344828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e08a5-d7e7-4eed-a4fe-c28be3918131 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:31.355955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:31.356618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:31.356899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:31.357172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] PATH_INFO: `/v3/projects/9001930303b447988a8c81589f00f57b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:31.362826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9001930303b447988a8c81589f00f57b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:31.364797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:31.485726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9001930303b447988a8c81589f00f57b', 'request_id': 'req-dadd7272-047f-4697-b57d-75bb1002787a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:31.493123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9001930303b447988a8c81589f00f57b', 'request_id': 'req-dadd7272-047f-4697-b57d-75bb1002787a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:31.502056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9001930303b447988a8c81589f00f57b', 'request_id': 'req-dadd7272-047f-4697-b57d-75bb1002787a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:31.523726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] The token cache is being invalidate because project 9001930303b447988a8c81589f00f57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:31.524315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:31.525243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:31.527679 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1746/3519] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:31 2022] DELETE /identity/v3/projects/9001930303b447988a8c81589f00f57b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:31.531665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f98335-eb78-4cef-9262-8a00d0a215f6 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:31.562980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f98335-eb78-4cef-9262-8a00d0a215f6 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:31.680042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:31.680911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:31.681204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:31.681530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] PATH_INFO: `/v3/users/13a287b00a25481a9a5e5db9d8dd9c4b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:31.682721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a287b00a25481a9a5e5db9d8dd9c4b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:31.684726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:31.758204 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:31.806501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a287b00a25481a9a5e5db9d8dd9c4b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:31.852960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a287b00a25481a9a5e5db9d8dd9c4b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:31.854672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a287b00a25481a9a5e5db9d8dd9c4b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:31.872243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a287b00a25481a9a5e5db9d8dd9c4b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:31.873090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a287b00a25481a9a5e5db9d8dd9c4b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:31.910718 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1774/3520] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:31 2022] DELETE /identity/v3/users/13a287b00a25481a9a5e5db9d8dd9c4b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:32.278468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:32.281048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:32.495434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:32.497000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:32.506046 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:32.518786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd7272-047f-4697-b57d-75bb1002787a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:32.621011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099632a7-3fa4-4963-9322-d5dee047aa21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:32.623821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099632a7-3fa4-4963-9322-d5dee047aa21 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:32.624176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099632a7-3fa4-4963-9322-d5dee047aa21 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:32.624780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099632a7-3fa4-4963-9322-d5dee047aa21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:32.642151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-099632a7-3fa4-4963-9322-d5dee047aa21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:32.675765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099632a7-3fa4-4963-9322-d5dee047aa21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:32.681471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099632a7-3fa4-4963-9322-d5dee047aa21 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:32.716187 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1747/3521] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:32.727217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a26bf3-b6b4-461e-8dcf-9eb9bc26de01 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:32.740964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:32.742208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:32.742706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:32.742984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] PATH_INFO: `/v3/projects/c2495bfe90ec43589c31a005cadd2906` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:32.744543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2495bfe90ec43589c31a005cadd2906)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:32.747115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:32.936612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2495bfe90ec43589c31a005cadd2906', 'request_id': 'req-b632461c-db41-4f64-9068-49212b2e2369'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:32.951578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2495bfe90ec43589c31a005cadd2906', 'request_id': 'req-b632461c-db41-4f64-9068-49212b2e2369'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:32.972090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2495bfe90ec43589c31a005cadd2906', 'request_id': 'req-b632461c-db41-4f64-9068-49212b2e2369'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:33.015571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] The token cache is being invalidate because project c2495bfe90ec43589c31a005cadd2906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:33.015963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:33.017266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b632461c-db41-4f64-9068-49212b2e2369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:33.027651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4773c64-bf52-439b-8f6f-07d2bf593cce None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:33.028395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4773c64-bf52-439b-8f6f-07d2bf593cce None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:33.028671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4773c64-bf52-439b-8f6f-07d2bf593cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:33.032708 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1775/3522] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:32 2022] DELETE /identity/v3/projects/c2495bfe90ec43589c31a005cadd2906 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:33.108704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c4773c64-bf52-439b-8f6f-07d2bf593cce None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:33.109926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c4773c64-bf52-439b-8f6f-07d2bf593cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:33.432519 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1748/3523] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:33.440849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b65f80-e3a6-4452-89e3-83285f616f2c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:33.441203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b65f80-e3a6-4452-89e3-83285f616f2c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:33.441423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b65f80-e3a6-4452-89e3-83285f616f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:33.518366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-69b65f80-e3a6-4452-89e3-83285f616f2c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:33.520846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-69b65f80-e3a6-4452-89e3-83285f616f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:33.559769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4773c64-bf52-439b-8f6f-07d2bf593cce None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:33.560358 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1776/3524] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:33.573629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4773c64-bf52-439b-8f6f-07d2bf593cce None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:33.597349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5913beb-53b6-402f-89ab-280c1570a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:33.598097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5913beb-53b6-402f-89ab-280c1570a600 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:33.598486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5913beb-53b6-402f-89ab-280c1570a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:33.598907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5913beb-53b6-402f-89ab-280c1570a600 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:33.599875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5913beb-53b6-402f-89ab-280c1570a600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:13:33.600070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5913beb-53b6-402f-89ab-280c1570a600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:33.601805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5913beb-53b6-402f-89ab-280c1570a600 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:33.649065 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1749/3525] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:13:33.650735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b65f80-e3a6-4452-89e3-83285f616f2c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:33.662453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b65f80-e3a6-4452-89e3-83285f616f2c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:33.671396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1378af-7609-4f48-b21a-e2e62c53ba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:33.673566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1378af-7609-4f48-b21a-e2e62c53ba19 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:33.675137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1378af-7609-4f48-b21a-e2e62c53ba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:33.677848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1378af-7609-4f48-b21a-e2e62c53ba19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:33.678768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1378af-7609-4f48-b21a-e2e62c53ba19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:33.680850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1378af-7609-4f48-b21a-e2e62c53ba19 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:33.751550 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1777/3526] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:13:33 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:13:33.755319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5913beb-53b6-402f-89ab-280c1570a600 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:33.771385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5913beb-53b6-402f-89ab-280c1570a600 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:33.926933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fab2e8-9e4c-4862-b7d8-ffc7f5f11a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:33.927561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fab2e8-9e4c-4862-b7d8-ffc7f5f11a76 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:33.927828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fab2e8-9e4c-4862-b7d8-ffc7f5f11a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:33.928104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fab2e8-9e4c-4862-b7d8-ffc7f5f11a76 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:33.928740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fab2e8-9e4c-4862-b7d8-ffc7f5f11a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:33.931477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fab2e8-9e4c-4862-b7d8-ffc7f5f11a76 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:33.985984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582347e7-d866-4a4e-9ca6-58d6bbe778dc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:33.989596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582347e7-d866-4a4e-9ca6-58d6bbe778dc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:33.990063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582347e7-d866-4a4e-9ca6-58d6bbe778dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:34.012968 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1750/3527] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:13:33 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:34.016756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fab2e8-9e4c-4862-b7d8-ffc7f5f11a76 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:34.020926 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:34.056050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-582347e7-d866-4a4e-9ca6-58d6bbe778dc None None] MFA Rules not processed for user `66a9d6a142d444be90b2101f23603522`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:34.057641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-582347e7-d866-4a4e-9ca6-58d6bbe778dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:34.060822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fab2e8-9e4c-4862-b7d8-ffc7f5f11a76 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:34.072471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5ece-bafc-437a-8c24-86aa8ff7d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:34.073105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5ece-bafc-437a-8c24-86aa8ff7d923 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:34.073388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5ece-bafc-437a-8c24-86aa8ff7d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:34.073661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5ece-bafc-437a-8c24-86aa8ff7d923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:34.074327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de5ece-bafc-437a-8c24-86aa8ff7d923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:34.079670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de5ece-bafc-437a-8c24-86aa8ff7d923 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:34.090633 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:34.121736 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1751/3528] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:34.130988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5ece-bafc-437a-8c24-86aa8ff7d923 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:34.156949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5ece-bafc-437a-8c24-86aa8ff7d923 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:34.171405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9bd53-6c75-471d-b238-d5e84d339aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:34.172203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9bd53-6c75-471d-b238-d5e84d339aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:34.172483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9bd53-6c75-471d-b238-d5e84d339aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:34.172758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9bd53-6c75-471d-b238-d5e84d339aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:34.178017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9bd53-6c75-471d-b238-d5e84d339aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:34.179725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9bd53-6c75-471d-b238-d5e84d339aa6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:34.234683 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1752/3529] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:34.236709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9bd53-6c75-471d-b238-d5e84d339aa6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:34.270064 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1778/3530] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:34.291419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9bd53-6c75-471d-b238-d5e84d339aa6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:34.305172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729cf5-f54d-433b-8a6f-31662e88d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:34.308732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729cf5-f54d-433b-8a6f-31662e88d598 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:34.308984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729cf5-f54d-433b-8a6f-31662e88d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:34.309253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729cf5-f54d-433b-8a6f-31662e88d598 admin admin] PATH_INFO: `/v3/projects/1fdfc6203c4d44dd9a3098f7b6b56f9c/users/7d31213ca7fe463685f86f2d9de6b00b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:34.349759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc729cf5-f54d-433b-8a6f-31662e88d598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdfc6203c4d44dd9a3098f7b6b56f9c, user_id=7d31213ca7fe463685f86f2d9de6b00b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:34.355291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc729cf5-f54d-433b-8a6f-31662e88d598 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:34.375062 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1753/3531] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:13:34 2022] PUT /identity/v3/projects/1fdfc6203c4d44dd9a3098f7b6b56f9c/users/7d31213ca7fe463685f86f2d9de6b00b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:34.386839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d6e07-253d-4a4b-972c-e97775142f78 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:34.388484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d6e07-253d-4a4b-972c-e97775142f78 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:34.389204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d6e07-253d-4a4b-972c-e97775142f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:34.437004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-314d6e07-253d-4a4b-972c-e97775142f78 None None] MFA Rules not processed for user `7d31213ca7fe463685f86f2d9de6b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:34.438369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-314d6e07-253d-4a4b-972c-e97775142f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:34.616572 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1779/3532] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:34.915922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729cf5-f54d-433b-8a6f-31662e88d598 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:34.917955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dc729cf5-f54d-433b-8a6f-31662e88d598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:35.109503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729cf5-f54d-433b-8a6f-31662e88d598 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:35.124743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0d42a-1369-48c4-9ca1-0b24e385f00e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:35.125534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d42a-1369-48c4-9ca1-0b24e385f00e service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:35.125820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d42a-1369-48c4-9ca1-0b24e385f00e service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:35.126320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d42a-1369-48c4-9ca1-0b24e385f00e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:35.146671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0d42a-1369-48c4-9ca1-0b24e385f00e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:35.149385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0d42a-1369-48c4-9ca1-0b24e385f00e service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:35.173402 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1754/3533] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:35.479343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21142bb4-ed33-478d-a25a-05398cab443b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:35.480238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21142bb4-ed33-478d-a25a-05398cab443b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:35.480694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21142bb4-ed33-478d-a25a-05398cab443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:35.504847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-21142bb4-ed33-478d-a25a-05398cab443b None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:35.506398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-21142bb4-ed33-478d-a25a-05398cab443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:35.568338 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1780/3534] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:35.582992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0d42a-1369-48c4-9ca1-0b24e385f00e service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:35.585666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fea0d42a-1369-48c4-9ca1-0b24e385f00e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:35.683124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0d42a-1369-48c4-9ca1-0b24e385f00e service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:35.689147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c9149-a033-4ce9-b06b-6a8e569f88bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:35.690832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9149-a033-4ce9-b06b-6a8e569f88bb service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:35.691535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9149-a033-4ce9-b06b-6a8e569f88bb service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:35.691879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9149-a033-4ce9-b06b-6a8e569f88bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:35.703276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c9149-a033-4ce9-b06b-6a8e569f88bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:35.705005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c9149-a033-4ce9-b06b-6a8e569f88bb service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:35.716026 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1755/3535] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:13:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:13:35.904056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ad536-1763-414e-bd8b-23f6392aa2a1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:35.905139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ad536-1763-414e-bd8b-23f6392aa2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:35.905801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ad536-1763-414e-bd8b-23f6392aa2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:35.943982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1c5ad536-1763-414e-bd8b-23f6392aa2a1 None None] MFA Rules not processed for user `7d31213ca7fe463685f86f2d9de6b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:35.946576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1c5ad536-1763-414e-bd8b-23f6392aa2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:35.999925 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1781/3536] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:37.220300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37379f2-3b42-4786-b9c0-264bae02d92c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:37.221188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37379f2-3b42-4786-b9c0-264bae02d92c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:37.222637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37379f2-3b42-4786-b9c0-264bae02d92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:37.304972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d37379f2-3b42-4786-b9c0-264bae02d92c None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:37.311201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d37379f2-3b42-4786-b9c0-264bae02d92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:37.381751 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1756/3537] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:13:37.382563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ad536-1763-414e-bd8b-23f6392aa2a1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:37.403912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ad536-1763-414e-bd8b-23f6392aa2a1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:37.433952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8253c-2251-41ab-93a9-cf269391b605 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:37.434577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8253c-2251-41ab-93a9-cf269391b605 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:37.434893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8253c-2251-41ab-93a9-cf269391b605 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:37.435174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8253c-2251-41ab-93a9-cf269391b605 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:37.469887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8253c-2251-41ab-93a9-cf269391b605 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:37.471982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8253c-2251-41ab-93a9-cf269391b605 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:37.501104 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1782/3538] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:13:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:13:37.715861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37379f2-3b42-4786-b9c0-264bae02d92c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:37.805207 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:37.910583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37379f2-3b42-4786-b9c0-264bae02d92c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:37.921282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:37.927124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:37.927415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:37.927695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] PATH_INFO: `/v3/users/7d31213ca7fe463685f86f2d9de6b00b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:37.929993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d31213ca7fe463685f86f2d9de6b00b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:37.937997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:38.157928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d31213ca7fe463685f86f2d9de6b00b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:38.203858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d31213ca7fe463685f86f2d9de6b00b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:38.204686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d31213ca7fe463685f86f2d9de6b00b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:38.238493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d31213ca7fe463685f86f2d9de6b00b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:38.266135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d31213ca7fe463685f86f2d9de6b00b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:38.287910 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1757/3539] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:37 2022] DELETE /identity/v3/users/7d31213ca7fe463685f86f2d9de6b00b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:38.289923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb7cc6-699f-4f8d-8e1c-e2c3f857c361 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:38.290285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb7cc6-699f-4f8d-8e1c-e2c3f857c361 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:38.290712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb7cc6-699f-4f8d-8e1c-e2c3f857c361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:38.349260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-38fb7cc6-699f-4f8d-8e1c-e2c3f857c361 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:38.353416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-38fb7cc6-699f-4f8d-8e1c-e2c3f857c361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:38.426310 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:38.491235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:38.493121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:38.519388 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1783/3540] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:38.529819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb7cc6-699f-4f8d-8e1c-e2c3f857c361 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:38.531942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-38fb7cc6-699f-4f8d-8e1c-e2c3f857c361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:38.778807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb7cc6-699f-4f8d-8e1c-e2c3f857c361 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:38.793443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc2862-0870-4078-9375-dfa56f616592 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:38.795640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c491d-5de5-45d2-9ac9-53e712980913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:38.797121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c491d-5de5-45d2-9ac9-53e712980913 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:38.798986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c491d-5de5-45d2-9ac9-53e712980913 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:38.801349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c491d-5de5-45d2-9ac9-53e712980913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:38.817651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bfc9f-9f2d-4808-ae13-c6dc42067a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:38.818759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bfc9f-9f2d-4808-ae13-c6dc42067a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:38.819115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bfc9f-9f2d-4808-ae13-c6dc42067a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:38.819469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bfc9f-9f2d-4808-ae13-c6dc42067a19 admin admin] PATH_INFO: `/v3/users/c6bc89a846ec4240bd21f1052b90be8f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:38.821590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bfc9f-9f2d-4808-ae13-c6dc42067a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bc89a846ec4240bd21f1052b90be8f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:38.830471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c491d-5de5-45d2-9ac9-53e712980913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:38.838214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c491d-5de5-45d2-9ac9-53e712980913 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:38.852192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bfc9f-9f2d-4808-ae13-c6dc42067a19 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:38.868550 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1784/3541] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:13:39.021396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb8eca-0d08-42f7-9cee-4e03a5703c56 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:39.022092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb8eca-0d08-42f7-9cee-4e03a5703c56 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:39.023051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb8eca-0d08-42f7-9cee-4e03a5703c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:39.083959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a4bb8eca-0d08-42f7-9cee-4e03a5703c56 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:39.090885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a4bb8eca-0d08-42f7-9cee-4e03a5703c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:39.096758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-918bfc9f-9f2d-4808-ae13-c6dc42067a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bc89a846ec4240bd21f1052b90be8f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:39.114272 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:39.144172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-918bfc9f-9f2d-4808-ae13-c6dc42067a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bc89a846ec4240bd21f1052b90be8f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:39.151429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-918bfc9f-9f2d-4808-ae13-c6dc42067a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bc89a846ec4240bd21f1052b90be8f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:39.181135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-918bfc9f-9f2d-4808-ae13-c6dc42067a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bc89a846ec4240bd21f1052b90be8f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:39.219235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-918bfc9f-9f2d-4808-ae13-c6dc42067a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bc89a846ec4240bd21f1052b90be8f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:39.239772 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1758/3542] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:38 2022] DELETE /identity/v3/users/c6bc89a846ec4240bd21f1052b90be8f => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:39.246215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569879-95fe-4686-afa0-78a096c71547 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:39.246502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569879-95fe-4686-afa0-78a096c71547 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:39.246815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569879-95fe-4686-afa0-78a096c71547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:39.314585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-32569879-95fe-4686-afa0-78a096c71547 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:39.317075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-32569879-95fe-4686-afa0-78a096c71547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:39.368643 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1785/3543] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:39.396764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb8eca-0d08-42f7-9cee-4e03a5703c56 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:39.399661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a4bb8eca-0d08-42f7-9cee-4e03a5703c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:39.530519 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1759/3544] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:39.613977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32569879-95fe-4686-afa0-78a096c71547 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:39.615742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-32569879-95fe-4686-afa0-78a096c71547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:39.663046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb8eca-0d08-42f7-9cee-4e03a5703c56 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:39.696174 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:39.759430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32569879-95fe-4686-afa0-78a096c71547 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:39.774281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1dde8-9a06-4a2b-90a9-bdab63051de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:39.775990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1dde8-9a06-4a2b-90a9-bdab63051de1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:39.775990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1dde8-9a06-4a2b-90a9-bdab63051de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:39.775990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1dde8-9a06-4a2b-90a9-bdab63051de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:39.793976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bcc9a-f003-4b8f-bc2b-c40d14ca6789 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:39.794382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bcc9a-f003-4b8f-bc2b-c40d14ca6789 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:39.796318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bcc9a-f003-4b8f-bc2b-c40d14ca6789 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:39.796799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bcc9a-f003-4b8f-bc2b-c40d14ca6789 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:39.798076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1dde8-9a06-4a2b-90a9-bdab63051de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:39.802776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1dde8-9a06-4a2b-90a9-bdab63051de1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:39.836764 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1760/3545] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:39.837646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1dde8-9a06-4a2b-90a9-bdab63051de1 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:39.845348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-87b1dde8-9a06-4a2b-90a9-bdab63051de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:39.871172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1dde8-9a06-4a2b-90a9-bdab63051de1 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:39.879799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:39.880453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:39.880733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:39.881385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] PATH_INFO: `/v3/projects/1fdfc6203c4d44dd9a3098f7b6b56f9c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:39.884216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fdfc6203c4d44dd9a3098f7b6b56f9c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:39.886855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:39.909945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bcc9a-f003-4b8f-bc2b-c40d14ca6789 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:39.911845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bcc9a-f003-4b8f-bc2b-c40d14ca6789 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:39.923458 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1786/3546] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:13:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:13:39.960151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fdfc6203c4d44dd9a3098f7b6b56f9c', 'request_id': 'req-5180616b-8a48-4e9c-81e8-88b8caecaddb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:39.997414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fdfc6203c4d44dd9a3098f7b6b56f9c', 'request_id': 'req-5180616b-8a48-4e9c-81e8-88b8caecaddb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:40.012415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fdfc6203c4d44dd9a3098f7b6b56f9c', 'request_id': 'req-5180616b-8a48-4e9c-81e8-88b8caecaddb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:40.024927 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:40.043791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] The token cache is being invalidate because project 1fdfc6203c4d44dd9a3098f7b6b56f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:40.044087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:40.047238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5180616b-8a48-4e9c-81e8-88b8caecaddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:40.060323 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1761/3547] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:39 2022] DELETE /identity/v3/projects/1fdfc6203c4d44dd9a3098f7b6b56f9c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:40.066623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4256ff-d261-495c-bce9-d43296972fe0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:40.067279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4256ff-d261-495c-bce9-d43296972fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:40.067708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4256ff-d261-495c-bce9-d43296972fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:40.112166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7e4256ff-d261-495c-bce9-d43296972fe0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:40.114438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7e4256ff-d261-495c-bce9-d43296972fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:40.265567 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1787/3548] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:13:40.275615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf159647-289a-435c-a95a-1cf25a377f4e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:40.276469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf159647-289a-435c-a95a-1cf25a377f4e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:40.276896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf159647-289a-435c-a95a-1cf25a377f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:40.317519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cf159647-289a-435c-a95a-1cf25a377f4e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:40.320303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf159647-289a-435c-a95a-1cf25a377f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:40.350038 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1762/3549] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:40.352310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4256ff-d261-495c-bce9-d43296972fe0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:40.364488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4256ff-d261-495c-bce9-d43296972fe0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:40.373390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7e89d-09d5-41f7-9f6c-f99d21d21995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:40.373390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7e89d-09d5-41f7-9f6c-f99d21d21995 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:40.373390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7e89d-09d5-41f7-9f6c-f99d21d21995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:40.373390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7e89d-09d5-41f7-9f6c-f99d21d21995 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:40.373945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7e89d-09d5-41f7-9f6c-f99d21d21995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:13:40.373945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7e89d-09d5-41f7-9f6c-f99d21d21995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:40.375480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7e89d-09d5-41f7-9f6c-f99d21d21995 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:40.391331 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1788/3550] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:40.397161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf159647-289a-435c-a95a-1cf25a377f4e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:40.412193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf159647-289a-435c-a95a-1cf25a377f4e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:40.422375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49038a0-0652-41b9-abfc-128863c781be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:40.423429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49038a0-0652-41b9-abfc-128863c781be admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:40.424079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49038a0-0652-41b9-abfc-128863c781be admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:40.425162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49038a0-0652-41b9-abfc-128863c781be admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:40.426848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49038a0-0652-41b9-abfc-128863c781be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:40.429316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49038a0-0652-41b9-abfc-128863c781be admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:40.489599 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1763/3551] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:13:40 2022] POST /identity/v3/projects => generated 397 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:13:40.494118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7e89d-09d5-41f7-9f6c-f99d21d21995 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:40.525286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7e89d-09d5-41f7-9f6c-f99d21d21995 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:40.639078 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:40.663649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883dab02-9240-4751-9582-d28a75b58a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:40.664468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dab02-9240-4751-9582-d28a75b58a4e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:40.664878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dab02-9240-4751-9582-d28a75b58a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:40.665160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dab02-9240-4751-9582-d28a75b58a4e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:40.665964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883dab02-9240-4751-9582-d28a75b58a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:40.668303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883dab02-9240-4751-9582-d28a75b58a4e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:40.712608 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1789/3552] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:13:40 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:40.716422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49038a0-0652-41b9-abfc-128863c781be admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:40.765171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49038a0-0652-41b9-abfc-128863c781be admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:40.785974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585acab-82a8-46fc-8db9-b1b36bf7f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:40.786675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585acab-82a8-46fc-8db9-b1b36bf7f31f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:40.791417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585acab-82a8-46fc-8db9-b1b36bf7f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:40.791732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585acab-82a8-46fc-8db9-b1b36bf7f31f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:40.792613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585acab-82a8-46fc-8db9-b1b36bf7f31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:40.794311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585acab-82a8-46fc-8db9-b1b36bf7f31f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:40.860059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883dab02-9240-4751-9582-d28a75b58a4e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:40.865208 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1764/3553] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:40.879534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883dab02-9240-4751-9582-d28a75b58a4e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:40.899684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eb13f-b6eb-4a54-a511-61f48e03c63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:40.900409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb13f-b6eb-4a54-a511-61f48e03c63a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:40.900714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb13f-b6eb-4a54-a511-61f48e03c63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:40.900996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb13f-b6eb-4a54-a511-61f48e03c63a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:40.906699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100eb13f-b6eb-4a54-a511-61f48e03c63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:40.909402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100eb13f-b6eb-4a54-a511-61f48e03c63a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:40.999159 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1790/3554] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:41.003678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585acab-82a8-46fc-8db9-b1b36bf7f31f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:41.026194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585acab-82a8-46fc-8db9-b1b36bf7f31f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:41.041376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92764c2-885b-4af1-80ca-f3a236f9784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:41.043035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92764c2-885b-4af1-80ca-f3a236f9784a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:41.043392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92764c2-885b-4af1-80ca-f3a236f9784a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:41.043674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92764c2-885b-4af1-80ca-f3a236f9784a admin admin] PATH_INFO: `/v3/projects/edfd034d62f4496fb72e741c40c86302/users/c2f85f8748d9445ba1bcfdb1d31c8a2d/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:41.053277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eb13f-b6eb-4a54-a511-61f48e03c63a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:41.058433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-100eb13f-b6eb-4a54-a511-61f48e03c63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:41.104676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eb13f-b6eb-4a54-a511-61f48e03c63a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:41.109968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:41.110703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:41.110980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:41.111302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] PATH_INFO: `/v3/projects/43ccfc72930a48ed8a9578968a8e0ee0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:41.113586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ccfc72930a48ed8a9578968a8e0ee0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:41.116656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:41.156306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92764c2-885b-4af1-80ca-f3a236f9784a admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfd034d62f4496fb72e741c40c86302, user_id=c2f85f8748d9445ba1bcfdb1d31c8a2d, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:41.166381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92764c2-885b-4af1-80ca-f3a236f9784a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:41.215478 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1765/3555] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:13:41 2022] PUT /identity/v3/projects/edfd034d62f4496fb72e741c40c86302/users/c2f85f8748d9445ba1bcfdb1d31c8a2d/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:41.230872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df849208-0400-4979-aaec-81a2c3f6a4df None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:41.231182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df849208-0400-4979-aaec-81a2c3f6a4df None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:41.240926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ccfc72930a48ed8a9578968a8e0ee0', 'request_id': 'req-28e5c1f2-11d8-46a7-b198-d10ddc08d128'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:41.244984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df849208-0400-4979-aaec-81a2c3f6a4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:41.266107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ccfc72930a48ed8a9578968a8e0ee0', 'request_id': 'req-28e5c1f2-11d8-46a7-b198-d10ddc08d128'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:41.300059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ccfc72930a48ed8a9578968a8e0ee0', 'request_id': 'req-28e5c1f2-11d8-46a7-b198-d10ddc08d128'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:41.337948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] The token cache is being invalidate because project 43ccfc72930a48ed8a9578968a8e0ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:41.338268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:41.344971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:41.359547 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1791/3556] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:41 2022] DELETE /identity/v3/projects/43ccfc72930a48ed8a9578968a8e0ee0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:41.361047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:41.363614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:41.384104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-df849208-0400-4979-aaec-81a2c3f6a4df None None] MFA Rules not processed for user `c2f85f8748d9445ba1bcfdb1d31c8a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:41.389827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-df849208-0400-4979-aaec-81a2c3f6a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:41.593771 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1766/3557] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:41.600545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5c1f2-11d8-46a7-b198-d10ddc08d128 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:41.625697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:41.626352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:41.626751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:41.627028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] PATH_INFO: `/v3/users/2c4c54d93fc64eec927c536e58ac2042` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:41.630276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4c54d93fc64eec927c536e58ac2042)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:41.633023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:41.773289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4c54d93fc64eec927c536e58ac2042'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:41.777756 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:41.779415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df849208-0400-4979-aaec-81a2c3f6a4df None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:41.781384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-df849208-0400-4979-aaec-81a2c3f6a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:41.811246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4c54d93fc64eec927c536e58ac2042'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:41.812156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4c54d93fc64eec927c536e58ac2042'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:41.843998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4c54d93fc64eec927c536e58ac2042'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:41.849143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4c54d93fc64eec927c536e58ac2042'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:41.886986 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1792/3558] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:41 2022] DELETE /identity/v3/users/2c4c54d93fc64eec927c536e58ac2042 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:41.960225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df849208-0400-4979-aaec-81a2c3f6a4df None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:42.014866 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:42.092814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc36879-42b3-4e6b-b52e-4b01c3829553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:42.093388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc36879-42b3-4e6b-b52e-4b01c3829553 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:42.093672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc36879-42b3-4e6b-b52e-4b01c3829553 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:42.094358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc36879-42b3-4e6b-b52e-4b01c3829553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:42.097699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1cc36879-42b3-4e6b-b52e-4b01c3829553 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:42.251905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc36879-42b3-4e6b-b52e-4b01c3829553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:42.256365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc36879-42b3-4e6b-b52e-4b01c3829553 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:42.282718 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1767/3559] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:41 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:13:42.926678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:42.928776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:43.101788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1887b5-d3ed-4f03-9bf5-65c37428ef61 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:43.160427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:43.161714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:43.162942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:43.163838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] PATH_INFO: `/v3/projects/2dc820cc8c734b3985bbdf16e536ee32` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:43.166938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dc820cc8c734b3985bbdf16e536ee32)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:43.170275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:43.281344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dc820cc8c734b3985bbdf16e536ee32', 'request_id': 'req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:43.293429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dc820cc8c734b3985bbdf16e536ee32', 'request_id': 'req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:43.301116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dc820cc8c734b3985bbdf16e536ee32', 'request_id': 'req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:43.336509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] The token cache is being invalidate because project 2dc820cc8c734b3985bbdf16e536ee32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:43.336509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:43.336509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:43.336509 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1793/3560] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:42 2022] DELETE /identity/v3/projects/2dc820cc8c734b3985bbdf16e536ee32 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:13:43.341095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a677b-cdad-46c9-b3eb-d219ec619929 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:43.341514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a677b-cdad-46c9-b3eb-d219ec619929 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:43.341648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a677b-cdad-46c9-b3eb-d219ec619929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:43.365103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b02a677b-cdad-46c9-b3eb-d219ec619929 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:43.366641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b02a677b-cdad-46c9-b3eb-d219ec619929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:43.497433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:43.497433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:43.543486 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1768/3561] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:43.545818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ccf88-873a-4384-8ab7-d87f39de83d9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:43.546084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ccf88-873a-4384-8ab7-d87f39de83d9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:43.546533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ccf88-873a-4384-8ab7-d87f39de83d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:43.575482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2f4ccf88-873a-4384-8ab7-d87f39de83d9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:43.577819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2f4ccf88-873a-4384-8ab7-d87f39de83d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:43.595252 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1769/3562] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:43.596415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ccf88-873a-4384-8ab7-d87f39de83d9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:43.611101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ccf88-873a-4384-8ab7-d87f39de83d9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:43.619153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ff874-a65c-40cf-afd2-7275211b652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:43.620370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ff874-a65c-40cf-afd2-7275211b652a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:43.620808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ff874-a65c-40cf-afd2-7275211b652a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:43.621966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ff874-a65c-40cf-afd2-7275211b652a admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:43.622878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ff874-a65c-40cf-afd2-7275211b652a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:13:43.623352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ff874-a65c-40cf-afd2-7275211b652a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:43.626369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ff874-a65c-40cf-afd2-7275211b652a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:43.649786 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1770/3563] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:43.650915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ff874-a65c-40cf-afd2-7275211b652a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:43.657964 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:43.667584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ff874-a65c-40cf-afd2-7275211b652a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:43.669227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0387b-e500-4fe2-abb6-ff6f4eb66999 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:43.675838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49129e87-2fc5-4de3-b682-45b17cb58c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:43.676789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129e87-2fc5-4de3-b682-45b17cb58c0a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:43.677276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98799f-2d4c-443d-8345-3723fad8f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:43.677512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129e87-2fc5-4de3-b682-45b17cb58c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:43.678008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98799f-2d4c-443d-8345-3723fad8f986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:43.678376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129e87-2fc5-4de3-b682-45b17cb58c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:43.678530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98799f-2d4c-443d-8345-3723fad8f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:43.678939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98799f-2d4c-443d-8345-3723fad8f986 admin admin] PATH_INFO: `/v3/users/c2f85f8748d9445ba1bcfdb1d31c8a2d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:43.679269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49129e87-2fc5-4de3-b682-45b17cb58c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:43.681600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49129e87-2fc5-4de3-b682-45b17cb58c0a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:43.683103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98799f-2d4c-443d-8345-3723fad8f986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2f85f8748d9445ba1bcfdb1d31c8a2d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:43.691413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98799f-2d4c-443d-8345-3723fad8f986 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:43.728871 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1771/3564] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:13:43 2022] POST /identity/v3/projects => generated 401 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:43.732740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49129e87-2fc5-4de3-b682-45b17cb58c0a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:43.769687 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:43.814029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cf98799f-2d4c-443d-8345-3723fad8f986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2f85f8748d9445ba1bcfdb1d31c8a2d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:43.840329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cf98799f-2d4c-443d-8345-3723fad8f986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2f85f8748d9445ba1bcfdb1d31c8a2d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:43.842754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cf98799f-2d4c-443d-8345-3723fad8f986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2f85f8748d9445ba1bcfdb1d31c8a2d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:43.866718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cf98799f-2d4c-443d-8345-3723fad8f986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2f85f8748d9445ba1bcfdb1d31c8a2d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:43.867658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cf98799f-2d4c-443d-8345-3723fad8f986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2f85f8748d9445ba1bcfdb1d31c8a2d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:43.885492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49129e87-2fc5-4de3-b682-45b17cb58c0a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:43.912310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58da9d-2cb2-4340-8bdd-32bc1b1aa7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:43.913186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58da9d-2cb2-4340-8bdd-32bc1b1aa7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:43.913541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58da9d-2cb2-4340-8bdd-32bc1b1aa7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:43.913920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58da9d-2cb2-4340-8bdd-32bc1b1aa7e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:43.914677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58da9d-2cb2-4340-8bdd-32bc1b1aa7e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:43.918643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58da9d-2cb2-4340-8bdd-32bc1b1aa7e9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:43.928545 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1794/3565] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:43 2022] DELETE /identity/v3/users/c2f85f8748d9445ba1bcfdb1d31c8a2d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:43.934526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17398bfb-db9b-484a-88f5-c19d917fd12b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:43.935030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17398bfb-db9b-484a-88f5-c19d917fd12b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:43.935481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17398bfb-db9b-484a-88f5-c19d917fd12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:43.975806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-17398bfb-db9b-484a-88f5-c19d917fd12b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:43.976915 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1772/3566] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:13:43 2022] POST /identity/v3/users => generated 301 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:43.977719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-17398bfb-db9b-484a-88f5-c19d917fd12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:43.982231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58da9d-2cb2-4340-8bdd-32bc1b1aa7e9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:43.987858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6d58da9d-2cb2-4340-8bdd-32bc1b1aa7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:44.019168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58da9d-2cb2-4340-8bdd-32bc1b1aa7e9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:44.094525 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1795/3567] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:44.132942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442deca-02d3-49fa-ae6c-633c52582cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:44.134111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442deca-02d3-49fa-ae6c-633c52582cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:44.134546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442deca-02d3-49fa-ae6c-633c52582cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:44.134997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442deca-02d3-49fa-ae6c-633c52582cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:44.135895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442deca-02d3-49fa-ae6c-633c52582cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:44.137878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442deca-02d3-49fa-ae6c-633c52582cc4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:44.176131 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1773/3568] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:44.180636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17398bfb-db9b-484a-88f5-c19d917fd12b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:44.192058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17398bfb-db9b-484a-88f5-c19d917fd12b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:44.207745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464f303-1025-4971-b27c-3639c45a034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:44.208441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464f303-1025-4971-b27c-3639c45a034a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:44.208649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464f303-1025-4971-b27c-3639c45a034a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:44.210407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464f303-1025-4971-b27c-3639c45a034a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:44.212846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464f303-1025-4971-b27c-3639c45a034a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:44.219505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464f303-1025-4971-b27c-3639c45a034a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:44.224150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442deca-02d3-49fa-ae6c-633c52582cc4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:44.227140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1442deca-02d3-49fa-ae6c-633c52582cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:44.269495 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1796/3569] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:44.273559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464f303-1025-4971-b27c-3639c45a034a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:44.296684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464f303-1025-4971-b27c-3639c45a034a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:44.308664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec198ec-408d-45bb-8a47-2f6a926fd4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:44.310101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec198ec-408d-45bb-8a47-2f6a926fd4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:44.310387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec198ec-408d-45bb-8a47-2f6a926fd4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:44.311086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec198ec-408d-45bb-8a47-2f6a926fd4c5 admin admin] PATH_INFO: `/v3/projects/2ca6d15d072944a39d152df7786d4c71/users/1d3f50ccb8c94d639e25978096ceadde/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:44.350376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec198ec-408d-45bb-8a47-2f6a926fd4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca6d15d072944a39d152df7786d4c71, user_id=1d3f50ccb8c94d639e25978096ceadde, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:44.353106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec198ec-408d-45bb-8a47-2f6a926fd4c5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:44.380839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442deca-02d3-49fa-ae6c-633c52582cc4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:44.395115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f117ac-41ce-41f0-bca2-87e1fb749ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:44.399656 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1797/3570] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:13:44 2022] PUT /identity/v3/projects/2ca6d15d072944a39d152df7786d4c71/users/1d3f50ccb8c94d639e25978096ceadde/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:44.400317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f117ac-41ce-41f0-bca2-87e1fb749ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:44.400608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f117ac-41ce-41f0-bca2-87e1fb749ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:44.400888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f117ac-41ce-41f0-bca2-87e1fb749ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:44.411595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49729107-c375-4ffe-adfa-e5ae46254c25 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:44.411887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49729107-c375-4ffe-adfa-e5ae46254c25 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:44.412173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49729107-c375-4ffe-adfa-e5ae46254c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:44.437088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f117ac-41ce-41f0-bca2-87e1fb749ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:44.450123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f117ac-41ce-41f0-bca2-87e1fb749ec7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:44.477259 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1774/3571] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:44.483345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-49729107-c375-4ffe-adfa-e5ae46254c25 None None] MFA Rules not processed for user `1d3f50ccb8c94d639e25978096ceadde`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:44.484980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-49729107-c375-4ffe-adfa-e5ae46254c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:44.540847 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:44.628163 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1798/3572] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:44.633789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f117ac-41ce-41f0-bca2-87e1fb749ec7 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:44.649164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f117ac-41ce-41f0-bca2-87e1fb749ec7 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:44.749976 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:44.836056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2cd02-b0ab-4d02-a5bf-0d4608aae489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:44.836648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2cd02-b0ab-4d02-a5bf-0d4608aae489 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:44.838184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2cd02-b0ab-4d02-a5bf-0d4608aae489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:44.839311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2cd02-b0ab-4d02-a5bf-0d4608aae489 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:44.841417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2cd02-b0ab-4d02-a5bf-0d4608aae489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:44.851986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2cd02-b0ab-4d02-a5bf-0d4608aae489 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:44.935340 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1775/3573] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:13:44 2022] POST /identity/v3/projects => generated 403 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:44.938895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49729107-c375-4ffe-adfa-e5ae46254c25 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:44.967963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49729107-c375-4ffe-adfa-e5ae46254c25 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:45.126188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e672bf-3465-4551-bbf6-73219fed877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:45.139880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e672bf-3465-4551-bbf6-73219fed877b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:45.140212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e672bf-3465-4551-bbf6-73219fed877b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:45.140492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e672bf-3465-4551-bbf6-73219fed877b admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:45.141814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e672bf-3465-4551-bbf6-73219fed877b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:45.146211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e672bf-3465-4551-bbf6-73219fed877b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:45.222112 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1799/3574] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:13:44 2022] POST /identity/v3/users => generated 308 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:45.224745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2cd02-b0ab-4d02-a5bf-0d4608aae489 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:45.261442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2cd02-b0ab-4d02-a5bf-0d4608aae489 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:45.266460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7d566-e592-40bb-8ccc-29281603c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:45.267767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7d566-e592-40bb-8ccc-29281603c768 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:45.268096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7d566-e592-40bb-8ccc-29281603c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:45.268407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7d566-e592-40bb-8ccc-29281603c768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:45.269140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7d566-e592-40bb-8ccc-29281603c768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:45.271349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7d566-e592-40bb-8ccc-29281603c768 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:45.288639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e672bf-3465-4551-bbf6-73219fed877b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:45.304097 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1776/3575] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:45.304486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e672bf-3465-4551-bbf6-73219fed877b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:45.313593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9c75b-8e48-4061-b777-ad23fac2263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:45.314466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9c75b-8e48-4061-b777-ad23fac2263f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:45.314786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9c75b-8e48-4061-b777-ad23fac2263f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:45.315160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9c75b-8e48-4061-b777-ad23fac2263f admin admin] PATH_INFO: `/v3/projects/74a5db96ff50409aa7d82bbcec32b9ee/users/338a2b7cdd8c4d23a53588de01c8b2f5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:45.337198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9c75b-8e48-4061-b777-ad23fac2263f admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a5db96ff50409aa7d82bbcec32b9ee, user_id=338a2b7cdd8c4d23a53588de01c8b2f5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:45.349070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9c75b-8e48-4061-b777-ad23fac2263f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:45.400017 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1800/3576] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:13:45 2022] PUT /identity/v3/projects/74a5db96ff50409aa7d82bbcec32b9ee/users/338a2b7cdd8c4d23a53588de01c8b2f5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:13:45.401247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7d566-e592-40bb-8ccc-29281603c768 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:45.418626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7d566-e592-40bb-8ccc-29281603c768 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:45.560384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbafe5-c2aa-4b61-b97a-4a56142760c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:45.561316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbafe5-c2aa-4b61-b97a-4a56142760c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:45.561793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbafe5-c2aa-4b61-b97a-4a56142760c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:45.562074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbafe5-c2aa-4b61-b97a-4a56142760c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:45.562795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbafe5-c2aa-4b61-b97a-4a56142760c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:45.565082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbafe5-c2aa-4b61-b97a-4a56142760c0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:45.590760 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1777/3577] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:45.592879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9c75b-8e48-4061-b777-ad23fac2263f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:45.612916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9c75b-8e48-4061-b777-ad23fac2263f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:45.619503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda0829-9764-4822-bb7f-3e7427bf2be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:45.620738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda0829-9764-4822-bb7f-3e7427bf2be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:45.621079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda0829-9764-4822-bb7f-3e7427bf2be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:45.621374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda0829-9764-4822-bb7f-3e7427bf2be7 admin admin] PATH_INFO: `/v3/projects/74a5db96ff50409aa7d82bbcec32b9ee/users/338a2b7cdd8c4d23a53588de01c8b2f5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:45.625448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda0829-9764-4822-bb7f-3e7427bf2be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a5db96ff50409aa7d82bbcec32b9ee, user_id=338a2b7cdd8c4d23a53588de01c8b2f5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:45.643846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda0829-9764-4822-bb7f-3e7427bf2be7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:45.672532 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1801/3578] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:13:45 2022] PUT /identity/v3/projects/74a5db96ff50409aa7d82bbcec32b9ee/users/338a2b7cdd8c4d23a53588de01c8b2f5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:45.683610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e497591-32cb-4b3b-a643-37ff16b11cf3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:45.684032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e497591-32cb-4b3b-a643-37ff16b11cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:45.684463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e497591-32cb-4b3b-a643-37ff16b11cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:45.732811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1e497591-32cb-4b3b-a643-37ff16b11cf3 None None] MFA Rules not processed for user `338a2b7cdd8c4d23a53588de01c8b2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:45.734202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1e497591-32cb-4b3b-a643-37ff16b11cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:45.826686 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1778/3579] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:46.767637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda0829-9764-4822-bb7f-3e7427bf2be7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:46.775524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bfda0829-9764-4822-bb7f-3e7427bf2be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:46.887562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda0829-9764-4822-bb7f-3e7427bf2be7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:46.895952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:46.896612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:46.897088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:46.897368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] PATH_INFO: `/v3/projects/edfd034d62f4496fb72e741c40c86302` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:46.898785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=edfd034d62f4496fb72e741c40c86302)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:46.902334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:46.950355 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:47.005551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edfd034d62f4496fb72e741c40c86302', 'request_id': 'req-c43c5a71-03db-44b3-ae40-740a5b5de44a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:47.029931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edfd034d62f4496fb72e741c40c86302', 'request_id': 'req-c43c5a71-03db-44b3-ae40-740a5b5de44a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:47.070622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edfd034d62f4496fb72e741c40c86302', 'request_id': 'req-c43c5a71-03db-44b3-ae40-740a5b5de44a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:47.104778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] The token cache is being invalidate because project edfd034d62f4496fb72e741c40c86302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:47.105167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:47.105937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c43c5a71-03db-44b3-ae40-740a5b5de44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:47.112572 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1802/3580] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:46 2022] DELETE /identity/v3/projects/edfd034d62f4496fb72e741c40c86302 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:47.115621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8556-5805-41cf-93f0-dddba0d3dbae None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:47.116101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8556-5805-41cf-93f0-dddba0d3dbae None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:47.116188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8556-5805-41cf-93f0-dddba0d3dbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:47.161190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4e7d8556-5805-41cf-93f0-dddba0d3dbae None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:47.167602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4e7d8556-5805-41cf-93f0-dddba0d3dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:47.254264 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:47.330052 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1779/3581] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:47.338440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba36ab-dfad-48e0-8316-d9a91939e8a5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:47.339989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba36ab-dfad-48e0-8316-d9a91939e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:47.340593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba36ab-dfad-48e0-8316-d9a91939e8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:47.413530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6cba36ab-dfad-48e0-8316-d9a91939e8a5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:47.419264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6cba36ab-dfad-48e0-8316-d9a91939e8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:47.432930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d8556-5805-41cf-93f0-dddba0d3dbae None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:47.434354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4e7d8556-5805-41cf-93f0-dddba0d3dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:47.448771 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1803/3582] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:47.453093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba36ab-dfad-48e0-8316-d9a91939e8a5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:47.472659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba36ab-dfad-48e0-8316-d9a91939e8a5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:47.498497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ade0e2-f118-4c1c-a223-42b492fca60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:47.499159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade0e2-f118-4c1c-a223-42b492fca60d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:47.499447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade0e2-f118-4c1c-a223-42b492fca60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:47.499721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade0e2-f118-4c1c-a223-42b492fca60d admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:47.500388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ade0e2-f118-4c1c-a223-42b492fca60d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:13:47.500691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ade0e2-f118-4c1c-a223-42b492fca60d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:47.502347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ade0e2-f118-4c1c-a223-42b492fca60d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:47.540228 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1804/3583] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:47.540746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ade0e2-f118-4c1c-a223-42b492fca60d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:47.568254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ade0e2-f118-4c1c-a223-42b492fca60d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:47.583876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de335ae-e9a8-4375-b623-a075b1f56eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:47.583876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de335ae-e9a8-4375-b623-a075b1f56eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:47.584289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de335ae-e9a8-4375-b623-a075b1f56eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:47.584426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de335ae-e9a8-4375-b623-a075b1f56eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:47.585067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de335ae-e9a8-4375-b623-a075b1f56eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:47.595325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de335ae-e9a8-4375-b623-a075b1f56eb9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:47.610155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d8556-5805-41cf-93f0-dddba0d3dbae None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:47.630508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fe004-a98c-42d4-a35c-1040673d0a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:47.631228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fe004-a98c-42d4-a35c-1040673d0a3d service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:47.632802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fe004-a98c-42d4-a35c-1040673d0a3d service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:47.633164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fe004-a98c-42d4-a35c-1040673d0a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:47.638868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c43fe004-a98c-42d4-a35c-1040673d0a3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:47.682627 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1805/3584] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:13:47 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:47.689544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de335ae-e9a8-4375-b623-a075b1f56eb9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:47.814120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fe004-a98c-42d4-a35c-1040673d0a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:47.819435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fe004-a98c-42d4-a35c-1040673d0a3d service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:47.853543 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1780/3585] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:13:47.933917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de335ae-e9a8-4375-b623-a075b1f56eb9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:47.942761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a12f9-4c36-4117-9652-3f4716f6f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:47.943386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a12f9-4c36-4117-9652-3f4716f6f678 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:47.943668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a12f9-4c36-4117-9652-3f4716f6f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:47.943977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a12f9-4c36-4117-9652-3f4716f6f678 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:47.945803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a12f9-4c36-4117-9652-3f4716f6f678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:47.965364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a12f9-4c36-4117-9652-3f4716f6f678 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:48.008588 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1806/3586] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:13:47 2022] POST /identity/v3/users => generated 288 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:13:48.012982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fe004-a98c-42d4-a35c-1040673d0a3d service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:48.029362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fe004-a98c-42d4-a35c-1040673d0a3d service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:48.040779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00339436-5d47-4e38-8644-a026a7feb372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:48.041643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339436-5d47-4e38-8644-a026a7feb372 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:48.043451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339436-5d47-4e38-8644-a026a7feb372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:48.044600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339436-5d47-4e38-8644-a026a7feb372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:48.045524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00339436-5d47-4e38-8644-a026a7feb372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:48.049631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00339436-5d47-4e38-8644-a026a7feb372 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:48.083787 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1781/3587] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:48.087950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a12f9-4c36-4117-9652-3f4716f6f678 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:48.107128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a12f9-4c36-4117-9652-3f4716f6f678 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:48.121499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8288-b60b-4b9e-9a7f-0092eb5d1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:48.122130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8288-b60b-4b9e-9a7f-0092eb5d1a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:48.122411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8288-b60b-4b9e-9a7f-0092eb5d1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:48.122709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8288-b60b-4b9e-9a7f-0092eb5d1a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:48.123584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8288-b60b-4b9e-9a7f-0092eb5d1a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:48.125201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8288-b60b-4b9e-9a7f-0092eb5d1a67 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:48.170045 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1807/3588] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:48.172898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00339436-5d47-4e38-8644-a026a7feb372 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:48.186435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00339436-5d47-4e38-8644-a026a7feb372 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:48.197390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1730e-f798-4a6e-b38d-6c439cc8e481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:48.198075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1730e-f798-4a6e-b38d-6c439cc8e481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:48.198405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1730e-f798-4a6e-b38d-6c439cc8e481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:48.200884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1730e-f798-4a6e-b38d-6c439cc8e481 admin admin] PATH_INFO: `/v3/projects/bf661665ac114503b71ac751f84bfdd7/users/852e8ab225d64f40a4dc9ce54fe509fd/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:48.241046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1730e-f798-4a6e-b38d-6c439cc8e481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf661665ac114503b71ac751f84bfdd7, user_id=852e8ab225d64f40a4dc9ce54fe509fd, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:48.244105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1730e-f798-4a6e-b38d-6c439cc8e481 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:48.297044 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1782/3589] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:13:48 2022] PUT /identity/v3/projects/bf661665ac114503b71ac751f84bfdd7/users/852e8ab225d64f40a4dc9ce54fe509fd/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:48.299303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0e6cb-7807-4037-a502-edaa1b091b4c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:48.299635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0e6cb-7807-4037-a502-edaa1b091b4c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:48.300015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0e6cb-7807-4037-a502-edaa1b091b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:48.345291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bef0e6cb-7807-4037-a502-edaa1b091b4c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:48.346676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bef0e6cb-7807-4037-a502-edaa1b091b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:48.473937 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:48.529798 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1808/3590] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:48.590094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1730e-f798-4a6e-b38d-6c439cc8e481 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:48.592547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dfe1730e-f798-4a6e-b38d-6c439cc8e481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:48.653527 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:48.687308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1730e-f798-4a6e-b38d-6c439cc8e481 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:48.714957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5d4b-0baf-4a2e-bb34-b96b2184f51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:48.714957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5d4b-0baf-4a2e-bb34-b96b2184f51c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:48.714957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5d4b-0baf-4a2e-bb34-b96b2184f51c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:48.714957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5d4b-0baf-4a2e-bb34-b96b2184f51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:48.732418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c5d4b-0baf-4a2e-bb34-b96b2184f51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:48.733847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c5d4b-0baf-4a2e-bb34-b96b2184f51c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:48.804350 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1783/3591] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:49.263491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0e6cb-7807-4037-a502-edaa1b091b4c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:49.266875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bef0e6cb-7807-4037-a502-edaa1b091b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:49.288205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0e6cb-7807-4037-a502-edaa1b091b4c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:49.306024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:49.307081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:49.307544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:49.307988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] PATH_INFO: `/v3/users/c4c8a46a0556407f9956cbd1ffd75c7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:49.309783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c8a46a0556407f9956cbd1ffd75c7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:49.312095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:49.476581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c8a46a0556407f9956cbd1ffd75c7e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:49.511040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c8a46a0556407f9956cbd1ffd75c7e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:49.513357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c8a46a0556407f9956cbd1ffd75c7e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:49.524662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c8a46a0556407f9956cbd1ffd75c7e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:49.525351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c8a46a0556407f9956cbd1ffd75c7e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:49.547485 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1809/3592] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:49 2022] DELETE /identity/v3/users/c4c8a46a0556407f9956cbd1ffd75c7e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:50.006418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5d4b-0baf-4a2e-bb34-b96b2184f51c service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:50.022312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5d4b-0baf-4a2e-bb34-b96b2184f51c service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:50.162061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:50.163534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:50.247228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:50.247954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:50.249182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:50.249492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] PATH_INFO: `/v3/projects/2b6dd9c628eb4be5b48c28a1192e16c1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:50.251634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6dd9c628eb4be5b48c28a1192e16c1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:50.256528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:50.323422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840bda-04b0-4b1e-9948-b8cd0f6d1db8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:50.333289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4067c8-18ac-4a7f-a899-b2016d040745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:50.333964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4067c8-18ac-4a7f-a899-b2016d040745 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:50.334244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4067c8-18ac-4a7f-a899-b2016d040745 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:50.334523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4067c8-18ac-4a7f-a899-b2016d040745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:50.337433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1f4067c8-18ac-4a7f-a899-b2016d040745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:50.367807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6dd9c628eb4be5b48c28a1192e16c1', 'request_id': 'req-afde8c0d-00de-477e-8b52-eb83c834e073'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.378262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6dd9c628eb4be5b48c28a1192e16c1', 'request_id': 'req-afde8c0d-00de-477e-8b52-eb83c834e073'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.391369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6dd9c628eb4be5b48c28a1192e16c1', 'request_id': 'req-afde8c0d-00de-477e-8b52-eb83c834e073'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.417498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] The token cache is being invalidate because project 2b6dd9c628eb4be5b48c28a1192e16c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:50.417793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.420546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.426912 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1784/3593] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:50 2022] DELETE /identity/v3/projects/2b6dd9c628eb4be5b48c28a1192e16c1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:50.427720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:50.429133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:50.487418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4067c8-18ac-4a7f-a899-b2016d040745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:50.489606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4067c8-18ac-4a7f-a899-b2016d040745 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:50.494088 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:50.501725 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1810/3594] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:50 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:50.548293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4067c8-18ac-4a7f-a899-b2016d040745 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:50.550485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1f4067c8-18ac-4a7f-a899-b2016d040745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:50.580755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4067c8-18ac-4a7f-a899-b2016d040745 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:50.584964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde8c0d-00de-477e-8b52-eb83c834e073 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:50.594767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61a70b-cc58-4619-8497-a54037cb81ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:50.596824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61a70b-cc58-4619-8497-a54037cb81ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:50.597481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61a70b-cc58-4619-8497-a54037cb81ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:50.598032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61a70b-cc58-4619-8497-a54037cb81ee admin admin] PATH_INFO: `/v3/users/1d3f50ccb8c94d639e25978096ceadde` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:50.600324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:50.601108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:50.601487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61a70b-cc58-4619-8497-a54037cb81ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d3f50ccb8c94d639e25978096ceadde)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:50.601603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:50.601833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] PATH_INFO: `/v3/users/5d5e0832ad9f4cd8959259bd5251f3f9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:50.604356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5e0832ad9f4cd8959259bd5251f3f9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:50.606319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61a70b-cc58-4619-8497-a54037cb81ee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:50.610703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:50.655025 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:50.724100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e61a70b-cc58-4619-8497-a54037cb81ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d3f50ccb8c94d639e25978096ceadde'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.754067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e61a70b-cc58-4619-8497-a54037cb81ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d3f50ccb8c94d639e25978096ceadde'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.756483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e61a70b-cc58-4619-8497-a54037cb81ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d3f50ccb8c94d639e25978096ceadde'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.760437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5e0832ad9f4cd8959259bd5251f3f9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.782026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e61a70b-cc58-4619-8497-a54037cb81ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d3f50ccb8c94d639e25978096ceadde'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.783005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e61a70b-cc58-4619-8497-a54037cb81ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d3f50ccb8c94d639e25978096ceadde'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.828499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5e0832ad9f4cd8959259bd5251f3f9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.829950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5e0832ad9f4cd8959259bd5251f3f9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.834784 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1811/3595] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:50 2022] DELETE /identity/v3/users/1d3f50ccb8c94d639e25978096ceadde => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:50.850442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b40f-8273-42ac-8db9-bdb67662ae62 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:50.850442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b40f-8273-42ac-8db9-bdb67662ae62 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:50.850806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b40f-8273-42ac-8db9-bdb67662ae62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:50.862825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5e0832ad9f4cd8959259bd5251f3f9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.907360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5e0832ad9f4cd8959259bd5251f3f9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:50.923653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d8c9b40f-8273-42ac-8db9-bdb67662ae62 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:50.927162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d8c9b40f-8273-42ac-8db9-bdb67662ae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:50.936722 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1785/3596] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:50 2022] DELETE /identity/v3/users/5d5e0832ad9f4cd8959259bd5251f3f9 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:51.148767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1812/3597] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:51.200407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:51.202961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:51.398459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0ae81-1eba-4c73-9e0e-8017834f1dc5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:51.413851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d92c3-dd6c-400f-a271-567c9e456368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:51.414467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d92c3-dd6c-400f-a271-567c9e456368 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:51.414774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d92c3-dd6c-400f-a271-567c9e456368 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:51.415040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d92c3-dd6c-400f-a271-567c9e456368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:51.437623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d92c3-dd6c-400f-a271-567c9e456368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:51.441068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d92c3-dd6c-400f-a271-567c9e456368 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:51.474766 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1786/3598] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:52.484954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9b40f-8273-42ac-8db9-bdb67662ae62 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:52.486790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d8c9b40f-8273-42ac-8db9-bdb67662ae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:52.513760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9b40f-8273-42ac-8db9-bdb67662ae62 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:52.543627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:52.544294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:52.544576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:52.544854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] PATH_INFO: `/v3/projects/6632fafd2c174cebae2ddd00f1c95d77` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:52.553141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6632fafd2c174cebae2ddd00f1c95d77)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:52.562633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:52.731446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6632fafd2c174cebae2ddd00f1c95d77', 'request_id': 'req-a6ee714c-3145-451b-af50-7853d612dcc3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:52.767565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6632fafd2c174cebae2ddd00f1c95d77', 'request_id': 'req-a6ee714c-3145-451b-af50-7853d612dcc3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:52.786113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6632fafd2c174cebae2ddd00f1c95d77', 'request_id': 'req-a6ee714c-3145-451b-af50-7853d612dcc3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:52.793605 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:52.833080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] The token cache is being invalidate because project 6632fafd2c174cebae2ddd00f1c95d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:52.833254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:52.833919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a6ee714c-3145-451b-af50-7853d612dcc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:52.842230 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1813/3599] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:52 2022] DELETE /identity/v3/projects/6632fafd2c174cebae2ddd00f1c95d77 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:52.843897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a777e0-31b7-4bb2-9f6b-085cee31bd86 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:52.845108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a777e0-31b7-4bb2-9f6b-085cee31bd86 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:52.845393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a777e0-31b7-4bb2-9f6b-085cee31bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:52.893437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-21a777e0-31b7-4bb2-9f6b-085cee31bd86 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:52.902975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-21a777e0-31b7-4bb2-9f6b-085cee31bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:53.187031 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1787/3600] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:53.197921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5daccb-5483-4cff-9736-588faf6086cc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:53.197921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5daccb-5483-4cff-9736-588faf6086cc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:53.197921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5daccb-5483-4cff-9736-588faf6086cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:53.267747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3e5daccb-5483-4cff-9736-588faf6086cc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:53.268146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3e5daccb-5483-4cff-9736-588faf6086cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:53.305461 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1814/3601] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:53.308146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a777e0-31b7-4bb2-9f6b-085cee31bd86 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:53.313664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5daccb-5483-4cff-9736-588faf6086cc None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:53.316023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3e5daccb-5483-4cff-9736-588faf6086cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:53.328740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a777e0-31b7-4bb2-9f6b-085cee31bd86 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:53.356242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb81e01-2ea7-4b3f-a47f-467a3e2cb806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:53.357373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81e01-2ea7-4b3f-a47f-467a3e2cb806 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:53.357809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81e01-2ea7-4b3f-a47f-467a3e2cb806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:53.360447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81e01-2ea7-4b3f-a47f-467a3e2cb806 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:53.365356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb81e01-2ea7-4b3f-a47f-467a3e2cb806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:13:53.367541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb81e01-2ea7-4b3f-a47f-467a3e2cb806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:53.379130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb81e01-2ea7-4b3f-a47f-467a3e2cb806 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:53.406137 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1788/3602] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:13:53.410694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb81e01-2ea7-4b3f-a47f-467a3e2cb806 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:53.443011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb81e01-2ea7-4b3f-a47f-467a3e2cb806 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:53.461596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099bf04-f856-416f-8cd6-46926efb09a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:53.463046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bf04-f856-416f-8cd6-46926efb09a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:53.463497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bf04-f856-416f-8cd6-46926efb09a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:53.463933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bf04-f856-416f-8cd6-46926efb09a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:53.464914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099bf04-f856-416f-8cd6-46926efb09a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:53.469062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099bf04-f856-416f-8cd6-46926efb09a5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:53.529587 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:53.555403 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1789/3603] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:13:53 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:13:53.559683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099bf04-f856-416f-8cd6-46926efb09a5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:53.603507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5daccb-5483-4cff-9736-588faf6086cc None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:53.828141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407e9b7-9d95-4a8d-a567-c077e3e65ac7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:53.829159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e9b7-9d95-4a8d-a567-c077e3e65ac7 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:53.829793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e9b7-9d95-4a8d-a567-c077e3e65ac7 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:53.830303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e9b7-9d95-4a8d-a567-c077e3e65ac7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:53.834258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5407e9b7-9d95-4a8d-a567-c077e3e65ac7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:53.882864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407e9b7-9d95-4a8d-a567-c077e3e65ac7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:53.890257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407e9b7-9d95-4a8d-a567-c077e3e65ac7 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:53.917945 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1815/3604] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:13:53.920251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099bf04-f856-416f-8cd6-46926efb09a5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:53.943056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12633884-0097-4fca-839e-0c2b34d72217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:53.943688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12633884-0097-4fca-839e-0c2b34d72217 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:53.943970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12633884-0097-4fca-839e-0c2b34d72217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:53.944239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12633884-0097-4fca-839e-0c2b34d72217 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:53.944895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12633884-0097-4fca-839e-0c2b34d72217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:53.950705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12633884-0097-4fca-839e-0c2b34d72217 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:54.009141 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1790/3605] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:13:53 2022] POST /identity/v3/users => generated 293 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:13:54.015183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407e9b7-9d95-4a8d-a567-c077e3e65ac7 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:54.031116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407e9b7-9d95-4a8d-a567-c077e3e65ac7 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:54.080878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159ef5-6f23-4121-af55-9a860e1f78d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:54.087026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159ef5-6f23-4121-af55-9a860e1f78d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:54.091342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159ef5-6f23-4121-af55-9a860e1f78d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:54.095587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159ef5-6f23-4121-af55-9a860e1f78d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:54.098782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d159ef5-6f23-4121-af55-9a860e1f78d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:54.119830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d159ef5-6f23-4121-af55-9a860e1f78d6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:54.166953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12633884-0097-4fca-839e-0c2b34d72217 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:54.176472 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1816/3606] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:54.200948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12633884-0097-4fca-839e-0c2b34d72217 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:54.231713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286fbbe-8caf-42d8-8b2d-2d74c6a7de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:54.232354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286fbbe-8caf-42d8-8b2d-2d74c6a7de76 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:54.232639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286fbbe-8caf-42d8-8b2d-2d74c6a7de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:54.232918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286fbbe-8caf-42d8-8b2d-2d74c6a7de76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:54.233887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286fbbe-8caf-42d8-8b2d-2d74c6a7de76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:54.252239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286fbbe-8caf-42d8-8b2d-2d74c6a7de76 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:54.315126 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1791/3607] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:13:54.319636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159ef5-6f23-4121-af55-9a860e1f78d6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:54.345049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159ef5-6f23-4121-af55-9a860e1f78d6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:54.367361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97458c-964f-4032-a7b3-2db5189d27a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:54.368168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97458c-964f-4032-a7b3-2db5189d27a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:54.371033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97458c-964f-4032-a7b3-2db5189d27a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:54.371444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97458c-964f-4032-a7b3-2db5189d27a8 admin admin] PATH_INFO: `/v3/projects/53272886aeac4313b1e8ad37b6f9ff12/users/7f2fd89c34d84d77b2c0ad9d5ad45390/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:54.454382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97458c-964f-4032-a7b3-2db5189d27a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53272886aeac4313b1e8ad37b6f9ff12, user_id=7f2fd89c34d84d77b2c0ad9d5ad45390, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:54.473647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97458c-964f-4032-a7b3-2db5189d27a8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:54.516324 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1817/3608] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:13:54 2022] PUT /identity/v3/projects/53272886aeac4313b1e8ad37b6f9ff12/users/7f2fd89c34d84d77b2c0ad9d5ad45390/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:54.522153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bbadd-b9b1-466f-b2f9-42cfb6768436 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:54.522555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bbadd-b9b1-466f-b2f9-42cfb6768436 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:54.522778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bbadd-b9b1-466f-b2f9-42cfb6768436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:54.600268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d41bbadd-b9b1-466f-b2f9-42cfb6768436 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:54.605046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d41bbadd-b9b1-466f-b2f9-42cfb6768436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:54.753703 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1792/3609] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:54.866820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97458c-964f-4032-a7b3-2db5189d27a8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:54.869247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fa97458c-964f-4032-a7b3-2db5189d27a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:55.064375 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:55.104309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97458c-964f-4032-a7b3-2db5189d27a8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:55.116841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04560b-5684-443a-ba48-1d95a20a3fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:55.118708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04560b-5684-443a-ba48-1d95a20a3fdc service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:55.120652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04560b-5684-443a-ba48-1d95a20a3fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:55.121018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04560b-5684-443a-ba48-1d95a20a3fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:55.148445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04560b-5684-443a-ba48-1d95a20a3fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:55.154151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04560b-5684-443a-ba48-1d95a20a3fdc service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:55.203369 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1818/3610] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:13:55.228845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bbadd-b9b1-466f-b2f9-42cfb6768436 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:55.230838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d41bbadd-b9b1-466f-b2f9-42cfb6768436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:55.259112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bbadd-b9b1-466f-b2f9-42cfb6768436 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:55.285576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:55.286525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:55.286943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:55.287295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] PATH_INFO: `/v3/projects/2ca6d15d072944a39d152df7786d4c71` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:55.294820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca6d15d072944a39d152df7786d4c71)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:55.297178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:55.535823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca6d15d072944a39d152df7786d4c71', 'request_id': 'req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:55.563478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca6d15d072944a39d152df7786d4c71', 'request_id': 'req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:55.578748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca6d15d072944a39d152df7786d4c71', 'request_id': 'req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:55.603747 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:55.613691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] The token cache is being invalidate because project 2ca6d15d072944a39d152df7786d4c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:55.619036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:55.619783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:55.625010 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1793/3611] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:55 2022] DELETE /identity/v3/projects/2ca6d15d072944a39d152df7786d4c71 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:55.634319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04560b-5684-443a-ba48-1d95a20a3fdc service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:55.655969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04560b-5684-443a-ba48-1d95a20a3fdc service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:55.818554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c278168-d47d-4f9e-b659-f228e9aa9b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:55.820857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c278168-d47d-4f9e-b659-f228e9aa9b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:55.821501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c278168-d47d-4f9e-b659-f228e9aa9b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:55.821940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c278168-d47d-4f9e-b659-f228e9aa9b7d admin admin] PATH_INFO: `/v3/users/338a2b7cdd8c4d23a53588de01c8b2f5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:55.832626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c278168-d47d-4f9e-b659-f228e9aa9b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=338a2b7cdd8c4d23a53588de01c8b2f5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:55.839271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c278168-d47d-4f9e-b659-f228e9aa9b7d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:56.020991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4c278168-d47d-4f9e-b659-f228e9aa9b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '338a2b7cdd8c4d23a53588de01c8b2f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:56.064517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4c278168-d47d-4f9e-b659-f228e9aa9b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '338a2b7cdd8c4d23a53588de01c8b2f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:56.066218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4c278168-d47d-4f9e-b659-f228e9aa9b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '338a2b7cdd8c4d23a53588de01c8b2f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:56.084211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4c278168-d47d-4f9e-b659-f228e9aa9b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '338a2b7cdd8c4d23a53588de01c8b2f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:56.085016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4c278168-d47d-4f9e-b659-f228e9aa9b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '338a2b7cdd8c4d23a53588de01c8b2f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:56.225135 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1819/3612] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:13:55 2022] DELETE /identity/v3/users/338a2b7cdd8c4d23a53588de01c8b2f5 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:58.652070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:58.656209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:58.703308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efd0e8-eb84-4714-afb9-bf34c2a635e1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:58.951741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:58.957267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:58.957705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:58.957984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] PATH_INFO: `/v3/projects/74a5db96ff50409aa7d82bbcec32b9ee` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:58.959925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a5db96ff50409aa7d82bbcec32b9ee)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:58.962413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:59.099449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a5db96ff50409aa7d82bbcec32b9ee', 'request_id': 'req-48827940-7972-4fb2-8416-17bb3d31b21a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:59.122095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a5db96ff50409aa7d82bbcec32b9ee', 'request_id': 'req-48827940-7972-4fb2-8416-17bb3d31b21a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:59.136675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a5db96ff50409aa7d82bbcec32b9ee', 'request_id': 'req-48827940-7972-4fb2-8416-17bb3d31b21a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:59.158075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] The token cache is being invalidate because project 74a5db96ff50409aa7d82bbcec32b9ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:13:59.158376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:59.163095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48827940-7972-4fb2-8416-17bb3d31b21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:13:59.171532 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1794/3613] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:13:58 2022] DELETE /identity/v3/projects/74a5db96ff50409aa7d82bbcec32b9ee => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:13:59.177519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ba49f-fe14-44ef-aae7-914265b7223e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:59.178111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ba49f-fe14-44ef-aae7-914265b7223e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:59.178111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ba49f-fe14-44ef-aae7-914265b7223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:59.252422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a27ba49f-fe14-44ef-aae7-914265b7223e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:59.254294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a27ba49f-fe14-44ef-aae7-914265b7223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:59.580654 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1820/3614] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:59.588901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969629-17c7-4ac1-884e-fd65891b9dbd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:59.589194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969629-17c7-4ac1-884e-fd65891b9dbd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:59.589476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969629-17c7-4ac1-884e-fd65891b9dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:59.652933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9a969629-17c7-4ac1-884e-fd65891b9dbd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:13:59.654497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9a969629-17c7-4ac1-884e-fd65891b9dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:13:59.723787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ba49f-fe14-44ef-aae7-914265b7223e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:59.729298 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1795/3615] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:13:59.737017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ba49f-fe14-44ef-aae7-914265b7223e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:59.759885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf25d-d2f1-47e2-8a41-872f6d5ee61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:59.760542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf25d-d2f1-47e2-8a41-872f6d5ee61a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:59.760827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf25d-d2f1-47e2-8a41-872f6d5ee61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:59.761103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf25d-d2f1-47e2-8a41-872f6d5ee61a admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:59.761806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf25d-d2f1-47e2-8a41-872f6d5ee61a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:13:59.762064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf25d-d2f1-47e2-8a41-872f6d5ee61a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:59.773354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf25d-d2f1-47e2-8a41-872f6d5ee61a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:13:59.783033 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:59.844717 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1821/3616] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:13:59.853354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a969629-17c7-4ac1-884e-fd65891b9dbd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:13:59.867202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a969629-17c7-4ac1-884e-fd65891b9dbd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:13:59.885098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223911e7-db18-48e2-a8f9-f10533288477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:13:59.887194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223911e7-db18-48e2-a8f9-f10533288477 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:13:59.894801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223911e7-db18-48e2-a8f9-f10533288477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:13:59.900567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223911e7-db18-48e2-a8f9-f10533288477 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:13:59.902523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223911e7-db18-48e2-a8f9-f10533288477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:13:59.907454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223911e7-db18-48e2-a8f9-f10533288477 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:00.064327 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1796/3617] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:13:59 2022] POST /identity/v3/projects => generated 411 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:14:00.069573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf25d-d2f1-47e2-8a41-872f6d5ee61a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:00.090538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf25d-d2f1-47e2-8a41-872f6d5ee61a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:00.246987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ddd9e-418d-471a-aff7-839556e611f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:00.247614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ddd9e-418d-471a-aff7-839556e611f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:00.251034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ddd9e-418d-471a-aff7-839556e611f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:00.251817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ddd9e-418d-471a-aff7-839556e611f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:00.252669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ddd9e-418d-471a-aff7-839556e611f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:00.254866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ddd9e-418d-471a-aff7-839556e611f7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:00.330123 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1822/3618] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:14:00 2022] POST /identity/v3/users => generated 306 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:14:00.334102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223911e7-db18-48e2-a8f9-f10533288477 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:00.350199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223911e7-db18-48e2-a8f9-f10533288477 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:00.368647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78525cf0-1c6c-446b-a6a3-01d2ef77f68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:00.369671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78525cf0-1c6c-446b-a6a3-01d2ef77f68a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:00.370190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78525cf0-1c6c-446b-a6a3-01d2ef77f68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:00.370831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78525cf0-1c6c-446b-a6a3-01d2ef77f68a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:00.372053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78525cf0-1c6c-446b-a6a3-01d2ef77f68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:00.375675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78525cf0-1c6c-446b-a6a3-01d2ef77f68a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:00.398956 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1797/3619] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:14:00.401586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ddd9e-418d-471a-aff7-839556e611f7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:00.416143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ddd9e-418d-471a-aff7-839556e611f7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:00.430090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36af327-6f26-44c5-830f-82627ea9a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:00.431034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af327-6f26-44c5-830f-82627ea9a52b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:00.431527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af327-6f26-44c5-830f-82627ea9a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:00.431973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af327-6f26-44c5-830f-82627ea9a52b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:00.432864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36af327-6f26-44c5-830f-82627ea9a52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:00.435178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36af327-6f26-44c5-830f-82627ea9a52b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:00.462779 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1823/3620] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:14:00.468061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78525cf0-1c6c-446b-a6a3-01d2ef77f68a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:00.481649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78525cf0-1c6c-446b-a6a3-01d2ef77f68a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:00.497842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48feaf2-2adf-49fa-ac31-ec9837e409ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:00.498940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48feaf2-2adf-49fa-ac31-ec9837e409ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:00.499433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48feaf2-2adf-49fa-ac31-ec9837e409ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:00.499916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48feaf2-2adf-49fa-ac31-ec9837e409ba admin admin] PATH_INFO: `/v3/projects/e3f2bd52c8d347679396891f8f163197/users/1e5ba26f19334afa95c2df9b1655626e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:00.542989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48feaf2-2adf-49fa-ac31-ec9837e409ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f2bd52c8d347679396891f8f163197, user_id=1e5ba26f19334afa95c2df9b1655626e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:00.546166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48feaf2-2adf-49fa-ac31-ec9837e409ba admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:00.591255 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1798/3621] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:14:00 2022] PUT /identity/v3/projects/e3f2bd52c8d347679396891f8f163197/users/1e5ba26f19334afa95c2df9b1655626e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:14:00.597957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796ef5c-00af-4305-9097-7718fe0fd51a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:00.598882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796ef5c-00af-4305-9097-7718fe0fd51a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:00.599852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796ef5c-00af-4305-9097-7718fe0fd51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:00.671196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2796ef5c-00af-4305-9097-7718fe0fd51a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:00.679552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2796ef5c-00af-4305-9097-7718fe0fd51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:00.932598 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1824/3622] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:00.989477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48feaf2-2adf-49fa-ac31-ec9837e409ba admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:01.002555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b48feaf2-2adf-49fa-ac31-ec9837e409ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:01.105120 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:01.143263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48feaf2-2adf-49fa-ac31-ec9837e409ba admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:01.147794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7337c52-ed55-44b7-a2b0-fd06858e8c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:01.148941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7337c52-ed55-44b7-a2b0-fd06858e8c83 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:01.149447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7337c52-ed55-44b7-a2b0-fd06858e8c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:01.149947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7337c52-ed55-44b7-a2b0-fd06858e8c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:01.164832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7337c52-ed55-44b7-a2b0-fd06858e8c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:01.166764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7337c52-ed55-44b7-a2b0-fd06858e8c83 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:01.179462 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1799/3623] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:14:02.633306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ddea7-7830-424f-9f4b-a8c37c7dbfdb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:02.633853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ddea7-7830-424f-9f4b-a8c37c7dbfdb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:02.633853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ddea7-7830-424f-9f4b-a8c37c7dbfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:02.694005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-498ddea7-7830-424f-9f4b-a8c37c7dbfdb None None] MFA Rules not processed for user `852e8ab225d64f40a4dc9ce54fe509fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:02.695432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-498ddea7-7830-424f-9f4b-a8c37c7dbfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:02.842561 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1825/3624] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:02.923234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7337c52-ed55-44b7-a2b0-fd06858e8c83 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:02.938646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7337c52-ed55-44b7-a2b0-fd06858e8c83 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:02.949323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849b6e4-b77f-42ce-8340-6a30db927858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:02.950403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849b6e4-b77f-42ce-8340-6a30db927858 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:02.950884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849b6e4-b77f-42ce-8340-6a30db927858 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:02.951313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849b6e4-b77f-42ce-8340-6a30db927858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:02.991380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849b6e4-b77f-42ce-8340-6a30db927858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:02.993021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849b6e4-b77f-42ce-8340-6a30db927858 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:03.004672 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1800/3625] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:14:06.944322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4cee3-80e5-48a1-acbc-41315a8c7d80 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:06.944880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4cee3-80e5-48a1-acbc-41315a8c7d80 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:06.944979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4cee3-80e5-48a1-acbc-41315a8c7d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:06.954211 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:06.990513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1db4cee3-80e5-48a1-acbc-41315a8c7d80 None None] MFA Rules not processed for user `852e8ab225d64f40a4dc9ce54fe509fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:06.994226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1db4cee3-80e5-48a1-acbc-41315a8c7d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:07.008929 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1826/3626] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:08.701959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849b6e4-b77f-42ce-8340-6a30db927858 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:08.716393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849b6e4-b77f-42ce-8340-6a30db927858 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:08.725551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b409aa1-4b4a-4d47-bb57-f8a711ee8509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:08.726991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b409aa1-4b4a-4d47-bb57-f8a711ee8509 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:08.727668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b409aa1-4b4a-4d47-bb57-f8a711ee8509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:08.729134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b409aa1-4b4a-4d47-bb57-f8a711ee8509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:08.734905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b409aa1-4b4a-4d47-bb57-f8a711ee8509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:08.757288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b409aa1-4b4a-4d47-bb57-f8a711ee8509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:08.759663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b409aa1-4b4a-4d47-bb57-f8a711ee8509 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:08.778618 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1801/3627] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:14:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:14:09.264610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417683b7-61e3-4ee1-89b5-6a33765f401b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:09.265241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417683b7-61e3-4ee1-89b5-6a33765f401b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:09.265241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417683b7-61e3-4ee1-89b5-6a33765f401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:09.298994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-417683b7-61e3-4ee1-89b5-6a33765f401b None None] MFA Rules not processed for user `ef737c7d2aa247388c88fc2ad7ea5748`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:09.300724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-417683b7-61e3-4ee1-89b5-6a33765f401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:09.414576 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1827/3628] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:09.427349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe94dba-4ea0-41ca-bba1-dd3c76f58386 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:09.428206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe94dba-4ea0-41ca-bba1-dd3c76f58386 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:09.428730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe94dba-4ea0-41ca-bba1-dd3c76f58386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:09.454980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0fe94dba-4ea0-41ca-bba1-dd3c76f58386 None None] MFA Rules not processed for user `ef737c7d2aa247388c88fc2ad7ea5748`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:09.456910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0fe94dba-4ea0-41ca-bba1-dd3c76f58386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:09.464942 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1802/3629] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:13.103749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da4de0-ba2b-4c99-9bec-f17347e32eb0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:13.104236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da4de0-ba2b-4c99-9bec-f17347e32eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:13.104333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da4de0-ba2b-4c99-9bec-f17347e32eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:13.182322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c4da4de0-ba2b-4c99-9bec-f17347e32eb0 None None] MFA Rules not processed for user `7f2fd89c34d84d77b2c0ad9d5ad45390`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:13.183936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c4da4de0-ba2b-4c99-9bec-f17347e32eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:13.394721 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1828/3630] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:13.403053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18824d-1d41-48a4-a3aa-92204b0a476c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:13.403929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18824d-1d41-48a4-a3aa-92204b0a476c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:13.404357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18824d-1d41-48a4-a3aa-92204b0a476c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:13.432233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6f18824d-1d41-48a4-a3aa-92204b0a476c None None] MFA Rules not processed for user `7f2fd89c34d84d77b2c0ad9d5ad45390`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:13.434899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6f18824d-1d41-48a4-a3aa-92204b0a476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:13.448804 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1803/3631] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:14.889519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38215e8-1817-4c08-9f4d-a239aadf2769 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:14.890558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38215e8-1817-4c08-9f4d-a239aadf2769 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:14.891059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38215e8-1817-4c08-9f4d-a239aadf2769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:14.937730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d38215e8-1817-4c08-9f4d-a239aadf2769 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:14.941838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d38215e8-1817-4c08-9f4d-a239aadf2769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:15.168480 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1829/3632] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:15.186000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18824d-1d41-48a4-a3aa-92204b0a476c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:15.187480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6f18824d-1d41-48a4-a3aa-92204b0a476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:15.412642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18824d-1d41-48a4-a3aa-92204b0a476c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:15.422698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b18f8b-d8e9-4b51-99ad-0d80d8487b8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:15.423270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b18f8b-d8e9-4b51-99ad-0d80d8487b8e service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:15.429391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b18f8b-d8e9-4b51-99ad-0d80d8487b8e service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:15.429680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b18f8b-d8e9-4b51-99ad-0d80d8487b8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:15.460578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b18f8b-d8e9-4b51-99ad-0d80d8487b8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:15.462577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b18f8b-d8e9-4b51-99ad-0d80d8487b8e service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:15.485414 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1804/3633] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:14:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:14:17.196834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38215e8-1817-4c08-9f4d-a239aadf2769 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:17.198278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d38215e8-1817-4c08-9f4d-a239aadf2769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:17.319135 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:17.432606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38215e8-1817-4c08-9f4d-a239aadf2769 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:17.447530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b8338-4993-4b5a-a84d-2a001fb01db0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:17.450998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b8338-4993-4b5a-a84d-2a001fb01db0 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:17.452730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b8338-4993-4b5a-a84d-2a001fb01db0 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:17.453304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b8338-4993-4b5a-a84d-2a001fb01db0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:17.477097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b8338-4993-4b5a-a84d-2a001fb01db0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:17.484419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b8338-4993-4b5a-a84d-2a001fb01db0 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:17.518985 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1830/3634] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:14:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:14:18.406909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb482-8616-4c54-b25b-2577414bd1fe None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:18.407429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb482-8616-4c54-b25b-2577414bd1fe None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:18.407429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb482-8616-4c54-b25b-2577414bd1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:18.448391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-516cb482-8616-4c54-b25b-2577414bd1fe None None] MFA Rules not processed for user `1e5ba26f19334afa95c2df9b1655626e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:18.449854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-516cb482-8616-4c54-b25b-2577414bd1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:18.541051 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1805/3635] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:18.552545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df723d-5f07-4344-8047-b56ccdd62904 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:18.553016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df723d-5f07-4344-8047-b56ccdd62904 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:18.553098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df723d-5f07-4344-8047-b56ccdd62904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:18.574088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c7df723d-5f07-4344-8047-b56ccdd62904 None None] MFA Rules not processed for user `1e5ba26f19334afa95c2df9b1655626e`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:18.575744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c7df723d-5f07-4344-8047-b56ccdd62904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:18.587892 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1831/3636] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:20.440243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cb482-8616-4c54-b25b-2577414bd1fe None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:20.467388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cb482-8616-4c54-b25b-2577414bd1fe None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:20.476594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787eb69-3fda-4139-b08a-2fa31aae472b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:20.477446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787eb69-3fda-4139-b08a-2fa31aae472b service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:20.477930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787eb69-3fda-4139-b08a-2fa31aae472b service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:20.478395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787eb69-3fda-4139-b08a-2fa31aae472b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:20.480946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c787eb69-3fda-4139-b08a-2fa31aae472b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:20.490399 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:20.570269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787eb69-3fda-4139-b08a-2fa31aae472b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:20.572232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787eb69-3fda-4139-b08a-2fa31aae472b service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:20.585972 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1806/3637] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:14:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:14:21.167738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df723d-5f07-4344-8047-b56ccdd62904 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:21.169193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c7df723d-5f07-4344-8047-b56ccdd62904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:21.209657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787eb69-3fda-4139-b08a-2fa31aae472b service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:21.219419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df723d-5f07-4344-8047-b56ccdd62904 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:21.227589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a64dc2-2fed-4039-922d-6c502af60c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:21.228480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a64dc2-2fed-4039-922d-6c502af60c19 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:21.228911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a64dc2-2fed-4039-922d-6c502af60c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:21.229362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a64dc2-2fed-4039-922d-6c502af60c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:21.233589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787eb69-3fda-4139-b08a-2fa31aae472b service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:21.234562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-89a64dc2-2fed-4039-922d-6c502af60c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:21.255089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00381cbb-100e-40b5-a715-5c50bba3e7b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:21.255724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00381cbb-100e-40b5-a715-5c50bba3e7b0 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:21.256007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00381cbb-100e-40b5-a715-5c50bba3e7b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:21.256290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00381cbb-100e-40b5-a715-5c50bba3e7b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:21.271513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00381cbb-100e-40b5-a715-5c50bba3e7b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:21.272978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a64dc2-2fed-4039-922d-6c502af60c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:21.273156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00381cbb-100e-40b5-a715-5c50bba3e7b0 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:21.274569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a64dc2-2fed-4039-922d-6c502af60c19 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:21.292690 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1807/3638] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:14:21.295871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dd32f-7639-43af-8029-f0875ae9bcee None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:21.296154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dd32f-7639-43af-8029-f0875ae9bcee None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:21.296431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dd32f-7639-43af-8029-f0875ae9bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:21.306687 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1832/3639] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:14:21.343117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8f4dd32f-7639-43af-8029-f0875ae9bcee None None] MFA Rules not processed for user `8cd2ad37e9b844ac8b7632fd9291023a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:21.344618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8f4dd32f-7639-43af-8029-f0875ae9bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:21.505281 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1808/3640] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:31.292297 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=27 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:31.484492 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=55 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:42.732306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26d601-9312-4ea4-ad7e-5fba6f38c4c9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:42.732811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26d601-9312-4ea4-ad7e-5fba6f38c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:42.732811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26d601-9312-4ea4-ad7e-5fba6f38c4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:42.760508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5c26d601-9312-4ea4-ad7e-5fba6f38c4c9 None None] MFA Rules not processed for user `66a9d6a142d444be90b2101f23603522`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:42.761826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5c26d601-9312-4ea4-ad7e-5fba6f38c4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:42.927209 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1833/3641] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:43.834032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc84dc-5954-41c4-ae31-3816ccb9cbdf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:43.834773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc84dc-5954-41c4-ae31-3816ccb9cbdf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:43.834773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc84dc-5954-41c4-ae31-3816ccb9cbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:43.872667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-22dc84dc-5954-41c4-ae31-3816ccb9cbdf None None] MFA Rules not processed for user `eb1045d1468b4a2f814930f5ace5c2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:43.874085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-22dc84dc-5954-41c4-ae31-3816ccb9cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:43.991319 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1809/3642] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:44.369537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26d601-9312-4ea4-ad7e-5fba6f38c4c9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:44.383419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26d601-9312-4ea4-ad7e-5fba6f38c4c9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:44.392031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99825d9e-a4b6-40d3-999f-1a877e69a471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:44.394063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825d9e-a4b6-40d3-999f-1a877e69a471 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:44.395924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825d9e-a4b6-40d3-999f-1a877e69a471 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:44.396549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825d9e-a4b6-40d3-999f-1a877e69a471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:44.402994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-99825d9e-a4b6-40d3-999f-1a877e69a471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:44.438448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99825d9e-a4b6-40d3-999f-1a877e69a471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:44.443055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99825d9e-a4b6-40d3-999f-1a877e69a471 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:44.479769 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1834/3643] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:14:52.715827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc84dc-5954-41c4-ae31-3816ccb9cbdf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:52.717760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-22dc84dc-5954-41c4-ae31-3816ccb9cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:52.827651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99825d9e-a4b6-40d3-999f-1a877e69a471 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:52.829339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-99825d9e-a4b6-40d3-999f-1a877e69a471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:52.855878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99825d9e-a4b6-40d3-999f-1a877e69a471 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:52.870343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf39b5-4080-4926-8e44-c5b3dbf8fb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:52.871348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf39b5-4080-4926-8e44-c5b3dbf8fb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:52.871985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf39b5-4080-4926-8e44-c5b3dbf8fb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:52.872281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf39b5-4080-4926-8e44-c5b3dbf8fb1c admin admin] PATH_INFO: `/v3/users/df46881c91e8419e84b8679ad474ba44` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:52.873859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf39b5-4080-4926-8e44-c5b3dbf8fb1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df46881c91e8419e84b8679ad474ba44)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:52.881802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf39b5-4080-4926-8e44-c5b3dbf8fb1c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:52.956123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc84dc-5954-41c4-ae31-3816ccb9cbdf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:52.979070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4391f11-bff7-4c57-a7a1-1d14b36b3051 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:52.979704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4391f11-bff7-4c57-a7a1-1d14b36b3051 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:52.980171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4391f11-bff7-4c57-a7a1-1d14b36b3051 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:52.981158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4391f11-bff7-4c57-a7a1-1d14b36b3051 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:52.984934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f4391f11-bff7-4c57-a7a1-1d14b36b3051 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:53.007926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4391f11-bff7-4c57-a7a1-1d14b36b3051 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:53.010565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4391f11-bff7-4c57-a7a1-1d14b36b3051 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:53.035975 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1810/3644] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:14:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:14:53.039151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eacf39b5-4080-4926-8e44-c5b3dbf8fb1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df46881c91e8419e84b8679ad474ba44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:14:53.070115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eacf39b5-4080-4926-8e44-c5b3dbf8fb1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df46881c91e8419e84b8679ad474ba44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:14:53.071196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eacf39b5-4080-4926-8e44-c5b3dbf8fb1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df46881c91e8419e84b8679ad474ba44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:14:53.084299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eacf39b5-4080-4926-8e44-c5b3dbf8fb1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df46881c91e8419e84b8679ad474ba44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:14:53.085350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-eacf39b5-4080-4926-8e44-c5b3dbf8fb1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df46881c91e8419e84b8679ad474ba44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:14:53.115348 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1835/3645] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:14:52 2022] DELETE /identity/v3/users/df46881c91e8419e84b8679ad474ba44 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:14:53.531974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4391f11-bff7-4c57-a7a1-1d14b36b3051 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:53.561120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4391f11-bff7-4c57-a7a1-1d14b36b3051 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:53.717672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:53.718590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:53.718968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:53.719313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] PATH_INFO: `/v3/projects/2b2d3a5d2c4f4761b3bb73e4967ed345` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:53.720539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b2d3a5d2c4f4761b3bb73e4967ed345)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:53.722557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:53.768387 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:53.779396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'request_id': 'req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:14:53.792423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'request_id': 'req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:14:53.799985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b2d3a5d2c4f4761b3bb73e4967ed345', 'request_id': 'req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:14:53.816172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] The token cache is being invalidate because project 2b2d3a5d2c4f4761b3bb73e4967ed345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:14:53.816926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:14:53.817939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e8cbdbf-4609-4ff1-aa95-4f62673bbb91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:14:53.819652 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1811/3646] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:14:53 2022] DELETE /identity/v3/projects/2b2d3a5d2c4f4761b3bb73e4967ed345 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:14:53.824599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aac89b-6df1-46ba-97a2-059993b8edc1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:53.824886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aac89b-6df1-46ba-97a2-059993b8edc1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:53.825158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aac89b-6df1-46ba-97a2-059993b8edc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:53.845562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b8aac89b-6df1-46ba-97a2-059993b8edc1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:53.846871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b8aac89b-6df1-46ba-97a2-059993b8edc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:53.931330 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1836/3647] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:14:53.939073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b2050-04ff-41e9-8c8d-3ea8bad25fcf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:53.939404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b2050-04ff-41e9-8c8d-3ea8bad25fcf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:53.939633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b2050-04ff-41e9-8c8d-3ea8bad25fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:53.972264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e61b2050-04ff-41e9-8c8d-3ea8bad25fcf None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:53.972264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e61b2050-04ff-41e9-8c8d-3ea8bad25fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:53.982639 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1812/3648] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:14:53.987205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aac89b-6df1-46ba-97a2-059993b8edc1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:53.995988 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:54.002186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aac89b-6df1-46ba-97a2-059993b8edc1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:54.012949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa65644-89c5-4e63-84ce-178276725a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:54.013581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65644-89c5-4e63-84ce-178276725a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:54.013859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65644-89c5-4e63-84ce-178276725a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:54.014133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65644-89c5-4e63-84ce-178276725a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:54.015403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa65644-89c5-4e63-84ce-178276725a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:14:54.017306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa65644-89c5-4e63-84ce-178276725a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:54.022105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa65644-89c5-4e63-84ce-178276725a63 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:54.045536 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1837/3649] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:14:54.050099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b2050-04ff-41e9-8c8d-3ea8bad25fcf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:54.061921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b2050-04ff-41e9-8c8d-3ea8bad25fcf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:54.069892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6333bf-4aa3-49fa-8a2e-f9db02d648cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:54.070479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6333bf-4aa3-49fa-8a2e-f9db02d648cf admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:54.070796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6333bf-4aa3-49fa-8a2e-f9db02d648cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:54.071097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6333bf-4aa3-49fa-8a2e-f9db02d648cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:54.071757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6333bf-4aa3-49fa-8a2e-f9db02d648cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:54.073724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6333bf-4aa3-49fa-8a2e-f9db02d648cf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:54.123270 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1813/3650] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:14:54 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:14:54.124906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa65644-89c5-4e63-84ce-178276725a63 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:54.137324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa65644-89c5-4e63-84ce-178276725a63 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:54.265164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee01fa-6e40-487f-a973-73a80c94ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:54.267062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee01fa-6e40-487f-a973-73a80c94ab3e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:54.267974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee01fa-6e40-487f-a973-73a80c94ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:54.268743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee01fa-6e40-487f-a973-73a80c94ab3e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:54.270192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee01fa-6e40-487f-a973-73a80c94ab3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:54.274288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee01fa-6e40-487f-a973-73a80c94ab3e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:54.322622 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1838/3651] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:14:54 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:14:54.326478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6333bf-4aa3-49fa-8a2e-f9db02d648cf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:54.345703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6333bf-4aa3-49fa-8a2e-f9db02d648cf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:54.352587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab388bd6-6f95-494d-bfe8-f66833dc584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:54.354834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab388bd6-6f95-494d-bfe8-f66833dc584a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:54.355120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab388bd6-6f95-494d-bfe8-f66833dc584a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:54.355396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab388bd6-6f95-494d-bfe8-f66833dc584a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:54.356097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab388bd6-6f95-494d-bfe8-f66833dc584a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:54.357735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab388bd6-6f95-494d-bfe8-f66833dc584a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:54.370232 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1814/3652] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:14:54.374419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee01fa-6e40-487f-a973-73a80c94ab3e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:54.386715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee01fa-6e40-487f-a973-73a80c94ab3e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:54.393352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d685372-fb44-46f1-9029-21293b7e0aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:54.393979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d685372-fb44-46f1-9029-21293b7e0aca admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:54.394260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d685372-fb44-46f1-9029-21293b7e0aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:54.394554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d685372-fb44-46f1-9029-21293b7e0aca admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:54.396613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d685372-fb44-46f1-9029-21293b7e0aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:54.398492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d685372-fb44-46f1-9029-21293b7e0aca admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:54.411653 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1839/3653] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:14:54.415918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab388bd6-6f95-494d-bfe8-f66833dc584a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:54.428018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab388bd6-6f95-494d-bfe8-f66833dc584a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:54.432744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598be4a-5472-407b-a4ea-a15f0b73901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:54.433409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598be4a-5472-407b-a4ea-a15f0b73901c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:54.433687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598be4a-5472-407b-a4ea-a15f0b73901c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:54.433969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598be4a-5472-407b-a4ea-a15f0b73901c admin admin] PATH_INFO: `/v3/projects/e44feebec98b4cd49f7a80597f47be35/users/5104bda5de774e93bd494d64a8f11faf/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:54.450764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598be4a-5472-407b-a4ea-a15f0b73901c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44feebec98b4cd49f7a80597f47be35, user_id=5104bda5de774e93bd494d64a8f11faf, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:54.454677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598be4a-5472-407b-a4ea-a15f0b73901c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:54.473794 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1815/3654] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:14:54 2022] PUT /identity/v3/projects/e44feebec98b4cd49f7a80597f47be35/users/5104bda5de774e93bd494d64a8f11faf/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:14:54.478758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc10a-7441-443b-a599-99102484a1ed None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:54.479136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc10a-7441-443b-a599-99102484a1ed None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:54.479418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc10a-7441-443b-a599-99102484a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:54.500409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-60dcc10a-7441-443b-a599-99102484a1ed None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:14:54.501072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-60dcc10a-7441-443b-a599-99102484a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:54.583727 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1840/3655] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:14:54.603646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598be4a-5472-407b-a4ea-a15f0b73901c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:14:54.606366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e598be4a-5472-407b-a4ea-a15f0b73901c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:14:54.687703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598be4a-5472-407b-a4ea-a15f0b73901c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:14:54.692572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ed044-4b06-42cc-9e1d-053f10cb1099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:14:54.693389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ed044-4b06-42cc-9e1d-053f10cb1099 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:14:54.693673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ed044-4b06-42cc-9e1d-053f10cb1099 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:14:54.693959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ed044-4b06-42cc-9e1d-053f10cb1099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:14:54.705188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ed044-4b06-42cc-9e1d-053f10cb1099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:14:54.707866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ed044-4b06-42cc-9e1d-053f10cb1099 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:14:54.721545 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1816/3656] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:15:00.607650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b47f2-4f04-42b5-a246-267ec5d48d66 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:00.608761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b47f2-4f04-42b5-a246-267ec5d48d66 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:00.609131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b47f2-4f04-42b5-a246-267ec5d48d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:00.636746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f43b47f2-4f04-42b5-a246-267ec5d48d66 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:00.638332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f43b47f2-4f04-42b5-a246-267ec5d48d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:00.712655 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1841/3657] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:15:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:00.730273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ed044-4b06-42cc-9e1d-053f10cb1099 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:00.732276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-791ed044-4b06-42cc-9e1d-053f10cb1099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:00.854987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ed044-4b06-42cc-9e1d-053f10cb1099 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:00.872290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a88d0-241e-4e61-a7af-e0a225bbfa2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:00.873505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a88d0-241e-4e61-a7af-e0a225bbfa2f service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:00.873951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a88d0-241e-4e61-a7af-e0a225bbfa2f service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:00.874509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a88d0-241e-4e61-a7af-e0a225bbfa2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:00.881897 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:00.891491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a88d0-241e-4e61-a7af-e0a225bbfa2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:00.893734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a88d0-241e-4e61-a7af-e0a225bbfa2f service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:00.905081 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1817/3658] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:15:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:05.360899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e379ca-d17d-4783-9aa0-ef218f2bc0a7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:05.361374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e379ca-d17d-4783-9aa0-ef218f2bc0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:05.361658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e379ca-d17d-4783-9aa0-ef218f2bc0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:05.440585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f7e379ca-d17d-4783-9aa0-ef218f2bc0a7 None None] MFA Rules not processed for user `5104bda5de774e93bd494d64a8f11faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:05.443913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f7e379ca-d17d-4783-9aa0-ef218f2bc0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:05.450969 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:05.565921 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1842/3659] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:05.579893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed39f-e4fb-4606-8b11-c5f989df5fa5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:05.580377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed39f-e4fb-4606-8b11-c5f989df5fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:05.580506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed39f-e4fb-4606-8b11-c5f989df5fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:05.609491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-60eed39f-e4fb-4606-8b11-c5f989df5fa5 None None] MFA Rules not processed for user `5104bda5de774e93bd494d64a8f11faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:05.610781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-60eed39f-e4fb-4606-8b11-c5f989df5fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:05.623740 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1818/3660] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:06.602702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e379ca-d17d-4783-9aa0-ef218f2bc0a7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:06.604028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f7e379ca-d17d-4783-9aa0-ef218f2bc0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:06.723721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e379ca-d17d-4783-9aa0-ef218f2bc0a7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:06.736535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77f42a-e846-4555-bd0c-a50a8c66f893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:06.737235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77f42a-e846-4555-bd0c-a50a8c66f893 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:06.737614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77f42a-e846-4555-bd0c-a50a8c66f893 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:06.737992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77f42a-e846-4555-bd0c-a50a8c66f893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:06.748064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77f42a-e846-4555-bd0c-a50a8c66f893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:06.750057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77f42a-e846-4555-bd0c-a50a8c66f893 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:06.762970 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1843/3661] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:15:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:15:15.603471 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:16.758140 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=59 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:16.908254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed39f-e4fb-4606-8b11-c5f989df5fa5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:16.909665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-60eed39f-e4fb-4606-8b11-c5f989df5fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:17.136849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed39f-e4fb-4606-8b11-c5f989df5fa5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:17.170121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32428-ded3-44f3-be32-df1202252a39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:17.172635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32428-ded3-44f3-be32-df1202252a39 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:17.172912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32428-ded3-44f3-be32-df1202252a39 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:17.173187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32428-ded3-44f3-be32-df1202252a39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:17.178299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4fd32428-ded3-44f3-be32-df1202252a39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:17.215395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd32428-ded3-44f3-be32-df1202252a39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:17.217133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd32428-ded3-44f3-be32-df1202252a39 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:17.240687 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1819/3662] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:15:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:15:18.590581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0b26-c694-4c03-b0fd-cfb273ccc8c3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:18.591496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0b26-c694-4c03-b0fd-cfb273ccc8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:18.591959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0b26-c694-4c03-b0fd-cfb273ccc8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:18.631054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e9cf0b26-c694-4c03-b0fd-cfb273ccc8c3 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:18.633566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e9cf0b26-c694-4c03-b0fd-cfb273ccc8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:18.647897 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1844/3663] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:18.666217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32428-ded3-44f3-be32-df1202252a39 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:18.683444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32428-ded3-44f3-be32-df1202252a39 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:18.690094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b12433-0cdd-4efc-9885-f615b4a1a076 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:18.692157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12433-0cdd-4efc-9885-f615b4a1a076 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:18.692647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12433-0cdd-4efc-9885-f615b4a1a076 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:18.693146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12433-0cdd-4efc-9885-f615b4a1a076 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:18.730436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b12433-0cdd-4efc-9885-f615b4a1a076 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:18.742476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b12433-0cdd-4efc-9885-f615b4a1a076 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:18.768829 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1820/3664] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:15:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:15:19.532919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf0b26-c694-4c03-b0fd-cfb273ccc8c3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:19.554950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf0b26-c694-4c03-b0fd-cfb273ccc8c3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:19.566282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739f8d8-6041-4d31-bd28-2a7cc16d35b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:19.566956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739f8d8-6041-4d31-bd28-2a7cc16d35b6 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:19.567242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739f8d8-6041-4d31-bd28-2a7cc16d35b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:19.567507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739f8d8-6041-4d31-bd28-2a7cc16d35b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:19.573219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0739f8d8-6041-4d31-bd28-2a7cc16d35b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:19.719316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739f8d8-6041-4d31-bd28-2a7cc16d35b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:19.722063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739f8d8-6041-4d31-bd28-2a7cc16d35b6 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:19.737254 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1845/3665] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:15:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:15:20.308718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f456ab2-2aec-4e46-9e9a-d9fcc3ae65d8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:20.309256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f456ab2-2aec-4e46-9e9a-d9fcc3ae65d8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:20.309357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f456ab2-2aec-4e46-9e9a-d9fcc3ae65d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:20.351411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8f456ab2-2aec-4e46-9e9a-d9fcc3ae65d8 None None] MFA Rules not processed for user `8cd2ad37e9b844ac8b7632fd9291023a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:20.352753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8f456ab2-2aec-4e46-9e9a-d9fcc3ae65d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:20.475997 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1821/3666] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:20.632010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a263a2-554d-4980-afa8-4aff019ef138 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:20.632374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a263a2-554d-4980-afa8-4aff019ef138 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:20.632744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a263a2-554d-4980-afa8-4aff019ef138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:20.653659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-69a263a2-554d-4980-afa8-4aff019ef138 None None] MFA Rules not processed for user `852e8ab225d64f40a4dc9ce54fe509fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:20.655291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-69a263a2-554d-4980-afa8-4aff019ef138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:20.745857 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1846/3667] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:24.666741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9cb4d-4a5b-4f21-b700-656e438fa9af None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:24.667258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9cb4d-4a5b-4f21-b700-656e438fa9af None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:24.667258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9cb4d-4a5b-4f21-b700-656e438fa9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:24.703257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c6d9cb4d-4a5b-4f21-b700-656e438fa9af None None] MFA Rules not processed for user `eb1045d1468b4a2f814930f5ace5c2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:24.704972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c6d9cb4d-4a5b-4f21-b700-656e438fa9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:24.905637 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1822/3668] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:26.625295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a263a2-554d-4980-afa8-4aff019ef138 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:26.627635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-69a263a2-554d-4980-afa8-4aff019ef138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:26.642264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a263a2-554d-4980-afa8-4aff019ef138 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:26.647407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e9aaf-ae53-4587-969e-7be822f7c796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:26.648354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e9aaf-ae53-4587-969e-7be822f7c796 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:26.648795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e9aaf-ae53-4587-969e-7be822f7c796 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:26.649239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e9aaf-ae53-4587-969e-7be822f7c796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:26.651442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a43e9aaf-ae53-4587-969e-7be822f7c796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:26.680021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e9aaf-ae53-4587-969e-7be822f7c796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:26.682543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e9aaf-ae53-4587-969e-7be822f7c796 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:26.702849 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1847/3669] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:15:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:15:29.525834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9cb4d-4a5b-4f21-b700-656e438fa9af None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:29.541234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9cb4d-4a5b-4f21-b700-656e438fa9af None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:29.546274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6f0c0-53a3-4daf-9056-72522f8841e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:29.546937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6f0c0-53a3-4daf-9056-72522f8841e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:29.547223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6f0c0-53a3-4daf-9056-72522f8841e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:29.547684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6f0c0-53a3-4daf-9056-72522f8841e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:29.549704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ecd6f0c0-53a3-4daf-9056-72522f8841e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:29.571267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6f0c0-53a3-4daf-9056-72522f8841e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:29.573187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6f0c0-53a3-4daf-9056-72522f8841e6 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:29.588718 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1823/3670] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:15:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:15:34.425118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e9aaf-ae53-4587-969e-7be822f7c796 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:34.427950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a43e9aaf-ae53-4587-969e-7be822f7c796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:34.453836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e9aaf-ae53-4587-969e-7be822f7c796 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:34.476641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220202-57aa-4f6c-9027-30be170e1a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:34.481032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220202-57aa-4f6c-9027-30be170e1a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:34.481597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220202-57aa-4f6c-9027-30be170e1a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:34.482732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220202-57aa-4f6c-9027-30be170e1a9e admin admin] PATH_INFO: `/v3/users/1e5ba26f19334afa95c2df9b1655626e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:34.488032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da220202-57aa-4f6c-9027-30be170e1a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5ba26f19334afa95c2df9b1655626e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:34.491346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da220202-57aa-4f6c-9027-30be170e1a9e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:34.576687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-da220202-57aa-4f6c-9027-30be170e1a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5ba26f19334afa95c2df9b1655626e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:34.602411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-da220202-57aa-4f6c-9027-30be170e1a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5ba26f19334afa95c2df9b1655626e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:34.603477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-da220202-57aa-4f6c-9027-30be170e1a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5ba26f19334afa95c2df9b1655626e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:34.616602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-da220202-57aa-4f6c-9027-30be170e1a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5ba26f19334afa95c2df9b1655626e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:34.618207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-da220202-57aa-4f6c-9027-30be170e1a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5ba26f19334afa95c2df9b1655626e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:34.628676 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:34.647129 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1848/3671] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:15:34 2022] DELETE /identity/v3/users/1e5ba26f19334afa95c2df9b1655626e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:15:35.102057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6f0c0-53a3-4daf-9056-72522f8841e6 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:35.128208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6f0c0-53a3-4daf-9056-72522f8841e6 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:35.138562 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:35.205284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:35.206682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:35.207128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:35.208866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] PATH_INFO: `/v3/projects/e3f2bd52c8d347679396891f8f163197` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:35.211038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f2bd52c8d347679396891f8f163197)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:35.213004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:35.271160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f2bd52c8d347679396891f8f163197', 'request_id': 'req-124ed566-10f5-4e1a-b609-752066ba7b76'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:35.277758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f2bd52c8d347679396891f8f163197', 'request_id': 'req-124ed566-10f5-4e1a-b609-752066ba7b76'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:35.284673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f2bd52c8d347679396891f8f163197', 'request_id': 'req-124ed566-10f5-4e1a-b609-752066ba7b76'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:35.298536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] The token cache is being invalidate because project e3f2bd52c8d347679396891f8f163197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:15:35.298936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:35.299639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-124ed566-10f5-4e1a-b609-752066ba7b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:35.302446 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1824/3672] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:35 2022] DELETE /identity/v3/projects/e3f2bd52c8d347679396891f8f163197 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:15:35.306994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72210-b012-4704-875c-cc66e54f6404 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:35.307512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72210-b012-4704-875c-cc66e54f6404 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:35.307787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72210-b012-4704-875c-cc66e54f6404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:35.329157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-90d72210-b012-4704-875c-cc66e54f6404 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:35.330323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-90d72210-b012-4704-875c-cc66e54f6404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:35.405496 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1849/3673] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:35.415193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccad7e-bc4b-47ea-b253-0b7068cbe909 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:35.415518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccad7e-bc4b-47ea-b253-0b7068cbe909 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:35.416032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccad7e-bc4b-47ea-b253-0b7068cbe909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:35.440907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c7ccad7e-bc4b-47ea-b253-0b7068cbe909 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:35.443150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7ccad7e-bc4b-47ea-b253-0b7068cbe909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:35.453537 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1825/3674] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:35.457872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72210-b012-4704-875c-cc66e54f6404 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:35.473339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72210-b012-4704-875c-cc66e54f6404 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:35.478803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9326313-0ba0-4e37-8596-fb4c6e5a8e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:35.479452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9326313-0ba0-4e37-8596-fb4c6e5a8e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:35.479718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9326313-0ba0-4e37-8596-fb4c6e5a8e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:35.480202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9326313-0ba0-4e37-8596-fb4c6e5a8e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:35.480898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9326313-0ba0-4e37-8596-fb4c6e5a8e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:15:35.481205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9326313-0ba0-4e37-8596-fb4c6e5a8e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:35.482868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9326313-0ba0-4e37-8596-fb4c6e5a8e59 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:35.500810 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1850/3675] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:15:35.502570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccad7e-bc4b-47ea-b253-0b7068cbe909 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:35.513556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccad7e-bc4b-47ea-b253-0b7068cbe909 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:35.532108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d552c-cefb-4c4f-9c58-b9ef35fde9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:35.533911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d552c-cefb-4c4f-9c58-b9ef35fde9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:35.534269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d552c-cefb-4c4f-9c58-b9ef35fde9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:35.534867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d552c-cefb-4c4f-9c58-b9ef35fde9b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:35.535362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d552c-cefb-4c4f-9c58-b9ef35fde9b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:35.537942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d552c-cefb-4c4f-9c58-b9ef35fde9b8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:35.583914 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1826/3676] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:15:35 2022] POST /identity/v3/projects => generated 403 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:15:35.584140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9326313-0ba0-4e37-8596-fb4c6e5a8e59 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:35.597877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9326313-0ba0-4e37-8596-fb4c6e5a8e59 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:35.672090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f35c0-07a9-4893-8eaa-903257712a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:35.673026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f35c0-07a9-4893-8eaa-903257712a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:35.673523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f35c0-07a9-4893-8eaa-903257712a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:35.673982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f35c0-07a9-4893-8eaa-903257712a97 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:35.675000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f35c0-07a9-4893-8eaa-903257712a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:35.677749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f35c0-07a9-4893-8eaa-903257712a97 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:35.725946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d552c-cefb-4c4f-9c58-b9ef35fde9b8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:35.735554 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1851/3677] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:15:35 2022] POST /identity/v3/users => generated 302 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:15:35.747041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d552c-cefb-4c4f-9c58-b9ef35fde9b8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:35.756773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc77606-125b-4188-ae51-33fd8d28bf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:35.757805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc77606-125b-4188-ae51-33fd8d28bf1c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:35.758295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc77606-125b-4188-ae51-33fd8d28bf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:35.758985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc77606-125b-4188-ae51-33fd8d28bf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:35.759975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc77606-125b-4188-ae51-33fd8d28bf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:35.762979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc77606-125b-4188-ae51-33fd8d28bf1c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:35.786049 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1827/3678] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:15:35.788243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f35c0-07a9-4893-8eaa-903257712a97 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:35.834290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f35c0-07a9-4893-8eaa-903257712a97 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:35.860519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c12bf7-a37a-4fb7-b1b4-ecc5e30ff837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:35.861512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c12bf7-a37a-4fb7-b1b4-ecc5e30ff837 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:35.861968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c12bf7-a37a-4fb7-b1b4-ecc5e30ff837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:35.862419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c12bf7-a37a-4fb7-b1b4-ecc5e30ff837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:35.863515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c12bf7-a37a-4fb7-b1b4-ecc5e30ff837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:35.876609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c12bf7-a37a-4fb7-b1b4-ecc5e30ff837 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:35.916666 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1852/3679] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:15:35.924320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc77606-125b-4188-ae51-33fd8d28bf1c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:35.953567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc77606-125b-4188-ae51-33fd8d28bf1c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:35.962811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cfa3f-cd2e-4efc-aa01-1ef329811b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:35.963492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cfa3f-cd2e-4efc-aa01-1ef329811b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:35.963771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cfa3f-cd2e-4efc-aa01-1ef329811b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:35.964045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cfa3f-cd2e-4efc-aa01-1ef329811b50 admin admin] PATH_INFO: `/v3/projects/3f2e0151157f4c0481260e9f8cd58d5e/users/5054b2caf1774655a579aae5db2f1ff9/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:35.993492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cfa3f-cd2e-4efc-aa01-1ef329811b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2e0151157f4c0481260e9f8cd58d5e, user_id=5054b2caf1774655a579aae5db2f1ff9, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:35.996415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cfa3f-cd2e-4efc-aa01-1ef329811b50 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:36.020958 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1828/3680] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:15:35 2022] PUT /identity/v3/projects/3f2e0151157f4c0481260e9f8cd58d5e/users/5054b2caf1774655a579aae5db2f1ff9/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:15:36.026919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da096b-fa87-402d-8876-90eea542080f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:36.027430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da096b-fa87-402d-8876-90eea542080f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:36.028074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da096b-fa87-402d-8876-90eea542080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:36.050958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c5da096b-fa87-402d-8876-90eea542080f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:36.052258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c5da096b-fa87-402d-8876-90eea542080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:36.124690 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1853/3681] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:36.132203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cfa3f-cd2e-4efc-aa01-1ef329811b50 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:36.135865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-778cfa3f-cd2e-4efc-aa01-1ef329811b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:36.190220 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:36.208404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cfa3f-cd2e-4efc-aa01-1ef329811b50 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:36.213692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec12e6-7854-4b5c-930e-a2f85fc33847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:36.214578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec12e6-7854-4b5c-930e-a2f85fc33847 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:36.215144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec12e6-7854-4b5c-930e-a2f85fc33847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:36.216255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec12e6-7854-4b5c-930e-a2f85fc33847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:36.231021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec12e6-7854-4b5c-930e-a2f85fc33847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:36.233578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec12e6-7854-4b5c-930e-a2f85fc33847 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:36.249320 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1829/3682] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:15:36.550777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df509af4-fe24-423e-a8f7-67ccd42333a1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:36.552322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df509af4-fe24-423e-a8f7-67ccd42333a1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:36.552817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df509af4-fe24-423e-a8f7-67ccd42333a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:36.565207 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:36.598350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-df509af4-fe24-423e-a8f7-67ccd42333a1 None None] MFA Rules not processed for user `7f2fd89c34d84d77b2c0ad9d5ad45390`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:36.600843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-df509af4-fe24-423e-a8f7-67ccd42333a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:36.738416 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1854/3683] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:42.321828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ceede3-7c88-4f77-9d62-7b484752aae3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:42.322298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ceede3-7c88-4f77-9d62-7b484752aae3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:42.322383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ceede3-7c88-4f77-9d62-7b484752aae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:42.344301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c6ceede3-7c88-4f77-9d62-7b484752aae3 None None] MFA Rules not processed for user `5104bda5de774e93bd494d64a8f11faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:42.345519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c6ceede3-7c88-4f77-9d62-7b484752aae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:42.412229 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1830/3684] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:45.625496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df509af4-fe24-423e-a8f7-67ccd42333a1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:45.627470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-df509af4-fe24-423e-a8f7-67ccd42333a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:45.732352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df509af4-fe24-423e-a8f7-67ccd42333a1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:45.739149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb1a29-87d1-44f7-9d1c-7e8d9340a367 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:45.740792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1a29-87d1-44f7-9d1c-7e8d9340a367 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:45.741385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1a29-87d1-44f7-9d1c-7e8d9340a367 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:45.742033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1a29-87d1-44f7-9d1c-7e8d9340a367 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:45.745819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1ebb1a29-87d1-44f7-9d1c-7e8d9340a367 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:45.765586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb1a29-87d1-44f7-9d1c-7e8d9340a367 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:45.767315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb1a29-87d1-44f7-9d1c-7e8d9340a367 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:45.783812 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1855/3685] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:15:46.544081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ce91-3994-4152-9f06-78e5440bff51 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:46.544636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ce91-3994-4152-9f06-78e5440bff51 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:46.544636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ce91-3994-4152-9f06-78e5440bff51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:46.579425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-71a9ce91-3994-4152-9f06-78e5440bff51 None None] MFA Rules not processed for user `5104bda5de774e93bd494d64a8f11faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:46.581066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-71a9ce91-3994-4152-9f06-78e5440bff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:46.593687 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1831/3686] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:49.218412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5661413-8aee-4574-9e2f-b4069b56abd7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:49.218938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5661413-8aee-4574-9e2f-b4069b56abd7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:49.219064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5661413-8aee-4574-9e2f-b4069b56abd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:49.249464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c5661413-8aee-4574-9e2f-b4069b56abd7 None None] MFA Rules not processed for user `5054b2caf1774655a579aae5db2f1ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:49.250821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c5661413-8aee-4574-9e2f-b4069b56abd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:49.332635 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1856/3687] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:49.900736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9ce91-3994-4152-9f06-78e5440bff51 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:49.903412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-71a9ce91-3994-4152-9f06-78e5440bff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:50.083900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9ce91-3994-4152-9f06-78e5440bff51 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:50.097914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b3973-2335-45db-b576-b5e63ed3e999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:50.099933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b3973-2335-45db-b576-b5e63ed3e999 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:50.100427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b3973-2335-45db-b576-b5e63ed3e999 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:50.100950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b3973-2335-45db-b576-b5e63ed3e999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:50.112973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b3973-2335-45db-b576-b5e63ed3e999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:50.116277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b3973-2335-45db-b576-b5e63ed3e999 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:50.128051 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1832/3688] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:15:49 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:15:54.276441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5661413-8aee-4574-9e2f-b4069b56abd7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:54.278514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c5661413-8aee-4574-9e2f-b4069b56abd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:54.298513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5661413-8aee-4574-9e2f-b4069b56abd7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:54.305954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde472f4-c299-40ac-a4c4-dad3c0df860d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:54.306840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde472f4-c299-40ac-a4c4-dad3c0df860d service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:54.307321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde472f4-c299-40ac-a4c4-dad3c0df860d service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:54.307851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde472f4-c299-40ac-a4c4-dad3c0df860d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:54.311691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cde472f4-c299-40ac-a4c4-dad3c0df860d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:54.362529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde472f4-c299-40ac-a4c4-dad3c0df860d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:54.364023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde472f4-c299-40ac-a4c4-dad3c0df860d service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:54.383220 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1857/3689] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:15:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:15:57.084804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b3973-2335-45db-b576-b5e63ed3e999 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:57.103899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b3973-2335-45db-b576-b5e63ed3e999 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:57.118838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f71190-02df-4f5a-898e-baea746e9fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:57.118838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f71190-02df-4f5a-898e-baea746e9fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:57.118838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f71190-02df-4f5a-898e-baea746e9fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:57.118838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f71190-02df-4f5a-898e-baea746e9fec admin admin] PATH_INFO: `/v3/users/5054b2caf1774655a579aae5db2f1ff9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:57.119308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f71190-02df-4f5a-898e-baea746e9fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=5054b2caf1774655a579aae5db2f1ff9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:57.119308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f71190-02df-4f5a-898e-baea746e9fec admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:57.237727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-36f71190-02df-4f5a-898e-baea746e9fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5054b2caf1774655a579aae5db2f1ff9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:57.269818 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:57.278582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-36f71190-02df-4f5a-898e-baea746e9fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5054b2caf1774655a579aae5db2f1ff9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:57.279900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-36f71190-02df-4f5a-898e-baea746e9fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5054b2caf1774655a579aae5db2f1ff9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:57.301151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-36f71190-02df-4f5a-898e-baea746e9fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5054b2caf1774655a579aae5db2f1ff9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:57.319826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-36f71190-02df-4f5a-898e-baea746e9fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5054b2caf1774655a579aae5db2f1ff9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:57.337119 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1833/3690] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:15:57 2022] DELETE /identity/v3/users/5054b2caf1774655a579aae5db2f1ff9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:15:57.835206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde472f4-c299-40ac-a4c4-dad3c0df860d service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:57.850723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde472f4-c299-40ac-a4c4-dad3c0df860d service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:57.861828 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:57.931835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:57.932784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:57.933273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:57.933756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] PATH_INFO: `/v3/projects/3f2e0151157f4c0481260e9f8cd58d5e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:57.935149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2e0151157f4c0481260e9f8cd58d5e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:57.937532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:58.085817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2e0151157f4c0481260e9f8cd58d5e', 'request_id': 'req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:58.101421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2e0151157f4c0481260e9f8cd58d5e', 'request_id': 'req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:58.117172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2e0151157f4c0481260e9f8cd58d5e', 'request_id': 'req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:58.142232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] The token cache is being invalidate because project 3f2e0151157f4c0481260e9f8cd58d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:15:58.142525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:58.143522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-74f41ee1-5d49-4eba-bfc7-dab1412e95cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:15:58.145329 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1858/3691] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:15:57 2022] DELETE /identity/v3/projects/3f2e0151157f4c0481260e9f8cd58d5e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:15:58.151307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b9038-f1d7-4fc6-abd2-7fd0985236fe None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:58.151841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b9038-f1d7-4fc6-abd2-7fd0985236fe None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:58.151841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b9038-f1d7-4fc6-abd2-7fd0985236fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:58.175219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3a0b9038-f1d7-4fc6-abd2-7fd0985236fe None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:58.176450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a0b9038-f1d7-4fc6-abd2-7fd0985236fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:58.278683 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1834/3692] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:58.279620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849613-d30f-4368-8d34-828689472914 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:58.280886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849613-d30f-4368-8d34-828689472914 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:58.281005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849613-d30f-4368-8d34-828689472914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:58.334776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-90849613-d30f-4368-8d34-828689472914 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:58.339547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-90849613-d30f-4368-8d34-828689472914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:58.367164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b9038-f1d7-4fc6-abd2-7fd0985236fe None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:58.379328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b9038-f1d7-4fc6-abd2-7fd0985236fe None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:58.383051 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1859/3693] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:15:58.391578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b854c3-7e47-4d0c-a1a0-6c579d7fd4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:58.392790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b854c3-7e47-4d0c-a1a0-6c579d7fd4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:58.397337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b854c3-7e47-4d0c-a1a0-6c579d7fd4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:58.397754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b854c3-7e47-4d0c-a1a0-6c579d7fd4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:58.398715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b854c3-7e47-4d0c-a1a0-6c579d7fd4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:15:58.399282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b854c3-7e47-4d0c-a1a0-6c579d7fd4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:58.401183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b854c3-7e47-4d0c-a1a0-6c579d7fd4d6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:58.418632 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1835/3694] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:15:58.431327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90849613-d30f-4368-8d34-828689472914 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:58.453579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90849613-d30f-4368-8d34-828689472914 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:58.466465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed754ef-c96b-4922-9b43-4cfc5b550e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:58.467715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed754ef-c96b-4922-9b43-4cfc5b550e9b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:58.467715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed754ef-c96b-4922-9b43-4cfc5b550e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:58.467715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed754ef-c96b-4922-9b43-4cfc5b550e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:58.469471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed754ef-c96b-4922-9b43-4cfc5b550e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:58.472284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed754ef-c96b-4922-9b43-4cfc5b550e9b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:58.511848 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1860/3695] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:15:58 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:15:58.520265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b854c3-7e47-4d0c-a1a0-6c579d7fd4d6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:58.553406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b854c3-7e47-4d0c-a1a0-6c579d7fd4d6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:58.681208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c7a01-9300-4b36-a8d4-e81bac9f1edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:58.681925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c7a01-9300-4b36-a8d4-e81bac9f1edc admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:58.682276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c7a01-9300-4b36-a8d4-e81bac9f1edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:58.682796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c7a01-9300-4b36-a8d4-e81bac9f1edc admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:58.683550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c7a01-9300-4b36-a8d4-e81bac9f1edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:58.685850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c7a01-9300-4b36-a8d4-e81bac9f1edc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:58.725841 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1836/3696] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:15:58 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:15:58.730165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed754ef-c96b-4922-9b43-4cfc5b550e9b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:58.746917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed754ef-c96b-4922-9b43-4cfc5b550e9b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:58.752074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2704f-5396-4207-8865-18781a1751dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:58.752691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2704f-5396-4207-8865-18781a1751dc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:58.752972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2704f-5396-4207-8865-18781a1751dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:58.753288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2704f-5396-4207-8865-18781a1751dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:58.754253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2704f-5396-4207-8865-18781a1751dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:58.756745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2704f-5396-4207-8865-18781a1751dc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:58.782317 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1861/3697] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:15:58.787262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c7a01-9300-4b36-a8d4-e81bac9f1edc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:58.799108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c7a01-9300-4b36-a8d4-e81bac9f1edc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:58.805219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1612f-9b56-4fe3-bef5-d073996c0155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:58.806246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1612f-9b56-4fe3-bef5-d073996c0155 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:58.806526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1612f-9b56-4fe3-bef5-d073996c0155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:58.806839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1612f-9b56-4fe3-bef5-d073996c0155 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:58.807654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1612f-9b56-4fe3-bef5-d073996c0155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:58.809311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1612f-9b56-4fe3-bef5-d073996c0155 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:58.826526 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1837/3698] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:15:58.827213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2704f-5396-4207-8865-18781a1751dc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:58.848345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2704f-5396-4207-8865-18781a1751dc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:58.853474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e25a11-918f-4b8a-b6c7-0002a2e693fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:58.854150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25a11-918f-4b8a-b6c7-0002a2e693fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:58.854489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25a11-918f-4b8a-b6c7-0002a2e693fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:58.855005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25a11-918f-4b8a-b6c7-0002a2e693fe admin admin] PATH_INFO: `/v3/projects/087deeb5d16442abaf8639044c1b1a46/users/565b532318284915b742bf70ff2cb226/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:58.874279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e25a11-918f-4b8a-b6c7-0002a2e693fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=087deeb5d16442abaf8639044c1b1a46, user_id=565b532318284915b742bf70ff2cb226, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:58.877270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e25a11-918f-4b8a-b6c7-0002a2e693fe admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:58.892060 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1862/3699] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:15:58 2022] PUT /identity/v3/projects/087deeb5d16442abaf8639044c1b1a46/users/565b532318284915b742bf70ff2cb226/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:15:58.897780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838a310-b42d-4b7f-b0ca-5b0365ae6d17 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:58.898137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838a310-b42d-4b7f-b0ca-5b0365ae6d17 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:58.898508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838a310-b42d-4b7f-b0ca-5b0365ae6d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:58.920616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1838a310-b42d-4b7f-b0ca-5b0365ae6d17 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:15:58.921908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1838a310-b42d-4b7f-b0ca-5b0365ae6d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:58.973119 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:58.995230 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1838/3700] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:15:59.005319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e25a11-918f-4b8a-b6c7-0002a2e693fe admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:15:59.007635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-41e25a11-918f-4b8a-b6c7-0002a2e693fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:15:59.056896 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:59.072390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e25a11-918f-4b8a-b6c7-0002a2e693fe admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:15:59.076114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83424-8fc4-4a46-8e32-d27b6ea8141a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:15:59.076722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83424-8fc4-4a46-8e32-d27b6ea8141a service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:15:59.077003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83424-8fc4-4a46-8e32-d27b6ea8141a service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:15:59.077277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83424-8fc4-4a46-8e32-d27b6ea8141a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:15:59.087985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e83424-8fc4-4a46-8e32-d27b6ea8141a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:15:59.089585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e83424-8fc4-4a46-8e32-d27b6ea8141a service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:15:59.100385 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1863/3701] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:06.875995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838a310-b42d-4b7f-b0ca-5b0365ae6d17 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:06.877534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1838a310-b42d-4b7f-b0ca-5b0365ae6d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:07.087467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838a310-b42d-4b7f-b0ca-5b0365ae6d17 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:07.100260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a597b3b-9236-4cf4-a777-c793b831cbee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:07.103058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597b3b-9236-4cf4-a777-c793b831cbee service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:07.103430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597b3b-9236-4cf4-a777-c793b831cbee service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:07.104185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597b3b-9236-4cf4-a777-c793b831cbee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:07.108089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1a597b3b-9236-4cf4-a777-c793b831cbee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:07.130364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a597b3b-9236-4cf4-a777-c793b831cbee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:07.133149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a597b3b-9236-4cf4-a777-c793b831cbee service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:07.172384 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1839/3702] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:08.263696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83424-8fc4-4a46-8e32-d27b6ea8141a service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:08.265282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a6e83424-8fc4-4a46-8e32-d27b6ea8141a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:08.289115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83424-8fc4-4a46-8e32-d27b6ea8141a service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:08.294270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:08.295502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:08.296236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:08.296725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] PATH_INFO: `/v3/users/eb1045d1468b4a2f814930f5ace5c2ef` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:08.298245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1045d1468b4a2f814930f5ace5c2ef)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:08.301987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:08.449195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1045d1468b4a2f814930f5ace5c2ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:08.473947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1045d1468b4a2f814930f5ace5c2ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:08.474854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1045d1468b4a2f814930f5ace5c2ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:08.485746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1045d1468b4a2f814930f5ace5c2ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:08.486882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1045d1468b4a2f814930f5ace5c2ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:08.503870 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1864/3703] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:16:08 2022] DELETE /identity/v3/users/eb1045d1468b4a2f814930f5ace5c2ef => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:16:08.799742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37280e4e-7a74-4374-901f-c1ebc361db7c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:08.800701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37280e4e-7a74-4374-901f-c1ebc361db7c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:08.801331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37280e4e-7a74-4374-901f-c1ebc361db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:08.855904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-37280e4e-7a74-4374-901f-c1ebc361db7c None None] MFA Rules not processed for user `565b532318284915b742bf70ff2cb226`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:08.857189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37280e4e-7a74-4374-901f-c1ebc361db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:08.917329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:08.919116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:09.030973 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1840/3704] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:09.042995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d9d65-a8f9-43ff-97e6-148ded12f716 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:09.043390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d9d65-a8f9-43ff-97e6-148ded12f716 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:09.043687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d9d65-a8f9-43ff-97e6-148ded12f716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:09.079657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b8b43-f151-4a91-a24a-fbea4630cd74 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:09.087857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d84d9d65-a8f9-43ff-97e6-148ded12f716 None None] MFA Rules not processed for user `565b532318284915b742bf70ff2cb226`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:09.089125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d84d9d65-a8f9-43ff-97e6-148ded12f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:09.093767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:09.094524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:09.094832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:09.095112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] PATH_INFO: `/v3/projects/4ac1963b4bf54123b0483de45b6617ea` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:09.096511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac1963b4bf54123b0483de45b6617ea)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:09.098638 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1841/3705] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:16:09.098786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:09.110201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d9d65-a8f9-43ff-97e6-148ded12f716 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:09.111704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d84d9d65-a8f9-43ff-97e6-148ded12f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:09.227286 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:09.252855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac1963b4bf54123b0483de45b6617ea', 'request_id': 'req-7c98ae25-48fa-4731-a09d-bbe26e450de2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:09.269354 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:09.271924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d9d65-a8f9-43ff-97e6-148ded12f716 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:09.273709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac1963b4bf54123b0483de45b6617ea', 'request_id': 'req-7c98ae25-48fa-4731-a09d-bbe26e450de2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:09.294727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac1963b4bf54123b0483de45b6617ea', 'request_id': 'req-7c98ae25-48fa-4731-a09d-bbe26e450de2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:09.320983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] The token cache is being invalidate because project 4ac1963b4bf54123b0483de45b6617ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:16:09.322958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:09.323971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c98ae25-48fa-4731-a09d-bbe26e450de2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:09.330563 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1865/3706] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:16:08 2022] DELETE /identity/v3/projects/4ac1963b4bf54123b0483de45b6617ea => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:09.336675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece178b6-00e1-4740-a75c-ba9303cf8141 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:09.337527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece178b6-00e1-4740-a75c-ba9303cf8141 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:09.338544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece178b6-00e1-4740-a75c-ba9303cf8141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:09.402951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ece178b6-00e1-4740-a75c-ba9303cf8141 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:09.406769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ece178b6-00e1-4740-a75c-ba9303cf8141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:09.414643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aed16c-e1b7-45b4-a9d9-8c214289380a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:09.415327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aed16c-e1b7-45b4-a9d9-8c214289380a service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:09.415739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aed16c-e1b7-45b4-a9d9-8c214289380a service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:09.422454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aed16c-e1b7-45b4-a9d9-8c214289380a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:09.423947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-65aed16c-e1b7-45b4-a9d9-8c214289380a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:09.614996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aed16c-e1b7-45b4-a9d9-8c214289380a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:09.617528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aed16c-e1b7-45b4-a9d9-8c214289380a service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:09.644271 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1866/3707] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:09.645338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc557c-fc80-4fad-bb3d-df6a9dfad397 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:09.649665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc557c-fc80-4fad-bb3d-df6a9dfad397 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:09.649665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc557c-fc80-4fad-bb3d-df6a9dfad397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:09.675083 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1842/3708] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:16:09.695754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bcbc557c-fc80-4fad-bb3d-df6a9dfad397 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:09.697100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bcbc557c-fc80-4fad-bb3d-df6a9dfad397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:09.720254 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1867/3709] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:09.724239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aed16c-e1b7-45b4-a9d9-8c214289380a service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:09.745110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aed16c-e1b7-45b4-a9d9-8c214289380a service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:09.751655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5f07f-188e-47cd-8505-e53d8df35882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:09.752551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5f07f-188e-47cd-8505-e53d8df35882 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:09.752905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5f07f-188e-47cd-8505-e53d8df35882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:09.753290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5f07f-188e-47cd-8505-e53d8df35882 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:09.754050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5f07f-188e-47cd-8505-e53d8df35882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:16:09.754457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5f07f-188e-47cd-8505-e53d8df35882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:09.763274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5f07f-188e-47cd-8505-e53d8df35882 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:09.793265 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1843/3710] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:16:09.795013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc557c-fc80-4fad-bb3d-df6a9dfad397 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:09.809663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc557c-fc80-4fad-bb3d-df6a9dfad397 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:09.815619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cb0ad-91b8-4422-a815-c88aa0f538a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:09.816273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cb0ad-91b8-4422-a815-c88aa0f538a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:09.816823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cb0ad-91b8-4422-a815-c88aa0f538a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:09.817254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cb0ad-91b8-4422-a815-c88aa0f538a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:09.819048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cb0ad-91b8-4422-a815-c88aa0f538a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:09.821370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cb0ad-91b8-4422-a815-c88aa0f538a7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:09.868061 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1868/3711] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:16:09 2022] POST /identity/v3/projects => generated 401 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:16:09.871920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5f07f-188e-47cd-8505-e53d8df35882 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:09.890058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5f07f-188e-47cd-8505-e53d8df35882 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:10.009357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e64d5-f0a4-41be-86a1-3ae97d1d433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:10.010238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e64d5-f0a4-41be-86a1-3ae97d1d433d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:10.010720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e64d5-f0a4-41be-86a1-3ae97d1d433d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:10.010991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e64d5-f0a4-41be-86a1-3ae97d1d433d admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:10.012274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e64d5-f0a4-41be-86a1-3ae97d1d433d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:10.016066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e64d5-f0a4-41be-86a1-3ae97d1d433d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:10.054508 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1844/3712] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:16:09 2022] POST /identity/v3/users => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:16:10.058767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cb0ad-91b8-4422-a815-c88aa0f538a7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:10.073924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cb0ad-91b8-4422-a815-c88aa0f538a7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:10.092606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6df397-b615-4d89-9cf3-2c43efb63ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:10.093548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6df397-b615-4d89-9cf3-2c43efb63ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:10.093856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6df397-b615-4d89-9cf3-2c43efb63ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:10.094148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6df397-b615-4d89-9cf3-2c43efb63ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:10.095085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6df397-b615-4d89-9cf3-2c43efb63ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:10.098313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6df397-b615-4d89-9cf3-2c43efb63ae9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:10.126231 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1869/3713] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:16:10.130350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e64d5-f0a4-41be-86a1-3ae97d1d433d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:10.143666 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:10.154903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e64d5-f0a4-41be-86a1-3ae97d1d433d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:10.166936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587a1df-c942-4ba9-8694-6082851bedb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:10.167643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a1df-c942-4ba9-8694-6082851bedb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:10.168004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a1df-c942-4ba9-8694-6082851bedb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:10.168345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a1df-c942-4ba9-8694-6082851bedb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:10.169077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587a1df-c942-4ba9-8694-6082851bedb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:10.170802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587a1df-c942-4ba9-8694-6082851bedb7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:10.201869 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1845/3714] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:16:10.202591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6df397-b615-4d89-9cf3-2c43efb63ae9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:10.219063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6df397-b615-4d89-9cf3-2c43efb63ae9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:10.232139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beb511-7042-4466-a5b0-199a77a21da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:10.232963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beb511-7042-4466-a5b0-199a77a21da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:10.233292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beb511-7042-4466-a5b0-199a77a21da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:10.233578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beb511-7042-4466-a5b0-199a77a21da4 admin admin] PATH_INFO: `/v3/projects/0c749fc01376448fb0d4f04bc8eb5528/users/bbc9ee7eb721413b833f4564ea64acb0/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:10.281577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9beb511-7042-4466-a5b0-199a77a21da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c749fc01376448fb0d4f04bc8eb5528, user_id=bbc9ee7eb721413b833f4564ea64acb0, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:10.287686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9beb511-7042-4466-a5b0-199a77a21da4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:10.323181 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1870/3715] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:16:10 2022] PUT /identity/v3/projects/0c749fc01376448fb0d4f04bc8eb5528/users/bbc9ee7eb721413b833f4564ea64acb0/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:16:10.336003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f411ef-3045-489c-a07a-7b439e3a1b7e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:10.336309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f411ef-3045-489c-a07a-7b439e3a1b7e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:10.336589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f411ef-3045-489c-a07a-7b439e3a1b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:10.383371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-30f411ef-3045-489c-a07a-7b439e3a1b7e None None] MFA Rules not processed for user `bbc9ee7eb721413b833f4564ea64acb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:10.385359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-30f411ef-3045-489c-a07a-7b439e3a1b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:10.530823 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1846/3716] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:10 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:10.728915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beb511-7042-4466-a5b0-199a77a21da4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:10.731062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e9beb511-7042-4466-a5b0-199a77a21da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:10.850832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beb511-7042-4466-a5b0-199a77a21da4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:10.860220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01ddef-c798-416d-ab9d-d777815776cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:10.861080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ddef-c798-416d-ab9d-d777815776cf service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:10.861471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ddef-c798-416d-ab9d-d777815776cf service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:10.861807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ddef-c798-416d-ab9d-d777815776cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:10.884403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01ddef-c798-416d-ab9d-d777815776cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:10.886706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01ddef-c798-416d-ab9d-d777815776cf service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:10.909297 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1871/3717] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:10 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:10.980264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f411ef-3045-489c-a07a-7b439e3a1b7e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:11.138023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f411ef-3045-489c-a07a-7b439e3a1b7e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:11.145864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:11.147930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:11.148402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:11.149546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] PATH_INFO: `/v3/users/bbc9ee7eb721413b833f4564ea64acb0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:11.151092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc9ee7eb721413b833f4564ea64acb0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:11.154514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:11.308726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc9ee7eb721413b833f4564ea64acb0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:11.349130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc9ee7eb721413b833f4564ea64acb0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:11.352251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc9ee7eb721413b833f4564ea64acb0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:11.370761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc9ee7eb721413b833f4564ea64acb0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:11.389660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc9ee7eb721413b833f4564ea64acb0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:11.405514 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1847/3718] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:16:10 2022] DELETE /identity/v3/users/bbc9ee7eb721413b833f4564ea64acb0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:11.411225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21966a-cb36-410a-8440-45aff793d789 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:11.411755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21966a-cb36-410a-8440-45aff793d789 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:11.412892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21966a-cb36-410a-8440-45aff793d789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:11.452383 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:11.464551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6b21966a-cb36-410a-8440-45aff793d789 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:11.466490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6b21966a-cb36-410a-8440-45aff793d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:11.616076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:11.617303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:11.626088 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:11.692118 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1872/3719] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:11.775735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21966a-cb36-410a-8440-45aff793d789 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:11.779430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6b21966a-cb36-410a-8440-45aff793d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:11.795778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fd065-7cf9-4dab-8a71-a716d33b2596 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:11.812358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b34334-6096-4618-90fb-cbd2620a16fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:11.814846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34334-6096-4618-90fb-cbd2620a16fd service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:11.815301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34334-6096-4618-90fb-cbd2620a16fd service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:11.815768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34334-6096-4618-90fb-cbd2620a16fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:11.820261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-89b34334-6096-4618-90fb-cbd2620a16fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:11.861375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b34334-6096-4618-90fb-cbd2620a16fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:11.864153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b34334-6096-4618-90fb-cbd2620a16fd service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:11.904876 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1848/3720] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:16:11.944205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21966a-cb36-410a-8440-45aff793d789 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:11.960084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34f715-5c4e-49bf-b4b7-262550e18f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:11.961265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34f715-5c4e-49bf-b4b7-262550e18f1f service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:11.961265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34f715-5c4e-49bf-b4b7-262550e18f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:11.962629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34f715-5c4e-49bf-b4b7-262550e18f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:11.980668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34f715-5c4e-49bf-b4b7-262550e18f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:11.982177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34f715-5c4e-49bf-b4b7-262550e18f1f service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:12.004732 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1873/3721] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:13.092610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b34334-6096-4618-90fb-cbd2620a16fd service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:13.094407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-89b34334-6096-4618-90fb-cbd2620a16fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:13.121095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b34334-6096-4618-90fb-cbd2620a16fd service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:13.128466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb98db-a7f4-42aa-af20-492b5806f054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:13.131170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb98db-a7f4-42aa-af20-492b5806f054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:13.131170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb98db-a7f4-42aa-af20-492b5806f054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:13.131170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb98db-a7f4-42aa-af20-492b5806f054 admin admin] PATH_INFO: `/v3/users/8cd2ad37e9b844ac8b7632fd9291023a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:13.132496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb98db-a7f4-42aa-af20-492b5806f054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd2ad37e9b844ac8b7632fd9291023a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:13.135363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb98db-a7f4-42aa-af20-492b5806f054 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:13.302316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34f715-5c4e-49bf-b4b7-262550e18f1f service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:13.306741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0c34f715-5c4e-49bf-b4b7-262550e18f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:13.324810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcdb98db-a7f4-42aa-af20-492b5806f054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd2ad37e9b844ac8b7632fd9291023a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.345066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34f715-5c4e-49bf-b4b7-262550e18f1f service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:13.358505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:13.359651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:13.360100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:13.360695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] PATH_INFO: `/v3/projects/0c749fc01376448fb0d4f04bc8eb5528` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:13.362036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c749fc01376448fb0d4f04bc8eb5528)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:13.371537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:13.372235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcdb98db-a7f4-42aa-af20-492b5806f054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd2ad37e9b844ac8b7632fd9291023a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.373001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcdb98db-a7f4-42aa-af20-492b5806f054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd2ad37e9b844ac8b7632fd9291023a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.384271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcdb98db-a7f4-42aa-af20-492b5806f054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd2ad37e9b844ac8b7632fd9291023a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.395477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcdb98db-a7f4-42aa-af20-492b5806f054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd2ad37e9b844ac8b7632fd9291023a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.406840 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1849/3722] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:16:13 2022] DELETE /identity/v3/users/8cd2ad37e9b844ac8b7632fd9291023a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:13.500750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c749fc01376448fb0d4f04bc8eb5528', 'request_id': 'req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.516851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c749fc01376448fb0d4f04bc8eb5528', 'request_id': 'req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.527961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c749fc01376448fb0d4f04bc8eb5528', 'request_id': 'req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.547374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] The token cache is being invalidate because project 0c749fc01376448fb0d4f04bc8eb5528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:16:13.547881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.548807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-023673b3-5fc7-4ce9-98b3-1a612e5fcfc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.555741 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1874/3723] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:16:13 2022] DELETE /identity/v3/projects/0c749fc01376448fb0d4f04bc8eb5528 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:13.558029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e474-1aeb-4c74-b039-ed8f5f6213ca None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:13.558433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e474-1aeb-4c74-b039-ed8f5f6213ca None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:13.558807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e474-1aeb-4c74-b039-ed8f5f6213ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:13.587091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-81a9e474-1aeb-4c74-b039-ed8f5f6213ca None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:13.588454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-81a9e474-1aeb-4c74-b039-ed8f5f6213ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:13.707087 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1850/3724] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:13.715985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f3772-5725-4d38-9354-4bc46e7e991b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:13.716303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f3772-5725-4d38-9354-4bc46e7e991b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:13.717108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f3772-5725-4d38-9354-4bc46e7e991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:13.741675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9e474-1aeb-4c74-b039-ed8f5f6213ca None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:13.745664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-81a9e474-1aeb-4c74-b039-ed8f5f6213ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:13.765814 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:13.770764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9e474-1aeb-4c74-b039-ed8f5f6213ca None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:13.778782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:13.779622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:13.780140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:13.780706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] PATH_INFO: `/v3/projects/9231cac91fd14f51a4efc95c84202419` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:13.782530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9231cac91fd14f51a4efc95c84202419)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:13.784888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:13.785879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0c4f3772-5725-4d38-9354-4bc46e7e991b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:13.789353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0c4f3772-5725-4d38-9354-4bc46e7e991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:13.804109 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1875/3725] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:13.826399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f3772-5725-4d38-9354-4bc46e7e991b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:13.845424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f3772-5725-4d38-9354-4bc46e7e991b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:13.862836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afbe11-f394-463b-b613-62f940d176b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:13.863435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afbe11-f394-463b-b613-62f940d176b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:13.863717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afbe11-f394-463b-b613-62f940d176b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:13.863992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afbe11-f394-463b-b613-62f940d176b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:13.864650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afbe11-f394-463b-b613-62f940d176b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:16:13.865508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afbe11-f394-463b-b613-62f940d176b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:13.871282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afbe11-f394-463b-b613-62f940d176b5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:13.877261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9231cac91fd14f51a4efc95c84202419', 'request_id': 'req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.889907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9231cac91fd14f51a4efc95c84202419', 'request_id': 'req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.901264 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1876/3726] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:16:13.902832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9231cac91fd14f51a4efc95c84202419', 'request_id': 'req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.914115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afbe11-f394-463b-b613-62f940d176b5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:13.939606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] The token cache is being invalidate because project 9231cac91fd14f51a4efc95c84202419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:16:13.940039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.944799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-43bfc7cd-64d8-464a-8740-b6a3c6ca4d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:13.950235 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1851/3727] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:16:13 2022] DELETE /identity/v3/projects/9231cac91fd14f51a4efc95c84202419 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:13.951733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e846c-b02c-4d1c-8796-8a3b707338c8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:13.952031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e846c-b02c-4d1c-8796-8a3b707338c8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:13.952312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e846c-b02c-4d1c-8796-8a3b707338c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:13.967935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afbe11-f394-463b-b613-62f940d176b5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:13.999041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-281e846c-b02c-4d1c-8796-8a3b707338c8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:14.000296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-281e846c-b02c-4d1c-8796-8a3b707338c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:14.006042 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:14.120397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6e308-2c41-4532-be6c-3fef3af14adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:14.121359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6e308-2c41-4532-be6c-3fef3af14adf admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.121886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6e308-2c41-4532-be6c-3fef3af14adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.122362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6e308-2c41-4532-be6c-3fef3af14adf admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.123382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6e308-2c41-4532-be6c-3fef3af14adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:14.125630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6e308-2c41-4532-be6c-3fef3af14adf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:14.134213 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1852/3728] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:14.156549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eee14-30a2-4ffb-9dfa-b7ada91e9db7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.156653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eee14-30a2-4ffb-9dfa-b7ada91e9db7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.156930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eee14-30a2-4ffb-9dfa-b7ada91e9db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.190211 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1877/3729] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:16:13 2022] POST /identity/v3/projects => generated 375 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:16:14.191220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6e308-2c41-4532-be6c-3fef3af14adf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:14.195858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2df6e308-2c41-4532-be6c-3fef3af14adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:14.198935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-967eee14-30a2-4ffb-9dfa-b7ada91e9db7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:14.202200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-967eee14-30a2-4ffb-9dfa-b7ada91e9db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:14.302641 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1853/3730] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:14.312942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eee14-30a2-4ffb-9dfa-b7ada91e9db7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:14.334768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eee14-30a2-4ffb-9dfa-b7ada91e9db7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:14.346925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066e24b-6812-4bf7-88ca-b48d62245030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:14.347566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066e24b-6812-4bf7-88ca-b48d62245030 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.347849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066e24b-6812-4bf7-88ca-b48d62245030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.348121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066e24b-6812-4bf7-88ca-b48d62245030 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.348482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6e308-2c41-4532-be6c-3fef3af14adf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:14.348952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066e24b-6812-4bf7-88ca-b48d62245030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:16:14.349057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066e24b-6812-4bf7-88ca-b48d62245030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:14.353318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066e24b-6812-4bf7-88ca-b48d62245030 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:14.366294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe67247-f613-4290-87eb-2e25833903e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:14.367747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe67247-f613-4290-87eb-2e25833903e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.368070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe67247-f613-4290-87eb-2e25833903e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.368410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe67247-f613-4290-87eb-2e25833903e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.369006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe67247-f613-4290-87eb-2e25833903e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:14.371680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe67247-f613-4290-87eb-2e25833903e9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:14.394105 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1854/3731] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:16:14.397801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066e24b-6812-4bf7-88ca-b48d62245030 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:14.412804 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1878/3732] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:16:14 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:16:14.416356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe67247-f613-4290-87eb-2e25833903e9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:14.423439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066e24b-6812-4bf7-88ca-b48d62245030 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:14.429776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe67247-f613-4290-87eb-2e25833903e9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:14.430391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7f368-90f9-4779-8dcd-abf9d1fd52f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:14.431099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7f368-90f9-4779-8dcd-abf9d1fd52f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.431382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7f368-90f9-4779-8dcd-abf9d1fd52f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.431770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7f368-90f9-4779-8dcd-abf9d1fd52f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.432433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7f368-90f9-4779-8dcd-abf9d1fd52f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:14.435584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7f368-90f9-4779-8dcd-abf9d1fd52f1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:14.436486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9479b4-bc0e-4635-bdd8-5fe48fa590f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:14.437202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9479b4-bc0e-4635-bdd8-5fe48fa590f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.437578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9479b4-bc0e-4635-bdd8-5fe48fa590f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.437948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9479b4-bc0e-4635-bdd8-5fe48fa590f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.438902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9479b4-bc0e-4635-bdd8-5fe48fa590f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:14.440836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9479b4-bc0e-4635-bdd8-5fe48fa590f4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:14.453942 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1879/3733] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:16:14.454557 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:14.469281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9479b4-bc0e-4635-bdd8-5fe48fa590f4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:14.485541 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1855/3734] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:16:14 2022] POST /identity/v3/projects => generated 403 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:16:14.486427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7f368-90f9-4779-8dcd-abf9d1fd52f1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:14.493109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9479b4-bc0e-4635-bdd8-5fe48fa590f4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:14.602141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629910be-1b21-47af-b8d5-b6eb0a5e0de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:14.602550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629910be-1b21-47af-b8d5-b6eb0a5e0de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.602957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629910be-1b21-47af-b8d5-b6eb0a5e0de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.603326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629910be-1b21-47af-b8d5-b6eb0a5e0de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.604144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629910be-1b21-47af-b8d5-b6eb0a5e0de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:14.605906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629910be-1b21-47af-b8d5-b6eb0a5e0de8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:14.619513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7f368-90f9-4779-8dcd-abf9d1fd52f1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:14.620749 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1880/3735] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:16:14.624650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629910be-1b21-47af-b8d5-b6eb0a5e0de8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:14.628026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dd938-b9fc-468b-a59c-26fac2c033e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:14.628795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dd938-b9fc-468b-a59c-26fac2c033e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.628926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dd938-b9fc-468b-a59c-26fac2c033e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.629309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dd938-b9fc-468b-a59c-26fac2c033e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.629943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68dd938-b9fc-468b-a59c-26fac2c033e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:14.632124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68dd938-b9fc-468b-a59c-26fac2c033e4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:14.637035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629910be-1b21-47af-b8d5-b6eb0a5e0de8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:14.648585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf752-ed62-4ee5-a271-3796e0e0a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:14.652472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf752-ed62-4ee5-a271-3796e0e0a433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.652647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf752-ed62-4ee5-a271-3796e0e0a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.653008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf752-ed62-4ee5-a271-3796e0e0a433 admin admin] PATH_INFO: `/v3/projects/f1abef7656444b029fc945e0b6e134e0/users/52f506d959b44a29b6bffb72566a7c03/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.686578 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1856/3736] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:16:14 2022] POST /identity/v3/users => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:16:14.689033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dd938-b9fc-468b-a59c-26fac2c033e4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:14.690769 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:14.712543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dd938-b9fc-468b-a59c-26fac2c033e4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:14.715376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf752-ed62-4ee5-a271-3796e0e0a433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1abef7656444b029fc945e0b6e134e0, user_id=52f506d959b44a29b6bffb72566a7c03, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:14.718332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf752-ed62-4ee5-a271-3796e0e0a433 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:14.724660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40779-85a3-47dc-a603-ef7b667daf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:14.725288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40779-85a3-47dc-a603-ef7b667daf72 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.725568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40779-85a3-47dc-a603-ef7b667daf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.725838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40779-85a3-47dc-a603-ef7b667daf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.727187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c40779-85a3-47dc-a603-ef7b667daf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:14.728868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c40779-85a3-47dc-a603-ef7b667daf72 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:14.757974 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1857/3738] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:16:14.759373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40779-85a3-47dc-a603-ef7b667daf72 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:14.761176 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1881/3738] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:16:14 2022] PUT /identity/v3/projects/f1abef7656444b029fc945e0b6e134e0/users/52f506d959b44a29b6bffb72566a7c03/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:14.763843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c000212-bacb-4ec9-b80d-754551b320ba None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.765284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c000212-bacb-4ec9-b80d-754551b320ba None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.765597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c000212-bacb-4ec9-b80d-754551b320ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.779105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40779-85a3-47dc-a603-ef7b667daf72 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:14.831741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7c000212-bacb-4ec9-b80d-754551b320ba None None] MFA Rules not processed for user `52f506d959b44a29b6bffb72566a7c03`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:14.832953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7c000212-bacb-4ec9-b80d-754551b320ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:14.898691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb333-1a30-459e-891f-a42bf7f4e3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:14.903629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb333-1a30-459e-891f-a42bf7f4e3cc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.903928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb333-1a30-459e-891f-a42bf7f4e3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.904210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb333-1a30-459e-891f-a42bf7f4e3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.904885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203eb333-1a30-459e-891f-a42bf7f4e3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:14.907739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203eb333-1a30-459e-891f-a42bf7f4e3cc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:14.929335 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1858/3739] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:16:14.930430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb333-1a30-459e-891f-a42bf7f4e3cc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:14.945622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb333-1a30-459e-891f-a42bf7f4e3cc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:14.952605 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1882/3740] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:14.954677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d8c46-7b92-4d5a-a40b-100fa12a84e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:14.955430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d8c46-7b92-4d5a-a40b-100fa12a84e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:14.955763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d8c46-7b92-4d5a-a40b-100fa12a84e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:14.956037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d8c46-7b92-4d5a-a40b-100fa12a84e7 admin admin] PATH_INFO: `/v3/projects/33dead72204946dd9bb526d037b4f0a0/users/acca7051bf9f4cae9dbd1435a08a57fd/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:14.983646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c000212-bacb-4ec9-b80d-754551b320ba None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:14.985663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7c000212-bacb-4ec9-b80d-754551b320ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:14.991366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d8c46-7b92-4d5a-a40b-100fa12a84e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33dead72204946dd9bb526d037b4f0a0, user_id=acca7051bf9f4cae9dbd1435a08a57fd, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:14.996770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d8c46-7b92-4d5a-a40b-100fa12a84e7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:15.029861 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1859/3741] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:16:14 2022] PUT /identity/v3/projects/33dead72204946dd9bb526d037b4f0a0/users/acca7051bf9f4cae9dbd1435a08a57fd/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:15.034812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dca9de-320c-4a13-8a12-7d7a588c8a4b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:15.035343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dca9de-320c-4a13-8a12-7d7a588c8a4b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:15.035772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dca9de-320c-4a13-8a12-7d7a588c8a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:15.076337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-30dca9de-320c-4a13-8a12-7d7a588c8a4b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:15.080768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-30dca9de-320c-4a13-8a12-7d7a588c8a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:15.132492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c000212-bacb-4ec9-b80d-754551b320ba None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:15.172727 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:15.216786 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1860/3742] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:15.239445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dca9de-320c-4a13-8a12-7d7a588c8a4b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:15.242057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-30dca9de-320c-4a13-8a12-7d7a588c8a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:15.288408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6536cef-4851-4be4-babc-fa183cfa356f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:15.291002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6536cef-4851-4be4-babc-fa183cfa356f service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:15.291450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6536cef-4851-4be4-babc-fa183cfa356f service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:15.292628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6536cef-4851-4be4-babc-fa183cfa356f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:15.324374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dca9de-320c-4a13-8a12-7d7a588c8a4b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:15.326560 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:15.332061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25785d1c-4f72-45f9-a5ab-423c41b793b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:15.333138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785d1c-4f72-45f9-a5ab-423c41b793b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:15.334756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785d1c-4f72-45f9-a5ab-423c41b793b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:15.335215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785d1c-4f72-45f9-a5ab-423c41b793b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:15.359267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25785d1c-4f72-45f9-a5ab-423c41b793b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:15.360822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25785d1c-4f72-45f9-a5ab-423c41b793b2 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:15.386503 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1861/3743] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:15.444389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6536cef-4851-4be4-babc-fa183cfa356f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:15.448293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6536cef-4851-4be4-babc-fa183cfa356f service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:15.497066 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1883/3744] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:16:15.623083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25785d1c-4f72-45f9-a5ab-423c41b793b2 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:15.661583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25785d1c-4f72-45f9-a5ab-423c41b793b2 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:15.678160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b987080-c4cc-484c-a232-ef09ffbb4960 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:15.679144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b987080-c4cc-484c-a232-ef09ffbb4960 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:15.679144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b987080-c4cc-484c-a232-ef09ffbb4960 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:15.679457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b987080-c4cc-484c-a232-ef09ffbb4960 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:15.684451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2b987080-c4cc-484c-a232-ef09ffbb4960 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:15.702218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b987080-c4cc-484c-a232-ef09ffbb4960 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:15.703929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b987080-c4cc-484c-a232-ef09ffbb4960 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:15.735822 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1862/3745] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:16.263621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6536cef-4851-4be4-babc-fa183cfa356f service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:16.265114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f6536cef-4851-4be4-babc-fa183cfa356f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:16.283689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6536cef-4851-4be4-babc-fa183cfa356f service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:16.306136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bf320-20b0-41d7-b434-41f1baaef16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:16.307053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf320-20b0-41d7-b434-41f1baaef16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:16.307545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf320-20b0-41d7-b434-41f1baaef16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:16.308066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf320-20b0-41d7-b434-41f1baaef16a admin admin] PATH_INFO: `/v3/users/852e8ab225d64f40a4dc9ce54fe509fd` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:16.310094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bf320-20b0-41d7-b434-41f1baaef16a admin admin] RBAC: Authorizing `identity:delete_user(user_id=852e8ab225d64f40a4dc9ce54fe509fd)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:16.312471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bf320-20b0-41d7-b434-41f1baaef16a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:16.411558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-107bf320-20b0-41d7-b434-41f1baaef16a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852e8ab225d64f40a4dc9ce54fe509fd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:16.463585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-107bf320-20b0-41d7-b434-41f1baaef16a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852e8ab225d64f40a4dc9ce54fe509fd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:16.464508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-107bf320-20b0-41d7-b434-41f1baaef16a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852e8ab225d64f40a4dc9ce54fe509fd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:16.479919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-107bf320-20b0-41d7-b434-41f1baaef16a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852e8ab225d64f40a4dc9ce54fe509fd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:16.480613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-107bf320-20b0-41d7-b434-41f1baaef16a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852e8ab225d64f40a4dc9ce54fe509fd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:16.510048 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1884/3746] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:16:16 2022] DELETE /identity/v3/users/852e8ab225d64f40a4dc9ce54fe509fd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:17.163248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b987080-c4cc-484c-a232-ef09ffbb4960 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:17.176018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b987080-c4cc-484c-a232-ef09ffbb4960 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:17.278186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:17.279090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:17.279515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:17.279855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] PATH_INFO: `/v3/projects/bf661665ac114503b71ac751f84bfdd7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:17.281224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf661665ac114503b71ac751f84bfdd7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:17.283849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:17.356308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf661665ac114503b71ac751f84bfdd7', 'request_id': 'req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:17.363644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf661665ac114503b71ac751f84bfdd7', 'request_id': 'req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:17.372261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf661665ac114503b71ac751f84bfdd7', 'request_id': 'req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:17.390442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] The token cache is being invalidate because project bf661665ac114503b71ac751f84bfdd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:16:17.391574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:17.392584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c0aa5b8-a73d-4bfa-bcc1-11a9299b04cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:17.399279 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1863/3747] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:16:17 2022] DELETE /identity/v3/projects/bf661665ac114503b71ac751f84bfdd7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:17.400489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26b51-e5d5-4f6b-bcec-258ba094e9fd None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:17.400869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26b51-e5d5-4f6b-bcec-258ba094e9fd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:17.401317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26b51-e5d5-4f6b-bcec-258ba094e9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:17.446985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e9a26b51-e5d5-4f6b-bcec-258ba094e9fd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:17.448442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e9a26b51-e5d5-4f6b-bcec-258ba094e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:17.603963 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1885/3748] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:17.607207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7dbd5-b020-454c-9e06-3af71d560c9d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:17.607794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7dbd5-b020-454c-9e06-3af71d560c9d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:17.608244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7dbd5-b020-454c-9e06-3af71d560c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:17.620313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c7a2c-ac12-4498-bdb1-bbfc158a4569 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:17.620599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c7a2c-ac12-4498-bdb1-bbfc158a4569 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:17.624156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c7a2c-ac12-4498-bdb1-bbfc158a4569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:17.625420 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:17.658712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2fb7dbd5-b020-454c-9e06-3af71d560c9d None None] MFA Rules not processed for user `5104bda5de774e93bd494d64a8f11faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:17.662884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2fb7dbd5-b020-454c-9e06-3af71d560c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:17.670953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5a0c7a2c-ac12-4498-bdb1-bbfc158a4569 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:17.673366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5a0c7a2c-ac12-4498-bdb1-bbfc158a4569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:17.691793 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1886/3749] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:17.693054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c7a2c-ac12-4498-bdb1-bbfc158a4569 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:17.696268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5a0c7a2c-ac12-4498-bdb1-bbfc158a4569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:17.723035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c7a2c-ac12-4498-bdb1-bbfc158a4569 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:17.737554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094b48a-75be-4300-a7be-f4effa350af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:17.738513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b48a-75be-4300-a7be-f4effa350af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:17.738977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b48a-75be-4300-a7be-f4effa350af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:17.739544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b48a-75be-4300-a7be-f4effa350af9 admin admin] PATH_INFO: `/v3/users/52f506d959b44a29b6bffb72566a7c03` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:17.746652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094b48a-75be-4300-a7be-f4effa350af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f506d959b44a29b6bffb72566a7c03)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:17.748931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094b48a-75be-4300-a7be-f4effa350af9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:17.766887 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:17.775968 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1864/3750] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:17.777262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7dbd5-b020-454c-9e06-3af71d560c9d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:17.792672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7dbd5-b020-454c-9e06-3af71d560c9d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:17.799626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93518e8-dd5a-40b8-9ddf-4ed15f3f9485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:17.800573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93518e8-dd5a-40b8-9ddf-4ed15f3f9485 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:17.801920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93518e8-dd5a-40b8-9ddf-4ed15f3f9485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:17.801920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93518e8-dd5a-40b8-9ddf-4ed15f3f9485 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:17.803492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93518e8-dd5a-40b8-9ddf-4ed15f3f9485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:16:17.803858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93518e8-dd5a-40b8-9ddf-4ed15f3f9485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:17.805608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93518e8-dd5a-40b8-9ddf-4ed15f3f9485 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:17.826768 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1865/3751] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:16:17.831159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93518e8-dd5a-40b8-9ddf-4ed15f3f9485 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:17.837832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1094b48a-75be-4300-a7be-f4effa350af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f506d959b44a29b6bffb72566a7c03'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:17.856687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1094b48a-75be-4300-a7be-f4effa350af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f506d959b44a29b6bffb72566a7c03'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:17.857890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1094b48a-75be-4300-a7be-f4effa350af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f506d959b44a29b6bffb72566a7c03'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:17.861522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93518e8-dd5a-40b8-9ddf-4ed15f3f9485 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:17.868292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41511e92-7ebb-40d6-973d-052169411833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:17.868848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41511e92-7ebb-40d6-973d-052169411833 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:17.869182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41511e92-7ebb-40d6-973d-052169411833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:17.869446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41511e92-7ebb-40d6-973d-052169411833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:17.870087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41511e92-7ebb-40d6-973d-052169411833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:17.872186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1094b48a-75be-4300-a7be-f4effa350af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f506d959b44a29b6bffb72566a7c03'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:17.872512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41511e92-7ebb-40d6-973d-052169411833 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:17.873834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1094b48a-75be-4300-a7be-f4effa350af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f506d959b44a29b6bffb72566a7c03'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:17.899039 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1887/3752] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:16:17 2022] DELETE /identity/v3/users/52f506d959b44a29b6bffb72566a7c03 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:17.903226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de772ee1-d035-466b-bb2a-4b70d738f960 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:17.903621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de772ee1-d035-466b-bb2a-4b70d738f960 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:17.904050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de772ee1-d035-466b-bb2a-4b70d738f960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:17.931186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-de772ee1-d035-466b-bb2a-4b70d738f960 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:17.932534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-de772ee1-d035-466b-bb2a-4b70d738f960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:17.936755 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1866/3753] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:16:17 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:16:17.938072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41511e92-7ebb-40d6-973d-052169411833 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:17.940943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-41511e92-7ebb-40d6-973d-052169411833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:18.025041 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1888/3754] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:16:18.037431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de772ee1-d035-466b-bb2a-4b70d738f960 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:18.039815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-de772ee1-d035-466b-bb2a-4b70d738f960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:18.051022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41511e92-7ebb-40d6-973d-052169411833 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:18.056966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf61590-a057-40b6-bbae-ed0cd5b0645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:18.057585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61590-a057-40b6-bbae-ed0cd5b0645e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:18.057865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61590-a057-40b6-bbae-ed0cd5b0645e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:18.058577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61590-a057-40b6-bbae-ed0cd5b0645e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:18.058963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf61590-a057-40b6-bbae-ed0cd5b0645e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:18.061117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf61590-a057-40b6-bbae-ed0cd5b0645e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:18.117165 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1867/3755] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:16:17 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:16:18.121617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf61590-a057-40b6-bbae-ed0cd5b0645e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:18.134014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf61590-a057-40b6-bbae-ed0cd5b0645e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:18.135002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de772ee1-d035-466b-bb2a-4b70d738f960 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:18.139267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deb3d8-d45d-4158-bf2b-830b8386fb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:18.139511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea179b2-93d5-4a33-abc3-ad23f2d69059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:18.139961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb3d8-d45d-4158-bf2b-830b8386fb7d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:18.140233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb3d8-d45d-4158-bf2b-830b8386fb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:18.140512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb3d8-d45d-4158-bf2b-830b8386fb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:18.140925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea179b2-93d5-4a33-abc3-ad23f2d69059 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:18.141220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deb3d8-d45d-4158-bf2b-830b8386fb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:18.141651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea179b2-93d5-4a33-abc3-ad23f2d69059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:18.142849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea179b2-93d5-4a33-abc3-ad23f2d69059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:18.142999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deb3d8-d45d-4158-bf2b-830b8386fb7d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:18.156290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea179b2-93d5-4a33-abc3-ad23f2d69059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:18.158244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea179b2-93d5-4a33-abc3-ad23f2d69059 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:18.160536 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1868/3756] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:16:18.161489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deb3d8-d45d-4158-bf2b-830b8386fb7d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:18.173918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deb3d8-d45d-4158-bf2b-830b8386fb7d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:18.180583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210c1f1-c7e8-4976-bd6b-d95c6f86e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:18.181220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c1f1-c7e8-4976-bd6b-d95c6f86e923 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:18.181603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c1f1-c7e8-4976-bd6b-d95c6f86e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:18.181933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c1f1-c7e8-4976-bd6b-d95c6f86e923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:18.182799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210c1f1-c7e8-4976-bd6b-d95c6f86e923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:18.184454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210c1f1-c7e8-4976-bd6b-d95c6f86e923 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:18.185803 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1889/3757] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:18.198232 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1869/3758] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:16:18.203134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea179b2-93d5-4a33-abc3-ad23f2d69059 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:18.218159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea179b2-93d5-4a33-abc3-ad23f2d69059 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:18.227693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3e2bb-4824-4b49-acd8-150480c6bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:18.228489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e2bb-4824-4b49-acd8-150480c6bae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:18.228769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e2bb-4824-4b49-acd8-150480c6bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:18.229167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e2bb-4824-4b49-acd8-150480c6bae2 admin admin] PATH_INFO: `/v3/projects/1d8558d451aa4c17b359f4ae0274a371/users/db9450c53d8944b88cfbbc541f585ba0/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:18.258054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3e2bb-4824-4b49-acd8-150480c6bae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8558d451aa4c17b359f4ae0274a371, user_id=db9450c53d8944b88cfbbc541f585ba0, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:18.264935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3e2bb-4824-4b49-acd8-150480c6bae2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:18.283963 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1890/3759] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:16:18 2022] PUT /identity/v3/projects/1d8558d451aa4c17b359f4ae0274a371/users/db9450c53d8944b88cfbbc541f585ba0/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:18.289881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e3294-6b60-472c-befe-6606a8449026 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:18.290407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e3294-6b60-472c-befe-6606a8449026 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:18.290786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e3294-6b60-472c-befe-6606a8449026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:18.314836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ed4e3294-6b60-472c-befe-6606a8449026 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:18.316192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed4e3294-6b60-472c-befe-6606a8449026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:18.372325 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:18.415238 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1870/3760] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:18.447319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3e2bb-4824-4b49-acd8-150480c6bae2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:18.462166 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:18.518056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3e2bb-4824-4b49-acd8-150480c6bae2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:18.523384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eade147-d379-4d83-a281-f707306a7e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:18.524003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eade147-d379-4d83-a281-f707306a7e1f service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:18.524500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eade147-d379-4d83-a281-f707306a7e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:18.524779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eade147-d379-4d83-a281-f707306a7e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:18.542498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eade147-d379-4d83-a281-f707306a7e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:18.544340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eade147-d379-4d83-a281-f707306a7e1f service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:18.559894 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1891/3761] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:18.638820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e3294-6b60-472c-befe-6606a8449026 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:18.640336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed4e3294-6b60-472c-befe-6606a8449026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:18.655907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e3294-6b60-472c-befe-6606a8449026 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:18.664068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:18.664941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:18.665286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:18.665810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] PATH_INFO: `/v3/projects/f1abef7656444b029fc945e0b6e134e0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:18.667255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1abef7656444b029fc945e0b6e134e0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:18.669403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:18.747190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1abef7656444b029fc945e0b6e134e0', 'request_id': 'req-244f3757-f812-4c8d-936d-5381ceb398d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:18.761002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1abef7656444b029fc945e0b6e134e0', 'request_id': 'req-244f3757-f812-4c8d-936d-5381ceb398d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:18.775792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1abef7656444b029fc945e0b6e134e0', 'request_id': 'req-244f3757-f812-4c8d-936d-5381ceb398d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:18.805732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] The token cache is being invalidate because project f1abef7656444b029fc945e0b6e134e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:16:18.806645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:18.807800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-244f3757-f812-4c8d-936d-5381ceb398d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:18.816253 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1871/3762] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:16:18 2022] DELETE /identity/v3/projects/f1abef7656444b029fc945e0b6e134e0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:18.819868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d7890-0af1-4ceb-82f3-0344881798c0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:18.820403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d7890-0af1-4ceb-82f3-0344881798c0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:18.820489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d7890-0af1-4ceb-82f3-0344881798c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:18.863884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-774d7890-0af1-4ceb-82f3-0344881798c0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:18.867329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-774d7890-0af1-4ceb-82f3-0344881798c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:18.962653 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1892/3763] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:18.972227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7d5c4-8bdc-4d9b-a487-1bb21bcd7295 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:18.972462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7d5c4-8bdc-4d9b-a487-1bb21bcd7295 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:18.972864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7d5c4-8bdc-4d9b-a487-1bb21bcd7295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:19.006774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-10a7d5c4-8bdc-4d9b-a487-1bb21bcd7295 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:19.008592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-10a7d5c4-8bdc-4d9b-a487-1bb21bcd7295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:19.019747 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1872/3764] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:19.025150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d7890-0af1-4ceb-82f3-0344881798c0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:19.048954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d7890-0af1-4ceb-82f3-0344881798c0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:19.063462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e20a1-ee42-4a06-8c08-462fb1e2fb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:19.064061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e20a1-ee42-4a06-8c08-462fb1e2fb6f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:19.064345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e20a1-ee42-4a06-8c08-462fb1e2fb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:19.065164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e20a1-ee42-4a06-8c08-462fb1e2fb6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:19.066174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e20a1-ee42-4a06-8c08-462fb1e2fb6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:16:19.066497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e20a1-ee42-4a06-8c08-462fb1e2fb6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:19.068178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e20a1-ee42-4a06-8c08-462fb1e2fb6f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:19.100071 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1893/3765] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:16:19.100937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7d5c4-8bdc-4d9b-a487-1bb21bcd7295 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:19.117962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7d5c4-8bdc-4d9b-a487-1bb21bcd7295 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:19.129275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f55b1-eeef-47b4-93d8-0c7a329192dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:19.130860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f55b1-eeef-47b4-93d8-0c7a329192dc admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:19.131252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f55b1-eeef-47b4-93d8-0c7a329192dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:19.131627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f55b1-eeef-47b4-93d8-0c7a329192dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:19.132393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f55b1-eeef-47b4-93d8-0c7a329192dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:19.134513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f55b1-eeef-47b4-93d8-0c7a329192dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:19.170649 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1873/3766] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:16:19 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:16:19.175004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e20a1-ee42-4a06-8c08-462fb1e2fb6f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:19.187791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e20a1-ee42-4a06-8c08-462fb1e2fb6f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:19.329361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbfdf5-97f4-451d-b626-f719a8b95388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:19.330528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbfdf5-97f4-451d-b626-f719a8b95388 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:19.331066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbfdf5-97f4-451d-b626-f719a8b95388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:19.331519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbfdf5-97f4-451d-b626-f719a8b95388 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:19.332559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbfdf5-97f4-451d-b626-f719a8b95388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:19.335514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbfdf5-97f4-451d-b626-f719a8b95388 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:19.373302 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1894/3767] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:16:19 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:16:19.374569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f55b1-eeef-47b4-93d8-0c7a329192dc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:19.389669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f55b1-eeef-47b4-93d8-0c7a329192dc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:19.394613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9794a6c-c9fa-4110-84c8-f259b7013f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:19.395529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9794a6c-c9fa-4110-84c8-f259b7013f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:19.395903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9794a6c-c9fa-4110-84c8-f259b7013f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:19.396186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9794a6c-c9fa-4110-84c8-f259b7013f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:19.397535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9794a6c-c9fa-4110-84c8-f259b7013f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:19.399595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9794a6c-c9fa-4110-84c8-f259b7013f22 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:19.419023 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1874/3768] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:16:19.422751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbfdf5-97f4-451d-b626-f719a8b95388 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:19.436987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbfdf5-97f4-451d-b626-f719a8b95388 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:19.442510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6c90d-a1bf-44cb-954d-3a39fe672eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:19.443950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6c90d-a1bf-44cb-954d-3a39fe672eae admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:19.444464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6c90d-a1bf-44cb-954d-3a39fe672eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:19.444903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6c90d-a1bf-44cb-954d-3a39fe672eae admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:19.445762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6c90d-a1bf-44cb-954d-3a39fe672eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:19.447774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6c90d-a1bf-44cb-954d-3a39fe672eae admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:19.460583 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1895/3769] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:16:19.464957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9794a6c-c9fa-4110-84c8-f259b7013f22 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:19.476917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9794a6c-c9fa-4110-84c8-f259b7013f22 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:19.482536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aebc0-0661-42b0-873d-742c633f73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:19.483468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aebc0-0661-42b0-873d-742c633f73e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:19.483601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aebc0-0661-42b0-873d-742c633f73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:19.483765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aebc0-0661-42b0-873d-742c633f73e7 admin admin] PATH_INFO: `/v3/projects/52c591d1679f478981bbe151f38dcb2f/users/39f8d72cfddb4f4c84f40e02574c3410/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:19.518461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8aebc0-0661-42b0-873d-742c633f73e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c591d1679f478981bbe151f38dcb2f, user_id=39f8d72cfddb4f4c84f40e02574c3410, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:19.524020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8aebc0-0661-42b0-873d-742c633f73e7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:19.550915 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1875/3770] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:16:19 2022] PUT /identity/v3/projects/52c591d1679f478981bbe151f38dcb2f/users/39f8d72cfddb4f4c84f40e02574c3410/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:19.551566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c638f-fe9a-42ca-979c-71d61f7ed20e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:19.552062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c638f-fe9a-42ca-979c-71d61f7ed20e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:19.552340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c638f-fe9a-42ca-979c-71d61f7ed20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:19.589795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-582c638f-fe9a-42ca-979c-71d61f7ed20e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:19.591267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-582c638f-fe9a-42ca-979c-71d61f7ed20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:19.621290 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:19.702971 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1896/3771] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:19.856873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aebc0-0661-42b0-873d-742c633f73e7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:19.862007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5d8aebc0-0661-42b0-873d-742c633f73e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:20.028266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aebc0-0661-42b0-873d-742c633f73e7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:20.039722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d482e8-7184-4403-94ba-4b218a32f7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:20.040382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d482e8-7184-4403-94ba-4b218a32f7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:20.040661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d482e8-7184-4403-94ba-4b218a32f7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:20.045393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d482e8-7184-4403-94ba-4b218a32f7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:20.073687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d482e8-7184-4403-94ba-4b218a32f7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:20.075192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d482e8-7184-4403-94ba-4b218a32f7d7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:20.100357 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1876/3772] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:26.515529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1f071-111e-43e1-89d1-63f88dc2e894 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:26.516131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1f071-111e-43e1-89d1-63f88dc2e894 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:26.516131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1f071-111e-43e1-89d1-63f88dc2e894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:26.592501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-11c1f071-111e-43e1-89d1-63f88dc2e894 None None] MFA Rules not processed for user `acca7051bf9f4cae9dbd1435a08a57fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:26.595479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-11c1f071-111e-43e1-89d1-63f88dc2e894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:26.807159 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1897/3773] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:26 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:26.815043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d482e8-7184-4403-94ba-4b218a32f7d7 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:26.820497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8d482e8-7184-4403-94ba-4b218a32f7d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:26.843834 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:26.999640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d482e8-7184-4403-94ba-4b218a32f7d7 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:27.007791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bf1a6-ea94-44d0-a0b5-d90ae984bca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:27.012083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf1a6-ea94-44d0-a0b5-d90ae984bca4 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:27.012516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf1a6-ea94-44d0-a0b5-d90ae984bca4 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:27.012803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf1a6-ea94-44d0-a0b5-d90ae984bca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:27.024963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bf1a6-ea94-44d0-a0b5-d90ae984bca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:27.026680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bf1a6-ea94-44d0-a0b5-d90ae984bca4 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:27.040284 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1877/3774] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:26 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:27.348850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1f071-111e-43e1-89d1-63f88dc2e894 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:27.350570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-11c1f071-111e-43e1-89d1-63f88dc2e894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:27.378086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1f071-111e-43e1-89d1-63f88dc2e894 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:27.405812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e64e7b-de30-4be0-9511-d47f61c93410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:27.408865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64e7b-de30-4be0-9511-d47f61c93410 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:27.413362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64e7b-de30-4be0-9511-d47f61c93410 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:27.413906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64e7b-de30-4be0-9511-d47f61c93410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:27.421165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e0e64e7b-de30-4be0-9511-d47f61c93410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:27.456571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e64e7b-de30-4be0-9511-d47f61c93410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:27.458321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e64e7b-de30-4be0-9511-d47f61c93410 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:27.486694 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1898/3775] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:29.008438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970be563-fc65-421e-b33c-1a62ac8dc0a7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:29.009339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970be563-fc65-421e-b33c-1a62ac8dc0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:29.009836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970be563-fc65-421e-b33c-1a62ac8dc0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:29.050529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-970be563-fc65-421e-b33c-1a62ac8dc0a7 None None] MFA Rules not processed for user `db9450c53d8944b88cfbbc541f585ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:29.051797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-970be563-fc65-421e-b33c-1a62ac8dc0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:29.201331 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1878/3776] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:29.213122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e35716-6a0e-44b6-946f-43a509e48585 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:29.213722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e35716-6a0e-44b6-946f-43a509e48585 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:29.213722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e35716-6a0e-44b6-946f-43a509e48585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:29.242930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-93e35716-6a0e-44b6-946f-43a509e48585 None None] MFA Rules not processed for user `db9450c53d8944b88cfbbc541f585ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:29.245124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-93e35716-6a0e-44b6-946f-43a509e48585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:29.255176 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1899/3777] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:30.674875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970be563-fc65-421e-b33c-1a62ac8dc0a7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:30.674875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-970be563-fc65-421e-b33c-1a62ac8dc0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:30.689802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970be563-fc65-421e-b33c-1a62ac8dc0a7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:30.697839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0c01c-4268-43f5-a28e-a43033a6af6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:30.698770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0c01c-4268-43f5-a28e-a43033a6af6b service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:30.699105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0c01c-4268-43f5-a28e-a43033a6af6b service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:30.699624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0c01c-4268-43f5-a28e-a43033a6af6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:30.712875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0c01c-4268-43f5-a28e-a43033a6af6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:30.714908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0c01c-4268-43f5-a28e-a43033a6af6b service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:30.726162 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1879/3778] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:37.637229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948f6d-63b4-4e63-b0a1-8bd04ba2e5c5 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:37.638458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948f6d-63b4-4e63-b0a1-8bd04ba2e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:37.638780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948f6d-63b4-4e63-b0a1-8bd04ba2e5c5 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:37.640737 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1900/3779] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:16:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:16:37.657157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450256d-7d28-42dd-883f-06421f5b624f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:37.657601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450256d-7d28-42dd-883f-06421f5b624f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:37.657719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450256d-7d28-42dd-883f-06421f5b624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:37.734516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d450256d-7d28-42dd-883f-06421f5b624f None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:37.735898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d450256d-7d28-42dd-883f-06421f5b624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:37.745266 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1880/3780] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:16:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:37.758803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948f6d-63b4-4e63-b0a1-8bd04ba2e5c5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:37.778876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948f6d-63b4-4e63-b0a1-8bd04ba2e5c5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:37.784366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce4c5d-b6b4-4441-82b4-1e59551647b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:37.785440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce4c5d-b6b4-4441-82b4-1e59551647b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:37.785915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce4c5d-b6b4-4441-82b4-1e59551647b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:37.786308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce4c5d-b6b4-4441-82b4-1e59551647b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:37.798327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce4c5d-b6b4-4441-82b4-1e59551647b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:37.800031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce4c5d-b6b4-4441-82b4-1e59551647b9 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:37.812994 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1901/3781] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:38.817665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418658a-0e05-4a0a-9f78-cf2bc7d95cb3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:38.818162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418658a-0e05-4a0a-9f78-cf2bc7d95cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:38.818249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418658a-0e05-4a0a-9f78-cf2bc7d95cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:38.864684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e418658a-0e05-4a0a-9f78-cf2bc7d95cb3 None None] MFA Rules not processed for user `39f8d72cfddb4f4c84f40e02574c3410`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:38.867185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e418658a-0e05-4a0a-9f78-cf2bc7d95cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:38.950209 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:39.019586 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1881/3782] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:39.033519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315132f-45e2-4b42-94ba-43b005c71751 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:39.034570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315132f-45e2-4b42-94ba-43b005c71751 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:39.035202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315132f-45e2-4b42-94ba-43b005c71751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:39.064652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d315132f-45e2-4b42-94ba-43b005c71751 None None] MFA Rules not processed for user `39f8d72cfddb4f4c84f40e02574c3410`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:39.066179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d315132f-45e2-4b42-94ba-43b005c71751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:39.074749 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1902/3783] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:39.541005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418658a-0e05-4a0a-9f78-cf2bc7d95cb3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:39.561309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418658a-0e05-4a0a-9f78-cf2bc7d95cb3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:39.570464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09047998-8e7f-455a-80bc-5b4dfae5fef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:39.571339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047998-8e7f-455a-80bc-5b4dfae5fef9 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:39.572170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047998-8e7f-455a-80bc-5b4dfae5fef9 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:39.572552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047998-8e7f-455a-80bc-5b4dfae5fef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:39.583407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09047998-8e7f-455a-80bc-5b4dfae5fef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:39.585682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09047998-8e7f-455a-80bc-5b4dfae5fef9 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:39.598298 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1882/3784] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:46.179738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315132f-45e2-4b42-94ba-43b005c71751 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:46.183157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d315132f-45e2-4b42-94ba-43b005c71751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:46.205346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315132f-45e2-4b42-94ba-43b005c71751 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:46.211256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f895c-f808-4647-84cb-d387064d48ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:46.211898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f895c-f808-4647-84cb-d387064d48ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:46.212178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f895c-f808-4647-84cb-d387064d48ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:46.212941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f895c-f808-4647-84cb-d387064d48ee admin admin] PATH_INFO: `/v3/users/565b532318284915b742bf70ff2cb226` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:46.214285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f895c-f808-4647-84cb-d387064d48ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=565b532318284915b742bf70ff2cb226)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:46.228313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f895c-f808-4647-84cb-d387064d48ee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:46.292126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c29f895c-f808-4647-84cb-d387064d48ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565b532318284915b742bf70ff2cb226'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:46.316194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c29f895c-f808-4647-84cb-d387064d48ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565b532318284915b742bf70ff2cb226'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:46.317056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c29f895c-f808-4647-84cb-d387064d48ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565b532318284915b742bf70ff2cb226'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:46.319283 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:46.327943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c29f895c-f808-4647-84cb-d387064d48ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565b532318284915b742bf70ff2cb226'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:46.329534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c29f895c-f808-4647-84cb-d387064d48ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565b532318284915b742bf70ff2cb226'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:46.349311 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1903/3785] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:16:46 2022] DELETE /identity/v3/users/565b532318284915b742bf70ff2cb226 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:46.546627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09047998-8e7f-455a-80bc-5b4dfae5fef9 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:46.561331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09047998-8e7f-455a-80bc-5b4dfae5fef9 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:46.649917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:46.650914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:46.651396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:46.651869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] PATH_INFO: `/v3/projects/087deeb5d16442abaf8639044c1b1a46` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:46.653200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] RBAC: Authorizing `identity:delete_project(project_id=087deeb5d16442abaf8639044c1b1a46)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:46.655592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:46.714725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '087deeb5d16442abaf8639044c1b1a46', 'request_id': 'req-6ad7d2e2-e396-4a71-839b-b94650ee540b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:46.724550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '087deeb5d16442abaf8639044c1b1a46', 'request_id': 'req-6ad7d2e2-e396-4a71-839b-b94650ee540b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:46.735915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '087deeb5d16442abaf8639044c1b1a46', 'request_id': 'req-6ad7d2e2-e396-4a71-839b-b94650ee540b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:46.753408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] The token cache is being invalidate because project 087deeb5d16442abaf8639044c1b1a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:16:46.753753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:46.754453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ad7d2e2-e396-4a71-839b-b94650ee540b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:46.756432 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1883/3786] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:16:46 2022] DELETE /identity/v3/projects/087deeb5d16442abaf8639044c1b1a46 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:46.761367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f8f8-0e81-4d4c-a102-938437a5398d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:46.761694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f8f8-0e81-4d4c-a102-938437a5398d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:46.761936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f8f8-0e81-4d4c-a102-938437a5398d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:46.789128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7f16f8f8-0e81-4d4c-a102-938437a5398d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:46.790454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7f16f8f8-0e81-4d4c-a102-938437a5398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:46.880950 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1904/3787] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:46.890510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0187-d3fb-4473-85b3-9a8d07826daf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:46.890906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0187-d3fb-4473-85b3-9a8d07826daf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:46.891175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0187-d3fb-4473-85b3-9a8d07826daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:46.911491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-202f0187-d3fb-4473-85b3-9a8d07826daf None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:46.912979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-202f0187-d3fb-4473-85b3-9a8d07826daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:46.921503 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1884/3788] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:46.925717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16f8f8-0e81-4d4c-a102-938437a5398d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:46.937014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16f8f8-0e81-4d4c-a102-938437a5398d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:46.943685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f7a2-f7c9-4392-a251-0eb75525a563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:46.944849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f7a2-f7c9-4392-a251-0eb75525a563 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:46.945128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f7a2-f7c9-4392-a251-0eb75525a563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:46.945399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f7a2-f7c9-4392-a251-0eb75525a563 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:46.946056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f7a2-f7c9-4392-a251-0eb75525a563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:16:46.946365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f7a2-f7c9-4392-a251-0eb75525a563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:46.948053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f7a2-f7c9-4392-a251-0eb75525a563 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:46.964896 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1905/3789] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:16:46.966119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f0187-d3fb-4473-85b3-9a8d07826daf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:46.977093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f0187-d3fb-4473-85b3-9a8d07826daf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:46.981959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722ac72-4c25-4930-81d6-4354b7c649a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:46.982584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722ac72-4c25-4930-81d6-4354b7c649a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:46.982921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722ac72-4c25-4930-81d6-4354b7c649a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:46.983200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722ac72-4c25-4930-81d6-4354b7c649a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:46.983841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722ac72-4c25-4930-81d6-4354b7c649a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:46.986762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722ac72-4c25-4930-81d6-4354b7c649a6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:47.023875 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1885/3790] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:16:46 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:16:47.028186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f7a2-f7c9-4392-a251-0eb75525a563 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:47.039785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f7a2-f7c9-4392-a251-0eb75525a563 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:47.103839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d1f5e-45c9-494b-bbd5-1f9cc1723155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:47.104472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d1f5e-45c9-494b-bbd5-1f9cc1723155 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:47.104757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d1f5e-45c9-494b-bbd5-1f9cc1723155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:47.105033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d1f5e-45c9-494b-bbd5-1f9cc1723155 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:47.105687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d1f5e-45c9-494b-bbd5-1f9cc1723155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:47.107670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d1f5e-45c9-494b-bbd5-1f9cc1723155 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:47.133133 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1906/3791] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:16:47 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:16:47.137532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722ac72-4c25-4930-81d6-4354b7c649a6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:47.150030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722ac72-4c25-4930-81d6-4354b7c649a6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:47.154929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd262de3-2266-45d2-9033-ae81fe12fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:47.155692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd262de3-2266-45d2-9033-ae81fe12fb52 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:47.155972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd262de3-2266-45d2-9033-ae81fe12fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:47.156242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd262de3-2266-45d2-9033-ae81fe12fb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:47.156892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd262de3-2266-45d2-9033-ae81fe12fb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:47.158511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd262de3-2266-45d2-9033-ae81fe12fb52 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:47.173115 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1886/3792] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:16:47.174318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d1f5e-45c9-494b-bbd5-1f9cc1723155 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:47.186282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d1f5e-45c9-494b-bbd5-1f9cc1723155 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:47.191660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d9923-d2f1-4cf8-ac7a-4f28b7378142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:47.192272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d9923-d2f1-4cf8-ac7a-4f28b7378142 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:47.192554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d9923-d2f1-4cf8-ac7a-4f28b7378142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:47.192830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d9923-d2f1-4cf8-ac7a-4f28b7378142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:47.193471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d9923-d2f1-4cf8-ac7a-4f28b7378142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:47.195473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d9923-d2f1-4cf8-ac7a-4f28b7378142 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:47.210539 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1907/3793] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:16:47.211759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd262de3-2266-45d2-9033-ae81fe12fb52 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:47.222637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd262de3-2266-45d2-9033-ae81fe12fb52 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:47.232837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90eae7-64d7-4c42-96d5-11a9e279ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:47.233581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90eae7-64d7-4c42-96d5-11a9e279ce88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:47.233864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90eae7-64d7-4c42-96d5-11a9e279ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:47.234149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90eae7-64d7-4c42-96d5-11a9e279ce88 admin admin] PATH_INFO: `/v3/projects/94224832aed24d2f83c72250cbfb4a4f/users/63e0eaf9b9e34b8d80e9ddadd09989fa/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:47.251227 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:47.256097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90eae7-64d7-4c42-96d5-11a9e279ce88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94224832aed24d2f83c72250cbfb4a4f, user_id=63e0eaf9b9e34b8d80e9ddadd09989fa, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:47.260516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90eae7-64d7-4c42-96d5-11a9e279ce88 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:47.286582 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1887/3794] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:16:47 2022] PUT /identity/v3/projects/94224832aed24d2f83c72250cbfb4a4f/users/63e0eaf9b9e34b8d80e9ddadd09989fa/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:47.291501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40fe93-2081-43f8-9a72-2ec392042db9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:47.291715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40fe93-2081-43f8-9a72-2ec392042db9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:47.292263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40fe93-2081-43f8-9a72-2ec392042db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:47.314480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3c40fe93-2081-43f8-9a72-2ec392042db9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:47.315999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3c40fe93-2081-43f8-9a72-2ec392042db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:47.363080 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:47.389282 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1908/3795] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:47.400331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90eae7-64d7-4c42-96d5-11a9e279ce88 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:47.402178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1e90eae7-64d7-4c42-96d5-11a9e279ce88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:47.463933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90eae7-64d7-4c42-96d5-11a9e279ce88 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:47.467621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacd2cf-bdbc-409b-8eea-a99b38647def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:47.468286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacd2cf-bdbc-409b-8eea-a99b38647def service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:47.468572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacd2cf-bdbc-409b-8eea-a99b38647def service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:47.468842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacd2cf-bdbc-409b-8eea-a99b38647def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:47.479049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacd2cf-bdbc-409b-8eea-a99b38647def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:47.480647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacd2cf-bdbc-409b-8eea-a99b38647def service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:47.493502 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1888/3796] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:49.271780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f0f87-eac6-487e-b14d-c946aa1b8bbe None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:49.273050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f0f87-eac6-487e-b14d-c946aa1b8bbe None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:49.273249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f0f87-eac6-487e-b14d-c946aa1b8bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:49.378349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7826b4b-0566-4b73-b38e-a556bc75e8b6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:49.379020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7826b4b-0566-4b73-b38e-a556bc75e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:49.379020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7826b4b-0566-4b73-b38e-a556bc75e8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:49.414364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c7826b4b-0566-4b73-b38e-a556bc75e8b6 None None] MFA Rules not processed for user `5104bda5de774e93bd494d64a8f11faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:49.417257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7826b4b-0566-4b73-b38e-a556bc75e8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:49.499290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-945f0f87-eac6-487e-b14d-c946aa1b8bbe None None] MFA Rules not processed for user `7f2fd89c34d84d77b2c0ad9d5ad45390`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:49.500836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-945f0f87-eac6-487e-b14d-c946aa1b8bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:49.576271 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1889/3797] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:49.625536 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1909/3798] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:16:54.557716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7826b4b-0566-4b73-b38e-a556bc75e8b6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:54.560631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7826b4b-0566-4b73-b38e-a556bc75e8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:54.615743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7826b4b-0566-4b73-b38e-a556bc75e8b6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:54.624333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba00d6f-be9d-4805-aac9-ca8f00f6812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:54.625538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00d6f-be9d-4805-aac9-ca8f00f6812e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:54.626019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00d6f-be9d-4805-aac9-ca8f00f6812e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:54.626352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00d6f-be9d-4805-aac9-ca8f00f6812e admin admin] PATH_INFO: `/v3/users/acca7051bf9f4cae9dbd1435a08a57fd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:54.638827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba00d6f-be9d-4805-aac9-ca8f00f6812e admin admin] RBAC: Authorizing `identity:delete_user(user_id=acca7051bf9f4cae9dbd1435a08a57fd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:54.641721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba00d6f-be9d-4805-aac9-ca8f00f6812e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:54.713828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ba00d6f-be9d-4805-aac9-ca8f00f6812e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acca7051bf9f4cae9dbd1435a08a57fd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:54.728888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ba00d6f-be9d-4805-aac9-ca8f00f6812e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acca7051bf9f4cae9dbd1435a08a57fd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:54.730765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ba00d6f-be9d-4805-aac9-ca8f00f6812e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acca7051bf9f4cae9dbd1435a08a57fd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:54.740253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ba00d6f-be9d-4805-aac9-ca8f00f6812e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acca7051bf9f4cae9dbd1435a08a57fd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:54.750562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ba00d6f-be9d-4805-aac9-ca8f00f6812e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acca7051bf9f4cae9dbd1435a08a57fd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:54.758485 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1890/3799] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:16:54 2022] DELETE /identity/v3/users/acca7051bf9f4cae9dbd1435a08a57fd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:55.709284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f0f87-eac6-487e-b14d-c946aa1b8bbe None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:55.724086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f0f87-eac6-487e-b14d-c946aa1b8bbe None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:55.850019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:55.853747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:55.854763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:55.855292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] PATH_INFO: `/v3/projects/33dead72204946dd9bb526d037b4f0a0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:55.859492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] RBAC: Authorizing `identity:delete_project(project_id=33dead72204946dd9bb526d037b4f0a0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:55.863987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:55.950997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33dead72204946dd9bb526d037b4f0a0', 'request_id': 'req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:55.962728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33dead72204946dd9bb526d037b4f0a0', 'request_id': 'req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:55.978488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33dead72204946dd9bb526d037b4f0a0', 'request_id': 'req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:56.020708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] The token cache is being invalidate because project 33dead72204946dd9bb526d037b4f0a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:16:56.021032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:56.022894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1cd66ef3-9b5b-4971-ad13-c5fc3f85a53a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:16:56.038791 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1910/3800] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:16:55 2022] DELETE /identity/v3/projects/33dead72204946dd9bb526d037b4f0a0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:16:56.039012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cd58-a6df-4afd-8d10-5f6c25f66285 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:56.039012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cd58-a6df-4afd-8d10-5f6c25f66285 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:56.039012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cd58-a6df-4afd-8d10-5f6c25f66285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:56.071419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8627cd58-a6df-4afd-8d10-5f6c25f66285 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:56.072667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8627cd58-a6df-4afd-8d10-5f6c25f66285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:56.077564 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:56.164626 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1891/3801] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:16:56.172224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560e1ca-917f-462c-bace-7154d18cb97b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:56.172791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560e1ca-917f-462c-bace-7154d18cb97b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:56.173199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560e1ca-917f-462c-bace-7154d18cb97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:56.196404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f560e1ca-917f-462c-bace-7154d18cb97b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:56.197737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f560e1ca-917f-462c-bace-7154d18cb97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:56.207131 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1911/3802] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:56.211408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627cd58-a6df-4afd-8d10-5f6c25f66285 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:56.227372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627cd58-a6df-4afd-8d10-5f6c25f66285 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:56.233145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e83345-f361-42d1-a057-147f8908d7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:56.234165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e83345-f361-42d1-a057-147f8908d7de admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:56.234649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e83345-f361-42d1-a057-147f8908d7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:56.235404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e83345-f361-42d1-a057-147f8908d7de admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:56.239468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e83345-f361-42d1-a057-147f8908d7de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:16:56.240364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e83345-f361-42d1-a057-147f8908d7de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:56.242844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e83345-f361-42d1-a057-147f8908d7de admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:56.262004 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1892/3803] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:16:56.267565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560e1ca-917f-462c-bace-7154d18cb97b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:56.281538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560e1ca-917f-462c-bace-7154d18cb97b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:56.296657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1d3e9-761c-4da6-8145-4ecd0505bdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:56.298750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1d3e9-761c-4da6-8145-4ecd0505bdb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:56.299145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1d3e9-761c-4da6-8145-4ecd0505bdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:56.300004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1d3e9-761c-4da6-8145-4ecd0505bdb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:56.301069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1d3e9-761c-4da6-8145-4ecd0505bdb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:56.305589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1d3e9-761c-4da6-8145-4ecd0505bdb7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:56.340954 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:56.362226 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1912/3804] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:16:56 2022] POST /identity/v3/projects => generated 395 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:16:56.366902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e83345-f361-42d1-a057-147f8908d7de admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:56.378758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e83345-f361-42d1-a057-147f8908d7de admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:56.451035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f8179-84fa-4d53-a2c9-ad236a7909d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:56.451906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f8179-84fa-4d53-a2c9-ad236a7909d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:56.452414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f8179-84fa-4d53-a2c9-ad236a7909d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:56.453665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f8179-84fa-4d53-a2c9-ad236a7909d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:56.454863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f8179-84fa-4d53-a2c9-ad236a7909d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:56.457045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f8179-84fa-4d53-a2c9-ad236a7909d3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:56.501129 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1893/3805] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:16:56 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:16:56.513899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1d3e9-761c-4da6-8145-4ecd0505bdb7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:56.539944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1d3e9-761c-4da6-8145-4ecd0505bdb7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:56.545020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b472cd-1bdb-4409-8e59-3d84b5c9aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:56.545644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b472cd-1bdb-4409-8e59-3d84b5c9aa1f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:56.545970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b472cd-1bdb-4409-8e59-3d84b5c9aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:56.546244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b472cd-1bdb-4409-8e59-3d84b5c9aa1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:56.546918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b472cd-1bdb-4409-8e59-3d84b5c9aa1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:56.548582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b472cd-1bdb-4409-8e59-3d84b5c9aa1f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:56.563007 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1913/3806] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:16:56.566660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f8179-84fa-4d53-a2c9-ad236a7909d3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:56.580757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f8179-84fa-4d53-a2c9-ad236a7909d3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:56.588242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e4c20-c028-4ebb-b7c8-fde36f1930bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:56.588874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4c20-c028-4ebb-b7c8-fde36f1930bc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:56.589237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4c20-c028-4ebb-b7c8-fde36f1930bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:56.589508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4c20-c028-4ebb-b7c8-fde36f1930bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:56.590156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e4c20-c028-4ebb-b7c8-fde36f1930bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:56.592033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e4c20-c028-4ebb-b7c8-fde36f1930bc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:56.609318 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1894/3807] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:16:56.609876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b472cd-1bdb-4409-8e59-3d84b5c9aa1f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:56.624193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b472cd-1bdb-4409-8e59-3d84b5c9aa1f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:56.629904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef47bfe-b293-4487-b430-34bf03bd4ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:56.630327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef47bfe-b293-4487-b430-34bf03bd4ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:56.630634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef47bfe-b293-4487-b430-34bf03bd4ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:56.630953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef47bfe-b293-4487-b430-34bf03bd4ccf admin admin] PATH_INFO: `/v3/projects/f302c6ba27b649e995c9f2efc56ddc80/users/e67fb3437fbc41129b85e8937f21e560/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:56.676486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef47bfe-b293-4487-b430-34bf03bd4ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f302c6ba27b649e995c9f2efc56ddc80, user_id=e67fb3437fbc41129b85e8937f21e560, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:56.679484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef47bfe-b293-4487-b430-34bf03bd4ccf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:56.734633 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1914/3808] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:16:56 2022] PUT /identity/v3/projects/f302c6ba27b649e995c9f2efc56ddc80/users/e67fb3437fbc41129b85e8937f21e560/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:16:56.741442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228a37-5230-4e3d-a97a-fad440be6393 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:56.741853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228a37-5230-4e3d-a97a-fad440be6393 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:56.742235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228a37-5230-4e3d-a97a-fad440be6393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:56.775279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b1228a37-5230-4e3d-a97a-fad440be6393 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:56.776569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b1228a37-5230-4e3d-a97a-fad440be6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:56.912930 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1895/3809] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:16:56.993730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef47bfe-b293-4487-b430-34bf03bd4ccf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:16:56.995524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6ef47bfe-b293-4487-b430-34bf03bd4ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:57.113067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef47bfe-b293-4487-b430-34bf03bd4ccf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:16:57.125589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261ff69-2ab6-4bf4-8251-0edf8348f83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:16:57.126223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261ff69-2ab6-4bf4-8251-0edf8348f83f service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:57.126563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261ff69-2ab6-4bf4-8251-0edf8348f83f service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:57.126863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261ff69-2ab6-4bf4-8251-0edf8348f83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:57.145664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261ff69-2ab6-4bf4-8251-0edf8348f83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:16:57.148212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261ff69-2ab6-4bf4-8251-0edf8348f83f service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:16:57.179462 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1915/3810] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:16:59.631230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc1b30-c218-434c-b1d1-5db82d36afd3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:16:59.631230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc1b30-c218-434c-b1d1-5db82d36afd3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:16:59.631949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc1b30-c218-434c-b1d1-5db82d36afd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:16:59.685771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-93cc1b30-c218-434c-b1d1-5db82d36afd3 None None] MFA Rules not processed for user `db9450c53d8944b88cfbbc541f585ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:16:59.687304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93cc1b30-c218-434c-b1d1-5db82d36afd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:16:59.722563 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:16:59.818294 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1896/3811] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:00.083132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af699fd8-52ab-49fa-a7c9-9fe18d00a605 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:00.083618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af699fd8-52ab-49fa-a7c9-9fe18d00a605 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:00.083723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af699fd8-52ab-49fa-a7c9-9fe18d00a605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:00.157402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-af699fd8-52ab-49fa-a7c9-9fe18d00a605 None None] MFA Rules not processed for user `63e0eaf9b9e34b8d80e9ddadd09989fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:00.158697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-af699fd8-52ab-49fa-a7c9-9fe18d00a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:00.339608 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1916/3812] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:00.442526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc1b30-c218-434c-b1d1-5db82d36afd3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:00.444305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93cc1b30-c218-434c-b1d1-5db82d36afd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:00.537069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc1b30-c218-434c-b1d1-5db82d36afd3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:00.543804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cb065-7eb1-4a72-aca4-5a6f01103a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:00.544434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cb065-7eb1-4a72-aca4-5a6f01103a44 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:00.544783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cb065-7eb1-4a72-aca4-5a6f01103a44 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:00.545061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cb065-7eb1-4a72-aca4-5a6f01103a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:00.554455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cb065-7eb1-4a72-aca4-5a6f01103a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:00.556163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cb065-7eb1-4a72-aca4-5a6f01103a44 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:00.568515 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1897/3813] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:02.655253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7f329-3731-41aa-8932-6d1bbeb11517 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:02.655717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7f329-3731-41aa-8932-6d1bbeb11517 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:02.655952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7f329-3731-41aa-8932-6d1bbeb11517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:02.693837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dee7f329-3731-41aa-8932-6d1bbeb11517 None None] MFA Rules not processed for user `63e0eaf9b9e34b8d80e9ddadd09989fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:02.699808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dee7f329-3731-41aa-8932-6d1bbeb11517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:02.739765 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1917/3814] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:17:08.377903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d297e0-135b-4f0c-a3a7-79c39c49c2a8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:08.381344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d297e0-135b-4f0c-a3a7-79c39c49c2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:08.382748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d297e0-135b-4f0c-a3a7-79c39c49c2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:08.476194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-68d297e0-135b-4f0c-a3a7-79c39c49c2a8 None None] MFA Rules not processed for user `e67fb3437fbc41129b85e8937f21e560`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:08.480146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-68d297e0-135b-4f0c-a3a7-79c39c49c2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:08.679148 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1898/3815] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:08.758890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7f329-3731-41aa-8932-6d1bbeb11517 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:08.780942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7f329-3731-41aa-8932-6d1bbeb11517 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:08.790065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8a210-158d-4d21-ab5a-14280254530d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:08.791008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a210-158d-4d21-ab5a-14280254530d service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:08.791441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a210-158d-4d21-ab5a-14280254530d service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:08.791821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a210-158d-4d21-ab5a-14280254530d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:08.808334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8a210-158d-4d21-ab5a-14280254530d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:08.813581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8a210-158d-4d21-ab5a-14280254530d service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:08.851208 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1918/3816] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:08 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:10.709255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d232c-5f45-4915-b7e8-e1d9957d46b1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:10.710672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d232c-5f45-4915-b7e8-e1d9957d46b1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:10.711173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d232c-5f45-4915-b7e8-e1d9957d46b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:10.754684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6b0d232c-5f45-4915-b7e8-e1d9957d46b1 None None] MFA Rules not processed for user `5104bda5de774e93bd494d64a8f11faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:10.759327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b0d232c-5f45-4915-b7e8-e1d9957d46b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:10.869544 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:10.900841 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1899/3817] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:12.896956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fac7d0-4b8d-4600-b9c7-c1c7516aa4c1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:12.898445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fac7d0-4b8d-4600-b9c7-c1c7516aa4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:12.899063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fac7d0-4b8d-4600-b9c7-c1c7516aa4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:12.921752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-38fac7d0-4b8d-4600-b9c7-c1c7516aa4c1 None None] MFA Rules not processed for user `66a9d6a142d444be90b2101f23603522`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:12.923403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-38fac7d0-4b8d-4600-b9c7-c1c7516aa4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:12.979055 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:13.012313 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1919/3818] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:17:20.902637 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=9 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:21.640995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d232c-5f45-4915-b7e8-e1d9957d46b1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:21.642564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b0d232c-5f45-4915-b7e8-e1d9957d46b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:21.688084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d232c-5f45-4915-b7e8-e1d9957d46b1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:21.698469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:21.699753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:21.701823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:21.702418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] PATH_INFO: `/v3/users/39f8d72cfddb4f4c84f40e02574c3410` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:21.704604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f8d72cfddb4f4c84f40e02574c3410)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:21.707317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:21.810957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fac7d0-4b8d-4600-b9c7-c1c7516aa4c1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:21.824332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f8d72cfddb4f4c84f40e02574c3410'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:21.836609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fac7d0-4b8d-4600-b9c7-c1c7516aa4c1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:21.848989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd8fc3-af2d-4b0b-a301-4abe5d05d7df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:21.850226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd8fc3-af2d-4b0b-a301-4abe5d05d7df service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:21.850891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd8fc3-af2d-4b0b-a301-4abe5d05d7df service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:21.852577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd8fc3-af2d-4b0b-a301-4abe5d05d7df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:21.857835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c0cd8fc3-af2d-4b0b-a301-4abe5d05d7df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:21.872238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f8d72cfddb4f4c84f40e02574c3410'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:21.873930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f8d72cfddb4f4c84f40e02574c3410'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:21.879465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd8fc3-af2d-4b0b-a301-4abe5d05d7df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:21.885218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd8fc3-af2d-4b0b-a301-4abe5d05d7df service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:21.887284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f8d72cfddb4f4c84f40e02574c3410'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:21.899315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f8d72cfddb4f4c84f40e02574c3410'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:21.913525 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1900/3819] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:21 2022] DELETE /identity/v3/users/39f8d72cfddb4f4c84f40e02574c3410 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:21.919427 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1920/3820] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:17:22.595924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:22.597016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:22.709798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0068a-a4c8-49b0-b7aa-609ecab3f8b0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:22.719014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:22.719689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:22.719970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:22.720247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] PATH_INFO: `/v3/projects/52c591d1679f478981bbe151f38dcb2f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:22.721448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c591d1679f478981bbe151f38dcb2f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:22.723515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:22.784685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c591d1679f478981bbe151f38dcb2f', 'request_id': 'req-bc7eec23-4665-496b-a5eb-a707f68dc2d0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:22.791807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c591d1679f478981bbe151f38dcb2f', 'request_id': 'req-bc7eec23-4665-496b-a5eb-a707f68dc2d0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:22.799900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c591d1679f478981bbe151f38dcb2f', 'request_id': 'req-bc7eec23-4665-496b-a5eb-a707f68dc2d0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:22.820316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] The token cache is being invalidate because project 52c591d1679f478981bbe151f38dcb2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:22.820988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:22.821915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc7eec23-4665-496b-a5eb-a707f68dc2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:22.824072 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1901/3821] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:22 2022] DELETE /identity/v3/projects/52c591d1679f478981bbe151f38dcb2f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:22.830433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be53ea-e54a-4195-8284-11d415eaf506 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:22.831397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be53ea-e54a-4195-8284-11d415eaf506 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:22.831885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be53ea-e54a-4195-8284-11d415eaf506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:22.859369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-04be53ea-e54a-4195-8284-11d415eaf506 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:22.860874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-04be53ea-e54a-4195-8284-11d415eaf506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:22.957957 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1921/3822] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:22.960020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09474614-5910-4ccf-9d34-47d3ca141eaf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:22.960998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09474614-5910-4ccf-9d34-47d3ca141eaf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:22.961177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09474614-5910-4ccf-9d34-47d3ca141eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:22.976545 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:23.007791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-09474614-5910-4ccf-9d34-47d3ca141eaf None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:23.009037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-09474614-5910-4ccf-9d34-47d3ca141eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:23.027715 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1902/3823] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:17:23.029410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be53ea-e54a-4195-8284-11d415eaf506 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:23.046447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be53ea-e54a-4195-8284-11d415eaf506 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:23.053107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119e4f1-1aeb-41f1-a42c-c363b0879de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:23.054852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e4f1-1aeb-41f1-a42c-c363b0879de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:23.056051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e4f1-1aeb-41f1-a42c-c363b0879de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:23.056874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e4f1-1aeb-41f1-a42c-c363b0879de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:23.057839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119e4f1-1aeb-41f1-a42c-c363b0879de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:17:23.058372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119e4f1-1aeb-41f1-a42c-c363b0879de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:23.060222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119e4f1-1aeb-41f1-a42c-c363b0879de1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:23.076014 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1922/3824] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:23.080554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09474614-5910-4ccf-9d34-47d3ca141eaf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:23.094181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09474614-5910-4ccf-9d34-47d3ca141eaf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:23.100831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119e4f1-1aeb-41f1-a42c-c363b0879de1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:23.103119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9119e4f1-1aeb-41f1-a42c-c363b0879de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:23.110052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260befdf-ec1e-431b-b0ff-668180661599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:23.110712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260befdf-ec1e-431b-b0ff-668180661599 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:23.111000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260befdf-ec1e-431b-b0ff-668180661599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:23.111273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260befdf-ec1e-431b-b0ff-668180661599 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:23.111914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260befdf-ec1e-431b-b0ff-668180661599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:23.113825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260befdf-ec1e-431b-b0ff-668180661599 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:23.123887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119e4f1-1aeb-41f1-a42c-c363b0879de1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:23.129493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:23.130916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:23.131285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:23.131699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] PATH_INFO: `/v3/users/e67fb3437fbc41129b85e8937f21e560` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:23.133631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67fb3437fbc41129b85e8937f21e560)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:23.135894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:23.184499 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1903/3825] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:23 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:23.188584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260befdf-ec1e-431b-b0ff-668180661599 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:23.207755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67fb3437fbc41129b85e8937f21e560'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:23.251956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67fb3437fbc41129b85e8937f21e560'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:23.252805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67fb3437fbc41129b85e8937f21e560'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:23.266398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67fb3437fbc41129b85e8937f21e560'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:23.267195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67fb3437fbc41129b85e8937f21e560'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:23.300618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260befdf-ec1e-431b-b0ff-668180661599 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:23.305030 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1923/3826] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:23 2022] DELETE /identity/v3/users/e67fb3437fbc41129b85e8937f21e560 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:23.431973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c78ed-116f-4071-94a8-ee02d4ba8ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:23.432660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c78ed-116f-4071-94a8-ee02d4ba8ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:23.432943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c78ed-116f-4071-94a8-ee02d4ba8ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:23.433258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c78ed-116f-4071-94a8-ee02d4ba8ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:23.434699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c78ed-116f-4071-94a8-ee02d4ba8ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:23.437960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c78ed-116f-4071-94a8-ee02d4ba8ca9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:23.474967 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1904/3827] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:23 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:23.476661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:23.479777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:23.513123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fcdf2-9a19-4d83-980b-db3b3febd253 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:23.536956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea883fd-04ce-4a29-a613-76b1b599510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:23.537805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea883fd-04ce-4a29-a613-76b1b599510a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:23.538089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea883fd-04ce-4a29-a613-76b1b599510a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:23.538638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea883fd-04ce-4a29-a613-76b1b599510a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:23.540483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea883fd-04ce-4a29-a613-76b1b599510a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:23.546454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea883fd-04ce-4a29-a613-76b1b599510a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:23.573044 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1924/3828] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:23.579109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c78ed-116f-4071-94a8-ee02d4ba8ca9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:23.595437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c78ed-116f-4071-94a8-ee02d4ba8ca9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:23.605921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03b9b3-99bd-4bdf-8f8e-4d5aa7bac5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:23.606791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b9b3-99bd-4bdf-8f8e-4d5aa7bac5db admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:23.607165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b9b3-99bd-4bdf-8f8e-4d5aa7bac5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:23.607923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b9b3-99bd-4bdf-8f8e-4d5aa7bac5db admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:23.610376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03b9b3-99bd-4bdf-8f8e-4d5aa7bac5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:23.612287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03b9b3-99bd-4bdf-8f8e-4d5aa7bac5db admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:23.646030 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1905/3829] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:23.650089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea883fd-04ce-4a29-a613-76b1b599510a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:23.663397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea883fd-04ce-4a29-a613-76b1b599510a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:23.668671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa102f07-45ed-4a19-bfef-16a7f5ad4855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:23.669798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa102f07-45ed-4a19-bfef-16a7f5ad4855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:23.670275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa102f07-45ed-4a19-bfef-16a7f5ad4855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:23.670853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa102f07-45ed-4a19-bfef-16a7f5ad4855 admin admin] PATH_INFO: `/v3/projects/0077a1893d26425ab0fcf96cb88df1d8/users/b04443b5a09f41f5ae0a187b4d6dc868/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:23.689609 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:23.695737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa102f07-45ed-4a19-bfef-16a7f5ad4855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0077a1893d26425ab0fcf96cb88df1d8, user_id=b04443b5a09f41f5ae0a187b4d6dc868, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:23.699644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa102f07-45ed-4a19-bfef-16a7f5ad4855 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:23.702477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03b9b3-99bd-4bdf-8f8e-4d5aa7bac5db admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:23.704884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b03b9b3-99bd-4bdf-8f8e-4d5aa7bac5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:23.735463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03b9b3-99bd-4bdf-8f8e-4d5aa7bac5db admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:23.742963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:23.745213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:23.745598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:23.746096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] PATH_INFO: `/v3/projects/f302c6ba27b649e995c9f2efc56ddc80` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:23.752520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f302c6ba27b649e995c9f2efc56ddc80)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:23.755021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:23.768396 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1925/3830] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:23 2022] PUT /identity/v3/projects/0077a1893d26425ab0fcf96cb88df1d8/users/b04443b5a09f41f5ae0a187b4d6dc868/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:23.771832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2618-341a-45ba-b4cb-bceb60e4cdd3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:23.772266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2618-341a-45ba-b4cb-bceb60e4cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:23.773331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2618-341a-45ba-b4cb-bceb60e4cdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:23.808251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ab4f2618-341a-45ba-b4cb-bceb60e4cdd3 None None] MFA Rules not processed for user `b04443b5a09f41f5ae0a187b4d6dc868`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:23.810390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ab4f2618-341a-45ba-b4cb-bceb60e4cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:23.821537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f302c6ba27b649e995c9f2efc56ddc80', 'request_id': 'req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:23.826286 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:23.828756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f302c6ba27b649e995c9f2efc56ddc80', 'request_id': 'req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:23.838076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f302c6ba27b649e995c9f2efc56ddc80', 'request_id': 'req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:23.862922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] The token cache is being invalidate because project f302c6ba27b649e995c9f2efc56ddc80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:23.863713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:23.864578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-af9aaaf5-b7e4-4b15-b8c2-22ffdbb02778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:23.871007 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1906/3831] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:23 2022] DELETE /identity/v3/projects/f302c6ba27b649e995c9f2efc56ddc80 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:23.875761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc83d-f69d-4566-b953-b60cd33bd604 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:23.876247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc83d-f69d-4566-b953-b60cd33bd604 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:23.876358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc83d-f69d-4566-b953-b60cd33bd604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:23.903313 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1926/3832] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:23.904993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f2618-341a-45ba-b4cb-bceb60e4cdd3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:23.906583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-653cc83d-f69d-4566-b953-b60cd33bd604 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:23.907848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-653cc83d-f69d-4566-b953-b60cd33bd604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:23.910140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ab4f2618-341a-45ba-b4cb-bceb60e4cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:24.016796 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1907/3833] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:17:24.020650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff649-3d37-4af2-97d7-8421542e6a30 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.021094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff649-3d37-4af2-97d7-8421542e6a30 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.021481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff649-3d37-4af2-97d7-8421542e6a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.051502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ee7ff649-3d37-4af2-97d7-8421542e6a30 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:24.052712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee7ff649-3d37-4af2-97d7-8421542e6a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:24.056400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f2618-341a-45ba-b4cb-bceb60e4cdd3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.064335 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1908/3834] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:24.070865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9789dea-cc70-4f77-880e-c1431594adfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.071098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff649-3d37-4af2-97d7-8421542e6a30 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:24.071676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789dea-cc70-4f77-880e-c1431594adfe admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.072041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789dea-cc70-4f77-880e-c1431594adfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.072420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789dea-cc70-4f77-880e-c1431594adfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.073146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9789dea-cc70-4f77-880e-c1431594adfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.075174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9789dea-cc70-4f77-880e-c1431594adfe admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.089110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff649-3d37-4af2-97d7-8421542e6a30 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.103906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1bf56-6eb7-41f1-9afe-fe18a1343954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.104690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1bf56-6eb7-41f1-9afe-fe18a1343954 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.105056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1bf56-6eb7-41f1-9afe-fe18a1343954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.105439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1bf56-6eb7-41f1-9afe-fe18a1343954 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.106201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1bf56-6eb7-41f1-9afe-fe18a1343954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:17:24.106849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1bf56-6eb7-41f1-9afe-fe18a1343954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.108701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1bf56-6eb7-41f1-9afe-fe18a1343954 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.123949 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1909/3835] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:24.130199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1bf56-6eb7-41f1-9afe-fe18a1343954 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:24.131882 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1927/3836] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:23 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:24.136751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9789dea-cc70-4f77-880e-c1431594adfe admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:24.146773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1bf56-6eb7-41f1-9afe-fe18a1343954 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.292660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9789dea-cc70-4f77-880e-c1431594adfe admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.295302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c6873-6634-47b0-85ee-c9176a20eefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.295935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c6873-6634-47b0-85ee-c9176a20eefd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.296218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c6873-6634-47b0-85ee-c9176a20eefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.296493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c6873-6634-47b0-85ee-c9176a20eefd admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.297132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c6873-6634-47b0-85ee-c9176a20eefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.299098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c6873-6634-47b0-85ee-c9176a20eefd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.300030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dd8e1-3024-4db2-815d-20d65e858e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.301001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd8e1-3024-4db2-815d-20d65e858e51 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.301501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd8e1-3024-4db2-815d-20d65e858e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.302078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd8e1-3024-4db2-815d-20d65e858e51 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.303358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dd8e1-3024-4db2-815d-20d65e858e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.308589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dd8e1-3024-4db2-815d-20d65e858e51 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.327257 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:24.351412 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1928/3837] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:24 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:24.356677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dd8e1-3024-4db2-815d-20d65e858e51 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:24.365689 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1910/3838] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:24 2022] POST /identity/v3/projects => generated 361 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:24.369551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c6873-6634-47b0-85ee-c9176a20eefd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:24.372329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dd8e1-3024-4db2-815d-20d65e858e51 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.482990 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:24.486847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b942db9-6d1a-4173-8d49-4f64507d4d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.488555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b942db9-6d1a-4173-8d49-4f64507d4d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.489659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b942db9-6d1a-4173-8d49-4f64507d4d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.491022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b942db9-6d1a-4173-8d49-4f64507d4d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.496051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b942db9-6d1a-4173-8d49-4f64507d4d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.502887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b942db9-6d1a-4173-8d49-4f64507d4d56 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.519937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c6873-6634-47b0-85ee-c9176a20eefd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.533909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38780-11e7-480f-bca1-b38624f9a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.535320 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1929/3839] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:17:24.536626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38780-11e7-480f-bca1-b38624f9a3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.537167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38780-11e7-480f-bca1-b38624f9a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.538538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38780-11e7-480f-bca1-b38624f9a3f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.539773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b942db9-6d1a-4173-8d49-4f64507d4d56 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:24.542654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab38780-11e7-480f-bca1-b38624f9a3f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.544913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab38780-11e7-480f-bca1-b38624f9a3f4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.555991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b942db9-6d1a-4173-8d49-4f64507d4d56 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.562006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf557f01-1a3f-48be-bf73-87f72941849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.563460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf557f01-1a3f-48be-bf73-87f72941849e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.563843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf557f01-1a3f-48be-bf73-87f72941849e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.564219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf557f01-1a3f-48be-bf73-87f72941849e admin admin] PATH_INFO: `/v3/projects/a920312e7654442c8977ec8b2308ebd7/users/574cf3c461a84520bf0ec0ab88bb4181/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.594798 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1911/3840] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:24 2022] POST /identity/v3/users => generated 281 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:17:24.595742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38780-11e7-480f-bca1-b38624f9a3f4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:24.603530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf557f01-1a3f-48be-bf73-87f72941849e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a920312e7654442c8977ec8b2308ebd7, user_id=574cf3c461a84520bf0ec0ab88bb4181, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.606548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf557f01-1a3f-48be-bf73-87f72941849e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.606902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38780-11e7-480f-bca1-b38624f9a3f4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.613275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee111354-e5cb-4d3f-9898-93d37e35a210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.613909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111354-e5cb-4d3f-9898-93d37e35a210 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.614227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111354-e5cb-4d3f-9898-93d37e35a210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.614502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111354-e5cb-4d3f-9898-93d37e35a210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.615469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee111354-e5cb-4d3f-9898-93d37e35a210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.617811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee111354-e5cb-4d3f-9898-93d37e35a210 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.633441 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1912/3841] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:24.634923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee111354-e5cb-4d3f-9898-93d37e35a210 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:24.646045 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1930/3842] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:24 2022] PUT /identity/v3/projects/a920312e7654442c8977ec8b2308ebd7/users/574cf3c461a84520bf0ec0ab88bb4181/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:17:24.650490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee111354-e5cb-4d3f-9898-93d37e35a210 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.653089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf557f01-1a3f-48be-bf73-87f72941849e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:24.730261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc0c7e-6768-4c36-bc21-5dd66122cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.731251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc0c7e-6768-4c36-bc21-5dd66122cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.731810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc0c7e-6768-4c36-bc21-5dd66122cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.734354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc0c7e-6768-4c36-bc21-5dd66122cd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.735352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc0c7e-6768-4c36-bc21-5dd66122cd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.737141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc0c7e-6768-4c36-bc21-5dd66122cd2d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.755180 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1913/3843] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:24.756190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc0c7e-6768-4c36-bc21-5dd66122cd2d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:24.773313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc0c7e-6768-4c36-bc21-5dd66122cd2d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.780557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf557f01-1a3f-48be-bf73-87f72941849e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.781923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b81b3-3868-4605-b09c-5e1f3aa408fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.783709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b81b3-3868-4605-b09c-5e1f3aa408fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.784353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b81b3-3868-4605-b09c-5e1f3aa408fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.784874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b81b3-3868-4605-b09c-5e1f3aa408fd admin admin] PATH_INFO: `/v3/projects/e812b263238041ef895f226547aa1095/users/486928970829448b901cdaf6b7c071ea/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.786126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66985152-df17-4e24-99af-13bc30959582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.786777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985152-df17-4e24-99af-13bc30959582 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.787051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985152-df17-4e24-99af-13bc30959582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.787319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985152-df17-4e24-99af-13bc30959582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.787962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66985152-df17-4e24-99af-13bc30959582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.789919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66985152-df17-4e24-99af-13bc30959582 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.802778 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1931/3844] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:24.807222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66985152-df17-4e24-99af-13bc30959582 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:24.808616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b81b3-3868-4605-b09c-5e1f3aa408fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e812b263238041ef895f226547aa1095, user_id=486928970829448b901cdaf6b7c071ea, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.814322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b81b3-3868-4605-b09c-5e1f3aa408fd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.818677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66985152-df17-4e24-99af-13bc30959582 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:24.826389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1a34e-8a13-4f0d-8af0-392c0288f6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:24.827406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1a34e-8a13-4f0d-8af0-392c0288f6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.827791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1a34e-8a13-4f0d-8af0-392c0288f6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.827966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1a34e-8a13-4f0d-8af0-392c0288f6f5 admin admin] PATH_INFO: `/v3/projects/a920312e7654442c8977ec8b2308ebd7/users/574cf3c461a84520bf0ec0ab88bb4181/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.830540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1a34e-8a13-4f0d-8af0-392c0288f6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a920312e7654442c8977ec8b2308ebd7, user_id=574cf3c461a84520bf0ec0ab88bb4181, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:24.833449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1a34e-8a13-4f0d-8af0-392c0288f6f5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:24.846107 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1914/3845] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:24 2022] PUT /identity/v3/projects/e812b263238041ef895f226547aa1095/users/486928970829448b901cdaf6b7c071ea/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:24.858761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d5001-556e-480a-b3bf-dcff6e5d2315 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.859129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d5001-556e-480a-b3bf-dcff6e5d2315 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.859824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d5001-556e-480a-b3bf-dcff6e5d2315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.876220 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1932/3846] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:24 2022] PUT /identity/v3/projects/a920312e7654442c8977ec8b2308ebd7/users/574cf3c461a84520bf0ec0ab88bb4181/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:24.877744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aab1f-070d-41ab-a2f4-a2739e499f52 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:24.878036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aab1f-070d-41ab-a2f4-a2739e499f52 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:24.878739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aab1f-070d-41ab-a2f4-a2739e499f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:24.908956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-605d5001-556e-480a-b3bf-dcff6e5d2315 None None] MFA Rules not processed for user `486928970829448b901cdaf6b7c071ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:24.910875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-605d5001-556e-480a-b3bf-dcff6e5d2315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:24.911452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ad6aab1f-070d-41ab-a2f4-a2739e499f52 None None] MFA Rules not processed for user `574cf3c461a84520bf0ec0ab88bb4181`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:24.912640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ad6aab1f-070d-41ab-a2f4-a2739e499f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:24.966537 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:25.008532 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1933/3847] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:25.011438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6aab1f-070d-41ab-a2f4-a2739e499f52 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.022285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6aab1f-070d-41ab-a2f4-a2739e499f52 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.029392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589764a-90fe-4ae1-a637-0b4e7229fcb3 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.030281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589764a-90fe-4ae1-a637-0b4e7229fcb3 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.030806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589764a-90fe-4ae1-a637-0b4e7229fcb3 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.031248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589764a-90fe-4ae1-a637-0b4e7229fcb3 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.032116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589764a-90fe-4ae1-a637-0b4e7229fcb3 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.033298 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-1589764a-90fe-4ae1-a637-0b4e7229fcb3 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:25.033298 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:25.033298 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:25.034197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589764a-90fe-4ae1-a637-0b4e7229fcb3 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.040869 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1915/3848] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:25.059284 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1934/3849] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:25 2022] POST /identity/v3/services => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:17:25.060893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d5001-556e-480a-b3bf-dcff6e5d2315 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.074507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d5001-556e-480a-b3bf-dcff6e5d2315 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.090854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d19953-61c6-4c54-b589-1a2459814c66 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.091857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d19953-61c6-4c54-b589-1a2459814c66 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.092204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d19953-61c6-4c54-b589-1a2459814c66 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.092547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d19953-61c6-4c54-b589-1a2459814c66 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.093279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d19953-61c6-4c54-b589-1a2459814c66 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.094361 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-62d19953-61c6-4c54-b589-1a2459814c66 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:25.094361 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:25.094361 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:25.095472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d19953-61c6-4c54-b589-1a2459814c66 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-62d19953-61c6-4c54-b589-1a2459814c66 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: On instance['enabled']: Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: On instance['enabled']: Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: 'False' Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise error Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application On instance['enabled']: Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application 'False' Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.110302 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 02 01:17:25.112417 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 02 01:17:25.113886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 02 01:17:25.113886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 02 01:17:25.113886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.113886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.113886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.113886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.113886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application On instance['enabled']: Oct 02 01:17:25.113886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application 'False' Oct 02 01:17:25.113886 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.119231 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1916/3850] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:17:25 2022] POST /identity/v3/endpoints => generated 283 bytes in 59 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 02 01:17:25.120885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589764a-90fe-4ae1-a637-0b4e7229fcb3 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.135885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589764a-90fe-4ae1-a637-0b4e7229fcb3 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.142963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fad1d-f367-488b-a52d-ec9562c83d37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.143849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fad1d-f367-488b-a52d-ec9562c83d37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.144139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fad1d-f367-488b-a52d-ec9562c83d37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.144421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fad1d-f367-488b-a52d-ec9562c83d37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.145095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fad1d-f367-488b-a52d-ec9562c83d37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.146100 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-bd8fad1d-f367-488b-a52d-ec9562c83d37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:25.146100 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:25.146100 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:25.147025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fad1d-f367-488b-a52d-ec9562c83d37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-bd8fad1d-f367-488b-a52d-ec9562c83d37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: On instance['enabled']: Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: On instance['enabled']: Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: 'True' Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise error Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application On instance['enabled']: Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application 'True' Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.156145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 02 01:17:25.158074 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 02 01:17:25.162168 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 02 01:17:25.162168 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 02 01:17:25.162168 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.162168 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.162168 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.162168 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.162168 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application On instance['enabled']: Oct 02 01:17:25.162168 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application 'True' Oct 02 01:17:25.162168 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.162168 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1935/3851] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:17:25 2022] POST /identity/v3/endpoints => generated 281 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 02 01:17:25.163291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d19953-61c6-4c54-b589-1a2459814c66 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.176053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d19953-61c6-4c54-b589-1a2459814c66 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.181142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360d245-418c-494c-a410-6e587764f221 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.181883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360d245-418c-494c-a410-6e587764f221 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.182259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360d245-418c-494c-a410-6e587764f221 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.182640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360d245-418c-494c-a410-6e587764f221 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.183430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360d245-418c-494c-a410-6e587764f221 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.185234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360d245-418c-494c-a410-6e587764f221 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.202832 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:25.218289 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-d360d245-418c-494c-a410-6e587764f221 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-283631360. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:17:25.218289 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:17:25.218289 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:25.262685 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1917/3852] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:17:25 2022] POST /identity/v3/endpoints => generated 358 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:25.266362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fad1d-f367-488b-a52d-ec9562c83d37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.281972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fad1d-f367-488b-a52d-ec9562c83d37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.311960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b4ad-5715-4782-bb74-3ac6f79c5a37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.312601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b4ad-5715-4782-bb74-3ac6f79c5a37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.312899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b4ad-5715-4782-bb74-3ac6f79c5a37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.313159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b4ad-5715-4782-bb74-3ac6f79c5a37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/regions/tempest-region-283631360` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.313795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85b4ad-5715-4782-bb74-3ac6f79c5a37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-283631360)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.314894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85b4ad-5715-4782-bb74-3ac6f79c5a37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.316784 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1936/3853] 10.222.0.23 () {58 vars in 1203 bytes} [Sun Oct 2 01:17:25 2022] GET /identity/v3/regions/tempest-region-283631360 => generated 178 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:25.321245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360d245-418c-494c-a410-6e587764f221 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.334916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360d245-418c-494c-a410-6e587764f221 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.341987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682cd0d-e1cc-4515-9a49-55c9a4abe0a1 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.342764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682cd0d-e1cc-4515-9a49-55c9a4abe0a1 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.343196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682cd0d-e1cc-4515-9a49-55c9a4abe0a1 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.343574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682cd0d-e1cc-4515-9a49-55c9a4abe0a1 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/endpoints/8682a56776c945df9439ea947099fbf6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.352742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682cd0d-e1cc-4515-9a49-55c9a4abe0a1 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=8682a56776c945df9439ea947099fbf6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.354349 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-f682cd0d-e1cc-4515-9a49-55c9a4abe0a1 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:25.354349 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:25.354349 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:25.355189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682cd0d-e1cc-4515-9a49-55c9a4abe0a1 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f682cd0d-e1cc-4515-9a49-55c9a4abe0a1 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: On instance['enabled']: Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: On instance['enabled']: Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: 'False' Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise error Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application On instance['enabled']: Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application 'False' Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.362891 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 02 01:17:25.364821 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 02 01:17:25.366173 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 02 01:17:25.366173 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 02 01:17:25.366173 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.366173 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.366173 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.366173 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.366173 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application On instance['enabled']: Oct 02 01:17:25.366173 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application 'False' Oct 02 01:17:25.366173 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:25.367794 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1918/3854] 10.222.0.23 () {60 vars in 1255 bytes} [Sun Oct 2 01:17:25 2022] PATCH /identity/v3/endpoints/8682a56776c945df9439ea947099fbf6 => generated 283 bytes in 47 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 02 01:17:25.371585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b4ad-5715-4782-bb74-3ac6f79c5a37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.384024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b4ad-5715-4782-bb74-3ac6f79c5a37 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.392656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a80cff-5b81-4107-9ef2-eb2a798b8d15 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.393425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a80cff-5b81-4107-9ef2-eb2a798b8d15 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.393803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a80cff-5b81-4107-9ef2-eb2a798b8d15 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.394172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a80cff-5b81-4107-9ef2-eb2a798b8d15 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/endpoints/8682a56776c945df9439ea947099fbf6` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.395647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a80cff-5b81-4107-9ef2-eb2a798b8d15 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8682a56776c945df9439ea947099fbf6)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.396822 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-86a80cff-5b81-4107-9ef2-eb2a798b8d15 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:25.396822 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:25.396822 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:25.398064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a80cff-5b81-4107-9ef2-eb2a798b8d15 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.409352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-86a80cff-5b81-4107-9ef2-eb2a798b8d15 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8682a56776c945df9439ea947099fbf6', 'request_id': 'req-86a80cff-5b81-4107-9ef2-eb2a798b8d15'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:25.422067 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1937/3855] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:25 2022] DELETE /identity/v3/endpoints/8682a56776c945df9439ea947099fbf6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:25.425906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682cd0d-e1cc-4515-9a49-55c9a4abe0a1 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.438353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682cd0d-e1cc-4515-9a49-55c9a4abe0a1 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.458158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3774e68-4615-464d-a8a5-02c289debf39 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.458851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3774e68-4615-464d-a8a5-02c289debf39 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.459143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3774e68-4615-464d-a8a5-02c289debf39 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.459420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3774e68-4615-464d-a8a5-02c289debf39 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/regions/tempest-region-283631360` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.460048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3774e68-4615-464d-a8a5-02c289debf39 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-283631360)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.461871 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-f3774e68-4615-464d-a8a5-02c289debf39 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:25.461871 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:25.461871 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:25.462954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3774e68-4615-464d-a8a5-02c289debf39 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.499612 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1919/3856] 10.222.0.23 () {58 vars in 1206 bytes} [Sun Oct 2 01:17:25 2022] DELETE /identity/v3/regions/tempest-region-283631360 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:25.504224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a80cff-5b81-4107-9ef2-eb2a798b8d15 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.531960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a80cff-5b81-4107-9ef2-eb2a798b8d15 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.554154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945188d-b833-4d02-abb1-6d0083d7be85 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.555877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945188d-b833-4d02-abb1-6d0083d7be85 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.556174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945188d-b833-4d02-abb1-6d0083d7be85 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.556455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945188d-b833-4d02-abb1-6d0083d7be85 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.557132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945188d-b833-4d02-abb1-6d0083d7be85 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.558925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945188d-b833-4d02-abb1-6d0083d7be85 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.594096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3774e68-4615-464d-a8a5-02c289debf39 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.596066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f3774e68-4615-464d-a8a5-02c289debf39 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:25.604220 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-1945188d-b833-4d02-abb1-6d0083d7be85 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-24819118. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:17:25.604220 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:17:25.604220 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:25.646397 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1938/3857] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:17:25 2022] POST /identity/v3/endpoints => generated 357 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:25.648240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945188d-b833-4d02-abb1-6d0083d7be85 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.681077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945188d-b833-4d02-abb1-6d0083d7be85 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.687847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a31cfd-f974-424b-a0d2-cd0f0fba30dd tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.688661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31cfd-f974-424b-a0d2-cd0f0fba30dd tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.688999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31cfd-f974-424b-a0d2-cd0f0fba30dd tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.689808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31cfd-f974-424b-a0d2-cd0f0fba30dd tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/regions/tempest-region-24819118` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.691945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a31cfd-f974-424b-a0d2-cd0f0fba30dd tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-24819118)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.693074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a31cfd-f974-424b-a0d2-cd0f0fba30dd tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.700974 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1939/3858] 10.222.0.23 () {58 vars in 1200 bytes} [Sun Oct 2 01:17:25 2022] GET /identity/v3/regions/tempest-region-24819118 => generated 176 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:17:25.702149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a31cfd-f974-424b-a0d2-cd0f0fba30dd tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.717630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a31cfd-f974-424b-a0d2-cd0f0fba30dd tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.723853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35134cf9-4e12-4df1-bb9e-dec614f5508f tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.724507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35134cf9-4e12-4df1-bb9e-dec614f5508f tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.724795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35134cf9-4e12-4df1-bb9e-dec614f5508f tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.725066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35134cf9-4e12-4df1-bb9e-dec614f5508f tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/endpoints/1cfd3f49fa2847b0ae89a9fe4c18e121` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.732621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35134cf9-4e12-4df1-bb9e-dec614f5508f tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=1cfd3f49fa2847b0ae89a9fe4c18e121)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.733975 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-35134cf9-4e12-4df1-bb9e-dec614f5508f tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:25.733975 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:25.733975 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:25.735094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35134cf9-4e12-4df1-bb9e-dec614f5508f tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-35134cf9-4e12-4df1-bb9e-dec614f5508f tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: On instance['enabled']: Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: On instance['enabled']: Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: 'True' Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise error Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application On instance['enabled']: Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application 'True' Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.745669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 02 01:17:25.747638 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 02 01:17:25.748774 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 02 01:17:25.748774 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 02 01:17:25.748774 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.748774 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 02 01:17:25.748774 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 02 01:17:25.748774 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.748774 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application On instance['enabled']: Oct 02 01:17:25.748774 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application 'True' Oct 02 01:17:25.748774 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:17:25.751194 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1940/3859] 10.222.0.23 () {60 vars in 1255 bytes} [Sun Oct 2 01:17:25 2022] PATCH /identity/v3/endpoints/1cfd3f49fa2847b0ae89a9fe4c18e121 => generated 281 bytes in 49 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 02 01:17:25.752686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35134cf9-4e12-4df1-bb9e-dec614f5508f tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.765541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35134cf9-4e12-4df1-bb9e-dec614f5508f tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.770571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec8a9b-4aa6-45a6-975e-e9cf1d6f1b08 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.771882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8a9b-4aa6-45a6-975e-e9cf1d6f1b08 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.772182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8a9b-4aa6-45a6-975e-e9cf1d6f1b08 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.772459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8a9b-4aa6-45a6-975e-e9cf1d6f1b08 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/endpoints/1cfd3f49fa2847b0ae89a9fe4c18e121` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.773904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3774e68-4615-464d-a8a5-02c289debf39 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.774496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec8a9b-4aa6-45a6-975e-e9cf1d6f1b08 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=1cfd3f49fa2847b0ae89a9fe4c18e121)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.776172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec8a9b-4aa6-45a6-975e-e9cf1d6f1b08 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.788599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1bec8a9b-4aa6-45a6-975e-e9cf1d6f1b08 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '1cfd3f49fa2847b0ae89a9fe4c18e121', 'request_id': 'req-1bec8a9b-4aa6-45a6-975e-e9cf1d6f1b08'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:25.798638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308401b4-3760-4dc3-b883-955528a4cb4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.799468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308401b4-3760-4dc3-b883-955528a4cb4e service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.799842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308401b4-3760-4dc3-b883-955528a4cb4e service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.800255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308401b4-3760-4dc3-b883-955528a4cb4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.806775 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1941/3860] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:17:25 2022] DELETE /identity/v3/endpoints/1cfd3f49fa2847b0ae89a9fe4c18e121 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:25.811356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec8a9b-4aa6-45a6-975e-e9cf1d6f1b08 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.813902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308401b4-3760-4dc3-b883-955528a4cb4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.815820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308401b4-3760-4dc3-b883-955528a4cb4e service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.842427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec8a9b-4aa6-45a6-975e-e9cf1d6f1b08 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:25.843758 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1920/3861] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:17:25.847929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9d061-d759-4d2c-a43c-ad5886a2b7d7 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:25.848810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9d061-d759-4d2c-a43c-ad5886a2b7d7 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:25.849433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9d061-d759-4d2c-a43c-ad5886a2b7d7 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:25.849878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9d061-d759-4d2c-a43c-ad5886a2b7d7 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/regions/tempest-region-24819118` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:25.851475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9d061-d759-4d2c-a43c-ad5886a2b7d7 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-24819118)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:25.853195 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-20c9d061-d759-4d2c-a43c-ad5886a2b7d7 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:25.853195 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:25.853195 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:25.854529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9d061-d759-4d2c-a43c-ad5886a2b7d7 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:25.901382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308401b4-3760-4dc3-b883-955528a4cb4e service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.903161 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1942/3862] 10.222.0.23 () {58 vars in 1203 bytes} [Sun Oct 2 01:17:25 2022] DELETE /identity/v3/regions/tempest-region-24819118 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:17:25.913393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9d061-d759-4d2c-a43c-ad5886a2b7d7 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:25.992636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9d061-d759-4d2c-a43c-ad5886a2b7d7 tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:26.001280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457b792-6f05-49c8-b855-eff76b055e5b tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '574cf3c461a84520bf0ec0ab88bb4181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a920312e7654442c8977ec8b2308ebd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:26.001858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457b792-6f05-49c8-b855-eff76b055e5b tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:26.002141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457b792-6f05-49c8-b855-eff76b055e5b tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:26.003167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457b792-6f05-49c8-b855-eff76b055e5b tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] PATH_INFO: `/v3/services/207afa06eb23446599985ed628f213f8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:26.003772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457b792-6f05-49c8-b855-eff76b055e5b tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorizing `identity:delete_service(service_id=207afa06eb23446599985ed628f213f8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:26.004958 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-e457b792-6f05-49c8-b855-eff76b055e5b tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:26.004958 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:26.004958 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:26.009040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457b792-6f05-49c8-b855-eff76b055e5b tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:26.040383 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:26.047437 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:26.064623 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1943/3863] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:25 2022] DELETE /identity/v3/services/207afa06eb23446599985ed628f213f8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:26.069444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457b792-6f05-49c8-b855-eff76b055e5b tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:26.080013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308401b4-3760-4dc3-b883-955528a4cb4e service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:26.113453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457b792-6f05-49c8-b855-eff76b055e5b tempest-EndpointsNegativeTestJSON-21627626 tempest-EndpointsNegativeTestJSON-21627626-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:26.122899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574af13-27ef-4afb-a6ad-d9b79c0c8f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:26.123560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574af13-27ef-4afb-a6ad-d9b79c0c8f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:26.123843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574af13-27ef-4afb-a6ad-d9b79c0c8f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:26.125093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574af13-27ef-4afb-a6ad-d9b79c0c8f81 admin admin] PATH_INFO: `/v3/users/486928970829448b901cdaf6b7c071ea` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:26.126990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574af13-27ef-4afb-a6ad-d9b79c0c8f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=486928970829448b901cdaf6b7c071ea)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:26.130810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574af13-27ef-4afb-a6ad-d9b79c0c8f81 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:26.143423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0a37f-f5bb-4662-a391-a01a2d43b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:26.144092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0a37f-f5bb-4662-a391-a01a2d43b2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:26.144381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0a37f-f5bb-4662-a391-a01a2d43b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:26.144666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0a37f-f5bb-4662-a391-a01a2d43b2c4 admin admin] PATH_INFO: `/v3/users/b04443b5a09f41f5ae0a187b4d6dc868` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:26.145945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0a37f-f5bb-4662-a391-a01a2d43b2c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04443b5a09f41f5ae0a187b4d6dc868)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:26.148482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0a37f-f5bb-4662-a391-a01a2d43b2c4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:26.254802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22f0a37f-f5bb-4662-a391-a01a2d43b2c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04443b5a09f41f5ae0a187b4d6dc868'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:26.284936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22f0a37f-f5bb-4662-a391-a01a2d43b2c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04443b5a09f41f5ae0a187b4d6dc868'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:26.285708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22f0a37f-f5bb-4662-a391-a01a2d43b2c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04443b5a09f41f5ae0a187b4d6dc868'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:26.293502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8574af13-27ef-4afb-a6ad-d9b79c0c8f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486928970829448b901cdaf6b7c071ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:26.298832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22f0a37f-f5bb-4662-a391-a01a2d43b2c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04443b5a09f41f5ae0a187b4d6dc868'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:26.299518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22f0a37f-f5bb-4662-a391-a01a2d43b2c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04443b5a09f41f5ae0a187b4d6dc868'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:26.330630 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1944/3864] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:26 2022] DELETE /identity/v3/users/b04443b5a09f41f5ae0a187b4d6dc868 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:17:26.336008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8574af13-27ef-4afb-a6ad-d9b79c0c8f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486928970829448b901cdaf6b7c071ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:26.336638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75138-66d6-4cbf-9953-3ac8a195f27c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:26.337099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8574af13-27ef-4afb-a6ad-d9b79c0c8f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486928970829448b901cdaf6b7c071ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:26.337243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75138-66d6-4cbf-9953-3ac8a195f27c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:26.337588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75138-66d6-4cbf-9953-3ac8a195f27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:26.349782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8574af13-27ef-4afb-a6ad-d9b79c0c8f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486928970829448b901cdaf6b7c071ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:26.360639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8574af13-27ef-4afb-a6ad-d9b79c0c8f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486928970829448b901cdaf6b7c071ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:26.369263 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1921/3865] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:25 2022] DELETE /identity/v3/users/486928970829448b901cdaf6b7c071ea => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:26.374757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8940f59-6f8e-4b82-9c12-c617a69253ab None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:26.375395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8940f59-6f8e-4b82-9c12-c617a69253ab None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:26.375888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8940f59-6f8e-4b82-9c12-c617a69253ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:26.390709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f9e75138-66d6-4cbf-9953-3ac8a195f27c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:26.394636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f9e75138-66d6-4cbf-9953-3ac8a195f27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:26.425933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c8940f59-6f8e-4b82-9c12-c617a69253ab None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:26.428204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8940f59-6f8e-4b82-9c12-c617a69253ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:26.512010 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1922/3866] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:26.512404 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1945/3867] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:17:26.512844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8940f59-6f8e-4b82-9c12-c617a69253ab None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:26.516770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8940f59-6f8e-4b82-9c12-c617a69253ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:26.523287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e75138-66d6-4cbf-9953-3ac8a195f27c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:26.525767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f9e75138-66d6-4cbf-9953-3ac8a195f27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:26.696798 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:26.702130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8940f59-6f8e-4b82-9c12-c617a69253ab None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:26.709054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb160d7-bc28-485c-acc0-49b0b9dafebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:26.709899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb160d7-bc28-485c-acc0-49b0b9dafebc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:26.710515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb160d7-bc28-485c-acc0-49b0b9dafebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:26.711026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb160d7-bc28-485c-acc0-49b0b9dafebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:26.719344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e75138-66d6-4cbf-9953-3ac8a195f27c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:26.727373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb160d7-bc28-485c-acc0-49b0b9dafebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:26.729601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb160d7-bc28-485c-acc0-49b0b9dafebc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:26.739506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8430b4-bd3f-450f-b76b-eb3ffcec0829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:26.740132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8430b4-bd3f-450f-b76b-eb3ffcec0829 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:26.740413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8430b4-bd3f-450f-b76b-eb3ffcec0829 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:26.740685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8430b4-bd3f-450f-b76b-eb3ffcec0829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:26.760431 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1923/3868] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:26.763828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8430b4-bd3f-450f-b76b-eb3ffcec0829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:26.765180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8430b4-bd3f-450f-b76b-eb3ffcec0829 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:26.777960 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:26.793636 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1946/3869] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:27.727673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb160d7-bc28-485c-acc0-49b0b9dafebc service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:27.730585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7bb160d7-bc28-485c-acc0-49b0b9dafebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:27.753453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb160d7-bc28-485c-acc0-49b0b9dafebc service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:27.765400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:27.767764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:27.768322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:27.769507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] PATH_INFO: `/v3/projects/0077a1893d26425ab0fcf96cb88df1d8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:27.772036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0077a1893d26425ab0fcf96cb88df1d8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:27.775370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:27.806658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8430b4-bd3f-450f-b76b-eb3ffcec0829 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:27.808351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fb8430b4-bd3f-450f-b76b-eb3ffcec0829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:27.828900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8430b4-bd3f-450f-b76b-eb3ffcec0829 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:27.845630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:27.846473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:27.846947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:27.847305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] PATH_INFO: `/v3/projects/e812b263238041ef895f226547aa1095` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:27.848568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e812b263238041ef895f226547aa1095)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:27.850689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:27.877423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0077a1893d26425ab0fcf96cb88df1d8', 'request_id': 'req-ce18acf0-9f79-4b56-90e3-7418286c5652'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:27.886869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0077a1893d26425ab0fcf96cb88df1d8', 'request_id': 'req-ce18acf0-9f79-4b56-90e3-7418286c5652'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:27.897534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0077a1893d26425ab0fcf96cb88df1d8', 'request_id': 'req-ce18acf0-9f79-4b56-90e3-7418286c5652'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:27.949499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] The token cache is being invalidate because project 0077a1893d26425ab0fcf96cb88df1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:27.949805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:27.951347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e812b263238041ef895f226547aa1095', 'request_id': 'req-938edc54-c0b3-4ac6-854d-929793236a85'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:27.955823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:27.968677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e812b263238041ef895f226547aa1095', 'request_id': 'req-938edc54-c0b3-4ac6-854d-929793236a85'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:27.981048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e812b263238041ef895f226547aa1095', 'request_id': 'req-938edc54-c0b3-4ac6-854d-929793236a85'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:27.992578 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1924/3870] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:27 2022] DELETE /identity/v3/projects/0077a1893d26425ab0fcf96cb88df1d8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:27.999175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:28.005145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:28.006932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] The token cache is being invalidate because project e812b263238041ef895f226547aa1095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:28.007396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:28.008305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-938edc54-c0b3-4ac6-854d-929793236a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:28.014716 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1947/3871] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:27 2022] DELETE /identity/v3/projects/e812b263238041ef895f226547aa1095 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:28.017096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ecb3c-0607-453d-ba29-956030b8b248 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:28.017096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ecb3c-0607-453d-ba29-956030b8b248 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:28.017096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ecb3c-0607-453d-ba29-956030b8b248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:28.066311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d09ecb3c-0607-453d-ba29-956030b8b248 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:28.068434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d09ecb3c-0607-453d-ba29-956030b8b248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:28.147062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18acf0-9f79-4b56-90e3-7418286c5652 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:28.149630 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1948/3872] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:17:28.157057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103df82-a9cc-4462-aab7-430799e2dd92 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:28.157557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103df82-a9cc-4462-aab7-430799e2dd92 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:28.157991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103df82-a9cc-4462-aab7-430799e2dd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:28.161748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:28.162406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:28.162716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:28.162991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] PATH_INFO: `/v3/users/574cf3c461a84520bf0ec0ab88bb4181` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:28.173134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=574cf3c461a84520bf0ec0ab88bb4181)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:28.177712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:28.181525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d103df82-a9cc-4462-aab7-430799e2dd92 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:28.182899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d103df82-a9cc-4462-aab7-430799e2dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:28.196162 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1949/3873] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:17:28.198370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103df82-a9cc-4462-aab7-430799e2dd92 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:28.211877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103df82-a9cc-4462-aab7-430799e2dd92 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:28.217880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2899e-8679-42ce-9468-8bafac88f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:28.218848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2899e-8679-42ce-9468-8bafac88f751 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:28.219899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2899e-8679-42ce-9468-8bafac88f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:28.220608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2899e-8679-42ce-9468-8bafac88f751 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:28.221439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2899e-8679-42ce-9468-8bafac88f751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:17:28.221856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2899e-8679-42ce-9468-8bafac88f751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:28.223792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2899e-8679-42ce-9468-8bafac88f751 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:28.246369 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1950/3874] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:28.248552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2899e-8679-42ce-9468-8bafac88f751 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:28.280921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2899e-8679-42ce-9468-8bafac88f751 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:28.282352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574cf3c461a84520bf0ec0ab88bb4181'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:28.290185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61c11-10d9-43ec-95f7-75514b23b4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:28.291156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61c11-10d9-43ec-95f7-75514b23b4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:28.291625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61c11-10d9-43ec-95f7-75514b23b4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:28.292176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61c11-10d9-43ec-95f7-75514b23b4d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:28.292853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c61c11-10d9-43ec-95f7-75514b23b4d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:28.296886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c61c11-10d9-43ec-95f7-75514b23b4d7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:28.309903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574cf3c461a84520bf0ec0ab88bb4181'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:28.310705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574cf3c461a84520bf0ec0ab88bb4181'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:28.325632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574cf3c461a84520bf0ec0ab88bb4181'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:28.333377 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:28.338630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574cf3c461a84520bf0ec0ab88bb4181'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:28.350016 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1951/3875] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:28 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:28.351439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61c11-10d9-43ec-95f7-75514b23b4d7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:28.353751 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1925/3876] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:27 2022] DELETE /identity/v3/users/574cf3c461a84520bf0ec0ab88bb4181 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:28.355561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e0c61c11-10d9-43ec-95f7-75514b23b4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:28.465466 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:28.500636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61c11-10d9-43ec-95f7-75514b23b4d7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:28.642488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef80da0-36a2-4321-bd69-50ea84b8eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:28.643231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef80da0-36a2-4321-bd69-50ea84b8eba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:28.643583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef80da0-36a2-4321-bd69-50ea84b8eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:28.643925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef80da0-36a2-4321-bd69-50ea84b8eba0 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:28.644628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef80da0-36a2-4321-bd69-50ea84b8eba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:28.647580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef80da0-36a2-4321-bd69-50ea84b8eba0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:28.713066 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1952/3877] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:28 2022] POST /identity/v3/users => generated 295 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:28.714420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:28.728156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdb99c-a01c-4cc8-a54c-264057378b64 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:28.733233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656120f-2a25-4bc8-aee6-80820dab800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:28.733912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656120f-2a25-4bc8-aee6-80820dab800d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:28.734198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656120f-2a25-4bc8-aee6-80820dab800d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:28.734474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656120f-2a25-4bc8-aee6-80820dab800d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:28.735333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656120f-2a25-4bc8-aee6-80820dab800d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:28.737508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656120f-2a25-4bc8-aee6-80820dab800d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:28.754023 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1926/3878] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:28.755322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef80da0-36a2-4321-bd69-50ea84b8eba0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:28.776505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef80da0-36a2-4321-bd69-50ea84b8eba0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:28.784214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedd045-8bee-42a2-a76d-5353d0206f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:28.784842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedd045-8bee-42a2-a76d-5353d0206f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:28.785122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedd045-8bee-42a2-a76d-5353d0206f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:28.785393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedd045-8bee-42a2-a76d-5353d0206f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:28.786046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedd045-8bee-42a2-a76d-5353d0206f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:28.787870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedd045-8bee-42a2-a76d-5353d0206f6b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:28.802038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656120f-2a25-4bc8-aee6-80820dab800d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:28.804703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2656120f-2a25-4bc8-aee6-80820dab800d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:28.815506 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1953/3879] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:28.816592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedd045-8bee-42a2-a76d-5353d0206f6b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:28.830769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656120f-2a25-4bc8-aee6-80820dab800d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:28.838978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedd045-8bee-42a2-a76d-5353d0206f6b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:28.845691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:28.847136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:28.847294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4edfc-9098-4ea4-a113-2796fd9a012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:28.847644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:28.847925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4edfc-9098-4ea4-a113-2796fd9a012d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:28.848208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4edfc-9098-4ea4-a113-2796fd9a012d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:28.848425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] PATH_INFO: `/v3/projects/a920312e7654442c8977ec8b2308ebd7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:28.848562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4edfc-9098-4ea4-a113-2796fd9a012d admin admin] PATH_INFO: `/v3/projects/aa4f0ad95a5e4ed294828e036dfef60a/users/4bfef22ac4e54465930158887c923f60/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:28.850028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a920312e7654442c8977ec8b2308ebd7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:28.854692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:28.893810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4edfc-9098-4ea4-a113-2796fd9a012d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4f0ad95a5e4ed294828e036dfef60a, user_id=4bfef22ac4e54465930158887c923f60, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:28.901642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4edfc-9098-4ea4-a113-2796fd9a012d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:28.940466 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1954/3880] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:28 2022] PUT /identity/v3/projects/aa4f0ad95a5e4ed294828e036dfef60a/users/4bfef22ac4e54465930158887c923f60/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:17:28.942231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147833df-12ce-4d7a-a762-951db3729479 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:28.942589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147833df-12ce-4d7a-a762-951db3729479 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:28.942962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147833df-12ce-4d7a-a762-951db3729479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:28.993496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-147833df-12ce-4d7a-a762-951db3729479 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:28.993769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a920312e7654442c8977ec8b2308ebd7', 'request_id': 'req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:28.995093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-147833df-12ce-4d7a-a762-951db3729479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:29.026050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a920312e7654442c8977ec8b2308ebd7', 'request_id': 'req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:29.073517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a920312e7654442c8977ec8b2308ebd7', 'request_id': 'req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:29.095151 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1955/3881] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:29.108728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] The token cache is being invalidate because project a920312e7654442c8977ec8b2308ebd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:29.109131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:29.110738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:29.115017 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1927/3882] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:28 2022] DELETE /identity/v3/projects/a920312e7654442c8977ec8b2308ebd7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:29.120290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f400ed-7dae-4f75-b464-bd798e44af98 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:29.120911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f400ed-7dae-4f75-b464-bd798e44af98 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:29.121234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f400ed-7dae-4f75-b464-bd798e44af98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:29.139244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:29.145911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:29.204204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-56f400ed-7dae-4f75-b464-bd798e44af98 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:29.205443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-56f400ed-7dae-4f75-b464-bd798e44af98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:29.241923 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1956/3883] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:29.244074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29acb57-2996-440f-93d4-a17d13226b94 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:29.244368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29acb57-2996-440f-93d4-a17d13226b94 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:29.244644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29acb57-2996-440f-93d4-a17d13226b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:29.269987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a29acb57-2996-440f-93d4-a17d13226b94 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:29.271596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a29acb57-2996-440f-93d4-a17d13226b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:29.298885 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1957/3884] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:29.300676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29acb57-2996-440f-93d4-a17d13226b94 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:29.312324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29acb57-2996-440f-93d4-a17d13226b94 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:29.317158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fa5f1-e0ee-4f1a-9593-4a475a5f8cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:29.317766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fa5f1-e0ee-4f1a-9593-4a475a5f8cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:29.318644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fa5f1-e0ee-4f1a-9593-4a475a5f8cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:29.318882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fa5f1-e0ee-4f1a-9593-4a475a5f8cbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:29.319531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fa5f1-e0ee-4f1a-9593-4a475a5f8cbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:17:29.320969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fa5f1-e0ee-4f1a-9593-4a475a5f8cbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:29.322670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fa5f1-e0ee-4f1a-9593-4a475a5f8cbc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:29.332813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28f5d9-33c6-4c70-96ad-c2c68af3babf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:29.337008 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1958/3885] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:17:29.339358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6aa75-c602-4a5b-a263-7071d16aa0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:29.340447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6aa75-c602-4a5b-a263-7071d16aa0ea service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:29.341436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fa5f1-e0ee-4f1a-9593-4a475a5f8cbc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:29.342816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6aa75-c602-4a5b-a263-7071d16aa0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:29.347363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6aa75-c602-4a5b-a263-7071d16aa0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:29.352234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-18f6aa75-c602-4a5b-a263-7071d16aa0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:29.358629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fa5f1-e0ee-4f1a-9593-4a475a5f8cbc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:29.373957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714020b-4df9-42ac-a74e-b287718ee763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:29.374450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714020b-4df9-42ac-a74e-b287718ee763 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:29.374757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714020b-4df9-42ac-a74e-b287718ee763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:29.375029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714020b-4df9-42ac-a74e-b287718ee763 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:29.375666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714020b-4df9-42ac-a74e-b287718ee763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:29.377579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714020b-4df9-42ac-a74e-b287718ee763 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:29.381404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6aa75-c602-4a5b-a263-7071d16aa0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:29.382899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6aa75-c602-4a5b-a263-7071d16aa0ea service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:29.418567 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1928/3886] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:29.442497 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:29.461314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6aa75-c602-4a5b-a263-7071d16aa0ea service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:29.466207 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1959/3887] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:29 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:29.477851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6aa75-c602-4a5b-a263-7071d16aa0ea service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:29.591286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c303478-7fed-4884-80de-c18f00a5b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:29.592353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c303478-7fed-4884-80de-c18f00a5b8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:29.592866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c303478-7fed-4884-80de-c18f00a5b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:29.593370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c303478-7fed-4884-80de-c18f00a5b8e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:29.595127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c303478-7fed-4884-80de-c18f00a5b8e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:29.599097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c303478-7fed-4884-80de-c18f00a5b8e1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:29.623042 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:29.633413 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1929/3888] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:29 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:29.638669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714020b-4df9-42ac-a74e-b287718ee763 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:29.650768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714020b-4df9-42ac-a74e-b287718ee763 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:29.666316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ce506-96cd-47b4-940f-716799d1f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:29.669411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ce506-96cd-47b4-940f-716799d1f94d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:29.669971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ce506-96cd-47b4-940f-716799d1f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:29.670667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ce506-96cd-47b4-940f-716799d1f94d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:29.673553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ce506-96cd-47b4-940f-716799d1f94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:29.677066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ce506-96cd-47b4-940f-716799d1f94d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:29.704008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c303478-7fed-4884-80de-c18f00a5b8e1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:29.720733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c303478-7fed-4884-80de-c18f00a5b8e1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:29.722258 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1960/3889] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:29.736678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7454cc2-63ef-4fd5-81f5-2540b99a97dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:29.737465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7454cc2-63ef-4fd5-81f5-2540b99a97dc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:29.737754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7454cc2-63ef-4fd5-81f5-2540b99a97dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:29.738033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7454cc2-63ef-4fd5-81f5-2540b99a97dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:29.738807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7454cc2-63ef-4fd5-81f5-2540b99a97dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:29.740865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7454cc2-63ef-4fd5-81f5-2540b99a97dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:29.768727 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1930/3890] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:29.774903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ce506-96cd-47b4-940f-716799d1f94d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:29.795084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ce506-96cd-47b4-940f-716799d1f94d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:29.809097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcba31-9db0-4c6f-bac1-f74469a22ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:29.809836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcba31-9db0-4c6f-bac1-f74469a22ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:29.810112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcba31-9db0-4c6f-bac1-f74469a22ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:29.810383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcba31-9db0-4c6f-bac1-f74469a22ef2 admin admin] PATH_INFO: `/v3/projects/e00db0b99140441586d38960284a8b8a/users/e4e17687a6a74b2fafc3f9b98d414f65/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:29.838829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcba31-9db0-4c6f-bac1-f74469a22ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00db0b99140441586d38960284a8b8a, user_id=e4e17687a6a74b2fafc3f9b98d414f65, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:29.842236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcba31-9db0-4c6f-bac1-f74469a22ef2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:29.862025 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1961/3891] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:29 2022] PUT /identity/v3/projects/e00db0b99140441586d38960284a8b8a/users/e4e17687a6a74b2fafc3f9b98d414f65/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:29.875986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f3489-d293-4c09-abe4-483fddd42dc0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:29.876650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f3489-d293-4c09-abe4-483fddd42dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:29.877328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f3489-d293-4c09-abe4-483fddd42dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:29.926634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c03f3489-d293-4c09-abe4-483fddd42dc0 None None] MFA Rules not processed for user `e4e17687a6a74b2fafc3f9b98d414f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:29.929266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c03f3489-d293-4c09-abe4-483fddd42dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:30.052625 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1931/3892] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:30.057218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcba31-9db0-4c6f-bac1-f74469a22ef2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:30.290545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcba31-9db0-4c6f-bac1-f74469a22ef2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:30.320845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147247e-fd02-4123-929a-7915e5ef5077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:30.324546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147247e-fd02-4123-929a-7915e5ef5077 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:30.325282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147247e-fd02-4123-929a-7915e5ef5077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:30.329037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147247e-fd02-4123-929a-7915e5ef5077 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:30.330560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147247e-fd02-4123-929a-7915e5ef5077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:30.343098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147247e-fd02-4123-929a-7915e5ef5077 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:30.439763 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1962/3893] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:30 2022] POST /identity/v3/projects => generated 369 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:30.442315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f3489-d293-4c09-abe4-483fddd42dc0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:30.471549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f3489-d293-4c09-abe4-483fddd42dc0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:30.589134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60edab4-b738-4fb2-bd7f-c092c67410cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:30.590485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60edab4-b738-4fb2-bd7f-c092c67410cf admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:30.591368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60edab4-b738-4fb2-bd7f-c092c67410cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:30.592060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60edab4-b738-4fb2-bd7f-c092c67410cf admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:30.593375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60edab4-b738-4fb2-bd7f-c092c67410cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:30.599626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60edab4-b738-4fb2-bd7f-c092c67410cf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:30.651474 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1932/3894] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:30 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:17:30.652841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147247e-fd02-4123-929a-7915e5ef5077 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:30.666647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147247e-fd02-4123-929a-7915e5ef5077 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:30.672158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6057b20-aa4f-4191-b6b7-794eb029dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:30.672828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6057b20-aa4f-4191-b6b7-794eb029dee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:30.673144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6057b20-aa4f-4191-b6b7-794eb029dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:30.673373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6057b20-aa4f-4191-b6b7-794eb029dee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:30.674016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6057b20-aa4f-4191-b6b7-794eb029dee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:30.675871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6057b20-aa4f-4191-b6b7-794eb029dee6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:30.695831 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1963/3895] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:30.697110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60edab4-b738-4fb2-bd7f-c092c67410cf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:30.717635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60edab4-b738-4fb2-bd7f-c092c67410cf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:30.728767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c171262-0223-4f18-a9c3-3e02309a813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:30.729490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c171262-0223-4f18-a9c3-3e02309a813f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:30.730757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c171262-0223-4f18-a9c3-3e02309a813f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:30.731030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c171262-0223-4f18-a9c3-3e02309a813f admin admin] PATH_INFO: `/v3/projects/2c8884e5c2494e269ce701c4a8dab69d/users/422acba3ff864de9a46658540e38afa5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:30.760195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c171262-0223-4f18-a9c3-3e02309a813f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8884e5c2494e269ce701c4a8dab69d, user_id=422acba3ff864de9a46658540e38afa5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:30.765303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c171262-0223-4f18-a9c3-3e02309a813f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:30.797213 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1933/3896] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:30 2022] PUT /identity/v3/projects/2c8884e5c2494e269ce701c4a8dab69d/users/422acba3ff864de9a46658540e38afa5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:30.802235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6057b20-aa4f-4191-b6b7-794eb029dee6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:30.815159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6057b20-aa4f-4191-b6b7-794eb029dee6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:30.956852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75a9bc-b5a8-4420-adad-daff347b7207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:30.966861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75a9bc-b5a8-4420-adad-daff347b7207 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:30.967227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75a9bc-b5a8-4420-adad-daff347b7207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:30.967502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75a9bc-b5a8-4420-adad-daff347b7207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:30.968372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75a9bc-b5a8-4420-adad-daff347b7207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:30.970017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75a9bc-b5a8-4420-adad-daff347b7207 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:30.990652 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1964/3897] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:30.993474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c171262-0223-4f18-a9c3-3e02309a813f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:31.010664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c171262-0223-4f18-a9c3-3e02309a813f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:31.026732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a6ef1-759f-4d46-a1a7-66e1f0bd0699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:31.027425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a6ef1-759f-4d46-a1a7-66e1f0bd0699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:31.027709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a6ef1-759f-4d46-a1a7-66e1f0bd0699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:31.027989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a6ef1-759f-4d46-a1a7-66e1f0bd0699 admin admin] PATH_INFO: `/v3/projects/2c8884e5c2494e269ce701c4a8dab69d/users/422acba3ff864de9a46658540e38afa5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:31.034334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a6ef1-759f-4d46-a1a7-66e1f0bd0699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8884e5c2494e269ce701c4a8dab69d, user_id=422acba3ff864de9a46658540e38afa5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:31.037249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a6ef1-759f-4d46-a1a7-66e1f0bd0699 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:31.057256 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1934/3898] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:30 2022] PUT /identity/v3/projects/2c8884e5c2494e269ce701c4a8dab69d/users/422acba3ff864de9a46658540e38afa5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:31.070477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bb8c-7d72-4452-ba65-b8525f23569e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:31.071154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bb8c-7d72-4452-ba65-b8525f23569e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:31.071619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bb8c-7d72-4452-ba65-b8525f23569e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:31.123906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dd65bb8c-7d72-4452-ba65-b8525f23569e None None] MFA Rules not processed for user `422acba3ff864de9a46658540e38afa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:31.126160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dd65bb8c-7d72-4452-ba65-b8525f23569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:31.163684 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:31.306539 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1965/3899] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:31.312154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a6ef1-759f-4d46-a1a7-66e1f0bd0699 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:31.330175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a6ef1-759f-4d46-a1a7-66e1f0bd0699 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:31.347626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb21a3d-ca73-4224-83d1-54744db8bd31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:31.348546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb21a3d-ca73-4224-83d1-54744db8bd31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:31.348942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb21a3d-ca73-4224-83d1-54744db8bd31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:31.349326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb21a3d-ca73-4224-83d1-54744db8bd31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:31.350114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb21a3d-ca73-4224-83d1-54744db8bd31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:31.352911 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-bcb21a3d-ca73-4224-83d1-54744db8bd31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:31.352911 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:31.352911 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:31.356777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb21a3d-ca73-4224-83d1-54744db8bd31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:31.406648 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1935/3900] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:17:31 2022] POST /identity/v3/domains => generated 277 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:31.411589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65bb8c-7d72-4452-ba65-b8525f23569e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:31.441897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65bb8c-7d72-4452-ba65-b8525f23569e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:31.602097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665c9b3-2d9b-4e0b-a445-1cb23daf7cbd tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:31.604766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665c9b3-2d9b-4e0b-a445-1cb23daf7cbd tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:31.605255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665c9b3-2d9b-4e0b-a445-1cb23daf7cbd tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:31.605621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665c9b3-2d9b-4e0b-a445-1cb23daf7cbd tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:31.608537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665c9b3-2d9b-4e0b-a445-1cb23daf7cbd tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:31.609788 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-2665c9b3-2d9b-4e0b-a445-1cb23daf7cbd tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:31.609788 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:31.609788 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:31.614870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665c9b3-2d9b-4e0b-a445-1cb23daf7cbd tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:31.689508 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1966/3901] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:31 2022] POST /identity/v3/groups => generated 278 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:31.695295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb21a3d-ca73-4224-83d1-54744db8bd31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:31.718200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb21a3d-ca73-4224-83d1-54744db8bd31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:31.743454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c551e16-61cf-4d48-86d8-28de99515c62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:31.745304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c551e16-61cf-4d48-86d8-28de99515c62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:31.745853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c551e16-61cf-4d48-86d8-28de99515c62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:31.746786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c551e16-61cf-4d48-86d8-28de99515c62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/de02ac06f8c44e76854c50c6e1af11ba` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:31.754322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c551e16-61cf-4d48-86d8-28de99515c62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:update_group(group_id=de02ac06f8c44e76854c50c6e1af11ba)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:31.761064 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-3c551e16-61cf-4d48-86d8-28de99515c62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:31.761064 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:31.761064 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:31.763915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c551e16-61cf-4d48-86d8-28de99515c62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:31.777916 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:31.818390 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1936/3902] 10.222.0.23 () {60 vars in 1247 bytes} [Sun Oct 2 01:17:31 2022] PATCH /identity/v3/groups/de02ac06f8c44e76854c50c6e1af11ba => generated 292 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:31.823277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665c9b3-2d9b-4e0b-a445-1cb23daf7cbd tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:31.843568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665c9b3-2d9b-4e0b-a445-1cb23daf7cbd tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:31.849884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fce0d-24fb-42a3-bbf4-734879a359e1 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:31.851392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fce0d-24fb-42a3-bbf4-734879a359e1 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:31.851709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fce0d-24fb-42a3-bbf4-734879a359e1 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:31.852273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fce0d-24fb-42a3-bbf4-734879a359e1 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/de02ac06f8c44e76854c50c6e1af11ba` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:31.859342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fce0d-24fb-42a3-bbf4-734879a359e1 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:get_group(group_id=de02ac06f8c44e76854c50c6e1af11ba)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:31.860776 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-9d3fce0d-24fb-42a3-bbf4-734879a359e1 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:31.860776 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:31.860776 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:31.862344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fce0d-24fb-42a3-bbf4-734879a359e1 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:31.866305 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1967/3903] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:31 2022] GET /identity/v3/groups/de02ac06f8c44e76854c50c6e1af11ba => generated 292 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:31.869961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c551e16-61cf-4d48-86d8-28de99515c62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:31.888087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c551e16-61cf-4d48-86d8-28de99515c62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:31.897569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fb297-9ba6-4ba3-860c-99b02ece9a2d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:31.900561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb297-9ba6-4ba3-860c-99b02ece9a2d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:31.902477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb297-9ba6-4ba3-860c-99b02ece9a2d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:31.903080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb297-9ba6-4ba3-860c-99b02ece9a2d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/de02ac06f8c44e76854c50c6e1af11ba` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:31.905418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fb297-9ba6-4ba3-860c-99b02ece9a2d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:update_group(group_id=de02ac06f8c44e76854c50c6e1af11ba)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:31.909365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fb297-9ba6-4ba3-860c-99b02ece9a2d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:31.945122 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1937/3904] 10.222.0.23 () {60 vars in 1246 bytes} [Sun Oct 2 01:17:31 2022] PATCH /identity/v3/groups/de02ac06f8c44e76854c50c6e1af11ba => generated 309 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:31.949759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fce0d-24fb-42a3-bbf4-734879a359e1 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:31.987399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fce0d-24fb-42a3-bbf4-734879a359e1 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:31.996417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828532e-f99e-447b-ad02-1e4f541754cb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:31.997947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828532e-f99e-447b-ad02-1e4f541754cb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:31.998448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828532e-f99e-447b-ad02-1e4f541754cb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:31.999127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828532e-f99e-447b-ad02-1e4f541754cb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/de02ac06f8c44e76854c50c6e1af11ba` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:32.006423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828532e-f99e-447b-ad02-1e4f541754cb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_group(group_id=de02ac06f8c44e76854c50c6e1af11ba)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:32.008426 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-9828532e-f99e-447b-ad02-1e4f541754cb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:32.008426 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:32.008426 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:32.010319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828532e-f99e-447b-ad02-1e4f541754cb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:32.126199 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1968/3905] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:17:31 2022] DELETE /identity/v3/groups/de02ac06f8c44e76854c50c6e1af11ba => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:17:32.133898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fb297-9ba6-4ba3-860c-99b02ece9a2d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:32.149502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fb297-9ba6-4ba3-860c-99b02ece9a2d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:32.230637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2488e0-2c9c-4a1f-9b9c-2ee910579011 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:32.231289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2488e0-2c9c-4a1f-9b9c-2ee910579011 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:32.231861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2488e0-2c9c-4a1f-9b9c-2ee910579011 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:32.232293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2488e0-2c9c-4a1f-9b9c-2ee910579011 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:32.234037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2488e0-2c9c-4a1f-9b9c-2ee910579011 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:32.235119 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-df2488e0-2c9c-4a1f-9b9c-2ee910579011 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:32.235119 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:32.235119 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:32.236469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2488e0-2c9c-4a1f-9b9c-2ee910579011 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:32.269660 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1938/3906] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:32 2022] POST /identity/v3/groups => generated 326 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:32.270835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828532e-f99e-447b-ad02-1e4f541754cb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:32.311495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828532e-f99e-447b-ad02-1e4f541754cb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:32.335752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a27e02-d7d6-4068-bae9-c1202f7172c8 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:32.336853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a27e02-d7d6-4068-bae9-c1202f7172c8 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:32.337387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a27e02-d7d6-4068-bae9-c1202f7172c8 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:32.339645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a27e02-d7d6-4068-bae9-c1202f7172c8 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:32.340814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a27e02-d7d6-4068-bae9-c1202f7172c8 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:32.343570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a27e02-d7d6-4068-bae9-c1202f7172c8 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:32.414715 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1969/3907] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:32 2022] POST /identity/v3/users => generated 321 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:32.419549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2488e0-2c9c-4a1f-9b9c-2ee910579011 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:32.437107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2488e0-2c9c-4a1f-9b9c-2ee910579011 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:32.447673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a5733-ad56-4467-bef4-4fcddb8aa0bc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:32.448285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a5733-ad56-4467-bef4-4fcddb8aa0bc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:32.448575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a5733-ad56-4467-bef4-4fcddb8aa0bc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:32.449004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a5733-ad56-4467-bef4-4fcddb8aa0bc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/7e4ebcd3f0a5425085124b28f44fa6ff` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:32.498082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a5733-ad56-4467-bef4-4fcddb8aa0bc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=73eebb3a206a4e3781575d061e5ae919, user_id=7e4ebcd3f0a5425085124b28f44fa6ff)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:32.499409 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-503a5733-ad56-4467-bef4-4fcddb8aa0bc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:32.499409 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:32.499409 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:32.501217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a5733-ad56-4467-bef4-4fcddb8aa0bc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:32.535252 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1939/3908] 10.222.0.23 () {60 vars in 1360 bytes} [Sun Oct 2 01:17:32 2022] PUT /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/7e4ebcd3f0a5425085124b28f44fa6ff => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:32.540387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a27e02-d7d6-4068-bae9-c1202f7172c8 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:32.558741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a27e02-d7d6-4068-bae9-c1202f7172c8 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:32.601036 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:32.713999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b580367-a6d4-4d74-b941-c89b5a052d90 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:32.715209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b580367-a6d4-4d74-b941-c89b5a052d90 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:32.715752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b580367-a6d4-4d74-b941-c89b5a052d90 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:32.716271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b580367-a6d4-4d74-b941-c89b5a052d90 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:32.717303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b580367-a6d4-4d74-b941-c89b5a052d90 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:32.719836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b580367-a6d4-4d74-b941-c89b5a052d90 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:32.753084 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1970/3909] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:32 2022] POST /identity/v3/users => generated 323 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:32.759783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a5733-ad56-4467-bef4-4fcddb8aa0bc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:32.785784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a5733-ad56-4467-bef4-4fcddb8aa0bc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:32.793808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d8c41-058d-40a5-b5d1-3f764b4a8b31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:32.794488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d8c41-058d-40a5-b5d1-3f764b4a8b31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:32.794816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d8c41-058d-40a5-b5d1-3f764b4a8b31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:32.795098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d8c41-058d-40a5-b5d1-3f764b4a8b31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/14516dad82554d43b977dfedff01878c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:32.813288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d8c41-058d-40a5-b5d1-3f764b4a8b31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=73eebb3a206a4e3781575d061e5ae919, user_id=14516dad82554d43b977dfedff01878c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:32.815320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d8c41-058d-40a5-b5d1-3f764b4a8b31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:32.865030 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1940/3910] 10.222.0.23 () {60 vars in 1360 bytes} [Sun Oct 2 01:17:32 2022] PUT /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/14516dad82554d43b977dfedff01878c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:32.870468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b580367-a6d4-4d74-b941-c89b5a052d90 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:32.894677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b580367-a6d4-4d74-b941-c89b5a052d90 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:32.991121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770587f-a946-4224-9ab2-56f15c5a6a2f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:32.992568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770587f-a946-4224-9ab2-56f15c5a6a2f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:32.993065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770587f-a946-4224-9ab2-56f15c5a6a2f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:32.993908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770587f-a946-4224-9ab2-56f15c5a6a2f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:32.994157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770587f-a946-4224-9ab2-56f15c5a6a2f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:32.996392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770587f-a946-4224-9ab2-56f15c5a6a2f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:33.033644 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1971/3911] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:32 2022] POST /identity/v3/users => generated 323 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:17:33.041930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d8c41-058d-40a5-b5d1-3f764b4a8b31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:33.055305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d8c41-058d-40a5-b5d1-3f764b4a8b31 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:33.062761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7f081-7397-4382-9f55-15fdac1132a3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:33.063045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7f081-7397-4382-9f55-15fdac1132a3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:33.063275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7f081-7397-4382-9f55-15fdac1132a3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:33.063473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7f081-7397-4382-9f55-15fdac1132a3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/1e126e9158c84100be94a71c80fcb910` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:33.088871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7f081-7397-4382-9f55-15fdac1132a3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=73eebb3a206a4e3781575d061e5ae919, user_id=1e126e9158c84100be94a71c80fcb910)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:33.092818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7f081-7397-4382-9f55-15fdac1132a3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:33.136797 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1941/3912] 10.222.0.23 () {60 vars in 1360 bytes} [Sun Oct 2 01:17:33 2022] PUT /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/1e126e9158c84100be94a71c80fcb910 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:33.140307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770587f-a946-4224-9ab2-56f15c5a6a2f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:33.160173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770587f-a946-4224-9ab2-56f15c5a6a2f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:33.253071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156133b3-18b5-45ae-9af4-14ace12ed623 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:33.253791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156133b3-18b5-45ae-9af4-14ace12ed623 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:33.254081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156133b3-18b5-45ae-9af4-14ace12ed623 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:33.255378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156133b3-18b5-45ae-9af4-14ace12ed623 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:33.256688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156133b3-18b5-45ae-9af4-14ace12ed623 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=73eebb3a206a4e3781575d061e5ae919)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:33.258367 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-156133b3-18b5-45ae-9af4-14ace12ed623 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:33.258367 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:33.258367 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:33.259839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156133b3-18b5-45ae-9af4-14ace12ed623 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:33.285076 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1972/3913] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:17:33 2022] GET /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919/users => generated 1083 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:33.289787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7f081-7397-4382-9f55-15fdac1132a3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:33.303845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7f081-7397-4382-9f55-15fdac1132a3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:33.315675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a45a95-e8a9-45fd-adf1-9642569faa0f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:33.316361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45a95-e8a9-45fd-adf1-9642569faa0f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:33.316648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45a95-e8a9-45fd-adf1-9642569faa0f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:33.316918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45a95-e8a9-45fd-adf1-9642569faa0f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/7e4ebcd3f0a5425085124b28f44fa6ff` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:33.323524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a45a95-e8a9-45fd-adf1-9642569faa0f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=73eebb3a206a4e3781575d061e5ae919, user_id=7e4ebcd3f0a5425085124b28f44fa6ff)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:33.324558 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-91a45a95-e8a9-45fd-adf1-9642569faa0f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:33.324558 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:33.324558 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:33.325795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a45a95-e8a9-45fd-adf1-9642569faa0f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:33.348963 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1942/3914] 10.222.0.23 () {58 vars in 1342 bytes} [Sun Oct 2 01:17:33 2022] HEAD /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/7e4ebcd3f0a5425085124b28f44fa6ff => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:33.350773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156133b3-18b5-45ae-9af4-14ace12ed623 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:33.363427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156133b3-18b5-45ae-9af4-14ace12ed623 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:33.370287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c536b-6ba3-44bc-9156-4977b115d753 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:33.370998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c536b-6ba3-44bc-9156-4977b115d753 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:33.371280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c536b-6ba3-44bc-9156-4977b115d753 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:33.371751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c536b-6ba3-44bc-9156-4977b115d753 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/7e4ebcd3f0a5425085124b28f44fa6ff` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:33.373667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c536b-6ba3-44bc-9156-4977b115d753 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=73eebb3a206a4e3781575d061e5ae919, user_id=7e4ebcd3f0a5425085124b28f44fa6ff)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:33.374885 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-e27c536b-6ba3-44bc-9156-4977b115d753 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:33.374885 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:33.374885 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:33.376982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c536b-6ba3-44bc-9156-4977b115d753 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:33.398608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e27c536b-6ba3-44bc-9156-4977b115d753 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7e4ebcd3f0a5425085124b28f44fa6ff'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:33.433884 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1973/3915] 10.222.0.23 () {58 vars in 1344 bytes} [Sun Oct 2 01:17:33 2022] DELETE /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/7e4ebcd3f0a5425085124b28f44fa6ff => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:33.435912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a45a95-e8a9-45fd-adf1-9642569faa0f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:33.448010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a45a95-e8a9-45fd-adf1-9642569faa0f tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:33.466149 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:33.528324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39817a4-7435-4ae4-a88c-36ce22a1230c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:33.529333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39817a4-7435-4ae4-a88c-36ce22a1230c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:33.529675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39817a4-7435-4ae4-a88c-36ce22a1230c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:33.529962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39817a4-7435-4ae4-a88c-36ce22a1230c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/14516dad82554d43b977dfedff01878c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:33.532146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39817a4-7435-4ae4-a88c-36ce22a1230c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=73eebb3a206a4e3781575d061e5ae919, user_id=14516dad82554d43b977dfedff01878c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:33.534282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39817a4-7435-4ae4-a88c-36ce22a1230c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:33.564576 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1943/3916] 10.222.0.23 () {58 vars in 1342 bytes} [Sun Oct 2 01:17:33 2022] HEAD /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/14516dad82554d43b977dfedff01878c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:17:33.582770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c536b-6ba3-44bc-9156-4977b115d753 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:33.606226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c536b-6ba3-44bc-9156-4977b115d753 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:33.621928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3c95-60a6-4ef3-81d9-28c5679bd5a6 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:33.623341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3c95-60a6-4ef3-81d9-28c5679bd5a6 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:33.623708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3c95-60a6-4ef3-81d9-28c5679bd5a6 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:33.624006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3c95-60a6-4ef3-81d9-28c5679bd5a6 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/14516dad82554d43b977dfedff01878c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:33.625822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb3c95-60a6-4ef3-81d9-28c5679bd5a6 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=73eebb3a206a4e3781575d061e5ae919, user_id=14516dad82554d43b977dfedff01878c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:33.628089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb3c95-60a6-4ef3-81d9-28c5679bd5a6 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:33.645720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b1eb3c95-60a6-4ef3-81d9-28c5679bd5a6 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '14516dad82554d43b977dfedff01878c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:33.648708 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:33.677462 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1974/3917] 10.222.0.23 () {58 vars in 1344 bytes} [Sun Oct 2 01:17:33 2022] DELETE /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/14516dad82554d43b977dfedff01878c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:33.686127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39817a4-7435-4ae4-a88c-36ce22a1230c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:33.712032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39817a4-7435-4ae4-a88c-36ce22a1230c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:33.847671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d8b94-3d25-4738-a013-e781b6c3bd69 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:33.848351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8b94-3d25-4738-a013-e781b6c3bd69 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:33.848639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8b94-3d25-4738-a013-e781b6c3bd69 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:33.848917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8b94-3d25-4738-a013-e781b6c3bd69 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/1e126e9158c84100be94a71c80fcb910` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:33.850806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d8b94-3d25-4738-a013-e781b6c3bd69 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=73eebb3a206a4e3781575d061e5ae919, user_id=1e126e9158c84100be94a71c80fcb910)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:33.853365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d8b94-3d25-4738-a013-e781b6c3bd69 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:33.901326 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1944/3918] 10.222.0.23 () {58 vars in 1342 bytes} [Sun Oct 2 01:17:33 2022] HEAD /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/1e126e9158c84100be94a71c80fcb910 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:33.901987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3c95-60a6-4ef3-81d9-28c5679bd5a6 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:33.920606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3c95-60a6-4ef3-81d9-28c5679bd5a6 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:33.934420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237c404-7ca2-4380-8d44-d05d68c41317 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:33.935449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237c404-7ca2-4380-8d44-d05d68c41317 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:33.935917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237c404-7ca2-4380-8d44-d05d68c41317 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:33.936375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237c404-7ca2-4380-8d44-d05d68c41317 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/1e126e9158c84100be94a71c80fcb910` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:33.938225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237c404-7ca2-4380-8d44-d05d68c41317 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=73eebb3a206a4e3781575d061e5ae919, user_id=1e126e9158c84100be94a71c80fcb910)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:33.940385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237c404-7ca2-4380-8d44-d05d68c41317 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:33.957943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3237c404-7ca2-4380-8d44-d05d68c41317 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1e126e9158c84100be94a71c80fcb910'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:33.999823 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1975/3919] 10.222.0.23 () {58 vars in 1344 bytes} [Sun Oct 2 01:17:33 2022] DELETE /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919/users/1e126e9158c84100be94a71c80fcb910 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:17:34.003811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d8b94-3d25-4738-a013-e781b6c3bd69 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:34.017844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d8b94-3d25-4738-a013-e781b6c3bd69 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:34.104745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253811fe-52a7-4bd1-a1fa-1e735d0dc5a9 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:34.105981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253811fe-52a7-4bd1-a1fa-1e735d0dc5a9 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:34.106550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253811fe-52a7-4bd1-a1fa-1e735d0dc5a9 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:34.106934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253811fe-52a7-4bd1-a1fa-1e735d0dc5a9 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:34.108491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253811fe-52a7-4bd1-a1fa-1e735d0dc5a9 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=73eebb3a206a4e3781575d061e5ae919)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:34.109537 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-253811fe-52a7-4bd1-a1fa-1e735d0dc5a9 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:34.109537 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:34.109537 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:34.111109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253811fe-52a7-4bd1-a1fa-1e735d0dc5a9 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:34.134338 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1945/3920] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:17:34 2022] GET /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919/users => generated 145 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:34.138625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237c404-7ca2-4380-8d44-d05d68c41317 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:34.150244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237c404-7ca2-4380-8d44-d05d68c41317 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:34.155755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:34.156413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:34.156696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:34.156978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/users/1e126e9158c84100be94a71c80fcb910` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:34.158481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1e126e9158c84100be94a71c80fcb910)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:34.161365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:34.251454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e126e9158c84100be94a71c80fcb910'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.318123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e126e9158c84100be94a71c80fcb910'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.320680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e126e9158c84100be94a71c80fcb910'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.344337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e126e9158c84100be94a71c80fcb910'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.346208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e126e9158c84100be94a71c80fcb910'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.410357 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1976/3921] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:34 2022] DELETE /identity/v3/users/1e126e9158c84100be94a71c80fcb910 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:34.416896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253811fe-52a7-4bd1-a1fa-1e735d0dc5a9 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:34.419500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-253811fe-52a7-4bd1-a1fa-1e735d0dc5a9 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:34.450843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253811fe-52a7-4bd1-a1fa-1e735d0dc5a9 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:34.529675 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:34.579502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:34.580762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:34.581058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:34.581871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/users/14516dad82554d43b977dfedff01878c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:34.583111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14516dad82554d43b977dfedff01878c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:34.586040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:34.663204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14516dad82554d43b977dfedff01878c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.682166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14516dad82554d43b977dfedff01878c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.683239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14516dad82554d43b977dfedff01878c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.697508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14516dad82554d43b977dfedff01878c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.728516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14516dad82554d43b977dfedff01878c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.740875 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1946/3922] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:34 2022] DELETE /identity/v3/users/14516dad82554d43b977dfedff01878c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:34.746101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:34.761598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9558e-5312-47cd-8039-24f80115baf2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:34.837861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:34.838883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:34.839298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:34.839682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/users/7e4ebcd3f0a5425085124b28f44fa6ff` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:34.841739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7e4ebcd3f0a5425085124b28f44fa6ff)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:34.844649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:34.934908 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=3,keystone:DELETE=19,keystone:SELECT=78 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:34.955547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e4ebcd3f0a5425085124b28f44fa6ff'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.986893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e4ebcd3f0a5425085124b28f44fa6ff'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:34.988325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e4ebcd3f0a5425085124b28f44fa6ff'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:35.009034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e4ebcd3f0a5425085124b28f44fa6ff'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:35.010579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e4ebcd3f0a5425085124b28f44fa6ff'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:35.036153 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1977/3923] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:34 2022] DELETE /identity/v3/users/7e4ebcd3f0a5425085124b28f44fa6ff => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:35.040701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:35.042933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:35.061286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fe06e-45c6-4477-9cca-4a253fd9e540 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:35.157294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a84ba0-8c3f-4fa6-9471-82ffc4e6ffcb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:35.158032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a84ba0-8c3f-4fa6-9471-82ffc4e6ffcb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:35.158388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a84ba0-8c3f-4fa6-9471-82ffc4e6ffcb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:35.158781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a84ba0-8c3f-4fa6-9471-82ffc4e6ffcb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/73eebb3a206a4e3781575d061e5ae919` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:35.160220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a84ba0-8c3f-4fa6-9471-82ffc4e6ffcb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_group(group_id=73eebb3a206a4e3781575d061e5ae919)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:35.161522 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-44a84ba0-8c3f-4fa6-9471-82ffc4e6ffcb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:35.161522 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:35.161522 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:35.164820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a84ba0-8c3f-4fa6-9471-82ffc4e6ffcb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:35.254705 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1947/3924] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:17:35 2022] DELETE /identity/v3/groups/73eebb3a206a4e3781575d061e5ae919 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:17:35.259419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:35.261322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:35.275712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a71dd-5892-452f-b9e9-f5a3ab59fc62 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:35.406690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8d06b-e2ba-491b-bf24-8f3a1276efcc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:35.407967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8d06b-e2ba-491b-bf24-8f3a1276efcc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:35.408695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8d06b-e2ba-491b-bf24-8f3a1276efcc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:35.409207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8d06b-e2ba-491b-bf24-8f3a1276efcc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:35.410181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8d06b-e2ba-491b-bf24-8f3a1276efcc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:35.416861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8d06b-e2ba-491b-bf24-8f3a1276efcc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:35.454024 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1978/3925] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:35 2022] POST /identity/v3/groups => generated 326 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:35.458218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a84ba0-8c3f-4fa6-9471-82ffc4e6ffcb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:35.479895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a84ba0-8c3f-4fa6-9471-82ffc4e6ffcb tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:35.486559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcda7a-8f8e-4af5-80b9-0517ab63946a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:35.487337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcda7a-8f8e-4af5-80b9-0517ab63946a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:35.487845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcda7a-8f8e-4af5-80b9-0517ab63946a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:35.488363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcda7a-8f8e-4af5-80b9-0517ab63946a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:35.489164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcda7a-8f8e-4af5-80b9-0517ab63946a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:35.492228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcda7a-8f8e-4af5-80b9-0517ab63946a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:35.509914 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:35.527255 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1948/3926] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:35 2022] POST /identity/v3/groups => generated 326 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:35.528886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8d06b-e2ba-491b-bf24-8f3a1276efcc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:35.542021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8d06b-e2ba-491b-bf24-8f3a1276efcc tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:35.558093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29700581-599d-400d-8c23-914e99e6ee84 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:35.559162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700581-599d-400d-8c23-914e99e6ee84 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:35.559576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700581-599d-400d-8c23-914e99e6ee84 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:35.560060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700581-599d-400d-8c23-914e99e6ee84 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:35.560824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29700581-599d-400d-8c23-914e99e6ee84 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:35.567202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29700581-599d-400d-8c23-914e99e6ee84 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:35.597087 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1979/3927] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:35 2022] POST /identity/v3/groups => generated 326 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:35.601317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcda7a-8f8e-4af5-80b9-0517ab63946a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:35.614139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcda7a-8f8e-4af5-80b9-0517ab63946a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:35.629654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69dddc-92d6-4765-ae98-47ac2d986983 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:35.630739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69dddc-92d6-4765-ae98-47ac2d986983 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:35.630739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69dddc-92d6-4765-ae98-47ac2d986983 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:35.630979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69dddc-92d6-4765-ae98-47ac2d986983 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:35.635681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69dddc-92d6-4765-ae98-47ac2d986983 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:35.640412 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-3f69dddc-92d6-4765-ae98-47ac2d986983 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:35.640412 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:35.640412 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:35.642429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69dddc-92d6-4765-ae98-47ac2d986983 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:35.658476 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1949/3928] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 2 01:17:35 2022] GET /identity/v3/groups => generated 1488 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:35.662452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29700581-599d-400d-8c23-914e99e6ee84 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:35.677151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29700581-599d-400d-8c23-914e99e6ee84 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:35.683046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc786-0b04-4542-8e0b-7aa3e308dad3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:35.683846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc786-0b04-4542-8e0b-7aa3e308dad3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:35.684137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc786-0b04-4542-8e0b-7aa3e308dad3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:35.684549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc786-0b04-4542-8e0b-7aa3e308dad3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/b5bfb2e5d32744849172ef7af0bdf97f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:35.696786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fc786-0b04-4542-8e0b-7aa3e308dad3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b5bfb2e5d32744849172ef7af0bdf97f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:35.701839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fc786-0b04-4542-8e0b-7aa3e308dad3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:35.778528 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1980/3929] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:17:35 2022] DELETE /identity/v3/groups/b5bfb2e5d32744849172ef7af0bdf97f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:35.781505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69dddc-92d6-4765-ae98-47ac2d986983 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:35.801936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69dddc-92d6-4765-ae98-47ac2d986983 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:35.931706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144804a-8701-48c8-8728-fae180f0323d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:35.932518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144804a-8701-48c8-8728-fae180f0323d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:35.932811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144804a-8701-48c8-8728-fae180f0323d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:35.933095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144804a-8701-48c8-8728-fae180f0323d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/6a2da94609874f7fa37c6e2b1212d483` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:35.941261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144804a-8701-48c8-8728-fae180f0323d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6a2da94609874f7fa37c6e2b1212d483)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:35.945841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144804a-8701-48c8-8728-fae180f0323d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:36.042127 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1950/3930] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:17:35 2022] DELETE /identity/v3/groups/6a2da94609874f7fa37c6e2b1212d483 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:36.051668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc786-0b04-4542-8e0b-7aa3e308dad3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:36.066337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc786-0b04-4542-8e0b-7aa3e308dad3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:36.166296 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:36.184578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063b2d-22ab-4749-980d-64b753e3c7af tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:36.185548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063b2d-22ab-4749-980d-64b753e3c7af tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:36.185935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063b2d-22ab-4749-980d-64b753e3c7af tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:36.186310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063b2d-22ab-4749-980d-64b753e3c7af tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/a3ebf53fcb9c4fb6977a473fe9a6e971` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:36.192536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb063b2d-22ab-4749-980d-64b753e3c7af tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a3ebf53fcb9c4fb6977a473fe9a6e971)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:36.195461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb063b2d-22ab-4749-980d-64b753e3c7af tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:36.261877 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1981/3931] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:17:36 2022] DELETE /identity/v3/groups/a3ebf53fcb9c4fb6977a473fe9a6e971 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:36.267857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144804a-8701-48c8-8728-fae180f0323d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:36.283280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144804a-8701-48c8-8728-fae180f0323d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:36.489541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ec21f-cebd-4d8e-928e-c8a65b7e5a2a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:36.495315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ec21f-cebd-4d8e-928e-c8a65b7e5a2a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:36.497314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ec21f-cebd-4d8e-928e-c8a65b7e5a2a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:36.497615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ec21f-cebd-4d8e-928e-c8a65b7e5a2a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:36.498303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ec21f-cebd-4d8e-928e-c8a65b7e5a2a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:36.505626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ec21f-cebd-4d8e-928e-c8a65b7e5a2a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:36.566698 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1951/3932] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:36 2022] POST /identity/v3/users => generated 323 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:17:36.567527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063b2d-22ab-4749-980d-64b753e3c7af tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:36.582294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063b2d-22ab-4749-980d-64b753e3c7af tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:36.591196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959acf14-6e6f-418d-b70a-039c22c36537 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:36.591830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959acf14-6e6f-418d-b70a-039c22c36537 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:36.592115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959acf14-6e6f-418d-b70a-039c22c36537 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:36.592394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959acf14-6e6f-418d-b70a-039c22c36537 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:36.593036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959acf14-6e6f-418d-b70a-039c22c36537 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:36.595322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959acf14-6e6f-418d-b70a-039c22c36537 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:36.622655 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1982/3933] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:36 2022] POST /identity/v3/groups => generated 326 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:36.626110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ec21f-cebd-4d8e-928e-c8a65b7e5a2a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:36.640377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ec21f-cebd-4d8e-928e-c8a65b7e5a2a tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:36.650984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c492a7d-86f3-45ed-8480-c10d2a17790c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:36.652043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c492a7d-86f3-45ed-8480-c10d2a17790c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:36.652452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c492a7d-86f3-45ed-8480-c10d2a17790c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:36.652947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c492a7d-86f3-45ed-8480-c10d2a17790c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/35ea4347136741b88f4e55cf136df5b8/users/87ddd0eda1ef4fbba487e075466f350f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:36.691633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c492a7d-86f3-45ed-8480-c10d2a17790c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=35ea4347136741b88f4e55cf136df5b8, user_id=87ddd0eda1ef4fbba487e075466f350f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:36.698558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c492a7d-86f3-45ed-8480-c10d2a17790c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:36.739354 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:36.755446 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1952/3934] 10.222.0.23 () {60 vars in 1360 bytes} [Sun Oct 2 01:17:36 2022] PUT /identity/v3/groups/35ea4347136741b88f4e55cf136df5b8/users/87ddd0eda1ef4fbba487e075466f350f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:36.756550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959acf14-6e6f-418d-b70a-039c22c36537 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:36.778614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959acf14-6e6f-418d-b70a-039c22c36537 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:36.936275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70772b95-81ba-4db9-badd-3bc4d8b7b5e3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:36.936906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772b95-81ba-4db9-badd-3bc4d8b7b5e3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:36.937274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772b95-81ba-4db9-badd-3bc4d8b7b5e3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:36.937549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772b95-81ba-4db9-badd-3bc4d8b7b5e3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:36.938256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70772b95-81ba-4db9-badd-3bc4d8b7b5e3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:36.940336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70772b95-81ba-4db9-badd-3bc4d8b7b5e3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:36.985319 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1983/3935] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:17:36 2022] POST /identity/v3/groups => generated 327 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:17:36.989549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c492a7d-86f3-45ed-8480-c10d2a17790c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:37.010106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c492a7d-86f3-45ed-8480-c10d2a17790c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:37.024499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d0b5b-177f-4611-b12c-49a2a8476020 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:37.025179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d0b5b-177f-4611-b12c-49a2a8476020 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:37.025464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d0b5b-177f-4611-b12c-49a2a8476020 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:37.025743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d0b5b-177f-4611-b12c-49a2a8476020 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/bec006e2f31e4fefb4921dd3e88e4a12/users/87ddd0eda1ef4fbba487e075466f350f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:37.041876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d0b5b-177f-4611-b12c-49a2a8476020 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bec006e2f31e4fefb4921dd3e88e4a12, user_id=87ddd0eda1ef4fbba487e075466f350f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:37.043912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d0b5b-177f-4611-b12c-49a2a8476020 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:37.106988 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1953/3936] 10.222.0.23 () {60 vars in 1360 bytes} [Sun Oct 2 01:17:36 2022] PUT /identity/v3/groups/bec006e2f31e4fefb4921dd3e88e4a12/users/87ddd0eda1ef4fbba487e075466f350f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:37.108719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70772b95-81ba-4db9-badd-3bc4d8b7b5e3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:37.123198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70772b95-81ba-4db9-badd-3bc4d8b7b5e3 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:37.210922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613a250-1ac6-4181-b7f9-59f2776ea1a2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:37.211794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613a250-1ac6-4181-b7f9-59f2776ea1a2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:37.211948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613a250-1ac6-4181-b7f9-59f2776ea1a2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:37.212198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613a250-1ac6-4181-b7f9-59f2776ea1a2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/users/87ddd0eda1ef4fbba487e075466f350f/groups` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:37.213486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613a250-1ac6-4181-b7f9-59f2776ea1a2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=87ddd0eda1ef4fbba487e075466f350f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:37.215952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613a250-1ac6-4181-b7f9-59f2776ea1a2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:37.267033 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1984/3937] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:17:37 2022] GET /identity/v3/users/87ddd0eda1ef4fbba487e075466f350f/groups => generated 839 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:37.268426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d0b5b-177f-4611-b12c-49a2a8476020 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:37.287339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d0b5b-177f-4611-b12c-49a2a8476020 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:37.295319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5925acd-8984-42b9-922b-59c245693d40 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:37.296269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5925acd-8984-42b9-922b-59c245693d40 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:37.296689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5925acd-8984-42b9-922b-59c245693d40 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:37.297061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5925acd-8984-42b9-922b-59c245693d40 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/bec006e2f31e4fefb4921dd3e88e4a12` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:37.298977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5925acd-8984-42b9-922b-59c245693d40 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bec006e2f31e4fefb4921dd3e88e4a12)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:37.302431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5925acd-8984-42b9-922b-59c245693d40 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:37.397383 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1954/3938] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:17:37 2022] DELETE /identity/v3/groups/bec006e2f31e4fefb4921dd3e88e4a12 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:37.403304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613a250-1ac6-4181-b7f9-59f2776ea1a2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:37.427483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613a250-1ac6-4181-b7f9-59f2776ea1a2 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:37.468921 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:37.607629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e8bb8-2748-459e-ac4c-8c5a23214586 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:37.609271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e8bb8-2748-459e-ac4c-8c5a23214586 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:37.609406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e8bb8-2748-459e-ac4c-8c5a23214586 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:37.611018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e8bb8-2748-459e-ac4c-8c5a23214586 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/groups/35ea4347136741b88f4e55cf136df5b8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:37.613323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e8bb8-2748-459e-ac4c-8c5a23214586 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_group(group_id=35ea4347136741b88f4e55cf136df5b8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:37.622801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e8bb8-2748-459e-ac4c-8c5a23214586 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:37.756401 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1985/3939] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:17:37 2022] DELETE /identity/v3/groups/35ea4347136741b88f4e55cf136df5b8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:37.758870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5925acd-8984-42b9-922b-59c245693d40 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:37.774879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5925acd-8984-42b9-922b-59c245693d40 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:37.885894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:37.886628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:37.886972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:37.887213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/users/87ddd0eda1ef4fbba487e075466f350f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:37.889300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_user(user_id=87ddd0eda1ef4fbba487e075466f350f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:37.895520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:38.011729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ddd0eda1ef4fbba487e075466f350f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:38.047387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ddd0eda1ef4fbba487e075466f350f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:38.047387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ddd0eda1ef4fbba487e075466f350f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:38.068804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ddd0eda1ef4fbba487e075466f350f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:38.081148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ddd0eda1ef4fbba487e075466f350f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:38.084467 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:38.094550 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1955/3940] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:37 2022] DELETE /identity/v3/users/87ddd0eda1ef4fbba487e075466f350f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:38.100211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e8bb8-2748-459e-ac4c-8c5a23214586 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:38.102386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e55e8bb8-2748-459e-ac4c-8c5a23214586 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:38.121514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e8bb8-2748-459e-ac4c-8c5a23214586 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:38.229405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:38.230056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:38.230794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:38.230794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/domains/88963d5fe8904f25b302999490dcb705` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:38.231873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=88963d5fe8904f25b302999490dcb705)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:38.233308 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:38.233308 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:17:38.233308 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:17:38.234519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:38.282694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '88963d5fe8904f25b302999490dcb705'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:38.283723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '88963d5fe8904f25b302999490dcb705'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:38.354743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '88963d5fe8904f25b302999490dcb705'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:38.356408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '88963d5fe8904f25b302999490dcb705'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:38.369274 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1986/3941] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:17:38 2022] PATCH /identity/v3/domains/88963d5fe8904f25b302999490dcb705 => generated 278 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:38.370585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:38.381144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512093c-d8e3-40c7-9348-9d17641d923d tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:38.587138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '422acba3ff864de9a46658540e38afa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8884e5c2494e269ce701c4a8dab69d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:38.588465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:38.588944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:38.595462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] PATH_INFO: `/v3/domains/88963d5fe8904f25b302999490dcb705` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:38.659487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=88963d5fe8904f25b302999490dcb705)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:38.664532 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:17:38.664532 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:17:38.664532 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:17:38.687999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:38.771961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '88963d5fe8904f25b302999490dcb705'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:38.790979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '88963d5fe8904f25b302999490dcb705'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.006195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88963d5fe8904f25b302999490dcb705', 'request_id': 'req-17cda5cb-dc49-4862-94b0-6f1f1933af7c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.014518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88963d5fe8904f25b302999490dcb705', 'request_id': 'req-17cda5cb-dc49-4862-94b0-6f1f1933af7c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.025571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88963d5fe8904f25b302999490dcb705', 'request_id': 'req-17cda5cb-dc49-4862-94b0-6f1f1933af7c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.046566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] The token cache is being invalidate because project 88963d5fe8904f25b302999490dcb705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:39.047050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.055372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.079156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '88963d5fe8904f25b302999490dcb705', 'request_id': 'req-17cda5cb-dc49-4862-94b0-6f1f1933af7c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.081197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '88963d5fe8904f25b302999490dcb705', 'request_id': 'req-17cda5cb-dc49-4862-94b0-6f1f1933af7c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.081972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17cda5cb-dc49-4862-94b0-6f1f1933af7c tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '88963d5fe8904f25b302999490dcb705', 'request_id': 'req-17cda5cb-dc49-4862-94b0-6f1f1933af7c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.100655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:39.102946 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1956/3942] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:17:38 2022] DELETE /identity/v3/domains/88963d5fe8904f25b302999490dcb705 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:39.103624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:39.201859 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:39.253025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc05c8-f2c4-44bc-a363-2bc3a763bf22 tempest-GroupsV3TestJSON-1981893587 tempest-GroupsV3TestJSON-1981893587-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:39.333909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f633d-d8b7-462d-90b3-c07b6a1e1106 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:39.334314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f633d-d8b7-462d-90b3-c07b6a1e1106 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:39.334770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f633d-d8b7-462d-90b3-c07b6a1e1106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:39.383473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd2b3c-a747-4cc8-9ec5-63116d007812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:39.384439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd2b3c-a747-4cc8-9ec5-63116d007812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:39.384883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd2b3c-a747-4cc8-9ec5-63116d007812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:39.385342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd2b3c-a747-4cc8-9ec5-63116d007812 admin admin] PATH_INFO: `/v3/users/e4e17687a6a74b2fafc3f9b98d414f65` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:39.387852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd2b3c-a747-4cc8-9ec5-63116d007812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e17687a6a74b2fafc3f9b98d414f65)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:39.391465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd2b3c-a747-4cc8-9ec5-63116d007812 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:39.400835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ad5f633d-d8b7-462d-90b3-c07b6a1e1106 None None] MFA Rules not processed for user `63e0eaf9b9e34b8d80e9ddadd09989fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:39.411744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ad5f633d-d8b7-462d-90b3-c07b6a1e1106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:39.501583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dfcd2b3c-a747-4cc8-9ec5-63116d007812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e17687a6a74b2fafc3f9b98d414f65'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.519881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dfcd2b3c-a747-4cc8-9ec5-63116d007812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e17687a6a74b2fafc3f9b98d414f65'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.522127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dfcd2b3c-a747-4cc8-9ec5-63116d007812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e17687a6a74b2fafc3f9b98d414f65'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.536439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dfcd2b3c-a747-4cc8-9ec5-63116d007812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e17687a6a74b2fafc3f9b98d414f65'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.537542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dfcd2b3c-a747-4cc8-9ec5-63116d007812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e17687a6a74b2fafc3f9b98d414f65'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:39.559385 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:39.562736 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1987/3943] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:39 2022] DELETE /identity/v3/users/e4e17687a6a74b2fafc3f9b98d414f65 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:39.565797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a52d-fd12-48da-981a-e70451721d98 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:39.566326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a52d-fd12-48da-981a-e70451721d98 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:39.579113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a52d-fd12-48da-981a-e70451721d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:39.646786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-84d8a52d-fd12-48da-981a-e70451721d98 None None] MFA Rules not processed for user `66a9d6a142d444be90b2101f23603522`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:39.649335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-84d8a52d-fd12-48da-981a-e70451721d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:39.658964 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1957/3944] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:17:39.660758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1cf33-1f7d-4167-9f09-a268f23f68f6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:39.661335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1cf33-1f7d-4167-9f09-a268f23f68f6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:39.662010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1cf33-1f7d-4167-9f09-a268f23f68f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:39.715650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-65b1cf33-1f7d-4167-9f09-a268f23f68f6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:39.719086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-65b1cf33-1f7d-4167-9f09-a268f23f68f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:39.819559 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:39.833360 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1988/3945] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:39.927575 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1958/3946] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:39.983338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8a52d-fd12-48da-981a-e70451721d98 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:39.984867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-84d8a52d-fd12-48da-981a-e70451721d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:40.073917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8a52d-fd12-48da-981a-e70451721d98 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:40.078365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886c610-5998-4518-a5e4-db54174fa4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:40.079122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886c610-5998-4518-a5e4-db54174fa4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:40.080011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886c610-5998-4518-a5e4-db54174fa4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:40.080011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886c610-5998-4518-a5e4-db54174fa4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:40.102052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886c610-5998-4518-a5e4-db54174fa4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:40.104390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886c610-5998-4518-a5e4-db54174fa4f2 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:40.117117 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1989/3947] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:40.407293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1cf33-1f7d-4167-9f09-a268f23f68f6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:40.409167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-65b1cf33-1f7d-4167-9f09-a268f23f68f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:40.453711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1cf33-1f7d-4167-9f09-a268f23f68f6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:40.471788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1812a-e462-4d0c-b265-4115c6f7ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:40.476989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1812a-e462-4d0c-b265-4115c6f7ecb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:40.479582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1812a-e462-4d0c-b265-4115c6f7ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:40.481116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1812a-e462-4d0c-b265-4115c6f7ecb0 admin admin] PATH_INFO: `/v3/users/7f2fd89c34d84d77b2c0ad9d5ad45390` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:40.485326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1812a-e462-4d0c-b265-4115c6f7ecb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2fd89c34d84d77b2c0ad9d5ad45390)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:40.490626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1812a-e462-4d0c-b265-4115c6f7ecb0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:40.595967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e5d1812a-e462-4d0c-b265-4115c6f7ecb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2fd89c34d84d77b2c0ad9d5ad45390'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:40.627737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e5d1812a-e462-4d0c-b265-4115c6f7ecb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2fd89c34d84d77b2c0ad9d5ad45390'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:40.628707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e5d1812a-e462-4d0c-b265-4115c6f7ecb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2fd89c34d84d77b2c0ad9d5ad45390'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:40.643312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e5d1812a-e462-4d0c-b265-4115c6f7ecb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2fd89c34d84d77b2c0ad9d5ad45390'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:40.671836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e5d1812a-e462-4d0c-b265-4115c6f7ecb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2fd89c34d84d77b2c0ad9d5ad45390'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:40.682459 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1959/3948] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:40 2022] DELETE /identity/v3/users/7f2fd89c34d84d77b2c0ad9d5ad45390 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:40.831629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be63c-c083-4d7d-a1ff-135de90068eb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:40.832639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be63c-c083-4d7d-a1ff-135de90068eb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:40.833394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be63c-c083-4d7d-a1ff-135de90068eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:40.879192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2f9be63c-c083-4d7d-a1ff-135de90068eb None None] MFA Rules not processed for user `4bfef22ac4e54465930158887c923f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:40.880716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2f9be63c-c083-4d7d-a1ff-135de90068eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:41.029777 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1990/3949] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:41.045004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa4cb3-260b-43e7-8a4c-fd8289da92ba None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:41.045293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa4cb3-260b-43e7-8a4c-fd8289da92ba None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:41.045637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa4cb3-260b-43e7-8a4c-fd8289da92ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:41.053900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9be63c-c083-4d7d-a1ff-135de90068eb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:41.057816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2f9be63c-c083-4d7d-a1ff-135de90068eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:41.130822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a4aa4cb3-260b-43e7-8a4c-fd8289da92ba None None] MFA Rules not processed for user `4bfef22ac4e54465930158887c923f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:41.132464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a4aa4cb3-260b-43e7-8a4c-fd8289da92ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:41.149574 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1960/3950] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:41.235497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9be63c-c083-4d7d-a1ff-135de90068eb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:41.241039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:41.242430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:41.242812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:41.243071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] PATH_INFO: `/v3/projects/53272886aeac4313b1e8ad37b6f9ff12` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:41.244351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=53272886aeac4313b1e8ad37b6f9ff12)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:41.246451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:41.334379 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:41.364951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53272886aeac4313b1e8ad37b6f9ff12', 'request_id': 'req-bd3cdd45-d5ec-4991-8884-734041b509ba'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:41.399883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53272886aeac4313b1e8ad37b6f9ff12', 'request_id': 'req-bd3cdd45-d5ec-4991-8884-734041b509ba'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:41.409639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53272886aeac4313b1e8ad37b6f9ff12', 'request_id': 'req-bd3cdd45-d5ec-4991-8884-734041b509ba'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:41.426827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa4cb3-260b-43e7-8a4c-fd8289da92ba None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:41.428748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a4aa4cb3-260b-43e7-8a4c-fd8289da92ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:41.435197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] The token cache is being invalidate because project 53272886aeac4313b1e8ad37b6f9ff12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:41.435591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:41.436833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd3cdd45-d5ec-4991-8884-734041b509ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:41.444073 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1991/3951] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:41 2022] DELETE /identity/v3/projects/53272886aeac4313b1e8ad37b6f9ff12 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:41.446876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4c546-a2ab-4914-9a37-3accc398c8e6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:41.447399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4c546-a2ab-4914-9a37-3accc398c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:41.447989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4c546-a2ab-4914-9a37-3accc398c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:41.463243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa4cb3-260b-43e7-8a4c-fd8289da92ba None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:41.511333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7bd4c546-a2ab-4914-9a37-3accc398c8e6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:41.514565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7bd4c546-a2ab-4914-9a37-3accc398c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:41.631992 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:41.705432 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1992/3952] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:41.716463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4c546-a2ab-4914-9a37-3accc398c8e6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:41.721470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7bd4c546-a2ab-4914-9a37-3accc398c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:41.728491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:41.729149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:41.729504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:41.729784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] PATH_INFO: `/v3/projects/e00db0b99140441586d38960284a8b8a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:41.731692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00db0b99140441586d38960284a8b8a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:41.734172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:41.851324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00db0b99140441586d38960284a8b8a', 'request_id': 'req-d265c073-337e-4d83-840b-f969b2d65b0e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:41.863643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00db0b99140441586d38960284a8b8a', 'request_id': 'req-d265c073-337e-4d83-840b-f969b2d65b0e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:41.873843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00db0b99140441586d38960284a8b8a', 'request_id': 'req-d265c073-337e-4d83-840b-f969b2d65b0e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:41.897209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] The token cache is being invalidate because project e00db0b99140441586d38960284a8b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:41.897940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:41.899166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d265c073-337e-4d83-840b-f969b2d65b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:41.901549 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1961/3953] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:41 2022] DELETE /identity/v3/projects/e00db0b99140441586d38960284a8b8a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:17:41.903262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e03ff-6b40-4cde-a7c5-a4aa4c6fcb93 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:41.903798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e03ff-6b40-4cde-a7c5-a4aa4c6fcb93 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:41.904300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e03ff-6b40-4cde-a7c5-a4aa4c6fcb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:41.932347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4c546-a2ab-4914-9a37-3accc398c8e6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:41.935037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d92e03ff-6b40-4cde-a7c5-a4aa4c6fcb93 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:41.937111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d92e03ff-6b40-4cde-a7c5-a4aa4c6fcb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:42.071370 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1962/3954] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:42.072571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e03ff-6b40-4cde-a7c5-a4aa4c6fcb93 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:42.074309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d92e03ff-6b40-4cde-a7c5-a4aa4c6fcb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:42.076644 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:42.115783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab82ff1-da08-415c-b4be-96285b0f58ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:42.116450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab82ff1-da08-415c-b4be-96285b0f58ef service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:42.116767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab82ff1-da08-415c-b4be-96285b0f58ef service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:42.117101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab82ff1-da08-415c-b4be-96285b0f58ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:42.119296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fab82ff1-da08-415c-b4be-96285b0f58ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:42.190116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e03ff-6b40-4cde-a7c5-a4aa4c6fcb93 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:42.197128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfc209-82d2-48de-85e9-65d0007c8880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:42.197549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfc209-82d2-48de-85e9-65d0007c8880 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:42.197937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfc209-82d2-48de-85e9-65d0007c8880 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:42.198334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfc209-82d2-48de-85e9-65d0007c8880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:42.201918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f8cfc209-82d2-48de-85e9-65d0007c8880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:42.219824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfc209-82d2-48de-85e9-65d0007c8880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:42.221593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfc209-82d2-48de-85e9-65d0007c8880 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:42.235521 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1963/3955] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:42.236875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfc209-82d2-48de-85e9-65d0007c8880 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:42.239734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f8cfc209-82d2-48de-85e9-65d0007c8880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:42.255325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab82ff1-da08-415c-b4be-96285b0f58ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:42.256656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab82ff1-da08-415c-b4be-96285b0f58ef service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:42.259758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfc209-82d2-48de-85e9-65d0007c8880 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:42.268807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:42.269875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:42.270473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:42.271057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] PATH_INFO: `/v3/users/422acba3ff864de9a46658540e38afa5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:42.272663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] RBAC: Authorizing `identity:delete_user(user_id=422acba3ff864de9a46658540e38afa5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:42.278248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:42.311846 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1993/3956] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:42.317494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab82ff1-da08-415c-b4be-96285b0f58ef service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:42.321839 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:42.362677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab82ff1-da08-415c-b4be-96285b0f58ef service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:42.383883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f22c-b4bf-4136-b280-a84b073cd06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:42.387557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f22c-b4bf-4136-b280-a84b073cd06a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:42.389206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f22c-b4bf-4136-b280-a84b073cd06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:42.392688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750f22c-b4bf-4136-b280-a84b073cd06a admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:42.394427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750f22c-b4bf-4136-b280-a84b073cd06a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:17:42.397563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750f22c-b4bf-4136-b280-a84b073cd06a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:42.403528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750f22c-b4bf-4136-b280-a84b073cd06a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:42.458210 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1994/3957] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:42.464917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f22c-b4bf-4136-b280-a84b073cd06a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:42.500717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422acba3ff864de9a46658540e38afa5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:42.526033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750f22c-b4bf-4136-b280-a84b073cd06a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:42.544105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32914b-f587-4171-ba79-5d33a66a0dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:42.546765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32914b-f587-4171-ba79-5d33a66a0dda admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:42.547061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32914b-f587-4171-ba79-5d33a66a0dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:42.547664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422acba3ff864de9a46658540e38afa5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:42.548615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32914b-f587-4171-ba79-5d33a66a0dda admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:42.549300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32914b-f587-4171-ba79-5d33a66a0dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:42.550873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422acba3ff864de9a46658540e38afa5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:42.559442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32914b-f587-4171-ba79-5d33a66a0dda admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:42.581647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422acba3ff864de9a46658540e38afa5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:42.613317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422acba3ff864de9a46658540e38afa5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:42.648383 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1964/3958] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:42 2022] DELETE /identity/v3/users/422acba3ff864de9a46658540e38afa5 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:42.689554 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1995/3959] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:42 2022] POST /identity/v3/projects => generated 395 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:42.690722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:42.692675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:42.880008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ee072-6036-4df1-88e7-6ba6d1f9335b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:43.062668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69112c66-8fc9-4c46-bd85-e09c53127c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:43.063314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69112c66-8fc9-4c46-bd85-e09c53127c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:43.063594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69112c66-8fc9-4c46-bd85-e09c53127c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:43.063868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69112c66-8fc9-4c46-bd85-e09c53127c3d admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:43.065052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69112c66-8fc9-4c46-bd85-e09c53127c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:43.067132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69112c66-8fc9-4c46-bd85-e09c53127c3d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:43.128121 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1965/3960] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:42 2022] POST /identity/v3/users => generated 298 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:43.130127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32914b-f587-4171-ba79-5d33a66a0dda admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:43.150293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32914b-f587-4171-ba79-5d33a66a0dda admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:43.166880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5240e-a6b3-4a6c-b0a4-7e10cc9dd693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:43.167815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5240e-a6b3-4a6c-b0a4-7e10cc9dd693 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:43.168279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5240e-a6b3-4a6c-b0a4-7e10cc9dd693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:43.168716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5240e-a6b3-4a6c-b0a4-7e10cc9dd693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:43.169863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5240e-a6b3-4a6c-b0a4-7e10cc9dd693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:43.173927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5240e-a6b3-4a6c-b0a4-7e10cc9dd693 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:43.191397 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1996/3961] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:17:43.198523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69112c66-8fc9-4c46-bd85-e09c53127c3d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:43.220804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69112c66-8fc9-4c46-bd85-e09c53127c3d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:43.233482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df412a12-0bf2-4de8-8973-d1c90afd0571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:43.234226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df412a12-0bf2-4de8-8973-d1c90afd0571 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:43.235969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df412a12-0bf2-4de8-8973-d1c90afd0571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:43.236733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df412a12-0bf2-4de8-8973-d1c90afd0571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:43.238892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df412a12-0bf2-4de8-8973-d1c90afd0571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:43.246166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df412a12-0bf2-4de8-8973-d1c90afd0571 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:43.283674 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1966/3962] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:43.284977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5240e-a6b3-4a6c-b0a4-7e10cc9dd693 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:43.300869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5240e-a6b3-4a6c-b0a4-7e10cc9dd693 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:43.318337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e679-b9ff-477d-ada3-0cb0b7a4ca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:43.325700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e679-b9ff-477d-ada3-0cb0b7a4ca26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:43.325992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e679-b9ff-477d-ada3-0cb0b7a4ca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:43.326280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e679-b9ff-477d-ada3-0cb0b7a4ca26 admin admin] PATH_INFO: `/v3/projects/b55ff3938f914b23a0a911b78d9da173/users/039f66a7c47b47e39672b8a49683f6ab/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:43.429058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608e679-b9ff-477d-ada3-0cb0b7a4ca26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55ff3938f914b23a0a911b78d9da173, user_id=039f66a7c47b47e39672b8a49683f6ab, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:43.434937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608e679-b9ff-477d-ada3-0cb0b7a4ca26 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:43.474704 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1997/3963] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:43 2022] PUT /identity/v3/projects/b55ff3938f914b23a0a911b78d9da173/users/039f66a7c47b47e39672b8a49683f6ab/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:43.478359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf31984-3b5f-433f-ac07-ac05bfab3ed6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:43.479088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf31984-3b5f-433f-ac07-ac05bfab3ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:43.479428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf31984-3b5f-433f-ac07-ac05bfab3ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:43.547030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cdf31984-3b5f-433f-ac07-ac05bfab3ed6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:43.551568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cdf31984-3b5f-433f-ac07-ac05bfab3ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:43.579003 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:43.752624 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1967/3964] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:43.779923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e679-b9ff-477d-ada3-0cb0b7a4ca26 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:43.781839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1608e679-b9ff-477d-ada3-0cb0b7a4ca26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:43.966627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e679-b9ff-477d-ada3-0cb0b7a4ca26 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:43.974344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf31984-3b5f-433f-ac07-ac05bfab3ed6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:43.976476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cdf31984-3b5f-433f-ac07-ac05bfab3ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:44.017162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9872324-0b04-4260-905b-c4af028cc01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:44.017920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872324-0b04-4260-905b-c4af028cc01b service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:44.018303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872324-0b04-4260-905b-c4af028cc01b service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:44.018550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872324-0b04-4260-905b-c4af028cc01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:44.028275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf31984-3b5f-433f-ac07-ac05bfab3ed6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:44.046510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:44.055028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:44.055375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:44.055656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] PATH_INFO: `/v3/projects/2c8884e5c2494e269ce701c4a8dab69d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:44.059641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8884e5c2494e269ce701c4a8dab69d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:44.061333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:44.068668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9872324-0b04-4260-905b-c4af028cc01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:44.078152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9872324-0b04-4260-905b-c4af028cc01b service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:44.118855 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1998/3965] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:44.215269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8884e5c2494e269ce701c4a8dab69d', 'request_id': 'req-08021712-eaa9-4dd6-84e3-de568f770ca8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:44.249392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8884e5c2494e269ce701c4a8dab69d', 'request_id': 'req-08021712-eaa9-4dd6-84e3-de568f770ca8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:44.258356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8884e5c2494e269ce701c4a8dab69d', 'request_id': 'req-08021712-eaa9-4dd6-84e3-de568f770ca8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:44.283735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] The token cache is being invalidate because project 2c8884e5c2494e269ce701c4a8dab69d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:44.284058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:44.285954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-08021712-eaa9-4dd6-84e3-de568f770ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:44.297955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072b77b-0d14-4e1c-bcc4-d059f963138d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:44.298480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072b77b-0d14-4e1c-bcc4-d059f963138d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:44.298480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072b77b-0d14-4e1c-bcc4-d059f963138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:44.301199 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1968/3966] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:43 2022] DELETE /identity/v3/projects/2c8884e5c2494e269ce701c4a8dab69d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:44.332935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d072b77b-0d14-4e1c-bcc4-d059f963138d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:44.334101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d072b77b-0d14-4e1c-bcc4-d059f963138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:44.423833 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:44.513514 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 1999/3967] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:44.521395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6138d-4bfc-4680-be68-9efe750882ec None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:44.521763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6138d-4bfc-4680-be68-9efe750882ec None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:44.522104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6138d-4bfc-4680-be68-9efe750882ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:44.558284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-36d6138d-4bfc-4680-be68-9efe750882ec None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:44.560936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-36d6138d-4bfc-4680-be68-9efe750882ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:44.577853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072b77b-0d14-4e1c-bcc4-d059f963138d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:44.588503 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1969/3968] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:44.594342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072b77b-0d14-4e1c-bcc4-d059f963138d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:44.601464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085c333-4ae8-4602-a13d-2143a84c3992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:44.602391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085c333-4ae8-4602-a13d-2143a84c3992 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:44.602969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085c333-4ae8-4602-a13d-2143a84c3992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:44.603452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085c333-4ae8-4602-a13d-2143a84c3992 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:44.604328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085c333-4ae8-4602-a13d-2143a84c3992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:17:44.604792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085c333-4ae8-4602-a13d-2143a84c3992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:44.606808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085c333-4ae8-4602-a13d-2143a84c3992 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:44.629749 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2000/3969] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:44.634752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6138d-4bfc-4680-be68-9efe750882ec None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:44.655345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6138d-4bfc-4680-be68-9efe750882ec None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:44.665560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cd4f8-50b8-4f89-aa61-88cf45d52628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:44.666387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cd4f8-50b8-4f89-aa61-88cf45d52628 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:44.666952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cd4f8-50b8-4f89-aa61-88cf45d52628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:44.667577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cd4f8-50b8-4f89-aa61-88cf45d52628 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:44.668414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cd4f8-50b8-4f89-aa61-88cf45d52628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:44.672250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cd4f8-50b8-4f89-aa61-88cf45d52628 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:44.743146 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1970/3970] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:44 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:44.746834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085c333-4ae8-4602-a13d-2143a84c3992 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:44.761592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085c333-4ae8-4602-a13d-2143a84c3992 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:44.878905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce3262-432c-40d8-bd79-5113335506f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:44.880389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce3262-432c-40d8-bd79-5113335506f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:44.881994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce3262-432c-40d8-bd79-5113335506f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:44.884434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce3262-432c-40d8-bd79-5113335506f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:44.887011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce3262-432c-40d8-bd79-5113335506f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:44.891894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce3262-432c-40d8-bd79-5113335506f6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:44.945710 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2001/3971] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:44 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:44.947429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cd4f8-50b8-4f89-aa61-88cf45d52628 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:44.966932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cd4f8-50b8-4f89-aa61-88cf45d52628 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:45.001718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6a4e4-4eb6-4461-8385-f6220b1695ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:45.004493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6a4e4-4eb6-4461-8385-f6220b1695ab admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:45.005604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6a4e4-4eb6-4461-8385-f6220b1695ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:45.007498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6a4e4-4eb6-4461-8385-f6220b1695ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:45.008868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6a4e4-4eb6-4461-8385-f6220b1695ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:45.013117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6a4e4-4eb6-4461-8385-f6220b1695ab admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:45.081797 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1971/3972] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:45.087567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce3262-432c-40d8-bd79-5113335506f6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:45.106285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce3262-432c-40d8-bd79-5113335506f6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:45.119952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88d0ae-a184-477c-9518-5768ce304779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:45.129080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d0ae-a184-477c-9518-5768ce304779 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:45.129505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d0ae-a184-477c-9518-5768ce304779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:45.129798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d0ae-a184-477c-9518-5768ce304779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:45.130481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d0ae-a184-477c-9518-5768ce304779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:45.135316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d0ae-a184-477c-9518-5768ce304779 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:45.181463 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2002/3973] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:45.186464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6a4e4-4eb6-4461-8385-f6220b1695ab admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:45.210245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6a4e4-4eb6-4461-8385-f6220b1695ab admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:45.230384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986c7f7-8a80-4cdb-a1e8-4589151f5f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:45.231110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986c7f7-8a80-4cdb-a1e8-4589151f5f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:45.231391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986c7f7-8a80-4cdb-a1e8-4589151f5f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:45.231665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986c7f7-8a80-4cdb-a1e8-4589151f5f9b admin admin] PATH_INFO: `/v3/projects/ad36bc69d684457b9d4e4114310409e7/users/50fb92e440f642c5849b3b8c3371d805/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:45.301668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986c7f7-8a80-4cdb-a1e8-4589151f5f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad36bc69d684457b9d4e4114310409e7, user_id=50fb92e440f642c5849b3b8c3371d805, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:45.305054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986c7f7-8a80-4cdb-a1e8-4589151f5f9b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:45.337820 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1972/3974] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:45 2022] PUT /identity/v3/projects/ad36bc69d684457b9d4e4114310409e7/users/50fb92e440f642c5849b3b8c3371d805/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:45.350106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e04ac-aadf-49a3-9438-b4389236ba36 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:45.350865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e04ac-aadf-49a3-9438-b4389236ba36 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:45.352069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e04ac-aadf-49a3-9438-b4389236ba36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:45.477971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5d6e04ac-aadf-49a3-9438-b4389236ba36 None None] MFA Rules not processed for user `50fb92e440f642c5849b3b8c3371d805`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:45.481168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5d6e04ac-aadf-49a3-9438-b4389236ba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:45.708203 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2003/3975] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:45.709812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986c7f7-8a80-4cdb-a1e8-4589151f5f9b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:45.735812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986c7f7-8a80-4cdb-a1e8-4589151f5f9b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:45.743195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d14067-9bdb-40ea-9051-322f3c157965 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:45.744322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d14067-9bdb-40ea-9051-322f3c157965 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:45.744904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d14067-9bdb-40ea-9051-322f3c157965 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:45.745415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d14067-9bdb-40ea-9051-322f3c157965 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:45.746546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d14067-9bdb-40ea-9051-322f3c157965 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=50fb92e440f642c5849b3b8c3371d805)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:45.749501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d14067-9bdb-40ea-9051-322f3c157965 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:45.807268 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1973/3976] 10.222.0.23 () {60 vars in 1299 bytes} [Sun Oct 2 01:17:45 2022] POST /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2 => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:45.811276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e04ac-aadf-49a3-9438-b4389236ba36 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:45.825879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e04ac-aadf-49a3-9438-b4389236ba36 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:45.839330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93ad13-264f-465f-a74b-2daad5780a89 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:45.840039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93ad13-264f-465f-a74b-2daad5780a89 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:45.840328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93ad13-264f-465f-a74b-2daad5780a89 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:45.840635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93ad13-264f-465f-a74b-2daad5780a89 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/3d368bcff8ae4b5ca7700f4ffbdd2624` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:45.844986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93ad13-264f-465f-a74b-2daad5780a89 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=50fb92e440f642c5849b3b8c3371d805, credential_id=3d368bcff8ae4b5ca7700f4ffbdd2624)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:45.846480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93ad13-264f-465f-a74b-2daad5780a89 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:45.901775 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2004/3977] 10.222.0.23 () {58 vars in 1380 bytes} [Sun Oct 2 01:17:45 2022] DELETE /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/3d368bcff8ae4b5ca7700f4ffbdd2624 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:45.907251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d14067-9bdb-40ea-9051-322f3c157965 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:45.941217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d14067-9bdb-40ea-9051-322f3c157965 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:45.956097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27883202-1f63-487a-a1b0-ca8d2fbfe96c tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:45.978196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883202-1f63-487a-a1b0-ca8d2fbfe96c tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:45.978655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883202-1f63-487a-a1b0-ca8d2fbfe96c tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:45.979803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883202-1f63-487a-a1b0-ca8d2fbfe96c tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:45.984107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27883202-1f63-487a-a1b0-ca8d2fbfe96c tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=50fb92e440f642c5849b3b8c3371d805)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:45.998768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27883202-1f63-487a-a1b0-ca8d2fbfe96c tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:46.056271 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1974/3978] 10.222.0.23 () {60 vars in 1299 bytes} [Sun Oct 2 01:17:45 2022] POST /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2 => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:46.058145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93ad13-264f-465f-a74b-2daad5780a89 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:46.063689 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:46.076053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93ad13-264f-465f-a74b-2daad5780a89 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:46.086384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60190deb-1d07-4f26-a0c1-ad8902dd63d8 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:46.089067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190deb-1d07-4f26-a0c1-ad8902dd63d8 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:46.089447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190deb-1d07-4f26-a0c1-ad8902dd63d8 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:46.090531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190deb-1d07-4f26-a0c1-ad8902dd63d8 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/e8b66449a46d419f967600b92b0bca34` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:46.094202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60190deb-1d07-4f26-a0c1-ad8902dd63d8 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=50fb92e440f642c5849b3b8c3371d805, credential_id=e8b66449a46d419f967600b92b0bca34)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:46.096396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60190deb-1d07-4f26-a0c1-ad8902dd63d8 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:46.157968 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2005/3979] 10.222.0.23 () {58 vars in 1380 bytes} [Sun Oct 2 01:17:46 2022] DELETE /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/e8b66449a46d419f967600b92b0bca34 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:46.159629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27883202-1f63-487a-a1b0-ca8d2fbfe96c tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:46.170034 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:46.185255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27883202-1f63-487a-a1b0-ca8d2fbfe96c tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:46.216534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5e420-b4ad-4db4-b42c-74dfda8e81ed tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:46.217226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5e420-b4ad-4db4-b42c-74dfda8e81ed tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:46.217514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5e420-b4ad-4db4-b42c-74dfda8e81ed tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:46.217788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5e420-b4ad-4db4-b42c-74dfda8e81ed tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/e8b66449a46d419f967600b92b0bca34` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-76c5e420-b4ad-4db4-b42c-74dfda8e81ed tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Could not find credential: 6468212e88eeb5cc45bb99387dc1476482c42269c2ac6d5d2dc1e5161b7960ee.: keystone.exception.CredentialNotFound: Could not find credential: 6468212e88eeb5cc45bb99387dc1476482c42269c2ac6d5d2dc1e5161b7960ee. Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 02 01:17:46.285600 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:17:46.287380 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 6468212e88eeb5cc45bb99387dc1476482c42269c2ac6d5d2dc1e5161b7960ee. Oct 02 01:17:46.288920 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:17:46.296478 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1975/3980] 10.222.0.23 () {58 vars in 1377 bytes} [Sun Oct 2 01:17:46 2022] GET /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/e8b66449a46d419f967600b92b0bca34 => generated 148 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:17:46.297398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60190deb-1d07-4f26-a0c1-ad8902dd63d8 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:46.314489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60190deb-1d07-4f26-a0c1-ad8902dd63d8 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:46.339165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87f9e2-983d-4968-a012-8fb6187da8e7 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:46.339690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87f9e2-983d-4968-a012-8fb6187da8e7 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:46.339981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87f9e2-983d-4968-a012-8fb6187da8e7 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:46.340260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87f9e2-983d-4968-a012-8fb6187da8e7 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:46.341324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87f9e2-983d-4968-a012-8fb6187da8e7 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=50fb92e440f642c5849b3b8c3371d805)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:46.343002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87f9e2-983d-4968-a012-8fb6187da8e7 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:46.431047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5e420-b4ad-4db4-b42c-74dfda8e81ed tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:46.431680 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2006/3981] 10.222.0.23 () {60 vars in 1299 bytes} [Sun Oct 2 01:17:46 2022] POST /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2 => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:17:46.449268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5e420-b4ad-4db4-b42c-74dfda8e81ed tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:46.462729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a6439-6b92-420f-a1b4-6e4fd728e67b tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:46.464053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a6439-6b92-420f-a1b4-6e4fd728e67b tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:46.465120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a6439-6b92-420f-a1b4-6e4fd728e67b tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:46.466259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a6439-6b92-420f-a1b4-6e4fd728e67b tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:46.467666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a6439-6b92-420f-a1b4-6e4fd728e67b tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=50fb92e440f642c5849b3b8c3371d805)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:46.469438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a6439-6b92-420f-a1b4-6e4fd728e67b tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:46.501831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87f9e2-983d-4968-a012-8fb6187da8e7 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:46.502717 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1976/3982] 10.222.0.23 () {60 vars in 1299 bytes} [Sun Oct 2 01:17:46 2022] POST /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2 => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:46.515196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87f9e2-983d-4968-a012-8fb6187da8e7 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:46.533429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5a58-453a-4023-b3c6-2a3cf03e2c3d tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:46.534128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5a58-453a-4023-b3c6-2a3cf03e2c3d tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:46.534418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5a58-453a-4023-b3c6-2a3cf03e2c3d tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:46.534732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5a58-453a-4023-b3c6-2a3cf03e2c3d tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:46.535424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba5a58-453a-4023-b3c6-2a3cf03e2c3d tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=50fb92e440f642c5849b3b8c3371d805)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:46.537078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba5a58-453a-4023-b3c6-2a3cf03e2c3d tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:46.565587 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2007/3983] 10.222.0.23 () {58 vars in 1278 bytes} [Sun Oct 2 01:17:46 2022] GET /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2 => generated 865 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:17:46.569866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a6439-6b92-420f-a1b4-6e4fd728e67b tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:46.582446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a6439-6b92-420f-a1b4-6e4fd728e67b tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:46.590639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bb758-672a-45f8-8a88-a69ac4ca2be4 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:46.595831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bb758-672a-45f8-8a88-a69ac4ca2be4 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:46.596975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bb758-672a-45f8-8a88-a69ac4ca2be4 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:46.598428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bb758-672a-45f8-8a88-a69ac4ca2be4 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/753c5001e2594f89aeafd4e3c5b2cb5b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:46.607529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bb758-672a-45f8-8a88-a69ac4ca2be4 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=50fb92e440f642c5849b3b8c3371d805, credential_id=753c5001e2594f89aeafd4e3c5b2cb5b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:46.609414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bb758-672a-45f8-8a88-a69ac4ca2be4 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:46.648343 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1977/3984] 10.222.0.23 () {58 vars in 1380 bytes} [Sun Oct 2 01:17:46 2022] DELETE /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/753c5001e2594f89aeafd4e3c5b2cb5b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:46.652605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5a58-453a-4023-b3c6-2a3cf03e2c3d tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:46.665930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5a58-453a-4023-b3c6-2a3cf03e2c3d tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:46.671395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b16e0-d9b5-4033-b098-aa1aa7792c6e tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:46.673853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b16e0-d9b5-4033-b098-aa1aa7792c6e tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:46.674654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b16e0-d9b5-4033-b098-aa1aa7792c6e tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:46.685266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b16e0-d9b5-4033-b098-aa1aa7792c6e tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/1cb63e46acc942de89a162549a8d68e8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:46.687883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b16e0-d9b5-4033-b098-aa1aa7792c6e tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=50fb92e440f642c5849b3b8c3371d805, credential_id=1cb63e46acc942de89a162549a8d68e8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:46.689582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b16e0-d9b5-4033-b098-aa1aa7792c6e tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:46.723631 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2008/3985] 10.222.0.23 () {58 vars in 1380 bytes} [Sun Oct 2 01:17:46 2022] DELETE /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/1cb63e46acc942de89a162549a8d68e8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:46.729368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bb758-672a-45f8-8a88-a69ac4ca2be4 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:46.743932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bb758-672a-45f8-8a88-a69ac4ca2be4 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:46.753135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276aa31-4c74-4fdf-89e8-5ac3ad1a036a tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:46.754326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276aa31-4c74-4fdf-89e8-5ac3ad1a036a tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:46.754804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276aa31-4c74-4fdf-89e8-5ac3ad1a036a tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:46.755243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276aa31-4c74-4fdf-89e8-5ac3ad1a036a tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:46.756046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276aa31-4c74-4fdf-89e8-5ac3ad1a036a tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=50fb92e440f642c5849b3b8c3371d805)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:46.758094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276aa31-4c74-4fdf-89e8-5ac3ad1a036a tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:46.793246 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1978/3986] 10.222.0.23 () {60 vars in 1299 bytes} [Sun Oct 2 01:17:46 2022] POST /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2 => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:46.796929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b16e0-d9b5-4033-b098-aa1aa7792c6e tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:46.810265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b16e0-d9b5-4033-b098-aa1aa7792c6e tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:46.822214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7063c0-f8d1-4393-9a84-709e9dd46605 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:46.823222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7063c0-f8d1-4393-9a84-709e9dd46605 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:46.823562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7063c0-f8d1-4393-9a84-709e9dd46605 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:46.823852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7063c0-f8d1-4393-9a84-709e9dd46605 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/59a67ccd3e644bd4be8b07103b3135cc` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:46.827484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7063c0-f8d1-4393-9a84-709e9dd46605 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=50fb92e440f642c5849b3b8c3371d805, credential_id=59a67ccd3e644bd4be8b07103b3135cc)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:46.831283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7063c0-f8d1-4393-9a84-709e9dd46605 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:46.843725 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2009/3987] 10.222.0.23 () {58 vars in 1377 bytes} [Sun Oct 2 01:17:46 2022] GET /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/59a67ccd3e644bd4be8b07103b3135cc => generated 367 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:46.847474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276aa31-4c74-4fdf-89e8-5ac3ad1a036a tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:46.862063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276aa31-4c74-4fdf-89e8-5ac3ad1a036a tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:46.874819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d2be2-ab9e-4826-9629-7e6d2fd15eb9 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fb92e440f642c5849b3b8c3371d805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad36bc69d684457b9d4e4114310409e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:46.875505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2be2-ab9e-4826-9629-7e6d2fd15eb9 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:46.875871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2be2-ab9e-4826-9629-7e6d2fd15eb9 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:46.876501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2be2-ab9e-4826-9629-7e6d2fd15eb9 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/59a67ccd3e644bd4be8b07103b3135cc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:46.881222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d2be2-ab9e-4826-9629-7e6d2fd15eb9 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=50fb92e440f642c5849b3b8c3371d805, credential_id=59a67ccd3e644bd4be8b07103b3135cc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:46.885720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d2be2-ab9e-4826-9629-7e6d2fd15eb9 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:46.917022 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1979/3988] 10.222.0.23 () {58 vars in 1380 bytes} [Sun Oct 2 01:17:46 2022] DELETE /identity/v3/users/50fb92e440f642c5849b3b8c3371d805/credentials/OS-EC2/59a67ccd3e644bd4be8b07103b3135cc => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:46.922008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7063c0-f8d1-4393-9a84-709e9dd46605 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:47.098865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7063c0-f8d1-4393-9a84-709e9dd46605 tempest-EC2CredentialsTest-55950589 tempest-EC2CredentialsTest-55950589-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:47.121223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:47.122105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:47.122487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:47.122897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] PATH_INFO: `/v3/users/50fb92e440f642c5849b3b8c3371d805` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:47.124369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fb92e440f642c5849b3b8c3371d805)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:47.127094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:47.229117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fb92e440f642c5849b3b8c3371d805'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:47.282629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fb92e440f642c5849b3b8c3371d805'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:47.286968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fb92e440f642c5849b3b8c3371d805'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:47.309025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fb92e440f642c5849b3b8c3371d805'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:47.309828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fb92e440f642c5849b3b8c3371d805'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:47.357067 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2010/3989] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:46 2022] DELETE /identity/v3/users/50fb92e440f642c5849b3b8c3371d805 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:47.361840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61352e88-7664-4d71-a52f-27d7b8bdc6f4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:47.362725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61352e88-7664-4d71-a52f-27d7b8bdc6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:47.363176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61352e88-7664-4d71-a52f-27d7b8bdc6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:47.402973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-61352e88-7664-4d71-a52f-27d7b8bdc6f4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:47.404601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-61352e88-7664-4d71-a52f-27d7b8bdc6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:47.514077 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1980/3990] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:47.558802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:47.560955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:47.624437 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:47.684354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa6718-b7f2-4116-823f-8a14ae2d2dbf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:47.692504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5059de2-3b7d-4399-9270-17558922f9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:47.693468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5059de2-3b7d-4399-9270-17558922f9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:47.694018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5059de2-3b7d-4399-9270-17558922f9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:47.694473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5059de2-3b7d-4399-9270-17558922f9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:47.706935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5059de2-3b7d-4399-9270-17558922f9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:47.708662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5059de2-3b7d-4399-9270-17558922f9c4 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:47.746696 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2011/3991] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:48.845475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61352e88-7664-4d71-a52f-27d7b8bdc6f4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:48.847583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-61352e88-7664-4d71-a52f-27d7b8bdc6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:48.865297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61352e88-7664-4d71-a52f-27d7b8bdc6f4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:48.902156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:48.903450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:48.904500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:48.904910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] PATH_INFO: `/v3/projects/ad36bc69d684457b9d4e4114310409e7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:48.906689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad36bc69d684457b9d4e4114310409e7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:48.911935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:49.031687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad36bc69d684457b9d4e4114310409e7', 'request_id': 'req-a8b4b699-78f5-4d89-8340-423b388e0d6d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:49.054318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad36bc69d684457b9d4e4114310409e7', 'request_id': 'req-a8b4b699-78f5-4d89-8340-423b388e0d6d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:49.076183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad36bc69d684457b9d4e4114310409e7', 'request_id': 'req-a8b4b699-78f5-4d89-8340-423b388e0d6d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:49.112587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] The token cache is being invalidate because project ad36bc69d684457b9d4e4114310409e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:49.113021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:49.113786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8b4b699-78f5-4d89-8340-423b388e0d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:49.119785 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1981/3992] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:48 2022] DELETE /identity/v3/projects/ad36bc69d684457b9d4e4114310409e7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:49.121170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a5784-dbac-4cfd-a72c-c3e3dd1bf737 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:49.121655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a5784-dbac-4cfd-a72c-c3e3dd1bf737 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:49.121655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a5784-dbac-4cfd-a72c-c3e3dd1bf737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:49.172406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ad0a5784-dbac-4cfd-a72c-c3e3dd1bf737 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:49.173939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ad0a5784-dbac-4cfd-a72c-c3e3dd1bf737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:49.337670 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2012/3993] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:49.352277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288fc7c-0482-428b-a1ec-2973372aa85b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:49.354928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288fc7c-0482-428b-a1ec-2973372aa85b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:49.355223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288fc7c-0482-428b-a1ec-2973372aa85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:49.423810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1288fc7c-0482-428b-a1ec-2973372aa85b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:49.427265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1288fc7c-0482-428b-a1ec-2973372aa85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:49.436730 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1982/3994] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:49.441351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a5784-dbac-4cfd-a72c-c3e3dd1bf737 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:49.458707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a5784-dbac-4cfd-a72c-c3e3dd1bf737 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:49.466564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e725ce-7f37-46de-848c-d0319d653bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:49.467226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e725ce-7f37-46de-848c-d0319d653bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:49.467713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e725ce-7f37-46de-848c-d0319d653bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:49.468605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e725ce-7f37-46de-848c-d0319d653bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:49.469904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e725ce-7f37-46de-848c-d0319d653bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:17:49.470518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e725ce-7f37-46de-848c-d0319d653bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:49.474447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e725ce-7f37-46de-848c-d0319d653bc3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:49.490438 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2013/3995] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:17:49.495289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288fc7c-0482-428b-a1ec-2973372aa85b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:49.511863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288fc7c-0482-428b-a1ec-2973372aa85b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:49.527628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98957a79-6fc3-48d2-8f63-cbfdd2ab62dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:49.528321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957a79-6fc3-48d2-8f63-cbfdd2ab62dd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:49.528606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957a79-6fc3-48d2-8f63-cbfdd2ab62dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:49.528878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957a79-6fc3-48d2-8f63-cbfdd2ab62dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:49.529681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98957a79-6fc3-48d2-8f63-cbfdd2ab62dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:49.533125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98957a79-6fc3-48d2-8f63-cbfdd2ab62dd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:49.554924 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:49.593315 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1983/3996] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:49 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:17:49.596474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e725ce-7f37-46de-848c-d0319d653bc3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:49.613937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e725ce-7f37-46de-848c-d0319d653bc3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:49.746942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884ad05-acd2-4ade-bf86-d0b8184e9cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:49.747971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ad05-acd2-4ade-bf86-d0b8184e9cba admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:49.751643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ad05-acd2-4ade-bf86-d0b8184e9cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:49.753009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ad05-acd2-4ade-bf86-d0b8184e9cba admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:49.754924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884ad05-acd2-4ade-bf86-d0b8184e9cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:49.762263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884ad05-acd2-4ade-bf86-d0b8184e9cba admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:49.825896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98957a79-6fc3-48d2-8f63-cbfdd2ab62dd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:49.826616 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2014/3997] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:49 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:17:49.843520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98957a79-6fc3-48d2-8f63-cbfdd2ab62dd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:49.890117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bbbd4-8bee-4053-9b22-3ad3c7ab096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:49.893913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bbbd4-8bee-4053-9b22-3ad3c7ab096b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:49.894400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bbbd4-8bee-4053-9b22-3ad3c7ab096b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:49.894918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bbbd4-8bee-4053-9b22-3ad3c7ab096b admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:49.897377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bbbd4-8bee-4053-9b22-3ad3c7ab096b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:49.905134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bbbd4-8bee-4053-9b22-3ad3c7ab096b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:49.943792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884ad05-acd2-4ade-bf86-d0b8184e9cba admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:49.957962 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1984/3998] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:49.963376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884ad05-acd2-4ade-bf86-d0b8184e9cba admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:49.972955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06705fe4-8f3f-4832-97b7-8f15bc9ecb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:49.974165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705fe4-8f3f-4832-97b7-8f15bc9ecb7e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:49.974165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705fe4-8f3f-4832-97b7-8f15bc9ecb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:49.974427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705fe4-8f3f-4832-97b7-8f15bc9ecb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:49.976139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06705fe4-8f3f-4832-97b7-8f15bc9ecb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:49.979333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06705fe4-8f3f-4832-97b7-8f15bc9ecb7e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:49.999290 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2015/3999] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:50.002870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bbbd4-8bee-4053-9b22-3ad3c7ab096b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:50.027251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bbbd4-8bee-4053-9b22-3ad3c7ab096b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:50.040536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c219a0-c1dd-4e9e-ae61-b63c5757b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:50.041817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c219a0-c1dd-4e9e-ae61-b63c5757b4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:50.042330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c219a0-c1dd-4e9e-ae61-b63c5757b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:50.043117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c219a0-c1dd-4e9e-ae61-b63c5757b4c6 admin admin] PATH_INFO: `/v3/projects/020d600e26ee4c42bf0042ca35ce3c06/users/8c513cd33754496191fde8af2f2569af/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:50.088837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c219a0-c1dd-4e9e-ae61-b63c5757b4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020d600e26ee4c42bf0042ca35ce3c06, user_id=8c513cd33754496191fde8af2f2569af, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:50.094938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c219a0-c1dd-4e9e-ae61-b63c5757b4c6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:50.131714 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1985/4000] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:50 2022] PUT /identity/v3/projects/020d600e26ee4c42bf0042ca35ce3c06/users/8c513cd33754496191fde8af2f2569af/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:50.136746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b4689-6c97-4b0b-af9d-6f45e3bb9253 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:50.137248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b4689-6c97-4b0b-af9d-6f45e3bb9253 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:50.137343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b4689-6c97-4b0b-af9d-6f45e3bb9253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:50.200025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6e8b4689-6c97-4b0b-af9d-6f45e3bb9253 None None] MFA Rules not processed for user `8c513cd33754496191fde8af2f2569af`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:50.201269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6e8b4689-6c97-4b0b-af9d-6f45e3bb9253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:50.249019 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:50.353189 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2016/4001] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:50.353439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c219a0-c1dd-4e9e-ae61-b63c5757b4c6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:50.435545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c219a0-c1dd-4e9e-ae61-b63c5757b4c6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:50.440670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9e2dc-758c-4ed5-bc0a-62f8a0e58efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:50.441293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9e2dc-758c-4ed5-bc0a-62f8a0e58efa admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:50.441570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9e2dc-758c-4ed5-bc0a-62f8a0e58efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:50.441844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9e2dc-758c-4ed5-bc0a-62f8a0e58efa admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:50.442511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9e2dc-758c-4ed5-bc0a-62f8a0e58efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:50.444483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9e2dc-758c-4ed5-bc0a-62f8a0e58efa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:50.479765 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1986/4002] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:50 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:17:50.483787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b4689-6c97-4b0b-af9d-6f45e3bb9253 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:50.495009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b4689-6c97-4b0b-af9d-6f45e3bb9253 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:50.564376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914c560-4d0c-484b-91f5-50ecb2a70c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:50.565414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c560-4d0c-484b-91f5-50ecb2a70c1b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:50.565886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c560-4d0c-484b-91f5-50ecb2a70c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:50.566235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c560-4d0c-484b-91f5-50ecb2a70c1b admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:50.567189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914c560-4d0c-484b-91f5-50ecb2a70c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:50.569545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914c560-4d0c-484b-91f5-50ecb2a70c1b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:50.598254 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2017/4003] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:50 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:17:50.602543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9e2dc-758c-4ed5-bc0a-62f8a0e58efa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:50.633697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9e2dc-758c-4ed5-bc0a-62f8a0e58efa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:50.640171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06174e1-8a05-4892-b56f-9e6a8e89b6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:50.641237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06174e1-8a05-4892-b56f-9e6a8e89b6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:50.641686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06174e1-8a05-4892-b56f-9e6a8e89b6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:50.642203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06174e1-8a05-4892-b56f-9e6a8e89b6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:50.644239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06174e1-8a05-4892-b56f-9e6a8e89b6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:50.649246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06174e1-8a05-4892-b56f-9e6a8e89b6d9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:50.667703 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1987/4004] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:50.671237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914c560-4d0c-484b-91f5-50ecb2a70c1b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:50.690974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914c560-4d0c-484b-91f5-50ecb2a70c1b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:50.698676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27ff82-07df-4609-8b7b-1a150531cf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:50.699717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27ff82-07df-4609-8b7b-1a150531cf69 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:50.700003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27ff82-07df-4609-8b7b-1a150531cf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:50.700374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27ff82-07df-4609-8b7b-1a150531cf69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:50.701034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27ff82-07df-4609-8b7b-1a150531cf69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:50.703014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27ff82-07df-4609-8b7b-1a150531cf69 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:50.726348 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2018/4005] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:50.730359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06174e1-8a05-4892-b56f-9e6a8e89b6d9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:50.747611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06174e1-8a05-4892-b56f-9e6a8e89b6d9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:50.757452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ace11-c7f5-483b-ab56-e8239eb74dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:50.758406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ace11-c7f5-483b-ab56-e8239eb74dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:50.758982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ace11-c7f5-483b-ab56-e8239eb74dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:50.758982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ace11-c7f5-483b-ab56-e8239eb74dfb admin admin] PATH_INFO: `/v3/projects/e20fcc48e7cc473fb8e4158846a44f46/users/ef635f8f91a144e592125b9b68d0c8be/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:50.782428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ace11-c7f5-483b-ab56-e8239eb74dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20fcc48e7cc473fb8e4158846a44f46, user_id=ef635f8f91a144e592125b9b68d0c8be, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:50.791974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ace11-c7f5-483b-ab56-e8239eb74dfb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:50.837645 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1988/4006] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:50 2022] PUT /identity/v3/projects/e20fcc48e7cc473fb8e4158846a44f46/users/ef635f8f91a144e592125b9b68d0c8be/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:50.839565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f1033-5156-4088-950e-c3fe3caecf07 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:50.839854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f1033-5156-4088-950e-c3fe3caecf07 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:50.840226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f1033-5156-4088-950e-c3fe3caecf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:50.942955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-087f1033-5156-4088-950e-c3fe3caecf07 None None] MFA Rules not processed for user `ef635f8f91a144e592125b9b68d0c8be`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:50.944799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-087f1033-5156-4088-950e-c3fe3caecf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:51.101029 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2019/4007] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:51.107877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ace11-c7f5-483b-ab56-e8239eb74dfb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:51.180433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ace11-c7f5-483b-ab56-e8239eb74dfb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:51.184719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5515c-81fa-475f-bdb9-029a3cad535f tempest-IdentityV3ProjectsTest-1172820511 tempest-IdentityV3ProjectsTest-1172820511-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c513cd33754496191fde8af2f2569af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d600e26ee4c42bf0042ca35ce3c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:51.185429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5515c-81fa-475f-bdb9-029a3cad535f tempest-IdentityV3ProjectsTest-1172820511 tempest-IdentityV3ProjectsTest-1172820511-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:51.185779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5515c-81fa-475f-bdb9-029a3cad535f tempest-IdentityV3ProjectsTest-1172820511 tempest-IdentityV3ProjectsTest-1172820511-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:51.186121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5515c-81fa-475f-bdb9-029a3cad535f tempest-IdentityV3ProjectsTest-1172820511 tempest-IdentityV3ProjectsTest-1172820511-project] PATH_INFO: `/v3/users/8c513cd33754496191fde8af2f2569af/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:51.188019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5515c-81fa-475f-bdb9-029a3cad535f tempest-IdentityV3ProjectsTest-1172820511 tempest-IdentityV3ProjectsTest-1172820511-project] RBAC: Authorizing `identity:list_user_projects(user_id=8c513cd33754496191fde8af2f2569af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:51.190745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5515c-81fa-475f-bdb9-029a3cad535f tempest-IdentityV3ProjectsTest-1172820511 tempest-IdentityV3ProjectsTest-1172820511-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:51.220980 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:51.266715 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1989/4008] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:17:51 2022] GET /identity/v3/users/8c513cd33754496191fde8af2f2569af/projects => generated 517 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:17:51.267006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1398-4a3f-4e4f-b350-5e6c88accfa9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:51.267503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1398-4a3f-4e4f-b350-5e6c88accfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:51.267610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1398-4a3f-4e4f-b350-5e6c88accfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:51.333711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0a5e1398-4a3f-4e4f-b350-5e6c88accfa9 None None] MFA Rules not processed for user `8c513cd33754496191fde8af2f2569af`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:51.335158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0a5e1398-4a3f-4e4f-b350-5e6c88accfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:51.344070 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2020/4009] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:17:51.349138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3574-7ec5-4c72-a734-3d2fc6f7ce05 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:51.349448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3574-7ec5-4c72-a734-3d2fc6f7ce05 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:51.349697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3574-7ec5-4c72-a734-3d2fc6f7ce05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:51.373438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-976e3574-7ec5-4c72-a734-3d2fc6f7ce05 None None] MFA Rules not processed for user `8c513cd33754496191fde8af2f2569af`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:51.374745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-976e3574-7ec5-4c72-a734-3d2fc6f7ce05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:51.435019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.models.token_model [None req-976e3574-7ec5-4c72-a734-3d2fc6f7ce05 None None] User 8c513cd33754496191fde8af2f2569af has no access to project e20fcc48e7cc473fb8e4158846a44f46 {{(pid=81854) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 02 01:17:51.439454 n-d-master-1 devstack@keystone.service[81854]: WARNING keystone.server.flask.application [None req-976e3574-7ec5-4c72-a734-3d2fc6f7ce05 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 02 01:17:51.441537 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1990/4010] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:51 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 93 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 02 01:17:51.446511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e1398-4a3f-4e4f-b350-5e6c88accfa9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:51.473885 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:51.559861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e1398-4a3f-4e4f-b350-5e6c88accfa9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:51.572416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb182da0-c139-4c08-bdb9-06e3b0031678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:51.573159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182da0-c139-4c08-bdb9-06e3b0031678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:51.573503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182da0-c139-4c08-bdb9-06e3b0031678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:51.573836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182da0-c139-4c08-bdb9-06e3b0031678 admin admin] PATH_INFO: `/v3/users/8c513cd33754496191fde8af2f2569af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:51.576274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb182da0-c139-4c08-bdb9-06e3b0031678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c513cd33754496191fde8af2f2569af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:51.584533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb182da0-c139-4c08-bdb9-06e3b0031678 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:51.718800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fb182da0-c139-4c08-bdb9-06e3b0031678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c513cd33754496191fde8af2f2569af'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:51.720111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb266d28-27f2-4691-b632-736b4a6e8ca1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:51.720413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb266d28-27f2-4691-b632-736b4a6e8ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:51.720690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb266d28-27f2-4691-b632-736b4a6e8ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:51.750950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fb182da0-c139-4c08-bdb9-06e3b0031678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c513cd33754496191fde8af2f2569af'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:51.751794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fb182da0-c139-4c08-bdb9-06e3b0031678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c513cd33754496191fde8af2f2569af'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:51.756831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cb266d28-27f2-4691-b632-736b4a6e8ca1 None None] MFA Rules not processed for user `db9450c53d8944b88cfbbc541f585ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:51.760174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cb266d28-27f2-4691-b632-736b4a6e8ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:51.764922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fb182da0-c139-4c08-bdb9-06e3b0031678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c513cd33754496191fde8af2f2569af'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:51.766177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fb182da0-c139-4c08-bdb9-06e3b0031678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c513cd33754496191fde8af2f2569af'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:51.796479 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2021/4011] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:51 2022] DELETE /identity/v3/users/8c513cd33754496191fde8af2f2569af => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:51.798185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf7304-f1b5-4dd1-948e-82a866a78776 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:51.798522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf7304-f1b5-4dd1-948e-82a866a78776 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:51.798915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf7304-f1b5-4dd1-948e-82a866a78776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:51.845154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2cbf7304-f1b5-4dd1-948e-82a866a78776 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:51.846393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2cbf7304-f1b5-4dd1-948e-82a866a78776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:51.874792 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1991/4012] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:17:51.938016 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2022/4013] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:51.950953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb266d28-27f2-4691-b632-736b4a6e8ca1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:51.952488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cb266d28-27f2-4691-b632-736b4a6e8ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:52.081931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb266d28-27f2-4691-b632-736b4a6e8ca1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:52.163897 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:52.177498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1cd26-50aa-4f06-b80b-70084130705c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:52.177998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1cd26-50aa-4f06-b80b-70084130705c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:52.178468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1cd26-50aa-4f06-b80b-70084130705c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:52.179094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1cd26-50aa-4f06-b80b-70084130705c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:52.192830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1cd26-50aa-4f06-b80b-70084130705c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:52.195029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1cd26-50aa-4f06-b80b-70084130705c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:52.209774 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1992/4014] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:52.677531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf7304-f1b5-4dd1-948e-82a866a78776 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:52.679951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2cbf7304-f1b5-4dd1-948e-82a866a78776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:52.702142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf7304-f1b5-4dd1-948e-82a866a78776 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:52.708021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:52.709032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:52.709514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:52.709953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] PATH_INFO: `/v3/projects/020d600e26ee4c42bf0042ca35ce3c06` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:52.711387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=020d600e26ee4c42bf0042ca35ce3c06)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:52.713837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:52.784869 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:52.803067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020d600e26ee4c42bf0042ca35ce3c06', 'request_id': 'req-7438896c-5c16-424c-a5dd-368b0f3b6081'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:52.815972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020d600e26ee4c42bf0042ca35ce3c06', 'request_id': 'req-7438896c-5c16-424c-a5dd-368b0f3b6081'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:52.823579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020d600e26ee4c42bf0042ca35ce3c06', 'request_id': 'req-7438896c-5c16-424c-a5dd-368b0f3b6081'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:52.850267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] The token cache is being invalidate because project 020d600e26ee4c42bf0042ca35ce3c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:52.852292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:52.853302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7438896c-5c16-424c-a5dd-368b0f3b6081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:52.857864 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2023/4015] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:52 2022] DELETE /identity/v3/projects/020d600e26ee4c42bf0042ca35ce3c06 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:52.859116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1cd26-50aa-4f06-b80b-70084130705c service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:52.873872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1cd26-50aa-4f06-b80b-70084130705c service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:52.954709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:52.955733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:52.956009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:52.956821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] PATH_INFO: `/v3/users/ef635f8f91a144e592125b9b68d0c8be` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:52.958007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef635f8f91a144e592125b9b68d0c8be)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:52.959992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:53.025409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef635f8f91a144e592125b9b68d0c8be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:53.042864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef635f8f91a144e592125b9b68d0c8be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:53.043672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef635f8f91a144e592125b9b68d0c8be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:53.053936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef635f8f91a144e592125b9b68d0c8be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:53.064377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef635f8f91a144e592125b9b68d0c8be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:53.079118 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1993/4016] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:52 2022] DELETE /identity/v3/users/ef635f8f91a144e592125b9b68d0c8be => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:53.364070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e255220-c5b7-4ef5-8add-37a7744741b3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:53.364358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e255220-c5b7-4ef5-8add-37a7744741b3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:53.364635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e255220-c5b7-4ef5-8add-37a7744741b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:53.394416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8e255220-c5b7-4ef5-8add-37a7744741b3 None None] MFA Rules not processed for user `5104bda5de774e93bd494d64a8f11faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:53.396045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8e255220-c5b7-4ef5-8add-37a7744741b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:53.406223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:53.408220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:53.504791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34e56-8675-4c11-81e7-67f114df345a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:53.506403 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2024/4017] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:53.510312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:53.510987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:53.511321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:53.511608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] PATH_INFO: `/v3/projects/e20fcc48e7cc473fb8e4158846a44f46` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:53.512731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20fcc48e7cc473fb8e4158846a44f46)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:53.514875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:53.523857 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:53.567742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20fcc48e7cc473fb8e4158846a44f46', 'request_id': 'req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:53.574400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20fcc48e7cc473fb8e4158846a44f46', 'request_id': 'req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:53.581473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20fcc48e7cc473fb8e4158846a44f46', 'request_id': 'req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:53.597493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] The token cache is being invalidate because project e20fcc48e7cc473fb8e4158846a44f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:53.597928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:53.599344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2eeb4f0f-645e-48cd-9058-5b0ae90b2adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:53.601811 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1994/4018] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:53 2022] DELETE /identity/v3/projects/e20fcc48e7cc473fb8e4158846a44f46 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:53.608764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925c1f-a5a2-454d-8a67-7852ee7b837c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:53.609073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925c1f-a5a2-454d-8a67-7852ee7b837c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:53.609358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925c1f-a5a2-454d-8a67-7852ee7b837c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:53.633715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-79925c1f-a5a2-454d-8a67-7852ee7b837c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:53.635344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-79925c1f-a5a2-454d-8a67-7852ee7b837c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:53.705155 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2025/4019] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:53.714062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289c661-723e-431e-bb3b-ca852879a003 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:53.714507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289c661-723e-431e-bb3b-ca852879a003 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:53.715254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289c661-723e-431e-bb3b-ca852879a003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:53.739481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4289c661-723e-431e-bb3b-ca852879a003 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:53.740838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4289c661-723e-431e-bb3b-ca852879a003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:53.754356 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1995/4020] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:53.756283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925c1f-a5a2-454d-8a67-7852ee7b837c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:53.766773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925c1f-a5a2-454d-8a67-7852ee7b837c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:53.771471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418424c9-d851-4fd9-a113-09dc94ca1ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:53.772083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418424c9-d851-4fd9-a113-09dc94ca1ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:53.772434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418424c9-d851-4fd9-a113-09dc94ca1ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:53.772712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418424c9-d851-4fd9-a113-09dc94ca1ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:53.774002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418424c9-d851-4fd9-a113-09dc94ca1ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:17:53.774247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418424c9-d851-4fd9-a113-09dc94ca1ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:53.775889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418424c9-d851-4fd9-a113-09dc94ca1ad6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:53.790680 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2026/4021] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:17:53.793313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289c661-723e-431e-bb3b-ca852879a003 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:53.803223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289c661-723e-431e-bb3b-ca852879a003 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:53.808095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254b8a-9d90-4c2c-b9e9-f9f799b59c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:53.808744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254b8a-9d90-4c2c-b9e9-f9f799b59c43 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:53.809026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254b8a-9d90-4c2c-b9e9-f9f799b59c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:53.809298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254b8a-9d90-4c2c-b9e9-f9f799b59c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:53.809944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1254b8a-9d90-4c2c-b9e9-f9f799b59c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:53.812577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1254b8a-9d90-4c2c-b9e9-f9f799b59c43 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:53.845190 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1996/4022] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:53 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:53.846464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418424c9-d851-4fd9-a113-09dc94ca1ad6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:53.857425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418424c9-d851-4fd9-a113-09dc94ca1ad6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:53.902908 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:53.923354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f72d7-45c1-4761-a91f-952472f5dac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:53.924073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f72d7-45c1-4761-a91f-952472f5dac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:53.924247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f72d7-45c1-4761-a91f-952472f5dac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:53.924524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f72d7-45c1-4761-a91f-952472f5dac1 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:53.925269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f72d7-45c1-4761-a91f-952472f5dac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:53.927662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f72d7-45c1-4761-a91f-952472f5dac1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:53.954295 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2027/4023] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:53 2022] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:53.955925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254b8a-9d90-4c2c-b9e9-f9f799b59c43 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:53.968774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254b8a-9d90-4c2c-b9e9-f9f799b59c43 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:53.974005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fb9d7-41db-4ceb-9f10-562e33fda3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:53.974919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb9d7-41db-4ceb-9f10-562e33fda3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:53.975203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb9d7-41db-4ceb-9f10-562e33fda3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:53.975476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb9d7-41db-4ceb-9f10-562e33fda3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:53.976132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fb9d7-41db-4ceb-9f10-562e33fda3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:53.978081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fb9d7-41db-4ceb-9f10-562e33fda3d5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:53.989074 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1997/4024] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:53.993072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f72d7-45c1-4761-a91f-952472f5dac1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:54.003204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f72d7-45c1-4761-a91f-952472f5dac1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:54.008761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e356-99d9-414f-98da-951c253d5c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:54.009778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e356-99d9-414f-98da-951c253d5c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:54.010240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e356-99d9-414f-98da-951c253d5c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:54.010728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e356-99d9-414f-98da-951c253d5c9d admin admin] PATH_INFO: `/v3/projects/7ead3e0855564017845dad81da654283/users/c9ab6805f82a431eb65f56e8298c3c4f/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:54.027690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e356-99d9-414f-98da-951c253d5c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ead3e0855564017845dad81da654283, user_id=c9ab6805f82a431eb65f56e8298c3c4f, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:54.030257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e356-99d9-414f-98da-951c253d5c9d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:54.045654 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2028/4025] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:53 2022] PUT /identity/v3/projects/7ead3e0855564017845dad81da654283/users/c9ab6805f82a431eb65f56e8298c3c4f/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:17:54.049432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fb9d7-41db-4ceb-9f10-562e33fda3d5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:54.059421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fb9d7-41db-4ceb-9f10-562e33fda3d5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:54.124636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57610154-3545-4b68-b944-0539dd6459e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:54.125350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57610154-3545-4b68-b944-0539dd6459e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:54.125699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57610154-3545-4b68-b944-0539dd6459e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:54.126043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57610154-3545-4b68-b944-0539dd6459e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:54.127218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57610154-3545-4b68-b944-0539dd6459e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:54.128631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57610154-3545-4b68-b944-0539dd6459e9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:54.141201 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1998/4026] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:54.145332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e356-99d9-414f-98da-951c253d5c9d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:54.173007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e356-99d9-414f-98da-951c253d5c9d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:54.182927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a594032-7c7f-436c-a57a-d1844dd38853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:54.183695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a594032-7c7f-436c-a57a-d1844dd38853 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:54.183980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a594032-7c7f-436c-a57a-d1844dd38853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:54.184254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a594032-7c7f-436c-a57a-d1844dd38853 admin admin] PATH_INFO: `/v3/projects/7ead3e0855564017845dad81da654283/users/c9ab6805f82a431eb65f56e8298c3c4f/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:54.186516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a594032-7c7f-436c-a57a-d1844dd38853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ead3e0855564017845dad81da654283, user_id=c9ab6805f82a431eb65f56e8298c3c4f, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:54.189287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a594032-7c7f-436c-a57a-d1844dd38853 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:54.201902 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2029/4027] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:54 2022] PUT /identity/v3/projects/7ead3e0855564017845dad81da654283/users/c9ab6805f82a431eb65f56e8298c3c4f/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:17:54.212314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88b6c-b1ca-4b13-9255-09fdb6e8ebc5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:54.212627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88b6c-b1ca-4b13-9255-09fdb6e8ebc5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:54.212905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88b6c-b1ca-4b13-9255-09fdb6e8ebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:54.253368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-04d88b6c-b1ca-4b13-9255-09fdb6e8ebc5 None None] MFA Rules not processed for user `c9ab6805f82a431eb65f56e8298c3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:54.255137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-04d88b6c-b1ca-4b13-9255-09fdb6e8ebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:54.340154 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:54.402176 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1999/4028] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:54.406630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a594032-7c7f-436c-a57a-d1844dd38853 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:54.510657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a594032-7c7f-436c-a57a-d1844dd38853 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:54.516385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a163e-1d71-4b0f-8657-3b8768d9a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:54.517112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a163e-1d71-4b0f-8657-3b8768d9a748 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:54.517548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a163e-1d71-4b0f-8657-3b8768d9a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:54.517913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a163e-1d71-4b0f-8657-3b8768d9a748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:54.518665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a163e-1d71-4b0f-8657-3b8768d9a748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:54.520665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a163e-1d71-4b0f-8657-3b8768d9a748 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:54.560190 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2030/4029] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:17:54 2022] POST /identity/v3/projects => generated 393 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:54.565143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d88b6c-b1ca-4b13-9255-09fdb6e8ebc5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:54.592602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d88b6c-b1ca-4b13-9255-09fdb6e8ebc5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:54.683085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5f63d-3b8a-47b9-95c0-1c3c19df929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:54.684183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f63d-3b8a-47b9-95c0-1c3c19df929c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:54.684635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f63d-3b8a-47b9-95c0-1c3c19df929c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:54.684909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f63d-3b8a-47b9-95c0-1c3c19df929c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:54.685533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5f63d-3b8a-47b9-95c0-1c3c19df929c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:54.687522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5f63d-3b8a-47b9-95c0-1c3c19df929c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:54.718821 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2000/4030] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:17:54 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:17:54.720061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a163e-1d71-4b0f-8657-3b8768d9a748 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:54.731810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a163e-1d71-4b0f-8657-3b8768d9a748 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:54.737831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0359bda-978f-44bd-9d20-cfa0c43d1c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:54.738709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359bda-978f-44bd-9d20-cfa0c43d1c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:54.739532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359bda-978f-44bd-9d20-cfa0c43d1c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:54.739826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359bda-978f-44bd-9d20-cfa0c43d1c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:54.740459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0359bda-978f-44bd-9d20-cfa0c43d1c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:54.742323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0359bda-978f-44bd-9d20-cfa0c43d1c99 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:54.757264 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2031/4031] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:54.760870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5f63d-3b8a-47b9-95c0-1c3c19df929c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:54.775737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5f63d-3b8a-47b9-95c0-1c3c19df929c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:54.780714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9ad4c-7caa-43ef-98a1-9a2692ce43d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:54.781706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9ad4c-7caa-43ef-98a1-9a2692ce43d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:54.782256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9ad4c-7caa-43ef-98a1-9a2692ce43d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:54.782560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9ad4c-7caa-43ef-98a1-9a2692ce43d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:54.783334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9ad4c-7caa-43ef-98a1-9a2692ce43d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:54.785142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9ad4c-7caa-43ef-98a1-9a2692ce43d2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:54.805590 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2001/4032] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:17:54.807305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0359bda-978f-44bd-9d20-cfa0c43d1c99 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:54.818145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0359bda-978f-44bd-9d20-cfa0c43d1c99 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:54.823912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70179513-e430-40b2-bf05-ca91e6505fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:54.824577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179513-e430-40b2-bf05-ca91e6505fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:54.824854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179513-e430-40b2-bf05-ca91e6505fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:54.825124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179513-e430-40b2-bf05-ca91e6505fe7 admin admin] PATH_INFO: `/v3/projects/7c20638e2360480ba263593f4314b94f/users/9fa146cfdae74bce97da001d3859f24c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:54.846536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70179513-e430-40b2-bf05-ca91e6505fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c20638e2360480ba263593f4314b94f, user_id=9fa146cfdae74bce97da001d3859f24c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:54.849480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70179513-e430-40b2-bf05-ca91e6505fe7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:54.864495 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2032/4033] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:17:54 2022] PUT /identity/v3/projects/7c20638e2360480ba263593f4314b94f/users/9fa146cfdae74bce97da001d3859f24c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:54.950524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7680b6a-7978-405e-be4b-72252c2f280f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:54.950882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7680b6a-7978-405e-be4b-72252c2f280f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:54.951116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7680b6a-7978-405e-be4b-72252c2f280f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:54.992335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e7680b6a-7978-405e-be4b-72252c2f280f None None] MFA Rules not processed for user `9fa146cfdae74bce97da001d3859f24c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:54.994541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e7680b6a-7978-405e-be4b-72252c2f280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:55.126641 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2002/4034] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:17:55.141397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70179513-e430-40b2-bf05-ca91e6505fe7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:55.143448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-70179513-e430-40b2-bf05-ca91e6505fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:55.222479 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:55.245005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70179513-e430-40b2-bf05-ca91e6505fe7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:55.249304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15091283-3a55-4da0-bfa0-1b585934b86b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:55.250025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15091283-3a55-4da0-bfa0-1b585934b86b service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:55.250332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15091283-3a55-4da0-bfa0-1b585934b86b service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:55.250867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15091283-3a55-4da0-bfa0-1b585934b86b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:55.377373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15091283-3a55-4da0-bfa0-1b585934b86b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:55.379517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15091283-3a55-4da0-bfa0-1b585934b86b service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:55.392915 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2033/4035] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:56.796785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7680b6a-7978-405e-be4b-72252c2f280f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:56.891395 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:56.920441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7680b6a-7978-405e-be4b-72252c2f280f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:56.929886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:56.931024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:56.931495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:56.931897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] PATH_INFO: `/v3/users/c9ab6805f82a431eb65f56e8298c3c4f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:56.933993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ab6805f82a431eb65f56e8298c3c4f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:56.936415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:57.045563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ab6805f82a431eb65f56e8298c3c4f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:57.085927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ab6805f82a431eb65f56e8298c3c4f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:57.087645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ab6805f82a431eb65f56e8298c3c4f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:57.103115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ab6805f82a431eb65f56e8298c3c4f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:57.119406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ab6805f82a431eb65f56e8298c3c4f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:57.136305 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2003/4036] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:56 2022] DELETE /identity/v3/users/c9ab6805f82a431eb65f56e8298c3c4f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:57.136991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89a4ca-c74a-4e6c-8da1-086ca2d42a5b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:57.137451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89a4ca-c74a-4e6c-8da1-086ca2d42a5b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:57.137556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89a4ca-c74a-4e6c-8da1-086ca2d42a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:57.178219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7b89a4ca-c74a-4e6c-8da1-086ca2d42a5b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:17:57.187567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7b89a4ca-c74a-4e6c-8da1-086ca2d42a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:57.324962 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2034/4037] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:17:57.352779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:57.354502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:57.505782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d318e0-c7d6-465d-b78e-32ee50db638f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:57.512070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb5903-18c2-4d50-9533-b1fb185dca0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:57.512705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb5903-18c2-4d50-9533-b1fb185dca0e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:57.512992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb5903-18c2-4d50-9533-b1fb185dca0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:57.513268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb5903-18c2-4d50-9533-b1fb185dca0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:57.534332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb5903-18c2-4d50-9533-b1fb185dca0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:57.536043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb5903-18c2-4d50-9533-b1fb185dca0e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:57.576665 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2004/4038] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:17:58.765764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89a4ca-c74a-4e6c-8da1-086ca2d42a5b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:58.771996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7b89a4ca-c74a-4e6c-8da1-086ca2d42a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:17:58.812833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89a4ca-c74a-4e6c-8da1-086ca2d42a5b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:58.830725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:58.831660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:58.832173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:58.832707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] PATH_INFO: `/v3/projects/7ead3e0855564017845dad81da654283` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:58.834950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ead3e0855564017845dad81da654283)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:58.837995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:58.938433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ead3e0855564017845dad81da654283', 'request_id': 'req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:58.946197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ead3e0855564017845dad81da654283', 'request_id': 'req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:58.953969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ead3e0855564017845dad81da654283', 'request_id': 'req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:59.009047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] The token cache is being invalidate because project 7ead3e0855564017845dad81da654283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:17:59.009311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:59.011271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:59.014241 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2035/4039] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:17:58 2022] DELETE /identity/v3/projects/7ead3e0855564017845dad81da654283 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:17:59.021467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb5903-18c2-4d50-9533-b1fb185dca0e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:17:59.060106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb5903-18c2-4d50-9533-b1fb185dca0e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:17:59.198408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829303f4-a55d-4638-96f3-c58c9b151519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:17:59.199128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829303f4-a55d-4638-96f3-c58c9b151519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:17:59.199409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829303f4-a55d-4638-96f3-c58c9b151519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:17:59.199684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829303f4-a55d-4638-96f3-c58c9b151519 admin admin] PATH_INFO: `/v3/users/9fa146cfdae74bce97da001d3859f24c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:17:59.202447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829303f4-a55d-4638-96f3-c58c9b151519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa146cfdae74bce97da001d3859f24c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:17:59.204486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829303f4-a55d-4638-96f3-c58c9b151519 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:17:59.240089 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:17:59.362752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-829303f4-a55d-4638-96f3-c58c9b151519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa146cfdae74bce97da001d3859f24c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:59.401858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-829303f4-a55d-4638-96f3-c58c9b151519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa146cfdae74bce97da001d3859f24c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:59.403265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-829303f4-a55d-4638-96f3-c58c9b151519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa146cfdae74bce97da001d3859f24c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:59.417683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-829303f4-a55d-4638-96f3-c58c9b151519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa146cfdae74bce97da001d3859f24c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:59.435081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-829303f4-a55d-4638-96f3-c58c9b151519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa146cfdae74bce97da001d3859f24c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:17:59.457254 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2005/4040] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:17:59 2022] DELETE /identity/v3/users/9fa146cfdae74bce97da001d3859f24c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:00.244415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:00.246054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:00.277915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb946-e8c3-4eeb-be49-2d2270ca163f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:00.297869 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:00.400248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:00.401535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:00.401881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:00.402866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] PATH_INFO: `/v3/projects/7c20638e2360480ba263593f4314b94f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:00.403575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c20638e2360480ba263593f4314b94f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:00.405769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:00.468627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c20638e2360480ba263593f4314b94f', 'request_id': 'req-08b7ad70-c082-45d3-9956-c9e991343978'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:00.475831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c20638e2360480ba263593f4314b94f', 'request_id': 'req-08b7ad70-c082-45d3-9956-c9e991343978'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:00.484552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c20638e2360480ba263593f4314b94f', 'request_id': 'req-08b7ad70-c082-45d3-9956-c9e991343978'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:00.505496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] The token cache is being invalidate because project 7c20638e2360480ba263593f4314b94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:00.506013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:00.507245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-08b7ad70-c082-45d3-9956-c9e991343978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:00.510005 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2036/4041] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:00 2022] DELETE /identity/v3/projects/7c20638e2360480ba263593f4314b94f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:00.515234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63364e-4dd8-4764-88f6-f0d01ad0ea03 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:00.515760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63364e-4dd8-4764-88f6-f0d01ad0ea03 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:00.518384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63364e-4dd8-4764-88f6-f0d01ad0ea03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:00.559532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ee63364e-4dd8-4764-88f6-f0d01ad0ea03 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:00.579829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee63364e-4dd8-4764-88f6-f0d01ad0ea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:00.682842 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2006/4042] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:00.690326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4e5c7-71a0-4136-8b5e-1de417368dfd None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:00.690918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4e5c7-71a0-4136-8b5e-1de417368dfd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:00.691359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4e5c7-71a0-4136-8b5e-1de417368dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:00.718463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-97f4e5c7-71a0-4136-8b5e-1de417368dfd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:00.720050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-97f4e5c7-71a0-4136-8b5e-1de417368dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:00.734146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63364e-4dd8-4764-88f6-f0d01ad0ea03 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:00.735286 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2037/4043] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:00.746446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63364e-4dd8-4764-88f6-f0d01ad0ea03 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:00.755789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1069d29-f517-450b-9d36-9420793c8383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:00.757176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1069d29-f517-450b-9d36-9420793c8383 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:00.757648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1069d29-f517-450b-9d36-9420793c8383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:00.758092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1069d29-f517-450b-9d36-9420793c8383 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:00.759132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1069d29-f517-450b-9d36-9420793c8383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:00.759683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1069d29-f517-450b-9d36-9420793c8383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:00.761671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1069d29-f517-450b-9d36-9420793c8383 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:00.778503 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2007/4044] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:00.779868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4e5c7-71a0-4136-8b5e-1de417368dfd None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:00.795449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4e5c7-71a0-4136-8b5e-1de417368dfd None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:00.803277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb4cc8-5352-435e-a689-554b9a57bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:00.805034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb4cc8-5352-435e-a689-554b9a57bdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:00.805420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb4cc8-5352-435e-a689-554b9a57bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:00.806062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb4cc8-5352-435e-a689-554b9a57bdb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:00.807169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb4cc8-5352-435e-a689-554b9a57bdb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:00.809242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb4cc8-5352-435e-a689-554b9a57bdb9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:00.859718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1069d29-f517-450b-9d36-9420793c8383 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:00.861705 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2038/4045] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:00 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:00.877166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1069d29-f517-450b-9d36-9420793c8383 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:00.995551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16718c25-636b-42fb-94fc-681489920cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:00.999092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718c25-636b-42fb-94fc-681489920cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:00.999674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718c25-636b-42fb-94fc-681489920cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:01.000132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16718c25-636b-42fb-94fc-681489920cdf admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:01.000992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16718c25-636b-42fb-94fc-681489920cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:01.004251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16718c25-636b-42fb-94fc-681489920cdf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:01.048382 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2008/4046] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:18:00 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:01.055339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb4cc8-5352-435e-a689-554b9a57bdb9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:01.069790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb4cc8-5352-435e-a689-554b9a57bdb9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:01.078369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddc70c-1677-47bb-bc0c-7526b6b7b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:01.079687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddc70c-1677-47bb-bc0c-7526b6b7b698 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:01.082338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddc70c-1677-47bb-bc0c-7526b6b7b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:01.083098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddc70c-1677-47bb-bc0c-7526b6b7b698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:01.084949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddc70c-1677-47bb-bc0c-7526b6b7b698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:01.088616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddc70c-1677-47bb-bc0c-7526b6b7b698 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:01.105889 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2039/4047] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:01.110025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16718c25-636b-42fb-94fc-681489920cdf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:01.116738 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:01.120986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16718c25-636b-42fb-94fc-681489920cdf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:01.127626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea63c1-c629-4ea0-bce5-0e39e629dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:01.128912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea63c1-c629-4ea0-bce5-0e39e629dc0f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:01.128912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea63c1-c629-4ea0-bce5-0e39e629dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:01.128912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea63c1-c629-4ea0-bce5-0e39e629dc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:01.129200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea63c1-c629-4ea0-bce5-0e39e629dc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:01.130804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea63c1-c629-4ea0-bce5-0e39e629dc0f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:01.150237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddc70c-1677-47bb-bc0c-7526b6b7b698 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:01.150532 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2009/4048] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:01.166522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddc70c-1677-47bb-bc0c-7526b6b7b698 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:01.172703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feade0a-7032-4b58-8a57-d0ba23fc4cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:01.173385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feade0a-7032-4b58-8a57-d0ba23fc4cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:01.173669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feade0a-7032-4b58-8a57-d0ba23fc4cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:01.173945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feade0a-7032-4b58-8a57-d0ba23fc4cd8 admin admin] PATH_INFO: `/v3/projects/f51dd29305bc46a1ad010bc07285b375/users/6d7ac7a06c3e4197b9399dc3ea9058ff/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:01.193161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feade0a-7032-4b58-8a57-d0ba23fc4cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51dd29305bc46a1ad010bc07285b375, user_id=6d7ac7a06c3e4197b9399dc3ea9058ff, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:01.196793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feade0a-7032-4b58-8a57-d0ba23fc4cd8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:01.213128 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2040/4049] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:01 2022] PUT /identity/v3/projects/f51dd29305bc46a1ad010bc07285b375/users/6d7ac7a06c3e4197b9399dc3ea9058ff/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:01.225049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c839fe7-0ec4-42b1-a002-46feebb5d04a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:01.225357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c839fe7-0ec4-42b1-a002-46feebb5d04a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:01.225671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c839fe7-0ec4-42b1-a002-46feebb5d04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:01.259721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3c839fe7-0ec4-42b1-a002-46feebb5d04a None None] MFA Rules not processed for user `6d7ac7a06c3e4197b9399dc3ea9058ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:01.261064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3c839fe7-0ec4-42b1-a002-46feebb5d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:01.341297 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2010/4050] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:01.363022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feade0a-7032-4b58-8a57-d0ba23fc4cd8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:01.366068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3feade0a-7032-4b58-8a57-d0ba23fc4cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:01.432235 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:01.463115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feade0a-7032-4b58-8a57-d0ba23fc4cd8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:01.467304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7b6a7-bfc8-4642-82dc-044fe541bf2c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:01.467917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7b6a7-bfc8-4642-82dc-044fe541bf2c service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:01.468193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7b6a7-bfc8-4642-82dc-044fe541bf2c service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:01.468463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7b6a7-bfc8-4642-82dc-044fe541bf2c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:01.479046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7b6a7-bfc8-4642-82dc-044fe541bf2c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:01.480480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7b6a7-bfc8-4642-82dc-044fe541bf2c service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:01.490710 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2041/4051] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:01.722664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cb22d-7a9a-4485-a072-8c5ff46e79ef None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:01.723168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cb22d-7a9a-4485-a072-8c5ff46e79ef None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:01.723591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cb22d-7a9a-4485-a072-8c5ff46e79ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:01.756161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1d2cb22d-7a9a-4485-a072-8c5ff46e79ef None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:01.758646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1d2cb22d-7a9a-4485-a072-8c5ff46e79ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:01.838409 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2011/4052] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:18:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:01.901586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7b6a7-bfc8-4642-82dc-044fe541bf2c service glance] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:01.903356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f0a7b6a7-bfc8-4642-82dc-044fe541bf2c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:02.009204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7b6a7-bfc8-4642-82dc-044fe541bf2c service glance] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:02.015271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d6bd0-ce77-491f-a83e-0bac2c0d04c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:02.016342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6bd0-ce77-491f-a83e-0bac2c0d04c9 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:02.016342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6bd0-ce77-491f-a83e-0bac2c0d04c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:02.016575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6bd0-ce77-491f-a83e-0bac2c0d04c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:02.027974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d6bd0-ce77-491f-a83e-0bac2c0d04c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:02.029670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d6bd0-ce77-491f-a83e-0bac2c0d04c9 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:02.046994 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2042/4053] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:02.413990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed335f-736e-4a9a-9384-8853767ab0d0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:02.414315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed335f-736e-4a9a-9384-8853767ab0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:02.414580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed335f-736e-4a9a-9384-8853767ab0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:02.441450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-07ed335f-736e-4a9a-9384-8853767ab0d0 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:02.443739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-07ed335f-736e-4a9a-9384-8853767ab0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:02.478846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d6bd0-ce77-491f-a83e-0bac2c0d04c9 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:02.483624 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2012/4054] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:18:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:02.492315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d6bd0-ce77-491f-a83e-0bac2c0d04c9 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:02.526089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5de6a-d791-499c-9aff-7912c0844d87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:02.527278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5de6a-d791-499c-9aff-7912c0844d87 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:02.527562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5de6a-d791-499c-9aff-7912c0844d87 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:02.527837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5de6a-d791-499c-9aff-7912c0844d87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:02.536855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5de6a-d791-499c-9aff-7912c0844d87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:02.538592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5de6a-d791-499c-9aff-7912c0844d87 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:02.547135 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2043/4055] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:18:03.027461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2aec1-3d28-4f48-9ea5-0dd1b4310fb4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:03.028674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2aec1-3d28-4f48-9ea5-0dd1b4310fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:03.029181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2aec1-3d28-4f48-9ea5-0dd1b4310fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:03.058968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d3c2aec1-3d28-4f48-9ea5-0dd1b4310fb4 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:03.061389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d3c2aec1-3d28-4f48-9ea5-0dd1b4310fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:03.073633 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2013/4056] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:18:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:03.088526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5de6a-d791-499c-9aff-7912c0844d87 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:03.101908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5de6a-d791-499c-9aff-7912c0844d87 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:03.115590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a09e4-7a02-4e6a-ab35-d2be7e85a9d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:03.117880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a09e4-7a02-4e6a-ab35-d2be7e85a9d7 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:03.118285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a09e4-7a02-4e6a-ab35-d2be7e85a9d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:03.118697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a09e4-7a02-4e6a-ab35-d2be7e85a9d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:03.136628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a09e4-7a02-4e6a-ab35-d2be7e85a9d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:03.138675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a09e4-7a02-4e6a-ab35-d2be7e85a9d7 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:03.173517 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2044/4057] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:03.635853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c790-488b-4920-8203-8c046b3b5cd4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:03.636436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c790-488b-4920-8203-8c046b3b5cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:03.636938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c790-488b-4920-8203-8c046b3b5cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:03.668214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cb23c790-488b-4920-8203-8c046b3b5cd4 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:03.670867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cb23c790-488b-4920-8203-8c046b3b5cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:03.678810 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2014/4058] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:18:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:03.694420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a09e4-7a02-4e6a-ab35-d2be7e85a9d7 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:03.707568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a09e4-7a02-4e6a-ab35-d2be7e85a9d7 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:03.715986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64d992-9127-4cd1-be90-3da2dc49c2df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:03.717070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64d992-9127-4cd1-be90-3da2dc49c2df service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:03.717604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64d992-9127-4cd1-be90-3da2dc49c2df service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:03.718106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64d992-9127-4cd1-be90-3da2dc49c2df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:03.727697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64d992-9127-4cd1-be90-3da2dc49c2df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:03.733695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64d992-9127-4cd1-be90-3da2dc49c2df service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:03.769978 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2045/4059] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:04.153835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67dd54-4fbe-46dd-8565-c0b0f8052647 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:04.154346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67dd54-4fbe-46dd-8565-c0b0f8052647 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:04.154461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67dd54-4fbe-46dd-8565-c0b0f8052647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:04.211368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11b3c-855d-46dd-a3c1-79af834e13c1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:04.211800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11b3c-855d-46dd-a3c1-79af834e13c1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:04.212129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11b3c-855d-46dd-a3c1-79af834e13c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:04.269104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1c67dd54-4fbe-46dd-8565-c0b0f8052647 None None] MFA Rules not processed for user `039f66a7c47b47e39672b8a49683f6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:04.270659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1c67dd54-4fbe-46dd-8565-c0b0f8052647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:04.291917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ccf11b3c-855d-46dd-a3c1-79af834e13c1 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:04.296086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ccf11b3c-855d-46dd-a3c1-79af834e13c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:04.331392 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2046/4060] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:18:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:04.344371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf11b3c-855d-46dd-a3c1-79af834e13c1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:04.376391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf11b3c-855d-46dd-a3c1-79af834e13c1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:04.390297 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:04.392688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c57838-e169-412c-b684-6ca87ed432d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:04.393404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57838-e169-412c-b684-6ca87ed432d9 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:04.393799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57838-e169-412c-b684-6ca87ed432d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:04.394163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57838-e169-412c-b684-6ca87ed432d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:04.417005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c57838-e169-412c-b684-6ca87ed432d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:04.419024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c57838-e169-412c-b684-6ca87ed432d9 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:04.425623 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2015/4061] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:04.439663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbcc54-36f3-4af4-9141-c1f5770a0306 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:04.439962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbcc54-36f3-4af4-9141-c1f5770a0306 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:04.440432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbcc54-36f3-4af4-9141-c1f5770a0306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:04.445666 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2047/4062] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:04.513639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bccbcc54-36f3-4af4-9141-c1f5770a0306 None None] MFA Rules not processed for user `039f66a7c47b47e39672b8a49683f6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:04.515807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bccbcc54-36f3-4af4-9141-c1f5770a0306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:04.534821 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2016/4063] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:04.851854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd850b-70f4-4070-9aaf-12e5eb9de9db None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:04.852364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd850b-70f4-4070-9aaf-12e5eb9de9db None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:04.852497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd850b-70f4-4070-9aaf-12e5eb9de9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:04.885165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-37cd850b-70f4-4070-9aaf-12e5eb9de9db None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:04.886839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-37cd850b-70f4-4070-9aaf-12e5eb9de9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:04.902833 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2048/4064] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:18:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:04.909672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbcc54-36f3-4af4-9141-c1f5770a0306 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:04.924739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbcc54-36f3-4af4-9141-c1f5770a0306 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:04.933391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1ce1c-0083-455e-9b5e-5dfa2cef174e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:04.934852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ce1c-0083-455e-9b5e-5dfa2cef174e service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:04.935267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ce1c-0083-455e-9b5e-5dfa2cef174e service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:04.935919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ce1c-0083-455e-9b5e-5dfa2cef174e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:04.948188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1ce1c-0083-455e-9b5e-5dfa2cef174e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:04.951107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1ce1c-0083-455e-9b5e-5dfa2cef174e service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:04.972691 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2017/4065] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:05.352763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd850b-70f4-4070-9aaf-12e5eb9de9db None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:05.354488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-37cd850b-70f4-4070-9aaf-12e5eb9de9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:05.428507 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:05.464802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd850b-70f4-4070-9aaf-12e5eb9de9db None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:05.484852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b64385-fe97-4d1d-9877-979fe672857d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:05.485594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b64385-fe97-4d1d-9877-979fe672857d service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:05.485767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b64385-fe97-4d1d-9877-979fe672857d service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:05.486004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b64385-fe97-4d1d-9877-979fe672857d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:05.502245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b64385-fe97-4d1d-9877-979fe672857d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:05.504090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b64385-fe97-4d1d-9877-979fe672857d service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:05.515411 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2049/4066] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:05 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:06.460254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6a878-d58c-44db-bd38-4b98d637b983 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:06.461074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6a878-d58c-44db-bd38-4b98d637b983 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:06.461529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6a878-d58c-44db-bd38-4b98d637b983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:06.490685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-87f6a878-d58c-44db-bd38-4b98d637b983 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:06.494124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-87f6a878-d58c-44db-bd38-4b98d637b983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:06.517595 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2018/4067] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:18:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:06.532203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b64385-fe97-4d1d-9877-979fe672857d service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:06.551564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b64385-fe97-4d1d-9877-979fe672857d service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:06.561946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6b535-7ee4-450e-a906-b48838b01b8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:06.562641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6b535-7ee4-450e-a906-b48838b01b8d service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:06.562910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6b535-7ee4-450e-a906-b48838b01b8d service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:06.563187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6b535-7ee4-450e-a906-b48838b01b8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:06.579240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6b535-7ee4-450e-a906-b48838b01b8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:06.581451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6b535-7ee4-450e-a906-b48838b01b8d service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:06.596377 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2050/4068] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:06.791660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb1831-b74d-4a41-95d9-8b6dd5bfffd1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:06.791948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb1831-b74d-4a41-95d9-8b6dd5bfffd1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:06.792224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb1831-b74d-4a41-95d9-8b6dd5bfffd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:06.814843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-57bb1831-b74d-4a41-95d9-8b6dd5bfffd1 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:06.816327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-57bb1831-b74d-4a41-95d9-8b6dd5bfffd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:06.837394 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2019/4069] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:18:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:06.853690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6b535-7ee4-450e-a906-b48838b01b8d service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:06.878676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6b535-7ee4-450e-a906-b48838b01b8d service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:06.892788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a725-c87e-44c6-979d-d96eeb687b69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:06.893655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a725-c87e-44c6-979d-d96eeb687b69 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:06.894168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a725-c87e-44c6-979d-d96eeb687b69 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:06.894700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a725-c87e-44c6-979d-d96eeb687b69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:06.908512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4a725-c87e-44c6-979d-d96eeb687b69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:06.911001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4a725-c87e-44c6-979d-d96eeb687b69 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:06.924270 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2051/4070] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:07.226793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ee047-1f41-4c8f-bc60-d88835512832 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:07.227082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ee047-1f41-4c8f-bc60-d88835512832 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:07.227372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ee047-1f41-4c8f-bc60-d88835512832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:07.259421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-099ee047-1f41-4c8f-bc60-d88835512832 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:07.260835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-099ee047-1f41-4c8f-bc60-d88835512832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:07.277757 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2020/4071] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:07.285038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a725-c87e-44c6-979d-d96eeb687b69 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:07.301434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a725-c87e-44c6-979d-d96eeb687b69 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:07.312791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68394d8-a34f-4567-a448-46d6e2c36653 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:07.313936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68394d8-a34f-4567-a448-46d6e2c36653 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:07.314445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68394d8-a34f-4567-a448-46d6e2c36653 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:07.314967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68394d8-a34f-4567-a448-46d6e2c36653 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:07.331806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68394d8-a34f-4567-a448-46d6e2c36653 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:07.333856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68394d8-a34f-4567-a448-46d6e2c36653 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:07.348772 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2052/4072] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:07.601174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034977b-f79e-4a2a-9301-95cc6c285078 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:07.602070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034977b-f79e-4a2a-9301-95cc6c285078 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:07.602756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034977b-f79e-4a2a-9301-95cc6c285078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:07.628283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b034977b-f79e-4a2a-9301-95cc6c285078 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:07.629717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b034977b-f79e-4a2a-9301-95cc6c285078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:07.639806 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2021/4073] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:07.653821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68394d8-a34f-4567-a448-46d6e2c36653 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:07.671594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68394d8-a34f-4567-a448-46d6e2c36653 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:07.682691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc733d-e765-4c24-bf6e-a89bad145032 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:07.683699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc733d-e765-4c24-bf6e-a89bad145032 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:07.684904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc733d-e765-4c24-bf6e-a89bad145032 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:07.686182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc733d-e765-4c24-bf6e-a89bad145032 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:07.717334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc733d-e765-4c24-bf6e-a89bad145032 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:07.720724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc733d-e765-4c24-bf6e-a89bad145032 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:07.738298 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2053/4074] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:07.900458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c547b-6788-43e0-a7a5-65d5e868bac5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:07.900749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c547b-6788-43e0-a7a5-65d5e868bac5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:07.901028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c547b-6788-43e0-a7a5-65d5e868bac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:07.921229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c49c547b-6788-43e0-a7a5-65d5e868bac5 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:07.922892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c49c547b-6788-43e0-a7a5-65d5e868bac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:07.932165 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2022/4075] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:07.945830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc733d-e765-4c24-bf6e-a89bad145032 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:07.957809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc733d-e765-4c24-bf6e-a89bad145032 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:07.965009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e225f2e-7451-4071-99d6-d56ab63ecb8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:07.965844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e225f2e-7451-4071-99d6-d56ab63ecb8f service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:07.966371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e225f2e-7451-4071-99d6-d56ab63ecb8f service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:07.966853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e225f2e-7451-4071-99d6-d56ab63ecb8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:07.987336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e225f2e-7451-4071-99d6-d56ab63ecb8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:08.009038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e225f2e-7451-4071-99d6-d56ab63ecb8f service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:08.019699 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2054/4076] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:08.185686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48903dab-fadf-4e52-a254-c97c21e23b00 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:08.186017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48903dab-fadf-4e52-a254-c97c21e23b00 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:08.186495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48903dab-fadf-4e52-a254-c97c21e23b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:08.210756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-48903dab-fadf-4e52-a254-c97c21e23b00 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:08.212610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-48903dab-fadf-4e52-a254-c97c21e23b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:08.228943 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2023/4077] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:08.236875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e225f2e-7451-4071-99d6-d56ab63ecb8f service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:08.250002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e225f2e-7451-4071-99d6-d56ab63ecb8f service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:08.257836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f5164-2be3-4bcc-b178-fa684233a27f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:08.258553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5164-2be3-4bcc-b178-fa684233a27f service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:08.258928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5164-2be3-4bcc-b178-fa684233a27f service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:08.259283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5164-2be3-4bcc-b178-fa684233a27f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:08.268744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f5164-2be3-4bcc-b178-fa684233a27f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:08.270432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f5164-2be3-4bcc-b178-fa684233a27f service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:08.280300 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2055/4078] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:18:08.459233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48903dab-fadf-4e52-a254-c97c21e23b00 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:08.538860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48903dab-fadf-4e52-a254-c97c21e23b00 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:08.543940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:08.544576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:08.544853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:08.545381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] PATH_INFO: `/v3/users/6d7ac7a06c3e4197b9399dc3ea9058ff` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:08.546779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7ac7a06c3e4197b9399dc3ea9058ff)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:08.548780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:08.615909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7ac7a06c3e4197b9399dc3ea9058ff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:08.635286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7ac7a06c3e4197b9399dc3ea9058ff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:08.636471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7ac7a06c3e4197b9399dc3ea9058ff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:08.647972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7ac7a06c3e4197b9399dc3ea9058ff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:08.657949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7ac7a06c3e4197b9399dc3ea9058ff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:08.665883 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2024/4079] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:18:08 2022] DELETE /identity/v3/users/6d7ac7a06c3e4197b9399dc3ea9058ff => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:08.671801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67281a0-6374-4a6a-87ea-aac68d94c86d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:08.672686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67281a0-6374-4a6a-87ea-aac68d94c86d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:08.673165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67281a0-6374-4a6a-87ea-aac68d94c86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:08.746651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f67281a0-6374-4a6a-87ea-aac68d94c86d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:08.749739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f67281a0-6374-4a6a-87ea-aac68d94c86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:08.888092 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2056/4080] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:08.905941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:08.908289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:08.927843 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:09.023896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70649173-6ec7-402e-811c-98cc42f3fc86 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:09.035352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522cdfb-7838-4dd4-913a-16723f8f260c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:09.037295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522cdfb-7838-4dd4-913a-16723f8f260c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:09.037295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522cdfb-7838-4dd4-913a-16723f8f260c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:09.037667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522cdfb-7838-4dd4-913a-16723f8f260c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:09.075865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522cdfb-7838-4dd4-913a-16723f8f260c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:09.077533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522cdfb-7838-4dd4-913a-16723f8f260c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:09.122097 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2025/4081] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:10.050275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67281a0-6374-4a6a-87ea-aac68d94c86d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:10.054536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f67281a0-6374-4a6a-87ea-aac68d94c86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:10.069517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67281a0-6374-4a6a-87ea-aac68d94c86d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:10.074864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:10.075611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:10.076128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:10.076617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] PATH_INFO: `/v3/projects/f51dd29305bc46a1ad010bc07285b375` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:10.077856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51dd29305bc46a1ad010bc07285b375)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:10.080298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:10.153973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51dd29305bc46a1ad010bc07285b375', 'request_id': 'req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:10.158975 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:10.160811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51dd29305bc46a1ad010bc07285b375', 'request_id': 'req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:10.172815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51dd29305bc46a1ad010bc07285b375', 'request_id': 'req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:10.188921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] The token cache is being invalidate because project f51dd29305bc46a1ad010bc07285b375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:10.189524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:10.190526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-282d1f8b-ad21-4f4f-bcb5-19d8bf425d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:10.192053 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2057/4082] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:10 2022] DELETE /identity/v3/projects/f51dd29305bc46a1ad010bc07285b375 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:10.197406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcf8dd-1ac6-4009-b7a5-dcb3881d17c2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:10.197993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcf8dd-1ac6-4009-b7a5-dcb3881d17c2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:10.197993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcf8dd-1ac6-4009-b7a5-dcb3881d17c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:10.225193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-09bcf8dd-1ac6-4009-b7a5-dcb3881d17c2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:10.226737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-09bcf8dd-1ac6-4009-b7a5-dcb3881d17c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:10.295605 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2026/4083] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:10.304936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e3c61-3be7-452b-9860-648ba8f255e4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:10.305408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e3c61-3be7-452b-9860-648ba8f255e4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:10.305916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e3c61-3be7-452b-9860-648ba8f255e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:10.334258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fb6e3c61-3be7-452b-9860-648ba8f255e4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:10.335774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fb6e3c61-3be7-452b-9860-648ba8f255e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:10.344506 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2058/4084] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:10.349372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcf8dd-1ac6-4009-b7a5-dcb3881d17c2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:10.359348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcf8dd-1ac6-4009-b7a5-dcb3881d17c2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:10.364105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde29c35-f0bb-4e84-b1a4-6055db1b3d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:10.364745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde29c35-f0bb-4e84-b1a4-6055db1b3d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:10.365029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde29c35-f0bb-4e84-b1a4-6055db1b3d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:10.365941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde29c35-f0bb-4e84-b1a4-6055db1b3d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:10.366621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde29c35-f0bb-4e84-b1a4-6055db1b3d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:10.366959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde29c35-f0bb-4e84-b1a4-6055db1b3d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:10.368705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde29c35-f0bb-4e84-b1a4-6055db1b3d36 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:10.381396 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2027/4085] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:10.385921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e3c61-3be7-452b-9860-648ba8f255e4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:10.395152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e3c61-3be7-452b-9860-648ba8f255e4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:10.400564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ebc45-f67c-4fa8-8394-8756280f6fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:10.401165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ebc45-f67c-4fa8-8394-8756280f6fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:10.401446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ebc45-f67c-4fa8-8394-8756280f6fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:10.401751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ebc45-f67c-4fa8-8394-8756280f6fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:10.402390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ebc45-f67c-4fa8-8394-8756280f6fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:10.404355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ebc45-f67c-4fa8-8394-8756280f6fb8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:10.453706 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2059/4086] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:10 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:18:10.457891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde29c35-f0bb-4e84-b1a4-6055db1b3d36 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:10.470196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde29c35-f0bb-4e84-b1a4-6055db1b3d36 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:10.544632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efaf6b-68bd-42e0-bf09-7ba5a005e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:10.545241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efaf6b-68bd-42e0-bf09-7ba5a005e90d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:10.545594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efaf6b-68bd-42e0-bf09-7ba5a005e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:10.545939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efaf6b-68bd-42e0-bf09-7ba5a005e90d admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:10.546687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efaf6b-68bd-42e0-bf09-7ba5a005e90d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:10.548705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efaf6b-68bd-42e0-bf09-7ba5a005e90d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:10.574709 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2028/4087] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:18:10 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:10.576213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ebc45-f67c-4fa8-8394-8756280f6fb8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:10.588002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ebc45-f67c-4fa8-8394-8756280f6fb8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:10.593009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dbc0f-90b4-4746-ba78-62acd2e9bfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:10.593616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dbc0f-90b4-4746-ba78-62acd2e9bfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:10.593897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dbc0f-90b4-4746-ba78-62acd2e9bfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:10.594170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dbc0f-90b4-4746-ba78-62acd2e9bfa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:10.594847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dbc0f-90b4-4746-ba78-62acd2e9bfa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:10.596449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dbc0f-90b4-4746-ba78-62acd2e9bfa0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:10.610142 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2060/4088] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:10.611466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efaf6b-68bd-42e0-bf09-7ba5a005e90d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:10.621795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efaf6b-68bd-42e0-bf09-7ba5a005e90d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:10.626460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb9ae-99cc-421c-a023-0a0d8090e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:10.627128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb9ae-99cc-421c-a023-0a0d8090e981 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:10.627413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb9ae-99cc-421c-a023-0a0d8090e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:10.627686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb9ae-99cc-421c-a023-0a0d8090e981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:10.628327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eb9ae-99cc-421c-a023-0a0d8090e981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:10.630462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eb9ae-99cc-421c-a023-0a0d8090e981 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:10.642397 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2029/4089] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:10.647376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dbc0f-90b4-4746-ba78-62acd2e9bfa0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:10.657529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dbc0f-90b4-4746-ba78-62acd2e9bfa0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:10.662124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f6a8f-ba35-4d7d-9543-28e6f88856fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:10.662879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f6a8f-ba35-4d7d-9543-28e6f88856fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:10.663155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f6a8f-ba35-4d7d-9543-28e6f88856fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:10.663632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f6a8f-ba35-4d7d-9543-28e6f88856fb admin admin] PATH_INFO: `/v3/projects/3ead71bbb19c440594cdcb9709bb46a3/users/9f75673f5bc142738ff75f1ee5d8d399/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:10.679508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f6a8f-ba35-4d7d-9543-28e6f88856fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ead71bbb19c440594cdcb9709bb46a3, user_id=9f75673f5bc142738ff75f1ee5d8d399, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:10.682203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f6a8f-ba35-4d7d-9543-28e6f88856fb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:10.715210 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2061/4090] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:10 2022] PUT /identity/v3/projects/3ead71bbb19c440594cdcb9709bb46a3/users/9f75673f5bc142738ff75f1ee5d8d399/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:18:10.725676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d7aca-51b8-4362-b636-556dd1c3592a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:10.725960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d7aca-51b8-4362-b636-556dd1c3592a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:10.726235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d7aca-51b8-4362-b636-556dd1c3592a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:10.760950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f43d7aca-51b8-4362-b636-556dd1c3592a None None] MFA Rules not processed for user `9f75673f5bc142738ff75f1ee5d8d399`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:10.762426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f43d7aca-51b8-4362-b636-556dd1c3592a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:10.769650 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:10.869557 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2030/4091] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:10.874292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f6a8f-ba35-4d7d-9543-28e6f88856fb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:10.995579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f6a8f-ba35-4d7d-9543-28e6f88856fb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:11.044471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623bd1b-e4b1-44c3-b3be-c44da3966652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:11.045168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623bd1b-e4b1-44c3-b3be-c44da3966652 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:11.045723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623bd1b-e4b1-44c3-b3be-c44da3966652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:11.046643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623bd1b-e4b1-44c3-b3be-c44da3966652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:11.047406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623bd1b-e4b1-44c3-b3be-c44da3966652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:11.053565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623bd1b-e4b1-44c3-b3be-c44da3966652 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:11.136660 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2062/4092] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:10 2022] POST /identity/v3/projects => generated 369 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:11.140630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d7aca-51b8-4362-b636-556dd1c3592a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:11.160402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d7aca-51b8-4362-b636-556dd1c3592a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:11.312491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84689c94-90b4-499f-aa2d-427ec33eae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:11.313381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84689c94-90b4-499f-aa2d-427ec33eae66 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:11.313830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84689c94-90b4-499f-aa2d-427ec33eae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:11.314207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84689c94-90b4-499f-aa2d-427ec33eae66 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:11.315366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84689c94-90b4-499f-aa2d-427ec33eae66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:11.317631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84689c94-90b4-499f-aa2d-427ec33eae66 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:11.367102 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2031/4093] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:18:11 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:11.368280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623bd1b-e4b1-44c3-b3be-c44da3966652 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:11.393614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623bd1b-e4b1-44c3-b3be-c44da3966652 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:11.424365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd23b9-2ab1-4802-8952-28769d8549c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:11.425717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd23b9-2ab1-4802-8952-28769d8549c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:11.426237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd23b9-2ab1-4802-8952-28769d8549c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:11.426880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd23b9-2ab1-4802-8952-28769d8549c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:11.428505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd23b9-2ab1-4802-8952-28769d8549c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:11.432195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd23b9-2ab1-4802-8952-28769d8549c6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:11.454963 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2063/4094] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:11.459584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84689c94-90b4-499f-aa2d-427ec33eae66 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:11.502290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84689c94-90b4-499f-aa2d-427ec33eae66 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:11.517196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88638690-2745-4b70-83bd-5cf032cb507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:11.518128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88638690-2745-4b70-83bd-5cf032cb507c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:11.518809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88638690-2745-4b70-83bd-5cf032cb507c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:11.523162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88638690-2745-4b70-83bd-5cf032cb507c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:11.525178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88638690-2745-4b70-83bd-5cf032cb507c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:11.528382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88638690-2745-4b70-83bd-5cf032cb507c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:11.556794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd23b9-2ab1-4802-8952-28769d8549c6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:11.563419 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2032/4095] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:11.580264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd23b9-2ab1-4802-8952-28769d8549c6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:11.587147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979489-c6c8-45e3-9b9c-d8db464869d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:11.587822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979489-c6c8-45e3-9b9c-d8db464869d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:11.588704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979489-c6c8-45e3-9b9c-d8db464869d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:11.589243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979489-c6c8-45e3-9b9c-d8db464869d5 admin admin] PATH_INFO: `/v3/projects/b299bae8cfc941d6bb7ca41e64c0eb46/users/c4e34baeb6db463fba96916e9c642468/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:11.612119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d979489-c6c8-45e3-9b9c-d8db464869d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b299bae8cfc941d6bb7ca41e64c0eb46, user_id=c4e34baeb6db463fba96916e9c642468, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:11.617722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d979489-c6c8-45e3-9b9c-d8db464869d5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:11.645990 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2064/4096] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:11 2022] PUT /identity/v3/projects/b299bae8cfc941d6bb7ca41e64c0eb46/users/c4e34baeb6db463fba96916e9c642468/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:18:11.660308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2bbb4-931e-4a8e-953e-3d57c2b1d4dc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:11.660603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2bbb4-931e-4a8e-953e-3d57c2b1d4dc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:11.661516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2bbb4-931e-4a8e-953e-3d57c2b1d4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:11.715987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b7e2bbb4-931e-4a8e-953e-3d57c2b1d4dc None None] MFA Rules not processed for user `c4e34baeb6db463fba96916e9c642468`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:11.719118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b7e2bbb4-931e-4a8e-953e-3d57c2b1d4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:11.802107 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2033/4097] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:11.825030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979489-c6c8-45e3-9b9c-d8db464869d5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:11.827439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6d979489-c6c8-45e3-9b9c-d8db464869d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:11.882814 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:11.920499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979489-c6c8-45e3-9b9c-d8db464869d5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:11.925764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899464fb-032f-4e19-a552-9d79d9e54eb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:11.926508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899464fb-032f-4e19-a552-9d79d9e54eb9 service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:11.926874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899464fb-032f-4e19-a552-9d79d9e54eb9 service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:11.927177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899464fb-032f-4e19-a552-9d79d9e54eb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:11.997804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899464fb-032f-4e19-a552-9d79d9e54eb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:11.999714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899464fb-032f-4e19-a552-9d79d9e54eb9 service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:12.011870 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2065/4098] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:12.179679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2bbb4-931e-4a8e-953e-3d57c2b1d4dc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:12.194085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2bbb4-931e-4a8e-953e-3d57c2b1d4dc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:12.200230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cce50-77cc-4e31-b19a-28af7854587e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:12.201216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cce50-77cc-4e31-b19a-28af7854587e service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:12.201216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cce50-77cc-4e31-b19a-28af7854587e service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:12.201871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cce50-77cc-4e31-b19a-28af7854587e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:12.213375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cce50-77cc-4e31-b19a-28af7854587e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:12.216267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cce50-77cc-4e31-b19a-28af7854587e service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:12.230409 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2034/4099] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:14.235956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899464fb-032f-4e19-a552-9d79d9e54eb9 service glance] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:14.315684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899464fb-032f-4e19-a552-9d79d9e54eb9 service glance] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:14.332264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:14.333218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:14.333767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:14.334308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] PATH_INFO: `/v3/users/9f75673f5bc142738ff75f1ee5d8d399` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:14.336419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f75673f5bc142738ff75f1ee5d8d399)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:14.338764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:14.387513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f75673f5bc142738ff75f1ee5d8d399'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:14.399630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f75673f5bc142738ff75f1ee5d8d399'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:14.400313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f75673f5bc142738ff75f1ee5d8d399'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:14.407857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f75673f5bc142738ff75f1ee5d8d399'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:14.408675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f75673f5bc142738ff75f1ee5d8d399'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:14.422329 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2066/4100] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:18:14 2022] DELETE /identity/v3/users/9f75673f5bc142738ff75f1ee5d8d399 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:14.427439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e4e7f-f5a2-4fbd-9e85-e2558d4ad2ee None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:14.427985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e4e7f-f5a2-4fbd-9e85-e2558d4ad2ee None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:14.428086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e4e7f-f5a2-4fbd-9e85-e2558d4ad2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:14.435413 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:14.450162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-593e4e7f-f5a2-4fbd-9e85-e2558d4ad2ee None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:14.451430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-593e4e7f-f5a2-4fbd-9e85-e2558d4ad2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:14.517786 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2035/4101] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:14.528822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:14.530250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:14.537803 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:14.596671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c15e0d-dd04-44aa-bc09-fe76051d3ec2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:14.601740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5d5ab-5af0-4d22-b1f1-0eb8b781f84d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:14.602444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d5ab-5af0-4d22-b1f1-0eb8b781f84d service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:14.602762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d5ab-5af0-4d22-b1f1-0eb8b781f84d service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:14.603038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d5ab-5af0-4d22-b1f1-0eb8b781f84d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:14.612556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5d5ab-5af0-4d22-b1f1-0eb8b781f84d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:14.614446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5d5ab-5af0-4d22-b1f1-0eb8b781f84d service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:14.624249 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2067/4102] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:14.897448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e4e7f-f5a2-4fbd-9e85-e2558d4ad2ee None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:14.899192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-593e4e7f-f5a2-4fbd-9e85-e2558d4ad2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:14.915174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e4e7f-f5a2-4fbd-9e85-e2558d4ad2ee None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:14.921172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:14.922173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:14.922693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:14.923602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] PATH_INFO: `/v3/projects/3ead71bbb19c440594cdcb9709bb46a3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:14.925156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ead71bbb19c440594cdcb9709bb46a3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:14.940940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:15.029685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ead71bbb19c440594cdcb9709bb46a3', 'request_id': 'req-a2c916ce-75d0-4baa-a875-096b09e91cce'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.036910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ead71bbb19c440594cdcb9709bb46a3', 'request_id': 'req-a2c916ce-75d0-4baa-a875-096b09e91cce'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.043544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ead71bbb19c440594cdcb9709bb46a3', 'request_id': 'req-a2c916ce-75d0-4baa-a875-096b09e91cce'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.063057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] The token cache is being invalidate because project 3ead71bbb19c440594cdcb9709bb46a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:15.063436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.064533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.068253 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2036/4103] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:14 2022] DELETE /identity/v3/projects/3ead71bbb19c440594cdcb9709bb46a3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:15.072775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5d5ab-5af0-4d22-b1f1-0eb8b781f84d service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:15.089158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5d5ab-5af0-4d22-b1f1-0eb8b781f84d service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:15.161747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623526d1-a132-461f-8893-c0843293a36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:15.162396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623526d1-a132-461f-8893-c0843293a36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:15.162723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623526d1-a132-461f-8893-c0843293a36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:15.163001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623526d1-a132-461f-8893-c0843293a36c admin admin] PATH_INFO: `/v3/users/c4e34baeb6db463fba96916e9c642468` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:15.164888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623526d1-a132-461f-8893-c0843293a36c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e34baeb6db463fba96916e9c642468)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:15.167899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623526d1-a132-461f-8893-c0843293a36c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:15.233831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-623526d1-a132-461f-8893-c0843293a36c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e34baeb6db463fba96916e9c642468'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.272923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-623526d1-a132-461f-8893-c0843293a36c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e34baeb6db463fba96916e9c642468'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.274145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-623526d1-a132-461f-8893-c0843293a36c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e34baeb6db463fba96916e9c642468'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.292911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-623526d1-a132-461f-8893-c0843293a36c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e34baeb6db463fba96916e9c642468'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.293621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-623526d1-a132-461f-8893-c0843293a36c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e34baeb6db463fba96916e9c642468'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.318187 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2068/4104] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:18:15 2022] DELETE /identity/v3/users/c4e34baeb6db463fba96916e9c642468 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:15.739300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:15.741134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:15.758798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c916ce-75d0-4baa-a875-096b09e91cce admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:15.825040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:15.825754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:15.826102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:15.826380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] PATH_INFO: `/v3/projects/b299bae8cfc941d6bb7ca41e64c0eb46` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:15.827587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b299bae8cfc941d6bb7ca41e64c0eb46)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:15.829499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:15.865726 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:15.891332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b299bae8cfc941d6bb7ca41e64c0eb46', 'request_id': 'req-52bbe357-39a9-463e-a400-75b6b84ba183'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.899384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b299bae8cfc941d6bb7ca41e64c0eb46', 'request_id': 'req-52bbe357-39a9-463e-a400-75b6b84ba183'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.909451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b299bae8cfc941d6bb7ca41e64c0eb46', 'request_id': 'req-52bbe357-39a9-463e-a400-75b6b84ba183'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.924788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] The token cache is being invalidate because project b299bae8cfc941d6bb7ca41e64c0eb46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:15.925078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.926099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52bbe357-39a9-463e-a400-75b6b84ba183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:15.928131 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2037/4105] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:15 2022] DELETE /identity/v3/projects/b299bae8cfc941d6bb7ca41e64c0eb46 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:15.935460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed22d8-c6af-46e4-a390-9fe3a609c66f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:15.935784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed22d8-c6af-46e4-a390-9fe3a609c66f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:15.936363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed22d8-c6af-46e4-a390-9fe3a609c66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:15.991187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-64ed22d8-c6af-46e4-a390-9fe3a609c66f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:15.992395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-64ed22d8-c6af-46e4-a390-9fe3a609c66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:16.013993 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:16.058651 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2069/4106] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:16.067372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a0d85-2634-4ab9-9b6b-f62402cdc129 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:16.067645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a0d85-2634-4ab9-9b6b-f62402cdc129 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:16.067921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a0d85-2634-4ab9-9b6b-f62402cdc129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:16.089061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-488a0d85-2634-4ab9-9b6b-f62402cdc129 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:16.090371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-488a0d85-2634-4ab9-9b6b-f62402cdc129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:16.102700 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2038/4107] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:16.105393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed22d8-c6af-46e4-a390-9fe3a609c66f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:16.115664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed22d8-c6af-46e4-a390-9fe3a609c66f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:16.120255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda5f3f-4481-4f0e-abe7-e8a33c6f84ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:16.120934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda5f3f-4481-4f0e-abe7-e8a33c6f84ce admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:16.121135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda5f3f-4481-4f0e-abe7-e8a33c6f84ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:16.121409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda5f3f-4481-4f0e-abe7-e8a33c6f84ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:16.122164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda5f3f-4481-4f0e-abe7-e8a33c6f84ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:16.122350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda5f3f-4481-4f0e-abe7-e8a33c6f84ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:16.124013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda5f3f-4481-4f0e-abe7-e8a33c6f84ce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:16.138790 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2070/4108] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:16.140936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a0d85-2634-4ab9-9b6b-f62402cdc129 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:16.152598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a0d85-2634-4ab9-9b6b-f62402cdc129 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:16.162104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e77f41-8f2b-4256-a974-ae6157122dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:16.162925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e77f41-8f2b-4256-a974-ae6157122dba admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:16.163270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e77f41-8f2b-4256-a974-ae6157122dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:16.163644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e77f41-8f2b-4256-a974-ae6157122dba admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:16.164343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e77f41-8f2b-4256-a974-ae6157122dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:16.166517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e77f41-8f2b-4256-a974-ae6157122dba admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:16.210125 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2039/4109] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:16 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:16.211532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda5f3f-4481-4f0e-abe7-e8a33c6f84ce admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:16.224609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda5f3f-4481-4f0e-abe7-e8a33c6f84ce admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:16.323408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07c64f-b29d-42dd-b5df-5e63e8639951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:16.325344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07c64f-b29d-42dd-b5df-5e63e8639951 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:16.325636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07c64f-b29d-42dd-b5df-5e63e8639951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:16.328318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07c64f-b29d-42dd-b5df-5e63e8639951 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:16.328318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07c64f-b29d-42dd-b5df-5e63e8639951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:16.333007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07c64f-b29d-42dd-b5df-5e63e8639951 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:16.386513 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2071/4110] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:18:16 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:18:16.388552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e77f41-8f2b-4256-a974-ae6157122dba admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:16.433479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e77f41-8f2b-4256-a974-ae6157122dba admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:16.450906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4d7e-cf90-447c-bb65-2d9fc9cf4e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:16.451699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4d7e-cf90-447c-bb65-2d9fc9cf4e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:16.451976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4d7e-cf90-447c-bb65-2d9fc9cf4e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:16.452253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4d7e-cf90-447c-bb65-2d9fc9cf4e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:16.452921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe4d7e-cf90-447c-bb65-2d9fc9cf4e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:16.454736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe4d7e-cf90-447c-bb65-2d9fc9cf4e1a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:16.479394 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2040/4111] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:16.480553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07c64f-b29d-42dd-b5df-5e63e8639951 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:16.493709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07c64f-b29d-42dd-b5df-5e63e8639951 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:16.499454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f727f0d-a6da-46e4-bdaa-b967e2db48fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:16.500231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f727f0d-a6da-46e4-bdaa-b967e2db48fa admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:16.500705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f727f0d-a6da-46e4-bdaa-b967e2db48fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:16.501484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f727f0d-a6da-46e4-bdaa-b967e2db48fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:16.501720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f727f0d-a6da-46e4-bdaa-b967e2db48fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:16.504002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f727f0d-a6da-46e4-bdaa-b967e2db48fa admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:16.518713 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2072/4112] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:18:16.521167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4d7e-cf90-447c-bb65-2d9fc9cf4e1a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:16.538440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4d7e-cf90-447c-bb65-2d9fc9cf4e1a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:16.546030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6c0dd-9217-4612-ae31-9044d228d7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:16.546859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c0dd-9217-4612-ae31-9044d228d7de admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:16.547149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c0dd-9217-4612-ae31-9044d228d7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:16.547433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c0dd-9217-4612-ae31-9044d228d7de admin admin] PATH_INFO: `/v3/projects/e616c64f061348b798424e8505f1e704/users/e4d11b5d97dd49a5a1109c9b20a1a01c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:16.575774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6c0dd-9217-4612-ae31-9044d228d7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e616c64f061348b798424e8505f1e704, user_id=e4d11b5d97dd49a5a1109c9b20a1a01c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:16.579134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6c0dd-9217-4612-ae31-9044d228d7de admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:16.603489 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2041/4113] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:16 2022] PUT /identity/v3/projects/e616c64f061348b798424e8505f1e704/users/e4d11b5d97dd49a5a1109c9b20a1a01c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:16.615694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c415e-4f71-4d0b-8fe2-cb41083ea087 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:16.615969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c415e-4f71-4d0b-8fe2-cb41083ea087 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:16.616362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c415e-4f71-4d0b-8fe2-cb41083ea087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:16.650473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cc8c415e-4f71-4d0b-8fe2-cb41083ea087 None None] MFA Rules not processed for user `e4d11b5d97dd49a5a1109c9b20a1a01c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:16.651866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cc8c415e-4f71-4d0b-8fe2-cb41083ea087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:16.767412 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2073/4114] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:16.773891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6c0dd-9217-4612-ae31-9044d228d7de admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:16.775676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9bc6c0dd-9217-4612-ae31-9044d228d7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:16.867254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6c0dd-9217-4612-ae31-9044d228d7de admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:16.872016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45bfad-9f3a-4f75-8cf7-2c04340739bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:16.872767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45bfad-9f3a-4f75-8cf7-2c04340739bb service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:16.873050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45bfad-9f3a-4f75-8cf7-2c04340739bb service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:16.873332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45bfad-9f3a-4f75-8cf7-2c04340739bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:16.885822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45bfad-9f3a-4f75-8cf7-2c04340739bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:16.887388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45bfad-9f3a-4f75-8cf7-2c04340739bb service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:16.901620 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2042/4115] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:17.068028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c415e-4f71-4d0b-8fe2-cb41083ea087 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:17.117725 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:17.175118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c415e-4f71-4d0b-8fe2-cb41083ea087 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:17.181077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:17.181845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:17.182200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:17.182546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] PATH_INFO: `/v3/users/e4d11b5d97dd49a5a1109c9b20a1a01c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:17.183816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d11b5d97dd49a5a1109c9b20a1a01c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:17.186774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:17.269508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d11b5d97dd49a5a1109c9b20a1a01c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:17.286767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d11b5d97dd49a5a1109c9b20a1a01c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:17.287793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d11b5d97dd49a5a1109c9b20a1a01c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:17.297515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d11b5d97dd49a5a1109c9b20a1a01c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:17.298443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d11b5d97dd49a5a1109c9b20a1a01c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:17.314956 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2074/4116] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:18:17 2022] DELETE /identity/v3/users/e4d11b5d97dd49a5a1109c9b20a1a01c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:17.320169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fb6ff-beff-4e1c-9314-729975e2f401 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:17.320456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fb6ff-beff-4e1c-9314-729975e2f401 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:17.320729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fb6ff-beff-4e1c-9314-729975e2f401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:17.341824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-653fb6ff-beff-4e1c-9314-729975e2f401 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:17.343113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-653fb6ff-beff-4e1c-9314-729975e2f401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:17.423396 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:17.458282 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2043/4117] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:17.471071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:17.482979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:17.565736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b8c5-4002-476e-a2b8-68e90258b6d2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:17.570226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae12bb8-67eb-40b2-a568-4c3197657198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:17.571657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12bb8-67eb-40b2-a568-4c3197657198 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:17.572285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12bb8-67eb-40b2-a568-4c3197657198 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:17.572886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12bb8-67eb-40b2-a568-4c3197657198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:17.584707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae12bb8-67eb-40b2-a568-4c3197657198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:17.586870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae12bb8-67eb-40b2-a568-4c3197657198 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:17.601261 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2075/4118] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:17.968988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fb6ff-beff-4e1c-9314-729975e2f401 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:17.973280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-653fb6ff-beff-4e1c-9314-729975e2f401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:18.009668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fb6ff-beff-4e1c-9314-729975e2f401 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:18.016364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:18.017890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:18.018637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:18.019668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] PATH_INFO: `/v3/projects/e616c64f061348b798424e8505f1e704` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:18.021301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e616c64f061348b798424e8505f1e704)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:18.023731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:18.102943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e616c64f061348b798424e8505f1e704', 'request_id': 'req-224b3753-028b-413c-a4dc-e75dbd5329e4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:18.111595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e616c64f061348b798424e8505f1e704', 'request_id': 'req-224b3753-028b-413c-a4dc-e75dbd5329e4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:18.125621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e616c64f061348b798424e8505f1e704', 'request_id': 'req-224b3753-028b-413c-a4dc-e75dbd5329e4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:18.167799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] The token cache is being invalidate because project e616c64f061348b798424e8505f1e704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:18.168093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:18.169122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-224b3753-028b-413c-a4dc-e75dbd5329e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:18.171061 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2044/4119] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:17 2022] DELETE /identity/v3/projects/e616c64f061348b798424e8505f1e704 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:18.177014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a75aa-849d-4c2b-9675-109309ef2e15 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:18.177724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a75aa-849d-4c2b-9675-109309ef2e15 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:18.178007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a75aa-849d-4c2b-9675-109309ef2e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:18.213288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e21a75aa-849d-4c2b-9675-109309ef2e15 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:18.214482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e21a75aa-849d-4c2b-9675-109309ef2e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:18.277415 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:18.305524 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2076/4120] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:18.314278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70165b5-4e60-46a2-aac4-d8984f4cce53 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:18.314560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70165b5-4e60-46a2-aac4-d8984f4cce53 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:18.314863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70165b5-4e60-46a2-aac4-d8984f4cce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:18.359779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d70165b5-4e60-46a2-aac4-d8984f4cce53 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:18.361094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d70165b5-4e60-46a2-aac4-d8984f4cce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:18.395635 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2045/4121] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:18.399793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a75aa-849d-4c2b-9675-109309ef2e15 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:18.420171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a75aa-849d-4c2b-9675-109309ef2e15 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:18.427609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0bdc8-4ea4-4479-b0c8-0e1f5b41244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:18.428478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0bdc8-4ea4-4479-b0c8-0e1f5b41244c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:18.428871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0bdc8-4ea4-4479-b0c8-0e1f5b41244c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:18.429296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0bdc8-4ea4-4479-b0c8-0e1f5b41244c admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:18.430812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0bdc8-4ea4-4479-b0c8-0e1f5b41244c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:18.431223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0bdc8-4ea4-4479-b0c8-0e1f5b41244c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:18.433038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0bdc8-4ea4-4479-b0c8-0e1f5b41244c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:18.463602 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2077/4122] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:18.463944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70165b5-4e60-46a2-aac4-d8984f4cce53 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:18.475370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70165b5-4e60-46a2-aac4-d8984f4cce53 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:18.481322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407c358-36b9-490e-aaf1-6f8384d6a12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:18.482055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407c358-36b9-490e-aaf1-6f8384d6a12a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:18.482437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407c358-36b9-490e-aaf1-6f8384d6a12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:18.482848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407c358-36b9-490e-aaf1-6f8384d6a12a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:18.484049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407c358-36b9-490e-aaf1-6f8384d6a12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:18.486101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407c358-36b9-490e-aaf1-6f8384d6a12a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:18.526720 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2046/4123] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:18 2022] POST /identity/v3/projects => generated 357 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:18:18.530884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0bdc8-4ea4-4479-b0c8-0e1f5b41244c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:18.552604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0bdc8-4ea4-4479-b0c8-0e1f5b41244c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:18.654405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83782eda-71be-4a43-b4d7-dd878761673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:18.655557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782eda-71be-4a43-b4d7-dd878761673a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:18.656529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782eda-71be-4a43-b4d7-dd878761673a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:18.657151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782eda-71be-4a43-b4d7-dd878761673a admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:18.658447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83782eda-71be-4a43-b4d7-dd878761673a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:18.671331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83782eda-71be-4a43-b4d7-dd878761673a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:18.699609 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2078/4124] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:18:18 2022] POST /identity/v3/users => generated 279 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:18.703789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407c358-36b9-490e-aaf1-6f8384d6a12a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:18.718014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407c358-36b9-490e-aaf1-6f8384d6a12a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:18.725830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34cc33-023e-412b-a9ed-867f9d4dd098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:18.726399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34cc33-023e-412b-a9ed-867f9d4dd098 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:18.726880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34cc33-023e-412b-a9ed-867f9d4dd098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:18.727164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34cc33-023e-412b-a9ed-867f9d4dd098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:18.727859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34cc33-023e-412b-a9ed-867f9d4dd098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:18.729957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34cc33-023e-412b-a9ed-867f9d4dd098 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:18.743843 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2047/4125] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:18.747462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83782eda-71be-4a43-b4d7-dd878761673a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:18.772928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83782eda-71be-4a43-b4d7-dd878761673a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:18.778389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638f288-9e84-4d0a-9949-c3c39439f542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:18.779050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638f288-9e84-4d0a-9949-c3c39439f542 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:18.779335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638f288-9e84-4d0a-9949-c3c39439f542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:18.779746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638f288-9e84-4d0a-9949-c3c39439f542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:18.780409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638f288-9e84-4d0a-9949-c3c39439f542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:18.782212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638f288-9e84-4d0a-9949-c3c39439f542 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:18.811719 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2079/4126] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:18.818470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34cc33-023e-412b-a9ed-867f9d4dd098 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:18.838361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34cc33-023e-412b-a9ed-867f9d4dd098 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:18.843546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395e1f5-70c4-44b0-bff1-b71f84698f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:18.844244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395e1f5-70c4-44b0-bff1-b71f84698f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:18.844526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395e1f5-70c4-44b0-bff1-b71f84698f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:18.845347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395e1f5-70c4-44b0-bff1-b71f84698f7e admin admin] PATH_INFO: `/v3/projects/24fd990a635c4d0f8707eb3682a5f65a/users/54379d4e32184840bdee08a3fd917a94/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:18.868770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395e1f5-70c4-44b0-bff1-b71f84698f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fd990a635c4d0f8707eb3682a5f65a, user_id=54379d4e32184840bdee08a3fd917a94, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:18.873157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395e1f5-70c4-44b0-bff1-b71f84698f7e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:18.894758 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2048/4127] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:18 2022] PUT /identity/v3/projects/24fd990a635c4d0f8707eb3682a5f65a/users/54379d4e32184840bdee08a3fd917a94/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:18.905144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba0265-c6b1-4b74-9b1e-0946c56d6a6c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:18.905431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba0265-c6b1-4b74-9b1e-0946c56d6a6c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:18.905702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba0265-c6b1-4b74-9b1e-0946c56d6a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:18.958389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-35ba0265-c6b1-4b74-9b1e-0946c56d6a6c None None] MFA Rules not processed for user `54379d4e32184840bdee08a3fd917a94`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:18.964776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-35ba0265-c6b1-4b74-9b1e-0946c56d6a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:19.113558 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2080/4128] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:19.127763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395e1f5-70c4-44b0-bff1-b71f84698f7e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:19.287180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395e1f5-70c4-44b0-bff1-b71f84698f7e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:19.295217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233f88c-7683-4110-b706-81f4bb36e831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:19.296119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f88c-7683-4110-b706-81f4bb36e831 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:19.296635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f88c-7683-4110-b706-81f4bb36e831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:19.307952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f88c-7683-4110-b706-81f4bb36e831 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:19.312852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233f88c-7683-4110-b706-81f4bb36e831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:19.318434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233f88c-7683-4110-b706-81f4bb36e831 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:19.392648 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:19.424168 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2049/4129] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:19 2022] POST /identity/v3/projects => generated 357 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:19.424799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba0265-c6b1-4b74-9b1e-0946c56d6a6c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:19.441121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba0265-c6b1-4b74-9b1e-0946c56d6a6c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:19.529184 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:19.625399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ee902-fd9b-4cfd-ba89-3d7ba62fabcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:19.626157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee902-fd9b-4cfd-ba89-3d7ba62fabcc admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:19.627023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee902-fd9b-4cfd-ba89-3d7ba62fabcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:19.628255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee902-fd9b-4cfd-ba89-3d7ba62fabcc admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:19.629027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ee902-fd9b-4cfd-ba89-3d7ba62fabcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:19.636248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ee902-fd9b-4cfd-ba89-3d7ba62fabcc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:19.749587 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2081/4130] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:18:19 2022] POST /identity/v3/users => generated 285 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:18:19.754424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233f88c-7683-4110-b706-81f4bb36e831 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:19.772945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233f88c-7683-4110-b706-81f4bb36e831 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:19.790693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea018b9-569a-4bb0-bca3-beaedc1b000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:19.793527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea018b9-569a-4bb0-bca3-beaedc1b000a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:19.794146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea018b9-569a-4bb0-bca3-beaedc1b000a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:19.794683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea018b9-569a-4bb0-bca3-beaedc1b000a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:19.796469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea018b9-569a-4bb0-bca3-beaedc1b000a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:19.803152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea018b9-569a-4bb0-bca3-beaedc1b000a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:19.822988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878035ed-3de1-47a8-bd79-ee69f133eb94 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:19.823593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878035ed-3de1-47a8-bd79-ee69f133eb94 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:19.823878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878035ed-3de1-47a8-bd79-ee69f133eb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:19.866870 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2050/4131] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:19.868493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea018b9-569a-4bb0-bca3-beaedc1b000a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:19.886850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-878035ed-3de1-47a8-bd79-ee69f133eb94 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:19.890094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-878035ed-3de1-47a8-bd79-ee69f133eb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:19.896529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea018b9-569a-4bb0-bca3-beaedc1b000a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:19.923142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c0029-56a7-4c45-9682-c082e172ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:19.924344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c0029-56a7-4c45-9682-c082e172ed40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:19.926542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c0029-56a7-4c45-9682-c082e172ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:19.927203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c0029-56a7-4c45-9682-c082e172ed40 admin admin] PATH_INFO: `/v3/projects/bf2cfac37e304ef28e0801e69cd8c489/users/9dcb5e4fccbd4781968782325943b6c4/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:20.016425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c0029-56a7-4c45-9682-c082e172ed40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2cfac37e304ef28e0801e69cd8c489, user_id=9dcb5e4fccbd4781968782325943b6c4, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:20.022514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c0029-56a7-4c45-9682-c082e172ed40 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:20.041412 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2051/4132] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:19 2022] PUT /identity/v3/projects/bf2cfac37e304ef28e0801e69cd8c489/users/9dcb5e4fccbd4781968782325943b6c4/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:20.045317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c0029-56a7-4c45-9682-c082e172ed40 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:20.078244 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2082/4133] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:18:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:20.096047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878035ed-3de1-47a8-bd79-ee69f133eb94 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:20.098223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-878035ed-3de1-47a8-bd79-ee69f133eb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:20.179910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c0029-56a7-4c45-9682-c082e172ed40 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:20.189226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f669-08bb-4e4b-a3e4-8adbc85229bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:20.191845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f669-08bb-4e4b-a3e4-8adbc85229bb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:20.192732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f669-08bb-4e4b-a3e4-8adbc85229bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:20.193213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f669-08bb-4e4b-a3e4-8adbc85229bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:20.194490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5f669-08bb-4e4b-a3e4-8adbc85229bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:20.196704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5f669-08bb-4e4b-a3e4-8adbc85229bb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:20.216404 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2052/4134] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:18:20.217281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f669-08bb-4e4b-a3e4-8adbc85229bb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:20.226980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878035ed-3de1-47a8-bd79-ee69f133eb94 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:20.237300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f669-08bb-4e4b-a3e4-8adbc85229bb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:20.245258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b67926-f8d0-4dd2-b66c-d121c8ccedf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:20.246951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b67926-f8d0-4dd2-b66c-d121c8ccedf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:20.247718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b67926-f8d0-4dd2-b66c-d121c8ccedf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:20.248210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b67926-f8d0-4dd2-b66c-d121c8ccedf3 admin admin] PATH_INFO: `/v3/projects/bf2cfac37e304ef28e0801e69cd8c489/users/9dcb5e4fccbd4781968782325943b6c4/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:20.253714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b67926-f8d0-4dd2-b66c-d121c8ccedf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2cfac37e304ef28e0801e69cd8c489, user_id=9dcb5e4fccbd4781968782325943b6c4, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:20.265925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b67926-f8d0-4dd2-b66c-d121c8ccedf3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:20.291531 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2053/4135] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:20 2022] PUT /identity/v3/projects/bf2cfac37e304ef28e0801e69cd8c489/users/9dcb5e4fccbd4781968782325943b6c4/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:20.313363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eec7fe-7c25-4b13-b507-3f94bc3efbe4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:20.313363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eec7fe-7c25-4b13-b507-3f94bc3efbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:20.313631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eec7fe-7c25-4b13-b507-3f94bc3efbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:20.370340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05ae15-669a-4ade-b01c-d37911d5ec66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:20.372398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05ae15-669a-4ade-b01c-d37911d5ec66 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:20.372857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05ae15-669a-4ade-b01c-d37911d5ec66 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:20.373299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05ae15-669a-4ade-b01c-d37911d5ec66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:20.382584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f6eec7fe-7c25-4b13-b507-3f94bc3efbe4 None None] MFA Rules not processed for user `9dcb5e4fccbd4781968782325943b6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:20.383576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f6eec7fe-7c25-4b13-b507-3f94bc3efbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:20.387113 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:20.468690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05ae15-669a-4ade-b01c-d37911d5ec66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:20.471990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05ae15-669a-4ade-b01c-d37911d5ec66 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:20.485295 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2083/4136] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:18:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:18:20.486716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05ae15-669a-4ade-b01c-d37911d5ec66 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:20.489240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9c05ae15-669a-4ade-b01c-d37911d5ec66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:20.506954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05ae15-669a-4ade-b01c-d37911d5ec66 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:20.603047 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2054/4137] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:18:20.604442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eec7fe-7c25-4b13-b507-3f94bc3efbe4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:20.632933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eec7fe-7c25-4b13-b507-3f94bc3efbe4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:20.642695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92db34-d789-4238-a2c7-ba2296e3d8b0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dcb5e4fccbd4781968782325943b6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf2cfac37e304ef28e0801e69cd8c489', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:20.644320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92db34-d789-4238-a2c7-ba2296e3d8b0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:20.644868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92db34-d789-4238-a2c7-ba2296e3d8b0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:20.645424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92db34-d789-4238-a2c7-ba2296e3d8b0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:20.647268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92db34-d789-4238-a2c7-ba2296e3d8b0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:20.648719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92db34-d789-4238-a2c7-ba2296e3d8b0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:20.652393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92db34-d789-4238-a2c7-ba2296e3d8b0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:20.667288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:20.667986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:20.668226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:20.668498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] PATH_INFO: `/v3/users/4bfef22ac4e54465930158887c923f60` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:20.671708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bfef22ac4e54465930158887c923f60)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:20.675316 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2055/4138] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:20.676322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:20.682179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92db34-d789-4238-a2c7-ba2296e3d8b0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:20.721021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92db34-d789-4238-a2c7-ba2296e3d8b0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:20.739758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9531f5-6d07-4c03-8567-8ac6c7a830a0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dcb5e4fccbd4781968782325943b6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf2cfac37e304ef28e0801e69cd8c489', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:20.741120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9531f5-6d07-4c03-8567-8ac6c7a830a0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:20.742051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9531f5-6d07-4c03-8567-8ac6c7a830a0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:20.742682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9531f5-6d07-4c03-8567-8ac6c7a830a0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:20.743872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9531f5-6d07-4c03-8567-8ac6c7a830a0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:20.746467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9531f5-6d07-4c03-8567-8ac6c7a830a0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:20.818416 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:20.842145 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2056/4139] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:20 2022] POST /identity/v3/projects => generated 350 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:20.843297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9531f5-6d07-4c03-8567-8ac6c7a830a0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:20.852476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bfef22ac4e54465930158887c923f60'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:20.887771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bfef22ac4e54465930158887c923f60'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:20.890658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bfef22ac4e54465930158887c923f60'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:20.913208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bfef22ac4e54465930158887c923f60'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:20.915204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bfef22ac4e54465930158887c923f60'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:20.957868 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2084/4140] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:18:20 2022] DELETE /identity/v3/users/4bfef22ac4e54465930158887c923f60 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:21.216642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9531f5-6d07-4c03-8567-8ac6c7a830a0 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:21.359766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b3d47-763a-4543-bd6f-23a35e6251cf tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dcb5e4fccbd4781968782325943b6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf2cfac37e304ef28e0801e69cd8c489', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:21.360458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b3d47-763a-4543-bd6f-23a35e6251cf tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:21.360742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b3d47-763a-4543-bd6f-23a35e6251cf tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:21.361020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b3d47-763a-4543-bd6f-23a35e6251cf tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:21.361685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b3d47-763a-4543-bd6f-23a35e6251cf tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:21.362609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b3d47-763a-4543-bd6f-23a35e6251cf tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:21.372199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b3d47-763a-4543-bd6f-23a35e6251cf tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:21.408995 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2057/4141] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 566 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:21.416948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:21.418345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:21.437875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b3d47-763a-4543-bd6f-23a35e6251cf tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:21.439618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b1b3d47-763a-4543-bd6f-23a35e6251cf tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:21.571237 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:21.734327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b3d47-763a-4543-bd6f-23a35e6251cf tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:21.747513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3676c-8a9f-4620-8f58-b6c76f2d9e73 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:21.749993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3642e5-ac23-47f2-bf69-b6d12e91828d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:21.750636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3642e5-ac23-47f2-bf69-b6d12e91828d service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:21.750924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3642e5-ac23-47f2-bf69-b6d12e91828d service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:21.753712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3642e5-ac23-47f2-bf69-b6d12e91828d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:21.756927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1e3642e5-ac23-47f2-bf69-b6d12e91828d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:21.760186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:21.760846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:21.761129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:21.761402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] PATH_INFO: `/v3/projects/aa4f0ad95a5e4ed294828e036dfef60a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:21.763997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4f0ad95a5e4ed294828e036dfef60a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:21.765705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:21.788790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3642e5-ac23-47f2-bf69-b6d12e91828d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:21.790262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3642e5-ac23-47f2-bf69-b6d12e91828d service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:21.816785 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2058/4142] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:18:21.818148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f359223-76c1-4e8a-b415-1e96f56db4bc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:21.818438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f359223-76c1-4e8a-b415-1e96f56db4bc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:21.818746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f359223-76c1-4e8a-b415-1e96f56db4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:21.839079 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:21.869694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5f359223-76c1-4e8a-b415-1e96f56db4bc None None] MFA Rules not processed for user `db9450c53d8944b88cfbbc541f585ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:21.874670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5f359223-76c1-4e8a-b415-1e96f56db4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:21.883582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4f0ad95a5e4ed294828e036dfef60a', 'request_id': 'req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:21.897870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4f0ad95a5e4ed294828e036dfef60a', 'request_id': 'req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:21.934827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4f0ad95a5e4ed294828e036dfef60a', 'request_id': 'req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:21.957037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] The token cache is being invalidate because project aa4f0ad95a5e4ed294828e036dfef60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:21.958228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:21.964029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5f7d29d5-4cec-4cf8-b20c-e515da5e9982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:21.971831 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2085/4143] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:21 2022] DELETE /identity/v3/projects/aa4f0ad95a5e4ed294828e036dfef60a => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:21.977834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af340f-e719-4a83-bb32-697b76e50540 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:21.978242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af340f-e719-4a83-bb32-697b76e50540 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:21.978627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af340f-e719-4a83-bb32-697b76e50540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:22.036751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d5af340f-e719-4a83-bb32-697b76e50540 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:22.038364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d5af340f-e719-4a83-bb32-697b76e50540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:22.058805 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2059/4144] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:22.213429 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2086/4145] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:22.222891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd9f3e-4876-492c-9493-6f31655f42ec None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:22.223485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd9f3e-4876-492c-9493-6f31655f42ec None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:22.223485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd9f3e-4876-492c-9493-6f31655f42ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:22.244441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8efd9f3e-4876-492c-9493-6f31655f42ec None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:22.246068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8efd9f3e-4876-492c-9493-6f31655f42ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:22.285339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af340f-e719-4a83-bb32-697b76e50540 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:22.286812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d5af340f-e719-4a83-bb32-697b76e50540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:22.315314 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2060/4146] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:22.320872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd9f3e-4876-492c-9493-6f31655f42ec None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:22.335405 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:22.349118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd9f3e-4876-492c-9493-6f31655f42ec None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:22.359074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d249-e92a-453b-8a16-4185bfec422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:22.359827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d249-e92a-453b-8a16-4185bfec422b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:22.367728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d249-e92a-453b-8a16-4185bfec422b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:22.367728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d249-e92a-453b-8a16-4185bfec422b admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:22.367728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1d249-e92a-453b-8a16-4185bfec422b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:22.367728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1d249-e92a-453b-8a16-4185bfec422b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:22.367728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1d249-e92a-453b-8a16-4185bfec422b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:22.386085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af340f-e719-4a83-bb32-697b76e50540 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:22.394381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dcb5e4fccbd4781968782325943b6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf2cfac37e304ef28e0801e69cd8c489', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:22.395062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:22.395353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:22.395633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] PATH_INFO: `/v3/projects/a680f82130d0481d8182c9138c001c82` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:22.398007 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2061/4147] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:22.399594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a680f82130d0481d8182c9138c001c82)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:22.401575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:22.494684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d249-e92a-453b-8a16-4185bfec422b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:22.522977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d249-e92a-453b-8a16-4185bfec422b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:22.553789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a680f82130d0481d8182c9138c001c82', 'request_id': 'req-c44b01f6-2b93-4021-84b7-434be6513130'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:22.570857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a680f82130d0481d8182c9138c001c82', 'request_id': 'req-c44b01f6-2b93-4021-84b7-434be6513130'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:22.587341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a680f82130d0481d8182c9138c001c82', 'request_id': 'req-c44b01f6-2b93-4021-84b7-434be6513130'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:22.623565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] The token cache is being invalidate because project a680f82130d0481d8182c9138c001c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:22.623962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:22.625705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:22.630185 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2087/4148] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:22 2022] DELETE /identity/v3/projects/a680f82130d0481d8182c9138c001c82 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:22.677038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f21b7-cff0-45e8-834f-f77f33ab7469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:22.677675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f21b7-cff0-45e8-834f-f77f33ab7469 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:22.677956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f21b7-cff0-45e8-834f-f77f33ab7469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:22.679045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f21b7-cff0-45e8-834f-f77f33ab7469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:22.680006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f21b7-cff0-45e8-834f-f77f33ab7469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:22.685474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f21b7-cff0-45e8-834f-f77f33ab7469 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:22.737926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2062/4149] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:22 2022] POST /identity/v3/projects => generated 381 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:22.739192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:22.740704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:22.762973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b01f6-2b93-4021-84b7-434be6513130 tempest-QuotasTest-1284290704 tempest-QuotasTest-1284290704-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:22.771679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f21b7-cff0-45e8-834f-f77f33ab7469 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:22.773749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b95f21b7-cff0-45e8-834f-f77f33ab7469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:22.857603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8581ca-6821-4443-922d-639c74f3359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:22.858234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8581ca-6821-4443-922d-639c74f3359a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:22.858516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8581ca-6821-4443-922d-639c74f3359a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:22.858836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8581ca-6821-4443-922d-639c74f3359a admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:22.862122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8581ca-6821-4443-922d-639c74f3359a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:22.862122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8581ca-6821-4443-922d-639c74f3359a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:22.898349 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2088/4150] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:18:22 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:22.903249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8581ca-6821-4443-922d-639c74f3359a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:22.907271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f21b7-cff0-45e8-834f-f77f33ab7469 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:22.918143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad4720-db57-4a35-b2e7-6fd7d4998b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:22.919536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad4720-db57-4a35-b2e7-6fd7d4998b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:22.920017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad4720-db57-4a35-b2e7-6fd7d4998b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:22.920488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad4720-db57-4a35-b2e7-6fd7d4998b27 admin admin] PATH_INFO: `/v3/users/54379d4e32184840bdee08a3fd917a94` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:22.921957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad4720-db57-4a35-b2e7-6fd7d4998b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54379d4e32184840bdee08a3fd917a94)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:22.923549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8581ca-6821-4443-922d-639c74f3359a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:22.925522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad4720-db57-4a35-b2e7-6fd7d4998b27 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:22.930496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906f55-8e4b-494f-8093-4650699d5241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:22.931186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906f55-8e4b-494f-8093-4650699d5241 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:22.931186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906f55-8e4b-494f-8093-4650699d5241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:22.931467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906f55-8e4b-494f-8093-4650699d5241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:22.932270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de906f55-8e4b-494f-8093-4650699d5241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:22.934367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de906f55-8e4b-494f-8093-4650699d5241 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:22.956624 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:22.968455 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2089/4151] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:18:22.988321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906f55-8e4b-494f-8093-4650699d5241 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:23.008478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906f55-8e4b-494f-8093-4650699d5241 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:23.019382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e4bda-a221-4ad4-88cb-513aea32902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:23.020104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e4bda-a221-4ad4-88cb-513aea32902c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:23.020383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e4bda-a221-4ad4-88cb-513aea32902c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:23.020666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e4bda-a221-4ad4-88cb-513aea32902c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:23.023788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e4bda-a221-4ad4-88cb-513aea32902c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:23.025428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e4bda-a221-4ad4-88cb-513aea32902c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:23.035418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aaad4720-db57-4a35-b2e7-6fd7d4998b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54379d4e32184840bdee08a3fd917a94'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:23.053462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aaad4720-db57-4a35-b2e7-6fd7d4998b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54379d4e32184840bdee08a3fd917a94'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:23.054467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aaad4720-db57-4a35-b2e7-6fd7d4998b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54379d4e32184840bdee08a3fd917a94'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:23.072101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aaad4720-db57-4a35-b2e7-6fd7d4998b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54379d4e32184840bdee08a3fd917a94'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:23.079913 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2090/4152] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:18:23.081312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e4bda-a221-4ad4-88cb-513aea32902c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:23.090323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aaad4720-db57-4a35-b2e7-6fd7d4998b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54379d4e32184840bdee08a3fd917a94'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:23.096269 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2063/4153] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:18:22 2022] DELETE /identity/v3/users/54379d4e32184840bdee08a3fd917a94 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:23.101342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070eafc-2abd-4637-86d6-d13fc12810cf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:23.101685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070eafc-2abd-4637-86d6-d13fc12810cf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:23.103797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070eafc-2abd-4637-86d6-d13fc12810cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:23.106548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cf7e4bda-a221-4ad4-88cb-513aea32902c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:23.136942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2070eafc-2abd-4637-86d6-d13fc12810cf None None] MFA Rules not processed for user `5104bda5de774e93bd494d64a8f11faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:23.138720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2070eafc-2abd-4637-86d6-d13fc12810cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:23.159613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e4bda-a221-4ad4-88cb-513aea32902c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:23.227948 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:23.234005 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2064/4154] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:23.239158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f28bb-ef7f-4d97-910f-4b5db3b74513 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:23.239968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f28bb-ef7f-4d97-910f-4b5db3b74513 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:23.240427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f28bb-ef7f-4d97-910f-4b5db3b74513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:23.266124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ad9f28bb-ef7f-4d97-910f-4b5db3b74513 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:23.269173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ad9f28bb-ef7f-4d97-910f-4b5db3b74513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:23.272389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42063803-7a2d-4c37-9bf7-b918065fa0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:23.272389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42063803-7a2d-4c37-9bf7-b918065fa0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:23.272389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42063803-7a2d-4c37-9bf7-b918065fa0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:23.272389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42063803-7a2d-4c37-9bf7-b918065fa0cf admin admin] PATH_INFO: `/v3/projects/13ce5884d5b34274951f43381af6fa31/users/98dee3ab3afb4e68a3e720db8e70f045/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:23.286036 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2065/4155] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:23.289991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42063803-7a2d-4c37-9bf7-b918065fa0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ce5884d5b34274951f43381af6fa31, user_id=98dee3ab3afb4e68a3e720db8e70f045, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:23.292876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42063803-7a2d-4c37-9bf7-b918065fa0cf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:23.295739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f28bb-ef7f-4d97-910f-4b5db3b74513 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:23.297361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ad9f28bb-ef7f-4d97-910f-4b5db3b74513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:23.328845 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2091/4156] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:23 2022] PUT /identity/v3/projects/13ce5884d5b34274951f43381af6fa31/users/98dee3ab3afb4e68a3e720db8e70f045/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:23.333921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43e7b-4587-4b37-b645-5db17c17aaa6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:23.334231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43e7b-4587-4b37-b645-5db17c17aaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:23.334509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43e7b-4587-4b37-b645-5db17c17aaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:23.390639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a3f43e7b-4587-4b37-b645-5db17c17aaa6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:23.391864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a3f43e7b-4587-4b37-b645-5db17c17aaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:23.402833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f28bb-ef7f-4d97-910f-4b5db3b74513 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:23.477529 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:23.496159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff8c74-2821-4c7e-93ca-5a50804205e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:23.496793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff8c74-2821-4c7e-93ca-5a50804205e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:23.497352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff8c74-2821-4c7e-93ca-5a50804205e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:23.497750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff8c74-2821-4c7e-93ca-5a50804205e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:23.580754 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2092/4157] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:23.590917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f43e7b-4587-4b37-b645-5db17c17aaa6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:23.655813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff8c74-2821-4c7e-93ca-5a50804205e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:23.657532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff8c74-2821-4c7e-93ca-5a50804205e5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:23.663293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f43e7b-4587-4b37-b645-5db17c17aaa6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:23.670077 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2066/4158] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:23.698899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da9007-3bc4-4b6a-9d03-fb8b5cc4f741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:23.699592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da9007-3bc4-4b6a-9d03-fb8b5cc4f741 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:23.699958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da9007-3bc4-4b6a-9d03-fb8b5cc4f741 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:23.700247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da9007-3bc4-4b6a-9d03-fb8b5cc4f741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:23.748058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da9007-3bc4-4b6a-9d03-fb8b5cc4f741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:23.749561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da9007-3bc4-4b6a-9d03-fb8b5cc4f741 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:23.792445 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2093/4159] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:25.041111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff8c74-2821-4c7e-93ca-5a50804205e5 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:25.042848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5ff8c74-2821-4c7e-93ca-5a50804205e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:25.086067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff8c74-2821-4c7e-93ca-5a50804205e5 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:25.116747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:25.117587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:25.117873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:25.120450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] PATH_INFO: `/v3/projects/24fd990a635c4d0f8707eb3682a5f65a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:25.128361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] RBAC: Authorizing `identity:delete_project(project_id=24fd990a635c4d0f8707eb3682a5f65a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:25.130357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:25.327896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24fd990a635c4d0f8707eb3682a5f65a', 'request_id': 'req-2f9fd6df-ea67-42da-9c51-b2743951596b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:25.342743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24fd990a635c4d0f8707eb3682a5f65a', 'request_id': 'req-2f9fd6df-ea67-42da-9c51-b2743951596b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:25.372163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24fd990a635c4d0f8707eb3682a5f65a', 'request_id': 'req-2f9fd6df-ea67-42da-9c51-b2743951596b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:25.433133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] The token cache is being invalidate because project 24fd990a635c4d0f8707eb3682a5f65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:25.434746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:25.435790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2f9fd6df-ea67-42da-9c51-b2743951596b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:25.445927 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2067/4160] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:25 2022] DELETE /identity/v3/projects/24fd990a635c4d0f8707eb3682a5f65a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:25.449668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da9007-3bc4-4b6a-9d03-fb8b5cc4f741 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:25.463341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da9007-3bc4-4b6a-9d03-fb8b5cc4f741 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:25.613832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b6296-bf87-4667-bf72-f40025f10761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:25.629270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b6296-bf87-4667-bf72-f40025f10761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:25.629657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b6296-bf87-4667-bf72-f40025f10761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:25.630273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b6296-bf87-4667-bf72-f40025f10761 admin admin] PATH_INFO: `/v3/users/9dcb5e4fccbd4781968782325943b6c4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:25.634440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b6296-bf87-4667-bf72-f40025f10761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dcb5e4fccbd4781968782325943b6c4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:25.637603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b6296-bf87-4667-bf72-f40025f10761 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:25.741168 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:25.747107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-354b6296-bf87-4667-bf72-f40025f10761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dcb5e4fccbd4781968782325943b6c4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:25.770253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-354b6296-bf87-4667-bf72-f40025f10761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dcb5e4fccbd4781968782325943b6c4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:25.771164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-354b6296-bf87-4667-bf72-f40025f10761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dcb5e4fccbd4781968782325943b6c4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:25.792197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-354b6296-bf87-4667-bf72-f40025f10761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dcb5e4fccbd4781968782325943b6c4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:25.792969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-354b6296-bf87-4667-bf72-f40025f10761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dcb5e4fccbd4781968782325943b6c4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:25.819878 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2094/4161] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:18:25 2022] DELETE /identity/v3/users/9dcb5e4fccbd4781968782325943b6c4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:26.368676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7e773-6a02-40cb-8567-dd3cbbf0b8fb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:26.370083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7e773-6a02-40cb-8567-dd3cbbf0b8fb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:26.372926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7e773-6a02-40cb-8567-dd3cbbf0b8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:26.417589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-21b7e773-6a02-40cb-8567-dd3cbbf0b8fb None None] MFA Rules not processed for user `039f66a7c47b47e39672b8a49683f6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:26.422008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-21b7e773-6a02-40cb-8567-dd3cbbf0b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:26.588515 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2068/4162] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:27.408230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31489077-a728-4673-997d-64f0c9c6a5ea None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:27.408982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31489077-a728-4673-997d-64f0c9c6a5ea None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:27.409313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31489077-a728-4673-997d-64f0c9c6a5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:27.476320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-31489077-a728-4673-997d-64f0c9c6a5ea None None] MFA Rules not processed for user `039f66a7c47b47e39672b8a49683f6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:27.477611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-31489077-a728-4673-997d-64f0c9c6a5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:27.502175 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2095/4163] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:27.551967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaebaf1-1afa-4fa8-8c16-9a68828f99f2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:27.552492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaebaf1-1afa-4fa8-8c16-9a68828f99f2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:27.552601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaebaf1-1afa-4fa8-8c16-9a68828f99f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:27.607177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8eaebaf1-1afa-4fa8-8c16-9a68828f99f2 None None] MFA Rules not processed for user `039f66a7c47b47e39672b8a49683f6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:27.608448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8eaebaf1-1afa-4fa8-8c16-9a68828f99f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:27.650930 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2069/4164] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:27.754794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5a28-85e0-4289-999f-7915d2fd8746 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:27.755391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5a28-85e0-4289-999f-7915d2fd8746 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:27.755681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5a28-85e0-4289-999f-7915d2fd8746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:27.843268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-764b5a28-85e0-4289-999f-7915d2fd8746 None None] MFA Rules not processed for user `039f66a7c47b47e39672b8a49683f6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:27.845230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-764b5a28-85e0-4289-999f-7915d2fd8746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:27.858232 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2096/4165] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:27.889754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253054-ded3-4b2b-9490-fe5776407f6d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:27.890054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253054-ded3-4b2b-9490-fe5776407f6d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:27.890338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253054-ded3-4b2b-9490-fe5776407f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:27.936673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d3253054-ded3-4b2b-9490-fe5776407f6d None None] MFA Rules not processed for user `039f66a7c47b47e39672b8a49683f6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:27.940848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d3253054-ded3-4b2b-9490-fe5776407f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:27.988074 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2070/4166] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:28.284340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5a28-85e0-4289-999f-7915d2fd8746 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:28.286057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-764b5a28-85e0-4289-999f-7915d2fd8746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:28.583856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5a28-85e0-4289-999f-7915d2fd8746 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:28.605729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:28.606393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:28.606708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:28.606986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] PATH_INFO: `/v3/projects/bf2cfac37e304ef28e0801e69cd8c489` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:28.609886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2cfac37e304ef28e0801e69cd8c489)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:28.613205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:28.767960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2cfac37e304ef28e0801e69cd8c489', 'request_id': 'req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:28.787037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2cfac37e304ef28e0801e69cd8c489', 'request_id': 'req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:28.811379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2cfac37e304ef28e0801e69cd8c489', 'request_id': 'req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:28.843332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] The token cache is being invalidate because project bf2cfac37e304ef28e0801e69cd8c489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:28.848999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:28.851231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3fd2cc12-60ab-4b5e-a631-eeb5d09a239e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:28.854646 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2097/4167] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:28 2022] DELETE /identity/v3/projects/bf2cfac37e304ef28e0801e69cd8c489 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:28.862496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d49ae4-ea7d-401c-9345-9dadb2b04b38 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:28.863595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d49ae4-ea7d-401c-9345-9dadb2b04b38 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:28.864073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d49ae4-ea7d-401c-9345-9dadb2b04b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:28.903795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-87d49ae4-ea7d-401c-9345-9dadb2b04b38 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:28.920859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-87d49ae4-ea7d-401c-9345-9dadb2b04b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:28.946178 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:29.064959 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2071/4168] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:29.074631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93c032-3619-45bb-ba08-70e5491e0890 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:29.075087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93c032-3619-45bb-ba08-70e5491e0890 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:29.075478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93c032-3619-45bb-ba08-70e5491e0890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:29.130106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fe93c032-3619-45bb-ba08-70e5491e0890 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:29.134080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fe93c032-3619-45bb-ba08-70e5491e0890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:29.165973 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2098/4169] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:29.167148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d49ae4-ea7d-401c-9345-9dadb2b04b38 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:29.186202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d49ae4-ea7d-401c-9345-9dadb2b04b38 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:29.202160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14385c5-afa8-4229-ba02-4412716a3cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:29.202961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14385c5-afa8-4229-ba02-4412716a3cab admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:29.203540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14385c5-afa8-4229-ba02-4412716a3cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:29.204811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14385c5-afa8-4229-ba02-4412716a3cab admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:29.207250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14385c5-afa8-4229-ba02-4412716a3cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:29.209523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14385c5-afa8-4229-ba02-4412716a3cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:29.216109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14385c5-afa8-4229-ba02-4412716a3cab admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:29.254491 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2072/4170] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:29.259601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93c032-3619-45bb-ba08-70e5491e0890 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:29.291793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93c032-3619-45bb-ba08-70e5491e0890 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:29.305404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0f23c-1b76-4b33-9d87-0b36ce473267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:29.306042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f23c-1b76-4b33-9d87-0b36ce473267 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:29.306367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f23c-1b76-4b33-9d87-0b36ce473267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:29.306686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f23c-1b76-4b33-9d87-0b36ce473267 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:29.307429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0f23c-1b76-4b33-9d87-0b36ce473267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:29.309806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0f23c-1b76-4b33-9d87-0b36ce473267 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:29.448076 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2099/4171] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:29 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:29.449254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14385c5-afa8-4229-ba02-4412716a3cab admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:29.466096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14385c5-afa8-4229-ba02-4412716a3cab admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:29.755744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324559b-e468-4305-90bf-9d26afb421ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:29.767875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324559b-e468-4305-90bf-9d26afb421ab admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:29.768238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324559b-e468-4305-90bf-9d26afb421ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:29.768752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324559b-e468-4305-90bf-9d26afb421ab admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:29.770298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324559b-e468-4305-90bf-9d26afb421ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:29.772521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324559b-e468-4305-90bf-9d26afb421ab admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:29.859039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0f23c-1b76-4b33-9d87-0b36ce473267 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:29.861494 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2073/4172] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:18:29 2022] POST /identity/v3/users => generated 284 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:29.884088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0f23c-1b76-4b33-9d87-0b36ce473267 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:29.902893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e19031-cc3a-4c5e-bafa-db760b365d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:29.904294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e19031-cc3a-4c5e-bafa-db760b365d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:29.905419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e19031-cc3a-4c5e-bafa-db760b365d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:29.905898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e19031-cc3a-4c5e-bafa-db760b365d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:29.907349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e19031-cc3a-4c5e-bafa-db760b365d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:29.909997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e19031-cc3a-4c5e-bafa-db760b365d8f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:29.933059 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:29.950988 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2100/4173] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:29.954928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324559b-e468-4305-90bf-9d26afb421ab admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:29.998948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324559b-e468-4305-90bf-9d26afb421ab admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:30.012200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2214119-e8bb-4d1d-a683-0614a8888faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:30.012842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2214119-e8bb-4d1d-a683-0614a8888faa admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:30.013116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2214119-e8bb-4d1d-a683-0614a8888faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:30.013391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2214119-e8bb-4d1d-a683-0614a8888faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:30.017813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2214119-e8bb-4d1d-a683-0614a8888faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:30.019487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2214119-e8bb-4d1d-a683-0614a8888faa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:30.037895 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2074/4174] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:30.041440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e19031-cc3a-4c5e-bafa-db760b365d8f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:30.065794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e19031-cc3a-4c5e-bafa-db760b365d8f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:30.087876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614f87f-803d-44e1-b7ef-d36db2727580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:30.088648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614f87f-803d-44e1-b7ef-d36db2727580 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:30.089239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614f87f-803d-44e1-b7ef-d36db2727580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:30.089525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614f87f-803d-44e1-b7ef-d36db2727580 admin admin] PATH_INFO: `/v3/projects/c497d2ed5bbb4ed186e2f6f74bfed47f/users/0137895559ee4c76a8ea40ac6bdc4d87/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:30.153873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614f87f-803d-44e1-b7ef-d36db2727580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c497d2ed5bbb4ed186e2f6f74bfed47f, user_id=0137895559ee4c76a8ea40ac6bdc4d87, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:30.157459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614f87f-803d-44e1-b7ef-d36db2727580 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:30.184393 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2101/4175] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:30 2022] PUT /identity/v3/projects/c497d2ed5bbb4ed186e2f6f74bfed47f/users/0137895559ee4c76a8ea40ac6bdc4d87/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:30.196313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b484e-4a81-404f-9f7c-cef870d5ea4d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:30.196599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b484e-4a81-404f-9f7c-cef870d5ea4d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:30.197175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b484e-4a81-404f-9f7c-cef870d5ea4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:30.256790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fb4b484e-4a81-404f-9f7c-cef870d5ea4d None None] MFA Rules not processed for user `0137895559ee4c76a8ea40ac6bdc4d87`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:30.258782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fb4b484e-4a81-404f-9f7c-cef870d5ea4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:30.415302 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2075/4176] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:30.416677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614f87f-803d-44e1-b7ef-d36db2727580 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:30.597287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614f87f-803d-44e1-b7ef-d36db2727580 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:30.622841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37841c90-b93f-4d70-bcbf-8043c50e4a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:30.623477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37841c90-b93f-4d70-bcbf-8043c50e4a96 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:30.623757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37841c90-b93f-4d70-bcbf-8043c50e4a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:30.624032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37841c90-b93f-4d70-bcbf-8043c50e4a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:30.624679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37841c90-b93f-4d70-bcbf-8043c50e4a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:30.629836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37841c90-b93f-4d70-bcbf-8043c50e4a96 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:30.717455 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2102/4177] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:30 2022] POST /identity/v3/projects => generated 369 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:30.721908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b484e-4a81-404f-9f7c-cef870d5ea4d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:30.762240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b484e-4a81-404f-9f7c-cef870d5ea4d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:30.766909 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:30.878224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12c0ee-3c43-4b33-96b6-468b49dccee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:30.878903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12c0ee-3c43-4b33-96b6-468b49dccee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:30.879552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12c0ee-3c43-4b33-96b6-468b49dccee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:30.879552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12c0ee-3c43-4b33-96b6-468b49dccee5 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:30.880096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12c0ee-3c43-4b33-96b6-468b49dccee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:30.888567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12c0ee-3c43-4b33-96b6-468b49dccee5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:30.937342 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2076/4178] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:18:30 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:30.940176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37841c90-b93f-4d70-bcbf-8043c50e4a96 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:30.972625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37841c90-b93f-4d70-bcbf-8043c50e4a96 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:30.987585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e524acc-b642-4aaa-a65d-4ff1f6d9708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:30.988218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e524acc-b642-4aaa-a65d-4ff1f6d9708c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:30.988503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e524acc-b642-4aaa-a65d-4ff1f6d9708c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:30.988785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e524acc-b642-4aaa-a65d-4ff1f6d9708c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:30.989445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e524acc-b642-4aaa-a65d-4ff1f6d9708c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:30.993011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e524acc-b642-4aaa-a65d-4ff1f6d9708c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:31.029412 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2103/4179] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:31.032696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12c0ee-3c43-4b33-96b6-468b49dccee5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:31.045390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12c0ee-3c43-4b33-96b6-468b49dccee5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:31.060697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab180b-0745-45c1-a175-a75e8774173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:31.061350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab180b-0745-45c1-a175-a75e8774173a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:31.061637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab180b-0745-45c1-a175-a75e8774173a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:31.061920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab180b-0745-45c1-a175-a75e8774173a admin admin] PATH_INFO: `/v3/projects/1995e813228a471f9a704a013182222f/users/f9b7c905bc0b431bb277ae441cb1f5c3/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:31.099758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab180b-0745-45c1-a175-a75e8774173a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1995e813228a471f9a704a013182222f, user_id=f9b7c905bc0b431bb277ae441cb1f5c3, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:31.103863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab180b-0745-45c1-a175-a75e8774173a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:31.171393 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2077/4180] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:31 2022] PUT /identity/v3/projects/1995e813228a471f9a704a013182222f/users/f9b7c905bc0b431bb277ae441cb1f5c3/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:31.178042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e524acc-b642-4aaa-a65d-4ff1f6d9708c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:31.190242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e524acc-b642-4aaa-a65d-4ff1f6d9708c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:31.350962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e078d5-f4b0-4bbc-805f-4176f0e9acd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:31.352085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e078d5-f4b0-4bbc-805f-4176f0e9acd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:31.353102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e078d5-f4b0-4bbc-805f-4176f0e9acd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:31.353681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e078d5-f4b0-4bbc-805f-4176f0e9acd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:31.354564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e078d5-f4b0-4bbc-805f-4176f0e9acd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:31.356479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e078d5-f4b0-4bbc-805f-4176f0e9acd6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:31.372965 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2104/4181] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:31.376997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab180b-0745-45c1-a175-a75e8774173a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:31.418746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab180b-0745-45c1-a175-a75e8774173a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:31.436673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e41607-e3e8-47b5-a8b1-738aabed5f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:31.437372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41607-e3e8-47b5-a8b1-738aabed5f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:31.437656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41607-e3e8-47b5-a8b1-738aabed5f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:31.437965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e41607-e3e8-47b5-a8b1-738aabed5f77 admin admin] PATH_INFO: `/v3/projects/1995e813228a471f9a704a013182222f/users/f9b7c905bc0b431bb277ae441cb1f5c3/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:31.448196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e41607-e3e8-47b5-a8b1-738aabed5f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1995e813228a471f9a704a013182222f, user_id=f9b7c905bc0b431bb277ae441cb1f5c3, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:31.450927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e41607-e3e8-47b5-a8b1-738aabed5f77 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:31.478420 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2078/4182] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:31 2022] PUT /identity/v3/projects/1995e813228a471f9a704a013182222f/users/f9b7c905bc0b431bb277ae441cb1f5c3/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:31.489533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ce525-3781-45e4-8746-54c729c12b8b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:31.490060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ce525-3781-45e4-8746-54c729c12b8b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:31.490507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ce525-3781-45e4-8746-54c729c12b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:31.556221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f80ce525-3781-45e4-8746-54c729c12b8b None None] MFA Rules not processed for user `f9b7c905bc0b431bb277ae441cb1f5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:31.558858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f80ce525-3781-45e4-8746-54c729c12b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:31.617110 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:31.692703 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2105/4183] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:31.765377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e41607-e3e8-47b5-a8b1-738aabed5f77 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:31.768072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37e41607-e3e8-47b5-a8b1-738aabed5f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:31.898543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e41607-e3e8-47b5-a8b1-738aabed5f77 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:31.906057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3f368-2748-48c0-8dfa-60e44a45c6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:31.907401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f368-2748-48c0-8dfa-60e44a45c6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:31.908655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f368-2748-48c0-8dfa-60e44a45c6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:31.908655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f368-2748-48c0-8dfa-60e44a45c6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:31.927726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3f368-2748-48c0-8dfa-60e44a45c6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:31.930453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3f368-2748-48c0-8dfa-60e44a45c6e8 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:31.950267 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2079/4184] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:32.892875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ce525-3781-45e4-8746-54c729c12b8b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:32.894549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f80ce525-3781-45e4-8746-54c729c12b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:33.195357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ce525-3781-45e4-8746-54c729c12b8b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:33.203971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0b04a-d15b-4151-a9c9-12a72b86ec53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:33.207927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b04a-d15b-4151-a9c9-12a72b86ec53 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:33.214901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b04a-d15b-4151-a9c9-12a72b86ec53 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:33.216207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b04a-d15b-4151-a9c9-12a72b86ec53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:33.219812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bdb0b04a-d15b-4151-a9c9-12a72b86ec53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:33.245843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0b04a-d15b-4151-a9c9-12a72b86ec53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:33.247466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0b04a-d15b-4151-a9c9-12a72b86ec53 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:33.292569 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2106/4185] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:34.753066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ba37f-f119-488d-8c0c-c5b5d2bc4409 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:34.753528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ba37f-f119-488d-8c0c-c5b5d2bc4409 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:34.753528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ba37f-f119-488d-8c0c-c5b5d2bc4409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:34.819103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cf2ba37f-f119-488d-8c0c-c5b5d2bc4409 None None] MFA Rules not processed for user `98dee3ab3afb4e68a3e720db8e70f045`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:34.821668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf2ba37f-f119-488d-8c0c-c5b5d2bc4409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:35.034889 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:35.071004 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2080/4186] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:35.081154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853a219-f2df-42c1-84fc-46ebdb9e5fc6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:35.081700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853a219-f2df-42c1-84fc-46ebdb9e5fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:35.081837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853a219-f2df-42c1-84fc-46ebdb9e5fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:35.113399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4853a219-f2df-42c1-84fc-46ebdb9e5fc6 None None] MFA Rules not processed for user `98dee3ab3afb4e68a3e720db8e70f045`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:35.114910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4853a219-f2df-42c1-84fc-46ebdb9e5fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:35.123885 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2107/4187] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:35.169185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ba37f-f119-488d-8c0c-c5b5d2bc4409 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:35.175114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf2ba37f-f119-488d-8c0c-c5b5d2bc4409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:35.346032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ba37f-f119-488d-8c0c-c5b5d2bc4409 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:35.355954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab4cd-27a1-4422-9314-4e124878be5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:35.356694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab4cd-27a1-4422-9314-4e124878be5d service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:35.357538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab4cd-27a1-4422-9314-4e124878be5d service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:35.357538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab4cd-27a1-4422-9314-4e124878be5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:35.387096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ab4cd-27a1-4422-9314-4e124878be5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:35.390633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ab4cd-27a1-4422-9314-4e124878be5d service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:35.414217 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2081/4188] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:41.521167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853a219-f2df-42c1-84fc-46ebdb9e5fc6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:41.543437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853a219-f2df-42c1-84fc-46ebdb9e5fc6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:41.581463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718b69-b00d-4eef-8f6f-8ef8166a8ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:41.583269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718b69-b00d-4eef-8f6f-8ef8166a8ee0 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:41.584292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718b69-b00d-4eef-8f6f-8ef8166a8ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:41.587471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718b69-b00d-4eef-8f6f-8ef8166a8ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:41.598126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-85718b69-b00d-4eef-8f6f-8ef8166a8ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:41.637202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab4cd-27a1-4422-9314-4e124878be5d service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:41.644860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-315ab4cd-27a1-4422-9314-4e124878be5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:41.829663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718b69-b00d-4eef-8f6f-8ef8166a8ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:41.837874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718b69-b00d-4eef-8f6f-8ef8166a8ee0 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:41.869577 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2108/4189] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:41.914909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab4cd-27a1-4422-9314-4e124878be5d service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:41.931583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe74593-bd85-4512-b203-9f5718ad7216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:41.932254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74593-bd85-4512-b203-9f5718ad7216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:41.932539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74593-bd85-4512-b203-9f5718ad7216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:41.932815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74593-bd85-4512-b203-9f5718ad7216 admin admin] PATH_INFO: `/v3/users/039f66a7c47b47e39672b8a49683f6ab` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:41.934116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe74593-bd85-4512-b203-9f5718ad7216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=039f66a7c47b47e39672b8a49683f6ab)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:41.938587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe74593-bd85-4512-b203-9f5718ad7216 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:42.128017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dfe74593-bd85-4512-b203-9f5718ad7216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039f66a7c47b47e39672b8a49683f6ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:42.195333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dfe74593-bd85-4512-b203-9f5718ad7216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039f66a7c47b47e39672b8a49683f6ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:42.203573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dfe74593-bd85-4512-b203-9f5718ad7216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039f66a7c47b47e39672b8a49683f6ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:42.235492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dfe74593-bd85-4512-b203-9f5718ad7216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039f66a7c47b47e39672b8a49683f6ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:42.255974 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:42.267614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dfe74593-bd85-4512-b203-9f5718ad7216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039f66a7c47b47e39672b8a49683f6ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:42.285967 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2082/4190] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:18:41 2022] DELETE /identity/v3/users/039f66a7c47b47e39672b8a49683f6ab => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:18:43.505200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718b69-b00d-4eef-8f6f-8ef8166a8ee0 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:43.531723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718b69-b00d-4eef-8f6f-8ef8166a8ee0 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:43.642425 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:43.738332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:43.739429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:43.739952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:43.740452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] PATH_INFO: `/v3/projects/b55ff3938f914b23a0a911b78d9da173` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:43.742084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55ff3938f914b23a0a911b78d9da173)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:43.745764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:43.882257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55ff3938f914b23a0a911b78d9da173', 'request_id': 'req-0fa58182-6ab0-43fc-bd7b-3995931a3efd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:43.893384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55ff3938f914b23a0a911b78d9da173', 'request_id': 'req-0fa58182-6ab0-43fc-bd7b-3995931a3efd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:43.904208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55ff3938f914b23a0a911b78d9da173', 'request_id': 'req-0fa58182-6ab0-43fc-bd7b-3995931a3efd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:43.931913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] The token cache is being invalidate because project b55ff3938f914b23a0a911b78d9da173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:43.932332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:43.933713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0fa58182-6ab0-43fc-bd7b-3995931a3efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:43.943633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5790b-be63-4021-b6ae-03e0f6557930 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:43.944246 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2109/4191] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:43 2022] DELETE /identity/v3/projects/b55ff3938f914b23a0a911b78d9da173 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:43.944816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5790b-be63-4021-b6ae-03e0f6557930 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:43.945060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5790b-be63-4021-b6ae-03e0f6557930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:44.003237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c4b5790b-be63-4021-b6ae-03e0f6557930 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:44.007737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c4b5790b-be63-4021-b6ae-03e0f6557930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:44.147707 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2083/4192] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:18:44.160385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d7ec1-4de8-4fe5-b87c-121a1942db5d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:44.160681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d7ec1-4de8-4fe5-b87c-121a1942db5d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:44.160963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d7ec1-4de8-4fe5-b87c-121a1942db5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:44.233917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c61d7ec1-4de8-4fe5-b87c-121a1942db5d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:44.251973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c61d7ec1-4de8-4fe5-b87c-121a1942db5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:44.276171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5790b-be63-4021-b6ae-03e0f6557930 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:44.276418 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2110/4193] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:44.291145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5790b-be63-4021-b6ae-03e0f6557930 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:44.309822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5bb6-5e0f-4dfa-a8eb-a4c6b45ac345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:44.311390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5bb6-5e0f-4dfa-a8eb-a4c6b45ac345 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:44.311952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5bb6-5e0f-4dfa-a8eb-a4c6b45ac345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:44.312446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5bb6-5e0f-4dfa-a8eb-a4c6b45ac345 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:44.313458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5bb6-5e0f-4dfa-a8eb-a4c6b45ac345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:44.313980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5bb6-5e0f-4dfa-a8eb-a4c6b45ac345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:44.315842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5bb6-5e0f-4dfa-a8eb-a4c6b45ac345 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:44.355569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d7ec1-4de8-4fe5-b87c-121a1942db5d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:44.368415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d7ec1-4de8-4fe5-b87c-121a1942db5d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:44.369078 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2084/4194] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:44.395578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b12f26-a7c9-45f6-aa2c-e46aa169c181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:44.396210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b12f26-a7c9-45f6-aa2c-e46aa169c181 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:44.396677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b12f26-a7c9-45f6-aa2c-e46aa169c181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:44.396961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b12f26-a7c9-45f6-aa2c-e46aa169c181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:44.398193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b12f26-a7c9-45f6-aa2c-e46aa169c181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:44.400728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b12f26-a7c9-45f6-aa2c-e46aa169c181 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:44.472401 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2111/4195] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:44 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:44.474121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5bb6-5e0f-4dfa-a8eb-a4c6b45ac345 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:44.498882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5bb6-5e0f-4dfa-a8eb-a4c6b45ac345 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:44.629115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b57f0-a4c2-46bf-81c3-ef2147043d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:44.629746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b57f0-a4c2-46bf-81c3-ef2147043d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:44.630250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b57f0-a4c2-46bf-81c3-ef2147043d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:44.630531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b57f0-a4c2-46bf-81c3-ef2147043d74 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:44.631211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b57f0-a4c2-46bf-81c3-ef2147043d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:44.633223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b57f0-a4c2-46bf-81c3-ef2147043d74 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:44.671653 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2085/4196] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:18:44 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:44.676100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b12f26-a7c9-45f6-aa2c-e46aa169c181 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:44.690435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b12f26-a7c9-45f6-aa2c-e46aa169c181 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:44.697665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34a36b-3787-4cc1-8004-a783a303ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:44.698422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a36b-3787-4cc1-8004-a783a303ce3b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:44.698850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a36b-3787-4cc1-8004-a783a303ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:44.699217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a36b-3787-4cc1-8004-a783a303ce3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:44.700481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34a36b-3787-4cc1-8004-a783a303ce3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:44.703375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34a36b-3787-4cc1-8004-a783a303ce3b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:44.722225 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2112/4197] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:44.723033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b57f0-a4c2-46bf-81c3-ef2147043d74 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:44.735871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b57f0-a4c2-46bf-81c3-ef2147043d74 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:44.741552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb2758-5335-414f-aef4-23e01b956979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:44.742798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb2758-5335-414f-aef4-23e01b956979 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:44.743304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb2758-5335-414f-aef4-23e01b956979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:44.743823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb2758-5335-414f-aef4-23e01b956979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:44.744733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb2758-5335-414f-aef4-23e01b956979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:44.746639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb2758-5335-414f-aef4-23e01b956979 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:44.769213 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2086/4198] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:44.772928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34a36b-3787-4cc1-8004-a783a303ce3b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:44.787628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34a36b-3787-4cc1-8004-a783a303ce3b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:44.803795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0976bfe-9bc6-4c3e-ad6a-9d9cc4bd20b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:44.804630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976bfe-9bc6-4c3e-ad6a-9d9cc4bd20b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:44.804918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976bfe-9bc6-4c3e-ad6a-9d9cc4bd20b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:44.805194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976bfe-9bc6-4c3e-ad6a-9d9cc4bd20b8 admin admin] PATH_INFO: `/v3/projects/77d8d4b0db154ba6acce7c0639e44530/users/16e7a0f9d35f40dc855b14b9977b6e73/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:44.838768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0976bfe-9bc6-4c3e-ad6a-9d9cc4bd20b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d8d4b0db154ba6acce7c0639e44530, user_id=16e7a0f9d35f40dc855b14b9977b6e73, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:44.841951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0976bfe-9bc6-4c3e-ad6a-9d9cc4bd20b8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:44.871074 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2113/4199] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:44 2022] PUT /identity/v3/projects/77d8d4b0db154ba6acce7c0639e44530/users/16e7a0f9d35f40dc855b14b9977b6e73/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:44.878433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171922a-7fff-4bfc-8348-4ce1ff810cb5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:44.878768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171922a-7fff-4bfc-8348-4ce1ff810cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:44.879049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171922a-7fff-4bfc-8348-4ce1ff810cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:44.930027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3171922a-7fff-4bfc-8348-4ce1ff810cb5 None None] MFA Rules not processed for user `16e7a0f9d35f40dc855b14b9977b6e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:44.931526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3171922a-7fff-4bfc-8348-4ce1ff810cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:45.006435 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:45.042703 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2087/4200] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:45.054097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7ef94-6ac7-4416-9902-5951073617c0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:45.054477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7ef94-6ac7-4416-9902-5951073617c0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:45.054853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7ef94-6ac7-4416-9902-5951073617c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:45.105725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a2b7ef94-6ac7-4416-9902-5951073617c0 None None] MFA Rules not processed for user `16e7a0f9d35f40dc855b14b9977b6e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:45.107689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a2b7ef94-6ac7-4416-9902-5951073617c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:45.122676 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2114/4201] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:45.177799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171922a-7fff-4bfc-8348-4ce1ff810cb5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:45.179383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3171922a-7fff-4bfc-8348-4ce1ff810cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:45.301176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171922a-7fff-4bfc-8348-4ce1ff810cb5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:45.345561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ecf17-dbaa-41f3-9a29-174295d963e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:45.346475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ecf17-dbaa-41f3-9a29-174295d963e0 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:45.347053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ecf17-dbaa-41f3-9a29-174295d963e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:45.347542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ecf17-dbaa-41f3-9a29-174295d963e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:45.367073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ecf17-dbaa-41f3-9a29-174295d963e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:45.369650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ecf17-dbaa-41f3-9a29-174295d963e0 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:45.394101 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2088/4202] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:48.875888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7ef94-6ac7-4416-9902-5951073617c0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:48.876697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a2b7ef94-6ac7-4416-9902-5951073617c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:48.944931 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:49.039194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7ef94-6ac7-4416-9902-5951073617c0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:49.049091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801169c-0eaa-44e5-b9fa-4cdc624d593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:49.050054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801169c-0eaa-44e5-b9fa-4cdc624d593e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:49.050487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801169c-0eaa-44e5-b9fa-4cdc624d593e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:49.050950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801169c-0eaa-44e5-b9fa-4cdc624d593e admin admin] PATH_INFO: `/v3/users/63e0eaf9b9e34b8d80e9ddadd09989fa` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:49.053944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801169c-0eaa-44e5-b9fa-4cdc624d593e admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e0eaf9b9e34b8d80e9ddadd09989fa)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:49.056822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801169c-0eaa-44e5-b9fa-4cdc624d593e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:49.129534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7801169c-0eaa-44e5-b9fa-4cdc624d593e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e0eaf9b9e34b8d80e9ddadd09989fa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:49.154924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7801169c-0eaa-44e5-b9fa-4cdc624d593e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e0eaf9b9e34b8d80e9ddadd09989fa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:49.155813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7801169c-0eaa-44e5-b9fa-4cdc624d593e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e0eaf9b9e34b8d80e9ddadd09989fa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:49.171513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7801169c-0eaa-44e5-b9fa-4cdc624d593e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e0eaf9b9e34b8d80e9ddadd09989fa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:49.173230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7801169c-0eaa-44e5-b9fa-4cdc624d593e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e0eaf9b9e34b8d80e9ddadd09989fa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:49.199467 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2115/4203] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:18:48 2022] DELETE /identity/v3/users/63e0eaf9b9e34b8d80e9ddadd09989fa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:49.436180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ecf17-dbaa-41f3-9a29-174295d963e0 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:49.449605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ecf17-dbaa-41f3-9a29-174295d963e0 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:49.572422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:49.573132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:49.573676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:49.574137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] PATH_INFO: `/v3/projects/94224832aed24d2f83c72250cbfb4a4f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:49.576178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94224832aed24d2f83c72250cbfb4a4f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:49.579571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:49.650748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94224832aed24d2f83c72250cbfb4a4f', 'request_id': 'req-7b8b1383-20e5-40dc-9a17-79e646cf1b27'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:49.661846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94224832aed24d2f83c72250cbfb4a4f', 'request_id': 'req-7b8b1383-20e5-40dc-9a17-79e646cf1b27'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:49.671602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94224832aed24d2f83c72250cbfb4a4f', 'request_id': 'req-7b8b1383-20e5-40dc-9a17-79e646cf1b27'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:49.687485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] The token cache is being invalidate because project 94224832aed24d2f83c72250cbfb4a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:49.688060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:49.688935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b8b1383-20e5-40dc-9a17-79e646cf1b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:49.690666 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2089/4204] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:49 2022] DELETE /identity/v3/projects/94224832aed24d2f83c72250cbfb4a4f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:49.695977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b635bbb-981e-493a-a0ff-6def7ae08514 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:49.696520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b635bbb-981e-493a-a0ff-6def7ae08514 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:49.696895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b635bbb-981e-493a-a0ff-6def7ae08514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:49.773601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0b635bbb-981e-493a-a0ff-6def7ae08514 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:49.775126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0b635bbb-981e-493a-a0ff-6def7ae08514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:49.854666 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2116/4205] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:49.858373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f824-536a-43f6-bd2f-b87ffb56b21e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:49.859616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f824-536a-43f6-bd2f-b87ffb56b21e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:49.859976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f824-536a-43f6-bd2f-b87ffb56b21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:49.880359 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:49.891616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8220f824-536a-43f6-bd2f-b87ffb56b21e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:49.893794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8220f824-536a-43f6-bd2f-b87ffb56b21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:49.908376 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2090/4206] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:49.921016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b635bbb-981e-493a-a0ff-6def7ae08514 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:49.933837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b635bbb-981e-493a-a0ff-6def7ae08514 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:49.940176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092313f0-f3d0-428d-8664-a5b3d4ea333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:49.941256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092313f0-f3d0-428d-8664-a5b3d4ea333d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:49.941739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092313f0-f3d0-428d-8664-a5b3d4ea333d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:49.942302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092313f0-f3d0-428d-8664-a5b3d4ea333d admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:49.943187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092313f0-f3d0-428d-8664-a5b3d4ea333d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:49.943512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092313f0-f3d0-428d-8664-a5b3d4ea333d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:49.945453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092313f0-f3d0-428d-8664-a5b3d4ea333d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:49.962902 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:49.969646 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2117/4207] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:49.969820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220f824-536a-43f6-bd2f-b87ffb56b21e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:49.980569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220f824-536a-43f6-bd2f-b87ffb56b21e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:49.986298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ca43e-47d9-4c79-9878-2a4af5eb1e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:49.986985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ca43e-47d9-4c79-9878-2a4af5eb1e1b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:49.987249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ca43e-47d9-4c79-9878-2a4af5eb1e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:49.987520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ca43e-47d9-4c79-9878-2a4af5eb1e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:49.988165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ca43e-47d9-4c79-9878-2a4af5eb1e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:49.990106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ca43e-47d9-4c79-9878-2a4af5eb1e1b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:50.054843 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2091/4208] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:49 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:18:50.060239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092313f0-f3d0-428d-8664-a5b3d4ea333d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:50.076581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092313f0-f3d0-428d-8664-a5b3d4ea333d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:50.212324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22eb285-7120-46c3-88af-9a7e2e0a54da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:50.224423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eb285-7120-46c3-88af-9a7e2e0a54da admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:50.224973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eb285-7120-46c3-88af-9a7e2e0a54da admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:50.225444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eb285-7120-46c3-88af-9a7e2e0a54da admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:50.226293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22eb285-7120-46c3-88af-9a7e2e0a54da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:50.231641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22eb285-7120-46c3-88af-9a7e2e0a54da admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:50.270033 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2118/4209] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:18:50 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:50.271319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ca43e-47d9-4c79-9878-2a4af5eb1e1b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:50.284299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ca43e-47d9-4c79-9878-2a4af5eb1e1b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:50.294460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581189f8-71c6-4ad6-bec7-3423f27719f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:50.296997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581189f8-71c6-4ad6-bec7-3423f27719f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:50.297509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581189f8-71c6-4ad6-bec7-3423f27719f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:50.297977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581189f8-71c6-4ad6-bec7-3423f27719f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:50.299109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581189f8-71c6-4ad6-bec7-3423f27719f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:50.301208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581189f8-71c6-4ad6-bec7-3423f27719f8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:50.320193 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2092/4210] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:50.323516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22eb285-7120-46c3-88af-9a7e2e0a54da admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:50.341920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22eb285-7120-46c3-88af-9a7e2e0a54da admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:50.351547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93f818-3f43-4a0b-96f5-f5ae9dc68456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:50.352981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93f818-3f43-4a0b-96f5-f5ae9dc68456 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:50.353765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93f818-3f43-4a0b-96f5-f5ae9dc68456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:50.354178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93f818-3f43-4a0b-96f5-f5ae9dc68456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:50.355366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93f818-3f43-4a0b-96f5-f5ae9dc68456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:50.359047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93f818-3f43-4a0b-96f5-f5ae9dc68456 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:50.386682 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2119/4211] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:18:50.390373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581189f8-71c6-4ad6-bec7-3423f27719f8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:50.404913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581189f8-71c6-4ad6-bec7-3423f27719f8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:50.413015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3d5fc-53ae-44ee-812b-ea13e4c69fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:50.414275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d5fc-53ae-44ee-812b-ea13e4c69fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:50.415238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d5fc-53ae-44ee-812b-ea13e4c69fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:50.415711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d5fc-53ae-44ee-812b-ea13e4c69fa1 admin admin] PATH_INFO: `/v3/projects/030545ae9fe8466887a79a55199dbe1e/users/c503b01d3a53481c9ded936a0a3f6c9f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:50.442220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3d5fc-53ae-44ee-812b-ea13e4c69fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=030545ae9fe8466887a79a55199dbe1e, user_id=c503b01d3a53481c9ded936a0a3f6c9f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:50.446440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3d5fc-53ae-44ee-812b-ea13e4c69fa1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:50.472710 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2093/4212] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:18:50 2022] PUT /identity/v3/projects/030545ae9fe8466887a79a55199dbe1e/users/c503b01d3a53481c9ded936a0a3f6c9f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:18:50.477442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f389-8ab2-47e4-a6e9-ddfc24d98949 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:50.477943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f389-8ab2-47e4-a6e9-ddfc24d98949 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:50.478394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f389-8ab2-47e4-a6e9-ddfc24d98949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:50.506658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b348f389-8ab2-47e4-a6e9-ddfc24d98949 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:50.508164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b348f389-8ab2-47e4-a6e9-ddfc24d98949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:50.609993 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2120/4213] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:50.645890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3d5fc-53ae-44ee-812b-ea13e4c69fa1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:50.648139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c3f3d5fc-53ae-44ee-812b-ea13e4c69fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:50.719369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3d5fc-53ae-44ee-812b-ea13e4c69fa1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:50.724463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900986-ae95-477f-a469-d5cc91b53b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:50.725383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900986-ae95-477f-a469-d5cc91b53b2e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:50.725925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900986-ae95-477f-a469-d5cc91b53b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:50.726475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900986-ae95-477f-a469-d5cc91b53b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:50.740918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d900986-ae95-477f-a469-d5cc91b53b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:50.743261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d900986-ae95-477f-a469-d5cc91b53b2e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:50.758996 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2094/4214] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:18:53.838345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348f389-8ab2-47e4-a6e9-ddfc24d98949 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:53.841049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b348f389-8ab2-47e4-a6e9-ddfc24d98949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:53.956105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348f389-8ab2-47e4-a6e9-ddfc24d98949 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:53.971646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047149c-d529-4b69-99d1-7d95134c226b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:53.972614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047149c-d529-4b69-99d1-7d95134c226b service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:53.974156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047149c-d529-4b69-99d1-7d95134c226b service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:53.974820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047149c-d529-4b69-99d1-7d95134c226b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:53.977470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6047149c-d529-4b69-99d1-7d95134c226b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:53.998290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047149c-d529-4b69-99d1-7d95134c226b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:54.000739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047149c-d529-4b69-99d1-7d95134c226b service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:54.020263 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2121/4215] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:18:54.895263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900986-ae95-477f-a469-d5cc91b53b2e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:54.896310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1d900986-ae95-477f-a469-d5cc91b53b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:55.118403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900986-ae95-477f-a469-d5cc91b53b2e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:55.129745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592cede-e436-46dd-aaaa-e34f2a77d37f tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b7c905bc0b431bb277ae441cb1f5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1995e813228a471f9a704a013182222f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:55.130376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592cede-e436-46dd-aaaa-e34f2a77d37f tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:55.130690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592cede-e436-46dd-aaaa-e34f2a77d37f tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:55.131384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592cede-e436-46dd-aaaa-e34f2a77d37f tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:55.132058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592cede-e436-46dd-aaaa-e34f2a77d37f tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:55.132375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592cede-e436-46dd-aaaa-e34f2a77d37f tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:55.135314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592cede-e436-46dd-aaaa-e34f2a77d37f tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:55.162342 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2095/4216] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:55.165449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047149c-d529-4b69-99d1-7d95134c226b service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:55.180974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047149c-d529-4b69-99d1-7d95134c226b service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:55.191277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764089e-e9a5-499a-a077-1c1d82b8faab tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b7c905bc0b431bb277ae441cb1f5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1995e813228a471f9a704a013182222f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:55.192133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764089e-e9a5-499a-a077-1c1d82b8faab tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:55.192553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764089e-e9a5-499a-a077-1c1d82b8faab tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:55.192971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764089e-e9a5-499a-a077-1c1d82b8faab tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:55.193755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764089e-e9a5-499a-a077-1c1d82b8faab tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:55.195829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764089e-e9a5-499a-a077-1c1d82b8faab tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:55.215371 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:55.291059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592cede-e436-46dd-aaaa-e34f2a77d37f tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:55.291228 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2122/4217] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:18:55 2022] POST /identity/v3/projects => generated 348 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:18:55.303905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592cede-e436-46dd-aaaa-e34f2a77d37f tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:55.394265 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:18:55.473208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4e08-ca42-49ca-a048-ee0c75832ede tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b7c905bc0b431bb277ae441cb1f5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1995e813228a471f9a704a013182222f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:55.474439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4e08-ca42-49ca-a048-ee0c75832ede tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:55.474851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4e08-ca42-49ca-a048-ee0c75832ede tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:55.475234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4e08-ca42-49ca-a048-ee0c75832ede tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:55.475997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e4e08-ca42-49ca-a048-ee0c75832ede tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:18:55.476405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e4e08-ca42-49ca-a048-ee0c75832ede tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:55.478147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e4e08-ca42-49ca-a048-ee0c75832ede tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:55.514760 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2096/4218] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:18:56.256544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2eae2-c398-4e8c-a66d-b7ef4865874b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:56.257014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2eae2-c398-4e8c-a66d-b7ef4865874b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:56.257126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2eae2-c398-4e8c-a66d-b7ef4865874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:56.302916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c2c2eae2-c398-4e8c-a66d-b7ef4865874b None None] MFA Rules not processed for user `db9450c53d8944b88cfbbc541f585ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:18:56.304152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c2c2eae2-c398-4e8c-a66d-b7ef4865874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:56.470589 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2123/4219] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:18:56.565531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4e08-ca42-49ca-a048-ee0c75832ede tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:56.580225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4e08-ca42-49ca-a048-ee0c75832ede tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:56.585735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b7c905bc0b431bb277ae441cb1f5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1995e813228a471f9a704a013182222f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:56.586748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:56.587178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:56.587592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] PATH_INFO: `/v3/projects/2d9a074169b84021af87ffba6d6f979b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:56.589569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2d9a074169b84021af87ffba6d6f979b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:56.591707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:56.665551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9a074169b84021af87ffba6d6f979b', 'request_id': 'req-cf4ca678-7d41-40cc-a118-df095f8e98a5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:56.673514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9a074169b84021af87ffba6d6f979b', 'request_id': 'req-cf4ca678-7d41-40cc-a118-df095f8e98a5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:56.681259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9a074169b84021af87ffba6d6f979b', 'request_id': 'req-cf4ca678-7d41-40cc-a118-df095f8e98a5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:56.702337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] The token cache is being invalidate because project 2d9a074169b84021af87ffba6d6f979b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:18:56.703490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:56.704486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cf4ca678-7d41-40cc-a118-df095f8e98a5 tempest-RoutersAdminTest-1535758085 tempest-RoutersAdminTest-1535758085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:18:56.708430 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2097/4220] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:18:56 2022] DELETE /identity/v3/projects/2d9a074169b84021af87ffba6d6f979b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:18:56.733660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2eae2-c398-4e8c-a66d-b7ef4865874b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:18:56.735357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c2c2eae2-c398-4e8c-a66d-b7ef4865874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:56.874423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2eae2-c398-4e8c-a66d-b7ef4865874b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:18:56.944708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322a35b-187e-4cb8-9c88-5e85ab944131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:18:56.945429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322a35b-187e-4cb8-9c88-5e85ab944131 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:18:56.946102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322a35b-187e-4cb8-9c88-5e85ab944131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:18:56.946842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322a35b-187e-4cb8-9c88-5e85ab944131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:18:56.949656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8322a35b-187e-4cb8-9c88-5e85ab944131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:18:57.073538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322a35b-187e-4cb8-9c88-5e85ab944131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:18:57.075315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322a35b-187e-4cb8-9c88-5e85ab944131 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:18:57.090403 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2124/4221] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:18:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:03.784362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2316e-fc28-4589-8408-6fd1ecbf3ca7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:03.784757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2316e-fc28-4589-8408-6fd1ecbf3ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:03.785108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2316e-fc28-4589-8408-6fd1ecbf3ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:04.071469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-eaf2316e-fc28-4589-8408-6fd1ecbf3ca7 None None] MFA Rules not processed for user `c503b01d3a53481c9ded936a0a3f6c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:04.073644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eaf2316e-fc28-4589-8408-6fd1ecbf3ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:04.210072 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2098/4222] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:04.472637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322a35b-187e-4cb8-9c88-5e85ab944131 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:04.474232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8322a35b-187e-4cb8-9c88-5e85ab944131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:04.478846 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:04.642632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322a35b-187e-4cb8-9c88-5e85ab944131 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:04.650479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a09f7-f772-43b8-b4cd-92906fc67447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:04.651145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a09f7-f772-43b8-b4cd-92906fc67447 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:04.651537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a09f7-f772-43b8-b4cd-92906fc67447 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:04.651872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a09f7-f772-43b8-b4cd-92906fc67447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:04.666090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a09f7-f772-43b8-b4cd-92906fc67447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:04.668202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a09f7-f772-43b8-b4cd-92906fc67447 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:04.680358 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2125/4223] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:07.293364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7fb8-ee69-485e-b150-8fddda558fba None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:07.293823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7fb8-ee69-485e-b150-8fddda558fba None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:07.293915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7fb8-ee69-485e-b150-8fddda558fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:07.332188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0b2f7fb8-ee69-485e-b150-8fddda558fba None None] MFA Rules not processed for user `c503b01d3a53481c9ded936a0a3f6c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:07.333881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b2f7fb8-ee69-485e-b150-8fddda558fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:07.348042 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2099/4224] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:08.989906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a09f7-f772-43b8-b4cd-92906fc67447 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:08.991534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e99a09f7-f772-43b8-b4cd-92906fc67447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:09.033188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a09f7-f772-43b8-b4cd-92906fc67447 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:09.040500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f8d93-5580-487a-97c7-8d10f27ea57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:09.041131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f8d93-5580-487a-97c7-8d10f27ea57c service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:09.041413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f8d93-5580-487a-97c7-8d10f27ea57c service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:09.041685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f8d93-5580-487a-97c7-8d10f27ea57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:09.044433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2e1f8d93-5580-487a-97c7-8d10f27ea57c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:09.061318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f8d93-5580-487a-97c7-8d10f27ea57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:09.062905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f8d93-5580-487a-97c7-8d10f27ea57c service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:09.073942 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2126/4225] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:17.318890 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:19.083115 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=52 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:20.931033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f7fb8-ee69-485e-b150-8fddda558fba None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:20.933414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b2f7fb8-ee69-485e-b150-8fddda558fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:21.038958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f7fb8-ee69-485e-b150-8fddda558fba None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:21.043612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733f9bf-7585-4699-8b2d-aebac3f3be24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:21.044248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733f9bf-7585-4699-8b2d-aebac3f3be24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:21.044523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733f9bf-7585-4699-8b2d-aebac3f3be24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:21.044791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733f9bf-7585-4699-8b2d-aebac3f3be24 admin admin] PATH_INFO: `/v3/users/98dee3ab3afb4e68a3e720db8e70f045` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:21.045909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733f9bf-7585-4699-8b2d-aebac3f3be24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98dee3ab3afb4e68a3e720db8e70f045)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:21.048014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733f9bf-7585-4699-8b2d-aebac3f3be24 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:21.148020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f733f9bf-7585-4699-8b2d-aebac3f3be24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98dee3ab3afb4e68a3e720db8e70f045'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:21.165923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f733f9bf-7585-4699-8b2d-aebac3f3be24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98dee3ab3afb4e68a3e720db8e70f045'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:21.168489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f733f9bf-7585-4699-8b2d-aebac3f3be24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98dee3ab3afb4e68a3e720db8e70f045'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:21.180772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f733f9bf-7585-4699-8b2d-aebac3f3be24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98dee3ab3afb4e68a3e720db8e70f045'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:21.208340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f733f9bf-7585-4699-8b2d-aebac3f3be24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98dee3ab3afb4e68a3e720db8e70f045'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:21.216926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2100/4226] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:19:20 2022] DELETE /identity/v3/users/98dee3ab3afb4e68a3e720db8e70f045 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:19:21.633248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f8d93-5580-487a-97c7-8d10f27ea57c service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:21.650794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f8d93-5580-487a-97c7-8d10f27ea57c service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:21.735290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:21.736023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:21.736303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:21.736781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] PATH_INFO: `/v3/projects/13ce5884d5b34274951f43381af6fa31` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:21.738105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ce5884d5b34274951f43381af6fa31)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:21.741079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:21.759949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae215-1b49-42fb-8086-3377c824a21b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:21.760234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae215-1b49-42fb-8086-3377c824a21b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:21.760511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae215-1b49-42fb-8086-3377c824a21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:21.800382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1a6ae215-1b49-42fb-8086-3377c824a21b None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:21.801832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1a6ae215-1b49-42fb-8086-3377c824a21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:21.811328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ce5884d5b34274951f43381af6fa31', 'request_id': 'req-2b98e180-9606-4a53-bc60-cf74b01e3a73'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:21.819329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ce5884d5b34274951f43381af6fa31', 'request_id': 'req-2b98e180-9606-4a53-bc60-cf74b01e3a73'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:21.828399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ce5884d5b34274951f43381af6fa31', 'request_id': 'req-2b98e180-9606-4a53-bc60-cf74b01e3a73'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:21.846972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] The token cache is being invalidate because project 13ce5884d5b34274951f43381af6fa31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:19:21.847355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:21.848093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b98e180-9606-4a53-bc60-cf74b01e3a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:21.856807 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2127/4227] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:19:21 2022] DELETE /identity/v3/projects/13ce5884d5b34274951f43381af6fa31 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:21.860827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286098f-bce0-4244-9f30-4518e80eae11 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:21.862755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286098f-bce0-4244-9f30-4518e80eae11 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:21.863420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286098f-bce0-4244-9f30-4518e80eae11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:21.893520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1286098f-bce0-4244-9f30-4518e80eae11 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:21.898651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1286098f-bce0-4244-9f30-4518e80eae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:21.902028 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2101/4228] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:19:21.940127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ae215-1b49-42fb-8086-3377c824a21b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:21.942280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1a6ae215-1b49-42fb-8086-3377c824a21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:21.966241 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:21.992121 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2128/4229] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:21.999659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624475f-7d54-4a62-88e3-05e1b1f6ccf4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:21.999933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624475f-7d54-4a62-88e3-05e1b1f6ccf4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.000148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624475f-7d54-4a62-88e3-05e1b1f6ccf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.021937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1624475f-7d54-4a62-88e3-05e1b1f6ccf4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:22.023924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1624475f-7d54-4a62-88e3-05e1b1f6ccf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:22.028310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ae215-1b49-42fb-8086-3377c824a21b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:22.033751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9629-0760-4e0b-ba51-129f3092fda4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:22.034388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9629-0760-4e0b-ba51-129f3092fda4 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:22.034697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9629-0760-4e0b-ba51-129f3092fda4 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.034964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9629-0760-4e0b-ba51-129f3092fda4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.035097 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2129/4230] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:19:22.036432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624475f-7d54-4a62-88e3-05e1b1f6ccf4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:22.046222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b9629-0760-4e0b-ba51-129f3092fda4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:22.047466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624475f-7d54-4a62-88e3-05e1b1f6ccf4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:22.049356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b9629-0760-4e0b-ba51-129f3092fda4 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:22.052085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec8487-f747-4280-a7ed-c890f567c8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:22.053019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec8487-f747-4280-a7ed-c890f567c8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:22.053019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec8487-f747-4280-a7ed-c890f567c8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.053355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec8487-f747-4280-a7ed-c890f567c8e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.054070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec8487-f747-4280-a7ed-c890f567c8e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:19:22.054375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec8487-f747-4280-a7ed-c890f567c8e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:22.056190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec8487-f747-4280-a7ed-c890f567c8e9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:22.061632 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2102/4231] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:19:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:22.070680 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2130/4232] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:19:22.075102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9629-0760-4e0b-ba51-129f3092fda4 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:22.088679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9629-0760-4e0b-ba51-129f3092fda4 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:22.095738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36c9fc-42eb-4162-9da7-57b60963f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:22.096542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36c9fc-42eb-4162-9da7-57b60963f27d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:22.097028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36c9fc-42eb-4162-9da7-57b60963f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.097439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36c9fc-42eb-4162-9da7-57b60963f27d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.098065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36c9fc-42eb-4162-9da7-57b60963f27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:22.102538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36c9fc-42eb-4162-9da7-57b60963f27d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:22.143993 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2103/4233] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:19:22 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:19:22.148721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec8487-f747-4280-a7ed-c890f567c8e9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:22.159632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec8487-f747-4280-a7ed-c890f567c8e9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:22.169033 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:22.251403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691ef9a-ba95-4c43-9a99-a788d8a15f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:22.252054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691ef9a-ba95-4c43-9a99-a788d8a15f30 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:22.252364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691ef9a-ba95-4c43-9a99-a788d8a15f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.253187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691ef9a-ba95-4c43-9a99-a788d8a15f30 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.253983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691ef9a-ba95-4c43-9a99-a788d8a15f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:22.256983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691ef9a-ba95-4c43-9a99-a788d8a15f30 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:22.290188 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2131/4234] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:19:22 2022] POST /identity/v3/users => generated 282 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:19:22.291548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36c9fc-42eb-4162-9da7-57b60963f27d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:22.302629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36c9fc-42eb-4162-9da7-57b60963f27d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:22.308122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4b0e8-30a2-4a8a-9c17-367d668c6ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:22.308737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4b0e8-30a2-4a8a-9c17-367d668c6ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:22.309043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4b0e8-30a2-4a8a-9c17-367d668c6ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.309324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4b0e8-30a2-4a8a-9c17-367d668c6ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.309971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4b0e8-30a2-4a8a-9c17-367d668c6ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:22.311648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4b0e8-30a2-4a8a-9c17-367d668c6ff1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:22.329856 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2104/4235] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:19:22.334134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691ef9a-ba95-4c43-9a99-a788d8a15f30 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:22.345953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691ef9a-ba95-4c43-9a99-a788d8a15f30 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:22.354459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1552e8e-a6e4-47c7-9da8-464334ef8003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:22.355519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1552e8e-a6e4-47c7-9da8-464334ef8003 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:22.355519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1552e8e-a6e4-47c7-9da8-464334ef8003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.355691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1552e8e-a6e4-47c7-9da8-464334ef8003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.356414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1552e8e-a6e4-47c7-9da8-464334ef8003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:22.358397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1552e8e-a6e4-47c7-9da8-464334ef8003 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:22.371187 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2132/4236] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:19:22.375295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4b0e8-30a2-4a8a-9c17-367d668c6ff1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:22.391779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4b0e8-30a2-4a8a-9c17-367d668c6ff1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:22.397552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f54f6-e17f-4b96-a5af-5d409d8ad44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:22.398310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f54f6-e17f-4b96-a5af-5d409d8ad44f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:22.398589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f54f6-e17f-4b96-a5af-5d409d8ad44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.398889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f54f6-e17f-4b96-a5af-5d409d8ad44f admin admin] PATH_INFO: `/v3/projects/1df47be5d8964fd9aca46b06b9abec43/users/395b575106154bb3a3590e5c299bcc4e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.417839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f54f6-e17f-4b96-a5af-5d409d8ad44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df47be5d8964fd9aca46b06b9abec43, user_id=395b575106154bb3a3590e5c299bcc4e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:22.421050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f54f6-e17f-4b96-a5af-5d409d8ad44f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:22.449790 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2105/4237] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:19:22 2022] PUT /identity/v3/projects/1df47be5d8964fd9aca46b06b9abec43/users/395b575106154bb3a3590e5c299bcc4e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:22.450837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2539818-2f19-46f8-a3d7-d87f9cca2ea5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:22.451125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2539818-2f19-46f8-a3d7-d87f9cca2ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.451395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2539818-2f19-46f8-a3d7-d87f9cca2ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.488762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b2539818-2f19-46f8-a3d7-d87f9cca2ea5 None None] MFA Rules not processed for user `395b575106154bb3a3590e5c299bcc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:22.489674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b2539818-2f19-46f8-a3d7-d87f9cca2ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:22.607154 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2133/4238] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:19:22.799231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f54f6-e17f-4b96-a5af-5d409d8ad44f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:22.800926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a0f54f6-e17f-4b96-a5af-5d409d8ad44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:22.904412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f54f6-e17f-4b96-a5af-5d409d8ad44f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:22.910555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6beb0-15e9-41b3-a6c8-5c07ab9a6f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:22.910940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6beb0-15e9-41b3-a6c8-5c07ab9a6f46 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:22.911294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6beb0-15e9-41b3-a6c8-5c07ab9a6f46 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.911634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6beb0-15e9-41b3-a6c8-5c07ab9a6f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.921377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6beb0-15e9-41b3-a6c8-5c07ab9a6f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:22.923193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6beb0-15e9-41b3-a6c8-5c07ab9a6f46 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:22.936140 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2106/4239] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:22.952028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a9b94-03bc-4524-95a0-dc9edec07c3e None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:22.952949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a9b94-03bc-4524-95a0-dc9edec07c3e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.952949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a9b94-03bc-4524-95a0-dc9edec07c3e None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.954503 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2134/4240] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:19:22.959539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6beb0-15e9-41b3-a6c8-5c07ab9a6f46 service nova] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:19:22.979837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6beb0-15e9-41b3-a6c8-5c07ab9a6f46 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:22.987800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6beb0-15e9-41b3-a6c8-5c07ab9a6f46 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:22.993008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024085b2-82a2-49a1-9b7e-729fa33919ce tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395b575106154bb3a3590e5c299bcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1df47be5d8964fd9aca46b06b9abec43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:22.993713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024085b2-82a2-49a1-9b7e-729fa33919ce tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:22.994057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024085b2-82a2-49a1-9b7e-729fa33919ce tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:22.994421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024085b2-82a2-49a1-9b7e-729fa33919ce tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] PATH_INFO: `/v3/projects/1df47be5d8964fd9aca46b06b9abec43` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:22.995671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024085b2-82a2-49a1-9b7e-729fa33919ce tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: Authorizing `identity:get_project(project_id=1df47be5d8964fd9aca46b06b9abec43)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:22.997559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024085b2-82a2-49a1-9b7e-729fa33919ce tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:22.999336 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2107/4241] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:19:22 2022] GET /identity/v3/projects/1df47be5d8964fd9aca46b06b9abec43 => generated 363 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:19:23.706366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8cc2b-7a9d-4216-9bda-62169018af86 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:23.706673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8cc2b-7a9d-4216-9bda-62169018af86 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:23.706958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8cc2b-7a9d-4216-9bda-62169018af86 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:23.708293 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2135/4242] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:19:23.721102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024085b2-82a2-49a1-9b7e-729fa33919ce tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:19:23.763477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024085b2-82a2-49a1-9b7e-729fa33919ce tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:23.783982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024085b2-82a2-49a1-9b7e-729fa33919ce tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:23.796406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834480dc-d20b-4b73-9eda-509ce2b44912 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395b575106154bb3a3590e5c299bcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1df47be5d8964fd9aca46b06b9abec43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:23.797352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834480dc-d20b-4b73-9eda-509ce2b44912 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:23.797828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834480dc-d20b-4b73-9eda-509ce2b44912 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:23.798285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834480dc-d20b-4b73-9eda-509ce2b44912 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] PATH_INFO: `/v3/projects/1df47be5d8964fd9aca46b06b9abec43` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:23.799761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834480dc-d20b-4b73-9eda-509ce2b44912 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: Authorizing `identity:get_project(project_id=1df47be5d8964fd9aca46b06b9abec43)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:23.801955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834480dc-d20b-4b73-9eda-509ce2b44912 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:23.821032 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2108/4243] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:19:23 2022] GET /identity/v3/projects/1df47be5d8964fd9aca46b06b9abec43 => generated 363 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:19:24.123014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1689-9995-4316-8304-08cf1483e93a None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:24.123503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1689-9995-4316-8304-08cf1483e93a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:24.123577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1689-9995-4316-8304-08cf1483e93a None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:24.124876 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2136/4244] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:19:24.129594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834480dc-d20b-4b73-9eda-509ce2b44912 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:19:24.146748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834480dc-d20b-4b73-9eda-509ce2b44912 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:24.155648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834480dc-d20b-4b73-9eda-509ce2b44912 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:24.159776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb0602-16a3-4bbd-9a85-353b8eebceb7 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395b575106154bb3a3590e5c299bcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1df47be5d8964fd9aca46b06b9abec43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:24.160430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb0602-16a3-4bbd-9a85-353b8eebceb7 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:24.160770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb0602-16a3-4bbd-9a85-353b8eebceb7 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:24.161056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb0602-16a3-4bbd-9a85-353b8eebceb7 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] PATH_INFO: `/v3/projects/1df47be5d8964fd9aca46b06b9abec43` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:24.162389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb0602-16a3-4bbd-9a85-353b8eebceb7 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: Authorizing `identity:get_project(project_id=1df47be5d8964fd9aca46b06b9abec43)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:24.164814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb0602-16a3-4bbd-9a85-353b8eebceb7 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:24.166459 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2109/4245] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:19:24 2022] GET /identity/v3/projects/1df47be5d8964fd9aca46b06b9abec43 => generated 363 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:19:24.306038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7ac8a-80d1-4ab1-a935-abf33ce55511 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:24.307101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7ac8a-80d1-4ab1-a935-abf33ce55511 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:24.307619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7ac8a-80d1-4ab1-a935-abf33ce55511 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:24.309334 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2137/4246] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:19:24.315562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb0602-16a3-4bbd-9a85-353b8eebceb7 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:19:24.331239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a6cb0602-16a3-4bbd-9a85-353b8eebceb7 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:24.355157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb0602-16a3-4bbd-9a85-353b8eebceb7 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:24.360331 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:24.367339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb0602-16a3-4bbd-9a85-353b8eebceb7 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:24.374883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7561388-f5ef-4839-b192-52a5c03192c5 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395b575106154bb3a3590e5c299bcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1df47be5d8964fd9aca46b06b9abec43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:24.376204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561388-f5ef-4839-b192-52a5c03192c5 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:24.376702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561388-f5ef-4839-b192-52a5c03192c5 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:24.377171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561388-f5ef-4839-b192-52a5c03192c5 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] PATH_INFO: `/v3/projects/1df47be5d8964fd9aca46b06b9abec43` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:24.378905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7561388-f5ef-4839-b192-52a5c03192c5 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: Authorizing `identity:get_project(project_id=1df47be5d8964fd9aca46b06b9abec43)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:24.383398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7561388-f5ef-4839-b192-52a5c03192c5 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:24.385832 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2110/4247] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:19:24 2022] GET /identity/v3/projects/1df47be5d8964fd9aca46b06b9abec43 => generated 363 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:19:25.016385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcd65f-0a02-48a6-bac9-ebf314726a29 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:25.016711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcd65f-0a02-48a6-bac9-ebf314726a29 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:25.016946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcd65f-0a02-48a6-bac9-ebf314726a29 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:25.018540 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2138/4248] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:19:25.044499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7561388-f5ef-4839-b192-52a5c03192c5 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:19:25.059465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7561388-f5ef-4839-b192-52a5c03192c5 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:25.069856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7561388-f5ef-4839-b192-52a5c03192c5 tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:25.074937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d99ac-7747-4c58-afa1-6730b955a1ec tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395b575106154bb3a3590e5c299bcc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1df47be5d8964fd9aca46b06b9abec43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:25.075969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d99ac-7747-4c58-afa1-6730b955a1ec tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:25.076458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d99ac-7747-4c58-afa1-6730b955a1ec tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:25.076942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d99ac-7747-4c58-afa1-6730b955a1ec tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] PATH_INFO: `/v3/projects/1df47be5d8964fd9aca46b06b9abec43` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:25.078574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d99ac-7747-4c58-afa1-6730b955a1ec tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: Authorizing `identity:get_project(project_id=1df47be5d8964fd9aca46b06b9abec43)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:25.081182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d99ac-7747-4c58-afa1-6730b955a1ec tempest-QuotasTestJSON-674634765 tempest-QuotasTestJSON-674634765-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:25.083109 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2111/4249] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:19:25 2022] GET /identity/v3/projects/1df47be5d8964fd9aca46b06b9abec43 => generated 363 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:19:25.120236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcd65f-0a02-48a6-bac9-ebf314726a29 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:25.214172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcd65f-0a02-48a6-bac9-ebf314726a29 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:25.228065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:25.229238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:25.229238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:25.229238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] PATH_INFO: `/v3/users/395b575106154bb3a3590e5c299bcc4e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:25.231519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=395b575106154bb3a3590e5c299bcc4e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:25.235552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:25.281367 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:25.341253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395b575106154bb3a3590e5c299bcc4e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:25.365841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395b575106154bb3a3590e5c299bcc4e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:25.367039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395b575106154bb3a3590e5c299bcc4e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:25.379379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395b575106154bb3a3590e5c299bcc4e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:25.381563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395b575106154bb3a3590e5c299bcc4e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:25.410026 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2139/4250] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:19:25 2022] DELETE /identity/v3/users/395b575106154bb3a3590e5c299bcc4e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:25.414916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67565ea0-d349-4382-81b4-8c7cc0af0f0b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:25.415389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67565ea0-d349-4382-81b4-8c7cc0af0f0b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:25.415655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67565ea0-d349-4382-81b4-8c7cc0af0f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:25.447087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-67565ea0-d349-4382-81b4-8c7cc0af0f0b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:25.449773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-67565ea0-d349-4382-81b4-8c7cc0af0f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:25.544063 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2112/4251] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:19:25.554131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:25.555660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:25.639347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267080-6442-4974-897d-622068e45af7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:25.672422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9a819-ff65-4e92-bee6-eedccc521f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:25.673132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a819-ff65-4e92-bee6-eedccc521f06 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:25.673578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a819-ff65-4e92-bee6-eedccc521f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:25.673904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a819-ff65-4e92-bee6-eedccc521f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:25.687705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9a819-ff65-4e92-bee6-eedccc521f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:25.689866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9a819-ff65-4e92-bee6-eedccc521f06 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:25.706633 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2140/4252] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:26.367770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67565ea0-d349-4382-81b4-8c7cc0af0f0b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:26.369234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-67565ea0-d349-4382-81b4-8c7cc0af0f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:26.389233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67565ea0-d349-4382-81b4-8c7cc0af0f0b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:26.400652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:26.401650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:26.402105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:26.402389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] PATH_INFO: `/v3/projects/1df47be5d8964fd9aca46b06b9abec43` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:26.416040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df47be5d8964fd9aca46b06b9abec43)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:26.420374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:26.551683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df47be5d8964fd9aca46b06b9abec43', 'request_id': 'req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:26.579956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df47be5d8964fd9aca46b06b9abec43', 'request_id': 'req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:26.592150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df47be5d8964fd9aca46b06b9abec43', 'request_id': 'req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:26.614069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] The token cache is being invalidate because project 1df47be5d8964fd9aca46b06b9abec43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:19:26.615898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:26.616582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f1a34ad-5922-4c85-b916-fdec4bf2b8ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:26.618828 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2113/4253] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:19:26 2022] DELETE /identity/v3/projects/1df47be5d8964fd9aca46b06b9abec43 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:26.624886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec88ec7-2161-44a0-b76f-8e5c2e782a8d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:26.625354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec88ec7-2161-44a0-b76f-8e5c2e782a8d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:26.625452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec88ec7-2161-44a0-b76f-8e5c2e782a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:26.656957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7ec88ec7-2161-44a0-b76f-8e5c2e782a8d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:26.660854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7ec88ec7-2161-44a0-b76f-8e5c2e782a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:26.770567 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2141/4254] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:26.782292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c912b55-271f-40b0-b693-2f3c06ed57c7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:26.782575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c912b55-271f-40b0-b693-2f3c06ed57c7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:26.782884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c912b55-271f-40b0-b693-2f3c06ed57c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:26.803514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1c912b55-271f-40b0-b693-2f3c06ed57c7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:26.804999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1c912b55-271f-40b0-b693-2f3c06ed57c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:26.813589 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2114/4255] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:26.818359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec88ec7-2161-44a0-b76f-8e5c2e782a8d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:26.828435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec88ec7-2161-44a0-b76f-8e5c2e782a8d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:26.833069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310e2e5-fa9e-410f-a853-68c71744db74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:26.834280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310e2e5-fa9e-410f-a853-68c71744db74 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:26.834559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310e2e5-fa9e-410f-a853-68c71744db74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:26.834861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310e2e5-fa9e-410f-a853-68c71744db74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:26.835507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310e2e5-fa9e-410f-a853-68c71744db74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:19:26.835870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310e2e5-fa9e-410f-a853-68c71744db74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:26.837605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310e2e5-fa9e-410f-a853-68c71744db74 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:26.855344 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2142/4256] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:19:26.856527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c912b55-271f-40b0-b693-2f3c06ed57c7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:26.866343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c912b55-271f-40b0-b693-2f3c06ed57c7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:26.871102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d715e-f83c-47a9-ac43-f6fc433c829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:26.871696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d715e-f83c-47a9-ac43-f6fc433c829d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:26.871970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d715e-f83c-47a9-ac43-f6fc433c829d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:26.872239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d715e-f83c-47a9-ac43-f6fc433c829d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:26.872872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d715e-f83c-47a9-ac43-f6fc433c829d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:26.874784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d715e-f83c-47a9-ac43-f6fc433c829d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:26.905567 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2115/4257] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:19:26 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:19:26.909831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310e2e5-fa9e-410f-a853-68c71744db74 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:26.920290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310e2e5-fa9e-410f-a853-68c71744db74 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:26.955838 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:27.001972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1afdc6-47b6-4acf-8b4f-64e831df2d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:27.002578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1afdc6-47b6-4acf-8b4f-64e831df2d35 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:27.002886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1afdc6-47b6-4acf-8b4f-64e831df2d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:27.003172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1afdc6-47b6-4acf-8b4f-64e831df2d35 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:27.003794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1afdc6-47b6-4acf-8b4f-64e831df2d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:27.006096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1afdc6-47b6-4acf-8b4f-64e831df2d35 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:27.032005 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2143/4258] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:19:26 2022] POST /identity/v3/users => generated 280 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:19:27.033294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d715e-f83c-47a9-ac43-f6fc433c829d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:27.044420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d715e-f83c-47a9-ac43-f6fc433c829d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:27.049263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdd8bd-a87b-42a1-8ef0-5de5f7f3499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:27.049860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdd8bd-a87b-42a1-8ef0-5de5f7f3499f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:27.050135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdd8bd-a87b-42a1-8ef0-5de5f7f3499f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:27.050435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdd8bd-a87b-42a1-8ef0-5de5f7f3499f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:27.051113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdd8bd-a87b-42a1-8ef0-5de5f7f3499f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:27.052812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdd8bd-a87b-42a1-8ef0-5de5f7f3499f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:27.063247 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2116/4259] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:19:27.067213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1afdc6-47b6-4acf-8b4f-64e831df2d35 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:27.078304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1afdc6-47b6-4acf-8b4f-64e831df2d35 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:27.082929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22630fd6-1ece-4058-bf58-67d51d837cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:27.084064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22630fd6-1ece-4058-bf58-67d51d837cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:27.084348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22630fd6-1ece-4058-bf58-67d51d837cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:27.084626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22630fd6-1ece-4058-bf58-67d51d837cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:27.085268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22630fd6-1ece-4058-bf58-67d51d837cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:27.086874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22630fd6-1ece-4058-bf58-67d51d837cdb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:27.096989 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2144/4260] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:19:27.101430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdd8bd-a87b-42a1-8ef0-5de5f7f3499f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:27.113147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdd8bd-a87b-42a1-8ef0-5de5f7f3499f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:27.118789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0541da-f5db-4600-bd30-05d1a54d4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:27.119481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0541da-f5db-4600-bd30-05d1a54d4574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:27.119761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0541da-f5db-4600-bd30-05d1a54d4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:27.120034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0541da-f5db-4600-bd30-05d1a54d4574 admin admin] PATH_INFO: `/v3/projects/98d08d4bec804fd5b93b98416177ac47/users/a3e576af29e74c3890980ee254e3faf9/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:27.137131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0541da-f5db-4600-bd30-05d1a54d4574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d08d4bec804fd5b93b98416177ac47, user_id=a3e576af29e74c3890980ee254e3faf9, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:27.141191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0541da-f5db-4600-bd30-05d1a54d4574 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:27.158895 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2117/4261] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:19:27 2022] PUT /identity/v3/projects/98d08d4bec804fd5b93b98416177ac47/users/a3e576af29e74c3890980ee254e3faf9/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:27.172228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db94e2-4741-48d0-b880-af89968b9a25 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:27.172514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db94e2-4741-48d0-b880-af89968b9a25 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:27.172789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db94e2-4741-48d0-b880-af89968b9a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:27.207519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-85db94e2-4741-48d0-b880-af89968b9a25 None None] MFA Rules not processed for user `a3e576af29e74c3890980ee254e3faf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:27.209877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-85db94e2-4741-48d0-b880-af89968b9a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:27.294752 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2145/4262] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:27.338668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0541da-f5db-4600-bd30-05d1a54d4574 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:27.363123 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:27.471339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0541da-f5db-4600-bd30-05d1a54d4574 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:27.478329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:27.479157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:27.479484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:27.479921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] PATH_INFO: `/v3/users/a3e576af29e74c3890980ee254e3faf9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:27.481398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e576af29e74c3890980ee254e3faf9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:27.483914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:27.570194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e576af29e74c3890980ee254e3faf9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:27.603303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e576af29e74c3890980ee254e3faf9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:27.604461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e576af29e74c3890980ee254e3faf9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:27.619790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e576af29e74c3890980ee254e3faf9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:27.630593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e576af29e74c3890980ee254e3faf9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:27.644271 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2118/4263] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:19:27 2022] DELETE /identity/v3/users/a3e576af29e74c3890980ee254e3faf9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:27.645699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f11a75-226c-46e8-bed7-5756032de778 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:27.646733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f11a75-226c-46e8-bed7-5756032de778 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:27.646822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f11a75-226c-46e8-bed7-5756032de778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:27.671693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a7f11a75-226c-46e8-bed7-5756032de778 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:27.673556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a7f11a75-226c-46e8-bed7-5756032de778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:27.801486 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2146/4264] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:27.823895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:27.825404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:28.001329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5ddaf-f29a-4f8f-b987-7419ceebd1e3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:28.022464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e608c-9bcf-4169-b864-2c2cfb026be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:28.023302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e608c-9bcf-4169-b864-2c2cfb026be4 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:28.023679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e608c-9bcf-4169-b864-2c2cfb026be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:28.024531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e608c-9bcf-4169-b864-2c2cfb026be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:28.047772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e608c-9bcf-4169-b864-2c2cfb026be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:28.049689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e608c-9bcf-4169-b864-2c2cfb026be4 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:28.061321 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2119/4265] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:28.682339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f11a75-226c-46e8-bed7-5756032de778 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:28.684518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a7f11a75-226c-46e8-bed7-5756032de778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:28.708789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f11a75-226c-46e8-bed7-5756032de778 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:28.731564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:28.732701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:28.733389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:28.733932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] PATH_INFO: `/v3/projects/98d08d4bec804fd5b93b98416177ac47` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:28.736577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d08d4bec804fd5b93b98416177ac47)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:28.739543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:28.817239 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:28.838407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d08d4bec804fd5b93b98416177ac47', 'request_id': 'req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:28.864662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d08d4bec804fd5b93b98416177ac47', 'request_id': 'req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:28.876725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d08d4bec804fd5b93b98416177ac47', 'request_id': 'req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:28.908081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] The token cache is being invalidate because project 98d08d4bec804fd5b93b98416177ac47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:19:28.908734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:28.910483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14fdbab9-fcb6-48a4-bc7f-8410ee2cb14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:28.913137 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2147/4266] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:19:28 2022] DELETE /identity/v3/projects/98d08d4bec804fd5b93b98416177ac47 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:28.918264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfd336-0d3d-4bba-a26c-a2721758fcf5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:28.919064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfd336-0d3d-4bba-a26c-a2721758fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:28.919360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfd336-0d3d-4bba-a26c-a2721758fcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:28.982511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-86dfd336-0d3d-4bba-a26c-a2721758fcf5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:28.988214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-86dfd336-0d3d-4bba-a26c-a2721758fcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:29.080983 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:29.160723 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2120/4267] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:29.169459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d4a0d-a0a3-4cd3-afdf-e937a2cc2bb5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:29.170010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d4a0d-a0a3-4cd3-afdf-e937a2cc2bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:29.170454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d4a0d-a0a3-4cd3-afdf-e937a2cc2bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:29.213143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6e1d4a0d-a0a3-4cd3-afdf-e937a2cc2bb5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:29.214567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6e1d4a0d-a0a3-4cd3-afdf-e937a2cc2bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:29.228036 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2148/4268] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:29.233318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfd336-0d3d-4bba-a26c-a2721758fcf5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:29.255906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfd336-0d3d-4bba-a26c-a2721758fcf5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:29.280854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75853557-a278-43d1-9239-f48de1136dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:29.281618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75853557-a278-43d1-9239-f48de1136dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:29.281824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75853557-a278-43d1-9239-f48de1136dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:29.282095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75853557-a278-43d1-9239-f48de1136dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:29.282784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75853557-a278-43d1-9239-f48de1136dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:19:29.283086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75853557-a278-43d1-9239-f48de1136dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:29.284775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75853557-a278-43d1-9239-f48de1136dd3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:29.329641 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2121/4269] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:19:29.335428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d4a0d-a0a3-4cd3-afdf-e937a2cc2bb5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:29.350753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d4a0d-a0a3-4cd3-afdf-e937a2cc2bb5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:29.361411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a45b1-d515-4885-bd05-14e12aa2a8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:29.362086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a45b1-d515-4885-bd05-14e12aa2a8ea admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:29.362363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a45b1-d515-4885-bd05-14e12aa2a8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:29.365032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a45b1-d515-4885-bd05-14e12aa2a8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:29.365740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a45b1-d515-4885-bd05-14e12aa2a8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:29.377088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a45b1-d515-4885-bd05-14e12aa2a8ea admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:29.454438 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2149/4270] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:19:29 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:19:29.458499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75853557-a278-43d1-9239-f48de1136dd3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:29.476021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75853557-a278-43d1-9239-f48de1136dd3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:29.562816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803c6cf-57e9-4161-bdfd-75d17539ec58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:29.563534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803c6cf-57e9-4161-bdfd-75d17539ec58 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:29.563937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803c6cf-57e9-4161-bdfd-75d17539ec58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:29.564274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803c6cf-57e9-4161-bdfd-75d17539ec58 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:29.565881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803c6cf-57e9-4161-bdfd-75d17539ec58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:29.569595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803c6cf-57e9-4161-bdfd-75d17539ec58 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:29.619540 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2122/4271] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:19:29 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:19:29.624212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a45b1-d515-4885-bd05-14e12aa2a8ea admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:29.651958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a45b1-d515-4885-bd05-14e12aa2a8ea admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:29.665805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a77594-f3f2-4f51-9ef5-75fbe6f783b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:29.666819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a77594-f3f2-4f51-9ef5-75fbe6f783b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:29.667297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a77594-f3f2-4f51-9ef5-75fbe6f783b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:29.668300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a77594-f3f2-4f51-9ef5-75fbe6f783b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:29.669152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a77594-f3f2-4f51-9ef5-75fbe6f783b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:29.672942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a77594-f3f2-4f51-9ef5-75fbe6f783b9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:29.691008 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2150/4272] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:19:29.695663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803c6cf-57e9-4161-bdfd-75d17539ec58 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:29.724149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803c6cf-57e9-4161-bdfd-75d17539ec58 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:29.737928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c29b25-2a1d-4d85-a6ef-426a72ba8ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:29.742831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c29b25-2a1d-4d85-a6ef-426a72ba8ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:29.742831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c29b25-2a1d-4d85-a6ef-426a72ba8ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:29.742831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c29b25-2a1d-4d85-a6ef-426a72ba8ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:29.742831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c29b25-2a1d-4d85-a6ef-426a72ba8ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:29.743654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c29b25-2a1d-4d85-a6ef-426a72ba8ca4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:29.793810 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2123/4273] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:19:29.798821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a77594-f3f2-4f51-9ef5-75fbe6f783b9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:29.813386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a77594-f3f2-4f51-9ef5-75fbe6f783b9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:29.838120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daced8ea-3a81-4a2a-b47e-a53d2168f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:29.838991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daced8ea-3a81-4a2a-b47e-a53d2168f206 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:29.839281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daced8ea-3a81-4a2a-b47e-a53d2168f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:29.839560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daced8ea-3a81-4a2a-b47e-a53d2168f206 admin admin] PATH_INFO: `/v3/projects/e8ab6dbed6cd4a09989164757910b06b/users/fe1fa0967b8444279e5bad164b635df5/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:29.869567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daced8ea-3a81-4a2a-b47e-a53d2168f206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ab6dbed6cd4a09989164757910b06b, user_id=fe1fa0967b8444279e5bad164b635df5, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:29.875377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daced8ea-3a81-4a2a-b47e-a53d2168f206 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:29.902681 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2151/4274] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:19:29 2022] PUT /identity/v3/projects/e8ab6dbed6cd4a09989164757910b06b/users/fe1fa0967b8444279e5bad164b635df5/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:29.908259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc038927-8795-48b6-9b3c-4db1ad7159d6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:29.909352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc038927-8795-48b6-9b3c-4db1ad7159d6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:29.909352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc038927-8795-48b6-9b3c-4db1ad7159d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:29.939388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fc038927-8795-48b6-9b3c-4db1ad7159d6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:29.940716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fc038927-8795-48b6-9b3c-4db1ad7159d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:30.030750 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2124/4275] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:30.081140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daced8ea-3a81-4a2a-b47e-a53d2168f206 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:30.084489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-daced8ea-3a81-4a2a-b47e-a53d2168f206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:30.167853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daced8ea-3a81-4a2a-b47e-a53d2168f206 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:30.172099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f0fa4-94e0-4b75-9fb9-f0d5bc18fcc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:30.172711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0fa4-94e0-4b75-9fb9-f0d5bc18fcc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:30.172993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0fa4-94e0-4b75-9fb9-f0d5bc18fcc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:30.173267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0fa4-94e0-4b75-9fb9-f0d5bc18fcc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:30.184177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f0fa4-94e0-4b75-9fb9-f0d5bc18fcc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:30.185639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f0fa4-94e0-4b75-9fb9-f0d5bc18fcc5 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:30.197202 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2152/4276] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:35.555946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc038927-8795-48b6-9b3c-4db1ad7159d6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:35.558423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fc038927-8795-48b6-9b3c-4db1ad7159d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:35.594521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc038927-8795-48b6-9b3c-4db1ad7159d6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:35.623109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:35.625027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:35.625898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:35.626840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] PATH_INFO: `/v3/users/16e7a0f9d35f40dc855b14b9977b6e73` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:35.634009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e7a0f9d35f40dc855b14b9977b6e73)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:35.643611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:35.758403 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:35.787407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e7a0f9d35f40dc855b14b9977b6e73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:35.805607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e7a0f9d35f40dc855b14b9977b6e73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:35.807486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e7a0f9d35f40dc855b14b9977b6e73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:35.824011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e7a0f9d35f40dc855b14b9977b6e73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:35.842519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e7a0f9d35f40dc855b14b9977b6e73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:35.873214 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2125/4277] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:19:35 2022] DELETE /identity/v3/users/16e7a0f9d35f40dc855b14b9977b6e73 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:35.875065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6ece-f8e4-4ded-9cff-4adf74d75836 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:35.875509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6ece-f8e4-4ded-9cff-4adf74d75836 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:35.875612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6ece-f8e4-4ded-9cff-4adf74d75836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:35.914928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-19ff6ece-f8e4-4ded-9cff-4adf74d75836 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:35.917270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-19ff6ece-f8e4-4ded-9cff-4adf74d75836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:36.150984 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:36.220748 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2153/4278] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:36.373013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:36.374717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:36.597317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e311e-6e5e-4b4a-892b-8beef8c9a197 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:36.610019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109145ed-0e39-443c-a31c-3fa9287b9ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:36.612830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109145ed-0e39-443c-a31c-3fa9287b9ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:36.613158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109145ed-0e39-443c-a31c-3fa9287b9ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:36.613440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109145ed-0e39-443c-a31c-3fa9287b9ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:36.648117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109145ed-0e39-443c-a31c-3fa9287b9ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:36.649595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109145ed-0e39-443c-a31c-3fa9287b9ff8 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:36.676438 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2126/4279] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:38.320689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6ece-f8e4-4ded-9cff-4adf74d75836 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:38.322153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-19ff6ece-f8e4-4ded-9cff-4adf74d75836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:38.343455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6ece-f8e4-4ded-9cff-4adf74d75836 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:38.359604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:38.360982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:38.361495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:38.361973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] PATH_INFO: `/v3/projects/77d8d4b0db154ba6acce7c0639e44530` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:38.366621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d8d4b0db154ba6acce7c0639e44530)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:38.369917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:38.463052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d8d4b0db154ba6acce7c0639e44530', 'request_id': 'req-5d91276c-2d8f-4f81-9f55-6a77a9338659'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:38.471666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d8d4b0db154ba6acce7c0639e44530', 'request_id': 'req-5d91276c-2d8f-4f81-9f55-6a77a9338659'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:38.481525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d8d4b0db154ba6acce7c0639e44530', 'request_id': 'req-5d91276c-2d8f-4f81-9f55-6a77a9338659'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:38.501712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] The token cache is being invalidate because project 77d8d4b0db154ba6acce7c0639e44530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:19:38.502271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:38.504675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5d91276c-2d8f-4f81-9f55-6a77a9338659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:38.508142 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2154/4280] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:19:38 2022] DELETE /identity/v3/projects/77d8d4b0db154ba6acce7c0639e44530 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:38.514972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bdb28-db5a-4113-94c6-703b36195f50 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:38.515437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bdb28-db5a-4113-94c6-703b36195f50 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:38.515604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bdb28-db5a-4113-94c6-703b36195f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:38.550404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6e3bdb28-db5a-4113-94c6-703b36195f50 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:38.551703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6e3bdb28-db5a-4113-94c6-703b36195f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:38.655044 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2127/4281] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:38.661885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466db94-0e47-4c0b-b7d9-4cd63e3371ec None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:38.662177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466db94-0e47-4c0b-b7d9-4cd63e3371ec None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:38.662460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466db94-0e47-4c0b-b7d9-4cd63e3371ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:38.699841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c466db94-0e47-4c0b-b7d9-4cd63e3371ec None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:38.716222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c466db94-0e47-4c0b-b7d9-4cd63e3371ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:38.744629 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2155/4282] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:38.746161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bdb28-db5a-4113-94c6-703b36195f50 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:38.763014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bdb28-db5a-4113-94c6-703b36195f50 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:38.772897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9a9af-8b85-4c66-b52f-79a861ab76f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:38.773773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a9af-8b85-4c66-b52f-79a861ab76f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:38.774205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a9af-8b85-4c66-b52f-79a861ab76f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:38.775500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a9af-8b85-4c66-b52f-79a861ab76f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:38.776398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9a9af-8b85-4c66-b52f-79a861ab76f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:19:38.777005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9a9af-8b85-4c66-b52f-79a861ab76f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:38.780092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9a9af-8b85-4c66-b52f-79a861ab76f8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:38.809347 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2128/4283] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:19:38.809555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466db94-0e47-4c0b-b7d9-4cd63e3371ec None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:38.821462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466db94-0e47-4c0b-b7d9-4cd63e3371ec None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:38.827924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbc8fa-541e-4f22-bfb6-8a94123a39d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:38.830807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbc8fa-541e-4f22-bfb6-8a94123a39d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:38.831305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbc8fa-541e-4f22-bfb6-8a94123a39d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:38.831792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbc8fa-541e-4f22-bfb6-8a94123a39d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:38.832765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbc8fa-541e-4f22-bfb6-8a94123a39d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:38.834751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbc8fa-541e-4f22-bfb6-8a94123a39d6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:38.901609 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2156/4284] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:19:38 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:19:38.906197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9a9af-8b85-4c66-b52f-79a861ab76f8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:38.920117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9a9af-8b85-4c66-b52f-79a861ab76f8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:39.029861 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:39.087338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b21bb-5db7-4b1b-8212-b9ebdd3ffd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:39.088227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b21bb-5db7-4b1b-8212-b9ebdd3ffd17 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:39.088599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b21bb-5db7-4b1b-8212-b9ebdd3ffd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:39.089051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b21bb-5db7-4b1b-8212-b9ebdd3ffd17 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:39.089797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b21bb-5db7-4b1b-8212-b9ebdd3ffd17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:39.091903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b21bb-5db7-4b1b-8212-b9ebdd3ffd17 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:39.141831 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2129/4285] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:19:38 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:19:39.148004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbc8fa-541e-4f22-bfb6-8a94123a39d6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:39.160778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbc8fa-541e-4f22-bfb6-8a94123a39d6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:39.167299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0134f-029d-4565-a78e-8b93e60ec3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:39.168256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0134f-029d-4565-a78e-8b93e60ec3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:39.168618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0134f-029d-4565-a78e-8b93e60ec3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:39.168993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0134f-029d-4565-a78e-8b93e60ec3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:39.170386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0134f-029d-4565-a78e-8b93e60ec3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:39.172308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0134f-029d-4565-a78e-8b93e60ec3d3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:39.190136 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2157/4286] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:19:39.190917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b21bb-5db7-4b1b-8212-b9ebdd3ffd17 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:39.204059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b21bb-5db7-4b1b-8212-b9ebdd3ffd17 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:39.209952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53890d8e-4128-4b3b-a5ae-f09d79889a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:39.210940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890d8e-4128-4b3b-a5ae-f09d79889a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:39.211429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890d8e-4128-4b3b-a5ae-f09d79889a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:39.214431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890d8e-4128-4b3b-a5ae-f09d79889a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:39.222861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53890d8e-4128-4b3b-a5ae-f09d79889a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:39.225918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53890d8e-4128-4b3b-a5ae-f09d79889a90 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:39.260679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0134f-029d-4565-a78e-8b93e60ec3d3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:39.285971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0134f-029d-4565-a78e-8b93e60ec3d3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:39.287186 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2130/4287] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:19:39.298816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ee0e3-3017-49fa-a378-aa469a0b72e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:39.299674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ee0e3-3017-49fa-a378-aa469a0b72e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:39.301881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ee0e3-3017-49fa-a378-aa469a0b72e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:39.302362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ee0e3-3017-49fa-a378-aa469a0b72e3 admin admin] PATH_INFO: `/v3/projects/550c19f69633414698e9c62c717660ae/users/bfae16ed6efb490d8d953bb78a5c1a00/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:39.328242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ee0e3-3017-49fa-a378-aa469a0b72e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=550c19f69633414698e9c62c717660ae, user_id=bfae16ed6efb490d8d953bb78a5c1a00, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:39.333732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ee0e3-3017-49fa-a378-aa469a0b72e3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:39.364550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d42afd-3fba-47d0-a537-e4c674362353 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:39.368661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d42afd-3fba-47d0-a537-e4c674362353 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:39.369151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d42afd-3fba-47d0-a537-e4c674362353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:39.384459 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2158/4288] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:19:39 2022] PUT /identity/v3/projects/550c19f69633414698e9c62c717660ae/users/bfae16ed6efb490d8d953bb78a5c1a00/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:39.410965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-12d42afd-3fba-47d0-a537-e4c674362353 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:39.412444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-12d42afd-3fba-47d0-a537-e4c674362353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:39.589567 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2131/4289] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:39.601018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ee0e3-3017-49fa-a378-aa469a0b72e3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:39.606911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a28ee0e3-3017-49fa-a378-aa469a0b72e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:39.708437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ee0e3-3017-49fa-a378-aa469a0b72e3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:39.716740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1d653-d631-437b-aab9-e9bbbcfe5076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:39.718003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1d653-d631-437b-aab9-e9bbbcfe5076 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:39.719034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1d653-d631-437b-aab9-e9bbbcfe5076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:39.719778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1d653-d631-437b-aab9-e9bbbcfe5076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:39.739377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1d653-d631-437b-aab9-e9bbbcfe5076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:39.741548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1d653-d631-437b-aab9-e9bbbcfe5076 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:39.769626 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2159/4290] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:46.565484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63923683-e3bb-46ca-8e70-5cf721ee966d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:46.567316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63923683-e3bb-46ca-8e70-5cf721ee966d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:46.568548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63923683-e3bb-46ca-8e70-5cf721ee966d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:46.689871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-63923683-e3bb-46ca-8e70-5cf721ee966d None None] MFA Rules not processed for user `fe1fa0967b8444279e5bad164b635df5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:46.691789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-63923683-e3bb-46ca-8e70-5cf721ee966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:46.857742 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2132/4291] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:46.874352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1d653-d631-437b-aab9-e9bbbcfe5076 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:46.875913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-35f1d653-d631-437b-aab9-e9bbbcfe5076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:46.951705 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:47.051413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1d653-d631-437b-aab9-e9bbbcfe5076 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:47.066203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0be65a-3b8f-4e6c-b254-f8910848782e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:47.066388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be65a-3b8f-4e6c-b254-f8910848782e service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:47.066935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be65a-3b8f-4e6c-b254-f8910848782e service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:47.067200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be65a-3b8f-4e6c-b254-f8910848782e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:47.087988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0be65a-3b8f-4e6c-b254-f8910848782e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:47.089882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0be65a-3b8f-4e6c-b254-f8910848782e service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:47.116924 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2160/4292] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:47.833171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63923683-e3bb-46ca-8e70-5cf721ee966d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:47.834744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-63923683-e3bb-46ca-8e70-5cf721ee966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:47.860997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63923683-e3bb-46ca-8e70-5cf721ee966d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:47.872591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0573b59-8610-41d8-9493-5f3603d8795a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:47.873613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0573b59-8610-41d8-9493-5f3603d8795a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:47.874116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0573b59-8610-41d8-9493-5f3603d8795a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:47.874630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0573b59-8610-41d8-9493-5f3603d8795a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:47.876720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d0573b59-8610-41d8-9493-5f3603d8795a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:47.904754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0573b59-8610-41d8-9493-5f3603d8795a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:47.910346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0573b59-8610-41d8-9493-5f3603d8795a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:47.938404 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2133/4293] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:48.821246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bda52-70a7-4c06-9f62-5298c05ed634 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:48.822233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bda52-70a7-4c06-9f62-5298c05ed634 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:48.822681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bda52-70a7-4c06-9f62-5298c05ed634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:48.855647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-387bda52-70a7-4c06-9f62-5298c05ed634 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:48.860003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-387bda52-70a7-4c06-9f62-5298c05ed634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:49.023644 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2161/4294] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:49.040073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0573b59-8610-41d8-9493-5f3603d8795a service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:49.041999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d0573b59-8610-41d8-9493-5f3603d8795a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:49.131122 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:49.179651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0573b59-8610-41d8-9493-5f3603d8795a service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:49.187444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e42f4e-90e5-4da9-b787-92fe45fbe20d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:49.188348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e42f4e-90e5-4da9-b787-92fe45fbe20d service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:49.188806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e42f4e-90e5-4da9-b787-92fe45fbe20d service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:49.189854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e42f4e-90e5-4da9-b787-92fe45fbe20d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:49.205187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e42f4e-90e5-4da9-b787-92fe45fbe20d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:49.209971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e42f4e-90e5-4da9-b787-92fe45fbe20d service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:49.224944 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2134/4295] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:19:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:19:51.112810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a16792-7fb5-448d-a316-8be4491a1562 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:51.113962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a16792-7fb5-448d-a316-8be4491a1562 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:51.114803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a16792-7fb5-448d-a316-8be4491a1562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:51.174740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a3a16792-7fb5-448d-a316-8be4491a1562 None None] MFA Rules not processed for user `bfae16ed6efb490d8d953bb78a5c1a00`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:51.175997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a3a16792-7fb5-448d-a316-8be4491a1562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:51.361830 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2162/4296] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:51.604066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e42f4e-90e5-4da9-b787-92fe45fbe20d service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:51.624534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e42f4e-90e5-4da9-b787-92fe45fbe20d service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:51.656069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae708962-248d-4f84-867c-cc59650e952f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:51.661103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708962-248d-4f84-867c-cc59650e952f service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:51.661823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708962-248d-4f84-867c-cc59650e952f service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:51.665086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708962-248d-4f84-867c-cc59650e952f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:51.699663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae708962-248d-4f84-867c-cc59650e952f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:51.701276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae708962-248d-4f84-867c-cc59650e952f service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:51.746097 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2135/4297] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:52.302485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a16792-7fb5-448d-a316-8be4491a1562 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:52.303786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a3a16792-7fb5-448d-a316-8be4491a1562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:52.339580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a16792-7fb5-448d-a316-8be4491a1562 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:52.361316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:52.369481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:52.370038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:52.371316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] PATH_INFO: `/v3/users/5104bda5de774e93bd494d64a8f11faf` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:52.379330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5104bda5de774e93bd494d64a8f11faf)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:52.387105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:52.552977 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:52.570544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5104bda5de774e93bd494d64a8f11faf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:52.606268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5104bda5de774e93bd494d64a8f11faf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:52.607196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5104bda5de774e93bd494d64a8f11faf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:52.630269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5104bda5de774e93bd494d64a8f11faf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:52.631358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5104bda5de774e93bd494d64a8f11faf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:52.717974 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2163/4298] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:19:52 2022] DELETE /identity/v3/users/5104bda5de774e93bd494d64a8f11faf => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:52.869145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dfc9c-d047-40b3-97ca-ac5492a9772b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:52.869762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dfc9c-d047-40b3-97ca-ac5492a9772b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:52.869762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dfc9c-d047-40b3-97ca-ac5492a9772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:52.919875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e84dfc9c-d047-40b3-97ca-ac5492a9772b None None] MFA Rules not processed for user `fe1fa0967b8444279e5bad164b635df5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:52.925063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e84dfc9c-d047-40b3-97ca-ac5492a9772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:53.130324 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2136/4299] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:53.471665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:53.473125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:53.661889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622259d-73c5-4b36-b45f-6fcd4cbff22f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:53.679368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:53.680361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:53.680651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:53.680928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] PATH_INFO: `/v3/projects/e44feebec98b4cd49f7a80597f47be35` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:53.684561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44feebec98b4cd49f7a80597f47be35)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:53.687868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:53.795520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44feebec98b4cd49f7a80597f47be35', 'request_id': 'req-66570143-bf68-4eca-850c-371cd9cec766'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:53.814472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44feebec98b4cd49f7a80597f47be35', 'request_id': 'req-66570143-bf68-4eca-850c-371cd9cec766'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:53.830622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44feebec98b4cd49f7a80597f47be35', 'request_id': 'req-66570143-bf68-4eca-850c-371cd9cec766'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:53.867145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] The token cache is being invalidate because project e44feebec98b4cd49f7a80597f47be35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:19:53.874009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:53.875184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-66570143-bf68-4eca-850c-371cd9cec766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:19:53.877515 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2164/4300] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:19:53 2022] DELETE /identity/v3/projects/e44feebec98b4cd49f7a80597f47be35 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:53.883785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee989ad-9495-424f-9720-8d64e42a7187 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:53.884908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee989ad-9495-424f-9720-8d64e42a7187 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:53.885369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee989ad-9495-424f-9720-8d64e42a7187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:53.931864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2ee989ad-9495-424f-9720-8d64e42a7187 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:53.933433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ee989ad-9495-424f-9720-8d64e42a7187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:54.121548 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2137/4301] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:54.210195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01962e-43ad-4527-93ac-7b0fd6c48f31 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:54.210950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01962e-43ad-4527-93ac-7b0fd6c48f31 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:54.211302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01962e-43ad-4527-93ac-7b0fd6c48f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:54.248352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2d01962e-43ad-4527-93ac-7b0fd6c48f31 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:54.249723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2d01962e-43ad-4527-93ac-7b0fd6c48f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:54.275926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee989ad-9495-424f-9720-8d64e42a7187 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:54.287341 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2165/4302] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:54.291012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee989ad-9495-424f-9720-8d64e42a7187 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:54.308633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfb310-0113-4767-a571-cf5be659dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:54.309750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfb310-0113-4767-a571-cf5be659dc78 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:54.311570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfb310-0113-4767-a571-cf5be659dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:54.312062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfb310-0113-4767-a571-cf5be659dc78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:54.317585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfb310-0113-4767-a571-cf5be659dc78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:19:54.318151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfb310-0113-4767-a571-cf5be659dc78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:54.322257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfb310-0113-4767-a571-cf5be659dc78 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:54.353215 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2138/4303] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:19:54.359421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01962e-43ad-4527-93ac-7b0fd6c48f31 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:54.375411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01962e-43ad-4527-93ac-7b0fd6c48f31 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:54.389035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5911c-4d1c-43d3-abed-e13577d5c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:54.390140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5911c-4d1c-43d3-abed-e13577d5c904 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:54.390745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5911c-4d1c-43d3-abed-e13577d5c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:54.394235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5911c-4d1c-43d3-abed-e13577d5c904 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:54.395863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5911c-4d1c-43d3-abed-e13577d5c904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:54.400237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5911c-4d1c-43d3-abed-e13577d5c904 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:54.523590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfb310-0113-4767-a571-cf5be659dc78 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:54.526814 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2166/4304] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:19:54 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:19:54.539242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfb310-0113-4767-a571-cf5be659dc78 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:54.640540 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:54.688389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fa8ce-0a99-433a-8428-01e99ce3816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:54.690474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fa8ce-0a99-433a-8428-01e99ce3816f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:54.691610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fa8ce-0a99-433a-8428-01e99ce3816f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:54.692343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fa8ce-0a99-433a-8428-01e99ce3816f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:54.693142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fa8ce-0a99-433a-8428-01e99ce3816f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:54.695340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fa8ce-0a99-433a-8428-01e99ce3816f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:54.737154 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2139/4305] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:19:54 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:19:54.741121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5911c-4d1c-43d3-abed-e13577d5c904 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:54.754811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5911c-4d1c-43d3-abed-e13577d5c904 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:54.768702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51027b3-741e-4d6a-844c-688c0d538bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:54.769664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51027b3-741e-4d6a-844c-688c0d538bae admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:54.770974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51027b3-741e-4d6a-844c-688c0d538bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:54.771415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51027b3-741e-4d6a-844c-688c0d538bae admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:54.772261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51027b3-741e-4d6a-844c-688c0d538bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:54.775776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51027b3-741e-4d6a-844c-688c0d538bae admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:54.798843 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2167/4306] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:19:54.801702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fa8ce-0a99-433a-8428-01e99ce3816f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:54.816288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fa8ce-0a99-433a-8428-01e99ce3816f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:54.826016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5565511-f86a-4a63-b432-81a695b8b81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:54.826930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5565511-f86a-4a63-b432-81a695b8b81c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:54.828066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5565511-f86a-4a63-b432-81a695b8b81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:54.828525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5565511-f86a-4a63-b432-81a695b8b81c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:54.830054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5565511-f86a-4a63-b432-81a695b8b81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:54.833548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5565511-f86a-4a63-b432-81a695b8b81c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:54.863640 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2140/4307] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:19:54.864876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51027b3-741e-4d6a-844c-688c0d538bae admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:54.876061 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:54.888593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51027b3-741e-4d6a-844c-688c0d538bae admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:54.915177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1bc4a-45cd-4b5c-bec4-42d5695031f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:54.915871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1bc4a-45cd-4b5c-bec4-42d5695031f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:54.916155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1bc4a-45cd-4b5c-bec4-42d5695031f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:54.916441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1bc4a-45cd-4b5c-bec4-42d5695031f6 admin admin] PATH_INFO: `/v3/projects/0db6d896601046a399cf18b45fcdc832/users/06f16b3109154e998d60747646c731d1/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:54.974622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1bc4a-45cd-4b5c-bec4-42d5695031f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db6d896601046a399cf18b45fcdc832, user_id=06f16b3109154e998d60747646c731d1, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:54.977353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1bc4a-45cd-4b5c-bec4-42d5695031f6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:55.020319 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2168/4308] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:19:54 2022] PUT /identity/v3/projects/0db6d896601046a399cf18b45fcdc832/users/06f16b3109154e998d60747646c731d1/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:19:55.025381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b42e1-53e3-4c69-8e9d-961d87842ebf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:55.025845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b42e1-53e3-4c69-8e9d-961d87842ebf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:55.025977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b42e1-53e3-4c69-8e9d-961d87842ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:55.058845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1d1b42e1-53e3-4c69-8e9d-961d87842ebf None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:55.060377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1d1b42e1-53e3-4c69-8e9d-961d87842ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:55.205786 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2141/4309] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:55.294315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1bc4a-45cd-4b5c-bec4-42d5695031f6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:55.296368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4fb1bc4a-45cd-4b5c-bec4-42d5695031f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:55.478993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1bc4a-45cd-4b5c-bec4-42d5695031f6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:55.489031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb731f-d350-4088-84ac-9e814f6279bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:55.490019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb731f-d350-4088-84ac-9e814f6279bb service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:55.490517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb731f-d350-4088-84ac-9e814f6279bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:55.491033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb731f-d350-4088-84ac-9e814f6279bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:55.512449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb731f-d350-4088-84ac-9e814f6279bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:55.514890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb731f-d350-4088-84ac-9e814f6279bb service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:55.536821 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2169/4310] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:57.725010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a93bd-cb3b-44fb-bac6-e4d931caf5d1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:57.725860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a93bd-cb3b-44fb-bac6-e4d931caf5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:57.726285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a93bd-cb3b-44fb-bac6-e4d931caf5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:57.814591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a06a93bd-cb3b-44fb-bac6-e4d931caf5d1 None None] MFA Rules not processed for user `06f16b3109154e998d60747646c731d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:57.816174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a06a93bd-cb3b-44fb-bac6-e4d931caf5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:58.027090 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2142/4311] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:58.037737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642fe1-00e7-4574-9a69-bc63d7829f61 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:58.038264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642fe1-00e7-4574-9a69-bc63d7829f61 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:58.038442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642fe1-00e7-4574-9a69-bc63d7829f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:58.083566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1c642fe1-00e7-4574-9a69-bc63d7829f61 None None] MFA Rules not processed for user `06f16b3109154e998d60747646c731d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:58.085183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1c642fe1-00e7-4574-9a69-bc63d7829f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:58.107623 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2170/4312] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:19:58.125141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a93bd-cb3b-44fb-bac6-e4d931caf5d1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:19:58.129117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a06a93bd-cb3b-44fb-bac6-e4d931caf5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:58.292578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185cd4-49dd-4267-a118-643fb191d224 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:58.294041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185cd4-49dd-4267-a118-643fb191d224 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:58.294549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185cd4-49dd-4267-a118-643fb191d224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:58.346525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-34185cd4-49dd-4267-a118-643fb191d224 None None] MFA Rules not processed for user `bfae16ed6efb490d8d953bb78a5c1a00`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:19:58.350847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-34185cd4-49dd-4267-a118-643fb191d224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:19:58.361514 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:58.459965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a93bd-cb3b-44fb-bac6-e4d931caf5d1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:19:58.484475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f4b3b-c688-4d07-91cf-0c96bceb6fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:19:58.492043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4b3b-c688-4d07-91cf-0c96bceb6fc1 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:19:58.492043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4b3b-c688-4d07-91cf-0c96bceb6fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:19:58.492043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4b3b-c688-4d07-91cf-0c96bceb6fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:19:58.517884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f4b3b-c688-4d07-91cf-0c96bceb6fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:19:58.519335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f4b3b-c688-4d07-91cf-0c96bceb6fc1 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:19:58.543365 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2143/4313] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:19:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:19:58.548926 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2171/4314] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:20:02.382312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f4b3b-c688-4d07-91cf-0c96bceb6fc1 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:02.387872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-916f4b3b-c688-4d07-91cf-0c96bceb6fc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:02.605653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34185cd4-49dd-4267-a118-643fb191d224 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:02.630846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34185cd4-49dd-4267-a118-643fb191d224 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:02.653477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:02.654311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:02.654797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:02.655283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] PATH_INFO: `/v3/users/06f16b3109154e998d60747646c731d1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:02.669719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f16b3109154e998d60747646c731d1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:02.672921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:02.685178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f4b3b-c688-4d07-91cf-0c96bceb6fc1 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:02.705741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7c07d-a8c2-4e4e-9dbe-3a79ce5c27b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:02.707343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7c07d-a8c2-4e4e-9dbe-3a79ce5c27b1 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:02.708430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7c07d-a8c2-4e4e-9dbe-3a79ce5c27b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:02.708813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7c07d-a8c2-4e4e-9dbe-3a79ce5c27b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:02.718149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-94b7c07d-a8c2-4e4e-9dbe-3a79ce5c27b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:02.776715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7c07d-a8c2-4e4e-9dbe-3a79ce5c27b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:02.779910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f16b3109154e998d60747646c731d1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:02.787315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7c07d-a8c2-4e4e-9dbe-3a79ce5c27b1 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:02.811669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f16b3109154e998d60747646c731d1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:02.812749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f16b3109154e998d60747646c731d1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:02.831640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f16b3109154e998d60747646c731d1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:02.832608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f16b3109154e998d60747646c731d1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:02.837932 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:02.848508 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2144/4315] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:02.857918 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2172/4316] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:02 2022] DELETE /identity/v3/users/06f16b3109154e998d60747646c731d1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:03.251319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7c07d-a8c2-4e4e-9dbe-3a79ce5c27b1 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:03.253490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-94b7c07d-a8c2-4e4e-9dbe-3a79ce5c27b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:03.272991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7c07d-a8c2-4e4e-9dbe-3a79ce5c27b1 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:03.396297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e6f72-c99b-4ebf-b474-553bf2839600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:03.398387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e6f72-c99b-4ebf-b474-553bf2839600 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:03.398840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e6f72-c99b-4ebf-b474-553bf2839600 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:03.399857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e6f72-c99b-4ebf-b474-553bf2839600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:03.405875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a7e6f72-c99b-4ebf-b474-553bf2839600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:03.561455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e6f72-c99b-4ebf-b474-553bf2839600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:03.563929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e6f72-c99b-4ebf-b474-553bf2839600 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:03.599857 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2145/4317] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:04.109673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:04.111159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:04.142022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a77d5-203a-40c7-b455-92787e817063 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:04.148597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:04.150192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:04.150698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:04.151805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] PATH_INFO: `/v3/projects/0db6d896601046a399cf18b45fcdc832` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:04.153251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db6d896601046a399cf18b45fcdc832)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:04.155461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:04.294188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db6d896601046a399cf18b45fcdc832', 'request_id': 'req-96354f34-69da-4ecf-8033-ca043ab952ac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:04.314092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db6d896601046a399cf18b45fcdc832', 'request_id': 'req-96354f34-69da-4ecf-8033-ca043ab952ac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:04.329125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db6d896601046a399cf18b45fcdc832', 'request_id': 'req-96354f34-69da-4ecf-8033-ca043ab952ac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:04.356140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] The token cache is being invalidate because project 0db6d896601046a399cf18b45fcdc832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:04.356443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:04.358106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-96354f34-69da-4ecf-8033-ca043ab952ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:04.364058 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2173/4318] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:04 2022] DELETE /identity/v3/projects/0db6d896601046a399cf18b45fcdc832 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:04.370492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b1f8d-f3a0-4ebb-be9d-c51c69a95aae None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:04.370809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b1f8d-f3a0-4ebb-be9d-c51c69a95aae None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:04.371081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b1f8d-f3a0-4ebb-be9d-c51c69a95aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:04.408313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f50b1f8d-f3a0-4ebb-be9d-c51c69a95aae None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:04.410770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f50b1f8d-f3a0-4ebb-be9d-c51c69a95aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:04.449384 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:04.542446 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2146/4319] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:04.543283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249528b-10ac-49d5-aef1-7945590802a2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:04.543605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249528b-10ac-49d5-aef1-7945590802a2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:04.544064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249528b-10ac-49d5-aef1-7945590802a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:04.572171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b249528b-10ac-49d5-aef1-7945590802a2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:04.573904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b249528b-10ac-49d5-aef1-7945590802a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:04.583051 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2174/4320] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:04.587156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b1f8d-f3a0-4ebb-be9d-c51c69a95aae None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:04.603597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b1f8d-f3a0-4ebb-be9d-c51c69a95aae None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:04.612742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc37e0-aadf-4979-8e82-add290d87056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:04.613636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc37e0-aadf-4979-8e82-add290d87056 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:04.614091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc37e0-aadf-4979-8e82-add290d87056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:04.614539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc37e0-aadf-4979-8e82-add290d87056 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:04.615386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc37e0-aadf-4979-8e82-add290d87056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:20:04.615844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc37e0-aadf-4979-8e82-add290d87056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:04.617955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc37e0-aadf-4979-8e82-add290d87056 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:04.638382 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2147/4321] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:20:04.643023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249528b-10ac-49d5-aef1-7945590802a2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:04.657666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249528b-10ac-49d5-aef1-7945590802a2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:04.665415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f674b8-8c57-4066-b351-1e295c3434d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:04.666338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f674b8-8c57-4066-b351-1e295c3434d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:04.666806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f674b8-8c57-4066-b351-1e295c3434d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:04.667228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f674b8-8c57-4066-b351-1e295c3434d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:04.669438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f674b8-8c57-4066-b351-1e295c3434d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:04.673575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f674b8-8c57-4066-b351-1e295c3434d2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:04.721188 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2175/4322] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:20:04 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:04.725505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc37e0-aadf-4979-8e82-add290d87056 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:04.748566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc37e0-aadf-4979-8e82-add290d87056 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:04.872597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dfd01-a5e6-4f99-ba4f-df903bb1a6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:04.873238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfd01-a5e6-4f99-ba4f-df903bb1a6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:04.873521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfd01-a5e6-4f99-ba4f-df903bb1a6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:04.873794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfd01-a5e6-4f99-ba4f-df903bb1a6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:04.874543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dfd01-a5e6-4f99-ba4f-df903bb1a6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:04.877837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dfd01-a5e6-4f99-ba4f-df903bb1a6d8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:04.918800 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2148/4323] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:20:04 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:04.922633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f674b8-8c57-4066-b351-1e295c3434d2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:04.950050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f674b8-8c57-4066-b351-1e295c3434d2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:04.956659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b06f1-0a18-435a-96b6-3e847dad8145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:04.957496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b06f1-0a18-435a-96b6-3e847dad8145 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:04.957950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b06f1-0a18-435a-96b6-3e847dad8145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:04.958369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b06f1-0a18-435a-96b6-3e847dad8145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:04.959209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b06f1-0a18-435a-96b6-3e847dad8145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:04.961019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b06f1-0a18-435a-96b6-3e847dad8145 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:04.979585 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2176/4324] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:04.982916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dfd01-a5e6-4f99-ba4f-df903bb1a6d8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:05.005525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dfd01-a5e6-4f99-ba4f-df903bb1a6d8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:05.022359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a413-6271-4a39-9090-9d99c962864e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:05.023029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a413-6271-4a39-9090-9d99c962864e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:05.023316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a413-6271-4a39-9090-9d99c962864e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:05.023596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a413-6271-4a39-9090-9d99c962864e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:05.024257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23a413-6271-4a39-9090-9d99c962864e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:05.025894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23a413-6271-4a39-9090-9d99c962864e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:05.043419 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2149/4325] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:05.048408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b06f1-0a18-435a-96b6-3e847dad8145 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:05.088867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b06f1-0a18-435a-96b6-3e847dad8145 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:05.103233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457f901-48e1-4205-9967-7ac6b9835f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:05.103942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f901-48e1-4205-9967-7ac6b9835f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:05.104231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f901-48e1-4205-9967-7ac6b9835f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:05.104510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f901-48e1-4205-9967-7ac6b9835f42 admin admin] PATH_INFO: `/v3/projects/b9d8ef80beda48cf95e02545177abc11/users/d5d496f6ab8d4844908672038999257c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:05.154100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457f901-48e1-4205-9967-7ac6b9835f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d8ef80beda48cf95e02545177abc11, user_id=d5d496f6ab8d4844908672038999257c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:05.159478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457f901-48e1-4205-9967-7ac6b9835f42 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:05.217767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2177/4326] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:05 2022] PUT /identity/v3/projects/b9d8ef80beda48cf95e02545177abc11/users/d5d496f6ab8d4844908672038999257c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:20:05.217994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f23b9-df35-4db5-ae3b-9994af2aedec None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:05.217994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f23b9-df35-4db5-ae3b-9994af2aedec None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:05.217994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f23b9-df35-4db5-ae3b-9994af2aedec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:05.311136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7e4f23b9-df35-4db5-ae3b-9994af2aedec None None] MFA Rules not processed for user `d5d496f6ab8d4844908672038999257c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:05.313895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7e4f23b9-df35-4db5-ae3b-9994af2aedec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:05.446426 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2150/4327] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:20:05.459457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457f901-48e1-4205-9967-7ac6b9835f42 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:05.462829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a457f901-48e1-4205-9967-7ac6b9835f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:05.744421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457f901-48e1-4205-9967-7ac6b9835f42 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:05.757386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95526413-6c3e-4cbf-9a39-734892f0e79c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:05.758034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95526413-6c3e-4cbf-9a39-734892f0e79c service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:05.758319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95526413-6c3e-4cbf-9a39-734892f0e79c service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:05.758617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95526413-6c3e-4cbf-9a39-734892f0e79c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:05.770316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95526413-6c3e-4cbf-9a39-734892f0e79c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:05.773029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95526413-6c3e-4cbf-9a39-734892f0e79c service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:05.777311 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:05.818792 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2178/4328] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:12.242130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f23b9-df35-4db5-ae3b-9994af2aedec None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:12.243617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7e4f23b9-df35-4db5-ae3b-9994af2aedec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:12.291461 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:12.486787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f23b9-df35-4db5-ae3b-9994af2aedec None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:12.523001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:12.523696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:12.524016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:12.524294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] PATH_INFO: `/v3/users/ef737c7d2aa247388c88fc2ad7ea5748` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:12.525491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef737c7d2aa247388c88fc2ad7ea5748)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:12.532766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:12.686256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef737c7d2aa247388c88fc2ad7ea5748'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:12.747185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef737c7d2aa247388c88fc2ad7ea5748'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:12.750664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef737c7d2aa247388c88fc2ad7ea5748'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:12.779170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef737c7d2aa247388c88fc2ad7ea5748'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:12.813764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef737c7d2aa247388c88fc2ad7ea5748'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:12.824450 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2151/4329] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:12 2022] DELETE /identity/v3/users/ef737c7d2aa247388c88fc2ad7ea5748 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:20:13.805996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95526413-6c3e-4cbf-9a39-734892f0e79c service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:13.836820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95526413-6c3e-4cbf-9a39-734892f0e79c service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:13.983592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:13.985212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:13.986330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:13.986956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] PATH_INFO: `/v3/projects/447cbc915a47450c8bc98a83e919310a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:13.989704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=447cbc915a47450c8bc98a83e919310a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:13.992016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:14.104089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447cbc915a47450c8bc98a83e919310a', 'request_id': 'req-63c96169-6663-49f5-992b-adcb8f31d0b8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:14.120238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447cbc915a47450c8bc98a83e919310a', 'request_id': 'req-63c96169-6663-49f5-992b-adcb8f31d0b8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:14.135598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447cbc915a47450c8bc98a83e919310a', 'request_id': 'req-63c96169-6663-49f5-992b-adcb8f31d0b8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:14.160344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] The token cache is being invalidate because project 447cbc915a47450c8bc98a83e919310a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:14.160687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:14.161450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:14.163071 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2179/4330] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:13 2022] DELETE /identity/v3/projects/447cbc915a47450c8bc98a83e919310a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:14.166979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:14.169158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:14.192270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8da1b-f19c-4caf-93aa-ceb47a8d1d42 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:14.283783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:14.284613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:14.284907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:14.285209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] PATH_INFO: `/v3/users/f74f0c5c99a14332bc3224b7400f4587` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:14.286424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74f0c5c99a14332bc3224b7400f4587)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:14.288578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:14.362429 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:14.384146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74f0c5c99a14332bc3224b7400f4587'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:14.407505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74f0c5c99a14332bc3224b7400f4587'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:14.408540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74f0c5c99a14332bc3224b7400f4587'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:14.419164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74f0c5c99a14332bc3224b7400f4587'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:14.429006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74f0c5c99a14332bc3224b7400f4587'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:14.441773 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2152/4331] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:14 2022] DELETE /identity/v3/users/f74f0c5c99a14332bc3224b7400f4587 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:14.739358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:14.741016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:14.766756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96169-6663-49f5-992b-adcb8f31d0b8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:14.881426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1f8a9-e1d7-4418-83bf-87bf6082b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:14.881426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f8a9-e1d7-4418-83bf-87bf6082b54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:14.881426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f8a9-e1d7-4418-83bf-87bf6082b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:14.881426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f8a9-e1d7-4418-83bf-87bf6082b54a admin admin] PATH_INFO: `/v3/users/0137895559ee4c76a8ea40ac6bdc4d87` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:14.882313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:14.884633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:14.893188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1f8a9-e1d7-4418-83bf-87bf6082b54a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0137895559ee4c76a8ea40ac6bdc4d87)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:14.898113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1f8a9-e1d7-4418-83bf-87bf6082b54a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:14.908213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5fe4-4309-45dd-95e4-abae65a5cf54 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:14.917239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:14.917830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:14.918107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:14.918763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] PATH_INFO: `/v3/projects/8d17afac888c409caeae7a34bb8ed044` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:14.927948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d17afac888c409caeae7a34bb8ed044)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:14.929957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:15.011796 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:15.062746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19c1f8a9-e1d7-4418-83bf-87bf6082b54a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0137895559ee4c76a8ea40ac6bdc4d87'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:15.102077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19c1f8a9-e1d7-4418-83bf-87bf6082b54a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0137895559ee4c76a8ea40ac6bdc4d87'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:15.103258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19c1f8a9-e1d7-4418-83bf-87bf6082b54a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0137895559ee4c76a8ea40ac6bdc4d87'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:15.124441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19c1f8a9-e1d7-4418-83bf-87bf6082b54a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0137895559ee4c76a8ea40ac6bdc4d87'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:15.125056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19c1f8a9-e1d7-4418-83bf-87bf6082b54a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0137895559ee4c76a8ea40ac6bdc4d87'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:15.128145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d17afac888c409caeae7a34bb8ed044', 'request_id': 'req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:15.140306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d17afac888c409caeae7a34bb8ed044', 'request_id': 'req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:15.142648 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2180/4332] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:14 2022] DELETE /identity/v3/users/0137895559ee4c76a8ea40ac6bdc4d87 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:15.147180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab94ac-12fb-454b-b7c8-0ea8d91e3fd4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:15.150989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab94ac-12fb-454b-b7c8-0ea8d91e3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:15.151241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab94ac-12fb-454b-b7c8-0ea8d91e3fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:15.162278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d17afac888c409caeae7a34bb8ed044', 'request_id': 'req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:15.194998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a5ab94ac-12fb-454b-b7c8-0ea8d91e3fd4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:15.197516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a5ab94ac-12fb-454b-b7c8-0ea8d91e3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:15.225818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] The token cache is being invalidate because project 8d17afac888c409caeae7a34bb8ed044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:15.226313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:15.227497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b08576df-4536-4f9c-9177-3c8d5a1d8bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:15.231278 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2153/4333] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:14 2022] DELETE /identity/v3/projects/8d17afac888c409caeae7a34bb8ed044 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:15.240052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc6188-c19f-4fb7-8360-49d6d38937e9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:15.240727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc6188-c19f-4fb7-8360-49d6d38937e9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:15.241173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc6188-c19f-4fb7-8360-49d6d38937e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:15.277333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-71dc6188-c19f-4fb7-8360-49d6d38937e9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:15.278893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-71dc6188-c19f-4fb7-8360-49d6d38937e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:15.329126 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2181/4334] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:15.339959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab94ac-12fb-454b-b7c8-0ea8d91e3fd4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:15.344278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a5ab94ac-12fb-454b-b7c8-0ea8d91e3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:15.453758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab94ac-12fb-454b-b7c8-0ea8d91e3fd4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:15.454623 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2154/4335] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:15.462461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c704a92-b8b9-42d6-a686-7215fc06caa5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:15.462912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c704a92-b8b9-42d6-a686-7215fc06caa5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:15.463302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c704a92-b8b9-42d6-a686-7215fc06caa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:15.471206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cd687-f23c-44a8-b938-ebb60a017e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:15.472507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cd687-f23c-44a8-b938-ebb60a017e16 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:15.473249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cd687-f23c-44a8-b938-ebb60a017e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:15.473817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cd687-f23c-44a8-b938-ebb60a017e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:15.489570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cd687-f23c-44a8-b938-ebb60a017e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:15.491904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cd687-f23c-44a8-b938-ebb60a017e16 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:15.503920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4c704a92-b8b9-42d6-a686-7215fc06caa5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:15.505826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4c704a92-b8b9-42d6-a686-7215fc06caa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:15.533806 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2155/4336] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:20:15.537735 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2182/4337] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:15.538524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c704a92-b8b9-42d6-a686-7215fc06caa5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:15.559977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c704a92-b8b9-42d6-a686-7215fc06caa5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:15.583983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7472ed7-6845-4bbe-99bc-85dd3d73fd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:15.584719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472ed7-6845-4bbe-99bc-85dd3d73fd2f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:15.585005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472ed7-6845-4bbe-99bc-85dd3d73fd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:15.585384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472ed7-6845-4bbe-99bc-85dd3d73fd2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:15.586190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7472ed7-6845-4bbe-99bc-85dd3d73fd2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:20:15.586575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7472ed7-6845-4bbe-99bc-85dd3d73fd2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:15.592216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7472ed7-6845-4bbe-99bc-85dd3d73fd2f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:15.630671 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2156/4338] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:20:15.635200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cd687-f23c-44a8-b938-ebb60a017e16 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:15.647474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cd687-f23c-44a8-b938-ebb60a017e16 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:15.660083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b79d8a-3332-4362-add2-8ed1572be01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:15.661780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b79d8a-3332-4362-add2-8ed1572be01c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:15.662220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b79d8a-3332-4362-add2-8ed1572be01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:15.666227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b79d8a-3332-4362-add2-8ed1572be01c admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:15.666227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b79d8a-3332-4362-add2-8ed1572be01c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:15.667077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b79d8a-3332-4362-add2-8ed1572be01c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:15.719823 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2183/4339] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:20:15 2022] POST /identity/v3/projects => generated 399 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:15.720142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7472ed7-6845-4bbe-99bc-85dd3d73fd2f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:15.735129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7472ed7-6845-4bbe-99bc-85dd3d73fd2f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:15.771678 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:15.866392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414496f3-d42e-4d5f-a0f4-d6ee96a955ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:15.867352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414496f3-d42e-4d5f-a0f4-d6ee96a955ce admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:15.867761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414496f3-d42e-4d5f-a0f4-d6ee96a955ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:15.868133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414496f3-d42e-4d5f-a0f4-d6ee96a955ce admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:15.868899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414496f3-d42e-4d5f-a0f4-d6ee96a955ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:15.871223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414496f3-d42e-4d5f-a0f4-d6ee96a955ce admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:15.911143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b79d8a-3332-4362-add2-8ed1572be01c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:15.911746 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2157/4340] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:20:15 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:15.947009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b79d8a-3332-4362-add2-8ed1572be01c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:15.963908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35342d39-af62-4ccf-b4a3-c07e11cb661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:15.964542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35342d39-af62-4ccf-b4a3-c07e11cb661d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:15.964822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35342d39-af62-4ccf-b4a3-c07e11cb661d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:15.965097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35342d39-af62-4ccf-b4a3-c07e11cb661d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:15.965747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35342d39-af62-4ccf-b4a3-c07e11cb661d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:15.968442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35342d39-af62-4ccf-b4a3-c07e11cb661d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:15.991420 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2184/4341] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:15.992454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414496f3-d42e-4d5f-a0f4-d6ee96a955ce admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:16.014342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414496f3-d42e-4d5f-a0f4-d6ee96a955ce admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:16.032472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c1967-57da-4c2b-8a88-aa31a55a42c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:16.033199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c1967-57da-4c2b-8a88-aa31a55a42c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:16.033491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c1967-57da-4c2b-8a88-aa31a55a42c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:16.033789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c1967-57da-4c2b-8a88-aa31a55a42c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:16.035972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c1967-57da-4c2b-8a88-aa31a55a42c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:16.042554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c1967-57da-4c2b-8a88-aa31a55a42c9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:16.067599 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2158/4342] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:20:16.071473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35342d39-af62-4ccf-b4a3-c07e11cb661d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:16.086509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35342d39-af62-4ccf-b4a3-c07e11cb661d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:16.096657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b554f0-796a-48ef-855a-1da32098130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:16.098116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b554f0-796a-48ef-855a-1da32098130d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:16.098642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b554f0-796a-48ef-855a-1da32098130d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:16.099134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b554f0-796a-48ef-855a-1da32098130d admin admin] PATH_INFO: `/v3/projects/b19b890a2ecc41439c8f44c11034441b/users/567970d4c702481995721669932ce41e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:16.122127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b554f0-796a-48ef-855a-1da32098130d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19b890a2ecc41439c8f44c11034441b, user_id=567970d4c702481995721669932ce41e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:16.127206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b554f0-796a-48ef-855a-1da32098130d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:16.132993 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:16.156559 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2185/4343] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:16 2022] PUT /identity/v3/projects/b19b890a2ecc41439c8f44c11034441b/users/567970d4c702481995721669932ce41e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:20:16.162994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd1d3-4241-4480-9a7f-460680886e4f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:16.164224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd1d3-4241-4480-9a7f-460680886e4f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:16.164699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd1d3-4241-4480-9a7f-460680886e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:16.203793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-389cd1d3-4241-4480-9a7f-460680886e4f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:16.206519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-389cd1d3-4241-4480-9a7f-460680886e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:16.404732 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2159/4344] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:16.429628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b554f0-796a-48ef-855a-1da32098130d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:16.517532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cd1d3-4241-4480-9a7f-460680886e4f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:16.519414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-389cd1d3-4241-4480-9a7f-460680886e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:16.538092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cd1d3-4241-4480-9a7f-460680886e4f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:16.549940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b554f0-796a-48ef-855a-1da32098130d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:16.551719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:16.552715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:16.553147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:16.553578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] PATH_INFO: `/v3/projects/c497d2ed5bbb4ed186e2f6f74bfed47f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:16.555043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c497d2ed5bbb4ed186e2f6f74bfed47f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:16.557339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:16.561557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3b852-1bc8-4c31-97e7-ab808288ac06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:16.562241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3b852-1bc8-4c31-97e7-ab808288ac06 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:16.562522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3b852-1bc8-4c31-97e7-ab808288ac06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:16.562821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3b852-1bc8-4c31-97e7-ab808288ac06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:16.594772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3b852-1bc8-4c31-97e7-ab808288ac06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:16.596252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3b852-1bc8-4c31-97e7-ab808288ac06 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:16.609780 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2186/4345] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:16.675438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c497d2ed5bbb4ed186e2f6f74bfed47f', 'request_id': 'req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:16.685058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c497d2ed5bbb4ed186e2f6f74bfed47f', 'request_id': 'req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:16.696327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c497d2ed5bbb4ed186e2f6f74bfed47f', 'request_id': 'req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:16.714142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] The token cache is being invalidate because project c497d2ed5bbb4ed186e2f6f74bfed47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:16.714744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:16.715584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:16.718380 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2160/4346] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:16 2022] DELETE /identity/v3/projects/c497d2ed5bbb4ed186e2f6f74bfed47f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:16.722140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3b852-1bc8-4c31-97e7-ab808288ac06 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:16.735852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3b852-1bc8-4c31-97e7-ab808288ac06 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:16.845854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:16.847420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:16.847747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:16.848186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] PATH_INFO: `/v3/users/f9b7c905bc0b431bb277ae441cb1f5c3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:16.850531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b7c905bc0b431bb277ae441cb1f5c3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:16.854492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:16.920050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:16.921655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:16.954076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b7c905bc0b431bb277ae441cb1f5c3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:16.982248 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:16.984367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b7c905bc0b431bb277ae441cb1f5c3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:16.989775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b7c905bc0b431bb277ae441cb1f5c3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:17.009603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b7c905bc0b431bb277ae441cb1f5c3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:17.011112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b7c905bc0b431bb277ae441cb1f5c3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:17.041607 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2187/4347] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:16 2022] DELETE /identity/v3/users/f9b7c905bc0b431bb277ae441cb1f5c3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:17.076440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04219505-3bf1-4e6e-8eb5-e389de5b0ea5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:17.262767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e7775-cdc9-48c7-a63d-343982720e9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:17.264550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7775-cdc9-48c7-a63d-343982720e9c service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:17.264550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7775-cdc9-48c7-a63d-343982720e9c service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:17.264550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7775-cdc9-48c7-a63d-343982720e9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:17.267429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-383e7775-cdc9-48c7-a63d-343982720e9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:17.281299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e7775-cdc9-48c7-a63d-343982720e9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:17.283028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e7775-cdc9-48c7-a63d-343982720e9c service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:17.296152 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2161/4348] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:20:17.361467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:17.362999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:17.385700 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:17.462795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e25b51-ac45-4333-b781-70e60e505253 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:17.471006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:17.472274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:17.472574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:17.473054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] PATH_INFO: `/v3/users/66a9d6a142d444be90b2101f23603522` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:17.493829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a9d6a142d444be90b2101f23603522)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:17.496677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:17.589427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a9d6a142d444be90b2101f23603522'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:17.609358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a9d6a142d444be90b2101f23603522'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:17.610455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a9d6a142d444be90b2101f23603522'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:17.625250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a9d6a142d444be90b2101f23603522'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:17.626151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a9d6a142d444be90b2101f23603522'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:17.648296 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2188/4349] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:17 2022] DELETE /identity/v3/users/66a9d6a142d444be90b2101f23603522 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:18.112497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e7775-cdc9-48c7-a63d-343982720e9c service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:18.131115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e7775-cdc9-48c7-a63d-343982720e9c service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:18.202217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:18.203790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:18.260520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:18.267451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:18.268020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:18.268490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] PATH_INFO: `/v3/projects/3c94ca45e7684b3c818871e232e08342` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:18.282260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c94ca45e7684b3c818871e232e08342)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:18.285450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:18.359454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefa28c-a5b1-4fc4-9dca-64cb14316936 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:18.376547 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:18.383606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c94ca45e7684b3c818871e232e08342', 'request_id': 'req-632827dc-828f-4a30-9743-fa3d480ed72c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:18.391559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c94ca45e7684b3c818871e232e08342', 'request_id': 'req-632827dc-828f-4a30-9743-fa3d480ed72c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:18.401525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c94ca45e7684b3c818871e232e08342', 'request_id': 'req-632827dc-828f-4a30-9743-fa3d480ed72c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:18.415101 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:18.447363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] The token cache is being invalidate because project 3c94ca45e7684b3c818871e232e08342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:18.447363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:18.450493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-632827dc-828f-4a30-9743-fa3d480ed72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:18.469871 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2162/4350] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:18 2022] DELETE /identity/v3/projects/3c94ca45e7684b3c818871e232e08342 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:18.476347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866ad3-dcc5-4711-9e6d-270b107233d6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:18.476848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866ad3-dcc5-4711-9e6d-270b107233d6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:18.477319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866ad3-dcc5-4711-9e6d-270b107233d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:18.484984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:18.485635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:18.485915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:18.486189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] PATH_INFO: `/v3/projects/1995e813228a471f9a704a013182222f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:18.487427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1995e813228a471f9a704a013182222f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:18.490581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:18.531937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3b866ad3-dcc5-4711-9e6d-270b107233d6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:18.534076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3b866ad3-dcc5-4711-9e6d-270b107233d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:18.558176 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2163/4351] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:18.566965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cbaa4-71ac-4d15-ac68-02d66947f2c0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:18.567481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cbaa4-71ac-4d15-ac68-02d66947f2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:18.567907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cbaa4-71ac-4d15-ac68-02d66947f2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:18.595056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b77cbaa4-71ac-4d15-ac68-02d66947f2c0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:18.595516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1995e813228a471f9a704a013182222f', 'request_id': 'req-52356acf-f50f-4f40-bc97-b06972ec53a6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:18.596738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b77cbaa4-71ac-4d15-ac68-02d66947f2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:18.610566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1995e813228a471f9a704a013182222f', 'request_id': 'req-52356acf-f50f-4f40-bc97-b06972ec53a6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:18.628716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1995e813228a471f9a704a013182222f', 'request_id': 'req-52356acf-f50f-4f40-bc97-b06972ec53a6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:18.654541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] The token cache is being invalidate because project 1995e813228a471f9a704a013182222f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:18.654904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:18.655666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-52356acf-f50f-4f40-bc97-b06972ec53a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:18.663421 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2189/4352] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:18 2022] DELETE /identity/v3/projects/1995e813228a471f9a704a013182222f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:20:18.670369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460aa25-f79c-4825-865f-20ee8ba0ec67 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:18.675567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460aa25-f79c-4825-865f-20ee8ba0ec67 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:18.676826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460aa25-f79c-4825-865f-20ee8ba0ec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:18.711801 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2164/4353] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:20:18.715589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cbaa4-71ac-4d15-ac68-02d66947f2c0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:18.732290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cbaa4-71ac-4d15-ac68-02d66947f2c0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:18.740131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059a902-bfd7-466d-9c1b-7906ce05b407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:18.740964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059a902-bfd7-466d-9c1b-7906ce05b407 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:18.741302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059a902-bfd7-466d-9c1b-7906ce05b407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:18.741654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059a902-bfd7-466d-9c1b-7906ce05b407 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:18.742503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059a902-bfd7-466d-9c1b-7906ce05b407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:20:18.743013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059a902-bfd7-466d-9c1b-7906ce05b407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:18.746001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059a902-bfd7-466d-9c1b-7906ce05b407 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:18.751873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3460aa25-f79c-4825-865f-20ee8ba0ec67 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:18.753257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3460aa25-f79c-4825-865f-20ee8ba0ec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:18.767794 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2190/4354] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:18.776971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1252f5-677d-46bc-968a-d02de9beb537 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:18.777548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1252f5-677d-46bc-968a-d02de9beb537 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:18.778027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1252f5-677d-46bc-968a-d02de9beb537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:18.809542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-eb1252f5-677d-46bc-968a-d02de9beb537 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:18.813838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eb1252f5-677d-46bc-968a-d02de9beb537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:18.814114 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2165/4355] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:20:18.815080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059a902-bfd7-466d-9c1b-7906ce05b407 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:18.826522 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2191/4356] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:20:18.828091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1252f5-677d-46bc-968a-d02de9beb537 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:18.840013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1252f5-677d-46bc-968a-d02de9beb537 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:18.852359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059a902-bfd7-466d-9c1b-7906ce05b407 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:18.854261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab25ca-59f7-46fa-a3ab-adb784fe775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:18.854981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab25ca-59f7-46fa-a3ab-adb784fe775c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:18.855321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab25ca-59f7-46fa-a3ab-adb784fe775c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:18.855657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab25ca-59f7-46fa-a3ab-adb784fe775c admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:18.857810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab25ca-59f7-46fa-a3ab-adb784fe775c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:20:18.858352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab25ca-59f7-46fa-a3ab-adb784fe775c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:18.863690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab25ca-59f7-46fa-a3ab-adb784fe775c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:18.867819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc6c7-9f4a-4c4e-8d95-7c8cc47eb2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:18.868445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc6c7-9f4a-4c4e-8d95-7c8cc47eb2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:18.869230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc6c7-9f4a-4c4e-8d95-7c8cc47eb2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:18.869521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc6c7-9f4a-4c4e-8d95-7c8cc47eb2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:18.870163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc6c7-9f4a-4c4e-8d95-7c8cc47eb2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:18.876058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc6c7-9f4a-4c4e-8d95-7c8cc47eb2e9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:18.900822 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2192/4357] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:20:18.901978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab25ca-59f7-46fa-a3ab-adb784fe775c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:18.914084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab25ca-59f7-46fa-a3ab-adb784fe775c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:18.921971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070081b6-1396-4699-a499-f331df2b55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:18.922949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070081b6-1396-4699-a499-f331df2b55c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:18.923379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070081b6-1396-4699-a499-f331df2b55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:18.923799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070081b6-1396-4699-a499-f331df2b55c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:18.924611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070081b6-1396-4699-a499-f331df2b55c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:18.926871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070081b6-1396-4699-a499-f331df2b55c7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:18.971915 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2166/4358] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:20:18 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:18.973336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc6c7-9f4a-4c4e-8d95-7c8cc47eb2e9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:18.987304 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2193/4359] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:20:18 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:18.991646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070081b6-1396-4699-a499-f331df2b55c7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:19.052929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc6c7-9f4a-4c4e-8d95-7c8cc47eb2e9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:19.086087 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:19.127707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070081b6-1396-4699-a499-f331df2b55c7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:19.131646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9cf46-29a3-4fa5-9dff-895e717dd9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:19.132751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9cf46-29a3-4fa5-9dff-895e717dd9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:19.133783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9cf46-29a3-4fa5-9dff-895e717dd9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:19.134153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9cf46-29a3-4fa5-9dff-895e717dd9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:19.135337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9cf46-29a3-4fa5-9dff-895e717dd9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:19.138631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9cf46-29a3-4fa5-9dff-895e717dd9f8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:19.143684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e47f5-0724-442a-8566-24ca60e25241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:19.145575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e47f5-0724-442a-8566-24ca60e25241 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:19.146824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e47f5-0724-442a-8566-24ca60e25241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:19.147274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e47f5-0724-442a-8566-24ca60e25241 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:19.149130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e47f5-0724-442a-8566-24ca60e25241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:19.157264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e47f5-0724-442a-8566-24ca60e25241 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:19.168268 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2167/4360] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:20:18 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:19.175670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9cf46-29a3-4fa5-9dff-895e717dd9f8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:19.199321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9cf46-29a3-4fa5-9dff-895e717dd9f8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:19.214052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af545e-5f7f-41e2-8858-a1377209d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:19.217073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af545e-5f7f-41e2-8858-a1377209d003 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:19.217073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af545e-5f7f-41e2-8858-a1377209d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:19.218580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af545e-5f7f-41e2-8858-a1377209d003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:19.220177 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2194/4361] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:20:18 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:19.221355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af545e-5f7f-41e2-8858-a1377209d003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:19.225000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e47f5-0724-442a-8566-24ca60e25241 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:19.225890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af545e-5f7f-41e2-8858-a1377209d003 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:19.235150 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:19.241619 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2168/4362] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:19.245830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af545e-5f7f-41e2-8858-a1377209d003 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:19.252874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e47f5-0724-442a-8566-24ca60e25241 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:19.263164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af545e-5f7f-41e2-8858-a1377209d003 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:19.272386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f957706-6223-448c-8c78-c13fdc9d0eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:19.273306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b35ae-dc5d-4c7a-8afa-914a043a9f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:19.274197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f957706-6223-448c-8c78-c13fdc9d0eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:19.274865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b35ae-dc5d-4c7a-8afa-914a043a9f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:19.275251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f957706-6223-448c-8c78-c13fdc9d0eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:19.275663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b35ae-dc5d-4c7a-8afa-914a043a9f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:19.276168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f957706-6223-448c-8c78-c13fdc9d0eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:19.276520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b35ae-dc5d-4c7a-8afa-914a043a9f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:19.278085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f957706-6223-448c-8c78-c13fdc9d0eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:19.279367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b35ae-dc5d-4c7a-8afa-914a043a9f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:19.280937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f957706-6223-448c-8c78-c13fdc9d0eaa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:19.284855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b35ae-dc5d-4c7a-8afa-914a043a9f34 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:19.309039 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2195/4363] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:19.311369 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2169/4364] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:19.313516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b35ae-dc5d-4c7a-8afa-914a043a9f34 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:19.316983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f957706-6223-448c-8c78-c13fdc9d0eaa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:19.336457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f957706-6223-448c-8c78-c13fdc9d0eaa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:19.338960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b35ae-dc5d-4c7a-8afa-914a043a9f34 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:19.349312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb14e1-f3e4-408e-9cb3-922b6032e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:19.350257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf618f7-be71-4ea1-9d48-be4a606c0abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:19.351516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb14e1-f3e4-408e-9cb3-922b6032e701 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:19.352224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf618f7-be71-4ea1-9d48-be4a606c0abc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:19.352829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb14e1-f3e4-408e-9cb3-922b6032e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:19.353202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf618f7-be71-4ea1-9d48-be4a606c0abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:19.353563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb14e1-f3e4-408e-9cb3-922b6032e701 admin admin] PATH_INFO: `/v3/projects/2cd0ce5cd5ab49599029053457a363d3/users/6f49cac861bf459cae96a19cd099513b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:19.353927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf618f7-be71-4ea1-9d48-be4a606c0abc admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:19.355045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf618f7-be71-4ea1-9d48-be4a606c0abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:19.358953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf618f7-be71-4ea1-9d48-be4a606c0abc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:19.394532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb14e1-f3e4-408e-9cb3-922b6032e701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd0ce5cd5ab49599029053457a363d3, user_id=6f49cac861bf459cae96a19cd099513b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:19.396382 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2196/4365] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:20:19.397483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf618f7-be71-4ea1-9d48-be4a606c0abc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:19.400270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb14e1-f3e4-408e-9cb3-922b6032e701 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:19.424430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf618f7-be71-4ea1-9d48-be4a606c0abc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:19.434477 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2170/4366] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:19 2022] PUT /identity/v3/projects/2cd0ce5cd5ab49599029053457a363d3/users/6f49cac861bf459cae96a19cd099513b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:20:19.441652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bad052-6616-4193-ab36-7a5368c7335b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:19.441937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bad052-6616-4193-ab36-7a5368c7335b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:19.442741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bad052-6616-4193-ab36-7a5368c7335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:19.479270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-94bad052-6616-4193-ab36-7a5368c7335b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:19.480907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-94bad052-6616-4193-ab36-7a5368c7335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:19.565676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc4f0b-c432-406f-984a-ef656b8a1890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:19.566590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4f0b-c432-406f-984a-ef656b8a1890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:19.567028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4f0b-c432-406f-984a-ef656b8a1890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:19.567427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4f0b-c432-406f-984a-ef656b8a1890 admin admin] PATH_INFO: `/v3/projects/f573b3c53b8d41c8bcc6c913a210c34e/users/7afff6b6dba543bca8e7bab8446d3870/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:19.607936 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2171/4367] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:20:19.611269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc4f0b-c432-406f-984a-ef656b8a1890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f573b3c53b8d41c8bcc6c913a210c34e, user_id=7afff6b6dba543bca8e7bab8446d3870, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:19.614373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc4f0b-c432-406f-984a-ef656b8a1890 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:19.645175 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2197/4368] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:19 2022] PUT /identity/v3/projects/f573b3c53b8d41c8bcc6c913a210c34e/users/7afff6b6dba543bca8e7bab8446d3870/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:19.659064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93bb4e-9323-480f-b5b4-2496b6262c1d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:19.659920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93bb4e-9323-480f-b5b4-2496b6262c1d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:19.661285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93bb4e-9323-480f-b5b4-2496b6262c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:19.715564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dd93bb4e-9323-480f-b5b4-2496b6262c1d None None] MFA Rules not processed for user `7afff6b6dba543bca8e7bab8446d3870`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:19.719611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dd93bb4e-9323-480f-b5b4-2496b6262c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:19.784712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc4f0b-c432-406f-984a-ef656b8a1890 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:19.787777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ffdc4f0b-c432-406f-984a-ef656b8a1890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:19.844914 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2172/4369] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:19.893899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93bb4e-9323-480f-b5b4-2496b6262c1d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:19.893899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dd93bb4e-9323-480f-b5b4-2496b6262c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:19.928897 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:19.953323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc4f0b-c432-406f-984a-ef656b8a1890 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:19.962338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bce257-d2dc-4cbd-a1cf-34cab1c7346a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:19.964681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bce257-d2dc-4cbd-a1cf-34cab1c7346a service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:19.967656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bce257-d2dc-4cbd-a1cf-34cab1c7346a service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:19.967994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bce257-d2dc-4cbd-a1cf-34cab1c7346a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:20.117771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93bb4e-9323-480f-b5b4-2496b6262c1d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:20.129659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5300a7b-e357-443c-8b7d-e82e101bf7ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:20.130293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300a7b-e357-443c-8b7d-e82e101bf7ae service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:20.130571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300a7b-e357-443c-8b7d-e82e101bf7ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:20.130873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300a7b-e357-443c-8b7d-e82e101bf7ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:20.133867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bce257-d2dc-4cbd-a1cf-34cab1c7346a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:20.135471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bce257-d2dc-4cbd-a1cf-34cab1c7346a service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:20.149437 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2198/4370] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:20.152064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bce257-d2dc-4cbd-a1cf-34cab1c7346a service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:20.154269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-72bce257-d2dc-4cbd-a1cf-34cab1c7346a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:20.155022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5300a7b-e357-443c-8b7d-e82e101bf7ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:20.156498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5300a7b-e357-443c-8b7d-e82e101bf7ae service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:20.178331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bce257-d2dc-4cbd-a1cf-34cab1c7346a service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:20.180256 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2173/4371] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:20.186339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:20.187192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:20.187598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:20.187977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] PATH_INFO: `/v3/users/d5d496f6ab8d4844908672038999257c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:20.189858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d496f6ab8d4844908672038999257c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:20.192082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:20.201672 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:20.277445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d496f6ab8d4844908672038999257c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:20.292020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d496f6ab8d4844908672038999257c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:20.292827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d496f6ab8d4844908672038999257c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:20.305116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d496f6ab8d4844908672038999257c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:20.305910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d496f6ab8d4844908672038999257c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:20.325202 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2199/4372] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:20 2022] DELETE /identity/v3/users/d5d496f6ab8d4844908672038999257c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:20.330583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505c475-9004-49b5-925c-620930d74850 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:20.330872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505c475-9004-49b5-925c-620930d74850 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:20.331251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505c475-9004-49b5-925c-620930d74850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:20.358163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2505c475-9004-49b5-925c-620930d74850 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:20.361630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2505c475-9004-49b5-925c-620930d74850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:20.494837 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2174/4373] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:20.535812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:20.537898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:20.696492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1608400-39bd-415a-a361-bc519a4e8da7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:20.708401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738a51d-9667-4284-85e9-f6c9e38bf7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:20.709049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738a51d-9667-4284-85e9-f6c9e38bf7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:20.709356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738a51d-9667-4284-85e9-f6c9e38bf7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:20.709613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738a51d-9667-4284-85e9-f6c9e38bf7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:20.736433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738a51d-9667-4284-85e9-f6c9e38bf7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:20.738318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738a51d-9667-4284-85e9-f6c9e38bf7b1 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:20.766259 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2200/4374] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:21.836107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505c475-9004-49b5-925c-620930d74850 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:21.838109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2505c475-9004-49b5-925c-620930d74850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:21.868055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505c475-9004-49b5-925c-620930d74850 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:21.895333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:21.896009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:21.896293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:21.896565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] PATH_INFO: `/v3/projects/b9d8ef80beda48cf95e02545177abc11` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:21.909784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d8ef80beda48cf95e02545177abc11)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:21.911872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:22.024425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d8ef80beda48cf95e02545177abc11', 'request_id': 'req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:22.041770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d8ef80beda48cf95e02545177abc11', 'request_id': 'req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:22.052163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d8ef80beda48cf95e02545177abc11', 'request_id': 'req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:22.075768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa4e1b-e449-47af-b8b8-86ac2487374a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:22.077292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa4e1b-e449-47af-b8b8-86ac2487374a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:22.077817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa4e1b-e449-47af-b8b8-86ac2487374a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:22.113982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] The token cache is being invalidate because project b9d8ef80beda48cf95e02545177abc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:22.115294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:22.117283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a027782a-eedd-4d16-ad95-9f0c66bd0e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:22.121374 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2175/4375] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:21 2022] DELETE /identity/v3/projects/b9d8ef80beda48cf95e02545177abc11 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:22.127269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076351d8-19ce-4d55-be1f-e5dde97e8f0b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:22.128185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076351d8-19ce-4d55-be1f-e5dde97e8f0b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:22.128714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076351d8-19ce-4d55-be1f-e5dde97e8f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:22.147832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ceaa4e1b-e449-47af-b8b8-86ac2487374a None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:22.151656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ceaa4e1b-e449-47af-b8b8-86ac2487374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:22.181651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-076351d8-19ce-4d55-be1f-e5dde97e8f0b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:22.182988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-076351d8-19ce-4d55-be1f-e5dde97e8f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:22.233511 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:22.306153 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2201/4376] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:22.336916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa4e1b-e449-47af-b8b8-86ac2487374a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:22.338533 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2176/4377] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:22.345175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ceaa4e1b-e449-47af-b8b8-86ac2487374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:22.346279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f27d-99ce-4380-bb12-b0626babb860 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:22.346791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f27d-99ce-4380-bb12-b0626babb860 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:22.347254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f27d-99ce-4380-bb12-b0626babb860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:22.391821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d660f27d-99ce-4380-bb12-b0626babb860 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:22.393160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d660f27d-99ce-4380-bb12-b0626babb860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:22.415630 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2177/4378] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:20:22.420207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660f27d-99ce-4380-bb12-b0626babb860 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:22.429778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660f27d-99ce-4380-bb12-b0626babb860 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:22.453440 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:22.468304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b8103-0556-4755-8ea0-b24704c144f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:22.469988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b8103-0556-4755-8ea0-b24704c144f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:22.469988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b8103-0556-4755-8ea0-b24704c144f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:22.469988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b8103-0556-4755-8ea0-b24704c144f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:22.470644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b8103-0556-4755-8ea0-b24704c144f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:20:22.470947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b8103-0556-4755-8ea0-b24704c144f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:22.472853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b8103-0556-4755-8ea0-b24704c144f9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:22.504693 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2178/4379] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:20:22.509394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b8103-0556-4755-8ea0-b24704c144f9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:22.534501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b8103-0556-4755-8ea0-b24704c144f9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:22.546152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17b47a-eb31-4537-be40-21afb0915f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:22.548295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17b47a-eb31-4537-be40-21afb0915f02 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:22.549557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17b47a-eb31-4537-be40-21afb0915f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:22.550965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17b47a-eb31-4537-be40-21afb0915f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:22.551990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17b47a-eb31-4537-be40-21afb0915f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:22.554773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17b47a-eb31-4537-be40-21afb0915f02 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:22.574257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa4e1b-e449-47af-b8b8-86ac2487374a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:22.580507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b31fdb-461c-4868-a33e-c8d0d1511e4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:22.581370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31fdb-461c-4868-a33e-c8d0d1511e4c service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:22.581654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31fdb-461c-4868-a33e-c8d0d1511e4c service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:22.582023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31fdb-461c-4868-a33e-c8d0d1511e4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:22.593728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b31fdb-461c-4868-a33e-c8d0d1511e4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:22.595494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b31fdb-461c-4868-a33e-c8d0d1511e4c service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:22.608607 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2202/4380] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:20:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:20:22.631464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b31fdb-461c-4868-a33e-c8d0d1511e4c service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:22.636619 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2179/4381] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:20:22 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:20:22.646745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b31fdb-461c-4868-a33e-c8d0d1511e4c service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:22.719299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49717bff-dba2-4442-bc86-02d78c4cbced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:22.719979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49717bff-dba2-4442-bc86-02d78c4cbced admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:22.720297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49717bff-dba2-4442-bc86-02d78c4cbced admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:22.720571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49717bff-dba2-4442-bc86-02d78c4cbced admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:22.722228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49717bff-dba2-4442-bc86-02d78c4cbced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:22.725784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49717bff-dba2-4442-bc86-02d78c4cbced admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:22.770774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17b47a-eb31-4537-be40-21afb0915f02 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:22.789165 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2203/4382] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:20:22 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:20:22.794681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17b47a-eb31-4537-be40-21afb0915f02 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:22.805038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe7ffa-c92d-4749-9ce7-2d1fee354700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:22.806434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe7ffa-c92d-4749-9ce7-2d1fee354700 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:22.808937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe7ffa-c92d-4749-9ce7-2d1fee354700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:22.809568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe7ffa-c92d-4749-9ce7-2d1fee354700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:22.813756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe7ffa-c92d-4749-9ce7-2d1fee354700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:22.815814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe7ffa-c92d-4749-9ce7-2d1fee354700 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:22.852952 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2180/4383] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:20:22.858268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49717bff-dba2-4442-bc86-02d78c4cbced admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:22.873711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49717bff-dba2-4442-bc86-02d78c4cbced admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:22.886684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f728b-25b1-493c-bf99-bb5284fdcbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:22.887198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f728b-25b1-493c-bf99-bb5284fdcbda admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:22.888110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f728b-25b1-493c-bf99-bb5284fdcbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:22.888428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f728b-25b1-493c-bf99-bb5284fdcbda admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:22.889157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f728b-25b1-493c-bf99-bb5284fdcbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:22.891881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f728b-25b1-493c-bf99-bb5284fdcbda admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:22.938857 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2204/4384] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:22.943576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe7ffa-c92d-4749-9ce7-2d1fee354700 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:22.975668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe7ffa-c92d-4749-9ce7-2d1fee354700 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:22.983786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ab41-cde0-4cac-adf9-3ddf12916dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:22.984844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ab41-cde0-4cac-adf9-3ddf12916dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:22.985310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ab41-cde0-4cac-adf9-3ddf12916dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:22.985782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ab41-cde0-4cac-adf9-3ddf12916dca admin admin] PATH_INFO: `/v3/projects/aaade3b81e5b4e0cbc7290e7e8ca97f5/users/0983bb77be0d4121a3841a3702d63c33/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:23.009669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098ab41-cde0-4cac-adf9-3ddf12916dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaade3b81e5b4e0cbc7290e7e8ca97f5, user_id=0983bb77be0d4121a3841a3702d63c33, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:23.013876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098ab41-cde0-4cac-adf9-3ddf12916dca admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:23.050061 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2181/4385] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:22 2022] PUT /identity/v3/projects/aaade3b81e5b4e0cbc7290e7e8ca97f5/users/0983bb77be0d4121a3841a3702d63c33/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:23.052845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1086df-d0ce-4907-a12e-cd94dd6d086d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:23.053320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1086df-d0ce-4907-a12e-cd94dd6d086d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:23.053673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1086df-d0ce-4907-a12e-cd94dd6d086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:23.116921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0c1086df-d0ce-4907-a12e-cd94dd6d086d None None] MFA Rules not processed for user `0983bb77be0d4121a3841a3702d63c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:23.120166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0c1086df-d0ce-4907-a12e-cd94dd6d086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:23.331287 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2205/4386] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:23.339512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ab41-cde0-4cac-adf9-3ddf12916dca admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:23.341956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6098ab41-cde0-4cac-adf9-3ddf12916dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:23.547402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ab41-cde0-4cac-adf9-3ddf12916dca admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:23.557783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11720147-2fc8-4cae-b466-67b0793e9aab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:23.558826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11720147-2fc8-4cae-b466-67b0793e9aab service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:23.560074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11720147-2fc8-4cae-b466-67b0793e9aab service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:23.560573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11720147-2fc8-4cae-b466-67b0793e9aab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:23.571695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11720147-2fc8-4cae-b466-67b0793e9aab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:23.573502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11720147-2fc8-4cae-b466-67b0793e9aab service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:23.587230 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2182/4387] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:25.602385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1086df-d0ce-4907-a12e-cd94dd6d086d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:25.612166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0c1086df-d0ce-4907-a12e-cd94dd6d086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:25.698566 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:25.784108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1086df-d0ce-4907-a12e-cd94dd6d086d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:25.810834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a51097-6f52-42e9-bd3f-a3e94e4d42ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:25.811490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a51097-6f52-42e9-bd3f-a3e94e4d42ba service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:25.811778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a51097-6f52-42e9-bd3f-a3e94e4d42ba service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:25.812051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a51097-6f52-42e9-bd3f-a3e94e4d42ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:25.815885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e1a51097-6f52-42e9-bd3f-a3e94e4d42ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:25.866900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a51097-6f52-42e9-bd3f-a3e94e4d42ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:25.869005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a51097-6f52-42e9-bd3f-a3e94e4d42ba service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:25.911535 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2206/4388] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:26.307500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a58cea-5b4c-4366-91ac-3d1742062c1b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:26.308514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a58cea-5b4c-4366-91ac-3d1742062c1b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:26.309183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a58cea-5b4c-4366-91ac-3d1742062c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:26.332494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-51a58cea-5b4c-4366-91ac-3d1742062c1b None None] MFA Rules not processed for user `db9450c53d8944b88cfbbc541f585ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:26.334104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-51a58cea-5b4c-4366-91ac-3d1742062c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:26.416676 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:26.482831 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2183/4389] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:26.542014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a51097-6f52-42e9-bd3f-a3e94e4d42ba service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:26.560673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a51097-6f52-42e9-bd3f-a3e94e4d42ba service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:26.572194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647eae1-e22d-48d1-aca0-9dea76f1b282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:26.572822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647eae1-e22d-48d1-aca0-9dea76f1b282 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:26.573111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647eae1-e22d-48d1-aca0-9dea76f1b282 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:26.573389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647eae1-e22d-48d1-aca0-9dea76f1b282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:26.591276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7647eae1-e22d-48d1-aca0-9dea76f1b282 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:26.728258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647eae1-e22d-48d1-aca0-9dea76f1b282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:26.730546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647eae1-e22d-48d1-aca0-9dea76f1b282 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:26.748731 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2207/4390] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:27.232518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8310e3a-81dd-412b-a3c5-a0cfada6c911 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:27.233710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8310e3a-81dd-412b-a3c5-a0cfada6c911 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:27.234174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8310e3a-81dd-412b-a3c5-a0cfada6c911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:27.307279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b8310e3a-81dd-412b-a3c5-a0cfada6c911 None None] MFA Rules not processed for user `567970d4c702481995721669932ce41e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:27.311670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b8310e3a-81dd-412b-a3c5-a0cfada6c911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:27.511629 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2184/4391] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:27.521456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874471d6-1158-4457-809a-8f454172ecb7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:27.522113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874471d6-1158-4457-809a-8f454172ecb7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:27.522780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874471d6-1158-4457-809a-8f454172ecb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:27.575214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-874471d6-1158-4457-809a-8f454172ecb7 None None] MFA Rules not processed for user `567970d4c702481995721669932ce41e`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:27.584947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-874471d6-1158-4457-809a-8f454172ecb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:27.607442 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2208/4392] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:27.626429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8310e3a-81dd-412b-a3c5-a0cfada6c911 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:27.631113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b8310e3a-81dd-412b-a3c5-a0cfada6c911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:27.706315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8310e3a-81dd-412b-a3c5-a0cfada6c911 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:27.720034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5517b-fa5d-4b40-964d-cba0add65658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:27.720847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5517b-fa5d-4b40-964d-cba0add65658 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:27.721588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5517b-fa5d-4b40-964d-cba0add65658 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:27.721970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5517b-fa5d-4b40-964d-cba0add65658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:27.754617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5517b-fa5d-4b40-964d-cba0add65658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:27.756450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5517b-fa5d-4b40-964d-cba0add65658 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:27.784037 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2185/4393] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:27 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:29.665055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874471d6-1158-4457-809a-8f454172ecb7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:29.666574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-874471d6-1158-4457-809a-8f454172ecb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:29.698909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874471d6-1158-4457-809a-8f454172ecb7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:29.722030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab8f20-b508-422e-a1bb-81e636e75f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:29.723089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8f20-b508-422e-a1bb-81e636e75f2f service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:29.723089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8f20-b508-422e-a1bb-81e636e75f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:29.723354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8f20-b508-422e-a1bb-81e636e75f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:29.733163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c3ab8f20-b508-422e-a1bb-81e636e75f2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:29.784540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab8f20-b508-422e-a1bb-81e636e75f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:29.786846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab8f20-b508-422e-a1bb-81e636e75f2f service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:29.856177 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2209/4394] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:37.766964 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=47 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:37.927145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f1d8a-af8b-4fe4-b0fa-7eef54149843 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:37.927571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f1d8a-af8b-4fe4-b0fa-7eef54149843 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:37.927980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f1d8a-af8b-4fe4-b0fa-7eef54149843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:38.006561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-de9f1d8a-af8b-4fe4-b0fa-7eef54149843 None None] MFA Rules not processed for user `6f49cac861bf459cae96a19cd099513b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:38.008350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de9f1d8a-af8b-4fe4-b0fa-7eef54149843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:38.225366 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2186/4395] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:38.239205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab8f20-b508-422e-a1bb-81e636e75f2f service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:38.240749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c3ab8f20-b508-422e-a1bb-81e636e75f2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:38.286026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab8f20-b508-422e-a1bb-81e636e75f2f service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:38.314372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50579174-37c7-418f-b9d4-535dc05a0198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:38.315072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50579174-37c7-418f-b9d4-535dc05a0198 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:38.315356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50579174-37c7-418f-b9d4-535dc05a0198 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:38.315633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50579174-37c7-418f-b9d4-535dc05a0198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:38.332081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50579174-37c7-418f-b9d4-535dc05a0198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:38.333571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50579174-37c7-418f-b9d4-535dc05a0198 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:38.375277 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2210/4396] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:45.891830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f1d8a-af8b-4fe4-b0fa-7eef54149843 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:45.894194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de9f1d8a-af8b-4fe4-b0fa-7eef54149843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:46.018104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f1d8a-af8b-4fe4-b0fa-7eef54149843 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:46.035298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:46.036252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:46.036687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:46.037108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] PATH_INFO: `/v3/users/6f49cac861bf459cae96a19cd099513b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:46.038465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f49cac861bf459cae96a19cd099513b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:46.040453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:46.122337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f49cac861bf459cae96a19cd099513b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:46.139023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f49cac861bf459cae96a19cd099513b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:46.139947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f49cac861bf459cae96a19cd099513b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:46.161304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f49cac861bf459cae96a19cd099513b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:46.178317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f49cac861bf459cae96a19cd099513b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:46.201573 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2187/4397] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:45 2022] DELETE /identity/v3/users/6f49cac861bf459cae96a19cd099513b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:47.320412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50579174-37c7-418f-b9d4-535dc05a0198 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:47.349724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50579174-37c7-418f-b9d4-535dc05a0198 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:47.396508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:47.398669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:47.423039 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:47.530861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b36397-3a3e-4dc8-8207-b088c5c113a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:47.532232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b36397-3a3e-4dc8-8207-b088c5c113a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:47.533800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b36397-3a3e-4dc8-8207-b088c5c113a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:47.534200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b36397-3a3e-4dc8-8207-b088c5c113a3 admin admin] PATH_INFO: `/v3/users/0983bb77be0d4121a3841a3702d63c33` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:47.536826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b36397-3a3e-4dc8-8207-b088c5c113a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0983bb77be0d4121a3841a3702d63c33)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:47.543222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b36397-3a3e-4dc8-8207-b088c5c113a3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:47.553178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8258e48-8e59-4039-a15e-faea15cb8843 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:47.571763 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:47.572247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:47.573076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:47.574403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:47.574403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] PATH_INFO: `/v3/projects/2cd0ce5cd5ab49599029053457a363d3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:47.575465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd0ce5cd5ab49599029053457a363d3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:47.579737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:47.667210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25b36397-3a3e-4dc8-8207-b088c5c113a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0983bb77be0d4121a3841a3702d63c33'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:47.708670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25b36397-3a3e-4dc8-8207-b088c5c113a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0983bb77be0d4121a3841a3702d63c33'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:47.709593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25b36397-3a3e-4dc8-8207-b088c5c113a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0983bb77be0d4121a3841a3702d63c33'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:47.738720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25b36397-3a3e-4dc8-8207-b088c5c113a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0983bb77be0d4121a3841a3702d63c33'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:47.739541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25b36397-3a3e-4dc8-8207-b088c5c113a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0983bb77be0d4121a3841a3702d63c33'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:47.745827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd0ce5cd5ab49599029053457a363d3', 'request_id': 'req-c0a50b6a-2636-447a-bff6-7936d505cb03'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:47.769060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd0ce5cd5ab49599029053457a363d3', 'request_id': 'req-c0a50b6a-2636-447a-bff6-7936d505cb03'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:47.776534 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2211/4398] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:47 2022] DELETE /identity/v3/users/0983bb77be0d4121a3841a3702d63c33 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:47.779834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a18a-934e-40ca-b54e-d5fc96e854e2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:47.785511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd0ce5cd5ab49599029053457a363d3', 'request_id': 'req-c0a50b6a-2636-447a-bff6-7936d505cb03'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:47.786166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a18a-934e-40ca-b54e-d5fc96e854e2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:47.787451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a18a-934e-40ca-b54e-d5fc96e854e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:47.820614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] The token cache is being invalidate because project 2cd0ce5cd5ab49599029053457a363d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:47.821085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:47.825540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0a50b6a-2636-447a-bff6-7936d505cb03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:47.831107 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2188/4399] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:47 2022] DELETE /identity/v3/projects/2cd0ce5cd5ab49599029053457a363d3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:47.834739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62d91a-cdff-4731-b3a1-c8980934968b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:47.835142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62d91a-cdff-4731-b3a1-c8980934968b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:47.835692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62d91a-cdff-4731-b3a1-c8980934968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:47.838282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2b39a18a-934e-40ca-b54e-d5fc96e854e2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:47.839861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2b39a18a-934e-40ca-b54e-d5fc96e854e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:47.903966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ce62d91a-cdff-4731-b3a1-c8980934968b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:47.907433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ce62d91a-cdff-4731-b3a1-c8980934968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:48.047482 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2212/4400] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:48.051467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39a18a-934e-40ca-b54e-d5fc96e854e2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:48.054833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2b39a18a-934e-40ca-b54e-d5fc96e854e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:48.059777 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2189/4401] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:48.067985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a9cb-3bde-4883-9a02-27de9310fa6e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:48.068589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a9cb-3bde-4883-9a02-27de9310fa6e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:48.068805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a9cb-3bde-4883-9a02-27de9310fa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:48.110683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0203a9cb-3bde-4883-9a02-27de9310fa6e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:48.115468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0203a9cb-3bde-4883-9a02-27de9310fa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:48.132712 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2190/4402] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:20:48.139178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203a9cb-3bde-4883-9a02-27de9310fa6e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:48.154211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203a9cb-3bde-4883-9a02-27de9310fa6e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:48.159838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7322f3-5b0e-4182-9abb-6d0c0c32dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:48.160483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7322f3-5b0e-4182-9abb-6d0c0c32dd1a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:48.161539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7322f3-5b0e-4182-9abb-6d0c0c32dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:48.161819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7322f3-5b0e-4182-9abb-6d0c0c32dd1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:48.162777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7322f3-5b0e-4182-9abb-6d0c0c32dd1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:20:48.163087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7322f3-5b0e-4182-9abb-6d0c0c32dd1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:48.166172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39a18a-934e-40ca-b54e-d5fc96e854e2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:48.166735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7322f3-5b0e-4182-9abb-6d0c0c32dd1a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:48.171597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47aab7-eeb8-4fb6-b07e-8744e33588c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:48.173247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47aab7-eeb8-4fb6-b07e-8744e33588c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:48.173791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47aab7-eeb8-4fb6-b07e-8744e33588c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:48.174276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47aab7-eeb8-4fb6-b07e-8744e33588c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:48.191557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47aab7-eeb8-4fb6-b07e-8744e33588c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:48.193380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47aab7-eeb8-4fb6-b07e-8744e33588c0 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:48.193853 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2191/4403] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:20:48.198635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7322f3-5b0e-4182-9abb-6d0c0c32dd1a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:48.210475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7322f3-5b0e-4182-9abb-6d0c0c32dd1a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:48.218238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691f5cf-d23f-4a87-b76f-32f95a0ae60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:48.219566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691f5cf-d23f-4a87-b76f-32f95a0ae60c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:48.220513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691f5cf-d23f-4a87-b76f-32f95a0ae60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:48.221040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691f5cf-d23f-4a87-b76f-32f95a0ae60c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:48.222458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691f5cf-d23f-4a87-b76f-32f95a0ae60c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:48.225515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691f5cf-d23f-4a87-b76f-32f95a0ae60c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:48.247127 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2213/4404] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:20:48.259627 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:48.276058 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2192/4405] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:20:48 2022] POST /identity/v3/projects => generated 403 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:20:48.284851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47aab7-eeb8-4fb6-b07e-8744e33588c0 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:48.301252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47aab7-eeb8-4fb6-b07e-8744e33588c0 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:48.374917 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:48.426202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc70a9-e126-4d88-85b2-512b82f16c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:48.428349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc70a9-e126-4d88-85b2-512b82f16c60 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:48.429069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc70a9-e126-4d88-85b2-512b82f16c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:48.431941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc70a9-e126-4d88-85b2-512b82f16c60 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:48.433641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc70a9-e126-4d88-85b2-512b82f16c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:48.438387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc70a9-e126-4d88-85b2-512b82f16c60 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:48.492457 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2214/4406] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:20:48 2022] POST /identity/v3/users => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:48.493330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691f5cf-d23f-4a87-b76f-32f95a0ae60c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:48.521981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691f5cf-d23f-4a87-b76f-32f95a0ae60c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:48.537830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f8df1-c511-4103-a4a6-a83fdfcd3bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:48.538857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f8df1-c511-4103-a4a6-a83fdfcd3bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:48.539356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f8df1-c511-4103-a4a6-a83fdfcd3bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:48.539846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f8df1-c511-4103-a4a6-a83fdfcd3bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:48.546140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f8df1-c511-4103-a4a6-a83fdfcd3bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:48.548133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f8df1-c511-4103-a4a6-a83fdfcd3bd0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:48.575245 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2193/4407] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:20:48.579269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc70a9-e126-4d88-85b2-512b82f16c60 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:48.595132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc70a9-e126-4d88-85b2-512b82f16c60 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:48.610396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfa070-f643-4979-bed2-c044fdb73b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:48.611539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa070-f643-4979-bed2-c044fdb73b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:48.612605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa070-f643-4979-bed2-c044fdb73b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:48.613763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa070-f643-4979-bed2-c044fdb73b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:48.614513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfa070-f643-4979-bed2-c044fdb73b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:48.616226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfa070-f643-4979-bed2-c044fdb73b90 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:48.634434 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2215/4408] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:48.638977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f8df1-c511-4103-a4a6-a83fdfcd3bd0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:48.654535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f8df1-c511-4103-a4a6-a83fdfcd3bd0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:48.672953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1645e-7c3c-4e06-9554-972463035c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:48.674106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1645e-7c3c-4e06-9554-972463035c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:48.675198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1645e-7c3c-4e06-9554-972463035c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:48.675693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1645e-7c3c-4e06-9554-972463035c59 admin admin] PATH_INFO: `/v3/projects/e1173034060443ac93a081ad71fb2629/users/b890aa0529304095933195cea870279b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:48.703134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1645e-7c3c-4e06-9554-972463035c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1173034060443ac93a081ad71fb2629, user_id=b890aa0529304095933195cea870279b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:48.706911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1645e-7c3c-4e06-9554-972463035c59 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:48.737316 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2194/4409] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:48 2022] PUT /identity/v3/projects/e1173034060443ac93a081ad71fb2629/users/b890aa0529304095933195cea870279b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:48.742350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ac7bd-93a2-4373-b3e6-cfedc3e1687b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:48.742662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ac7bd-93a2-4373-b3e6-cfedc3e1687b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:48.742946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ac7bd-93a2-4373-b3e6-cfedc3e1687b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:48.806582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-318ac7bd-93a2-4373-b3e6-cfedc3e1687b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:48.815916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-318ac7bd-93a2-4373-b3e6-cfedc3e1687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:49.011235 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2216/4410] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:49.065146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1645e-7c3c-4e06-9554-972463035c59 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:49.157198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ac7bd-93a2-4373-b3e6-cfedc3e1687b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:49.158779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-318ac7bd-93a2-4373-b3e6-cfedc3e1687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:49.188677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ac7bd-93a2-4373-b3e6-cfedc3e1687b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:49.191936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1645e-7c3c-4e06-9554-972463035c59 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:49.200791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8a56-6d3f-4373-af87-6b3c476f4ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:49.201682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:49.202502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8a56-6d3f-4373-af87-6b3c476f4ddf service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:49.203279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:49.203717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8a56-6d3f-4373-af87-6b3c476f4ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:49.204095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8a56-6d3f-4373-af87-6b3c476f4ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:49.205029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:49.205565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] PATH_INFO: `/v3/projects/aaade3b81e5b4e0cbc7290e7e8ca97f5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:49.209568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaade3b81e5b4e0cbc7290e7e8ca97f5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:49.212875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:49.231647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf8a56-6d3f-4373-af87-6b3c476f4ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:49.235184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf8a56-6d3f-4373-af87-6b3c476f4ddf service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:49.259481 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2195/4411] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:49.310704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaade3b81e5b4e0cbc7290e7e8ca97f5', 'request_id': 'req-fb804f52-1e58-46eb-8160-e55b575de487'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:49.317891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaade3b81e5b4e0cbc7290e7e8ca97f5', 'request_id': 'req-fb804f52-1e58-46eb-8160-e55b575de487'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:49.328648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaade3b81e5b4e0cbc7290e7e8ca97f5', 'request_id': 'req-fb804f52-1e58-46eb-8160-e55b575de487'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:49.346385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] The token cache is being invalidate because project aaade3b81e5b4e0cbc7290e7e8ca97f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:49.346971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:49.347746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fb804f52-1e58-46eb-8160-e55b575de487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:49.359622 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2217/4412] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:49 2022] DELETE /identity/v3/projects/aaade3b81e5b4e0cbc7290e7e8ca97f5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:49.361760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c3cbb-9eec-4f06-8447-4f9bca3b1829 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:49.362396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c3cbb-9eec-4f06-8447-4f9bca3b1829 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:49.362753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c3cbb-9eec-4f06-8447-4f9bca3b1829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:49.390279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ac8c3cbb-9eec-4f06-8447-4f9bca3b1829 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:49.391890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ac8c3cbb-9eec-4f06-8447-4f9bca3b1829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:49.466664 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2196/4413] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:49.480618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052dfa-6da5-4efa-acfe-5e9149288947 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:49.480618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052dfa-6da5-4efa-acfe-5e9149288947 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:49.480618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052dfa-6da5-4efa-acfe-5e9149288947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:49.512625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-73052dfa-6da5-4efa-acfe-5e9149288947 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:49.513963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-73052dfa-6da5-4efa-acfe-5e9149288947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:49.524913 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2218/4414] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:49.530933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c3cbb-9eec-4f06-8447-4f9bca3b1829 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:49.546755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c3cbb-9eec-4f06-8447-4f9bca3b1829 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:49.554432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fae256-1477-4b31-9dd3-8fa060d0f70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:49.555442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fae256-1477-4b31-9dd3-8fa060d0f70d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:49.555971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fae256-1477-4b31-9dd3-8fa060d0f70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:49.556426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fae256-1477-4b31-9dd3-8fa060d0f70d admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:49.557668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fae256-1477-4b31-9dd3-8fa060d0f70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:20:49.558377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fae256-1477-4b31-9dd3-8fa060d0f70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:49.560516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fae256-1477-4b31-9dd3-8fa060d0f70d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:49.575948 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2197/4415] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:20:49.580564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73052dfa-6da5-4efa-acfe-5e9149288947 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:49.590583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73052dfa-6da5-4efa-acfe-5e9149288947 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:49.606174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b00d3-39e8-487e-901a-4f76cc501d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:49.607280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b00d3-39e8-487e-901a-4f76cc501d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:49.607280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b00d3-39e8-487e-901a-4f76cc501d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:49.607639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b00d3-39e8-487e-901a-4f76cc501d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:49.608773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b00d3-39e8-487e-901a-4f76cc501d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:49.610332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b00d3-39e8-487e-901a-4f76cc501d62 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:49.648040 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2219/4416] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:20:49 2022] POST /identity/v3/projects => generated 403 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:49.649963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fae256-1477-4b31-9dd3-8fa060d0f70d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:49.665045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fae256-1477-4b31-9dd3-8fa060d0f70d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:49.740664 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:49.760676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34fe3e-8208-4047-8021-ac02d0aeba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:49.761980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34fe3e-8208-4047-8021-ac02d0aeba76 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:49.763187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34fe3e-8208-4047-8021-ac02d0aeba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:49.763466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34fe3e-8208-4047-8021-ac02d0aeba76 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:49.764146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34fe3e-8208-4047-8021-ac02d0aeba76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:49.767697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34fe3e-8208-4047-8021-ac02d0aeba76 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:49.797244 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2198/4417] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:20:49 2022] POST /identity/v3/users => generated 302 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:49.798568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b00d3-39e8-487e-901a-4f76cc501d62 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:49.811315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b00d3-39e8-487e-901a-4f76cc501d62 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:49.816823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175585c3-7312-4bae-bd20-3fc2ea266400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:49.817442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175585c3-7312-4bae-bd20-3fc2ea266400 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:49.817772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175585c3-7312-4bae-bd20-3fc2ea266400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:49.818502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175585c3-7312-4bae-bd20-3fc2ea266400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:49.819271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175585c3-7312-4bae-bd20-3fc2ea266400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:49.821002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175585c3-7312-4bae-bd20-3fc2ea266400 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:49.824949 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:49.837168 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2220/4418] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:20:49.841925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34fe3e-8208-4047-8021-ac02d0aeba76 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:49.853345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34fe3e-8208-4047-8021-ac02d0aeba76 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:49.860300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c0fba-da89-49b8-9dd7-abfb89fe0ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:49.860907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c0fba-da89-49b8-9dd7-abfb89fe0ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:49.861185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c0fba-da89-49b8-9dd7-abfb89fe0ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:49.861459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c0fba-da89-49b8-9dd7-abfb89fe0ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:49.862097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c0fba-da89-49b8-9dd7-abfb89fe0ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:49.863745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c0fba-da89-49b8-9dd7-abfb89fe0ab9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:49.876130 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2199/4419] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:49.881236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175585c3-7312-4bae-bd20-3fc2ea266400 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:49.895457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175585c3-7312-4bae-bd20-3fc2ea266400 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:49.907827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c8d45-97ff-4a32-ac80-d6f19b1b7d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:49.908592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8d45-97ff-4a32-ac80-d6f19b1b7d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:49.908872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8d45-97ff-4a32-ac80-d6f19b1b7d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:49.909151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8d45-97ff-4a32-ac80-d6f19b1b7d77 admin admin] PATH_INFO: `/v3/projects/7ce491666cc04b4db929345acb59c966/users/42523362a9ea4812b3f3b9003e0cb1d3/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:49.951111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c8d45-97ff-4a32-ac80-d6f19b1b7d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce491666cc04b4db929345acb59c966, user_id=42523362a9ea4812b3f3b9003e0cb1d3, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:49.964971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c8d45-97ff-4a32-ac80-d6f19b1b7d77 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:50.018921 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2221/4420] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:49 2022] PUT /identity/v3/projects/7ce491666cc04b4db929345acb59c966/users/42523362a9ea4812b3f3b9003e0cb1d3/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:50.019134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db0eb-8fbf-4157-aac5-59ff0d620eed None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:50.019134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db0eb-8fbf-4157-aac5-59ff0d620eed None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:50.019312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db0eb-8fbf-4157-aac5-59ff0d620eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:50.056441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-083db0eb-8fbf-4157-aac5-59ff0d620eed None None] MFA Rules not processed for user `42523362a9ea4812b3f3b9003e0cb1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:50.057587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-083db0eb-8fbf-4157-aac5-59ff0d620eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:50.210333 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2200/4421] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:50.211790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c8d45-97ff-4a32-ac80-d6f19b1b7d77 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:50.354283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c8d45-97ff-4a32-ac80-d6f19b1b7d77 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:50.363510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47038c03-6851-4367-b824-dd95926ff983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:50.364517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038c03-6851-4367-b824-dd95926ff983 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:50.365027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038c03-6851-4367-b824-dd95926ff983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:50.365496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038c03-6851-4367-b824-dd95926ff983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:50.366646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47038c03-6851-4367-b824-dd95926ff983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:50.373396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47038c03-6851-4367-b824-dd95926ff983 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:50.421952 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2222/4422] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:20:50 2022] POST /identity/v3/projects => generated 403 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:50.426501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db0eb-8fbf-4157-aac5-59ff0d620eed None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:50.450431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db0eb-8fbf-4157-aac5-59ff0d620eed None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:50.623919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfe141-c1ab-4e0b-b52a-a81ea3551890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:50.624584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe141-c1ab-4e0b-b52a-a81ea3551890 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:50.625003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe141-c1ab-4e0b-b52a-a81ea3551890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:50.625292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe141-c1ab-4e0b-b52a-a81ea3551890 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:50.626047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfe141-c1ab-4e0b-b52a-a81ea3551890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:50.628105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfe141-c1ab-4e0b-b52a-a81ea3551890 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:50.657340 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2201/4423] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:20:50 2022] POST /identity/v3/users => generated 308 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:50.661223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47038c03-6851-4367-b824-dd95926ff983 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:50.675437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47038c03-6851-4367-b824-dd95926ff983 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:50.682467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966d14-296c-4313-ae9b-e8f84b2e45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:50.683567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966d14-296c-4313-ae9b-e8f84b2e45c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:50.683857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966d14-296c-4313-ae9b-e8f84b2e45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:50.684128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966d14-296c-4313-ae9b-e8f84b2e45c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:50.685858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10966d14-296c-4313-ae9b-e8f84b2e45c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:50.687716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10966d14-296c-4313-ae9b-e8f84b2e45c8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:50.711150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfe141-c1ab-4e0b-b52a-a81ea3551890 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:50.711362 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2223/4424] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:50.724899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfe141-c1ab-4e0b-b52a-a81ea3551890 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:50.734108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871972f-022d-4557-9be8-6320be11ed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:50.734916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871972f-022d-4557-9be8-6320be11ed82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:50.735267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871972f-022d-4557-9be8-6320be11ed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:50.735938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871972f-022d-4557-9be8-6320be11ed82 admin admin] PATH_INFO: `/v3/projects/e5c93207573c4eed876959299ccaa1b3/users/ae34626e00004905aa22c796f023f43a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:50.788437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871972f-022d-4557-9be8-6320be11ed82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c93207573c4eed876959299ccaa1b3, user_id=ae34626e00004905aa22c796f023f43a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:50.792612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871972f-022d-4557-9be8-6320be11ed82 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:50.831973 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2202/4425] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:50 2022] PUT /identity/v3/projects/e5c93207573c4eed876959299ccaa1b3/users/ae34626e00004905aa22c796f023f43a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:50.833619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966d14-296c-4313-ae9b-e8f84b2e45c8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:50.857139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966d14-296c-4313-ae9b-e8f84b2e45c8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:50.951945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b83346-e835-4e25-a083-e398e112127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:50.952626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83346-e835-4e25-a083-e398e112127c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:50.953094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83346-e835-4e25-a083-e398e112127c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:50.953462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83346-e835-4e25-a083-e398e112127c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:50.954120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b83346-e835-4e25-a083-e398e112127c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:50.956304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b83346-e835-4e25-a083-e398e112127c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:50.975004 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2224/4426] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:50.981190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871972f-022d-4557-9be8-6320be11ed82 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:51.013346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871972f-022d-4557-9be8-6320be11ed82 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:51.030178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536690b5-2409-4d6b-b782-08b78e8b90e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:51.031042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536690b5-2409-4d6b-b782-08b78e8b90e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:51.032208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536690b5-2409-4d6b-b782-08b78e8b90e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:51.032208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536690b5-2409-4d6b-b782-08b78e8b90e9 admin admin] PATH_INFO: `/v3/projects/e5c93207573c4eed876959299ccaa1b3/users/ae34626e00004905aa22c796f023f43a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:51.034021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536690b5-2409-4d6b-b782-08b78e8b90e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c93207573c4eed876959299ccaa1b3, user_id=ae34626e00004905aa22c796f023f43a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:51.036927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536690b5-2409-4d6b-b782-08b78e8b90e9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:51.052212 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2203/4427] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:50 2022] PUT /identity/v3/projects/e5c93207573c4eed876959299ccaa1b3/users/ae34626e00004905aa22c796f023f43a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:51.062992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924cd4c-8f43-4425-88e7-9a345ae760d1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:51.063278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924cd4c-8f43-4425-88e7-9a345ae760d1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:51.063557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924cd4c-8f43-4425-88e7-9a345ae760d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:51.113445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c924cd4c-8f43-4425-88e7-9a345ae760d1 None None] MFA Rules not processed for user `ae34626e00004905aa22c796f023f43a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:51.116767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c924cd4c-8f43-4425-88e7-9a345ae760d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:51.182614 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:51.251223 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2225/4428] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:51.252934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536690b5-2409-4d6b-b782-08b78e8b90e9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:51.269879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536690b5-2409-4d6b-b782-08b78e8b90e9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:51.284219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a836533-38a7-4ff4-bf33-dcdf413b3934 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae34626e00004905aa22c796f023f43a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5c93207573c4eed876959299ccaa1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:51.286415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836533-38a7-4ff4-bf33-dcdf413b3934 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:51.286733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836533-38a7-4ff4-bf33-dcdf413b3934 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:51.287012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836533-38a7-4ff4-bf33-dcdf413b3934 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:51.292186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a836533-38a7-4ff4-bf33-dcdf413b3934 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:51.295616 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-7a836533-38a7-4ff4-bf33-dcdf413b3934 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:20:51.295616 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:20:51.295616 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:20:51.299637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a836533-38a7-4ff4-bf33-dcdf413b3934 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:51.315609 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:51.325926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2204/4429] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:20:51 2022] POST /identity/v3/roles => generated 240 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:51.327202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924cd4c-8f43-4425-88e7-9a345ae760d1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:51.339313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924cd4c-8f43-4425-88e7-9a345ae760d1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:51.344642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba06037-01cc-4ee9-aebb-4378537fa97e tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae34626e00004905aa22c796f023f43a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5c93207573c4eed876959299ccaa1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:51.344935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06037-01cc-4ee9-aebb-4378537fa97e tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:51.345224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06037-01cc-4ee9-aebb-4378537fa97e tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:51.345506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06037-01cc-4ee9-aebb-4378537fa97e tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] PATH_INFO: `/v3/projects/7ce491666cc04b4db929345acb59c966/users/42523362a9ea4812b3f3b9003e0cb1d3/roles/26c1dc31fe7c4b1490ec100578e3288a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:51.348440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba06037-01cc-4ee9-aebb-4378537fa97e tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7ce491666cc04b4db929345acb59c966, user_id=42523362a9ea4812b3f3b9003e0cb1d3, role_id=26c1dc31fe7c4b1490ec100578e3288a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:51.351410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba06037-01cc-4ee9-aebb-4378537fa97e tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:51.370895 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2226/4430] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:51 2022] PUT /identity/v3/projects/7ce491666cc04b4db929345acb59c966/users/42523362a9ea4812b3f3b9003e0cb1d3/roles/26c1dc31fe7c4b1490ec100578e3288a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:51.375558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a836533-38a7-4ff4-bf33-dcdf413b3934 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:51.517713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a836533-38a7-4ff4-bf33-dcdf413b3934 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:51.611593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea46b8-e462-4a1d-b93b-e2cca18558d3 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42523362a9ea4812b3f3b9003e0cb1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce491666cc04b4db929345acb59c966', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1794163109'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:51.613071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea46b8-e462-4a1d-b93b-e2cca18558d3 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:51.613071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea46b8-e462-4a1d-b93b-e2cca18558d3 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:51.613071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea46b8-e462-4a1d-b93b-e2cca18558d3 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] PATH_INFO: `/v3/users/42523362a9ea4812b3f3b9003e0cb1d3/application_credentials` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:51.613809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea46b8-e462-4a1d-b93b-e2cca18558d3 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] RBAC: Authorizing `identity:create_application_credential(user_id=42523362a9ea4812b3f3b9003e0cb1d3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:51.615358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea46b8-e462-4a1d-b93b-e2cca18558d3 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:51.720782 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2205/4431] 10.222.0.23 () {60 vars in 1315 bytes} [Sun Oct 2 01:20:51 2022] POST /identity/v3/users/42523362a9ea4812b3f3b9003e0cb1d3/application_credentials => generated 659 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:51.723362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9a0b-56f0-44b2-b060-4bc408b3ce84 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:51.723957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9a0b-56f0-44b2-b060-4bc408b3ce84 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:51.724366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9a0b-56f0-44b2-b060-4bc408b3ce84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:51.767150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e43a9a0b-56f0-44b2-b060-4bc408b3ce84 None None] MFA Rules not processed for user `42523362a9ea4812b3f3b9003e0cb1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:51.768804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e43a9a0b-56f0-44b2-b060-4bc408b3ce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:51.973249 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2227/4432] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3396 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 02 01:20:51.974562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea46b8-e462-4a1d-b93b-e2cca18558d3 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:51.991819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea46b8-e462-4a1d-b93b-e2cca18558d3 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:52.004892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3954ba-5cd9-4ffd-931c-bd37c279bd83 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42523362a9ea4812b3f3b9003e0cb1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce491666cc04b4db929345acb59c966', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1794163109'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:52.005727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3954ba-5cd9-4ffd-931c-bd37c279bd83 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:52.006144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3954ba-5cd9-4ffd-931c-bd37c279bd83 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:52.006524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3954ba-5cd9-4ffd-931c-bd37c279bd83 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] PATH_INFO: `/v3/users/42523362a9ea4812b3f3b9003e0cb1d3/application_credentials/3104ec74479f4ff19f2600077b53daa2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:52.016990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3954ba-5cd9-4ffd-931c-bd37c279bd83 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] RBAC: Authorizing `identity:delete_application_credential(user_id=42523362a9ea4812b3f3b9003e0cb1d3, application_credential_id=3104ec74479f4ff19f2600077b53daa2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:52.022173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3954ba-5cd9-4ffd-931c-bd37c279bd83 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:52.084560 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2206/4433] 10.222.0.23 () {58 vars in 1395 bytes} [Sun Oct 2 01:20:51 2022] DELETE /identity/v3/users/42523362a9ea4812b3f3b9003e0cb1d3/application_credentials/3104ec74479f4ff19f2600077b53daa2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:52.085010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a9a0b-56f0-44b2-b060-4bc408b3ce84 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:52.208424 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:52.231530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a9a0b-56f0-44b2-b060-4bc408b3ce84 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:52.247226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e11e7-50c4-4212-8141-1111e5f8bc28 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae34626e00004905aa22c796f023f43a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5c93207573c4eed876959299ccaa1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:52.248018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e11e7-50c4-4212-8141-1111e5f8bc28 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:52.248371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e11e7-50c4-4212-8141-1111e5f8bc28 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:52.248721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e11e7-50c4-4212-8141-1111e5f8bc28 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] PATH_INFO: `/v3/roles/26c1dc31fe7c4b1490ec100578e3288a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:52.252892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e11e7-50c4-4212-8141-1111e5f8bc28 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] RBAC: Authorizing `identity:delete_role(role_id=26c1dc31fe7c4b1490ec100578e3288a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:52.254105 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-b96e11e7-50c4-4212-8141-1111e5f8bc28 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:20:52.254105 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:20:52.254105 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:20:52.255173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e11e7-50c4-4212-8141-1111e5f8bc28 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:52.371575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b96e11e7-50c4-4212-8141-1111e5f8bc28 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] Invalidating the token cache because role 26c1dc31fe7c4b1490ec100578e3288a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:52.371939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b96e11e7-50c4-4212-8141-1111e5f8bc28 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:52.372798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b96e11e7-50c4-4212-8141-1111e5f8bc28 tempest-ApplicationCredentialsV3AdminTest-1798559870 tempest-ApplicationCredentialsV3AdminTest-1798559870-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:52.400961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3954ba-5cd9-4ffd-931c-bd37c279bd83 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:52.403304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7b3954ba-5cd9-4ffd-931c-bd37c279bd83 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:52.404515 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2228/4434] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:52 2022] DELETE /identity/v3/roles/26c1dc31fe7c4b1490ec100578e3288a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:52.471096 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:52.564409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3954ba-5cd9-4ffd-931c-bd37c279bd83 tempest-ApplicationCredentialsV3AdminTest-1665875350 tempest-ApplicationCredentialsV3AdminTest-1665875350-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:52.671358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:52.672128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:52.672652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:52.672780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] PATH_INFO: `/v3/users/42523362a9ea4812b3f3b9003e0cb1d3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:52.676586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=42523362a9ea4812b3f3b9003e0cb1d3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:52.681690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:52.763303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42523362a9ea4812b3f3b9003e0cb1d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:52.785977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42523362a9ea4812b3f3b9003e0cb1d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:52.787120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42523362a9ea4812b3f3b9003e0cb1d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:52.802868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42523362a9ea4812b3f3b9003e0cb1d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:52.816922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42523362a9ea4812b3f3b9003e0cb1d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:52.826572 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2207/4435] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:52 2022] DELETE /identity/v3/users/42523362a9ea4812b3f3b9003e0cb1d3 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:52.831379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc89c-1188-4fb4-9dce-e85bd265cbc0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:52.831867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc89c-1188-4fb4-9dce-e85bd265cbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:52.832137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc89c-1188-4fb4-9dce-e85bd265cbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:52.859963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2f3bc89c-1188-4fb4-9dce-e85bd265cbc0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:52.862216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2f3bc89c-1188-4fb4-9dce-e85bd265cbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:52.980724 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2229/4436] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:20:53.007314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:53.010464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:53.122203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc2aaf-9f70-4f63-b63a-9dd68a5861ab admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:53.130308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612af91-9563-4fe0-bac0-fd95299252cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:53.131265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612af91-9563-4fe0-bac0-fd95299252cc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:53.131551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612af91-9563-4fe0-bac0-fd95299252cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:53.131926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612af91-9563-4fe0-bac0-fd95299252cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:53.143059 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:53.147313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612af91-9563-4fe0-bac0-fd95299252cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:53.150299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612af91-9563-4fe0-bac0-fd95299252cc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:53.161797 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2208/4437] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:53.819703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc89c-1188-4fb4-9dce-e85bd265cbc0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:53.822273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2f3bc89c-1188-4fb4-9dce-e85bd265cbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:53.842872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc89c-1188-4fb4-9dce-e85bd265cbc0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:53.849030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:53.850004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:53.850519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:53.851338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] PATH_INFO: `/v3/projects/7ce491666cc04b4db929345acb59c966` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:53.853775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce491666cc04b4db929345acb59c966)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:53.856916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:53.950904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce491666cc04b4db929345acb59c966', 'request_id': 'req-ab02e790-30ec-4775-bcd5-357b43df853d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:53.958439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce491666cc04b4db929345acb59c966', 'request_id': 'req-ab02e790-30ec-4775-bcd5-357b43df853d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:53.973682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce491666cc04b4db929345acb59c966', 'request_id': 'req-ab02e790-30ec-4775-bcd5-357b43df853d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:53.997556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] The token cache is being invalidate because project 7ce491666cc04b4db929345acb59c966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:53.998154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:53.999013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:54.001265 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2230/4438] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:53 2022] DELETE /identity/v3/projects/7ce491666cc04b4db929345acb59c966 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:54.005235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612af91-9563-4fe0-bac0-fd95299252cc service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:54.018761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612af91-9563-4fe0-bac0-fd95299252cc service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:54.139444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81313b-3df4-4b4c-bf7e-d67057df21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:54.140197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81313b-3df4-4b4c-bf7e-d67057df21eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:54.140916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81313b-3df4-4b4c-bf7e-d67057df21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:54.141328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81313b-3df4-4b4c-bf7e-d67057df21eb admin admin] PATH_INFO: `/v3/users/ae34626e00004905aa22c796f023f43a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:54.143394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81313b-3df4-4b4c-bf7e-d67057df21eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae34626e00004905aa22c796f023f43a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:54.145872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81313b-3df4-4b4c-bf7e-d67057df21eb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:54.273059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e81313b-3df4-4b4c-bf7e-d67057df21eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae34626e00004905aa22c796f023f43a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:54.311416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e81313b-3df4-4b4c-bf7e-d67057df21eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae34626e00004905aa22c796f023f43a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:54.312190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e81313b-3df4-4b4c-bf7e-d67057df21eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae34626e00004905aa22c796f023f43a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:54.325350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e81313b-3df4-4b4c-bf7e-d67057df21eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae34626e00004905aa22c796f023f43a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:54.336682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e81313b-3df4-4b4c-bf7e-d67057df21eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae34626e00004905aa22c796f023f43a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:54.366725 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2209/4439] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:54 2022] DELETE /identity/v3/users/ae34626e00004905aa22c796f023f43a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:54.873440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:54.876477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:54.907732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02e790-30ec-4775-bcd5-357b43df853d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:55.002838 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:55.030746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:55.031438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:55.031718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:55.032214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] PATH_INFO: `/v3/projects/e5c93207573c4eed876959299ccaa1b3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:55.033545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c93207573c4eed876959299ccaa1b3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:55.036585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:55.103176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c93207573c4eed876959299ccaa1b3', 'request_id': 'req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:55.109936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c93207573c4eed876959299ccaa1b3', 'request_id': 'req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:55.124456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c93207573c4eed876959299ccaa1b3', 'request_id': 'req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:55.143485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] The token cache is being invalidate because project e5c93207573c4eed876959299ccaa1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:55.143848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:55.144833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c6725f-6230-4ae6-8c8f-b7c4881915f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:55.146938 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2231/4440] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:54 2022] DELETE /identity/v3/projects/e5c93207573c4eed876959299ccaa1b3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:55.152289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dcd53-a636-4186-acc2-38146d286dbc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:55.152804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dcd53-a636-4186-acc2-38146d286dbc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:55.152804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dcd53-a636-4186-acc2-38146d286dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:55.175708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-503dcd53-a636-4186-acc2-38146d286dbc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:55.176935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-503dcd53-a636-4186-acc2-38146d286dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:55.252114 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2210/4441] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:55.262314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada5e79-d581-4dae-9a76-5692bab404d3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:55.265033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada5e79-d581-4dae-9a76-5692bab404d3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:55.265199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada5e79-d581-4dae-9a76-5692bab404d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:55.290299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-aada5e79-d581-4dae-9a76-5692bab404d3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:55.291562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-aada5e79-d581-4dae-9a76-5692bab404d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:55.311879 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2232/4442] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:20:55.315881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dcd53-a636-4186-acc2-38146d286dbc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:55.327322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dcd53-a636-4186-acc2-38146d286dbc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:55.333792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dfec8-3a63-4926-b83e-02a375668e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:55.336395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dfec8-3a63-4926-b83e-02a375668e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:55.337185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dfec8-3a63-4926-b83e-02a375668e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:55.337745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dfec8-3a63-4926-b83e-02a375668e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:55.338704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dfec8-3a63-4926-b83e-02a375668e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:20:55.339563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dfec8-3a63-4926-b83e-02a375668e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:55.341614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dfec8-3a63-4926-b83e-02a375668e36 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:55.366111 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:55.366453 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2211/4443] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:20:55.370394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada5e79-d581-4dae-9a76-5692bab404d3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:55.388000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada5e79-d581-4dae-9a76-5692bab404d3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:55.422704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008969f5-f669-4b9a-9f19-42dbe4baeaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:55.423388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008969f5-f669-4b9a-9f19-42dbe4baeaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:55.424407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008969f5-f669-4b9a-9f19-42dbe4baeaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:55.424693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008969f5-f669-4b9a-9f19-42dbe4baeaf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:55.425331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008969f5-f669-4b9a-9f19-42dbe4baeaf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:55.427392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008969f5-f669-4b9a-9f19-42dbe4baeaf7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:55.467014 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2233/4444] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:20:55 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:55.468920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dfec8-3a63-4926-b83e-02a375668e36 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:55.481416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dfec8-3a63-4926-b83e-02a375668e36 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:55.562567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8824b7f-4e90-40af-914c-5fbcf843580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:55.563219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8824b7f-4e90-40af-914c-5fbcf843580e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:55.563506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8824b7f-4e90-40af-914c-5fbcf843580e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:55.563778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8824b7f-4e90-40af-914c-5fbcf843580e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:55.564473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8824b7f-4e90-40af-914c-5fbcf843580e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:55.566446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8824b7f-4e90-40af-914c-5fbcf843580e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:55.603445 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2212/4445] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:20:55 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:20:55.607755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008969f5-f669-4b9a-9f19-42dbe4baeaf7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:55.620471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008969f5-f669-4b9a-9f19-42dbe4baeaf7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:55.627495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7114d-ac54-4e87-bcae-14c5ac2a936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:55.628949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7114d-ac54-4e87-bcae-14c5ac2a936b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:55.628949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7114d-ac54-4e87-bcae-14c5ac2a936b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:55.629165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7114d-ac54-4e87-bcae-14c5ac2a936b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:55.631299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7114d-ac54-4e87-bcae-14c5ac2a936b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:55.637024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7114d-ac54-4e87-bcae-14c5ac2a936b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:55.660849 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2234/4446] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:20:55.665933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8824b7f-4e90-40af-914c-5fbcf843580e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:55.679783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8824b7f-4e90-40af-914c-5fbcf843580e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:55.688979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b4c02-d5bb-4ea0-9052-ea9d1e10a3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:55.689617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b4c02-d5bb-4ea0-9052-ea9d1e10a3ef admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:55.689915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b4c02-d5bb-4ea0-9052-ea9d1e10a3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:55.690354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b4c02-d5bb-4ea0-9052-ea9d1e10a3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:55.691056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b4c02-d5bb-4ea0-9052-ea9d1e10a3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:55.693611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b4c02-d5bb-4ea0-9052-ea9d1e10a3ef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:55.712989 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2213/4447] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:55.721807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7114d-ac54-4e87-bcae-14c5ac2a936b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:55.738430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7114d-ac54-4e87-bcae-14c5ac2a936b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:55.744872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771174aa-22f0-4f31-b089-73a7c0453636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:55.745702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771174aa-22f0-4f31-b089-73a7c0453636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:55.746102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771174aa-22f0-4f31-b089-73a7c0453636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:55.746389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771174aa-22f0-4f31-b089-73a7c0453636 admin admin] PATH_INFO: `/v3/projects/a6f09046ce3c4c12a5b1a18d23ac0678/users/da2ff429df8e4994a7f6a2599160d524/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:55.775696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771174aa-22f0-4f31-b089-73a7c0453636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f09046ce3c4c12a5b1a18d23ac0678, user_id=da2ff429df8e4994a7f6a2599160d524, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:55.781380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771174aa-22f0-4f31-b089-73a7c0453636 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:55.824234 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2235/4448] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:55 2022] PUT /identity/v3/projects/a6f09046ce3c4c12a5b1a18d23ac0678/users/da2ff429df8e4994a7f6a2599160d524/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:55.834282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0011ed-ce5d-4ffa-917d-cd4816686943 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:55.834984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0011ed-ce5d-4ffa-917d-cd4816686943 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:55.835407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0011ed-ce5d-4ffa-917d-cd4816686943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:55.880500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6e0011ed-ce5d-4ffa-917d-cd4816686943 None None] MFA Rules not processed for user `da2ff429df8e4994a7f6a2599160d524`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:55.881954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6e0011ed-ce5d-4ffa-917d-cd4816686943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:56.036759 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2214/4449] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:56.037843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771174aa-22f0-4f31-b089-73a7c0453636 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:56.191057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771174aa-22f0-4f31-b089-73a7c0453636 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:56.197470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380fcec-0f81-4d1f-99d9-34c4b57776a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:56.198227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380fcec-0f81-4d1f-99d9-34c4b57776a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:56.198792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380fcec-0f81-4d1f-99d9-34c4b57776a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:56.199119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380fcec-0f81-4d1f-99d9-34c4b57776a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:56.199949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380fcec-0f81-4d1f-99d9-34c4b57776a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:56.202027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380fcec-0f81-4d1f-99d9-34c4b57776a8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:56.247087 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:56.280267 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2236/4450] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:20:56 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:56.284086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0011ed-ce5d-4ffa-917d-cd4816686943 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:56.313117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0011ed-ce5d-4ffa-917d-cd4816686943 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:56.409255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05aa243-c129-4821-b9c7-53bbad5e844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:56.409882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aa243-c129-4821-b9c7-53bbad5e844c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:56.410325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aa243-c129-4821-b9c7-53bbad5e844c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:56.410776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aa243-c129-4821-b9c7-53bbad5e844c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:56.411793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05aa243-c129-4821-b9c7-53bbad5e844c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:56.413895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05aa243-c129-4821-b9c7-53bbad5e844c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:56.454129 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:56.465204 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2215/4451] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:20:56 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:56.469136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380fcec-0f81-4d1f-99d9-34c4b57776a8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:56.480420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380fcec-0f81-4d1f-99d9-34c4b57776a8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:56.486241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1a5e1-de4b-4b4a-a833-d61f10a5871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:56.487016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1a5e1-de4b-4b4a-a833-d61f10a5871b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:56.487526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1a5e1-de4b-4b4a-a833-d61f10a5871b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:56.488030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1a5e1-de4b-4b4a-a833-d61f10a5871b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:56.488908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1a5e1-de4b-4b4a-a833-d61f10a5871b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:56.491650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1a5e1-de4b-4b4a-a833-d61f10a5871b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:56.508381 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2237/4452] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:56.509614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05aa243-c129-4821-b9c7-53bbad5e844c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:56.522359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05aa243-c129-4821-b9c7-53bbad5e844c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:56.528850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85212836-9366-46fc-9d7e-05e236eec0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:56.529905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212836-9366-46fc-9d7e-05e236eec0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:56.530459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212836-9366-46fc-9d7e-05e236eec0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:56.531616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212836-9366-46fc-9d7e-05e236eec0b7 admin admin] PATH_INFO: `/v3/projects/f2b7ea520cf24b97b3a2346d98c06461/users/cff4acf0bd8b4ab88bc1d9e3ca56226f/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:56.549212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85212836-9366-46fc-9d7e-05e236eec0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b7ea520cf24b97b3a2346d98c06461, user_id=cff4acf0bd8b4ab88bc1d9e3ca56226f, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:56.552993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85212836-9366-46fc-9d7e-05e236eec0b7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:56.574752 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2216/4453] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:56 2022] PUT /identity/v3/projects/f2b7ea520cf24b97b3a2346d98c06461/users/cff4acf0bd8b4ab88bc1d9e3ca56226f/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:20:56.579014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1a5e1-de4b-4b4a-a833-d61f10a5871b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:56.591397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1a5e1-de4b-4b4a-a833-d61f10a5871b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:56.689254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19df89-5b18-46ea-becb-8392d9d51bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:56.690544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19df89-5b18-46ea-becb-8392d9d51bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:56.691360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19df89-5b18-46ea-becb-8392d9d51bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:56.694099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19df89-5b18-46ea-becb-8392d9d51bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:56.695662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19df89-5b18-46ea-becb-8392d9d51bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:56.697827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19df89-5b18-46ea-becb-8392d9d51bdd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:56.716996 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2238/4454] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:20:56.718190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85212836-9366-46fc-9d7e-05e236eec0b7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:56.729340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85212836-9366-46fc-9d7e-05e236eec0b7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:56.735140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0654ca4-ddaa-42ac-8477-aae9d77bb947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:56.735871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654ca4-ddaa-42ac-8477-aae9d77bb947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:56.736268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654ca4-ddaa-42ac-8477-aae9d77bb947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:56.736546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654ca4-ddaa-42ac-8477-aae9d77bb947 admin admin] PATH_INFO: `/v3/projects/f2b7ea520cf24b97b3a2346d98c06461/users/cff4acf0bd8b4ab88bc1d9e3ca56226f/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:56.738853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0654ca4-ddaa-42ac-8477-aae9d77bb947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b7ea520cf24b97b3a2346d98c06461, user_id=cff4acf0bd8b4ab88bc1d9e3ca56226f, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:56.741662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0654ca4-ddaa-42ac-8477-aae9d77bb947 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:56.770808 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2217/4455] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:56 2022] PUT /identity/v3/projects/f2b7ea520cf24b97b3a2346d98c06461/users/cff4acf0bd8b4ab88bc1d9e3ca56226f/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:56.773124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e4a0-9fbb-42d2-9800-a9de0596faf1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:56.773411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e4a0-9fbb-42d2-9800-a9de0596faf1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:56.774383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e4a0-9fbb-42d2-9800-a9de0596faf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:56.818694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-82c2e4a0-9fbb-42d2-9800-a9de0596faf1 None None] MFA Rules not processed for user `cff4acf0bd8b4ab88bc1d9e3ca56226f`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:56.821537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-82c2e4a0-9fbb-42d2-9800-a9de0596faf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:56.926659 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2239/4456] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:56.929081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0654ca4-ddaa-42ac-8477-aae9d77bb947 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:56.941346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0654ca4-ddaa-42ac-8477-aae9d77bb947 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:56.949206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdfeb3-3ec2-4bc0-889b-7ef12197077f tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff4acf0bd8b4ab88bc1d9e3ca56226f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b7ea520cf24b97b3a2346d98c06461', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:56.949835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdfeb3-3ec2-4bc0-889b-7ef12197077f tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:56.950115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdfeb3-3ec2-4bc0-889b-7ef12197077f tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:56.950405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdfeb3-3ec2-4bc0-889b-7ef12197077f tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:56.951097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdfeb3-3ec2-4bc0-889b-7ef12197077f tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:56.952735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdfeb3-3ec2-4bc0-889b-7ef12197077f tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:56.995825 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2218/4457] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:20:56 2022] POST /identity/v3/domains => generated 246 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:56.996661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e4a0-9fbb-42d2-9800-a9de0596faf1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:57.007567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e4a0-9fbb-42d2-9800-a9de0596faf1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:57.083853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be56d86-5da3-425c-83a7-429fe1180a5b tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff4acf0bd8b4ab88bc1d9e3ca56226f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b7ea520cf24b97b3a2346d98c06461', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:57.084502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be56d86-5da3-425c-83a7-429fe1180a5b tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:57.084687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be56d86-5da3-425c-83a7-429fe1180a5b tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:57.084975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be56d86-5da3-425c-83a7-429fe1180a5b tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:57.085624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be56d86-5da3-425c-83a7-429fe1180a5b tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:57.088364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be56d86-5da3-425c-83a7-429fe1180a5b tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:57.098950 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:57.149314 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2240/4458] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:20:56 2022] POST /identity/v3/projects => generated 407 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:20:57.151029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdfeb3-3ec2-4bc0-889b-7ef12197077f tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:57.173094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdfeb3-3ec2-4bc0-889b-7ef12197077f tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:57.239842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594855d7-f2e3-4683-84f6-c597f25986cf tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff4acf0bd8b4ab88bc1d9e3ca56226f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b7ea520cf24b97b3a2346d98c06461', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:57.240514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594855d7-f2e3-4683-84f6-c597f25986cf tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:57.240846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594855d7-f2e3-4683-84f6-c597f25986cf tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:57.241084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594855d7-f2e3-4683-84f6-c597f25986cf tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:57.241921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594855d7-f2e3-4683-84f6-c597f25986cf tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:57.244600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594855d7-f2e3-4683-84f6-c597f25986cf tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:57.276004 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2219/4459] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:20:57 2022] POST /identity/v3/users => generated 348 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:20:57.280253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be56d86-5da3-425c-83a7-429fe1180a5b tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:57.291085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be56d86-5da3-425c-83a7-429fe1180a5b tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:57.295703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f0d71-0bd9-4ae6-b474-ffc2f86e88af tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff4acf0bd8b4ab88bc1d9e3ca56226f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b7ea520cf24b97b3a2346d98c06461', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:57.296416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f0d71-0bd9-4ae6-b474-ffc2f86e88af tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:57.296721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f0d71-0bd9-4ae6-b474-ffc2f86e88af tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:57.297014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f0d71-0bd9-4ae6-b474-ffc2f86e88af tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:57.297655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f0d71-0bd9-4ae6-b474-ffc2f86e88af tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:57.299990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f0d71-0bd9-4ae6-b474-ffc2f86e88af tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:57.312315 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2241/4460] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:20:57.316178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594855d7-f2e3-4683-84f6-c597f25986cf tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:57.327099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594855d7-f2e3-4683-84f6-c597f25986cf tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:57.332519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fffb4-44e2-4774-a983-18fa11ee0117 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff4acf0bd8b4ab88bc1d9e3ca56226f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b7ea520cf24b97b3a2346d98c06461', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:57.333189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fffb4-44e2-4774-a983-18fa11ee0117 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:57.333473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fffb4-44e2-4774-a983-18fa11ee0117 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:57.333753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fffb4-44e2-4774-a983-18fa11ee0117 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] PATH_INFO: `/v3/projects/99db1d64d6fb445a8b8f9857d770c7e6/users/31cc0339dfd244e4b9e3cd470fc5b38b/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:57.350259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fffb4-44e2-4774-a983-18fa11ee0117 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorizing `identity:create_grant(project_id=99db1d64d6fb445a8b8f9857d770c7e6, user_id=31cc0339dfd244e4b9e3cd470fc5b38b, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:57.353158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fffb4-44e2-4774-a983-18fa11ee0117 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:57.369203 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2220/4461] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:20:57 2022] PUT /identity/v3/projects/99db1d64d6fb445a8b8f9857d770c7e6/users/31cc0339dfd244e4b9e3cd470fc5b38b/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:57.373678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44500ecd-9b63-4c22-b8a0-83d677caaf1b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:57.374063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44500ecd-9b63-4c22-b8a0-83d677caaf1b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:57.374415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44500ecd-9b63-4c22-b8a0-83d677caaf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:57.478425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-44500ecd-9b63-4c22-b8a0-83d677caaf1b None None] MFA Rules not processed for user `31cc0339dfd244e4b9e3cd470fc5b38b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:57.479759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-44500ecd-9b63-4c22-b8a0-83d677caaf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:57.496482 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2242/4462] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:57.507245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b863b93-4dcf-4bc1-bd99-52ac9908a1a0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:57.507620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b863b93-4dcf-4bc1-bd99-52ac9908a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:57.508547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b863b93-4dcf-4bc1-bd99-52ac9908a1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:57.530194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2b863b93-4dcf-4bc1-bd99-52ac9908a1a0 None None] MFA Rules not processed for user `31cc0339dfd244e4b9e3cd470fc5b38b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:57.531471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2b863b93-4dcf-4bc1-bd99-52ac9908a1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:57.538713 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2221/4463] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:20:57.543883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44500ecd-9b63-4c22-b8a0-83d677caaf1b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:57.554059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44500ecd-9b63-4c22-b8a0-83d677caaf1b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:57.566843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59628d6-72b2-4899-b3fa-ac79e9d5b8d9 tempest-test_project-53820553 tempest-user-1227583536] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cc0339dfd244e4b9e3cd470fc5b38b', 'user_domain_id': 'fc41d449145744e5b5ffefd3ac4684dd', 'system_scope': None, 'project_id': '99db1d64d6fb445a8b8f9857d770c7e6', 'project_domain_id': 'fc41d449145744e5b5ffefd3ac4684dd', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:57.567901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59628d6-72b2-4899-b3fa-ac79e9d5b8d9 tempest-test_project-53820553 tempest-user-1227583536] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:57.568282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59628d6-72b2-4899-b3fa-ac79e9d5b8d9 tempest-test_project-53820553 tempest-user-1227583536] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:57.568655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59628d6-72b2-4899-b3fa-ac79e9d5b8d9 tempest-test_project-53820553 tempest-user-1227583536] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:57.578794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59628d6-72b2-4899-b3fa-ac79e9d5b8d9 tempest-test_project-53820553 tempest-user-1227583536] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:57.580556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59628d6-72b2-4899-b3fa-ac79e9d5b8d9 tempest-test_project-53820553 tempest-user-1227583536] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:57.589749 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2243/4464] 10.222.0.23 () {56 vars in 1284 bytes} [Sun Oct 2 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3361 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:20:57.594390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b863b93-4dcf-4bc1-bd99-52ac9908a1a0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:57.666809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b863b93-4dcf-4bc1-bd99-52ac9908a1a0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:57.681488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff4acf0bd8b4ab88bc1d9e3ca56226f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b7ea520cf24b97b3a2346d98c06461', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:57.682878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:57.683273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:57.685881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] PATH_INFO: `/v3/users/31cc0339dfd244e4b9e3cd470fc5b38b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:57.688025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorizing `identity:delete_user(user_id=31cc0339dfd244e4b9e3cd470fc5b38b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:57.691326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:57.701509 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:57.775933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31cc0339dfd244e4b9e3cd470fc5b38b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:57.802399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31cc0339dfd244e4b9e3cd470fc5b38b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:57.804317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31cc0339dfd244e4b9e3cd470fc5b38b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:57.822842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31cc0339dfd244e4b9e3cd470fc5b38b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:57.833194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31cc0339dfd244e4b9e3cd470fc5b38b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:57.841696 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2222/4465] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:57 2022] DELETE /identity/v3/users/31cc0339dfd244e4b9e3cd470fc5b38b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:57.845522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59628d6-72b2-4899-b3fa-ac79e9d5b8d9 tempest-test_project-53820553 tempest-user-1227583536] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:57.858039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59628d6-72b2-4899-b3fa-ac79e9d5b8d9 tempest-test_project-53820553 tempest-user-1227583536] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:57.925623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff4acf0bd8b4ab88bc1d9e3ca56226f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b7ea520cf24b97b3a2346d98c06461', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:57.926391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:57.926708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:57.926980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] PATH_INFO: `/v3/projects/99db1d64d6fb445a8b8f9857d770c7e6` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:57.929053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorizing `identity:delete_project(project_id=99db1d64d6fb445a8b8f9857d770c7e6)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:57.931460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:57.995576 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:58.018974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99db1d64d6fb445a8b8f9857d770c7e6', 'request_id': 'req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.027373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99db1d64d6fb445a8b8f9857d770c7e6', 'request_id': 'req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.035266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99db1d64d6fb445a8b8f9857d770c7e6', 'request_id': 'req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.057632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] The token cache is being invalidate because project 99db1d64d6fb445a8b8f9857d770c7e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:58.057955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.059194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.065114 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2244/4466] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:20:57 2022] DELETE /identity/v3/projects/99db1d64d6fb445a8b8f9857d770c7e6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:58.066377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:58.068621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:58.088732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cf06a-ab15-4077-b08e-061bb561fb68 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:58.176245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff4acf0bd8b4ab88bc1d9e3ca56226f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b7ea520cf24b97b3a2346d98c06461', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:58.177292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:58.177642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:58.177924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] PATH_INFO: `/v3/domains/fc41d449145744e5b5ffefd3ac4684dd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:58.183520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fc41d449145744e5b5ffefd3ac4684dd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:58.185074 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:20:58.185074 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:20:58.185074 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:20:58.186845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:58.248273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.249180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.316037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.316920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.322841 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2223/4467] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:20:58 2022] PATCH /identity/v3/domains/fc41d449145744e5b5ffefd3ac4684dd => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:20:58.324466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:58.326460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:58.344318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd47c6c-2951-4756-a31a-3fe3c1e5c521 tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:58.424845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff4acf0bd8b4ab88bc1d9e3ca56226f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b7ea520cf24b97b3a2346d98c06461', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:58.426084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:58.427196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:58.427719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] PATH_INFO: `/v3/domains/fc41d449145744e5b5ffefd3ac4684dd` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:58.443941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fc41d449145744e5b5ffefd3ac4684dd)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:58.446705 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:20:58.446705 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:20:58.446705 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:20:58.448169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:58.481286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.487897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.573799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd', 'request_id': 'req-3b9e037d-6649-4e3a-a6dd-b57a6168089e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.596854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd', 'request_id': 'req-3b9e037d-6649-4e3a-a6dd-b57a6168089e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.611560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd', 'request_id': 'req-3b9e037d-6649-4e3a-a6dd-b57a6168089e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.639390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] The token cache is being invalidate because project fc41d449145744e5b5ffefd3ac4684dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:20:58.639820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.640631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.657491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd', 'request_id': 'req-3b9e037d-6649-4e3a-a6dd-b57a6168089e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.659422 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:58.662509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd', 'request_id': 'req-3b9e037d-6649-4e3a-a6dd-b57a6168089e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.663369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b9e037d-6649-4e3a-a6dd-b57a6168089e tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fc41d449145744e5b5ffefd3ac4684dd', 'request_id': 'req-3b9e037d-6649-4e3a-a6dd-b57a6168089e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.671287 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2245/4468] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:20:58 2022] DELETE /identity/v3/domains/fc41d449145744e5b5ffefd3ac4684dd => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:58.676912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:58.679480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:58.762281 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:58.791848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da353468-f37a-41a5-9586-cc395ec297ff tempest-TestDefaultProjectId-517581853 tempest-TestDefaultProjectId-517581853-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:58.868007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:58.870094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:58.870593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:58.871098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] PATH_INFO: `/v3/users/da2ff429df8e4994a7f6a2599160d524` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:58.872541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2ff429df8e4994a7f6a2599160d524)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:58.876004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:58.975536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2ff429df8e4994a7f6a2599160d524'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.993581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2ff429df8e4994a7f6a2599160d524'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:58.995184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2ff429df8e4994a7f6a2599160d524'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:59.017385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2ff429df8e4994a7f6a2599160d524'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:59.028165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2ff429df8e4994a7f6a2599160d524'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:20:59.041004 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2224/4469] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:20:58 2022] DELETE /identity/v3/users/da2ff429df8e4994a7f6a2599160d524 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:20:59.041844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fc1bb-b939-4a70-98f5-fd8c5042c8b9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:59.042134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fc1bb-b939-4a70-98f5-fd8c5042c8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:59.042412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fc1bb-b939-4a70-98f5-fd8c5042c8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:59.068265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-814fc1bb-b939-4a70-98f5-fd8c5042c8b9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:20:59.069491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-814fc1bb-b939-4a70-98f5-fd8c5042c8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:59.221068 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2246/4470] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:20:59.254356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:20:59.256623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:20:59.407971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7770f2-4a21-4061-ad89-20116c4215ef admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:20:59.417899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d347609-9ef5-4064-97cc-bb56ee1301cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:20:59.418751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d347609-9ef5-4064-97cc-bb56ee1301cf service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:20:59.419035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d347609-9ef5-4064-97cc-bb56ee1301cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:20:59.419307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d347609-9ef5-4064-97cc-bb56ee1301cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:20:59.449912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d347609-9ef5-4064-97cc-bb56ee1301cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:20:59.451330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d347609-9ef5-4064-97cc-bb56ee1301cf service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:20:59.479653 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2225/4471] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:01.691890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fc1bb-b939-4a70-98f5-fd8c5042c8b9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:01.693627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-814fc1bb-b939-4a70-98f5-fd8c5042c8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:01.713920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fc1bb-b939-4a70-98f5-fd8c5042c8b9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:01.733800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:01.734647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:01.734783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:01.735055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] PATH_INFO: `/v3/projects/a6f09046ce3c4c12a5b1a18d23ac0678` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:01.740233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f09046ce3c4c12a5b1a18d23ac0678)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:01.744159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:01.850100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f09046ce3c4c12a5b1a18d23ac0678', 'request_id': 'req-01c0181d-4622-4d9e-9126-1fc305f745b7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:01.858421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f09046ce3c4c12a5b1a18d23ac0678', 'request_id': 'req-01c0181d-4622-4d9e-9126-1fc305f745b7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:01.867618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f09046ce3c4c12a5b1a18d23ac0678', 'request_id': 'req-01c0181d-4622-4d9e-9126-1fc305f745b7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:01.893269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] The token cache is being invalidate because project a6f09046ce3c4c12a5b1a18d23ac0678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:01.894028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:01.896096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:01.902518 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2247/4472] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:01 2022] DELETE /identity/v3/projects/a6f09046ce3c4c12a5b1a18d23ac0678 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:01.905444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d347609-9ef5-4064-97cc-bb56ee1301cf service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:01.930821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d347609-9ef5-4064-97cc-bb56ee1301cf service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:01.968852 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:02.088564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:02.088874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:02.089158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:02.089430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] PATH_INFO: `/v3/users/cff4acf0bd8b4ab88bc1d9e3ca56226f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:02.096366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cff4acf0bd8b4ab88bc1d9e3ca56226f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:02.098411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:02.261489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cff4acf0bd8b4ab88bc1d9e3ca56226f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:02.295924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cff4acf0bd8b4ab88bc1d9e3ca56226f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:02.297273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cff4acf0bd8b4ab88bc1d9e3ca56226f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:02.315285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cff4acf0bd8b4ab88bc1d9e3ca56226f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:02.338352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cff4acf0bd8b4ab88bc1d9e3ca56226f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:02.349422 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2226/4473] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:01 2022] DELETE /identity/v3/users/cff4acf0bd8b4ab88bc1d9e3ca56226f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:02.652770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:02.653454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:02.685202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0181d-4622-4d9e-9126-1fc305f745b7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:02.807364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:02.807983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:02.808065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:02.808464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] PATH_INFO: `/v3/users/c503b01d3a53481c9ded936a0a3f6c9f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:02.809698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c503b01d3a53481c9ded936a0a3f6c9f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:02.811894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:02.845051 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:02.894296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c503b01d3a53481c9ded936a0a3f6c9f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:02.928756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c503b01d3a53481c9ded936a0a3f6c9f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:02.929802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c503b01d3a53481c9ded936a0a3f6c9f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:02.942257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c503b01d3a53481c9ded936a0a3f6c9f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:02.943075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c503b01d3a53481c9ded936a0a3f6c9f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:03.003891 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2248/4474] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:02 2022] DELETE /identity/v3/users/c503b01d3a53481c9ded936a0a3f6c9f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:03.660557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:03.661857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:03.686768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14539-3a32-4f91-8dfd-ec3ee77c862f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:03.828650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:03.829448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:03.829650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:03.829878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] PATH_INFO: `/v3/projects/f2b7ea520cf24b97b3a2346d98c06461` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:03.831860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b7ea520cf24b97b3a2346d98c06461)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:03.833936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:03.843240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:03.845635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:03.873072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29781b30-9084-43cf-b917-c5c5ca3ab6ff admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:03.889212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:03.889870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:03.890154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:03.890432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] PATH_INFO: `/v3/projects/030545ae9fe8466887a79a55199dbe1e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:03.893644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=030545ae9fe8466887a79a55199dbe1e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:03.896022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:03.934812 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:03.949610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b7ea520cf24b97b3a2346d98c06461', 'request_id': 'req-4d115850-a2c8-4bb0-b19a-e9237ee7f186'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:03.963728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b7ea520cf24b97b3a2346d98c06461', 'request_id': 'req-4d115850-a2c8-4bb0-b19a-e9237ee7f186'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:03.982331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b7ea520cf24b97b3a2346d98c06461', 'request_id': 'req-4d115850-a2c8-4bb0-b19a-e9237ee7f186'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:04.010445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] The token cache is being invalidate because project f2b7ea520cf24b97b3a2346d98c06461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:04.010777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:04.012915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d115850-a2c8-4bb0-b19a-e9237ee7f186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:04.019785 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2227/4475] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:03 2022] DELETE /identity/v3/projects/f2b7ea520cf24b97b3a2346d98c06461 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:04.019987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030545ae9fe8466887a79a55199dbe1e', 'request_id': 'req-f38be370-5d04-4a88-b553-ccb8147f4c12'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:04.024539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cd7a8-58b8-4ccc-b2b9-5cbe523ad707 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:04.024932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cd7a8-58b8-4ccc-b2b9-5cbe523ad707 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:04.025204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cd7a8-58b8-4ccc-b2b9-5cbe523ad707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:04.039918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030545ae9fe8466887a79a55199dbe1e', 'request_id': 'req-f38be370-5d04-4a88-b553-ccb8147f4c12'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:04.065488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030545ae9fe8466887a79a55199dbe1e', 'request_id': 'req-f38be370-5d04-4a88-b553-ccb8147f4c12'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:04.093384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9b9cd7a8-58b8-4ccc-b2b9-5cbe523ad707 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:04.100514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b9cd7a8-58b8-4ccc-b2b9-5cbe523ad707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:04.105134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] The token cache is being invalidate because project 030545ae9fe8466887a79a55199dbe1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:04.105430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:04.110889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f38be370-5d04-4a88-b553-ccb8147f4c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:04.117892 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2249/4476] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:03 2022] DELETE /identity/v3/projects/030545ae9fe8466887a79a55199dbe1e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:04.130357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c748ec5-d48b-463b-bc94-b95eebd475fb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:04.135606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c748ec5-d48b-463b-bc94-b95eebd475fb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:04.135888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c748ec5-d48b-463b-bc94-b95eebd475fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:04.194478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4c748ec5-d48b-463b-bc94-b95eebd475fb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:04.196476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4c748ec5-d48b-463b-bc94-b95eebd475fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:04.276624 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2228/4477] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:04.285157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1e912-19da-481e-a56c-a3fc6816dec4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:04.285608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1e912-19da-481e-a56c-a3fc6816dec4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:04.286460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1e912-19da-481e-a56c-a3fc6816dec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:04.334683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-46f1e912-19da-481e-a56c-a3fc6816dec4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:04.337864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-46f1e912-19da-481e-a56c-a3fc6816dec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:04.358977 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2229/4478] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:04.363034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1e912-19da-481e-a56c-a3fc6816dec4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:04.370094 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2250/4479] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:04.377342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1e912-19da-481e-a56c-a3fc6816dec4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:04.379134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ee09-6f84-4e6a-ad4b-4b297a630583 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:04.379409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ee09-6f84-4e6a-ad4b-4b297a630583 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:04.379685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ee09-6f84-4e6a-ad4b-4b297a630583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:04.408644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf731d-c65b-45fd-b859-78bab85f2d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:04.409376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf731d-c65b-45fd-b859-78bab85f2d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:04.411000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf731d-c65b-45fd-b859-78bab85f2d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:04.411730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf731d-c65b-45fd-b859-78bab85f2d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:04.411969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf731d-c65b-45fd-b859-78bab85f2d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:21:04.412277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf731d-c65b-45fd-b859-78bab85f2d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:04.414516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf731d-c65b-45fd-b859-78bab85f2d0e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:04.437744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a3f2ee09-6f84-4e6a-ad4b-4b297a630583 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:04.439030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a3f2ee09-6f84-4e6a-ad4b-4b297a630583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:04.465307 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2230/4480] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:21:04.467611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf731d-c65b-45fd-b859-78bab85f2d0e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:04.475246 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2251/4481] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:21:04.476987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2ee09-6f84-4e6a-ad4b-4b297a630583 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:04.506306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf731d-c65b-45fd-b859-78bab85f2d0e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:04.509666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2ee09-6f84-4e6a-ad4b-4b297a630583 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:04.525137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d770f-2fed-484e-8906-af4e8ff6e221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:04.526136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d770f-2fed-484e-8906-af4e8ff6e221 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:04.526411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d770f-2fed-484e-8906-af4e8ff6e221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:04.526751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d770f-2fed-484e-8906-af4e8ff6e221 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:04.528407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d770f-2fed-484e-8906-af4e8ff6e221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:04.532190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d770f-2fed-484e-8906-af4e8ff6e221 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:04.534342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9354c-6966-46c7-acff-9534b6d03dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:04.535008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9354c-6966-46c7-acff-9534b6d03dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:04.535280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9354c-6966-46c7-acff-9534b6d03dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:04.538049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9354c-6966-46c7-acff-9534b6d03dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:04.539726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9354c-6966-46c7-acff-9534b6d03dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:21:04.540306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9354c-6966-46c7-acff-9534b6d03dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:04.552602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9354c-6966-46c7-acff-9534b6d03dcc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:04.598038 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:04.611885 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2252/4482] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:21:04.613854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9354c-6966-46c7-acff-9534b6d03dcc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:04.634738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9354c-6966-46c7-acff-9534b6d03dcc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:04.637024 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2231/4483] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:04 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:04.641977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d770f-2fed-484e-8906-af4e8ff6e221 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:04.809744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d770f-2fed-484e-8906-af4e8ff6e221 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:04.812537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742bf5b-9f5e-45a6-a108-081f402de398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:04.813357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742bf5b-9f5e-45a6-a108-081f402de398 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:04.813797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742bf5b-9f5e-45a6-a108-081f402de398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:04.814219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742bf5b-9f5e-45a6-a108-081f402de398 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:04.815034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742bf5b-9f5e-45a6-a108-081f402de398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:04.817479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742bf5b-9f5e-45a6-a108-081f402de398 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:04.825939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e19ef-7a0e-4724-a690-111cfb7ea35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:04.826928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e19ef-7a0e-4724-a690-111cfb7ea35b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:04.827365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e19ef-7a0e-4724-a690-111cfb7ea35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:04.827819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e19ef-7a0e-4724-a690-111cfb7ea35b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:04.830340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e19ef-7a0e-4724-a690-111cfb7ea35b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:04.833788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e19ef-7a0e-4724-a690-111cfb7ea35b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:04.890434 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2232/4484] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:04 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:04.895088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e19ef-7a0e-4724-a690-111cfb7ea35b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:04.896828 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2253/4485] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:04 2022] POST /identity/v3/projects => generated 391 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:04.900876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742bf5b-9f5e-45a6-a108-081f402de398 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:04.919708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e19ef-7a0e-4724-a690-111cfb7ea35b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:04.952980 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:05.067628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742bf5b-9f5e-45a6-a108-081f402de398 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:05.073913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e193b-9025-4e4e-873e-300b2eb5bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:05.074711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e193b-9025-4e4e-873e-300b2eb5bc5c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.075147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e193b-9025-4e4e-873e-300b2eb5bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.076786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e193b-9025-4e4e-873e-300b2eb5bc5c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.077549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e193b-9025-4e4e-873e-300b2eb5bc5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:05.079761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e193b-9025-4e4e-873e-300b2eb5bc5c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:05.084108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eae9c-5c60-44ac-aa11-1722d9384851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:05.084736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eae9c-5c60-44ac-aa11-1722d9384851 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.085020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eae9c-5c60-44ac-aa11-1722d9384851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.085331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eae9c-5c60-44ac-aa11-1722d9384851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.086563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791eae9c-5c60-44ac-aa11-1722d9384851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:05.089849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791eae9c-5c60-44ac-aa11-1722d9384851 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:05.114216 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2233/4486] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:05.119944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eae9c-5c60-44ac-aa11-1722d9384851 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:05.124825 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2254/4487] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:04 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:05.126154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e193b-9025-4e4e-873e-300b2eb5bc5c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:05.138653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eae9c-5c60-44ac-aa11-1722d9384851 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:05.151666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fef6e6-90af-489b-a582-8a554570186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:05.152571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fef6e6-90af-489b-a582-8a554570186f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.152697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fef6e6-90af-489b-a582-8a554570186f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.152942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fef6e6-90af-489b-a582-8a554570186f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.153825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fef6e6-90af-489b-a582-8a554570186f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:05.157852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fef6e6-90af-489b-a582-8a554570186f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:05.161308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e193b-9025-4e4e-873e-300b2eb5bc5c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:05.176438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcebed2-a2b4-4455-82e4-ae3c8054fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:05.178032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcebed2-a2b4-4455-82e4-ae3c8054fac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.178540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcebed2-a2b4-4455-82e4-ae3c8054fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.179291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcebed2-a2b4-4455-82e4-ae3c8054fac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.180444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcebed2-a2b4-4455-82e4-ae3c8054fac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:05.182545 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2234/4488] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:21:05.188187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fef6e6-90af-489b-a582-8a554570186f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:05.193522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcebed2-a2b4-4455-82e4-ae3c8054fac9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:05.207794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fef6e6-90af-489b-a582-8a554570186f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:05.219128 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2255/4489] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:05.223079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcebed2-a2b4-4455-82e4-ae3c8054fac9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:05.223538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cca0b-10cc-433e-b1a6-e37108b8672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:05.224240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cca0b-10cc-433e-b1a6-e37108b8672c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.224525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cca0b-10cc-433e-b1a6-e37108b8672c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.224800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cca0b-10cc-433e-b1a6-e37108b8672c admin admin] PATH_INFO: `/v3/projects/133702a004ce464bb740a631c722a401/users/ea01f14a8cd14da184bfe48debb11ba4/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.234558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcebed2-a2b4-4455-82e4-ae3c8054fac9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:05.239425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cab86f-75b5-472a-96ba-29e875b419db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:05.240035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cab86f-75b5-472a-96ba-29e875b419db admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.240335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cab86f-75b5-472a-96ba-29e875b419db admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.240571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cab86f-75b5-472a-96ba-29e875b419db admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.241396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cab86f-75b5-472a-96ba-29e875b419db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:05.243281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cab86f-75b5-472a-96ba-29e875b419db admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:05.256086 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2256/4490] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:21:05.260511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cab86f-75b5-472a-96ba-29e875b419db admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:05.268395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cca0b-10cc-433e-b1a6-e37108b8672c admin admin] RBAC: Authorizing `identity:create_grant(project_id=133702a004ce464bb740a631c722a401, user_id=ea01f14a8cd14da184bfe48debb11ba4, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:05.271627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cca0b-10cc-433e-b1a6-e37108b8672c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:05.276161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cab86f-75b5-472a-96ba-29e875b419db admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:05.283361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a0cf8-3770-4cc9-bc9d-64b252416b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:05.285022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a0cf8-3770-4cc9-bc9d-64b252416b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.285984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a0cf8-3770-4cc9-bc9d-64b252416b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.286520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a0cf8-3770-4cc9-bc9d-64b252416b1d admin admin] PATH_INFO: `/v3/projects/64858251a1ff4228adccb029de599d31/users/85d3ffda1a2247e891ef255f3f90ea15/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.300040 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2235/4491] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:05 2022] PUT /identity/v3/projects/133702a004ce464bb740a631c722a401/users/ea01f14a8cd14da184bfe48debb11ba4/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:05.313001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58e7b3-7a2e-4d0f-8213-becc74bd34ab None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.313318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58e7b3-7a2e-4d0f-8213-becc74bd34ab None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.313564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58e7b3-7a2e-4d0f-8213-becc74bd34ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.318701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a0cf8-3770-4cc9-bc9d-64b252416b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64858251a1ff4228adccb029de599d31, user_id=85d3ffda1a2247e891ef255f3f90ea15, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:05.323851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a0cf8-3770-4cc9-bc9d-64b252416b1d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:05.346039 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2257/4492] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:05 2022] PUT /identity/v3/projects/64858251a1ff4228adccb029de599d31/users/85d3ffda1a2247e891ef255f3f90ea15/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:05.354784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea9655-f7cb-4de9-b4db-5e3cbea1739f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.355340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea9655-f7cb-4de9-b4db-5e3cbea1739f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.355795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea9655-f7cb-4de9-b4db-5e3cbea1739f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.371893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8c58e7b3-7a2e-4d0f-8213-becc74bd34ab None None] MFA Rules not processed for user `ea01f14a8cd14da184bfe48debb11ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:05.373054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8c58e7b3-7a2e-4d0f-8213-becc74bd34ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:05.381672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-90ea9655-f7cb-4de9-b4db-5e3cbea1739f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:05.384080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-90ea9655-f7cb-4de9-b4db-5e3cbea1739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:05.456929 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:05.519307 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2258/4493] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:05.545060 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2236/4494] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:21:05.548649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea9655-f7cb-4de9-b4db-5e3cbea1739f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:05.550051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-90ea9655-f7cb-4de9-b4db-5e3cbea1739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:05.557829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58e7b3-7a2e-4d0f-8213-becc74bd34ab None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:05.595341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58e7b3-7a2e-4d0f-8213-becc74bd34ab None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:05.607940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3995ea-cce0-45df-921e-d4df15ec564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:05.608783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3995ea-cce0-45df-921e-d4df15ec564b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.609551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3995ea-cce0-45df-921e-d4df15ec564b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.612251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3995ea-cce0-45df-921e-d4df15ec564b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.613952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3995ea-cce0-45df-921e-d4df15ec564b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:05.617390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3995ea-cce0-45df-921e-d4df15ec564b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:05.659963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea9655-f7cb-4de9-b4db-5e3cbea1739f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:05.666894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b19cb-01f6-4c8e-b505-9618edf89315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:05.667453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b19cb-01f6-4c8e-b505-9618edf89315 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.667756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b19cb-01f6-4c8e-b505-9618edf89315 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.668064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b19cb-01f6-4c8e-b505-9618edf89315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.684640 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2237/4495] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:05 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:05.689641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3995ea-cce0-45df-921e-d4df15ec564b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:05.690019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b19cb-01f6-4c8e-b505-9618edf89315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:05.692070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b19cb-01f6-4c8e-b505-9618edf89315 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:05.732036 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2259/4496] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:05.797293 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:05.834041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3995ea-cce0-45df-921e-d4df15ec564b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:05.843129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc6476-0bc9-4ade-aeb0-a263b7642a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:05.844857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6476-0bc9-4ade-aeb0-a263b7642a16 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.845166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6476-0bc9-4ade-aeb0-a263b7642a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.845446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6476-0bc9-4ade-aeb0-a263b7642a16 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.846972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc6476-0bc9-4ade-aeb0-a263b7642a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:05.849320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc6476-0bc9-4ade-aeb0-a263b7642a16 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:05.912936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b19cb-01f6-4c8e-b505-9618edf89315 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:05.926560 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2238/4497] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:05 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:05.953306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b19cb-01f6-4c8e-b505-9618edf89315 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:05.971996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b722a-3da7-45fe-8d99-19393d301b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:05.973146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b722a-3da7-45fe-8d99-19393d301b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:05.974725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b722a-3da7-45fe-8d99-19393d301b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:05.975303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b722a-3da7-45fe-8d99-19393d301b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:05.978135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b722a-3da7-45fe-8d99-19393d301b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:05.983167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b722a-3da7-45fe-8d99-19393d301b1d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:06.022172 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2260/4498] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:06.024026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc6476-0bc9-4ade-aeb0-a263b7642a16 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:06.052825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc6476-0bc9-4ade-aeb0-a263b7642a16 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:06.063116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c420c1c-181c-4ff9-8221-8271e41833e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:06.064034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420c1c-181c-4ff9-8221-8271e41833e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:06.064347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420c1c-181c-4ff9-8221-8271e41833e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:06.065948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420c1c-181c-4ff9-8221-8271e41833e0 admin admin] PATH_INFO: `/v3/projects/66e81d3c5904438eb5a9931f6202c4e7/users/1876a238f48c4a5692de28ac6accaa67/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:06.105573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c420c1c-181c-4ff9-8221-8271e41833e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e81d3c5904438eb5a9931f6202c4e7, user_id=1876a238f48c4a5692de28ac6accaa67, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:06.113011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c420c1c-181c-4ff9-8221-8271e41833e0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:06.149064 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2239/4499] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:06 2022] PUT /identity/v3/projects/66e81d3c5904438eb5a9931f6202c4e7/users/1876a238f48c4a5692de28ac6accaa67/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:06.153597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b722a-3da7-45fe-8d99-19393d301b1d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:06.167805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b722a-3da7-45fe-8d99-19393d301b1d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:06.359857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428ea65-d3b7-4d58-b651-620f156996d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:06.362018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428ea65-d3b7-4d58-b651-620f156996d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:06.362316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428ea65-d3b7-4d58-b651-620f156996d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:06.362717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428ea65-d3b7-4d58-b651-620f156996d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:06.363459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428ea65-d3b7-4d58-b651-620f156996d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:06.367861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428ea65-d3b7-4d58-b651-620f156996d3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:06.396001 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2261/4500] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:06.401730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c420c1c-181c-4ff9-8221-8271e41833e0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:06.433575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c420c1c-181c-4ff9-8221-8271e41833e0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:06.446691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783830d4-8dc1-4644-b042-d1e54cbfc560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:06.447661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783830d4-8dc1-4644-b042-d1e54cbfc560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:06.451617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783830d4-8dc1-4644-b042-d1e54cbfc560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:06.451617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783830d4-8dc1-4644-b042-d1e54cbfc560 admin admin] PATH_INFO: `/v3/projects/66e81d3c5904438eb5a9931f6202c4e7/users/1876a238f48c4a5692de28ac6accaa67/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:06.453483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783830d4-8dc1-4644-b042-d1e54cbfc560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e81d3c5904438eb5a9931f6202c4e7, user_id=1876a238f48c4a5692de28ac6accaa67, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:06.470765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783830d4-8dc1-4644-b042-d1e54cbfc560 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:06.512403 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2240/4501] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:06 2022] PUT /identity/v3/projects/66e81d3c5904438eb5a9931f6202c4e7/users/1876a238f48c4a5692de28ac6accaa67/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:06.530422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba964c1-fe57-4426-a4d1-d2cf59b0196b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:06.530648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba964c1-fe57-4426-a4d1-d2cf59b0196b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:06.530938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba964c1-fe57-4426-a4d1-d2cf59b0196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:06.594829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-eba964c1-fe57-4426-a4d1-d2cf59b0196b None None] MFA Rules not processed for user `1876a238f48c4a5692de28ac6accaa67`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:06.598257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eba964c1-fe57-4426-a4d1-d2cf59b0196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:06.713399 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:06.762468 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2262/4502] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:06.767024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783830d4-8dc1-4644-b042-d1e54cbfc560 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:06.952541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783830d4-8dc1-4644-b042-d1e54cbfc560 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:06.959301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974814d-67d1-474d-978d-948b4fab76dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:06.959994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974814d-67d1-474d-978d-948b4fab76dd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:06.960804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974814d-67d1-474d-978d-948b4fab76dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:06.961075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974814d-67d1-474d-978d-948b4fab76dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:06.961728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974814d-67d1-474d-978d-948b4fab76dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:06.965072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974814d-67d1-474d-978d-948b4fab76dd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:07.006718 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2241/4503] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:06 2022] POST /identity/v3/projects => generated 369 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:07.011525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba964c1-fe57-4426-a4d1-d2cf59b0196b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:07.023976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d438c9c-a26a-4070-9a5d-d8876d4fdb0d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:07.024736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d438c9c-a26a-4070-9a5d-d8876d4fdb0d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:07.028052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d438c9c-a26a-4070-9a5d-d8876d4fdb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:07.028508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba964c1-fe57-4426-a4d1-d2cf59b0196b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:07.119578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8d438c9c-a26a-4070-9a5d-d8876d4fdb0d None None] MFA Rules not processed for user `b890aa0529304095933195cea870279b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:07.121059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d438c9c-a26a-4070-9a5d-d8876d4fdb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:07.202414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633668-befb-45f5-b9eb-acf78d2302db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:07.203429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633668-befb-45f5-b9eb-acf78d2302db admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:07.203718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633668-befb-45f5-b9eb-acf78d2302db admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:07.205845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633668-befb-45f5-b9eb-acf78d2302db admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:07.207581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d633668-befb-45f5-b9eb-acf78d2302db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:07.211807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d633668-befb-45f5-b9eb-acf78d2302db admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:07.284553 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2263/4504] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:07 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:21:07.288483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633668-befb-45f5-b9eb-acf78d2302db admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:07.324061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633668-befb-45f5-b9eb-acf78d2302db admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:07.339310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81934be-61d7-4735-bcca-769329b8742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:07.339927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81934be-61d7-4735-bcca-769329b8742a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:07.340206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81934be-61d7-4735-bcca-769329b8742a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:07.340475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81934be-61d7-4735-bcca-769329b8742a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:07.341198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81934be-61d7-4735-bcca-769329b8742a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:07.345149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81934be-61d7-4735-bcca-769329b8742a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:07.348323 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2242/4505] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:07.354347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d438c9c-a26a-4070-9a5d-d8876d4fdb0d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:07.365330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d438c9c-a26a-4070-9a5d-d8876d4fdb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:07.373122 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2264/4506] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:07.376111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81934be-61d7-4735-bcca-769329b8742a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:07.397811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81934be-61d7-4735-bcca-769329b8742a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:07.406145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d438c9c-a26a-4070-9a5d-d8876d4fdb0d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:07.413492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398566-4d1b-4a58-aafa-4971db199e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:07.414330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398566-4d1b-4a58-aafa-4971db199e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:07.414832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398566-4d1b-4a58-aafa-4971db199e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:07.415108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398566-4d1b-4a58-aafa-4971db199e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:07.415754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398566-4d1b-4a58-aafa-4971db199e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:07.419443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398566-4d1b-4a58-aafa-4971db199e94 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:07.429337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed87375-f2a3-4070-a295-9d0c1179c049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:07.430420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed87375-f2a3-4070-a295-9d0c1179c049 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:07.430729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed87375-f2a3-4070-a295-9d0c1179c049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:07.431004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed87375-f2a3-4070-a295-9d0c1179c049 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:07.431651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed87375-f2a3-4070-a295-9d0c1179c049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:07.441287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed87375-f2a3-4070-a295-9d0c1179c049 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:07.450972 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2265/4507] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:07.451887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398566-4d1b-4a58-aafa-4971db199e94 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:07.478347 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:07.480304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398566-4d1b-4a58-aafa-4971db199e94 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:07.494922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f709b7-355b-4e4d-8594-4293867ac244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:07.496740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f709b7-355b-4e4d-8594-4293867ac244 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:07.497379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f709b7-355b-4e4d-8594-4293867ac244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:07.498460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f709b7-355b-4e4d-8594-4293867ac244 admin admin] PATH_INFO: `/v3/projects/6a6c253dea6e44778cfc4f7321c1a12f/users/5ed7743886514865821e3fbfec7fdfbe/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:07.525305 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2243/4508] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:07 2022] POST /identity/v3/projects => generated 403 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:07.525305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed87375-f2a3-4070-a295-9d0c1179c049 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:07.540871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f709b7-355b-4e4d-8594-4293867ac244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6c253dea6e44778cfc4f7321c1a12f, user_id=5ed7743886514865821e3fbfec7fdfbe, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:07.545923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f709b7-355b-4e4d-8594-4293867ac244 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:07.580786 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2266/4509] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:07 2022] PUT /identity/v3/projects/6a6c253dea6e44778cfc4f7321c1a12f/users/5ed7743886514865821e3fbfec7fdfbe/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:07.598211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d53ee-ba1c-4d40-ae1d-d10986604426 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:07.598211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d53ee-ba1c-4d40-ae1d-d10986604426 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:07.598211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d53ee-ba1c-4d40-ae1d-d10986604426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:07.661627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d93d53ee-ba1c-4d40-ae1d-d10986604426 None None] MFA Rules not processed for user `5ed7743886514865821e3fbfec7fdfbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:07.664343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d93d53ee-ba1c-4d40-ae1d-d10986604426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:07.680982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed87375-f2a3-4070-a295-9d0c1179c049 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:07.793266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2db80c-85c6-46f9-8185-1e621c0ee8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:07.793902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2db80c-85c6-46f9-8185-1e621c0ee8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:07.794187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2db80c-85c6-46f9-8185-1e621c0ee8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:07.794631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2db80c-85c6-46f9-8185-1e621c0ee8f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:07.795122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2db80c-85c6-46f9-8185-1e621c0ee8f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:07.798342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2db80c-85c6-46f9-8185-1e621c0ee8f5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:07.830147 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2267/4510] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:21:07.832969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d53ee-ba1c-4d40-ae1d-d10986604426 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:07.847358 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2244/4511] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:07 2022] POST /identity/v3/users => generated 302 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:07.849885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2db80c-85c6-46f9-8185-1e621c0ee8f5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:07.875337 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:07.884587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2db80c-85c6-46f9-8185-1e621c0ee8f5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:07.901843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84149dbe-7241-4398-9730-8091dbdbcc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:07.902476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84149dbe-7241-4398-9730-8091dbdbcc2c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:07.902790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84149dbe-7241-4398-9730-8091dbdbcc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:07.903071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84149dbe-7241-4398-9730-8091dbdbcc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:07.903727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84149dbe-7241-4398-9730-8091dbdbcc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:07.905372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84149dbe-7241-4398-9730-8091dbdbcc2c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:07.925541 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2245/4512] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:07.934804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84149dbe-7241-4398-9730-8091dbdbcc2c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:07.957672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84149dbe-7241-4398-9730-8091dbdbcc2c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:07.967965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a0b57-c924-47fd-9a88-197d01a57677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:07.968594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a0b57-c924-47fd-9a88-197d01a57677 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:07.968879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a0b57-c924-47fd-9a88-197d01a57677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:07.969154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a0b57-c924-47fd-9a88-197d01a57677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:07.969809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a0b57-c924-47fd-9a88-197d01a57677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:07.971476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a0b57-c924-47fd-9a88-197d01a57677 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:07.996710 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2246/4513] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:08.000825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a0b57-c924-47fd-9a88-197d01a57677 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:08.006021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d53ee-ba1c-4d40-ae1d-d10986604426 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:08.019341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d517f4-073d-42be-98ba-d47e78c9c387 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:08.020000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d517f4-073d-42be-98ba-d47e78c9c387 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:08.020251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d517f4-073d-42be-98ba-d47e78c9c387 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:08.020524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d517f4-073d-42be-98ba-d47e78c9c387 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:08.020969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a0b57-c924-47fd-9a88-197d01a57677 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:08.021189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d517f4-073d-42be-98ba-d47e78c9c387 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:08.023132 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-72d517f4-073d-42be-98ba-d47e78c9c387 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:21:08.023132 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:21:08.023132 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:21:08.024035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d517f4-073d-42be-98ba-d47e78c9c387 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:08.037315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ba25c-33ee-4b5c-8606-23f99fcee750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:08.038100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ba25c-33ee-4b5c-8606-23f99fcee750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:08.038313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ba25c-33ee-4b5c-8606-23f99fcee750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:08.038587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ba25c-33ee-4b5c-8606-23f99fcee750 admin admin] PATH_INFO: `/v3/projects/29543a5108fa4988863e470031e37cc0/users/1ea58206b2c744e5a153d56bacc5311f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:08.068136 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2268/4514] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:21:07 2022] POST /identity/v3/domains => generated 277 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:21:08.073981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d517f4-073d-42be-98ba-d47e78c9c387 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:08.082465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ba25c-33ee-4b5c-8606-23f99fcee750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29543a5108fa4988863e470031e37cc0, user_id=1ea58206b2c744e5a153d56bacc5311f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:08.085611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ba25c-33ee-4b5c-8606-23f99fcee750 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:08.124678 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2247/4515] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:07 2022] PUT /identity/v3/projects/29543a5108fa4988863e470031e37cc0/users/1ea58206b2c744e5a153d56bacc5311f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:08.199992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d517f4-073d-42be-98ba-d47e78c9c387 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:08.385325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d81da-61dc-47e2-9fb2-bbc6b0fb2cbc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:08.385938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d81da-61dc-47e2-9fb2-bbc6b0fb2cbc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:08.386875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d81da-61dc-47e2-9fb2-bbc6b0fb2cbc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:08.387163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d81da-61dc-47e2-9fb2-bbc6b0fb2cbc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:08.390733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d81da-61dc-47e2-9fb2-bbc6b0fb2cbc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:08.391942 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-df2d81da-61dc-47e2-9fb2-bbc6b0fb2cbc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:21:08.391942 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:21:08.391942 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:21:08.392955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d81da-61dc-47e2-9fb2-bbc6b0fb2cbc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:08.433722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ba25c-33ee-4b5c-8606-23f99fcee750 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:08.439391 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2269/4516] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:21:08 2022] POST /identity/v3/roles => generated 239 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:08.450855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ba25c-33ee-4b5c-8606-23f99fcee750 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:08.461145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d43580-c34a-4599-9adf-bd21e8dbc4ec tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:08.461929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d43580-c34a-4599-9adf-bd21e8dbc4ec tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:08.462283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d43580-c34a-4599-9adf-bd21e8dbc4ec tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:08.462668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d43580-c34a-4599-9adf-bd21e8dbc4ec tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/f167d95b6437474b91b4589d1da7dd94/users/5ed7743886514865821e3fbfec7fdfbe/roles/28099731bd5040e5be35c48b8be66eff` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:08.504004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d43580-c34a-4599-9adf-bd21e8dbc4ec tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f167d95b6437474b91b4589d1da7dd94, user_id=5ed7743886514865821e3fbfec7fdfbe, role_id=28099731bd5040e5be35c48b8be66eff)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:08.512127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d43580-c34a-4599-9adf-bd21e8dbc4ec tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:08.544934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d81da-61dc-47e2-9fb2-bbc6b0fb2cbc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:08.545512 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2248/4517] 10.222.0.23 () {60 vars in 1480 bytes} [Sun Oct 2 01:21:08 2022] PUT /identity/v3/domains/f167d95b6437474b91b4589d1da7dd94/users/5ed7743886514865821e3fbfec7fdfbe/roles/28099731bd5040e5be35c48b8be66eff => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:08.559144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d81da-61dc-47e2-9fb2-bbc6b0fb2cbc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:08.673560 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:08.696373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13ca02-a729-40f3-a0c8-e917f983912b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:08.697011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13ca02-a729-40f3-a0c8-e917f983912b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:08.697297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13ca02-a729-40f3-a0c8-e917f983912b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:08.697576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13ca02-a729-40f3-a0c8-e917f983912b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:08.698253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13ca02-a729-40f3-a0c8-e917f983912b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:08.700135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13ca02-a729-40f3-a0c8-e917f983912b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:08.737856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d43580-c34a-4599-9adf-bd21e8dbc4ec tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:08.738279 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2270/4518] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:21:08 2022] POST /identity/v3/domains => generated 277 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:08.761696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d43580-c34a-4599-9adf-bd21e8dbc4ec tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:08.798819 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:08.879199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df894fe3-75e9-468c-b79a-8fc791f43a87 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:08.880892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df894fe3-75e9-468c-b79a-8fc791f43a87 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:08.881181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df894fe3-75e9-468c-b79a-8fc791f43a87 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:08.881461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df894fe3-75e9-468c-b79a-8fc791f43a87 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:08.900520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df894fe3-75e9-468c-b79a-8fc791f43a87 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:08.902255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df894fe3-75e9-468c-b79a-8fc791f43a87 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:08.940141 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2249/4519] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:21:08 2022] POST /identity/v3/roles => generated 240 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:08.945122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13ca02-a729-40f3-a0c8-e917f983912b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:08.967633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13ca02-a729-40f3-a0c8-e917f983912b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:08.980745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830270d1-8039-4188-b993-29bfcac801e2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:08.981400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830270d1-8039-4188-b993-29bfcac801e2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:08.982339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830270d1-8039-4188-b993-29bfcac801e2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:08.982339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830270d1-8039-4188-b993-29bfcac801e2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/groups` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:08.983295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830270d1-8039-4188-b993-29bfcac801e2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:08.987941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830270d1-8039-4188-b993-29bfcac801e2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:09.044291 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2271/4520] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:21:08 2022] POST /identity/v3/groups => generated 326 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:09.048737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df894fe3-75e9-468c-b79a-8fc791f43a87 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:09.064616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df894fe3-75e9-468c-b79a-8fc791f43a87 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:09.078924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478ed2-b8f2-46c6-b702-f9130811769b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:09.079604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478ed2-b8f2-46c6-b702-f9130811769b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:09.079896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478ed2-b8f2-46c6-b702-f9130811769b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:09.080179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478ed2-b8f2-46c6-b702-f9130811769b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/groups/1a0f6552a00f44cfbd9adc5619f7c668/users/5ed7743886514865821e3fbfec7fdfbe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:09.092071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da478ed2-b8f2-46c6-b702-f9130811769b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=1a0f6552a00f44cfbd9adc5619f7c668, user_id=5ed7743886514865821e3fbfec7fdfbe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:09.094060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da478ed2-b8f2-46c6-b702-f9130811769b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:09.158141 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2250/4521] 10.222.0.23 () {60 vars in 1360 bytes} [Sun Oct 2 01:21:09 2022] PUT /identity/v3/groups/1a0f6552a00f44cfbd9adc5619f7c668/users/5ed7743886514865821e3fbfec7fdfbe => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:09.162515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830270d1-8039-4188-b993-29bfcac801e2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:09.185294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830270d1-8039-4188-b993-29bfcac801e2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:09.323171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025dbcc-8112-4353-9cac-adc82e02c3ac tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:09.324138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025dbcc-8112-4353-9cac-adc82e02c3ac tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:09.324629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025dbcc-8112-4353-9cac-adc82e02c3ac tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:09.325098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025dbcc-8112-4353-9cac-adc82e02c3ac tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/15fb746659f947d9889e5c96c18c938f/groups/1a0f6552a00f44cfbd9adc5619f7c668/roles/79d98302466f4136a10f77fc8b76b148` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:09.331543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025dbcc-8112-4353-9cac-adc82e02c3ac tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=15fb746659f947d9889e5c96c18c938f, group_id=1a0f6552a00f44cfbd9adc5619f7c668, role_id=79d98302466f4136a10f77fc8b76b148)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:09.335248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025dbcc-8112-4353-9cac-adc82e02c3ac tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:09.366095 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2272/4522] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:09 2022] PUT /identity/v3/domains/15fb746659f947d9889e5c96c18c938f/groups/1a0f6552a00f44cfbd9adc5619f7c668/roles/79d98302466f4136a10f77fc8b76b148 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:09.367807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478ed2-b8f2-46c6-b702-f9130811769b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:09.387966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478ed2-b8f2-46c6-b702-f9130811769b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:09.547652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02eb1af-b523-4c9c-8b8f-9e5972cf048d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:09.548585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eb1af-b523-4c9c-8b8f-9e5972cf048d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:09.548870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eb1af-b523-4c9c-8b8f-9e5972cf048d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:09.552809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eb1af-b523-4c9c-8b8f-9e5972cf048d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:09.553807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02eb1af-b523-4c9c-8b8f-9e5972cf048d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:09.558373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02eb1af-b523-4c9c-8b8f-9e5972cf048d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:09.606266 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2251/4523] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:21:09 2022] POST /identity/v3/domains => generated 276 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:09.607669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025dbcc-8112-4353-9cac-adc82e02c3ac tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:09.625138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025dbcc-8112-4353-9cac-adc82e02c3ac tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:09.783347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77053b36-8d97-4915-814d-f8d04e197a1c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:09.784497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77053b36-8d97-4915-814d-f8d04e197a1c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:09.785155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77053b36-8d97-4915-814d-f8d04e197a1c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:09.785631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77053b36-8d97-4915-814d-f8d04e197a1c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:09.786872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77053b36-8d97-4915-814d-f8d04e197a1c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:09.789138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77053b36-8d97-4915-814d-f8d04e197a1c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:09.883221 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2273/4524] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:21:09 2022] POST /identity/v3/roles => generated 240 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:09.887594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02eb1af-b523-4c9c-8b8f-9e5972cf048d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:09.916609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02eb1af-b523-4c9c-8b8f-9e5972cf048d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:09.942916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ae192-94bd-4d43-b954-abfa069d07b2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:09.945173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ae192-94bd-4d43-b954-abfa069d07b2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:09.945655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ae192-94bd-4d43-b954-abfa069d07b2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:09.947755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ae192-94bd-4d43-b954-abfa069d07b2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/a3b2cfd92db64b93923d7e1b5cefd4e1/users/5ed7743886514865821e3fbfec7fdfbe/roles/ba554dbc531f4b5c82e58aef244c24fd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:09.985115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ae192-94bd-4d43-b954-abfa069d07b2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a3b2cfd92db64b93923d7e1b5cefd4e1, user_id=5ed7743886514865821e3fbfec7fdfbe, role_id=ba554dbc531f4b5c82e58aef244c24fd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:10.002336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ae192-94bd-4d43-b954-abfa069d07b2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:10.058552 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2252/4525] 10.222.0.23 () {60 vars in 1480 bytes} [Sun Oct 2 01:21:09 2022] PUT /identity/v3/domains/a3b2cfd92db64b93923d7e1b5cefd4e1/users/5ed7743886514865821e3fbfec7fdfbe/roles/ba554dbc531f4b5c82e58aef244c24fd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:10.062301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77053b36-8d97-4915-814d-f8d04e197a1c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:10.078806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77053b36-8d97-4915-814d-f8d04e197a1c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:10.219874 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:10.235075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a78d50-5309-4b34-8497-716cdc513cbd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:10.236368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a78d50-5309-4b34-8497-716cdc513cbd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:10.236914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a78d50-5309-4b34-8497-716cdc513cbd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:10.237406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a78d50-5309-4b34-8497-716cdc513cbd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:10.238365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a78d50-5309-4b34-8497-716cdc513cbd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:10.240331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a78d50-5309-4b34-8497-716cdc513cbd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:10.283599 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2274/4526] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:21:10 2022] POST /identity/v3/domains => generated 275 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:21:10.287526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ae192-94bd-4d43-b954-abfa069d07b2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:10.308246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ae192-94bd-4d43-b954-abfa069d07b2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:10.455605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daa97a-7f92-4484-bfc9-96d895b467c5 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:10.456324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daa97a-7f92-4484-bfc9-96d895b467c5 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:10.456615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daa97a-7f92-4484-bfc9-96d895b467c5 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:10.456888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daa97a-7f92-4484-bfc9-96d895b467c5 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:10.457606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daa97a-7f92-4484-bfc9-96d895b467c5 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:10.459366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daa97a-7f92-4484-bfc9-96d895b467c5 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:10.464052 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:10.491630 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2253/4527] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:21:10 2022] POST /identity/v3/roles => generated 240 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:10.493147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a78d50-5309-4b34-8497-716cdc513cbd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:10.506014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a78d50-5309-4b34-8497-716cdc513cbd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:10.513137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66be1e-8843-4940-a734-c3cc1501806d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:10.514579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66be1e-8843-4940-a734-c3cc1501806d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:10.515133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66be1e-8843-4940-a734-c3cc1501806d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:10.515615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66be1e-8843-4940-a734-c3cc1501806d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/groups` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:10.516476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66be1e-8843-4940-a734-c3cc1501806d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:10.519038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66be1e-8843-4940-a734-c3cc1501806d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:10.570861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daa97a-7f92-4484-bfc9-96d895b467c5 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:10.571432 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2275/4528] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:21:10 2022] POST /identity/v3/groups => generated 324 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:10.588152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daa97a-7f92-4484-bfc9-96d895b467c5 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:10.617948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0e46c-8f86-41a7-be8e-f0ebb7664b57 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:10.620206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0e46c-8f86-41a7-be8e-f0ebb7664b57 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:10.620493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0e46c-8f86-41a7-be8e-f0ebb7664b57 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:10.620766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0e46c-8f86-41a7-be8e-f0ebb7664b57 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/groups/671882f00e3e498b81940ea1fa4b9381/users/5ed7743886514865821e3fbfec7fdfbe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:10.639019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0e46c-8f86-41a7-be8e-f0ebb7664b57 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=671882f00e3e498b81940ea1fa4b9381, user_id=5ed7743886514865821e3fbfec7fdfbe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:10.641180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0e46c-8f86-41a7-be8e-f0ebb7664b57 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:10.702950 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2254/4529] 10.222.0.23 () {60 vars in 1360 bytes} [Sun Oct 2 01:21:10 2022] PUT /identity/v3/groups/671882f00e3e498b81940ea1fa4b9381/users/5ed7743886514865821e3fbfec7fdfbe => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:10.709766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66be1e-8843-4940-a734-c3cc1501806d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:10.733265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66be1e-8843-4940-a734-c3cc1501806d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:10.886868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173e696-3a7a-41cc-9ee6-2a2b2a989a3c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:10.888236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e696-3a7a-41cc-9ee6-2a2b2a989a3c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:10.888803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e696-3a7a-41cc-9ee6-2a2b2a989a3c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:10.889320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e696-3a7a-41cc-9ee6-2a2b2a989a3c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/9eb1a95a39934a24a7d8e7d6349d00fa/groups/671882f00e3e498b81940ea1fa4b9381/roles/6b5d30bf034042bc87ceb7b923b53274` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:10.892283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173e696-3a7a-41cc-9ee6-2a2b2a989a3c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9eb1a95a39934a24a7d8e7d6349d00fa, group_id=671882f00e3e498b81940ea1fa4b9381, role_id=6b5d30bf034042bc87ceb7b923b53274)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:10.895589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173e696-3a7a-41cc-9ee6-2a2b2a989a3c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:10.907193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0e46c-8f86-41a7-be8e-f0ebb7664b57 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:10.910636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a6a0e46c-8f86-41a7-be8e-f0ebb7664b57 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:10.929265 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2276/4530] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:10 2022] PUT /identity/v3/domains/9eb1a95a39934a24a7d8e7d6349d00fa/groups/671882f00e3e498b81940ea1fa4b9381/roles/6b5d30bf034042bc87ceb7b923b53274 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:10.935586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173e696-3a7a-41cc-9ee6-2a2b2a989a3c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:11.180511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0e46c-8f86-41a7-be8e-f0ebb7664b57 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:11.279687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173e696-3a7a-41cc-9ee6-2a2b2a989a3c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:11.292581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ddccf-aa2a-46be-9550-3fd0edb8d298 tempest-TokensV3TestJSON-1653811759 tempest-TokensV3TestJSON-1653811759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7743886514865821e3fbfec7fdfbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a6c253dea6e44778cfc4f7321c1a12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:11.293468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ddccf-aa2a-46be-9550-3fd0edb8d298 tempest-TokensV3TestJSON-1653811759 tempest-TokensV3TestJSON-1653811759-project] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:11.293928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ddccf-aa2a-46be-9550-3fd0edb8d298 tempest-TokensV3TestJSON-1653811759 tempest-TokensV3TestJSON-1653811759-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:11.294354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ddccf-aa2a-46be-9550-3fd0edb8d298 tempest-TokensV3TestJSON-1653811759 tempest-TokensV3TestJSON-1653811759-project] PATH_INFO: `/v3/auth/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:11.295502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ddccf-aa2a-46be-9550-3fd0edb8d298 tempest-TokensV3TestJSON-1653811759 tempest-TokensV3TestJSON-1653811759-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:11.296762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ddccf-aa2a-46be-9550-3fd0edb8d298 tempest-TokensV3TestJSON-1653811759 tempest-TokensV3TestJSON-1653811759-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:11.383437 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:11.398339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:11.400902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:11.401183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:11.401453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] PATH_INFO: `/v3/users/567970d4c702481995721669932ce41e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:11.408461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=567970d4c702481995721669932ce41e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:11.417012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:11.480572 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2277/4531] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:21:10 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:11.484324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ddccf-aa2a-46be-9550-3fd0edb8d298 tempest-TokensV3TestJSON-1653811759 tempest-TokensV3TestJSON-1653811759-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:11.590087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567970d4c702481995721669932ce41e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:11.609504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567970d4c702481995721669932ce41e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:11.611359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567970d4c702481995721669932ce41e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:11.628693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567970d4c702481995721669932ce41e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:11.646073 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:11.652408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567970d4c702481995721669932ce41e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:11.662279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ddccf-aa2a-46be-9550-3fd0edb8d298 tempest-TokensV3TestJSON-1653811759 tempest-TokensV3TestJSON-1653811759-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:11.672189 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2255/4532] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:10 2022] DELETE /identity/v3/users/567970d4c702481995721669932ce41e => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:11.677393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:11.679563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:11.680179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:11.681112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/9eb1a95a39934a24a7d8e7d6349d00fa/groups/671882f00e3e498b81940ea1fa4b9381/roles/6b5d30bf034042bc87ceb7b923b53274` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:11.685044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9eb1a95a39934a24a7d8e7d6349d00fa, group_id=671882f00e3e498b81940ea1fa4b9381, role_id=6b5d30bf034042bc87ceb7b923b53274)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:11.687263 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:21:11.687263 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:21:11.687263 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:21:11.693752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:11.711449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invalidating the token cache because role 6b5d30bf034042bc87ceb7b923b53274 was removed from group 671882f00e3e498b81940ea1fa4b9381 on domain 9eb1a95a39934a24a7d8e7d6349d00fa. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:11.712139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:11.713183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:11.743773 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2278/4533] 10.222.0.23 () {58 vars in 1467 bytes} [Sun Oct 2 01:21:11 2022] DELETE /identity/v3/domains/9eb1a95a39934a24a7d8e7d6349d00fa/groups/671882f00e3e498b81940ea1fa4b9381/roles/6b5d30bf034042bc87ceb7b923b53274 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:11.747797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:11.749675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:11.907174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431edfd-974c-4d9a-9edf-8198f624bab3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:12.057068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f73b1-3e08-43dc-bbdc-7b992f1fd8d4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:12.060058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f73b1-3e08-43dc-bbdc-7b992f1fd8d4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:12.064102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f73b1-3e08-43dc-bbdc-7b992f1fd8d4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:12.064401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f73b1-3e08-43dc-bbdc-7b992f1fd8d4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/groups/671882f00e3e498b81940ea1fa4b9381/users/5ed7743886514865821e3fbfec7fdfbe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:12.071403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f73b1-3e08-43dc-bbdc-7b992f1fd8d4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=671882f00e3e498b81940ea1fa4b9381, user_id=5ed7743886514865821e3fbfec7fdfbe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:12.072482 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-be4f73b1-3e08-43dc-bbdc-7b992f1fd8d4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:21:12.072482 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:21:12.072482 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:21:12.079298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f73b1-3e08-43dc-bbdc-7b992f1fd8d4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:12.103006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be4f73b1-3e08-43dc-bbdc-7b992f1fd8d4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5ed7743886514865821e3fbfec7fdfbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:12.130531 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2256/4534] 10.222.0.23 () {58 vars in 1344 bytes} [Sun Oct 2 01:21:11 2022] DELETE /identity/v3/groups/671882f00e3e498b81940ea1fa4b9381/users/5ed7743886514865821e3fbfec7fdfbe => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:12.135432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:12.138512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:12.164171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935be7d-a41c-4627-b9dc-ee88188464c8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:12.311740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b44bb8-a66c-4f62-8fe1-898c8ca532e8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:12.312326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b44bb8-a66c-4f62-8fe1-898c8ca532e8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:12.312612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b44bb8-a66c-4f62-8fe1-898c8ca532e8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:12.313071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b44bb8-a66c-4f62-8fe1-898c8ca532e8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/groups/671882f00e3e498b81940ea1fa4b9381` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:12.314838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b44bb8-a66c-4f62-8fe1-898c8ca532e8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_group(group_id=671882f00e3e498b81940ea1fa4b9381)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:12.320003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b44bb8-a66c-4f62-8fe1-898c8ca532e8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:12.394133 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2279/4535] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:21:12 2022] DELETE /identity/v3/groups/671882f00e3e498b81940ea1fa4b9381 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:12.395459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f73b1-3e08-43dc-bbdc-7b992f1fd8d4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:12.419609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f73b1-3e08-43dc-bbdc-7b992f1fd8d4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:12.576227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:12.577314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:12.577314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:12.577533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/roles/6b5d30bf034042bc87ceb7b923b53274` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:12.578845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6b5d30bf034042bc87ceb7b923b53274)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:12.579859 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:21:12.579859 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:21:12.579859 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:21:12.580770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:12.624121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b44bb8-a66c-4f62-8fe1-898c8ca532e8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:12.624573 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:12.626545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-99b44bb8-a66c-4f62-8fe1-898c8ca532e8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:12.665178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invalidating the token cache because role 6b5d30bf034042bc87ceb7b923b53274 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:12.665572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:12.666309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:12.671202 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2257/4536] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:12 2022] DELETE /identity/v3/roles/6b5d30bf034042bc87ceb7b923b53274 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:12.672209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:12.673591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:12.711154 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:12.807459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3fbe7-384c-4d60-b4fc-3a226bd3cb61 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:12.814430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b44bb8-a66c-4f62-8fe1-898c8ca532e8 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:12.820198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:12.820866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:12.821155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:12.821442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/9eb1a95a39934a24a7d8e7d6349d00fa` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:12.822780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9eb1a95a39934a24a7d8e7d6349d00fa)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:12.825514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:12.873236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:12.879934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:12.916494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:12.917567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:12.918071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:12.918488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] PATH_INFO: `/v3/projects/b19b890a2ecc41439c8f44c11034441b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:12.920473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19b890a2ecc41439c8f44c11034441b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:12.923415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:12.934585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:12.935284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:12.938208 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2258/4537] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:21:12 2022] PATCH /identity/v3/domains/9eb1a95a39934a24a7d8e7d6349d00fa => generated 276 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:21:12.942846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:12.945671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:13.042728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19b890a2ecc41439c8f44c11034441b', 'request_id': 'req-34de4609-4719-43f4-bcd8-824ce8ab3f61'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.051833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19b890a2ecc41439c8f44c11034441b', 'request_id': 'req-34de4609-4719-43f4-bcd8-824ce8ab3f61'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.074897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19b890a2ecc41439c8f44c11034441b', 'request_id': 'req-34de4609-4719-43f4-bcd8-824ce8ab3f61'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.090808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac3457-a77a-48d3-9aa9-20c6562456c7 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:13.100347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] The token cache is being invalidate because project b19b890a2ecc41439c8f44c11034441b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:13.102174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.106553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-34de4609-4719-43f4-bcd8-824ce8ab3f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.108885 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2280/4538] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:12 2022] DELETE /identity/v3/projects/b19b890a2ecc41439c8f44c11034441b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:13.117819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996740-fc8c-446c-b9f9-98fd790ca4c4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:13.118480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996740-fc8c-446c-b9f9-98fd790ca4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:13.119386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996740-fc8c-446c-b9f9-98fd790ca4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:13.203786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-78996740-fc8c-446c-b9f9-98fd790ca4c4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:13.206486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-78996740-fc8c-446c-b9f9-98fd790ca4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:13.208840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:13.210076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:13.210367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:13.210716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/9eb1a95a39934a24a7d8e7d6349d00fa` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:13.218792 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:13.234050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9eb1a95a39934a24a7d8e7d6349d00fa)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:13.235537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:13.290175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.298401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.400655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa', 'request_id': 'req-da91fee4-b963-451a-a879-86a534776bcd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.406806 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:13.413798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa', 'request_id': 'req-da91fee4-b963-451a-a879-86a534776bcd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.426729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa', 'request_id': 'req-da91fee4-b963-451a-a879-86a534776bcd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.437318 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2281/4539] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:13.439275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249abe0-c734-47ed-89f9-41ad0156c418 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:13.439571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249abe0-c734-47ed-89f9-41ad0156c418 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:13.440071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249abe0-c734-47ed-89f9-41ad0156c418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:13.451791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] The token cache is being invalidate because project 9eb1a95a39934a24a7d8e7d6349d00fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:13.452124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.463161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.471303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b249abe0-c734-47ed-89f9-41ad0156c418 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:13.473038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa', 'request_id': 'req-da91fee4-b963-451a-a879-86a534776bcd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.473727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b249abe0-c734-47ed-89f9-41ad0156c418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:13.475915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa', 'request_id': 'req-da91fee4-b963-451a-a879-86a534776bcd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.476649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9eb1a95a39934a24a7d8e7d6349d00fa', 'request_id': 'req-da91fee4-b963-451a-a879-86a534776bcd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.503915 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2259/4540] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:21:12 2022] DELETE /identity/v3/domains/9eb1a95a39934a24a7d8e7d6349d00fa => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:13.505048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:13.507552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:13.574740 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2282/4541] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:13.576061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249abe0-c734-47ed-89f9-41ad0156c418 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:13.590750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249abe0-c734-47ed-89f9-41ad0156c418 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:13.600435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e669f-ebf5-4eb6-a406-69c0d4c7aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:13.601054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e669f-ebf5-4eb6-a406-69c0d4c7aeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:13.601391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e669f-ebf5-4eb6-a406-69c0d4c7aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:13.602271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e669f-ebf5-4eb6-a406-69c0d4c7aeb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:13.603323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e669f-ebf5-4eb6-a406-69c0d4c7aeb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:21:13.603636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e669f-ebf5-4eb6-a406-69c0d4c7aeb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:13.605911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e669f-ebf5-4eb6-a406-69c0d4c7aeb1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:13.630767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2283/4542] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:21:13.632637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e669f-ebf5-4eb6-a406-69c0d4c7aeb1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:13.648823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e669f-ebf5-4eb6-a406-69c0d4c7aeb1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:13.655958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91fee4-b963-451a-a879-86a534776bcd tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:13.656672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1adbe6-9bf1-4a8e-ad0f-bd56de78eac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:13.657400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1adbe6-9bf1-4a8e-ad0f-bd56de78eac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:13.657979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1adbe6-9bf1-4a8e-ad0f-bd56de78eac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:13.659346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1adbe6-9bf1-4a8e-ad0f-bd56de78eac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:13.660344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1adbe6-9bf1-4a8e-ad0f-bd56de78eac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:13.664587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:13.664837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1adbe6-9bf1-4a8e-ad0f-bd56de78eac8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:13.665398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:13.665797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:13.666096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/a3b2cfd92db64b93923d7e1b5cefd4e1/users/5ed7743886514865821e3fbfec7fdfbe/roles/ba554dbc531f4b5c82e58aef244c24fd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:13.672417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a3b2cfd92db64b93923d7e1b5cefd4e1, user_id=5ed7743886514865821e3fbfec7fdfbe, role_id=ba554dbc531f4b5c82e58aef244c24fd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:13.674702 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:21:13.674702 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:21:13.674702 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:21:13.679213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:13.699893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invalidating the token cache because role ba554dbc531f4b5c82e58aef244c24fd was removed from user 5ed7743886514865821e3fbfec7fdfbe on domain a3b2cfd92db64b93923d7e1b5cefd4e1. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:13.700229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.701080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.722739 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2284/4543] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:13 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:13.727129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1adbe6-9bf1-4a8e-ad0f-bd56de78eac8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:13.731402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4a1adbe6-9bf1-4a8e-ad0f-bd56de78eac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:13.737057 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2260/4544] 10.222.0.23 () {58 vars in 1464 bytes} [Sun Oct 2 01:21:13 2022] DELETE /identity/v3/domains/a3b2cfd92db64b93923d7e1b5cefd4e1/users/5ed7743886514865821e3fbfec7fdfbe/roles/ba554dbc531f4b5c82e58aef244c24fd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:13.741803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:13.743544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:13.811833 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:13.878657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f43cb-d05c-4c02-97b3-666df5e3df96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:13.897298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:13.898103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:13.898394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:13.898720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/roles/ba554dbc531f4b5c82e58aef244c24fd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:13.900179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1adbe6-9bf1-4a8e-ad0f-bd56de78eac8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:13.902327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ba554dbc531f4b5c82e58aef244c24fd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:13.904044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:13.983536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invalidating the token cache because role ba554dbc531f4b5c82e58aef244c24fd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:13.984065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.985410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:13.991682 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2261/4545] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:13 2022] DELETE /identity/v3/roles/ba554dbc531f4b5c82e58aef244c24fd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:13.995885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:13.999308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:14.028962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d86b31-8d07-40f7-95ea-9e42764ef0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:14.029540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86b31-8d07-40f7-95ea-9e42764ef0ed admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:14.029826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86b31-8d07-40f7-95ea-9e42764ef0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:14.030221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86b31-8d07-40f7-95ea-9e42764ef0ed admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:14.030857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d86b31-8d07-40f7-95ea-9e42764ef0ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:14.032813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d86b31-8d07-40f7-95ea-9e42764ef0ed admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:14.074741 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:14.086581 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2285/4546] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:13 2022] POST /identity/v3/users => generated 289 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:14.087953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d86b31-8d07-40f7-95ea-9e42764ef0ed admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:14.090135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-92d86b31-8d07-40f7-95ea-9e42764ef0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:14.112306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d86b31-8d07-40f7-95ea-9e42764ef0ed admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:14.145900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b8ff7-e9c6-4506-a9ac-53e60e5b3085 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:14.161954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:14.162796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:14.163380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:14.163778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/a3b2cfd92db64b93923d7e1b5cefd4e1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:14.167808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a3b2cfd92db64b93923d7e1b5cefd4e1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:14.169763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:14.215789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.217599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.241850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a4659-3ad1-41d4-afa4-cdea171f6ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:14.242726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a4659-3ad1-41d4-afa4-cdea171f6ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:14.243147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a4659-3ad1-41d4-afa4-cdea171f6ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:14.243574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a4659-3ad1-41d4-afa4-cdea171f6ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:14.244334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a4659-3ad1-41d4-afa4-cdea171f6ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:14.247513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a4659-3ad1-41d4-afa4-cdea171f6ce5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:14.280486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.282300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.284010 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2286/4547] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:14 2022] GET /identity/v3/roles => generated 1881 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:14.292104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a4659-3ad1-41d4-afa4-cdea171f6ce5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:14.292901 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2262/4548] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:21:13 2022] PATCH /identity/v3/domains/a3b2cfd92db64b93923d7e1b5cefd4e1 => generated 277 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:21:14.298147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:14.299438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ff4a4659-3ad1-41d4-afa4-cdea171f6ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:14.301882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:14.336977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a4659-3ad1-41d4-afa4-cdea171f6ce5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:14.462341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee246a-e8e4-4128-8074-8d4bd61563cf tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:14.474247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:14.476002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:14.476921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:14.477869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/a3b2cfd92db64b93923d7e1b5cefd4e1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:14.478434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037716de-715d-4ab2-8dab-0d881fa5b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:14.479099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037716de-715d-4ab2-8dab-0d881fa5b45a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:14.479391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037716de-715d-4ab2-8dab-0d881fa5b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:14.479683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037716de-715d-4ab2-8dab-0d881fa5b45a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:14.480318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037716de-715d-4ab2-8dab-0d881fa5b45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:14.485640 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:14.486436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037716de-715d-4ab2-8dab-0d881fa5b45a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:14.509815 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2287/4549] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:14 2022] GET /identity/v3/roles => generated 1881 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:14.510927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037716de-715d-4ab2-8dab-0d881fa5b45a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:14.516777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a3b2cfd92db64b93923d7e1b5cefd4e1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:14.519226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:14.531221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037716de-715d-4ab2-8dab-0d881fa5b45a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:14.546942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72de39-8184-416d-b2e2-bf908f8d328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:14.547681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72de39-8184-416d-b2e2-bf908f8d328c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:14.547998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72de39-8184-416d-b2e2-bf908f8d328c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:14.548338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72de39-8184-416d-b2e2-bf908f8d328c admin admin] PATH_INFO: `/v3/projects/43f430c55874406eabf551e14b955282/users/cc4d3e3c7fe74e48be84c87ee70687cb/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:14.565243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.574167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.586861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72de39-8184-416d-b2e2-bf908f8d328c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f430c55874406eabf551e14b955282, user_id=cc4d3e3c7fe74e48be84c87ee70687cb, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:14.589337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72de39-8184-416d-b2e2-bf908f8d328c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:14.622415 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2288/4550] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:14 2022] PUT /identity/v3/projects/43f430c55874406eabf551e14b955282/users/cc4d3e3c7fe74e48be84c87ee70687cb/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:14.633791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb1f2-01d5-4ae9-a553-2278396780a0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:14.634207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb1f2-01d5-4ae9-a553-2278396780a0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:14.634393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb1f2-01d5-4ae9-a553-2278396780a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:14.696528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-76dcb1f2-01d5-4ae9-a553-2278396780a0 None None] MFA Rules not processed for user `cc4d3e3c7fe74e48be84c87ee70687cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:14.697168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1', 'request_id': 'req-52b41dfd-2d26-46f8-a761-9463f04e654b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.697770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-76dcb1f2-01d5-4ae9-a553-2278396780a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:14.707955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1', 'request_id': 'req-52b41dfd-2d26-46f8-a761-9463f04e654b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.725563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1', 'request_id': 'req-52b41dfd-2d26-46f8-a761-9463f04e654b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.751515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] The token cache is being invalidate because project a3b2cfd92db64b93923d7e1b5cefd4e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:14.752195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.753443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.793756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1', 'request_id': 'req-52b41dfd-2d26-46f8-a761-9463f04e654b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.795489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1', 'request_id': 'req-52b41dfd-2d26-46f8-a761-9463f04e654b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.797575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a3b2cfd92db64b93923d7e1b5cefd4e1', 'request_id': 'req-52b41dfd-2d26-46f8-a761-9463f04e654b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:14.823280 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2263/4551] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:21:14 2022] DELETE /identity/v3/domains/a3b2cfd92db64b93923d7e1b5cefd4e1 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:14.826350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:14.829749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:14.848984 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:14.867911 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2289/4552] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:14.883322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca81fca-8d75-4284-aec4-970c0a5310f3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:14.883822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca81fca-8d75-4284-aec4-970c0a5310f3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:14.884105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca81fca-8d75-4284-aec4-970c0a5310f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:14.919008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5ca81fca-8d75-4284-aec4-970c0a5310f3 None None] MFA Rules not processed for user `cc4d3e3c7fe74e48be84c87ee70687cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:14.920329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5ca81fca-8d75-4284-aec4-970c0a5310f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:14.937012 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2290/4553] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:14.949777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca81fca-8d75-4284-aec4-970c0a5310f3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:14.951905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5ca81fca-8d75-4284-aec4-970c0a5310f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:14.973736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b41dfd-2d26-46f8-a761-9463f04e654b tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:14.985583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:14.986727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:14.987084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:14.987502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/15fb746659f947d9889e5c96c18c938f/groups/1a0f6552a00f44cfbd9adc5619f7c668/roles/79d98302466f4136a10f77fc8b76b148` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:14.997757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=15fb746659f947d9889e5c96c18c938f, group_id=1a0f6552a00f44cfbd9adc5619f7c668, role_id=79d98302466f4136a10f77fc8b76b148)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:15.001996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:15.011926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invalidating the token cache because role 79d98302466f4136a10f77fc8b76b148 was removed from group 1a0f6552a00f44cfbd9adc5619f7c668 on domain 15fb746659f947d9889e5c96c18c938f. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:15.012303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:15.013334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:15.040804 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2264/4554] 10.222.0.23 () {58 vars in 1467 bytes} [Sun Oct 2 01:21:14 2022] DELETE /identity/v3/domains/15fb746659f947d9889e5c96c18c938f/groups/1a0f6552a00f44cfbd9adc5619f7c668/roles/79d98302466f4136a10f77fc8b76b148 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:15.045858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:15.049041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:15.096526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca81fca-8d75-4284-aec4-970c0a5310f3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:15.123752 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:15.188312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44f3e1-5ca6-4118-a17d-87e4851293e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:15.202767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3a958-7e6c-4119-badb-b7435fff2453 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:15.203458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3a958-7e6c-4119-badb-b7435fff2453 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:15.203747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3a958-7e6c-4119-badb-b7435fff2453 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:15.204029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3a958-7e6c-4119-badb-b7435fff2453 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/groups/1a0f6552a00f44cfbd9adc5619f7c668/users/5ed7743886514865821e3fbfec7fdfbe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:15.207202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3a958-7e6c-4119-badb-b7435fff2453 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=1a0f6552a00f44cfbd9adc5619f7c668, user_id=5ed7743886514865821e3fbfec7fdfbe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:15.211235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3a958-7e6c-4119-badb-b7435fff2453 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:15.227787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-87a3a958-7e6c-4119-badb-b7435fff2453 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5ed7743886514865821e3fbfec7fdfbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:15.243443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b45809-8db1-44b4-add7-81639370ef55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:15.249698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45809-8db1-44b4-add7-81639370ef55 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:15.250060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45809-8db1-44b4-add7-81639370ef55 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:15.251374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45809-8db1-44b4-add7-81639370ef55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:15.256229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-59b45809-8db1-44b4-add7-81639370ef55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:15.257162 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2265/4555] 10.222.0.23 () {58 vars in 1344 bytes} [Sun Oct 2 01:21:15 2022] DELETE /identity/v3/groups/1a0f6552a00f44cfbd9adc5619f7c668/users/5ed7743886514865821e3fbfec7fdfbe => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:15.261689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3a958-7e6c-4119-badb-b7435fff2453 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:15.345251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3a958-7e6c-4119-badb-b7435fff2453 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:15.350669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a38071-e1eb-4683-8a8b-ac032b003f44 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:15.351349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a38071-e1eb-4683-8a8b-ac032b003f44 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:15.351639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a38071-e1eb-4683-8a8b-ac032b003f44 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:15.351922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a38071-e1eb-4683-8a8b-ac032b003f44 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/groups/1a0f6552a00f44cfbd9adc5619f7c668` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:15.353372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a38071-e1eb-4683-8a8b-ac032b003f44 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1a0f6552a00f44cfbd9adc5619f7c668)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:15.355375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a38071-e1eb-4683-8a8b-ac032b003f44 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:15.401907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b45809-8db1-44b4-add7-81639370ef55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:15.406579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b45809-8db1-44b4-add7-81639370ef55 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:15.422211 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2266/4556] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:21:15 2022] DELETE /identity/v3/groups/1a0f6552a00f44cfbd9adc5619f7c668 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:15.426999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a38071-e1eb-4683-8a8b-ac032b003f44 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:15.428270 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2291/4557] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:15.547669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a38071-e1eb-4683-8a8b-ac032b003f44 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:15.563093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:15.563868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:15.564369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:15.564723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/roles/79d98302466f4136a10f77fc8b76b148` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:15.567780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_role(role_id=79d98302466f4136a10f77fc8b76b148)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:15.580242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:15.596503 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:15.656614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invalidating the token cache because role 79d98302466f4136a10f77fc8b76b148 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:15.657215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:15.668643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:15.674268 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2267/4558] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:15 2022] DELETE /identity/v3/roles/79d98302466f4136a10f77fc8b76b148 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:15.678816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b45809-8db1-44b4-add7-81639370ef55 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:15.697515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b45809-8db1-44b4-add7-81639370ef55 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:15.804108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:15.806233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:15.812874 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:15.905868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:15.906908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:15.907420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:15.907899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/15fb746659f947d9889e5c96c18c938f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:15.911439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=15fb746659f947d9889e5c96c18c938f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:15.913723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:15.956823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd02e28-5033-4011-9695-85953c57ee1a tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:15.965080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb6ca9-b715-49d2-8db1-3eb73b09048e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:15.965080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb6ca9-b715-49d2-8db1-3eb73b09048e service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:15.965573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb6ca9-b715-49d2-8db1-3eb73b09048e service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:15.965680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb6ca9-b715-49d2-8db1-3eb73b09048e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:15.967703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2bcb6ca9-b715-49d2-8db1-3eb73b09048e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:15.985415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb6ca9-b715-49d2-8db1-3eb73b09048e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:15.989297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb6ca9-b715-49d2-8db1-3eb73b09048e service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:15.992762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '15fb746659f947d9889e5c96c18c938f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:15.993531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '15fb746659f947d9889e5c96c18c938f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.058549 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2268/4559] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:16.076873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '15fb746659f947d9889e5c96c18c938f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.077495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '15fb746659f947d9889e5c96c18c938f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.083135 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2292/4560] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:21:15 2022] PATCH /identity/v3/domains/15fb746659f947d9889e5c96c18c938f => generated 278 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:21:16.085458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb6ca9-b715-49d2-8db1-3eb73b09048e service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:16.086969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2bcb6ca9-b715-49d2-8db1-3eb73b09048e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:16.117480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb6ca9-b715-49d2-8db1-3eb73b09048e service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:16.272424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:16.274873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:16.275289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:16.275650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/15fb746659f947d9889e5c96c18c938f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:16.306564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=15fb746659f947d9889e5c96c18c938f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:16.308464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:16.363728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '15fb746659f947d9889e5c96c18c938f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.376552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '15fb746659f947d9889e5c96c18c938f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.458446 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:16.470459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15fb746659f947d9889e5c96c18c938f', 'request_id': 'req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.480293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15fb746659f947d9889e5c96c18c938f', 'request_id': 'req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.488246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15fb746659f947d9889e5c96c18c938f', 'request_id': 'req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.516106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] The token cache is being invalidate because project 15fb746659f947d9889e5c96c18c938f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:16.516482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.517858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.543877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '15fb746659f947d9889e5c96c18c938f', 'request_id': 'req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.551059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '15fb746659f947d9889e5c96c18c938f', 'request_id': 'req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.552742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '15fb746659f947d9889e5c96c18c938f', 'request_id': 'req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.583423 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2269/4561] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:21:16 2022] DELETE /identity/v3/domains/15fb746659f947d9889e5c96c18c938f => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:16.587905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:16.589394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:16.614144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc229e-33b6-47dc-93b3-2bd08019f701 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:16.793986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:16.794682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:16.799021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:16.799329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/f167d95b6437474b91b4589d1da7dd94/users/5ed7743886514865821e3fbfec7fdfbe/roles/28099731bd5040e5be35c48b8be66eff` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:16.813252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f167d95b6437474b91b4589d1da7dd94, user_id=5ed7743886514865821e3fbfec7fdfbe, role_id=28099731bd5040e5be35c48b8be66eff)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:16.823390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:16.843656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invalidating the token cache because role 28099731bd5040e5be35c48b8be66eff was removed from user 5ed7743886514865821e3fbfec7fdfbe on domain f167d95b6437474b91b4589d1da7dd94. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:16.844580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.846918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:16.878065 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2293/4562] 10.222.0.23 () {58 vars in 1464 bytes} [Sun Oct 2 01:21:16 2022] DELETE /identity/v3/domains/f167d95b6437474b91b4589d1da7dd94/users/5ed7743886514865821e3fbfec7fdfbe/roles/28099731bd5040e5be35c48b8be66eff => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:16.883271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:16.885281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:16.913009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3b004-9bb7-4557-8fbf-f1a640ffaf3d tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:17.128479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:17.130122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:17.135286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:17.135830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/roles/28099731bd5040e5be35c48b8be66eff` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:17.140103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_role(role_id=28099731bd5040e5be35c48b8be66eff)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:17.145170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:17.234104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invalidating the token cache because role 28099731bd5040e5be35c48b8be66eff has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:17.234413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:17.235132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:17.237474 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2270/4563] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:16 2022] DELETE /identity/v3/roles/28099731bd5040e5be35c48b8be66eff => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:17.241781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:17.244043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:17.274300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c609a-948c-4544-8f9a-ec00e9c0b48e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:17.501297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:17.502117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:17.502411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:17.502716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/f167d95b6437474b91b4589d1da7dd94` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:17.508399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f167d95b6437474b91b4589d1da7dd94)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:17.510884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:17.563676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:17.564744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:17.573668 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:17.607241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:17.608380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:17.611766 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2294/4564] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:21:17 2022] PATCH /identity/v3/domains/f167d95b6437474b91b4589d1da7dd94 => generated 278 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:21:17.616251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:17.617725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:17.648282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdf1e3-15f5-4b31-bab1-fd0a5dffedb1 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:17.819447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:17.820105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:17.820388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:17.820668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/f167d95b6437474b91b4589d1da7dd94` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:17.848031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f167d95b6437474b91b4589d1da7dd94)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:17.853391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:17.861273 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:17.939811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:17.951754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:18.088203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94', 'request_id': 'req-123e38f1-46e1-4741-a864-ac5b228a43e9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:18.107551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94', 'request_id': 'req-123e38f1-46e1-4741-a864-ac5b228a43e9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:18.120691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94', 'request_id': 'req-123e38f1-46e1-4741-a864-ac5b228a43e9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:18.155831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] The token cache is being invalidate because project f167d95b6437474b91b4589d1da7dd94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:18.157469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:18.160270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:18.178064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94', 'request_id': 'req-123e38f1-46e1-4741-a864-ac5b228a43e9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:18.181057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94', 'request_id': 'req-123e38f1-46e1-4741-a864-ac5b228a43e9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:18.182883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f167d95b6437474b91b4589d1da7dd94', 'request_id': 'req-123e38f1-46e1-4741-a864-ac5b228a43e9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:18.203282 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2271/4565] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:21:17 2022] DELETE /identity/v3/domains/f167d95b6437474b91b4589d1da7dd94 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:18.212095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:18.215944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:18.308693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1e0b7-bc8f-4823-8c9b-508035e86b17 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:18.542354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b0c8-5998-461d-8fa8-3c3a04dc7d7e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:18.543018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b0c8-5998-461d-8fa8-3c3a04dc7d7e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:18.543305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b0c8-5998-461d-8fa8-3c3a04dc7d7e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:18.543837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b0c8-5998-461d-8fa8-3c3a04dc7d7e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:18.544496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05b0c8-5998-461d-8fa8-3c3a04dc7d7e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:18.546124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05b0c8-5998-461d-8fa8-3c3a04dc7d7e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:18.561690 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2295/4566] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:18.563006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:18.564885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:18.603665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e38f1-46e1-4741-a864-ac5b228a43e9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:18.622190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77def6-dec2-408b-8989-c6fb29e30799 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:18.622908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77def6-dec2-408b-8989-c6fb29e30799 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:18.623672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77def6-dec2-408b-8989-c6fb29e30799 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:18.623672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77def6-dec2-408b-8989-c6fb29e30799 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/projects/133702a004ce464bb740a631c722a401/users/1876a238f48c4a5692de28ac6accaa67/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:18.627157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77def6-dec2-408b-8989-c6fb29e30799 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_grant(project_id=133702a004ce464bb740a631c722a401, user_id=1876a238f48c4a5692de28ac6accaa67, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:18.629894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77def6-dec2-408b-8989-c6fb29e30799 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:18.661281 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2272/4567] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:18 2022] PUT /identity/v3/projects/133702a004ce464bb740a631c722a401/users/1876a238f48c4a5692de28ac6accaa67/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:18.666455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b0c8-5998-461d-8fa8-3c3a04dc7d7e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:18.683883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b0c8-5998-461d-8fa8-3c3a04dc7d7e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:18.899214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696e831-e826-46cd-b8d2-7ce77637fa4c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:18.899862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696e831-e826-46cd-b8d2-7ce77637fa4c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:18.900152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696e831-e826-46cd-b8d2-7ce77637fa4c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:18.900437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696e831-e826-46cd-b8d2-7ce77637fa4c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:18.901031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696e831-e826-46cd-b8d2-7ce77637fa4c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:18.902136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696e831-e826-46cd-b8d2-7ce77637fa4c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:19.045350 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2296/4568] 10.222.0.23 () {58 vars in 1146 bytes} [Sun Oct 2 01:21:18 2022] GET /identity/v3/auth/projects => generated 826 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:21:19.049649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77def6-dec2-408b-8989-c6fb29e30799 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:19.065926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77def6-dec2-408b-8989-c6fb29e30799 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:19.080274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a17a1-52de-4a33-aefb-92c2e3959865 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:19.080966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a17a1-52de-4a33-aefb-92c2e3959865 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:19.081246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a17a1-52de-4a33-aefb-92c2e3959865 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:19.081703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a17a1-52de-4a33-aefb-92c2e3959865 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/projects/133702a004ce464bb740a631c722a401/users/1876a238f48c4a5692de28ac6accaa67/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:19.090550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a17a1-52de-4a33-aefb-92c2e3959865 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=133702a004ce464bb740a631c722a401, user_id=1876a238f48c4a5692de28ac6accaa67, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:19.093261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a17a1-52de-4a33-aefb-92c2e3959865 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:19.116432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db9a17a1-52de-4a33-aefb-92c2e3959865 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invalidating the token cache because role 284afd30cc464e98bd3e2b1e1c42ff7e was removed from user 1876a238f48c4a5692de28ac6accaa67 on project 133702a004ce464bb740a631c722a401. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:19.116748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db9a17a1-52de-4a33-aefb-92c2e3959865 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:19.124174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db9a17a1-52de-4a33-aefb-92c2e3959865 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:19.154115 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2273/4569] 10.222.0.23 () {58 vars in 1467 bytes} [Sun Oct 2 01:21:19 2022] DELETE /identity/v3/projects/133702a004ce464bb740a631c722a401/users/1876a238f48c4a5692de28ac6accaa67/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:19.158822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696e831-e826-46cd-b8d2-7ce77637fa4c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:19.164278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5696e831-e826-46cd-b8d2-7ce77637fa4c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:19.187671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696e831-e826-46cd-b8d2-7ce77637fa4c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:19.274780 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:19.313527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b751e3-a1a0-429a-80f2-7f2b9cd508a2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:19.314179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b751e3-a1a0-429a-80f2-7f2b9cd508a2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:19.314481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b751e3-a1a0-429a-80f2-7f2b9cd508a2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:19.314804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b751e3-a1a0-429a-80f2-7f2b9cd508a2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:19.315517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b751e3-a1a0-429a-80f2-7f2b9cd508a2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:19.317814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b751e3-a1a0-429a-80f2-7f2b9cd508a2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:19.360063 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2297/4570] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:19 2022] POST /identity/v3/users => generated 321 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:19.364809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a17a1-52de-4a33-aefb-92c2e3959865 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:19.393001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a17a1-52de-4a33-aefb-92c2e3959865 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:19.428387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d864e-1050-497d-9f8d-e38954f31de6 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:19.429553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d864e-1050-497d-9f8d-e38954f31de6 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:19.429978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d864e-1050-497d-9f8d-e38954f31de6 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:19.430387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d864e-1050-497d-9f8d-e38954f31de6 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:19.431707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d864e-1050-497d-9f8d-e38954f31de6 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:19.437366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d864e-1050-497d-9f8d-e38954f31de6 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:19.492184 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2274/4571] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:19 2022] POST /identity/v3/projects => generated 364 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:19.496900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b751e3-a1a0-429a-80f2-7f2b9cd508a2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:19.517359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b751e3-a1a0-429a-80f2-7f2b9cd508a2 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:19.613055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4faa2-6882-498d-a8cf-87d1f9e16068 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:19.613696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4faa2-6882-498d-a8cf-87d1f9e16068 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:19.614988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4faa2-6882-498d-a8cf-87d1f9e16068 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:19.618000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4faa2-6882-498d-a8cf-87d1f9e16068 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:19.618801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4faa2-6882-498d-a8cf-87d1f9e16068 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:19.620991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4faa2-6882-498d-a8cf-87d1f9e16068 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:19.708185 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2298/4572] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:19 2022] POST /identity/v3/projects => generated 363 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:19.709421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d864e-1050-497d-9f8d-e38954f31de6 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:19.725946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d864e-1050-497d-9f8d-e38954f31de6 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:19.832768 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:19.845350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867cc3a-3521-4323-8b2f-036e9795572e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:19.846229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867cc3a-3521-4323-8b2f-036e9795572e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:19.846678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867cc3a-3521-4323-8b2f-036e9795572e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:19.847337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867cc3a-3521-4323-8b2f-036e9795572e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:19.848213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867cc3a-3521-4323-8b2f-036e9795572e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:19.850593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867cc3a-3521-4323-8b2f-036e9795572e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:19.880003 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2275/4573] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:21:19 2022] POST /identity/v3/roles => generated 239 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:21:19.884549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4faa2-6882-498d-a8cf-87d1f9e16068 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:19.897526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4faa2-6882-498d-a8cf-87d1f9e16068 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:19.904513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fea48e-da5c-44af-b20c-45d541350303 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:19.905505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fea48e-da5c-44af-b20c-45d541350303 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:19.905897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fea48e-da5c-44af-b20c-45d541350303 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:19.906296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fea48e-da5c-44af-b20c-45d541350303 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/projects/f007cb8fe2714fd0859ac1c57ef681e7/users/cd09465f61e544759b3351828730f2ad/roles/7b17d5ed63a541789a9bfcf44d4249ea` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:19.959537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fea48e-da5c-44af-b20c-45d541350303 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f007cb8fe2714fd0859ac1c57ef681e7, user_id=cd09465f61e544759b3351828730f2ad, role_id=7b17d5ed63a541789a9bfcf44d4249ea)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:19.966301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fea48e-da5c-44af-b20c-45d541350303 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:20.005425 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2299/4574] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:19 2022] PUT /identity/v3/projects/f007cb8fe2714fd0859ac1c57ef681e7/users/cd09465f61e544759b3351828730f2ad/roles/7b17d5ed63a541789a9bfcf44d4249ea => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:20.010438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867cc3a-3521-4323-8b2f-036e9795572e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:20.026085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867cc3a-3521-4323-8b2f-036e9795572e tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:20.200196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c983a0-fd37-4baa-983e-d226eabcbb96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:20.200898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c983a0-fd37-4baa-983e-d226eabcbb96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:20.201191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c983a0-fd37-4baa-983e-d226eabcbb96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:20.201478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c983a0-fd37-4baa-983e-d226eabcbb96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/projects/d9af65828e864037bb09fc2ad7223842/users/cd09465f61e544759b3351828730f2ad/roles/7b17d5ed63a541789a9bfcf44d4249ea` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:20.205494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c983a0-fd37-4baa-983e-d226eabcbb96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d9af65828e864037bb09fc2ad7223842, user_id=cd09465f61e544759b3351828730f2ad, role_id=7b17d5ed63a541789a9bfcf44d4249ea)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:20.208362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c983a0-fd37-4baa-983e-d226eabcbb96 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:20.263389 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2276/4575] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:20 2022] PUT /identity/v3/projects/d9af65828e864037bb09fc2ad7223842/users/cd09465f61e544759b3351828730f2ad/roles/7b17d5ed63a541789a9bfcf44d4249ea => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:20.268762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e931-4ea2-4154-8533-551f5f418afe None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:20.269147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e931-4ea2-4154-8533-551f5f418afe None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:20.269419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e931-4ea2-4154-8533-551f5f418afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:20.363366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3872e931-4ea2-4154-8533-551f5f418afe None None] MFA Rules not processed for user `cd09465f61e544759b3351828730f2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:20.365204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3872e931-4ea2-4154-8533-551f5f418afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:20.373355 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2300/4576] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:20 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:21:20.377452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea9cbf-ead1-4745-920c-ca69d988b122 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:20.377844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea9cbf-ead1-4745-920c-ca69d988b122 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:20.378245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea9cbf-ead1-4745-920c-ca69d988b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:20.396958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-15ea9cbf-ead1-4745-920c-ca69d988b122 None None] MFA Rules not processed for user `cd09465f61e544759b3351828730f2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:20.397951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-15ea9cbf-ead1-4745-920c-ca69d988b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:20.565733 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2277/4577] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 02 01:21:20.567028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872e931-4ea2-4154-8533-551f5f418afe None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:20.745766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872e931-4ea2-4154-8533-551f5f418afe None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:20.760047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc149f-cabb-4002-929d-314674f24618 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:20.762833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc149f-cabb-4002-929d-314674f24618 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:20.763337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc149f-cabb-4002-929d-314674f24618 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:20.764824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc149f-cabb-4002-929d-314674f24618 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:20.786770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc149f-cabb-4002-929d-314674f24618 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:20.789110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc149f-cabb-4002-929d-314674f24618 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:20.833497 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2301/4578] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 2 01:21:20 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:20.853840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd83686-cb36-4abe-b384-118f0d754f6c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:20.854517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd83686-cb36-4abe-b384-118f0d754f6c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:20.863095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd83686-cb36-4abe-b384-118f0d754f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:20.884625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1dd83686-cb36-4abe-b384-118f0d754f6c None None] MFA Rules not processed for user `cd09465f61e544759b3351828730f2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:20.885826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1dd83686-cb36-4abe-b384-118f0d754f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:21.114801 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2278/4579] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 02 01:21:21.116227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc149f-cabb-4002-929d-314674f24618 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:21.139428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc149f-cabb-4002-929d-314674f24618 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:21.150780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:21.151322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:21.151689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:21.151969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/roles/7b17d5ed63a541789a9bfcf44d4249ea` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:21.156034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7b17d5ed63a541789a9bfcf44d4249ea)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:21.157531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:21.166129 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:21.287950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invalidating the token cache because role 7b17d5ed63a541789a9bfcf44d4249ea has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:21.289027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:21.289947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:21.292375 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2302/4580] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:21 2022] DELETE /identity/v3/roles/7b17d5ed63a541789a9bfcf44d4249ea => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:21.296469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd83686-cb36-4abe-b384-118f0d754f6c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:21.318305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd83686-cb36-4abe-b384-118f0d754f6c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:21.450310 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:21.536292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:21.537319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:21.537600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:21.537863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/projects/d9af65828e864037bb09fc2ad7223842` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:21.542431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d9af65828e864037bb09fc2ad7223842)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:21.544457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:21.664937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9af65828e864037bb09fc2ad7223842', 'request_id': 'req-ecb35b50-02c5-4b05-97e8-9c7885c40782'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:21.678785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9af65828e864037bb09fc2ad7223842', 'request_id': 'req-ecb35b50-02c5-4b05-97e8-9c7885c40782'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:21.696232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9af65828e864037bb09fc2ad7223842', 'request_id': 'req-ecb35b50-02c5-4b05-97e8-9c7885c40782'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:21.723150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] The token cache is being invalidate because project d9af65828e864037bb09fc2ad7223842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:21.723454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:21.725833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:21.729641 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2279/4581] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:21 2022] DELETE /identity/v3/projects/d9af65828e864037bb09fc2ad7223842 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:21.733855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:21.736589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:21.770064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4edb7a-f43d-4870-b1cc-8d3a6ccca478 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:21.930935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734c579-e8a5-496b-8b8e-9a8fe1985097 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:21.931772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c579-e8a5-496b-8b8e-9a8fe1985097 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:21.932066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c579-e8a5-496b-8b8e-9a8fe1985097 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:21.932381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c579-e8a5-496b-8b8e-9a8fe1985097 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/projects/d9af65828e864037bb09fc2ad7223842` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:21.988662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734c579-e8a5-496b-8b8e-9a8fe1985097 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d9af65828e864037bb09fc2ad7223842)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:21.992871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734c579-e8a5-496b-8b8e-9a8fe1985097 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:22.028175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:22.029690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-c734c579-e8a5-496b-8b8e-9a8fe1985097 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Could not find project: d9af65828e864037bb09fc2ad7223842.: keystone.exception.ProjectNotFound: Could not find project: d9af65828e864037bb09fc2ad7223842. Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 02 01:21:22.037585 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 02 01:21:22.038615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:21:22.038615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:21:22.038615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 02 01:21:22.038615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 02 01:21:22.038615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:21:22.038615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:21:22.038615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:21:22.038615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:21:22.038615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d9af65828e864037bb09fc2ad7223842. Oct 02 01:21:22.038615 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:21:22.041043 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2303/4582] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:21 2022] DELETE /identity/v3/projects/d9af65828e864037bb09fc2ad7223842 => generated 113 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:21:22.047520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734c579-e8a5-496b-8b8e-9a8fe1985097 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:22.063324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c734c579-e8a5-496b-8b8e-9a8fe1985097 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:22.092182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734c579-e8a5-496b-8b8e-9a8fe1985097 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:22.100497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:22.101149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:22.101427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:22.102437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/projects/f007cb8fe2714fd0859ac1c57ef681e7` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:22.104455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f007cb8fe2714fd0859ac1c57ef681e7)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:22.122562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:22.255900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb35b50-02c5-4b05-97e8-9c7885c40782 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:22.261392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f007cb8fe2714fd0859ac1c57ef681e7', 'request_id': 'req-1783d7be-de9e-42a5-8866-ac21b2c69382'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:22.275483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f007cb8fe2714fd0859ac1c57ef681e7', 'request_id': 'req-1783d7be-de9e-42a5-8866-ac21b2c69382'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:22.299084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f007cb8fe2714fd0859ac1c57ef681e7', 'request_id': 'req-1783d7be-de9e-42a5-8866-ac21b2c69382'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:22.330644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] The token cache is being invalidate because project f007cb8fe2714fd0859ac1c57ef681e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:22.330941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:22.332415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:22.337060 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2304/4583] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:22 2022] DELETE /identity/v3/projects/f007cb8fe2714fd0859ac1c57ef681e7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:22.340950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:22.343712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:22.395874 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:22.437338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9324e6-9fb4-4c84-b190-bc87019c2991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:22.437973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9324e6-9fb4-4c84-b190-bc87019c2991 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:22.438256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9324e6-9fb4-4c84-b190-bc87019c2991 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:22.438559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9324e6-9fb4-4c84-b190-bc87019c2991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:22.445801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a9324e6-9fb4-4c84-b190-bc87019c2991 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:22.502788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9324e6-9fb4-4c84-b190-bc87019c2991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:22.504439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9324e6-9fb4-4c84-b190-bc87019c2991 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:22.533349 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2280/4584] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:22.542673 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:22.595425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783d7be-de9e-42a5-8866-ac21b2c69382 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:22.619551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:22.620217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:22.620499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:22.622346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/users/cd09465f61e544759b3351828730f2ad` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:22.625127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cd09465f61e544759b3351828730f2ad)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:22.630996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:22.809857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd09465f61e544759b3351828730f2ad'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:22.828237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76376fd9-2b1d-4f0a-9915-1c3fba643c9b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:22.828568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76376fd9-2b1d-4f0a-9915-1c3fba643c9b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:22.828802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76376fd9-2b1d-4f0a-9915-1c3fba643c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:22.848101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd09465f61e544759b3351828730f2ad'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:22.848910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd09465f61e544759b3351828730f2ad'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:22.862211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd09465f61e544759b3351828730f2ad'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:22.865105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd09465f61e544759b3351828730f2ad'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:22.887286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-76376fd9-2b1d-4f0a-9915-1c3fba643c9b None None] MFA Rules not processed for user `1ea58206b2c744e5a153d56bacc5311f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:22.888487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-76376fd9-2b1d-4f0a-9915-1c3fba643c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:22.902379 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2305/4585] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:22 2022] DELETE /identity/v3/users/cd09465f61e544759b3351828730f2ad => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:22.909288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:22.911243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:23.057575 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2281/4586] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:21:23.061765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb5681-a974-48df-8792-f4c015c50a2c tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:23.075480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ed315-1374-4621-a4ae-3f52aaa30f5e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:23.075933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ed315-1374-4621-a4ae-3f52aaa30f5e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:23.076094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ed315-1374-4621-a4ae-3f52aaa30f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:23.092116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165a09e-259b-4a72-a5e0-9b47b97de1b4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:23.093401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a09e-259b-4a72-a5e0-9b47b97de1b4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:23.093534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a09e-259b-4a72-a5e0-9b47b97de1b4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:23.093886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a09e-259b-4a72-a5e0-9b47b97de1b4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/9eb1a95a39934a24a7d8e7d6349d00fa` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:23.120181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165a09e-259b-4a72-a5e0-9b47b97de1b4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-a165a09e-259b-4a72-a5e0-9b47b97de1b4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Could not find domain: 9eb1a95a39934a24a7d8e7d6349d00fa.: keystone.exception.DomainNotFound: Could not find domain: 9eb1a95a39934a24a7d8e7d6349d00fa. Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9eb1a95a39934a24a7d8e7d6349d00fa. Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:21:23.126741 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:21:23.128207 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9eb1a95a39934a24a7d8e7d6349d00fa. Oct 02 01:21:23.129178 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:21:23.131431 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2306/4587] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:21:22 2022] PATCH /identity/v3/domains/9eb1a95a39934a24a7d8e7d6349d00fa => generated 112 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:21:23.131431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecba6b-b2d1-4e2f-8f1c-4080adb577e5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:23.131431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecba6b-b2d1-4e2f-8f1c-4080adb577e5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:23.131431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecba6b-b2d1-4e2f-8f1c-4080adb577e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:23.138315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b81ed315-1374-4621-a4ae-3f52aaa30f5e None None] MFA Rules not processed for user `b890aa0529304095933195cea870279b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:23.140486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b81ed315-1374-4621-a4ae-3f52aaa30f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:23.211109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cfecba6b-b2d1-4e2f-8f1c-4080adb577e5 None None] MFA Rules not processed for user `85d3ffda1a2247e891ef255f3f90ea15`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:23.212443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cfecba6b-b2d1-4e2f-8f1c-4080adb577e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:23.338654 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:23.356079 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2282/4588] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:23.357274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ed315-1374-4621-a4ae-3f52aaa30f5e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:23.373610 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2307/4589] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:23.375937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecba6b-b2d1-4e2f-8f1c-4080adb577e5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:23.384807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cfecba6b-b2d1-4e2f-8f1c-4080adb577e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:23.404812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ed315-1374-4621-a4ae-3f52aaa30f5e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:23.422071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d8000-4d62-492a-9896-87393a7ff3c4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:23.422769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d8000-4d62-492a-9896-87393a7ff3c4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:23.423053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d8000-4d62-492a-9896-87393a7ff3c4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:23.423331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d8000-4d62-492a-9896-87393a7ff3c4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/a3b2cfd92db64b93923d7e1b5cefd4e1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:23.445888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d8000-4d62-492a-9896-87393a7ff3c4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ad4d8000-4d62-492a-9896-87393a7ff3c4 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Could not find domain: a3b2cfd92db64b93923d7e1b5cefd4e1.: keystone.exception.DomainNotFound: Could not find domain: a3b2cfd92db64b93923d7e1b5cefd4e1. Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a3b2cfd92db64b93923d7e1b5cefd4e1. Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:21:23.451078 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:21:23.452355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a3b2cfd92db64b93923d7e1b5cefd4e1. Oct 02 01:21:23.453484 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:23.460113 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2283/4590] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:21:23 2022] PATCH /identity/v3/domains/a3b2cfd92db64b93923d7e1b5cefd4e1 => generated 112 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:21:23.462101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba559-2997-4e51-afdf-a1d0b3aa0788 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:23.462388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba559-2997-4e51-afdf-a1d0b3aa0788 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:23.462696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba559-2997-4e51-afdf-a1d0b3aa0788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:23.511283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-31dba559-2997-4e51-afdf-a1d0b3aa0788 None None] MFA Rules not processed for user `85d3ffda1a2247e891ef255f3f90ea15`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:23.515096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31dba559-2997-4e51-afdf-a1d0b3aa0788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:23.530946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecba6b-b2d1-4e2f-8f1c-4080adb577e5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:23.540716 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2284/4591] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:23.541895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dba559-2997-4e51-afdf-a1d0b3aa0788 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:23.563349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7cd5d-8010-4e86-8e36-3d5a8086c703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:23.564779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dba559-2997-4e51-afdf-a1d0b3aa0788 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:23.567368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7cd5d-8010-4e86-8e36-3d5a8086c703 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:23.573003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7cd5d-8010-4e86-8e36-3d5a8086c703 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:23.573542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7cd5d-8010-4e86-8e36-3d5a8086c703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:23.581161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bcc7cd5d-8010-4e86-8e36-3d5a8086c703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:23.582013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbe4a9-f500-4ef6-9ebe-0b687c4717d9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:23.583049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbe4a9-f500-4ef6-9ebe-0b687c4717d9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:23.585339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbe4a9-f500-4ef6-9ebe-0b687c4717d9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:23.585783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbe4a9-f500-4ef6-9ebe-0b687c4717d9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/15fb746659f947d9889e5c96c18c938f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:23.605095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbe4a9-f500-4ef6-9ebe-0b687c4717d9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c7cbe4a9-f500-4ef6-9ebe-0b687c4717d9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Could not find domain: 15fb746659f947d9889e5c96c18c938f.: keystone.exception.DomainNotFound: Could not find domain: 15fb746659f947d9889e5c96c18c938f. Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 15fb746659f947d9889e5c96c18c938f. Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:21:23.611065 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:21:23.612322 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 15fb746659f947d9889e5c96c18c938f. Oct 02 01:21:23.613237 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:23.624181 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2285/4592] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:21:23 2022] PATCH /identity/v3/domains/15fb746659f947d9889e5c96c18c938f => generated 112 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:21:23.627263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbe4a9-f500-4ef6-9ebe-0b687c4717d9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:23.638439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7cd5d-8010-4e86-8e36-3d5a8086c703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:23.643220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7cd5d-8010-4e86-8e36-3d5a8086c703 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:23.649928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbe4a9-f500-4ef6-9ebe-0b687c4717d9 tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:23.670629 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2308/4593] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:23 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:23.674909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5820b0-5eec-46d3-b56e-e5147584b3fc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1876a238f48c4a5692de28ac6accaa67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66e81d3c5904438eb5a9931f6202c4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:23.675876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5820b0-5eec-46d3-b56e-e5147584b3fc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:23.676384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5820b0-5eec-46d3-b56e-e5147584b3fc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:23.677411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5820b0-5eec-46d3-b56e-e5147584b3fc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] PATH_INFO: `/v3/domains/f167d95b6437474b91b4589d1da7dd94` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:23.680782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7cd5d-8010-4e86-8e36-3d5a8086c703 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:23.682781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bcc7cd5d-8010-4e86-8e36-3d5a8086c703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:23.697917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5820b0-5eec-46d3-b56e-e5147584b3fc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-6c5820b0-5eec-46d3-b56e-e5147584b3fc tempest-TokensV3TestJSON-519696533 tempest-TokensV3TestJSON-519696533-project-admin] Could not find domain: f167d95b6437474b91b4589d1da7dd94.: keystone.exception.DomainNotFound: Could not find domain: f167d95b6437474b91b4589d1da7dd94. Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f167d95b6437474b91b4589d1da7dd94. Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:21:23.710939 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:21:23.712258 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f167d95b6437474b91b4589d1da7dd94. Oct 02 01:21:23.713198 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:23.715720 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2286/4594] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:21:23 2022] PATCH /identity/v3/domains/f167d95b6437474b91b4589d1da7dd94 => generated 112 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:21:23.724413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794b8d-e475-49e4-9160-6da218af6ac5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:23.724834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794b8d-e475-49e4-9160-6da218af6ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:23.725180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794b8d-e475-49e4-9160-6da218af6ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:23.734424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7cd5d-8010-4e86-8e36-3d5a8086c703 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:23.757326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e01cb4-802c-42b2-96f5-e736de914151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:23.758167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e01cb4-802c-42b2-96f5-e736de914151 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:23.758458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e01cb4-802c-42b2-96f5-e736de914151 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:23.758789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e01cb4-802c-42b2-96f5-e736de914151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:23.775254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-23794b8d-e475-49e4-9160-6da218af6ac5 None None] MFA Rules not processed for user `db9450c53d8944b88cfbbc541f585ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:23.778770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-23794b8d-e475-49e4-9160-6da218af6ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:23.779771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e01cb4-802c-42b2-96f5-e736de914151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:23.782551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e01cb4-802c-42b2-96f5-e736de914151 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:23.809594 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2309/4595] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:23.810701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e01cb4-802c-42b2-96f5-e736de914151 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:23.812672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-79e01cb4-802c-42b2-96f5-e736de914151 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:23.875201 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:23.922564 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2287/4596] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:23.940039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e01cb4-802c-42b2-96f5-e736de914151 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:23.946374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:23.948192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:23.948698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:23.949574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] PATH_INFO: `/v3/users/ea01f14a8cd14da184bfe48debb11ba4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:23.952021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea01f14a8cd14da184bfe48debb11ba4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:23.954245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:24.053403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea01f14a8cd14da184bfe48debb11ba4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:24.085876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea01f14a8cd14da184bfe48debb11ba4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:24.087317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea01f14a8cd14da184bfe48debb11ba4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:24.090425 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:24.114429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea01f14a8cd14da184bfe48debb11ba4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:24.115617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea01f14a8cd14da184bfe48debb11ba4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:24.159920 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2310/4597] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:23 2022] DELETE /identity/v3/users/ea01f14a8cd14da184bfe48debb11ba4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:24.165591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e0d2-c3ef-45b5-a21d-7e51bc4d356e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:24.166776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e0d2-c3ef-45b5-a21d-7e51bc4d356e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:24.167315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e0d2-c3ef-45b5-a21d-7e51bc4d356e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:24.207742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1ab6e0d2-c3ef-45b5-a21d-7e51bc4d356e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:24.210198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ab6e0d2-c3ef-45b5-a21d-7e51bc4d356e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:24.348645 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2288/4598] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:24.372814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:24.374501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:24.467079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e738a5-2895-49be-9dc3-d95dd2a56342 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:24.472022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab56cd-d51d-4069-98c5-1376d760cd0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:24.472967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab56cd-d51d-4069-98c5-1376d760cd0c service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:24.473514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab56cd-d51d-4069-98c5-1376d760cd0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:24.474190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab56cd-d51d-4069-98c5-1376d760cd0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:24.494643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab56cd-d51d-4069-98c5-1376d760cd0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:24.497103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab56cd-d51d-4069-98c5-1376d760cd0c service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:24.520468 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2311/4599] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:27.452478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6e0d2-c3ef-45b5-a21d-7e51bc4d356e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:27.454288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ab6e0d2-c3ef-45b5-a21d-7e51bc4d356e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:27.482962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6e0d2-c3ef-45b5-a21d-7e51bc4d356e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:27.493532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:27.494573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:27.495297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:27.502157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] PATH_INFO: `/v3/projects/133702a004ce464bb740a631c722a401` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:27.505736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=133702a004ce464bb740a631c722a401)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:27.511646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:27.573078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab56cd-d51d-4069-98c5-1376d760cd0c service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:27.574425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-89ab56cd-d51d-4069-98c5-1376d760cd0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:27.645896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab56cd-d51d-4069-98c5-1376d760cd0c service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:27.664815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d353b3d-e3fd-4cc4-bff1-f32cf620c4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:27.665731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353b3d-e3fd-4cc4-bff1-f32cf620c4eb service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:27.667531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353b3d-e3fd-4cc4-bff1-f32cf620c4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:27.668580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353b3d-e3fd-4cc4-bff1-f32cf620c4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:27.673448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5d353b3d-e3fd-4cc4-bff1-f32cf620c4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:27.694265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133702a004ce464bb740a631c722a401', 'request_id': 'req-38d615de-0652-462b-a06c-6182760b22f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:27.712020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d353b3d-e3fd-4cc4-bff1-f32cf620c4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:27.716225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d353b3d-e3fd-4cc4-bff1-f32cf620c4eb service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:27.720924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133702a004ce464bb740a631c722a401', 'request_id': 'req-38d615de-0652-462b-a06c-6182760b22f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:27.740493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133702a004ce464bb740a631c722a401', 'request_id': 'req-38d615de-0652-462b-a06c-6182760b22f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:27.744587 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2312/4600] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:27.763883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] The token cache is being invalidate because project 133702a004ce464bb740a631c722a401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:27.764474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:27.766074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d615de-0652-462b-a06c-6182760b22f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:27.770798 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2289/4601] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:27 2022] DELETE /identity/v3/projects/133702a004ce464bb740a631c722a401 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:27.774718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d353b3d-e3fd-4cc4-bff1-f32cf620c4eb service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:27.797454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d353b3d-e3fd-4cc4-bff1-f32cf620c4eb service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:27.942931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448e19-539e-44f5-b1ec-69d71c1f1c2b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:27.943222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448e19-539e-44f5-b1ec-69d71c1f1c2b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:27.943531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448e19-539e-44f5-b1ec-69d71c1f1c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:27.962171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:27.964305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:27.964691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:27.965092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] PATH_INFO: `/v3/users/1876a238f48c4a5692de28ac6accaa67` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:27.969020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1876a238f48c4a5692de28ac6accaa67)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:27.978740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:28.019800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9a448e19-539e-44f5-b1ec-69d71c1f1c2b None None] MFA Rules not processed for user `bfae16ed6efb490d8d953bb78a5c1a00`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:28.022190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9a448e19-539e-44f5-b1ec-69d71c1f1c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:28.081485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1876a238f48c4a5692de28ac6accaa67'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:28.126993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1876a238f48c4a5692de28ac6accaa67'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:28.128419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1876a238f48c4a5692de28ac6accaa67'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:28.155376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1876a238f48c4a5692de28ac6accaa67'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:28.156404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1876a238f48c4a5692de28ac6accaa67'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:28.161485 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:28.188966 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2313/4602] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:27 2022] DELETE /identity/v3/users/1876a238f48c4a5692de28ac6accaa67 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:28.198056 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2290/4603] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:29.570741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:29.578401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:29.800479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dea96-242c-48ff-9e76-9e55515eddc5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:29.821473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:29.822141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:29.822947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:29.823218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] PATH_INFO: `/v3/projects/66e81d3c5904438eb5a9931f6202c4e7` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:29.824440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e81d3c5904438eb5a9931f6202c4e7)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:29.827846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:29.940282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e81d3c5904438eb5a9931f6202c4e7', 'request_id': 'req-bc1769cf-0d8c-4d2c-9b62-74565130bcda'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:29.964754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e81d3c5904438eb5a9931f6202c4e7', 'request_id': 'req-bc1769cf-0d8c-4d2c-9b62-74565130bcda'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:29.991745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e81d3c5904438eb5a9931f6202c4e7', 'request_id': 'req-bc1769cf-0d8c-4d2c-9b62-74565130bcda'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:30.040610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] The token cache is being invalidate because project 66e81d3c5904438eb5a9931f6202c4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:30.040915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:30.042794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:30.048490 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2314/4604] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:29 2022] DELETE /identity/v3/projects/66e81d3c5904438eb5a9931f6202c4e7 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:30.052625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a448e19-539e-44f5-b1ec-69d71c1f1c2b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:30.076568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a448e19-539e-44f5-b1ec-69d71c1f1c2b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:30.113504 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:30.298837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:30.304053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:30.304365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:30.306289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] PATH_INFO: `/v3/users/5ed7743886514865821e3fbfec7fdfbe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:30.315444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed7743886514865821e3fbfec7fdfbe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:30.323724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:30.475291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed7743886514865821e3fbfec7fdfbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:30.502951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed7743886514865821e3fbfec7fdfbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:30.505893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed7743886514865821e3fbfec7fdfbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:30.525177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed7743886514865821e3fbfec7fdfbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:30.560587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed7743886514865821e3fbfec7fdfbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:30.580662 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2291/4605] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:30 2022] DELETE /identity/v3/users/5ed7743886514865821e3fbfec7fdfbe => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:30.979630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:30.981815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:30.995050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:30.997571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:31.231851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1769cf-0d8c-4d2c-9b62-74565130bcda admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:31.279848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00829-66b1-4689-890d-1b2580270401 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:31.324310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c367f9-a5ff-46f2-abbe-b90726eb512b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:31.329426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c367f9-a5ff-46f2-abbe-b90726eb512b service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:31.335800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c367f9-a5ff-46f2-abbe-b90726eb512b service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:31.336158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c367f9-a5ff-46f2-abbe-b90726eb512b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:31.345392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0c367f9-a5ff-46f2-abbe-b90726eb512b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:31.362712 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:31.452027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890e7e7-f63a-4c7c-844f-0b2466d9bca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:31.452691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890e7e7-f63a-4c7c-844f-0b2466d9bca3 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:31.452935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890e7e7-f63a-4c7c-844f-0b2466d9bca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:31.453217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890e7e7-f63a-4c7c-844f-0b2466d9bca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:31.464300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4890e7e7-f63a-4c7c-844f-0b2466d9bca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:31.522745 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:31.623646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c367f9-a5ff-46f2-abbe-b90726eb512b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:31.625700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c367f9-a5ff-46f2-abbe-b90726eb512b service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:31.668023 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2292/4606] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:21:31.717389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890e7e7-f63a-4c7c-844f-0b2466d9bca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:31.723452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890e7e7-f63a-4c7c-844f-0b2466d9bca3 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:31.761882 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2315/4607] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:32.356104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c367f9-a5ff-46f2-abbe-b90726eb512b service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:32.357543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0c367f9-a5ff-46f2-abbe-b90726eb512b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:32.376650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c367f9-a5ff-46f2-abbe-b90726eb512b service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:32.389061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7be27-599b-4129-acd0-91b4d00d5c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:32.390229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7be27-599b-4129-acd0-91b4d00d5c51 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:32.390589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7be27-599b-4129-acd0-91b4d00d5c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:32.391055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7be27-599b-4129-acd0-91b4d00d5c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:32.396375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3db7be27-599b-4129-acd0-91b4d00d5c51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:32.429014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7be27-599b-4129-acd0-91b4d00d5c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:32.433995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7be27-599b-4129-acd0-91b4d00d5c51 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:32.465922 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2293/4608] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:33.731304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890e7e7-f63a-4c7c-844f-0b2466d9bca3 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:33.733373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4890e7e7-f63a-4c7c-844f-0b2466d9bca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:33.857658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7be27-599b-4129-acd0-91b4d00d5c51 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:33.861294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3db7be27-599b-4129-acd0-91b4d00d5c51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:33.918473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890e7e7-f63a-4c7c-844f-0b2466d9bca3 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:33.930491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:33.931644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:33.932095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:33.932897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] PATH_INFO: `/v3/projects/6a6c253dea6e44778cfc4f7321c1a12f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:33.935817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6c253dea6e44778cfc4f7321c1a12f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:33.939233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:34.068443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6c253dea6e44778cfc4f7321c1a12f', 'request_id': 'req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:34.083704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7be27-599b-4129-acd0-91b4d00d5c51 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:34.086682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6c253dea6e44778cfc4f7321c1a12f', 'request_id': 'req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:34.097685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6c253dea6e44778cfc4f7321c1a12f', 'request_id': 'req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:34.135135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] The token cache is being invalidate because project 6a6c253dea6e44778cfc4f7321c1a12f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:34.135429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:34.136453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f5f917c2-fa88-4e41-99ff-223ea6fa80e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:34.144335 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2316/4609] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:33 2022] DELETE /identity/v3/projects/6a6c253dea6e44778cfc4f7321c1a12f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:34.161732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a881b-9a17-47a1-850a-952aa776c5f3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:34.163551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a881b-9a17-47a1-850a-952aa776c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:34.164683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a881b-9a17-47a1-850a-952aa776c5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:34.233235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-db0a881b-9a17-47a1-850a-952aa776c5f3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:34.235216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-db0a881b-9a17-47a1-850a-952aa776c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:34.304824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9c14a-066f-45a6-a3bb-d12007407715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:34.307034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c14a-066f-45a6-a3bb-d12007407715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:34.308356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c14a-066f-45a6-a3bb-d12007407715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:34.308662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c14a-066f-45a6-a3bb-d12007407715 admin admin] PATH_INFO: `/v3/users/cc4d3e3c7fe74e48be84c87ee70687cb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:34.312424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9c14a-066f-45a6-a3bb-d12007407715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4d3e3c7fe74e48be84c87ee70687cb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:34.315400 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:34.325108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9c14a-066f-45a6-a3bb-d12007407715 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:34.490839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9e9c14a-066f-45a6-a3bb-d12007407715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4d3e3c7fe74e48be84c87ee70687cb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:34.514733 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2317/4610] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:34.517332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701c12-1776-45dd-82d1-0e22e46e81f3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:34.517843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701c12-1776-45dd-82d1-0e22e46e81f3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:34.518184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701c12-1776-45dd-82d1-0e22e46e81f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:34.539146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9e9c14a-066f-45a6-a3bb-d12007407715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4d3e3c7fe74e48be84c87ee70687cb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:34.546153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9e9c14a-066f-45a6-a3bb-d12007407715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4d3e3c7fe74e48be84c87ee70687cb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:34.560021 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:34.569867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9e9c14a-066f-45a6-a3bb-d12007407715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4d3e3c7fe74e48be84c87ee70687cb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:34.581433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ff701c12-1776-45dd-82d1-0e22e46e81f3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:34.583381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ff701c12-1776-45dd-82d1-0e22e46e81f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:34.587494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9e9c14a-066f-45a6-a3bb-d12007407715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4d3e3c7fe74e48be84c87ee70687cb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:34.605826 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2294/4611] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:33 2022] DELETE /identity/v3/users/cc4d3e3c7fe74e48be84c87ee70687cb => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:34.609723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc8679-df0f-49d8-8847-0734b5d7464e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:34.615111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc8679-df0f-49d8-8847-0734b5d7464e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:34.615478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc8679-df0f-49d8-8847-0734b5d7464e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:34.616020 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2318/4612] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:34.617541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff701c12-1776-45dd-82d1-0e22e46e81f3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:34.646937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff701c12-1776-45dd-82d1-0e22e46e81f3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:34.657468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-41bc8679-df0f-49d8-8847-0734b5d7464e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:34.658842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-41bc8679-df0f-49d8-8847-0734b5d7464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:34.768894 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2295/4613] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:21:34.789022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359df0-a16f-4c0d-bea6-b2d8ba73c0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:34.792597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359df0-a16f-4c0d-bea6-b2d8ba73c0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:34.792965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359df0-a16f-4c0d-bea6-b2d8ba73c0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:34.793157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359df0-a16f-4c0d-bea6-b2d8ba73c0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:34.795364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a359df0-a16f-4c0d-bea6-b2d8ba73c0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:21:34.795674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a359df0-a16f-4c0d-bea6-b2d8ba73c0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:34.802031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a359df0-a16f-4c0d-bea6-b2d8ba73c0a8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:34.824639 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2319/4614] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:21:34.826777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc8679-df0f-49d8-8847-0734b5d7464e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:34.827160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359df0-a16f-4c0d-bea6-b2d8ba73c0a8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:34.829061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-41bc8679-df0f-49d8-8847-0734b5d7464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:34.845368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359df0-a16f-4c0d-bea6-b2d8ba73c0a8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:34.855800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ccfb2-a157-4f76-8e30-101995796ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:34.858006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ccfb2-a157-4f76-8e30-101995796ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:34.858317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ccfb2-a157-4f76-8e30-101995796ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:34.859315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ccfb2-a157-4f76-8e30-101995796ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:34.861602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ccfb2-a157-4f76-8e30-101995796ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:34.872015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ccfb2-a157-4f76-8e30-101995796ba2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:35.000969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc8679-df0f-49d8-8847-0734b5d7464e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:35.007307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ff975-30db-43e9-9c23-3a33a17a4f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:35.008324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ff975-30db-43e9-9c23-3a33a17a4f27 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:35.009708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ff975-30db-43e9-9c23-3a33a17a4f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:35.009995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ff975-30db-43e9-9c23-3a33a17a4f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:35.020156 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2320/4615] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:34 2022] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:35.027154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ccfb2-a157-4f76-8e30-101995796ba2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:35.049707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ff975-30db-43e9-9c23-3a33a17a4f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:35.052369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ff975-30db-43e9-9c23-3a33a17a4f27 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:35.092697 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2296/4616] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:35.273240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ccfb2-a157-4f76-8e30-101995796ba2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:35.293186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6598f1d-cc8e-4b85-a5db-c029318350ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:35.295688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6598f1d-cc8e-4b85-a5db-c029318350ee admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:35.296372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6598f1d-cc8e-4b85-a5db-c029318350ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:35.296947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6598f1d-cc8e-4b85-a5db-c029318350ee admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:35.297802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6598f1d-cc8e-4b85-a5db-c029318350ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:35.300462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6598f1d-cc8e-4b85-a5db-c029318350ee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:35.351485 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2321/4617] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:35 2022] POST /identity/v3/users => generated 285 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:35.357563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ff975-30db-43e9-9c23-3a33a17a4f27 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:35.374060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ff975-30db-43e9-9c23-3a33a17a4f27 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:35.386681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72006f35-1d7d-4304-a72b-23ac96b1b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:35.387327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72006f35-1d7d-4304-a72b-23ac96b1b2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:35.387937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72006f35-1d7d-4304-a72b-23ac96b1b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:35.388213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72006f35-1d7d-4304-a72b-23ac96b1b2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:35.388860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72006f35-1d7d-4304-a72b-23ac96b1b2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:35.390483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72006f35-1d7d-4304-a72b-23ac96b1b2a3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:35.432871 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2297/4618] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:35.434205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6598f1d-cc8e-4b85-a5db-c029318350ee admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:35.453621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6598f1d-cc8e-4b85-a5db-c029318350ee admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:35.460961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408f635-5e35-4932-9ff3-4a656a5080e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:35.462008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408f635-5e35-4932-9ff3-4a656a5080e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:35.464358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408f635-5e35-4932-9ff3-4a656a5080e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:35.465095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408f635-5e35-4932-9ff3-4a656a5080e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:35.465956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408f635-5e35-4932-9ff3-4a656a5080e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:35.478967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408f635-5e35-4932-9ff3-4a656a5080e1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:35.507187 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2322/4619] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:35.511132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72006f35-1d7d-4304-a72b-23ac96b1b2a3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:35.524080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72006f35-1d7d-4304-a72b-23ac96b1b2a3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:35.543196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90ddbe-c5bd-4540-9149-0c22c58f2a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:35.543902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90ddbe-c5bd-4540-9149-0c22c58f2a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:35.544483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90ddbe-c5bd-4540-9149-0c22c58f2a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:35.544775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90ddbe-c5bd-4540-9149-0c22c58f2a59 admin admin] PATH_INFO: `/v3/projects/90dac64fe16b4bd19fcb57bd348bfd8a/users/f36bf7b45b0149b28ce5c14a1a6d4f2b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:35.623266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90ddbe-c5bd-4540-9149-0c22c58f2a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90dac64fe16b4bd19fcb57bd348bfd8a, user_id=f36bf7b45b0149b28ce5c14a1a6d4f2b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:35.628937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90ddbe-c5bd-4540-9149-0c22c58f2a59 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:35.658846 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2298/4620] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:35 2022] PUT /identity/v3/projects/90dac64fe16b4bd19fcb57bd348bfd8a/users/f36bf7b45b0149b28ce5c14a1a6d4f2b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:35.669616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec975-11b3-4ec4-a407-5dc04f8c0120 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:35.672799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec975-11b3-4ec4-a407-5dc04f8c0120 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:35.673170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec975-11b3-4ec4-a407-5dc04f8c0120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:35.729353 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:35.784701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-967ec975-11b3-4ec4-a407-5dc04f8c0120 None None] MFA Rules not processed for user `f36bf7b45b0149b28ce5c14a1a6d4f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:35.792073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-967ec975-11b3-4ec4-a407-5dc04f8c0120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:36.005019 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2323/4621] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:36.010236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90ddbe-c5bd-4540-9149-0c22c58f2a59 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:36.162864 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:36.180416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90ddbe-c5bd-4540-9149-0c22c58f2a59 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:36.187440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0bb41-114c-40a8-bafd-f067dcaf3792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:36.188509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0bb41-114c-40a8-bafd-f067dcaf3792 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:36.189003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0bb41-114c-40a8-bafd-f067dcaf3792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:36.189737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0bb41-114c-40a8-bafd-f067dcaf3792 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:36.190639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0bb41-114c-40a8-bafd-f067dcaf3792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:36.196615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0bb41-114c-40a8-bafd-f067dcaf3792 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:36.239257 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2299/4622] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:36 2022] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:36.243083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ec975-11b3-4ec4-a407-5dc04f8c0120 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:36.256457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ec975-11b3-4ec4-a407-5dc04f8c0120 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:36.365018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eeb8a-92c9-4730-b0f7-e625c9d27aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:36.365845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eeb8a-92c9-4730-b0f7-e625c9d27aaf admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:36.366308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eeb8a-92c9-4730-b0f7-e625c9d27aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:36.366959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eeb8a-92c9-4730-b0f7-e625c9d27aaf admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:36.368050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eeb8a-92c9-4730-b0f7-e625c9d27aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:36.370412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eeb8a-92c9-4730-b0f7-e625c9d27aaf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:36.405069 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2324/4623] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:36 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:36.409360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0bb41-114c-40a8-bafd-f067dcaf3792 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:36.427774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0bb41-114c-40a8-bafd-f067dcaf3792 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:36.446734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7febd7-029a-4d3f-89f4-dcc2227fdef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:36.447383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7febd7-029a-4d3f-89f4-dcc2227fdef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:36.447642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7febd7-029a-4d3f-89f4-dcc2227fdef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:36.447906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7febd7-029a-4d3f-89f4-dcc2227fdef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:36.448552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7febd7-029a-4d3f-89f4-dcc2227fdef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:36.450299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7febd7-029a-4d3f-89f4-dcc2227fdef4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:36.510926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2300/4624] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:36.511908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eeb8a-92c9-4730-b0f7-e625c9d27aaf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:36.529175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eeb8a-92c9-4730-b0f7-e625c9d27aaf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:36.552024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffc65a-f01a-4d5d-9d67-972ff52411e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:36.552823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffc65a-f01a-4d5d-9d67-972ff52411e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:36.553221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffc65a-f01a-4d5d-9d67-972ff52411e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:36.553411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffc65a-f01a-4d5d-9d67-972ff52411e2 admin admin] PATH_INFO: `/v3/projects/ee1eadb774aa483289b7b429e0e69bdf/users/52f6953a22d24578b6c8e0f188bad8d9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:36.573502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffc65a-f01a-4d5d-9d67-972ff52411e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1eadb774aa483289b7b429e0e69bdf, user_id=52f6953a22d24578b6c8e0f188bad8d9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:36.576227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffc65a-f01a-4d5d-9d67-972ff52411e2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:36.596340 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2325/4625] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:36 2022] PUT /identity/v3/projects/ee1eadb774aa483289b7b429e0e69bdf/users/52f6953a22d24578b6c8e0f188bad8d9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:36.600546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7febd7-029a-4d3f-89f4-dcc2227fdef4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:36.613312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7febd7-029a-4d3f-89f4-dcc2227fdef4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:36.716537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecfe4e-f080-4dd1-b0db-6ce5a3cf717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:36.717972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecfe4e-f080-4dd1-b0db-6ce5a3cf717d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:36.718352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecfe4e-f080-4dd1-b0db-6ce5a3cf717d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:36.718742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecfe4e-f080-4dd1-b0db-6ce5a3cf717d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:36.721275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecfe4e-f080-4dd1-b0db-6ce5a3cf717d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:36.725099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecfe4e-f080-4dd1-b0db-6ce5a3cf717d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:36.751427 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2301/4626] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:36.756962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffc65a-f01a-4d5d-9d67-972ff52411e2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:36.774133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffc65a-f01a-4d5d-9d67-972ff52411e2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:36.784200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d6c6e-ead3-46e4-bf7d-02efd0ed2248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:36.785779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6c6e-ead3-46e4-bf7d-02efd0ed2248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:36.786453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6c6e-ead3-46e4-bf7d-02efd0ed2248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:36.786936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6c6e-ead3-46e4-bf7d-02efd0ed2248 admin admin] PATH_INFO: `/v3/projects/ee1eadb774aa483289b7b429e0e69bdf/users/52f6953a22d24578b6c8e0f188bad8d9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:36.790224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d6c6e-ead3-46e4-bf7d-02efd0ed2248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1eadb774aa483289b7b429e0e69bdf, user_id=52f6953a22d24578b6c8e0f188bad8d9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:36.793412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d6c6e-ead3-46e4-bf7d-02efd0ed2248 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:36.809116 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2326/4627] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:36 2022] PUT /identity/v3/projects/ee1eadb774aa483289b7b429e0e69bdf/users/52f6953a22d24578b6c8e0f188bad8d9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:36.825088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bfae0-9b32-4ee2-beea-a4d91151377a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:36.825292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bfae0-9b32-4ee2-beea-a4d91151377a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:36.825860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bfae0-9b32-4ee2-beea-a4d91151377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:36.865652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0a1bfae0-9b32-4ee2-beea-a4d91151377a None None] MFA Rules not processed for user `52f6953a22d24578b6c8e0f188bad8d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:36.867300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0a1bfae0-9b32-4ee2-beea-a4d91151377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:36.995231 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2302/4628] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:37.000350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d6c6e-ead3-46e4-bf7d-02efd0ed2248 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:37.015728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d6c6e-ead3-46e4-bf7d-02efd0ed2248 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:37.023268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b0528-8169-4d78-bd99-f2da3ebba532 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f6953a22d24578b6c8e0f188bad8d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee1eadb774aa483289b7b429e0e69bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:37.024095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b0528-8169-4d78-bd99-f2da3ebba532 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:37.024709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b0528-8169-4d78-bd99-f2da3ebba532 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:37.025196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b0528-8169-4d78-bd99-f2da3ebba532 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:37.025964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b0528-8169-4d78-bd99-f2da3ebba532 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:37.028187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b0528-8169-4d78-bd99-f2da3ebba532 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:37.102926 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2327/4629] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:36 2022] POST /identity/v3/projects => generated 360 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:37.107142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bfae0-9b32-4ee2-beea-a4d91151377a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:37.121395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bfae0-9b32-4ee2-beea-a4d91151377a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:37.234062 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:37.248545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b8f3a-3b19-429e-9e49-73dd2fdd623f tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f6953a22d24578b6c8e0f188bad8d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee1eadb774aa483289b7b429e0e69bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:37.250454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b8f3a-3b19-429e-9e49-73dd2fdd623f tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:37.252835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b8f3a-3b19-429e-9e49-73dd2fdd623f tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:37.253136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b8f3a-3b19-429e-9e49-73dd2fdd623f tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:37.254311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b8f3a-3b19-429e-9e49-73dd2fdd623f tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:37.259729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b8f3a-3b19-429e-9e49-73dd2fdd623f tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:37.308604 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2303/4630] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:37 2022] POST /identity/v3/users => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:37.313266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b0528-8169-4d78-bd99-f2da3ebba532 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:37.329406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b0528-8169-4d78-bd99-f2da3ebba532 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:37.336028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90501a24-49ac-4707-80b9-99b90f2f6c02 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f6953a22d24578b6c8e0f188bad8d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee1eadb774aa483289b7b429e0e69bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:37.336839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90501a24-49ac-4707-80b9-99b90f2f6c02 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:37.337195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90501a24-49ac-4707-80b9-99b90f2f6c02 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:37.337538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90501a24-49ac-4707-80b9-99b90f2f6c02 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:37.338321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90501a24-49ac-4707-80b9-99b90f2f6c02 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:21:37.338763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90501a24-49ac-4707-80b9-99b90f2f6c02 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:37.340051 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-90501a24-49ac-4707-80b9-99b90f2f6c02 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:21:37.340051 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:21:37.340051 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:21:37.341395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90501a24-49ac-4707-80b9-99b90f2f6c02 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:37.399977 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2328/4631] 10.222.0.23 () {58 vars in 1157 bytes} [Sun Oct 2 01:21:37 2022] GET /identity/v3/users?domain_id=default => generated 7749 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:37.404048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b8f3a-3b19-429e-9e49-73dd2fdd623f tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:37.417505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b8f3a-3b19-429e-9e49-73dd2fdd623f tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:37.429720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f6953a22d24578b6c8e0f188bad8d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee1eadb774aa483289b7b429e0e69bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:37.432621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:37.432908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:37.433192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] PATH_INFO: `/v3/users/8ad0977487f34a57b727e38dec4d52ab` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:37.457936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorizing `identity:update_user(user_id=8ad0977487f34a57b727e38dec4d52ab)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:37.459724 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:21:37.459724 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:21:37.459724 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:21:37.461640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:37.580523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8ad0977487f34a57b727e38dec4d52ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:37.607971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invalidating the token cache because user 8ad0977487f34a57b727e38dec4d52ab was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:37.608499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:37.609625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:37.616684 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2304/4632] 10.222.0.23 () {60 vars in 1244 bytes} [Sun Oct 2 01:21:37 2022] PATCH /identity/v3/users/8ad0977487f34a57b727e38dec4d52ab => generated 488 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:21:37.618366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b64ac0-6ac6-4529-b68f-bc4fefdfebb5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:37.618944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b64ac0-6ac6-4529-b68f-bc4fefdfebb5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:37.619229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b64ac0-6ac6-4529-b68f-bc4fefdfebb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:37.665693 n-d-master-1 devstack@keystone.service[81853]: WARNING keystone.auth.plugins.core [None req-a7b64ac0-6ac6-4529-b68f-bc4fefdfebb5 None None] User is disabled: 8ad0977487f34a57b727e38dec4d52ab: AssertionError: User is disabled: 8ad0977487f34a57b727e38dec4d52ab Oct 02 01:21:37.683524 n-d-master-1 devstack@keystone.service[81853]: WARNING keystone.server.flask.application [None req-a7b64ac0-6ac6-4529-b68f-bc4fefdfebb5 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 02 01:21:37.685562 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2329/4633] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:37 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 68 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 02 01:21:37.689745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:37.691581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:37.724127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193308e-337c-4b42-8368-0fa90a8f7633 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:37.742797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f6953a22d24578b6c8e0f188bad8d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee1eadb774aa483289b7b429e0e69bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:37.746539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:37.747759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:37.749226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] PATH_INFO: `/v3/users/8ad0977487f34a57b727e38dec4d52ab` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:37.803988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8ad0977487f34a57b727e38dec4d52ab)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:37.812138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:37.895023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad0977487f34a57b727e38dec4d52ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:37.918805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b64ac0-6ac6-4529-b68f-bc4fefdfebb5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:37.922204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a7b64ac0-6ac6-4529-b68f-bc4fefdfebb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:37.952991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad0977487f34a57b727e38dec4d52ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:37.953987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad0977487f34a57b727e38dec4d52ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:37.980880 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:37.991997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad0977487f34a57b727e38dec4d52ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.007820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad0977487f34a57b727e38dec4d52ab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.023063 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2305/4634] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:37 2022] DELETE /identity/v3/users/8ad0977487f34a57b727e38dec4d52ab => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:38.024283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:38.031588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:38.170780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b64ac0-6ac6-4529-b68f-bc4fefdfebb5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:38.178621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118f49-38fb-4fd0-8ec3-e5719552fc78 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:38.194958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f6953a22d24578b6c8e0f188bad8d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee1eadb774aa483289b7b429e0e69bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:38.195627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:38.195915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:38.196197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] PATH_INFO: `/v3/projects/9760f4bd17df41cfa5929d2f88e7e0d6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:38.197865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9760f4bd17df41cfa5929d2f88e7e0d6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:38.199953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:38.204939 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:38.317962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9760f4bd17df41cfa5929d2f88e7e0d6', 'request_id': 'req-f9b94f30-50f0-4eda-aa33-be4c4d353adf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.329037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9760f4bd17df41cfa5929d2f88e7e0d6', 'request_id': 'req-f9b94f30-50f0-4eda-aa33-be4c4d353adf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.351320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9760f4bd17df41cfa5929d2f88e7e0d6', 'request_id': 'req-f9b94f30-50f0-4eda-aa33-be4c4d353adf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.377185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] The token cache is being invalidate because project 9760f4bd17df41cfa5929d2f88e7e0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:38.377185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.388105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.394760 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2306/4635] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:38 2022] DELETE /identity/v3/projects/9760f4bd17df41cfa5929d2f88e7e0d6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:38.395585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:38.397227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:38.402746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:38.404067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:38.404677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:38.404952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] PATH_INFO: `/v3/projects/43f430c55874406eabf551e14b955282` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:38.406786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f430c55874406eabf551e14b955282)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:38.408984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:38.510863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f430c55874406eabf551e14b955282', 'request_id': 'req-d31fde3a-0f59-41b9-83c3-d2e5e7790137'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.526639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f430c55874406eabf551e14b955282', 'request_id': 'req-d31fde3a-0f59-41b9-83c3-d2e5e7790137'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.535329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b94f30-50f0-4eda-aa33-be4c4d353adf tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:38.537612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f430c55874406eabf551e14b955282', 'request_id': 'req-d31fde3a-0f59-41b9-83c3-d2e5e7790137'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.560238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] The token cache is being invalidate because project 43f430c55874406eabf551e14b955282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:38.560542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.561467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d31fde3a-0f59-41b9-83c3-d2e5e7790137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:38.565821 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2330/4636] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:37 2022] DELETE /identity/v3/projects/43f430c55874406eabf551e14b955282 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:21:38.570558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13455f-cd6b-45e1-969e-00eb15d251f8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:38.570856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13455f-cd6b-45e1-969e-00eb15d251f8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:38.571081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13455f-cd6b-45e1-969e-00eb15d251f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:38.620221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5e13455f-cd6b-45e1-969e-00eb15d251f8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:38.622499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5e13455f-cd6b-45e1-969e-00eb15d251f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:38.670910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ea003-26c3-4089-9206-c5ef1e3fdd10 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f6953a22d24578b6c8e0f188bad8d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee1eadb774aa483289b7b429e0e69bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:38.671732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea003-26c3-4089-9206-c5ef1e3fdd10 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:38.672016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea003-26c3-4089-9206-c5ef1e3fdd10 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:38.672293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea003-26c3-4089-9206-c5ef1e3fdd10 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:38.672946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ea003-26c3-4089-9206-c5ef1e3fdd10 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:38.679462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ea003-26c3-4089-9206-c5ef1e3fdd10 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d61ea003-26c3-4089-9206-c5ef1e3fdd10 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Could not find domain: 7d4599b8c0f04a2ca7b01f7d6a0fc2ff.: keystone.exception.DomainNotFound: Could not find domain: 7d4599b8c0f04a2ca7b01f7d6a0fc2ff. Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7d4599b8c0f04a2ca7b01f7d6a0fc2ff. Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:21:38.710955 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 02 01:21:38.712126 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:21:38.713159 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:21:38.714131 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:21:38.714131 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7d4599b8c0f04a2ca7b01f7d6a0fc2ff. Oct 02 01:21:38.714131 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:21:38.723491 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2307/4637] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:38 2022] POST /identity/v3/users => generated 112 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:21:38.725289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ea003-26c3-4089-9206-c5ef1e3fdd10 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:38.727892 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:38.729093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d61ea003-26c3-4089-9206-c5ef1e3fdd10 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:38.776012 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2331/4638] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:21:38.785969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b647dc-1c25-4875-9556-edad7c6e9cc4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:38.786320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b647dc-1c25-4875-9556-edad7c6e9cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:38.786567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b647dc-1c25-4875-9556-edad7c6e9cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:38.809480 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:38.820538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-12b647dc-1c25-4875-9556-edad7c6e9cc4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:38.822657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-12b647dc-1c25-4875-9556-edad7c6e9cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:38.854763 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2332/4639] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:21:38.860777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b647dc-1c25-4875-9556-edad7c6e9cc4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:38.880915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b647dc-1c25-4875-9556-edad7c6e9cc4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:38.887942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ea003-26c3-4089-9206-c5ef1e3fdd10 tempest-UsersNegativeTest-433157184 tempest-UsersNegativeTest-433157184-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:38.892500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79371c3d-0f85-4d47-a05c-36011157fb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:38.903167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79371c3d-0f85-4d47-a05c-36011157fb43 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:38.904119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79371c3d-0f85-4d47-a05c-36011157fb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:38.904409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79371c3d-0f85-4d47-a05c-36011157fb43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:38.907017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79371c3d-0f85-4d47-a05c-36011157fb43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:21:38.907339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79371c3d-0f85-4d47-a05c-36011157fb43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:38.911179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2647d5e-3c71-433e-8661-a5dea13833b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:38.912174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79371c3d-0f85-4d47-a05c-36011157fb43 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:38.913365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647d5e-3c71-433e-8661-a5dea13833b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:38.914964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647d5e-3c71-433e-8661-a5dea13833b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:38.915464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647d5e-3c71-433e-8661-a5dea13833b3 admin admin] PATH_INFO: `/v3/users/f36bf7b45b0149b28ce5c14a1a6d4f2b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:38.918731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2647d5e-3c71-433e-8661-a5dea13833b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f36bf7b45b0149b28ce5c14a1a6d4f2b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:38.925509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2647d5e-3c71-433e-8661-a5dea13833b3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:38.939909 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2333/4640] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:21:38.947836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79371c3d-0f85-4d47-a05c-36011157fb43 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:38.986169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79371c3d-0f85-4d47-a05c-36011157fb43 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:39.016455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7121b82-72a2-4761-9f50-1fc6140bdfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:39.017328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7121b82-72a2-4761-9f50-1fc6140bdfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:39.017781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7121b82-72a2-4761-9f50-1fc6140bdfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:39.018298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7121b82-72a2-4761-9f50-1fc6140bdfc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:39.021111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7121b82-72a2-4761-9f50-1fc6140bdfc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:39.026321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7121b82-72a2-4761-9f50-1fc6140bdfc9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:39.076868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2647d5e-3c71-433e-8661-a5dea13833b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f36bf7b45b0149b28ce5c14a1a6d4f2b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:39.107178 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2334/4641] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:38 2022] POST /identity/v3/projects => generated 395 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:39.113552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7121b82-72a2-4761-9f50-1fc6140bdfc9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:39.119780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2647d5e-3c71-433e-8661-a5dea13833b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f36bf7b45b0149b28ce5c14a1a6d4f2b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:39.121526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2647d5e-3c71-433e-8661-a5dea13833b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f36bf7b45b0149b28ce5c14a1a6d4f2b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:39.148060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2647d5e-3c71-433e-8661-a5dea13833b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f36bf7b45b0149b28ce5c14a1a6d4f2b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:39.166103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2647d5e-3c71-433e-8661-a5dea13833b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f36bf7b45b0149b28ce5c14a1a6d4f2b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:39.202972 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2308/4642] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:38 2022] DELETE /identity/v3/users/f36bf7b45b0149b28ce5c14a1a6d4f2b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:39.208764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001dfda-cab5-47ff-9d67-110708dedbab None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:39.209103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001dfda-cab5-47ff-9d67-110708dedbab None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:39.209571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001dfda-cab5-47ff-9d67-110708dedbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:39.263177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7121b82-72a2-4761-9f50-1fc6140bdfc9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:39.268182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5001dfda-cab5-47ff-9d67-110708dedbab None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:39.272906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5001dfda-cab5-47ff-9d67-110708dedbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:39.374082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6780134-89d2-4505-9021-a35ecdaecbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:39.375458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6780134-89d2-4505-9021-a35ecdaecbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:39.375813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6780134-89d2-4505-9021-a35ecdaecbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:39.376156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6780134-89d2-4505-9021-a35ecdaecbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:39.376866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6780134-89d2-4505-9021-a35ecdaecbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:39.381515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6780134-89d2-4505-9021-a35ecdaecbf3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:39.423925 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2309/4643] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:39.438216 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2335/4644] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:39 2022] POST /identity/v3/users => generated 298 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:39.446545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001dfda-cab5-47ff-9d67-110708dedbab None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:39.448345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5001dfda-cab5-47ff-9d67-110708dedbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:39.470851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001dfda-cab5-47ff-9d67-110708dedbab None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:39.489959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77533569-202c-4652-b06e-de5f80fddf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:39.491843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77533569-202c-4652-b06e-de5f80fddf7e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:39.492188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77533569-202c-4652-b06e-de5f80fddf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:39.493556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77533569-202c-4652-b06e-de5f80fddf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:39.494285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77533569-202c-4652-b06e-de5f80fddf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:39.502053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77533569-202c-4652-b06e-de5f80fddf7e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:39.508085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6780134-89d2-4505-9021-a35ecdaecbf3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:39.510126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d6780134-89d2-4505-9021-a35ecdaecbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:39.526242 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2310/4645] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:39.533107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77533569-202c-4652-b06e-de5f80fddf7e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:39.558196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77533569-202c-4652-b06e-de5f80fddf7e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:39.573928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c08bfb-7688-40e2-bb63-c6bb40a97805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:39.574561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c08bfb-7688-40e2-bb63-c6bb40a97805 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:39.574897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c08bfb-7688-40e2-bb63-c6bb40a97805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:39.575176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c08bfb-7688-40e2-bb63-c6bb40a97805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:39.575836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c08bfb-7688-40e2-bb63-c6bb40a97805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:39.577461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c08bfb-7688-40e2-bb63-c6bb40a97805 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:39.603218 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2311/4646] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:39.604535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c08bfb-7688-40e2-bb63-c6bb40a97805 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:39.618213 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:39.632083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c08bfb-7688-40e2-bb63-c6bb40a97805 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:39.644470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6780134-89d2-4505-9021-a35ecdaecbf3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:39.647945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f6562-13a1-468e-a793-8aab989e3a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:39.648639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6562-13a1-468e-a793-8aab989e3a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:39.648927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6562-13a1-468e-a793-8aab989e3a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:39.649205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6562-13a1-468e-a793-8aab989e3a09 admin admin] PATH_INFO: `/v3/projects/22fb92463e1c4d17947550b9b5513d70/users/953559ae78e14bffa8ec7b866b498875/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:39.652123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d62eab-4b3a-4db0-9aa8-d7138ed46273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:39.652943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d62eab-4b3a-4db0-9aa8-d7138ed46273 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:39.653377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d62eab-4b3a-4db0-9aa8-d7138ed46273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:39.653819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d62eab-4b3a-4db0-9aa8-d7138ed46273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:39.669014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d62eab-4b3a-4db0-9aa8-d7138ed46273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:39.670720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d62eab-4b3a-4db0-9aa8-d7138ed46273 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:39.685920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f6562-13a1-468e-a793-8aab989e3a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fb92463e1c4d17947550b9b5513d70, user_id=953559ae78e14bffa8ec7b866b498875, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:39.690524 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2336/4647] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:21:39.693059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f6562-13a1-468e-a793-8aab989e3a09 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:39.723193 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2312/4648] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:39 2022] PUT /identity/v3/projects/22fb92463e1c4d17947550b9b5513d70/users/953559ae78e14bffa8ec7b866b498875/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:39.728358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761fa88-3e8f-4bfe-8f1a-f6e9ad594e47 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:39.728762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761fa88-3e8f-4bfe-8f1a-f6e9ad594e47 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:39.729137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761fa88-3e8f-4bfe-8f1a-f6e9ad594e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:39.756219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d761fa88-3e8f-4bfe-8f1a-f6e9ad594e47 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:39.758159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d761fa88-3e8f-4bfe-8f1a-f6e9ad594e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:39.935704 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2337/4649] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:39.949633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f6562-13a1-468e-a793-8aab989e3a09 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:39.951700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-573f6562-13a1-468e-a793-8aab989e3a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:39.994120 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:40.093628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f6562-13a1-468e-a793-8aab989e3a09 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:40.097899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ea4cb-22b8-44df-a8ac-2b7d9d1198ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:40.098517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea4cb-22b8-44df-a8ac-2b7d9d1198ef service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:40.099001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea4cb-22b8-44df-a8ac-2b7d9d1198ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:40.099280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea4cb-22b8-44df-a8ac-2b7d9d1198ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:40.111559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ea4cb-22b8-44df-a8ac-2b7d9d1198ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:40.115703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ea4cb-22b8-44df-a8ac-2b7d9d1198ef service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:40.133495 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2313/4650] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:41.947087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761fa88-3e8f-4bfe-8f1a-f6e9ad594e47 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:41.949043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d761fa88-3e8f-4bfe-8f1a-f6e9ad594e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:41.972552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761fa88-3e8f-4bfe-8f1a-f6e9ad594e47 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:41.984676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:41.985336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:41.985607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:41.986035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] PATH_INFO: `/v3/projects/90dac64fe16b4bd19fcb57bd348bfd8a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:41.988416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90dac64fe16b4bd19fcb57bd348bfd8a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:41.995138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:42.138405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90dac64fe16b4bd19fcb57bd348bfd8a', 'request_id': 'req-b5a231c5-da67-4c14-b382-8f2b8e64db07'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:42.147026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90dac64fe16b4bd19fcb57bd348bfd8a', 'request_id': 'req-b5a231c5-da67-4c14-b382-8f2b8e64db07'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:42.160046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90dac64fe16b4bd19fcb57bd348bfd8a', 'request_id': 'req-b5a231c5-da67-4c14-b382-8f2b8e64db07'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:42.216776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] The token cache is being invalidate because project 90dac64fe16b4bd19fcb57bd348bfd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:42.217412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:42.220159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:42.222813 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2338/4651] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:41 2022] DELETE /identity/v3/projects/90dac64fe16b4bd19fcb57bd348bfd8a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:42.230191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ea4cb-22b8-44df-a8ac-2b7d9d1198ef service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:42.240604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ea4cb-22b8-44df-a8ac-2b7d9d1198ef service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:42.402954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fffe46-efdf-49be-b7c4-02645993288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:42.403613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fffe46-efdf-49be-b7c4-02645993288e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:42.403893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fffe46-efdf-49be-b7c4-02645993288e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:42.404171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fffe46-efdf-49be-b7c4-02645993288e admin admin] PATH_INFO: `/v3/users/52f6953a22d24578b6c8e0f188bad8d9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:42.407032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fffe46-efdf-49be-b7c4-02645993288e admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f6953a22d24578b6c8e0f188bad8d9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:42.408986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fffe46-efdf-49be-b7c4-02645993288e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:42.515629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28fffe46-efdf-49be-b7c4-02645993288e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f6953a22d24578b6c8e0f188bad8d9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:42.568626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28fffe46-efdf-49be-b7c4-02645993288e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f6953a22d24578b6c8e0f188bad8d9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:42.570358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28fffe46-efdf-49be-b7c4-02645993288e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f6953a22d24578b6c8e0f188bad8d9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:42.593469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28fffe46-efdf-49be-b7c4-02645993288e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f6953a22d24578b6c8e0f188bad8d9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:42.617496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28fffe46-efdf-49be-b7c4-02645993288e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f6953a22d24578b6c8e0f188bad8d9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:42.632267 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2314/4652] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:21:42 2022] DELETE /identity/v3/users/52f6953a22d24578b6c8e0f188bad8d9 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:44.287850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:44.290163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:44.330366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a231c5-da67-4c14-b382-8f2b8e64db07 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:44.495124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:44.496712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:44.496993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:44.497264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] PATH_INFO: `/v3/projects/ee1eadb774aa483289b7b429e0e69bdf` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:44.498572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee1eadb774aa483289b7b429e0e69bdf)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:44.501028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:44.520373 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:44.601215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee1eadb774aa483289b7b429e0e69bdf', 'request_id': 'req-9aac7a56-2a13-42d1-8630-8a941e657940'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:44.610756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee1eadb774aa483289b7b429e0e69bdf', 'request_id': 'req-9aac7a56-2a13-42d1-8630-8a941e657940'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:44.623749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee1eadb774aa483289b7b429e0e69bdf', 'request_id': 'req-9aac7a56-2a13-42d1-8630-8a941e657940'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:44.648120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] The token cache is being invalidate because project ee1eadb774aa483289b7b429e0e69bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:21:44.649385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:44.650815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9aac7a56-2a13-42d1-8630-8a941e657940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:21:44.659423 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2339/4653] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:21:44 2022] DELETE /identity/v3/projects/ee1eadb774aa483289b7b429e0e69bdf => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:44.661064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273cbe-7c9a-400e-bb55-0055ed3ed46f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:44.661543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273cbe-7c9a-400e-bb55-0055ed3ed46f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:44.661747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273cbe-7c9a-400e-bb55-0055ed3ed46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:44.689675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0d273cbe-7c9a-400e-bb55-0055ed3ed46f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:44.691305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0d273cbe-7c9a-400e-bb55-0055ed3ed46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:44.725605 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:44.775464 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2315/4654] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:44.783883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ac999-c527-4e15-aef4-d107c540040e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:44.784281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ac999-c527-4e15-aef4-d107c540040e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:44.784652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ac999-c527-4e15-aef4-d107c540040e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:44.833068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c08ac999-c527-4e15-aef4-d107c540040e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:44.834320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c08ac999-c527-4e15-aef4-d107c540040e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:44.855143 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2340/4655] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:21:44.859832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d273cbe-7c9a-400e-bb55-0055ed3ed46f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:44.873260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d273cbe-7c9a-400e-bb55-0055ed3ed46f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:44.903546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449353eb-ae2e-4f9a-8b90-563498c7427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:44.904113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449353eb-ae2e-4f9a-8b90-563498c7427c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:44.904398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449353eb-ae2e-4f9a-8b90-563498c7427c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:44.904817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449353eb-ae2e-4f9a-8b90-563498c7427c admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:44.905696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449353eb-ae2e-4f9a-8b90-563498c7427c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:21:44.906167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449353eb-ae2e-4f9a-8b90-563498c7427c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:44.908019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449353eb-ae2e-4f9a-8b90-563498c7427c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:44.938722 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2316/4656] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:21:44.941067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ac999-c527-4e15-aef4-d107c540040e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:44.953653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ac999-c527-4e15-aef4-d107c540040e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:44.970935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c0648-adbe-4b08-a4cd-1df79aabeeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:44.972488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c0648-adbe-4b08-a4cd-1df79aabeeee admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:44.972920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c0648-adbe-4b08-a4cd-1df79aabeeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:44.973347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c0648-adbe-4b08-a4cd-1df79aabeeee admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:44.974201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c0648-adbe-4b08-a4cd-1df79aabeeee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:44.980222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c0648-adbe-4b08-a4cd-1df79aabeeee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:45.049914 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2341/4657] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:44 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:21:45.054129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449353eb-ae2e-4f9a-8b90-563498c7427c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:45.067418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449353eb-ae2e-4f9a-8b90-563498c7427c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:45.184127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8aaa9-dd22-4a43-bb34-2d4698620346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:45.184751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8aaa9-dd22-4a43-bb34-2d4698620346 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:45.185035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8aaa9-dd22-4a43-bb34-2d4698620346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:45.185313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8aaa9-dd22-4a43-bb34-2d4698620346 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:45.185951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8aaa9-dd22-4a43-bb34-2d4698620346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:45.187935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8aaa9-dd22-4a43-bb34-2d4698620346 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:45.233164 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2317/4658] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:45 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:45.238236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c0648-adbe-4b08-a4cd-1df79aabeeee admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:45.257210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c0648-adbe-4b08-a4cd-1df79aabeeee admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:45.271548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac9b32-11d6-4d38-bb92-f24ed9f9a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:45.273150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9b32-11d6-4d38-bb92-f24ed9f9a7ed admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:45.274204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9b32-11d6-4d38-bb92-f24ed9f9a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:45.276454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9b32-11d6-4d38-bb92-f24ed9f9a7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:45.277427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac9b32-11d6-4d38-bb92-f24ed9f9a7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:45.281899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac9b32-11d6-4d38-bb92-f24ed9f9a7ed admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:45.307020 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2342/4659] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:45.311173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8aaa9-dd22-4a43-bb34-2d4698620346 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:45.327066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8aaa9-dd22-4a43-bb34-2d4698620346 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:45.340916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9bc54-e6f6-4af6-8741-fe7e3ddb6418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:45.341792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9bc54-e6f6-4af6-8741-fe7e3ddb6418 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:45.342376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9bc54-e6f6-4af6-8741-fe7e3ddb6418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:45.342853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9bc54-e6f6-4af6-8741-fe7e3ddb6418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:45.343682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9bc54-e6f6-4af6-8741-fe7e3ddb6418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:45.346898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9bc54-e6f6-4af6-8741-fe7e3ddb6418 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:45.361154 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2318/4660] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:45.365992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac9b32-11d6-4d38-bb92-f24ed9f9a7ed admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:45.381083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac9b32-11d6-4d38-bb92-f24ed9f9a7ed admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:45.394562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55f107-be5b-4494-b54a-3b2635db102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:45.395274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55f107-be5b-4494-b54a-3b2635db102e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:45.395562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55f107-be5b-4494-b54a-3b2635db102e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:45.395839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55f107-be5b-4494-b54a-3b2635db102e admin admin] PATH_INFO: `/v3/projects/eee612756ca94222b8ef4cd96da28309/users/da2dea71988a4399856fef9ff1cb5694/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:45.410991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9bc54-e6f6-4af6-8741-fe7e3ddb6418 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:45.413210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31f9bc54-e6f6-4af6-8741-fe7e3ddb6418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:45.431983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55f107-be5b-4494-b54a-3b2635db102e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee612756ca94222b8ef4cd96da28309, user_id=da2dea71988a4399856fef9ff1cb5694, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:45.434578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55f107-be5b-4494-b54a-3b2635db102e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:45.465569 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2343/4661] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:45 2022] PUT /identity/v3/projects/eee612756ca94222b8ef4cd96da28309/users/da2dea71988a4399856fef9ff1cb5694/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:45.476850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1f900-4959-4ec5-b7ee-875634572dd2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:45.477437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1f900-4959-4ec5-b7ee-875634572dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:45.477978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1f900-4959-4ec5-b7ee-875634572dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:45.538093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-47f1f900-4959-4ec5-b7ee-875634572dd2 None None] MFA Rules not processed for user `da2dea71988a4399856fef9ff1cb5694`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:45.541009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-47f1f900-4959-4ec5-b7ee-875634572dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:45.563224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9bc54-e6f6-4af6-8741-fe7e3ddb6418 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:45.699082 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:45.745489 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2344/4662] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:45.749703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1f900-4959-4ec5-b7ee-875634572dd2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:45.771602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c871042-41c7-4885-aba9-4f23add5bdab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:45.772229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c871042-41c7-4885-aba9-4f23add5bdab service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:45.772515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c871042-41c7-4885-aba9-4f23add5bdab service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:45.772793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c871042-41c7-4885-aba9-4f23add5bdab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:45.775254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4c871042-41c7-4885-aba9-4f23add5bdab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:45.796269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c871042-41c7-4885-aba9-4f23add5bdab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:45.796679 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:45.798053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c871042-41c7-4885-aba9-4f23add5bdab service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:45.843034 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2319/4663] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:45.845217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1f900-4959-4ec5-b7ee-875634572dd2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:45.853065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adb640-e68e-4f21-beb9-017e66b637ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:45.854062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adb640-e68e-4f21-beb9-017e66b637ce admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:45.854786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adb640-e68e-4f21-beb9-017e66b637ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:45.856270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adb640-e68e-4f21-beb9-017e66b637ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:45.858231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adb640-e68e-4f21-beb9-017e66b637ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:45.863305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adb640-e68e-4f21-beb9-017e66b637ce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:45.942792 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2345/4664] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:21:45 2022] POST /identity/v3/projects => generated 391 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:45.947010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c871042-41c7-4885-aba9-4f23add5bdab service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:45.961901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c871042-41c7-4885-aba9-4f23add5bdab service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:46.104047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95934f-7948-4147-998a-9cfedf457cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:46.104811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95934f-7948-4147-998a-9cfedf457cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:46.104939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95934f-7948-4147-998a-9cfedf457cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:46.105205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95934f-7948-4147-998a-9cfedf457cbc admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:46.105862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95934f-7948-4147-998a-9cfedf457cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:46.114539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95934f-7948-4147-998a-9cfedf457cbc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:46.162565 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2320/4665] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:21:45 2022] POST /identity/v3/users => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:21:46.166501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adb640-e68e-4f21-beb9-017e66b637ce admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:46.181199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adb640-e68e-4f21-beb9-017e66b637ce admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:46.194084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a8050-b57f-44dd-8c05-856ac525333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:46.194558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a8050-b57f-44dd-8c05-856ac525333f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:46.194875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a8050-b57f-44dd-8c05-856ac525333f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:46.195150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a8050-b57f-44dd-8c05-856ac525333f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:46.196281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a8050-b57f-44dd-8c05-856ac525333f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:46.198869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a8050-b57f-44dd-8c05-856ac525333f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:46.215635 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2346/4666] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:46.219669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95934f-7948-4147-998a-9cfedf457cbc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:46.248072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95934f-7948-4147-998a-9cfedf457cbc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:46.256551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe3c82-6da8-413d-a1de-bb8798a0cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:46.257270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3c82-6da8-413d-a1de-bb8798a0cd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:46.257546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3c82-6da8-413d-a1de-bb8798a0cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:46.257817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3c82-6da8-413d-a1de-bb8798a0cd24 admin admin] PATH_INFO: `/v3/projects/ef29ef174c5a4066953afa53690aa87d/users/7e1be013407c458fa6ebacf8b57b5c3a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:46.293733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe3c82-6da8-413d-a1de-bb8798a0cd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef29ef174c5a4066953afa53690aa87d, user_id=7e1be013407c458fa6ebacf8b57b5c3a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:46.296720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe3c82-6da8-413d-a1de-bb8798a0cd24 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:46.335001 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2321/4667] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:46 2022] PUT /identity/v3/projects/ef29ef174c5a4066953afa53690aa87d/users/7e1be013407c458fa6ebacf8b57b5c3a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:46.335397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a8050-b57f-44dd-8c05-856ac525333f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:46.353271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a8050-b57f-44dd-8c05-856ac525333f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:46.568254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d3b53-f21d-43dc-904a-a50afef9e66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:46.568903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3b53-f21d-43dc-904a-a50afef9e66c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:46.569187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3b53-f21d-43dc-904a-a50afef9e66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:46.569464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d3b53-f21d-43dc-904a-a50afef9e66c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:46.570117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d3b53-f21d-43dc-904a-a50afef9e66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:46.574908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d3b53-f21d-43dc-904a-a50afef9e66c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:46.614567 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2347/4668] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:21:46.617015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe3c82-6da8-413d-a1de-bb8798a0cd24 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:46.640632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe3c82-6da8-413d-a1de-bb8798a0cd24 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:46.648362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bc7a7-e871-4d6b-aa34-6b33413561a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:46.649909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bc7a7-e871-4d6b-aa34-6b33413561a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:46.650425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bc7a7-e871-4d6b-aa34-6b33413561a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:46.651003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bc7a7-e871-4d6b-aa34-6b33413561a6 admin admin] PATH_INFO: `/v3/projects/ef29ef174c5a4066953afa53690aa87d/users/7e1be013407c458fa6ebacf8b57b5c3a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:46.653406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bc7a7-e871-4d6b-aa34-6b33413561a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef29ef174c5a4066953afa53690aa87d, user_id=7e1be013407c458fa6ebacf8b57b5c3a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:46.656553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bc7a7-e871-4d6b-aa34-6b33413561a6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:46.671228 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2322/4669] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:21:46 2022] PUT /identity/v3/projects/ef29ef174c5a4066953afa53690aa87d/users/7e1be013407c458fa6ebacf8b57b5c3a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:21:46.682592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5216f-faa0-41ba-b303-8b57a8ff6d1b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:46.682961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5216f-faa0-41ba-b303-8b57a8ff6d1b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:46.683170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5216f-faa0-41ba-b303-8b57a8ff6d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:46.738717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e9f5216f-faa0-41ba-b303-8b57a8ff6d1b None None] MFA Rules not processed for user `7e1be013407c458fa6ebacf8b57b5c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:46.739981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e9f5216f-faa0-41ba-b303-8b57a8ff6d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:46.876563 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2348/4670] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:47.045428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bc7a7-e871-4d6b-aa34-6b33413561a6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:47.048684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5c7bc7a7-e871-4d6b-aa34-6b33413561a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:47.225548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bc7a7-e871-4d6b-aa34-6b33413561a6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:47.243364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a9a43-5701-4db4-a4dc-5c529e6f0ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:47.243939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a9a43-5701-4db4-a4dc-5c529e6f0ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:47.245605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a9a43-5701-4db4-a4dc-5c529e6f0ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:47.245884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a9a43-5701-4db4-a4dc-5c529e6f0ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:47.340908 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:47.423695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a9a43-5701-4db4-a4dc-5c529e6f0ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:47.425627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a9a43-5701-4db4-a4dc-5c529e6f0ed4 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:47.442505 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2323/4671] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:51.143082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5216f-faa0-41ba-b303-8b57a8ff6d1b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:51.144985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e9f5216f-faa0-41ba-b303-8b57a8ff6d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:51.176809 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:51.333965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5216f-faa0-41ba-b303-8b57a8ff6d1b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:51.359081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a19a4c-53a4-4b03-95cc-db3706cbaded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:51.360172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19a4c-53a4-4b03-95cc-db3706cbaded service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:51.360657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19a4c-53a4-4b03-95cc-db3706cbaded service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:51.362964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19a4c-53a4-4b03-95cc-db3706cbaded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:51.365601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b8a19a4c-53a4-4b03-95cc-db3706cbaded service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:51.508593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19a4c-53a4-4b03-95cc-db3706cbaded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:51.510238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19a4c-53a4-4b03-95cc-db3706cbaded service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:51.550656 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2349/4672] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:51 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:54.568073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a9a43-5701-4db4-a4dc-5c529e6f0ed4 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:54.577780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a9a43-5701-4db4-a4dc-5c529e6f0ed4 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:54.582459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae4ab5-8d5d-482f-b50d-84a90f417aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:54.583120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae4ab5-8d5d-482f-b50d-84a90f417aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:54.583406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae4ab5-8d5d-482f-b50d-84a90f417aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:54.583677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae4ab5-8d5d-482f-b50d-84a90f417aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:54.593454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae4ab5-8d5d-482f-b50d-84a90f417aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:54.595325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae4ab5-8d5d-482f-b50d-84a90f417aa5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:54.607308 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2324/4673] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:21:58.414246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6c54-ff97-4350-a329-0c4c9a516da0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:58.414836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6c54-ff97-4350-a329-0c4c9a516da0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:58.415042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6c54-ff97-4350-a329-0c4c9a516da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:58.480361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-eefb6c54-ff97-4350-a329-0c4c9a516da0 None None] MFA Rules not processed for user `953559ae78e14bffa8ec7b866b498875`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:58.481558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eefb6c54-ff97-4350-a329-0c4c9a516da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:58.622173 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2350/4674] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:58.632785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b9717-578a-40e0-904c-eb8f695f6f4b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:58.633343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b9717-578a-40e0-904c-eb8f695f6f4b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:58.633343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b9717-578a-40e0-904c-eb8f695f6f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:58.699345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-225b9717-578a-40e0-904c-eb8f695f6f4b None None] MFA Rules not processed for user `953559ae78e14bffa8ec7b866b498875`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:21:58.700978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-225b9717-578a-40e0-904c-eb8f695f6f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:21:58.728656 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2325/4675] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:21:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:21:58.887343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb6c54-ff97-4350-a329-0c4c9a516da0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:21:58.909538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb6c54-ff97-4350-a329-0c4c9a516da0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:21:58.925872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266d943-8cdb-4149-971c-2cea1f8aea6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:21:58.926919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266d943-8cdb-4149-971c-2cea1f8aea6d service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:21:58.927050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266d943-8cdb-4149-971c-2cea1f8aea6d service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:21:58.927247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266d943-8cdb-4149-971c-2cea1f8aea6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:21:58.951348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266d943-8cdb-4149-971c-2cea1f8aea6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:21:58.951348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266d943-8cdb-4149-971c-2cea1f8aea6d service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:21:58.991977 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2351/4676] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:21:58 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:22:04.967953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b9717-578a-40e0-904c-eb8f695f6f4b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:05.089287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b9717-578a-40e0-904c-eb8f695f6f4b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:05.097865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:05.098528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:05.098833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:05.099338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] PATH_INFO: `/v3/users/da2dea71988a4399856fef9ff1cb5694` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:05.100878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2dea71988a4399856fef9ff1cb5694)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:05.103160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:05.231712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2dea71988a4399856fef9ff1cb5694'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:05.281127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2dea71988a4399856fef9ff1cb5694'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:05.284984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2dea71988a4399856fef9ff1cb5694'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:05.317986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2dea71988a4399856fef9ff1cb5694'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:05.338921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2dea71988a4399856fef9ff1cb5694'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:05.356565 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2326/4677] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:04 2022] DELETE /identity/v3/users/da2dea71988a4399856fef9ff1cb5694 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:05.357060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636015-313c-4f92-9d38-df73467571b8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:05.357542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636015-313c-4f92-9d38-df73467571b8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:05.357738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636015-313c-4f92-9d38-df73467571b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:05.399761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9e636015-313c-4f92-9d38-df73467571b8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:05.403092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9e636015-313c-4f92-9d38-df73467571b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:05.516791 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:05.584858 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2352/4678] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:22:05.636982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:05.639514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:05.715491 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:05.792957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499db88e-73a2-4837-8119-f0286d3155ab admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:05.805869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2392170-3ff5-478d-b40b-963687d1042e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:05.814579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392170-3ff5-478d-b40b-963687d1042e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:05.814924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392170-3ff5-478d-b40b-963687d1042e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:05.815196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392170-3ff5-478d-b40b-963687d1042e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:05.840464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2392170-3ff5-478d-b40b-963687d1042e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:05.842236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2392170-3ff5-478d-b40b-963687d1042e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:05.872872 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2327/4679] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:22:07.179835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e636015-313c-4f92-9d38-df73467571b8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:07.181403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9e636015-313c-4f92-9d38-df73467571b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:07.209060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e636015-313c-4f92-9d38-df73467571b8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:07.229832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:07.230880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:07.231310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:07.231991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] PATH_INFO: `/v3/projects/eee612756ca94222b8ef4cd96da28309` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:07.235400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee612756ca94222b8ef4cd96da28309)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:07.238348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:07.353201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee612756ca94222b8ef4cd96da28309', 'request_id': 'req-232ad12d-4ebc-4106-a220-955efbb46ae6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:07.365459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee612756ca94222b8ef4cd96da28309', 'request_id': 'req-232ad12d-4ebc-4106-a220-955efbb46ae6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:07.380013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee612756ca94222b8ef4cd96da28309', 'request_id': 'req-232ad12d-4ebc-4106-a220-955efbb46ae6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:07.414494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] The token cache is being invalidate because project eee612756ca94222b8ef4cd96da28309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:07.416544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:07.419956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:07.427257 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2353/4680] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:07 2022] DELETE /identity/v3/projects/eee612756ca94222b8ef4cd96da28309 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:07.428336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2392170-3ff5-478d-b40b-963687d1042e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:07.445158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2392170-3ff5-478d-b40b-963687d1042e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:07.633371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3da087-1d5e-4bb5-b23b-e2c7613aaee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:07.635251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3da087-1d5e-4bb5-b23b-e2c7613aaee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:07.636161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3da087-1d5e-4bb5-b23b-e2c7613aaee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:07.636443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3da087-1d5e-4bb5-b23b-e2c7613aaee9 admin admin] PATH_INFO: `/v3/users/7e1be013407c458fa6ebacf8b57b5c3a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:07.637742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3da087-1d5e-4bb5-b23b-e2c7613aaee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1be013407c458fa6ebacf8b57b5c3a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:07.640677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3da087-1d5e-4bb5-b23b-e2c7613aaee9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:07.726947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1f3da087-1d5e-4bb5-b23b-e2c7613aaee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1be013407c458fa6ebacf8b57b5c3a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:07.746262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1f3da087-1d5e-4bb5-b23b-e2c7613aaee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1be013407c458fa6ebacf8b57b5c3a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:07.747417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1f3da087-1d5e-4bb5-b23b-e2c7613aaee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1be013407c458fa6ebacf8b57b5c3a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:07.766836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1f3da087-1d5e-4bb5-b23b-e2c7613aaee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1be013407c458fa6ebacf8b57b5c3a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:07.781921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1f3da087-1d5e-4bb5-b23b-e2c7613aaee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1be013407c458fa6ebacf8b57b5c3a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:07.801856 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2328/4681] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:07 2022] DELETE /identity/v3/users/7e1be013407c458fa6ebacf8b57b5c3a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:10.436637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:10.438491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:10.461303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ad12d-4ebc-4106-a220-955efbb46ae6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:10.597784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:10.598430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:10.598768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:10.599044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] PATH_INFO: `/v3/projects/ef29ef174c5a4066953afa53690aa87d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:10.600331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef29ef174c5a4066953afa53690aa87d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:10.602282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:10.679405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef29ef174c5a4066953afa53690aa87d', 'request_id': 'req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:10.689312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef29ef174c5a4066953afa53690aa87d', 'request_id': 'req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:10.691130 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:10.704977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef29ef174c5a4066953afa53690aa87d', 'request_id': 'req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:10.728240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] The token cache is being invalidate because project ef29ef174c5a4066953afa53690aa87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:10.728804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:10.729531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-44b5f1fc-d7b4-476e-8d43-4c9e8a61deb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:10.737410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a5930-1f3e-43fa-9c51-c660842d6da1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:10.737869 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2354/4682] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:10 2022] DELETE /identity/v3/projects/ef29ef174c5a4066953afa53690aa87d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:10.737956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a5930-1f3e-43fa-9c51-c660842d6da1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:10.737956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a5930-1f3e-43fa-9c51-c660842d6da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:10.781939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ae9a5930-1f3e-43fa-9c51-c660842d6da1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:10.786899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ae9a5930-1f3e-43fa-9c51-c660842d6da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:10.900357 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:10.938263 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2329/4683] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:10.940517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe65d4-e013-4cfb-9a17-f9441bcc83c8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:10.941577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe65d4-e013-4cfb-9a17-f9441bcc83c8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:10.942043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe65d4-e013-4cfb-9a17-f9441bcc83c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:10.982088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3dfe65d4-e013-4cfb-9a17-f9441bcc83c8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:10.984420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3dfe65d4-e013-4cfb-9a17-f9441bcc83c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:11.014655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a5930-1f3e-43fa-9c51-c660842d6da1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:11.019997 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2355/4684] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:11.061508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a5930-1f3e-43fa-9c51-c660842d6da1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:11.081696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fd94d-4f7b-4eab-af5d-341596aea080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:11.082566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fd94d-4f7b-4eab-af5d-341596aea080 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:11.083011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fd94d-4f7b-4eab-af5d-341596aea080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:11.083451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fd94d-4f7b-4eab-af5d-341596aea080 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:11.084217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fd94d-4f7b-4eab-af5d-341596aea080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:22:11.084748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fd94d-4f7b-4eab-af5d-341596aea080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:11.087781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fd94d-4f7b-4eab-af5d-341596aea080 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:11.124813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe65d4-e013-4cfb-9a17-f9441bcc83c8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:11.137866 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2330/4685] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:22:11.139729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe65d4-e013-4cfb-9a17-f9441bcc83c8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:11.150423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1478fb-3c5e-47e9-9fe1-4daa16e8dc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:11.151208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1478fb-3c5e-47e9-9fe1-4daa16e8dc82 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:11.151660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1478fb-3c5e-47e9-9fe1-4daa16e8dc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:11.152024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1478fb-3c5e-47e9-9fe1-4daa16e8dc82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:11.152756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1478fb-3c5e-47e9-9fe1-4daa16e8dc82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:11.154815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1478fb-3c5e-47e9-9fe1-4daa16e8dc82 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:11.199724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fd94d-4f7b-4eab-af5d-341596aea080 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:11.209444 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2356/4686] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:11 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:11.213845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fd94d-4f7b-4eab-af5d-341596aea080 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:11.467972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcc075-f292-486c-9ee4-a545351eb0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:11.468623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc075-f292-486c-9ee4-a545351eb0bd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:11.469519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc075-f292-486c-9ee4-a545351eb0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:11.470003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc075-f292-486c-9ee4-a545351eb0bd admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:11.470726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcc075-f292-486c-9ee4-a545351eb0bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:11.472982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcc075-f292-486c-9ee4-a545351eb0bd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:11.529900 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2331/4687] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:11 2022] POST /identity/v3/users => generated 287 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:11.534948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1478fb-3c5e-47e9-9fe1-4daa16e8dc82 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:11.552920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1478fb-3c5e-47e9-9fe1-4daa16e8dc82 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:11.572155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e29239-cf42-42b4-9f6b-2ba8d1e0ad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:11.572832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29239-cf42-42b4-9f6b-2ba8d1e0ad8f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:11.573202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29239-cf42-42b4-9f6b-2ba8d1e0ad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:11.573578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29239-cf42-42b4-9f6b-2ba8d1e0ad8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:11.575003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e29239-cf42-42b4-9f6b-2ba8d1e0ad8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:11.576737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e29239-cf42-42b4-9f6b-2ba8d1e0ad8f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:11.613228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcc075-f292-486c-9ee4-a545351eb0bd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:11.618903 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2357/4688] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:11.626186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcc075-f292-486c-9ee4-a545351eb0bd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:11.640138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6111aa-3efe-44a0-8ad4-68db92e12f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:11.641500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6111aa-3efe-44a0-8ad4-68db92e12f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:11.641877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6111aa-3efe-44a0-8ad4-68db92e12f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:11.642397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6111aa-3efe-44a0-8ad4-68db92e12f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:11.643207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6111aa-3efe-44a0-8ad4-68db92e12f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:11.647276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6111aa-3efe-44a0-8ad4-68db92e12f35 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:11.704288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e29239-cf42-42b4-9f6b-2ba8d1e0ad8f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:11.718320 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2332/4689] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:11.722851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e29239-cf42-42b4-9f6b-2ba8d1e0ad8f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:11.734391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a133-79a9-4640-b48f-d0939f9ab47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:11.737792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a133-79a9-4640-b48f-d0939f9ab47f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:11.738200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a133-79a9-4640-b48f-d0939f9ab47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:11.738729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a133-79a9-4640-b48f-d0939f9ab47f admin admin] PATH_INFO: `/v3/projects/edfd49db753f41daad43f36e980d675b/users/980b3b0a839e4518b5ada0f0d95763d5/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:11.758408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1a133-79a9-4640-b48f-d0939f9ab47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfd49db753f41daad43f36e980d675b, user_id=980b3b0a839e4518b5ada0f0d95763d5, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:11.761404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1a133-79a9-4640-b48f-d0939f9ab47f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:11.794259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc537be-ddd8-4fc9-aa87-cee9386147cb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:11.794799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc537be-ddd8-4fc9-aa87-cee9386147cb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:11.795014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc537be-ddd8-4fc9-aa87-cee9386147cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:11.798484 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2358/4690] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:11 2022] PUT /identity/v3/projects/edfd49db753f41daad43f36e980d675b/users/980b3b0a839e4518b5ada0f0d95763d5/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:22:11.834405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2cc537be-ddd8-4fc9-aa87-cee9386147cb None None] MFA Rules not processed for user `980b3b0a839e4518b5ada0f0d95763d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:11.836046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2cc537be-ddd8-4fc9-aa87-cee9386147cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:12.020264 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2333/4691] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:12.030719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a133-79a9-4640-b48f-d0939f9ab47f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:12.034745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-58b1a133-79a9-4640-b48f-d0939f9ab47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:12.187124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a133-79a9-4640-b48f-d0939f9ab47f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:12.196497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb479b-7bd7-473d-b9c4-3c68b847bf7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:12.197149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb479b-7bd7-473d-b9c4-3c68b847bf7e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:12.197429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb479b-7bd7-473d-b9c4-3c68b847bf7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:12.197709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb479b-7bd7-473d-b9c4-3c68b847bf7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:12.225981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb479b-7bd7-473d-b9c4-3c68b847bf7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:12.229756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb479b-7bd7-473d-b9c4-3c68b847bf7e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:12.254988 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2359/4692] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:22:13.060130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc537be-ddd8-4fc9-aa87-cee9386147cb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:13.079219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc537be-ddd8-4fc9-aa87-cee9386147cb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:13.085133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20934e99-f1fd-4c5b-8c9c-39d5d4e89b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:13.085841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20934e99-f1fd-4c5b-8c9c-39d5d4e89b6d service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:13.086143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20934e99-f1fd-4c5b-8c9c-39d5d4e89b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:13.086423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20934e99-f1fd-4c5b-8c9c-39d5d4e89b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:13.092036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20934e99-f1fd-4c5b-8c9c-39d5d4e89b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:13.190055 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:13.228428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20934e99-f1fd-4c5b-8c9c-39d5d4e89b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:13.230073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20934e99-f1fd-4c5b-8c9c-39d5d4e89b6d service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:13.246522 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2334/4693] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:22:22.252266 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=57,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:23.238347 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=9 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:24.090698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb479b-7bd7-473d-b9c4-3c68b847bf7e service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:24.094075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-45cb479b-7bd7-473d-b9c4-3c68b847bf7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:24.110060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb479b-7bd7-473d-b9c4-3c68b847bf7e service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:24.116112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:24.117010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:24.117454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:24.117894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] PATH_INFO: `/v3/users/db9450c53d8944b88cfbbc541f585ba0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:24.119090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db9450c53d8944b88cfbbc541f585ba0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:24.121225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:24.231379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db9450c53d8944b88cfbbc541f585ba0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:24.323033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db9450c53d8944b88cfbbc541f585ba0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:24.324092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db9450c53d8944b88cfbbc541f585ba0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:24.361971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db9450c53d8944b88cfbbc541f585ba0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:24.364814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db9450c53d8944b88cfbbc541f585ba0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:24.446058 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2360/4694] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:24 2022] DELETE /identity/v3/users/db9450c53d8944b88cfbbc541f585ba0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:25.333185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20934e99-f1fd-4c5b-8c9c-39d5d4e89b6d service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:25.335633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20934e99-f1fd-4c5b-8c9c-39d5d4e89b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:25.357053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20934e99-f1fd-4c5b-8c9c-39d5d4e89b6d service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:25.461395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3f469-5383-43ef-8344-ddb32afe1f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:25.462052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3f469-5383-43ef-8344-ddb32afe1f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:25.462336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3f469-5383-43ef-8344-ddb32afe1f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:25.462632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3f469-5383-43ef-8344-ddb32afe1f28 admin admin] PATH_INFO: `/v3/users/b890aa0529304095933195cea870279b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:25.463860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3f469-5383-43ef-8344-ddb32afe1f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b890aa0529304095933195cea870279b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:25.466256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3f469-5383-43ef-8344-ddb32afe1f28 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:25.540640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51a3f469-5383-43ef-8344-ddb32afe1f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b890aa0529304095933195cea870279b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:25.555854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51a3f469-5383-43ef-8344-ddb32afe1f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b890aa0529304095933195cea870279b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:25.557175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51a3f469-5383-43ef-8344-ddb32afe1f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b890aa0529304095933195cea870279b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:25.568193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51a3f469-5383-43ef-8344-ddb32afe1f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b890aa0529304095933195cea870279b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:25.579515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51a3f469-5383-43ef-8344-ddb32afe1f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b890aa0529304095933195cea870279b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:25.589694 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2335/4695] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:25 2022] DELETE /identity/v3/users/b890aa0529304095933195cea870279b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:25.601634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:25.604017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:25.624875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297963e-f32c-445e-85cc-76b9684d0c2a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:25.745671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:25.746735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:25.747019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:25.747291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] PATH_INFO: `/v3/projects/1d8558d451aa4c17b359f4ae0274a371` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:25.751262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8558d451aa4c17b359f4ae0274a371)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:25.757200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:25.841310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8558d451aa4c17b359f4ae0274a371', 'request_id': 'req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:25.850867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8558d451aa4c17b359f4ae0274a371', 'request_id': 'req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:25.860059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8558d451aa4c17b359f4ae0274a371', 'request_id': 'req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:25.879047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] The token cache is being invalidate because project 1d8558d451aa4c17b359f4ae0274a371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:25.879343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:25.880070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:25.882530 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2361/4696] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:25 2022] DELETE /identity/v3/projects/1d8558d451aa4c17b359f4ae0274a371 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:25.892371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dc6ff-cc3e-4d32-b43c-2a375f3b2d97 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:25.892797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dc6ff-cc3e-4d32-b43c-2a375f3b2d97 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:25.892980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dc6ff-cc3e-4d32-b43c-2a375f3b2d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:25.931585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:25.934181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:25.939291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ab8dc6ff-cc3e-4d32-b43c-2a375f3b2d97 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:25.943694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ab8dc6ff-cc3e-4d32-b43c-2a375f3b2d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:25.945697 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:26.080312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd917-c92c-41fe-9781-7d0c5a9f42b2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:26.080577 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2336/4697] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:26.085176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:26.085923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.086407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.086745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] PATH_INFO: `/v3/projects/e1173034060443ac93a081ad71fb2629` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:26.087874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef85f13-e1a4-454e-a84b-fe754a62350a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.088015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1173034060443ac93a081ad71fb2629)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:26.088169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef85f13-e1a4-454e-a84b-fe754a62350a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.088438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef85f13-e1a4-454e-a84b-fe754a62350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:26.090112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:26.111843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8ef85f13-e1a4-454e-a84b-fe754a62350a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:26.113069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8ef85f13-e1a4-454e-a84b-fe754a62350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:26.126668 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2337/4698] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:22:26.134160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef85f13-e1a4-454e-a84b-fe754a62350a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:26.146502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef85f13-e1a4-454e-a84b-fe754a62350a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:26.155967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1173034060443ac93a081ad71fb2629', 'request_id': 'req-3636d857-14ed-442d-a181-500f908394d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.160182 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:26.165385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1173034060443ac93a081ad71fb2629', 'request_id': 'req-3636d857-14ed-442d-a181-500f908394d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.178626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1173034060443ac93a081ad71fb2629', 'request_id': 'req-3636d857-14ed-442d-a181-500f908394d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.204270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] The token cache is being invalidate because project e1173034060443ac93a081ad71fb2629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:26.205214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.206404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.209258 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2362/4699] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:25 2022] DELETE /identity/v3/projects/e1173034060443ac93a081ad71fb2629 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:22:26.213895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:26.215494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:26.230677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adaff5-090a-4fa5-a1f7-bfe69a0234c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:26.231496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adaff5-090a-4fa5-a1f7-bfe69a0234c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.231681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adaff5-090a-4fa5-a1f7-bfe69a0234c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.231950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adaff5-090a-4fa5-a1f7-bfe69a0234c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:26.232623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adaff5-090a-4fa5-a1f7-bfe69a0234c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:22:26.232915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adaff5-090a-4fa5-a1f7-bfe69a0234c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:26.236112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adaff5-090a-4fa5-a1f7-bfe69a0234c7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:26.252241 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2338/4700] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:26.256334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adaff5-090a-4fa5-a1f7-bfe69a0234c7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:26.258853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-50adaff5-090a-4fa5-a1f7-bfe69a0234c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:26.275306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adaff5-090a-4fa5-a1f7-bfe69a0234c7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:26.283690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea671-422b-41d2-aba5-24ccd6043b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:26.284362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea671-422b-41d2-aba5-24ccd6043b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.284914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea671-422b-41d2-aba5-24ccd6043b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.285293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea671-422b-41d2-aba5-24ccd6043b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:26.286063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ea671-422b-41d2-aba5-24ccd6043b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:26.288190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ea671-422b-41d2-aba5-24ccd6043b02 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:26.298847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636d857-14ed-442d-a181-500f908394d6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:26.305388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:26.306127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.306420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.306771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] PATH_INFO: `/v3/users/1ea58206b2c744e5a153d56bacc5311f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:26.307984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea58206b2c744e5a153d56bacc5311f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:26.310503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:26.324554 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2339/4701] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:26 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:26.328810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea671-422b-41d2-aba5-24ccd6043b02 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:26.369389 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:26.383329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea58206b2c744e5a153d56bacc5311f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.410132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea58206b2c744e5a153d56bacc5311f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.411309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea58206b2c744e5a153d56bacc5311f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.422020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea58206b2c744e5a153d56bacc5311f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.422772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea58206b2c744e5a153d56bacc5311f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.423680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea671-422b-41d2-aba5-24ccd6043b02 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:26.429729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d770bb-4dcb-40fe-bb46-c45055e20435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:26.430584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d770bb-4dcb-40fe-bb46-c45055e20435 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.430830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d770bb-4dcb-40fe-bb46-c45055e20435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.430985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d770bb-4dcb-40fe-bb46-c45055e20435 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:26.432166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d770bb-4dcb-40fe-bb46-c45055e20435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:26.434299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d770bb-4dcb-40fe-bb46-c45055e20435 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:26.445754 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2363/4702] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:26 2022] DELETE /identity/v3/users/1ea58206b2c744e5a153d56bacc5311f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:22:26.462884 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2340/4703] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:26 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:26.466905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:26.468753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:26.555403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56084cd-fa71-428d-802c-ab1786bb93c9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:26.560675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d2b2-eb71-48b2-bc30-dd55d1d88691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:26.561342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d2b2-eb71-48b2-bc30-dd55d1d88691 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.561884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d2b2-eb71-48b2-bc30-dd55d1d88691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.562254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d2b2-eb71-48b2-bc30-dd55d1d88691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:26.563019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6d2b2-eb71-48b2-bc30-dd55d1d88691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:26.566244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6d2b2-eb71-48b2-bc30-dd55d1d88691 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:26.579872 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2364/4704] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:26.583449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d770bb-4dcb-40fe-bb46-c45055e20435 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:26.594699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d770bb-4dcb-40fe-bb46-c45055e20435 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:26.612083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcd2cb-5111-45a2-8dfb-78bae19888df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:26.612613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd2cb-5111-45a2-8dfb-78bae19888df admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.612896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd2cb-5111-45a2-8dfb-78bae19888df admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.613172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd2cb-5111-45a2-8dfb-78bae19888df admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:26.613839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcd2cb-5111-45a2-8dfb-78bae19888df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:26.616720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcd2cb-5111-45a2-8dfb-78bae19888df admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:26.641844 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2341/4705] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:26.645458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d2b2-eb71-48b2-bc30-dd55d1d88691 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:26.657327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d2b2-eb71-48b2-bc30-dd55d1d88691 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:26.662906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44042b8e-fe25-4847-aa7d-dfb61b89bac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:26.663598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042b8e-fe25-4847-aa7d-dfb61b89bac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.663877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042b8e-fe25-4847-aa7d-dfb61b89bac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.664154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042b8e-fe25-4847-aa7d-dfb61b89bac3 admin admin] PATH_INFO: `/v3/projects/cd04da83ed96424998ce30378767d820/users/99a3a1761393475fa6f7c95e95b8136b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:26.688007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44042b8e-fe25-4847-aa7d-dfb61b89bac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd04da83ed96424998ce30378767d820, user_id=99a3a1761393475fa6f7c95e95b8136b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:26.691698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44042b8e-fe25-4847-aa7d-dfb61b89bac3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:26.711972 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2365/4706] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:26 2022] PUT /identity/v3/projects/cd04da83ed96424998ce30378767d820/users/99a3a1761393475fa6f7c95e95b8136b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:26.717629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdaf91-93ff-409d-8ca3-aed28547e510 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.717629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdaf91-93ff-409d-8ca3-aed28547e510 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.717629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdaf91-93ff-409d-8ca3-aed28547e510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:26.726796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44042b8e-fe25-4847-aa7d-dfb61b89bac3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:26.729081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-44042b8e-fe25-4847-aa7d-dfb61b89bac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:26.745593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-90cdaf91-93ff-409d-8ca3-aed28547e510 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:26.747151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-90cdaf91-93ff-409d-8ca3-aed28547e510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:26.827742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44042b8e-fe25-4847-aa7d-dfb61b89bac3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:26.833978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:26.834941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.835237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.835488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] PATH_INFO: `/v3/projects/29543a5108fa4988863e470031e37cc0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:26.837200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29543a5108fa4988863e470031e37cc0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:26.839527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:26.845642 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2342/4707] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:26.853300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdaf91-93ff-409d-8ca3-aed28547e510 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:26.863385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-90cdaf91-93ff-409d-8ca3-aed28547e510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:26.875832 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:26.891632 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:26.915770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29543a5108fa4988863e470031e37cc0', 'request_id': 'req-1f68d3e0-80c4-4821-b75c-da03ff963955'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.924968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29543a5108fa4988863e470031e37cc0', 'request_id': 'req-1f68d3e0-80c4-4821-b75c-da03ff963955'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.934307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29543a5108fa4988863e470031e37cc0', 'request_id': 'req-1f68d3e0-80c4-4821-b75c-da03ff963955'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.945672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdaf91-93ff-409d-8ca3-aed28547e510 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:26.954098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] The token cache is being invalidate because project 29543a5108fa4988863e470031e37cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:26.954768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.955731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1f68d3e0-80c4-4821-b75c-da03ff963955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:26.959380 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2366/4708] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:26 2022] DELETE /identity/v3/projects/29543a5108fa4988863e470031e37cc0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:26.968918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ed3e-88ab-4bab-ab95-ffa9fa96fb99 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:26.969213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ed3e-88ab-4bab-ab95-ffa9fa96fb99 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:26.969589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ed3e-88ab-4bab-ab95-ffa9fa96fb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.002786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ff35ed3e-88ab-4bab-ab95-ffa9fa96fb99 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:27.004330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ff35ed3e-88ab-4bab-ab95-ffa9fa96fb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:27.015718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc08f8d-361f-40ab-87bf-15e4ef35bead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:27.016624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc08f8d-361f-40ab-87bf-15e4ef35bead service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.017091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc08f8d-361f-40ab-87bf-15e4ef35bead service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.017552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc08f8d-361f-40ab-87bf-15e4ef35bead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.020109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1cc08f8d-361f-40ab-87bf-15e4ef35bead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:27.091635 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2367/4709] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:27.101753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853c8c-d0ea-450a-a177-07443d082dda None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.102058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853c8c-d0ea-450a-a177-07443d082dda None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.102335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853c8c-d0ea-450a-a177-07443d082dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.111956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc08f8d-361f-40ab-87bf-15e4ef35bead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:27.114628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc08f8d-361f-40ab-87bf-15e4ef35bead service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:27.123595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-22853c8c-d0ea-450a-a177-07443d082dda None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:27.125767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-22853c8c-d0ea-450a-a177-07443d082dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:27.128213 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2343/4710] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:22:27.147800 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2368/4711] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:27.149063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc08f8d-361f-40ab-87bf-15e4ef35bead service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:27.161232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc08f8d-361f-40ab-87bf-15e4ef35bead service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:27.166422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc326c0-fd8d-48cf-b204-4f0b73a8ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:27.167087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc326c0-fd8d-48cf-b204-4f0b73a8ccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.167369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc326c0-fd8d-48cf-b204-4f0b73a8ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.167643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc326c0-fd8d-48cf-b204-4f0b73a8ccd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.168302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc326c0-fd8d-48cf-b204-4f0b73a8ccd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:22:27.168608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc326c0-fd8d-48cf-b204-4f0b73a8ccd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:27.175417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc326c0-fd8d-48cf-b204-4f0b73a8ccd1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:27.194888 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2344/4712] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:27.197175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22853c8c-d0ea-450a-a177-07443d082dda None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:27.207755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22853c8c-d0ea-450a-a177-07443d082dda None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:27.214007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226575ef-5eaf-4d29-9b32-4dba2dbadac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:27.214706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226575ef-5eaf-4d29-9b32-4dba2dbadac5 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.215240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226575ef-5eaf-4d29-9b32-4dba2dbadac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.215935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226575ef-5eaf-4d29-9b32-4dba2dbadac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.216902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226575ef-5eaf-4d29-9b32-4dba2dbadac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:27.219831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226575ef-5eaf-4d29-9b32-4dba2dbadac5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:27.254174 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2369/4713] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:27 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:27.258405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc326c0-fd8d-48cf-b204-4f0b73a8ccd1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:27.271068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc326c0-fd8d-48cf-b204-4f0b73a8ccd1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:27.348300 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:27.359499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453cb26-01d1-408d-9fd3-d273dc1c0f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:27.360647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453cb26-01d1-408d-9fd3-d273dc1c0f4d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.361765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453cb26-01d1-408d-9fd3-d273dc1c0f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.362034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453cb26-01d1-408d-9fd3-d273dc1c0f4d admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.364301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453cb26-01d1-408d-9fd3-d273dc1c0f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:27.365379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453cb26-01d1-408d-9fd3-d273dc1c0f4d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:27.393027 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2345/4714] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:27 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:22:27.394279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226575ef-5eaf-4d29-9b32-4dba2dbadac5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:27.406665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226575ef-5eaf-4d29-9b32-4dba2dbadac5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:27.413029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbd433-4b7b-43d5-9a8a-5da4e9d57142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:27.413792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbd433-4b7b-43d5-9a8a-5da4e9d57142 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.414171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbd433-4b7b-43d5-9a8a-5da4e9d57142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.414539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbd433-4b7b-43d5-9a8a-5da4e9d57142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.415611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbd433-4b7b-43d5-9a8a-5da4e9d57142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:27.417048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbd433-4b7b-43d5-9a8a-5da4e9d57142 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:27.431331 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2370/4715] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:27.434057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453cb26-01d1-408d-9fd3-d273dc1c0f4d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:27.447006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453cb26-01d1-408d-9fd3-d273dc1c0f4d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:27.453292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f8ebc-bb5d-42d1-b272-8ce96726feec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:27.453934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f8ebc-bb5d-42d1-b272-8ce96726feec admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.454216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f8ebc-bb5d-42d1-b272-8ce96726feec admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.454490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f8ebc-bb5d-42d1-b272-8ce96726feec admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.455399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f8ebc-bb5d-42d1-b272-8ce96726feec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:27.456799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f8ebc-bb5d-42d1-b272-8ce96726feec admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:27.479328 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2346/4716] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:27.479605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbd433-4b7b-43d5-9a8a-5da4e9d57142 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:27.490463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbd433-4b7b-43d5-9a8a-5da4e9d57142 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:27.497242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6f77-79ad-45e8-96b1-6dfd2e2cd712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:27.498280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6f77-79ad-45e8-96b1-6dfd2e2cd712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.498865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6f77-79ad-45e8-96b1-6dfd2e2cd712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.499380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6f77-79ad-45e8-96b1-6dfd2e2cd712 admin admin] PATH_INFO: `/v3/projects/329631d325a84cb3affe277d40136ca3/users/6b5c1e6c18554c8f8332e6d06150174c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.519323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b6f77-79ad-45e8-96b1-6dfd2e2cd712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329631d325a84cb3affe277d40136ca3, user_id=6b5c1e6c18554c8f8332e6d06150174c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:27.522139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b6f77-79ad-45e8-96b1-6dfd2e2cd712 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:27.542637 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2371/4717] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:27 2022] PUT /identity/v3/projects/329631d325a84cb3affe277d40136ca3/users/6b5c1e6c18554c8f8332e6d06150174c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:27.551336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc227c-b4c9-4fb4-af52-4ace4453a644 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.551826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc227c-b4c9-4fb4-af52-4ace4453a644 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.552277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc227c-b4c9-4fb4-af52-4ace4453a644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.601858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3dcc227c-b4c9-4fb4-af52-4ace4453a644 None None] MFA Rules not processed for user `6b5c1e6c18554c8f8332e6d06150174c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:27.603965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3dcc227c-b4c9-4fb4-af52-4ace4453a644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:27.702553 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2347/4718] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:27.707902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6f77-79ad-45e8-96b1-6dfd2e2cd712 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:27.778834 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:27.800017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6f77-79ad-45e8-96b1-6dfd2e2cd712 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:27.807087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fec2e3-4a8c-40d7-bb4d-df00012508cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:27.807794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fec2e3-4a8c-40d7-bb4d-df00012508cf admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.808264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fec2e3-4a8c-40d7-bb4d-df00012508cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.808423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fec2e3-4a8c-40d7-bb4d-df00012508cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.809192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fec2e3-4a8c-40d7-bb4d-df00012508cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:27.813001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fec2e3-4a8c-40d7-bb4d-df00012508cf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:27.854292 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2372/4719] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:27 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:22:27.861474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc227c-b4c9-4fb4-af52-4ace4453a644 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:27.867885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7197-3320-43a3-89cf-9c0f7b13ae69 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.868964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7197-3320-43a3-89cf-9c0f7b13ae69 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.869255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7197-3320-43a3-89cf-9c0f7b13ae69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.874928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc227c-b4c9-4fb4-af52-4ace4453a644 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:27.903855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-daaa7197-3320-43a3-89cf-9c0f7b13ae69 None None] MFA Rules not processed for user `99a3a1761393475fa6f7c95e95b8136b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:27.907846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-daaa7197-3320-43a3-89cf-9c0f7b13ae69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:27.984709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41878b-fd93-437f-8380-6c159d082bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:27.985423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41878b-fd93-437f-8380-6c159d082bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:27.985820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41878b-fd93-437f-8380-6c159d082bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:27.986164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41878b-fd93-437f-8380-6c159d082bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:27.987006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41878b-fd93-437f-8380-6c159d082bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:27.990895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41878b-fd93-437f-8380-6c159d082bd9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:28.024375 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2373/4720] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:28.036804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd40760-4880-4b4c-8648-9b8ca9896108 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:28.037136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd40760-4880-4b4c-8648-9b8ca9896108 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:28.037461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd40760-4880-4b4c-8648-9b8ca9896108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:28.055257 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2348/4721] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:27 2022] POST /identity/v3/users => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:28.057234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41878b-fd93-437f-8380-6c159d082bd9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:28.097431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6bd40760-4880-4b4c-8648-9b8ca9896108 None None] MFA Rules not processed for user `99a3a1761393475fa6f7c95e95b8136b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:28.097579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41878b-fd93-437f-8380-6c159d082bd9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:28.100300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6bd40760-4880-4b4c-8648-9b8ca9896108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:28.108587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09b616-8e0f-4ef3-b0d8-9af79a6b31f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:28.108963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09b616-8e0f-4ef3-b0d8-9af79a6b31f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:28.109319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09b616-8e0f-4ef3-b0d8-9af79a6b31f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:28.109671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09b616-8e0f-4ef3-b0d8-9af79a6b31f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:28.110457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09b616-8e0f-4ef3-b0d8-9af79a6b31f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:28.112223 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2374/4722] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:22:28.112796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09b616-8e0f-4ef3-b0d8-9af79a6b31f1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:28.132877 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2349/4723] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:22:28.133494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c252d2-69b6-4a39-8d14-78b3c8cb353c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:28.133835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c252d2-69b6-4a39-8d14-78b3c8cb353c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:28.134162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c252d2-69b6-4a39-8d14-78b3c8cb353c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:28.137181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09b616-8e0f-4ef3-b0d8-9af79a6b31f1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:28.149932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09b616-8e0f-4ef3-b0d8-9af79a6b31f1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:28.156009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e4635-9601-4948-a292-baa7b716de80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:28.157932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e4635-9601-4948-a292-baa7b716de80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:28.158432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e4635-9601-4948-a292-baa7b716de80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:28.159010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e4635-9601-4948-a292-baa7b716de80 admin admin] PATH_INFO: `/v3/projects/3630009868ab4aab9aae6b2a5a412df3/users/0ce6b9cdc4334027b6911b69af2ce5ce/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:28.162407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-58c252d2-69b6-4a39-8d14-78b3c8cb353c None None] MFA Rules not processed for user `99a3a1761393475fa6f7c95e95b8136b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:28.163799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-58c252d2-69b6-4a39-8d14-78b3c8cb353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:28.176051 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2375/4724] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:28.183209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e4635-9601-4948-a292-baa7b716de80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3630009868ab4aab9aae6b2a5a412df3, user_id=0ce6b9cdc4334027b6911b69af2ce5ce, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:28.185089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c252d2-69b6-4a39-8d14-78b3c8cb353c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:28.187612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e4635-9601-4948-a292-baa7b716de80 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:28.188079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-58c252d2-69b6-4a39-8d14-78b3c8cb353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:28.210358 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2350/4725] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:28 2022] PUT /identity/v3/projects/3630009868ab4aab9aae6b2a5a412df3/users/0ce6b9cdc4334027b6911b69af2ce5ce/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:22:28.214484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e4635-9601-4948-a292-baa7b716de80 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:28.286116 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:28.317238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c252d2-69b6-4a39-8d14-78b3c8cb353c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:28.395601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e4635-9601-4948-a292-baa7b716de80 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:28.409336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eff4f9-3d8f-4ad6-a89d-af9a396424c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:28.411173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff4f9-3d8f-4ad6-a89d-af9a396424c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:28.418830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff4f9-3d8f-4ad6-a89d-af9a396424c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:28.419264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff4f9-3d8f-4ad6-a89d-af9a396424c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:28.420075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eff4f9-3d8f-4ad6-a89d-af9a396424c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:28.422500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eff4f9-3d8f-4ad6-a89d-af9a396424c8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:28.426905 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:28.439365 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2351/4726] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:22:28.449610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eff4f9-3d8f-4ad6-a89d-af9a396424c8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:28.463957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eff4f9-3d8f-4ad6-a89d-af9a396424c8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:28.468607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6dc8-85d5-4464-9708-6ec7572f595e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:28.470307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6dc8-85d5-4464-9708-6ec7572f595e service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:28.471087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6dc8-85d5-4464-9708-6ec7572f595e service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:28.472067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6dc8-85d5-4464-9708-6ec7572f595e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:28.477494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a858190-8fa7-4d43-b3f2-8fa5269f7662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:28.480789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858190-8fa7-4d43-b3f2-8fa5269f7662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:28.481224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858190-8fa7-4d43-b3f2-8fa5269f7662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:28.481583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858190-8fa7-4d43-b3f2-8fa5269f7662 admin admin] PATH_INFO: `/v3/projects/3630009868ab4aab9aae6b2a5a412df3/users/0ce6b9cdc4334027b6911b69af2ce5ce/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:28.486099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a858190-8fa7-4d43-b3f2-8fa5269f7662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3630009868ab4aab9aae6b2a5a412df3, user_id=0ce6b9cdc4334027b6911b69af2ce5ce, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:28.490864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a858190-8fa7-4d43-b3f2-8fa5269f7662 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:28.538636 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2352/4727] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:28 2022] PUT /identity/v3/projects/3630009868ab4aab9aae6b2a5a412df3/users/0ce6b9cdc4334027b6911b69af2ce5ce/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:28.545682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fffc90-b15b-47a6-96bc-3b18d35b78bd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:28.545967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fffc90-b15b-47a6-96bc-3b18d35b78bd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:28.546298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fffc90-b15b-47a6-96bc-3b18d35b78bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:28.564418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6dc8-85d5-4464-9708-6ec7572f595e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:28.567433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6dc8-85d5-4464-9708-6ec7572f595e service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:28.583183 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2376/4728] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:22:28.610834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-93fffc90-b15b-47a6-96bc-3b18d35b78bd None None] MFA Rules not processed for user `0ce6b9cdc4334027b6911b69af2ce5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:28.615369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93fffc90-b15b-47a6-96bc-3b18d35b78bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:28.787107 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2353/4729] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:28.793153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6dc8-85d5-4464-9708-6ec7572f595e service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:28.815818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fffc90-b15b-47a6-96bc-3b18d35b78bd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:28.817675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93fffc90-b15b-47a6-96bc-3b18d35b78bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:28.929538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6dc8-85d5-4464-9708-6ec7572f595e service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:28.940494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c304735-87ea-4429-bb90-680c452b52ba tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:28.942268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c304735-87ea-4429-bb90-680c452b52ba tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:28.944594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c304735-87ea-4429-bb90-680c452b52ba tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:28.945325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c304735-87ea-4429-bb90-680c452b52ba tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects/329631d325a84cb3affe277d40136ca3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:28.949635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c304735-87ea-4429-bb90-680c452b52ba tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:get_project(project_id=329631d325a84cb3affe277d40136ca3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:28.952987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c304735-87ea-4429-bb90-680c452b52ba tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:28.956229 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2377/4730] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:22:28 2022] GET /identity/v3/projects/329631d325a84cb3affe277d40136ca3 => generated 389 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:28.981849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c304735-87ea-4429-bb90-680c452b52ba tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:29.020696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c304735-87ea-4429-bb90-680c452b52ba tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:29.021124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fffc90-b15b-47a6-96bc-3b18d35b78bd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:29.031842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dba900-029a-47be-ab68-d2ffec66a8b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:29.032684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba900-029a-47be-ab68-d2ffec66a8b0 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:29.033126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba900-029a-47be-ab68-d2ffec66a8b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:29.033501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba900-029a-47be-ab68-d2ffec66a8b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:29.033818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe7801-56b1-473d-adf3-b5348391577d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:29.034853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe7801-56b1-473d-adf3-b5348391577d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:29.035405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe7801-56b1-473d-adf3-b5348391577d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:29.035858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe7801-56b1-473d-adf3-b5348391577d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:29.036021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d9dba900-029a-47be-ab68-d2ffec66a8b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:29.037490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe7801-56b1-473d-adf3-b5348391577d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:29.044273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe7801-56b1-473d-adf3-b5348391577d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:29.055323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dba900-029a-47be-ab68-d2ffec66a8b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:29.061102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dba900-029a-47be-ab68-d2ffec66a8b0 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:29.114958 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2354/4731] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:22:29.164665 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2378/4732] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:22:28 2022] POST /identity/v3/projects => generated 339 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:29.170109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dba900-029a-47be-ab68-d2ffec66a8b0 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:29.188198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dba900-029a-47be-ab68-d2ffec66a8b0 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:29.211425 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:29.307079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6caf9c-c0bd-4887-916a-0098408cc199 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:29.308323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6caf9c-c0bd-4887-916a-0098408cc199 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:29.308711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6caf9c-c0bd-4887-916a-0098408cc199 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:29.309089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6caf9c-c0bd-4887-916a-0098408cc199 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:29.310421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6caf9c-c0bd-4887-916a-0098408cc199 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:29.315218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6caf9c-c0bd-4887-916a-0098408cc199 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:29.340254 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2355/4733] 10.222.0.23 () {58 vars in 1131 bytes} [Sun Oct 2 01:22:29 2022] GET /identity/v3/projects => generated 6227 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:22:29.344803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe7801-56b1-473d-adf3-b5348391577d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:29.359966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe7801-56b1-473d-adf3-b5348391577d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:29.379328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f76810-5b9e-482d-a094-19a3a2508021 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:29.379992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f76810-5b9e-482d-a094-19a3a2508021 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:29.380285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f76810-5b9e-482d-a094-19a3a2508021 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:29.380566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f76810-5b9e-482d-a094-19a3a2508021 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects/329631d325a84cb3affe277d40136ca3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:29.381773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f76810-5b9e-482d-a094-19a3a2508021 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:get_project(project_id=329631d325a84cb3affe277d40136ca3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:29.384986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f76810-5b9e-482d-a094-19a3a2508021 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:29.386950 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2379/4734] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:22:29 2022] GET /identity/v3/projects/329631d325a84cb3affe277d40136ca3 => generated 389 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:29.391682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6caf9c-c0bd-4887-916a-0098408cc199 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:29.417725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6caf9c-c0bd-4887-916a-0098408cc199 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:29.424844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb79ef-e8db-4332-8f04-63e5b123ea5d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:29.426258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb79ef-e8db-4332-8f04-63e5b123ea5d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:29.426965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb79ef-e8db-4332-8f04-63e5b123ea5d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:29.427538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb79ef-e8db-4332-8f04-63e5b123ea5d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects/bfbc7c0de7764f0291a390b6032dffeb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:29.429826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb79ef-e8db-4332-8f04-63e5b123ea5d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:get_project(project_id=bfbc7c0de7764f0291a390b6032dffeb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:29.433174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb79ef-e8db-4332-8f04-63e5b123ea5d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:29.435588 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2356/4735] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:22:29 2022] GET /identity/v3/projects/bfbc7c0de7764f0291a390b6032dffeb => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:29.440854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f76810-5b9e-482d-a094-19a3a2508021 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:29.454096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f76810-5b9e-482d-a094-19a3a2508021 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:29.471379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bb85e-c33f-443d-9443-2d10dbb59ceb tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:29.472008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bb85e-c33f-443d-9443-2d10dbb59ceb tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:29.472300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bb85e-c33f-443d-9443-2d10dbb59ceb tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:29.472590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bb85e-c33f-443d-9443-2d10dbb59ceb tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:29.473234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bb85e-c33f-443d-9443-2d10dbb59ceb tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:29.474252 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-7d2bb85e-c33f-443d-9443-2d10dbb59ceb tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:22:29.474252 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:22:29.474252 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:22:29.475463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bb85e-c33f-443d-9443-2d10dbb59ceb tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:29.534803 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2380/4736] 10.222.0.23 () {58 vars in 1131 bytes} [Sun Oct 2 01:22:29 2022] GET /identity/v3/projects => generated 6227 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:29.540014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb79ef-e8db-4332-8f04-63e5b123ea5d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:29.558968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb79ef-e8db-4332-8f04-63e5b123ea5d tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:29.578222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89267912-272d-4673-bb04-cfe2af4b0cf5 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:29.579501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89267912-272d-4673-bb04-cfe2af4b0cf5 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:29.579501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89267912-272d-4673-bb04-cfe2af4b0cf5 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:29.579763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89267912-272d-4673-bb04-cfe2af4b0cf5 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:29.581085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89267912-272d-4673-bb04-cfe2af4b0cf5 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:22:29.581496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89267912-272d-4673-bb04-cfe2af4b0cf5 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:29.583659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89267912-272d-4673-bb04-cfe2af4b0cf5 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:29.643173 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2357/4737] 10.222.0.23 () {58 vars in 1166 bytes} [Sun Oct 2 01:22:29 2022] GET /identity/v3/projects?domain_id=default => generated 5896 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:29.647455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bb85e-c33f-443d-9443-2d10dbb59ceb tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:29.662789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bb85e-c33f-443d-9443-2d10dbb59ceb tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:29.674995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9880c2b-cca9-4722-bca6-7c467512355b tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:29.678257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9880c2b-cca9-4722-bca6-7c467512355b tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:29.679735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9880c2b-cca9-4722-bca6-7c467512355b tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:29.680035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9880c2b-cca9-4722-bca6-7c467512355b tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:29.680814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9880c2b-cca9-4722-bca6-7c467512355b tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:29.683041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9880c2b-cca9-4722-bca6-7c467512355b tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:29.738669 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2381/4738] 10.222.0.23 () {58 vars in 1131 bytes} [Sun Oct 2 01:22:29 2022] GET /identity/v3/projects => generated 6227 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:29.743232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89267912-272d-4673-bb04-cfe2af4b0cf5 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:29.756093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89267912-272d-4673-bb04-cfe2af4b0cf5 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:29.761176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec96b43-905d-4ec5-89ff-b57914534b46 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:29.761930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96b43-905d-4ec5-89ff-b57914534b46 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:29.762351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96b43-905d-4ec5-89ff-b57914534b46 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:29.763337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96b43-905d-4ec5-89ff-b57914534b46 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:29.765607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec96b43-905d-4ec5-89ff-b57914534b46 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:22:29.766056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec96b43-905d-4ec5-89ff-b57914534b46 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:29.768534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec96b43-905d-4ec5-89ff-b57914534b46 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:29.799303 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2358/4739] 10.222.0.23 () {58 vars in 1166 bytes} [Sun Oct 2 01:22:29 2022] GET /identity/v3/projects?domain_id=default => generated 5896 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:29.800672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9880c2b-cca9-4722-bca6-7c467512355b tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:29.832613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9880c2b-cca9-4722-bca6-7c467512355b tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:29.846442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e52b8-69ed-4f00-99ed-2bab89f1215a tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:29.847292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e52b8-69ed-4f00-99ed-2bab89f1215a tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:29.847673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e52b8-69ed-4f00-99ed-2bab89f1215a tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:29.849256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e52b8-69ed-4f00-99ed-2bab89f1215a tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:29.851100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e52b8-69ed-4f00-99ed-2bab89f1215a tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:29.853903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e52b8-69ed-4f00-99ed-2bab89f1215a tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:29.923242 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2382/4740] 10.222.0.23 () {58 vars in 1131 bytes} [Sun Oct 2 01:22:29 2022] GET /identity/v3/projects => generated 6227 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:29.924542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec96b43-905d-4ec5-89ff-b57914534b46 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:29.942297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec96b43-905d-4ec5-89ff-b57914534b46 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:29.953785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4634d-f4e1-4855-9b16-1d961b579615 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:29.954902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4634d-f4e1-4855-9b16-1d961b579615 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:29.954902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4634d-f4e1-4855-9b16-1d961b579615 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:29.955341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4634d-f4e1-4855-9b16-1d961b579615 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:29.956116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4634d-f4e1-4855-9b16-1d961b579615 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1720439495) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:22:29.956523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4634d-f4e1-4855-9b16-1d961b579615 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:29.958501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4634d-f4e1-4855-9b16-1d961b579615 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:30.010503 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2359/4741] 10.222.0.23 () {58 vars in 1232 bytes} [Sun Oct 2 01:22:29 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1720439495 => generated 537 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:30.016471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e52b8-69ed-4f00-99ed-2bab89f1215a tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:30.036295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e52b8-69ed-4f00-99ed-2bab89f1215a tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:30.045304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ce6b9cdc4334027b6911b69af2ce5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3630009868ab4aab9aae6b2a5a412df3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:30.046725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:30.047259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:30.047632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] PATH_INFO: `/v3/projects/bfbc7c0de7764f0291a390b6032dffeb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:30.048971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bfbc7c0de7764f0291a390b6032dffeb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:30.051315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:30.093828 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:30.127077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfbc7c0de7764f0291a390b6032dffeb', 'request_id': 'req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:30.139810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfbc7c0de7764f0291a390b6032dffeb', 'request_id': 'req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:30.146906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfbc7c0de7764f0291a390b6032dffeb', 'request_id': 'req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:30.171597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] The token cache is being invalidate because project bfbc7c0de7764f0291a390b6032dffeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:30.172100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:30.173611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50c3e63f-d1ce-4dae-8077-573bdc6d91c4 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:30.176625 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2383/4742] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:30 2022] DELETE /identity/v3/projects/bfbc7c0de7764f0291a390b6032dffeb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:30.180720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4634d-f4e1-4855-9b16-1d961b579615 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:30.182563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-13c4634d-f4e1-4855-9b16-1d961b579615 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:30.305271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4634d-f4e1-4855-9b16-1d961b579615 tempest-ListProjectsStaticTestJSON-2073632748 tempest-ListProjectsStaticTestJSON-2073632748-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:30.418362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947bea6-b329-4bb2-b244-c265656bd5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:30.419271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947bea6-b329-4bb2-b244-c265656bd5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:30.419657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947bea6-b329-4bb2-b244-c265656bd5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:30.420036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947bea6-b329-4bb2-b244-c265656bd5ec admin admin] PATH_INFO: `/v3/users/6b5c1e6c18554c8f8332e6d06150174c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:30.422959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947bea6-b329-4bb2-b244-c265656bd5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5c1e6c18554c8f8332e6d06150174c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:30.425826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947bea6-b329-4bb2-b244-c265656bd5ec admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:30.467555 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:30.555237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326b5a-076e-4655-bfa1-7efb38711933 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:30.555475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326b5a-076e-4655-bfa1-7efb38711933 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:30.555677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326b5a-076e-4655-bfa1-7efb38711933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:30.562546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2947bea6-b329-4bb2-b244-c265656bd5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5c1e6c18554c8f8332e6d06150174c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:30.590799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2947bea6-b329-4bb2-b244-c265656bd5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5c1e6c18554c8f8332e6d06150174c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:30.591718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2947bea6-b329-4bb2-b244-c265656bd5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5c1e6c18554c8f8332e6d06150174c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:30.615392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2947bea6-b329-4bb2-b244-c265656bd5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5c1e6c18554c8f8332e6d06150174c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:30.615629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b8326b5a-076e-4655-bfa1-7efb38711933 None None] MFA Rules not processed for user `99a3a1761393475fa6f7c95e95b8136b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:30.616562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b8326b5a-076e-4655-bfa1-7efb38711933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:30.625332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2947bea6-b329-4bb2-b244-c265656bd5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5c1e6c18554c8f8332e6d06150174c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:30.645675 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2360/4743] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:30 2022] DELETE /identity/v3/users/6b5c1e6c18554c8f8332e6d06150174c => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:30.647739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97457a8a-2857-488c-a6c9-242d8d4c81a7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:30.648186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97457a8a-2857-488c-a6c9-242d8d4c81a7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:30.648595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97457a8a-2857-488c-a6c9-242d8d4c81a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:30.702896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-97457a8a-2857-488c-a6c9-242d8d4c81a7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:30.704478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-97457a8a-2857-488c-a6c9-242d8d4c81a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:30.788614 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2384/4744] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:30.838863 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2361/4745] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:22:30.854634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326b5a-076e-4655-bfa1-7efb38711933 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:30.856137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b8326b5a-076e-4655-bfa1-7efb38711933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:31.024274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326b5a-076e-4655-bfa1-7efb38711933 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:31.109831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248cc6e-703d-44ce-87c8-0a128aaa1baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:31.110526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248cc6e-703d-44ce-87c8-0a128aaa1baf service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:31.110983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248cc6e-703d-44ce-87c8-0a128aaa1baf service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:31.111326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248cc6e-703d-44ce-87c8-0a128aaa1baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:31.137636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248cc6e-703d-44ce-87c8-0a128aaa1baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:31.142084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248cc6e-703d-44ce-87c8-0a128aaa1baf service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:31.157509 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2385/4746] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:22:32.393462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2115a6-f078-4464-b5e5-217170e75dc6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:32.394339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2115a6-f078-4464-b5e5-217170e75dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:32.394793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2115a6-f078-4464-b5e5-217170e75dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:32.454393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0c2115a6-f078-4464-b5e5-217170e75dc6 None None] MFA Rules not processed for user `99a3a1761393475fa6f7c95e95b8136b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:32.455857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0c2115a6-f078-4464-b5e5-217170e75dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:32.566889 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2362/4747] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:33.349742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248cc6e-703d-44ce-87c8-0a128aaa1baf service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:33.351392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9248cc6e-703d-44ce-87c8-0a128aaa1baf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:33.373046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248cc6e-703d-44ce-87c8-0a128aaa1baf service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:33.416919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:33.418511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:33.419612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:33.422108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] PATH_INFO: `/v3/projects/329631d325a84cb3affe277d40136ca3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:33.425750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=329631d325a84cb3affe277d40136ca3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:33.430633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:33.451028 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:33.559794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329631d325a84cb3affe277d40136ca3', 'request_id': 'req-df88436a-4a0d-49ba-a92f-7ae053100d3a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:33.567055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329631d325a84cb3affe277d40136ca3', 'request_id': 'req-df88436a-4a0d-49ba-a92f-7ae053100d3a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:33.576562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329631d325a84cb3affe277d40136ca3', 'request_id': 'req-df88436a-4a0d-49ba-a92f-7ae053100d3a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:33.596584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] The token cache is being invalidate because project 329631d325a84cb3affe277d40136ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:33.597786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:33.599592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:33.601791 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2386/4748] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:33 2022] DELETE /identity/v3/projects/329631d325a84cb3affe277d40136ca3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:33.606277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2115a6-f078-4464-b5e5-217170e75dc6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:33.624879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2115a6-f078-4464-b5e5-217170e75dc6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:33.689215 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:33.725054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:33.725550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:33.726095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:33.726529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] PATH_INFO: `/v3/users/0ce6b9cdc4334027b6911b69af2ce5ce` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:33.727891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce6b9cdc4334027b6911b69af2ce5ce)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:33.730002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:33.853437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce6b9cdc4334027b6911b69af2ce5ce'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:33.892865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce6b9cdc4334027b6911b69af2ce5ce'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:33.894805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce6b9cdc4334027b6911b69af2ce5ce'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:33.912689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce6b9cdc4334027b6911b69af2ce5ce'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:33.944732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce6b9cdc4334027b6911b69af2ce5ce'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:33.957889 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2363/4749] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:33 2022] DELETE /identity/v3/users/0ce6b9cdc4334027b6911b69af2ce5ce => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:34.007225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:34.009067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:34.034538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88436a-4a0d-49ba-a92f-7ae053100d3a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:34.146655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795911c-a0a3-4c82-ac79-4ad961fb2101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:34.148616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795911c-a0a3-4c82-ac79-4ad961fb2101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:34.148994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795911c-a0a3-4c82-ac79-4ad961fb2101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:34.149369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795911c-a0a3-4c82-ac79-4ad961fb2101 admin admin] PATH_INFO: `/v3/users/85d3ffda1a2247e891ef255f3f90ea15` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:34.151047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795911c-a0a3-4c82-ac79-4ad961fb2101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d3ffda1a2247e891ef255f3f90ea15)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:34.155228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795911c-a0a3-4c82-ac79-4ad961fb2101 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:34.282707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b795911c-a0a3-4c82-ac79-4ad961fb2101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d3ffda1a2247e891ef255f3f90ea15'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:34.301825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b795911c-a0a3-4c82-ac79-4ad961fb2101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d3ffda1a2247e891ef255f3f90ea15'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:34.302745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b795911c-a0a3-4c82-ac79-4ad961fb2101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d3ffda1a2247e891ef255f3f90ea15'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:34.317864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b795911c-a0a3-4c82-ac79-4ad961fb2101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d3ffda1a2247e891ef255f3f90ea15'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:34.319562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b795911c-a0a3-4c82-ac79-4ad961fb2101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d3ffda1a2247e891ef255f3f90ea15'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:34.364431 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2387/4750] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:34 2022] DELETE /identity/v3/users/85d3ffda1a2247e891ef255f3f90ea15 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:34.903490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:34.905069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:34.926125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e2b23-ba15-45e2-9180-29d1dfaf1aa9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:35.063384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:35.064164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:35.064553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:35.064900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] PATH_INFO: `/v3/projects/3630009868ab4aab9aae6b2a5a412df3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:35.066761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3630009868ab4aab9aae6b2a5a412df3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:35.070732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:35.166761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3630009868ab4aab9aae6b2a5a412df3', 'request_id': 'req-df4b08a7-c949-4e9f-abf3-309ea1eaa800'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:35.175696 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:35.177148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3630009868ab4aab9aae6b2a5a412df3', 'request_id': 'req-df4b08a7-c949-4e9f-abf3-309ea1eaa800'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:35.191674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3630009868ab4aab9aae6b2a5a412df3', 'request_id': 'req-df4b08a7-c949-4e9f-abf3-309ea1eaa800'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:35.241210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] The token cache is being invalidate because project 3630009868ab4aab9aae6b2a5a412df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:35.242469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:35.243956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:35.249811 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2364/4751] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:34 2022] DELETE /identity/v3/projects/3630009868ab4aab9aae6b2a5a412df3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:35.255172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d5d41-c229-457f-a3d3-7b4d0cd63e10 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:35.257901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d5d41-c229-457f-a3d3-7b4d0cd63e10 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:35.262954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d5d41-c229-457f-a3d3-7b4d0cd63e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:35.302492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f79d5d41-c229-457f-a3d3-7b4d0cd63e10 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:35.304219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f79d5d41-c229-457f-a3d3-7b4d0cd63e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:35.314236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:35.316237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:35.331067 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:35.469603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b08a7-c949-4e9f-abf3-309ea1eaa800 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:35.477428 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2388/4752] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:35.477960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:35.477960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:35.477960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:35.477960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] PATH_INFO: `/v3/projects/64858251a1ff4228adccb029de599d31` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:35.479212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64858251a1ff4228adccb029de599d31)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:35.480044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7915f3-6a7f-4814-8680-4d8f561424b3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:35.480328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7915f3-6a7f-4814-8680-4d8f561424b3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:35.480852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7915f3-6a7f-4814-8680-4d8f561424b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:35.481814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:35.530640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1c7915f3-6a7f-4814-8680-4d8f561424b3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:35.535764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1c7915f3-6a7f-4814-8680-4d8f561424b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:35.561739 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2389/4753] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:22:35.564629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7915f3-6a7f-4814-8680-4d8f561424b3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:35.601136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7915f3-6a7f-4814-8680-4d8f561424b3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:35.619503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64858251a1ff4228adccb029de599d31', 'request_id': 'req-ba1a619c-16d4-47aa-b49c-b103b12d807c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:35.641641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64858251a1ff4228adccb029de599d31', 'request_id': 'req-ba1a619c-16d4-47aa-b49c-b103b12d807c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:35.652413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64858251a1ff4228adccb029de599d31', 'request_id': 'req-ba1a619c-16d4-47aa-b49c-b103b12d807c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:35.692202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] The token cache is being invalidate because project 64858251a1ff4228adccb029de599d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:35.693308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:35.694586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ba1a619c-16d4-47aa-b49c-b103b12d807c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:35.699032 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2365/4754] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:35 2022] DELETE /identity/v3/projects/64858251a1ff4228adccb029de599d31 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:35.707214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f815ad9-9a59-4b0e-80f8-0dd4e062461b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:35.711742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f815ad9-9a59-4b0e-80f8-0dd4e062461b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:35.712057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f815ad9-9a59-4b0e-80f8-0dd4e062461b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:35.761568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8f815ad9-9a59-4b0e-80f8-0dd4e062461b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:35.764790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8f815ad9-9a59-4b0e-80f8-0dd4e062461b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:35.776446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533a19-7401-4b5d-8d15-71beb362bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:35.777208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533a19-7401-4b5d-8d15-71beb362bed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:35.777679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533a19-7401-4b5d-8d15-71beb362bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:35.777999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533a19-7401-4b5d-8d15-71beb362bed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:35.780229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2533a19-7401-4b5d-8d15-71beb362bed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:22:35.780612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2533a19-7401-4b5d-8d15-71beb362bed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:35.781374 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2366/4755] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:35.789988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b3d73-9780-4b22-800c-77064c3896e6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:35.790415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b3d73-9780-4b22-800c-77064c3896e6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:35.790828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b3d73-9780-4b22-800c-77064c3896e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:35.792999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2533a19-7401-4b5d-8d15-71beb362bed3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:35.841392 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2390/4756] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:35.846858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533a19-7401-4b5d-8d15-71beb362bed3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:35.851197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a2533a19-7401-4b5d-8d15-71beb362bed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:35.858383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b32b3d73-9780-4b22-800c-77064c3896e6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:35.860099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b32b3d73-9780-4b22-800c-77064c3896e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:35.870990 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2367/4757] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:35.875891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b3d73-9780-4b22-800c-77064c3896e6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:35.886579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b3d73-9780-4b22-800c-77064c3896e6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:35.900080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b7dc2-7e53-4113-bed9-c5da4364ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:35.901011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7dc2-7e53-4113-bed9-c5da4364ea3e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:35.901499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7dc2-7e53-4113-bed9-c5da4364ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:35.901974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7dc2-7e53-4113-bed9-c5da4364ea3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:35.903043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b7dc2-7e53-4113-bed9-c5da4364ea3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:22:35.903577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b7dc2-7e53-4113-bed9-c5da4364ea3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:35.904140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533a19-7401-4b5d-8d15-71beb362bed3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:35.906097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b7dc2-7e53-4113-bed9-c5da4364ea3e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:35.917305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f5775-02d8-4026-b0f4-646782b08911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:35.918048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5775-02d8-4026-b0f4-646782b08911 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:35.918563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5775-02d8-4026-b0f4-646782b08911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:35.921097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5775-02d8-4026-b0f4-646782b08911 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:35.921775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f5775-02d8-4026-b0f4-646782b08911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:35.923868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f5775-02d8-4026-b0f4-646782b08911 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:35.944464 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2368/4758] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:35.948898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b7dc2-7e53-4113-bed9-c5da4364ea3e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:35.965017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b7dc2-7e53-4113-bed9-c5da4364ea3e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:35.988746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3907900-3b93-4caa-ab21-b9c117bdaf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:35.989456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3907900-3b93-4caa-ab21-b9c117bdaf5a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:35.989748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3907900-3b93-4caa-ab21-b9c117bdaf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:35.990357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3907900-3b93-4caa-ab21-b9c117bdaf5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:35.993644 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2391/4759] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:35 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:35.993766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3907900-3b93-4caa-ab21-b9c117bdaf5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:35.993766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3907900-3b93-4caa-ab21-b9c117bdaf5a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.015355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f5775-02d8-4026-b0f4-646782b08911 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.055233 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2369/4760] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:35 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:22:36.059029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3907900-3b93-4caa-ab21-b9c117bdaf5a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.152333 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:36.169141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f5775-02d8-4026-b0f4-646782b08911 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.206356 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:36.221947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3907900-3b93-4caa-ab21-b9c117bdaf5a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.234298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de83d08-c557-419f-8255-3da894f78308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.235659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de83d08-c557-419f-8255-3da894f78308 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.236336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de83d08-c557-419f-8255-3da894f78308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.237958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de83d08-c557-419f-8255-3da894f78308 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.238855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de83d08-c557-419f-8255-3da894f78308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.241079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de83d08-c557-419f-8255-3da894f78308 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.254005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d386aa-c12d-4b23-9952-47029e153c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.254913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d386aa-c12d-4b23-9952-47029e153c85 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.255321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d386aa-c12d-4b23-9952-47029e153c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.255610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d386aa-c12d-4b23-9952-47029e153c85 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.256260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d386aa-c12d-4b23-9952-47029e153c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.258335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d386aa-c12d-4b23-9952-47029e153c85 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.280924 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2370/4761] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:36 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:36.285494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de83d08-c557-419f-8255-3da894f78308 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.298731 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2392/4762] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:36 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:36.300096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d386aa-c12d-4b23-9952-47029e153c85 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.304795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de83d08-c557-419f-8255-3da894f78308 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.312943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d386aa-c12d-4b23-9952-47029e153c85 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.313216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ceeb9-af1a-451e-91b3-7bd8f755b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.313730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ceeb9-af1a-451e-91b3-7bd8f755b2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.314013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ceeb9-af1a-451e-91b3-7bd8f755b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.314293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ceeb9-af1a-451e-91b3-7bd8f755b2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.315324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ceeb9-af1a-451e-91b3-7bd8f755b2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.317597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ceeb9-af1a-451e-91b3-7bd8f755b2d2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.319172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501cdf9-418c-46b6-83d2-e35d0594000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.320203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501cdf9-418c-46b6-83d2-e35d0594000d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.320668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501cdf9-418c-46b6-83d2-e35d0594000d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.321147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501cdf9-418c-46b6-83d2-e35d0594000d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.321949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501cdf9-418c-46b6-83d2-e35d0594000d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.324150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501cdf9-418c-46b6-83d2-e35d0594000d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.340791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2371/4763] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:36.342556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ceeb9-af1a-451e-91b3-7bd8f755b2d2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.343116 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2393/4764] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:36.347549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501cdf9-418c-46b6-83d2-e35d0594000d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.358028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ceeb9-af1a-451e-91b3-7bd8f755b2d2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.360927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501cdf9-418c-46b6-83d2-e35d0594000d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.366003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4951b-3fa2-40bd-8aa4-f0db1972e4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.366682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4951b-3fa2-40bd-8aa4-f0db1972e4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.367020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4951b-3fa2-40bd-8aa4-f0db1972e4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.367351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4951b-3fa2-40bd-8aa4-f0db1972e4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.369054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4951b-3fa2-40bd-8aa4-f0db1972e4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.369565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64053f7c-29d2-4986-b96c-9b61fcf7e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.369729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4951b-3fa2-40bd-8aa4-f0db1972e4a7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.370496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64053f7c-29d2-4986-b96c-9b61fcf7e591 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.370964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64053f7c-29d2-4986-b96c-9b61fcf7e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.371499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64053f7c-29d2-4986-b96c-9b61fcf7e591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.372314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64053f7c-29d2-4986-b96c-9b61fcf7e591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.374270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64053f7c-29d2-4986-b96c-9b61fcf7e591 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.390535 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2372/4765] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:36.390535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4951b-3fa2-40bd-8aa4-f0db1972e4a7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.395001 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2394/4766] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:36.396747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64053f7c-29d2-4986-b96c-9b61fcf7e591 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.402395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4951b-3fa2-40bd-8aa4-f0db1972e4a7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.410066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2ea52-ce30-418a-9d43-2f46e17c440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.410844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2ea52-ce30-418a-9d43-2f46e17c440c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.411126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2ea52-ce30-418a-9d43-2f46e17c440c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.411682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64053f7c-29d2-4986-b96c-9b61fcf7e591 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.411833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2ea52-ce30-418a-9d43-2f46e17c440c admin admin] PATH_INFO: `/v3/projects/4426feaf511c44568616f844a3c657f0/users/a4ba5c1008c3439689b252d70a0b3f2c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.417948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b1f3d-0bd5-4596-b39a-4fb249261f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.418938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1f3d-0bd5-4596-b39a-4fb249261f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.419425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1f3d-0bd5-4596-b39a-4fb249261f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.420004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1f3d-0bd5-4596-b39a-4fb249261f72 admin admin] PATH_INFO: `/v3/projects/f039b5639f0f4374a06752fc71387e6f/users/b677a24043ce40229fec5cc19c45626a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.437882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2ea52-ce30-418a-9d43-2f46e17c440c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4426feaf511c44568616f844a3c657f0, user_id=a4ba5c1008c3439689b252d70a0b3f2c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.440521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b1f3d-0bd5-4596-b39a-4fb249261f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f039b5639f0f4374a06752fc71387e6f, user_id=b677a24043ce40229fec5cc19c45626a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.441443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2ea52-ce30-418a-9d43-2f46e17c440c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.445104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b1f3d-0bd5-4596-b39a-4fb249261f72 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.472914 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2395/4768] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:36 2022] PUT /identity/v3/projects/f039b5639f0f4374a06752fc71387e6f/users/b677a24043ce40229fec5cc19c45626a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:36.474875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b21883-1f01-4ed8-b01a-9c814f54138a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.475380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b21883-1f01-4ed8-b01a-9c814f54138a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.475855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b21883-1f01-4ed8-b01a-9c814f54138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.477181 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2373/4768] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:36 2022] PUT /identity/v3/projects/4426feaf511c44568616f844a3c657f0/users/a4ba5c1008c3439689b252d70a0b3f2c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:36.478849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096b374-8d35-4b2d-8b9d-6bdc0f8db831 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.479185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096b374-8d35-4b2d-8b9d-6bdc0f8db831 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.479466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096b374-8d35-4b2d-8b9d-6bdc0f8db831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.499710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-28b21883-1f01-4ed8-b01a-9c814f54138a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:36.501551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-28b21883-1f01-4ed8-b01a-9c814f54138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:36.582352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4096b374-8d35-4b2d-8b9d-6bdc0f8db831 None None] MFA Rules not processed for user `b677a24043ce40229fec5cc19c45626a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:36.584373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4096b374-8d35-4b2d-8b9d-6bdc0f8db831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:36.648135 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2396/4769] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:36.681347 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2374/4770] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:36.682736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b21883-1f01-4ed8-b01a-9c814f54138a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.696741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b21883-1f01-4ed8-b01a-9c814f54138a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.696942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096b374-8d35-4b2d-8b9d-6bdc0f8db831 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.698395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4096b374-8d35-4b2d-8b9d-6bdc0f8db831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:36.705158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37f25-1764-40de-ab11-5de55dfb73f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.706036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37f25-1764-40de-ab11-5de55dfb73f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.706977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37f25-1764-40de-ab11-5de55dfb73f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.707504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37f25-1764-40de-ab11-5de55dfb73f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.708374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a37f25-1764-40de-ab11-5de55dfb73f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.710554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a37f25-1764-40de-ab11-5de55dfb73f4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.759713 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2397/4771] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:36 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:36.760795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37f25-1764-40de-ab11-5de55dfb73f4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.803164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096b374-8d35-4b2d-8b9d-6bdc0f8db831 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.818508 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:36.821226 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:36.841319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37f25-1764-40de-ab11-5de55dfb73f4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.847793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215655eb-d064-4584-b1ff-42df4f99a49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.848411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215655eb-d064-4584-b1ff-42df4f99a49d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.848700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215655eb-d064-4584-b1ff-42df4f99a49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.848957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215655eb-d064-4584-b1ff-42df4f99a49d admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.849589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215655eb-d064-4584-b1ff-42df4f99a49d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.851546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215655eb-d064-4584-b1ff-42df4f99a49d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.879756 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2398/4772] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:36 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:36.884388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215655eb-d064-4584-b1ff-42df4f99a49d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.898633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215655eb-d064-4584-b1ff-42df4f99a49d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.904020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8a724-65c0-4831-9078-0f43840e704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.905343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8a724-65c0-4831-9078-0f43840e704b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.905634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8a724-65c0-4831-9078-0f43840e704b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.906012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8a724-65c0-4831-9078-0f43840e704b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.906785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8a724-65c0-4831-9078-0f43840e704b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.908552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8a724-65c0-4831-9078-0f43840e704b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.919097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef10ab-4a5b-4577-ab2f-7534331418ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.921160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef10ab-4a5b-4577-ab2f-7534331418ca service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.922106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef10ab-4a5b-4577-ab2f-7534331418ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.922795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef10ab-4a5b-4577-ab2f-7534331418ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.926416 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2399/4773] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:36.927605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8a724-65c0-4831-9078-0f43840e704b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:36.938902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef10ab-4a5b-4577-ab2f-7534331418ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.940667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8a724-65c0-4831-9078-0f43840e704b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:36.941818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef10ab-4a5b-4577-ab2f-7534331418ca service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.947883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226f353-7bd7-47ba-9c40-102f6a30ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:36.948842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226f353-7bd7-47ba-9c40-102f6a30ddad admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:36.949143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226f353-7bd7-47ba-9c40-102f6a30ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:36.949418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226f353-7bd7-47ba-9c40-102f6a30ddad admin admin] PATH_INFO: `/v3/projects/26ce819ddfd144f3ba74ff3033b54acf/users/dda8dd15992745948dd60e00eed24f2d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:36.972696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226f353-7bd7-47ba-9c40-102f6a30ddad admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ce819ddfd144f3ba74ff3033b54acf, user_id=dda8dd15992745948dd60e00eed24f2d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:36.978262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226f353-7bd7-47ba-9c40-102f6a30ddad admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:36.978991 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2375/4774] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:22:36.994514 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2400/4775] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:36 2022] PUT /identity/v3/projects/26ce819ddfd144f3ba74ff3033b54acf/users/dda8dd15992745948dd60e00eed24f2d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:36.999432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef10ab-4a5b-4577-ab2f-7534331418ca service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:37.012061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef10ab-4a5b-4577-ab2f-7534331418ca service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:37.081005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9f877-cc78-401f-baa7-8a0f9216ad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:37.083488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9f877-cc78-401f-baa7-8a0f9216ad6f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.083488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9f877-cc78-401f-baa7-8a0f9216ad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.083488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9f877-cc78-401f-baa7-8a0f9216ad6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.083488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9f877-cc78-401f-baa7-8a0f9216ad6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:37.084452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9f877-cc78-401f-baa7-8a0f9216ad6f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:37.097081 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2376/4776] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:37.101162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226f353-7bd7-47ba-9c40-102f6a30ddad admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:37.113501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226f353-7bd7-47ba-9c40-102f6a30ddad admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:37.117933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a8f81-11ca-4156-a13b-113b98d3d86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:37.119203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a8f81-11ca-4156-a13b-113b98d3d86d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.119484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a8f81-11ca-4156-a13b-113b98d3d86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.119886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a8f81-11ca-4156-a13b-113b98d3d86d admin admin] PATH_INFO: `/v3/projects/26ce819ddfd144f3ba74ff3033b54acf/users/dda8dd15992745948dd60e00eed24f2d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.122164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a8f81-11ca-4156-a13b-113b98d3d86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ce819ddfd144f3ba74ff3033b54acf, user_id=dda8dd15992745948dd60e00eed24f2d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:37.125324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a8f81-11ca-4156-a13b-113b98d3d86d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:37.139608 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2401/4777] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:37 2022] PUT /identity/v3/projects/26ce819ddfd144f3ba74ff3033b54acf/users/dda8dd15992745948dd60e00eed24f2d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:37.155853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c9df-db85-4cb2-aaf1-134932d60bf4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.156172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c9df-db85-4cb2-aaf1-134932d60bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.156417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c9df-db85-4cb2-aaf1-134932d60bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.186798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-94d7c9df-db85-4cb2-aaf1-134932d60bf4 None None] MFA Rules not processed for user `dda8dd15992745948dd60e00eed24f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:37.188132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-94d7c9df-db85-4cb2-aaf1-134932d60bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:37.279601 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2377/4778] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:37.284353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a8f81-11ca-4156-a13b-113b98d3d86d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:37.302483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a8f81-11ca-4156-a13b-113b98d3d86d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:37.308633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287e10e-f099-4054-a7b7-f774f42787eb tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:37.309259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287e10e-f099-4054-a7b7-f774f42787eb tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.309541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287e10e-f099-4054-a7b7-f774f42787eb tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.309815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287e10e-f099-4054-a7b7-f774f42787eb tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.311363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287e10e-f099-4054-a7b7-f774f42787eb tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:37.312392 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-c287e10e-f099-4054-a7b7-f774f42787eb tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:22:37.312392 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:22:37.312392 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:22:37.313300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287e10e-f099-4054-a7b7-f774f42787eb tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:37.345587 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2402/4779] 10.222.0.23 () {60 vars in 1185 bytes} [Sun Oct 2 01:22:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:37.349923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c9df-db85-4cb2-aaf1-134932d60bf4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:37.368989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c9df-db85-4cb2-aaf1-134932d60bf4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:37.381192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af9e50-ba87-44ac-a9dc-f3f1c0d112f6 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:37.383888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af9e50-ba87-44ac-a9dc-f3f1c0d112f6 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.384235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af9e50-ba87-44ac-a9dc-f3f1c0d112f6 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.384809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af9e50-ba87-44ac-a9dc-f3f1c0d112f6 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/54da5adee1d24df998a94dfc241c4a49` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.385943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af9e50-ba87-44ac-a9dc-f3f1c0d112f6 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=54da5adee1d24df998a94dfc241c4a49)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:37.389076 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-44af9e50-ba87-44ac-a9dc-f3f1c0d112f6 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:22:37.389076 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:22:37.389076 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:22:37.390865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af9e50-ba87-44ac-a9dc-f3f1c0d112f6 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:37.418333 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2378/4780] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:22:37 2022] GET /identity/v3/OS-OAUTH1/consumers/54da5adee1d24df998a94dfc241c4a49 => generated 220 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:37.420453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287e10e-f099-4054-a7b7-f774f42787eb tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:37.438538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287e10e-f099-4054-a7b7-f774f42787eb tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:37.445879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:37.446671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.447120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.447530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/54da5adee1d24df998a94dfc241c4a49` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.449227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=54da5adee1d24df998a94dfc241c4a49)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:37.450529 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:22:37.450529 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:22:37.450529 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:22:37.451964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:37.452449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invalidating token cache because consumer 54da5adee1d24df998a94dfc241c4a49 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:37.452961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:37.453917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:37.485397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '54da5adee1d24df998a94dfc241c4a49', 'request_id': 'req-f198817a-2dbb-4c95-b073-9e77e6f7ff39'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:37.516104 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2403/4781] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:22:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/54da5adee1d24df998a94dfc241c4a49 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:37.517222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af9e50-ba87-44ac-a9dc-f3f1c0d112f6 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:37.520057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-44af9e50-ba87-44ac-a9dc-f3f1c0d112f6 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:37.550799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af9e50-ba87-44ac-a9dc-f3f1c0d112f6 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:37.577036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ab4c-589f-4538-a49f-69f2b6d3d1ce tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:37.577910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ab4c-589f-4538-a49f-69f2b6d3d1ce tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.578042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ab4c-589f-4538-a49f-69f2b6d3d1ce tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.578232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ab4c-589f-4538-a49f-69f2b6d3d1ce tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.588038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ab4c-589f-4538-a49f-69f2b6d3d1ce tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:37.589323 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-2519ab4c-589f-4538-a49f-69f2b6d3d1ce tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:22:37.589323 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:22:37.589323 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:22:37.591028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ab4c-589f-4538-a49f-69f2b6d3d1ce tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:37.618030 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2379/4782] 10.222.0.23 () {60 vars in 1185 bytes} [Sun Oct 2 01:22:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:22:37.622397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:37.646135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198817a-2dbb-4c95-b073-9e77e6f7ff39 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:37.656169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754bc3-cc23-48c4-be8a-3cafbf7898ba tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:37.657511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754bc3-cc23-48c4-be8a-3cafbf7898ba tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.658874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754bc3-cc23-48c4-be8a-3cafbf7898ba tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.659501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754bc3-cc23-48c4-be8a-3cafbf7898ba tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/701bf5e4c83b4035ad2b7fef8529d7c1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.661004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65754bc3-cc23-48c4-be8a-3cafbf7898ba tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=701bf5e4c83b4035ad2b7fef8529d7c1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:37.663801 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-65754bc3-cc23-48c4-be8a-3cafbf7898ba tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:22:37.663801 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:22:37.663801 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:22:37.665593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65754bc3-cc23-48c4-be8a-3cafbf7898ba tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:37.674536 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2404/4783] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:22:37 2022] GET /identity/v3/OS-OAUTH1/consumers/701bf5e4c83b4035ad2b7fef8529d7c1 => generated 221 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:37.679050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ab4c-589f-4538-a49f-69f2b6d3d1ce tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:37.695207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ab4c-589f-4538-a49f-69f2b6d3d1ce tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:37.708031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:37.709132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.709655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.710092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/701bf5e4c83b4035ad2b7fef8529d7c1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.711213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=701bf5e4c83b4035ad2b7fef8529d7c1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:37.715238 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:22:37.715238 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:22:37.715238 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:22:37.717897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:37.718387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invalidating token cache because consumer 701bf5e4c83b4035ad2b7fef8529d7c1 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:37.719006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:37.720001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:37.750539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '701bf5e4c83b4035ad2b7fef8529d7c1', 'request_id': 'req-1440a623-5446-4fb4-8afc-4ced91786acd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:37.754771 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:37.785366 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2380/4784] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:22:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/701bf5e4c83b4035ad2b7fef8529d7c1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:37.789423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754bc3-cc23-48c4-be8a-3cafbf7898ba tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:37.792140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-65754bc3-cc23-48c4-be8a-3cafbf7898ba tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:37.810725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754bc3-cc23-48c4-be8a-3cafbf7898ba tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:37.832140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4984882-7ae2-4202-bc9d-a34f81140b9d tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:37.833931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984882-7ae2-4202-bc9d-a34f81140b9d tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.834569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984882-7ae2-4202-bc9d-a34f81140b9d tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.836027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984882-7ae2-4202-bc9d-a34f81140b9d tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/701bf5e4c83b4035ad2b7fef8529d7c1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.838858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4984882-7ae2-4202-bc9d-a34f81140b9d tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=701bf5e4c83b4035ad2b7fef8529d7c1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:37.845616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4984882-7ae2-4202-bc9d-a34f81140b9d tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-e4984882-7ae2-4202-bc9d-a34f81140b9d tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 02 01:22:37.871508 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 02 01:22:37.873007 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 02 01:22:37.873007 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 02 01:22:37.873007 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 02 01:22:37.873007 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 02 01:22:37.873007 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 02 01:22:37.873007 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 02 01:22:37.873007 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 02 01:22:37.873007 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 02 01:22:37.873007 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:37.876211 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2405/4785] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:22:37 2022] GET /identity/v3/OS-OAUTH1/consumers/701bf5e4c83b4035ad2b7fef8529d7c1 => generated 74 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 01:22:37.880247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:37.893062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440a623-5446-4fb4-8afc-4ced91786acd tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:37.900549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:37.901905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.901905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.902315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/701bf5e4c83b4035ad2b7fef8529d7c1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.903202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=701bf5e4c83b4035ad2b7fef8529d7c1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:37.905936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:37.906581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invalidating token cache because consumer 701bf5e4c83b4035ad2b7fef8529d7c1 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:37.907040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:37.907959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 02 01:22:37.926296 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:22:37.927868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:22:37.927868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 02 01:22:37.927868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 02 01:22:37.927868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 02 01:22:37.927868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 02 01:22:37.927868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 02 01:22:37.927868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 02 01:22:37.927868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 02 01:22:37.927868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 02 01:22:37.927868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 02 01:22:37.927868 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:22:37.932894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4984882-7ae2-4202-bc9d-a34f81140b9d tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:37.933930 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2381/4786] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:22:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/701bf5e4c83b4035ad2b7fef8529d7c1 => generated 74 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 01:22:37.936249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e4984882-7ae2-4202-bc9d-a34f81140b9d tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:37.955472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4984882-7ae2-4202-bc9d-a34f81140b9d tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:37.968161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418be2-6bf9-4595-b03e-181f3d45c8b4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:37.968948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418be2-6bf9-4595-b03e-181f3d45c8b4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:37.969327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418be2-6bf9-4595-b03e-181f3d45c8b4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:37.969912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418be2-6bf9-4595-b03e-181f3d45c8b4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:37.970477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35418be2-6bf9-4595-b03e-181f3d45c8b4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:37.972876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35418be2-6bf9-4595-b03e-181f3d45c8b4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:38.027721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:38.028707 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2406/4787] 10.222.0.23 () {60 vars in 1185 bytes} [Sun Oct 2 01:22:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:38.050118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d864457-c242-4a40-a5e7-59d93de4abc8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:38.058085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbed5b2-a29f-4b00-a9b6-5f345e7fc8f8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:38.059200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbed5b2-a29f-4b00-a9b6-5f345e7fc8f8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:38.059836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbed5b2-a29f-4b00-a9b6-5f345e7fc8f8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:38.060768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbed5b2-a29f-4b00-a9b6-5f345e7fc8f8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:38.062131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbed5b2-a29f-4b00-a9b6-5f345e7fc8f8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:38.064282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbed5b2-a29f-4b00-a9b6-5f345e7fc8f8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:38.089098 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2382/4788] 10.222.0.23 () {60 vars in 1185 bytes} [Sun Oct 2 01:22:38 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:38.090342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418be2-6bf9-4595-b03e-181f3d45c8b4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:38.103272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418be2-6bf9-4595-b03e-181f3d45c8b4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:38.108313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e32bd-96a4-48c8-8177-0b9e1fb00337 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:38.109136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e32bd-96a4-48c8-8177-0b9e1fb00337 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:38.109475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e32bd-96a4-48c8-8177-0b9e1fb00337 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:38.109757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e32bd-96a4-48c8-8177-0b9e1fb00337 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:38.110350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e32bd-96a4-48c8-8177-0b9e1fb00337 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:38.111430 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-251e32bd-96a4-48c8-8177-0b9e1fb00337 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:22:38.111430 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:22:38.111430 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:22:38.112351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e32bd-96a4-48c8-8177-0b9e1fb00337 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:38.122213 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2407/4789] 10.222.0.23 () {58 vars in 1164 bytes} [Sun Oct 2 01:22:38 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:38.123783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbed5b2-a29f-4b00-a9b6-5f345e7fc8f8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:38.152265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbed5b2-a29f-4b00-a9b6-5f345e7fc8f8 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:38.174212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:38.174212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:38.174212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:38.175156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/920c769ac97742a38defba429a8d4634` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:38.175784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=920c769ac97742a38defba429a8d4634)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:38.180072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:38.180376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invalidating token cache because consumer 920c769ac97742a38defba429a8d4634 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:38.180648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.181713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.199731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '920c769ac97742a38defba429a8d4634', 'request_id': 'req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.231849 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2383/4790] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:22:38 2022] DELETE /identity/v3/OS-OAUTH1/consumers/920c769ac97742a38defba429a8d4634 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:38.233556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e32bd-96a4-48c8-8177-0b9e1fb00337 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:38.235440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-251e32bd-96a4-48c8-8177-0b9e1fb00337 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:38.257083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e32bd-96a4-48c8-8177-0b9e1fb00337 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:38.262012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:38.262735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:38.263180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:38.263529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/638d63bf0f1c4f9aa54d9fe82be44234` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:38.264630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=638d63bf0f1c4f9aa54d9fe82be44234)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:38.266287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:38.266564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invalidating token cache because consumer 638d63bf0f1c4f9aa54d9fe82be44234 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:38.266873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.267640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.283993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '638d63bf0f1c4f9aa54d9fe82be44234', 'request_id': 'req-d0971890-be6f-41b2-b49e-23abd3fff6ed'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.299951 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2408/4791] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:22:38 2022] DELETE /identity/v3/OS-OAUTH1/consumers/638d63bf0f1c4f9aa54d9fe82be44234 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:22:38.305438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:38.323560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1d46c-94d6-42a1-ae0d-c39e55dedf84 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:38.331311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb846d-ec72-46e7-81a7-0d453c499ad9 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:38.333102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb846d-ec72-46e7-81a7-0d453c499ad9 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:38.333625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb846d-ec72-46e7-81a7-0d453c499ad9 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:38.334115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb846d-ec72-46e7-81a7-0d453c499ad9 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:38.335191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb846d-ec72-46e7-81a7-0d453c499ad9 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:38.337790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb846d-ec72-46e7-81a7-0d453c499ad9 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:38.364209 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2384/4792] 10.222.0.23 () {60 vars in 1185 bytes} [Sun Oct 2 01:22:38 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:38.365509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:38.367082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:38.381997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0971890-be6f-41b2-b49e-23abd3fff6ed tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:38.391936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f9239-0782-4b2a-9dbd-835380b35ba4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:38.392521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f9239-0782-4b2a-9dbd-835380b35ba4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:38.392898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f9239-0782-4b2a-9dbd-835380b35ba4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:38.393122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f9239-0782-4b2a-9dbd-835380b35ba4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5f8a2057556048f087f7ff1ac13a5b9f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:38.393782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f9239-0782-4b2a-9dbd-835380b35ba4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=5f8a2057556048f087f7ff1ac13a5b9f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:38.394921 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-5b4f9239-0782-4b2a-9dbd-835380b35ba4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:22:38.394921 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:22:38.394921 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:22:38.395873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f9239-0782-4b2a-9dbd-835380b35ba4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:38.422400 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2409/4793] 10.222.0.23 () {60 vars in 1285 bytes} [Sun Oct 2 01:22:38 2022] PATCH /identity/v3/OS-OAUTH1/consumers/5f8a2057556048f087f7ff1ac13a5b9f => generated 221 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:38.427331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb846d-ec72-46e7-81a7-0d453c499ad9 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:38.444498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb846d-ec72-46e7-81a7-0d453c499ad9 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:38.452977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4a311-183c-414b-9156-ce9270ab8672 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:38.453759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4a311-183c-414b-9156-ce9270ab8672 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:38.455339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4a311-183c-414b-9156-ce9270ab8672 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:38.455761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4a311-183c-414b-9156-ce9270ab8672 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5f8a2057556048f087f7ff1ac13a5b9f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:38.456491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4a311-183c-414b-9156-ce9270ab8672 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=5f8a2057556048f087f7ff1ac13a5b9f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:38.458690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4a311-183c-414b-9156-ce9270ab8672 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:38.468080 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2385/4794] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:22:38 2022] GET /identity/v3/OS-OAUTH1/consumers/5f8a2057556048f087f7ff1ac13a5b9f => generated 221 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:22:38.472269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f9239-0782-4b2a-9dbd-835380b35ba4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:38.487226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f9239-0782-4b2a-9dbd-835380b35ba4 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:38.494391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee0dd7-d25d-4d1c-bf0a-f483f52eaba1 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dda8dd15992745948dd60e00eed24f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26ce819ddfd144f3ba74ff3033b54acf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:38.495310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee0dd7-d25d-4d1c-bf0a-f483f52eaba1 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:38.495753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee0dd7-d25d-4d1c-bf0a-f483f52eaba1 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:38.496175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee0dd7-d25d-4d1c-bf0a-f483f52eaba1 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5f8a2057556048f087f7ff1ac13a5b9f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:38.497200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee0dd7-d25d-4d1c-bf0a-f483f52eaba1 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=5f8a2057556048f087f7ff1ac13a5b9f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:38.499405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee0dd7-d25d-4d1c-bf0a-f483f52eaba1 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:38.499947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8cee0dd7-d25d-4d1c-bf0a-f483f52eaba1 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invalidating token cache because consumer 5f8a2057556048f087f7ff1ac13a5b9f has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:38.500605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8cee0dd7-d25d-4d1c-bf0a-f483f52eaba1 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.501550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8cee0dd7-d25d-4d1c-bf0a-f483f52eaba1 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.531982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8cee0dd7-d25d-4d1c-bf0a-f483f52eaba1 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '5f8a2057556048f087f7ff1ac13a5b9f', 'request_id': 'req-8cee0dd7-d25d-4d1c-bf0a-f483f52eaba1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.559743 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2410/4795] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:22:38 2022] DELETE /identity/v3/OS-OAUTH1/consumers/5f8a2057556048f087f7ff1ac13a5b9f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:38.565057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4a311-183c-414b-9156-ce9270ab8672 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:38.567890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d0e4a311-183c-414b-9156-ce9270ab8672 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:38.727178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4a311-183c-414b-9156-ce9270ab8672 tempest-OAUTHConsumersV3Test-1039272218 tempest-OAUTHConsumersV3Test-1039272218-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:38.747668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:38.748502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:38.748792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:38.749122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] PATH_INFO: `/v3/users/b677a24043ce40229fec5cc19c45626a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:38.750314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b677a24043ce40229fec5cc19c45626a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:38.752479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:38.818476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b677a24043ce40229fec5cc19c45626a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.838552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b677a24043ce40229fec5cc19c45626a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.839627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b677a24043ce40229fec5cc19c45626a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.849185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b677a24043ce40229fec5cc19c45626a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.870969 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:DELETE=13,keystone:SELECT=82 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:38.877245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b677a24043ce40229fec5cc19c45626a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:38.896838 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2386/4796] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:38 2022] DELETE /identity/v3/users/b677a24043ce40229fec5cc19c45626a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:38.901127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0ec56-cb99-4f72-a676-b168eec37361 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:38.901653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0ec56-cb99-4f72-a676-b168eec37361 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:38.902109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0ec56-cb99-4f72-a676-b168eec37361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:38.929474 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=83,keystone:INSERT=10,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:38.953914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-acd0ec56-cb99-4f72-a676-b168eec37361 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:38.956194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-acd0ec56-cb99-4f72-a676-b168eec37361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:39.068213 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2411/4797] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:39.146478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:39.148388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:39.251557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8af7-085e-4971-90d0-8295be2ecc9e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:39.256575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2286c3-614d-4f8b-bd03-8ca0c314749c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:39.257645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2286c3-614d-4f8b-bd03-8ca0c314749c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:39.258117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2286c3-614d-4f8b-bd03-8ca0c314749c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:39.258633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2286c3-614d-4f8b-bd03-8ca0c314749c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:39.273152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2286c3-614d-4f8b-bd03-8ca0c314749c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:39.275268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2286c3-614d-4f8b-bd03-8ca0c314749c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:39.289278 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2387/4798] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:22:41.445023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0ec56-cb99-4f72-a676-b168eec37361 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:41.448059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-acd0ec56-cb99-4f72-a676-b168eec37361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:41.549461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0ec56-cb99-4f72-a676-b168eec37361 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:41.566284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:41.567266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:41.568664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:41.570134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] PATH_INFO: `/v3/projects/f039b5639f0f4374a06752fc71387e6f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:41.573095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f039b5639f0f4374a06752fc71387e6f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:41.578507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:41.698291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f039b5639f0f4374a06752fc71387e6f', 'request_id': 'req-47750f28-41e7-493b-adab-ab2c8b229d81'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:41.706164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f039b5639f0f4374a06752fc71387e6f', 'request_id': 'req-47750f28-41e7-493b-adab-ab2c8b229d81'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:41.713740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f039b5639f0f4374a06752fc71387e6f', 'request_id': 'req-47750f28-41e7-493b-adab-ab2c8b229d81'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:41.745264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] The token cache is being invalidate because project f039b5639f0f4374a06752fc71387e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:41.745264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:41.746116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:41.752270 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2412/4799] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:41 2022] DELETE /identity/v3/projects/f039b5639f0f4374a06752fc71387e6f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:41.753292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2286c3-614d-4f8b-bd03-8ca0c314749c service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:41.766534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2286c3-614d-4f8b-bd03-8ca0c314749c service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:41.906642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5cf9-d1d0-4dbd-b4eb-511828b3ef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:41.907318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5cf9-d1d0-4dbd-b4eb-511828b3ef4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:41.916463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5cf9-d1d0-4dbd-b4eb-511828b3ef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:41.916758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5cf9-d1d0-4dbd-b4eb-511828b3ef4e admin admin] PATH_INFO: `/v3/users/dda8dd15992745948dd60e00eed24f2d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:41.920554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c5cf9-d1d0-4dbd-b4eb-511828b3ef4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda8dd15992745948dd60e00eed24f2d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:41.925570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c5cf9-d1d0-4dbd-b4eb-511828b3ef4e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:42.058279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c71c5cf9-d1d0-4dbd-b4eb-511828b3ef4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda8dd15992745948dd60e00eed24f2d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:42.103166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c71c5cf9-d1d0-4dbd-b4eb-511828b3ef4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda8dd15992745948dd60e00eed24f2d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:42.103554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c71c5cf9-d1d0-4dbd-b4eb-511828b3ef4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda8dd15992745948dd60e00eed24f2d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:42.119868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c71c5cf9-d1d0-4dbd-b4eb-511828b3ef4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda8dd15992745948dd60e00eed24f2d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:42.136409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c71c5cf9-d1d0-4dbd-b4eb-511828b3ef4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda8dd15992745948dd60e00eed24f2d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:42.147288 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2388/4800] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:41 2022] DELETE /identity/v3/users/dda8dd15992745948dd60e00eed24f2d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:44.366938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:44.368573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:44.398379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750f28-41e7-493b-adab-ab2c8b229d81 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:44.569151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:44.569932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:44.570212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:44.570487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] PATH_INFO: `/v3/projects/26ce819ddfd144f3ba74ff3033b54acf` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:44.573375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ce819ddfd144f3ba74ff3033b54acf)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:44.582214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:44.657718 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:44.697217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ce819ddfd144f3ba74ff3033b54acf', 'request_id': 'req-3a4b3362-a021-4e1e-a276-a4112b0ef811'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:44.705168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ce819ddfd144f3ba74ff3033b54acf', 'request_id': 'req-3a4b3362-a021-4e1e-a276-a4112b0ef811'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:44.721153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ce819ddfd144f3ba74ff3033b54acf', 'request_id': 'req-3a4b3362-a021-4e1e-a276-a4112b0ef811'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:44.746279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] The token cache is being invalidate because project 26ce819ddfd144f3ba74ff3033b54acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:44.746574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:44.747691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a4b3362-a021-4e1e-a276-a4112b0ef811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:44.749273 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2413/4801] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:44 2022] DELETE /identity/v3/projects/26ce819ddfd144f3ba74ff3033b54acf => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:44.754219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c5e52-47d3-4b80-bd60-7587f7047313 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:44.754725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c5e52-47d3-4b80-bd60-7587f7047313 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:44.755008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c5e52-47d3-4b80-bd60-7587f7047313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:44.794848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ae1c5e52-47d3-4b80-bd60-7587f7047313 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:44.795922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ae1c5e52-47d3-4b80-bd60-7587f7047313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:44.828335 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:44.996122 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2389/4802] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:44.999800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd36e4-5b6a-4de5-a8bd-5303b5cdd3c0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:44.999800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd36e4-5b6a-4de5-a8bd-5303b5cdd3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:44.999800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd36e4-5b6a-4de5-a8bd-5303b5cdd3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:45.024102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-febd36e4-5b6a-4de5-a8bd-5303b5cdd3c0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:45.026015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-febd36e4-5b6a-4de5-a8bd-5303b5cdd3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:45.038639 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2414/4803] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:45.040860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c5e52-47d3-4b80-bd60-7587f7047313 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:45.052169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c5e52-47d3-4b80-bd60-7587f7047313 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:45.058177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44756d5-202b-4164-ab91-690102224058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:45.058855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44756d5-202b-4164-ab91-690102224058 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:45.059548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44756d5-202b-4164-ab91-690102224058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:45.059548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44756d5-202b-4164-ab91-690102224058 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:45.061010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44756d5-202b-4164-ab91-690102224058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:22:45.061323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44756d5-202b-4164-ab91-690102224058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:45.063052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44756d5-202b-4164-ab91-690102224058 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:45.081663 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2390/4804] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:45.085857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd36e4-5b6a-4de5-a8bd-5303b5cdd3c0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:45.102274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd36e4-5b6a-4de5-a8bd-5303b5cdd3c0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:45.117450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8773-fab3-4e53-9f80-5abc6930a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:45.119277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8773-fab3-4e53-9f80-5abc6930a5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:45.119770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8773-fab3-4e53-9f80-5abc6930a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:45.123575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8773-fab3-4e53-9f80-5abc6930a5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:45.127780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa8773-fab3-4e53-9f80-5abc6930a5b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:45.129904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa8773-fab3-4e53-9f80-5abc6930a5b1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:45.185227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44756d5-202b-4164-ab91-690102224058 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:45.187526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f44756d5-202b-4164-ab91-690102224058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:45.194698 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2415/4805] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:45 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:45.195844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8773-fab3-4e53-9f80-5abc6930a5b1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:45.227601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44756d5-202b-4164-ab91-690102224058 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:45.301451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8773-fab3-4e53-9f80-5abc6930a5b1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:45.306719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d534f-c2fa-4790-a02a-ad1426160599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:45.307342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d534f-c2fa-4790-a02a-ad1426160599 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:45.307961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d534f-c2fa-4790-a02a-ad1426160599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:45.308060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d534f-c2fa-4790-a02a-ad1426160599 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:45.308805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d534f-c2fa-4790-a02a-ad1426160599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:45.311417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d534f-c2fa-4790-a02a-ad1426160599 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:45.349026 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2416/4806] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:45 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:45.354618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d534f-c2fa-4790-a02a-ad1426160599 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:45.390881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d534f-c2fa-4790-a02a-ad1426160599 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:45.401156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec557fa-fd19-4f67-936c-1c8105f317eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:45.402289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec557fa-fd19-4f67-936c-1c8105f317eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:45.402794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec557fa-fd19-4f67-936c-1c8105f317eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:45.404984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec557fa-fd19-4f67-936c-1c8105f317eb admin admin] PATH_INFO: `/v3/users/953559ae78e14bffa8ec7b866b498875` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:45.406696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec557fa-fd19-4f67-936c-1c8105f317eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=953559ae78e14bffa8ec7b866b498875)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:45.408451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4a4cc-ebaa-43da-b700-df2abdb150ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:45.409085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4a4cc-ebaa-43da-b700-df2abdb150ae admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:45.409307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec557fa-fd19-4f67-936c-1c8105f317eb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:45.409499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4a4cc-ebaa-43da-b700-df2abdb150ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:45.409787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4a4cc-ebaa-43da-b700-df2abdb150ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:45.410440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4a4cc-ebaa-43da-b700-df2abdb150ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:45.412071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4a4cc-ebaa-43da-b700-df2abdb150ae admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:45.435901 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2417/4807] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:45.440655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4a4cc-ebaa-43da-b700-df2abdb150ae admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:45.464008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4a4cc-ebaa-43da-b700-df2abdb150ae admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:45.471441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e687d-6988-4955-b11f-6c0e879c172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:45.472145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e687d-6988-4955-b11f-6c0e879c172d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:45.472478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e687d-6988-4955-b11f-6c0e879c172d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:45.473529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e687d-6988-4955-b11f-6c0e879c172d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:45.474452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e687d-6988-4955-b11f-6c0e879c172d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:45.476566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e687d-6988-4955-b11f-6c0e879c172d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:45.498445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aec557fa-fd19-4f67-936c-1c8105f317eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953559ae78e14bffa8ec7b866b498875'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:45.512167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aec557fa-fd19-4f67-936c-1c8105f317eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953559ae78e14bffa8ec7b866b498875'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:45.515414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aec557fa-fd19-4f67-936c-1c8105f317eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953559ae78e14bffa8ec7b866b498875'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:45.515609 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2418/4808] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:22:45.516921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e687d-6988-4955-b11f-6c0e879c172d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:45.520800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a08e687d-6988-4955-b11f-6c0e879c172d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:45.531113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aec557fa-fd19-4f67-936c-1c8105f317eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953559ae78e14bffa8ec7b866b498875'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:45.542751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e687d-6988-4955-b11f-6c0e879c172d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:45.555025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aec557fa-fd19-4f67-936c-1c8105f317eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953559ae78e14bffa8ec7b866b498875'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:45.561000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707330c-2af9-4210-a355-8e2e680d5089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:45.561920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707330c-2af9-4210-a355-8e2e680d5089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:45.562054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707330c-2af9-4210-a355-8e2e680d5089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:45.562226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707330c-2af9-4210-a355-8e2e680d5089 admin admin] PATH_INFO: `/v3/projects/43ea7f51fc6e422abc7115e631c3d796/users/ddb90671a5f94a9b99c8e65f37c8c873/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:45.573504 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2391/4809] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:45 2022] DELETE /identity/v3/users/953559ae78e14bffa8ec7b866b498875 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:22:45.598070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707330c-2af9-4210-a355-8e2e680d5089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ea7f51fc6e422abc7115e631c3d796, user_id=ddb90671a5f94a9b99c8e65f37c8c873, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:45.599918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707330c-2af9-4210-a355-8e2e680d5089 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:45.641128 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2419/4810] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:45 2022] PUT /identity/v3/projects/43ea7f51fc6e422abc7115e631c3d796/users/ddb90671a5f94a9b99c8e65f37c8c873/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:45.653573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e950f28-1a73-4dd5-b6ab-59879effda14 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:45.653867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e950f28-1a73-4dd5-b6ab-59879effda14 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:45.654144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e950f28-1a73-4dd5-b6ab-59879effda14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:45.695388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5e950f28-1a73-4dd5-b6ab-59879effda14 None None] MFA Rules not processed for user `ddb90671a5f94a9b99c8e65f37c8c873`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:45.697383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5e950f28-1a73-4dd5-b6ab-59879effda14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:45.712691 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:45.791166 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2392/4811] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:45.795892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707330c-2af9-4210-a355-8e2e680d5089 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:45.837565 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:45.879706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707330c-2af9-4210-a355-8e2e680d5089 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:45.884965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e1369-55bc-4b0a-817b-8290892be7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:45.885786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1369-55bc-4b0a-817b-8290892be7fc admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:45.886102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1369-55bc-4b0a-817b-8290892be7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:45.886445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1369-55bc-4b0a-817b-8290892be7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:45.888076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e1369-55bc-4b0a-817b-8290892be7fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:45.894670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e1369-55bc-4b0a-817b-8290892be7fc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:45.947463 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2420/4812] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:45 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:45.950753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e950f28-1a73-4dd5-b6ab-59879effda14 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:45.964234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e950f28-1a73-4dd5-b6ab-59879effda14 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:46.056227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6b1b3-24db-4068-bde6-584a68b9d683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:46.057116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6b1b3-24db-4068-bde6-584a68b9d683 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:46.057740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6b1b3-24db-4068-bde6-584a68b9d683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:46.058215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6b1b3-24db-4068-bde6-584a68b9d683 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:46.059495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6b1b3-24db-4068-bde6-584a68b9d683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:46.062335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6b1b3-24db-4068-bde6-584a68b9d683 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:46.110441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e1369-55bc-4b0a-817b-8290892be7fc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:46.110673 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2393/4813] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:45 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:46.133336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e1369-55bc-4b0a-817b-8290892be7fc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:46.147452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149329c4-ae5c-4141-925d-2d2e18c9d961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:46.148092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149329c4-ae5c-4141-925d-2d2e18c9d961 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:46.148377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149329c4-ae5c-4141-925d-2d2e18c9d961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:46.148652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149329c4-ae5c-4141-925d-2d2e18c9d961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:46.149312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149329c4-ae5c-4141-925d-2d2e18c9d961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:46.151065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149329c4-ae5c-4141-925d-2d2e18c9d961 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:46.172567 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2421/4814] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:46.177532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6b1b3-24db-4068-bde6-584a68b9d683 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:46.198581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6b1b3-24db-4068-bde6-584a68b9d683 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:46.210983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b47562-bbad-499f-9ebf-ddc06fc2a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:46.213882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b47562-bbad-499f-9ebf-ddc06fc2a334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:46.214642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b47562-bbad-499f-9ebf-ddc06fc2a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:46.214642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b47562-bbad-499f-9ebf-ddc06fc2a334 admin admin] PATH_INFO: `/v3/projects/723574ae711a48a1a18446485271b575/users/196b3b38023e42fea765025183207472/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:46.247898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b47562-bbad-499f-9ebf-ddc06fc2a334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=723574ae711a48a1a18446485271b575, user_id=196b3b38023e42fea765025183207472, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:46.255553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b47562-bbad-499f-9ebf-ddc06fc2a334 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:46.279692 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2394/4815] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:46 2022] PUT /identity/v3/projects/723574ae711a48a1a18446485271b575/users/196b3b38023e42fea765025183207472/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:46.284297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149329c4-ae5c-4141-925d-2d2e18c9d961 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:46.295451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149329c4-ae5c-4141-925d-2d2e18c9d961 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:46.360054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4cc0-c156-4b5d-9cce-3990dab1ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:46.360682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4cc0-c156-4b5d-9cce-3990dab1ee4d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:46.360962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4cc0-c156-4b5d-9cce-3990dab1ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:46.361236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4cc0-c156-4b5d-9cce-3990dab1ee4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:46.362494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4cc0-c156-4b5d-9cce-3990dab1ee4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:46.364157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4cc0-c156-4b5d-9cce-3990dab1ee4d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:46.380730 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2422/4816] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:22:46.383489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b47562-bbad-499f-9ebf-ddc06fc2a334 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:46.396516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b47562-bbad-499f-9ebf-ddc06fc2a334 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:46.403332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf08bf-3300-4347-a2a8-e7235dd0e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:46.405510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf08bf-3300-4347-a2a8-e7235dd0e85f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:46.406035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf08bf-3300-4347-a2a8-e7235dd0e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:46.406538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf08bf-3300-4347-a2a8-e7235dd0e85f admin admin] PATH_INFO: `/v3/projects/723574ae711a48a1a18446485271b575/users/196b3b38023e42fea765025183207472/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:46.409327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf08bf-3300-4347-a2a8-e7235dd0e85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=723574ae711a48a1a18446485271b575, user_id=196b3b38023e42fea765025183207472, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:46.412797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf08bf-3300-4347-a2a8-e7235dd0e85f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:46.436934 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2395/4817] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:46 2022] PUT /identity/v3/projects/723574ae711a48a1a18446485271b575/users/196b3b38023e42fea765025183207472/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:46.437683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5589ca-1928-42cf-9aab-e988e53f3c47 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:46.438076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5589ca-1928-42cf-9aab-e988e53f3c47 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:46.438242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5589ca-1928-42cf-9aab-e988e53f3c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:46.479010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1f5589ca-1928-42cf-9aab-e988e53f3c47 None None] MFA Rules not processed for user `196b3b38023e42fea765025183207472`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:46.480313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1f5589ca-1928-42cf-9aab-e988e53f3c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:46.616417 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2423/4818] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:22:46.621219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf08bf-3300-4347-a2a8-e7235dd0e85f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:46.635810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf08bf-3300-4347-a2a8-e7235dd0e85f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:46.654844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f76a33-6bc5-49f7-a0ef-ce87e464fa14 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196b3b38023e42fea765025183207472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723574ae711a48a1a18446485271b575', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:46.655483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f76a33-6bc5-49f7-a0ef-ce87e464fa14 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:46.655765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f76a33-6bc5-49f7-a0ef-ce87e464fa14 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:46.656040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f76a33-6bc5-49f7-a0ef-ce87e464fa14 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:46.656677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f76a33-6bc5-49f7-a0ef-ce87e464fa14 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:46.658563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f76a33-6bc5-49f7-a0ef-ce87e464fa14 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:46.688199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5589ca-1928-42cf-9aab-e988e53f3c47 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:46.689673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1f5589ca-1928-42cf-9aab-e988e53f3c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:46.728875 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2396/4819] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:46 2022] POST /identity/v3/projects => generated 358 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:46.733213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f76a33-6bc5-49f7-a0ef-ce87e464fa14 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:46.779338 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:46.855058 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:46.855933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5589ca-1928-42cf-9aab-e988e53f3c47 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:46.897276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f76a33-6bc5-49f7-a0ef-ce87e464fa14 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:46.912292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a71d9-7c19-47d0-970d-3f427b4e2e00 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196b3b38023e42fea765025183207472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723574ae711a48a1a18446485271b575', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:46.913541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a71d9-7c19-47d0-970d-3f427b4e2e00 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:46.913541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a71d9-7c19-47d0-970d-3f427b4e2e00 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:46.913541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a71d9-7c19-47d0-970d-3f427b4e2e00 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] PATH_INFO: `/v3/projects/45c1602debc94394aa5337fa09e502ee/tags/tempest-tag-1832641823` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:46.916409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a71d9-7c19-47d0-970d-3f427b4e2e00 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=45c1602debc94394aa5337fa09e502ee, value=tempest-tag-1832641823)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:46.918714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a71d9-7c19-47d0-970d-3f427b4e2e00 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:46.987403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:46.988893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:46.989396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:46.990213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] PATH_INFO: `/v3/projects/22fb92463e1c4d17947550b9b5513d70` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:46.992092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22fb92463e1c4d17947550b9b5513d70)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:46.995187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.079733 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-800a71d9-7c19-47d0-970d-3f427b4e2e00 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1832641823. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:22:47.079733 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:22:47.079733 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:22:47.094886 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2397/4820] 10.222.0.23 () {60 vars in 1333 bytes} [Sun Oct 2 01:22:46 2022] PUT /identity/v3/projects/45c1602debc94394aa5337fa09e502ee/tags/tempest-tag-1832641823 => generated 0 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 291 bytes (2 switches on core 0) Oct 02 01:22:47.096168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a71d9-7c19-47d0-970d-3f427b4e2e00 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.108415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a71d9-7c19-47d0-970d-3f427b4e2e00 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.111536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22fb92463e1c4d17947550b9b5513d70', 'request_id': 'req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:47.125736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22fb92463e1c4d17947550b9b5513d70', 'request_id': 'req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:47.145907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22fb92463e1c4d17947550b9b5513d70', 'request_id': 'req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:47.181153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] The token cache is being invalidate because project 22fb92463e1c4d17947550b9b5513d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:47.181550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:47.182104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f3bfb2c5-ddf3-43fd-bc5e-9dd6f0c84d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:47.183947 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2424/4821] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:46 2022] DELETE /identity/v3/projects/22fb92463e1c4d17947550b9b5513d70 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:47.190287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93854d6c-7f30-4727-b05c-3a9b259939f0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.190572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93854d6c-7f30-4727-b05c-3a9b259939f0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.190881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93854d6c-7f30-4727-b05c-3a9b259939f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.205066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461398-537d-4690-bc6f-71556969e02b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196b3b38023e42fea765025183207472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723574ae711a48a1a18446485271b575', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.206437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461398-537d-4690-bc6f-71556969e02b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.207148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461398-537d-4690-bc6f-71556969e02b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.207784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461398-537d-4690-bc6f-71556969e02b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] PATH_INFO: `/v3/projects/45c1602debc94394aa5337fa09e502ee/tags/tempest-tag-1832641823` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.230666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4461398-537d-4690-bc6f-71556969e02b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=45c1602debc94394aa5337fa09e502ee, value=tempest-tag-1832641823)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:47.233540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4461398-537d-4690-bc6f-71556969e02b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.242785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-93854d6c-7f30-4727-b05c-3a9b259939f0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:47.244374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-93854d6c-7f30-4727-b05c-3a9b259939f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:47.252083 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2398/4822] 10.222.0.23 () {58 vars in 1314 bytes} [Sun Oct 2 01:22:47 2022] GET /identity/v3/projects/45c1602debc94394aa5337fa09e502ee/tags/tempest-tag-1832641823 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:47.256492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461398-537d-4690-bc6f-71556969e02b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.259640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e4461398-537d-4690-bc6f-71556969e02b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:47.305586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461398-537d-4690-bc6f-71556969e02b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.320107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae03f8-c956-425f-904d-61986872b46b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196b3b38023e42fea765025183207472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723574ae711a48a1a18446485271b575', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.321350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae03f8-c956-425f-904d-61986872b46b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.321835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae03f8-c956-425f-904d-61986872b46b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.322652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae03f8-c956-425f-904d-61986872b46b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] PATH_INFO: `/v3/projects/45c1602debc94394aa5337fa09e502ee/tags` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.325808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae03f8-c956-425f-904d-61986872b46b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=45c1602debc94394aa5337fa09e502ee)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:47.334947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae03f8-c956-425f-904d-61986872b46b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.351620 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2425/4823] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:47.359767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9d827-b098-4ba2-8c67-d5381f0a686f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.360422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9d827-b098-4ba2-8c67-d5381f0a686f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.360871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9d827-b098-4ba2-8c67-d5381f0a686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.379673 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:47.401628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-94b9d827-b098-4ba2-8c67-d5381f0a686f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:47.406928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-94b9d827-b098-4ba2-8c67-d5381f0a686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:47.419671 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2426/4824] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:22:47.423908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9d827-b098-4ba2-8c67-d5381f0a686f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.441050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9d827-b098-4ba2-8c67-d5381f0a686f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.447495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454244ea-fe1b-4760-807c-69675adea978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.448599 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2399/4825] 10.222.0.23 () {60 vars in 1265 bytes} [Sun Oct 2 01:22:47 2022] PUT /identity/v3/projects/45c1602debc94394aa5337fa09e502ee/tags => generated 142 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:47.453194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae03f8-c956-425f-904d-61986872b46b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.453508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454244ea-fe1b-4760-807c-69675adea978 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.453969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454244ea-fe1b-4760-807c-69675adea978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.454444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454244ea-fe1b-4760-807c-69675adea978 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.457194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454244ea-fe1b-4760-807c-69675adea978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:22:47.459988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454244ea-fe1b-4760-807c-69675adea978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:47.464121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454244ea-fe1b-4760-807c-69675adea978 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.472595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae03f8-c956-425f-904d-61986872b46b tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.482746 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2427/4826] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:47.488066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9021af8-fff0-4d27-a9cf-a5a76cb8a05f tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196b3b38023e42fea765025183207472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723574ae711a48a1a18446485271b575', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.489081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9021af8-fff0-4d27-a9cf-a5a76cb8a05f tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.489432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9021af8-fff0-4d27-a9cf-a5a76cb8a05f tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.489729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9021af8-fff0-4d27-a9cf-a5a76cb8a05f tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] PATH_INFO: `/v3/projects/45c1602debc94394aa5337fa09e502ee/tags` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.503518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454244ea-fe1b-4760-807c-69675adea978 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.518432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9021af8-fff0-4d27-a9cf-a5a76cb8a05f tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=45c1602debc94394aa5337fa09e502ee)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:47.521567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9021af8-fff0-4d27-a9cf-a5a76cb8a05f tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.530178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454244ea-fe1b-4760-807c-69675adea978 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.538160 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2400/4827] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:22:47 2022] GET /identity/v3/projects/45c1602debc94394aa5337fa09e502ee/tags => generated 142 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:22:47.542555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9021af8-fff0-4d27-a9cf-a5a76cb8a05f tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.546461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9607c-29df-4800-b3e8-3af1d926fde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.549389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9607c-29df-4800-b3e8-3af1d926fde5 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.550155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9607c-29df-4800-b3e8-3af1d926fde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.550918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9607c-29df-4800-b3e8-3af1d926fde5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.552916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9607c-29df-4800-b3e8-3af1d926fde5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:47.556983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9607c-29df-4800-b3e8-3af1d926fde5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.560216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9021af8-fff0-4d27-a9cf-a5a76cb8a05f tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.566902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c043a3-5cfc-4348-a9b3-7b1346b697a4 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196b3b38023e42fea765025183207472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723574ae711a48a1a18446485271b575', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.568302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c043a3-5cfc-4348-a9b3-7b1346b697a4 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.569044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c043a3-5cfc-4348-a9b3-7b1346b697a4 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.569423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c043a3-5cfc-4348-a9b3-7b1346b697a4 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] PATH_INFO: `/v3/projects/45c1602debc94394aa5337fa09e502ee/tags/tempest-tag-1668554352` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.571435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c043a3-5cfc-4348-a9b3-7b1346b697a4 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=45c1602debc94394aa5337fa09e502ee, value=tempest-tag-1668554352)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:47.574668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c043a3-5cfc-4348-a9b3-7b1346b697a4 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.601591 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2428/4828] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:47 2022] POST /identity/v3/projects => generated 395 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:22:47.607626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9607c-29df-4800-b3e8-3af1d926fde5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.609179 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:47.647411 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-76c043a3-5cfc-4348-a9b3-7b1346b697a4 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1668554352. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:22:47.647411 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:22:47.647411 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:22:47.657845 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2401/4829] 10.222.0.23 () {58 vars in 1317 bytes} [Sun Oct 2 01:22:47 2022] DELETE /identity/v3/projects/45c1602debc94394aa5337fa09e502ee/tags/tempest-tag-1668554352 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:47.662175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c043a3-5cfc-4348-a9b3-7b1346b697a4 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.692708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c043a3-5cfc-4348-a9b3-7b1346b697a4 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.726256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9607c-29df-4800-b3e8-3af1d926fde5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.734340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c468c7-b462-42ef-9189-6f55e4b24b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.735380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c468c7-b462-42ef-9189-6f55e4b24b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.736028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c468c7-b462-42ef-9189-6f55e4b24b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.736570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c468c7-b462-42ef-9189-6f55e4b24b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.737397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c468c7-b462-42ef-9189-6f55e4b24b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:47.740815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c468c7-b462-42ef-9189-6f55e4b24b9e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.775803 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2429/4830] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:47 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:47.779615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c468c7-b462-42ef-9189-6f55e4b24b9e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.797745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c468c7-b462-42ef-9189-6f55e4b24b9e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.803238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35a7ce-7d8b-4251-bc62-b2205eae2f3d tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196b3b38023e42fea765025183207472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723574ae711a48a1a18446485271b575', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.803905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a7ce-7d8b-4251-bc62-b2205eae2f3d tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.804188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a7ce-7d8b-4251-bc62-b2205eae2f3d tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.804466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a7ce-7d8b-4251-bc62-b2205eae2f3d tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] PATH_INFO: `/v3/projects/45c1602debc94394aa5337fa09e502ee/tags/tempest-tag-1668554352` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.804740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c4083-a756-40c0-ac93-68ff69a5175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.805656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c4083-a756-40c0-ac93-68ff69a5175b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.806064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c4083-a756-40c0-ac93-68ff69a5175b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.806435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c4083-a756-40c0-ac93-68ff69a5175b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.807788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c4083-a756-40c0-ac93-68ff69a5175b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:47.811608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c4083-a756-40c0-ac93-68ff69a5175b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.837963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35a7ce-7d8b-4251-bc62-b2205eae2f3d tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=45c1602debc94394aa5337fa09e502ee, value=tempest-tag-1668554352)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:47.842654 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2430/4831] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:22:47.844255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35a7ce-7d8b-4251-bc62-b2205eae2f3d tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.845475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c4083-a756-40c0-ac93-68ff69a5175b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cc35a7ce-7d8b-4251-bc62-b2205eae2f3d tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Could not find project tag: tempest-tag-1668554352.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1668554352. Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 02 01:22:47.863429 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 02 01:22:47.864966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:22:47.864966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:22:47.864966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 02 01:22:47.864966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 02 01:22:47.864966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1668554352. Oct 02 01:22:47.864966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:22:47.866206 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2402/4832] 10.222.0.23 () {58 vars in 1314 bytes} [Sun Oct 2 01:22:47 2022] GET /identity/v3/projects/45c1602debc94394aa5337fa09e502ee/tags/tempest-tag-1668554352 => generated 107 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:22:47.870444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35a7ce-7d8b-4251-bc62-b2205eae2f3d tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.883578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c4083-a756-40c0-ac93-68ff69a5175b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.884850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35a7ce-7d8b-4251-bc62-b2205eae2f3d tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.892371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eed837-e720-4382-9f24-3a8762539a3c tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196b3b38023e42fea765025183207472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723574ae711a48a1a18446485271b575', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.892781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eed837-e720-4382-9f24-3a8762539a3c tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.893159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eed837-e720-4382-9f24-3a8762539a3c tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.893553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eed837-e720-4382-9f24-3a8762539a3c tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] PATH_INFO: `/v3/projects/45c1602debc94394aa5337fa09e502ee/tags` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.895364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eed837-e720-4382-9f24-3a8762539a3c tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=45c1602debc94394aa5337fa09e502ee)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:47.897873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965848-a1d5-49fb-92cc-ac85c736b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.898630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eed837-e720-4382-9f24-3a8762539a3c tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.900420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965848-a1d5-49fb-92cc-ac85c736b156 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.900710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965848-a1d5-49fb-92cc-ac85c736b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.900993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965848-a1d5-49fb-92cc-ac85c736b156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.903759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92965848-a1d5-49fb-92cc-ac85c736b156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:47.910534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92965848-a1d5-49fb-92cc-ac85c736b156 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:47.949594 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2431/4833] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:47.954804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965848-a1d5-49fb-92cc-ac85c736b156 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:47.970385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965848-a1d5-49fb-92cc-ac85c736b156 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:47.984119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522ee7b-a147-4c06-9e92-448819944f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:47.986813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ee7b-a147-4c06-9e92-448819944f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:47.987799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ee7b-a147-4c06-9e92-448819944f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:47.988098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ee7b-a147-4c06-9e92-448819944f9b admin admin] PATH_INFO: `/v3/projects/621bdb6aad704cf9b2f31f9e1e653d8c/users/4701f06a10ad4f89984132f8ec72b955/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:47.991948 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2403/4834] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:22:47 2022] DELETE /identity/v3/projects/45c1602debc94394aa5337fa09e502ee/tags => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:22:47.996381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eed837-e720-4382-9f24-3a8762539a3c tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:48.013759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eed837-e720-4382-9f24-3a8762539a3c tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:48.021002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc38e6-11c1-4389-b909-6e216b498804 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196b3b38023e42fea765025183207472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723574ae711a48a1a18446485271b575', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:48.022749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc38e6-11c1-4389-b909-6e216b498804 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:48.023214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc38e6-11c1-4389-b909-6e216b498804 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:48.023641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc38e6-11c1-4389-b909-6e216b498804 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] PATH_INFO: `/v3/projects/45c1602debc94394aa5337fa09e502ee/tags` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:48.031380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522ee7b-a147-4c06-9e92-448819944f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=621bdb6aad704cf9b2f31f9e1e653d8c, user_id=4701f06a10ad4f89984132f8ec72b955, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:48.040025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc38e6-11c1-4389-b909-6e216b498804 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=45c1602debc94394aa5337fa09e502ee)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:48.040989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522ee7b-a147-4c06-9e92-448819944f9b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:48.044593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc38e6-11c1-4389-b909-6e216b498804 tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:48.072286 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2432/4835] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:47 2022] PUT /identity/v3/projects/621bdb6aad704cf9b2f31f9e1e653d8c/users/4701f06a10ad4f89984132f8ec72b955/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:48.072879 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2404/4836] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:22:47 2022] GET /identity/v3/projects/45c1602debc94394aa5337fa09e502ee/tags => generated 66 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:22:48.075363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522ee7b-a147-4c06-9e92-448819944f9b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:48.077729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ba89-9d2b-4dbc-b487-fafbe5d8cdad None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:48.078012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ba89-9d2b-4dbc-b487-fafbe5d8cdad None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:48.082424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ba89-9d2b-4dbc-b487-fafbe5d8cdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:48.110359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e430ba89-9d2b-4dbc-b487-fafbe5d8cdad None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:48.111757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e430ba89-9d2b-4dbc-b487-fafbe5d8cdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:48.214993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522ee7b-a147-4c06-9e92-448819944f9b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:48.237834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196b3b38023e42fea765025183207472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723574ae711a48a1a18446485271b575', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:48.238496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:48.238812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:48.239088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] PATH_INFO: `/v3/projects/45c1602debc94394aa5337fa09e502ee` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:48.243548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45c1602debc94394aa5337fa09e502ee)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:48.249826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:48.253529 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2405/4837] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:48.272694 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:48.298906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430ba89-9d2b-4dbc-b487-fafbe5d8cdad None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:48.301055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e430ba89-9d2b-4dbc-b487-fafbe5d8cdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:48.330531 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:48.484438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c1602debc94394aa5337fa09e502ee', 'request_id': 'req-a1a57f2a-caf9-44e5-9e68-7de3d489629e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:48.511279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c1602debc94394aa5337fa09e502ee', 'request_id': 'req-a1a57f2a-caf9-44e5-9e68-7de3d489629e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:48.527686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c1602debc94394aa5337fa09e502ee', 'request_id': 'req-a1a57f2a-caf9-44e5-9e68-7de3d489629e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:48.556884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] The token cache is being invalidate because project 45c1602debc94394aa5337fa09e502ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:48.557227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:48.557848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430ba89-9d2b-4dbc-b487-fafbe5d8cdad None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:48.570542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:48.582522 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2433/4838] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:48 2022] DELETE /identity/v3/projects/45c1602debc94394aa5337fa09e502ee => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:48.588328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:48.592480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:48.672649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71586067-264c-4f3e-88b6-dd9a4ec795c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:48.673472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586067-264c-4f3e-88b6-dd9a4ec795c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:48.673758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586067-264c-4f3e-88b6-dd9a4ec795c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:48.674030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586067-264c-4f3e-88b6-dd9a4ec795c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:48.678046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-71586067-264c-4f3e-88b6-dd9a4ec795c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:48.818427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71586067-264c-4f3e-88b6-dd9a4ec795c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:48.820039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71586067-264c-4f3e-88b6-dd9a4ec795c5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:48.829404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a57f2a-caf9-44e5-9e68-7de3d489629e tempest-IdentityV3ProjectTagsTest-94278281 tempest-IdentityV3ProjectTagsTest-94278281-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:48.841588 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2406/4839] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:22:48.843826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:48.844485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:48.844763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:48.845036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] PATH_INFO: `/v3/users/ddb90671a5f94a9b99c8e65f37c8c873` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:48.846248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb90671a5f94a9b99c8e65f37c8c873)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:48.849605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:48.925192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb90671a5f94a9b99c8e65f37c8c873'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:48.943709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb90671a5f94a9b99c8e65f37c8c873'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:48.944739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb90671a5f94a9b99c8e65f37c8c873'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:48.958102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb90671a5f94a9b99c8e65f37c8c873'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:48.960127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb90671a5f94a9b99c8e65f37c8c873'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:48.982393 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2434/4840] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:48 2022] DELETE /identity/v3/users/ddb90671a5f94a9b99c8e65f37c8c873 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:48.982969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588e305-a42e-47d3-9a2f-5731c1de34c1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:48.983484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588e305-a42e-47d3-9a2f-5731c1de34c1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:48.983583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588e305-a42e-47d3-9a2f-5731c1de34c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:49.018565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3588e305-a42e-47d3-9a2f-5731c1de34c1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:49.021177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3588e305-a42e-47d3-9a2f-5731c1de34c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:49.167087 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2407/4841] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:22:49.219120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:49.221111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:49.245779 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:49.349030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a97cc-d28e-4238-9b5f-4e87b972e9b2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:49.358473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b55a5-5307-4979-bfb3-90dd58c5d6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:49.359511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b55a5-5307-4979-bfb3-90dd58c5d6fc service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:49.360715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b55a5-5307-4979-bfb3-90dd58c5d6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:49.361217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b55a5-5307-4979-bfb3-90dd58c5d6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:49.385842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b55a5-5307-4979-bfb3-90dd58c5d6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:49.387363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b55a5-5307-4979-bfb3-90dd58c5d6fc service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:49.398779 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2435/4842] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:22:51.145332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2413-d92f-483d-a647-9e391d99e465 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:51.145801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2413-d92f-483d-a647-9e391d99e465 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:51.145914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2413-d92f-483d-a647-9e391d99e465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:51.204557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-762c2413-d92f-483d-a647-9e391d99e465 None None] MFA Rules not processed for user `a4ba5c1008c3439689b252d70a0b3f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:51.205770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-762c2413-d92f-483d-a647-9e391d99e465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:51.222640 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:51.336064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b55a5-5307-4979-bfb3-90dd58c5d6fc service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:51.337537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4c2b55a5-5307-4979-bfb3-90dd58c5d6fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:51.353632 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2408/4843] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:51.361621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b55a5-5307-4979-bfb3-90dd58c5d6fc service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:51.364296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ca6f-2f48-4914-b63f-80235cd8c025 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:51.364628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ca6f-2f48-4914-b63f-80235cd8c025 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:51.364908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ca6f-2f48-4914-b63f-80235cd8c025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:51.383389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:51.384536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:51.385289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:51.386122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] PATH_INFO: `/v3/projects/43ea7f51fc6e422abc7115e631c3d796` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:51.388277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ea7f51fc6e422abc7115e631c3d796)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:51.391854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:51.409876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9f74ca6f-2f48-4914-b63f-80235cd8c025 None None] MFA Rules not processed for user `a4ba5c1008c3439689b252d70a0b3f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:51.417030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f74ca6f-2f48-4914-b63f-80235cd8c025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:51.437047 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2409/4844] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:22:51.457072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74ca6f-2f48-4914-b63f-80235cd8c025 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:51.460481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f74ca6f-2f48-4914-b63f-80235cd8c025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:51.494580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ea7f51fc6e422abc7115e631c3d796', 'request_id': 'req-291ccfff-605f-4ba4-8104-21bdbd21c0f7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:51.511474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ea7f51fc6e422abc7115e631c3d796', 'request_id': 'req-291ccfff-605f-4ba4-8104-21bdbd21c0f7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:51.526079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ea7f51fc6e422abc7115e631c3d796', 'request_id': 'req-291ccfff-605f-4ba4-8104-21bdbd21c0f7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:51.558175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] The token cache is being invalidate because project 43ea7f51fc6e422abc7115e631c3d796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:51.559066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:51.561042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:51.566649 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2436/4845] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:51 2022] DELETE /identity/v3/projects/43ea7f51fc6e422abc7115e631c3d796 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:51.572043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:51.577821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:51.686978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74ca6f-2f48-4914-b63f-80235cd8c025 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:51.787955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ccfff-605f-4ba4-8104-21bdbd21c0f7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:51.802285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:51.804638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:51.805345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:51.806450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] PATH_INFO: `/v3/users/196b3b38023e42fea765025183207472` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:51.808687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196b3b38023e42fea765025183207472)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:51.814347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:51.866051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d6e06-fcd4-48d4-91c3-dc98f1e9d22e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:51.866743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6e06-fcd4-48d4-91c3-dc98f1e9d22e service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:51.867039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6e06-fcd4-48d4-91c3-dc98f1e9d22e service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:51.867345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6e06-fcd4-48d4-91c3-dc98f1e9d22e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:51.876228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-563d6e06-fcd4-48d4-91c3-dc98f1e9d22e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:51.927067 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:51.932280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196b3b38023e42fea765025183207472'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:51.964431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196b3b38023e42fea765025183207472'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:51.966822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196b3b38023e42fea765025183207472'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:51.984839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196b3b38023e42fea765025183207472'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:51.985792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196b3b38023e42fea765025183207472'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:52.005690 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2437/4846] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:51 2022] DELETE /identity/v3/users/196b3b38023e42fea765025183207472 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:52.007082 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:52.053674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d6e06-fcd4-48d4-91c3-dc98f1e9d22e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:52.055378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d6e06-fcd4-48d4-91c3-dc98f1e9d22e service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:52.076310 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2410/4847] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:22:53.485802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:53.488804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:53.631303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d871b-ddd3-4815-84a0-b3a84c9dd1e4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:53.636306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aad26-3ffe-4f78-b659-148cea1aee46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:53.637156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aad26-3ffe-4f78-b659-148cea1aee46 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:53.637526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aad26-3ffe-4f78-b659-148cea1aee46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:53.638065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aad26-3ffe-4f78-b659-148cea1aee46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:53.639943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-534aad26-3ffe-4f78-b659-148cea1aee46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:53.662584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aad26-3ffe-4f78-b659-148cea1aee46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:53.669593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aad26-3ffe-4f78-b659-148cea1aee46 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:53.703867 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2438/4848] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:22:53.907564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d6e06-fcd4-48d4-91c3-dc98f1e9d22e service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:53.933770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d6e06-fcd4-48d4-91c3-dc98f1e9d22e service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:54.065376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:54.066028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:54.066353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:54.066664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] PATH_INFO: `/v3/projects/723574ae711a48a1a18446485271b575` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:54.068601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723574ae711a48a1a18446485271b575)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:54.073118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:54.199383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723574ae711a48a1a18446485271b575', 'request_id': 'req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:54.213258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723574ae711a48a1a18446485271b575', 'request_id': 'req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:54.224267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723574ae711a48a1a18446485271b575', 'request_id': 'req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:54.262060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] The token cache is being invalidate because project 723574ae711a48a1a18446485271b575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:54.262647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:54.263431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c7bb4330-0fb6-42a5-a9ba-585bebc43c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:54.268582 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2411/4849] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:53 2022] DELETE /identity/v3/projects/723574ae711a48a1a18446485271b575 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:54.270081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806056a-bfb6-4bb1-bfdf-98d180fad9b4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:54.270377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806056a-bfb6-4bb1-bfdf-98d180fad9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:54.270683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806056a-bfb6-4bb1-bfdf-98d180fad9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:54.316182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e806056a-bfb6-4bb1-bfdf-98d180fad9b4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:54.323060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e806056a-bfb6-4bb1-bfdf-98d180fad9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:54.511345 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2439/4850] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:22:54.520064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc6c7c-8eab-4695-b849-54bd7c652813 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:54.520356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc6c7c-8eab-4695-b849-54bd7c652813 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:54.520648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc6c7c-8eab-4695-b849-54bd7c652813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:54.557978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6ffc6c7c-8eab-4695-b849-54bd7c652813 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:54.559686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ffc6c7c-8eab-4695-b849-54bd7c652813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:54.598791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2412/4851] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:54.601939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806056a-bfb6-4bb1-bfdf-98d180fad9b4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:54.627897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806056a-bfb6-4bb1-bfdf-98d180fad9b4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:54.645073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15464d3-6342-4899-b044-b61ba131cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:54.645714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15464d3-6342-4899-b044-b61ba131cfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:54.646166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15464d3-6342-4899-b044-b61ba131cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:54.646426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15464d3-6342-4899-b044-b61ba131cfa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:54.647133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15464d3-6342-4899-b044-b61ba131cfa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:22:54.647440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15464d3-6342-4899-b044-b61ba131cfa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:54.649153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15464d3-6342-4899-b044-b61ba131cfa9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:54.679707 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2440/4852] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:22:54.684584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc6c7c-8eab-4695-b849-54bd7c652813 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:54.699872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc6c7c-8eab-4695-b849-54bd7c652813 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:54.718717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06c4e4-16f7-4d20-b5d6-34aa32453ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:54.719608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c4e4-16f7-4d20-b5d6-34aa32453ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:54.720445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c4e4-16f7-4d20-b5d6-34aa32453ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:54.721063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c4e4-16f7-4d20-b5d6-34aa32453ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:54.721700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06c4e4-16f7-4d20-b5d6-34aa32453ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:54.728146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06c4e4-16f7-4d20-b5d6-34aa32453ec6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:54.774332 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2413/4853] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:54 2022] POST /identity/v3/projects => generated 397 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:54.774882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15464d3-6342-4899-b044-b61ba131cfa9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:54.792536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15464d3-6342-4899-b044-b61ba131cfa9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:54.961360 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:55.001723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15505092-3265-422f-a6d0-e5a01ad43b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:55.003294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15505092-3265-422f-a6d0-e5a01ad43b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:55.005774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15505092-3265-422f-a6d0-e5a01ad43b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:55.006156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15505092-3265-422f-a6d0-e5a01ad43b0b admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:55.009336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15505092-3265-422f-a6d0-e5a01ad43b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:55.016819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15505092-3265-422f-a6d0-e5a01ad43b0b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:55.091435 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2441/4854] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:54 2022] POST /identity/v3/users => generated 299 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:55.093328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06c4e4-16f7-4d20-b5d6-34aa32453ec6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:55.108899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06c4e4-16f7-4d20-b5d6-34aa32453ec6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:55.125359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3de5d3-11fb-4e9a-9936-63da520e21a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:55.126207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3de5d3-11fb-4e9a-9936-63da520e21a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:55.126207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3de5d3-11fb-4e9a-9936-63da520e21a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:55.126480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3de5d3-11fb-4e9a-9936-63da520e21a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:55.127164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3de5d3-11fb-4e9a-9936-63da520e21a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:55.128903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3de5d3-11fb-4e9a-9936-63da520e21a4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:55.147457 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2414/4855] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:55.151376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15505092-3265-422f-a6d0-e5a01ad43b0b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:55.161909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15505092-3265-422f-a6d0-e5a01ad43b0b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:55.173911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08fbc9-1e96-4f25-940d-ab933cddfd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:55.174811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08fbc9-1e96-4f25-940d-ab933cddfd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:55.175181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08fbc9-1e96-4f25-940d-ab933cddfd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:55.175181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08fbc9-1e96-4f25-940d-ab933cddfd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:55.176952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08fbc9-1e96-4f25-940d-ab933cddfd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:55.177998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08fbc9-1e96-4f25-940d-ab933cddfd0d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:55.195730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3de5d3-11fb-4e9a-9936-63da520e21a4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:55.201562 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2442/4856] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:55.208036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3de5d3-11fb-4e9a-9936-63da520e21a4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:55.217526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7300-68ec-4d88-bfbb-e969eb4b9143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:55.218780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7300-68ec-4d88-bfbb-e969eb4b9143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:55.219588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7300-68ec-4d88-bfbb-e969eb4b9143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:55.219588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7300-68ec-4d88-bfbb-e969eb4b9143 admin admin] PATH_INFO: `/v3/projects/d95855f7c3744cc499c94b44b33456f9/users/5018352154d64cedb53c4c72c03b7ade/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:55.267803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a7300-68ec-4d88-bfbb-e969eb4b9143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95855f7c3744cc499c94b44b33456f9, user_id=5018352154d64cedb53c4c72c03b7ade, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:55.287517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a7300-68ec-4d88-bfbb-e969eb4b9143 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:55.310661 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:55.335817 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2415/4857] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:55 2022] PUT /identity/v3/projects/d95855f7c3744cc499c94b44b33456f9/users/5018352154d64cedb53c4c72c03b7ade/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:22:55.347100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ad0c4-e486-461a-8a93-2e445cf5ca74 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:55.347629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ad0c4-e486-461a-8a93-2e445cf5ca74 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:55.348068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ad0c4-e486-461a-8a93-2e445cf5ca74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:55.421330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-752ad0c4-e486-461a-8a93-2e445cf5ca74 None None] MFA Rules not processed for user `5018352154d64cedb53c4c72c03b7ade`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:55.422589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-752ad0c4-e486-461a-8a93-2e445cf5ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:55.562874 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2443/4858] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:55.566547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7300-68ec-4d88-bfbb-e969eb4b9143 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:55.838360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7300-68ec-4d88-bfbb-e969eb4b9143 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:55.852509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b937f1-ffb2-448e-a93e-61ba37c99af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:55.853415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b937f1-ffb2-448e-a93e-61ba37c99af3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:55.853804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b937f1-ffb2-448e-a93e-61ba37c99af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:55.854125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b937f1-ffb2-448e-a93e-61ba37c99af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:55.855091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b937f1-ffb2-448e-a93e-61ba37c99af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:55.859805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b937f1-ffb2-448e-a93e-61ba37c99af3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:55.937234 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2416/4859] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:55 2022] POST /identity/v3/projects => generated 397 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:55.940972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ad0c4-e486-461a-8a93-2e445cf5ca74 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:55.956809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ad0c4-e486-461a-8a93-2e445cf5ca74 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:56.107190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9df95-316c-43c7-9224-505d374ec5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:56.107827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9df95-316c-43c7-9224-505d374ec5bb admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:56.108112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9df95-316c-43c7-9224-505d374ec5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:56.108411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9df95-316c-43c7-9224-505d374ec5bb admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:56.109037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9df95-316c-43c7-9224-505d374ec5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:56.111422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9df95-316c-43c7-9224-505d374ec5bb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:56.171441 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2444/4860] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:22:55 2022] POST /identity/v3/users => generated 305 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:56.175847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b937f1-ffb2-448e-a93e-61ba37c99af3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:56.196715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b937f1-ffb2-448e-a93e-61ba37c99af3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:56.208545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017c70-4c87-4d3a-b0f0-f1dedb322515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:56.209404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017c70-4c87-4d3a-b0f0-f1dedb322515 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:56.209763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017c70-4c87-4d3a-b0f0-f1dedb322515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:56.210276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017c70-4c87-4d3a-b0f0-f1dedb322515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:56.211055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab017c70-4c87-4d3a-b0f0-f1dedb322515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:56.212958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab017c70-4c87-4d3a-b0f0-f1dedb322515 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:56.256670 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2417/4861] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:56.261385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9df95-316c-43c7-9224-505d374ec5bb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:56.284813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9df95-316c-43c7-9224-505d374ec5bb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:56.295581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a47c4-842f-476c-9c2f-a635b49613cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:56.297125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a47c4-842f-476c-9c2f-a635b49613cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:56.299017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a47c4-842f-476c-9c2f-a635b49613cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:56.299402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a47c4-842f-476c-9c2f-a635b49613cc admin admin] PATH_INFO: `/v3/projects/838620414847488f9c2570305a417c7d/users/189d8d3ad8d747968cb6531780224101/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:56.331570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a47c4-842f-476c-9c2f-a635b49613cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=838620414847488f9c2570305a417c7d, user_id=189d8d3ad8d747968cb6531780224101, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:56.341398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a47c4-842f-476c-9c2f-a635b49613cc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:56.373525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017c70-4c87-4d3a-b0f0-f1dedb322515 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:56.375047 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2445/4862] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:56 2022] PUT /identity/v3/projects/838620414847488f9c2570305a417c7d/users/189d8d3ad8d747968cb6531780224101/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:56.393820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017c70-4c87-4d3a-b0f0-f1dedb322515 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:56.514607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac70b3a-bb75-40cb-a128-5e01aafbd246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:56.516078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac70b3a-bb75-40cb-a128-5e01aafbd246 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:56.516876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac70b3a-bb75-40cb-a128-5e01aafbd246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:56.517203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac70b3a-bb75-40cb-a128-5e01aafbd246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:56.517945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac70b3a-bb75-40cb-a128-5e01aafbd246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:56.520252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac70b3a-bb75-40cb-a128-5e01aafbd246 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:56.552084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2418/4863] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:22:56.553752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a47c4-842f-476c-9c2f-a635b49613cc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:56.569066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a47c4-842f-476c-9c2f-a635b49613cc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:56.578221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5a430-35cb-4edc-8fdd-3f8445ccc5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:56.579929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5a430-35cb-4edc-8fdd-3f8445ccc5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:56.580636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5a430-35cb-4edc-8fdd-3f8445ccc5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:56.581118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5a430-35cb-4edc-8fdd-3f8445ccc5c9 admin admin] PATH_INFO: `/v3/projects/838620414847488f9c2570305a417c7d/users/189d8d3ad8d747968cb6531780224101/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:56.587780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5a430-35cb-4edc-8fdd-3f8445ccc5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838620414847488f9c2570305a417c7d, user_id=189d8d3ad8d747968cb6531780224101, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:56.599696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5a430-35cb-4edc-8fdd-3f8445ccc5c9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:56.635575 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2446/4864] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:22:56 2022] PUT /identity/v3/projects/838620414847488f9c2570305a417c7d/users/189d8d3ad8d747968cb6531780224101/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:56.648702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6f5a-df89-4271-af14-c22bac2c36a3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:56.649008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6f5a-df89-4271-af14-c22bac2c36a3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:56.649287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6f5a-df89-4271-af14-c22bac2c36a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:56.718955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b42f6f5a-df89-4271-af14-c22bac2c36a3 None None] MFA Rules not processed for user `189d8d3ad8d747968cb6531780224101`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:56.721091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b42f6f5a-df89-4271-af14-c22bac2c36a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:56.909093 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:56.934207 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2419/4865] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:56.939738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5a430-35cb-4edc-8fdd-3f8445ccc5c9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:56.973862 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:57.069781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5a430-35cb-4edc-8fdd-3f8445ccc5c9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:57.082941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cfd5e-81fb-4870-95de-bf93e874ae30 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5018352154d64cedb53c4c72c03b7ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd95855f7c3744cc499c94b44b33456f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:57.084646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cfd5e-81fb-4870-95de-bf93e874ae30 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:57.084941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cfd5e-81fb-4870-95de-bf93e874ae30 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:57.085216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cfd5e-81fb-4870-95de-bf93e874ae30 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:57.087959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cfd5e-81fb-4870-95de-bf93e874ae30 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-2b8cfd5e-81fb-4870-95de-bf93e874ae30 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 02 01:22:57.093891 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 02 01:22:57.095145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 02 01:22:57.095145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 02 01:22:57.095145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 02 01:22:57.095145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 02 01:22:57.095145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:22:57.095145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 02 01:22:57.095145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 02 01:22:57.095145 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.099991 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2447/4866] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:22:56 2022] POST /identity/v3/projects => generated 136 bytes in 156 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 02 01:22:57.100614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f6f5a-df89-4271-af14-c22bac2c36a3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:57.111866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f6f5a-df89-4271-af14-c22bac2c36a3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:57.126141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d729f-6cd4-4788-9285-c508fbd7014a tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d8d3ad8d747968cb6531780224101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838620414847488f9c2570305a417c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:57.126881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d729f-6cd4-4788-9285-c508fbd7014a tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:57.127213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d729f-6cd4-4788-9285-c508fbd7014a tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:57.127812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d729f-6cd4-4788-9285-c508fbd7014a tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:57.128462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d729f-6cd4-4788-9285-c508fbd7014a tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:57.130348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d729f-6cd4-4788-9285-c508fbd7014a tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-028d729f-6cd4-4788-9285-c508fbd7014a tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Invalid input for field 'name': '' is too short Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: Failed validating 'minLength' in schema['properties']['name']: Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: On instance['name']: Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: Failed validating 'minLength' in schema['properties']['name']: Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: On instance['name']: Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: '' Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise error Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application On instance['name']: Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application '' Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:22:57.142616 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 02 01:22:57.144504 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 02 01:22:57.145969 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 02 01:22:57.145969 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 02 01:22:57.145969 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:22:57.145969 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 02 01:22:57.145969 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:22:57.145969 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:22:57.145969 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application On instance['name']: Oct 02 01:22:57.145969 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application '' Oct 02 01:22:57.145969 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:22:57.155420 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2420/4867] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:22:57 2022] POST /identity/v3/projects => generated 283 bytes in 52 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 02 01:22:57.156857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cfd5e-81fb-4870-95de-bf93e874ae30 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:57.169258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cfd5e-81fb-4870-95de-bf93e874ae30 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:57.175120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b23ad2-11d3-4a4b-b682-d0f31bfa4f04 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d8d3ad8d747968cb6531780224101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838620414847488f9c2570305a417c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:57.175941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b23ad2-11d3-4a4b-b682-d0f31bfa4f04 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:57.176269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b23ad2-11d3-4a4b-b682-d0f31bfa4f04 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:57.176485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b23ad2-11d3-4a4b-b682-d0f31bfa4f04 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:57.177131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b23ad2-11d3-4a4b-b682-d0f31bfa4f04 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:57.182584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b23ad2-11d3-4a4b-b682-d0f31bfa4f04 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-72b23ad2-11d3-4a4b-b682-d0f31bfa4f04 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: Failed validating 'maxLength' in schema['properties']['name']: Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: On instance['name']: Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: Failed validating 'maxLength' in schema['properties']['name']: Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: On instance['name']: Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise error Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 02 01:22:57.199097 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application On instance['name']: Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:22:57.205267 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application On instance['name']: Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.206674 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2448/4868] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:22:57 2022] POST /identity/v3/projects => generated 412 bytes in 48 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 02 01:22:57.207673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d729f-6cd4-4788-9285-c508fbd7014a tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:57.224251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d729f-6cd4-4788-9285-c508fbd7014a tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:57.232850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c48e-fce1-4d7f-be2b-652a2c837adc tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d8d3ad8d747968cb6531780224101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838620414847488f9c2570305a417c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:57.233778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c48e-fce1-4d7f-be2b-652a2c837adc tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:57.234137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c48e-fce1-4d7f-be2b-652a2c837adc tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:57.234481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c48e-fce1-4d7f-be2b-652a2c837adc tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] PATH_INFO: `/v3/projects/3c96a02eacf240e3aa696ebcaa64f9d6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:57.244252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26c48e-fce1-4d7f-be2b-652a2c837adc tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c96a02eacf240e3aa696ebcaa64f9d6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:57.246531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26c48e-fce1-4d7f-be2b-652a2c837adc tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-9f26c48e-fce1-4d7f-be2b-652a2c837adc tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Could not find project: 3c96a02eacf240e3aa696ebcaa64f9d6.: keystone.exception.ProjectNotFound: Could not find project: 3c96a02eacf240e3aa696ebcaa64f9d6. Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 02 01:22:57.261319 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 02 01:22:57.263379 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:22:57.263379 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:22:57.263379 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 02 01:22:57.263379 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 02 01:22:57.263379 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:22:57.263379 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:22:57.263379 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:22:57.263379 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:22:57.263379 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3c96a02eacf240e3aa696ebcaa64f9d6. Oct 02 01:22:57.263379 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:22:57.268695 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2421/4869] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:57 2022] DELETE /identity/v3/projects/3c96a02eacf240e3aa696ebcaa64f9d6 => generated 113 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:22:57.270103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b23ad2-11d3-4a4b-b682-d0f31bfa4f04 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:57.292088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b23ad2-11d3-4a4b-b682-d0f31bfa4f04 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:57.304244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c102433-9a81-410d-bcb5-5a6214e9e115 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5018352154d64cedb53c4c72c03b7ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd95855f7c3744cc499c94b44b33456f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:57.309588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102433-9a81-410d-bcb5-5a6214e9e115 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:57.309588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102433-9a81-410d-bcb5-5a6214e9e115 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:57.309588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102433-9a81-410d-bcb5-5a6214e9e115 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:57.311541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c102433-9a81-410d-bcb5-5a6214e9e115 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-1c102433-9a81-410d-bcb5-5a6214e9e115 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 02 01:22:57.327962 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._list_projects() Oct 02 01:22:57.328918 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 02 01:22:57.328918 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 02 01:22:57.328918 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 02 01:22:57.328918 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 02 01:22:57.328918 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 02 01:22:57.328918 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 02 01:22:57.328918 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:22:57.328918 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 02 01:22:57.328918 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 02 01:22:57.328918 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.333845 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2449/4870] 10.222.0.23 () {58 vars in 1131 bytes} [Sun Oct 2 01:22:57 2022] GET /identity/v3/projects => generated 135 bytes in 60 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:22:57.334433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c48e-fce1-4d7f-be2b-652a2c837adc tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:57.350202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c48e-fce1-4d7f-be2b-652a2c837adc tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:57.368194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe620944-eb18-46ce-b344-55ac791eb531 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d8d3ad8d747968cb6531780224101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838620414847488f9c2570305a417c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:57.372594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620944-eb18-46ce-b344-55ac791eb531 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:57.372906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620944-eb18-46ce-b344-55ac791eb531 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:57.373191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620944-eb18-46ce-b344-55ac791eb531 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:57.373869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe620944-eb18-46ce-b344-55ac791eb531 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:57.382454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe620944-eb18-46ce-b344-55ac791eb531 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:57.491077 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2422/4871] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:22:57 2022] POST /identity/v3/projects => generated 358 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:22:57.492116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c102433-9a81-410d-bcb5-5a6214e9e115 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:57.518450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c102433-9a81-410d-bcb5-5a6214e9e115 tempest-ProjectsNegativeStaticTestJSON-1104866050 tempest-ProjectsNegativeStaticTestJSON-1104866050-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:57.668920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c48a24-92ad-48ae-9aa6-768e35d32210 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d8d3ad8d747968cb6531780224101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838620414847488f9c2570305a417c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:57.673830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c48a24-92ad-48ae-9aa6-768e35d32210 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:57.674682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c48a24-92ad-48ae-9aa6-768e35d32210 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:57.675607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c48a24-92ad-48ae-9aa6-768e35d32210 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:57.677151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c48a24-92ad-48ae-9aa6-768e35d32210 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:57.680509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c48a24-92ad-48ae-9aa6-768e35d32210 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:57.731698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.sql.core [None req-37c48a24-92ad-48ae-9aa6-768e35d32210 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-865170030' for key 'project.ixu_project_name_domain_id'") Oct 02 01:22:57.731698 n-d-master-1 devstack@keystone.service[81853]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 02 01:22:57.731698 n-d-master-1 devstack@keystone.service[81853]: [parameters: {'id': '8a095296e27b4f51b844119815b3c744', 'name': 'tempest-project-dup-865170030', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 02 01:22:57.731698 n-d-master-1 devstack@keystone.service[81853]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81853) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-37c48a24-92ad-48ae-9aa6-768e35d32210 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-865170030, project id 8a095296e27b4f51b844119815b3c744.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-865170030, project id 8a095296e27b4f51b844119815b3c744. Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application conn.query(q) Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 01:22:57.752416 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result.read() Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-865170030' for key 'project.ixu_project_name_domain_id'") Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 02 01:22:57.753480 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application next(self.gen) Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application yield resource Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application next(self.gen) Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.session.rollback() Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.force_reraise() Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise self.value Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 02 01:22:57.754932 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application session.commit() Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._prepare_impl() Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.session.flush() Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._flush(objects) Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application compat.raise_( Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application flush_context.execute() Oct 02 01:22:57.756314 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rec.execute(self) Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 02 01:22:57.757569 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application conn.query(q) Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application result.read() Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 01:22:57.758801 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-865170030' for key 'project.ixu_project_name_domain_id'") Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [parameters: {'id': '8a095296e27b4f51b844119815b3c744', 'name': 'tempest-project-dup-865170030', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:57.760069 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-865170030 at domain ID default. Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:22:57.761217 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:22:57.763089 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:22:57.763089 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 02 01:22:57.763089 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 02 01:22:57.763089 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:22:57.763089 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:22:57.763089 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 02 01:22:57.763089 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 02 01:22:57.763089 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-865170030, project id 8a095296e27b4f51b844119815b3c744. Oct 02 01:22:57.763089 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:22:57.764590 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2450/4872] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:22:57 2022] POST /identity/v3/projects => generated 284 bytes in 272 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 02 01:22:57.768549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe620944-eb18-46ce-b344-55ac791eb531 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:57.784545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe620944-eb18-46ce-b344-55ac791eb531 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:57.796227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d8d3ad8d747968cb6531780224101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838620414847488f9c2570305a417c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:57.797454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:57.797844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:57.798391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] PATH_INFO: `/v3/projects/854bb00c01ce46b28a22806fe5bd9ec4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:57.801404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=854bb00c01ce46b28a22806fe5bd9ec4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:57.809720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:57.908805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854bb00c01ce46b28a22806fe5bd9ec4', 'request_id': 'req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:57.925190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854bb00c01ce46b28a22806fe5bd9ec4', 'request_id': 'req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:57.937510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854bb00c01ce46b28a22806fe5bd9ec4', 'request_id': 'req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:57.958456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] The token cache is being invalidate because project 854bb00c01ce46b28a22806fe5bd9ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:22:57.977918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:57.978929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5273bd50-27ad-414d-ad9c-ec5cbf84a3ce tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:57.980939 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2423/4873] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:22:57 2022] DELETE /identity/v3/projects/854bb00c01ce46b28a22806fe5bd9ec4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:57.986070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c48a24-92ad-48ae-9aa6-768e35d32210 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:57.988375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-37c48a24-92ad-48ae-9aa6-768e35d32210 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:58.127151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c48a24-92ad-48ae-9aa6-768e35d32210 tempest-ProjectsNegativeStaticTestJSON-1920977168 tempest-ProjectsNegativeStaticTestJSON-1920977168-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:58.256778 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:58.277553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:58.278136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:58.278423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:58.278854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] PATH_INFO: `/v3/users/5018352154d64cedb53c4c72c03b7ade` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:58.283463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5018352154d64cedb53c4c72c03b7ade)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:58.286410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:58.390486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5018352154d64cedb53c4c72c03b7ade'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:58.426738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5018352154d64cedb53c4c72c03b7ade'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:58.427696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5018352154d64cedb53c4c72c03b7ade'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:58.444282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5018352154d64cedb53c4c72c03b7ade'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:58.445926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5018352154d64cedb53c4c72c03b7ade'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:22:58.469267 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2451/4874] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:22:57 2022] DELETE /identity/v3/users/5018352154d64cedb53c4c72c03b7ade => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:22:58.474988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87c45a-e8cb-4033-9896-2fd706f1ff68 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:58.475532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87c45a-e8cb-4033-9896-2fd706f1ff68 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:58.475532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87c45a-e8cb-4033-9896-2fd706f1ff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:58.505273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4f87c45a-e8cb-4033-9896-2fd706f1ff68 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:22:58.507139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4f87c45a-e8cb-4033-9896-2fd706f1ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:58.635175 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2424/4875] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:22:58.703759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:22:58.705457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:22:58.876775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47ca1-3d2d-4172-ba4a-6976b12d13bc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:22:58.884978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb76fd-792b-4318-b4a0-9317ddea3007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:22:58.885613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb76fd-792b-4318-b4a0-9317ddea3007 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:22:58.885894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb76fd-792b-4318-b4a0-9317ddea3007 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:22:58.886173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb76fd-792b-4318-b4a0-9317ddea3007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:22:58.907703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb76fd-792b-4318-b4a0-9317ddea3007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:22:58.909158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb76fd-792b-4318-b4a0-9317ddea3007 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:22:58.931424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2452/4876] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:00.651609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87c45a-e8cb-4033-9896-2fd706f1ff68 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:00.654483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4f87c45a-e8cb-4033-9896-2fd706f1ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:00.699200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87c45a-e8cb-4033-9896-2fd706f1ff68 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:00.706011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:00.707197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:00.708142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:00.708640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] PATH_INFO: `/v3/projects/d95855f7c3744cc499c94b44b33456f9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:00.710389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95855f7c3744cc499c94b44b33456f9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:00.714421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:00.796259 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:00.816884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95855f7c3744cc499c94b44b33456f9', 'request_id': 'req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:00.825672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95855f7c3744cc499c94b44b33456f9', 'request_id': 'req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:00.833625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95855f7c3744cc499c94b44b33456f9', 'request_id': 'req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:00.864142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] The token cache is being invalidate because project d95855f7c3744cc499c94b44b33456f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:00.864692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:00.866246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9f37ffd-3c87-4bec-9ca4-8b3ddd060432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:00.873338 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2425/4877] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:00 2022] DELETE /identity/v3/projects/d95855f7c3744cc499c94b44b33456f9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:00.877362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb76fd-792b-4318-b4a0-9317ddea3007 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:00.891741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb76fd-792b-4318-b4a0-9317ddea3007 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:00.977105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:00.978424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:00.978945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:00.979393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] PATH_INFO: `/v3/users/189d8d3ad8d747968cb6531780224101` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:00.981719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=189d8d3ad8d747968cb6531780224101)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:00.983806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:01.003204 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:01.108961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189d8d3ad8d747968cb6531780224101'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:01.134816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189d8d3ad8d747968cb6531780224101'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:01.135571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189d8d3ad8d747968cb6531780224101'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:01.147416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189d8d3ad8d747968cb6531780224101'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:01.149770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189d8d3ad8d747968cb6531780224101'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:01.193726 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2453/4878] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:00 2022] DELETE /identity/v3/users/189d8d3ad8d747968cb6531780224101 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:02.573201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5379-4258-425e-8245-a7dca7feee77 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:02.575036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5379-4258-425e-8245-a7dca7feee77 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:02.575541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5379-4258-425e-8245-a7dca7feee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:02.650008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-680f5379-4258-425e-8245-a7dca7feee77 None None] MFA Rules not processed for user `4701f06a10ad4f89984132f8ec72b955`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:02.651560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-680f5379-4258-425e-8245-a7dca7feee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:02.680787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:02.682476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:02.794869 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2426/4879] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:02.805490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00249a-abeb-4e76-88cf-1a2829e839a8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:02.806026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00249a-abeb-4e76-88cf-1a2829e839a8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:02.806469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00249a-abeb-4e76-88cf-1a2829e839a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:02.831110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ce00249a-abeb-4e76-88cf-1a2829e839a8 None None] MFA Rules not processed for user `4701f06a10ad4f89984132f8ec72b955`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:02.833190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ce00249a-abeb-4e76-88cf-1a2829e839a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:02.855817 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2427/4880] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:23:02.867241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a8ad8-d1cb-4a4f-9f50-4d739644c28a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:02.867700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00249a-abeb-4e76-88cf-1a2829e839a8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:02.869445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ce00249a-abeb-4e76-88cf-1a2829e839a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:02.875940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:02.876854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:02.877287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:02.877760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] PATH_INFO: `/v3/projects/838620414847488f9c2570305a417c7d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:02.879084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838620414847488f9c2570305a417c7d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:02.883561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:03.046123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838620414847488f9c2570305a417c7d', 'request_id': 'req-89890212-82bf-46ad-92c2-cf6aa65ea827'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:03.070511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00249a-abeb-4e76-88cf-1a2829e839a8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:03.075349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838620414847488f9c2570305a417c7d', 'request_id': 'req-89890212-82bf-46ad-92c2-cf6aa65ea827'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:03.096151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838620414847488f9c2570305a417c7d', 'request_id': 'req-89890212-82bf-46ad-92c2-cf6aa65ea827'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:03.134843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] The token cache is being invalidate because project 838620414847488f9c2570305a417c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:03.139904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:03.141861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89890212-82bf-46ad-92c2-cf6aa65ea827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:03.145683 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2454/4881] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:02 2022] DELETE /identity/v3/projects/838620414847488f9c2570305a417c7d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:03.153714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c5ffa-5115-49ec-a64e-471da167974f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:03.154002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c5ffa-5115-49ec-a64e-471da167974f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:03.154280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c5ffa-5115-49ec-a64e-471da167974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:03.190130 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:03.198767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ac0c5ffa-5115-49ec-a64e-471da167974f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:03.202108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ac0c5ffa-5115-49ec-a64e-471da167974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:03.223626 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:03.244303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d290306-4c8f-4d35-a082-56b025fa4e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:03.244938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290306-4c8f-4d35-a082-56b025fa4e05 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:03.245220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290306-4c8f-4d35-a082-56b025fa4e05 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:03.245495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290306-4c8f-4d35-a082-56b025fa4e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:03.248454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4d290306-4c8f-4d35-a082-56b025fa4e05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:03.300767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2455/4882] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:03.302244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207f19-6245-4b75-a7e2-7204e3e89a82 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:03.302530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207f19-6245-4b75-a7e2-7204e3e89a82 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:03.302837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207f19-6245-4b75-a7e2-7204e3e89a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:03.332181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cf207f19-6245-4b75-a7e2-7204e3e89a82 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:03.333613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cf207f19-6245-4b75-a7e2-7204e3e89a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:03.367972 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2456/4883] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:03.369110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf207f19-6245-4b75-a7e2-7204e3e89a82 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:03.382929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d290306-4c8f-4d35-a082-56b025fa4e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:03.384625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d290306-4c8f-4d35-a082-56b025fa4e05 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:03.397071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf207f19-6245-4b75-a7e2-7204e3e89a82 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:03.408913 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2428/4884] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:02 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:23:03.409971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df80ba-d56a-4c92-81c4-1500ad91a31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:03.410672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df80ba-d56a-4c92-81c4-1500ad91a31c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:03.421829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df80ba-d56a-4c92-81c4-1500ad91a31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:03.422042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df80ba-d56a-4c92-81c4-1500ad91a31c admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:03.422820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df80ba-d56a-4c92-81c4-1500ad91a31c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:23:03.429300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df80ba-d56a-4c92-81c4-1500ad91a31c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:03.431551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df80ba-d56a-4c92-81c4-1500ad91a31c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:03.489735 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2457/4885] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:03.494989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d290306-4c8f-4d35-a082-56b025fa4e05 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:03.514230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d290306-4c8f-4d35-a082-56b025fa4e05 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:03.526070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a1d9f-d12f-47ae-ad48-3367672f92ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:03.526751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a1d9f-d12f-47ae-ad48-3367672f92ef admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:03.527062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a1d9f-d12f-47ae-ad48-3367672f92ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:03.527374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a1d9f-d12f-47ae-ad48-3367672f92ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:03.528479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a1d9f-d12f-47ae-ad48-3367672f92ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:03.530853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a1d9f-d12f-47ae-ad48-3367672f92ef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:03.572465 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2429/4886] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:23:03 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:03.577798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df80ba-d56a-4c92-81c4-1500ad91a31c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:03.594776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df80ba-d56a-4c92-81c4-1500ad91a31c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:03.667741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef5b88-e3fb-4252-87f3-a2fa5dd5b0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:03.670236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef5b88-e3fb-4252-87f3-a2fa5dd5b0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:03.670847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef5b88-e3fb-4252-87f3-a2fa5dd5b0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:03.670997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef5b88-e3fb-4252-87f3-a2fa5dd5b0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:03.671695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef5b88-e3fb-4252-87f3-a2fa5dd5b0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:03.673964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef5b88-e3fb-4252-87f3-a2fa5dd5b0d2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:03.703972 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2458/4887] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:03 2022] POST /identity/v3/users => generated 285 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:03.704751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a1d9f-d12f-47ae-ad48-3367672f92ef admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:03.720578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a1d9f-d12f-47ae-ad48-3367672f92ef admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:03.735852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ef293-9c80-4693-8029-59f9ff3a8178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:03.738377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef293-9c80-4693-8029-59f9ff3a8178 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:03.738699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef293-9c80-4693-8029-59f9ff3a8178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:03.739295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef293-9c80-4693-8029-59f9ff3a8178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:03.740113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ef293-9c80-4693-8029-59f9ff3a8178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:03.741894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ef293-9c80-4693-8029-59f9ff3a8178 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:03.754453 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2430/4888] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:03.759815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef5b88-e3fb-4252-87f3-a2fa5dd5b0d2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:03.774720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef5b88-e3fb-4252-87f3-a2fa5dd5b0d2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:03.784104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b552cc5-1ec5-45f8-adb2-d168433b0057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:03.785418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b552cc5-1ec5-45f8-adb2-d168433b0057 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:03.785968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b552cc5-1ec5-45f8-adb2-d168433b0057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:03.786428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b552cc5-1ec5-45f8-adb2-d168433b0057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:03.787363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b552cc5-1ec5-45f8-adb2-d168433b0057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:03.790391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b552cc5-1ec5-45f8-adb2-d168433b0057 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:03.811727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ef293-9c80-4693-8029-59f9ff3a8178 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:03.814525 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2459/4889] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:03.825679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ef293-9c80-4693-8029-59f9ff3a8178 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:03.836168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c6fb1-4ecc-4ad3-8366-b2bc5861eb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:03.837419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c6fb1-4ecc-4ad3-8366-b2bc5861eb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:03.838033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c6fb1-4ecc-4ad3-8366-b2bc5861eb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:03.839296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c6fb1-4ecc-4ad3-8366-b2bc5861eb14 admin admin] PATH_INFO: `/v3/projects/9c74eade786d4c3dbb9498b9919ee8e0/users/aa0d2ce52c864a35913f556b37baec95/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:03.889244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c6fb1-4ecc-4ad3-8366-b2bc5861eb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c74eade786d4c3dbb9498b9919ee8e0, user_id=aa0d2ce52c864a35913f556b37baec95, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:03.892127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c6fb1-4ecc-4ad3-8366-b2bc5861eb14 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:03.912690 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2431/4890] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:03 2022] PUT /identity/v3/projects/9c74eade786d4c3dbb9498b9919ee8e0/users/aa0d2ce52c864a35913f556b37baec95/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:03.932441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4003c0-2194-4c05-ad1b-437e158567b7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:03.932729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4003c0-2194-4c05-ad1b-437e158567b7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:03.933135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4003c0-2194-4c05-ad1b-437e158567b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:04.004106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-be4003c0-2194-4c05-ad1b-437e158567b7 None None] MFA Rules not processed for user `aa0d2ce52c864a35913f556b37baec95`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:04.010321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-be4003c0-2194-4c05-ad1b-437e158567b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:04.134936 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2460/4891] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:04.137380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c6fb1-4ecc-4ad3-8366-b2bc5861eb14 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:04.236707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c6fb1-4ecc-4ad3-8366-b2bc5861eb14 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:04.244319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099b878-82a3-44ed-8cc5-a109c93a5ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:04.246240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099b878-82a3-44ed-8cc5-a109c93a5ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:04.247415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099b878-82a3-44ed-8cc5-a109c93a5ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:04.247549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099b878-82a3-44ed-8cc5-a109c93a5ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:04.248619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099b878-82a3-44ed-8cc5-a109c93a5ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:04.251347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099b878-82a3-44ed-8cc5-a109c93a5ae0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:04.307632 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2432/4892] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:23:04 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:04.328187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4003c0-2194-4c05-ad1b-437e158567b7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:04.342548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4003c0-2194-4c05-ad1b-437e158567b7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:04.351645 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:04.471803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f5fbb-b6b4-4e7b-9b85-9c6b15afc234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:04.472687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5fbb-b6b4-4e7b-9b85-9c6b15afc234 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:04.473124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5fbb-b6b4-4e7b-9b85-9c6b15afc234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:04.473592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5fbb-b6b4-4e7b-9b85-9c6b15afc234 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:04.475067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f5fbb-b6b4-4e7b-9b85-9c6b15afc234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:04.478779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f5fbb-b6b4-4e7b-9b85-9c6b15afc234 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:04.547353 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2461/4893] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:04 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:04.564052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099b878-82a3-44ed-8cc5-a109c93a5ae0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:04.596903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099b878-82a3-44ed-8cc5-a109c93a5ae0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:04.610419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdedd56-9fc8-426e-92f4-abeee920a287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:04.611678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdedd56-9fc8-426e-92f4-abeee920a287 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:04.616777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdedd56-9fc8-426e-92f4-abeee920a287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:04.618096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdedd56-9fc8-426e-92f4-abeee920a287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:04.629848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdedd56-9fc8-426e-92f4-abeee920a287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:04.631614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdedd56-9fc8-426e-92f4-abeee920a287 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:04.634720 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:04.651777 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2433/4894] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:04.654288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f5fbb-b6b4-4e7b-9b85-9c6b15afc234 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:04.671496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f5fbb-b6b4-4e7b-9b85-9c6b15afc234 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:04.684534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10c7ad-18e1-4ad2-bb59-dba855cdd279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:04.686052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10c7ad-18e1-4ad2-bb59-dba855cdd279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:04.686463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10c7ad-18e1-4ad2-bb59-dba855cdd279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:04.686872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10c7ad-18e1-4ad2-bb59-dba855cdd279 admin admin] PATH_INFO: `/v3/projects/ff4eec12dcbe42a486dfc8915596033a/users/965aaaedebd9413d9717c3dba4552f9c/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:04.725377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10c7ad-18e1-4ad2-bb59-dba855cdd279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4eec12dcbe42a486dfc8915596033a, user_id=965aaaedebd9413d9717c3dba4552f9c, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:04.732276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10c7ad-18e1-4ad2-bb59-dba855cdd279 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:04.775197 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2462/4895] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:04 2022] PUT /identity/v3/projects/ff4eec12dcbe42a486dfc8915596033a/users/965aaaedebd9413d9717c3dba4552f9c/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:04.778948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdedd56-9fc8-426e-92f4-abeee920a287 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:04.797793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdedd56-9fc8-426e-92f4-abeee920a287 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:04.980018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565296b-abea-47b0-9cc2-35644c092280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:04.981167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565296b-abea-47b0-9cc2-35644c092280 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:04.981450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565296b-abea-47b0-9cc2-35644c092280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:04.981724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565296b-abea-47b0-9cc2-35644c092280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:04.982383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565296b-abea-47b0-9cc2-35644c092280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:04.984064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565296b-abea-47b0-9cc2-35644c092280 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:04.998171 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2434/4896] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:04.999440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10c7ad-18e1-4ad2-bb59-dba855cdd279 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:05.013365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10c7ad-18e1-4ad2-bb59-dba855cdd279 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:05.019340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ace0b8-2a23-4a42-a7d8-ca6d8a055c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:05.020292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ace0b8-2a23-4a42-a7d8-ca6d8a055c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:05.020718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ace0b8-2a23-4a42-a7d8-ca6d8a055c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:05.021238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ace0b8-2a23-4a42-a7d8-ca6d8a055c6f admin admin] PATH_INFO: `/v3/projects/ff4eec12dcbe42a486dfc8915596033a/users/965aaaedebd9413d9717c3dba4552f9c/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:05.023578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ace0b8-2a23-4a42-a7d8-ca6d8a055c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4eec12dcbe42a486dfc8915596033a, user_id=965aaaedebd9413d9717c3dba4552f9c, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:05.027042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ace0b8-2a23-4a42-a7d8-ca6d8a055c6f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:05.043121 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2463/4897] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:04 2022] PUT /identity/v3/projects/ff4eec12dcbe42a486dfc8915596033a/users/965aaaedebd9413d9717c3dba4552f9c/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:05.053725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192109d-a912-4ee9-ae9a-594fc684d456 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:05.053725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192109d-a912-4ee9-ae9a-594fc684d456 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:05.054098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192109d-a912-4ee9-ae9a-594fc684d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:05.108795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3192109d-a912-4ee9-ae9a-594fc684d456 None None] MFA Rules not processed for user `965aaaedebd9413d9717c3dba4552f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:05.114286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3192109d-a912-4ee9-ae9a-594fc684d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:05.275194 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2435/4898] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:05.276376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ace0b8-2a23-4a42-a7d8-ca6d8a055c6f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:05.296171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ace0b8-2a23-4a42-a7d8-ca6d8a055c6f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:05.305943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e3d57-bab0-4054-8ffa-fc43152156bd tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:05.307062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3d57-bab0-4054-8ffa-fc43152156bd tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:05.307719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3d57-bab0-4054-8ffa-fc43152156bd tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:05.310836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3d57-bab0-4054-8ffa-fc43152156bd tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:05.312427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e3d57-bab0-4054-8ffa-fc43152156bd tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:05.315848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e3d57-bab0-4054-8ffa-fc43152156bd tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:05.381818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192109d-a912-4ee9-ae9a-594fc684d456 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:05.382097 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2464/4899] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:23:05 2022] POST /identity/v3/projects => generated 328 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:05.393707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192109d-a912-4ee9-ae9a-594fc684d456 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:05.603867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a392fa5-e8d3-4d2f-bcfc-6aab58988e8d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:05.604668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a392fa5-e8d3-4d2f-bcfc-6aab58988e8d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:05.604914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a392fa5-e8d3-4d2f-bcfc-6aab58988e8d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:05.605292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a392fa5-e8d3-4d2f-bcfc-6aab58988e8d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:05.605892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a392fa5-e8d3-4d2f-bcfc-6aab58988e8d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:05.615937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a392fa5-e8d3-4d2f-bcfc-6aab58988e8d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:05.670466 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2436/4900] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:05 2022] POST /identity/v3/users => generated 413 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:05.675068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e3d57-bab0-4054-8ffa-fc43152156bd tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:05.691803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e3d57-bab0-4054-8ffa-fc43152156bd tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:05.699969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162f53e-7af0-4e41-b7bc-2bbd5ab43e22 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:05.701572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162f53e-7af0-4e41-b7bc-2bbd5ab43e22 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:05.701948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162f53e-7af0-4e41-b7bc-2bbd5ab43e22 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:05.702374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162f53e-7af0-4e41-b7bc-2bbd5ab43e22 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:05.703256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162f53e-7af0-4e41-b7bc-2bbd5ab43e22 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:05.705510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162f53e-7af0-4e41-b7bc-2bbd5ab43e22 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:05.733070 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2465/4901] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:05 2022] POST /identity/v3/roles => generated 244 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:05.736700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a392fa5-e8d3-4d2f-bcfc-6aab58988e8d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:05.750009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a392fa5-e8d3-4d2f-bcfc-6aab58988e8d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:05.760693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a661a3f-41f0-4cb4-b5b6-3dc3e935f1c7 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:05.762962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a661a3f-41f0-4cb4-b5b6-3dc3e935f1c7 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:05.763532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a661a3f-41f0-4cb4-b5b6-3dc3e935f1c7 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:05.764045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a661a3f-41f0-4cb4-b5b6-3dc3e935f1c7 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:05.776774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a661a3f-41f0-4cb4-b5b6-3dc3e935f1c7 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:05.779388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a661a3f-41f0-4cb4-b5b6-3dc3e935f1c7 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:05.789887 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:05.820050 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2437/4902] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:05 2022] POST /identity/v3/roles => generated 246 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:05.820882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162f53e-7af0-4e41-b7bc-2bbd5ab43e22 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:05.834243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162f53e-7af0-4e41-b7bc-2bbd5ab43e22 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:05.841246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909379f5-5e68-4504-8aef-d7fc9cffde76 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:05.842237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909379f5-5e68-4504-8aef-d7fc9cffde76 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:05.842740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909379f5-5e68-4504-8aef-d7fc9cffde76 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:05.843340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909379f5-5e68-4504-8aef-d7fc9cffde76 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/e81141886ea04443bb9562a354069b66/users/2d35a73a697e4b82b0e21fb9c3cdc2b0/roles/005f9475a5c2451981ef9977fdc49dff` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:05.865800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909379f5-5e68-4504-8aef-d7fc9cffde76 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e81141886ea04443bb9562a354069b66, user_id=2d35a73a697e4b82b0e21fb9c3cdc2b0, role_id=005f9475a5c2451981ef9977fdc49dff)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:05.868997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909379f5-5e68-4504-8aef-d7fc9cffde76 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:05.894244 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2466/4903] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:05 2022] PUT /identity/v3/projects/e81141886ea04443bb9562a354069b66/users/2d35a73a697e4b82b0e21fb9c3cdc2b0/roles/005f9475a5c2451981ef9977fdc49dff => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:05.895658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a661a3f-41f0-4cb4-b5b6-3dc3e935f1c7 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:05.915904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a661a3f-41f0-4cb4-b5b6-3dc3e935f1c7 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:06.117423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8cad2-3dec-41d4-b50b-73fc4becaf7c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:06.118453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8cad2-3dec-41d4-b50b-73fc4becaf7c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:06.118938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8cad2-3dec-41d4-b50b-73fc4becaf7c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:06.119493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8cad2-3dec-41d4-b50b-73fc4becaf7c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/e81141886ea04443bb9562a354069b66/users/2d35a73a697e4b82b0e21fb9c3cdc2b0/roles/612912d4272e4828a18e24e195248199` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:06.127715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8cad2-3dec-41d4-b50b-73fc4becaf7c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e81141886ea04443bb9562a354069b66, user_id=2d35a73a697e4b82b0e21fb9c3cdc2b0, role_id=612912d4272e4828a18e24e195248199)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:06.133384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8cad2-3dec-41d4-b50b-73fc4becaf7c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:06.187208 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2438/4904] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:05 2022] PUT /identity/v3/projects/e81141886ea04443bb9562a354069b66/users/2d35a73a697e4b82b0e21fb9c3cdc2b0/roles/612912d4272e4828a18e24e195248199 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:06.191535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909379f5-5e68-4504-8aef-d7fc9cffde76 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:06.249277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909379f5-5e68-4504-8aef-d7fc9cffde76 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:06.428273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46b66f-e6f7-4072-bf47-0c9eb2ace47b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:06.429256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b66f-e6f7-4072-bf47-0c9eb2ace47b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:06.429911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b66f-e6f7-4072-bf47-0c9eb2ace47b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:06.430427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b66f-e6f7-4072-bf47-0c9eb2ace47b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:06.431325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46b66f-e6f7-4072-bf47-0c9eb2ace47b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:06.434319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46b66f-e6f7-4072-bf47-0c9eb2ace47b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:06.436743 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:06.518209 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2467/4905] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:06 2022] GET /identity/v3/users => generated 8054 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:06.520302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae028-e90a-4b01-81f7-9a2d7502cde0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:06.520592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae028-e90a-4b01-81f7-9a2d7502cde0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:06.520872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae028-e90a-4b01-81f7-9a2d7502cde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:06.573287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-14aae028-e90a-4b01-81f7-9a2d7502cde0 None None] MFA Rules not processed for user `2d35a73a697e4b82b0e21fb9c3cdc2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:06.575142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-14aae028-e90a-4b01-81f7-9a2d7502cde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:06.763001 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2439/4906] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:06.773045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28c8d-dc32-42ad-8839-75c3ea4c92ce None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:06.774467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28c8d-dc32-42ad-8839-75c3ea4c92ce None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:06.774982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28c8d-dc32-42ad-8839-75c3ea4c92ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:06.818225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-adf28c8d-dc32-42ad-8839-75c3ea4c92ce None None] MFA Rules not processed for user `2d35a73a697e4b82b0e21fb9c3cdc2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:06.819604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-adf28c8d-dc32-42ad-8839-75c3ea4c92ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:06.828197 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2468/4907] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:06.832215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aae028-e90a-4b01-81f7-9a2d7502cde0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:06.844279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aae028-e90a-4b01-81f7-9a2d7502cde0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:06.851829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8648e-7135-493f-8e03-5a386583028c tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d35a73a697e4b82b0e21fb9c3cdc2b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81141886ea04443bb9562a354069b66', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1056843867', 'tempest-NotDelegatedRole-868240819'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:06.852855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8648e-7135-493f-8e03-5a386583028c tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:06.854690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8648e-7135-493f-8e03-5a386583028c tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:06.857042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8648e-7135-493f-8e03-5a386583028c tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:06.858156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8648e-7135-493f-8e03-5a386583028c tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] RBAC: Authorizing `identity:create_trust()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:06.860730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8648e-7135-493f-8e03-5a386583028c tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:07.078894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf28c8d-dc32-42ad-8839-75c3ea4c92ce None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:07.079910 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2440/4908] 10.222.0.23 () {60 vars in 1174 bytes} [Sun Oct 2 01:23:06 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:07.099855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf28c8d-dc32-42ad-8839-75c3ea4c92ce None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:07.112849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad57e49-c4e2-4db3-a6d8-897db46c6566 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:07.113494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad57e49-c4e2-4db3-a6d8-897db46c6566 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:07.113778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad57e49-c4e2-4db3-a6d8-897db46c6566 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:07.114058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad57e49-c4e2-4db3-a6d8-897db46c6566 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:07.114736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad57e49-c4e2-4db3-a6d8-897db46c6566 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:07.115818 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-bad57e49-c4e2-4db3-a6d8-897db46c6566 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:23:07.115818 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:23:07.115818 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:23:07.124903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad57e49-c4e2-4db3-a6d8-897db46c6566 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:07.154773 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2469/4909] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 2 01:23:07 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:23:07.156354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8648e-7135-493f-8e03-5a386583028c tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:07.165293 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:07.179445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8648e-7135-493f-8e03-5a386583028c tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:07.192870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d35a73a697e4b82b0e21fb9c3cdc2b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81141886ea04443bb9562a354069b66', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1056843867', 'tempest-NotDelegatedRole-868240819'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:07.193942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:07.194930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:07.195319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] PATH_INFO: `/v3/OS-TRUST/trusts/8ea82a57e8b444b0b1c0b5fae31a2b0c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:07.222083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] RBAC: Authorizing `identity:delete_trust(trust_id=8ea82a57e8b444b0b1c0b5fae31a2b0c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:07.224330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:07.265666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8ea82a57e8b444b0b1c0b5fae31a2b0c', 'request_id': 'req-e41136c1-a9a9-4284-aad9-68f42238e0ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:07.266429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8ea82a57e8b444b0b1c0b5fae31a2b0c', 'request_id': 'req-e41136c1-a9a9-4284-aad9-68f42238e0ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:07.287658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8ea82a57e8b444b0b1c0b5fae31a2b0c', 'request_id': 'req-e41136c1-a9a9-4284-aad9-68f42238e0ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:07.307569 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2441/4910] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 2 01:23:07 2022] DELETE /identity/v3/OS-TRUST/trusts/8ea82a57e8b444b0b1c0b5fae31a2b0c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:07.323395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad57e49-c4e2-4db3-a6d8-897db46c6566 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:07.325678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bad57e49-c4e2-4db3-a6d8-897db46c6566 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:07.414025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad57e49-c4e2-4db3-a6d8-897db46c6566 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:07.424642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f238b38-92c3-4c91-99c6-620e2a31d0a1 tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d35a73a697e4b82b0e21fb9c3cdc2b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81141886ea04443bb9562a354069b66', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1056843867', 'tempest-NotDelegatedRole-868240819'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:07.425788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f238b38-92c3-4c91-99c6-620e2a31d0a1 tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:07.425788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f238b38-92c3-4c91-99c6-620e2a31d0a1 tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:07.425960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f238b38-92c3-4c91-99c6-620e2a31d0a1 tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] PATH_INFO: `/v3/OS-TRUST/trusts/8ea82a57e8b444b0b1c0b5fae31a2b0c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-9f238b38-92c3-4c91-99c6-620e2a31d0a1 tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Could not find trust: 8ea82a57e8b444b0b1c0b5fae31a2b0c.: keystone.exception.TrustNotFound: Could not find trust: 8ea82a57e8b444b0b1c0b5fae31a2b0c. Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 02 01:23:07.472131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8ea82a57e8b444b0b1c0b5fae31a2b0c. Oct 02 01:23:07.473198 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:23:07.474066 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2470/4911] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:23:07 2022] GET /identity/v3/OS-TRUST/trusts/8ea82a57e8b444b0b1c0b5fae31a2b0c => generated 111 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:23:07.477965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:07.481938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:07.551291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41136c1-a9a9-4284-aad9-68f42238e0ee tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:07.569506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc720309-0164-4629-aa4b-73681c8b84ec tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:07.572960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720309-0164-4629-aa4b-73681c8b84ec tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:07.575168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720309-0164-4629-aa4b-73681c8b84ec tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:07.576732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720309-0164-4629-aa4b-73681c8b84ec tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/612912d4272e4828a18e24e195248199` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:07.581248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc720309-0164-4629-aa4b-73681c8b84ec tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=612912d4272e4828a18e24e195248199)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:07.586032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc720309-0164-4629-aa4b-73681c8b84ec tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:07.700942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cc720309-0164-4629-aa4b-73681c8b84ec tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role 612912d4272e4828a18e24e195248199 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:07.701966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cc720309-0164-4629-aa4b-73681c8b84ec tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:07.703596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cc720309-0164-4629-aa4b-73681c8b84ec tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:07.706228 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2442/4912] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:07 2022] DELETE /identity/v3/roles/612912d4272e4828a18e24e195248199 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:07.710714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f238b38-92c3-4c91-99c6-620e2a31d0a1 tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:07.713234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9f238b38-92c3-4c91-99c6-620e2a31d0a1 tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:07.736814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f238b38-92c3-4c91-99c6-620e2a31d0a1 tempest-TrustsV3TestJSON-326078036 tempest-user-937018881] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:07.844701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:07.846193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:07.846703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:07.847165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/005f9475a5c2451981ef9977fdc49dff` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:07.848810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=005f9475a5c2451981ef9977fdc49dff)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:07.852204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:07.946853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role 005f9475a5c2451981ef9977fdc49dff has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:07.947203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:07.949564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:07.954375 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2471/4913] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:07 2022] DELETE /identity/v3/roles/005f9475a5c2451981ef9977fdc49dff => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:07.957767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc720309-0164-4629-aa4b-73681c8b84ec tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:07.973131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc720309-0164-4629-aa4b-73681c8b84ec tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:08.140731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:08.141564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:08.141851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:08.142465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users/2d35a73a697e4b82b0e21fb9c3cdc2b0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:08.144655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2d35a73a697e4b82b0e21fb9c3cdc2b0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:08.146630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:08.272536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d35a73a697e4b82b0e21fb9c3cdc2b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:08.303529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d35a73a697e4b82b0e21fb9c3cdc2b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:08.304431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d35a73a697e4b82b0e21fb9c3cdc2b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:08.325498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d35a73a697e4b82b0e21fb9c3cdc2b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:08.342271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d35a73a697e4b82b0e21fb9c3cdc2b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:08.347800 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:08.368642 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2443/4914] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:07 2022] DELETE /identity/v3/users/2d35a73a697e4b82b0e21fb9c3cdc2b0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:08.373691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:08.375514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:08.410671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe632d-dd27-409f-b847-58b29bb78451 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:08.565516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:08.566171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:08.566451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:08.566751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/e81141886ea04443bb9562a354069b66` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:08.571226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e81141886ea04443bb9562a354069b66)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:08.573178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:08.682776 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:08.718435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81141886ea04443bb9562a354069b66', 'request_id': 'req-2f1f35d9-8e0e-4958-9759-321e890cad70'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:08.727350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81141886ea04443bb9562a354069b66', 'request_id': 'req-2f1f35d9-8e0e-4958-9759-321e890cad70'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:08.743333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81141886ea04443bb9562a354069b66', 'request_id': 'req-2f1f35d9-8e0e-4958-9759-321e890cad70'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:08.769855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] The token cache is being invalidate because project e81141886ea04443bb9562a354069b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:08.770171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:08.771919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:08.774545 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2472/4915] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:08 2022] DELETE /identity/v3/projects/e81141886ea04443bb9562a354069b66 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:08.781222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:08.783056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:08.800961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808b6b3-f543-43a3-9fbc-29118b52d83e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:08.889996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e099-abb3-4bf7-9b0f-69acba138315 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:08.890662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e099-abb3-4bf7-9b0f-69acba138315 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:08.890953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e099-abb3-4bf7-9b0f-69acba138315 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:08.891233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e099-abb3-4bf7-9b0f-69acba138315 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:08.891888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50e099-abb3-4bf7-9b0f-69acba138315 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:08.894159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50e099-abb3-4bf7-9b0f-69acba138315 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:08.936543 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2444/4916] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:23:08 2022] POST /identity/v3/projects => generated 329 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:23:08.940664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:08.943315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:08.965981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f35d9-8e0e-4958-9759-321e890cad70 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:09.044519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f60a70-b5d2-4f2f-bd85-efce3f56a0a4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:09.045159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f60a70-b5d2-4f2f-bd85-efce3f56a0a4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:09.045444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f60a70-b5d2-4f2f-bd85-efce3f56a0a4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:09.045720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f60a70-b5d2-4f2f-bd85-efce3f56a0a4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:09.046545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f60a70-b5d2-4f2f-bd85-efce3f56a0a4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:09.049040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f60a70-b5d2-4f2f-bd85-efce3f56a0a4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:09.075978 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2473/4917] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:08 2022] POST /identity/v3/users => generated 410 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:09.077999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e099-abb3-4bf7-9b0f-69acba138315 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:09.115098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e099-abb3-4bf7-9b0f-69acba138315 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:09.144058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fbc16-bab3-4dab-923e-e6fe869786be tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:09.144818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fbc16-bab3-4dab-923e-e6fe869786be tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:09.145105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fbc16-bab3-4dab-923e-e6fe869786be tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:09.145404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fbc16-bab3-4dab-923e-e6fe869786be tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:09.146152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fbc16-bab3-4dab-923e-e6fe869786be tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:09.147835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fbc16-bab3-4dab-923e-e6fe869786be tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:09.166711 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2445/4918] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:09 2022] POST /identity/v3/roles => generated 243 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:09.169915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f60a70-b5d2-4f2f-bd85-efce3f56a0a4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:09.181664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f60a70-b5d2-4f2f-bd85-efce3f56a0a4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:09.188524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872945d-b0b2-4d73-92d4-fa093cde3c8f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:09.189152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872945d-b0b2-4d73-92d4-fa093cde3c8f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:09.189454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872945d-b0b2-4d73-92d4-fa093cde3c8f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:09.189736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872945d-b0b2-4d73-92d4-fa093cde3c8f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:09.190622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872945d-b0b2-4d73-92d4-fa093cde3c8f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:09.192583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872945d-b0b2-4d73-92d4-fa093cde3c8f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:09.217604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fbc16-bab3-4dab-923e-e6fe869786be tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:09.227110 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2474/4919] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:09 2022] POST /identity/v3/roles => generated 247 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:23:09.234933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fbc16-bab3-4dab-923e-e6fe869786be tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:09.240879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324cab3-9882-44e1-bf45-c3dd643ef8c6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:09.241897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324cab3-9882-44e1-bf45-c3dd643ef8c6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:09.241897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324cab3-9882-44e1-bf45-c3dd643ef8c6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:09.242105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324cab3-9882-44e1-bf45-c3dd643ef8c6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/b485c671e73e4e54b73c2002905369b3/users/201e54e32fc5439f8df6ba0ea957cc59/roles/77da6b2981094f27843d4be8c9a0f01d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:09.264442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324cab3-9882-44e1-bf45-c3dd643ef8c6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b485c671e73e4e54b73c2002905369b3, user_id=201e54e32fc5439f8df6ba0ea957cc59, role_id=77da6b2981094f27843d4be8c9a0f01d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:09.267984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324cab3-9882-44e1-bf45-c3dd643ef8c6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:09.289059 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2446/4920] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:09 2022] PUT /identity/v3/projects/b485c671e73e4e54b73c2002905369b3/users/201e54e32fc5439f8df6ba0ea957cc59/roles/77da6b2981094f27843d4be8c9a0f01d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:09.290734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872945d-b0b2-4d73-92d4-fa093cde3c8f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:09.308881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872945d-b0b2-4d73-92d4-fa093cde3c8f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:09.387799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275868a-f977-47b8-a6d3-9b6685fd7ee5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:09.388838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275868a-f977-47b8-a6d3-9b6685fd7ee5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:09.389280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275868a-f977-47b8-a6d3-9b6685fd7ee5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:09.389709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275868a-f977-47b8-a6d3-9b6685fd7ee5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/b485c671e73e4e54b73c2002905369b3/users/201e54e32fc5439f8df6ba0ea957cc59/roles/54023e4e084142b7adddc271c0f46c5f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:09.394112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275868a-f977-47b8-a6d3-9b6685fd7ee5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b485c671e73e4e54b73c2002905369b3, user_id=201e54e32fc5439f8df6ba0ea957cc59, role_id=54023e4e084142b7adddc271c0f46c5f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:09.397160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275868a-f977-47b8-a6d3-9b6685fd7ee5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:09.429556 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2475/4921] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:09 2022] PUT /identity/v3/projects/b485c671e73e4e54b73c2002905369b3/users/201e54e32fc5439f8df6ba0ea957cc59/roles/54023e4e084142b7adddc271c0f46c5f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:09.433650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324cab3-9882-44e1-bf45-c3dd643ef8c6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:09.451824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324cab3-9882-44e1-bf45-c3dd643ef8c6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:09.556473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16270e8b-73bf-4968-b2fd-2c5e47fdedac tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:09.557522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16270e8b-73bf-4968-b2fd-2c5e47fdedac tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:09.558081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16270e8b-73bf-4968-b2fd-2c5e47fdedac tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:09.558732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16270e8b-73bf-4968-b2fd-2c5e47fdedac tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:09.560204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16270e8b-73bf-4968-b2fd-2c5e47fdedac tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:09.561423 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-16270e8b-73bf-4968-b2fd-2c5e47fdedac tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:23:09.561423 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:23:09.561423 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:23:09.563806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16270e8b-73bf-4968-b2fd-2c5e47fdedac tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:09.638918 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2447/4922] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:09 2022] GET /identity/v3/users => generated 8051 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:09.639725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b57e6-f310-4539-9a5f-8c2b982d0a8d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:09.640098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b57e6-f310-4539-9a5f-8c2b982d0a8d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:09.640407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b57e6-f310-4539-9a5f-8c2b982d0a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:09.714853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a00b57e6-f310-4539-9a5f-8c2b982d0a8d None None] MFA Rules not processed for user `201e54e32fc5439f8df6ba0ea957cc59`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:09.716199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a00b57e6-f310-4539-9a5f-8c2b982d0a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:09.740734 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=4,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:09.862051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989419a-d22e-4904-a000-17603ce2dcc4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:09.862345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989419a-d22e-4904-a000-17603ce2dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:09.862664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989419a-d22e-4904-a000-17603ce2dcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:09.872271 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2476/4923] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:09.897733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4989419a-d22e-4904-a000-17603ce2dcc4 None None] MFA Rules not processed for user `201e54e32fc5439f8df6ba0ea957cc59`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:09.899471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4989419a-d22e-4904-a000-17603ce2dcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:09.920369 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2448/4924] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:09.924921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b57e6-f310-4539-9a5f-8c2b982d0a8d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:09.941400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b57e6-f310-4539-9a5f-8c2b982d0a8d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:09.947321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0865f6-72fd-4cfb-856c-7b1bd9c65cc4 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201e54e32fc5439f8df6ba0ea957cc59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b485c671e73e4e54b73c2002905369b3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-663894887', 'tempest-NotDelegatedRole-1265625450'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:09.948061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0865f6-72fd-4cfb-856c-7b1bd9c65cc4 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:09.948356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0865f6-72fd-4cfb-856c-7b1bd9c65cc4 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:09.948680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0865f6-72fd-4cfb-856c-7b1bd9c65cc4 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:09.949379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0865f6-72fd-4cfb-856c-7b1bd9c65cc4 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] RBAC: Authorizing `identity:create_trust()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:09.950794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0865f6-72fd-4cfb-856c-7b1bd9c65cc4 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:10.354250 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2477/4925] 10.222.0.23 () {60 vars in 1174 bytes} [Sun Oct 2 01:23:09 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:10.356702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989419a-d22e-4904-a000-17603ce2dcc4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:10.371509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989419a-d22e-4904-a000-17603ce2dcc4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:10.377741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92519a90-caf6-4142-86ba-0cff4abce690 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201e54e32fc5439f8df6ba0ea957cc59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b485c671e73e4e54b73c2002905369b3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-663894887', 'tempest-NotDelegatedRole-1265625450'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:10.379364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92519a90-caf6-4142-86ba-0cff4abce690 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:10.379364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92519a90-caf6-4142-86ba-0cff4abce690 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:10.379364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92519a90-caf6-4142-86ba-0cff4abce690 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:10.380196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92519a90-caf6-4142-86ba-0cff4abce690 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:10.381676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92519a90-caf6-4142-86ba-0cff4abce690 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:10.389985 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2449/4926] 10.222.0.23 () {58 vars in 1252 bytes} [Sun Oct 2 01:23:10 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=201e54e32fc5439f8df6ba0ea957cc59 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:10.397011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0865f6-72fd-4cfb-856c-7b1bd9c65cc4 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:10.410576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0865f6-72fd-4cfb-856c-7b1bd9c65cc4 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:10.421919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201e54e32fc5439f8df6ba0ea957cc59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b485c671e73e4e54b73c2002905369b3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-663894887', 'tempest-NotDelegatedRole-1265625450'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:10.422790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:10.423078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:10.423354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] PATH_INFO: `/v3/OS-TRUST/trusts/6ea18e0772134d4298fba45ec06c9075` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:10.435660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] RBAC: Authorizing `identity:delete_trust(trust_id=6ea18e0772134d4298fba45ec06c9075)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:10.437827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:10.466786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6ea18e0772134d4298fba45ec06c9075', 'request_id': 'req-adc16455-74e1-4cc8-bb75-240ce33d18d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.468006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6ea18e0772134d4298fba45ec06c9075', 'request_id': 'req-adc16455-74e1-4cc8-bb75-240ce33d18d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.481989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6ea18e0772134d4298fba45ec06c9075', 'request_id': 'req-adc16455-74e1-4cc8-bb75-240ce33d18d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.492773 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2478/4927] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 2 01:23:10 2022] DELETE /identity/v3/OS-TRUST/trusts/6ea18e0772134d4298fba45ec06c9075 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:10.498192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92519a90-caf6-4142-86ba-0cff4abce690 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:10.500267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-92519a90-caf6-4142-86ba-0cff4abce690 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:10.515777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92519a90-caf6-4142-86ba-0cff4abce690 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:10.523427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8becc-8535-43d0-b8d5-10ba1589568a tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201e54e32fc5439f8df6ba0ea957cc59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b485c671e73e4e54b73c2002905369b3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-663894887', 'tempest-NotDelegatedRole-1265625450'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:10.524438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8becc-8535-43d0-b8d5-10ba1589568a tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:10.524930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8becc-8535-43d0-b8d5-10ba1589568a tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:10.525442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8becc-8535-43d0-b8d5-10ba1589568a tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] PATH_INFO: `/v3/OS-TRUST/trusts/6ea18e0772134d4298fba45ec06c9075` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b7a8becc-8535-43d0-b8d5-10ba1589568a tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Could not find trust: 6ea18e0772134d4298fba45ec06c9075.: keystone.exception.TrustNotFound: Could not find trust: 6ea18e0772134d4298fba45ec06c9075. Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 02 01:23:10.536972 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6ea18e0772134d4298fba45ec06c9075. Oct 02 01:23:10.538355 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:10.539243 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2450/4928] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:23:10 2022] GET /identity/v3/OS-TRUST/trusts/6ea18e0772134d4298fba45ec06c9075 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:23:10.543575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:10.544500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:10.562689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc16455-74e1-4cc8-bb75-240ce33d18d6 tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:10.567863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a0a03-8f62-4dba-92d2-c4713dbd0819 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:10.568598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a0a03-8f62-4dba-92d2-c4713dbd0819 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:10.568807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a0a03-8f62-4dba-92d2-c4713dbd0819 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:10.569068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a0a03-8f62-4dba-92d2-c4713dbd0819 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/54023e4e084142b7adddc271c0f46c5f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:10.570523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a0a03-8f62-4dba-92d2-c4713dbd0819 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=54023e4e084142b7adddc271c0f46c5f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:10.572504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a0a03-8f62-4dba-92d2-c4713dbd0819 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:10.627774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b26a0a03-8f62-4dba-92d2-c4713dbd0819 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role 54023e4e084142b7adddc271c0f46c5f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:10.628438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b26a0a03-8f62-4dba-92d2-c4713dbd0819 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.629189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b26a0a03-8f62-4dba-92d2-c4713dbd0819 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.631707 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2479/4929] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:10 2022] DELETE /identity/v3/roles/54023e4e084142b7adddc271c0f46c5f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:10.635643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8becc-8535-43d0-b8d5-10ba1589568a tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:10.638724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b7a8becc-8535-43d0-b8d5-10ba1589568a tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:10.656821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8becc-8535-43d0-b8d5-10ba1589568a tempest-TrustsV3TestJSON-1035330962 tempest-user-38357494] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:10.676586 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:10.740043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:10.740848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:10.741132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:10.741409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/77da6b2981094f27843d4be8c9a0f01d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:10.742877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=77da6b2981094f27843d4be8c9a0f01d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:10.745349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:10.791464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role 77da6b2981094f27843d4be8c9a0f01d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:10.791764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.793054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.795027 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2451/4930] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:10 2022] DELETE /identity/v3/roles/77da6b2981094f27843d4be8c9a0f01d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:10.799091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a0a03-8f62-4dba-92d2-c4713dbd0819 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:10.810943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a0a03-8f62-4dba-92d2-c4713dbd0819 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:10.842458 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:10.879158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:10.879810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:10.880083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:10.880352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users/201e54e32fc5439f8df6ba0ea957cc59` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:10.881610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_user(user_id=201e54e32fc5439f8df6ba0ea957cc59)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:10.883723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:10.933630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201e54e32fc5439f8df6ba0ea957cc59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.947257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201e54e32fc5439f8df6ba0ea957cc59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.949280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201e54e32fc5439f8df6ba0ea957cc59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.957020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201e54e32fc5439f8df6ba0ea957cc59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.957805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201e54e32fc5439f8df6ba0ea957cc59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:10.979560 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2480/4931] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:10 2022] DELETE /identity/v3/users/201e54e32fc5439f8df6ba0ea957cc59 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:10.984122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:10.985591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:11.002264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ed356-d23b-4a6d-848d-c4dd6327f3df tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:11.065387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:11.066032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:11.066362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:11.066675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/b485c671e73e4e54b73c2002905369b3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:11.067860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b485c671e73e4e54b73c2002905369b3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:11.069833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:11.161685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b485c671e73e4e54b73c2002905369b3', 'request_id': 'req-6ca7954a-cf7e-4366-bf28-27dadfa57a23'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:11.177357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b485c671e73e4e54b73c2002905369b3', 'request_id': 'req-6ca7954a-cf7e-4366-bf28-27dadfa57a23'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:11.191674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b485c671e73e4e54b73c2002905369b3', 'request_id': 'req-6ca7954a-cf7e-4366-bf28-27dadfa57a23'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:11.205876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] The token cache is being invalidate because project b485c671e73e4e54b73c2002905369b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:11.206352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:11.207052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:11.208600 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2452/4932] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:10 2022] DELETE /identity/v3/projects/b485c671e73e4e54b73c2002905369b3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:11.215955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:11.217519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:11.232305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca353de-d009-4eb4-92fb-1b9c935bb29e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:11.302562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b27c6a-7ce6-45a5-a2ca-e463fffb9486 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:11.303211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b27c6a-7ce6-45a5-a2ca-e463fffb9486 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:11.303636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b27c6a-7ce6-45a5-a2ca-e463fffb9486 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:11.303933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b27c6a-7ce6-45a5-a2ca-e463fffb9486 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:11.305569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b27c6a-7ce6-45a5-a2ca-e463fffb9486 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:11.306495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b27c6a-7ce6-45a5-a2ca-e463fffb9486 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:11.350593 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2481/4933] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:23:11 2022] POST /identity/v3/projects => generated 329 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:11.354636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:11.356896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:11.376250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7954a-cf7e-4366-bf28-27dadfa57a23 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:11.387865 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:11.450040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f300d-bd5b-436e-bce4-174c9f67205e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:11.450568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f300d-bd5b-436e-bce4-174c9f67205e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:11.450997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f300d-bd5b-436e-bce4-174c9f67205e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:11.451361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f300d-bd5b-436e-bce4-174c9f67205e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:11.452018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f300d-bd5b-436e-bce4-174c9f67205e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:11.454014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f300d-bd5b-436e-bce4-174c9f67205e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:11.478253 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2453/4934] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:11 2022] POST /identity/v3/users => generated 413 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:11.482623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b27c6a-7ce6-45a5-a2ca-e463fffb9486 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:11.498872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b27c6a-7ce6-45a5-a2ca-e463fffb9486 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:11.504132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901d658-5ddc-4738-b6b8-94520cc6450a tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:11.504756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901d658-5ddc-4738-b6b8-94520cc6450a tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:11.505042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901d658-5ddc-4738-b6b8-94520cc6450a tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:11.505321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901d658-5ddc-4738-b6b8-94520cc6450a tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:11.505993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901d658-5ddc-4738-b6b8-94520cc6450a tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:11.507879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901d658-5ddc-4738-b6b8-94520cc6450a tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:11.534853 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2482/4935] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:11 2022] POST /identity/v3/roles => generated 243 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:11.537584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f300d-bd5b-436e-bce4-174c9f67205e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:11.553906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f300d-bd5b-436e-bce4-174c9f67205e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:11.561089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07efb0c-e4a0-47d2-847e-6f45c413986d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:11.561714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efb0c-e4a0-47d2-847e-6f45c413986d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:11.562003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efb0c-e4a0-47d2-847e-6f45c413986d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:11.562279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efb0c-e4a0-47d2-847e-6f45c413986d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:11.562997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07efb0c-e4a0-47d2-847e-6f45c413986d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:11.565053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07efb0c-e4a0-47d2-847e-6f45c413986d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:11.590726 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2454/4936] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:11 2022] POST /identity/v3/roles => generated 247 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:11.597378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901d658-5ddc-4738-b6b8-94520cc6450a tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:11.609612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901d658-5ddc-4738-b6b8-94520cc6450a tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:11.616220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d1b2b-9ba5-4b0e-8553-a6a333c9e61c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:11.617090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1b2b-9ba5-4b0e-8553-a6a333c9e61c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:11.617593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1b2b-9ba5-4b0e-8553-a6a333c9e61c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:11.617924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1b2b-9ba5-4b0e-8553-a6a333c9e61c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/1ebd45c1dc2344798f8227d8dd4040bf/users/dce7669077f64732b05c469977d5097d/roles/b05a372b43e54355b5469534366682e9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:11.637953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d1b2b-9ba5-4b0e-8553-a6a333c9e61c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1ebd45c1dc2344798f8227d8dd4040bf, user_id=dce7669077f64732b05c469977d5097d, role_id=b05a372b43e54355b5469534366682e9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:11.640971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d1b2b-9ba5-4b0e-8553-a6a333c9e61c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:11.643498 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:11.658215 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2483/4937] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:11 2022] PUT /identity/v3/projects/1ebd45c1dc2344798f8227d8dd4040bf/users/dce7669077f64732b05c469977d5097d/roles/b05a372b43e54355b5469534366682e9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:11.662348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07efb0c-e4a0-47d2-847e-6f45c413986d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:11.674824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07efb0c-e4a0-47d2-847e-6f45c413986d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:11.771726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a10d27-0feb-46be-bc1e-f5858f2b24f6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:11.772818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a10d27-0feb-46be-bc1e-f5858f2b24f6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:11.773167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a10d27-0feb-46be-bc1e-f5858f2b24f6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:11.773563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a10d27-0feb-46be-bc1e-f5858f2b24f6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/1ebd45c1dc2344798f8227d8dd4040bf/users/dce7669077f64732b05c469977d5097d/roles/633881261adb4c3ab8f7cd5e08433bbc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:11.776056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a10d27-0feb-46be-bc1e-f5858f2b24f6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1ebd45c1dc2344798f8227d8dd4040bf, user_id=dce7669077f64732b05c469977d5097d, role_id=633881261adb4c3ab8f7cd5e08433bbc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:11.783246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a10d27-0feb-46be-bc1e-f5858f2b24f6 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:11.798842 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2455/4938] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:11 2022] PUT /identity/v3/projects/1ebd45c1dc2344798f8227d8dd4040bf/users/dce7669077f64732b05c469977d5097d/roles/633881261adb4c3ab8f7cd5e08433bbc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:11.802996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d1b2b-9ba5-4b0e-8553-a6a333c9e61c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:11.814646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d1b2b-9ba5-4b0e-8553-a6a333c9e61c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:11.881373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49583887-18fa-411b-a8da-dc61c48d7c13 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:11.881992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49583887-18fa-411b-a8da-dc61c48d7c13 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:11.882425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49583887-18fa-411b-a8da-dc61c48d7c13 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:11.882759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49583887-18fa-411b-a8da-dc61c48d7c13 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:11.883428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49583887-18fa-411b-a8da-dc61c48d7c13 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:11.886375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49583887-18fa-411b-a8da-dc61c48d7c13 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:11.937440 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2484/4939] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:11 2022] GET /identity/v3/users => generated 8054 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:11.938035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ac6e-776f-4350-b711-0a7f7d8b1f8a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:11.938329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ac6e-776f-4350-b711-0a7f7d8b1f8a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:11.938632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ac6e-776f-4350-b711-0a7f7d8b1f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.015824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cf56ac6e-776f-4350-b711-0a7f7d8b1f8a None None] MFA Rules not processed for user `dce7669077f64732b05c469977d5097d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:12.017070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf56ac6e-776f-4350-b711-0a7f7d8b1f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:12.176259 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2456/4940] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:11 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:12.176666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1683025-7999-4a9a-a494-6b4d831f5678 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:12.177123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1683025-7999-4a9a-a494-6b4d831f5678 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:12.177206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1683025-7999-4a9a-a494-6b4d831f5678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.218541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b1683025-7999-4a9a-a494-6b4d831f5678 None None] MFA Rules not processed for user `dce7669077f64732b05c469977d5097d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:12.221704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b1683025-7999-4a9a-a494-6b4d831f5678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:12.236953 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2485/4941] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:12.241222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ac6e-776f-4350-b711-0a7f7d8b1f8a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:12.252163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ac6e-776f-4350-b711-0a7f7d8b1f8a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:12.257454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988324-1ffc-4829-a9e8-e7b6d1f6a9c6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce7669077f64732b05c469977d5097d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ebd45c1dc2344798f8227d8dd4040bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335945900', 'tempest-DelegatedRole-754314092'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:12.257885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988324-1ffc-4829-a9e8-e7b6d1f6a9c6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:12.258352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988324-1ffc-4829-a9e8-e7b6d1f6a9c6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:12.258663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988324-1ffc-4829-a9e8-e7b6d1f6a9c6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.259708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988324-1ffc-4829-a9e8-e7b6d1f6a9c6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorizing `identity:create_trust()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:12.261362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988324-1ffc-4829-a9e8-e7b6d1f6a9c6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:12.265724 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:12.365118 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2457/4942] 10.222.0.23 () {60 vars in 1174 bytes} [Sun Oct 2 01:23:12 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:12.365753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1683025-7999-4a9a-a494-6b4d831f5678 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:12.374615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1683025-7999-4a9a-a494-6b4d831f5678 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:12.380561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc68a7e-90b0-46aa-949e-62785359d4cb tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce7669077f64732b05c469977d5097d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ebd45c1dc2344798f8227d8dd4040bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335945900', 'tempest-DelegatedRole-754314092'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:12.381221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68a7e-90b0-46aa-949e-62785359d4cb tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:12.381501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68a7e-90b0-46aa-949e-62785359d4cb tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:12.381774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68a7e-90b0-46aa-949e-62785359d4cb tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] PATH_INFO: `/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.389375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc68a7e-90b0-46aa-949e-62785359d4cb tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorizing `identity:get_trust(trust_id=77b2500b7472465db9ad1d6dc6488b80)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:12.390866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc68a7e-90b0-46aa-949e-62785359d4cb tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:12.402290 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2486/4943] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:23:12 2022] GET /identity/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80 => generated 858 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:12.408389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988324-1ffc-4829-a9e8-e7b6d1f6a9c6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:12.419984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988324-1ffc-4829-a9e8-e7b6d1f6a9c6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:12.424385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ac2a2-0884-4a3f-980c-1fa5bc7d9aa6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce7669077f64732b05c469977d5097d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ebd45c1dc2344798f8227d8dd4040bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335945900', 'tempest-DelegatedRole-754314092'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:12.425041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ac2a2-0884-4a3f-980c-1fa5bc7d9aa6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:12.425763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ac2a2-0884-4a3f-980c-1fa5bc7d9aa6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:12.425763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ac2a2-0884-4a3f-980c-1fa5bc7d9aa6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] PATH_INFO: `/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.433686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ac2a2-0884-4a3f-980c-1fa5bc7d9aa6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=77b2500b7472465db9ad1d6dc6488b80)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:12.435796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ac2a2-0884-4a3f-980c-1fa5bc7d9aa6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:12.447206 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2458/4944] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:23:12 2022] GET /identity/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80/roles => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:12.448155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc68a7e-90b0-46aa-949e-62785359d4cb tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:12.463754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc68a7e-90b0-46aa-949e-62785359d4cb tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:12.468686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d2c5-d5db-4495-a4df-6503f5ad532d tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce7669077f64732b05c469977d5097d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ebd45c1dc2344798f8227d8dd4040bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335945900', 'tempest-DelegatedRole-754314092'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:12.469476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d2c5-d5db-4495-a4df-6503f5ad532d tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:12.469912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d2c5-d5db-4495-a4df-6503f5ad532d tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:12.470397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d2c5-d5db-4495-a4df-6503f5ad532d tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] PATH_INFO: `/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80/roles/b05a372b43e54355b5469534366682e9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.479390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7d2c5-d5db-4495-a4df-6503f5ad532d tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorizing `identity:get_role_for_trust(trust_id=77b2500b7472465db9ad1d6dc6488b80, role_id=b05a372b43e54355b5469534366682e9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:12.481522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7d2c5-d5db-4495-a4df-6503f5ad532d tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:12.495578 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2487/4945] 10.222.0.23 () {58 vars in 1368 bytes} [Sun Oct 2 01:23:12 2022] GET /identity/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80/roles/b05a372b43e54355b5469534366682e9 => generated 243 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:12.500005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ac2a2-0884-4a3f-980c-1fa5bc7d9aa6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:12.511667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ac2a2-0884-4a3f-980c-1fa5bc7d9aa6 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:12.522350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a08712-d463-4173-a794-340d7fe02335 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce7669077f64732b05c469977d5097d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ebd45c1dc2344798f8227d8dd4040bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335945900', 'tempest-DelegatedRole-754314092'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:12.523151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a08712-d463-4173-a794-340d7fe02335 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:12.523440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a08712-d463-4173-a794-340d7fe02335 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:12.523720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a08712-d463-4173-a794-340d7fe02335 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] PATH_INFO: `/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80/roles/b05a372b43e54355b5469534366682e9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.531455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a08712-d463-4173-a794-340d7fe02335 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorizing `identity:get_role_for_trust(trust_id=77b2500b7472465db9ad1d6dc6488b80, role_id=b05a372b43e54355b5469534366682e9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:12.533020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a08712-d463-4173-a794-340d7fe02335 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:12.543091 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2459/4946] 10.222.0.23 () {58 vars in 1369 bytes} [Sun Oct 2 01:23:12 2022] HEAD /identity/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80/roles/b05a372b43e54355b5469534366682e9 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 02 01:23:12.545891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d2c5-d5db-4495-a4df-6503f5ad532d tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:12.556033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d2c5-d5db-4495-a4df-6503f5ad532d tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:12.561988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72aec7-d149-431e-8c8f-2305a58b8926 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce7669077f64732b05c469977d5097d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ebd45c1dc2344798f8227d8dd4040bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335945900', 'tempest-DelegatedRole-754314092'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:12.562701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72aec7-d149-431e-8c8f-2305a58b8926 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:12.562987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72aec7-d149-431e-8c8f-2305a58b8926 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:12.563265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72aec7-d149-431e-8c8f-2305a58b8926 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] PATH_INFO: `/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80/roles/633881261adb4c3ab8f7cd5e08433bbc` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.570016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72aec7-d149-431e-8c8f-2305a58b8926 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorizing `identity:get_role_for_trust(trust_id=77b2500b7472465db9ad1d6dc6488b80, role_id=633881261adb4c3ab8f7cd5e08433bbc)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:12.571866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72aec7-d149-431e-8c8f-2305a58b8926 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-dd72aec7-d149-431e-8c8f-2305a58b8926 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Could not find role: 633881261adb4c3ab8f7cd5e08433bbc.: keystone.exception.RoleNotFound: Could not find role: 633881261adb4c3ab8f7cd5e08433bbc. Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 01:23:12.585847 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 633881261adb4c3ab8f7cd5e08433bbc. Oct 02 01:23:12.587109 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:23:12.587109 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2488/4947] 10.222.0.23 () {58 vars in 1368 bytes} [Sun Oct 2 01:23:12 2022] GET /identity/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80/roles/633881261adb4c3ab8f7cd5e08433bbc => generated 110 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:23:12.592850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a08712-d463-4173-a794-340d7fe02335 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:12.606346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a08712-d463-4173-a794-340d7fe02335 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:12.617066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eac282-6354-42c9-8ee2-6963ac7c90f1 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce7669077f64732b05c469977d5097d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ebd45c1dc2344798f8227d8dd4040bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335945900', 'tempest-DelegatedRole-754314092'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:12.619014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eac282-6354-42c9-8ee2-6963ac7c90f1 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:12.619554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eac282-6354-42c9-8ee2-6963ac7c90f1 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:12.620056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eac282-6354-42c9-8ee2-6963ac7c90f1 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] PATH_INFO: `/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80/roles/633881261adb4c3ab8f7cd5e08433bbc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.640073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eac282-6354-42c9-8ee2-6963ac7c90f1 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorizing `identity:get_role_for_trust(trust_id=77b2500b7472465db9ad1d6dc6488b80, role_id=633881261adb4c3ab8f7cd5e08433bbc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:12.642542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eac282-6354-42c9-8ee2-6963ac7c90f1 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-57eac282-6354-42c9-8ee2-6963ac7c90f1 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Could not find role: 633881261adb4c3ab8f7cd5e08433bbc.: keystone.exception.RoleNotFound: Could not find role: 633881261adb4c3ab8f7cd5e08433bbc. Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 01:23:12.657864 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 633881261adb4c3ab8f7cd5e08433bbc. Oct 02 01:23:12.659191 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:12.662497 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2460/4948] 10.222.0.23 () {58 vars in 1369 bytes} [Sun Oct 2 01:23:12 2022] HEAD /identity/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80/roles/633881261adb4c3ab8f7cd5e08433bbc => generated 0 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 02 01:23:12.666408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72aec7-d149-431e-8c8f-2305a58b8926 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:12.676997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72aec7-d149-431e-8c8f-2305a58b8926 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:12.681729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce7669077f64732b05c469977d5097d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ebd45c1dc2344798f8227d8dd4040bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335945900', 'tempest-DelegatedRole-754314092'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:12.682554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:12.682554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:12.683667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] PATH_INFO: `/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.695763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorizing `identity:delete_trust(trust_id=77b2500b7472465db9ad1d6dc6488b80)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:12.697968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:12.723451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '77b2500b7472465db9ad1d6dc6488b80', 'request_id': 'req-6ae8d3d2-450f-4e60-bd64-403969d17737'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:12.724140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '77b2500b7472465db9ad1d6dc6488b80', 'request_id': 'req-6ae8d3d2-450f-4e60-bd64-403969d17737'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:12.747767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '77b2500b7472465db9ad1d6dc6488b80', 'request_id': 'req-6ae8d3d2-450f-4e60-bd64-403969d17737'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:12.767287 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2489/4949] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 2 01:23:12 2022] DELETE /identity/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:12.784222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eac282-6354-42c9-8ee2-6963ac7c90f1 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:12.786254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-57eac282-6354-42c9-8ee2-6963ac7c90f1 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:12.820823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eac282-6354-42c9-8ee2-6963ac7c90f1 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:12.836831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3159fa-f599-4074-881e-6e28a3845c36 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce7669077f64732b05c469977d5097d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ebd45c1dc2344798f8227d8dd4040bf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335945900', 'tempest-DelegatedRole-754314092'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:12.837771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3159fa-f599-4074-881e-6e28a3845c36 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:12.838197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3159fa-f599-4074-881e-6e28a3845c36 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:12.838656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3159fa-f599-4074-881e-6e28a3845c36 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] PATH_INFO: `/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0f3159fa-f599-4074-881e-6e28a3845c36 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Could not find trust: 77b2500b7472465db9ad1d6dc6488b80.: keystone.exception.TrustNotFound: Could not find trust: 77b2500b7472465db9ad1d6dc6488b80. Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 02 01:23:12.860555 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 77b2500b7472465db9ad1d6dc6488b80. Oct 02 01:23:12.861817 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:12.867264 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2461/4950] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:23:12 2022] GET /identity/v3/OS-TRUST/trusts/77b2500b7472465db9ad1d6dc6488b80 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:23:12.871683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:12.873221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:12.908712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8d3d2-450f-4e60-bd64-403969d17737 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:12.924305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f78f1b-545e-468c-9ffe-d4dda9647794 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:12.925417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f78f1b-545e-468c-9ffe-d4dda9647794 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:12.925944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f78f1b-545e-468c-9ffe-d4dda9647794 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:12.926277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f78f1b-545e-468c-9ffe-d4dda9647794 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/633881261adb4c3ab8f7cd5e08433bbc` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:12.930299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f78f1b-545e-468c-9ffe-d4dda9647794 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=633881261adb4c3ab8f7cd5e08433bbc)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:12.932041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f78f1b-545e-468c-9ffe-d4dda9647794 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:13.013789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-09f78f1b-545e-468c-9ffe-d4dda9647794 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role 633881261adb4c3ab8f7cd5e08433bbc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:13.014226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-09f78f1b-545e-468c-9ffe-d4dda9647794 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.015825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-09f78f1b-545e-468c-9ffe-d4dda9647794 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.018386 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2490/4951] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:12 2022] DELETE /identity/v3/roles/633881261adb4c3ab8f7cd5e08433bbc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:13.022317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3159fa-f599-4074-881e-6e28a3845c36 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:13.024368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0f3159fa-f599-4074-881e-6e28a3845c36 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:13.041270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3159fa-f599-4074-881e-6e28a3845c36 tempest-TrustsV3TestJSON-1756284105 tempest-user-544938830] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:13.140946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:13.142193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:13.142762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:13.143366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/b05a372b43e54355b5469534366682e9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:13.145160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b05a372b43e54355b5469534366682e9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:13.147160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:13.222849 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:13.235998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role b05a372b43e54355b5469534366682e9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:13.236716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.237997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.244177 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2462/4952] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:13 2022] DELETE /identity/v3/roles/b05a372b43e54355b5469534366682e9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:13.246946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f78f1b-545e-468c-9ffe-d4dda9647794 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:13.265772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f78f1b-545e-468c-9ffe-d4dda9647794 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:13.279151 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:13.365627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:13.367867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:13.368487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:13.370784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users/dce7669077f64732b05c469977d5097d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:13.372926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dce7669077f64732b05c469977d5097d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:13.377042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:13.471423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce7669077f64732b05c469977d5097d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.489010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce7669077f64732b05c469977d5097d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.489735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce7669077f64732b05c469977d5097d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.502110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce7669077f64732b05c469977d5097d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.503370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce7669077f64732b05c469977d5097d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.519240 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2491/4953] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:13 2022] DELETE /identity/v3/users/dce7669077f64732b05c469977d5097d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:13.523540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:13.524662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:13.553294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024ab53-386a-4613-8879-7f96e91e38d8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:13.652320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:13.653175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:13.658929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:13.659527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/1ebd45c1dc2344798f8227d8dd4040bf` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:13.661177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1ebd45c1dc2344798f8227d8dd4040bf)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:13.664703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:13.758378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ebd45c1dc2344798f8227d8dd4040bf', 'request_id': 'req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.789661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ebd45c1dc2344798f8227d8dd4040bf', 'request_id': 'req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.813032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ebd45c1dc2344798f8227d8dd4040bf', 'request_id': 'req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.849419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] The token cache is being invalidate because project 1ebd45c1dc2344798f8227d8dd4040bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:13.851538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.855554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:13.857900 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2463/4954] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:13 2022] DELETE /identity/v3/projects/1ebd45c1dc2344798f8227d8dd4040bf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:13.867505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:13.867684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:13.910882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857db059-7679-44ef-a1d8-ab9b4cd291ba tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:14.081360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b59a41-752a-45fe-9fbe-94b0a9d1e549 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:14.082674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b59a41-752a-45fe-9fbe-94b0a9d1e549 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:14.083116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b59a41-752a-45fe-9fbe-94b0a9d1e549 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:14.083488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b59a41-752a-45fe-9fbe-94b0a9d1e549 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:14.084845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b59a41-752a-45fe-9fbe-94b0a9d1e549 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:14.092721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b59a41-752a-45fe-9fbe-94b0a9d1e549 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:14.154031 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2492/4955] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:23:13 2022] POST /identity/v3/projects => generated 329 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:14.155231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:14.157898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:14.179463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3586e3-17d2-4934-a4e8-0dd7b3acad34 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:14.249674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c803938-c610-4274-a085-45f28bcf1135 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:14.250294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803938-c610-4274-a085-45f28bcf1135 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:14.250577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803938-c610-4274-a085-45f28bcf1135 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:14.262661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803938-c610-4274-a085-45f28bcf1135 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:14.263478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c803938-c610-4274-a085-45f28bcf1135 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:14.265675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c803938-c610-4274-a085-45f28bcf1135 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:14.302369 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2464/4956] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:14 2022] POST /identity/v3/users => generated 416 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:14.306068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b59a41-752a-45fe-9fbe-94b0a9d1e549 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:14.326382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b59a41-752a-45fe-9fbe-94b0a9d1e549 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:14.332964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53f277-704e-411a-8cae-bfed9a4aa637 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:14.335214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53f277-704e-411a-8cae-bfed9a4aa637 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:14.335510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53f277-704e-411a-8cae-bfed9a4aa637 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:14.335833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53f277-704e-411a-8cae-bfed9a4aa637 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:14.336802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53f277-704e-411a-8cae-bfed9a4aa637 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:14.339936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53f277-704e-411a-8cae-bfed9a4aa637 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:14.358656 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:14.374358 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2493/4957] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:14 2022] POST /identity/v3/roles => generated 244 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:14.380865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c803938-c610-4274-a085-45f28bcf1135 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:14.403931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c803938-c610-4274-a085-45f28bcf1135 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:14.411057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3da08d-228f-4ffa-826c-b426085265b4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:14.411432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da08d-228f-4ffa-826c-b426085265b4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:14.411817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da08d-228f-4ffa-826c-b426085265b4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:14.412446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da08d-228f-4ffa-826c-b426085265b4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:14.413228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3da08d-228f-4ffa-826c-b426085265b4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:14.415519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3da08d-228f-4ffa-826c-b426085265b4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:14.453814 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2465/4958] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:14 2022] POST /identity/v3/roles => generated 247 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:14.457413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53f277-704e-411a-8cae-bfed9a4aa637 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:14.468370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53f277-704e-411a-8cae-bfed9a4aa637 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:14.484873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ce0c-a7aa-49ec-a8da-6dbba162dfc5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:14.485569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ce0c-a7aa-49ec-a8da-6dbba162dfc5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:14.485845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ce0c-a7aa-49ec-a8da-6dbba162dfc5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:14.486127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ce0c-a7aa-49ec-a8da-6dbba162dfc5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/df1e2ea7cb6442c0a623a77cfc0d5396/users/246271468b8549cdaeb53155b8e083c6/roles/348dad27299e4c0fbbd52418c9aa93ff` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:14.512253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558ce0c-a7aa-49ec-a8da-6dbba162dfc5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df1e2ea7cb6442c0a623a77cfc0d5396, user_id=246271468b8549cdaeb53155b8e083c6, role_id=348dad27299e4c0fbbd52418c9aa93ff)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:14.514976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558ce0c-a7aa-49ec-a8da-6dbba162dfc5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:14.539035 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2494/4959] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:14 2022] PUT /identity/v3/projects/df1e2ea7cb6442c0a623a77cfc0d5396/users/246271468b8549cdaeb53155b8e083c6/roles/348dad27299e4c0fbbd52418c9aa93ff => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:14.540790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3da08d-228f-4ffa-826c-b426085265b4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:14.558179 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:14.566099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3da08d-228f-4ffa-826c-b426085265b4 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:14.673813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d65723-266b-4f3b-9c68-168c88e7f6b2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:14.674815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d65723-266b-4f3b-9c68-168c88e7f6b2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:14.675252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d65723-266b-4f3b-9c68-168c88e7f6b2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:14.676354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d65723-266b-4f3b-9c68-168c88e7f6b2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/df1e2ea7cb6442c0a623a77cfc0d5396/users/246271468b8549cdaeb53155b8e083c6/roles/3a99b7f20bd2495f8ad3605e46ed0ca2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:14.678774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d65723-266b-4f3b-9c68-168c88e7f6b2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df1e2ea7cb6442c0a623a77cfc0d5396, user_id=246271468b8549cdaeb53155b8e083c6, role_id=3a99b7f20bd2495f8ad3605e46ed0ca2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:14.681471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d65723-266b-4f3b-9c68-168c88e7f6b2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:14.707619 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2466/4960] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:14 2022] PUT /identity/v3/projects/df1e2ea7cb6442c0a623a77cfc0d5396/users/246271468b8549cdaeb53155b8e083c6/roles/3a99b7f20bd2495f8ad3605e46ed0ca2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:14.712066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ce0c-a7aa-49ec-a8da-6dbba162dfc5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:14.730841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ce0c-a7aa-49ec-a8da-6dbba162dfc5 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:14.850466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfbd56-1d49-42b8-866e-078a466683f1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:14.851423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfbd56-1d49-42b8-866e-078a466683f1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:14.851708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfbd56-1d49-42b8-866e-078a466683f1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:14.851989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfbd56-1d49-42b8-866e-078a466683f1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:14.852807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfbd56-1d49-42b8-866e-078a466683f1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:14.855370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfbd56-1d49-42b8-866e-078a466683f1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:14.892678 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2495/4961] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:14 2022] GET /identity/v3/users => generated 8057 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:14.897303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4377-7133-4964-a8ad-3ba151404006 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:14.897926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4377-7133-4964-a8ad-3ba151404006 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:14.898211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4377-7133-4964-a8ad-3ba151404006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:14.952448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1c8d4377-7133-4964-a8ad-3ba151404006 None None] MFA Rules not processed for user `246271468b8549cdaeb53155b8e083c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:14.953598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1c8d4377-7133-4964-a8ad-3ba151404006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:15.058150 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2467/4962] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:15.067974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7a39f-705a-4e82-b934-0754cb329e02 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:15.068258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7a39f-705a-4e82-b934-0754cb329e02 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:15.068531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7a39f-705a-4e82-b934-0754cb329e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:15.089902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6dd7a39f-705a-4e82-b934-0754cb329e02 None None] MFA Rules not processed for user `246271468b8549cdaeb53155b8e083c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:15.091132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6dd7a39f-705a-4e82-b934-0754cb329e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:15.099271 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2496/4963] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:15.103604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d4377-7133-4964-a8ad-3ba151404006 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:15.115162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d4377-7133-4964-a8ad-3ba151404006 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:15.119462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea465772-ca94-4bea-bb0f-13f75b7f99bc tempest-TrustsV3TestJSON-1041976228 tempest-user-1707607932] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '246271468b8549cdaeb53155b8e083c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1e2ea7cb6442c0a623a77cfc0d5396', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1014172107', 'tempest-NotDelegatedRole-1655752758'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:15.120144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea465772-ca94-4bea-bb0f-13f75b7f99bc tempest-TrustsV3TestJSON-1041976228 tempest-user-1707607932] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:15.120961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea465772-ca94-4bea-bb0f-13f75b7f99bc tempest-TrustsV3TestJSON-1041976228 tempest-user-1707607932] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:15.120961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea465772-ca94-4bea-bb0f-13f75b7f99bc tempest-TrustsV3TestJSON-1041976228 tempest-user-1707607932] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:15.121782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea465772-ca94-4bea-bb0f-13f75b7f99bc tempest-TrustsV3TestJSON-1041976228 tempest-user-1707607932] RBAC: Authorizing `identity:create_trust()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:15.122990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea465772-ca94-4bea-bb0f-13f75b7f99bc tempest-TrustsV3TestJSON-1041976228 tempest-user-1707607932] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ea465772-ca94-4bea-bb0f-13f75b7f99bc tempest-TrustsV3TestJSON-1041976228 tempest-user-1707607932] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 02 01:23:15.241604 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 02 01:23:15.242823 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 02 01:23:15.247742 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 02 01:23:15.247742 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 02 01:23:15.247742 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 02 01:23:15.247742 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 02 01:23:15.247742 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 02 01:23:15.247742 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:15.247742 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2468/4964] 10.222.0.23 () {60 vars in 1174 bytes} [Sun Oct 2 01:23:15 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 140 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 02 01:23:15.248260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7a39f-705a-4e82-b934-0754cb329e02 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:15.260120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7a39f-705a-4e82-b934-0754cb329e02 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:15.265416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcfcfc-2d49-4c30-9dab-61feb0b83103 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:15.266046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcfcfc-2d49-4c30-9dab-61feb0b83103 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:15.266383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcfcfc-2d49-4c30-9dab-61feb0b83103 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:15.266694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcfcfc-2d49-4c30-9dab-61feb0b83103 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/3a99b7f20bd2495f8ad3605e46ed0ca2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:15.268422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcfcfc-2d49-4c30-9dab-61feb0b83103 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3a99b7f20bd2495f8ad3605e46ed0ca2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:15.270019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcfcfc-2d49-4c30-9dab-61feb0b83103 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:15.315622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0abcfcfc-2d49-4c30-9dab-61feb0b83103 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role 3a99b7f20bd2495f8ad3605e46ed0ca2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:15.316254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0abcfcfc-2d49-4c30-9dab-61feb0b83103 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:15.316634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0abcfcfc-2d49-4c30-9dab-61feb0b83103 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:15.321619 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2497/4965] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:15 2022] DELETE /identity/v3/roles/3a99b7f20bd2495f8ad3605e46ed0ca2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:15.323642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea465772-ca94-4bea-bb0f-13f75b7f99bc tempest-TrustsV3TestJSON-1041976228 tempest-user-1707607932] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:15.325824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea465772-ca94-4bea-bb0f-13f75b7f99bc tempest-TrustsV3TestJSON-1041976228 tempest-user-1707607932] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:15.349487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea465772-ca94-4bea-bb0f-13f75b7f99bc tempest-TrustsV3TestJSON-1041976228 tempest-user-1707607932] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:15.376905 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:15.454373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:15.455088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:15.455489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:15.455688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/348dad27299e4c0fbbd52418c9aa93ff` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:15.457298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=348dad27299e4c0fbbd52418c9aa93ff)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:15.459240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:15.533368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role 348dad27299e4c0fbbd52418c9aa93ff has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:15.534335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:15.535821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:15.537799 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2469/4966] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:15 2022] DELETE /identity/v3/roles/348dad27299e4c0fbbd52418c9aa93ff => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:15.541708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcfcfc-2d49-4c30-9dab-61feb0b83103 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:15.559001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcfcfc-2d49-4c30-9dab-61feb0b83103 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:15.748922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:15.750483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:15.750980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:15.752266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users/246271468b8549cdaeb53155b8e083c6` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:15.756183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_user(user_id=246271468b8549cdaeb53155b8e083c6)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:15.758909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:15.832313 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:15.863867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246271468b8549cdaeb53155b8e083c6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:15.916566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246271468b8549cdaeb53155b8e083c6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:15.918612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246271468b8549cdaeb53155b8e083c6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:15.949712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246271468b8549cdaeb53155b8e083c6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:15.954689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246271468b8549cdaeb53155b8e083c6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:16.001994 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2498/4967] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:15 2022] DELETE /identity/v3/users/246271468b8549cdaeb53155b8e083c6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:16.006956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:16.009008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:16.030239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65207cd2-05b6-4634-a52c-4a937e71339c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:16.212214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:16.213345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:16.214179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:16.217560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/df1e2ea7cb6442c0a623a77cfc0d5396` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:16.220915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df1e2ea7cb6442c0a623a77cfc0d5396)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:16.225019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:16.339906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1e2ea7cb6442c0a623a77cfc0d5396', 'request_id': 'req-ee79618e-6b6e-4743-a383-4fde2a566623'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:16.347434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1e2ea7cb6442c0a623a77cfc0d5396', 'request_id': 'req-ee79618e-6b6e-4743-a383-4fde2a566623'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:16.359881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1e2ea7cb6442c0a623a77cfc0d5396', 'request_id': 'req-ee79618e-6b6e-4743-a383-4fde2a566623'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:16.397942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] The token cache is being invalidate because project df1e2ea7cb6442c0a623a77cfc0d5396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:16.398213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:16.400572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:16.404037 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2470/4968] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:16 2022] DELETE /identity/v3/projects/df1e2ea7cb6442c0a623a77cfc0d5396 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:16.409631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:16.411257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:16.438144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0761820-1b15-40be-89d7-bc1e635922d3 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:16.578788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdc9a4-d797-4db9-b698-9ffbd30eb2b1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:16.579932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdc9a4-d797-4db9-b698-9ffbd30eb2b1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:16.580225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdc9a4-d797-4db9-b698-9ffbd30eb2b1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:16.580504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdc9a4-d797-4db9-b698-9ffbd30eb2b1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:16.581152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdc9a4-d797-4db9-b698-9ffbd30eb2b1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:16.592416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdc9a4-d797-4db9-b698-9ffbd30eb2b1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:16.650141 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2499/4969] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:23:16 2022] POST /identity/v3/projects => generated 329 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:16.650955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:16.653179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:16.679328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79618e-6b6e-4743-a383-4fde2a566623 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:16.696699 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:16.776995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b985f-9ef2-46ed-998c-172090afa69b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:16.778762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b985f-9ef2-46ed-998c-172090afa69b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:16.779275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b985f-9ef2-46ed-998c-172090afa69b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:16.779786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b985f-9ef2-46ed-998c-172090afa69b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:16.780667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b985f-9ef2-46ed-998c-172090afa69b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:16.784087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b985f-9ef2-46ed-998c-172090afa69b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:16.833839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdc9a4-d797-4db9-b698-9ffbd30eb2b1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:16.834738 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2471/4970] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:16 2022] POST /identity/v3/users => generated 416 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:16.873768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdc9a4-d797-4db9-b698-9ffbd30eb2b1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:16.902688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94dafc-d5a8-4fcf-ae61-dbcf6b44220d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:16.903762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94dafc-d5a8-4fcf-ae61-dbcf6b44220d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:16.904005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94dafc-d5a8-4fcf-ae61-dbcf6b44220d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:16.904443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94dafc-d5a8-4fcf-ae61-dbcf6b44220d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:16.904986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94dafc-d5a8-4fcf-ae61-dbcf6b44220d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:16.909898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94dafc-d5a8-4fcf-ae61-dbcf6b44220d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:16.946730 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2500/4971] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:16 2022] POST /identity/v3/roles => generated 243 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:16.948751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b985f-9ef2-46ed-998c-172090afa69b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:16.964549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b985f-9ef2-46ed-998c-172090afa69b tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:16.981852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4797f4-24d0-46bb-943e-0697ebe8f2e2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:16.982729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4797f4-24d0-46bb-943e-0697ebe8f2e2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:16.983171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4797f4-24d0-46bb-943e-0697ebe8f2e2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:16.983799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4797f4-24d0-46bb-943e-0697ebe8f2e2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:16.985991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4797f4-24d0-46bb-943e-0697ebe8f2e2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:16.988523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4797f4-24d0-46bb-943e-0697ebe8f2e2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:17.013743 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2472/4972] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:16 2022] POST /identity/v3/roles => generated 245 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:17.021713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94dafc-d5a8-4fcf-ae61-dbcf6b44220d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:17.044518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94dafc-d5a8-4fcf-ae61-dbcf6b44220d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:17.055170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211a4e-80d8-44dc-8448-7c4e9034a743 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:17.055170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211a4e-80d8-44dc-8448-7c4e9034a743 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:17.055526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211a4e-80d8-44dc-8448-7c4e9034a743 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:17.055526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211a4e-80d8-44dc-8448-7c4e9034a743 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/ee2cc2f556f04e8793cdc755d26fb799/users/9fff24236622443387b4b61bfb5da8da/roles/6245ea91825e4c9abf79556c038c4b58` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:17.076202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be211a4e-80d8-44dc-8448-7c4e9034a743 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ee2cc2f556f04e8793cdc755d26fb799, user_id=9fff24236622443387b4b61bfb5da8da, role_id=6245ea91825e4c9abf79556c038c4b58)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:17.090820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be211a4e-80d8-44dc-8448-7c4e9034a743 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:17.124464 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2501/4973] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:17 2022] PUT /identity/v3/projects/ee2cc2f556f04e8793cdc755d26fb799/users/9fff24236622443387b4b61bfb5da8da/roles/6245ea91825e4c9abf79556c038c4b58 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:17.125800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4797f4-24d0-46bb-943e-0697ebe8f2e2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:17.153157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4797f4-24d0-46bb-943e-0697ebe8f2e2 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:17.298497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec53a28-ccc0-4373-8905-92f7f689219d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:17.299241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53a28-ccc0-4373-8905-92f7f689219d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:17.299536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53a28-ccc0-4373-8905-92f7f689219d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:17.299811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53a28-ccc0-4373-8905-92f7f689219d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/ee2cc2f556f04e8793cdc755d26fb799/users/9fff24236622443387b4b61bfb5da8da/roles/bfb534c41d2841d189b437350daba210` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:17.303572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec53a28-ccc0-4373-8905-92f7f689219d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ee2cc2f556f04e8793cdc755d26fb799, user_id=9fff24236622443387b4b61bfb5da8da, role_id=bfb534c41d2841d189b437350daba210)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:17.306856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec53a28-ccc0-4373-8905-92f7f689219d tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:17.336292 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2473/4974] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:17 2022] PUT /identity/v3/projects/ee2cc2f556f04e8793cdc755d26fb799/users/9fff24236622443387b4b61bfb5da8da/roles/bfb534c41d2841d189b437350daba210 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:17.341239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211a4e-80d8-44dc-8448-7c4e9034a743 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:17.355787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211a4e-80d8-44dc-8448-7c4e9034a743 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:17.478743 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:17.505859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2544bd9-49ee-455a-9797-246e0ce61b5c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:17.507084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2544bd9-49ee-455a-9797-246e0ce61b5c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:17.507441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2544bd9-49ee-455a-9797-246e0ce61b5c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:17.508187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2544bd9-49ee-455a-9797-246e0ce61b5c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:17.508954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2544bd9-49ee-455a-9797-246e0ce61b5c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:17.512564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2544bd9-49ee-455a-9797-246e0ce61b5c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:17.581298 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2502/4975] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:17 2022] GET /identity/v3/users => generated 8057 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:23:17.581845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911bdc3-8cf1-4abe-aac5-fda58fb2c862 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:17.582130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911bdc3-8cf1-4abe-aac5-fda58fb2c862 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:17.582423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911bdc3-8cf1-4abe-aac5-fda58fb2c862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:17.716724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0911bdc3-8cf1-4abe-aac5-fda58fb2c862 None None] MFA Rules not processed for user `9fff24236622443387b4b61bfb5da8da`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:17.717964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0911bdc3-8cf1-4abe-aac5-fda58fb2c862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:17.862255 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2474/4976] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:17.876013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6af8e-b16d-4039-9fde-b99345872fa0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:17.876586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6af8e-b16d-4039-9fde-b99345872fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:17.877065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6af8e-b16d-4039-9fde-b99345872fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:17.957663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a1f6af8e-b16d-4039-9fde-b99345872fa0 None None] MFA Rules not processed for user `9fff24236622443387b4b61bfb5da8da`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:17.958950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1f6af8e-b16d-4039-9fde-b99345872fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:17.991628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911bdc3-8cf1-4abe-aac5-fda58fb2c862 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:17.992661 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2503/4977] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:18.003841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911bdc3-8cf1-4abe-aac5-fda58fb2c862 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:18.010492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d708f2-22d5-46e6-a5aa-9f088df6c995 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff24236622443387b4b61bfb5da8da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2cc2f556f04e8793cdc755d26fb799', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-32972337', 'tempest-DelegatedRole-865215972'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:18.011185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d708f2-22d5-46e6-a5aa-9f088df6c995 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:18.011461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d708f2-22d5-46e6-a5aa-9f088df6c995 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:18.011729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d708f2-22d5-46e6-a5aa-9f088df6c995 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:18.012403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d708f2-22d5-46e6-a5aa-9f088df6c995 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorizing `identity:create_trust()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:18.013582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d708f2-22d5-46e6-a5aa-9f088df6c995 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:18.024669 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:18.133907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6af8e-b16d-4039-9fde-b99345872fa0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:18.140592 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2475/4978] 10.222.0.23 () {60 vars in 1174 bytes} [Sun Oct 2 01:23:17 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:18.149099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6af8e-b16d-4039-9fde-b99345872fa0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:18.154854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c717f-2bdc-4631-89b5-1e297f879d88 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff24236622443387b4b61bfb5da8da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2cc2f556f04e8793cdc755d26fb799', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-32972337', 'tempest-DelegatedRole-865215972'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:18.155586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c717f-2bdc-4631-89b5-1e297f879d88 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:18.155869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c717f-2bdc-4631-89b5-1e297f879d88 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:18.156145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c717f-2bdc-4631-89b5-1e297f879d88 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] PATH_INFO: `/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:18.162552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c717f-2bdc-4631-89b5-1e297f879d88 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorizing `identity:get_trust(trust_id=8e22df707b344d0787cce0545371c2d2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:18.164075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c717f-2bdc-4631-89b5-1e297f879d88 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:18.188287 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2504/4979] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:23:18 2022] GET /identity/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2 => generated 833 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:18.194623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d708f2-22d5-46e6-a5aa-9f088df6c995 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:18.206002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d708f2-22d5-46e6-a5aa-9f088df6c995 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:18.210908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4c3dc-0b12-474d-9f91-03414b3cd085 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff24236622443387b4b61bfb5da8da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2cc2f556f04e8793cdc755d26fb799', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-32972337', 'tempest-DelegatedRole-865215972'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:18.211543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4c3dc-0b12-474d-9f91-03414b3cd085 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:18.211883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4c3dc-0b12-474d-9f91-03414b3cd085 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:18.212165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4c3dc-0b12-474d-9f91-03414b3cd085 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] PATH_INFO: `/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:18.220045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4c3dc-0b12-474d-9f91-03414b3cd085 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=8e22df707b344d0787cce0545371c2d2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:18.221578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4c3dc-0b12-474d-9f91-03414b3cd085 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:18.248070 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2476/4980] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:23:18 2022] GET /identity/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2/roles => generated 370 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:23:18.253150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c717f-2bdc-4631-89b5-1e297f879d88 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:18.269460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c717f-2bdc-4631-89b5-1e297f879d88 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:18.283503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7d21b-0339-4742-8018-cb9f074abb7b tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff24236622443387b4b61bfb5da8da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2cc2f556f04e8793cdc755d26fb799', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-32972337', 'tempest-DelegatedRole-865215972'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:18.284181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d21b-0339-4742-8018-cb9f074abb7b tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:18.284468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d21b-0339-4742-8018-cb9f074abb7b tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:18.284745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d21b-0339-4742-8018-cb9f074abb7b tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] PATH_INFO: `/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2/roles/6245ea91825e4c9abf79556c038c4b58` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:18.297731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7d21b-0339-4742-8018-cb9f074abb7b tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8e22df707b344d0787cce0545371c2d2, role_id=6245ea91825e4c9abf79556c038c4b58)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:18.300019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7d21b-0339-4742-8018-cb9f074abb7b tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:18.314745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4c3dc-0b12-474d-9f91-03414b3cd085 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:18.322231 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2505/4981] 10.222.0.23 () {58 vars in 1368 bytes} [Sun Oct 2 01:23:18 2022] GET /identity/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2/roles/6245ea91825e4c9abf79556c038c4b58 => generated 243 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:18.330908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4c3dc-0b12-474d-9f91-03414b3cd085 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:18.338862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a1f9e-dec1-4bf9-85b1-990dba147f9a tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff24236622443387b4b61bfb5da8da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2cc2f556f04e8793cdc755d26fb799', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-32972337', 'tempest-DelegatedRole-865215972'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:18.340983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1f9e-dec1-4bf9-85b1-990dba147f9a tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:18.341283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1f9e-dec1-4bf9-85b1-990dba147f9a tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:18.341735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1f9e-dec1-4bf9-85b1-990dba147f9a tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] PATH_INFO: `/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2/roles/6245ea91825e4c9abf79556c038c4b58` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:18.352798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a1f9e-dec1-4bf9-85b1-990dba147f9a tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8e22df707b344d0787cce0545371c2d2, role_id=6245ea91825e4c9abf79556c038c4b58)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:18.356159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a1f9e-dec1-4bf9-85b1-990dba147f9a tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:18.367461 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2477/4982] 10.222.0.23 () {58 vars in 1369 bytes} [Sun Oct 2 01:23:18 2022] HEAD /identity/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2/roles/6245ea91825e4c9abf79556c038c4b58 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 02 01:23:18.373065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7d21b-0339-4742-8018-cb9f074abb7b tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:18.390451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7d21b-0339-4742-8018-cb9f074abb7b tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:18.399064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee12ff9-4d01-43e8-ab2f-e41712be8deb tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff24236622443387b4b61bfb5da8da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2cc2f556f04e8793cdc755d26fb799', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-32972337', 'tempest-DelegatedRole-865215972'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:18.399727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee12ff9-4d01-43e8-ab2f-e41712be8deb tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:18.400009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee12ff9-4d01-43e8-ab2f-e41712be8deb tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:18.402662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee12ff9-4d01-43e8-ab2f-e41712be8deb tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] PATH_INFO: `/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2/roles/bfb534c41d2841d189b437350daba210` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:18.413227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee12ff9-4d01-43e8-ab2f-e41712be8deb tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8e22df707b344d0787cce0545371c2d2, role_id=bfb534c41d2841d189b437350daba210)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:18.414732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee12ff9-4d01-43e8-ab2f-e41712be8deb tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-3ee12ff9-4d01-43e8-ab2f-e41712be8deb tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Could not find role: bfb534c41d2841d189b437350daba210.: keystone.exception.RoleNotFound: Could not find role: bfb534c41d2841d189b437350daba210. Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 01:23:18.441153 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: bfb534c41d2841d189b437350daba210. Oct 02 01:23:18.442322 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:23:18.449482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a1f9e-dec1-4bf9-85b1-990dba147f9a tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:18.457832 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2506/4983] 10.222.0.23 () {58 vars in 1368 bytes} [Sun Oct 2 01:23:18 2022] GET /identity/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2/roles/bfb534c41d2841d189b437350daba210 => generated 110 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:23:18.465090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a1f9e-dec1-4bf9-85b1-990dba147f9a tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:18.470672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f69113-0eaf-4c98-8800-53436b51bb40 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff24236622443387b4b61bfb5da8da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2cc2f556f04e8793cdc755d26fb799', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-32972337', 'tempest-DelegatedRole-865215972'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:18.472020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69113-0eaf-4c98-8800-53436b51bb40 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:18.472375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69113-0eaf-4c98-8800-53436b51bb40 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:18.473089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69113-0eaf-4c98-8800-53436b51bb40 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] PATH_INFO: `/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2/roles/bfb534c41d2841d189b437350daba210` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:18.482878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f69113-0eaf-4c98-8800-53436b51bb40 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8e22df707b344d0787cce0545371c2d2, role_id=bfb534c41d2841d189b437350daba210)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:18.485811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f69113-0eaf-4c98-8800-53436b51bb40 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-27f69113-0eaf-4c98-8800-53436b51bb40 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Could not find role: bfb534c41d2841d189b437350daba210.: keystone.exception.RoleNotFound: Could not find role: bfb534c41d2841d189b437350daba210. Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 01:23:18.513498 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: bfb534c41d2841d189b437350daba210. Oct 02 01:23:18.514486 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:18.520106 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2478/4984] 10.222.0.23 () {58 vars in 1369 bytes} [Sun Oct 2 01:23:18 2022] HEAD /identity/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2/roles/bfb534c41d2841d189b437350daba210 => generated 0 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 02 01:23:18.523666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee12ff9-4d01-43e8-ab2f-e41712be8deb tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:18.537407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee12ff9-4d01-43e8-ab2f-e41712be8deb tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:18.545055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff24236622443387b4b61bfb5da8da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2cc2f556f04e8793cdc755d26fb799', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-32972337', 'tempest-DelegatedRole-865215972'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:18.546701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:18.547470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:18.548604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] PATH_INFO: `/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:18.564248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorizing `identity:delete_trust(trust_id=8e22df707b344d0787cce0545371c2d2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:18.566022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:18.602944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8e22df707b344d0787cce0545371c2d2', 'request_id': 'req-90855b00-be4e-42d0-8fc2-8d692adf025f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:18.607205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8e22df707b344d0787cce0545371c2d2', 'request_id': 'req-90855b00-be4e-42d0-8fc2-8d692adf025f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:18.624072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8e22df707b344d0787cce0545371c2d2', 'request_id': 'req-90855b00-be4e-42d0-8fc2-8d692adf025f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:18.639437 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2507/4985] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 2 01:23:18 2022] DELETE /identity/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:18.643320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f69113-0eaf-4c98-8800-53436b51bb40 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:18.645894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-27f69113-0eaf-4c98-8800-53436b51bb40 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:18.669475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f69113-0eaf-4c98-8800-53436b51bb40 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:18.679666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092b58f-798c-4498-b661-e835ea2d0020 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fff24236622443387b4b61bfb5da8da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2cc2f556f04e8793cdc755d26fb799', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-32972337', 'tempest-DelegatedRole-865215972'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:18.680784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092b58f-798c-4498-b661-e835ea2d0020 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:18.681026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092b58f-798c-4498-b661-e835ea2d0020 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:18.681329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092b58f-798c-4498-b661-e835ea2d0020 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] PATH_INFO: `/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5092b58f-798c-4498-b661-e835ea2d0020 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Could not find trust: 8e22df707b344d0787cce0545371c2d2.: keystone.exception.TrustNotFound: Could not find trust: 8e22df707b344d0787cce0545371c2d2. Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 02 01:23:18.699167 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8e22df707b344d0787cce0545371c2d2. Oct 02 01:23:18.700304 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:18.704868 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2479/4986] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:23:18 2022] GET /identity/v3/OS-TRUST/trusts/8e22df707b344d0787cce0545371c2d2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:23:18.707612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:18.709531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:18.731578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90855b00-be4e-42d0-8fc2-8d692adf025f tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:18.737443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1fa2-5c34-4b6c-889f-3a8c58fb196e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:18.738079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1fa2-5c34-4b6c-889f-3a8c58fb196e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:18.738578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1fa2-5c34-4b6c-889f-3a8c58fb196e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:18.738897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1fa2-5c34-4b6c-889f-3a8c58fb196e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/bfb534c41d2841d189b437350daba210` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:18.740361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1fa2-5c34-4b6c-889f-3a8c58fb196e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bfb534c41d2841d189b437350daba210)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:18.742021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1fa2-5c34-4b6c-889f-3a8c58fb196e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:18.813010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1f0e1fa2-5c34-4b6c-889f-3a8c58fb196e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role bfb534c41d2841d189b437350daba210 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:18.813672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1f0e1fa2-5c34-4b6c-889f-3a8c58fb196e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:18.814825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1f0e1fa2-5c34-4b6c-889f-3a8c58fb196e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:18.820167 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2508/4987] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:18 2022] DELETE /identity/v3/roles/bfb534c41d2841d189b437350daba210 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:18.824367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092b58f-798c-4498-b661-e835ea2d0020 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:18.826718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5092b58f-798c-4498-b661-e835ea2d0020 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:18.846701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092b58f-798c-4498-b661-e835ea2d0020 tempest-TrustsV3TestJSON-1015051183 tempest-user-1797548437] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:18.939547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:18.940333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:18.940734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:18.941106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/6245ea91825e4c9abf79556c038c4b58` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:18.942697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6245ea91825e4c9abf79556c038c4b58)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:18.944653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:19.033947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role 6245ea91825e4c9abf79556c038c4b58 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:19.033947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.034570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.038899 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2480/4988] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:18 2022] DELETE /identity/v3/roles/6245ea91825e4c9abf79556c038c4b58 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:19.043181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1fa2-5c34-4b6c-889f-3a8c58fb196e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:19.060229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1fa2-5c34-4b6c-889f-3a8c58fb196e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:19.158877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:19.160237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:19.161212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:19.161817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users/9fff24236622443387b4b61bfb5da8da` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:19.163492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9fff24236622443387b4b61bfb5da8da)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:19.166006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:19.177924 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:19.240535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fff24236622443387b4b61bfb5da8da'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.265629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fff24236622443387b4b61bfb5da8da'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.267483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fff24236622443387b4b61bfb5da8da'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.282315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fff24236622443387b4b61bfb5da8da'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.283149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fff24236622443387b4b61bfb5da8da'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.317497 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2509/4989] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:19 2022] DELETE /identity/v3/users/9fff24236622443387b4b61bfb5da8da => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:19.324739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:19.326273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:19.344438 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:19.349567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d667-f247-47bb-a0c2-71e5bc7e762c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:19.441736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:19.442645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:19.442873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:19.443444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/ee2cc2f556f04e8793cdc755d26fb799` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:19.444658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee2cc2f556f04e8793cdc755d26fb799)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:19.446822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:19.567206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2cc2f556f04e8793cdc755d26fb799', 'request_id': 'req-576dca55-f130-4749-aa1b-806ff15f5394'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.587443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2cc2f556f04e8793cdc755d26fb799', 'request_id': 'req-576dca55-f130-4749-aa1b-806ff15f5394'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.609573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2cc2f556f04e8793cdc755d26fb799', 'request_id': 'req-576dca55-f130-4749-aa1b-806ff15f5394'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.643066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] The token cache is being invalidate because project ee2cc2f556f04e8793cdc755d26fb799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:19.643439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.645279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:19.647517 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2481/4990] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:19 2022] DELETE /identity/v3/projects/ee2cc2f556f04e8793cdc755d26fb799 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:19.654575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:19.656120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:19.694485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc004b-9294-4b13-9fd5-fe9de4ff841c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:19.811472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b856dd-a6b3-42a0-b201-ab94f4a99fc1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:19.812190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b856dd-a6b3-42a0-b201-ab94f4a99fc1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:19.812547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b856dd-a6b3-42a0-b201-ab94f4a99fc1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:19.814081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b856dd-a6b3-42a0-b201-ab94f4a99fc1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:19.815027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b856dd-a6b3-42a0-b201-ab94f4a99fc1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:19.818018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b856dd-a6b3-42a0-b201-ab94f4a99fc1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:19.868909 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2510/4991] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:23:19 2022] POST /identity/v3/projects => generated 329 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:19.870474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:19.872133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:19.886937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dca55-f130-4749-aa1b-806ff15f5394 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:19.962421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67c508-d15e-4356-80b4-43d904b24c2e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:19.963317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67c508-d15e-4356-80b4-43d904b24c2e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:19.964004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67c508-d15e-4356-80b4-43d904b24c2e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:19.964481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67c508-d15e-4356-80b4-43d904b24c2e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:19.965319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67c508-d15e-4356-80b4-43d904b24c2e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:19.967479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67c508-d15e-4356-80b4-43d904b24c2e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:20.005840 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2482/4992] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:19 2022] POST /identity/v3/users => generated 413 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:20.011809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b856dd-a6b3-42a0-b201-ab94f4a99fc1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:20.029501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b856dd-a6b3-42a0-b201-ab94f4a99fc1 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:20.042799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d154b-e440-4c62-8799-c6e5c3d266c8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:20.043114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d154b-e440-4c62-8799-c6e5c3d266c8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:20.043369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d154b-e440-4c62-8799-c6e5c3d266c8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:20.043646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d154b-e440-4c62-8799-c6e5c3d266c8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:20.044328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d154b-e440-4c62-8799-c6e5c3d266c8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:20.046823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d154b-e440-4c62-8799-c6e5c3d266c8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:20.067796 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2511/4993] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:20 2022] POST /identity/v3/roles => generated 244 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:20.071687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67c508-d15e-4356-80b4-43d904b24c2e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:20.083483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67c508-d15e-4356-80b4-43d904b24c2e tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:20.089707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ede7-152b-4859-ab0a-a4a33b700b1c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:20.090656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ede7-152b-4859-ab0a-a4a33b700b1c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:20.090656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ede7-152b-4859-ab0a-a4a33b700b1c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:20.090887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ede7-152b-4859-ab0a-a4a33b700b1c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:20.091404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4ede7-152b-4859-ab0a-a4a33b700b1c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:20.093671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4ede7-152b-4859-ab0a-a4a33b700b1c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:20.115438 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2483/4994] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:23:20 2022] POST /identity/v3/roles => generated 246 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:23:20.119505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d154b-e440-4c62-8799-c6e5c3d266c8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:20.131189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d154b-e440-4c62-8799-c6e5c3d266c8 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:20.154318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c200ec-4781-47de-843e-05390b99946f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:20.155137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c200ec-4781-47de-843e-05390b99946f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:20.155581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c200ec-4781-47de-843e-05390b99946f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:20.155877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c200ec-4781-47de-843e-05390b99946f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/05337ffebac54366a874d575b099d069/users/56c5a3387444400495c0f105815c2063/roles/5633d48231fb446a925a2fc0b85a75a6` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:20.176374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c200ec-4781-47de-843e-05390b99946f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=05337ffebac54366a874d575b099d069, user_id=56c5a3387444400495c0f105815c2063, role_id=5633d48231fb446a925a2fc0b85a75a6)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:20.179188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c200ec-4781-47de-843e-05390b99946f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:20.216779 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2512/4995] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:20 2022] PUT /identity/v3/projects/05337ffebac54366a874d575b099d069/users/56c5a3387444400495c0f105815c2063/roles/5633d48231fb446a925a2fc0b85a75a6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:20.218126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ede7-152b-4859-ab0a-a4a33b700b1c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:20.233083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ede7-152b-4859-ab0a-a4a33b700b1c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:20.240271 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:20.330188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408c31a-5b41-4070-a7be-e39b3a96d7f9 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:20.331185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408c31a-5b41-4070-a7be-e39b3a96d7f9 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:20.332233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408c31a-5b41-4070-a7be-e39b3a96d7f9 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:20.332533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408c31a-5b41-4070-a7be-e39b3a96d7f9 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/05337ffebac54366a874d575b099d069/users/56c5a3387444400495c0f105815c2063/roles/0568c28f93074b219a6ea3921401da5e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:20.335470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408c31a-5b41-4070-a7be-e39b3a96d7f9 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:create_grant(project_id=05337ffebac54366a874d575b099d069, user_id=56c5a3387444400495c0f105815c2063, role_id=0568c28f93074b219a6ea3921401da5e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:20.341121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408c31a-5b41-4070-a7be-e39b3a96d7f9 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:20.367774 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2484/4996] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:20 2022] PUT /identity/v3/projects/05337ffebac54366a874d575b099d069/users/56c5a3387444400495c0f105815c2063/roles/0568c28f93074b219a6ea3921401da5e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:20.368390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c200ec-4781-47de-843e-05390b99946f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:20.379813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c200ec-4781-47de-843e-05390b99946f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:20.419449 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:20.460669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e49a6-55c2-4b29-9163-e2319701ae08 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:20.461314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e49a6-55c2-4b29-9163-e2319701ae08 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:20.461602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e49a6-55c2-4b29-9163-e2319701ae08 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:20.461881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e49a6-55c2-4b29-9163-e2319701ae08 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:20.462562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e49a6-55c2-4b29-9163-e2319701ae08 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:20.464929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e49a6-55c2-4b29-9163-e2319701ae08 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:20.503026 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2513/4997] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:20 2022] GET /identity/v3/users => generated 8054 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:20.506128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff1f7d-d51b-465e-80f6-dcbd8658581f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:20.506128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff1f7d-d51b-465e-80f6-dcbd8658581f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:20.506572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff1f7d-d51b-465e-80f6-dcbd8658581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:20.560634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2fff1f7d-d51b-465e-80f6-dcbd8658581f None None] MFA Rules not processed for user `56c5a3387444400495c0f105815c2063`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:20.561943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2fff1f7d-d51b-465e-80f6-dcbd8658581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:20.645881 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2485/4998] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:20.656463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f455e7a-fd5e-4d13-ae40-20ce821b5be5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:20.657015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f455e7a-fd5e-4d13-ae40-20ce821b5be5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:20.657015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f455e7a-fd5e-4d13-ae40-20ce821b5be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:20.693194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5f455e7a-fd5e-4d13-ae40-20ce821b5be5 None None] MFA Rules not processed for user `56c5a3387444400495c0f105815c2063`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:20.695681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5f455e7a-fd5e-4d13-ae40-20ce821b5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:20.709767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff1f7d-d51b-465e-80f6-dcbd8658581f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:20.709945 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2514/4999] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:20.721167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff1f7d-d51b-465e-80f6-dcbd8658581f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:20.728235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa2f52-390c-4fd5-97e9-96dd0cbe385d tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56c5a3387444400495c0f105815c2063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05337ffebac54366a874d575b099d069', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-127763506', 'tempest-DelegatedRole-1778946152'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:20.731082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2f52-390c-4fd5-97e9-96dd0cbe385d tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:20.732122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2f52-390c-4fd5-97e9-96dd0cbe385d tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:20.732602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2f52-390c-4fd5-97e9-96dd0cbe385d tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:20.733522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa2f52-390c-4fd5-97e9-96dd0cbe385d tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorizing `identity:create_trust()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:20.736440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa2f52-390c-4fd5-97e9-96dd0cbe385d tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:20.865752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f455e7a-fd5e-4d13-ae40-20ce821b5be5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:20.871649 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2486/5000] 10.222.0.23 () {60 vars in 1174 bytes} [Sun Oct 2 01:23:20 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:23:20.879942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f455e7a-fd5e-4d13-ae40-20ce821b5be5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:20.886117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd23676-78b2-4587-a2c1-df63cb0b4283 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56c5a3387444400495c0f105815c2063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05337ffebac54366a874d575b099d069', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-127763506', 'tempest-DelegatedRole-1778946152'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:20.887202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23676-78b2-4587-a2c1-df63cb0b4283 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:20.887698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23676-78b2-4587-a2c1-df63cb0b4283 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:20.888164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23676-78b2-4587-a2c1-df63cb0b4283 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] PATH_INFO: `/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:20.897074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd23676-78b2-4587-a2c1-df63cb0b4283 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorizing `identity:get_trust(trust_id=5b9ed5aa76be40ffa4cf4a19675a52e5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:20.899031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd23676-78b2-4587-a2c1-df63cb0b4283 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:20.917780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa2f52-390c-4fd5-97e9-96dd0cbe385d tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:20.918219 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2515/5001] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:23:20 2022] GET /identity/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5 => generated 835 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:20.939647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa2f52-390c-4fd5-97e9-96dd0cbe385d tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:20.946256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c61bba-bac7-4a69-a915-d461c5d1d016 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56c5a3387444400495c0f105815c2063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05337ffebac54366a874d575b099d069', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-127763506', 'tempest-DelegatedRole-1778946152'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:20.947584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61bba-bac7-4a69-a915-d461c5d1d016 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:20.948191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61bba-bac7-4a69-a915-d461c5d1d016 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:20.948664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61bba-bac7-4a69-a915-d461c5d1d016 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] PATH_INFO: `/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:20.988825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c61bba-bac7-4a69-a915-d461c5d1d016 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=5b9ed5aa76be40ffa4cf4a19675a52e5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:20.995138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c61bba-bac7-4a69-a915-d461c5d1d016 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:21.001301 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:21.017377 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2487/5002] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:23:20 2022] GET /identity/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5/roles => generated 371 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:21.021860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd23676-78b2-4587-a2c1-df63cb0b4283 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:21.057000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd23676-78b2-4587-a2c1-df63cb0b4283 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:21.069639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ce4a0-f711-43d6-8ad9-32a78d13973e tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56c5a3387444400495c0f105815c2063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05337ffebac54366a874d575b099d069', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-127763506', 'tempest-DelegatedRole-1778946152'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:21.071768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ce4a0-f711-43d6-8ad9-32a78d13973e tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:21.072356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ce4a0-f711-43d6-8ad9-32a78d13973e tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:21.074152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ce4a0-f711-43d6-8ad9-32a78d13973e tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] PATH_INFO: `/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5/roles/5633d48231fb446a925a2fc0b85a75a6` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:21.085330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ce4a0-f711-43d6-8ad9-32a78d13973e tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5b9ed5aa76be40ffa4cf4a19675a52e5, role_id=5633d48231fb446a925a2fc0b85a75a6)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:21.087448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ce4a0-f711-43d6-8ad9-32a78d13973e tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:21.097802 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2516/5003] 10.222.0.23 () {58 vars in 1368 bytes} [Sun Oct 2 01:23:21 2022] GET /identity/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5/roles/5633d48231fb446a925a2fc0b85a75a6 => generated 244 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:21.101820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c61bba-bac7-4a69-a915-d461c5d1d016 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:21.116339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c61bba-bac7-4a69-a915-d461c5d1d016 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:21.138477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e671-91f8-4a1a-ba89-f029a540b7fa tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56c5a3387444400495c0f105815c2063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05337ffebac54366a874d575b099d069', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-127763506', 'tempest-DelegatedRole-1778946152'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:21.139152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e671-91f8-4a1a-ba89-f029a540b7fa tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:21.139430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e671-91f8-4a1a-ba89-f029a540b7fa tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:21.139713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e671-91f8-4a1a-ba89-f029a540b7fa tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] PATH_INFO: `/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5/roles/5633d48231fb446a925a2fc0b85a75a6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:21.154742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86e671-91f8-4a1a-ba89-f029a540b7fa tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5b9ed5aa76be40ffa4cf4a19675a52e5, role_id=5633d48231fb446a925a2fc0b85a75a6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:21.156232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86e671-91f8-4a1a-ba89-f029a540b7fa tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:21.170658 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2488/5004] 10.222.0.23 () {58 vars in 1369 bytes} [Sun Oct 2 01:23:21 2022] HEAD /identity/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5/roles/5633d48231fb446a925a2fc0b85a75a6 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 02 01:23:21.175188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ce4a0-f711-43d6-8ad9-32a78d13973e tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:21.189312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ce4a0-f711-43d6-8ad9-32a78d13973e tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:21.198368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2aa4ad-3ddc-4185-996a-56eccbcb79dc tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56c5a3387444400495c0f105815c2063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05337ffebac54366a874d575b099d069', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-127763506', 'tempest-DelegatedRole-1778946152'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:21.199938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2aa4ad-3ddc-4185-996a-56eccbcb79dc tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:21.200339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2aa4ad-3ddc-4185-996a-56eccbcb79dc tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:21.200724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2aa4ad-3ddc-4185-996a-56eccbcb79dc tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] PATH_INFO: `/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5/roles/0568c28f93074b219a6ea3921401da5e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:21.216370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2aa4ad-3ddc-4185-996a-56eccbcb79dc tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5b9ed5aa76be40ffa4cf4a19675a52e5, role_id=0568c28f93074b219a6ea3921401da5e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:21.218585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2aa4ad-3ddc-4185-996a-56eccbcb79dc tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-7d2aa4ad-3ddc-4185-996a-56eccbcb79dc tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Could not find role: 0568c28f93074b219a6ea3921401da5e.: keystone.exception.RoleNotFound: Could not find role: 0568c28f93074b219a6ea3921401da5e. Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 01:23:21.234193 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0568c28f93074b219a6ea3921401da5e. Oct 02 01:23:21.235306 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:23:21.241146 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2517/5005] 10.222.0.23 () {58 vars in 1368 bytes} [Sun Oct 2 01:23:21 2022] GET /identity/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5/roles/0568c28f93074b219a6ea3921401da5e => generated 110 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:23:21.242573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e671-91f8-4a1a-ba89-f029a540b7fa tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:21.256750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e671-91f8-4a1a-ba89-f029a540b7fa tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:21.273229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa5bc2-b133-4061-a5fc-6ee93fbad795 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56c5a3387444400495c0f105815c2063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05337ffebac54366a874d575b099d069', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-127763506', 'tempest-DelegatedRole-1778946152'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:21.273897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa5bc2-b133-4061-a5fc-6ee93fbad795 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:21.274173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa5bc2-b133-4061-a5fc-6ee93fbad795 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:21.274854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa5bc2-b133-4061-a5fc-6ee93fbad795 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] PATH_INFO: `/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5/roles/0568c28f93074b219a6ea3921401da5e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:21.282588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa5bc2-b133-4061-a5fc-6ee93fbad795 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5b9ed5aa76be40ffa4cf4a19675a52e5, role_id=0568c28f93074b219a6ea3921401da5e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:21.284094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa5bc2-b133-4061-a5fc-6ee93fbad795 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-aefa5bc2-b133-4061-a5fc-6ee93fbad795 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Could not find role: 0568c28f93074b219a6ea3921401da5e.: keystone.exception.RoleNotFound: Could not find role: 0568c28f93074b219a6ea3921401da5e. Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 01:23:21.298232 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0568c28f93074b219a6ea3921401da5e. Oct 02 01:23:21.299351 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:21.302119 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2489/5006] 10.222.0.23 () {58 vars in 1369 bytes} [Sun Oct 2 01:23:21 2022] HEAD /identity/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5/roles/0568c28f93074b219a6ea3921401da5e => generated 0 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:23:21.306564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2aa4ad-3ddc-4185-996a-56eccbcb79dc tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:21.323121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2aa4ad-3ddc-4185-996a-56eccbcb79dc tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:21.334325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56c5a3387444400495c0f105815c2063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05337ffebac54366a874d575b099d069', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-127763506', 'tempest-DelegatedRole-1778946152'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:21.335164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:21.335657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:21.336014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] PATH_INFO: `/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:21.351531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorizing `identity:delete_trust(trust_id=5b9ed5aa76be40ffa4cf4a19675a52e5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:21.353136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:21.384028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5b9ed5aa76be40ffa4cf4a19675a52e5', 'request_id': 'req-35ed8b44-435d-40e0-bffc-d7a4980909ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:21.385436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '5b9ed5aa76be40ffa4cf4a19675a52e5', 'request_id': 'req-35ed8b44-435d-40e0-bffc-d7a4980909ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:21.397468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5b9ed5aa76be40ffa4cf4a19675a52e5', 'request_id': 'req-35ed8b44-435d-40e0-bffc-d7a4980909ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:21.407989 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2518/5007] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 2 01:23:21 2022] DELETE /identity/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:21.411865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa5bc2-b133-4061-a5fc-6ee93fbad795 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:21.413692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aefa5bc2-b133-4061-a5fc-6ee93fbad795 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:21.428812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa5bc2-b133-4061-a5fc-6ee93fbad795 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:21.434214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdceb848-c7df-4498-9838-e835bd4ad576 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56c5a3387444400495c0f105815c2063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05337ffebac54366a874d575b099d069', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-127763506', 'tempest-DelegatedRole-1778946152'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:21.435695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceb848-c7df-4498-9838-e835bd4ad576 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:21.435988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceb848-c7df-4498-9838-e835bd4ad576 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:21.436749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceb848-c7df-4498-9838-e835bd4ad576 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] PATH_INFO: `/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cdceb848-c7df-4498-9838-e835bd4ad576 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Could not find trust: 5b9ed5aa76be40ffa4cf4a19675a52e5.: keystone.exception.TrustNotFound: Could not find trust: 5b9ed5aa76be40ffa4cf4a19675a52e5. Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 02 01:23:21.446650 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 5b9ed5aa76be40ffa4cf4a19675a52e5. Oct 02 01:23:21.447810 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:23:21.451940 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2490/5008] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:23:21 2022] GET /identity/v3/OS-TRUST/trusts/5b9ed5aa76be40ffa4cf4a19675a52e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:23:21.452197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:21.454302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:21.474261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed8b44-435d-40e0-bffc-d7a4980909ef tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:21.482192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21265b3-8157-4e1f-9091-4931dabd604c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:21.483312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21265b3-8157-4e1f-9091-4931dabd604c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:21.483831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21265b3-8157-4e1f-9091-4931dabd604c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:21.484256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21265b3-8157-4e1f-9091-4931dabd604c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/0568c28f93074b219a6ea3921401da5e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:21.486415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21265b3-8157-4e1f-9091-4931dabd604c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0568c28f93074b219a6ea3921401da5e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:21.487898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21265b3-8157-4e1f-9091-4931dabd604c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:21.565451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e21265b3-8157-4e1f-9091-4931dabd604c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role 0568c28f93074b219a6ea3921401da5e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:21.566902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e21265b3-8157-4e1f-9091-4931dabd604c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:21.568664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e21265b3-8157-4e1f-9091-4931dabd604c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:21.578520 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2519/5009] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:21 2022] DELETE /identity/v3/roles/0568c28f93074b219a6ea3921401da5e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:21.583548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdceb848-c7df-4498-9838-e835bd4ad576 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:21.585994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cdceb848-c7df-4498-9838-e835bd4ad576 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:21.616354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdceb848-c7df-4498-9838-e835bd4ad576 tempest-TrustsV3TestJSON-1706617777 tempest-user-454260945] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:21.764748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:21.765811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:21.766308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:21.767186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/roles/5633d48231fb446a925a2fc0b85a75a6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:21.768924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5633d48231fb446a925a2fc0b85a75a6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:21.772224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:21.844152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invalidating the token cache because role 5633d48231fb446a925a2fc0b85a75a6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:21.844678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:21.845627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:21.848216 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2491/5010] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:21 2022] DELETE /identity/v3/roles/5633d48231fb446a925a2fc0b85a75a6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:21.852238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21265b3-8157-4e1f-9091-4931dabd604c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:21.864879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21265b3-8157-4e1f-9091-4931dabd604c tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:21.926552 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:21.942459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:21.944012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:21.944296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:21.944885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/users/56c5a3387444400495c0f105815c2063` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:21.946865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_user(user_id=56c5a3387444400495c0f105815c2063)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:21.950247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:22.060157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c5a3387444400495c0f105815c2063'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.121094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c5a3387444400495c0f105815c2063'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.122130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c5a3387444400495c0f105815c2063'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.137626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c5a3387444400495c0f105815c2063'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.138309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c5a3387444400495c0f105815c2063'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.181082 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2520/5011] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:21 2022] DELETE /identity/v3/users/56c5a3387444400495c0f105815c2063 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:22.186053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:22.187864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:22.214379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112c293-25f7-42b8-99ee-5c7d3ad7d234 tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:22.312776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965aaaedebd9413d9717c3dba4552f9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4eec12dcbe42a486dfc8915596033a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:22.313863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:22.314222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:22.314568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] PATH_INFO: `/v3/projects/05337ffebac54366a874d575b099d069` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:22.316893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05337ffebac54366a874d575b099d069)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:22.319409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:22.384318 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:22.444360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05337ffebac54366a874d575b099d069', 'request_id': 'req-d7098d93-23bd-48c0-a8be-4d6e121169db'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.458584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05337ffebac54366a874d575b099d069', 'request_id': 'req-d7098d93-23bd-48c0-a8be-4d6e121169db'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.470779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05337ffebac54366a874d575b099d069', 'request_id': 'req-d7098d93-23bd-48c0-a8be-4d6e121169db'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.498041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] The token cache is being invalidate because project 05337ffebac54366a874d575b099d069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:22.498496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.500237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7098d93-23bd-48c0-a8be-4d6e121169db tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.506708 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2492/5012] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:22 2022] DELETE /identity/v3/projects/05337ffebac54366a874d575b099d069 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:22.508556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:22.511810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:22.620473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dd677-26d4-4d20-9472-124d7a487d6f tempest-TrustsV3TestJSON-1392377999 tempest-TrustsV3TestJSON-1392377999-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:22.689505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:22.690172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:22.690465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:22.690758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] PATH_INFO: `/v3/users/aa0d2ce52c864a35913f556b37baec95` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:22.693231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0d2ce52c864a35913f556b37baec95)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:22.706945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:22.760695 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:22.833974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0d2ce52c864a35913f556b37baec95'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.896084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0d2ce52c864a35913f556b37baec95'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.897521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0d2ce52c864a35913f556b37baec95'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.924282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0d2ce52c864a35913f556b37baec95'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.925145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0d2ce52c864a35913f556b37baec95'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:22.965397 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2521/5013] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:22 2022] DELETE /identity/v3/users/aa0d2ce52c864a35913f556b37baec95 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:22.970094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e712b-595d-4f1b-a359-2919cfbaa94b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:22.970491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e712b-595d-4f1b-a359-2919cfbaa94b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:22.970887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e712b-595d-4f1b-a359-2919cfbaa94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:22.999600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1f1e712b-595d-4f1b-a359-2919cfbaa94b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:23.001576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f1e712b-595d-4f1b-a359-2919cfbaa94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:23.116348 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2493/5014] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:23.128205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:23.129806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:23.277837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5995fb-0638-43f3-8cc8-d3e956d006e4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:23.289625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc828bf8-308e-4231-aac8-b9397afa74a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:23.292951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828bf8-308e-4231-aac8-b9397afa74a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:23.294383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828bf8-308e-4231-aac8-b9397afa74a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:23.294976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828bf8-308e-4231-aac8-b9397afa74a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:23.319990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc828bf8-308e-4231-aac8-b9397afa74a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:23.321522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc828bf8-308e-4231-aac8-b9397afa74a7 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:23.362035 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2522/5015] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:24.709264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e712b-595d-4f1b-a359-2919cfbaa94b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:24.711235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f1e712b-595d-4f1b-a359-2919cfbaa94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:24.730462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e712b-595d-4f1b-a359-2919cfbaa94b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:24.737858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:24.738923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:24.739863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:24.740584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] PATH_INFO: `/v3/projects/9c74eade786d4c3dbb9498b9919ee8e0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:24.742369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c74eade786d4c3dbb9498b9919ee8e0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:24.745285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:24.876837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c74eade786d4c3dbb9498b9919ee8e0', 'request_id': 'req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:24.885216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c74eade786d4c3dbb9498b9919ee8e0', 'request_id': 'req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:24.894852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c74eade786d4c3dbb9498b9919ee8e0', 'request_id': 'req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:24.919222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] The token cache is being invalidate because project 9c74eade786d4c3dbb9498b9919ee8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:24.919603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:24.921165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:24.923439 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2494/5016] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:24 2022] DELETE /identity/v3/projects/9c74eade786d4c3dbb9498b9919ee8e0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:24.927964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc828bf8-308e-4231-aac8-b9397afa74a7 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:24.942004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc828bf8-308e-4231-aac8-b9397afa74a7 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:25.037012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:25.037861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:25.039421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:25.039874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] PATH_INFO: `/v3/users/965aaaedebd9413d9717c3dba4552f9c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:25.042095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=965aaaedebd9413d9717c3dba4552f9c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:25.044618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:25.120560 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:25.129260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965aaaedebd9413d9717c3dba4552f9c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:25.147728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965aaaedebd9413d9717c3dba4552f9c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:25.151495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965aaaedebd9413d9717c3dba4552f9c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:25.163668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965aaaedebd9413d9717c3dba4552f9c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:25.165043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965aaaedebd9413d9717c3dba4552f9c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:25.183803 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2523/5017] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:24 2022] DELETE /identity/v3/users/965aaaedebd9413d9717c3dba4552f9c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:25.507521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:25.509605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:25.533677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6a1c-a8c4-4a0f-93f6-9613f2e3f9c4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:25.649267 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:25.715453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62911201-c502-4545-8805-8af269758304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:25.716175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62911201-c502-4545-8805-8af269758304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:25.716648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62911201-c502-4545-8805-8af269758304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:25.717095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62911201-c502-4545-8805-8af269758304 admin admin] PATH_INFO: `/v3/users/a4ba5c1008c3439689b252d70a0b3f2c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:25.719315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62911201-c502-4545-8805-8af269758304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ba5c1008c3439689b252d70a0b3f2c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:25.721464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62911201-c502-4545-8805-8af269758304 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:25.807665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-62911201-c502-4545-8805-8af269758304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ba5c1008c3439689b252d70a0b3f2c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:25.836414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-62911201-c502-4545-8805-8af269758304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ba5c1008c3439689b252d70a0b3f2c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:25.837335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-62911201-c502-4545-8805-8af269758304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ba5c1008c3439689b252d70a0b3f2c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:25.856795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-62911201-c502-4545-8805-8af269758304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ba5c1008c3439689b252d70a0b3f2c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:25.866874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-62911201-c502-4545-8805-8af269758304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ba5c1008c3439689b252d70a0b3f2c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:25.882925 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2495/5018] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:25 2022] DELETE /identity/v3/users/a4ba5c1008c3439689b252d70a0b3f2c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:26.001791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:26.004179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:26.023667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608aef9-b2da-47eb-8063-5da301550676 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:26.138078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:26.139057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:26.139650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:26.140743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] PATH_INFO: `/v3/projects/ff4eec12dcbe42a486dfc8915596033a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:26.142781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4eec12dcbe42a486dfc8915596033a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:26.144902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:26.273611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4eec12dcbe42a486dfc8915596033a', 'request_id': 'req-e1c9e159-ad8b-42ab-91de-f449cb24d45e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:26.281715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4eec12dcbe42a486dfc8915596033a', 'request_id': 'req-e1c9e159-ad8b-42ab-91de-f449cb24d45e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:26.291199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4eec12dcbe42a486dfc8915596033a', 'request_id': 'req-e1c9e159-ad8b-42ab-91de-f449cb24d45e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:26.313920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] The token cache is being invalidate because project ff4eec12dcbe42a486dfc8915596033a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:26.314559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:26.315441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1c9e159-ad8b-42ab-91de-f449cb24d45e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:26.318276 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2524/5019] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:25 2022] DELETE /identity/v3/projects/ff4eec12dcbe42a486dfc8915596033a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:26.324010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f0258-06ed-4b3e-9845-6f9a79a2149e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:26.324575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f0258-06ed-4b3e-9845-6f9a79a2149e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:26.325030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f0258-06ed-4b3e-9845-6f9a79a2149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:26.357035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-088f0258-06ed-4b3e-9845-6f9a79a2149e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:26.358548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-088f0258-06ed-4b3e-9845-6f9a79a2149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:26.474922 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2496/5020] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:23:26.484077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd088-4f2d-4dac-b8a3-4096a1e272cf None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:26.485047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd088-4f2d-4dac-b8a3-4096a1e272cf None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:26.486111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd088-4f2d-4dac-b8a3-4096a1e272cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:26.514002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5b3fd088-4f2d-4dac-b8a3-4096a1e272cf None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:26.516315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5b3fd088-4f2d-4dac-b8a3-4096a1e272cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:26.537611 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2525/5021] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:26.542196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f0258-06ed-4b3e-9845-6f9a79a2149e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:26.558623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f0258-06ed-4b3e-9845-6f9a79a2149e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:26.573762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff846f7-58d0-4fe4-99fb-14a5510ed344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:26.574423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff846f7-58d0-4fe4-99fb-14a5510ed344 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:26.574736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff846f7-58d0-4fe4-99fb-14a5510ed344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:26.575012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff846f7-58d0-4fe4-99fb-14a5510ed344 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:26.575696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff846f7-58d0-4fe4-99fb-14a5510ed344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:23:26.576002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff846f7-58d0-4fe4-99fb-14a5510ed344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:26.577682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff846f7-58d0-4fe4-99fb-14a5510ed344 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:26.607447 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2497/5022] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:26.611778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd088-4f2d-4dac-b8a3-4096a1e272cf None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:26.628076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd088-4f2d-4dac-b8a3-4096a1e272cf None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:26.635236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d68829-1432-47dd-8985-3c6bdf41f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:26.636227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d68829-1432-47dd-8985-3c6bdf41f6cb admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:26.636605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d68829-1432-47dd-8985-3c6bdf41f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:26.636972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d68829-1432-47dd-8985-3c6bdf41f6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:26.637894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d68829-1432-47dd-8985-3c6bdf41f6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:26.640715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d68829-1432-47dd-8985-3c6bdf41f6cb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:26.719749 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2526/5023] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:23:26 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:23:26.721087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff846f7-58d0-4fe4-99fb-14a5510ed344 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:26.726915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d68829-1432-47dd-8985-3c6bdf41f6cb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:26.730916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-96d68829-1432-47dd-8985-3c6bdf41f6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:26.740186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff846f7-58d0-4fe4-99fb-14a5510ed344 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:26.817240 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:26.840877 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:26.898894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e713-ce18-45b0-9adf-dfebdd413106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:26.899532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e713-ce18-45b0-9adf-dfebdd413106 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:26.899814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e713-ce18-45b0-9adf-dfebdd413106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:26.900088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e713-ce18-45b0-9adf-dfebdd413106 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:26.901606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8e713-ce18-45b0-9adf-dfebdd413106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:26.906835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8e713-ce18-45b0-9adf-dfebdd413106 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:26.949858 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2498/5024] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:26 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:26.952399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d68829-1432-47dd-8985-3c6bdf41f6cb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:26.953653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e713-ce18-45b0-9adf-dfebdd413106 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:26.967251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:26.968132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:26.968263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:26.968460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] PATH_INFO: `/v3/projects/4426feaf511c44568616f844a3c657f0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:26.969784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4426feaf511c44568616f844a3c657f0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:26.972652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e713-ce18-45b0-9adf-dfebdd413106 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:26.974929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:26.995358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ab981-e1da-44fb-ae67-104939e7cdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:26.996141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ab981-e1da-44fb-ae67-104939e7cdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:26.996428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ab981-e1da-44fb-ae67-104939e7cdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:26.996709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ab981-e1da-44fb-ae67-104939e7cdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:26.997369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ab981-e1da-44fb-ae67-104939e7cdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:26.999042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ab981-e1da-44fb-ae67-104939e7cdc3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:27.024470 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2499/5025] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:23:27.027790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ab981-e1da-44fb-ae67-104939e7cdc3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:27.056695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ab981-e1da-44fb-ae67-104939e7cdc3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:27.071108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668efb4-5ee6-4e30-a5bf-20335dd12e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:27.071990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668efb4-5ee6-4e30-a5bf-20335dd12e3f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:27.072651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668efb4-5ee6-4e30-a5bf-20335dd12e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:27.072651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668efb4-5ee6-4e30-a5bf-20335dd12e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:27.076052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668efb4-5ee6-4e30-a5bf-20335dd12e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:27.080194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668efb4-5ee6-4e30-a5bf-20335dd12e3f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:27.090994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4426feaf511c44568616f844a3c657f0', 'request_id': 'req-cefe16db-06c3-4f7e-816d-3438af26faf0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:27.101969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4426feaf511c44568616f844a3c657f0', 'request_id': 'req-cefe16db-06c3-4f7e-816d-3438af26faf0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:27.107875 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2500/5026] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:27.110398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668efb4-5ee6-4e30-a5bf-20335dd12e3f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:27.111611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4426feaf511c44568616f844a3c657f0', 'request_id': 'req-cefe16db-06c3-4f7e-816d-3438af26faf0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:27.138629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668efb4-5ee6-4e30-a5bf-20335dd12e3f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:27.148446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] The token cache is being invalidate because project 4426feaf511c44568616f844a3c657f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:27.151662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:27.152078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cefe16db-06c3-4f7e-816d-3438af26faf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:27.154320 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2527/5027] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:26 2022] DELETE /identity/v3/projects/4426feaf511c44568616f844a3c657f0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:27.159821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44b10e-e446-4a6f-90ca-cc432f7e9591 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:27.160332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44b10e-e446-4a6f-90ca-cc432f7e9591 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:27.160721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44b10e-e446-4a6f-90ca-cc432f7e9591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:27.215993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dd44b10e-e446-4a6f-90ca-cc432f7e9591 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:27.217974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dd44b10e-e446-4a6f-90ca-cc432f7e9591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:27.251048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12366739-00ab-49da-a452-567d6eb161d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:27.252044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12366739-00ab-49da-a452-567d6eb161d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:27.252685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12366739-00ab-49da-a452-567d6eb161d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:27.253330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12366739-00ab-49da-a452-567d6eb161d1 admin admin] PATH_INFO: `/v3/projects/56eafa03a1d442b3b818a173bc7388fd/users/43815d5de45f4ca791a0caf32340798a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:27.276855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12366739-00ab-49da-a452-567d6eb161d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56eafa03a1d442b3b818a173bc7388fd, user_id=43815d5de45f4ca791a0caf32340798a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:27.280483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12366739-00ab-49da-a452-567d6eb161d1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:27.301867 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2501/5028] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:27 2022] PUT /identity/v3/projects/56eafa03a1d442b3b818a173bc7388fd/users/43815d5de45f4ca791a0caf32340798a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:27.360767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2528/5029] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:27.362428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9509-250c-4a9e-86c6-8c0cae02dca7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:27.362756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9509-250c-4a9e-86c6-8c0cae02dca7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:27.363039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9509-250c-4a9e-86c6-8c0cae02dca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:27.405713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9bad9509-250c-4a9e-86c6-8c0cae02dca7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:27.406101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf98d8-0cb3-4bec-9083-02440193caca None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:27.406395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf98d8-0cb3-4bec-9083-02440193caca None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:27.406703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf98d8-0cb3-4bec-9083-02440193caca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:27.407513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9bad9509-250c-4a9e-86c6-8c0cae02dca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:27.439500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-84bf98d8-0cb3-4bec-9083-02440193caca None None] MFA Rules not processed for user `43815d5de45f4ca791a0caf32340798a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:27.440657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-84bf98d8-0cb3-4bec-9083-02440193caca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:27.520828 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2502/5030] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:27.525555 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:27.527025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad9509-250c-4a9e-86c6-8c0cae02dca7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:27.543192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad9509-250c-4a9e-86c6-8c0cae02dca7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:27.571264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44841237-90d7-4cd6-9769-04be8f3f0c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:27.572846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44841237-90d7-4cd6-9769-04be8f3f0c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:27.572846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44841237-90d7-4cd6-9769-04be8f3f0c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:27.572846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44841237-90d7-4cd6-9769-04be8f3f0c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:27.573378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44841237-90d7-4cd6-9769-04be8f3f0c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:23:27.573687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44841237-90d7-4cd6-9769-04be8f3f0c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:27.575682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44841237-90d7-4cd6-9769-04be8f3f0c64 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:27.606950 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2503/5031] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:27.607820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44841237-90d7-4cd6-9769-04be8f3f0c64 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:27.608120 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2529/5032] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:27.609156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf98d8-0cb3-4bec-9083-02440193caca None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:27.628190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf98d8-0cb3-4bec-9083-02440193caca None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:27.638179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44841237-90d7-4cd6-9769-04be8f3f0c64 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:27.641662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a09340-c10c-4b98-b0db-e9f93f5de36b tempest-DefaultDomainTestJSON-1007829625 tempest-DefaultDomainTestJSON-1007829625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43815d5de45f4ca791a0caf32340798a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56eafa03a1d442b3b818a173bc7388fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:27.642326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09340-c10c-4b98-b0db-e9f93f5de36b tempest-DefaultDomainTestJSON-1007829625 tempest-DefaultDomainTestJSON-1007829625-project] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:27.642629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09340-c10c-4b98-b0db-e9f93f5de36b tempest-DefaultDomainTestJSON-1007829625 tempest-DefaultDomainTestJSON-1007829625-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:27.642944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09340-c10c-4b98-b0db-e9f93f5de36b tempest-DefaultDomainTestJSON-1007829625 tempest-DefaultDomainTestJSON-1007829625-project] PATH_INFO: `/v3/domains/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:27.647948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a09340-c10c-4b98-b0db-e9f93f5de36b tempest-DefaultDomainTestJSON-1007829625 tempest-DefaultDomainTestJSON-1007829625-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:27.649714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a09340-c10c-4b98-b0db-e9f93f5de36b tempest-DefaultDomainTestJSON-1007829625 tempest-DefaultDomainTestJSON-1007829625-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:27.658839 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2530/5033] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:23:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:27.660497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a09340-c10c-4b98-b0db-e9f93f5de36b tempest-DefaultDomainTestJSON-1007829625 tempest-DefaultDomainTestJSON-1007829625-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:27.661302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba496b-ce28-471d-af72-3abc459674d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:27.662122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba496b-ce28-471d-af72-3abc459674d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:27.662720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba496b-ce28-471d-af72-3abc459674d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:27.663161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba496b-ce28-471d-af72-3abc459674d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:27.663976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba496b-ce28-471d-af72-3abc459674d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:27.666307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba496b-ce28-471d-af72-3abc459674d4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:27.672659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d2a09340-c10c-4b98-b0db-e9f93f5de36b tempest-DefaultDomainTestJSON-1007829625 tempest-DefaultDomainTestJSON-1007829625-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:27.696938 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:27.716092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a09340-c10c-4b98-b0db-e9f93f5de36b tempest-DefaultDomainTestJSON-1007829625 tempest-DefaultDomainTestJSON-1007829625-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:27.722664 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2504/5034] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:23:27 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:27.727824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba496b-ce28-471d-af72-3abc459674d4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:27.732015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156813cd-08e2-4830-9877-b73071c2afa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:27.732684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156813cd-08e2-4830-9877-b73071c2afa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:27.733208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156813cd-08e2-4830-9877-b73071c2afa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:27.733208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156813cd-08e2-4830-9877-b73071c2afa8 admin admin] PATH_INFO: `/v3/users/43815d5de45f4ca791a0caf32340798a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:27.739454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156813cd-08e2-4830-9877-b73071c2afa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43815d5de45f4ca791a0caf32340798a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:27.751416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156813cd-08e2-4830-9877-b73071c2afa8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:27.859885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba496b-ce28-471d-af72-3abc459674d4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:27.872937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-156813cd-08e2-4830-9877-b73071c2afa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43815d5de45f4ca791a0caf32340798a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:27.882066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e7862-4f44-4d0f-a668-d0191e16cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:27.883033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7862-4f44-4d0f-a668-d0191e16cc08 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:27.883315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7862-4f44-4d0f-a668-d0191e16cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:27.883768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7862-4f44-4d0f-a668-d0191e16cc08 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:27.885141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e7862-4f44-4d0f-a668-d0191e16cc08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:27.897815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e7862-4f44-4d0f-a668-d0191e16cc08 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:27.900842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-156813cd-08e2-4830-9877-b73071c2afa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43815d5de45f4ca791a0caf32340798a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:27.908662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-156813cd-08e2-4830-9877-b73071c2afa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43815d5de45f4ca791a0caf32340798a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:27.921916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-156813cd-08e2-4830-9877-b73071c2afa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43815d5de45f4ca791a0caf32340798a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:27.922660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-156813cd-08e2-4830-9877-b73071c2afa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43815d5de45f4ca791a0caf32340798a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:27.943171 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2505/5035] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:27 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:27.944752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e7862-4f44-4d0f-a668-d0191e16cc08 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:27.947042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-368e7862-4f44-4d0f-a668-d0191e16cc08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:27.949352 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2531/5036] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:27 2022] DELETE /identity/v3/users/43815d5de45f4ca791a0caf32340798a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:27.953608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c4d9b-1e07-4d75-9ce2-b8e7e407506c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:27.953945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c4d9b-1e07-4d75-9ce2-b8e7e407506c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:27.954220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c4d9b-1e07-4d75-9ce2-b8e7e407506c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:27.963011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e7862-4f44-4d0f-a668-d0191e16cc08 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:27.999489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c11c4d9b-1e07-4d75-9ce2-b8e7e407506c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:28.000704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c11c4d9b-1e07-4d75-9ce2-b8e7e407506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:28.045222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7c36e-ba80-4fc4-9ab9-6ce292088135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:28.045757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c36e-ba80-4fc4-9ab9-6ce292088135 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:28.046096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c36e-ba80-4fc4-9ab9-6ce292088135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:28.046375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c36e-ba80-4fc4-9ab9-6ce292088135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:28.047064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7c36e-ba80-4fc4-9ab9-6ce292088135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:28.048994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7c36e-ba80-4fc4-9ab9-6ce292088135 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:28.064187 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2506/5037] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:28.066147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7c36e-ba80-4fc4-9ab9-6ce292088135 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:28.084730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7c36e-ba80-4fc4-9ab9-6ce292088135 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:28.095850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee1789-b3b9-43bd-9b44-7ce518e96b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:28.096879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee1789-b3b9-43bd-9b44-7ce518e96b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:28.097384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee1789-b3b9-43bd-9b44-7ce518e96b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:28.097859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee1789-b3b9-43bd-9b44-7ce518e96b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:28.098860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee1789-b3b9-43bd-9b44-7ce518e96b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:28.101367 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2532/5038] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:23:28.102762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee1789-b3b9-43bd-9b44-7ce518e96b60 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:28.125068 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2507/5039] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:28.125812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c4d9b-1e07-4d75-9ce2-b8e7e407506c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:28.139963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee1789-b3b9-43bd-9b44-7ce518e96b60 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:28.140747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c4d9b-1e07-4d75-9ce2-b8e7e407506c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:28.143288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-17ee1789-b3b9-43bd-9b44-7ce518e96b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:28.151176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33694a7-8da1-4c32-b582-4738f9893bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:28.151461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33694a7-8da1-4c32-b582-4738f9893bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:28.151739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33694a7-8da1-4c32-b582-4738f9893bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:28.152010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33694a7-8da1-4c32-b582-4738f9893bf8 admin admin] PATH_INFO: `/v3/projects/d51755a194eb4b65bb07bb52dc274f4f/users/12321c4eed38481bb09670364f1716c0/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:28.196859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33694a7-8da1-4c32-b582-4738f9893bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51755a194eb4b65bb07bb52dc274f4f, user_id=12321c4eed38481bb09670364f1716c0, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:28.201284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33694a7-8da1-4c32-b582-4738f9893bf8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:28.223531 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2533/5040] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:28 2022] PUT /identity/v3/projects/d51755a194eb4b65bb07bb52dc274f4f/users/12321c4eed38481bb09670364f1716c0/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:28.227671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af391fa2-c866-4693-87e3-7d5f083d29de None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:28.228221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af391fa2-c866-4693-87e3-7d5f083d29de None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:28.228808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af391fa2-c866-4693-87e3-7d5f083d29de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:28.276852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-af391fa2-c866-4693-87e3-7d5f083d29de None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:28.281372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-af391fa2-c866-4693-87e3-7d5f083d29de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:28.283095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee1789-b3b9-43bd-9b44-7ce518e96b60 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:28.316953 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:28.332140 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:28.365435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de7fbc-7c7c-408f-b47a-d01663f1e2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:28.366343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7fbc-7c7c-408f-b47a-d01663f1e2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:28.366641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7fbc-7c7c-408f-b47a-d01663f1e2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:28.366922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7fbc-7c7c-408f-b47a-d01663f1e2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:28.446085 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2534/5041] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:28.457529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de7fbc-7c7c-408f-b47a-d01663f1e2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:28.459953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de7fbc-7c7c-408f-b47a-d01663f1e2c5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:28.476230 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2508/5042] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:28.485397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af391fa2-c866-4693-87e3-7d5f083d29de None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:28.501455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af391fa2-c866-4693-87e3-7d5f083d29de None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:28.513486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c9097-a166-4f70-ae36-8f912631c030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:28.514205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c9097-a166-4f70-ae36-8f912631c030 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:28.514552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c9097-a166-4f70-ae36-8f912631c030 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:28.514915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c9097-a166-4f70-ae36-8f912631c030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:28.538101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c9097-a166-4f70-ae36-8f912631c030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:28.541412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c9097-a166-4f70-ae36-8f912631c030 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:28.560472 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2535/5043] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:29.877341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de7fbc-7c7c-408f-b47a-d01663f1e2c5 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:29.881149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e8de7fbc-7c7c-408f-b47a-d01663f1e2c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:29.919715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de7fbc-7c7c-408f-b47a-d01663f1e2c5 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:29.932688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:29.934903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:29.935577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:29.936076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] PATH_INFO: `/v3/projects/56eafa03a1d442b3b818a173bc7388fd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:29.938827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56eafa03a1d442b3b818a173bc7388fd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:29.941623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:30.100526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56eafa03a1d442b3b818a173bc7388fd', 'request_id': 'req-c0181fb3-651f-478d-a849-17378ec62be9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:30.119830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56eafa03a1d442b3b818a173bc7388fd', 'request_id': 'req-c0181fb3-651f-478d-a849-17378ec62be9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:30.142452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56eafa03a1d442b3b818a173bc7388fd', 'request_id': 'req-c0181fb3-651f-478d-a849-17378ec62be9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:30.180201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] The token cache is being invalidate because project 56eafa03a1d442b3b818a173bc7388fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:30.180591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:30.181321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0181fb3-651f-478d-a849-17378ec62be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:30.184740 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2509/5044] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:29 2022] DELETE /identity/v3/projects/56eafa03a1d442b3b818a173bc7388fd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:30.191672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48afd3-b6d3-4fc6-8900-226fac3e3941 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:30.192173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48afd3-b6d3-4fc6-8900-226fac3e3941 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:30.192280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48afd3-b6d3-4fc6-8900-226fac3e3941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:30.214089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6d48afd3-b6d3-4fc6-8900-226fac3e3941 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:30.215421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6d48afd3-b6d3-4fc6-8900-226fac3e3941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:30.379851 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2536/5045] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:30.382794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf3e68-3e7f-4634-8649-461f4806ecb5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:30.383090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf3e68-3e7f-4634-8649-461f4806ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:30.383377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf3e68-3e7f-4634-8649-461f4806ecb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:30.422213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-80bf3e68-3e7f-4634-8649-461f4806ecb5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:30.425546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-80bf3e68-3e7f-4634-8649-461f4806ecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:30.444393 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2510/5046] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:30.445670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48afd3-b6d3-4fc6-8900-226fac3e3941 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:30.458283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48afd3-b6d3-4fc6-8900-226fac3e3941 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:30.484995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bbd7e-bea0-4d64-9166-ba2db362f7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:30.485887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bbd7e-bea0-4d64-9166-ba2db362f7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:30.486380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bbd7e-bea0-4d64-9166-ba2db362f7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:30.486921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bbd7e-bea0-4d64-9166-ba2db362f7d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:30.487815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bbd7e-bea0-4d64-9166-ba2db362f7d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:23:30.488348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bbd7e-bea0-4d64-9166-ba2db362f7d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:30.490250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bbd7e-bea0-4d64-9166-ba2db362f7d2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:30.521111 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2537/5047] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:23:30.525775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf3e68-3e7f-4634-8649-461f4806ecb5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:30.538140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf3e68-3e7f-4634-8649-461f4806ecb5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:30.555647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14adca-ac73-40e9-92af-e9123824befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:30.556716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14adca-ac73-40e9-92af-e9123824befc admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:30.557217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14adca-ac73-40e9-92af-e9123824befc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:30.557732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14adca-ac73-40e9-92af-e9123824befc admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:30.558785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14adca-ac73-40e9-92af-e9123824befc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:30.561220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14adca-ac73-40e9-92af-e9123824befc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:30.670727 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2511/5048] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:23:30 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:23:30.674801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bbd7e-bea0-4d64-9166-ba2db362f7d2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:30.693194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bbd7e-bea0-4d64-9166-ba2db362f7d2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:30.853394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b298e-2ed6-49b6-912b-a55e582d2c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:30.854523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b298e-2ed6-49b6-912b-a55e582d2c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:30.855072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b298e-2ed6-49b6-912b-a55e582d2c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:30.866808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b298e-2ed6-49b6-912b-a55e582d2c2c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:30.867590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b298e-2ed6-49b6-912b-a55e582d2c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:30.871649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b298e-2ed6-49b6-912b-a55e582d2c2c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:30.922206 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2538/5049] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:30 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:23:30.923647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14adca-ac73-40e9-92af-e9123824befc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:30.939221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14adca-ac73-40e9-92af-e9123824befc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:30.979821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff94004-787f-44cf-a244-bdd40655cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:30.980648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94004-787f-44cf-a244-bdd40655cc84 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:30.981006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94004-787f-44cf-a244-bdd40655cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:30.981385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94004-787f-44cf-a244-bdd40655cc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:30.982164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff94004-787f-44cf-a244-bdd40655cc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:30.983974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff94004-787f-44cf-a244-bdd40655cc84 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:31.014313 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2512/5050] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:31.015842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b298e-2ed6-49b6-912b-a55e582d2c2c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:31.040492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b298e-2ed6-49b6-912b-a55e582d2c2c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:31.047382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a0515-1489-4d13-b75c-9efd4ec62416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:31.048472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a0515-1489-4d13-b75c-9efd4ec62416 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:31.048913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a0515-1489-4d13-b75c-9efd4ec62416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:31.049346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a0515-1489-4d13-b75c-9efd4ec62416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:31.053175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a0515-1489-4d13-b75c-9efd4ec62416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:31.058330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a0515-1489-4d13-b75c-9efd4ec62416 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:31.081364 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2539/5051] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:31.081621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff94004-787f-44cf-a244-bdd40655cc84 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:31.109937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff94004-787f-44cf-a244-bdd40655cc84 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:31.126856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86891d20-6a0a-497c-8cab-ec7449bc26be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:31.127559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891d20-6a0a-497c-8cab-ec7449bc26be admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:31.127842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891d20-6a0a-497c-8cab-ec7449bc26be admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:31.128122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891d20-6a0a-497c-8cab-ec7449bc26be admin admin] PATH_INFO: `/v3/projects/1babd622e3ae46269f04b650d2488839/users/3cefb853b0cb4c25b99de3a552eabc62/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:31.162285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86891d20-6a0a-497c-8cab-ec7449bc26be admin admin] RBAC: Authorizing `identity:create_grant(project_id=1babd622e3ae46269f04b650d2488839, user_id=3cefb853b0cb4c25b99de3a552eabc62, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:31.165129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86891d20-6a0a-497c-8cab-ec7449bc26be admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:31.174629 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:31.223678 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2513/5052] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:31 2022] PUT /identity/v3/projects/1babd622e3ae46269f04b650d2488839/users/3cefb853b0cb4c25b99de3a552eabc62/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:31.232347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592c118-9313-47f6-be9e-2ac9714fe620 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:31.233394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592c118-9313-47f6-be9e-2ac9714fe620 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:31.233851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592c118-9313-47f6-be9e-2ac9714fe620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:31.307569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4592c118-9313-47f6-be9e-2ac9714fe620 None None] MFA Rules not processed for user `3cefb853b0cb4c25b99de3a552eabc62`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:31.310456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4592c118-9313-47f6-be9e-2ac9714fe620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:31.319821 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:31.513937 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2540/5053] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:31.526883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86891d20-6a0a-497c-8cab-ec7449bc26be admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:31.528618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-86891d20-6a0a-497c-8cab-ec7449bc26be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:31.698386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86891d20-6a0a-497c-8cab-ec7449bc26be admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:31.709226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc3fdc-bed1-451a-ada5-b0910119cebc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:31.709859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc3fdc-bed1-451a-ada5-b0910119cebc service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:31.710137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc3fdc-bed1-451a-ada5-b0910119cebc service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:31.710408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc3fdc-bed1-451a-ada5-b0910119cebc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:31.724975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc3fdc-bed1-451a-ada5-b0910119cebc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:31.728718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc3fdc-bed1-451a-ada5-b0910119cebc service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:31.758931 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2514/5054] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:33.538882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592c118-9313-47f6-be9e-2ac9714fe620 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:33.688604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592c118-9313-47f6-be9e-2ac9714fe620 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:33.695127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:33.695891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:33.696186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:33.696498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] PATH_INFO: `/v3/users/3cefb853b0cb4c25b99de3a552eabc62` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:33.698267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cefb853b0cb4c25b99de3a552eabc62)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:33.701082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:33.820544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cefb853b0cb4c25b99de3a552eabc62'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:33.871802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cefb853b0cb4c25b99de3a552eabc62'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:33.877132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cefb853b0cb4c25b99de3a552eabc62'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:33.895418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cefb853b0cb4c25b99de3a552eabc62'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:33.897681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cefb853b0cb4c25b99de3a552eabc62'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:33.929278 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2541/5055] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:33 2022] DELETE /identity/v3/users/3cefb853b0cb4c25b99de3a552eabc62 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:33.935461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43d658-2f80-40ef-a6a6-dd956a96bfd7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:33.935998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43d658-2f80-40ef-a6a6-dd956a96bfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:33.935998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43d658-2f80-40ef-a6a6-dd956a96bfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:33.964546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ed43d658-2f80-40ef-a6a6-dd956a96bfd7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:33.966240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed43d658-2f80-40ef-a6a6-dd956a96bfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:34.081839 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2515/5056] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:34.093992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:34.095369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:34.148332 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:34.221017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc86d-1c2a-4ca3-bacf-3d662585c2ce admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:34.226797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b86458-c80d-4bf1-ab31-c8bbed57fc02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:34.227427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b86458-c80d-4bf1-ab31-c8bbed57fc02 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:34.227710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b86458-c80d-4bf1-ab31-c8bbed57fc02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:34.228845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b86458-c80d-4bf1-ab31-c8bbed57fc02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:34.250640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b86458-c80d-4bf1-ab31-c8bbed57fc02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:34.252108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b86458-c80d-4bf1-ab31-c8bbed57fc02 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:34.274861 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2542/5057] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:35.049510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43d658-2f80-40ef-a6a6-dd956a96bfd7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:35.055764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed43d658-2f80-40ef-a6a6-dd956a96bfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:35.108229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43d658-2f80-40ef-a6a6-dd956a96bfd7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:35.132971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:35.135246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:35.136289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:35.136958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] PATH_INFO: `/v3/projects/1babd622e3ae46269f04b650d2488839` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:35.140856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] RBAC: Authorizing `identity:delete_project(project_id=1babd622e3ae46269f04b650d2488839)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:35.154050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:35.330150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1babd622e3ae46269f04b650d2488839', 'request_id': 'req-0c370b5c-4595-4278-97d4-8795c4d624be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:35.355629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1babd622e3ae46269f04b650d2488839', 'request_id': 'req-0c370b5c-4595-4278-97d4-8795c4d624be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:35.373707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1babd622e3ae46269f04b650d2488839', 'request_id': 'req-0c370b5c-4595-4278-97d4-8795c4d624be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:35.401460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] The token cache is being invalidate because project 1babd622e3ae46269f04b650d2488839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:35.401840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:35.407027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c370b5c-4595-4278-97d4-8795c4d624be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:35.419138 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2516/5058] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:35 2022] DELETE /identity/v3/projects/1babd622e3ae46269f04b650d2488839 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:35.423915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e703e-c6bd-420a-90c8-323aa0b0051b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:35.425356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e703e-c6bd-420a-90c8-323aa0b0051b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:35.425793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e703e-c6bd-420a-90c8-323aa0b0051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:35.471315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-594e703e-c6bd-420a-90c8-323aa0b0051b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:35.474577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-594e703e-c6bd-420a-90c8-323aa0b0051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:35.649792 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2543/5059] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:35.658062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eee1c-49e3-4692-8605-647a16061d9a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:35.658584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eee1c-49e3-4692-8605-647a16061d9a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:35.659061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eee1c-49e3-4692-8605-647a16061d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:35.707456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3b6eee1c-49e3-4692-8605-647a16061d9a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:35.708795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3b6eee1c-49e3-4692-8605-647a16061d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:35.735875 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2517/5060] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:35.737060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e703e-c6bd-420a-90c8-323aa0b0051b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:35.749867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e703e-c6bd-420a-90c8-323aa0b0051b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:35.781780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245a88c-996f-4944-bc8c-a5d697610ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:35.783076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245a88c-996f-4944-bc8c-a5d697610ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:35.783464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245a88c-996f-4944-bc8c-a5d697610ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:35.783971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245a88c-996f-4944-bc8c-a5d697610ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:35.784876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245a88c-996f-4944-bc8c-a5d697610ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:23:35.785287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245a88c-996f-4944-bc8c-a5d697610ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:35.787063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245a88c-996f-4944-bc8c-a5d697610ddb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:35.811509 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2544/5061] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:35.812784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eee1c-49e3-4692-8605-647a16061d9a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:35.820077 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:35.830267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eee1c-49e3-4692-8605-647a16061d9a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:35.841301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea25ee8-72c9-49f7-a488-2e2a7f6c2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:35.842031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea25ee8-72c9-49f7-a488-2e2a7f6c2098 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:35.842379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea25ee8-72c9-49f7-a488-2e2a7f6c2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:35.843171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea25ee8-72c9-49f7-a488-2e2a7f6c2098 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:35.843522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea25ee8-72c9-49f7-a488-2e2a7f6c2098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:35.845510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea25ee8-72c9-49f7-a488-2e2a7f6c2098 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:35.940133 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2518/5062] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:23:35 2022] POST /identity/v3/projects => generated 407 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:35.941479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245a88c-996f-4944-bc8c-a5d697610ddb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:35.961934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245a88c-996f-4944-bc8c-a5d697610ddb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:36.203481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf6109-cac4-4273-95e5-111b417319d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:36.204436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf6109-cac4-4273-95e5-111b417319d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:36.205061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf6109-cac4-4273-95e5-111b417319d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:36.205489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf6109-cac4-4273-95e5-111b417319d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:36.206289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf6109-cac4-4273-95e5-111b417319d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:36.210179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf6109-cac4-4273-95e5-111b417319d8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:36.272141 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2545/5063] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:35 2022] POST /identity/v3/users => generated 304 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:36.275919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea25ee8-72c9-49f7-a488-2e2a7f6c2098 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:36.297429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea25ee8-72c9-49f7-a488-2e2a7f6c2098 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:36.315321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8f65-1c70-4be7-b775-48a472e04b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:36.316180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8f65-1c70-4be7-b775-48a472e04b9d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:36.316647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8f65-1c70-4be7-b775-48a472e04b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:36.317080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8f65-1c70-4be7-b775-48a472e04b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:36.317910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee8f65-1c70-4be7-b775-48a472e04b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:36.319772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee8f65-1c70-4be7-b775-48a472e04b9d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:36.355184 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2519/5064] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:36.356301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf6109-cac4-4273-95e5-111b417319d8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:36.372585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf6109-cac4-4273-95e5-111b417319d8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:36.389144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324cfe2-09b3-4732-8cf2-84a4ac10b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:36.389777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324cfe2-09b3-4732-8cf2-84a4ac10b7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:36.390057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324cfe2-09b3-4732-8cf2-84a4ac10b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:36.393540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324cfe2-09b3-4732-8cf2-84a4ac10b7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:36.393910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324cfe2-09b3-4732-8cf2-84a4ac10b7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:36.399384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324cfe2-09b3-4732-8cf2-84a4ac10b7c6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:36.432545 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2546/5065] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:36.437207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8f65-1c70-4be7-b775-48a472e04b9d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:36.449343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8f65-1c70-4be7-b775-48a472e04b9d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:36.473257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea939-0d22-4b43-bf7c-16cb17fa43ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:36.474313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea939-0d22-4b43-bf7c-16cb17fa43ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:36.474826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea939-0d22-4b43-bf7c-16cb17fa43ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:36.475295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea939-0d22-4b43-bf7c-16cb17fa43ed admin admin] PATH_INFO: `/v3/projects/c5ed4498e56f4b9b98ae9846200d5ed4/users/05308e04fdb84845bc8e1a08e6ede801/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:36.537195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea939-0d22-4b43-bf7c-16cb17fa43ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ed4498e56f4b9b98ae9846200d5ed4, user_id=05308e04fdb84845bc8e1a08e6ede801, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:36.540190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea939-0d22-4b43-bf7c-16cb17fa43ed admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:36.575023 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2520/5066] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:36 2022] PUT /identity/v3/projects/c5ed4498e56f4b9b98ae9846200d5ed4/users/05308e04fdb84845bc8e1a08e6ede801/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:36.590332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89413f9-c5fb-4350-8c5b-233e8e00f5fc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:36.590332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89413f9-c5fb-4350-8c5b-233e8e00f5fc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:36.590332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89413f9-c5fb-4350-8c5b-233e8e00f5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:36.656672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c89413f9-c5fb-4350-8c5b-233e8e00f5fc None None] MFA Rules not processed for user `05308e04fdb84845bc8e1a08e6ede801`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:36.657704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c89413f9-c5fb-4350-8c5b-233e8e00f5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:36.719524 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:36.955192 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2547/5067] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:36 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:36.965863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea939-0d22-4b43-bf7c-16cb17fa43ed admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:37.106855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea939-0d22-4b43-bf7c-16cb17fa43ed admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:37.117127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c58bfb-2a73-4f4f-b6b2-2475556b63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:37.118378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c58bfb-2a73-4f4f-b6b2-2475556b63b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:37.119505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c58bfb-2a73-4f4f-b6b2-2475556b63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:37.119505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c58bfb-2a73-4f4f-b6b2-2475556b63b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:37.120582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c58bfb-2a73-4f4f-b6b2-2475556b63b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:37.124490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c58bfb-2a73-4f4f-b6b2-2475556b63b1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:37.192644 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2521/5068] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:23:36 2022] POST /identity/v3/projects => generated 407 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:37.195157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89413f9-c5fb-4350-8c5b-233e8e00f5fc None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:37.214169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89413f9-c5fb-4350-8c5b-233e8e00f5fc None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:37.350188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ac97-f08f-4029-b22b-271832689b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:37.350853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ac97-f08f-4029-b22b-271832689b62 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:37.354118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ac97-f08f-4029-b22b-271832689b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:37.354422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ac97-f08f-4029-b22b-271832689b62 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:37.355235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ac97-f08f-4029-b22b-271832689b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:37.359218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ac97-f08f-4029-b22b-271832689b62 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:37.408945 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2548/5069] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:37 2022] POST /identity/v3/users => generated 310 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:37.412384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c58bfb-2a73-4f4f-b6b2-2475556b63b1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:37.430421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c58bfb-2a73-4f4f-b6b2-2475556b63b1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:37.446261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8924fb-e4d6-4694-ac5e-2c15cb5db76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:37.447238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8924fb-e4d6-4694-ac5e-2c15cb5db76f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:37.448077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8924fb-e4d6-4694-ac5e-2c15cb5db76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:37.448586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8924fb-e4d6-4694-ac5e-2c15cb5db76f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:37.449898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8924fb-e4d6-4694-ac5e-2c15cb5db76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:37.451877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8924fb-e4d6-4694-ac5e-2c15cb5db76f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:37.482980 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2522/5070] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:37.486809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ac97-f08f-4029-b22b-271832689b62 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:37.502453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ac97-f08f-4029-b22b-271832689b62 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:37.512644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752f864-8123-446e-bee1-184aced2cbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:37.514617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f864-8123-446e-bee1-184aced2cbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:37.514843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f864-8123-446e-bee1-184aced2cbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:37.515244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f864-8123-446e-bee1-184aced2cbeb admin admin] PATH_INFO: `/v3/projects/bdfc29f3228c4da1a762f7def3ce4aa8/users/4a40ba824ffc413da0b859c934188638/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:37.606796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752f864-8123-446e-bee1-184aced2cbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfc29f3228c4da1a762f7def3ce4aa8, user_id=4a40ba824ffc413da0b859c934188638, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:37.609951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752f864-8123-446e-bee1-184aced2cbeb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:37.665214 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2549/5071] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:37 2022] PUT /identity/v3/projects/bdfc29f3228c4da1a762f7def3ce4aa8/users/4a40ba824ffc413da0b859c934188638/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:37.670008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8924fb-e4d6-4694-ac5e-2c15cb5db76f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:37.686222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8924fb-e4d6-4694-ac5e-2c15cb5db76f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:37.836914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fcc0-371b-4869-88d3-a2eee8968140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:37.838426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fcc0-371b-4869-88d3-a2eee8968140 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:37.838820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fcc0-371b-4869-88d3-a2eee8968140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:37.839198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fcc0-371b-4869-88d3-a2eee8968140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:37.840077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62fcc0-371b-4869-88d3-a2eee8968140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:37.850770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62fcc0-371b-4869-88d3-a2eee8968140 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:37.881254 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2523/5072] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:37.882643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752f864-8123-446e-bee1-184aced2cbeb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:37.904664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752f864-8123-446e-bee1-184aced2cbeb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:37.923566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c4cd2-03c8-432a-aef5-4ab626e56a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:37.924261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c4cd2-03c8-432a-aef5-4ab626e56a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:37.924537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c4cd2-03c8-432a-aef5-4ab626e56a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:37.924815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c4cd2-03c8-432a-aef5-4ab626e56a08 admin admin] PATH_INFO: `/v3/projects/bdfc29f3228c4da1a762f7def3ce4aa8/users/4a40ba824ffc413da0b859c934188638/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:37.935127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c4cd2-03c8-432a-aef5-4ab626e56a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfc29f3228c4da1a762f7def3ce4aa8, user_id=4a40ba824ffc413da0b859c934188638, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:37.944279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c4cd2-03c8-432a-aef5-4ab626e56a08 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:37.995963 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2550/5073] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:37 2022] PUT /identity/v3/projects/bdfc29f3228c4da1a762f7def3ce4aa8/users/4a40ba824ffc413da0b859c934188638/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:38.007541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646a982-5252-425e-95e4-176979d5ad6a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:38.008295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646a982-5252-425e-95e4-176979d5ad6a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:38.008828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646a982-5252-425e-95e4-176979d5ad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:38.065834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8646a982-5252-425e-95e4-176979d5ad6a None None] MFA Rules not processed for user `4a40ba824ffc413da0b859c934188638`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:38.067447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8646a982-5252-425e-95e4-176979d5ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:38.093273 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:38.284421 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2524/5074] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:38 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:38.433260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c4cd2-03c8-432a-aef5-4ab626e56a08 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:38.437031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-893c4cd2-03c8-432a-aef5-4ab626e56a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:38.690865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c4cd2-03c8-432a-aef5-4ab626e56a08 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:38.696681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588176-4ccf-4ed9-8f6e-5eb566aae936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:38.697642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588176-4ccf-4ed9-8f6e-5eb566aae936 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:38.697926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588176-4ccf-4ed9-8f6e-5eb566aae936 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:38.698200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588176-4ccf-4ed9-8f6e-5eb566aae936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:38.783694 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:38.840748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588176-4ccf-4ed9-8f6e-5eb566aae936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:38.842225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588176-4ccf-4ed9-8f6e-5eb566aae936 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:38.884572 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2551/5075] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:38 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:39.194805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646a982-5252-425e-95e4-176979d5ad6a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:39.197262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8646a982-5252-425e-95e4-176979d5ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:39.355948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646a982-5252-425e-95e4-176979d5ad6a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:39.361382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8163f-04d1-4bf8-9ecb-2861ce5f8b08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:39.362014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8163f-04d1-4bf8-9ecb-2861ce5f8b08 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:39.362297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8163f-04d1-4bf8-9ecb-2861ce5f8b08 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:39.362578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8163f-04d1-4bf8-9ecb-2861ce5f8b08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:39.372525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d9d8163f-04d1-4bf8-9ecb-2861ce5f8b08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:39.398234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8163f-04d1-4bf8-9ecb-2861ce5f8b08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:39.400398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8163f-04d1-4bf8-9ecb-2861ce5f8b08 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:39.425843 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2525/5076] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:39.975513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e293a-d56d-49c6-baca-865e9e78186b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:39.976065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e293a-d56d-49c6-baca-865e9e78186b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:39.976354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e293a-d56d-49c6-baca-865e9e78186b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:40.031721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-142e293a-d56d-49c6-baca-865e9e78186b None None] MFA Rules not processed for user `12321c4eed38481bb09670364f1716c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:40.033114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-142e293a-d56d-49c6-baca-865e9e78186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:40.208051 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2552/5077] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:40.219950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8163f-04d1-4bf8-9ecb-2861ce5f8b08 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:40.222901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d9d8163f-04d1-4bf8-9ecb-2861ce5f8b08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:40.431289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8163f-04d1-4bf8-9ecb-2861ce5f8b08 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:40.462103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f771b4b-0a20-4ea0-a603-b65956fc14b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:40.466092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f771b4b-0a20-4ea0-a603-b65956fc14b4 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:40.466641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f771b4b-0a20-4ea0-a603-b65956fc14b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:40.467151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f771b4b-0a20-4ea0-a603-b65956fc14b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:40.490133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f771b4b-0a20-4ea0-a603-b65956fc14b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:40.492127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f771b4b-0a20-4ea0-a603-b65956fc14b4 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:40.517628 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2526/5078] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:41.595751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e293a-d56d-49c6-baca-865e9e78186b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:41.618179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e293a-d56d-49c6-baca-865e9e78186b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:41.632014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9c26b-80b3-4205-afb9-98f3edf067a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:41.632648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9c26b-80b3-4205-afb9-98f3edf067a2 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:41.635304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9c26b-80b3-4205-afb9-98f3edf067a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:41.635589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9c26b-80b3-4205-afb9-98f3edf067a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:41.658305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9c26b-80b3-4205-afb9-98f3edf067a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:41.660254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9c26b-80b3-4205-afb9-98f3edf067a2 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:41.683982 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2553/5079] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:41 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:45.546894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733900f-7124-4502-b827-0a8d74d89b83 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:45.547433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733900f-7124-4502-b827-0a8d74d89b83 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:45.547433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733900f-7124-4502-b827-0a8d74d89b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:45.587280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a733900f-7124-4502-b827-0a8d74d89b83 None None] MFA Rules not processed for user `12321c4eed38481bb09670364f1716c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:45.588520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a733900f-7124-4502-b827-0a8d74d89b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:45.606334 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2527/5080] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:46.048270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9c26b-80b3-4205-afb9-98f3edf067a2 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:46.049826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b0b9c26b-80b3-4205-afb9-98f3edf067a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:46.198037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9c26b-80b3-4205-afb9-98f3edf067a2 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:46.210239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc50612-655d-4bb0-87a2-7d4a6486bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:46.211168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50612-655d-4bb0-87a2-7d4a6486bf5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:46.211721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50612-655d-4bb0-87a2-7d4a6486bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:46.213556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50612-655d-4bb0-87a2-7d4a6486bf5e admin admin] PATH_INFO: `/v3/users/99a3a1761393475fa6f7c95e95b8136b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:46.215323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc50612-655d-4bb0-87a2-7d4a6486bf5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a3a1761393475fa6f7c95e95b8136b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:46.217624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc50612-655d-4bb0-87a2-7d4a6486bf5e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:46.331547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fc50612-655d-4bb0-87a2-7d4a6486bf5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a3a1761393475fa6f7c95e95b8136b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:46.333236 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:46.404932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fc50612-655d-4bb0-87a2-7d4a6486bf5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a3a1761393475fa6f7c95e95b8136b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:46.419201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fc50612-655d-4bb0-87a2-7d4a6486bf5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a3a1761393475fa6f7c95e95b8136b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:46.436446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fc50612-655d-4bb0-87a2-7d4a6486bf5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a3a1761393475fa6f7c95e95b8136b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:46.438871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fc50612-655d-4bb0-87a2-7d4a6486bf5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a3a1761393475fa6f7c95e95b8136b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:46.480574 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2554/5081] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:23:46 2022] DELETE /identity/v3/users/99a3a1761393475fa6f7c95e95b8136b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:23:47.259112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733900f-7124-4502-b827-0a8d74d89b83 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:47.289063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733900f-7124-4502-b827-0a8d74d89b83 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:47.315883 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:47.505195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:47.507443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:47.509302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:47.531858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] PATH_INFO: `/v3/projects/cd04da83ed96424998ce30378767d820` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:47.535212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd04da83ed96424998ce30378767d820)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:47.572280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:47.708363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd04da83ed96424998ce30378767d820', 'request_id': 'req-ad17b1b2-7243-4107-b0b8-891fceecef2b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:47.750995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd04da83ed96424998ce30378767d820', 'request_id': 'req-ad17b1b2-7243-4107-b0b8-891fceecef2b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:47.789407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd04da83ed96424998ce30378767d820', 'request_id': 'req-ad17b1b2-7243-4107-b0b8-891fceecef2b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:47.822244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] The token cache is being invalidate because project cd04da83ed96424998ce30378767d820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:23:47.823084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:47.824135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ad17b1b2-7243-4107-b0b8-891fceecef2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:23:47.826869 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2528/5082] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:23:47 2022] DELETE /identity/v3/projects/cd04da83ed96424998ce30378767d820 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:47.832674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7cf86-a419-4f46-a6d9-91dfdb6e8784 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:47.833200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7cf86-a419-4f46-a6d9-91dfdb6e8784 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:47.833286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7cf86-a419-4f46-a6d9-91dfdb6e8784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:47.857076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-06c7cf86-a419-4f46-a6d9-91dfdb6e8784 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:47.858357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-06c7cf86-a419-4f46-a6d9-91dfdb6e8784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:47.942480 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2555/5083] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:47.951205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2b49-9a44-4800-9244-01782a1ceee5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:47.952130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2b49-9a44-4800-9244-01782a1ceee5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:47.952627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2b49-9a44-4800-9244-01782a1ceee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:47.997635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f61a2b49-9a44-4800-9244-01782a1ceee5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:47.999418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f61a2b49-9a44-4800-9244-01782a1ceee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:48.019704 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2529/5084] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:48.026566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7cf86-a419-4f46-a6d9-91dfdb6e8784 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:48.042632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7cf86-a419-4f46-a6d9-91dfdb6e8784 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:48.058966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93f5e9-5822-4030-b203-81128caf2c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:48.060237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f5e9-5822-4030-b203-81128caf2c03 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:48.062051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f5e9-5822-4030-b203-81128caf2c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:48.062567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f5e9-5822-4030-b203-81128caf2c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:48.063574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93f5e9-5822-4030-b203-81128caf2c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:23:48.064171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93f5e9-5822-4030-b203-81128caf2c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:48.066556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93f5e9-5822-4030-b203-81128caf2c03 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:48.086003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2b49-9a44-4800-9244-01782a1ceee5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:48.097635 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2556/5085] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:23:48.098033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2b49-9a44-4800-9244-01782a1ceee5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:48.106025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965026fc-8554-4e9a-b6ce-07c1e0a99462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:48.107015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965026fc-8554-4e9a-b6ce-07c1e0a99462 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:48.107566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965026fc-8554-4e9a-b6ce-07c1e0a99462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:48.108073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965026fc-8554-4e9a-b6ce-07c1e0a99462 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:48.108982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965026fc-8554-4e9a-b6ce-07c1e0a99462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:48.111284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965026fc-8554-4e9a-b6ce-07c1e0a99462 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:48.159967 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2530/5086] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:23:48 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:48.161869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93f5e9-5822-4030-b203-81128caf2c03 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:48.177903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93f5e9-5822-4030-b203-81128caf2c03 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:48.269286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebde9a6-218c-43a8-af0e-d180a31325fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:48.278477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebde9a6-218c-43a8-af0e-d180a31325fa admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:48.279796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebde9a6-218c-43a8-af0e-d180a31325fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:48.281208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebde9a6-218c-43a8-af0e-d180a31325fa admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:48.282089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebde9a6-218c-43a8-af0e-d180a31325fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:48.284474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebde9a6-218c-43a8-af0e-d180a31325fa admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:48.330436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965026fc-8554-4e9a-b6ce-07c1e0a99462 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:48.331160 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2557/5087] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:23:48 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:23:48.349176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965026fc-8554-4e9a-b6ce-07c1e0a99462 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:48.375581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e70ad-4883-43d8-9e8a-800d2db2cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:48.377222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e70ad-4883-43d8-9e8a-800d2db2cc2e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:48.377505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e70ad-4883-43d8-9e8a-800d2db2cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:48.387228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e70ad-4883-43d8-9e8a-800d2db2cc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:48.391140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e70ad-4883-43d8-9e8a-800d2db2cc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:48.392806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e70ad-4883-43d8-9e8a-800d2db2cc2e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:48.425902 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2531/5088] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:48.426974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebde9a6-218c-43a8-af0e-d180a31325fa admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:48.466398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebde9a6-218c-43a8-af0e-d180a31325fa admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:48.488441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218add91-5df6-4a05-ba59-5627e8a236d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:48.489250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218add91-5df6-4a05-ba59-5627e8a236d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:48.489803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218add91-5df6-4a05-ba59-5627e8a236d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:48.490241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218add91-5df6-4a05-ba59-5627e8a236d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:48.491084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218add91-5df6-4a05-ba59-5627e8a236d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:48.503480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218add91-5df6-4a05-ba59-5627e8a236d5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:48.519441 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2558/5089] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:23:48.523439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e70ad-4883-43d8-9e8a-800d2db2cc2e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:48.540474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e70ad-4883-43d8-9e8a-800d2db2cc2e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:48.550872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfad23-bffb-4bcc-adfa-0e97bd730a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:48.551811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfad23-bffb-4bcc-adfa-0e97bd730a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:48.552248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfad23-bffb-4bcc-adfa-0e97bd730a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:48.552676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfad23-bffb-4bcc-adfa-0e97bd730a81 admin admin] PATH_INFO: `/v3/projects/084a8da705e0434e8a008ffdd019f6e8/users/26e4e60bc26a4d229a85c9990e1730a5/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:48.596142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfad23-bffb-4bcc-adfa-0e97bd730a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084a8da705e0434e8a008ffdd019f6e8, user_id=26e4e60bc26a4d229a85c9990e1730a5, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:48.599165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfad23-bffb-4bcc-adfa-0e97bd730a81 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:48.623761 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2532/5090] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:23:48 2022] PUT /identity/v3/projects/084a8da705e0434e8a008ffdd019f6e8/users/26e4e60bc26a4d229a85c9990e1730a5/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:23:48.628889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e86af4-f6fb-43f4-ad54-d65d1030b482 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:48.629180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e86af4-f6fb-43f4-ad54-d65d1030b482 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:48.629461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e86af4-f6fb-43f4-ad54-d65d1030b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:48.666551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-21e86af4-f6fb-43f4-ad54-d65d1030b482 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:23:48.667969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-21e86af4-f6fb-43f4-ad54-d65d1030b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:48.755795 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:48.873645 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2559/5091] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:23:48.927973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfad23-bffb-4bcc-adfa-0e97bd730a81 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:48.932006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0abfad23-bffb-4bcc-adfa-0e97bd730a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:49.017686 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:49.052715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfad23-bffb-4bcc-adfa-0e97bd730a81 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:49.058286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ebd6b-70e0-42c7-a85a-3a9551ff746c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:49.059240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ebd6b-70e0-42c7-a85a-3a9551ff746c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:49.059519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ebd6b-70e0-42c7-a85a-3a9551ff746c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:49.059791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ebd6b-70e0-42c7-a85a-3a9551ff746c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:49.079293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ebd6b-70e0-42c7-a85a-3a9551ff746c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:49.084754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ebd6b-70e0-42c7-a85a-3a9551ff746c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:49.114937 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2533/5092] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:57.178136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e86af4-f6fb-43f4-ad54-d65d1030b482 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:23:57.182618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-21e86af4-f6fb-43f4-ad54-d65d1030b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:57.349872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e86af4-f6fb-43f4-ad54-d65d1030b482 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:23:57.369211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626b260-a484-4e74-a2ba-a620ecdf096a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:23:57.369884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626b260-a484-4e74-a2ba-a620ecdf096a service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:23:57.370350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626b260-a484-4e74-a2ba-a620ecdf096a service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:23:57.371019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626b260-a484-4e74-a2ba-a620ecdf096a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:23:57.375422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e626b260-a484-4e74-a2ba-a620ecdf096a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:23:57.422695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626b260-a484-4e74-a2ba-a620ecdf096a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:23:57.428831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626b260-a484-4e74-a2ba-a620ecdf096a service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:23:57.452136 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2560/5093] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:23:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:23:59.109477 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:03.467333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033fa11-8ea6-4478-b181-a94ba1eca9e6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:03.468330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033fa11-8ea6-4478-b181-a94ba1eca9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:03.468809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033fa11-8ea6-4478-b181-a94ba1eca9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:03.526386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f033fa11-8ea6-4478-b181-a94ba1eca9e6 None None] MFA Rules not processed for user `26e4e60bc26a4d229a85c9990e1730a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:03.527817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f033fa11-8ea6-4478-b181-a94ba1eca9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:03.698774 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2534/5094] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:03.709485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d761f-782a-499f-bee1-f3f40f0fe54e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:03.710292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d761f-782a-499f-bee1-f3f40f0fe54e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:03.711268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d761f-782a-499f-bee1-f3f40f0fe54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:03.771240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-331d761f-782a-499f-bee1-f3f40f0fe54e None None] MFA Rules not processed for user `26e4e60bc26a4d229a85c9990e1730a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:03.781461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-331d761f-782a-499f-bee1-f3f40f0fe54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:03.798854 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2561/5095] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:03.846031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033fa11-8ea6-4478-b181-a94ba1eca9e6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:03.847564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f033fa11-8ea6-4478-b181-a94ba1eca9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:04.007856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033fa11-8ea6-4478-b181-a94ba1eca9e6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:04.027209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03c52b-a0ce-4122-9b5c-25e6744b1964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:04.028047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c52b-a0ce-4122-9b5c-25e6744b1964 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:04.028587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c52b-a0ce-4122-9b5c-25e6744b1964 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:04.028726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c52b-a0ce-4122-9b5c-25e6744b1964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:04.062093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03c52b-a0ce-4122-9b5c-25e6744b1964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:04.064917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03c52b-a0ce-4122-9b5c-25e6744b1964 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:04.087130 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2535/5096] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:05.428269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d761f-782a-499f-bee1-f3f40f0fe54e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:05.430541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-331d761f-782a-499f-bee1-f3f40f0fe54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:05.453513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d761f-782a-499f-bee1-f3f40f0fe54e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:05.468281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:05.469153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:05.469586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:05.470029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] PATH_INFO: `/v3/users/05308e04fdb84845bc8e1a08e6ede801` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:05.471615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05308e04fdb84845bc8e1a08e6ede801)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:05.473784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:05.556067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05308e04fdb84845bc8e1a08e6ede801'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:05.582163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05308e04fdb84845bc8e1a08e6ede801'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:05.583989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05308e04fdb84845bc8e1a08e6ede801'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:05.598783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05308e04fdb84845bc8e1a08e6ede801'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:05.600328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05308e04fdb84845bc8e1a08e6ede801'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:05.620920 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2562/5097] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:05 2022] DELETE /identity/v3/users/05308e04fdb84845bc8e1a08e6ede801 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:05.624947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f022ba8-a880-4a21-b5db-afd7b292ba4b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:05.625748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f022ba8-a880-4a21-b5db-afd7b292ba4b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:05.626174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f022ba8-a880-4a21-b5db-afd7b292ba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:05.647944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8f022ba8-a880-4a21-b5db-afd7b292ba4b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:05.649450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8f022ba8-a880-4a21-b5db-afd7b292ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:05.765239 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2536/5098] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:05.810327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:05.811075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:05.883991 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:05.944254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04cb53-a7b1-4179-8d52-f866a1009cc5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:05.950353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f1cb-8ab0-4ef3-880e-5028f3865f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:05.951691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f1cb-8ab0-4ef3-880e-5028f3865f9b service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:05.954238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f1cb-8ab0-4ef3-880e-5028f3865f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:05.957709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f1cb-8ab0-4ef3-880e-5028f3865f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:05.985583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19f1cb-8ab0-4ef3-880e-5028f3865f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:05.987251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19f1cb-8ab0-4ef3-880e-5028f3865f9b service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:06.008441 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2563/5099] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:06.868359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f022ba8-a880-4a21-b5db-afd7b292ba4b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:06.869902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8f022ba8-a880-4a21-b5db-afd7b292ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:06.896788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f022ba8-a880-4a21-b5db-afd7b292ba4b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:06.929562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:06.930398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:06.930487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:06.930795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] PATH_INFO: `/v3/projects/c5ed4498e56f4b9b98ae9846200d5ed4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:06.935435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ed4498e56f4b9b98ae9846200d5ed4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:06.937418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:06.976857 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:07.073448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ed4498e56f4b9b98ae9846200d5ed4', 'request_id': 'req-57639407-601e-4f8d-8639-4cd3a854f714'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:07.093199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ed4498e56f4b9b98ae9846200d5ed4', 'request_id': 'req-57639407-601e-4f8d-8639-4cd3a854f714'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:07.103795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ed4498e56f4b9b98ae9846200d5ed4', 'request_id': 'req-57639407-601e-4f8d-8639-4cd3a854f714'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:07.129253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] The token cache is being invalidate because project c5ed4498e56f4b9b98ae9846200d5ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:07.129503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:07.130389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:07.136791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2537/5100] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:06 2022] DELETE /identity/v3/projects/c5ed4498e56f4b9b98ae9846200d5ed4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:07.138122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f1cb-8ab0-4ef3-880e-5028f3865f9b service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:07.156330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f1cb-8ab0-4ef3-880e-5028f3865f9b service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:07.275906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3bb1e-f1c9-493d-bd86-c3129da45dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:07.276605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3bb1e-f1c9-493d-bd86-c3129da45dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:07.276887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3bb1e-f1c9-493d-bd86-c3129da45dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:07.277159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3bb1e-f1c9-493d-bd86-c3129da45dc0 admin admin] PATH_INFO: `/v3/users/4a40ba824ffc413da0b859c934188638` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:07.283031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3bb1e-f1c9-493d-bd86-c3129da45dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a40ba824ffc413da0b859c934188638)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:07.284984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3bb1e-f1c9-493d-bd86-c3129da45dc0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:07.397369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8b3bb1e-f1c9-493d-bd86-c3129da45dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a40ba824ffc413da0b859c934188638'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:07.422554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8b3bb1e-f1c9-493d-bd86-c3129da45dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a40ba824ffc413da0b859c934188638'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:07.423685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8b3bb1e-f1c9-493d-bd86-c3129da45dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a40ba824ffc413da0b859c934188638'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:07.451962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8b3bb1e-f1c9-493d-bd86-c3129da45dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a40ba824ffc413da0b859c934188638'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:07.454289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8b3bb1e-f1c9-493d-bd86-c3129da45dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a40ba824ffc413da0b859c934188638'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:07.512626 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2564/5101] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:07 2022] DELETE /identity/v3/users/4a40ba824ffc413da0b859c934188638 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:24:08.244310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:08.245775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:08.280783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57639407-601e-4f8d-8639-4cd3a854f714 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:08.406784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:08.407707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:08.408145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:08.408603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] PATH_INFO: `/v3/projects/bdfc29f3228c4da1a762f7def3ce4aa8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:08.410068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdfc29f3228c4da1a762f7def3ce4aa8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:08.412651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:08.482977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdfc29f3228c4da1a762f7def3ce4aa8', 'request_id': 'req-42a0123c-5de2-4a8d-8e5a-11e092792e80'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:08.493957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdfc29f3228c4da1a762f7def3ce4aa8', 'request_id': 'req-42a0123c-5de2-4a8d-8e5a-11e092792e80'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:08.502318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdfc29f3228c4da1a762f7def3ce4aa8', 'request_id': 'req-42a0123c-5de2-4a8d-8e5a-11e092792e80'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:08.522218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] The token cache is being invalidate because project bdfc29f3228c4da1a762f7def3ce4aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:08.522562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:08.523936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-42a0123c-5de2-4a8d-8e5a-11e092792e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:08.525722 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2538/5102] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:08 2022] DELETE /identity/v3/projects/bdfc29f3228c4da1a762f7def3ce4aa8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:08.532934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9427a36-7ffe-49a2-bdef-ccfe12b2c2b5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:08.533969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9427a36-7ffe-49a2-bdef-ccfe12b2c2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:08.534461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9427a36-7ffe-49a2-bdef-ccfe12b2c2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:08.560227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c9427a36-7ffe-49a2-bdef-ccfe12b2c2b5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:08.561575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c9427a36-7ffe-49a2-bdef-ccfe12b2c2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:08.621919 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:08.652241 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2565/5103] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:08.660244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fdd9b-789f-468e-aa1e-8ed17d8b313b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:08.660749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fdd9b-789f-468e-aa1e-8ed17d8b313b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:08.661094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fdd9b-789f-468e-aa1e-8ed17d8b313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:08.698268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b68fdd9b-789f-468e-aa1e-8ed17d8b313b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:08.702515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b68fdd9b-789f-468e-aa1e-8ed17d8b313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:08.720294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9427a36-7ffe-49a2-bdef-ccfe12b2c2b5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:08.727985 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2539/5104] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:08.732989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9427a36-7ffe-49a2-bdef-ccfe12b2c2b5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:08.739491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2e4a-700e-40a2-9560-c9ccb4d96b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:08.740308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2e4a-700e-40a2-9560-c9ccb4d96b29 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:08.740744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2e4a-700e-40a2-9560-c9ccb4d96b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:08.741172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2e4a-700e-40a2-9560-c9ccb4d96b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:08.742659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f2e4a-700e-40a2-9560-c9ccb4d96b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:24:08.743126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f2e4a-700e-40a2-9560-c9ccb4d96b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:08.744919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f2e4a-700e-40a2-9560-c9ccb4d96b29 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:08.796447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fdd9b-789f-468e-aa1e-8ed17d8b313b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:08.804889 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2566/5105] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:24:08.814661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fdd9b-789f-468e-aa1e-8ed17d8b313b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:08.828991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e554401-00ff-472c-9ba5-66900e249cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:08.829683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554401-00ff-472c-9ba5-66900e249cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:08.830012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554401-00ff-472c-9ba5-66900e249cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:08.830289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554401-00ff-472c-9ba5-66900e249cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:08.830964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e554401-00ff-472c-9ba5-66900e249cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:08.833203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e554401-00ff-472c-9ba5-66900e249cf0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:08.904231 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:08.918218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2e4a-700e-40a2-9560-c9ccb4d96b29 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:08.925417 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2540/5106] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:08 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:08.930498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2e4a-700e-40a2-9560-c9ccb4d96b29 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:09.039327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a13ac-f22f-421b-96c9-64c532a36307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:09.040265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a13ac-f22f-421b-96c9-64c532a36307 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:09.040717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a13ac-f22f-421b-96c9-64c532a36307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:09.041150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a13ac-f22f-421b-96c9-64c532a36307 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:09.041973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a13ac-f22f-421b-96c9-64c532a36307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:09.044272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a13ac-f22f-421b-96c9-64c532a36307 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:09.094781 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2567/5107] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:08 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:09.098516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e554401-00ff-472c-9ba5-66900e249cf0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:09.112211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e554401-00ff-472c-9ba5-66900e249cf0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:09.119789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5e8b0-6834-4d94-ac84-a1623cdfd30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:09.122338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5e8b0-6834-4d94-ac84-a1623cdfd30f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:09.122798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5e8b0-6834-4d94-ac84-a1623cdfd30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:09.123242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5e8b0-6834-4d94-ac84-a1623cdfd30f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:09.124190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5e8b0-6834-4d94-ac84-a1623cdfd30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:09.126559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5e8b0-6834-4d94-ac84-a1623cdfd30f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:09.142161 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2541/5108] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:09.145872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a13ac-f22f-421b-96c9-64c532a36307 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:09.160277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a13ac-f22f-421b-96c9-64c532a36307 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:09.169019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb85ed-68f2-49cf-8d7f-4105e64af7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:09.169659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb85ed-68f2-49cf-8d7f-4105e64af7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:09.169944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb85ed-68f2-49cf-8d7f-4105e64af7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:09.170691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb85ed-68f2-49cf-8d7f-4105e64af7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:09.171034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb85ed-68f2-49cf-8d7f-4105e64af7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:09.173805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb85ed-68f2-49cf-8d7f-4105e64af7e1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:09.191372 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2568/5109] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:24:09.195866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5e8b0-6834-4d94-ac84-a1623cdfd30f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:09.209555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5e8b0-6834-4d94-ac84-a1623cdfd30f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:09.216079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbed11a-c899-4c77-b5df-fabadbf5dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:09.217113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbed11a-c899-4c77-b5df-fabadbf5dcab admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:09.217490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbed11a-c899-4c77-b5df-fabadbf5dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:09.217887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbed11a-c899-4c77-b5df-fabadbf5dcab admin admin] PATH_INFO: `/v3/projects/0145f40e656a4a78a82825a1d9af1986/users/708ebf724c924eaebdce2c2cdfe6ac96/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:09.247982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbed11a-c899-4c77-b5df-fabadbf5dcab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0145f40e656a4a78a82825a1d9af1986, user_id=708ebf724c924eaebdce2c2cdfe6ac96, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:09.252949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbed11a-c899-4c77-b5df-fabadbf5dcab admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:09.277991 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2542/5110] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:09 2022] PUT /identity/v3/projects/0145f40e656a4a78a82825a1d9af1986/users/708ebf724c924eaebdce2c2cdfe6ac96/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:09.289879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fcce0-d53b-497d-bd39-7546a149d175 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:09.290301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fcce0-d53b-497d-bd39-7546a149d175 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:09.290918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fcce0-d53b-497d-bd39-7546a149d175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:09.333841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-de7fcce0-d53b-497d-bd39-7546a149d175 None None] MFA Rules not processed for user `708ebf724c924eaebdce2c2cdfe6ac96`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:09.335677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-de7fcce0-d53b-497d-bd39-7546a149d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:09.442134 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2569/5111] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:09.488044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbed11a-c899-4c77-b5df-fabadbf5dcab admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:09.491102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fcbed11a-c899-4c77-b5df-fabadbf5dcab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:09.632138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbed11a-c899-4c77-b5df-fabadbf5dcab admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:09.643297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008dcd4-28a2-40d0-a9c4-f00c6ea84123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:09.644021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008dcd4-28a2-40d0-a9c4-f00c6ea84123 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:09.644611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008dcd4-28a2-40d0-a9c4-f00c6ea84123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:09.644877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008dcd4-28a2-40d0-a9c4-f00c6ea84123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:09.658705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008dcd4-28a2-40d0-a9c4-f00c6ea84123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:09.660933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008dcd4-28a2-40d0-a9c4-f00c6ea84123 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:09.673578 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2543/5112] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:10.120531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b8dff-65eb-4897-b18c-3fab9e7d0791 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:10.121237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b8dff-65eb-4897-b18c-3fab9e7d0791 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:10.121769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b8dff-65eb-4897-b18c-3fab9e7d0791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:10.149707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f85b8dff-65eb-4897-b18c-3fab9e7d0791 None None] MFA Rules not processed for user `bfae16ed6efb490d8d953bb78a5c1a00`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:10.151669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f85b8dff-65eb-4897-b18c-3fab9e7d0791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:10.202447 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:10.223389 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2570/5113] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:12.127665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008dcd4-28a2-40d0-a9c4-f00c6ea84123 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:12.141136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008dcd4-28a2-40d0-a9c4-f00c6ea84123 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:12.148210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b6626-77f9-48d6-aa30-0763faeac068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:12.148753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b6626-77f9-48d6-aa30-0763faeac068 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:12.149042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b6626-77f9-48d6-aa30-0763faeac068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:12.149320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b6626-77f9-48d6-aa30-0763faeac068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:12.151356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b7b6626-77f9-48d6-aa30-0763faeac068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:12.168565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b6626-77f9-48d6-aa30-0763faeac068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:12.170236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b6626-77f9-48d6-aa30-0763faeac068 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:12.182327 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2544/5114] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:20.221081 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:22.175553 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=47,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:22.253342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b8dff-65eb-4897-b18c-3fab9e7d0791 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:22.256167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f85b8dff-65eb-4897-b18c-3fab9e7d0791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:22.337200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b8dff-65eb-4897-b18c-3fab9e7d0791 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:22.343831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:22.344481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:22.344767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:22.345044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] PATH_INFO: `/v3/users/7afff6b6dba543bca8e7bab8446d3870` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:22.354159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7afff6b6dba543bca8e7bab8446d3870)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:22.357710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:22.426624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7afff6b6dba543bca8e7bab8446d3870'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:22.440544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7afff6b6dba543bca8e7bab8446d3870'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:22.441263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7afff6b6dba543bca8e7bab8446d3870'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:22.450987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7afff6b6dba543bca8e7bab8446d3870'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:22.451666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7afff6b6dba543bca8e7bab8446d3870'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:22.465054 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2571/5115] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:22 2022] DELETE /identity/v3/users/7afff6b6dba543bca8e7bab8446d3870 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:22.469339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dfc5b-9b3b-4d5a-956a-0d56232c370a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:22.469656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dfc5b-9b3b-4d5a-956a-0d56232c370a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:22.469969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dfc5b-9b3b-4d5a-956a-0d56232c370a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:22.489170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-de8dfc5b-9b3b-4d5a-956a-0d56232c370a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:22.490307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de8dfc5b-9b3b-4d5a-956a-0d56232c370a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:22.551138 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2545/5116] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:22.561733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:22.563289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:22.624531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510b185-2760-446a-9592-08604af1d674 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:22.628419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459edc5-ac00-4c4c-bf40-357de268c0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:22.629040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459edc5-ac00-4c4c-bf40-357de268c0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:22.629325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459edc5-ac00-4c4c-bf40-357de268c0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:22.629598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459edc5-ac00-4c4c-bf40-357de268c0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:22.639120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459edc5-ac00-4c4c-bf40-357de268c0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:22.640567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459edc5-ac00-4c4c-bf40-357de268c0a0 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:22.651195 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2572/5117] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:22.828987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dfc5b-9b3b-4d5a-956a-0d56232c370a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:22.830792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de8dfc5b-9b3b-4d5a-956a-0d56232c370a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:22.847583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dfc5b-9b3b-4d5a-956a-0d56232c370a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:22.856448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:22.857681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:22.858002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:22.858907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] PATH_INFO: `/v3/projects/f573b3c53b8d41c8bcc6c913a210c34e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:22.859996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f573b3c53b8d41c8bcc6c913a210c34e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:22.862001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:22.930565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f573b3c53b8d41c8bcc6c913a210c34e', 'request_id': 'req-c5e612b9-658f-45ce-bb4f-fe24a84914c1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:22.951871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f573b3c53b8d41c8bcc6c913a210c34e', 'request_id': 'req-c5e612b9-658f-45ce-bb4f-fe24a84914c1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:22.960401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f573b3c53b8d41c8bcc6c913a210c34e', 'request_id': 'req-c5e612b9-658f-45ce-bb4f-fe24a84914c1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:22.991646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] The token cache is being invalidate because project f573b3c53b8d41c8bcc6c913a210c34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:22.991946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:22.993796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c5e612b9-658f-45ce-bb4f-fe24a84914c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:23.001564 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2546/5118] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:22 2022] DELETE /identity/v3/projects/f573b3c53b8d41c8bcc6c913a210c34e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:23.005401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290986-9603-4139-b64a-629bd2d9d6f3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:23.005698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290986-9603-4139-b64a-629bd2d9d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:23.005976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290986-9603-4139-b64a-629bd2d9d6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:23.041171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ac290986-9603-4139-b64a-629bd2d9d6f3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:23.043387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ac290986-9603-4139-b64a-629bd2d9d6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:23.086168 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:23.161428 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2573/5119] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:23.169772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a8e9d-4036-49e7-96ee-aaf8a9b146a8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:23.170426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a8e9d-4036-49e7-96ee-aaf8a9b146a8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:23.170968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a8e9d-4036-49e7-96ee-aaf8a9b146a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:23.197881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c48a8e9d-4036-49e7-96ee-aaf8a9b146a8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:23.199123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c48a8e9d-4036-49e7-96ee-aaf8a9b146a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:23.213489 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2547/5120] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:23.214841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac290986-9603-4139-b64a-629bd2d9d6f3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:23.227355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac290986-9603-4139-b64a-629bd2d9d6f3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:23.232222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129eac1-b99a-4317-b10e-7a445f90810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:23.232860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129eac1-b99a-4317-b10e-7a445f90810f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:23.233142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129eac1-b99a-4317-b10e-7a445f90810f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:23.233444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129eac1-b99a-4317-b10e-7a445f90810f admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:23.234098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129eac1-b99a-4317-b10e-7a445f90810f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:24:23.234631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129eac1-b99a-4317-b10e-7a445f90810f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:23.236035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129eac1-b99a-4317-b10e-7a445f90810f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:23.251343 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2574/5121] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:24:23.254993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a8e9d-4036-49e7-96ee-aaf8a9b146a8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:23.267311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a8e9d-4036-49e7-96ee-aaf8a9b146a8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:23.283117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7bb07-8746-4cc4-b797-2e742fcecab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:23.284501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7bb07-8746-4cc4-b797-2e742fcecab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:23.284965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7bb07-8746-4cc4-b797-2e742fcecab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:23.285628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7bb07-8746-4cc4-b797-2e742fcecab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:23.286497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7bb07-8746-4cc4-b797-2e742fcecab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:23.288876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7bb07-8746-4cc4-b797-2e742fcecab7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:23.351223 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2548/5122] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:23 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:23.355541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129eac1-b99a-4317-b10e-7a445f90810f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:23.370546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129eac1-b99a-4317-b10e-7a445f90810f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:23.489462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6f4e7-f990-4f05-8bc3-d5f0493836a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:23.489462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6f4e7-f990-4f05-8bc3-d5f0493836a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:23.489462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6f4e7-f990-4f05-8bc3-d5f0493836a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:23.489462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6f4e7-f990-4f05-8bc3-d5f0493836a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:23.490007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6f4e7-f990-4f05-8bc3-d5f0493836a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:23.493926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6f4e7-f990-4f05-8bc3-d5f0493836a9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:23.546642 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2575/5123] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:23 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:23.552995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7bb07-8746-4cc4-b797-2e742fcecab7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:23.570032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7bb07-8746-4cc4-b797-2e742fcecab7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:23.610673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1174fb3-c569-4b60-b508-ca3e43493adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:23.611686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1174fb3-c569-4b60-b508-ca3e43493adb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:23.612175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1174fb3-c569-4b60-b508-ca3e43493adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:23.612665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1174fb3-c569-4b60-b508-ca3e43493adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:23.613528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1174fb3-c569-4b60-b508-ca3e43493adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:23.616342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1174fb3-c569-4b60-b508-ca3e43493adb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:23.638900 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2549/5124] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:23.642954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6f4e7-f990-4f05-8bc3-d5f0493836a9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:23.698441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6f4e7-f990-4f05-8bc3-d5f0493836a9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:23.713509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57065fc-5102-4b1c-9e3b-e274761b38ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:23.714152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57065fc-5102-4b1c-9e3b-e274761b38ca admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:23.714439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57065fc-5102-4b1c-9e3b-e274761b38ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:23.714855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57065fc-5102-4b1c-9e3b-e274761b38ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:23.715522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57065fc-5102-4b1c-9e3b-e274761b38ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:23.721313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57065fc-5102-4b1c-9e3b-e274761b38ca admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:23.737515 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2576/5125] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:23.746818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1174fb3-c569-4b60-b508-ca3e43493adb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:23.770109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1174fb3-c569-4b60-b508-ca3e43493adb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:23.802532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c9077-e44a-41f6-a7cd-9b77c7605738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:23.803761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9077-e44a-41f6-a7cd-9b77c7605738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:23.804452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9077-e44a-41f6-a7cd-9b77c7605738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:23.804833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9077-e44a-41f6-a7cd-9b77c7605738 admin admin] PATH_INFO: `/v3/projects/359a9a2fb8b7443a991ca17fe389eaa2/users/e294e38022bf430892f87be160200f7e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:23.843515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c9077-e44a-41f6-a7cd-9b77c7605738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=359a9a2fb8b7443a991ca17fe389eaa2, user_id=e294e38022bf430892f87be160200f7e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:23.846522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c9077-e44a-41f6-a7cd-9b77c7605738 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:23.869514 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2550/5126] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:23 2022] PUT /identity/v3/projects/359a9a2fb8b7443a991ca17fe389eaa2/users/e294e38022bf430892f87be160200f7e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:23.883657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305b373-0409-47ca-b968-890dbfe265a8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:23.883657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305b373-0409-47ca-b968-890dbfe265a8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:23.883657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305b373-0409-47ca-b968-890dbfe265a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:23.939336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8305b373-0409-47ca-b968-890dbfe265a8 None None] MFA Rules not processed for user `e294e38022bf430892f87be160200f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:23.942907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8305b373-0409-47ca-b968-890dbfe265a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:24.084970 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2577/5127] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:24.200737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c9077-e44a-41f6-a7cd-9b77c7605738 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:24.202663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e55c9077-e44a-41f6-a7cd-9b77c7605738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:24.233062 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:24.305878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c9077-e44a-41f6-a7cd-9b77c7605738 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:24.310642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac21bee-dae8-479e-8f3e-a18bbd8a814b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:24.311281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac21bee-dae8-479e-8f3e-a18bbd8a814b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:24.311561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac21bee-dae8-479e-8f3e-a18bbd8a814b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:24.311835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac21bee-dae8-479e-8f3e-a18bbd8a814b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:24.323146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac21bee-dae8-479e-8f3e-a18bbd8a814b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:24.324383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac21bee-dae8-479e-8f3e-a18bbd8a814b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:24.336830 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2551/5128] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:25.329930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305b373-0409-47ca-b968-890dbfe265a8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:25.331724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8305b373-0409-47ca-b968-890dbfe265a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:25.404870 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:25.480338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305b373-0409-47ca-b968-890dbfe265a8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:25.501245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855db08-2cdb-49a3-976e-66bf00b66fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:25.501923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855db08-2cdb-49a3-976e-66bf00b66fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:25.502213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855db08-2cdb-49a3-976e-66bf00b66fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:25.502494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855db08-2cdb-49a3-976e-66bf00b66fe0 admin admin] PATH_INFO: `/v3/users/12321c4eed38481bb09670364f1716c0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:25.507701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855db08-2cdb-49a3-976e-66bf00b66fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12321c4eed38481bb09670364f1716c0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:25.511392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855db08-2cdb-49a3-976e-66bf00b66fe0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:25.609855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4855db08-2cdb-49a3-976e-66bf00b66fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12321c4eed38481bb09670364f1716c0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:25.624591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4855db08-2cdb-49a3-976e-66bf00b66fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12321c4eed38481bb09670364f1716c0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:25.625363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4855db08-2cdb-49a3-976e-66bf00b66fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12321c4eed38481bb09670364f1716c0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:25.639686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4855db08-2cdb-49a3-976e-66bf00b66fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12321c4eed38481bb09670364f1716c0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:25.640349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4855db08-2cdb-49a3-976e-66bf00b66fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12321c4eed38481bb09670364f1716c0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:25.659397 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2578/5129] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:25 2022] DELETE /identity/v3/users/12321c4eed38481bb09670364f1716c0 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:26.156082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac21bee-dae8-479e-8f3e-a18bbd8a814b service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:26.168436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac21bee-dae8-479e-8f3e-a18bbd8a814b service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:26.242443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:26.243490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:26.243860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:26.244025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] PATH_INFO: `/v3/projects/d51755a194eb4b65bb07bb52dc274f4f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:26.245454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51755a194eb4b65bb07bb52dc274f4f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:26.247763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:26.314027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51755a194eb4b65bb07bb52dc274f4f', 'request_id': 'req-2e108d67-98eb-4bf2-87e0-1d702786ec21'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:26.327332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51755a194eb4b65bb07bb52dc274f4f', 'request_id': 'req-2e108d67-98eb-4bf2-87e0-1d702786ec21'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:26.339591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51755a194eb4b65bb07bb52dc274f4f', 'request_id': 'req-2e108d67-98eb-4bf2-87e0-1d702786ec21'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:26.364711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] The token cache is being invalidate because project d51755a194eb4b65bb07bb52dc274f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:26.365276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:26.366677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e108d67-98eb-4bf2-87e0-1d702786ec21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:26.376184 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2552/5130] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:26 2022] DELETE /identity/v3/projects/d51755a194eb4b65bb07bb52dc274f4f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:26.377856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c2bc9-bd6d-4a8e-9773-1ab0d0463e79 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:26.378294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c2bc9-bd6d-4a8e-9773-1ab0d0463e79 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:26.378514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c2bc9-bd6d-4a8e-9773-1ab0d0463e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:26.401406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d15c2bc9-bd6d-4a8e-9773-1ab0d0463e79 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:26.402842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d15c2bc9-bd6d-4a8e-9773-1ab0d0463e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:26.503361 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2579/5131] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:26.505004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1860ab-0e40-41b9-96c3-89f12c266778 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:26.505308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1860ab-0e40-41b9-96c3-89f12c266778 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:26.505574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1860ab-0e40-41b9-96c3-89f12c266778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:26.545977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fa1860ab-0e40-41b9-96c3-89f12c266778 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:26.547095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fa1860ab-0e40-41b9-96c3-89f12c266778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:26.563288 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2553/5132] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:26.564858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c2bc9-bd6d-4a8e-9773-1ab0d0463e79 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:26.580021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c2bc9-bd6d-4a8e-9773-1ab0d0463e79 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:26.592729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58aa74-7c98-42c2-b492-f3043ccbb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:26.593507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58aa74-7c98-42c2-b492-f3043ccbb509 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:26.593951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58aa74-7c98-42c2-b492-f3043ccbb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:26.594330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58aa74-7c98-42c2-b492-f3043ccbb509 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:26.595769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58aa74-7c98-42c2-b492-f3043ccbb509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:24:26.596530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58aa74-7c98-42c2-b492-f3043ccbb509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:26.599385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58aa74-7c98-42c2-b492-f3043ccbb509 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:26.629560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1860ab-0e40-41b9-96c3-89f12c266778 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:26.633527 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2580/5133] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:24:26.641157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1860ab-0e40-41b9-96c3-89f12c266778 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:26.649448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbdfb5-2cba-4b44-a527-4216b873e4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:26.650312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbdfb5-2cba-4b44-a527-4216b873e4cd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:26.650799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbdfb5-2cba-4b44-a527-4216b873e4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:26.651352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbdfb5-2cba-4b44-a527-4216b873e4cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:26.652180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbdfb5-2cba-4b44-a527-4216b873e4cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:26.654504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbdfb5-2cba-4b44-a527-4216b873e4cd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:26.688467 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2554/5134] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:26 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:24:26.692989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58aa74-7c98-42c2-b492-f3043ccbb509 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:26.711427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58aa74-7c98-42c2-b492-f3043ccbb509 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:26.737714 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:26.807346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674b0f-2ac8-4753-b5d3-6cba8ee678f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:26.808677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674b0f-2ac8-4753-b5d3-6cba8ee678f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:26.809062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674b0f-2ac8-4753-b5d3-6cba8ee678f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:26.809442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674b0f-2ac8-4753-b5d3-6cba8ee678f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:26.810193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8674b0f-2ac8-4753-b5d3-6cba8ee678f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:26.812727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8674b0f-2ac8-4753-b5d3-6cba8ee678f5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:26.850896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbdfb5-2cba-4b44-a527-4216b873e4cd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:26.851130 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2581/5135] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:26 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:26.864253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbdfb5-2cba-4b44-a527-4216b873e4cd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:26.872431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52008d08-53bd-4a0e-8255-4c9675856ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:26.873513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52008d08-53bd-4a0e-8255-4c9675856ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:26.876337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52008d08-53bd-4a0e-8255-4c9675856ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:26.877325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52008d08-53bd-4a0e-8255-4c9675856ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:26.878060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52008d08-53bd-4a0e-8255-4c9675856ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:26.880540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52008d08-53bd-4a0e-8255-4c9675856ec2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:26.895821 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2555/5136] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:26.900207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674b0f-2ac8-4753-b5d3-6cba8ee678f5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:26.936234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674b0f-2ac8-4753-b5d3-6cba8ee678f5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:26.957068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b07b3a-0cc4-4998-994f-5b97aa5719f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:26.958477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b07b3a-0cc4-4998-994f-5b97aa5719f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:26.961717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b07b3a-0cc4-4998-994f-5b97aa5719f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:26.962269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b07b3a-0cc4-4998-994f-5b97aa5719f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:26.963188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b07b3a-0cc4-4998-994f-5b97aa5719f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:26.966955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b07b3a-0cc4-4998-994f-5b97aa5719f1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:26.994039 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2582/5137] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:24:26.997932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52008d08-53bd-4a0e-8255-4c9675856ec2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:27.014278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52008d08-53bd-4a0e-8255-4c9675856ec2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:27.023925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e198d-a006-498b-9fb4-eca7a9b2e219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:27.024771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e198d-a006-498b-9fb4-eca7a9b2e219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:27.025124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e198d-a006-498b-9fb4-eca7a9b2e219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:27.027384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e198d-a006-498b-9fb4-eca7a9b2e219 admin admin] PATH_INFO: `/v3/projects/6d0540166c8146a9b853f288bc048b63/users/7c17addef0664acbacdf877431d73888/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:27.077142 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:27.084463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e198d-a006-498b-9fb4-eca7a9b2e219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0540166c8146a9b853f288bc048b63, user_id=7c17addef0664acbacdf877431d73888, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:27.090903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e198d-a006-498b-9fb4-eca7a9b2e219 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:27.122259 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2556/5138] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:26 2022] PUT /identity/v3/projects/6d0540166c8146a9b853f288bc048b63/users/7c17addef0664acbacdf877431d73888/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:27.134398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b135e-fb49-4c1f-b1e2-6057f420624c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:27.135329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b135e-fb49-4c1f-b1e2-6057f420624c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:27.135789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b135e-fb49-4c1f-b1e2-6057f420624c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:27.217763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bc4b135e-fb49-4c1f-b1e2-6057f420624c None None] MFA Rules not processed for user `7c17addef0664acbacdf877431d73888`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:27.219092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bc4b135e-fb49-4c1f-b1e2-6057f420624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:27.291820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e198d-a006-498b-9fb4-eca7a9b2e219 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:27.293619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-952e198d-a006-498b-9fb4-eca7a9b2e219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:27.345251 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2583/5139] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:27.357990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2799cf-7cf8-40a6-a814-c2ac384a1a62 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:27.359039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2799cf-7cf8-40a6-a814-c2ac384a1a62 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:27.360136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2799cf-7cf8-40a6-a814-c2ac384a1a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:27.378890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e198d-a006-498b-9fb4-eca7a9b2e219 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:27.385549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:27.386358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:27.386715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:27.387362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] PATH_INFO: `/v3/users/980b3b0a839e4518b5ada0f0d95763d5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:27.388777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=980b3b0a839e4518b5ada0f0d95763d5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:27.389788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6c2799cf-7cf8-40a6-a814-c2ac384a1a62 None None] MFA Rules not processed for user `7c17addef0664acbacdf877431d73888`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:27.390826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:27.392088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6c2799cf-7cf8-40a6-a814-c2ac384a1a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:27.404532 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2584/5140] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:27.462713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980b3b0a839e4518b5ada0f0d95763d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:27.482577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980b3b0a839e4518b5ada0f0d95763d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:27.483544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980b3b0a839e4518b5ada0f0d95763d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:27.493132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980b3b0a839e4518b5ada0f0d95763d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:27.506740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980b3b0a839e4518b5ada0f0d95763d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:27.517823 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2557/5141] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:27 2022] DELETE /identity/v3/users/980b3b0a839e4518b5ada0f0d95763d5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:24:27.519473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5caa3-ff93-4e6c-89ce-fc28c17d74db None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:27.519766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5caa3-ff93-4e6c-89ce-fc28c17d74db None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:27.520042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5caa3-ff93-4e6c-89ce-fc28c17d74db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:27.540651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cfd5caa3-ff93-4e6c-89ce-fc28c17d74db None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:27.541987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cfd5caa3-ff93-4e6c-89ce-fc28c17d74db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:27.571739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:27.573457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:27.664629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a53041-e15c-42e0-99e2-7a6342db6c3a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:27.670741 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2585/5142] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:27.672475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5caa3-ff93-4e6c-89ce-fc28c17d74db None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:27.673975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cfd5caa3-ff93-4e6c-89ce-fc28c17d74db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:27.674908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:27.675564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:27.675866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:27.676124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] PATH_INFO: `/v3/users/708ebf724c924eaebdce2c2cdfe6ac96` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:27.677328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=708ebf724c924eaebdce2c2cdfe6ac96)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:27.679885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:27.692467 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:27.722560 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:27.751647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708ebf724c924eaebdce2c2cdfe6ac96'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:27.789105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708ebf724c924eaebdce2c2cdfe6ac96'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:27.790753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708ebf724c924eaebdce2c2cdfe6ac96'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:27.816529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5caa3-ff93-4e6c-89ce-fc28c17d74db None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:27.817634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708ebf724c924eaebdce2c2cdfe6ac96'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:27.825636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b8803-e2d1-45ad-a5cb-e935e18f9397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:27.826853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8803-e2d1-45ad-a5cb-e935e18f9397 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:27.827827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8803-e2d1-45ad-a5cb-e935e18f9397 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:27.828856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8803-e2d1-45ad-a5cb-e935e18f9397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:27.829551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708ebf724c924eaebdce2c2cdfe6ac96'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:27.831837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-659b8803-e2d1-45ad-a5cb-e935e18f9397 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:27.840100 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2558/5143] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:27 2022] DELETE /identity/v3/users/708ebf724c924eaebdce2c2cdfe6ac96 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:27.841129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:27.842518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:27.924308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b8803-e2d1-45ad-a5cb-e935e18f9397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:27.924574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89d195-8847-464e-8804-50f1b18d37e9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:27.926431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b8803-e2d1-45ad-a5cb-e935e18f9397 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:27.929005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a06ca-dda5-45d9-87f3-6e3651129666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:27.929625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a06ca-dda5-45d9-87f3-6e3651129666 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:27.929905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a06ca-dda5-45d9-87f3-6e3651129666 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:27.930179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a06ca-dda5-45d9-87f3-6e3651129666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:27.933145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-780a06ca-dda5-45d9-87f3-6e3651129666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:27.937459 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2586/5144] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:27.938892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a24d2-23a9-4a7a-b8b8-88e3a6668e51 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:27.939174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a24d2-23a9-4a7a-b8b8-88e3a6668e51 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:27.939443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a24d2-23a9-4a7a-b8b8-88e3a6668e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:27.961197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ed7a24d2-23a9-4a7a-b8b8-88e3a6668e51 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:27.962328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ed7a24d2-23a9-4a7a-b8b8-88e3a6668e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:28.033439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a06ca-dda5-45d9-87f3-6e3651129666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:28.035228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a06ca-dda5-45d9-87f3-6e3651129666 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:28.060745 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2587/5146] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:28.060980 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2559/5146] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:28.098816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a24d2-23a9-4a7a-b8b8-88e3a6668e51 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:28.103907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ed7a24d2-23a9-4a7a-b8b8-88e3a6668e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:28.131598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a24d2-23a9-4a7a-b8b8-88e3a6668e51 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:28.139981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c447c90-bd2e-4f98-abc9-0226ff0b215a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:28.140856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447c90-bd2e-4f98-abc9-0226ff0b215a service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:28.141444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447c90-bd2e-4f98-abc9-0226ff0b215a service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:28.141977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447c90-bd2e-4f98-abc9-0226ff0b215a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:28.158647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c447c90-bd2e-4f98-abc9-0226ff0b215a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:28.195058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c447c90-bd2e-4f98-abc9-0226ff0b215a service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:28.225433 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2588/5147] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:28.296796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a06ca-dda5-45d9-87f3-6e3651129666 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:28.299143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-780a06ca-dda5-45d9-87f3-6e3651129666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:28.336336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a06ca-dda5-45d9-87f3-6e3651129666 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:28.341913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:28.343763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:28.344217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:28.344492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] PATH_INFO: `/v3/projects/edfd49db753f41daad43f36e980d675b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:28.345822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edfd49db753f41daad43f36e980d675b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:28.348062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:28.404373 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:28.427669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edfd49db753f41daad43f36e980d675b', 'request_id': 'req-642077ab-fa0e-4f18-84a4-25480b9c43e6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:28.441721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edfd49db753f41daad43f36e980d675b', 'request_id': 'req-642077ab-fa0e-4f18-84a4-25480b9c43e6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:28.454118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edfd49db753f41daad43f36e980d675b', 'request_id': 'req-642077ab-fa0e-4f18-84a4-25480b9c43e6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:28.477053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] The token cache is being invalidate because project edfd49db753f41daad43f36e980d675b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:28.477430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:28.478262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642077ab-fa0e-4f18-84a4-25480b9c43e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:28.480361 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2560/5148] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:28 2022] DELETE /identity/v3/projects/edfd49db753f41daad43f36e980d675b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:28.485137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd049-2d65-4cde-aeb1-fbbb4d9652fa None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:28.486005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd049-2d65-4cde-aeb1-fbbb4d9652fa None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:28.486458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd049-2d65-4cde-aeb1-fbbb4d9652fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:28.509713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4edcd049-2d65-4cde-aeb1-fbbb4d9652fa None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:28.511351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4edcd049-2d65-4cde-aeb1-fbbb4d9652fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:28.590705 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:28.634651 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2589/5149] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:28.649419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815554d-31a3-4945-910c-26b54d97653f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:28.649931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815554d-31a3-4945-910c-26b54d97653f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:28.650283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815554d-31a3-4945-910c-26b54d97653f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:28.700089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcd049-2d65-4cde-aeb1-fbbb4d9652fa None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:28.702060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4edcd049-2d65-4cde-aeb1-fbbb4d9652fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:28.725826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcd049-2d65-4cde-aeb1-fbbb4d9652fa None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:28.732749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1815554d-31a3-4945-910c-26b54d97653f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:28.737416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1815554d-31a3-4945-910c-26b54d97653f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:28.739564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:28.740256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:28.741749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:28.741749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] PATH_INFO: `/v3/projects/0145f40e656a4a78a82825a1d9af1986` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:28.746007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0145f40e656a4a78a82825a1d9af1986)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:28.752934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:28.767729 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2561/5150] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:28.769699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815554d-31a3-4945-910c-26b54d97653f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:28.789733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815554d-31a3-4945-910c-26b54d97653f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:28.800960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bb0f4-f5ae-4a50-95a6-9f95709c4289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:28.801752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bb0f4-f5ae-4a50-95a6-9f95709c4289 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:28.801923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bb0f4-f5ae-4a50-95a6-9f95709c4289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:28.802175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bb0f4-f5ae-4a50-95a6-9f95709c4289 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:28.804357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bb0f4-f5ae-4a50-95a6-9f95709c4289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:24:28.804668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bb0f4-f5ae-4a50-95a6-9f95709c4289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:28.809841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bb0f4-f5ae-4a50-95a6-9f95709c4289 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:28.834489 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2562/5151] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:24:28.839692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bb0f4-f5ae-4a50-95a6-9f95709c4289 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:28.861586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0145f40e656a4a78a82825a1d9af1986', 'request_id': 'req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:28.872633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bb0f4-f5ae-4a50-95a6-9f95709c4289 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:28.883438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0145f40e656a4a78a82825a1d9af1986', 'request_id': 'req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:28.893721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0145f40e656a4a78a82825a1d9af1986', 'request_id': 'req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:28.923271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] The token cache is being invalidate because project 0145f40e656a4a78a82825a1d9af1986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:28.923791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:28.935187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-78c690d8-8fc7-4dfa-a4f0-8f7056bd6ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:28.937379 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2590/5152] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:28 2022] DELETE /identity/v3/projects/0145f40e656a4a78a82825a1d9af1986 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:24:28.943740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df298ded-40f5-47df-80ad-19fc6ff9b305 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:28.944556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df298ded-40f5-47df-80ad-19fc6ff9b305 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:28.945035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df298ded-40f5-47df-80ad-19fc6ff9b305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:29.013610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-df298ded-40f5-47df-80ad-19fc6ff9b305 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:29.016002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-df298ded-40f5-47df-80ad-19fc6ff9b305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:29.055559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6e24b-c045-4430-884c-f87de10b813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:29.056196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6e24b-c045-4430-884c-f87de10b813c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:29.056486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6e24b-c045-4430-884c-f87de10b813c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:29.056763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6e24b-c045-4430-884c-f87de10b813c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:29.057412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6e24b-c045-4430-884c-f87de10b813c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:29.059664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6e24b-c045-4430-884c-f87de10b813c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:29.130429 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2563/5153] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:28 2022] POST /identity/v3/projects => generated 375 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:29.132408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6e24b-c045-4430-884c-f87de10b813c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:29.140186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aea6e24b-c045-4430-884c-f87de10b813c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:29.235610 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2591/5154] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:24:29.250663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fdf5d-4e89-4fc1-80ed-3c96577a542c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:29.250975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fdf5d-4e89-4fc1-80ed-3c96577a542c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:29.251485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fdf5d-4e89-4fc1-80ed-3c96577a542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:29.284352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-422fdf5d-4e89-4fc1-80ed-3c96577a542c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:29.285576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-422fdf5d-4e89-4fc1-80ed-3c96577a542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:29.345212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6e24b-c045-4430-884c-f87de10b813c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:29.353564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1819f5-1e0a-4fee-9923-6b046c62f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:29.354361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1819f5-1e0a-4fee-9923-6b046c62f1cf admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:29.354723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1819f5-1e0a-4fee-9923-6b046c62f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:29.357581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1819f5-1e0a-4fee-9923-6b046c62f1cf admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:29.360419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1819f5-1e0a-4fee-9923-6b046c62f1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:29.368425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1819f5-1e0a-4fee-9923-6b046c62f1cf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:29.410952 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2564/5155] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:29 2022] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:29.412947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1819f5-1e0a-4fee-9923-6b046c62f1cf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:29.429280 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2592/5156] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:24:29.431067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1819f5-1e0a-4fee-9923-6b046c62f1cf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:29.433664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fdf5d-4e89-4fc1-80ed-3c96577a542c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:29.438110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58071245-0a48-4b8e-ba05-e35404e01a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:29.439306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58071245-0a48-4b8e-ba05-e35404e01a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:29.439664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58071245-0a48-4b8e-ba05-e35404e01a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:29.439941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58071245-0a48-4b8e-ba05-e35404e01a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:29.440806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58071245-0a48-4b8e-ba05-e35404e01a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:29.444516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58071245-0a48-4b8e-ba05-e35404e01a6b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:29.451370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fdf5d-4e89-4fc1-80ed-3c96577a542c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:29.467603 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2565/5157] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:29.468218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58071245-0a48-4b8e-ba05-e35404e01a6b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:29.472762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcefa61-4241-47d8-9d97-f5c4572d4b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:29.473153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefa61-4241-47d8-9d97-f5c4572d4b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:29.473440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefa61-4241-47d8-9d97-f5c4572d4b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:29.473714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefa61-4241-47d8-9d97-f5c4572d4b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:29.475173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcefa61-4241-47d8-9d97-f5c4572d4b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:24:29.475538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcefa61-4241-47d8-9d97-f5c4572d4b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:29.477168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcefa61-4241-47d8-9d97-f5c4572d4b31 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:29.486557 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:29.493675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58071245-0a48-4b8e-ba05-e35404e01a6b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:29.494370 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2593/5158] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:24:29.499195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcefa61-4241-47d8-9d97-f5c4572d4b31 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:29.508072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6110f-3fb1-4acc-889e-ca2d255d41f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:29.508205 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:29.508655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6110f-3fb1-4acc-889e-ca2d255d41f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:29.508913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6110f-3fb1-4acc-889e-ca2d255d41f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:29.509034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6110f-3fb1-4acc-889e-ca2d255d41f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:29.509660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6110f-3fb1-4acc-889e-ca2d255d41f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:29.515811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6110f-3fb1-4acc-889e-ca2d255d41f3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:29.516054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcefa61-4241-47d8-9d97-f5c4572d4b31 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:29.532918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e21fd7-6bbd-4d07-9ec8-9827d63b3b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:29.534808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21fd7-6bbd-4d07-9ec8-9827d63b3b35 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:29.535318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21fd7-6bbd-4d07-9ec8-9827d63b3b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:29.536080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21fd7-6bbd-4d07-9ec8-9827d63b3b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:29.536976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e21fd7-6bbd-4d07-9ec8-9827d63b3b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:29.542934 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2566/5159] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:29.544327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e21fd7-6bbd-4d07-9ec8-9827d63b3b35 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:29.544517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6110f-3fb1-4acc-889e-ca2d255d41f3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:29.593808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6110f-3fb1-4acc-889e-ca2d255d41f3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:29.609904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da3660-d26d-43c7-b38b-348dd440c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:29.612647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3660-d26d-43c7-b38b-348dd440c878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:29.612938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3660-d26d-43c7-b38b-348dd440c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:29.614780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3660-d26d-43c7-b38b-348dd440c878 admin admin] PATH_INFO: `/v3/projects/c5fa35039cfb4d8baece9ac416122e12/users/dc420d8379e8483db7cfa3bc5f1c5e97/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:29.651730 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2594/5160] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:29 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:29.652658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e21fd7-6bbd-4d07-9ec8-9827d63b3b35 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:29.676340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da3660-d26d-43c7-b38b-348dd440c878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5fa35039cfb4d8baece9ac416122e12, user_id=dc420d8379e8483db7cfa3bc5f1c5e97, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:29.679470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da3660-d26d-43c7-b38b-348dd440c878 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:29.704164 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2567/5161] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:29 2022] PUT /identity/v3/projects/c5fa35039cfb4d8baece9ac416122e12/users/dc420d8379e8483db7cfa3bc5f1c5e97/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:29.715228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c35c95-f982-462f-99f5-6ae45e9aa551 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:29.715839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c35c95-f982-462f-99f5-6ae45e9aa551 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:29.716563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c35c95-f982-462f-99f5-6ae45e9aa551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:29.774159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-80c35c95-f982-462f-99f5-6ae45e9aa551 None None] MFA Rules not processed for user `dc420d8379e8483db7cfa3bc5f1c5e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:29.776917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-80c35c95-f982-462f-99f5-6ae45e9aa551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:29.782861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e21fd7-6bbd-4d07-9ec8-9827d63b3b35 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:29.903693 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2568/5162] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:29.908168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde44c-68c8-4689-b327-9a441a2aadf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:29.908968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde44c-68c8-4689-b327-9a441a2aadf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:29.909352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde44c-68c8-4689-b327-9a441a2aadf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:29.909695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde44c-68c8-4689-b327-9a441a2aadf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:29.910429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dde44c-68c8-4689-b327-9a441a2aadf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:29.912605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dde44c-68c8-4689-b327-9a441a2aadf3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:29.937772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c35c95-f982-462f-99f5-6ae45e9aa551 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:29.939829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-80c35c95-f982-462f-99f5-6ae45e9aa551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:29.962657 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2595/5163] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:29 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:29.966573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde44c-68c8-4689-b327-9a441a2aadf3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:29.996804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde44c-68c8-4689-b327-9a441a2aadf3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:30.002773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1525f0-7216-49b5-b225-05eb5474ac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:30.003060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1525f0-7216-49b5-b225-05eb5474ac1b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:30.003620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1525f0-7216-49b5-b225-05eb5474ac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:30.003620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1525f0-7216-49b5-b225-05eb5474ac1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:30.004251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1525f0-7216-49b5-b225-05eb5474ac1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:30.006677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1525f0-7216-49b5-b225-05eb5474ac1b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:30.019602 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2596/5164] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:24:30.024077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1525f0-7216-49b5-b225-05eb5474ac1b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:30.049689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1525f0-7216-49b5-b225-05eb5474ac1b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:30.062566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e02b30-c48b-4347-b0f5-3f907a5cdafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:30.063889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e02b30-c48b-4347-b0f5-3f907a5cdafb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:30.064330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e02b30-c48b-4347-b0f5-3f907a5cdafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:30.065039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e02b30-c48b-4347-b0f5-3f907a5cdafb admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:30.070675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e02b30-c48b-4347-b0f5-3f907a5cdafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:30.077089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e02b30-c48b-4347-b0f5-3f907a5cdafb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:30.095294 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2597/5165] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:30.101240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e02b30-c48b-4347-b0f5-3f907a5cdafb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:30.125558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c35c95-f982-462f-99f5-6ae45e9aa551 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:30.125784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e02b30-c48b-4347-b0f5-3f907a5cdafb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:30.132270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5faeef-4d6e-4f6f-b708-3a746aa38ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:30.133007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5faeef-4d6e-4f6f-b708-3a746aa38ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:30.133204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53758412-e20a-4d41-a67d-1a4cdbf843ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:30.133357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5faeef-4d6e-4f6f-b708-3a746aa38ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:30.133552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5faeef-4d6e-4f6f-b708-3a746aa38ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:30.134058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53758412-e20a-4d41-a67d-1a4cdbf843ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:30.134682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53758412-e20a-4d41-a67d-1a4cdbf843ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:30.135184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53758412-e20a-4d41-a67d-1a4cdbf843ac admin admin] PATH_INFO: `/v3/projects/c9c4332e9e6a4ae0bb0c2bf875fea00e/users/744719f831404b889bc76ed8d86965fe/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:30.144970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5faeef-4d6e-4f6f-b708-3a746aa38ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:30.147117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5faeef-4d6e-4f6f-b708-3a746aa38ce8 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:30.157155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53758412-e20a-4d41-a67d-1a4cdbf843ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c4332e9e6a4ae0bb0c2bf875fea00e, user_id=744719f831404b889bc76ed8d86965fe, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:30.168097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53758412-e20a-4d41-a67d-1a4cdbf843ac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:30.168999 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2569/5166] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:24:30.189898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5faeef-4d6e-4f6f-b708-3a746aa38ce8 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:30.211135 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2598/5167] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:30 2022] PUT /identity/v3/projects/c9c4332e9e6a4ae0bb0c2bf875fea00e/users/744719f831404b889bc76ed8d86965fe/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:30.215763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5faeef-4d6e-4f6f-b708-3a746aa38ce8 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:30.216591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d2c68-b084-4b15-beac-ef7d23f0f369 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:30.218046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d2c68-b084-4b15-beac-ef7d23f0f369 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:30.218570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d2c68-b084-4b15-beac-ef7d23f0f369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:30.295686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e28d2c68-b084-4b15-beac-ef7d23f0f369 None None] MFA Rules not processed for user `744719f831404b889bc76ed8d86965fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:30.299819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e28d2c68-b084-4b15-beac-ef7d23f0f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:30.310361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c3339-0479-4c28-b884-27dc3eff6ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:30.311847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3339-0479-4c28-b884-27dc3eff6ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:30.312768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3339-0479-4c28-b884-27dc3eff6ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:30.313329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3339-0479-4c28-b884-27dc3eff6ed0 admin admin] PATH_INFO: `/v3/users/dc420d8379e8483db7cfa3bc5f1c5e97` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:30.316998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c3339-0479-4c28-b884-27dc3eff6ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc420d8379e8483db7cfa3bc5f1c5e97)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:30.321487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c3339-0479-4c28-b884-27dc3eff6ed0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:30.325512 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:30.341920 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:30.406960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4e8c3339-0479-4c28-b884-27dc3eff6ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc420d8379e8483db7cfa3bc5f1c5e97'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:30.426805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4e8c3339-0479-4c28-b884-27dc3eff6ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc420d8379e8483db7cfa3bc5f1c5e97'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:30.428145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4e8c3339-0479-4c28-b884-27dc3eff6ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc420d8379e8483db7cfa3bc5f1c5e97'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:30.446955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4e8c3339-0479-4c28-b884-27dc3eff6ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc420d8379e8483db7cfa3bc5f1c5e97'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:30.461369 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2599/5168] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:30.469952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4e8c3339-0479-4c28-b884-27dc3eff6ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc420d8379e8483db7cfa3bc5f1c5e97'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:30.479224 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2570/5169] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:30 2022] DELETE /identity/v3/users/dc420d8379e8483db7cfa3bc5f1c5e97 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:24:30.480367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d2c68-b084-4b15-beac-ef7d23f0f369 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:30.483595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052468d-5643-48f6-bc0f-028ed1cead3c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:30.484794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e28d2c68-b084-4b15-beac-ef7d23f0f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:30.485988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052468d-5643-48f6-bc0f-028ed1cead3c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:30.486277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052468d-5643-48f6-bc0f-028ed1cead3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:30.524412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d052468d-5643-48f6-bc0f-028ed1cead3c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:30.527514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d052468d-5643-48f6-bc0f-028ed1cead3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:30.569947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d2c68-b084-4b15-beac-ef7d23f0f369 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:30.648415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db068631-31b8-4e8a-9645-ac3cad2fd9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:30.649337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068631-31b8-4e8a-9645-ac3cad2fd9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:30.651331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068631-31b8-4e8a-9645-ac3cad2fd9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:30.651778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068631-31b8-4e8a-9645-ac3cad2fd9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:30.687103 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2571/5170] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:30.706811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052468d-5643-48f6-bc0f-028ed1cead3c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:30.729487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052468d-5643-48f6-bc0f-028ed1cead3c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:30.733847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d5058-83d9-42d3-8365-2c6af4de50dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:30.734571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d5058-83d9-42d3-8365-2c6af4de50dc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:30.734927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d5058-83d9-42d3-8365-2c6af4de50dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:30.735283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d5058-83d9-42d3-8365-2c6af4de50dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:30.748853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d5058-83d9-42d3-8365-2c6af4de50dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:30.750329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d5058-83d9-42d3-8365-2c6af4de50dc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:30.760456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db068631-31b8-4e8a-9645-ac3cad2fd9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:30.763646 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2572/5171] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:24:30.765675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db068631-31b8-4e8a-9645-ac3cad2fd9c5 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:30.798063 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2600/5172] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:24:32.221805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d5058-83d9-42d3-8365-2c6af4de50dc service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:32.223702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-508d5058-83d9-42d3-8365-2c6af4de50dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:32.246362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d5058-83d9-42d3-8365-2c6af4de50dc service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:32.255868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:32.257083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:32.257467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:32.257891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] PATH_INFO: `/v3/projects/c5fa35039cfb4d8baece9ac416122e12` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:32.259188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5fa35039cfb4d8baece9ac416122e12)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:32.261540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:32.333149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5fa35039cfb4d8baece9ac416122e12', 'request_id': 'req-e8f46956-192d-4cd6-855d-df44a0a48494'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:32.344523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5fa35039cfb4d8baece9ac416122e12', 'request_id': 'req-e8f46956-192d-4cd6-855d-df44a0a48494'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:32.358538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5fa35039cfb4d8baece9ac416122e12', 'request_id': 'req-e8f46956-192d-4cd6-855d-df44a0a48494'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:32.361979 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:32.383270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] The token cache is being invalidate because project c5fa35039cfb4d8baece9ac416122e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:32.384133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:32.385765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8f46956-192d-4cd6-855d-df44a0a48494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:32.388888 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2573/5173] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:32 2022] DELETE /identity/v3/projects/c5fa35039cfb4d8baece9ac416122e12 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:24:32.394727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270258b6-1252-44e4-b5a2-be68ca019abc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:32.395755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270258b6-1252-44e4-b5a2-be68ca019abc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:32.396209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270258b6-1252-44e4-b5a2-be68ca019abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:32.433347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-270258b6-1252-44e4-b5a2-be68ca019abc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:32.434974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-270258b6-1252-44e4-b5a2-be68ca019abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:32.472337 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:32.524815 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2601/5174] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:32.531773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791dc3d-a797-464a-8098-63dceedd1a17 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:32.533142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791dc3d-a797-464a-8098-63dceedd1a17 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:32.533581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791dc3d-a797-464a-8098-63dceedd1a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:32.573843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3791dc3d-a797-464a-8098-63dceedd1a17 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:32.575359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3791dc3d-a797-464a-8098-63dceedd1a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:32.586478 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2574/5175] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:32.590732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270258b6-1252-44e4-b5a2-be68ca019abc None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:32.609972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270258b6-1252-44e4-b5a2-be68ca019abc None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:32.615999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca089831-417e-498f-a017-9bc80dbc7560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:32.616784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089831-417e-498f-a017-9bc80dbc7560 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:32.617069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089831-417e-498f-a017-9bc80dbc7560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:32.617645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089831-417e-498f-a017-9bc80dbc7560 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:32.618488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca089831-417e-498f-a017-9bc80dbc7560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:24:32.618843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca089831-417e-498f-a017-9bc80dbc7560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:32.620527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca089831-417e-498f-a017-9bc80dbc7560 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:32.639123 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2602/5176] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:24:32.644014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791dc3d-a797-464a-8098-63dceedd1a17 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:32.657619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791dc3d-a797-464a-8098-63dceedd1a17 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:32.665453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fdd8-652c-4d1e-9fd7-24d7a55d66fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:32.666804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fdd8-652c-4d1e-9fd7-24d7a55d66fe admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:32.667090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fdd8-652c-4d1e-9fd7-24d7a55d66fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:32.667423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fdd8-652c-4d1e-9fd7-24d7a55d66fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:32.668005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001fdd8-652c-4d1e-9fd7-24d7a55d66fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:32.670971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001fdd8-652c-4d1e-9fd7-24d7a55d66fe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:32.711859 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2575/5177] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:32 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:32.716401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca089831-417e-498f-a017-9bc80dbc7560 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:32.747237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca089831-417e-498f-a017-9bc80dbc7560 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:32.856996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f109a-c168-4389-919f-e74bbe1edf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:32.857999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f109a-c168-4389-919f-e74bbe1edf00 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:32.861383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f109a-c168-4389-919f-e74bbe1edf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:32.861862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f109a-c168-4389-919f-e74bbe1edf00 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:32.863491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f109a-c168-4389-919f-e74bbe1edf00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:32.869331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f109a-c168-4389-919f-e74bbe1edf00 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:32.924934 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2603/5178] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:32 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:32.925111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fdd8-652c-4d1e-9fd7-24d7a55d66fe admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:32.941715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fdd8-652c-4d1e-9fd7-24d7a55d66fe admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:32.951582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d70d8b-1e39-4a57-a65d-b8558d98ab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:32.951582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d70d8b-1e39-4a57-a65d-b8558d98ab0a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:32.951582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d70d8b-1e39-4a57-a65d-b8558d98ab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:32.951582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d70d8b-1e39-4a57-a65d-b8558d98ab0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:32.952536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d70d8b-1e39-4a57-a65d-b8558d98ab0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:32.955218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d70d8b-1e39-4a57-a65d-b8558d98ab0a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:32.975657 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2576/5179] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:32.979722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f109a-c168-4389-919f-e74bbe1edf00 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:33.010563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f109a-c168-4389-919f-e74bbe1edf00 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:33.028251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bac300-0bb0-412e-b5b2-2bd6a1c00f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:33.029656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bac300-0bb0-412e-b5b2-2bd6a1c00f7e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:33.031529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bac300-0bb0-412e-b5b2-2bd6a1c00f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:33.031942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bac300-0bb0-412e-b5b2-2bd6a1c00f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:33.034818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bac300-0bb0-412e-b5b2-2bd6a1c00f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:33.040603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bac300-0bb0-412e-b5b2-2bd6a1c00f7e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:33.071356 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2604/5180] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:33.076176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d70d8b-1e39-4a57-a65d-b8558d98ab0a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:33.091680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d70d8b-1e39-4a57-a65d-b8558d98ab0a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:33.107419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c667f-38a0-4a1b-9fe6-aa680b86d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:33.108536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c667f-38a0-4a1b-9fe6-aa680b86d378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:33.109167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c667f-38a0-4a1b-9fe6-aa680b86d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:33.110366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c667f-38a0-4a1b-9fe6-aa680b86d378 admin admin] PATH_INFO: `/v3/projects/dec21ee744ec45018bdfce96f41d7037/users/e7ffb645ee034c89a9fe848974d9159a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:33.153324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c667f-38a0-4a1b-9fe6-aa680b86d378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec21ee744ec45018bdfce96f41d7037, user_id=e7ffb645ee034c89a9fe848974d9159a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:33.156267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c667f-38a0-4a1b-9fe6-aa680b86d378 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:33.175195 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2577/5181] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:33 2022] PUT /identity/v3/projects/dec21ee744ec45018bdfce96f41d7037/users/e7ffb645ee034c89a9fe848974d9159a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:24:33.283072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93efa5-bb39-4cdf-98fb-949cc754ba24 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:33.283364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93efa5-bb39-4cdf-98fb-949cc754ba24 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:33.283643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93efa5-bb39-4cdf-98fb-949cc754ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:33.327801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5a93efa5-bb39-4cdf-98fb-949cc754ba24 None None] MFA Rules not processed for user `e7ffb645ee034c89a9fe848974d9159a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:33.329690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5a93efa5-bb39-4cdf-98fb-949cc754ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:33.429122 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2605/5182] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:33.435445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c667f-38a0-4a1b-9fe6-aa680b86d378 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:33.513676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c667f-38a0-4a1b-9fe6-aa680b86d378 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:33.521436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55198652-416a-459d-8c94-591b6f08b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:33.521812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55198652-416a-459d-8c94-591b6f08b130 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:33.522451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55198652-416a-459d-8c94-591b6f08b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:33.522844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55198652-416a-459d-8c94-591b6f08b130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:33.523605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55198652-416a-459d-8c94-591b6f08b130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:33.527684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55198652-416a-459d-8c94-591b6f08b130 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:33.590302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93efa5-bb39-4cdf-98fb-949cc754ba24 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:33.597408 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2578/5183] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:33 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:33.605107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93efa5-bb39-4cdf-98fb-949cc754ba24 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:33.643370 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:33.691821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4295664-8dfc-4faa-8b4a-029a9c3613ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:33.693823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4295664-8dfc-4faa-8b4a-029a9c3613ec admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:33.694749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4295664-8dfc-4faa-8b4a-029a9c3613ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:33.695219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4295664-8dfc-4faa-8b4a-029a9c3613ec admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:33.696049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4295664-8dfc-4faa-8b4a-029a9c3613ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:33.698418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4295664-8dfc-4faa-8b4a-029a9c3613ec admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:33.727208 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2606/5184] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:33 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:33.731250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55198652-416a-459d-8c94-591b6f08b130 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:33.743410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55198652-416a-459d-8c94-591b6f08b130 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:33.750346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38f25a-81df-41bb-840e-7757b9a79e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:33.750925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38f25a-81df-41bb-840e-7757b9a79e06 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:33.751210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38f25a-81df-41bb-840e-7757b9a79e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:33.751460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38f25a-81df-41bb-840e-7757b9a79e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:33.752106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38f25a-81df-41bb-840e-7757b9a79e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:33.753915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38f25a-81df-41bb-840e-7757b9a79e06 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:33.782137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4295664-8dfc-4faa-8b4a-029a9c3613ec admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:33.783148 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2579/5185] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:33.793538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4295664-8dfc-4faa-8b4a-029a9c3613ec admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:33.799617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222654e1-6f2b-4d2b-8e0d-2f31833cd01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:33.800597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222654e1-6f2b-4d2b-8e0d-2f31833cd01e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:33.800982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222654e1-6f2b-4d2b-8e0d-2f31833cd01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:33.801358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222654e1-6f2b-4d2b-8e0d-2f31833cd01e admin admin] PATH_INFO: `/v3/projects/dc6f1a115684427fb271708b175bb2a4/users/4d0b5abad4534e85a1c2417bac19e4a6/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:33.824976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222654e1-6f2b-4d2b-8e0d-2f31833cd01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6f1a115684427fb271708b175bb2a4, user_id=4d0b5abad4534e85a1c2417bac19e4a6, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:33.829079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222654e1-6f2b-4d2b-8e0d-2f31833cd01e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:33.854701 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2607/5186] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:33 2022] PUT /identity/v3/projects/dc6f1a115684427fb271708b175bb2a4/users/4d0b5abad4534e85a1c2417bac19e4a6/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:33.858891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38f25a-81df-41bb-840e-7757b9a79e06 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:33.873357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38f25a-81df-41bb-840e-7757b9a79e06 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:34.028193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c2e49-20e1-4670-ba8c-c7e0ca7ed86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:34.028896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c2e49-20e1-4670-ba8c-c7e0ca7ed86c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:34.029179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c2e49-20e1-4670-ba8c-c7e0ca7ed86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:34.029455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c2e49-20e1-4670-ba8c-c7e0ca7ed86c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:34.033955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c2e49-20e1-4670-ba8c-c7e0ca7ed86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:34.035708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c2e49-20e1-4670-ba8c-c7e0ca7ed86c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:34.049392 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:34.081803 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2580/5187] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:34.082802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222654e1-6f2b-4d2b-8e0d-2f31833cd01e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:34.094425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222654e1-6f2b-4d2b-8e0d-2f31833cd01e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:34.120447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30deb7-72c2-4211-b290-577834b496fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:34.120898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30deb7-72c2-4211-b290-577834b496fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:34.121244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30deb7-72c2-4211-b290-577834b496fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:34.122159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30deb7-72c2-4211-b290-577834b496fc admin admin] PATH_INFO: `/v3/projects/dc6f1a115684427fb271708b175bb2a4/users/4d0b5abad4534e85a1c2417bac19e4a6/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:34.125712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30deb7-72c2-4211-b290-577834b496fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6f1a115684427fb271708b175bb2a4, user_id=4d0b5abad4534e85a1c2417bac19e4a6, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:34.128949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30deb7-72c2-4211-b290-577834b496fc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:34.166721 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2608/5188] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:34 2022] PUT /identity/v3/projects/dc6f1a115684427fb271708b175bb2a4/users/4d0b5abad4534e85a1c2417bac19e4a6/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:34.178449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b475d0-285d-48e1-a6d0-43cbf2acdc7a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:34.178756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b475d0-285d-48e1-a6d0-43cbf2acdc7a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:34.179029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b475d0-285d-48e1-a6d0-43cbf2acdc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:34.236459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b7b475d0-285d-48e1-a6d0-43cbf2acdc7a None None] MFA Rules not processed for user `4d0b5abad4534e85a1c2417bac19e4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:34.237681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b7b475d0-285d-48e1-a6d0-43cbf2acdc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:34.407291 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2581/5189] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:34.420043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30deb7-72c2-4211-b290-577834b496fc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:34.422507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-af30deb7-72c2-4211-b290-577834b496fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:34.545884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30deb7-72c2-4211-b290-577834b496fc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:34.554660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954b3a6-9933-4424-b1de-b9f4eb5304fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:34.555359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b3a6-9933-4424-b1de-b9f4eb5304fe service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:34.555642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b3a6-9933-4424-b1de-b9f4eb5304fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:34.555915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b3a6-9933-4424-b1de-b9f4eb5304fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:34.589541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954b3a6-9933-4424-b1de-b9f4eb5304fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:34.594712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954b3a6-9933-4424-b1de-b9f4eb5304fe service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:34.650144 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2609/5190] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:34.779188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b475d0-285d-48e1-a6d0-43cbf2acdc7a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:34.797226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b475d0-285d-48e1-a6d0-43cbf2acdc7a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:34.805276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df5c3e-4513-47a8-afd7-49caf63036e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:34.805901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5c3e-4513-47a8-afd7-49caf63036e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:34.806180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5c3e-4513-47a8-afd7-49caf63036e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:34.806450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5c3e-4513-47a8-afd7-49caf63036e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:34.957856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df5c3e-4513-47a8-afd7-49caf63036e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:34.959724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df5c3e-4513-47a8-afd7-49caf63036e9 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:34.988065 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2582/5191] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:24:40.146282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954b3a6-9933-4424-b1de-b9f4eb5304fe service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:40.147926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e954b3a6-9933-4424-b1de-b9f4eb5304fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:40.336534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954b3a6-9933-4424-b1de-b9f4eb5304fe service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:40.347351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca11de2-8641-4922-9045-f507c21d7261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:40.348237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca11de2-8641-4922-9045-f507c21d7261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:40.348601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca11de2-8641-4922-9045-f507c21d7261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:40.349679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca11de2-8641-4922-9045-f507c21d7261 admin admin] PATH_INFO: `/v3/users/4701f06a10ad4f89984132f8ec72b955` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:40.351330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca11de2-8641-4922-9045-f507c21d7261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4701f06a10ad4f89984132f8ec72b955)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:40.353543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca11de2-8641-4922-9045-f507c21d7261 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:40.406160 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:40.457902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7ca11de2-8641-4922-9045-f507c21d7261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4701f06a10ad4f89984132f8ec72b955'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:40.490486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7ca11de2-8641-4922-9045-f507c21d7261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4701f06a10ad4f89984132f8ec72b955'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:40.491654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7ca11de2-8641-4922-9045-f507c21d7261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4701f06a10ad4f89984132f8ec72b955'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:40.503331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7ca11de2-8641-4922-9045-f507c21d7261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4701f06a10ad4f89984132f8ec72b955'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:40.504329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7ca11de2-8641-4922-9045-f507c21d7261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4701f06a10ad4f89984132f8ec72b955'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:40.522332 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2610/5192] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:40 2022] DELETE /identity/v3/users/4701f06a10ad4f89984132f8ec72b955 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:40.886679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df5c3e-4513-47a8-afd7-49caf63036e9 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:40.905884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df5c3e-4513-47a8-afd7-49caf63036e9 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:41.051501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:41.052161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:41.052515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:41.052710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] PATH_INFO: `/v3/projects/621bdb6aad704cf9b2f31f9e1e653d8c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:41.054691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621bdb6aad704cf9b2f31f9e1e653d8c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:41.055956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:41.087975 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:41.167586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621bdb6aad704cf9b2f31f9e1e653d8c', 'request_id': 'req-33578ca1-09b1-482b-aacf-b92da4e89ff4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:41.193185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621bdb6aad704cf9b2f31f9e1e653d8c', 'request_id': 'req-33578ca1-09b1-482b-aacf-b92da4e89ff4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:41.212005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621bdb6aad704cf9b2f31f9e1e653d8c', 'request_id': 'req-33578ca1-09b1-482b-aacf-b92da4e89ff4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:41.237184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] The token cache is being invalidate because project 621bdb6aad704cf9b2f31f9e1e653d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:41.237793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:41.240905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:41.248244 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2583/5193] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:40 2022] DELETE /identity/v3/projects/621bdb6aad704cf9b2f31f9e1e653d8c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:41.249400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3366b-2401-48c4-a833-9792b424a993 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:41.249887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3366b-2401-48c4-a833-9792b424a993 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:41.249973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3366b-2401-48c4-a833-9792b424a993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:41.286356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ccd3366b-2401-48c4-a833-9792b424a993 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:41.286356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ccd3366b-2401-48c4-a833-9792b424a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:41.327458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:41.329685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:41.433964 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2611/5194] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:24:41.442345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceaf58-b6f2-4d54-a8c3-176451cd266e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:41.443693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceaf58-b6f2-4d54-a8c3-176451cd266e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:41.444266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceaf58-b6f2-4d54-a8c3-176451cd266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:41.470713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33578ca1-09b1-482b-aacf-b92da4e89ff4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:41.477611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd510b70-3aa2-42bb-aa0e-a7dd371f294b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:41.478121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510b70-3aa2-42bb-aa0e-a7dd371f294b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:41.478505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510b70-3aa2-42bb-aa0e-a7dd371f294b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:41.478834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510b70-3aa2-42bb-aa0e-a7dd371f294b admin admin] PATH_INFO: `/v3/users/744719f831404b889bc76ed8d86965fe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:41.480005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd510b70-3aa2-42bb-aa0e-a7dd371f294b admin admin] RBAC: Authorizing `identity:delete_user(user_id=744719f831404b889bc76ed8d86965fe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:41.481988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd510b70-3aa2-42bb-aa0e-a7dd371f294b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:41.482787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-11ceaf58-b6f2-4d54-a8c3-176451cd266e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:41.484079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-11ceaf58-b6f2-4d54-a8c3-176451cd266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:41.505055 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2612/5195] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:24:41.506816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceaf58-b6f2-4d54-a8c3-176451cd266e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:41.530772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceaf58-b6f2-4d54-a8c3-176451cd266e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:41.537916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c18b2a-6c92-4d5b-90f1-4ffb921b43b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:41.539152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c18b2a-6c92-4d5b-90f1-4ffb921b43b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:41.539585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c18b2a-6c92-4d5b-90f1-4ffb921b43b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:41.540121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c18b2a-6c92-4d5b-90f1-4ffb921b43b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:41.540957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c18b2a-6c92-4d5b-90f1-4ffb921b43b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:24:41.541597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c18b2a-6c92-4d5b-90f1-4ffb921b43b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:41.543489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c18b2a-6c92-4d5b-90f1-4ffb921b43b8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:41.575318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd510b70-3aa2-42bb-aa0e-a7dd371f294b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744719f831404b889bc76ed8d86965fe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:41.577601 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2613/5196] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:24:41.582757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c18b2a-6c92-4d5b-90f1-4ffb921b43b8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:41.598324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd510b70-3aa2-42bb-aa0e-a7dd371f294b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744719f831404b889bc76ed8d86965fe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:41.598540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c18b2a-6c92-4d5b-90f1-4ffb921b43b8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:41.600656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd510b70-3aa2-42bb-aa0e-a7dd371f294b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744719f831404b889bc76ed8d86965fe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:41.609231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390f315-0750-4f40-a6ce-1c8ac8b0838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:41.609914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390f315-0750-4f40-a6ce-1c8ac8b0838a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:41.620108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd510b70-3aa2-42bb-aa0e-a7dd371f294b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744719f831404b889bc76ed8d86965fe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:41.622950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390f315-0750-4f40-a6ce-1c8ac8b0838a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:41.623478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390f315-0750-4f40-a6ce-1c8ac8b0838a admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:41.624347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390f315-0750-4f40-a6ce-1c8ac8b0838a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:41.626466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390f315-0750-4f40-a6ce-1c8ac8b0838a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:41.629023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd510b70-3aa2-42bb-aa0e-a7dd371f294b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744719f831404b889bc76ed8d86965fe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:41.643173 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2584/5197] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:41 2022] DELETE /identity/v3/users/744719f831404b889bc76ed8d86965fe => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:41.648182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d0c4-4708-433d-a8d6-88658b79737b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:41.648627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d0c4-4708-433d-a8d6-88658b79737b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:41.648810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d0c4-4708-433d-a8d6-88658b79737b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:41.689645 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2614/5198] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:41 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:41.705391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390f315-0750-4f40-a6ce-1c8ac8b0838a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:41.717543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4390f315-0750-4f40-a6ce-1c8ac8b0838a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:41.724050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7450d0c4-4708-433d-a8d6-88658b79737b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:41.725819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7450d0c4-4708-433d-a8d6-88658b79737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:41.769496 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:41.854913 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2585/5199] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:41.861596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450d0c4-4708-433d-a8d6-88658b79737b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:41.863209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7450d0c4-4708-433d-a8d6-88658b79737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:41.880048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390f315-0750-4f40-a6ce-1c8ac8b0838a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:41.897871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515bbbf-6a17-4394-8217-9397d51b0bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:41.900029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515bbbf-6a17-4394-8217-9397d51b0bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:41.900579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515bbbf-6a17-4394-8217-9397d51b0bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:41.904333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515bbbf-6a17-4394-8217-9397d51b0bdb admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:41.905118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515bbbf-6a17-4394-8217-9397d51b0bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:41.908739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515bbbf-6a17-4394-8217-9397d51b0bdb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:41.922559 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:41.954513 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2615/5200] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:41 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:41.956636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515bbbf-6a17-4394-8217-9397d51b0bdb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:41.983206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515bbbf-6a17-4394-8217-9397d51b0bdb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:42.001402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896047a-3602-4a1c-8da2-2746bae36bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:42.002039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896047a-3602-4a1c-8da2-2746bae36bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:42.005491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896047a-3602-4a1c-8da2-2746bae36bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:42.005776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896047a-3602-4a1c-8da2-2746bae36bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:42.007919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896047a-3602-4a1c-8da2-2746bae36bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:42.008212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896047a-3602-4a1c-8da2-2746bae36bb4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:42.012652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450d0c4-4708-433d-a8d6-88658b79737b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:42.026361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e174e-6a04-4262-b6bb-9d0848b701b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:42.027324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e174e-6a04-4262-b6bb-9d0848b701b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:42.027910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e174e-6a04-4262-b6bb-9d0848b701b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:42.028357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e174e-6a04-4262-b6bb-9d0848b701b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:42.050254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e174e-6a04-4262-b6bb-9d0848b701b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:42.052804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e174e-6a04-4262-b6bb-9d0848b701b1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:42.059287 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2616/5201] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:42.060488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896047a-3602-4a1c-8da2-2746bae36bb4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:42.084267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896047a-3602-4a1c-8da2-2746bae36bb4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:42.084487 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2586/5202] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:24:42.090143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e130913-8213-407a-b9a2-2c52cd094090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:42.091483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e130913-8213-407a-b9a2-2c52cd094090 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:42.092003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e130913-8213-407a-b9a2-2c52cd094090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:42.092347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e130913-8213-407a-b9a2-2c52cd094090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:42.093157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e130913-8213-407a-b9a2-2c52cd094090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:42.096190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e130913-8213-407a-b9a2-2c52cd094090 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:42.121866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e174e-6a04-4262-b6bb-9d0848b701b1 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:42.123208 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2617/5203] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:42.137132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e174e-6a04-4262-b6bb-9d0848b701b1 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:42.155741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627826e-435f-40a0-804e-6b29642b11a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:42.156836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627826e-435f-40a0-804e-6b29642b11a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:42.156836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627826e-435f-40a0-804e-6b29642b11a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:42.157035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627826e-435f-40a0-804e-6b29642b11a1 admin admin] PATH_INFO: `/v3/projects/ca7d49167f014e31841f231f94b43e60/users/a003e4392e9c4aa587573cb1dfa605e0/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:42.187301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627826e-435f-40a0-804e-6b29642b11a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7d49167f014e31841f231f94b43e60, user_id=a003e4392e9c4aa587573cb1dfa605e0, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:42.190439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627826e-435f-40a0-804e-6b29642b11a1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:42.223759 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2587/5204] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:42 2022] PUT /identity/v3/projects/ca7d49167f014e31841f231f94b43e60/users/a003e4392e9c4aa587573cb1dfa605e0/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:24:42.228147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d24e0-9e9f-4e19-843b-1a516d87c7d3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:42.228147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d24e0-9e9f-4e19-843b-1a516d87c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:42.228147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d24e0-9e9f-4e19-843b-1a516d87c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:42.263801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ba5d24e0-9e9f-4e19-843b-1a516d87c7d3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:42.268410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ba5d24e0-9e9f-4e19-843b-1a516d87c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:42.474655 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2618/5205] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:42.487117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627826e-435f-40a0-804e-6b29642b11a1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:42.489018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d627826e-435f-40a0-804e-6b29642b11a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:42.581169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d24e0-9e9f-4e19-843b-1a516d87c7d3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:42.582669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ba5d24e0-9e9f-4e19-843b-1a516d87c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:42.604068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627826e-435f-40a0-804e-6b29642b11a1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:42.615304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce19c4f-6826-4b65-a3c9-5bcfd22cf417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:42.615524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d24e0-9e9f-4e19-843b-1a516d87c7d3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:42.616015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce19c4f-6826-4b65-a3c9-5bcfd22cf417 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:42.617446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce19c4f-6826-4b65-a3c9-5bcfd22cf417 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:42.617797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce19c4f-6826-4b65-a3c9-5bcfd22cf417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:42.623637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:42.624291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:42.624607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:42.624889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] PATH_INFO: `/v3/projects/c9c4332e9e6a4ae0bb0c2bf875fea00e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:42.627920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c4332e9e6a4ae0bb0c2bf875fea00e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:42.630075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:42.642406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce19c4f-6826-4b65-a3c9-5bcfd22cf417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:42.644197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce19c4f-6826-4b65-a3c9-5bcfd22cf417 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:42.660924 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2588/5206] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:42.745654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c4332e9e6a4ae0bb0c2bf875fea00e', 'request_id': 'req-04471dab-d18f-4ecb-9f7c-5abc1665c269'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:42.757444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c4332e9e6a4ae0bb0c2bf875fea00e', 'request_id': 'req-04471dab-d18f-4ecb-9f7c-5abc1665c269'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:42.765682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c4332e9e6a4ae0bb0c2bf875fea00e', 'request_id': 'req-04471dab-d18f-4ecb-9f7c-5abc1665c269'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:42.788875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] The token cache is being invalidate because project c9c4332e9e6a4ae0bb0c2bf875fea00e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:42.789608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:42.791345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-04471dab-d18f-4ecb-9f7c-5abc1665c269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:42.797019 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2619/5207] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:42 2022] DELETE /identity/v3/projects/c9c4332e9e6a4ae0bb0c2bf875fea00e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:24:42.798151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d0bd2-0d19-4a2d-860c-2515e8a986a1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:42.798442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d0bd2-0d19-4a2d-860c-2515e8a986a1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:42.799035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d0bd2-0d19-4a2d-860c-2515e8a986a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:42.853070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9b0d0bd2-0d19-4a2d-860c-2515e8a986a1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:42.855066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b0d0bd2-0d19-4a2d-860c-2515e8a986a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:42.952765 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:42.970381 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2589/5208] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:42.980066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d31bf-28a3-4103-b4da-05e6d274c5b9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:42.980540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d31bf-28a3-4103-b4da-05e6d274c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:42.981244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d31bf-28a3-4103-b4da-05e6d274c5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:43.013225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cc7d31bf-28a3-4103-b4da-05e6d274c5b9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:43.015260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cc7d31bf-28a3-4103-b4da-05e6d274c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:43.025794 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2620/5209] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:43.031335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d0bd2-0d19-4a2d-860c-2515e8a986a1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:43.045703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d0bd2-0d19-4a2d-860c-2515e8a986a1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:43.051415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6dd0-b50d-4ae3-8a92-af16ac5d02d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:43.052491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6dd0-b50d-4ae3-8a92-af16ac5d02d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:43.052966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6dd0-b50d-4ae3-8a92-af16ac5d02d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:43.053408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6dd0-b50d-4ae3-8a92-af16ac5d02d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:43.054128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c6dd0-b50d-4ae3-8a92-af16ac5d02d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:24:43.054386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c6dd0-b50d-4ae3-8a92-af16ac5d02d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:43.060930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c6dd0-b50d-4ae3-8a92-af16ac5d02d1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:43.089032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d31bf-28a3-4103-b4da-05e6d274c5b9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:43.098708 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2590/5210] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:24:43.105095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d31bf-28a3-4103-b4da-05e6d274c5b9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:43.113561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541ada-3f21-412f-873c-40b9b671cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:43.114239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541ada-3f21-412f-873c-40b9b671cc5d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:43.114559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541ada-3f21-412f-873c-40b9b671cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:43.114893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541ada-3f21-412f-873c-40b9b671cc5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:43.115842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3541ada-3f21-412f-873c-40b9b671cc5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:43.118789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3541ada-3f21-412f-873c-40b9b671cc5d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:43.182843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6dd0-b50d-4ae3-8a92-af16ac5d02d1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:43.189614 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2621/5211] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:43 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:43.196072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6dd0-b50d-4ae3-8a92-af16ac5d02d1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:43.267489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b0b09-c654-44f9-8404-f98d578370ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:43.268236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b0b09-c654-44f9-8404-f98d578370ac admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:43.268598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b0b09-c654-44f9-8404-f98d578370ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:43.268949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b0b09-c654-44f9-8404-f98d578370ac admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:43.269673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b0b09-c654-44f9-8404-f98d578370ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:43.271917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b0b09-c654-44f9-8404-f98d578370ac admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:43.297582 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2591/5212] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:43 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:43.301699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541ada-3f21-412f-873c-40b9b671cc5d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:43.319373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541ada-3f21-412f-873c-40b9b671cc5d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:43.331102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d0197-11e1-4cc5-918b-761d1461cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:43.332951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d0197-11e1-4cc5-918b-761d1461cca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:43.333974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d0197-11e1-4cc5-918b-761d1461cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:43.334964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d0197-11e1-4cc5-918b-761d1461cca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:43.335779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d0197-11e1-4cc5-918b-761d1461cca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:43.338310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d0197-11e1-4cc5-918b-761d1461cca3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:43.351638 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2622/5213] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:43.355601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b0b09-c654-44f9-8404-f98d578370ac admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:43.371121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b0b09-c654-44f9-8404-f98d578370ac admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:43.376248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94f4b-378c-48d6-b076-37e2bb663010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:43.377008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94f4b-378c-48d6-b076-37e2bb663010 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:43.377362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94f4b-378c-48d6-b076-37e2bb663010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:43.378338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94f4b-378c-48d6-b076-37e2bb663010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:43.379256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94f4b-378c-48d6-b076-37e2bb663010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:43.383271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94f4b-378c-48d6-b076-37e2bb663010 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:43.400203 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2592/5214] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:43.404152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d0197-11e1-4cc5-918b-761d1461cca3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:43.417598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d0197-11e1-4cc5-918b-761d1461cca3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:43.425302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc3f70-44d7-4436-a828-72edb8192119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:43.431758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc3f70-44d7-4436-a828-72edb8192119 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:43.432283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc3f70-44d7-4436-a828-72edb8192119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:43.433049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc3f70-44d7-4436-a828-72edb8192119 admin admin] PATH_INFO: `/v3/projects/0508a90bd1e044cfa448730bff083a3f/users/0ea2dc39336748829235976ad74fc8ca/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:43.448048 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:43.463789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc3f70-44d7-4436-a828-72edb8192119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0508a90bd1e044cfa448730bff083a3f, user_id=0ea2dc39336748829235976ad74fc8ca, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:43.466742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc3f70-44d7-4436-a828-72edb8192119 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:43.501757 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2623/5215] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:43 2022] PUT /identity/v3/projects/0508a90bd1e044cfa448730bff083a3f/users/0ea2dc39336748829235976ad74fc8ca/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:43.503610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42f737-8acb-4900-96b8-39c57032ce74 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:43.503904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42f737-8acb-4900-96b8-39c57032ce74 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:43.504185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42f737-8acb-4900-96b8-39c57032ce74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:43.579210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fe42f737-8acb-4900-96b8-39c57032ce74 None None] MFA Rules not processed for user `0ea2dc39336748829235976ad74fc8ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:43.581861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fe42f737-8acb-4900-96b8-39c57032ce74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:43.692448 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2593/5216] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:43.726902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc3f70-44d7-4436-a828-72edb8192119 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:43.730273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-36dc3f70-44d7-4436-a828-72edb8192119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:43.831076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc3f70-44d7-4436-a828-72edb8192119 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:43.841812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93302cd8-e9e1-4885-9fbd-902db2894c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:43.842499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93302cd8-e9e1-4885-9fbd-902db2894c2e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:43.842861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93302cd8-e9e1-4885-9fbd-902db2894c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:43.843913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93302cd8-e9e1-4885-9fbd-902db2894c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:43.870043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93302cd8-e9e1-4885-9fbd-902db2894c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:43.872129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93302cd8-e9e1-4885-9fbd-902db2894c2e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:43.893030 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2624/5217] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:46.323843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42f737-8acb-4900-96b8-39c57032ce74 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:46.328643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fe42f737-8acb-4900-96b8-39c57032ce74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:46.405071 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:46.434186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42f737-8acb-4900-96b8-39c57032ce74 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:46.440256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:46.440987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:46.441531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:46.441806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] PATH_INFO: `/v3/users/e294e38022bf430892f87be160200f7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:46.443224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e294e38022bf430892f87be160200f7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:46.453047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:46.544839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e294e38022bf430892f87be160200f7e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:46.561105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e294e38022bf430892f87be160200f7e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:46.561861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e294e38022bf430892f87be160200f7e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:46.577401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e294e38022bf430892f87be160200f7e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:46.589690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e294e38022bf430892f87be160200f7e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:46.600521 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2594/5218] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:46 2022] DELETE /identity/v3/users/e294e38022bf430892f87be160200f7e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:46.604726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c7604-7651-43cf-a2ab-a292c9094d1b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:46.605577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c7604-7651-43cf-a2ab-a292c9094d1b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:46.606095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c7604-7651-43cf-a2ab-a292c9094d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:46.632300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-859c7604-7651-43cf-a2ab-a292c9094d1b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:46.633933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-859c7604-7651-43cf-a2ab-a292c9094d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:46.795027 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2625/5219] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:24:46.810130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:46.812927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:46.944852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99784b7-4d31-4026-8872-d6d0768c64c2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:46.949635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579012e7-1959-4fa5-9120-f5b3888e1962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:46.951007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579012e7-1959-4fa5-9120-f5b3888e1962 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:46.951531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579012e7-1959-4fa5-9120-f5b3888e1962 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:46.952015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579012e7-1959-4fa5-9120-f5b3888e1962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:46.963522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579012e7-1959-4fa5-9120-f5b3888e1962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:46.968666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579012e7-1959-4fa5-9120-f5b3888e1962 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:46.985749 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2595/5220] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:47.714588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c7604-7651-43cf-a2ab-a292c9094d1b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:47.720124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-859c7604-7651-43cf-a2ab-a292c9094d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:47.750270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c7604-7651-43cf-a2ab-a292c9094d1b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:47.763728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:47.764988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:47.765615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:47.766061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] PATH_INFO: `/v3/projects/359a9a2fb8b7443a991ca17fe389eaa2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:47.767476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=359a9a2fb8b7443a991ca17fe389eaa2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:47.769631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:47.916199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359a9a2fb8b7443a991ca17fe389eaa2', 'request_id': 'req-02acfa06-f4cf-48aa-ab41-11c80caca766'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:47.930037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359a9a2fb8b7443a991ca17fe389eaa2', 'request_id': 'req-02acfa06-f4cf-48aa-ab41-11c80caca766'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:47.941189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359a9a2fb8b7443a991ca17fe389eaa2', 'request_id': 'req-02acfa06-f4cf-48aa-ab41-11c80caca766'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:47.979899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] The token cache is being invalidate because project 359a9a2fb8b7443a991ca17fe389eaa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:47.981737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:47.983944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-02acfa06-f4cf-48aa-ab41-11c80caca766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:47.988421 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2626/5221] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:47 2022] DELETE /identity/v3/projects/359a9a2fb8b7443a991ca17fe389eaa2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:47.995554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ea4e6-7cfd-4139-a103-c1f6b59f6ea5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:47.996056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ea4e6-7cfd-4139-a103-c1f6b59f6ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:47.996721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ea4e6-7cfd-4139-a103-c1f6b59f6ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:48.061858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-df9ea4e6-7cfd-4139-a103-c1f6b59f6ea5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:48.063922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-df9ea4e6-7cfd-4139-a103-c1f6b59f6ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:48.225336 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2596/5222] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:48.232707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fd94b-ecb1-4967-80a0-33ae98025491 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:48.233222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fd94b-ecb1-4967-80a0-33ae98025491 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:48.233689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fd94b-ecb1-4967-80a0-33ae98025491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:48.295322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-253fd94b-ecb1-4967-80a0-33ae98025491 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:48.299107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-253fd94b-ecb1-4967-80a0-33ae98025491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:48.326767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2627/5223] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:48.327988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ea4e6-7cfd-4139-a103-c1f6b59f6ea5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:48.340389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ea4e6-7cfd-4139-a103-c1f6b59f6ea5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:48.354219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab94baa-d49b-4e28-b50b-db9df76f4ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:48.354955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94baa-d49b-4e28-b50b-db9df76f4ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:48.355299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94baa-d49b-4e28-b50b-db9df76f4ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:48.355639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94baa-d49b-4e28-b50b-db9df76f4ba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:48.356368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab94baa-d49b-4e28-b50b-db9df76f4ba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:24:48.356736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab94baa-d49b-4e28-b50b-db9df76f4ba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:48.358419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab94baa-d49b-4e28-b50b-db9df76f4ba4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:48.375463 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:48.387542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fd94b-ecb1-4967-80a0-33ae98025491 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:48.388674 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2597/5224] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:24:48.397676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fd94b-ecb1-4967-80a0-33ae98025491 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:48.415886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e774163-004d-4f31-b3dc-75671facae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:48.416658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e774163-004d-4f31-b3dc-75671facae2f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:48.417035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e774163-004d-4f31-b3dc-75671facae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:48.417421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e774163-004d-4f31-b3dc-75671facae2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:48.418169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e774163-004d-4f31-b3dc-75671facae2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:48.420269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e774163-004d-4f31-b3dc-75671facae2f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:48.431943 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:48.479957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab94baa-d49b-4e28-b50b-db9df76f4ba4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:48.489526 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2628/5225] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:48 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:24:48.494304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab94baa-d49b-4e28-b50b-db9df76f4ba4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:48.608624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1b028-45ba-46fd-9d06-16d5816ac7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:48.609247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1b028-45ba-46fd-9d06-16d5816ac7de admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:48.609526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1b028-45ba-46fd-9d06-16d5816ac7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:48.609801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1b028-45ba-46fd-9d06-16d5816ac7de admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:48.610442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1b028-45ba-46fd-9d06-16d5816ac7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:48.613372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1b028-45ba-46fd-9d06-16d5816ac7de admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:48.657922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e774163-004d-4f31-b3dc-75671facae2f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:48.668066 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2598/5226] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:48 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:48.671306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e774163-004d-4f31-b3dc-75671facae2f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:48.678406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd9609-067b-4601-8ad0-f93ce8d06d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:48.679079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd9609-067b-4601-8ad0-f93ce8d06d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:48.679504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd9609-067b-4601-8ad0-f93ce8d06d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:48.679777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd9609-067b-4601-8ad0-f93ce8d06d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:48.680845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd9609-067b-4601-8ad0-f93ce8d06d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:48.682884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd9609-067b-4601-8ad0-f93ce8d06d89 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:48.704540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1b028-45ba-46fd-9d06-16d5816ac7de admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:48.712581 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2629/5227] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:48.718096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1b028-45ba-46fd-9d06-16d5816ac7de admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:48.723068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022aff2b-a338-47d7-8b66-6a659e4975e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:48.723725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022aff2b-a338-47d7-8b66-6a659e4975e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:48.724004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022aff2b-a338-47d7-8b66-6a659e4975e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:48.724282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022aff2b-a338-47d7-8b66-6a659e4975e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:48.725260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022aff2b-a338-47d7-8b66-6a659e4975e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:48.726662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022aff2b-a338-47d7-8b66-6a659e4975e9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:48.744927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd9609-067b-4601-8ad0-f93ce8d06d89 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:48.753672 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2599/5228] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:48.757563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd9609-067b-4601-8ad0-f93ce8d06d89 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:48.762475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8562f-b17b-4556-889d-6382b3904097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:48.763196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8562f-b17b-4556-889d-6382b3904097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:48.763536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8562f-b17b-4556-889d-6382b3904097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:48.764194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8562f-b17b-4556-889d-6382b3904097 admin admin] PATH_INFO: `/v3/projects/38b777af8148446cb979fa33a1b05817/users/ef5c54746e034cf8868cdaa3a28c6915/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:48.780725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8562f-b17b-4556-889d-6382b3904097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b777af8148446cb979fa33a1b05817, user_id=ef5c54746e034cf8868cdaa3a28c6915, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:48.783798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8562f-b17b-4556-889d-6382b3904097 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:48.815801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517adf-39aa-448e-b059-6070be9577f9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:48.816343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517adf-39aa-448e-b059-6070be9577f9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:48.816780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517adf-39aa-448e-b059-6070be9577f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:48.820481 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2630/5229] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:48 2022] PUT /identity/v3/projects/38b777af8148446cb979fa33a1b05817/users/ef5c54746e034cf8868cdaa3a28c6915/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:48.851120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f4517adf-39aa-448e-b059-6070be9577f9 None None] MFA Rules not processed for user `ef5c54746e034cf8868cdaa3a28c6915`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:48.853079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f4517adf-39aa-448e-b059-6070be9577f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:49.038563 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2600/5230] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:49.070289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8562f-b17b-4556-889d-6382b3904097 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:49.072297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b7e8562f-b17b-4556-889d-6382b3904097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:49.263326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8562f-b17b-4556-889d-6382b3904097 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:49.274693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05943c9-c425-482e-9b78-dfc21c79f3a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:49.275356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05943c9-c425-482e-9b78-dfc21c79f3a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:49.275638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05943c9-c425-482e-9b78-dfc21c79f3a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:49.275905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05943c9-c425-482e-9b78-dfc21c79f3a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:49.299689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05943c9-c425-482e-9b78-dfc21c79f3a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:49.301819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05943c9-c425-482e-9b78-dfc21c79f3a4 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:49.325537 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2631/5231] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:50.203037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a725263-c2a5-4f79-9ca0-c4abf8abd15c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:50.204370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a725263-c2a5-4f79-9ca0-c4abf8abd15c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:50.204886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a725263-c2a5-4f79-9ca0-c4abf8abd15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:50.287542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5a725263-c2a5-4f79-9ca0-c4abf8abd15c None None] MFA Rules not processed for user `26e4e60bc26a4d229a85c9990e1730a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:50.288789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5a725263-c2a5-4f79-9ca0-c4abf8abd15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:50.580666 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2601/5232] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:51.283284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05943c9-c425-482e-9b78-dfc21c79f3a4 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:51.284722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b05943c9-c425-482e-9b78-dfc21c79f3a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:51.491338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05943c9-c425-482e-9b78-dfc21c79f3a4 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:51.506022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:51.507552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:51.507997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:51.508458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] PATH_INFO: `/v3/users/e7ffb645ee034c89a9fe848974d9159a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:51.510550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ffb645ee034c89a9fe848974d9159a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:51.512703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:51.640048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ffb645ee034c89a9fe848974d9159a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:51.661854 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:51.683082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ffb645ee034c89a9fe848974d9159a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:51.684035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ffb645ee034c89a9fe848974d9159a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:51.707533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ffb645ee034c89a9fe848974d9159a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:51.709206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ffb645ee034c89a9fe848974d9159a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:51.736231 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2632/5233] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:51 2022] DELETE /identity/v3/users/e7ffb645ee034c89a9fe848974d9159a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:51.742186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec4cb2-6b96-477f-9f54-bacb44209d5f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:51.743183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec4cb2-6b96-477f-9f54-bacb44209d5f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:51.743668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec4cb2-6b96-477f-9f54-bacb44209d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:51.779568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0bec4cb2-6b96-477f-9f54-bacb44209d5f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:51.782632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0bec4cb2-6b96-477f-9f54-bacb44209d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:51.802819 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:52.009085 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2602/5234] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:24:52.032397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:52.033855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:52.216022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d9d86-b716-4118-b4a7-3bc303df639d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:52.235143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db6998-374e-4abf-b2a1-789ff8b687fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:52.236095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db6998-374e-4abf-b2a1-789ff8b687fd service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:52.236541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db6998-374e-4abf-b2a1-789ff8b687fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:52.236979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db6998-374e-4abf-b2a1-789ff8b687fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:52.249408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db6998-374e-4abf-b2a1-789ff8b687fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:52.251274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db6998-374e-4abf-b2a1-789ff8b687fd service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:52.263262 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2633/5235] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:52.970714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef8487-609a-4798-acce-cd2e1bea5c69 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:52.972392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef8487-609a-4798-acce-cd2e1bea5c69 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:52.973251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef8487-609a-4798-acce-cd2e1bea5c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:53.115789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db6998-374e-4abf-b2a1-789ff8b687fd service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:53.119727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b2db6998-374e-4abf-b2a1-789ff8b687fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:53.125465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b7ef8487-609a-4798-acce-cd2e1bea5c69 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:53.126755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b7ef8487-609a-4798-acce-cd2e1bea5c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:53.365014 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2603/5236] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:53.385013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db6998-374e-4abf-b2a1-789ff8b687fd service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:53.385287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4a5b5-c06b-44a0-b4d4-0d571d4d0d37 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:53.385737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4a5b5-c06b-44a0-b4d4-0d571d4d0d37 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:53.386973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4a5b5-c06b-44a0-b4d4-0d571d4d0d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:53.409061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e4ffe-be8a-4d63-9f6a-487a015058f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:53.412757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e4ffe-be8a-4d63-9f6a-487a015058f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:53.413284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e4ffe-be8a-4d63-9f6a-487a015058f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:53.414732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e4ffe-be8a-4d63-9f6a-487a015058f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:53.420096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-800e4ffe-be8a-4d63-9f6a-487a015058f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:53.439321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bce4a5b5-c06b-44a0-b4d4-0d571d4d0d37 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:53.441043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bce4a5b5-c06b-44a0-b4d4-0d571d4d0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:53.453270 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2604/5237] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:24:53.472435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4a5b5-c06b-44a0-b4d4-0d571d4d0d37 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:53.474743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bce4a5b5-c06b-44a0-b4d4-0d571d4d0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:53.493825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4a5b5-c06b-44a0-b4d4-0d571d4d0d37 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:53.502885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:53.504679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:53.505378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:53.506397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] PATH_INFO: `/v3/projects/dec21ee744ec45018bdfce96f41d7037` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:53.509628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec21ee744ec45018bdfce96f41d7037)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:53.512311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:53.603557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec21ee744ec45018bdfce96f41d7037', 'request_id': 'req-81f8231d-bc2c-4845-b002-d874d8f6b72c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:53.614197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec21ee744ec45018bdfce96f41d7037', 'request_id': 'req-81f8231d-bc2c-4845-b002-d874d8f6b72c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:53.624906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec21ee744ec45018bdfce96f41d7037', 'request_id': 'req-81f8231d-bc2c-4845-b002-d874d8f6b72c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:53.626536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e4ffe-be8a-4d63-9f6a-487a015058f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:53.630567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e4ffe-be8a-4d63-9f6a-487a015058f5 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:53.650180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] The token cache is being invalidate because project dec21ee744ec45018bdfce96f41d7037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:53.650853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:53.651765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:53.654905 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2605/5238] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:53 2022] DELETE /identity/v3/projects/dec21ee744ec45018bdfce96f41d7037 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:53.656542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:53.658465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:53.659499 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2634/5239] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:53.673010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e4ffe-be8a-4d63-9f6a-487a015058f5 service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:53.696705 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:53.709405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e4ffe-be8a-4d63-9f6a-487a015058f5 service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:53.794388 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:53.814162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8231d-bc2c-4845-b002-d874d8f6b72c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:53.840182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfbd4a-7e1f-4356-95aa-3caf18c886c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:53.840828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfbd4a-7e1f-4356-95aa-3caf18c886c4 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:53.841107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfbd4a-7e1f-4356-95aa-3caf18c886c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:53.841498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfbd4a-7e1f-4356-95aa-3caf18c886c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:53.843521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e7dfbd4a-7e1f-4356-95aa-3caf18c886c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:53.870075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d632ed5-643d-45ad-be8f-73bdfe8c8028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:53.870793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632ed5-643d-45ad-be8f-73bdfe8c8028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:53.871391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632ed5-643d-45ad-be8f-73bdfe8c8028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:53.872261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632ed5-643d-45ad-be8f-73bdfe8c8028 admin admin] PATH_INFO: `/v3/users/4d0b5abad4534e85a1c2417bac19e4a6` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:53.874557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d632ed5-643d-45ad-be8f-73bdfe8c8028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0b5abad4534e85a1c2417bac19e4a6)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:53.880395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d632ed5-643d-45ad-be8f-73bdfe8c8028 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:53.989674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfbd4a-7e1f-4356-95aa-3caf18c886c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:53.991350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfbd4a-7e1f-4356-95aa-3caf18c886c4 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:54.004205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2d632ed5-643d-45ad-be8f-73bdfe8c8028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0b5abad4534e85a1c2417bac19e4a6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:54.013660 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2606/5240] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:24:54.048203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2d632ed5-643d-45ad-be8f-73bdfe8c8028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0b5abad4534e85a1c2417bac19e4a6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:54.051162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2d632ed5-643d-45ad-be8f-73bdfe8c8028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0b5abad4534e85a1c2417bac19e4a6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:54.065862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2d632ed5-643d-45ad-be8f-73bdfe8c8028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0b5abad4534e85a1c2417bac19e4a6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:54.067816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2d632ed5-643d-45ad-be8f-73bdfe8c8028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0b5abad4534e85a1c2417bac19e4a6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:54.091966 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2635/5241] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:24:53 2022] DELETE /identity/v3/users/4d0b5abad4534e85a1c2417bac19e4a6 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:55.928208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfbd4a-7e1f-4356-95aa-3caf18c886c4 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:55.930243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e7dfbd4a-7e1f-4356-95aa-3caf18c886c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:55.958203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfbd4a-7e1f-4356-95aa-3caf18c886c4 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:56.076806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:56.077778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:56.078370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:56.079072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] PATH_INFO: `/v3/projects/dc6f1a115684427fb271708b175bb2a4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:56.080859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6f1a115684427fb271708b175bb2a4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:56.087211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:56.173384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6f1a115684427fb271708b175bb2a4', 'request_id': 'req-a8a42165-ab4a-41f7-a264-8f07bea663da'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:56.180392 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:56.183044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6f1a115684427fb271708b175bb2a4', 'request_id': 'req-a8a42165-ab4a-41f7-a264-8f07bea663da'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:56.193231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6f1a115684427fb271708b175bb2a4', 'request_id': 'req-a8a42165-ab4a-41f7-a264-8f07bea663da'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:56.225022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] The token cache is being invalidate because project dc6f1a115684427fb271708b175bb2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:24:56.225428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:56.226197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8a42165-ab4a-41f7-a264-8f07bea663da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:24:56.233614 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2607/5242] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:24:55 2022] DELETE /identity/v3/projects/dc6f1a115684427fb271708b175bb2a4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:56.249403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a8f3-a136-4af4-a6dc-231eb07c448c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:56.250726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a8f3-a136-4af4-a6dc-231eb07c448c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:56.251220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a8f3-a136-4af4-a6dc-231eb07c448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:56.297462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-53d6a8f3-a136-4af4-a6dc-231eb07c448c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:56.299930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-53d6a8f3-a136-4af4-a6dc-231eb07c448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:56.392665 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2636/5243] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:56.393003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf6d61-2362-4b32-9f40-8fcd28f83473 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:56.393299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf6d61-2362-4b32-9f40-8fcd28f83473 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:56.393569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf6d61-2362-4b32-9f40-8fcd28f83473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:56.419950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d8cf6d61-2362-4b32-9f40-8fcd28f83473 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:56.422378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d8cf6d61-2362-4b32-9f40-8fcd28f83473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:56.444095 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2608/5244] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:24:56.445664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6a8f3-a136-4af4-a6dc-231eb07c448c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:56.460063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6a8f3-a136-4af4-a6dc-231eb07c448c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:56.468276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb25da-1f9f-4f11-8524-e98df2c6307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:56.469088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb25da-1f9f-4f11-8524-e98df2c6307e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:56.469372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb25da-1f9f-4f11-8524-e98df2c6307e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:56.469692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb25da-1f9f-4f11-8524-e98df2c6307e admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:56.470372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb25da-1f9f-4f11-8524-e98df2c6307e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:24:56.470751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb25da-1f9f-4f11-8524-e98df2c6307e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:56.472564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb25da-1f9f-4f11-8524-e98df2c6307e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:56.496237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf6d61-2362-4b32-9f40-8fcd28f83473 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:56.510302 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2637/5245] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:24:56.512383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf6d61-2362-4b32-9f40-8fcd28f83473 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:56.520828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865c668-28e3-4002-b00f-f567464274e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:56.521726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865c668-28e3-4002-b00f-f567464274e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:56.522087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865c668-28e3-4002-b00f-f567464274e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:56.522349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865c668-28e3-4002-b00f-f567464274e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:56.523312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865c668-28e3-4002-b00f-f567464274e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:56.526455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865c668-28e3-4002-b00f-f567464274e3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:56.595834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb25da-1f9f-4f11-8524-e98df2c6307e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:56.602564 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2609/5246] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:56 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:56.611829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb25da-1f9f-4f11-8524-e98df2c6307e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:56.686930 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:56.733418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899d5f-852f-4ac8-a95d-55a7d928f5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:56.734135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899d5f-852f-4ac8-a95d-55a7d928f5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:56.734517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899d5f-852f-4ac8-a95d-55a7d928f5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:56.734888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899d5f-852f-4ac8-a95d-55a7d928f5e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:56.735745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899d5f-852f-4ac8-a95d-55a7d928f5e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:56.738095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899d5f-852f-4ac8-a95d-55a7d928f5e0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:56.769407 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2638/5247] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:56 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:56.774094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865c668-28e3-4002-b00f-f567464274e3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:56.804198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865c668-28e3-4002-b00f-f567464274e3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:56.815139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49b8fc-c4b9-4e4a-a11f-0afb30b54d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:56.816097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b8fc-c4b9-4e4a-a11f-0afb30b54d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:56.816491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b8fc-c4b9-4e4a-a11f-0afb30b54d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:56.816918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b8fc-c4b9-4e4a-a11f-0afb30b54d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:56.818490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49b8fc-c4b9-4e4a-a11f-0afb30b54d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:56.822089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49b8fc-c4b9-4e4a-a11f-0afb30b54d9a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:56.841793 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2610/5248] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:56.845457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899d5f-852f-4ac8-a95d-55a7d928f5e0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:56.876720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899d5f-852f-4ac8-a95d-55a7d928f5e0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:56.891854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927327c-d8b9-4b07-9442-94916b058d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:56.896293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927327c-d8b9-4b07-9442-94916b058d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:56.898523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927327c-d8b9-4b07-9442-94916b058d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:56.899167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927327c-d8b9-4b07-9442-94916b058d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:56.901932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927327c-d8b9-4b07-9442-94916b058d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:56.907257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927327c-d8b9-4b07-9442-94916b058d56 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:56.942664 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2639/5249] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:56.947037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49b8fc-c4b9-4e4a-a11f-0afb30b54d9a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:56.980411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49b8fc-c4b9-4e4a-a11f-0afb30b54d9a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:56.998807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e62c2-b3a2-40aa-be5b-4631f7fd6445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:57.002696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e62c2-b3a2-40aa-be5b-4631f7fd6445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:57.003024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e62c2-b3a2-40aa-be5b-4631f7fd6445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:57.003312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e62c2-b3a2-40aa-be5b-4631f7fd6445 admin admin] PATH_INFO: `/v3/projects/7f1d5d96035b4a5186a923f5720fe123/users/481166213ddc412aa894441f4ad9558b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:57.034277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e62c2-b3a2-40aa-be5b-4631f7fd6445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1d5d96035b4a5186a923f5720fe123, user_id=481166213ddc412aa894441f4ad9558b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:57.040769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e62c2-b3a2-40aa-be5b-4631f7fd6445 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:57.060753 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2611/5250] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:56 2022] PUT /identity/v3/projects/7f1d5d96035b4a5186a923f5720fe123/users/481166213ddc412aa894441f4ad9558b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:57.072509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f6716-9335-492c-be55-c6a186068293 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:57.073223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f6716-9335-492c-be55-c6a186068293 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:57.073711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f6716-9335-492c-be55-c6a186068293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:57.125576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5e7f6716-9335-492c-be55-c6a186068293 None None] MFA Rules not processed for user `481166213ddc412aa894441f4ad9558b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:57.127196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5e7f6716-9335-492c-be55-c6a186068293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:57.319898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e62c2-b3a2-40aa-be5b-4631f7fd6445 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:57.326772 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2640/5251] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:57.593510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e62c2-b3a2-40aa-be5b-4631f7fd6445 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:57.617870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508c809-0de4-4466-9791-ccecbed4ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:57.618798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c809-0de4-4466-9791-ccecbed4ea15 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:57.619091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c809-0de4-4466-9791-ccecbed4ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:57.621574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c809-0de4-4466-9791-ccecbed4ea15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:57.622296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508c809-0de4-4466-9791-ccecbed4ea15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:57.634590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508c809-0de4-4466-9791-ccecbed4ea15 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:57.710442 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2612/5252] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:24:57 2022] POST /identity/v3/projects => generated 367 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:24:57.714246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f6716-9335-492c-be55-c6a186068293 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:57.732374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f6716-9335-492c-be55-c6a186068293 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:57.897281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5e2c-deba-4a4d-89f5-f28aa4f5ade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:57.898126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5e2c-deba-4a4d-89f5-f28aa4f5ade4 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:57.898418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5e2c-deba-4a4d-89f5-f28aa4f5ade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:57.898688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5e2c-deba-4a4d-89f5-f28aa4f5ade4 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:57.899315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a5e2c-deba-4a4d-89f5-f28aa4f5ade4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:57.901367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a5e2c-deba-4a4d-89f5-f28aa4f5ade4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:57.964621 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2641/5253] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:24:57 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:24:57.968605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508c809-0de4-4466-9791-ccecbed4ea15 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:57.991524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508c809-0de4-4466-9791-ccecbed4ea15 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:58.001271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d018a-3256-4ac7-ba91-27e0f59c3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:58.002701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d018a-3256-4ac7-ba91-27e0f59c3f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:58.003238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d018a-3256-4ac7-ba91-27e0f59c3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:58.003735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d018a-3256-4ac7-ba91-27e0f59c3f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:58.004770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d018a-3256-4ac7-ba91-27e0f59c3f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:58.006823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d018a-3256-4ac7-ba91-27e0f59c3f40 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:58.034888 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2613/5254] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:58.035549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5e2c-deba-4a4d-89f5-f28aa4f5ade4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:58.052856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5e2c-deba-4a4d-89f5-f28aa4f5ade4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:58.068311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb240b9-7379-46a5-bbd3-7f6161d12619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:58.069730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb240b9-7379-46a5-bbd3-7f6161d12619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:58.070017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb240b9-7379-46a5-bbd3-7f6161d12619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:58.070830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb240b9-7379-46a5-bbd3-7f6161d12619 admin admin] PATH_INFO: `/v3/projects/affe175b622440b985745ad4716de782/users/23d3895b305849f68ab0b6c95e15c4d6/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:58.103013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb240b9-7379-46a5-bbd3-7f6161d12619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=affe175b622440b985745ad4716de782, user_id=23d3895b305849f68ab0b6c95e15c4d6, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:58.106702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb240b9-7379-46a5-bbd3-7f6161d12619 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:58.129279 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2642/5255] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:58 2022] PUT /identity/v3/projects/affe175b622440b985745ad4716de782/users/23d3895b305849f68ab0b6c95e15c4d6/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:24:58.133498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d018a-3256-4ac7-ba91-27e0f59c3f40 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:58.155221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d018a-3256-4ac7-ba91-27e0f59c3f40 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:58.380246 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:58.400159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248c1fe-630e-4a62-95b2-aafd11c2f20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:58.401221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c1fe-630e-4a62-95b2-aafd11c2f20f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:58.403613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c1fe-630e-4a62-95b2-aafd11c2f20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:58.403613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c1fe-630e-4a62-95b2-aafd11c2f20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:58.404073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248c1fe-630e-4a62-95b2-aafd11c2f20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:58.408867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248c1fe-630e-4a62-95b2-aafd11c2f20f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:58.436560 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2614/5256] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:24:58.437811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb240b9-7379-46a5-bbd3-7f6161d12619 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:58.449614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb240b9-7379-46a5-bbd3-7f6161d12619 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:58.470930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152530-de12-42e3-8c3e-17b6462d62b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:58.471549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152530-de12-42e3-8c3e-17b6462d62b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:58.471833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152530-de12-42e3-8c3e-17b6462d62b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:58.472114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152530-de12-42e3-8c3e-17b6462d62b3 admin admin] PATH_INFO: `/v3/projects/affe175b622440b985745ad4716de782/users/23d3895b305849f68ab0b6c95e15c4d6/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:58.475077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4152530-de12-42e3-8c3e-17b6462d62b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=affe175b622440b985745ad4716de782, user_id=23d3895b305849f68ab0b6c95e15c4d6, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:58.477748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4152530-de12-42e3-8c3e-17b6462d62b3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:58.484506 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:58.507824 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2643/5257] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:24:58 2022] PUT /identity/v3/projects/affe175b622440b985745ad4716de782/users/23d3895b305849f68ab0b6c95e15c4d6/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:24:58.518427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cabf2-f6cb-4203-af7a-19f9a9e81b91 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:58.518906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cabf2-f6cb-4203-af7a-19f9a9e81b91 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:58.519270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cabf2-f6cb-4203-af7a-19f9a9e81b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:58.577013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-597cabf2-f6cb-4203-af7a-19f9a9e81b91 None None] MFA Rules not processed for user `23d3895b305849f68ab0b6c95e15c4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:24:58.578260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-597cabf2-f6cb-4203-af7a-19f9a9e81b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:58.760484 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2615/5258] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:24:58.776087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152530-de12-42e3-8c3e-17b6462d62b3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:24:58.778000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e4152530-de12-42e3-8c3e-17b6462d62b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:24:58.942096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152530-de12-42e3-8c3e-17b6462d62b3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:24:58.955349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfb5d6-e539-470e-b18d-b2c593541b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:24:58.956406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfb5d6-e539-470e-b18d-b2c593541b06 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:24:58.956720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfb5d6-e539-470e-b18d-b2c593541b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:24:58.956963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfb5d6-e539-470e-b18d-b2c593541b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:24:58.983329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfb5d6-e539-470e-b18d-b2c593541b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:24:58.986405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfb5d6-e539-470e-b18d-b2c593541b06 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:24:59.015401 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2644/5259] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:02.097672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cabf2-f6cb-4203-af7a-19f9a9e81b91 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:02.117704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfb5d6-e539-470e-b18d-b2c593541b06 service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:02.119759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2cbfb5d6-e539-470e-b18d-b2c593541b06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:02.254046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfb5d6-e539-470e-b18d-b2c593541b06 service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:02.265409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bea06-a157-44ef-908b-5063cbf26cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:02.266160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bea06-a157-44ef-908b-5063cbf26cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:02.266536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bea06-a157-44ef-908b-5063cbf26cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:02.266924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bea06-a157-44ef-908b-5063cbf26cb7 admin admin] PATH_INFO: `/v3/users/0ea2dc39336748829235976ad74fc8ca` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:02.268163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bea06-a157-44ef-908b-5063cbf26cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea2dc39336748829235976ad74fc8ca)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:02.272731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bea06-a157-44ef-908b-5063cbf26cb7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:02.302593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cabf2-f6cb-4203-af7a-19f9a9e81b91 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:02.318668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7aab26-b5d2-4965-a8e8-08f4b289ed72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:02.319436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7aab26-b5d2-4965-a8e8-08f4b289ed72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:02.319730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7aab26-b5d2-4965-a8e8-08f4b289ed72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:02.320007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7aab26-b5d2-4965-a8e8-08f4b289ed72 admin admin] PATH_INFO: `/v3/users/481166213ddc412aa894441f4ad9558b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:02.321225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7aab26-b5d2-4965-a8e8-08f4b289ed72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481166213ddc412aa894441f4ad9558b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:02.323758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7aab26-b5d2-4965-a8e8-08f4b289ed72 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:02.376782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8b0bea06-a157-44ef-908b-5063cbf26cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea2dc39336748829235976ad74fc8ca'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:02.414475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8b0bea06-a157-44ef-908b-5063cbf26cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea2dc39336748829235976ad74fc8ca'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:02.416525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8b0bea06-a157-44ef-908b-5063cbf26cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea2dc39336748829235976ad74fc8ca'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:02.443955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd7aab26-b5d2-4965-a8e8-08f4b289ed72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481166213ddc412aa894441f4ad9558b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:02.448965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8b0bea06-a157-44ef-908b-5063cbf26cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea2dc39336748829235976ad74fc8ca'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:02.450070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8b0bea06-a157-44ef-908b-5063cbf26cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea2dc39336748829235976ad74fc8ca'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:02.478738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd7aab26-b5d2-4965-a8e8-08f4b289ed72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481166213ddc412aa894441f4ad9558b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:02.480008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd7aab26-b5d2-4965-a8e8-08f4b289ed72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481166213ddc412aa894441f4ad9558b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:02.482676 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2645/5260] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:02 2022] DELETE /identity/v3/users/0ea2dc39336748829235976ad74fc8ca => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:25:02.491341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81879fee-723f-49fd-b766-761b19fd83f4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:02.491655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81879fee-723f-49fd-b766-761b19fd83f4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:02.492659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81879fee-723f-49fd-b766-761b19fd83f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:02.505012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd7aab26-b5d2-4965-a8e8-08f4b289ed72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481166213ddc412aa894441f4ad9558b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:02.511353 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:02.514837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd7aab26-b5d2-4965-a8e8-08f4b289ed72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481166213ddc412aa894441f4ad9558b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:02.536341 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2616/5261] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:02 2022] DELETE /identity/v3/users/481166213ddc412aa894441f4ad9558b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:02.538224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd3fe0-00b1-4abe-a06c-2ba4321ad267 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:02.540229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd3fe0-00b1-4abe-a06c-2ba4321ad267 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:02.541564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd3fe0-00b1-4abe-a06c-2ba4321ad267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:02.547655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-81879fee-723f-49fd-b766-761b19fd83f4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:02.562034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-81879fee-723f-49fd-b766-761b19fd83f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:02.588186 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:02.603608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d5dd3fe0-00b1-4abe-a06c-2ba4321ad267 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:02.609686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5dd3fe0-00b1-4abe-a06c-2ba4321ad267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:02.733872 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2646/5262] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:25:02.749562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81879fee-723f-49fd-b766-761b19fd83f4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:02.751460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-81879fee-723f-49fd-b766-761b19fd83f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:02.813558 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2617/5263] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:02.833613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd3fe0-00b1-4abe-a06c-2ba4321ad267 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:02.835169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5dd3fe0-00b1-4abe-a06c-2ba4321ad267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:02.986524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81879fee-723f-49fd-b766-761b19fd83f4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:03.008236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1294a-674d-4ede-8bca-110128b7a549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:03.009024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1294a-674d-4ede-8bca-110128b7a549 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:03.009235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1294a-674d-4ede-8bca-110128b7a549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:03.009604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1294a-674d-4ede-8bca-110128b7a549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:03.029865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1294a-674d-4ede-8bca-110128b7a549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:03.035740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1294a-674d-4ede-8bca-110128b7a549 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:03.069500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd3fe0-00b1-4abe-a06c-2ba4321ad267 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:03.074504 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2647/5264] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:25:03.078532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dec83-f351-4e00-9759-de8091f6b5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:03.079219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dec83-f351-4e00-9759-de8091f6b5ca service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:03.079511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dec83-f351-4e00-9759-de8091f6b5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:03.080325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dec83-f351-4e00-9759-de8091f6b5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:03.103645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dec83-f351-4e00-9759-de8091f6b5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:03.105561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dec83-f351-4e00-9759-de8091f6b5ca service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:03.145647 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2618/5265] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:25:04.206132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1294a-674d-4ede-8bca-110128b7a549 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:04.208972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-82a1294a-674d-4ede-8bca-110128b7a549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:04.236444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dec83-f351-4e00-9759-de8091f6b5ca service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:04.240419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c85dec83-f351-4e00-9759-de8091f6b5ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:04.255721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1294a-674d-4ede-8bca-110128b7a549 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:04.267671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dec83-f351-4e00-9759-de8091f6b5ca service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:04.268613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:04.270724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:04.271807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:04.273133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] PATH_INFO: `/v3/projects/7f1d5d96035b4a5186a923f5720fe123` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:04.277867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1d5d96035b4a5186a923f5720fe123)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:04.283603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:04.283968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:04.287035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:04.287494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:04.287869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] PATH_INFO: `/v3/projects/0508a90bd1e044cfa448730bff083a3f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:04.289208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0508a90bd1e044cfa448730bff083a3f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:04.292565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:04.388155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0508a90bd1e044cfa448730bff083a3f', 'request_id': 'req-225be6c1-bf59-4261-8ba7-f02ec3ddb323'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.400372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0508a90bd1e044cfa448730bff083a3f', 'request_id': 'req-225be6c1-bf59-4261-8ba7-f02ec3ddb323'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.418014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0508a90bd1e044cfa448730bff083a3f', 'request_id': 'req-225be6c1-bf59-4261-8ba7-f02ec3ddb323'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.431733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1d5d96035b4a5186a923f5720fe123', 'request_id': 'req-9cb71eb5-fd68-4067-846d-e4a1bd020802'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.439545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1d5d96035b4a5186a923f5720fe123', 'request_id': 'req-9cb71eb5-fd68-4067-846d-e4a1bd020802'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.454353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1d5d96035b4a5186a923f5720fe123', 'request_id': 'req-9cb71eb5-fd68-4067-846d-e4a1bd020802'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.474509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] The token cache is being invalidate because project 0508a90bd1e044cfa448730bff083a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:04.475458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.476358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-225be6c1-bf59-4261-8ba7-f02ec3ddb323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.478589 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2619/5266] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:04 2022] DELETE /identity/v3/projects/0508a90bd1e044cfa448730bff083a3f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:04.493482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] The token cache is being invalidate because project 7f1d5d96035b4a5186a923f5720fe123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:04.493780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.496690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.500179 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2648/5267] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:04 2022] DELETE /identity/v3/projects/7f1d5d96035b4a5186a923f5720fe123 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:04.505408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:04.505965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad63a2c-e58f-4003-b3bb-0753457793f0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:04.506339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad63a2c-e58f-4003-b3bb-0753457793f0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:04.506712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad63a2c-e58f-4003-b3bb-0753457793f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:04.507113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:04.536086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fad63a2c-e58f-4003-b3bb-0753457793f0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:04.537963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fad63a2c-e58f-4003-b3bb-0753457793f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:04.565971 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:04.618238 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:04.629216 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2620/5268] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:04.636094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2772f9-fd1a-4804-8b27-94e5ee02a6d8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:04.636519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2772f9-fd1a-4804-8b27-94e5ee02a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:04.636797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2772f9-fd1a-4804-8b27-94e5ee02a6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:04.648219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb71eb5-fd68-4067-846d-e4a1bd020802 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:04.654786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:04.655480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:04.655782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:04.656064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] PATH_INFO: `/v3/users/23d3895b305849f68ab0b6c95e15c4d6` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:04.657397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d3895b305849f68ab0b6c95e15c4d6)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:04.660164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:04.661226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5a2772f9-fd1a-4804-8b27-94e5ee02a6d8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:04.665975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5a2772f9-fd1a-4804-8b27-94e5ee02a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:04.678677 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2621/5269] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:04.682712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2772f9-fd1a-4804-8b27-94e5ee02a6d8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:04.696649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2772f9-fd1a-4804-8b27-94e5ee02a6d8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:04.703977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ffe5e-55f0-4c90-9191-1362a4bcd03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:04.706061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ffe5e-55f0-4c90-9191-1362a4bcd03f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:04.706686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ffe5e-55f0-4c90-9191-1362a4bcd03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:04.707023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ffe5e-55f0-4c90-9191-1362a4bcd03f admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:04.708157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ffe5e-55f0-4c90-9191-1362a4bcd03f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:25:04.708762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ffe5e-55f0-4c90-9191-1362a4bcd03f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:04.711313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ffe5e-55f0-4c90-9191-1362a4bcd03f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:04.729415 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2622/5270] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:25:04.733814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ffe5e-55f0-4c90-9191-1362a4bcd03f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:04.740096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d3895b305849f68ab0b6c95e15c4d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.746350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ffe5e-55f0-4c90-9191-1362a4bcd03f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:04.752236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6150c3-6dee-4210-a622-2fdcdc19db74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:04.752940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6150c3-6dee-4210-a622-2fdcdc19db74 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:04.753309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6150c3-6dee-4210-a622-2fdcdc19db74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:04.753708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6150c3-6dee-4210-a622-2fdcdc19db74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:04.754680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6150c3-6dee-4210-a622-2fdcdc19db74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:04.756647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6150c3-6dee-4210-a622-2fdcdc19db74 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:04.757518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d3895b305849f68ab0b6c95e15c4d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.758437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d3895b305849f68ab0b6c95e15c4d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.767752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d3895b305849f68ab0b6c95e15c4d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.769152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d3895b305849f68ab0b6c95e15c4d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:04.811743 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2623/5271] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:04 2022] POST /identity/v3/projects => generated 359 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:25:04.812635 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2649/5272] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:04 2022] DELETE /identity/v3/users/23d3895b305849f68ab0b6c95e15c4d6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:04.813822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6150c3-6dee-4210-a622-2fdcdc19db74 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:04.818929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b6150c3-6dee-4210-a622-2fdcdc19db74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:04.914844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6150c3-6dee-4210-a622-2fdcdc19db74 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:05.020023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204e875-285b-4ebe-9c9f-82dc6c96b8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:05.020296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204e875-285b-4ebe-9c9f-82dc6c96b8ad admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:05.021171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204e875-285b-4ebe-9c9f-82dc6c96b8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:05.021791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204e875-285b-4ebe-9c9f-82dc6c96b8ad admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:05.023298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204e875-285b-4ebe-9c9f-82dc6c96b8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:05.026756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204e875-285b-4ebe-9c9f-82dc6c96b8ad admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:05.062292 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2624/5273] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:04 2022] POST /identity/v3/users => generated 280 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:05.063529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:05.085703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd3f41-762c-4c1c-9cb3-2d6fa9c416e5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:05.097617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd242-b3d2-47b2-b278-a672d64603b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:05.099526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd242-b3d2-47b2-b278-a672d64603b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:05.099916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd242-b3d2-47b2-b278-a672d64603b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:05.100296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd242-b3d2-47b2-b278-a672d64603b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:05.101191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fd242-b3d2-47b2-b278-a672d64603b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:05.103603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fd242-b3d2-47b2-b278-a672d64603b1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:05.131574 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2650/5274] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:05.134764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204e875-285b-4ebe-9c9f-82dc6c96b8ad admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:05.148254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204e875-285b-4ebe-9c9f-82dc6c96b8ad admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:05.154335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6418ee8-6446-409b-9c6d-edeeaa1c9de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:05.155159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6418ee8-6446-409b-9c6d-edeeaa1c9de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:05.155544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6418ee8-6446-409b-9c6d-edeeaa1c9de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:05.155956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6418ee8-6446-409b-9c6d-edeeaa1c9de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:05.157009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6418ee8-6446-409b-9c6d-edeeaa1c9de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:05.158875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6418ee8-6446-409b-9c6d-edeeaa1c9de1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:05.171863 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2625/5275] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:25:05.175615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd242-b3d2-47b2-b278-a672d64603b1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:05.189755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd242-b3d2-47b2-b278-a672d64603b1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:05.195350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faac5b-2dae-429b-9dc5-036f84627a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:05.196211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faac5b-2dae-429b-9dc5-036f84627a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:05.196550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faac5b-2dae-429b-9dc5-036f84627a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:05.196928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faac5b-2dae-429b-9dc5-036f84627a29 admin admin] PATH_INFO: `/v3/projects/a63303f5cd894aa8b31af9fe3c8d179d/users/a6de25ef23674c9092c55d2e02c01587/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:05.217175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faac5b-2dae-429b-9dc5-036f84627a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63303f5cd894aa8b31af9fe3c8d179d, user_id=a6de25ef23674c9092c55d2e02c01587, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:05.220785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faac5b-2dae-429b-9dc5-036f84627a29 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:05.245338 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2651/5276] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:05 2022] PUT /identity/v3/projects/a63303f5cd894aa8b31af9fe3c8d179d/users/a6de25ef23674c9092c55d2e02c01587/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:25:05.256721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f89ec-8148-4c69-a81f-f708f7562d0a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:05.257846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f89ec-8148-4c69-a81f-f708f7562d0a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:05.258220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f89ec-8148-4c69-a81f-f708f7562d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:05.277009 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:05.299955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4b3f89ec-8148-4c69-a81f-f708f7562d0a None None] MFA Rules not processed for user `a6de25ef23674c9092c55d2e02c01587`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:05.302344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b3f89ec-8148-4c69-a81f-f708f7562d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:05.418341 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2626/5277] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:05.456111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faac5b-2dae-429b-9dc5-036f84627a29 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:05.458506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-19faac5b-2dae-429b-9dc5-036f84627a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:05.605162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faac5b-2dae-429b-9dc5-036f84627a29 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:05.611877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dba12b-1615-466e-b2d1-c4c53d143961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:05.612571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dba12b-1615-466e-b2d1-c4c53d143961 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:05.612849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dba12b-1615-466e-b2d1-c4c53d143961 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:05.613122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dba12b-1615-466e-b2d1-c4c53d143961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:05.627991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dba12b-1615-466e-b2d1-c4c53d143961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:05.630545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dba12b-1615-466e-b2d1-c4c53d143961 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:05.663220 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2652/5278] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:05.842053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f89ec-8148-4c69-a81f-f708f7562d0a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:05.843170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b3f89ec-8148-4c69-a81f-f708f7562d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:06.045169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f89ec-8148-4c69-a81f-f708f7562d0a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:06.058370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:06.060033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:06.060531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:06.060871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] PATH_INFO: `/v3/projects/affe175b622440b985745ad4716de782` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:06.063493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=affe175b622440b985745ad4716de782)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:06.068543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:06.195183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affe175b622440b985745ad4716de782', 'request_id': 'req-f2b06e40-ae68-4ca7-83cc-57ae996913ae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:06.214813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affe175b622440b985745ad4716de782', 'request_id': 'req-f2b06e40-ae68-4ca7-83cc-57ae996913ae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:06.223401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affe175b622440b985745ad4716de782', 'request_id': 'req-f2b06e40-ae68-4ca7-83cc-57ae996913ae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:06.268050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] The token cache is being invalidate because project affe175b622440b985745ad4716de782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:06.268739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:06.270615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b06e40-ae68-4ca7-83cc-57ae996913ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:06.276111 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2627/5279] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:05 2022] DELETE /identity/v3/projects/affe175b622440b985745ad4716de782 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:06.282330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686ade-659e-4dd1-b683-203bdd614d9c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:06.282920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686ade-659e-4dd1-b683-203bdd614d9c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:06.283034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686ade-659e-4dd1-b683-203bdd614d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:06.328727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-57686ade-659e-4dd1-b683-203bdd614d9c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:06.329962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-57686ade-659e-4dd1-b683-203bdd614d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:06.392233 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:06.457832 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2653/5280] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:06.459916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94f662-f578-4144-b14a-110a31893d31 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:06.460588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94f662-f578-4144-b14a-110a31893d31 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:06.460588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94f662-f578-4144-b14a-110a31893d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:06.506829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3f94f662-f578-4144-b14a-110a31893d31 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:06.508431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3f94f662-f578-4144-b14a-110a31893d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:06.528956 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2628/5281] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:06.532670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57686ade-659e-4dd1-b683-203bdd614d9c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:06.545680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57686ade-659e-4dd1-b683-203bdd614d9c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:06.552827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937a0e0-3e36-44d4-a148-1b37de15fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:06.553619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937a0e0-3e36-44d4-a148-1b37de15fbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:06.553915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937a0e0-3e36-44d4-a148-1b37de15fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:06.554234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937a0e0-3e36-44d4-a148-1b37de15fbf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:06.554931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937a0e0-3e36-44d4-a148-1b37de15fbf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:25:06.556647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937a0e0-3e36-44d4-a148-1b37de15fbf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:06.558692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937a0e0-3e36-44d4-a148-1b37de15fbf2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:06.574370 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2654/5282] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:25:06.579239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94f662-f578-4144-b14a-110a31893d31 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:06.592789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94f662-f578-4144-b14a-110a31893d31 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:06.603246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bbee6-347b-4e6e-9286-eb1dfef9e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:06.604553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bbee6-347b-4e6e-9286-eb1dfef9e46f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:06.604949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bbee6-347b-4e6e-9286-eb1dfef9e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:06.605978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bbee6-347b-4e6e-9286-eb1dfef9e46f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:06.606845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bbee6-347b-4e6e-9286-eb1dfef9e46f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:06.610170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bbee6-347b-4e6e-9286-eb1dfef9e46f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:06.674695 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:06.696440 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2629/5283] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:06 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:06.702101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937a0e0-3e36-44d4-a148-1b37de15fbf2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:06.727693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937a0e0-3e36-44d4-a148-1b37de15fbf2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:06.825078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71120967-8cc0-4d67-b74f-e6887be38c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:06.826288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120967-8cc0-4d67-b74f-e6887be38c6b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:06.826722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120967-8cc0-4d67-b74f-e6887be38c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:06.827667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120967-8cc0-4d67-b74f-e6887be38c6b admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:06.828523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71120967-8cc0-4d67-b74f-e6887be38c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:06.831871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71120967-8cc0-4d67-b74f-e6887be38c6b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:06.887791 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2655/5284] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:06 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:06.891140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bbee6-347b-4e6e-9286-eb1dfef9e46f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:06.915255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bbee6-347b-4e6e-9286-eb1dfef9e46f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:06.922111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d046edc-ffab-4057-9baf-082d3411f23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:06.922917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d046edc-ffab-4057-9baf-082d3411f23c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:06.923346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d046edc-ffab-4057-9baf-082d3411f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:06.924363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d046edc-ffab-4057-9baf-082d3411f23c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:06.925141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d046edc-ffab-4057-9baf-082d3411f23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:06.927517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d046edc-ffab-4057-9baf-082d3411f23c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:06.948135 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2630/5285] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:06.950503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71120967-8cc0-4d67-b74f-e6887be38c6b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:06.967753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71120967-8cc0-4d67-b74f-e6887be38c6b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:06.990326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d10c-7e70-4324-b81c-81d936b279b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:06.991007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d10c-7e70-4324-b81c-81d936b279b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:06.991304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d10c-7e70-4324-b81c-81d936b279b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:06.995159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d10c-7e70-4324-b81c-81d936b279b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:06.995967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706d10c-7e70-4324-b81c-81d936b279b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:07.000399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706d10c-7e70-4324-b81c-81d936b279b1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:07.050520 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2656/5286] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:07.051519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d046edc-ffab-4057-9baf-082d3411f23c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:07.068652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d046edc-ffab-4057-9baf-082d3411f23c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:07.083313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035bf60-b490-4cb3-b4c8-fa01f12e1ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:07.084548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035bf60-b490-4cb3-b4c8-fa01f12e1ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:07.084849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035bf60-b490-4cb3-b4c8-fa01f12e1ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:07.085340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035bf60-b490-4cb3-b4c8-fa01f12e1ad3 admin admin] PATH_INFO: `/v3/projects/7c6d539743fb49e4a439fdc23603eacd/users/2c289cdc25624ae1bca8f1de1227dd89/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:07.120569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035bf60-b490-4cb3-b4c8-fa01f12e1ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6d539743fb49e4a439fdc23603eacd, user_id=2c289cdc25624ae1bca8f1de1227dd89, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:07.124065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035bf60-b490-4cb3-b4c8-fa01f12e1ad3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:07.161527 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2631/5287] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:07 2022] PUT /identity/v3/projects/7c6d539743fb49e4a439fdc23603eacd/users/2c289cdc25624ae1bca8f1de1227dd89/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:25:07.164544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc198985-a014-41c5-be9b-b8d488e9d810 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:07.164923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc198985-a014-41c5-be9b-b8d488e9d810 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:07.165361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc198985-a014-41c5-be9b-b8d488e9d810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:07.252748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bc198985-a014-41c5-be9b-b8d488e9d810 None None] MFA Rules not processed for user `2c289cdc25624ae1bca8f1de1227dd89`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:07.254776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bc198985-a014-41c5-be9b-b8d488e9d810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:07.424285 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2657/5288] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:07.426262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035bf60-b490-4cb3-b4c8-fa01f12e1ad3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:07.556948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035bf60-b490-4cb3-b4c8-fa01f12e1ad3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:07.570911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd8b47-e039-4f0e-a35d-2dc53905e005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:07.571552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd8b47-e039-4f0e-a35d-2dc53905e005 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:07.571840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd8b47-e039-4f0e-a35d-2dc53905e005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:07.572111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd8b47-e039-4f0e-a35d-2dc53905e005 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:07.572759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd8b47-e039-4f0e-a35d-2dc53905e005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:07.574764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd8b47-e039-4f0e-a35d-2dc53905e005 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:07.643950 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2632/5289] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:07 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:07.650105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc198985-a014-41c5-be9b-b8d488e9d810 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:07.671408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc198985-a014-41c5-be9b-b8d488e9d810 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:07.727078 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:07.799335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff49f6-1692-4505-89f3-7c9b8602c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:07.800499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff49f6-1692-4505-89f3-7c9b8602c384 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:07.800499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff49f6-1692-4505-89f3-7c9b8602c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:07.800704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff49f6-1692-4505-89f3-7c9b8602c384 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:07.803359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff49f6-1692-4505-89f3-7c9b8602c384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:07.806796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff49f6-1692-4505-89f3-7c9b8602c384 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:07.842408 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2658/5290] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:07 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:07.843628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd8b47-e039-4f0e-a35d-2dc53905e005 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:07.859832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd8b47-e039-4f0e-a35d-2dc53905e005 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:07.867252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2320-8f23-404d-9ec4-5da575cd8b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:07.868219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2320-8f23-404d-9ec4-5da575cd8b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:07.868713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2320-8f23-404d-9ec4-5da575cd8b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:07.869302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2320-8f23-404d-9ec4-5da575cd8b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:07.870180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b2320-8f23-404d-9ec4-5da575cd8b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:07.872075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b2320-8f23-404d-9ec4-5da575cd8b9e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:07.896047 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2633/5291] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:07.902472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff49f6-1692-4505-89f3-7c9b8602c384 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:07.927472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff49f6-1692-4505-89f3-7c9b8602c384 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:07.973363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118a755-f1b0-48e5-9e4a-7e328a40090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:07.974078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a755-f1b0-48e5-9e4a-7e328a40090c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:07.974371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a755-f1b0-48e5-9e4a-7e328a40090c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:07.974499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a755-f1b0-48e5-9e4a-7e328a40090c admin admin] PATH_INFO: `/v3/projects/e56209c347154571827b263c5079caf1/users/478d572382244f19bf304fa21ec3cbb7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:08.028885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118a755-f1b0-48e5-9e4a-7e328a40090c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56209c347154571827b263c5079caf1, user_id=478d572382244f19bf304fa21ec3cbb7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:08.032894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118a755-f1b0-48e5-9e4a-7e328a40090c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:08.061603 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2659/5292] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:07 2022] PUT /identity/v3/projects/e56209c347154571827b263c5079caf1/users/478d572382244f19bf304fa21ec3cbb7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:08.067321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2320-8f23-404d-9ec4-5da575cd8b9e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:08.083506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2320-8f23-404d-9ec4-5da575cd8b9e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:08.245382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc93c32-968d-4a18-87e9-f721f864ed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:08.246584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93c32-968d-4a18-87e9-f721f864ed28 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:08.246916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93c32-968d-4a18-87e9-f721f864ed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:08.247205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93c32-968d-4a18-87e9-f721f864ed28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:08.247938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc93c32-968d-4a18-87e9-f721f864ed28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:08.250334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc93c32-968d-4a18-87e9-f721f864ed28 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:08.272804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118a755-f1b0-48e5-9e4a-7e328a40090c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:08.273018 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2634/5293] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:08.284496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118a755-f1b0-48e5-9e4a-7e328a40090c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:08.319652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faf6a2-1a83-4d04-8d17-61b18cef5d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:08.320604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faf6a2-1a83-4d04-8d17-61b18cef5d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:08.321135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faf6a2-1a83-4d04-8d17-61b18cef5d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:08.321623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faf6a2-1a83-4d04-8d17-61b18cef5d65 admin admin] PATH_INFO: `/v3/projects/e56209c347154571827b263c5079caf1/users/478d572382244f19bf304fa21ec3cbb7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:08.327600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8faf6a2-1a83-4d04-8d17-61b18cef5d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56209c347154571827b263c5079caf1, user_id=478d572382244f19bf304fa21ec3cbb7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:08.332390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8faf6a2-1a83-4d04-8d17-61b18cef5d65 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:08.368625 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2660/5294] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:08 2022] PUT /identity/v3/projects/e56209c347154571827b263c5079caf1/users/478d572382244f19bf304fa21ec3cbb7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:25:08.382319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d4d3-f269-418e-8374-574bab1efcd5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:08.382644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d4d3-f269-418e-8374-574bab1efcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:08.382919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d4d3-f269-418e-8374-574bab1efcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:08.467557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-51e0d4d3-f269-418e-8374-574bab1efcd5 None None] MFA Rules not processed for user `478d572382244f19bf304fa21ec3cbb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:08.468860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-51e0d4d3-f269-418e-8374-574bab1efcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:08.492853 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:08.571209 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2635/5295] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:08.578415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faf6a2-1a83-4d04-8d17-61b18cef5d65 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:08.581653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a8faf6a2-1a83-4d04-8d17-61b18cef5d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:08.721299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faf6a2-1a83-4d04-8d17-61b18cef5d65 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:08.740251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fc05a-5b13-44d3-b3cd-e15747e65f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:08.741111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fc05a-5b13-44d3-b3cd-e15747e65f72 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:08.741565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fc05a-5b13-44d3-b3cd-e15747e65f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:08.741994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fc05a-5b13-44d3-b3cd-e15747e65f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:08.758114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fc05a-5b13-44d3-b3cd-e15747e65f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:08.759860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fc05a-5b13-44d3-b3cd-e15747e65f72 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:08.798005 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2661/5296] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:08.820915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0d4d3-f269-418e-8374-574bab1efcd5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:08.822585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-51e0d4d3-f269-418e-8374-574bab1efcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:09.034913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0d4d3-f269-418e-8374-574bab1efcd5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:09.041816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579f879-b0af-4bef-86a2-637e259dac20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:09.042805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f879-b0af-4bef-86a2-637e259dac20 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:09.043085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f879-b0af-4bef-86a2-637e259dac20 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:09.043402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f879-b0af-4bef-86a2-637e259dac20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:09.053690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fc05a-5b13-44d3-b3cd-e15747e65f72 service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:09.056110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c579f879-b0af-4bef-86a2-637e259dac20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:09.103414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579f879-b0af-4bef-86a2-637e259dac20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:09.105178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579f879-b0af-4bef-86a2-637e259dac20 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:09.136838 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2636/5297] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:09.206489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fc05a-5b13-44d3-b3cd-e15747e65f72 service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:09.219328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:09.219990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:09.220320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:09.220543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] PATH_INFO: `/v3/users/2c289cdc25624ae1bca8f1de1227dd89` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:09.221746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c289cdc25624ae1bca8f1de1227dd89)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:09.231410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:09.282944 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:09.357354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c289cdc25624ae1bca8f1de1227dd89'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:09.373930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c289cdc25624ae1bca8f1de1227dd89'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:09.375699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c289cdc25624ae1bca8f1de1227dd89'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:09.394043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c289cdc25624ae1bca8f1de1227dd89'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:09.395407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c289cdc25624ae1bca8f1de1227dd89'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:09.422032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dbcac-d3a0-4a92-9a57-06a0f814aaf8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:09.422804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dbcac-d3a0-4a92-9a57-06a0f814aaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:09.422804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dbcac-d3a0-4a92-9a57-06a0f814aaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:09.427128 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2662/5298] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:09 2022] DELETE /identity/v3/users/2c289cdc25624ae1bca8f1de1227dd89 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:09.462007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c18dbcac-d3a0-4a92-9a57-06a0f814aaf8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:09.463355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c18dbcac-d3a0-4a92-9a57-06a0f814aaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:09.607792 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2637/5299] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:09.654919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:09.657276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:09.750015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88bb60-e818-44cb-8dc6-fd93232efe29 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:09.755624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68734876-1f4b-47cc-954d-452e15975b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:09.757030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68734876-1f4b-47cc-954d-452e15975b28 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:09.757417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68734876-1f4b-47cc-954d-452e15975b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:09.757794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68734876-1f4b-47cc-954d-452e15975b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:09.776472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d1afb-11a3-449a-97d9-83d93a9740ac None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:09.776863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d1afb-11a3-449a-97d9-83d93a9740ac None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:09.777199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d1afb-11a3-449a-97d9-83d93a9740ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:09.781075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68734876-1f4b-47cc-954d-452e15975b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:09.793033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68734876-1f4b-47cc-954d-452e15975b28 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:09.812935 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2663/5300] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:09.837198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7f5d1afb-11a3-449a-97d9-83d93a9740ac None None] MFA Rules not processed for user `fe1fa0967b8444279e5bad164b635df5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:09.838431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7f5d1afb-11a3-449a-97d9-83d93a9740ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:09.920127 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:09.943653 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2638/5301] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:11.088006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68734876-1f4b-47cc-954d-452e15975b28 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:11.089860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-68734876-1f4b-47cc-954d-452e15975b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:11.151560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68734876-1f4b-47cc-954d-452e15975b28 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:11.172852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:11.176560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:11.176877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:11.179937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] PATH_INFO: `/v3/projects/7c6d539743fb49e4a439fdc23603eacd` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:11.185382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6d539743fb49e4a439fdc23603eacd)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:11.188857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:11.346823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6d539743fb49e4a439fdc23603eacd', 'request_id': 'req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:11.363796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6d539743fb49e4a439fdc23603eacd', 'request_id': 'req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:11.385775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6d539743fb49e4a439fdc23603eacd', 'request_id': 'req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:11.411375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] The token cache is being invalidate because project 7c6d539743fb49e4a439fdc23603eacd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:11.412116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:11.416089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:11.420616 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2664/5302] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:11 2022] DELETE /identity/v3/projects/7c6d539743fb49e4a439fdc23603eacd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:11.424569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d1afb-11a3-449a-97d9-83d93a9740ac None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:11.464843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d1afb-11a3-449a-97d9-83d93a9740ac None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:11.624834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d64ef0-e2ae-4ac0-b46e-70c9f6383515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:11.626676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64ef0-e2ae-4ac0-b46e-70c9f6383515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:11.627194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64ef0-e2ae-4ac0-b46e-70c9f6383515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:11.650722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64ef0-e2ae-4ac0-b46e-70c9f6383515 admin admin] PATH_INFO: `/v3/users/478d572382244f19bf304fa21ec3cbb7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:11.655000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d64ef0-e2ae-4ac0-b46e-70c9f6383515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478d572382244f19bf304fa21ec3cbb7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:11.658084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d64ef0-e2ae-4ac0-b46e-70c9f6383515 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:11.848461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-90d64ef0-e2ae-4ac0-b46e-70c9f6383515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478d572382244f19bf304fa21ec3cbb7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:11.866426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-90d64ef0-e2ae-4ac0-b46e-70c9f6383515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478d572382244f19bf304fa21ec3cbb7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:11.867406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-90d64ef0-e2ae-4ac0-b46e-70c9f6383515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478d572382244f19bf304fa21ec3cbb7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:11.880608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-90d64ef0-e2ae-4ac0-b46e-70c9f6383515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478d572382244f19bf304fa21ec3cbb7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:11.893589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-90d64ef0-e2ae-4ac0-b46e-70c9f6383515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478d572382244f19bf304fa21ec3cbb7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:11.932315 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2639/5303] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:11 2022] DELETE /identity/v3/users/478d572382244f19bf304fa21ec3cbb7 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:12.662031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:12.665490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:12.718482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb71ad2-1dc3-40b6-a20b-8ddaecce2573 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:12.776633 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:12.856984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:12.857688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:12.859633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:12.859935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] PATH_INFO: `/v3/projects/e56209c347154571827b263c5079caf1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:12.861236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56209c347154571827b263c5079caf1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:12.864039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:12.939934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56209c347154571827b263c5079caf1', 'request_id': 'req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:12.953425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56209c347154571827b263c5079caf1', 'request_id': 'req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:12.965491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56209c347154571827b263c5079caf1', 'request_id': 'req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:12.994841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] The token cache is being invalidate because project e56209c347154571827b263c5079caf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:12.995482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:12.997147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-243e381e-0c69-4ae1-8f32-d0c2d0ae28d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:13.001620 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2665/5304] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:12 2022] DELETE /identity/v3/projects/e56209c347154571827b263c5079caf1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:13.006789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02894005-a4ef-403f-8e64-0670cf90c7c3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:13.007635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02894005-a4ef-403f-8e64-0670cf90c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:13.008682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02894005-a4ef-403f-8e64-0670cf90c7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:13.067797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-02894005-a4ef-403f-8e64-0670cf90c7c3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:13.069342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-02894005-a4ef-403f-8e64-0670cf90c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:13.247760 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2640/5305] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:13.255299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb0932-008d-49f7-ba1b-63f4a0da48b1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:13.256482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb0932-008d-49f7-ba1b-63f4a0da48b1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:13.256482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb0932-008d-49f7-ba1b-63f4a0da48b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:13.318198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a9fb0932-008d-49f7-ba1b-63f4a0da48b1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:13.319768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a9fb0932-008d-49f7-ba1b-63f4a0da48b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:13.346220 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2666/5306] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:13.350547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02894005-a4ef-403f-8e64-0670cf90c7c3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:13.376614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02894005-a4ef-403f-8e64-0670cf90c7c3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:13.409468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32513b-10d0-4024-8e9a-3a560a938a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:13.414000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32513b-10d0-4024-8e9a-3a560a938a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:13.417741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32513b-10d0-4024-8e9a-3a560a938a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:13.419791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32513b-10d0-4024-8e9a-3a560a938a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:13.427594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32513b-10d0-4024-8e9a-3a560a938a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:25:13.430333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32513b-10d0-4024-8e9a-3a560a938a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:13.443206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32513b-10d0-4024-8e9a-3a560a938a8b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:13.497846 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:13.509544 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2641/5307] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:25:13.515137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb0932-008d-49f7-ba1b-63f4a0da48b1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:13.538899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb0932-008d-49f7-ba1b-63f4a0da48b1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:13.555421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c1d1e-d8f7-4ad9-9c1f-b84aa183f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:13.557994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c1d1e-d8f7-4ad9-9c1f-b84aa183f449 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:13.558484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c1d1e-d8f7-4ad9-9c1f-b84aa183f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:13.558962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c1d1e-d8f7-4ad9-9c1f-b84aa183f449 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:13.559886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c1d1e-d8f7-4ad9-9c1f-b84aa183f449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:13.562961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c1d1e-d8f7-4ad9-9c1f-b84aa183f449 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:13.639691 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2667/5308] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:13 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:13.644248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32513b-10d0-4024-8e9a-3a560a938a8b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:13.661334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32513b-10d0-4024-8e9a-3a560a938a8b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:13.765896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aa254-72d6-4548-89fb-3921e3a3802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:13.767416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa254-72d6-4548-89fb-3921e3a3802d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:13.768187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa254-72d6-4548-89fb-3921e3a3802d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:13.768864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa254-72d6-4548-89fb-3921e3a3802d admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:13.770521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aa254-72d6-4548-89fb-3921e3a3802d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:13.775523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aa254-72d6-4548-89fb-3921e3a3802d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:13.872334 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2642/5309] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:13 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:13.877021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c1d1e-d8f7-4ad9-9c1f-b84aa183f449 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:13.895131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c1d1e-d8f7-4ad9-9c1f-b84aa183f449 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:13.904223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e62e37-f346-4c3b-bb68-47f65e9f4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:13.905867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e62e37-f346-4c3b-bb68-47f65e9f4c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:13.906542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e62e37-f346-4c3b-bb68-47f65e9f4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:13.910454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e62e37-f346-4c3b-bb68-47f65e9f4c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:13.912242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e62e37-f346-4c3b-bb68-47f65e9f4c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:13.914532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e62e37-f346-4c3b-bb68-47f65e9f4c90 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:13.938112 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2668/5310] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:13.943233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aa254-72d6-4548-89fb-3921e3a3802d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:13.964699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aa254-72d6-4548-89fb-3921e3a3802d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:13.996044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b0993-70b2-4f1c-bf8d-d259100d3b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:13.996687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0993-70b2-4f1c-bf8d-d259100d3b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:13.998658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0993-70b2-4f1c-bf8d-d259100d3b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:13.998915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0993-70b2-4f1c-bf8d-d259100d3b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:14.000651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b0993-70b2-4f1c-bf8d-d259100d3b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:14.002298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b0993-70b2-4f1c-bf8d-d259100d3b04 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:14.025399 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2643/5311] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:14.030730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e62e37-f346-4c3b-bb68-47f65e9f4c90 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:14.046265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e62e37-f346-4c3b-bb68-47f65e9f4c90 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:14.053124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338c2f3-acf2-4633-b03c-fefdc2470611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:14.054064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338c2f3-acf2-4633-b03c-fefdc2470611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:14.054420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338c2f3-acf2-4633-b03c-fefdc2470611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:14.054813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338c2f3-acf2-4633-b03c-fefdc2470611 admin admin] PATH_INFO: `/v3/projects/e2eac95593b2430a915a917f4e19fc23/users/3015cff8c4c445e39545e5a4cec93a1c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:14.074879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338c2f3-acf2-4633-b03c-fefdc2470611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2eac95593b2430a915a917f4e19fc23, user_id=3015cff8c4c445e39545e5a4cec93a1c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:14.078517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338c2f3-acf2-4633-b03c-fefdc2470611 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:14.103646 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2669/5312] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:14 2022] PUT /identity/v3/projects/e2eac95593b2430a915a917f4e19fc23/users/3015cff8c4c445e39545e5a4cec93a1c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:14.116998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d7638-6d68-4bea-926d-1520392481a4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:14.117286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d7638-6d68-4bea-926d-1520392481a4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:14.117559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d7638-6d68-4bea-926d-1520392481a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:14.167951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-622d7638-6d68-4bea-926d-1520392481a4 None None] MFA Rules not processed for user `3015cff8c4c445e39545e5a4cec93a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:14.168785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-622d7638-6d68-4bea-926d-1520392481a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:14.318732 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2644/5313] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:14.319919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338c2f3-acf2-4633-b03c-fefdc2470611 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:14.444263 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:14.474138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338c2f3-acf2-4633-b03c-fefdc2470611 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:14.497493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fdba6-3cb3-44e4-b8d4-6d4ed15dd4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:14.498201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fdba6-3cb3-44e4-b8d4-6d4ed15dd4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:14.498476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fdba6-3cb3-44e4-b8d4-6d4ed15dd4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:14.498770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fdba6-3cb3-44e4-b8d4-6d4ed15dd4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:14.499413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fdba6-3cb3-44e4-b8d4-6d4ed15dd4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:14.501359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fdba6-3cb3-44e4-b8d4-6d4ed15dd4c3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:14.580833 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2670/5314] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:14 2022] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:14.584833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d7638-6d68-4bea-926d-1520392481a4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:14.601967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d7638-6d68-4bea-926d-1520392481a4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:14.692821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259afbf-2e80-4b7e-aeb6-e9ac6ec82498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:14.693453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259afbf-2e80-4b7e-aeb6-e9ac6ec82498 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:14.693738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259afbf-2e80-4b7e-aeb6-e9ac6ec82498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:14.694013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259afbf-2e80-4b7e-aeb6-e9ac6ec82498 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:14.694698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259afbf-2e80-4b7e-aeb6-e9ac6ec82498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:14.696654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259afbf-2e80-4b7e-aeb6-e9ac6ec82498 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:14.735307 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:14.767005 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2645/5315] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:14 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:14.769862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fdba6-3cb3-44e4-b8d4-6d4ed15dd4c3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:14.790417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fdba6-3cb3-44e4-b8d4-6d4ed15dd4c3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:14.797443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d6a81-c5f9-41f3-92f0-ddc801bc3ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:14.798327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d6a81-c5f9-41f3-92f0-ddc801bc3ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:14.798642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d6a81-c5f9-41f3-92f0-ddc801bc3ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:14.798994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d6a81-c5f9-41f3-92f0-ddc801bc3ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:14.801173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d6a81-c5f9-41f3-92f0-ddc801bc3ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:14.803694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d6a81-c5f9-41f3-92f0-ddc801bc3ca3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:14.829565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259afbf-2e80-4b7e-aeb6-e9ac6ec82498 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:14.830232 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2671/5316] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:14.846650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259afbf-2e80-4b7e-aeb6-e9ac6ec82498 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:14.855368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda52fd-9ec7-4de6-9ef2-f87009ad00c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:14.856302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda52fd-9ec7-4de6-9ef2-f87009ad00c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:14.857119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda52fd-9ec7-4de6-9ef2-f87009ad00c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:14.857119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda52fd-9ec7-4de6-9ef2-f87009ad00c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:14.857831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda52fd-9ec7-4de6-9ef2-f87009ad00c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:14.860722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda52fd-9ec7-4de6-9ef2-f87009ad00c0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:14.880065 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2646/5317] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:14.889071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d6a81-c5f9-41f3-92f0-ddc801bc3ca3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:14.926897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d6a81-c5f9-41f3-92f0-ddc801bc3ca3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:14.932984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a0db-5b80-4746-b1a1-7d33d6944cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:14.934991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a0db-5b80-4746-b1a1-7d33d6944cea admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:14.935277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a0db-5b80-4746-b1a1-7d33d6944cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:14.935759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a0db-5b80-4746-b1a1-7d33d6944cea admin admin] PATH_INFO: `/v3/projects/87c9cae7535e4037931d50215f1bbf2f/users/7e33815c28154536ae906392a3de933f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:14.984660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6a0db-5b80-4746-b1a1-7d33d6944cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c9cae7535e4037931d50215f1bbf2f, user_id=7e33815c28154536ae906392a3de933f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:14.996869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6a0db-5b80-4746-b1a1-7d33d6944cea admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:15.025344 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2672/5318] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:14 2022] PUT /identity/v3/projects/87c9cae7535e4037931d50215f1bbf2f/users/7e33815c28154536ae906392a3de933f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:15.038164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab35336-cc64-44ed-9bc6-d24a33342fac None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:15.038715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab35336-cc64-44ed-9bc6-d24a33342fac None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:15.038938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab35336-cc64-44ed-9bc6-d24a33342fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:15.117226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7ab35336-cc64-44ed-9bc6-d24a33342fac None None] MFA Rules not processed for user `7e33815c28154536ae906392a3de933f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:15.120978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7ab35336-cc64-44ed-9bc6-d24a33342fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:15.201918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a0db-5b80-4746-b1a1-7d33d6944cea admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:15.204425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c2b6a0db-5b80-4746-b1a1-7d33d6944cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:15.276022 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2647/5319] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:15.280788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab35336-cc64-44ed-9bc6-d24a33342fac None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:15.334366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a0db-5b80-4746-b1a1-7d33d6944cea admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:15.347722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26925588-a9b5-4d92-a087-c6207411013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:15.350272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26925588-a9b5-4d92-a087-c6207411013b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:15.350674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26925588-a9b5-4d92-a087-c6207411013b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:15.350945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26925588-a9b5-4d92-a087-c6207411013b admin admin] PATH_INFO: `/v3/users/7c17addef0664acbacdf877431d73888` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:15.353718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26925588-a9b5-4d92-a087-c6207411013b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c17addef0664acbacdf877431d73888)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:15.359535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26925588-a9b5-4d92-a087-c6207411013b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:15.377800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab35336-cc64-44ed-9bc6-d24a33342fac None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:15.384830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc8489-619a-4831-a899-905a1e3b9170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:15.385717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc8489-619a-4831-a899-905a1e3b9170 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:15.387392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc8489-619a-4831-a899-905a1e3b9170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:15.387392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc8489-619a-4831-a899-905a1e3b9170 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:15.387392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc8489-619a-4831-a899-905a1e3b9170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:15.389785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc8489-619a-4831-a899-905a1e3b9170 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:15.436114 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2648/5320] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:15 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:25:15.442666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc8489-619a-4831-a899-905a1e3b9170 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:15.505706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26925588-a9b5-4d92-a087-c6207411013b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c17addef0664acbacdf877431d73888'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:15.523342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26925588-a9b5-4d92-a087-c6207411013b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c17addef0664acbacdf877431d73888'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:15.524926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26925588-a9b5-4d92-a087-c6207411013b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c17addef0664acbacdf877431d73888'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:15.539406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26925588-a9b5-4d92-a087-c6207411013b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c17addef0664acbacdf877431d73888'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:15.540941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26925588-a9b5-4d92-a087-c6207411013b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c17addef0664acbacdf877431d73888'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:15.543535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc8489-619a-4831-a899-905a1e3b9170 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:15.563409 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2673/5321] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:15 2022] DELETE /identity/v3/users/7c17addef0664acbacdf877431d73888 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:25:15.566093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657daf1-6671-4d3c-aed6-69cc22da4d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:15.566464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5f06-b397-49ff-889a-fd0811fe0d34 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:15.566987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5f06-b397-49ff-889a-fd0811fe0d34 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:15.567548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657daf1-6671-4d3c-aed6-69cc22da4d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:15.567703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5f06-b397-49ff-889a-fd0811fe0d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:15.568124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657daf1-6671-4d3c-aed6-69cc22da4d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:15.568637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657daf1-6671-4d3c-aed6-69cc22da4d5c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:15.569450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657daf1-6671-4d3c-aed6-69cc22da4d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:15.573065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657daf1-6671-4d3c-aed6-69cc22da4d5c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:15.597180 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:15.602233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-85dc5f06-b397-49ff-889a-fd0811fe0d34 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:15.605030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-85dc5f06-b397-49ff-889a-fd0811fe0d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:15.620784 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2649/5322] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:15 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:15.629874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657daf1-6671-4d3c-aed6-69cc22da4d5c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:15.632714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1657daf1-6671-4d3c-aed6-69cc22da4d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:15.667690 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:15.690180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657daf1-6671-4d3c-aed6-69cc22da4d5c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:15.801464 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2674/5323] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:15.825940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc5f06-b397-49ff-889a-fd0811fe0d34 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:15.827620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-85dc5f06-b397-49ff-889a-fd0811fe0d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:15.839695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c991f-17db-40a1-b784-d6d045c3e961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:15.842062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c991f-17db-40a1-b784-d6d045c3e961 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:15.843218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c991f-17db-40a1-b784-d6d045c3e961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:15.844736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c991f-17db-40a1-b784-d6d045c3e961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:15.848090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c991f-17db-40a1-b784-d6d045c3e961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:15.856060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c991f-17db-40a1-b784-d6d045c3e961 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:15.894787 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2650/5324] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:15.897336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c991f-17db-40a1-b784-d6d045c3e961 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:15.925319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c991f-17db-40a1-b784-d6d045c3e961 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:15.949249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2bbe6-dbcd-424d-90a8-25aef62a8753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:15.951966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2bbe6-dbcd-424d-90a8-25aef62a8753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:15.953503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2bbe6-dbcd-424d-90a8-25aef62a8753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:15.955191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2bbe6-dbcd-424d-90a8-25aef62a8753 admin admin] PATH_INFO: `/v3/projects/b4eecefe9f544b7d9888807549fb7717/users/233dbf8ce49242238f2a007c2c8e7650/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:16.001817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2bbe6-dbcd-424d-90a8-25aef62a8753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4eecefe9f544b7d9888807549fb7717, user_id=233dbf8ce49242238f2a007c2c8e7650, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:16.007321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2bbe6-dbcd-424d-90a8-25aef62a8753 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:16.010263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc5f06-b397-49ff-889a-fd0811fe0d34 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:16.018447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfc36a-2396-4677-8c4b-75e642c36cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:16.019599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc36a-2396-4677-8c4b-75e642c36cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:16.020326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc36a-2396-4677-8c4b-75e642c36cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:16.020795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc36a-2396-4677-8c4b-75e642c36cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:16.042883 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2651/5325] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:15 2022] PUT /identity/v3/projects/b4eecefe9f544b7d9888807549fb7717/users/233dbf8ce49242238f2a007c2c8e7650/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:16.047524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2bbe6-dbcd-424d-90a8-25aef62a8753 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:16.053522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfc36a-2396-4677-8c4b-75e642c36cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:16.056958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfc36a-2396-4677-8c4b-75e642c36cc4 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:16.084893 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2675/5326] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:16.166725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2bbe6-dbcd-424d-90a8-25aef62a8753 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:16.175445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a4f20-7a95-4010-a52e-47c606032fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:16.175866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a4f20-7a95-4010-a52e-47c606032fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:16.176148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a4f20-7a95-4010-a52e-47c606032fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:16.176772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a4f20-7a95-4010-a52e-47c606032fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:16.177613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a4f20-7a95-4010-a52e-47c606032fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:16.179512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a4f20-7a95-4010-a52e-47c606032fe6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:16.195793 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2652/5327] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:16.199735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfc36a-2396-4677-8c4b-75e642c36cc4 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:16.217587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfc36a-2396-4677-8c4b-75e642c36cc4 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:16.223619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68364802-aa42-479b-94c5-8639bad6fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:16.224309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68364802-aa42-479b-94c5-8639bad6fe70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:16.224588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68364802-aa42-479b-94c5-8639bad6fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:16.225062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68364802-aa42-479b-94c5-8639bad6fe70 admin admin] PATH_INFO: `/v3/projects/b4eecefe9f544b7d9888807549fb7717/users/233dbf8ce49242238f2a007c2c8e7650/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:16.227244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68364802-aa42-479b-94c5-8639bad6fe70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4eecefe9f544b7d9888807549fb7717, user_id=233dbf8ce49242238f2a007c2c8e7650, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:16.230467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68364802-aa42-479b-94c5-8639bad6fe70 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:16.247106 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2676/5328] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:16 2022] PUT /identity/v3/projects/b4eecefe9f544b7d9888807549fb7717/users/233dbf8ce49242238f2a007c2c8e7650/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:16.262150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27273a8c-9b13-4d1e-881c-2bbafb178bc7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:16.262447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27273a8c-9b13-4d1e-881c-2bbafb178bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:16.262761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27273a8c-9b13-4d1e-881c-2bbafb178bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:16.301271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-27273a8c-9b13-4d1e-881c-2bbafb178bc7 None None] MFA Rules not processed for user `233dbf8ce49242238f2a007c2c8e7650`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:16.302637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-27273a8c-9b13-4d1e-881c-2bbafb178bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:16.404990 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:16.462044 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2653/5329] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:25:16.472449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68364802-aa42-479b-94c5-8639bad6fe70 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:16.474971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-68364802-aa42-479b-94c5-8639bad6fe70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:16.593720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68364802-aa42-479b-94c5-8639bad6fe70 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:16.598677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba95f9-9dec-453e-a1db-b8a7e6901577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:16.599401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba95f9-9dec-453e-a1db-b8a7e6901577 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:16.599755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba95f9-9dec-453e-a1db-b8a7e6901577 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:16.600123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba95f9-9dec-453e-a1db-b8a7e6901577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:16.610732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba95f9-9dec-453e-a1db-b8a7e6901577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:16.613441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba95f9-9dec-453e-a1db-b8a7e6901577 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:16.638854 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2677/5330] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:16.952330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27273a8c-9b13-4d1e-881c-2bbafb178bc7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:16.954338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-27273a8c-9b13-4d1e-881c-2bbafb178bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:17.200461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27273a8c-9b13-4d1e-881c-2bbafb178bc7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:17.220269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:17.220939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:17.221225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:17.221498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] PATH_INFO: `/v3/projects/6d0540166c8146a9b853f288bc048b63` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:17.227218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0540166c8146a9b853f288bc048b63)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:17.230885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:17.342839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0540166c8146a9b853f288bc048b63', 'request_id': 'req-a10e03df-931c-4a75-a215-6b4fbb045a3c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:17.380345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0540166c8146a9b853f288bc048b63', 'request_id': 'req-a10e03df-931c-4a75-a215-6b4fbb045a3c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:17.388124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0540166c8146a9b853f288bc048b63', 'request_id': 'req-a10e03df-931c-4a75-a215-6b4fbb045a3c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:17.409309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] The token cache is being invalidate because project 6d0540166c8146a9b853f288bc048b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:17.411160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:17.412891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a10e03df-931c-4a75-a215-6b4fbb045a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:17.416426 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2654/5331] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:16 2022] DELETE /identity/v3/projects/6d0540166c8146a9b853f288bc048b63 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:17.423131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e8ce-ab46-4e71-a63f-3664fea377aa None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:17.423672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e8ce-ab46-4e71-a63f-3664fea377aa None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:17.423672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e8ce-ab46-4e71-a63f-3664fea377aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:17.468118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7d91e8ce-ab46-4e71-a63f-3664fea377aa None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:17.471768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7d91e8ce-ab46-4e71-a63f-3664fea377aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:17.575331 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:17.595887 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2678/5332] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:17.605525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6be6fc-1b97-4d7e-90f8-b9b79432924a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:17.605728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6be6fc-1b97-4d7e-90f8-b9b79432924a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:17.606008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6be6fc-1b97-4d7e-90f8-b9b79432924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:17.672199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2e6be6fc-1b97-4d7e-90f8-b9b79432924a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:17.677193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2e6be6fc-1b97-4d7e-90f8-b9b79432924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:17.686488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91e8ce-ab46-4e71-a63f-3664fea377aa None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:17.688195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7d91e8ce-ab46-4e71-a63f-3664fea377aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:17.690042 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2655/5333] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:17.692542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6be6fc-1b97-4d7e-90f8-b9b79432924a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:17.717458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6be6fc-1b97-4d7e-90f8-b9b79432924a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:17.723232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9fdf1-4e65-4eb6-bd7f-a226ed3dc186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:17.723848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9fdf1-4e65-4eb6-bd7f-a226ed3dc186 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:17.724134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9fdf1-4e65-4eb6-bd7f-a226ed3dc186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:17.724410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9fdf1-4e65-4eb6-bd7f-a226ed3dc186 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:17.725075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9fdf1-4e65-4eb6-bd7f-a226ed3dc186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:25:17.725599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9fdf1-4e65-4eb6-bd7f-a226ed3dc186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:17.727034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9fdf1-4e65-4eb6-bd7f-a226ed3dc186 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:17.758411 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2656/5334] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:25:17.762883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9fdf1-4e65-4eb6-bd7f-a226ed3dc186 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:17.780330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91e8ce-ab46-4e71-a63f-3664fea377aa None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:17.784251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9fdf1-4e65-4eb6-bd7f-a226ed3dc186 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:17.785925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f478a-8360-4791-9a77-cbc9676da74e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:17.786933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f478a-8360-4791-9a77-cbc9676da74e service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:17.787448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f478a-8360-4791-9a77-cbc9676da74e service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:17.788132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f478a-8360-4791-9a77-cbc9676da74e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:17.790439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-127f478a-8360-4791-9a77-cbc9676da74e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:17.797621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c66d99-f85f-4abe-a063-ed7d970b95f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:17.798248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c66d99-f85f-4abe-a063-ed7d970b95f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:17.798552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c66d99-f85f-4abe-a063-ed7d970b95f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:17.798841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c66d99-f85f-4abe-a063-ed7d970b95f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:17.799491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c66d99-f85f-4abe-a063-ed7d970b95f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:17.801715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c66d99-f85f-4abe-a063-ed7d970b95f1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:17.867666 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2657/5335] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:17 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:17.873303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c66d99-f85f-4abe-a063-ed7d970b95f1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:17.962686 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:17.973049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f478a-8360-4791-9a77-cbc9676da74e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:17.977479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f478a-8360-4791-9a77-cbc9676da74e service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:18.026866 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2679/5336] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:25:18.067260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c66d99-f85f-4abe-a063-ed7d970b95f1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:18.084785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13105d-8c35-4409-88fc-764f97507d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:18.085430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13105d-8c35-4409-88fc-764f97507d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:18.085712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13105d-8c35-4409-88fc-764f97507d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:18.085988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13105d-8c35-4409-88fc-764f97507d80 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:18.086807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13105d-8c35-4409-88fc-764f97507d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:18.089187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13105d-8c35-4409-88fc-764f97507d80 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:18.133202 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2658/5337] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:17 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:18.134455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f478a-8360-4791-9a77-cbc9676da74e service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:18.151516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f478a-8360-4791-9a77-cbc9676da74e service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:18.158634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a71f90-92eb-4435-bafd-51e3a45d137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:18.159277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a71f90-92eb-4435-bafd-51e3a45d137b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:18.159835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a71f90-92eb-4435-bafd-51e3a45d137b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:18.160130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a71f90-92eb-4435-bafd-51e3a45d137b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:18.161285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a71f90-92eb-4435-bafd-51e3a45d137b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:18.164391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a71f90-92eb-4435-bafd-51e3a45d137b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:18.189989 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2680/5338] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:25:18.191368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13105d-8c35-4409-88fc-764f97507d80 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:18.213382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13105d-8c35-4409-88fc-764f97507d80 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:18.227388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c26917-ccc0-4199-bb2a-42d05faafed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:18.228293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26917-ccc0-4199-bb2a-42d05faafed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:18.228742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26917-ccc0-4199-bb2a-42d05faafed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:18.229183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26917-ccc0-4199-bb2a-42d05faafed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:18.230033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c26917-ccc0-4199-bb2a-42d05faafed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:18.231862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c26917-ccc0-4199-bb2a-42d05faafed9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:18.267467 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2659/5339] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:18.267714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a71f90-92eb-4435-bafd-51e3a45d137b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:18.287040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a71f90-92eb-4435-bafd-51e3a45d137b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:18.300208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77657b-d910-48af-a5b1-f51300753e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:18.311077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77657b-d910-48af-a5b1-f51300753e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:18.311367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77657b-d910-48af-a5b1-f51300753e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:18.311644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77657b-d910-48af-a5b1-f51300753e04 admin admin] PATH_INFO: `/v3/projects/677f09ff90d04d7e803218f07fa98330/users/3c2247a1da314b88ab4ffc440b14680d/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:18.355535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77657b-d910-48af-a5b1-f51300753e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=677f09ff90d04d7e803218f07fa98330, user_id=3c2247a1da314b88ab4ffc440b14680d, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:18.360050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77657b-d910-48af-a5b1-f51300753e04 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:18.400416 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2681/5340] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:18 2022] PUT /identity/v3/projects/677f09ff90d04d7e803218f07fa98330/users/3c2247a1da314b88ab4ffc440b14680d/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:18.405155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67060a39-94de-41a3-8767-56e03e370298 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:18.405441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67060a39-94de-41a3-8767-56e03e370298 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:18.405719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67060a39-94de-41a3-8767-56e03e370298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:18.454825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-67060a39-94de-41a3-8767-56e03e370298 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:18.458787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-67060a39-94de-41a3-8767-56e03e370298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:18.664165 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2660/5341] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:18.699239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77657b-d910-48af-a5b1-f51300753e04 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:18.701239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fe77657b-d910-48af-a5b1-f51300753e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:18.814491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77657b-d910-48af-a5b1-f51300753e04 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:18.826194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ae7c-bb76-429e-972a-339c627288e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:18.826849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ae7c-bb76-429e-972a-339c627288e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:18.828188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ae7c-bb76-429e-972a-339c627288e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:18.828188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ae7c-bb76-429e-972a-339c627288e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:18.853077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ae7c-bb76-429e-972a-339c627288e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:18.854537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ae7c-bb76-429e-972a-339c627288e6 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:18.872791 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2682/5342] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:22.909203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a2512-7bf8-47bc-a10a-3a8186f32843 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:22.910583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a2512-7bf8-47bc-a10a-3a8186f32843 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:22.910583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a2512-7bf8-47bc-a10a-3a8186f32843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:22.951800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b43a2512-7bf8-47bc-a10a-3a8186f32843 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:22.953269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b43a2512-7bf8-47bc-a10a-3a8186f32843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:23.141711 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2661/5343] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:23.898134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ae7c-bb76-429e-972a-339c627288e6 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:23.904685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-52d5ae7c-bb76-429e-972a-339c627288e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:23.946238 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:24.056606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ae7c-bb76-429e-972a-339c627288e6 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:24.079095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbaaddf-1489-4502-b37c-4278df96f546 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:24.080375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaaddf-1489-4502-b37c-4278df96f546 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:24.080908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaaddf-1489-4502-b37c-4278df96f546 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:24.083267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaaddf-1489-4502-b37c-4278df96f546 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:24.096555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9bbaaddf-1489-4502-b37c-4278df96f546 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:24.119903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbaaddf-1489-4502-b37c-4278df96f546 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:24.121651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbaaddf-1489-4502-b37c-4278df96f546 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:24.145276 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2683/5344] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:26.615077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a2512-7bf8-47bc-a10a-3a8186f32843 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:26.648826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a2512-7bf8-47bc-a10a-3a8186f32843 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:26.655253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1db99-c126-4dd9-8132-fff280b27f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:26.656130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1db99-c126-4dd9-8132-fff280b27f37 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:26.658577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1db99-c126-4dd9-8132-fff280b27f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:26.662164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1db99-c126-4dd9-8132-fff280b27f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:26.666891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ae1db99-c126-4dd9-8132-fff280b27f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:26.835049 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:26.888019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1db99-c126-4dd9-8132-fff280b27f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:26.891461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1db99-c126-4dd9-8132-fff280b27f37 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:26.926289 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2662/5345] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:27.531442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbaaddf-1489-4502-b37c-4278df96f546 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:27.534101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9bbaaddf-1489-4502-b37c-4278df96f546 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:27.710040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbaaddf-1489-4502-b37c-4278df96f546 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:27.719929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58c08a-5881-4826-90b0-75a78be554e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:27.720201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58c08a-5881-4826-90b0-75a78be554e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:27.720614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58c08a-5881-4826-90b0-75a78be554e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:27.720872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58c08a-5881-4826-90b0-75a78be554e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:27.742708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2e58c08a-5881-4826-90b0-75a78be554e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:27.986626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58c08a-5881-4826-90b0-75a78be554e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:27.989302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58c08a-5881-4826-90b0-75a78be554e8 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:28.013087 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2684/5346] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:29.522504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1db99-c126-4dd9-8132-fff280b27f37 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:29.540968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1db99-c126-4dd9-8132-fff280b27f37 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:29.546373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfd25f-7d99-47b8-b184-f940fa41de18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:29.547213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfd25f-7d99-47b8-b184-f940fa41de18 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:29.547814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfd25f-7d99-47b8-b184-f940fa41de18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:29.548492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfd25f-7d99-47b8-b184-f940fa41de18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:29.559155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4adfd25f-7d99-47b8-b184-f940fa41de18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:29.602356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfd25f-7d99-47b8-b184-f940fa41de18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:29.604272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfd25f-7d99-47b8-b184-f940fa41de18 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:29.631702 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2663/5347] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:33.680732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20081497-d370-4d17-9f0c-77379e50d48d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:33.681859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20081497-d370-4d17-9f0c-77379e50d48d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:33.682676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20081497-d370-4d17-9f0c-77379e50d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:33.767406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-20081497-d370-4d17-9f0c-77379e50d48d None None] MFA Rules not processed for user `3c2247a1da314b88ab4ffc440b14680d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:33.769480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-20081497-d370-4d17-9f0c-77379e50d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:33.879760 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:33.925462 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2685/5348] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:35.052040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfd25f-7d99-47b8-b184-f940fa41de18 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:35.054351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4adfd25f-7d99-47b8-b184-f940fa41de18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:35.082655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfd25f-7d99-47b8-b184-f940fa41de18 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:35.087885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:35.088745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:35.089233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:35.089667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] PATH_INFO: `/v3/users/3015cff8c4c445e39545e5a4cec93a1c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:35.091132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3015cff8c4c445e39545e5a4cec93a1c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:35.094622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:35.168743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3015cff8c4c445e39545e5a4cec93a1c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:35.192247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3015cff8c4c445e39545e5a4cec93a1c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:35.193397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3015cff8c4c445e39545e5a4cec93a1c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:35.206876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3015cff8c4c445e39545e5a4cec93a1c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:35.217991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3015cff8c4c445e39545e5a4cec93a1c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:35.234309 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2664/5349] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:35 2022] DELETE /identity/v3/users/3015cff8c4c445e39545e5a4cec93a1c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:35.236103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a153f34-c732-4472-8c44-0d8c4360756e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:35.237853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a153f34-c732-4472-8c44-0d8c4360756e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:35.237853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a153f34-c732-4472-8c44-0d8c4360756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:35.289191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6a153f34-c732-4472-8c44-0d8c4360756e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:35.290829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6a153f34-c732-4472-8c44-0d8c4360756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:35.392117 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2686/5350] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:35.419371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:35.422014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:35.528276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7d433-f60e-41fa-a611-3a03823f8249 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:35.535981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944f0c9-8bb4-45b0-a830-d86383b9c961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:35.537175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944f0c9-8bb4-45b0-a830-d86383b9c961 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:35.537628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944f0c9-8bb4-45b0-a830-d86383b9c961 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:35.538260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944f0c9-8bb4-45b0-a830-d86383b9c961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:35.551000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944f0c9-8bb4-45b0-a830-d86383b9c961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:35.553595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944f0c9-8bb4-45b0-a830-d86383b9c961 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:35.569588 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2665/5351] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:36.676791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a153f34-c732-4472-8c44-0d8c4360756e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:36.678278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6a153f34-c732-4472-8c44-0d8c4360756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:36.692158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a153f34-c732-4472-8c44-0d8c4360756e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:36.703520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:36.704412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:36.708174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:36.708920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] PATH_INFO: `/v3/projects/e2eac95593b2430a915a917f4e19fc23` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:36.713437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2eac95593b2430a915a917f4e19fc23)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:36.718589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:36.830505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2eac95593b2430a915a917f4e19fc23', 'request_id': 'req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:36.841921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2eac95593b2430a915a917f4e19fc23', 'request_id': 'req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:36.854261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2eac95593b2430a915a917f4e19fc23', 'request_id': 'req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:36.877613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] The token cache is being invalidate because project e2eac95593b2430a915a917f4e19fc23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:36.878213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:36.880672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:36.888562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944f0c9-8bb4-45b0-a830-d86383b9c961 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:36.906898 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2687/5352] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:36 2022] DELETE /identity/v3/projects/e2eac95593b2430a915a917f4e19fc23 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:36.910915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944f0c9-8bb4-45b0-a830-d86383b9c961 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:36.993194 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:37.022089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:37.023135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:37.023702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:37.024069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] PATH_INFO: `/v3/users/7e33815c28154536ae906392a3de933f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:37.025666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e33815c28154536ae906392a3de933f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:37.029887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:37.103781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e33815c28154536ae906392a3de933f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:37.121608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e33815c28154536ae906392a3de933f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:37.122588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e33815c28154536ae906392a3de933f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:37.137461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e33815c28154536ae906392a3de933f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:37.150777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e33815c28154536ae906392a3de933f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:37.162302 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2666/5353] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:36 2022] DELETE /identity/v3/users/7e33815c28154536ae906392a3de933f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:38.825676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:38.828356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:38.898174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399fff3-a4b6-4c69-8acb-f72fb0b3b37f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:39.042641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:39.043678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:39.044124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:39.044648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] PATH_INFO: `/v3/projects/87c9cae7535e4037931d50215f1bbf2f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:39.046243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c9cae7535e4037931d50215f1bbf2f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:39.050039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:39.094294 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:39.216886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c9cae7535e4037931d50215f1bbf2f', 'request_id': 'req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:39.246101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c9cae7535e4037931d50215f1bbf2f', 'request_id': 'req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:39.274831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c9cae7535e4037931d50215f1bbf2f', 'request_id': 'req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:39.309714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] The token cache is being invalidate because project 87c9cae7535e4037931d50215f1bbf2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:39.310128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:39.312949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:39.319223 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2688/5354] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:38 2022] DELETE /identity/v3/projects/87c9cae7535e4037931d50215f1bbf2f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:39.323378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:39.324923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:39.355262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d7005-143f-4b66-a96f-ab948d3fb038 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:39.502290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b39533-d86f-4ab8-8462-64c47863ed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:39.503876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39533-d86f-4ab8-8462-64c47863ed6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:39.504242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39533-d86f-4ab8-8462-64c47863ed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:39.504643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39533-d86f-4ab8-8462-64c47863ed6d admin admin] PATH_INFO: `/v3/users/233dbf8ce49242238f2a007c2c8e7650` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:39.506920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b39533-d86f-4ab8-8462-64c47863ed6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=233dbf8ce49242238f2a007c2c8e7650)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:39.509179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b39533-d86f-4ab8-8462-64c47863ed6d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:39.610287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-35b39533-d86f-4ab8-8462-64c47863ed6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233dbf8ce49242238f2a007c2c8e7650'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:39.664378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-35b39533-d86f-4ab8-8462-64c47863ed6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233dbf8ce49242238f2a007c2c8e7650'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:39.670904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-35b39533-d86f-4ab8-8462-64c47863ed6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233dbf8ce49242238f2a007c2c8e7650'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:39.673445 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:39.697736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-35b39533-d86f-4ab8-8462-64c47863ed6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233dbf8ce49242238f2a007c2c8e7650'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:39.727243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-35b39533-d86f-4ab8-8462-64c47863ed6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233dbf8ce49242238f2a007c2c8e7650'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:39.745250 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2667/5355] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:39 2022] DELETE /identity/v3/users/233dbf8ce49242238f2a007c2c8e7650 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:41.651055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:41.653101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:41.674413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b8020-bb7b-4029-a42a-ee2c8bc48d9b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:41.814920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:41.816328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:41.816818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:41.817370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] PATH_INFO: `/v3/projects/b4eecefe9f544b7d9888807549fb7717` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:41.843555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4eecefe9f544b7d9888807549fb7717)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:41.852510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:41.948978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4eecefe9f544b7d9888807549fb7717', 'request_id': 'req-ecc95665-82c6-4a7f-85cb-c955cc2ab705'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:41.962558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4eecefe9f544b7d9888807549fb7717', 'request_id': 'req-ecc95665-82c6-4a7f-85cb-c955cc2ab705'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:41.974078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4eecefe9f544b7d9888807549fb7717', 'request_id': 'req-ecc95665-82c6-4a7f-85cb-c955cc2ab705'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:42.040530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] The token cache is being invalidate because project b4eecefe9f544b7d9888807549fb7717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:42.040993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:42.041831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ecc95665-82c6-4a7f-85cb-c955cc2ab705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:42.047893 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2689/5356] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:41 2022] DELETE /identity/v3/projects/b4eecefe9f544b7d9888807549fb7717 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:42.058869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd010c5c-c74d-4534-b052-a54175bf69d1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:42.058869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd010c5c-c74d-4534-b052-a54175bf69d1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:42.058869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd010c5c-c74d-4534-b052-a54175bf69d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:42.078108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bd010c5c-c74d-4534-b052-a54175bf69d1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:42.079499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bd010c5c-c74d-4534-b052-a54175bf69d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:42.246521 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2668/5357] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:42.256641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb8fdc-5bd8-4236-8ebb-1a9aeb74f867 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:42.256987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb8fdc-5bd8-4236-8ebb-1a9aeb74f867 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:42.257285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb8fdc-5bd8-4236-8ebb-1a9aeb74f867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:42.293657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-37cb8fdc-5bd8-4236-8ebb-1a9aeb74f867 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:42.295258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-37cb8fdc-5bd8-4236-8ebb-1a9aeb74f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:42.307908 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2690/5358] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:42.311801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd010c5c-c74d-4534-b052-a54175bf69d1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:42.328968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd010c5c-c74d-4534-b052-a54175bf69d1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:42.343350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d56b-b5b0-4c5e-b8c3-32cd7f55054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:42.345254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d56b-b5b0-4c5e-b8c3-32cd7f55054e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:42.345563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d56b-b5b0-4c5e-b8c3-32cd7f55054e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:42.346871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d56b-b5b0-4c5e-b8c3-32cd7f55054e admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:42.350515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d56b-b5b0-4c5e-b8c3-32cd7f55054e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:25:42.350893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d56b-b5b0-4c5e-b8c3-32cd7f55054e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:42.354728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d56b-b5b0-4c5e-b8c3-32cd7f55054e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:42.382843 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2669/5359] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:25:42.386747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb8fdc-5bd8-4236-8ebb-1a9aeb74f867 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:42.412306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb8fdc-5bd8-4236-8ebb-1a9aeb74f867 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:42.418491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5a08f-6aec-408b-8558-1c1064f55fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:42.419950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5a08f-6aec-408b-8558-1c1064f55fca admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:42.420475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5a08f-6aec-408b-8558-1c1064f55fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:42.420940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5a08f-6aec-408b-8558-1c1064f55fca admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:42.421854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5a08f-6aec-408b-8558-1c1064f55fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:42.425372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5a08f-6aec-408b-8558-1c1064f55fca admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:42.467392 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2691/5360] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:42 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:42.471906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d56b-b5b0-4c5e-b8c3-32cd7f55054e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:42.493234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d56b-b5b0-4c5e-b8c3-32cd7f55054e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:42.592199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562838d2-3e0f-4286-bfdd-9201913f2622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:42.593335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562838d2-3e0f-4286-bfdd-9201913f2622 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:42.596962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562838d2-3e0f-4286-bfdd-9201913f2622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:42.597488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562838d2-3e0f-4286-bfdd-9201913f2622 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:42.598380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562838d2-3e0f-4286-bfdd-9201913f2622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:42.601375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562838d2-3e0f-4286-bfdd-9201913f2622 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:42.658063 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2670/5361] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:42 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:42.659417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5a08f-6aec-408b-8558-1c1064f55fca admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:42.673208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5a08f-6aec-408b-8558-1c1064f55fca admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:42.681284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c449093-ec6e-43b4-8805-bd232c40d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:42.682837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449093-ec6e-43b4-8805-bd232c40d4ad admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:42.683210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449093-ec6e-43b4-8805-bd232c40d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:42.683558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449093-ec6e-43b4-8805-bd232c40d4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:42.684334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c449093-ec6e-43b4-8805-bd232c40d4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:42.686358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c449093-ec6e-43b4-8805-bd232c40d4ad admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:42.688401 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:42.723011 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2692/5362] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:42.726804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562838d2-3e0f-4286-bfdd-9201913f2622 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:42.741945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562838d2-3e0f-4286-bfdd-9201913f2622 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:42.748408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befc395-b2f7-4986-b4d2-1bad400c316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:42.749464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befc395-b2f7-4986-b4d2-1bad400c316e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:42.750074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befc395-b2f7-4986-b4d2-1bad400c316e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:42.750519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befc395-b2f7-4986-b4d2-1bad400c316e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:42.752298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befc395-b2f7-4986-b4d2-1bad400c316e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:42.760849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befc395-b2f7-4986-b4d2-1bad400c316e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:42.787672 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2671/5363] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:42.792004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c449093-ec6e-43b4-8805-bd232c40d4ad admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:42.809596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c449093-ec6e-43b4-8805-bd232c40d4ad admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:42.815903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067722f-c4e3-4c4d-9eee-36c0b42ef982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:42.817014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067722f-c4e3-4c4d-9eee-36c0b42ef982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:42.817880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067722f-c4e3-4c4d-9eee-36c0b42ef982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:42.818383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067722f-c4e3-4c4d-9eee-36c0b42ef982 admin admin] PATH_INFO: `/v3/projects/dd92af08168f411c81d45f2f3a77b126/users/8ab1db3078094bd480b00389288005be/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:42.859257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067722f-c4e3-4c4d-9eee-36c0b42ef982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd92af08168f411c81d45f2f3a77b126, user_id=8ab1db3078094bd480b00389288005be, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:42.864491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067722f-c4e3-4c4d-9eee-36c0b42ef982 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:42.898714 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2693/5364] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:42 2022] PUT /identity/v3/projects/dd92af08168f411c81d45f2f3a77b126/users/8ab1db3078094bd480b00389288005be/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:42.911468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396aacc-f89b-42ab-84a8-c64008044aa3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:42.911468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396aacc-f89b-42ab-84a8-c64008044aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:42.911468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396aacc-f89b-42ab-84a8-c64008044aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:42.969583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9396aacc-f89b-42ab-84a8-c64008044aa3 None None] MFA Rules not processed for user `8ab1db3078094bd480b00389288005be`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:42.971107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9396aacc-f89b-42ab-84a8-c64008044aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:43.055372 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:43.121209 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2672/5365] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:43.123103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067722f-c4e3-4c4d-9eee-36c0b42ef982 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:43.233090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067722f-c4e3-4c4d-9eee-36c0b42ef982 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:43.244518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b6749-72e1-4dd1-9b42-11e000427963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:43.245962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b6749-72e1-4dd1-9b42-11e000427963 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:43.246578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b6749-72e1-4dd1-9b42-11e000427963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:43.248499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b6749-72e1-4dd1-9b42-11e000427963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:43.250131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b6749-72e1-4dd1-9b42-11e000427963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:43.254191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b6749-72e1-4dd1-9b42-11e000427963 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:43.304334 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2694/5366] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:43 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:43.305569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396aacc-f89b-42ab-84a8-c64008044aa3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:43.324223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396aacc-f89b-42ab-84a8-c64008044aa3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:43.439536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0eb4-d84a-4f8d-b664-fd420a99b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:43.440303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0eb4-d84a-4f8d-b664-fd420a99b374 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:43.441407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0eb4-d84a-4f8d-b664-fd420a99b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:43.441965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0eb4-d84a-4f8d-b664-fd420a99b374 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:43.442710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b0eb4-d84a-4f8d-b664-fd420a99b374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:43.444758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b0eb4-d84a-4f8d-b664-fd420a99b374 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:43.486311 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2673/5367] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:43 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:43.488252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b6749-72e1-4dd1-9b42-11e000427963 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:43.505021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b6749-72e1-4dd1-9b42-11e000427963 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:43.516481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12198ae-50b8-4195-aff8-8918b989f503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:43.517265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12198ae-50b8-4195-aff8-8918b989f503 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:43.517564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12198ae-50b8-4195-aff8-8918b989f503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:43.518352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12198ae-50b8-4195-aff8-8918b989f503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:43.519129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12198ae-50b8-4195-aff8-8918b989f503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:43.521653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12198ae-50b8-4195-aff8-8918b989f503 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:43.541694 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2695/5368] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:43.543286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0eb4-d84a-4f8d-b664-fd420a99b374 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:43.555522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0eb4-d84a-4f8d-b664-fd420a99b374 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:43.561716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370969a-bde3-4aa2-960d-4f4ef091895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:43.562729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370969a-bde3-4aa2-960d-4f4ef091895a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:43.563701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370969a-bde3-4aa2-960d-4f4ef091895a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:43.564282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370969a-bde3-4aa2-960d-4f4ef091895a admin admin] PATH_INFO: `/v3/projects/94b9ab5cfa4d49e5bd531f6c6e3c6e3b/users/091fe577009649c8bd842a93b3313669/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:43.586031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370969a-bde3-4aa2-960d-4f4ef091895a admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b9ab5cfa4d49e5bd531f6c6e3c6e3b, user_id=091fe577009649c8bd842a93b3313669, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:43.589352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370969a-bde3-4aa2-960d-4f4ef091895a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:43.609526 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2674/5369] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:43 2022] PUT /identity/v3/projects/94b9ab5cfa4d49e5bd531f6c6e3c6e3b/users/091fe577009649c8bd842a93b3313669/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:25:43.615695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12198ae-50b8-4195-aff8-8918b989f503 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:43.630508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12198ae-50b8-4195-aff8-8918b989f503 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:43.749754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52842e26-7402-409d-b9fa-804aca915fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:43.751209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842e26-7402-409d-b9fa-804aca915fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:43.751708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842e26-7402-409d-b9fa-804aca915fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:43.752192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842e26-7402-409d-b9fa-804aca915fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:43.753957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52842e26-7402-409d-b9fa-804aca915fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:43.756167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52842e26-7402-409d-b9fa-804aca915fe6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:43.776931 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2696/5370] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:25:43.777591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370969a-bde3-4aa2-960d-4f4ef091895a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:43.789191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370969a-bde3-4aa2-960d-4f4ef091895a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:43.803638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b3c0f-8e8f-4ea4-b34c-6f55d3e7e935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:43.812960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b3c0f-8e8f-4ea4-b34c-6f55d3e7e935 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:43.813367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b3c0f-8e8f-4ea4-b34c-6f55d3e7e935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:43.813794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b3c0f-8e8f-4ea4-b34c-6f55d3e7e935 admin admin] PATH_INFO: `/v3/projects/94b9ab5cfa4d49e5bd531f6c6e3c6e3b/users/091fe577009649c8bd842a93b3313669/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:43.817393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b3c0f-8e8f-4ea4-b34c-6f55d3e7e935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b9ab5cfa4d49e5bd531f6c6e3c6e3b, user_id=091fe577009649c8bd842a93b3313669, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:43.821486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b3c0f-8e8f-4ea4-b34c-6f55d3e7e935 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:43.871602 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2675/5371] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:43 2022] PUT /identity/v3/projects/94b9ab5cfa4d49e5bd531f6c6e3c6e3b/users/091fe577009649c8bd842a93b3313669/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:43.874755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839ff7-0107-46bb-ad21-6ad2149a2d00 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:43.875121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839ff7-0107-46bb-ad21-6ad2149a2d00 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:43.875392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839ff7-0107-46bb-ad21-6ad2149a2d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:43.952106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-27839ff7-0107-46bb-ad21-6ad2149a2d00 None None] MFA Rules not processed for user `091fe577009649c8bd842a93b3313669`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:43.958379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-27839ff7-0107-46bb-ad21-6ad2149a2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:44.093723 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:44.179033 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2697/5372] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:44.192598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b3c0f-8e8f-4ea4-b34c-6f55d3e7e935 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:44.194944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f79b3c0f-8e8f-4ea4-b34c-6f55d3e7e935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:44.302022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b3c0f-8e8f-4ea4-b34c-6f55d3e7e935 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:44.311872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f80b83-8d12-48a8-bec9-0879ad35e96d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:44.312525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f80b83-8d12-48a8-bec9-0879ad35e96d service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:44.313346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f80b83-8d12-48a8-bec9-0879ad35e96d service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:44.313643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f80b83-8d12-48a8-bec9-0879ad35e96d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:44.325721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f80b83-8d12-48a8-bec9-0879ad35e96d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:44.327363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f80b83-8d12-48a8-bec9-0879ad35e96d service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:44.355106 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2676/5373] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:44.501954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27839ff7-0107-46bb-ad21-6ad2149a2d00 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:44.518768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27839ff7-0107-46bb-ad21-6ad2149a2d00 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:44.524188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68032825-7a6a-4225-92ee-9ac9bd05b33d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:44.524986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68032825-7a6a-4225-92ee-9ac9bd05b33d service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:44.525575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68032825-7a6a-4225-92ee-9ac9bd05b33d service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:44.525995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68032825-7a6a-4225-92ee-9ac9bd05b33d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:44.639274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68032825-7a6a-4225-92ee-9ac9bd05b33d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:44.641064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68032825-7a6a-4225-92ee-9ac9bd05b33d service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:44.680935 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2698/5374] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:44.949862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f80b83-8d12-48a8-bec9-0879ad35e96d service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:44.951380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f8f80b83-8d12-48a8-bec9-0879ad35e96d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:45.014714 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:45.126527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f80b83-8d12-48a8-bec9-0879ad35e96d service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:45.142019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4de64-6370-4fc2-988c-4fddc89b1289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:45.145121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4de64-6370-4fc2-988c-4fddc89b1289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:45.145630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4de64-6370-4fc2-988c-4fddc89b1289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:45.146086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4de64-6370-4fc2-988c-4fddc89b1289 admin admin] PATH_INFO: `/v3/users/3c2247a1da314b88ab4ffc440b14680d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:45.150711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4de64-6370-4fc2-988c-4fddc89b1289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2247a1da314b88ab4ffc440b14680d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:45.163021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4de64-6370-4fc2-988c-4fddc89b1289 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:45.187328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68032825-7a6a-4225-92ee-9ac9bd05b33d service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:45.202847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68032825-7a6a-4225-92ee-9ac9bd05b33d service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:45.239669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:45.242735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:45.243328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:45.243852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] PATH_INFO: `/v3/users/8ab1db3078094bd480b00389288005be` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:45.245498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab1db3078094bd480b00389288005be)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:45.248853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:45.285972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eca4de64-6370-4fc2-988c-4fddc89b1289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2247a1da314b88ab4ffc440b14680d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:45.305163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eca4de64-6370-4fc2-988c-4fddc89b1289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2247a1da314b88ab4ffc440b14680d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:45.306019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eca4de64-6370-4fc2-988c-4fddc89b1289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2247a1da314b88ab4ffc440b14680d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:45.321446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eca4de64-6370-4fc2-988c-4fddc89b1289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2247a1da314b88ab4ffc440b14680d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:45.339574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eca4de64-6370-4fc2-988c-4fddc89b1289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2247a1da314b88ab4ffc440b14680d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:45.352285 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2677/5375] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:44 2022] DELETE /identity/v3/users/3c2247a1da314b88ab4ffc440b14680d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:45.354480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab1db3078094bd480b00389288005be'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:45.374486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab1db3078094bd480b00389288005be'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:45.376916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab1db3078094bd480b00389288005be'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:45.390636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab1db3078094bd480b00389288005be'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:45.391703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab1db3078094bd480b00389288005be'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:45.410634 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2699/5376] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:45 2022] DELETE /identity/v3/users/8ab1db3078094bd480b00389288005be => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:45.414771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4623-18eb-4b79-80d6-4261f10f81a5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:45.415066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4623-18eb-4b79-80d6-4261f10f81a5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:45.415353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4623-18eb-4b79-80d6-4261f10f81a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:45.440366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-115c4623-18eb-4b79-80d6-4261f10f81a5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:45.441612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-115c4623-18eb-4b79-80d6-4261f10f81a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:45.521394 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2678/5377] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:45.535334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:45.537292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:45.598862 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:45.625040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5faa6-02ac-436c-a200-54005e81cac8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:45.630758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b7289-6f67-40d7-b049-3207c17667df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:45.631554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7289-6f67-40d7-b049-3207c17667df service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:45.632148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7289-6f67-40d7-b049-3207c17667df service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:45.632656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7289-6f67-40d7-b049-3207c17667df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:45.652029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b7289-6f67-40d7-b049-3207c17667df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:45.653990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b7289-6f67-40d7-b049-3207c17667df service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:45.680313 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2700/5378] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:45.821836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c4623-18eb-4b79-80d6-4261f10f81a5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:45.824916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-115c4623-18eb-4b79-80d6-4261f10f81a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:45.858636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c4623-18eb-4b79-80d6-4261f10f81a5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:45.865872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:45.866637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:45.866944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:45.867656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] PATH_INFO: `/v3/projects/677f09ff90d04d7e803218f07fa98330` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:45.869065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=677f09ff90d04d7e803218f07fa98330)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:45.872538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:45.996440 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:45.998101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677f09ff90d04d7e803218f07fa98330', 'request_id': 'req-5bb24c56-27b4-4ef9-8019-351d0a170e4e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:46.013542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677f09ff90d04d7e803218f07fa98330', 'request_id': 'req-5bb24c56-27b4-4ef9-8019-351d0a170e4e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:46.023373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677f09ff90d04d7e803218f07fa98330', 'request_id': 'req-5bb24c56-27b4-4ef9-8019-351d0a170e4e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:46.058777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] The token cache is being invalidate because project 677f09ff90d04d7e803218f07fa98330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:46.061029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:46.061813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5bb24c56-27b4-4ef9-8019-351d0a170e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:46.066901 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2679/5379] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:45 2022] DELETE /identity/v3/projects/677f09ff90d04d7e803218f07fa98330 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:46.072008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd1253-55a8-4cee-bdd9-dbada68a9f92 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:46.072849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd1253-55a8-4cee-bdd9-dbada68a9f92 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:46.073444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd1253-55a8-4cee-bdd9-dbada68a9f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:46.113459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-72cd1253-55a8-4cee-bdd9-dbada68a9f92 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:46.118236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-72cd1253-55a8-4cee-bdd9-dbada68a9f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:46.266162 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2701/5380] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:46.276805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285eb91-1b1a-4450-abda-8b487f12a7c2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:46.277579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285eb91-1b1a-4450-abda-8b487f12a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:46.278142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285eb91-1b1a-4450-abda-8b487f12a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:46.322369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b285eb91-1b1a-4450-abda-8b487f12a7c2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:46.342577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b285eb91-1b1a-4450-abda-8b487f12a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:46.372287 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2680/5381] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:46.376927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd1253-55a8-4cee-bdd9-dbada68a9f92 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:46.396534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd1253-55a8-4cee-bdd9-dbada68a9f92 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:46.420996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3c74a-0dcc-45d6-9121-3b953047bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:46.423780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c74a-0dcc-45d6-9121-3b953047bb73 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:46.424830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c74a-0dcc-45d6-9121-3b953047bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:46.425319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c74a-0dcc-45d6-9121-3b953047bb73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:46.426388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c74a-0dcc-45d6-9121-3b953047bb73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:25:46.426892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c74a-0dcc-45d6-9121-3b953047bb73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:46.429463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c74a-0dcc-45d6-9121-3b953047bb73 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:46.454924 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2702/5382] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:25:46.459404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285eb91-1b1a-4450-abda-8b487f12a7c2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:46.472567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285eb91-1b1a-4450-abda-8b487f12a7c2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:46.478631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3007038-2b27-441b-9ff2-e10020756319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:46.479615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3007038-2b27-441b-9ff2-e10020756319 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:46.480073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3007038-2b27-441b-9ff2-e10020756319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:46.480519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3007038-2b27-441b-9ff2-e10020756319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:46.495171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3007038-2b27-441b-9ff2-e10020756319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:46.501216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3007038-2b27-441b-9ff2-e10020756319 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:46.597253 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2681/5383] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:46 2022] POST /identity/v3/projects => generated 401 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:46.601418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3c74a-0dcc-45d6-9121-3b953047bb73 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:46.618552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3c74a-0dcc-45d6-9121-3b953047bb73 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:46.811561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86cff2-7733-4217-afa6-2bce181bf542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:46.812797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86cff2-7733-4217-afa6-2bce181bf542 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:46.813250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86cff2-7733-4217-afa6-2bce181bf542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:46.813801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86cff2-7733-4217-afa6-2bce181bf542 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:46.815762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86cff2-7733-4217-afa6-2bce181bf542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:46.818358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86cff2-7733-4217-afa6-2bce181bf542 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:46.856466 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2703/5384] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:46 2022] POST /identity/v3/users => generated 301 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:46.861187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3007038-2b27-441b-9ff2-e10020756319 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:46.880635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86cff2-7733-4217-afa6-2bce181bf542 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:46.884924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3007038-2b27-441b-9ff2-e10020756319 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:46.886727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2c86cff2-7733-4217-afa6-2bce181bf542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:46.906064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e61f3-ba93-4a25-b676-a079f9a76a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:46.907283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e61f3-ba93-4a25-b676-a079f9a76a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:46.907567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e61f3-ba93-4a25-b676-a079f9a76a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:46.910144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e61f3-ba93-4a25-b676-a079f9a76a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:46.911998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e61f3-ba93-4a25-b676-a079f9a76a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:46.916446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e61f3-ba93-4a25-b676-a079f9a76a60 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:46.929603 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2682/5385] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:46.935055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86cff2-7733-4217-afa6-2bce181bf542 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:46.942589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e61f3-ba93-4a25-b676-a079f9a76a60 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:46.943336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:46.944635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:46.944949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:46.945232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] PATH_INFO: `/v3/projects/dd92af08168f411c81d45f2f3a77b126` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:46.947106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd92af08168f411c81d45f2f3a77b126)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:46.950530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:46.968113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e61f3-ba93-4a25-b676-a079f9a76a60 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:46.978497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc2e6d-5e13-4999-a083-af5aa33222db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:46.979427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc2e6d-5e13-4999-a083-af5aa33222db admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:46.979996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc2e6d-5e13-4999-a083-af5aa33222db admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:46.980531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc2e6d-5e13-4999-a083-af5aa33222db admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:46.981426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc2e6d-5e13-4999-a083-af5aa33222db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:46.985003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc2e6d-5e13-4999-a083-af5aa33222db admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:47.007831 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2683/5386] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:25:47.011716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc2e6d-5e13-4999-a083-af5aa33222db admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:47.027610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc2e6d-5e13-4999-a083-af5aa33222db admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:47.037769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd92af08168f411c81d45f2f3a77b126', 'request_id': 'req-877453c4-948e-4aef-9d8d-24b4c6033c1b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.040609 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:47.046319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd92af08168f411c81d45f2f3a77b126', 'request_id': 'req-877453c4-948e-4aef-9d8d-24b4c6033c1b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.068410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd92af08168f411c81d45f2f3a77b126', 'request_id': 'req-877453c4-948e-4aef-9d8d-24b4c6033c1b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.095282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] The token cache is being invalidate because project dd92af08168f411c81d45f2f3a77b126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:47.095673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.096980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.108272 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2704/5387] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:46 2022] DELETE /identity/v3/projects/dd92af08168f411c81d45f2f3a77b126 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:47.108272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:47.108272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:47.188049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d60b10-e1f0-4b2c-ba78-25f606ed3ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:47.188972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d60b10-e1f0-4b2c-ba78-25f606ed3ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:47.189485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d60b10-e1f0-4b2c-ba78-25f606ed3ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:47.189859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d60b10-e1f0-4b2c-ba78-25f606ed3ef0 admin admin] PATH_INFO: `/v3/projects/c306724b7a004c1395216308d3dd649a/users/105cc5a547594d7d8057323157179574/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:47.228395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d60b10-e1f0-4b2c-ba78-25f606ed3ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c306724b7a004c1395216308d3dd649a, user_id=105cc5a547594d7d8057323157179574, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:47.238650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d60b10-e1f0-4b2c-ba78-25f606ed3ef0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:47.274031 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2684/5388] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:47 2022] PUT /identity/v3/projects/c306724b7a004c1395216308d3dd649a/users/105cc5a547594d7d8057323157179574/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:25:47.286351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5e195-3e57-4d7c-839d-06fc674608dd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:47.286671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5e195-3e57-4d7c-839d-06fc674608dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:47.286928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5e195-3e57-4d7c-839d-06fc674608dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:47.321212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877453c4-948e-4aef-9d8d-24b4c6033c1b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:47.380418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-62f5e195-3e57-4d7c-839d-06fc674608dd None None] MFA Rules not processed for user `105cc5a547594d7d8057323157179574`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:47.384346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62f5e195-3e57-4d7c-839d-06fc674608dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:47.531411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aafec1-4183-489f-bfde-65cc3edffe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:47.532233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aafec1-4183-489f-bfde-65cc3edffe9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:47.532508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aafec1-4183-489f-bfde-65cc3edffe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:47.532779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aafec1-4183-489f-bfde-65cc3edffe9c admin admin] PATH_INFO: `/v3/users/091fe577009649c8bd842a93b3313669` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:47.534546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aafec1-4183-489f-bfde-65cc3edffe9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=091fe577009649c8bd842a93b3313669)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:47.542143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aafec1-4183-489f-bfde-65cc3edffe9c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:47.581814 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:47.612824 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2685/5389] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:47 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:47.630498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5e195-3e57-4d7c-839d-06fc674608dd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:47.632791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62f5e195-3e57-4d7c-839d-06fc674608dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:47.666831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5e195-3e57-4d7c-839d-06fc674608dd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:47.673954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a2aafec1-4183-489f-bfde-65cc3edffe9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091fe577009649c8bd842a93b3313669'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.684245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:47.687631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:47.688944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:47.689762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] PATH_INFO: `/v3/users/105cc5a547594d7d8057323157179574` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:47.692129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=105cc5a547594d7d8057323157179574)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:47.695883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:47.711689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a2aafec1-4183-489f-bfde-65cc3edffe9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091fe577009649c8bd842a93b3313669'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.715837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a2aafec1-4183-489f-bfde-65cc3edffe9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091fe577009649c8bd842a93b3313669'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.739038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a2aafec1-4183-489f-bfde-65cc3edffe9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091fe577009649c8bd842a93b3313669'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.740106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a2aafec1-4183-489f-bfde-65cc3edffe9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091fe577009649c8bd842a93b3313669'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.766805 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2705/5390] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:47 2022] DELETE /identity/v3/users/091fe577009649c8bd842a93b3313669 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:47.796321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105cc5a547594d7d8057323157179574'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.811992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105cc5a547594d7d8057323157179574'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.812765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105cc5a547594d7d8057323157179574'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.824395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105cc5a547594d7d8057323157179574'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.838714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105cc5a547594d7d8057323157179574'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:47.850063 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2686/5391] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:47 2022] DELETE /identity/v3/users/105cc5a547594d7d8057323157179574 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:47.855509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ce5ad-4e87-4efb-a485-f9f60f175f52 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:47.856268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ce5ad-4e87-4efb-a485-f9f60f175f52 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:47.856673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ce5ad-4e87-4efb-a485-f9f60f175f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:47.875114 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:47.887371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-050ce5ad-4e87-4efb-a485-f9f60f175f52 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:47.888750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-050ce5ad-4e87-4efb-a485-f9f60f175f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:47.998377 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2706/5392] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:48.026200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:48.027781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:48.073098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ce5ad-4e87-4efb-a485-f9f60f175f52 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:48.074932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-050ce5ad-4e87-4efb-a485-f9f60f175f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:48.215901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242cd66-e55f-4ecc-afc3-cd889c5b81d5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:48.224690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd969e-f495-40ee-a94b-47be1271e18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:48.225332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd969e-f495-40ee-a94b-47be1271e18b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:48.225616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd969e-f495-40ee-a94b-47be1271e18b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:48.226028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd969e-f495-40ee-a94b-47be1271e18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:48.248659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd969e-f495-40ee-a94b-47be1271e18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:48.248922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ce5ad-4e87-4efb-a485-f9f60f175f52 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:48.250429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd969e-f495-40ee-a94b-47be1271e18b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:48.255724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e8225-43b7-45c7-b7c3-d47b2516ab64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:48.256335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8225-43b7-45c7-b7c3-d47b2516ab64 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:48.258052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8225-43b7-45c7-b7c3-d47b2516ab64 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:48.258052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8225-43b7-45c7-b7c3-d47b2516ab64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:48.259839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-725e8225-43b7-45c7-b7c3-d47b2516ab64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:48.276599 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2687/5393] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:25:48.279153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd969e-f495-40ee-a94b-47be1271e18b service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:48.282125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dacd969e-f495-40ee-a94b-47be1271e18b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:48.332235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd969e-f495-40ee-a94b-47be1271e18b service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:48.338949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:48.339604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:48.339888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:48.340170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] PATH_INFO: `/v3/projects/94b9ab5cfa4d49e5bd531f6c6e3c6e3b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:48.342218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b9ab5cfa4d49e5bd531f6c6e3c6e3b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:48.344759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:48.385212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e8225-43b7-45c7-b7c3-d47b2516ab64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:48.387847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e8225-43b7-45c7-b7c3-d47b2516ab64 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:48.412479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b9ab5cfa4d49e5bd531f6c6e3c6e3b', 'request_id': 'req-f1b6688c-3090-45c2-b4db-77ba511916c8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:48.414632 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2707/5394] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:48.419656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b9ab5cfa4d49e5bd531f6c6e3c6e3b', 'request_id': 'req-f1b6688c-3090-45c2-b4db-77ba511916c8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:48.435873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b9ab5cfa4d49e5bd531f6c6e3c6e3b', 'request_id': 'req-f1b6688c-3090-45c2-b4db-77ba511916c8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:48.443856 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:48.466549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] The token cache is being invalidate because project 94b9ab5cfa4d49e5bd531f6c6e3c6e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:48.467106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:48.468785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1b6688c-3090-45c2-b4db-77ba511916c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:48.472634 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2688/5395] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:48 2022] DELETE /identity/v3/projects/94b9ab5cfa4d49e5bd531f6c6e3c6e3b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:48.484339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb7135-d25a-4eef-b09d-0e46edd40eee None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:48.484781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb7135-d25a-4eef-b09d-0e46edd40eee None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:48.487315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb7135-d25a-4eef-b09d-0e46edd40eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:48.537298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1cdb7135-d25a-4eef-b09d-0e46edd40eee None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:48.538817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1cdb7135-d25a-4eef-b09d-0e46edd40eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:48.610006 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:48.656547 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2708/5396] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:48.667316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97cb6f-49c8-45a5-9303-f5edd5eb3559 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:48.667693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97cb6f-49c8-45a5-9303-f5edd5eb3559 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:48.667980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97cb6f-49c8-45a5-9303-f5edd5eb3559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:48.697664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ce97cb6f-49c8-45a5-9303-f5edd5eb3559 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:48.699304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ce97cb6f-49c8-45a5-9303-f5edd5eb3559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:48.712481 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2689/5397] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:48.717496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb7135-d25a-4eef-b09d-0e46edd40eee None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:48.731043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb7135-d25a-4eef-b09d-0e46edd40eee None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:48.739527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96de200-2d3e-4bbf-9453-f3d3d1f51a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:48.740745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96de200-2d3e-4bbf-9453-f3d3d1f51a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:48.741304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96de200-2d3e-4bbf-9453-f3d3d1f51a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:48.741921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96de200-2d3e-4bbf-9453-f3d3d1f51a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:48.743282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96de200-2d3e-4bbf-9453-f3d3d1f51a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:25:48.743819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96de200-2d3e-4bbf-9453-f3d3d1f51a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:48.745834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96de200-2d3e-4bbf-9453-f3d3d1f51a52 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:48.794133 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2709/5398] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:25:48.795644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97cb6f-49c8-45a5-9303-f5edd5eb3559 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:48.806094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97cb6f-49c8-45a5-9303-f5edd5eb3559 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:48.811845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8625fb-8c72-4723-87ef-5eed1fa03fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:48.812265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8625fb-8c72-4723-87ef-5eed1fa03fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:48.812556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8625fb-8c72-4723-87ef-5eed1fa03fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:48.812828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8625fb-8c72-4723-87ef-5eed1fa03fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:48.813467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8625fb-8c72-4723-87ef-5eed1fa03fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:48.815731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8625fb-8c72-4723-87ef-5eed1fa03fbd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:48.852159 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2690/5399] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:48 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:48.854477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96de200-2d3e-4bbf-9453-f3d3d1f51a52 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:48.907704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96de200-2d3e-4bbf-9453-f3d3d1f51a52 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:48.997240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f312f-d83d-46ad-8b0a-779e06588f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:48.998219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f312f-d83d-46ad-8b0a-779e06588f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:48.998504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f312f-d83d-46ad-8b0a-779e06588f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:48.998915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f312f-d83d-46ad-8b0a-779e06588f48 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:48.999623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f312f-d83d-46ad-8b0a-779e06588f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:49.002153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f312f-d83d-46ad-8b0a-779e06588f48 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:49.031071 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2710/5400] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:48 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:49.034494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8625fb-8c72-4723-87ef-5eed1fa03fbd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:49.048333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8625fb-8c72-4723-87ef-5eed1fa03fbd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:49.058496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a8108-d236-4761-b126-ac37a9a8d724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:49.059316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a8108-d236-4761-b126-ac37a9a8d724 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:49.059602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a8108-d236-4761-b126-ac37a9a8d724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:49.059888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a8108-d236-4761-b126-ac37a9a8d724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:49.060560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a8108-d236-4761-b126-ac37a9a8d724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:49.062466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a8108-d236-4761-b126-ac37a9a8d724 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:49.077757 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2691/5401] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:49.084576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f312f-d83d-46ad-8b0a-779e06588f48 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:49.103115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc038b-7ebc-46fc-8c52-c5d21d3ce3a2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:49.103493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc038b-7ebc-46fc-8c52-c5d21d3ce3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:49.104158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc038b-7ebc-46fc-8c52-c5d21d3ce3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:49.106287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f312f-d83d-46ad-8b0a-779e06588f48 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:49.112282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea329-224b-42b3-a368-9d63ab3d9319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:49.112968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea329-224b-42b3-a368-9d63ab3d9319 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:49.113252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea329-224b-42b3-a368-9d63ab3d9319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:49.113528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea329-224b-42b3-a368-9d63ab3d9319 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:49.114337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dea329-224b-42b3-a368-9d63ab3d9319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:49.116004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dea329-224b-42b3-a368-9d63ab3d9319 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:49.130384 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2711/5402] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:49.133255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-45dc038b-7ebc-46fc-8c52-c5d21d3ce3a2 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:49.134332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45dc038b-7ebc-46fc-8c52-c5d21d3ce3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:49.136628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea329-224b-42b3-a368-9d63ab3d9319 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:49.151666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea329-224b-42b3-a368-9d63ab3d9319 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:49.160621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d7260-3617-4560-8f45-3ef755425a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:49.161443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d7260-3617-4560-8f45-3ef755425a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:49.161800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d7260-3617-4560-8f45-3ef755425a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:49.162849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d7260-3617-4560-8f45-3ef755425a7c admin admin] PATH_INFO: `/v3/projects/acd9c14e9d064f8a959c304ca86d41c0/users/80154b381d5f4e8594b817e4ea2995f2/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:49.183959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d7260-3617-4560-8f45-3ef755425a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd9c14e9d064f8a959c304ca86d41c0, user_id=80154b381d5f4e8594b817e4ea2995f2, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:49.187988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d7260-3617-4560-8f45-3ef755425a7c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:49.205905 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2712/5403] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:49 2022] PUT /identity/v3/projects/acd9c14e9d064f8a959c304ca86d41c0/users/80154b381d5f4e8594b817e4ea2995f2/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:49.212168 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2692/5404] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:49.219298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bf0a7-0cc4-413b-a4e9-709e3dbaafbe None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:49.219624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bf0a7-0cc4-413b-a4e9-709e3dbaafbe None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:49.219896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bf0a7-0cc4-413b-a4e9-709e3dbaafbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:49.266725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e47bf0a7-0cc4-413b-a4e9-709e3dbaafbe None None] MFA Rules not processed for user `80154b381d5f4e8594b817e4ea2995f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:49.268371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e47bf0a7-0cc4-413b-a4e9-709e3dbaafbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:49.403457 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2713/5405] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:49.405016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc038b-7ebc-46fc-8c52-c5d21d3ce3a2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:49.422460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc038b-7ebc-46fc-8c52-c5d21d3ce3a2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:49.508496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af81a6-9a34-4764-af76-e2430efcb37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:49.509210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af81a6-9a34-4764-af76-e2430efcb37a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:49.509678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af81a6-9a34-4764-af76-e2430efcb37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:49.510070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af81a6-9a34-4764-af76-e2430efcb37a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:49.510821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af81a6-9a34-4764-af76-e2430efcb37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:49.515950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bf0a7-0cc4-413b-a4e9-709e3dbaafbe None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:49.521045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e47bf0a7-0cc4-413b-a4e9-709e3dbaafbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:49.526505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af81a6-9a34-4764-af76-e2430efcb37a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:49.566165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bf0a7-0cc4-413b-a4e9-709e3dbaafbe None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:49.583366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:49.584051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:49.585702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:49.586380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] PATH_INFO: `/v3/projects/c306724b7a004c1395216308d3dd649a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:49.590366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c306724b7a004c1395216308d3dd649a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:49.596502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:49.622087 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2693/5406] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:49 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:49.628421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af81a6-9a34-4764-af76-e2430efcb37a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:49.650674 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:49.746172 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:49.776513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af81a6-9a34-4764-af76-e2430efcb37a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:49.784557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c306724b7a004c1395216308d3dd649a', 'request_id': 'req-45a7d8d4-f0ee-4497-97d2-dfec967b067c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:49.817152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c306724b7a004c1395216308d3dd649a', 'request_id': 'req-45a7d8d4-f0ee-4497-97d2-dfec967b067c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:49.849060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c306724b7a004c1395216308d3dd649a', 'request_id': 'req-45a7d8d4-f0ee-4497-97d2-dfec967b067c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:49.882135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] The token cache is being invalidate because project c306724b7a004c1395216308d3dd649a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:49.882957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:49.883145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-45a7d8d4-f0ee-4497-97d2-dfec967b067c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:49.895155 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2714/5407] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:49 2022] DELETE /identity/v3/projects/c306724b7a004c1395216308d3dd649a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:25:49.900364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55186c8-1ff7-4853-a927-8834ff573bc9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:49.900980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55186c8-1ff7-4853-a927-8834ff573bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:49.901656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55186c8-1ff7-4853-a927-8834ff573bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:49.947907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527d2b-16a9-4ee7-8b19-ca4a7be9f85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:49.948704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527d2b-16a9-4ee7-8b19-ca4a7be9f85e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:49.949219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527d2b-16a9-4ee7-8b19-ca4a7be9f85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:49.949598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527d2b-16a9-4ee7-8b19-ca4a7be9f85e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:49.950560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61527d2b-16a9-4ee7-8b19-ca4a7be9f85e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:49.953194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61527d2b-16a9-4ee7-8b19-ca4a7be9f85e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:49.959984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c55186c8-1ff7-4853-a927-8834ff573bc9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:49.962331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c55186c8-1ff7-4853-a927-8834ff573bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:49.997408 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2715/5408] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:50.007119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce0ac6-bffe-4230-a35e-b3259c544404 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.007119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce0ac6-bffe-4230-a35e-b3259c544404 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.007119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce0ac6-bffe-4230-a35e-b3259c544404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.046088 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2694/5409] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:49 2022] POST /identity/v3/users => generated 297 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:50.047063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cdce0ac6-bffe-4230-a35e-b3259c544404 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:50.048392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cdce0ac6-bffe-4230-a35e-b3259c544404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:50.050419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527d2b-16a9-4ee7-8b19-ca4a7be9f85e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:50.055058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-61527d2b-16a9-4ee7-8b19-ca4a7be9f85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:50.070017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527d2b-16a9-4ee7-8b19-ca4a7be9f85e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:50.075295 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2716/5410] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:25:50.079627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce0ac6-bffe-4230-a35e-b3259c544404 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:50.081363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d641c-d110-4308-a56b-a416cd68b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:50.082094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d641c-d110-4308-a56b-a416cd68b2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.082471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d641c-d110-4308-a56b-a416cd68b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.082874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d641c-d110-4308-a56b-a416cd68b2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.083698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d641c-d110-4308-a56b-a416cd68b2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:50.086413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d641c-d110-4308-a56b-a416cd68b2c9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:50.089684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce0ac6-bffe-4230-a35e-b3259c544404 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:50.099769 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2695/5411] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:50.103490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d641c-d110-4308-a56b-a416cd68b2c9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:50.106221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2bf99-e5d5-4f3c-8e36-d4a3fdc09612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:50.106889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2bf99-e5d5-4f3c-8e36-d4a3fdc09612 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.107999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2bf99-e5d5-4f3c-8e36-d4a3fdc09612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.107999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2bf99-e5d5-4f3c-8e36-d4a3fdc09612 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.108207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2bf99-e5d5-4f3c-8e36-d4a3fdc09612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:25:50.108437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2bf99-e5d5-4f3c-8e36-d4a3fdc09612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:50.110210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2bf99-e5d5-4f3c-8e36-d4a3fdc09612 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:50.138850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d641c-d110-4308-a56b-a416cd68b2c9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:50.144856 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2717/5412] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:25:50.146769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2bf99-e5d5-4f3c-8e36-d4a3fdc09612 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:50.152302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec0163-0744-4042-992d-58164c424a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:50.153473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec0163-0744-4042-992d-58164c424a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.155049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec0163-0744-4042-992d-58164c424a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.158339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec0163-0744-4042-992d-58164c424a13 admin admin] PATH_INFO: `/v3/projects/33412b3a439a49799bc77800e1bc6e5e/users/af52ff64992f48e691c2c45846b9998a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.167400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2bf99-e5d5-4f3c-8e36-d4a3fdc09612 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:50.194627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890352e9-bd64-45e1-896e-a01ada8948ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:50.194627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890352e9-bd64-45e1-896e-a01ada8948ee admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.194627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890352e9-bd64-45e1-896e-a01ada8948ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.194627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890352e9-bd64-45e1-896e-a01ada8948ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.195322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890352e9-bd64-45e1-896e-a01ada8948ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:50.195961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890352e9-bd64-45e1-896e-a01ada8948ee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:50.204656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec0163-0744-4042-992d-58164c424a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33412b3a439a49799bc77800e1bc6e5e, user_id=af52ff64992f48e691c2c45846b9998a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:50.208943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec0163-0744-4042-992d-58164c424a13 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:50.229114 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2696/5413] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:50 2022] PUT /identity/v3/projects/33412b3a439a49799bc77800e1bc6e5e/users/af52ff64992f48e691c2c45846b9998a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:50.233033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec0163-0744-4042-992d-58164c424a13 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:50.277591 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2718/5414] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:50 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:50.279303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890352e9-bd64-45e1-896e-a01ada8948ee admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:50.396001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec0163-0744-4042-992d-58164c424a13 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:50.429534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890352e9-bd64-45e1-896e-a01ada8948ee admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:50.443514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053d84-c944-4dd7-9aa2-0e5a9277976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:50.444275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053d84-c944-4dd7-9aa2-0e5a9277976d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.444618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053d84-c944-4dd7-9aa2-0e5a9277976d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.444974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053d84-c944-4dd7-9aa2-0e5a9277976d admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.445649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76053d84-c944-4dd7-9aa2-0e5a9277976d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:50.449314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76053d84-c944-4dd7-9aa2-0e5a9277976d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:50.508428 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2719/5415] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:50 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:50.510526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053d84-c944-4dd7-9aa2-0e5a9277976d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:50.545073 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:50.547221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053d84-c944-4dd7-9aa2-0e5a9277976d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:50.566326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d62c4-875c-4fc5-9b2c-eda81439f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:50.566645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d62c4-875c-4fc5-9b2c-eda81439f7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.566898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d62c4-875c-4fc5-9b2c-eda81439f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.567178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d62c4-875c-4fc5-9b2c-eda81439f7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.567850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d62c4-875c-4fc5-9b2c-eda81439f7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:50.568544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741a961-b323-48d3-a6d7-cba5b78d07cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:50.570162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741a961-b323-48d3-a6d7-cba5b78d07cb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.570338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d62c4-875c-4fc5-9b2c-eda81439f7b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:50.576392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741a961-b323-48d3-a6d7-cba5b78d07cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.578201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741a961-b323-48d3-a6d7-cba5b78d07cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.582980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741a961-b323-48d3-a6d7-cba5b78d07cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:50.589643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741a961-b323-48d3-a6d7-cba5b78d07cb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:50.601481 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2697/5416] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:50.602730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d62c4-875c-4fc5-9b2c-eda81439f7b0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:50.615463 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2720/5417] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:50.620910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741a961-b323-48d3-a6d7-cba5b78d07cb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:50.627855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d62c4-875c-4fc5-9b2c-eda81439f7b0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:50.644273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce7727-b980-4922-8805-c54e9414e013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:50.644970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce7727-b980-4922-8805-c54e9414e013 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.645257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce7727-b980-4922-8805-c54e9414e013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.646948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce7727-b980-4922-8805-c54e9414e013 admin admin] PATH_INFO: `/v3/projects/33412b3a439a49799bc77800e1bc6e5e/users/af52ff64992f48e691c2c45846b9998a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.649121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741a961-b323-48d3-a6d7-cba5b78d07cb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:50.653485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce7727-b980-4922-8805-c54e9414e013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33412b3a439a49799bc77800e1bc6e5e, user_id=af52ff64992f48e691c2c45846b9998a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:50.662524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce7727-b980-4922-8805-c54e9414e013 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:50.665005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569968c-7f8e-42bd-b9fc-dce51d24e00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:50.665983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569968c-7f8e-42bd-b9fc-dce51d24e00e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.666815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569968c-7f8e-42bd-b9fc-dce51d24e00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.668134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569968c-7f8e-42bd-b9fc-dce51d24e00e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.670837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569968c-7f8e-42bd-b9fc-dce51d24e00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:50.672869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569968c-7f8e-42bd-b9fc-dce51d24e00e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:50.694482 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2698/5418] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:50 2022] PUT /identity/v3/projects/33412b3a439a49799bc77800e1bc6e5e/users/af52ff64992f48e691c2c45846b9998a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:50.703323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce7727-b980-4922-8805-c54e9414e013 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:50.704569 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2721/5419] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:50.706235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812adb13-ebd5-4f1d-875a-d5847b976da6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.706525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812adb13-ebd5-4f1d-875a-d5847b976da6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.706830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812adb13-ebd5-4f1d-875a-d5847b976da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.778068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-812adb13-ebd5-4f1d-875a-d5847b976da6 None None] MFA Rules not processed for user `af52ff64992f48e691c2c45846b9998a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:50.780396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-812adb13-ebd5-4f1d-875a-d5847b976da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:50.794436 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:50.848907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce7727-b980-4922-8805-c54e9414e013 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:50.867040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b872840-b055-44ba-8e50-7bd1f0faa3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:50.867738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b872840-b055-44ba-8e50-7bd1f0faa3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.868881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b872840-b055-44ba-8e50-7bd1f0faa3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.869181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b872840-b055-44ba-8e50-7bd1f0faa3d6 admin admin] PATH_INFO: `/v3/projects/d9b8b20b7702433486fbb08f8e801d57/users/116490a90023449a83265db52a0debb1/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:50.913850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b872840-b055-44ba-8e50-7bd1f0faa3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b8b20b7702433486fbb08f8e801d57, user_id=116490a90023449a83265db52a0debb1, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:50.913850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b872840-b055-44ba-8e50-7bd1f0faa3d6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:50.965773 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2699/5420] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:50 2022] PUT /identity/v3/projects/d9b8b20b7702433486fbb08f8e801d57/users/116490a90023449a83265db52a0debb1/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:50.971297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45941f0-8a1d-488e-bfa5-8f0f56f6e91a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:50.971621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45941f0-8a1d-488e-bfa5-8f0f56f6e91a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:50.971862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45941f0-8a1d-488e-bfa5-8f0f56f6e91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:51.009158 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2722/5421] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:51.026611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c45941f0-8a1d-488e-bfa5-8f0f56f6e91a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:51.027953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c45941f0-8a1d-488e-bfa5-8f0f56f6e91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:51.032464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812adb13-ebd5-4f1d-875a-d5847b976da6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:51.035406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-812adb13-ebd5-4f1d-875a-d5847b976da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:51.194859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812adb13-ebd5-4f1d-875a-d5847b976da6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:51.212639 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2700/5422] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:51.313608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eefc94-3850-4290-973c-6c5029008e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:51.314244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eefc94-3850-4290-973c-6c5029008e67 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:51.315214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eefc94-3850-4290-973c-6c5029008e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:51.315950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eefc94-3850-4290-973c-6c5029008e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:51.320980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-35eefc94-3850-4290-973c-6c5029008e67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:51.432513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eefc94-3850-4290-973c-6c5029008e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:51.436749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eefc94-3850-4290-973c-6c5029008e67 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:51.457978 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2723/5423] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:51.547374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45941f0-8a1d-488e-bfa5-8f0f56f6e91a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:51.549124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c45941f0-8a1d-488e-bfa5-8f0f56f6e91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:51.692113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45941f0-8a1d-488e-bfa5-8f0f56f6e91a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:51.698380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7f6f3-a0c3-4db1-a447-1cc6e65193fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:51.700320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7f6f3-a0c3-4db1-a447-1cc6e65193fe service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:51.700320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7f6f3-a0c3-4db1-a447-1cc6e65193fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:51.700320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7f6f3-a0c3-4db1-a447-1cc6e65193fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:51.714236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7f6f3-a0c3-4db1-a447-1cc6e65193fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:51.717128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7f6f3-a0c3-4db1-a447-1cc6e65193fe service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:51.735269 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2701/5424] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:53.438531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918e12-128c-4342-8b25-fe6d69fb4c2d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:53.440230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918e12-128c-4342-8b25-fe6d69fb4c2d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:53.440526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918e12-128c-4342-8b25-fe6d69fb4c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:53.475769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e8918e12-128c-4342-8b25-fe6d69fb4c2d None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:53.477585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e8918e12-128c-4342-8b25-fe6d69fb4c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:53.488861 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:53.563622 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2724/5425] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:54.712261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7f6f3-a0c3-4db1-a447-1cc6e65193fe service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:54.714223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0bc7f6f3-a0c3-4db1-a447-1cc6e65193fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:54.729240 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:54.734514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7f6f3-a0c3-4db1-a447-1cc6e65193fe service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:54.741897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:54.742961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:54.744417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:54.745129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] PATH_INFO: `/v3/users/ef5c54746e034cf8868cdaa3a28c6915` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:54.746986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5c54746e034cf8868cdaa3a28c6915)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:54.750298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:54.816082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5c54746e034cf8868cdaa3a28c6915'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:54.839307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5c54746e034cf8868cdaa3a28c6915'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:54.840400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5c54746e034cf8868cdaa3a28c6915'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:54.857451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5c54746e034cf8868cdaa3a28c6915'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:54.873840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5c54746e034cf8868cdaa3a28c6915'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:54.884724 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2702/5426] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:54 2022] DELETE /identity/v3/users/ef5c54746e034cf8868cdaa3a28c6915 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:54.886494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d74c3-f22e-459f-9fa0-d857d4675210 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:54.886982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d74c3-f22e-459f-9fa0-d857d4675210 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:54.887167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d74c3-f22e-459f-9fa0-d857d4675210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:54.938324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-298d74c3-f22e-459f-9fa0-d857d4675210 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:54.942699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-298d74c3-f22e-459f-9fa0-d857d4675210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:55.106654 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2725/5427] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:55.118965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:55.121017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:55.287862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02cedd-3161-4197-8722-65af584442af admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:55.312997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f3fe3-58ff-4e3a-9b69-5486f7c9df51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:55.313640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f3fe3-58ff-4e3a-9b69-5486f7c9df51 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:55.314033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f3fe3-58ff-4e3a-9b69-5486f7c9df51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:55.314259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f3fe3-58ff-4e3a-9b69-5486f7c9df51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:55.334305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f3fe3-58ff-4e3a-9b69-5486f7c9df51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:55.337979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f3fe3-58ff-4e3a-9b69-5486f7c9df51 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:55.362467 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2703/5428] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:55.713711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d74c3-f22e-459f-9fa0-d857d4675210 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:55.715562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-298d74c3-f22e-459f-9fa0-d857d4675210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:55.732777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d74c3-f22e-459f-9fa0-d857d4675210 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:55.746191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:55.746924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:55.747212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:55.748516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] PATH_INFO: `/v3/projects/38b777af8148446cb979fa33a1b05817` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:55.753109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b777af8148446cb979fa33a1b05817)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:55.756442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:55.882956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b777af8148446cb979fa33a1b05817', 'request_id': 'req-7f233320-6264-4797-b04c-5bd5fe6b3858'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:55.902049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b777af8148446cb979fa33a1b05817', 'request_id': 'req-7f233320-6264-4797-b04c-5bd5fe6b3858'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:55.921603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b777af8148446cb979fa33a1b05817', 'request_id': 'req-7f233320-6264-4797-b04c-5bd5fe6b3858'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:55.951380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] The token cache is being invalidate because project 38b777af8148446cb979fa33a1b05817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:55.951678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:55.954936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7f233320-6264-4797-b04c-5bd5fe6b3858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:55.965041 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2726/5429] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:55 2022] DELETE /identity/v3/projects/38b777af8148446cb979fa33a1b05817 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:55.967084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4755d1-82ef-4281-b879-137ac48ccf34 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:55.967585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4755d1-82ef-4281-b879-137ac48ccf34 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:55.967719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4755d1-82ef-4281-b879-137ac48ccf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:56.012507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2b4755d1-82ef-4281-b879-137ac48ccf34 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:56.013861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2b4755d1-82ef-4281-b879-137ac48ccf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:56.156884 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2704/5430] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:56.164975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ac46-60c3-4d61-88da-9872291dabb2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:56.165560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ac46-60c3-4d61-88da-9872291dabb2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:56.166060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ac46-60c3-4d61-88da-9872291dabb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:56.215055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-09e9ac46-60c3-4d61-88da-9872291dabb2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:56.216757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-09e9ac46-60c3-4d61-88da-9872291dabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:56.239574 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2727/5431] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:56.243523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4755d1-82ef-4281-b879-137ac48ccf34 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:56.258233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4755d1-82ef-4281-b879-137ac48ccf34 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:56.267288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f91656-4be5-486c-8e80-a143a7b492ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:56.268441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f91656-4be5-486c-8e80-a143a7b492ff admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:56.268724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f91656-4be5-486c-8e80-a143a7b492ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:56.269000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f91656-4be5-486c-8e80-a143a7b492ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:56.269664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f91656-4be5-486c-8e80-a143a7b492ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:25:56.269967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f91656-4be5-486c-8e80-a143a7b492ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:56.275755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f91656-4be5-486c-8e80-a143a7b492ff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:56.298489 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2705/5432] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:25:56.303432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ac46-60c3-4d61-88da-9872291dabb2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:56.317717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ac46-60c3-4d61-88da-9872291dabb2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:56.336196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723a7a6-5c1b-4bfe-826d-7512d174eaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:56.337205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723a7a6-5c1b-4bfe-826d-7512d174eaab admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:56.337836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723a7a6-5c1b-4bfe-826d-7512d174eaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:56.338332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723a7a6-5c1b-4bfe-826d-7512d174eaab admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:56.339257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723a7a6-5c1b-4bfe-826d-7512d174eaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:56.341407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723a7a6-5c1b-4bfe-826d-7512d174eaab admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:56.401656 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2728/5433] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:56 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:25:56.406352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f91656-4be5-486c-8e80-a143a7b492ff admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:56.420054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f91656-4be5-486c-8e80-a143a7b492ff admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:56.434722 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:56.549662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c81433-d29d-46f7-a5f8-0b97d533497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:56.550429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c81433-d29d-46f7-a5f8-0b97d533497c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:56.550780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c81433-d29d-46f7-a5f8-0b97d533497c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:56.551054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c81433-d29d-46f7-a5f8-0b97d533497c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:56.551773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c81433-d29d-46f7-a5f8-0b97d533497c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:56.557719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c81433-d29d-46f7-a5f8-0b97d533497c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:56.610291 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2706/5434] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:56 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:56.614440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723a7a6-5c1b-4bfe-826d-7512d174eaab admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:56.636752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723a7a6-5c1b-4bfe-826d-7512d174eaab admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:56.659765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cffd61-bd6c-4872-b39e-66a1b4337b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:56.662151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cffd61-bd6c-4872-b39e-66a1b4337b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:56.663848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cffd61-bd6c-4872-b39e-66a1b4337b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:56.664451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cffd61-bd6c-4872-b39e-66a1b4337b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:56.667121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cffd61-bd6c-4872-b39e-66a1b4337b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:56.675008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cffd61-bd6c-4872-b39e-66a1b4337b8f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:56.722671 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2729/5435] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:56.728546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c81433-d29d-46f7-a5f8-0b97d533497c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:56.766756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c81433-d29d-46f7-a5f8-0b97d533497c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:56.789940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74254780-595d-4230-8ec6-b7f20bf1220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:56.793355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74254780-595d-4230-8ec6-b7f20bf1220e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:56.793867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74254780-595d-4230-8ec6-b7f20bf1220e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:56.794338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74254780-595d-4230-8ec6-b7f20bf1220e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:56.795711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74254780-595d-4230-8ec6-b7f20bf1220e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:56.807625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74254780-595d-4230-8ec6-b7f20bf1220e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:56.871190 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2707/5436] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:25:56.873174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cffd61-bd6c-4872-b39e-66a1b4337b8f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:56.898400 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:56.937648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cffd61-bd6c-4872-b39e-66a1b4337b8f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:56.943412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5710-bd2f-437e-8d5c-911afb4e347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:56.944202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5710-bd2f-437e-8d5c-911afb4e347a admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:56.944593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5710-bd2f-437e-8d5c-911afb4e347a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:56.945007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5710-bd2f-437e-8d5c-911afb4e347a admin admin] PATH_INFO: `/v3/projects/8bd04eeb20c441ca9bd85f847280763b/users/b23a8c2ea4e94c06a7a67f474a305758/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:56.993410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5710-bd2f-437e-8d5c-911afb4e347a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd04eeb20c441ca9bd85f847280763b, user_id=b23a8c2ea4e94c06a7a67f474a305758, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:56.999230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5710-bd2f-437e-8d5c-911afb4e347a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:57.039419 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2730/5437] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:25:56 2022] PUT /identity/v3/projects/8bd04eeb20c441ca9bd85f847280763b/users/b23a8c2ea4e94c06a7a67f474a305758/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:57.052691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346b327-0dae-4e60-b73b-62e831aa23dc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:57.053204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346b327-0dae-4e60-b73b-62e831aa23dc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:57.053492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346b327-0dae-4e60-b73b-62e831aa23dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:57.141605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d346b327-0dae-4e60-b73b-62e831aa23dc None None] MFA Rules not processed for user `b23a8c2ea4e94c06a7a67f474a305758`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:57.149764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d346b327-0dae-4e60-b73b-62e831aa23dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:57.363011 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2708/5438] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:57.375373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5710-bd2f-437e-8d5c-911afb4e347a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:57.378391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-adca5710-bd2f-437e-8d5c-911afb4e347a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:57.568884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5710-bd2f-437e-8d5c-911afb4e347a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:57.578357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77241f0e-2fe8-4035-b780-6cc08082565b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:57.585425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77241f0e-2fe8-4035-b780-6cc08082565b service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:57.586854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77241f0e-2fe8-4035-b780-6cc08082565b service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:57.588746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77241f0e-2fe8-4035-b780-6cc08082565b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:57.614416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77241f0e-2fe8-4035-b780-6cc08082565b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:57.618225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77241f0e-2fe8-4035-b780-6cc08082565b service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:57.654495 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2731/5439] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:25:57.659350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346b327-0dae-4e60-b73b-62e831aa23dc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:57.791965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346b327-0dae-4e60-b73b-62e831aa23dc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:57.813162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedee1fd-460f-4b5c-bce7-9b8eb5fe9095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:57.818500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee1fd-460f-4b5c-bce7-9b8eb5fe9095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:57.819938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee1fd-460f-4b5c-bce7-9b8eb5fe9095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:57.821700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee1fd-460f-4b5c-bce7-9b8eb5fe9095 admin admin] PATH_INFO: `/v3/users/b23a8c2ea4e94c06a7a67f474a305758` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:57.827865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedee1fd-460f-4b5c-bce7-9b8eb5fe9095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23a8c2ea4e94c06a7a67f474a305758)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:57.836160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedee1fd-460f-4b5c-bce7-9b8eb5fe9095 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:57.916470 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:58.022390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dedee1fd-460f-4b5c-bce7-9b8eb5fe9095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23a8c2ea4e94c06a7a67f474a305758'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:58.045439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dedee1fd-460f-4b5c-bce7-9b8eb5fe9095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23a8c2ea4e94c06a7a67f474a305758'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:58.046231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dedee1fd-460f-4b5c-bce7-9b8eb5fe9095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23a8c2ea4e94c06a7a67f474a305758'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:58.066344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dedee1fd-460f-4b5c-bce7-9b8eb5fe9095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23a8c2ea4e94c06a7a67f474a305758'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:58.080908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dedee1fd-460f-4b5c-bce7-9b8eb5fe9095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23a8c2ea4e94c06a7a67f474a305758'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:58.101029 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2709/5440] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:25:57 2022] DELETE /identity/v3/users/b23a8c2ea4e94c06a7a67f474a305758 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:25:58.103146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799cd71-a671-4b6c-9967-82753b5f86f1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:58.103638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799cd71-a671-4b6c-9967-82753b5f86f1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:58.103896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799cd71-a671-4b6c-9967-82753b5f86f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:58.159868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1799cd71-a671-4b6c-9967-82753b5f86f1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:58.164020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1799cd71-a671-4b6c-9967-82753b5f86f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:58.195445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0139a-a5c0-4dbf-9b6e-e2d87d16de96 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:58.195947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0139a-a5c0-4dbf-9b6e-e2d87d16de96 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:58.196558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0139a-a5c0-4dbf-9b6e-e2d87d16de96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:58.255157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-36c0139a-a5c0-4dbf-9b6e-e2d87d16de96 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:58.257378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-36c0139a-a5c0-4dbf-9b6e-e2d87d16de96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:58.392027 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2732/5441] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:58.402942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799cd71-a671-4b6c-9967-82753b5f86f1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:58.409190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1799cd71-a671-4b6c-9967-82753b5f86f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:58.425861 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2710/5442] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:25:58.561226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799cd71-a671-4b6c-9967-82753b5f86f1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:58.568599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464597db-c0d8-4661-ad63-41f8549d960e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:58.569151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464597db-c0d8-4661-ad63-41f8549d960e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:58.569432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464597db-c0d8-4661-ad63-41f8549d960e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:58.569705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464597db-c0d8-4661-ad63-41f8549d960e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:58.596490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464597db-c0d8-4661-ad63-41f8549d960e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:58.597946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464597db-c0d8-4661-ad63-41f8549d960e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:58.622804 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2733/5443] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:25:59.173930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0139a-a5c0-4dbf-9b6e-e2d87d16de96 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:59.175558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-36c0139a-a5c0-4dbf-9b6e-e2d87d16de96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:59.203806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0139a-a5c0-4dbf-9b6e-e2d87d16de96 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:59.209679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:59.210619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:59.211083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:59.211525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] PATH_INFO: `/v3/projects/8bd04eeb20c441ca9bd85f847280763b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:59.212871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd04eeb20c441ca9bd85f847280763b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:59.215410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:59.323359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd04eeb20c441ca9bd85f847280763b', 'request_id': 'req-587246bc-e256-423a-9cfd-416b137bb1ae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:59.340030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd04eeb20c441ca9bd85f847280763b', 'request_id': 'req-587246bc-e256-423a-9cfd-416b137bb1ae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:59.357034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd04eeb20c441ca9bd85f847280763b', 'request_id': 'req-587246bc-e256-423a-9cfd-416b137bb1ae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:59.396126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] The token cache is being invalidate because project 8bd04eeb20c441ca9bd85f847280763b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:25:59.396707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:59.397575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-587246bc-e256-423a-9cfd-416b137bb1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:25:59.399621 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2711/5444] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:25:59 2022] DELETE /identity/v3/projects/8bd04eeb20c441ca9bd85f847280763b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:25:59.405378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73917ce-462e-4542-bfd8-1b0ae86a1c9e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:59.406354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73917ce-462e-4542-bfd8-1b0ae86a1c9e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:59.406840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73917ce-462e-4542-bfd8-1b0ae86a1c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:59.446032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a73917ce-462e-4542-bfd8-1b0ae86a1c9e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:59.447488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a73917ce-462e-4542-bfd8-1b0ae86a1c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:59.473380 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:59.531991 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2734/5445] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:59.540722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413db5f-cdaf-487e-9f3a-e8568ca6359a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:59.541377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413db5f-cdaf-487e-9f3a-e8568ca6359a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:59.541839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413db5f-cdaf-487e-9f3a-e8568ca6359a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:59.584875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2413db5f-cdaf-487e-9f3a-e8568ca6359a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:25:59.586498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2413db5f-cdaf-487e-9f3a-e8568ca6359a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:25:59.606845 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2712/5446] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:25:59.610918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73917ce-462e-4542-bfd8-1b0ae86a1c9e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:59.624280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73917ce-462e-4542-bfd8-1b0ae86a1c9e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:59.637072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4fbc3-b30f-4c81-9e2b-d0acda3b3368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:59.637970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4fbc3-b30f-4c81-9e2b-d0acda3b3368 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:59.638436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4fbc3-b30f-4c81-9e2b-d0acda3b3368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:59.638910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4fbc3-b30f-4c81-9e2b-d0acda3b3368 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:59.639746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4fbc3-b30f-4c81-9e2b-d0acda3b3368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:25:59.640223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4fbc3-b30f-4c81-9e2b-d0acda3b3368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:59.644496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4fbc3-b30f-4c81-9e2b-d0acda3b3368 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:59.669626 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2735/5447] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:25:59.674574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413db5f-cdaf-487e-9f3a-e8568ca6359a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:59.690026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413db5f-cdaf-487e-9f3a-e8568ca6359a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:59.701042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543f795-2dd4-4c2f-aea6-6d0c2602a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:59.702205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543f795-2dd4-4c2f-aea6-6d0c2602a1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:59.703902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543f795-2dd4-4c2f-aea6-6d0c2602a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:59.704133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543f795-2dd4-4c2f-aea6-6d0c2602a1e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:59.704860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543f795-2dd4-4c2f-aea6-6d0c2602a1e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:59.716443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543f795-2dd4-4c2f-aea6-6d0c2602a1e4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:59.745191 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:59.767420 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2713/5448] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:25:59 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:25:59.772577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4fbc3-b30f-4c81-9e2b-d0acda3b3368 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:59.786717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4fbc3-b30f-4c81-9e2b-d0acda3b3368 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:25:59.880550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c15c8-d78d-4081-8c68-d1937715272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:25:59.881084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c15c8-d78d-4081-8c68-d1937715272f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:25:59.881363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c15c8-d78d-4081-8c68-d1937715272f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:25:59.881634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c15c8-d78d-4081-8c68-d1937715272f admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:25:59.882278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c15c8-d78d-4081-8c68-d1937715272f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:25:59.884275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c15c8-d78d-4081-8c68-d1937715272f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:25:59.937522 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2736/5449] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:25:59 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:25:59.943599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543f795-2dd4-4c2f-aea6-6d0c2602a1e4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:25:59.966866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543f795-2dd4-4c2f-aea6-6d0c2602a1e4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:00.026498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0598bcd-b525-42a9-8255-48af3af7d1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:00.028925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0598bcd-b525-42a9-8255-48af3af7d1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:00.029459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0598bcd-b525-42a9-8255-48af3af7d1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:00.037699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0598bcd-b525-42a9-8255-48af3af7d1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:00.041064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0598bcd-b525-42a9-8255-48af3af7d1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:00.051539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0598bcd-b525-42a9-8255-48af3af7d1f1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:00.077086 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2714/5450] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:00.082664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c15c8-d78d-4081-8c68-d1937715272f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:00.105521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c15c8-d78d-4081-8c68-d1937715272f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:00.122844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e22f2-140f-435c-943c-9e92913f8d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:00.123230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e22f2-140f-435c-943c-9e92913f8d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:00.123509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e22f2-140f-435c-943c-9e92913f8d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:00.123778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e22f2-140f-435c-943c-9e92913f8d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:00.124428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e22f2-140f-435c-943c-9e92913f8d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:00.131120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e22f2-140f-435c-943c-9e92913f8d53 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:00.165020 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2737/5451] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:00.169007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0598bcd-b525-42a9-8255-48af3af7d1f1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:00.197700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0598bcd-b525-42a9-8255-48af3af7d1f1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:00.216580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22732ff-b781-4a99-9b75-66c9654c33b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:00.217906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22732ff-b781-4a99-9b75-66c9654c33b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:00.218425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22732ff-b781-4a99-9b75-66c9654c33b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:00.219013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22732ff-b781-4a99-9b75-66c9654c33b6 admin admin] PATH_INFO: `/v3/projects/aab19cb2d1fc4447b6c6684c8c269e30/users/4209a1bb1fd24dcd9f2ce084f666c350/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:00.279729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22732ff-b781-4a99-9b75-66c9654c33b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aab19cb2d1fc4447b6c6684c8c269e30, user_id=4209a1bb1fd24dcd9f2ce084f666c350, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:00.284724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22732ff-b781-4a99-9b75-66c9654c33b6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:00.334441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa3051-c299-4e30-ae65-95c3a23348f7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:00.334813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa3051-c299-4e30-ae65-95c3a23348f7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:00.335084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa3051-c299-4e30-ae65-95c3a23348f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:00.335771 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2715/5452] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:26:00 2022] PUT /identity/v3/projects/aab19cb2d1fc4447b6c6684c8c269e30/users/4209a1bb1fd24dcd9f2ce084f666c350/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:00.396618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f1fa3051-c299-4e30-ae65-95c3a23348f7 None None] MFA Rules not processed for user `4209a1bb1fd24dcd9f2ce084f666c350`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:00.397758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f1fa3051-c299-4e30-ae65-95c3a23348f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:00.540874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22732ff-b781-4a99-9b75-66c9654c33b6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:00.541440 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2738/5453] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:00.697223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22732ff-b781-4a99-9b75-66c9654c33b6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:00.727087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b77ec9-1b2b-4e54-a852-e3ebbfca9de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:00.727902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77ec9-1b2b-4e54-a852-e3ebbfca9de5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:00.728628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77ec9-1b2b-4e54-a852-e3ebbfca9de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:00.729185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6f057-2d8f-4d3c-b996-e054a71fc842 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:00.729356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77ec9-1b2b-4e54-a852-e3ebbfca9de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:00.729850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6f057-2d8f-4d3c-b996-e054a71fc842 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:00.730335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6f057-2d8f-4d3c-b996-e054a71fc842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:00.732135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b77ec9-1b2b-4e54-a852-e3ebbfca9de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:00.733657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b77ec9-1b2b-4e54-a852-e3ebbfca9de5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:00.759792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-04b6f057-2d8f-4d3c-b996-e054a71fc842 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:00.770806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-04b6f057-2d8f-4d3c-b996-e054a71fc842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:00.788833 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:00.817410 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2716/5454] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:26:00 2022] POST /identity/v3/projects => generated 387 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:26:00.824241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b77ec9-1b2b-4e54-a852-e3ebbfca9de5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:00.924169 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2739/5455] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:26:01.026891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b77ec9-1b2b-4e54-a852-e3ebbfca9de5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:01.037969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ed119-b5e6-49e1-8d81-f243aa9ac82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:01.047722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ed119-b5e6-49e1-8d81-f243aa9ac82f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:01.048473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ed119-b5e6-49e1-8d81-f243aa9ac82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:01.050397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ed119-b5e6-49e1-8d81-f243aa9ac82f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:01.051945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ed119-b5e6-49e1-8d81-f243aa9ac82f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:01.054639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ed119-b5e6-49e1-8d81-f243aa9ac82f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:01.104206 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2717/5456] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:26:00 2022] POST /identity/v3/users => generated 300 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:01.106539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6f057-2d8f-4d3c-b996-e054a71fc842 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:01.131075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6f057-2d8f-4d3c-b996-e054a71fc842 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:01.146033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f240543-ecd7-4302-9c7d-bad20dad62f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:01.147369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f240543-ecd7-4302-9c7d-bad20dad62f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:01.154490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f240543-ecd7-4302-9c7d-bad20dad62f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:01.156061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f240543-ecd7-4302-9c7d-bad20dad62f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:01.158628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f240543-ecd7-4302-9c7d-bad20dad62f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:01.162234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f240543-ecd7-4302-9c7d-bad20dad62f7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:01.187133 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2740/5457] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:01.191385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ed119-b5e6-49e1-8d81-f243aa9ac82f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:01.205506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ed119-b5e6-49e1-8d81-f243aa9ac82f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:01.230378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5826f-19d1-4ea5-b29f-a764dd538b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:01.231592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5826f-19d1-4ea5-b29f-a764dd538b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:01.232051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5826f-19d1-4ea5-b29f-a764dd538b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:01.232646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5826f-19d1-4ea5-b29f-a764dd538b1f admin admin] PATH_INFO: `/v3/projects/f544c3371e1f47d885003272ec1c62f3/users/0e372f74dd7147aab6d862fe2e9b0ea1/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:01.254358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5826f-19d1-4ea5-b29f-a764dd538b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f544c3371e1f47d885003272ec1c62f3, user_id=0e372f74dd7147aab6d862fe2e9b0ea1, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:01.257301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5826f-19d1-4ea5-b29f-a764dd538b1f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:01.290335 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2718/5458] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:26:01 2022] PUT /identity/v3/projects/f544c3371e1f47d885003272ec1c62f3/users/0e372f74dd7147aab6d862fe2e9b0ea1/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:26:01.295009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f240543-ecd7-4302-9c7d-bad20dad62f7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:01.311055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f240543-ecd7-4302-9c7d-bad20dad62f7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:01.544250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae938-a856-4cba-bcb7-b1831b8f7cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:01.544952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae938-a856-4cba-bcb7-b1831b8f7cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:01.545130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae938-a856-4cba-bcb7-b1831b8f7cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:01.545855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae938-a856-4cba-bcb7-b1831b8f7cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:01.547140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ae938-a856-4cba-bcb7-b1831b8f7cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:01.551283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ae938-a856-4cba-bcb7-b1831b8f7cf8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:01.576529 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2741/5459] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:01.577748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5826f-19d1-4ea5-b29f-a764dd538b1f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:01.592974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5826f-19d1-4ea5-b29f-a764dd538b1f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:01.602396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261629ef-38b5-4617-8ec4-e5e476e57e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:01.603105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261629ef-38b5-4617-8ec4-e5e476e57e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:01.604164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261629ef-38b5-4617-8ec4-e5e476e57e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:01.605445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261629ef-38b5-4617-8ec4-e5e476e57e5f admin admin] PATH_INFO: `/v3/projects/f544c3371e1f47d885003272ec1c62f3/users/0e372f74dd7147aab6d862fe2e9b0ea1/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:01.610738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261629ef-38b5-4617-8ec4-e5e476e57e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f544c3371e1f47d885003272ec1c62f3, user_id=0e372f74dd7147aab6d862fe2e9b0ea1, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:01.616285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261629ef-38b5-4617-8ec4-e5e476e57e5f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:01.624014 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:01.634758 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2719/5460] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:26:01 2022] PUT /identity/v3/projects/f544c3371e1f47d885003272ec1c62f3/users/0e372f74dd7147aab6d862fe2e9b0ea1/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:01.645395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650d24-3060-4d9f-87be-0a4d946e59ab None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:01.645733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650d24-3060-4d9f-87be-0a4d946e59ab None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:01.646021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650d24-3060-4d9f-87be-0a4d946e59ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:01.691469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3a650d24-3060-4d9f-87be-0a4d946e59ab None None] MFA Rules not processed for user `0e372f74dd7147aab6d862fe2e9b0ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:01.693025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3a650d24-3060-4d9f-87be-0a4d946e59ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:01.822314 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2742/5461] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:01.837207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261629ef-38b5-4617-8ec4-e5e476e57e5f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:01.839985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-261629ef-38b5-4617-8ec4-e5e476e57e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:01.994515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261629ef-38b5-4617-8ec4-e5e476e57e5f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:01.999665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a6cd0-6e04-49a9-b001-0fa3c9188ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:02.001137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a6cd0-6e04-49a9-b001-0fa3c9188ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:02.002037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a6cd0-6e04-49a9-b001-0fa3c9188ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:02.002513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a6cd0-6e04-49a9-b001-0fa3c9188ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:02.016135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a6cd0-6e04-49a9-b001-0fa3c9188ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:02.018550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a6cd0-6e04-49a9-b001-0fa3c9188ba5 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:02.036335 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2720/5462] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:02.267930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a650d24-3060-4d9f-87be-0a4d946e59ab None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:02.343666 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:02.382651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a650d24-3060-4d9f-87be-0a4d946e59ab None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:02.388068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5405f-d4b4-40df-9bf9-4b21fb2de6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:02.388895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5405f-d4b4-40df-9bf9-4b21fb2de6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:02.389353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5405f-d4b4-40df-9bf9-4b21fb2de6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:02.389835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5405f-d4b4-40df-9bf9-4b21fb2de6cd admin admin] PATH_INFO: `/v3/users/4209a1bb1fd24dcd9f2ce084f666c350` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:02.391405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5405f-d4b4-40df-9bf9-4b21fb2de6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4209a1bb1fd24dcd9f2ce084f666c350)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:02.395342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5405f-d4b4-40df-9bf9-4b21fb2de6cd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:02.455113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787228-aabf-4ceb-9be6-d2c4d6b1c3b9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:02.455820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787228-aabf-4ceb-9be6-d2c4d6b1c3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:02.455820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787228-aabf-4ceb-9be6-d2c4d6b1c3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:02.489782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-17787228-aabf-4ceb-9be6-d2c4d6b1c3b9 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:02.492851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-17787228-aabf-4ceb-9be6-d2c4d6b1c3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:02.500964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dcd5405f-d4b4-40df-9bf9-4b21fb2de6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4209a1bb1fd24dcd9f2ce084f666c350'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:02.527443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dcd5405f-d4b4-40df-9bf9-4b21fb2de6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4209a1bb1fd24dcd9f2ce084f666c350'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:02.528430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dcd5405f-d4b4-40df-9bf9-4b21fb2de6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4209a1bb1fd24dcd9f2ce084f666c350'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:02.551765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dcd5405f-d4b4-40df-9bf9-4b21fb2de6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4209a1bb1fd24dcd9f2ce084f666c350'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:02.553131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dcd5405f-d4b4-40df-9bf9-4b21fb2de6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4209a1bb1fd24dcd9f2ce084f666c350'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:02.590352 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2743/5463] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:26:02 2022] DELETE /identity/v3/users/4209a1bb1fd24dcd9f2ce084f666c350 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:02.594678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c86e3-cf1b-40c5-86e7-33954e8e3a5b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:02.595688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c86e3-cf1b-40c5-86e7-33954e8e3a5b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:02.596188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c86e3-cf1b-40c5-86e7-33954e8e3a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:02.629355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d38c86e3-cf1b-40c5-86e7-33954e8e3a5b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:02.631170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d38c86e3-cf1b-40c5-86e7-33954e8e3a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:02.660982 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2721/5464] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:02.768786 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2744/5465] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:02.824580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17787228-aabf-4ceb-9be6-d2c4d6b1c3b9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:02.826577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-17787228-aabf-4ceb-9be6-d2c4d6b1c3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:02.946312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17787228-aabf-4ceb-9be6-d2c4d6b1c3b9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:03.082218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35687e42-ea08-4675-8a97-506cd1a2be2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:03.082996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35687e42-ea08-4675-8a97-506cd1a2be2b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:03.083349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35687e42-ea08-4675-8a97-506cd1a2be2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:03.084450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35687e42-ea08-4675-8a97-506cd1a2be2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:03.103783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35687e42-ea08-4675-8a97-506cd1a2be2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:03.106149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35687e42-ea08-4675-8a97-506cd1a2be2b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:03.142853 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2722/5466] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:03.699458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808978b-ca67-4324-ae36-1253724ef8ac None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:03.699458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808978b-ca67-4324-ae36-1253724ef8ac None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:03.700044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808978b-ca67-4324-ae36-1253724ef8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:03.766926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e808978b-ca67-4324-ae36-1253724ef8ac None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:03.769290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e808978b-ca67-4324-ae36-1253724ef8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:03.884122 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:03.898817 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2745/5467] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:05.150349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35687e42-ea08-4675-8a97-506cd1a2be2b service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:05.153775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-35687e42-ea08-4675-8a97-506cd1a2be2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:05.171018 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:05.188036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35687e42-ea08-4675-8a97-506cd1a2be2b service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:05.205932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:05.208214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:05.210320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:05.210751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] PATH_INFO: `/v3/projects/aab19cb2d1fc4447b6c6684c8c269e30` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:05.213276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] RBAC: Authorizing `identity:delete_project(project_id=aab19cb2d1fc4447b6c6684c8c269e30)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:05.223093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:05.367501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aab19cb2d1fc4447b6c6684c8c269e30', 'request_id': 'req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:05.384573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aab19cb2d1fc4447b6c6684c8c269e30', 'request_id': 'req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:05.413136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aab19cb2d1fc4447b6c6684c8c269e30', 'request_id': 'req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:05.466996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] The token cache is being invalidate because project aab19cb2d1fc4447b6c6684c8c269e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:26:05.467604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:05.476257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a13f5fa-3b3a-4b1f-b8b7-34c72bf289be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:05.482740 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2723/5468] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:26:05 2022] DELETE /identity/v3/projects/aab19cb2d1fc4447b6c6684c8c269e30 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:05.483695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808978b-ca67-4324-ae36-1253724ef8ac None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:05.499081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bdc05-f764-460c-91f5-f3d306f04005 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:05.499445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bdc05-f764-460c-91f5-f3d306f04005 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:05.499630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bdc05-f764-460c-91f5-f3d306f04005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:05.503007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808978b-ca67-4324-ae36-1253724ef8ac None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:05.527000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e30bdc05-f764-460c-91f5-f3d306f04005 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:05.528384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e30bdc05-f764-460c-91f5-f3d306f04005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:05.593462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:05.594567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:05.595923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:05.596552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] PATH_INFO: `/v3/users/0e372f74dd7147aab6d862fe2e9b0ea1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:05.598128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e372f74dd7147aab6d862fe2e9b0ea1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:05.600446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:05.638812 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2724/5469] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:05.707540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e372f74dd7147aab6d862fe2e9b0ea1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:05.740705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e372f74dd7147aab6d862fe2e9b0ea1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:05.742107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e372f74dd7147aab6d862fe2e9b0ea1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:05.760339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e372f74dd7147aab6d862fe2e9b0ea1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:05.761255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e372f74dd7147aab6d862fe2e9b0ea1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:05.795332 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2746/5470] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:26:05 2022] DELETE /identity/v3/users/0e372f74dd7147aab6d862fe2e9b0ea1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:26:07.055208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dc18e-b5c8-44ba-901d-24bdf2e0151d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:07.056123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dc18e-b5c8-44ba-901d-24bdf2e0151d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:07.056123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dc18e-b5c8-44ba-901d-24bdf2e0151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:07.083107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b33dc18e-b5c8-44ba-901d-24bdf2e0151d None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:07.084720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b33dc18e-b5c8-44ba-901d-24bdf2e0151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:07.227775 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2725/5471] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:07.320092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:07.321721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:07.485215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc971e1-6b93-40e1-bc3d-a4da8ed94587 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:07.485547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc971e1-6b93-40e1-bc3d-a4da8ed94587 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:07.486453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc971e1-6b93-40e1-bc3d-a4da8ed94587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:07.499484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44035742-99b6-432b-b6d9-732bd8626f11 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:07.512519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:07.513614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:07.514221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:07.514743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] PATH_INFO: `/v3/projects/f544c3371e1f47d885003272ec1c62f3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:07.517556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f544c3371e1f47d885003272ec1c62f3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:07.524071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:07.551703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-adc971e1-6b93-40e1-bc3d-a4da8ed94587 None None] MFA Rules not processed for user `116490a90023449a83265db52a0debb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:07.559187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-adc971e1-6b93-40e1-bc3d-a4da8ed94587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:07.590943 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:07.628968 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:07.644694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f544c3371e1f47d885003272ec1c62f3', 'request_id': 'req-2326d3bd-ceb3-49cf-b975-83609b4d1d59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:07.660477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f544c3371e1f47d885003272ec1c62f3', 'request_id': 'req-2326d3bd-ceb3-49cf-b975-83609b4d1d59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:07.675295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f544c3371e1f47d885003272ec1c62f3', 'request_id': 'req-2326d3bd-ceb3-49cf-b975-83609b4d1d59'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:07.704544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] The token cache is being invalidate because project f544c3371e1f47d885003272ec1c62f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:26:07.705284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:07.707119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2326d3bd-ceb3-49cf-b975-83609b4d1d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:07.711231 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2747/5472] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:26:07 2022] DELETE /identity/v3/projects/f544c3371e1f47d885003272ec1c62f3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:07.716022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f262e-ad3c-4478-b8d7-c68072248180 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:07.716310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f262e-ad3c-4478-b8d7-c68072248180 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:07.716590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f262e-ad3c-4478-b8d7-c68072248180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:07.743787 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2726/5473] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:07.752639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-720f262e-ad3c-4478-b8d7-c68072248180 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:07.754340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-720f262e-ad3c-4478-b8d7-c68072248180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:07.755681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc971e1-6b93-40e1-bc3d-a4da8ed94587 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:07.757973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-adc971e1-6b93-40e1-bc3d-a4da8ed94587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:07.968583 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2748/5474] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:07.978417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacc6a2-f55b-4305-b1cf-57502fba319f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:07.978736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacc6a2-f55b-4305-b1cf-57502fba319f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:07.979014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacc6a2-f55b-4305-b1cf-57502fba319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:07.990729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc971e1-6b93-40e1-bc3d-a4da8ed94587 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:08.011092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bbacc6a2-f55b-4305-b1cf-57502fba319f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:08.015368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bbacc6a2-f55b-4305-b1cf-57502fba319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:08.074083 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2749/5475] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:08.079957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacc6a2-f55b-4305-b1cf-57502fba319f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:08.137357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacc6a2-f55b-4305-b1cf-57502fba319f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:08.144949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ff210-ded5-484a-9da1-56f858bcde51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:08.145688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ff210-ded5-484a-9da1-56f858bcde51 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:08.145974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ff210-ded5-484a-9da1-56f858bcde51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:08.146250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ff210-ded5-484a-9da1-56f858bcde51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:08.146990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ff210-ded5-484a-9da1-56f858bcde51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:26:08.161154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ff210-ded5-484a-9da1-56f858bcde51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:08.165304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ff210-ded5-484a-9da1-56f858bcde51 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:08.188320 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2750/5476] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:26:08.201991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ff210-ded5-484a-9da1-56f858bcde51 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:08.236751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ff210-ded5-484a-9da1-56f858bcde51 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:08.255621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f32b7e-8491-456e-9bdc-348b0f2a4e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:08.256731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f32b7e-8491-456e-9bdc-348b0f2a4e9a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:08.258241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f32b7e-8491-456e-9bdc-348b0f2a4e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:08.258876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f32b7e-8491-456e-9bdc-348b0f2a4e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:08.260878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f32b7e-8491-456e-9bdc-348b0f2a4e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:08.264423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f32b7e-8491-456e-9bdc-348b0f2a4e9a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:08.271852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108b88b-3556-49aa-8d91-819f07114a2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:08.272418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108b88b-3556-49aa-8d91-819f07114a2c service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:08.272679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108b88b-3556-49aa-8d91-819f07114a2c service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:08.272954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108b88b-3556-49aa-8d91-819f07114a2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:08.286083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d108b88b-3556-49aa-8d91-819f07114a2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:08.327231 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2751/5477] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:26:08 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:26:08.334678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f32b7e-8491-456e-9bdc-348b0f2a4e9a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:08.418396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108b88b-3556-49aa-8d91-819f07114a2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:08.421546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108b88b-3556-49aa-8d91-819f07114a2c service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:08.428723 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:08.437746 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2727/5478] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:08.490460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f32b7e-8491-456e-9bdc-348b0f2a4e9a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:08.507027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d86fe-5d18-486c-819d-a793099eb21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:08.507823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d86fe-5d18-486c-819d-a793099eb21f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:08.508208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d86fe-5d18-486c-819d-a793099eb21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:08.508589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d86fe-5d18-486c-819d-a793099eb21f admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:08.509361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d86fe-5d18-486c-819d-a793099eb21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:08.511502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d86fe-5d18-486c-819d-a793099eb21f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:08.551132 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:08.560387 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2752/5479] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:26:08 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:08.565509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108b88b-3556-49aa-8d91-819f07114a2c service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:08.582873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108b88b-3556-49aa-8d91-819f07114a2c service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:08.596178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5d2cf-263e-45ae-8d7e-bb74b11fabcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:08.597969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5d2cf-263e-45ae-8d7e-bb74b11fabcd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:08.597969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5d2cf-263e-45ae-8d7e-bb74b11fabcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:08.597969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5d2cf-263e-45ae-8d7e-bb74b11fabcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:08.599185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5d2cf-263e-45ae-8d7e-bb74b11fabcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:08.605040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5d2cf-263e-45ae-8d7e-bb74b11fabcd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:08.630845 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2728/5480] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:08.634955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d86fe-5d18-486c-819d-a793099eb21f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:08.650628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d86fe-5d18-486c-819d-a793099eb21f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:08.664583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e093126-c0f8-4531-a208-c7e6e48ec7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:08.665329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093126-c0f8-4531-a208-c7e6e48ec7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:08.665726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093126-c0f8-4531-a208-c7e6e48ec7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:08.666100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093126-c0f8-4531-a208-c7e6e48ec7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:08.666881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e093126-c0f8-4531-a208-c7e6e48ec7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:08.670229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e093126-c0f8-4531-a208-c7e6e48ec7d5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:08.694960 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2753/5481] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:08.698871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5d2cf-263e-45ae-8d7e-bb74b11fabcd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:08.713504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5d2cf-263e-45ae-8d7e-bb74b11fabcd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:08.730982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e04ea-241e-4fd2-b2d0-0e6e6125ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:08.731831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e04ea-241e-4fd2-b2d0-0e6e6125ed89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:08.732223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e04ea-241e-4fd2-b2d0-0e6e6125ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:08.732608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e04ea-241e-4fd2-b2d0-0e6e6125ed89 admin admin] PATH_INFO: `/v3/projects/fe9cebc57da14c23979162d3aab9d4de/users/a8e9ef92ec7f49efa3f3edf5fa780694/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:08.762694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e04ea-241e-4fd2-b2d0-0e6e6125ed89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9cebc57da14c23979162d3aab9d4de, user_id=a8e9ef92ec7f49efa3f3edf5fa780694, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:08.766759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e04ea-241e-4fd2-b2d0-0e6e6125ed89 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:08.789576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e093126-c0f8-4531-a208-c7e6e48ec7d5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:08.792159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3e093126-c0f8-4531-a208-c7e6e48ec7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:08.840755 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2729/5482] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:26:08 2022] PUT /identity/v3/projects/fe9cebc57da14c23979162d3aab9d4de/users/a8e9ef92ec7f49efa3f3edf5fa780694/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:08.841896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e093126-c0f8-4531-a208-c7e6e48ec7d5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:08.858006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cf7a5-23a8-4fe2-a43c-2a949172ed3c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:08.859956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cf7a5-23a8-4fe2-a43c-2a949172ed3c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:08.861277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cf7a5-23a8-4fe2-a43c-2a949172ed3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:08.945762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-111cf7a5-23a8-4fe2-a43c-2a949172ed3c None None] MFA Rules not processed for user `a8e9ef92ec7f49efa3f3edf5fa780694`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:08.948634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-111cf7a5-23a8-4fe2-a43c-2a949172ed3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:09.020194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:09.021067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:09.021199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:09.021484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] PATH_INFO: `/v3/users/26e4e60bc26a4d229a85c9990e1730a5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:09.022569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e4e60bc26a4d229a85c9990e1730a5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:09.024807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:09.129072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e4e60bc26a4d229a85c9990e1730a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:09.146283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e4e60bc26a4d229a85c9990e1730a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:09.147436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e4e60bc26a4d229a85c9990e1730a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:09.153946 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2730/5483] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:26:09.157006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418668b7-1d64-497c-a1b2-ca0f83e2bd63 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:09.158848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418668b7-1d64-497c-a1b2-ca0f83e2bd63 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:09.160036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418668b7-1d64-497c-a1b2-ca0f83e2bd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:09.166007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e4e60bc26a4d229a85c9990e1730a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:09.166007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e4e60bc26a4d229a85c9990e1730a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:09.201643 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2754/5484] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:26:08 2022] DELETE /identity/v3/users/26e4e60bc26a4d229a85c9990e1730a5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:09.202534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:09.204253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:09.214616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-418668b7-1d64-497c-a1b2-ca0f83e2bd63 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:09.216106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-418668b7-1d64-497c-a1b2-ca0f83e2bd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:09.347511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7542-b10a-4cf2-8767-e06dae269bc9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:09.361010 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2731/5485] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:09.377566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae25ca7-2cde-403b-bf81-0aa7cf93991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:09.378364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae25ca7-2cde-403b-bf81-0aa7cf93991d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:09.378782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae25ca7-2cde-403b-bf81-0aa7cf93991d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:09.381449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae25ca7-2cde-403b-bf81-0aa7cf93991d admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:09.382411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae25ca7-2cde-403b-bf81-0aa7cf93991d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:09.384696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae25ca7-2cde-403b-bf81-0aa7cf93991d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:09.416368 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:09.448146 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2755/5486] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:26:09 2022] POST /identity/v3/projects => generated 379 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:09.449389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418668b7-1d64-497c-a1b2-ca0f83e2bd63 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:09.465248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418668b7-1d64-497c-a1b2-ca0f83e2bd63 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:09.590883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d751b-0c49-431d-9140-aa20bd92200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:09.592099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d751b-0c49-431d-9140-aa20bd92200d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:09.592665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d751b-0c49-431d-9140-aa20bd92200d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:09.593101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d751b-0c49-431d-9140-aa20bd92200d admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:09.594129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d751b-0c49-431d-9140-aa20bd92200d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:09.597612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d751b-0c49-431d-9140-aa20bd92200d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:09.611884 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:09.637210 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2732/5487] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:26:09 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:09.640624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae25ca7-2cde-403b-bf81-0aa7cf93991d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:09.658748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae25ca7-2cde-403b-bf81-0aa7cf93991d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:09.666021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed41e64-86b1-4e28-93a5-eebbace91fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:09.667190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed41e64-86b1-4e28-93a5-eebbace91fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:09.667633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed41e64-86b1-4e28-93a5-eebbace91fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:09.668341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed41e64-86b1-4e28-93a5-eebbace91fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:09.669411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed41e64-86b1-4e28-93a5-eebbace91fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:09.673899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed41e64-86b1-4e28-93a5-eebbace91fcd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:09.690381 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2756/5488] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:26:09.694970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d751b-0c49-431d-9140-aa20bd92200d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:09.712671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d751b-0c49-431d-9140-aa20bd92200d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:09.722643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938a1c6-38a3-4438-ae0c-4d28bc47c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:09.723519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a1c6-38a3-4438-ae0c-4d28bc47c371 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:09.723791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a1c6-38a3-4438-ae0c-4d28bc47c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:09.724080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a1c6-38a3-4438-ae0c-4d28bc47c371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:09.725299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938a1c6-38a3-4438-ae0c-4d28bc47c371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:09.727172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938a1c6-38a3-4438-ae0c-4d28bc47c371 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:09.747371 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2733/5489] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:09.748984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed41e64-86b1-4e28-93a5-eebbace91fcd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:09.770895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed41e64-86b1-4e28-93a5-eebbace91fcd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:09.781639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711f691-c5e8-4913-a6cd-386ea9aa172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:09.782104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711f691-c5e8-4913-a6cd-386ea9aa172f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:09.786436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711f691-c5e8-4913-a6cd-386ea9aa172f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:09.786436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711f691-c5e8-4913-a6cd-386ea9aa172f admin admin] PATH_INFO: `/v3/projects/3e6afd25060142c4a51393f365b28e12/users/54f0216a3f4947739af965101b1c6619/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:09.808885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938a1c6-38a3-4438-ae0c-4d28bc47c371 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:09.812318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0938a1c6-38a3-4438-ae0c-4d28bc47c371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:09.852584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711f691-c5e8-4913-a6cd-386ea9aa172f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6afd25060142c4a51393f365b28e12, user_id=54f0216a3f4947739af965101b1c6619, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:09.855629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711f691-c5e8-4913-a6cd-386ea9aa172f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:09.864230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938a1c6-38a3-4438-ae0c-4d28bc47c371 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:09.883500 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2757/5490] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:26:09 2022] PUT /identity/v3/projects/3e6afd25060142c4a51393f365b28e12/users/54f0216a3f4947739af965101b1c6619/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:26:09.895351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:09.895859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:09.896151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:09.896433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] PATH_INFO: `/v3/projects/084a8da705e0434e8a008ffdd019f6e8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:09.897614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6bfc3-9035-43e3-8138-035bd69369ea None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:09.899093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6bfc3-9035-43e3-8138-035bd69369ea None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:09.899417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=084a8da705e0434e8a008ffdd019f6e8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:09.899579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6bfc3-9035-43e3-8138-035bd69369ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:09.901451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:09.995331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d7b6bfc3-9035-43e3-8138-035bd69369ea None None] MFA Rules not processed for user `54f0216a3f4947739af965101b1c6619`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:09.996740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d7b6bfc3-9035-43e3-8138-035bd69369ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:10.067725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084a8da705e0434e8a008ffdd019f6e8', 'request_id': 'req-8e206a72-a260-4e01-a6e4-f31ba984ad88'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:10.085130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084a8da705e0434e8a008ffdd019f6e8', 'request_id': 'req-8e206a72-a260-4e01-a6e4-f31ba984ad88'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:10.096703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084a8da705e0434e8a008ffdd019f6e8', 'request_id': 'req-8e206a72-a260-4e01-a6e4-f31ba984ad88'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:10.123361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] The token cache is being invalidate because project 084a8da705e0434e8a008ffdd019f6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:26:10.123816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:10.127383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e206a72-a260-4e01-a6e4-f31ba984ad88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:10.129292 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2734/5491] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:26:09 2022] DELETE /identity/v3/projects/084a8da705e0434e8a008ffdd019f6e8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:10.134405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0d36b-6679-4caf-974d-2a92cc6133a1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:10.134837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0d36b-6679-4caf-974d-2a92cc6133a1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:10.135215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0d36b-6679-4caf-974d-2a92cc6133a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:10.184436 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2758/5492] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:26:10.190647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6bfc3-9035-43e3-8138-035bd69369ea None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:10.193331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d7b6bfc3-9035-43e3-8138-035bd69369ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:10.202032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-95c0d36b-6679-4caf-974d-2a92cc6133a1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:10.203221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-95c0d36b-6679-4caf-974d-2a92cc6133a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:10.341850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6bfc3-9035-43e3-8138-035bd69369ea None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:10.361787 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2735/5493] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:10.369254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeca6cd-c5c1-43be-aa08-9b9a543cdb4e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:10.369544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeca6cd-c5c1-43be-aa08-9b9a543cdb4e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:10.369820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeca6cd-c5c1-43be-aa08-9b9a543cdb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:10.416893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cdeca6cd-c5c1-43be-aa08-9b9a543cdb4e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:10.418149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cdeca6cd-c5c1-43be-aa08-9b9a543cdb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:10.429117 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2736/5494] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:10.441614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeca6cd-c5c1-43be-aa08-9b9a543cdb4e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:10.484957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeca6cd-c5c1-43be-aa08-9b9a543cdb4e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:10.501251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f432ab-8f82-4ac8-b0b6-fdfe99fa6521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:10.502676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f432ab-8f82-4ac8-b0b6-fdfe99fa6521 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:10.503063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f432ab-8f82-4ac8-b0b6-fdfe99fa6521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:10.504190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f432ab-8f82-4ac8-b0b6-fdfe99fa6521 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:10.506265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f432ab-8f82-4ac8-b0b6-fdfe99fa6521 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:26:10.506862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f432ab-8f82-4ac8-b0b6-fdfe99fa6521 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:10.510891 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:10.512690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f432ab-8f82-4ac8-b0b6-fdfe99fa6521 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:10.534088 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2737/5495] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:26:10.539131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218361d-95c4-4290-8d47-b85432defff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:10.539759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218361d-95c4-4290-8d47-b85432defff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:10.540049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218361d-95c4-4290-8d47-b85432defff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:10.540187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f432ab-8f82-4ac8-b0b6-fdfe99fa6521 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:10.540320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218361d-95c4-4290-8d47-b85432defff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:10.541150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218361d-95c4-4290-8d47-b85432defff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:10.543292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218361d-95c4-4290-8d47-b85432defff8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:10.561736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f432ab-8f82-4ac8-b0b6-fdfe99fa6521 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:10.575549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5691e98-7257-4251-bd52-861b6737b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:10.576276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691e98-7257-4251-bd52-861b6737b51f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:10.576634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691e98-7257-4251-bd52-861b6737b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:10.577154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691e98-7257-4251-bd52-861b6737b51f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:10.578020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5691e98-7257-4251-bd52-861b6737b51f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:10.585112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5691e98-7257-4251-bd52-861b6737b51f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:10.629817 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2738/5496] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:26:10 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:10.631122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5691e98-7257-4251-bd52-861b6737b51f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:10.656074 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2759/5497] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:26:10 2022] POST /identity/v3/projects => generated 377 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:10.656984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218361d-95c4-4290-8d47-b85432defff8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:10.675632 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:10.785854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218361d-95c4-4290-8d47-b85432defff8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:10.792462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833a385-e6dd-4ae7-bab1-80290696e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:10.793405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833a385-e6dd-4ae7-bab1-80290696e01c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:10.793908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833a385-e6dd-4ae7-bab1-80290696e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:10.794405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833a385-e6dd-4ae7-bab1-80290696e01c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:10.795384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833a385-e6dd-4ae7-bab1-80290696e01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:10.797836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833a385-e6dd-4ae7-bab1-80290696e01c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:10.809496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5691e98-7257-4251-bd52-861b6737b51f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:10.824172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8b1bb-6145-4f37-95c5-2d88cd2964f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:10.825021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8b1bb-6145-4f37-95c5-2d88cd2964f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:10.825413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8b1bb-6145-4f37-95c5-2d88cd2964f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:10.825797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8b1bb-6145-4f37-95c5-2d88cd2964f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:10.827058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8b1bb-6145-4f37-95c5-2d88cd2964f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:10.829366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8b1bb-6145-4f37-95c5-2d88cd2964f2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:10.870805 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2739/5498] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:26:10 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:10.870805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8b1bb-6145-4f37-95c5-2d88cd2964f2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:10.872669 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2760/5499] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:26:10 2022] POST /identity/v3/users => generated 295 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:10.879764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8b1bb-6145-4f37-95c5-2d88cd2964f2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:10.880989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833a385-e6dd-4ae7-bab1-80290696e01c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:10.888187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc97215-0401-4803-8a17-cf04e48259c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:10.889292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc97215-0401-4803-8a17-cf04e48259c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:10.889682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc97215-0401-4803-8a17-cf04e48259c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:10.890063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc97215-0401-4803-8a17-cf04e48259c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:10.890867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc97215-0401-4803-8a17-cf04e48259c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:10.892892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc97215-0401-4803-8a17-cf04e48259c2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:10.912808 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2740/5500] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:10.914176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc97215-0401-4803-8a17-cf04e48259c2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:10.916504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833a385-e6dd-4ae7-bab1-80290696e01c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:10.935208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc97215-0401-4803-8a17-cf04e48259c2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:10.941179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739950-5ece-493f-b3eb-521adf7c4eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:10.941813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739950-5ece-493f-b3eb-521adf7c4eab admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:10.942099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739950-5ece-493f-b3eb-521adf7c4eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:10.942377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739950-5ece-493f-b3eb-521adf7c4eab admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:10.943075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e739950-5ece-493f-b3eb-521adf7c4eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:10.943223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afc7b5-b40a-4dd0-a673-a541083ad297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:10.944294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afc7b5-b40a-4dd0-a673-a541083ad297 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:10.944812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afc7b5-b40a-4dd0-a673-a541083ad297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:10.944936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e739950-5ece-493f-b3eb-521adf7c4eab admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:10.945447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afc7b5-b40a-4dd0-a673-a541083ad297 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:10.946706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afc7b5-b40a-4dd0-a673-a541083ad297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:10.948739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afc7b5-b40a-4dd0-a673-a541083ad297 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:10.964505 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2741/5501] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:10.973121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afc7b5-b40a-4dd0-a673-a541083ad297 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:10.987392 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2761/5502] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:10.992426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739950-5ece-493f-b3eb-521adf7c4eab admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:10.998982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afc7b5-b40a-4dd0-a673-a541083ad297 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:11.004471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf5cb2-3088-41a0-9ea5-aa6be4fa85f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:11.005138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf5cb2-3088-41a0-9ea5-aa6be4fa85f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:11.005516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf5cb2-3088-41a0-9ea5-aa6be4fa85f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:11.005799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf5cb2-3088-41a0-9ea5-aa6be4fa85f7 admin admin] PATH_INFO: `/v3/projects/08b504dc949d418fb27c4149a55f669e/users/b2ffde89d3704dd68bdb30ac4ad3ff53/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:11.014102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739950-5ece-493f-b3eb-521adf7c4eab admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:11.027036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f17787-885f-4a1f-bbe2-169686140e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:11.029444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f17787-885f-4a1f-bbe2-169686140e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:11.029444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f17787-885f-4a1f-bbe2-169686140e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:11.029715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f17787-885f-4a1f-bbe2-169686140e19 admin admin] PATH_INFO: `/v3/projects/3f3f41034b21462cb2df7800330b60fa/users/0a19cd1c53164432a603f248ea87879a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:11.036964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf5cb2-3088-41a0-9ea5-aa6be4fa85f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b504dc949d418fb27c4149a55f669e, user_id=b2ffde89d3704dd68bdb30ac4ad3ff53, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:11.041216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf5cb2-3088-41a0-9ea5-aa6be4fa85f7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:11.075943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f17787-885f-4a1f-bbe2-169686140e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3f41034b21462cb2df7800330b60fa, user_id=0a19cd1c53164432a603f248ea87879a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:11.078961 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2742/5503] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:26:10 2022] PUT /identity/v3/projects/08b504dc949d418fb27c4149a55f669e/users/b2ffde89d3704dd68bdb30ac4ad3ff53/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:11.082086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f17787-885f-4a1f-bbe2-169686140e19 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:11.090130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabadb8-ee03-4475-aa4c-5d6e02570126 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:11.090414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabadb8-ee03-4475-aa4c-5d6e02570126 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:11.090706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabadb8-ee03-4475-aa4c-5d6e02570126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:11.128809 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2762/5504] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:26:10 2022] PUT /identity/v3/projects/3f3f41034b21462cb2df7800330b60fa/users/0a19cd1c53164432a603f248ea87879a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:11.129995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f17787-885f-4a1f-bbe2-169686140e19 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:11.167847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8cabadb8-ee03-4475-aa4c-5d6e02570126 None None] MFA Rules not processed for user `b2ffde89d3704dd68bdb30ac4ad3ff53`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:11.183565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8cabadb8-ee03-4475-aa4c-5d6e02570126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:11.309951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f17787-885f-4a1f-bbe2-169686140e19 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:11.330934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8637d3-a5ba-402d-a948-fe9392e8d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:11.331528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8637d3-a5ba-402d-a948-fe9392e8d0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:11.331817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8637d3-a5ba-402d-a948-fe9392e8d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:11.332095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8637d3-a5ba-402d-a948-fe9392e8d0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:11.332780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8637d3-a5ba-402d-a948-fe9392e8d0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:11.338423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8637d3-a5ba-402d-a948-fe9392e8d0f2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:11.351443 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2743/5505] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:26:11.352716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69096895-ac0a-42b8-86df-f3588c906f6d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:11.353006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69096895-ac0a-42b8-86df-f3588c906f6d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:11.353284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69096895-ac0a-42b8-86df-f3588c906f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:11.362772 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2763/5506] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:11.364220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849fe10-5d60-4803-857b-99a10d542d4d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:11.365159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849fe10-5d60-4803-857b-99a10d542d4d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:11.365159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849fe10-5d60-4803-857b-99a10d542d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:11.385022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-69096895-ac0a-42b8-86df-f3588c906f6d None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:11.386445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-69096895-ac0a-42b8-86df-f3588c906f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:11.386638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e849fe10-5d60-4803-857b-99a10d542d4d None None] MFA Rules not processed for user `b2ffde89d3704dd68bdb30ac4ad3ff53`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:11.388406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e849fe10-5d60-4803-857b-99a10d542d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:11.403473 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2764/5507] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:11.404751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849fe10-5d60-4803-857b-99a10d542d4d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:11.449832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849fe10-5d60-4803-857b-99a10d542d4d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:11.463479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52edc2-b7ef-4ed9-8ca7-204482c2fa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:11.464183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52edc2-b7ef-4ed9-8ca7-204482c2fa99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:11.464470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52edc2-b7ef-4ed9-8ca7-204482c2fa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:11.464747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52edc2-b7ef-4ed9-8ca7-204482c2fa99 admin admin] PATH_INFO: `/v3/projects/3f3f41034b21462cb2df7800330b60fa/users/0a19cd1c53164432a603f248ea87879a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:11.468253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52edc2-b7ef-4ed9-8ca7-204482c2fa99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3f41034b21462cb2df7800330b60fa, user_id=0a19cd1c53164432a603f248ea87879a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:11.477358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52edc2-b7ef-4ed9-8ca7-204482c2fa99 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:11.485574 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:11.511679 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2744/5508] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:11.512832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69096895-ac0a-42b8-86df-f3588c906f6d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:11.513503 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2765/5509] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:26:11 2022] PUT /identity/v3/projects/3f3f41034b21462cb2df7800330b60fa/users/0a19cd1c53164432a603f248ea87879a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:11.515469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-69096895-ac0a-42b8-86df-f3588c906f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:11.523693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376033cb-3908-463c-9e13-e0c733a69c99 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:11.524001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376033cb-3908-463c-9e13-e0c733a69c99 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:11.524254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376033cb-3908-463c-9e13-e0c733a69c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:11.559808 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:11.572806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-376033cb-3908-463c-9e13-e0c733a69c99 None None] MFA Rules not processed for user `0a19cd1c53164432a603f248ea87879a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:11.576600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-376033cb-3908-463c-9e13-e0c733a69c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:11.728566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69096895-ac0a-42b8-86df-f3588c906f6d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:11.749674 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2766/5510] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:26:11.761812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376033cb-3908-463c-9e13-e0c733a69c99 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:11.763234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-376033cb-3908-463c-9e13-e0c733a69c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:11.936294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c55276-93fa-41d2-a793-e6b773567028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:11.940326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c55276-93fa-41d2-a793-e6b773567028 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:11.940839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c55276-93fa-41d2-a793-e6b773567028 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:11.941215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c55276-93fa-41d2-a793-e6b773567028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:11.978339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376033cb-3908-463c-9e13-e0c733a69c99 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:11.988249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83854903-d846-4c17-929d-8e941846ab8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:11.988249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83854903-d846-4c17-929d-8e941846ab8d service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:11.988590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83854903-d846-4c17-929d-8e941846ab8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:11.988686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83854903-d846-4c17-929d-8e941846ab8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:12.024545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83854903-d846-4c17-929d-8e941846ab8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:12.026009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83854903-d846-4c17-929d-8e941846ab8d service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:12.042686 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2767/5511] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:26:12.140212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c55276-93fa-41d2-a793-e6b773567028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:12.151398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c55276-93fa-41d2-a793-e6b773567028 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:12.205248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83854903-d846-4c17-929d-8e941846ab8d service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:12.219307 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2745/5512] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:12.239758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83854903-d846-4c17-929d-8e941846ab8d service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:12.254468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24843d85-3ce0-4b21-a0a3-3e90358d4b6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:12.255416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24843d85-3ce0-4b21-a0a3-3e90358d4b6a service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:12.255887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24843d85-3ce0-4b21-a0a3-3e90358d4b6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:12.256327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24843d85-3ce0-4b21-a0a3-3e90358d4b6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:12.265040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-24843d85-3ce0-4b21-a0a3-3e90358d4b6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:12.472474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24843d85-3ce0-4b21-a0a3-3e90358d4b6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:12.475270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24843d85-3ce0-4b21-a0a3-3e90358d4b6a service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:12.507259 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2768/5513] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:26:12.878341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b035-3db3-4c3d-8aac-e4869501f213 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:12.879479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b035-3db3-4c3d-8aac-e4869501f213 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:12.880652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b035-3db3-4c3d-8aac-e4869501f213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:12.922036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6587b035-3db3-4c3d-8aac-e4869501f213 None None] MFA Rules not processed for user `116490a90023449a83265db52a0debb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:12.924058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6587b035-3db3-4c3d-8aac-e4869501f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:13.049629 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:13.130410 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2746/5514] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:13.180878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541894-b60b-49ba-8128-5864bf2a363c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:13.181340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541894-b60b-49ba-8128-5864bf2a363c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:13.181512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541894-b60b-49ba-8128-5864bf2a363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:13.268329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f6541894-b60b-49ba-8128-5864bf2a363c None None] MFA Rules not processed for user `b2ffde89d3704dd68bdb30ac4ad3ff53`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:13.281072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f6541894-b60b-49ba-8128-5864bf2a363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:13.333215 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2769/5515] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:26:13.533126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b035-3db3-4c3d-8aac-e4869501f213 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:13.536568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6587b035-3db3-4c3d-8aac-e4869501f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:13.801064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b035-3db3-4c3d-8aac-e4869501f213 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:13.831554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c8f06-cc46-4047-8985-65eacf136c3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:13.832199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c8f06-cc46-4047-8985-65eacf136c3c service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:13.832682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c8f06-cc46-4047-8985-65eacf136c3c service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:13.833120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c8f06-cc46-4047-8985-65eacf136c3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:13.836577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-664c8f06-cc46-4047-8985-65eacf136c3c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:14.019255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c8f06-cc46-4047-8985-65eacf136c3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:14.019255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c8f06-cc46-4047-8985-65eacf136c3c service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:14.033814 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2747/5516] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:26:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:26:15.921515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6541894-b60b-49ba-8128-5864bf2a363c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:15.923504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f6541894-b60b-49ba-8128-5864bf2a363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:16.000479 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:16.079053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6541894-b60b-49ba-8128-5864bf2a363c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:16.099652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa831a0-0904-4a9e-b143-3d1edba70d8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:16.100751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa831a0-0904-4a9e-b143-3d1edba70d8a service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:16.101282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa831a0-0904-4a9e-b143-3d1edba70d8a service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:16.101811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa831a0-0904-4a9e-b143-3d1edba70d8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:16.104375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3fa831a0-0904-4a9e-b143-3d1edba70d8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:16.138666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa831a0-0904-4a9e-b143-3d1edba70d8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:16.147334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa831a0-0904-4a9e-b143-3d1edba70d8a service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:16.198685 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2770/5517] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:21.433482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ff6b-1746-4ff1-a974-d4e5a4f1fb03 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:21.434012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ff6b-1746-4ff1-a974-d4e5a4f1fb03 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:21.434012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ff6b-1746-4ff1-a974-d4e5a4f1fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:21.472889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1957ff6b-1746-4ff1-a974-d4e5a4f1fb03 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:21.474496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1957ff6b-1746-4ff1-a974-d4e5a4f1fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:21.696304 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2748/5518] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:22.083627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa831a0-0904-4a9e-b143-3d1edba70d8a service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:22.237859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa831a0-0904-4a9e-b143-3d1edba70d8a service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:22.252100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ac144-68dc-494c-aab6-22cb33ba199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:22.252756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac144-68dc-494c-aab6-22cb33ba199e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:22.253040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac144-68dc-494c-aab6-22cb33ba199e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:22.253317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac144-68dc-494c-aab6-22cb33ba199e admin admin] PATH_INFO: `/v3/users/a8e9ef92ec7f49efa3f3edf5fa780694` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:22.254480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ac144-68dc-494c-aab6-22cb33ba199e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e9ef92ec7f49efa3f3edf5fa780694)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:22.256445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ac144-68dc-494c-aab6-22cb33ba199e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:22.452867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f50ac144-68dc-494c-aab6-22cb33ba199e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e9ef92ec7f49efa3f3edf5fa780694'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:22.491870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f50ac144-68dc-494c-aab6-22cb33ba199e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e9ef92ec7f49efa3f3edf5fa780694'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:22.492630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f50ac144-68dc-494c-aab6-22cb33ba199e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e9ef92ec7f49efa3f3edf5fa780694'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:22.509949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f50ac144-68dc-494c-aab6-22cb33ba199e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e9ef92ec7f49efa3f3edf5fa780694'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:22.510651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f50ac144-68dc-494c-aab6-22cb33ba199e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e9ef92ec7f49efa3f3edf5fa780694'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:22.541071 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2771/5519] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:26:22 2022] DELETE /identity/v3/users/a8e9ef92ec7f49efa3f3edf5fa780694 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:22.545874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb59063-8c74-4900-9a2a-c14c6c959fd6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:22.546418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb59063-8c74-4900-9a2a-c14c6c959fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:22.546570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb59063-8c74-4900-9a2a-c14c6c959fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:22.583257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4cb59063-8c74-4900-9a2a-c14c6c959fd6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:22.586384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4cb59063-8c74-4900-9a2a-c14c6c959fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:22.606886 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:22.747103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600d4f1-beaa-4fe3-a637-d2938ab1aef4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:22.747441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600d4f1-beaa-4fe3-a637-d2938ab1aef4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:22.747720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600d4f1-beaa-4fe3-a637-d2938ab1aef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:22.749344 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2749/5520] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:22.760494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb59063-8c74-4900-9a2a-c14c6c959fd6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:22.763096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4cb59063-8c74-4900-9a2a-c14c6c959fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:22.792985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d600d4f1-beaa-4fe3-a637-d2938ab1aef4 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:22.794592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d600d4f1-beaa-4fe3-a637-d2938ab1aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:22.942342 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:22.949701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb59063-8c74-4900-9a2a-c14c6c959fd6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:22.977786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf4e37-b4ba-46fe-b05b-d88538f0ee62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:22.979308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf4e37-b4ba-46fe-b05b-d88538f0ee62 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:22.979308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf4e37-b4ba-46fe-b05b-d88538f0ee62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:22.979505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf4e37-b4ba-46fe-b05b-d88538f0ee62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:23.000069 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2772/5521] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:23.033558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf4e37-b4ba-46fe-b05b-d88538f0ee62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:23.036689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf4e37-b4ba-46fe-b05b-d88538f0ee62 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:23.073059 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2750/5522] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:24.919419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600d4f1-beaa-4fe3-a637-d2938ab1aef4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:24.921000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d600d4f1-beaa-4fe3-a637-d2938ab1aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:24.973694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600d4f1-beaa-4fe3-a637-d2938ab1aef4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:24.983962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:24.984703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:24.986882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:24.987166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] PATH_INFO: `/v3/projects/fe9cebc57da14c23979162d3aab9d4de` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:24.995905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9cebc57da14c23979162d3aab9d4de)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:24.997491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:25.131835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9cebc57da14c23979162d3aab9d4de', 'request_id': 'req-a734193c-50e0-4c50-b0f0-4451cd4ce828'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.152593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9cebc57da14c23979162d3aab9d4de', 'request_id': 'req-a734193c-50e0-4c50-b0f0-4451cd4ce828'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.161186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9cebc57da14c23979162d3aab9d4de', 'request_id': 'req-a734193c-50e0-4c50-b0f0-4451cd4ce828'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.182013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] The token cache is being invalidate because project fe9cebc57da14c23979162d3aab9d4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:26:25.182847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.184068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.186361 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2773/5523] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:26:24 2022] DELETE /identity/v3/projects/fe9cebc57da14c23979162d3aab9d4de => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:25.190780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf4e37-b4ba-46fe-b05b-d88538f0ee62 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:25.205596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf4e37-b4ba-46fe-b05b-d88538f0ee62 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:25.276267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:25.280647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:25.337301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d69c7-b98b-4966-bab8-69fce2a699d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:25.338191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d69c7-b98b-4966-bab8-69fce2a699d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:25.338690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d69c7-b98b-4966-bab8-69fce2a699d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:25.338968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d69c7-b98b-4966-bab8-69fce2a699d2 admin admin] PATH_INFO: `/v3/users/54f0216a3f4947739af965101b1c6619` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:25.342863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d69c7-b98b-4966-bab8-69fce2a699d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f0216a3f4947739af965101b1c6619)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:25.345528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d69c7-b98b-4966-bab8-69fce2a699d2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:25.435763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734193c-50e0-4c50-b0f0-4451cd4ce828 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:25.447823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:25.449682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:25.449996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:25.450856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] PATH_INFO: `/v3/users/a6de25ef23674c9092c55d2e02c01587` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:25.455254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6de25ef23674c9092c55d2e02c01587)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:25.460297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:25.509395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf5d69c7-b98b-4966-bab8-69fce2a699d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f0216a3f4947739af965101b1c6619'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.532058 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:25.551125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf5d69c7-b98b-4966-bab8-69fce2a699d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f0216a3f4947739af965101b1c6619'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.552586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf5d69c7-b98b-4966-bab8-69fce2a699d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f0216a3f4947739af965101b1c6619'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.571884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf5d69c7-b98b-4966-bab8-69fce2a699d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f0216a3f4947739af965101b1c6619'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.597803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf5d69c7-b98b-4966-bab8-69fce2a699d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f0216a3f4947739af965101b1c6619'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.616777 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2751/5524] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:26:25 2022] DELETE /identity/v3/users/54f0216a3f4947739af965101b1c6619 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:25.618066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6de25ef23674c9092c55d2e02c01587'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.635734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6de25ef23674c9092c55d2e02c01587'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.636897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6de25ef23674c9092c55d2e02c01587'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.639926 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:25.650585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6de25ef23674c9092c55d2e02c01587'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.653257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6de25ef23674c9092c55d2e02c01587'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:25.685676 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2774/5525] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:26:25 2022] DELETE /identity/v3/users/a6de25ef23674c9092c55d2e02c01587 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:25.691858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd4e2-3095-4604-8087-35acda343cb6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:25.691858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd4e2-3095-4604-8087-35acda343cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:25.691858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd4e2-3095-4604-8087-35acda343cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:25.726868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2a5fd4e2-3095-4604-8087-35acda343cb6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:25.728130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a5fd4e2-3095-4604-8087-35acda343cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:25.819091 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2752/5526] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:25.857385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:25.860204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:26.048731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1c665-130f-4504-bf34-f83afa06bdb0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:26.064678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6c3bc-ac74-4296-bd62-bb2f52a16935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:26.077058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6c3bc-ac74-4296-bd62-bb2f52a16935 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:26.085488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6c3bc-ac74-4296-bd62-bb2f52a16935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:26.085841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6c3bc-ac74-4296-bd62-bb2f52a16935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:26.128489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6c3bc-ac74-4296-bd62-bb2f52a16935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:26.129800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6c3bc-ac74-4296-bd62-bb2f52a16935 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:26.148371 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2775/5527] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:27.121114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fd4e2-3095-4604-8087-35acda343cb6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:27.124605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a5fd4e2-3095-4604-8087-35acda343cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:27.163228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fd4e2-3095-4604-8087-35acda343cb6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:27.171954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:27.173256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:27.173897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:27.174158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] PATH_INFO: `/v3/projects/3e6afd25060142c4a51393f365b28e12` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:27.175494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6afd25060142c4a51393f365b28e12)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:27.177463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:27.265521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6afd25060142c4a51393f365b28e12', 'request_id': 'req-84d0dbd5-71a4-45da-abc1-204bdf01c477'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:27.274708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6afd25060142c4a51393f365b28e12', 'request_id': 'req-84d0dbd5-71a4-45da-abc1-204bdf01c477'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:27.282897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6afd25060142c4a51393f365b28e12', 'request_id': 'req-84d0dbd5-71a4-45da-abc1-204bdf01c477'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:27.341889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] The token cache is being invalidate because project 3e6afd25060142c4a51393f365b28e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:26:27.342288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:27.345261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:27.367871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6c3bc-ac74-4296-bd62-bb2f52a16935 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:27.383558 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2753/5528] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:26:27 2022] DELETE /identity/v3/projects/3e6afd25060142c4a51393f365b28e12 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:27.386449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6c3bc-ac74-4296-bd62-bb2f52a16935 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:27.567203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:27.567851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:27.568134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:27.568409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] PATH_INFO: `/v3/users/0a19cd1c53164432a603f248ea87879a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:27.571234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a19cd1c53164432a603f248ea87879a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:27.575590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:27.663993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:27.665959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:27.701904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a19cd1c53164432a603f248ea87879a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:27.756950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a19cd1c53164432a603f248ea87879a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:27.758866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a19cd1c53164432a603f248ea87879a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:27.780023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a19cd1c53164432a603f248ea87879a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:27.780823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a19cd1c53164432a603f248ea87879a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:27.807895 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2776/5529] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:26:27 2022] DELETE /identity/v3/users/0a19cd1c53164432a603f248ea87879a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:27.866334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0dbd5-71a4-45da-abc1-204bdf01c477 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:27.905641 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:28.019259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:28.022867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:28.037786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd9820-6f06-4525-a5f3-7b6fc3819132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:28.038435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9820-6f06-4525-a5f3-7b6fc3819132 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:28.038757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9820-6f06-4525-a5f3-7b6fc3819132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:28.039071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9820-6f06-4525-a5f3-7b6fc3819132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:28.043269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e8dd9820-6f06-4525-a5f3-7b6fc3819132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:28.046748 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:28.078278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd9820-6f06-4525-a5f3-7b6fc3819132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:28.081966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd9820-6f06-4525-a5f3-7b6fc3819132 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:28.107483 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2754/5530] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:28.238701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18950-5163-4836-92f9-0dc28bb7475f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:28.269170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:28.269837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:28.270126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:28.270404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] PATH_INFO: `/v3/projects/a63303f5cd894aa8b31af9fe3c8d179d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:28.276179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63303f5cd894aa8b31af9fe3c8d179d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:28.278147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:28.422149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63303f5cd894aa8b31af9fe3c8d179d', 'request_id': 'req-883b6da1-bba1-4588-b762-efe38b3f4fcd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:28.436678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63303f5cd894aa8b31af9fe3c8d179d', 'request_id': 'req-883b6da1-bba1-4588-b762-efe38b3f4fcd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:28.450667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63303f5cd894aa8b31af9fe3c8d179d', 'request_id': 'req-883b6da1-bba1-4588-b762-efe38b3f4fcd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:28.480941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] The token cache is being invalidate because project a63303f5cd894aa8b31af9fe3c8d179d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:26:28.481257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:28.486356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-883b6da1-bba1-4588-b762-efe38b3f4fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:28.502389 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2777/5531] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:26:28 2022] DELETE /identity/v3/projects/a63303f5cd894aa8b31af9fe3c8d179d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:26:28.502797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fbdb4-ddb8-4fb7-a163-1a7f58a6faba None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:28.503319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fbdb4-ddb8-4fb7-a163-1a7f58a6faba None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:28.503319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fbdb4-ddb8-4fb7-a163-1a7f58a6faba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:28.561645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9d4fbdb4-ddb8-4fb7-a163-1a7f58a6faba None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:28.575962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9d4fbdb4-ddb8-4fb7-a163-1a7f58a6faba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:28.749848 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2755/5532] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:26:28.759583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274284e3-2cf2-4230-8ed2-369b12443bca None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:28.760062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274284e3-2cf2-4230-8ed2-369b12443bca None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:28.760441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274284e3-2cf2-4230-8ed2-369b12443bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:28.800519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-274284e3-2cf2-4230-8ed2-369b12443bca None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:28.819542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-274284e3-2cf2-4230-8ed2-369b12443bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:28.835870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fbdb4-ddb8-4fb7-a163-1a7f58a6faba None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:28.836413 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2778/5533] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:28.848177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fbdb4-ddb8-4fb7-a163-1a7f58a6faba None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:28.864248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad544a-e730-4b51-a515-c2164ccc86a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:28.865866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad544a-e730-4b51-a515-c2164ccc86a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:28.866445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad544a-e730-4b51-a515-c2164ccc86a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:28.866965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad544a-e730-4b51-a515-c2164ccc86a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:28.867874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad544a-e730-4b51-a515-c2164ccc86a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:26:28.868480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad544a-e730-4b51-a515-c2164ccc86a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:28.872913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad544a-e730-4b51-a515-c2164ccc86a3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:28.920523 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2756/5534] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:26:28.934993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274284e3-2cf2-4230-8ed2-369b12443bca None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:28.936235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad544a-e730-4b51-a515-c2164ccc86a3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:28.942270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b9ad544a-e730-4b51-a515-c2164ccc86a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:28.957540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274284e3-2cf2-4230-8ed2-369b12443bca None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:28.979366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1ab49-fd08-4038-af10-943ed2369a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:28.980095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad544a-e730-4b51-a515-c2164ccc86a3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:28.981552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1ab49-fd08-4038-af10-943ed2369a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:28.981552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1ab49-fd08-4038-af10-943ed2369a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:28.981785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1ab49-fd08-4038-af10-943ed2369a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:28.982433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1ab49-fd08-4038-af10-943ed2369a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:28.984372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1ab49-fd08-4038-af10-943ed2369a12 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.007099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.008115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.008672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.009226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] PATH_INFO: `/v3/projects/3f3f41034b21462cb2df7800330b60fa` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.011304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3f41034b21462cb2df7800330b60fa)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.013759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.051864 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2779/5535] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:26:28 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:29.053356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1ab49-fd08-4038-af10-943ed2369a12 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:29.091660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3f41034b21462cb2df7800330b60fa', 'request_id': 'req-283cf74c-d21a-4499-b516-59f2fa8b659c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:29.099417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3f41034b21462cb2df7800330b60fa', 'request_id': 'req-283cf74c-d21a-4499-b516-59f2fa8b659c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:29.107990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3f41034b21462cb2df7800330b60fa', 'request_id': 'req-283cf74c-d21a-4499-b516-59f2fa8b659c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:29.125486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] The token cache is being invalidate because project 3f3f41034b21462cb2df7800330b60fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:26:29.127599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:29.128404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-283cf74c-d21a-4499-b516-59f2fa8b659c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:26:29.132262 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2757/5536] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:26:28 2022] DELETE /identity/v3/projects/3f3f41034b21462cb2df7800330b60fa => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:26:29.137905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49df646-323b-468a-8f04-912c6a114855 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.138220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49df646-323b-468a-8f04-912c6a114855 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.138503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49df646-323b-468a-8f04-912c6a114855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.160422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1ab49-fd08-4038-af10-943ed2369a12 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:29.165955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c49df646-323b-468a-8f04-912c6a114855 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:29.166928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c49df646-323b-468a-8f04-912c6a114855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:29.174850 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:29.198573 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:29.231091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355a2c6-8ebf-4a07-a24e-9ce597217b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.231713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355a2c6-8ebf-4a07-a24e-9ce597217b2f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.231997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355a2c6-8ebf-4a07-a24e-9ce597217b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.232274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355a2c6-8ebf-4a07-a24e-9ce597217b2f admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.233008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355a2c6-8ebf-4a07-a24e-9ce597217b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.235805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355a2c6-8ebf-4a07-a24e-9ce597217b2f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.251287 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2758/5537] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:29.257025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc90e8-1b88-41b7-915d-87c280e305d0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.257781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc90e8-1b88-41b7-915d-87c280e305d0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.258007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc90e8-1b88-41b7-915d-87c280e305d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.264937 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2780/5538] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:26:29 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:29.268774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355a2c6-8ebf-4a07-a24e-9ce597217b2f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:29.270728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e355a2c6-8ebf-4a07-a24e-9ce597217b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:29.284436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-26fc90e8-1b88-41b7-915d-87c280e305d0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:29.285651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-26fc90e8-1b88-41b7-915d-87c280e305d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:29.295601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355a2c6-8ebf-4a07-a24e-9ce597217b2f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:29.300002 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2759/5539] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:29.302417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc90e8-1b88-41b7-915d-87c280e305d0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:29.312668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a6a73-1346-49b9-9b45-16e9de82f227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.314861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a6a73-1346-49b9-9b45-16e9de82f227 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.315325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a6a73-1346-49b9-9b45-16e9de82f227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.315781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a6a73-1346-49b9-9b45-16e9de82f227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.318086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a6a73-1346-49b9-9b45-16e9de82f227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.321444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a6a73-1346-49b9-9b45-16e9de82f227 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.326115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc90e8-1b88-41b7-915d-87c280e305d0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:29.345985 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2781/5540] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:29.359320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef7e0a-0f80-425e-ba85-6acc944fe6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.364475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a6a73-1346-49b9-9b45-16e9de82f227 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:29.370407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef7e0a-0f80-425e-ba85-6acc944fe6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.370797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef7e0a-0f80-425e-ba85-6acc944fe6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.371080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef7e0a-0f80-425e-ba85-6acc944fe6e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.377432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef7e0a-0f80-425e-ba85-6acc944fe6e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:26:29.377749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef7e0a-0f80-425e-ba85-6acc944fe6e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.383627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef7e0a-0f80-425e-ba85-6acc944fe6e1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.390418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a6a73-1346-49b9-9b45-16e9de82f227 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:29.401963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f4685-f5b8-4124-ab5c-5f11e86f3d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.402568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4685-f5b8-4124-ab5c-5f11e86f3d6f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.403030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4685-f5b8-4124-ab5c-5f11e86f3d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.403278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4685-f5b8-4124-ab5c-5f11e86f3d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.403808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f4685-f5b8-4124-ab5c-5f11e86f3d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.405721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f4685-f5b8-4124-ab5c-5f11e86f3d6f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.416596 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2760/5541] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:26:29.421664 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2782/5542] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:29.423653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f4685-f5b8-4124-ab5c-5f11e86f3d6f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:29.424651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef7e0a-0f80-425e-ba85-6acc944fe6e1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:29.435982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f4685-f5b8-4124-ab5c-5f11e86f3d6f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:29.436989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef7e0a-0f80-425e-ba85-6acc944fe6e1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:29.442138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bae3e6-3349-442b-925a-afec636d76bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.442762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bae3e6-3349-442b-925a-afec636d76bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.443040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bae3e6-3349-442b-925a-afec636d76bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.443314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bae3e6-3349-442b-925a-afec636d76bc admin admin] PATH_INFO: `/v3/projects/eadebca1e5e9421c837c5a34549af52b/users/851539b28b7f4571bc4388ac1c57d2f0/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.450230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68881a32-a66d-4126-9809-4a063c70f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.451228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68881a32-a66d-4126-9809-4a063c70f41d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.454793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68881a32-a66d-4126-9809-4a063c70f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.455198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68881a32-a66d-4126-9809-4a063c70f41d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.456041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68881a32-a66d-4126-9809-4a063c70f41d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.458308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68881a32-a66d-4126-9809-4a063c70f41d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.462382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bae3e6-3349-442b-925a-afec636d76bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadebca1e5e9421c837c5a34549af52b, user_id=851539b28b7f4571bc4388ac1c57d2f0, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.466712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bae3e6-3349-442b-925a-afec636d76bc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.491286 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2783/5543] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:26:29 2022] PUT /identity/v3/projects/eadebca1e5e9421c837c5a34549af52b/users/851539b28b7f4571bc4388ac1c57d2f0/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:26:29.498181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdef27d-450f-4683-a0f7-6ff62cefb4be None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.498542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdef27d-450f-4683-a0f7-6ff62cefb4be None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.498915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdef27d-450f-4683-a0f7-6ff62cefb4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.511035 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2761/5544] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:26:29 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:29.514754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68881a32-a66d-4126-9809-4a063c70f41d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:29.533993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-efdef27d-450f-4683-a0f7-6ff62cefb4be None None] MFA Rules not processed for user `851539b28b7f4571bc4388ac1c57d2f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:29.535278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-efdef27d-450f-4683-a0f7-6ff62cefb4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:29.602817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68881a32-a66d-4126-9809-4a063c70f41d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:29.609826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60302e35-b817-4513-adcf-eb2c2059db16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.610568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302e35-b817-4513-adcf-eb2c2059db16 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.610893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302e35-b817-4513-adcf-eb2c2059db16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.611151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302e35-b817-4513-adcf-eb2c2059db16 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.612350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60302e35-b817-4513-adcf-eb2c2059db16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.615333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60302e35-b817-4513-adcf-eb2c2059db16 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.652085 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2762/5545] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:26:29 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:26:29.656160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60302e35-b817-4513-adcf-eb2c2059db16 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:29.659759 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2784/5546] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:26:29.670177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60302e35-b817-4513-adcf-eb2c2059db16 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:29.670703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdef27d-450f-4683-a0f7-6ff62cefb4be None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:29.673424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-efdef27d-450f-4683-a0f7-6ff62cefb4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:29.713119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f88e02-7aee-4689-9a65-1adec465e88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.716120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f88e02-7aee-4689-9a65-1adec465e88a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.716410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f88e02-7aee-4689-9a65-1adec465e88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.717870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f88e02-7aee-4689-9a65-1adec465e88a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.718565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f88e02-7aee-4689-9a65-1adec465e88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.723603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f88e02-7aee-4689-9a65-1adec465e88a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.741377 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2763/5547] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:29.742393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f88e02-7aee-4689-9a65-1adec465e88a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:29.754529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f88e02-7aee-4689-9a65-1adec465e88a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:29.762053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918144d8-172b-4ac7-8c76-5abed1e8fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.762620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918144d8-172b-4ac7-8c76-5abed1e8fc21 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.762928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918144d8-172b-4ac7-8c76-5abed1e8fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.763205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918144d8-172b-4ac7-8c76-5abed1e8fc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.763887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918144d8-172b-4ac7-8c76-5abed1e8fc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.766433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918144d8-172b-4ac7-8c76-5abed1e8fc21 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.793928 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2764/5548] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:26:29.796047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918144d8-172b-4ac7-8c76-5abed1e8fc21 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:29.812543 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:29.821413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdef27d-450f-4683-a0f7-6ff62cefb4be None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:29.827634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7f34a-3d0b-48a7-8e9b-8e01207b7d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.829045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7f34a-3d0b-48a7-8e9b-8e01207b7d00 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.829791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7f34a-3d0b-48a7-8e9b-8e01207b7d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.830228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7f34a-3d0b-48a7-8e9b-8e01207b7d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.843118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918144d8-172b-4ac7-8c76-5abed1e8fc21 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:29.845459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7f34a-3d0b-48a7-8e9b-8e01207b7d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.846929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7f34a-3d0b-48a7-8e9b-8e01207b7d00 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.848954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef9bba-edd1-4e76-b4d3-dfccd88b0aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:29.852717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9bba-edd1-4e76-b4d3-dfccd88b0aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.853579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9bba-edd1-4e76-b4d3-dfccd88b0aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.853961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9bba-edd1-4e76-b4d3-dfccd88b0aaf admin admin] PATH_INFO: `/v3/projects/133349796718454eb3b452ed62d15a8d/users/dc7cc78032a34034aed2d761e8cfe068/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:29.872697 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2785/5549] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:26:29.883268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef9bba-edd1-4e76-b4d3-dfccd88b0aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=133349796718454eb3b452ed62d15a8d, user_id=dc7cc78032a34034aed2d761e8cfe068, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:29.886522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef9bba-edd1-4e76-b4d3-dfccd88b0aaf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:29.945925 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2765/5550] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:26:29 2022] PUT /identity/v3/projects/133349796718454eb3b452ed62d15a8d/users/dc7cc78032a34034aed2d761e8cfe068/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:26:29.946968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7956e7-711d-4a62-949e-d165b751f28b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:29.947477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7956e7-711d-4a62-949e-d165b751f28b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:29.947754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7956e7-711d-4a62-949e-d165b751f28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:30.023726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dc7956e7-711d-4a62-949e-d165b751f28b None None] MFA Rules not processed for user `dc7cc78032a34034aed2d761e8cfe068`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:30.024954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dc7956e7-711d-4a62-949e-d165b751f28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:30.132025 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2786/5551] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:30.141623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef9bba-edd1-4e76-b4d3-dfccd88b0aaf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:30.143676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-46ef9bba-edd1-4e76-b4d3-dfccd88b0aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:30.191448 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:30.224863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef9bba-edd1-4e76-b4d3-dfccd88b0aaf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:30.238897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e1e59-5d06-4bf9-8a4a-913d5c696805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:30.239823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e1e59-5d06-4bf9-8a4a-913d5c696805 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:30.240117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e1e59-5d06-4bf9-8a4a-913d5c696805 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:30.240392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e1e59-5d06-4bf9-8a4a-913d5c696805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:30.256942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e1e59-5d06-4bf9-8a4a-913d5c696805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:30.260404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e1e59-5d06-4bf9-8a4a-913d5c696805 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:30.278061 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2766/5552] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:32.955773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fac1-5bed-4c7a-9b37-11d575a390d6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:32.956456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fac1-5bed-4c7a-9b37-11d575a390d6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:32.956456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fac1-5bed-4c7a-9b37-11d575a390d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:32.995092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9443fac1-5bed-4c7a-9b37-11d575a390d6 None None] MFA Rules not processed for user `dc7cc78032a34034aed2d761e8cfe068`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:32.996327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9443fac1-5bed-4c7a-9b37-11d575a390d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:33.017728 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2787/5553] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:39.523059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fa36d-d8ca-4ea7-a72d-4d79e7cda2f4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:39.523593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fa36d-d8ca-4ea7-a72d-4d79e7cda2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:39.523593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fa36d-d8ca-4ea7-a72d-4d79e7cda2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:39.747194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9f9fa36d-d8ca-4ea7-a72d-4d79e7cda2f4 None None] MFA Rules not processed for user `bfae16ed6efb490d8d953bb78a5c1a00`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:39.748593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f9fa36d-d8ca-4ea7-a72d-4d79e7cda2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:39.896796 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2767/5554] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:41.308325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8eb45-e294-4de1-a39e-f16264f2fac1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:41.308325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8eb45-e294-4de1-a39e-f16264f2fac1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:41.308325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8eb45-e294-4de1-a39e-f16264f2fac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:41.346306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cee8eb45-e294-4de1-a39e-f16264f2fac1 None None] MFA Rules not processed for user `a003e4392e9c4aa587573cb1dfa605e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:26:41.347563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cee8eb45-e294-4de1-a39e-f16264f2fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:41.473463 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2788/5555] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:26:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:26:42.179969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fa36d-d8ca-4ea7-a72d-4d79e7cda2f4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:42.330070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fa36d-d8ca-4ea7-a72d-4d79e7cda2f4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:42.336476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc039876-0732-451f-a79e-56cf9248ad30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:42.337159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc039876-0732-451f-a79e-56cf9248ad30 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:42.337443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc039876-0732-451f-a79e-56cf9248ad30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:42.338130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc039876-0732-451f-a79e-56cf9248ad30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:42.340325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dc039876-0732-451f-a79e-56cf9248ad30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:42.357620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc039876-0732-451f-a79e-56cf9248ad30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:42.360388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc039876-0732-451f-a79e-56cf9248ad30 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:42.373212 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2768/5556] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:46.794773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8eb45-e294-4de1-a39e-f16264f2fac1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:46.797028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cee8eb45-e294-4de1-a39e-f16264f2fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:46.951717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8eb45-e294-4de1-a39e-f16264f2fac1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:46.974593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fffc8-f890-4054-aeb7-078302d54a37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:46.975418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fffc8-f890-4054-aeb7-078302d54a37 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:46.975861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fffc8-f890-4054-aeb7-078302d54a37 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:46.976304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fffc8-f890-4054-aeb7-078302d54a37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:46.988570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ad5fffc8-f890-4054-aeb7-078302d54a37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:47.028146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fffc8-f890-4054-aeb7-078302d54a37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:47.028146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fffc8-f890-4054-aeb7-078302d54a37 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:47.074860 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2789/5557] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:52.365491 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=63 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:52.955153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc039876-0732-451f-a79e-56cf9248ad30 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:26:52.956753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dc039876-0732-451f-a79e-56cf9248ad30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:52.981626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc039876-0732-451f-a79e-56cf9248ad30 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:26:52.989562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738340e1-9471-4750-982e-5c7612be5285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:26:52.990582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738340e1-9471-4750-982e-5c7612be5285 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:26:52.991126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738340e1-9471-4750-982e-5c7612be5285 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:26:52.991789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738340e1-9471-4750-982e-5c7612be5285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:26:52.993772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-738340e1-9471-4750-982e-5c7612be5285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:26:53.012672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738340e1-9471-4750-982e-5c7612be5285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:26:53.014531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738340e1-9471-4750-982e-5c7612be5285 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:26:53.029087 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2769/5558] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:26:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:26:57.058057 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:03.022182 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:05.252130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fffc8-f890-4054-aeb7-078302d54a37 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:05.253585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ad5fffc8-f890-4054-aeb7-078302d54a37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:05.329698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fffc8-f890-4054-aeb7-078302d54a37 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:05.336397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:05.337040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:05.337318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:05.337594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] PATH_INFO: `/v3/users/b2ffde89d3704dd68bdb30ac4ad3ff53` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:05.338909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2ffde89d3704dd68bdb30ac4ad3ff53)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:05.340948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:05.398254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2ffde89d3704dd68bdb30ac4ad3ff53'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:05.414554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2ffde89d3704dd68bdb30ac4ad3ff53'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:05.415423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2ffde89d3704dd68bdb30ac4ad3ff53'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:05.424839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2ffde89d3704dd68bdb30ac4ad3ff53'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:05.425610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2ffde89d3704dd68bdb30ac4ad3ff53'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:05.444663 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2790/5559] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:27:05 2022] DELETE /identity/v3/users/b2ffde89d3704dd68bdb30ac4ad3ff53 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:05.445823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a432e-a99f-460c-8e69-bd325e897597 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:05.446293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a432e-a99f-460c-8e69-bd325e897597 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:05.446380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a432e-a99f-460c-8e69-bd325e897597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:05.466401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9c2a432e-a99f-460c-8e69-bd325e897597 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:05.467628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c2a432e-a99f-460c-8e69-bd325e897597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:05.534148 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2770/5560] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:05.544459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:05.546922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:05.617911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3fc6d-d48c-412f-b6a0-5c0884ed57b3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:05.625230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd019f-ec4e-4bf9-a71d-05fbe7a1b3e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:05.626014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd019f-ec4e-4bf9-a71d-05fbe7a1b3e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:05.626464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd019f-ec4e-4bf9-a71d-05fbe7a1b3e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:05.626903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd019f-ec4e-4bf9-a71d-05fbe7a1b3e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:05.637611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd019f-ec4e-4bf9-a71d-05fbe7a1b3e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:05.639221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd019f-ec4e-4bf9-a71d-05fbe7a1b3e2 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:05.650967 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2791/5561] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:27:06.139360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a432e-a99f-460c-8e69-bd325e897597 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:06.142177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c2a432e-a99f-460c-8e69-bd325e897597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:06.198984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a432e-a99f-460c-8e69-bd325e897597 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:06.205322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:06.206641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:06.207119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:06.207590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] PATH_INFO: `/v3/projects/08b504dc949d418fb27c4149a55f669e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:06.208948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b504dc949d418fb27c4149a55f669e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:06.211138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:06.292296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b504dc949d418fb27c4149a55f669e', 'request_id': 'req-522be17a-68f1-44d2-8cb4-027d61f93447'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:06.300550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b504dc949d418fb27c4149a55f669e', 'request_id': 'req-522be17a-68f1-44d2-8cb4-027d61f93447'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:06.311094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b504dc949d418fb27c4149a55f669e', 'request_id': 'req-522be17a-68f1-44d2-8cb4-027d61f93447'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:06.330772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] The token cache is being invalidate because project 08b504dc949d418fb27c4149a55f669e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:27:06.331370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:06.332246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-522be17a-68f1-44d2-8cb4-027d61f93447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:06.334337 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2771/5562] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:06 2022] DELETE /identity/v3/projects/08b504dc949d418fb27c4149a55f669e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:06.339224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e7728-f9a6-401f-8da5-5f26817df65d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:06.340294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e7728-f9a6-401f-8da5-5f26817df65d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:06.340812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e7728-f9a6-401f-8da5-5f26817df65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:06.366926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-693e7728-f9a6-401f-8da5-5f26817df65d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:06.368554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-693e7728-f9a6-401f-8da5-5f26817df65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:06.392087 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:06.461882 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2792/5563] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:06.464323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab244bd-a9d8-4bb3-bd7b-2ceec04ea93b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:06.464818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab244bd-a9d8-4bb3-bd7b-2ceec04ea93b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:06.465246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab244bd-a9d8-4bb3-bd7b-2ceec04ea93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:06.493688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0ab244bd-a9d8-4bb3-bd7b-2ceec04ea93b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:06.495592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ab244bd-a9d8-4bb3-bd7b-2ceec04ea93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:06.512187 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2772/5564] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:06.516750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e7728-f9a6-401f-8da5-5f26817df65d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:06.528256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e7728-f9a6-401f-8da5-5f26817df65d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:06.534042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517c9c5-6220-4b97-83a6-1dba3b7776a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:06.534844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517c9c5-6220-4b97-83a6-1dba3b7776a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:06.535192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517c9c5-6220-4b97-83a6-1dba3b7776a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:06.535600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517c9c5-6220-4b97-83a6-1dba3b7776a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:06.536304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517c9c5-6220-4b97-83a6-1dba3b7776a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:27:06.536683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517c9c5-6220-4b97-83a6-1dba3b7776a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:06.538495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517c9c5-6220-4b97-83a6-1dba3b7776a5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:06.555511 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2793/5565] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:27:06.556268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab244bd-a9d8-4bb3-bd7b-2ceec04ea93b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:06.566374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab244bd-a9d8-4bb3-bd7b-2ceec04ea93b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:06.571718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05a70b-58be-4d14-9272-cf64b50c53b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:06.572909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05a70b-58be-4d14-9272-cf64b50c53b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:06.572909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05a70b-58be-4d14-9272-cf64b50c53b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:06.572909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05a70b-58be-4d14-9272-cf64b50c53b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:06.573493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05a70b-58be-4d14-9272-cf64b50c53b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:06.575437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05a70b-58be-4d14-9272-cf64b50c53b1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:06.610390 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2773/5566] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:06 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:06.611612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517c9c5-6220-4b97-83a6-1dba3b7776a5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:06.625640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517c9c5-6220-4b97-83a6-1dba3b7776a5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:06.705561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f2d60-198a-439f-8a00-71cbbb1dd558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:06.705725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f2d60-198a-439f-8a00-71cbbb1dd558 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:06.706143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f2d60-198a-439f-8a00-71cbbb1dd558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:06.706508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f2d60-198a-439f-8a00-71cbbb1dd558 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:06.707378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f2d60-198a-439f-8a00-71cbbb1dd558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:06.709544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f2d60-198a-439f-8a00-71cbbb1dd558 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:06.742772 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2794/5567] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:27:06 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:27:06.746132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05a70b-58be-4d14-9272-cf64b50c53b1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:06.759500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05a70b-58be-4d14-9272-cf64b50c53b1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:06.791957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99770-4f98-47b1-8093-cc7383988b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:06.793094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99770-4f98-47b1-8093-cc7383988b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:06.793786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99770-4f98-47b1-8093-cc7383988b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:06.794461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99770-4f98-47b1-8093-cc7383988b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:06.795562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb99770-4f98-47b1-8093-cc7383988b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:06.799116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb99770-4f98-47b1-8093-cc7383988b23 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:06.812707 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2774/5568] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:06.816498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f2d60-198a-439f-8a00-71cbbb1dd558 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:06.829297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f2d60-198a-439f-8a00-71cbbb1dd558 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:06.835139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df080c-9f4b-4d78-8cb9-96f96b50150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:06.836007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df080c-9f4b-4d78-8cb9-96f96b50150b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:06.836409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df080c-9f4b-4d78-8cb9-96f96b50150b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:06.836754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df080c-9f4b-4d78-8cb9-96f96b50150b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:06.837636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df080c-9f4b-4d78-8cb9-96f96b50150b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:06.839303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df080c-9f4b-4d78-8cb9-96f96b50150b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:06.860071 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2795/5569] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:06.862085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99770-4f98-47b1-8093-cc7383988b23 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:06.881657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99770-4f98-47b1-8093-cc7383988b23 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:06.889643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8f74e-af3e-4e57-bd3b-0c7bd1e0da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:06.891336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8f74e-af3e-4e57-bd3b-0c7bd1e0da41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:06.891869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8f74e-af3e-4e57-bd3b-0c7bd1e0da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:06.892362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8f74e-af3e-4e57-bd3b-0c7bd1e0da41 admin admin] PATH_INFO: `/v3/projects/8aa90be9f4d34051b2d556a871bd960c/users/554662c41c244bf5b2720aced1f66355/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:06.911459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8f74e-af3e-4e57-bd3b-0c7bd1e0da41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa90be9f4d34051b2d556a871bd960c, user_id=554662c41c244bf5b2720aced1f66355, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:06.917104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8f74e-af3e-4e57-bd3b-0c7bd1e0da41 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:06.942284 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2775/5570] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:27:06 2022] PUT /identity/v3/projects/8aa90be9f4d34051b2d556a871bd960c/users/554662c41c244bf5b2720aced1f66355/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:27:06.953094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e4101-b23c-4864-8465-155985cae8f2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:06.953913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e4101-b23c-4864-8465-155985cae8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:06.954427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e4101-b23c-4864-8465-155985cae8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:06.996075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6b8e4101-b23c-4864-8465-155985cae8f2 None None] MFA Rules not processed for user `554662c41c244bf5b2720aced1f66355`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:06.997841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6b8e4101-b23c-4864-8465-155985cae8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:07.126123 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2796/5571] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:07.132734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8f74e-af3e-4e57-bd3b-0c7bd1e0da41 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:07.134468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-85c8f74e-af3e-4e57-bd3b-0c7bd1e0da41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:07.191448 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:07.242680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607761b-a47c-4634-a05a-356683febacf None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:07.243007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607761b-a47c-4634-a05a-356683febacf None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:07.243274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607761b-a47c-4634-a05a-356683febacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:07.299156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8f74e-af3e-4e57-bd3b-0c7bd1e0da41 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:07.303202 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:07.309611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce42e7-5031-4299-bd2a-2814ecc845f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:07.310875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce42e7-5031-4299-bd2a-2814ecc845f1 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:07.311363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce42e7-5031-4299-bd2a-2814ecc845f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:07.313679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce42e7-5031-4299-bd2a-2814ecc845f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:07.325663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce42e7-5031-4299-bd2a-2814ecc845f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:07.328829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce42e7-5031-4299-bd2a-2814ecc845f1 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:07.356271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9607761b-a47c-4634-a05a-356683febacf None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:07.360558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9607761b-a47c-4634-a05a-356683febacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:07.361161 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2776/5572] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:27:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:27:07.467759 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2797/5573] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:27:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:27:07.507219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce42e7-5031-4299-bd2a-2814ecc845f1 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:07.508673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d3ce42e7-5031-4299-bd2a-2814ecc845f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:07.601141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce42e7-5031-4299-bd2a-2814ecc845f1 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:07.613241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fada90-9a0e-4a6b-9398-419d455b4373 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:07.613867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fada90-9a0e-4a6b-9398-419d455b4373 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:07.614151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fada90-9a0e-4a6b-9398-419d455b4373 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:07.614428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fada90-9a0e-4a6b-9398-419d455b4373 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:07.625971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fada90-9a0e-4a6b-9398-419d455b4373 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:07.627942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fada90-9a0e-4a6b-9398-419d455b4373 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:07.639348 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2777/5574] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:27:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:27:17.438840 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=28 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:17.633757 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=57 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:18.999166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607761b-a47c-4634-a05a-356683febacf None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:19.001325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9607761b-a47c-4634-a05a-356683febacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:19.109386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607761b-a47c-4634-a05a-356683febacf None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:19.113325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b3f27-39ae-433f-be00-576880a5f8e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:19.114079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b3f27-39ae-433f-be00-576880a5f8e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:19.117183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b3f27-39ae-433f-be00-576880a5f8e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:19.117183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b3f27-39ae-433f-be00-576880a5f8e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:19.117183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ba8b3f27-39ae-433f-be00-576880a5f8e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:19.204768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b3f27-39ae-433f-be00-576880a5f8e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:19.206414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b3f27-39ae-433f-be00-576880a5f8e1 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:19.234374 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2798/5575] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:27:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:27:22.838623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fada90-9a0e-4a6b-9398-419d455b4373 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:23.006193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fada90-9a0e-4a6b-9398-419d455b4373 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:23.012976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:23.013939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:23.015489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:23.016790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] PATH_INFO: `/v3/users/554662c41c244bf5b2720aced1f66355` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:23.020228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] RBAC: Authorizing `identity:delete_user(user_id=554662c41c244bf5b2720aced1f66355)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:23.022408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:23.104467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554662c41c244bf5b2720aced1f66355'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:23.128393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554662c41c244bf5b2720aced1f66355'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:23.129484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554662c41c244bf5b2720aced1f66355'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:23.143698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554662c41c244bf5b2720aced1f66355'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:23.161886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554662c41c244bf5b2720aced1f66355'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:23.172928 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2778/5576] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:27:22 2022] DELETE /identity/v3/users/554662c41c244bf5b2720aced1f66355 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:23.177443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ebb40-279d-4b7f-8de3-355a79c3fc2a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:23.177963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ebb40-279d-4b7f-8de3-355a79c3fc2a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:23.178035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ebb40-279d-4b7f-8de3-355a79c3fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:23.205568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dd5ebb40-279d-4b7f-8de3-355a79c3fc2a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:23.207148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dd5ebb40-279d-4b7f-8de3-355a79c3fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:23.418017 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2799/5577] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:23.433158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:23.435282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:23.601735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e72b9-1df9-4a08-8b46-b5b83e49787e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:23.612349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48beb2-ea2e-461d-81f0-c803144d9125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:23.613067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48beb2-ea2e-461d-81f0-c803144d9125 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:23.613457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48beb2-ea2e-461d-81f0-c803144d9125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:23.613807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48beb2-ea2e-461d-81f0-c803144d9125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:23.631964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48beb2-ea2e-461d-81f0-c803144d9125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:23.634903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48beb2-ea2e-461d-81f0-c803144d9125 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:23.652644 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2779/5578] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:27:25.207778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ebb40-279d-4b7f-8de3-355a79c3fc2a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:25.209342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dd5ebb40-279d-4b7f-8de3-355a79c3fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:25.244915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ebb40-279d-4b7f-8de3-355a79c3fc2a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:25.263833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:25.267028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:25.267564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:25.268266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] PATH_INFO: `/v3/projects/8aa90be9f4d34051b2d556a871bd960c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:25.272029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa90be9f4d34051b2d556a871bd960c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:25.281400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:25.404057 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:25.412202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa90be9f4d34051b2d556a871bd960c', 'request_id': 'req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:25.425523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa90be9f4d34051b2d556a871bd960c', 'request_id': 'req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:25.437880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa90be9f4d34051b2d556a871bd960c', 'request_id': 'req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:25.466693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] The token cache is being invalidate because project 8aa90be9f4d34051b2d556a871bd960c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:27:25.467001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:25.468294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8ad2006-c1e1-4ab4-ad43-027da9210d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:25.471120 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2800/5579] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:25 2022] DELETE /identity/v3/projects/8aa90be9f4d34051b2d556a871bd960c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:25.477789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bdf94-16ac-4fe4-a656-7677f2ee08cc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:25.478238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bdf94-16ac-4fe4-a656-7677f2ee08cc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:25.478406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bdf94-16ac-4fe4-a656-7677f2ee08cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:25.527643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-827bdf94-16ac-4fe4-a656-7677f2ee08cc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:25.528861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-827bdf94-16ac-4fe4-a656-7677f2ee08cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:25.570002 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:25.688791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2780/5580] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:25.695557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1048-d33f-4401-81b5-37d64a303a0d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:25.695845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1048-d33f-4401-81b5-37d64a303a0d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:25.696125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1048-d33f-4401-81b5-37d64a303a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:25.744476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ebdd1048-d33f-4401-81b5-37d64a303a0d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:25.747572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ebdd1048-d33f-4401-81b5-37d64a303a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:25.774521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bdf94-16ac-4fe4-a656-7677f2ee08cc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:25.777360 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2801/5581] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:25.786931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bdf94-16ac-4fe4-a656-7677f2ee08cc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:25.825415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a2b02-8365-4a0d-b802-078a0693a131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:25.826508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2b02-8365-4a0d-b802-078a0693a131 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:25.827309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2b02-8365-4a0d-b802-078a0693a131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:25.827862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2b02-8365-4a0d-b802-078a0693a131 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:25.828750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a2b02-8365-4a0d-b802-078a0693a131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:27:25.829271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a2b02-8365-4a0d-b802-078a0693a131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:25.834151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a2b02-8365-4a0d-b802-078a0693a131 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:25.880316 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2781/5582] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:25.883535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd1048-d33f-4401-81b5-37d64a303a0d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:25.901733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd1048-d33f-4401-81b5-37d64a303a0d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:25.927625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11652d51-136c-4cac-844e-452cffcd6ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:25.928266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11652d51-136c-4cac-844e-452cffcd6ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:25.928552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11652d51-136c-4cac-844e-452cffcd6ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:25.928834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11652d51-136c-4cac-844e-452cffcd6ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:25.929479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11652d51-136c-4cac-844e-452cffcd6ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:25.931796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11652d51-136c-4cac-844e-452cffcd6ef3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:26.018680 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2802/5583] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:25 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:26.022692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a2b02-8365-4a0d-b802-078a0693a131 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:26.040117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a2b02-8365-4a0d-b802-078a0693a131 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:26.228467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7476cc9-6bb0-4bda-989b-296a71b52ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:26.229195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7476cc9-6bb0-4bda-989b-296a71b52ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:26.229664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7476cc9-6bb0-4bda-989b-296a71b52ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:26.231068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7476cc9-6bb0-4bda-989b-296a71b52ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:26.232742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7476cc9-6bb0-4bda-989b-296a71b52ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:26.237353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7476cc9-6bb0-4bda-989b-296a71b52ac7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:26.319085 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2782/5584] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:27:26 2022] POST /identity/v3/users => generated 286 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:26.323476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11652d51-136c-4cac-844e-452cffcd6ef3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:26.373124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11652d51-136c-4cac-844e-452cffcd6ef3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:26.383308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654d32-b949-4bf9-ad2e-e9eb93051b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:26.384327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654d32-b949-4bf9-ad2e-e9eb93051b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:26.384804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654d32-b949-4bf9-ad2e-e9eb93051b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:26.385267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654d32-b949-4bf9-ad2e-e9eb93051b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:26.386116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9654d32-b949-4bf9-ad2e-e9eb93051b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:26.388045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9654d32-b949-4bf9-ad2e-e9eb93051b6c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:26.442721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7476cc9-6bb0-4bda-989b-296a71b52ac7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:26.446047 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2803/5585] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:26.458870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7476cc9-6bb0-4bda-989b-296a71b52ac7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:26.471437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e70a3-42d6-487c-a8d9-5ead63a2fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:26.472210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e70a3-42d6-487c-a8d9-5ead63a2fa18 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:26.472585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e70a3-42d6-487c-a8d9-5ead63a2fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:26.472956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e70a3-42d6-487c-a8d9-5ead63a2fa18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:26.473701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e70a3-42d6-487c-a8d9-5ead63a2fa18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:26.475651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e70a3-42d6-487c-a8d9-5ead63a2fa18 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:26.508199 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2783/5586] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:27:26.511996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654d32-b949-4bf9-ad2e-e9eb93051b6c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:26.544596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654d32-b949-4bf9-ad2e-e9eb93051b6c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:26.557466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8069dd-9926-4828-ae76-5d401c759065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:26.558941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8069dd-9926-4828-ae76-5d401c759065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:26.559554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8069dd-9926-4828-ae76-5d401c759065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:26.559976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8069dd-9926-4828-ae76-5d401c759065 admin admin] PATH_INFO: `/v3/projects/7ce2885c41b84891b0d65042005d94e4/users/13e85358685944ed89b6c3abffe88340/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:26.605257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8069dd-9926-4828-ae76-5d401c759065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce2885c41b84891b0d65042005d94e4, user_id=13e85358685944ed89b6c3abffe88340, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:26.613044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8069dd-9926-4828-ae76-5d401c759065 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:26.645155 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2804/5587] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:27:26 2022] PUT /identity/v3/projects/7ce2885c41b84891b0d65042005d94e4/users/13e85358685944ed89b6c3abffe88340/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:26.656765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ce753-81ab-4b7e-b9a9-6d2ea4e5f15d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:26.657198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ce753-81ab-4b7e-b9a9-6d2ea4e5f15d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:26.658234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ce753-81ab-4b7e-b9a9-6d2ea4e5f15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:26.716399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-337ce753-81ab-4b7e-b9a9-6d2ea4e5f15d None None] MFA Rules not processed for user `13e85358685944ed89b6c3abffe88340`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:26.718285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-337ce753-81ab-4b7e-b9a9-6d2ea4e5f15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:26.872884 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2784/5588] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:26.877917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8069dd-9926-4828-ae76-5d401c759065 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:27.004298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8069dd-9926-4828-ae76-5d401c759065 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:27.015582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e72f3-99ac-40a1-b9ee-269e30caad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:27.016357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e72f3-99ac-40a1-b9ee-269e30caad2e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:27.016734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e72f3-99ac-40a1-b9ee-269e30caad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:27.017206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e72f3-99ac-40a1-b9ee-269e30caad2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:27.017910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e72f3-99ac-40a1-b9ee-269e30caad2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:27.021173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e72f3-99ac-40a1-b9ee-269e30caad2e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:27.101578 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2805/5589] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:26 2022] POST /identity/v3/projects => generated 371 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:27.103572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ce753-81ab-4b7e-b9a9-6d2ea4e5f15d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:27.115787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ce753-81ab-4b7e-b9a9-6d2ea4e5f15d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:27.124929 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:27.235032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40066968-6c24-46ec-9eb3-86d2d855a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:27.236119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40066968-6c24-46ec-9eb3-86d2d855a505 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:27.239168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40066968-6c24-46ec-9eb3-86d2d855a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:27.239443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40066968-6c24-46ec-9eb3-86d2d855a505 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:27.240242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40066968-6c24-46ec-9eb3-86d2d855a505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:27.244983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40066968-6c24-46ec-9eb3-86d2d855a505 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:27.305428 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2785/5590] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:27:27 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:27.309354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e72f3-99ac-40a1-b9ee-269e30caad2e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:27.327695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e72f3-99ac-40a1-b9ee-269e30caad2e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:27.345425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76040f5e-7866-4e16-9992-e9537e56e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:27.346789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040f5e-7866-4e16-9992-e9537e56e760 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:27.347073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040f5e-7866-4e16-9992-e9537e56e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:27.347346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040f5e-7866-4e16-9992-e9537e56e760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:27.348001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76040f5e-7866-4e16-9992-e9537e56e760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:27.349625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76040f5e-7866-4e16-9992-e9537e56e760 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:27.378927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40066968-6c24-46ec-9eb3-86d2d855a505 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:27.386278 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2806/5591] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:27.392592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40066968-6c24-46ec-9eb3-86d2d855a505 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:27.404031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59aae09-cfcb-42fc-8c6a-d5888be55578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:27.405657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aae09-cfcb-42fc-8c6a-d5888be55578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:27.406091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aae09-cfcb-42fc-8c6a-d5888be55578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:27.406513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aae09-cfcb-42fc-8c6a-d5888be55578 admin admin] PATH_INFO: `/v3/projects/be7d9b3792cc48aaa3538cb3fe76f49b/users/a39d31bf11074304b0faeb63a349cda8/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:27.446547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59aae09-cfcb-42fc-8c6a-d5888be55578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7d9b3792cc48aaa3538cb3fe76f49b, user_id=a39d31bf11074304b0faeb63a349cda8, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:27.449908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59aae09-cfcb-42fc-8c6a-d5888be55578 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:27.482799 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2786/5592] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:27:27 2022] PUT /identity/v3/projects/be7d9b3792cc48aaa3538cb3fe76f49b/users/a39d31bf11074304b0faeb63a349cda8/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:27.486954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76040f5e-7866-4e16-9992-e9537e56e760 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:27.499509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76040f5e-7866-4e16-9992-e9537e56e760 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:27.598493 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:27.634102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb34c8-96e0-416e-88f1-eb7495afc853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:27.635010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb34c8-96e0-416e-88f1-eb7495afc853 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:27.635010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb34c8-96e0-416e-88f1-eb7495afc853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:27.635293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb34c8-96e0-416e-88f1-eb7495afc853 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:27.636278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb34c8-96e0-416e-88f1-eb7495afc853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:27.637900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb34c8-96e0-416e-88f1-eb7495afc853 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:27.655928 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2807/5593] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:27.660184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59aae09-cfcb-42fc-8c6a-d5888be55578 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:27.678890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59aae09-cfcb-42fc-8c6a-d5888be55578 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:27.688695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a328bb-e91f-4180-b86d-368d0b4b012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:27.689381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a328bb-e91f-4180-b86d-368d0b4b012c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:27.689656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a328bb-e91f-4180-b86d-368d0b4b012c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:27.689930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a328bb-e91f-4180-b86d-368d0b4b012c admin admin] PATH_INFO: `/v3/projects/be7d9b3792cc48aaa3538cb3fe76f49b/users/a39d31bf11074304b0faeb63a349cda8/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:27.694048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a328bb-e91f-4180-b86d-368d0b4b012c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7d9b3792cc48aaa3538cb3fe76f49b, user_id=a39d31bf11074304b0faeb63a349cda8, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:27.696961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a328bb-e91f-4180-b86d-368d0b4b012c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:27.722630 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2787/5594] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:27:27 2022] PUT /identity/v3/projects/be7d9b3792cc48aaa3538cb3fe76f49b/users/a39d31bf11074304b0faeb63a349cda8/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:27.735227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49afc-7b70-4669-b586-0e7df66ba7c9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:27.735917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49afc-7b70-4669-b586-0e7df66ba7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:27.736122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49afc-7b70-4669-b586-0e7df66ba7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:27.799295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-74c49afc-7b70-4669-b586-0e7df66ba7c9 None None] MFA Rules not processed for user `a39d31bf11074304b0faeb63a349cda8`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:27.814863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-74c49afc-7b70-4669-b586-0e7df66ba7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:27.958384 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2808/5595] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:27.963618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a328bb-e91f-4180-b86d-368d0b4b012c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:27.984296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a328bb-e91f-4180-b86d-368d0b4b012c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:28.010252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba7262-c4ea-4ef0-a1df-88c1e5a9a3a5 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:28.010840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba7262-c4ea-4ef0-a1df-88c1e5a9a3a5 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:28.011568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba7262-c4ea-4ef0-a1df-88c1e5a9a3a5 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:28.011568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba7262-c4ea-4ef0-a1df-88c1e5a9a3a5 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:28.015285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba7262-c4ea-4ef0-a1df-88c1e5a9a3a5 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:28.016368 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-04ba7262-c4ea-4ef0-a1df-88c1e5a9a3a5 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:27:28.016368 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:27:28.016368 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:27:28.017458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba7262-c4ea-4ef0-a1df-88c1e5a9a3a5 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:28.050469 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2788/5596] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:27 2022] POST /identity/v3/services => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:28.054373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c49afc-7b70-4669-b586-0e7df66ba7c9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:28.069038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c49afc-7b70-4669-b586-0e7df66ba7c9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:28.126925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce1029-3a9e-4e44-b5bf-a01bc1f2a55f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:28.128015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce1029-3a9e-4e44-b5bf-a01bc1f2a55f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:28.128320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce1029-3a9e-4e44-b5bf-a01bc1f2a55f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:28.128635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce1029-3a9e-4e44-b5bf-a01bc1f2a55f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:28.129468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce1029-3a9e-4e44-b5bf-a01bc1f2a55f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:28.131249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce1029-3a9e-4e44-b5bf-a01bc1f2a55f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:28.158906 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-d2ce1029-3a9e-4e44-b5bf-a01bc1f2a55f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1377910337. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:27:28.158906 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:27:28.158906 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:27:28.252811 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2809/5597] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:27:28 2022] POST /identity/v3/endpoints => generated 361 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:28.256535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba7262-c4ea-4ef0-a1df-88c1e5a9a3a5 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:28.317561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba7262-c4ea-4ef0-a1df-88c1e5a9a3a5 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:28.458893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556aa8a-24d1-4434-b420-84ff03aa4eb7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:28.459981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556aa8a-24d1-4434-b420-84ff03aa4eb7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:28.461129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556aa8a-24d1-4434-b420-84ff03aa4eb7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:28.461552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556aa8a-24d1-4434-b420-84ff03aa4eb7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/regions/tempest-region-1377910337` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:28.462164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556aa8a-24d1-4434-b420-84ff03aa4eb7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1377910337)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:28.467455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556aa8a-24d1-4434-b420-84ff03aa4eb7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:28.480010 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2789/5598] 10.222.0.23 () {58 vars in 1206 bytes} [Sun Oct 2 01:27:28 2022] GET /identity/v3/regions/tempest-region-1377910337 => generated 180 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:28.484605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce1029-3a9e-4e44-b5bf-a01bc1f2a55f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:28.498929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce1029-3a9e-4e44-b5bf-a01bc1f2a55f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:28.506475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f488a-4051-45bf-9d20-37881fcc7ca4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:28.508558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f488a-4051-45bf-9d20-37881fcc7ca4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:28.508866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f488a-4051-45bf-9d20-37881fcc7ca4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:28.510266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f488a-4051-45bf-9d20-37881fcc7ca4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:28.512462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f488a-4051-45bf-9d20-37881fcc7ca4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:28.515983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f488a-4051-45bf-9d20-37881fcc7ca4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:28.547161 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2810/5599] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:28 2022] POST /identity/v3/services => generated 288 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:28.551101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556aa8a-24d1-4434-b420-84ff03aa4eb7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:28.573352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556aa8a-24d1-4434-b420-84ff03aa4eb7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:28.646042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf1680-3c51-4830-adb2-7922bf3ab93d tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:28.646952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf1680-3c51-4830-adb2-7922bf3ab93d tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:28.647121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf1680-3c51-4830-adb2-7922bf3ab93d tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:28.647549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf1680-3c51-4830-adb2-7922bf3ab93d tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:28.648387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf1680-3c51-4830-adb2-7922bf3ab93d tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:28.651580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf1680-3c51-4830-adb2-7922bf3ab93d tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:28.713406 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-9eaf1680-3c51-4830-adb2-7922bf3ab93d tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1244668399. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:27:28.713406 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:27:28.713406 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:27:28.782508 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2790/5600] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:27:28 2022] POST /identity/v3/endpoints => generated 362 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:28.785866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f488a-4051-45bf-9d20-37881fcc7ca4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:28.804500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f488a-4051-45bf-9d20-37881fcc7ca4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:28.861734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a9ac6-8b4e-4c69-b81a-89a8150ea2c0 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:28.862865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a9ac6-8b4e-4c69-b81a-89a8150ea2c0 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:28.863373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a9ac6-8b4e-4c69-b81a-89a8150ea2c0 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:28.864275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a9ac6-8b4e-4c69-b81a-89a8150ea2c0 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/regions/tempest-region-1244668399` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:28.865170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a9ac6-8b4e-4c69-b81a-89a8150ea2c0 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1244668399)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:28.868522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a9ac6-8b4e-4c69-b81a-89a8150ea2c0 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:28.873408 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2811/5601] 10.222.0.23 () {58 vars in 1206 bytes} [Sun Oct 2 01:27:28 2022] GET /identity/v3/regions/tempest-region-1244668399 => generated 180 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:28.878147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf1680-3c51-4830-adb2-7922bf3ab93d tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:28.905986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf1680-3c51-4830-adb2-7922bf3ab93d tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:28.928834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d1137-0e8b-4371-9ca9-07ee684e2713 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:28.929238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d1137-0e8b-4371-9ca9-07ee684e2713 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:28.929520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d1137-0e8b-4371-9ca9-07ee684e2713 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:28.929792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d1137-0e8b-4371-9ca9-07ee684e2713 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:28.930480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d1137-0e8b-4371-9ca9-07ee684e2713 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:28.932665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d1137-0e8b-4371-9ca9-07ee684e2713 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:28.993293 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-fa8d1137-0e8b-4371-9ca9-07ee684e2713 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1576973608. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:27:28.993293 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:27:28.993293 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:27:29.033464 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2791/5602] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:27:28 2022] POST /identity/v3/endpoints => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:29.037653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a9ac6-8b4e-4c69-b81a-89a8150ea2c0 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.049721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a9ac6-8b4e-4c69-b81a-89a8150ea2c0 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.069735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dc295-7f38-4e37-b626-d357047db6c6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.070823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dc295-7f38-4e37-b626-d357047db6c6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.071329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dc295-7f38-4e37-b626-d357047db6c6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.071808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dc295-7f38-4e37-b626-d357047db6c6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/regions/tempest-region-1576973608` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.072603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dc295-7f38-4e37-b626-d357047db6c6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1576973608)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.075019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dc295-7f38-4e37-b626-d357047db6c6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:29.078708 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2812/5603] 10.222.0.23 () {58 vars in 1206 bytes} [Sun Oct 2 01:27:29 2022] GET /identity/v3/regions/tempest-region-1576973608 => generated 180 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:29.082972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d1137-0e8b-4371-9ca9-07ee684e2713 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.103415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d1137-0e8b-4371-9ca9-07ee684e2713 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.115979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70649cbd-31bf-4f50-a00b-6e9c62437214 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.116609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649cbd-31bf-4f50-a00b-6e9c62437214 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.116895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649cbd-31bf-4f50-a00b-6e9c62437214 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.117168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649cbd-31bf-4f50-a00b-6e9c62437214 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.117796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70649cbd-31bf-4f50-a00b-6e9c62437214 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.118848 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-70649cbd-31bf-4f50-a00b-6e9c62437214 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:27:29.118848 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:27:29.118848 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:27:29.119743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70649cbd-31bf-4f50-a00b-6e9c62437214 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:29.164542 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2792/5604] 10.222.0.23 () {58 vars in 1134 bytes} [Sun Oct 2 01:27:29 2022] GET /identity/v3/endpoints => generated 4398 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:29.169253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dc295-7f38-4e37-b626-d357047db6c6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.189322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dc295-7f38-4e37-b626-d357047db6c6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.196008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848377c3-a3da-4daf-bd91-a891e478fb83 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.196815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848377c3-a3da-4daf-bd91-a891e478fb83 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.197099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848377c3-a3da-4daf-bd91-a891e478fb83 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.197374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848377c3-a3da-4daf-bd91-a891e478fb83 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints/7a7954adec52407cadace1b86ade9465` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.204861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848377c3-a3da-4daf-bd91-a891e478fb83 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=7a7954adec52407cadace1b86ade9465)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.205879 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-848377c3-a3da-4daf-bd91-a891e478fb83 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:27:29.205879 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:27:29.205879 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:27:29.207746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848377c3-a3da-4daf-bd91-a891e478fb83 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:29.210221 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2813/5605] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:29 2022] GET /identity/v3/endpoints/7a7954adec52407cadace1b86ade9465 => generated 361 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:29.214037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70649cbd-31bf-4f50-a00b-6e9c62437214 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.219655 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:29.227533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70649cbd-31bf-4f50-a00b-6e9c62437214 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.246841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c14431-3579-4f71-a464-bb6960021508 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.247427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c14431-3579-4f71-a464-bb6960021508 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.247708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c14431-3579-4f71-a464-bb6960021508 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.247981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c14431-3579-4f71-a464-bb6960021508 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints/7a7954adec52407cadace1b86ade9465` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.249655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c14431-3579-4f71-a464-bb6960021508 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7a7954adec52407cadace1b86ade9465)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.250724 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-b2c14431-3579-4f71-a464-bb6960021508 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:27:29.250724 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:27:29.250724 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:27:29.251615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c14431-3579-4f71-a464-bb6960021508 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:29.269440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2c14431-3579-4f71-a464-bb6960021508 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7a7954adec52407cadace1b86ade9465', 'request_id': 'req-b2c14431-3579-4f71-a464-bb6960021508'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:29.317225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848377c3-a3da-4daf-bd91-a891e478fb83 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.317656 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2793/5606] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:29 2022] DELETE /identity/v3/endpoints/7a7954adec52407cadace1b86ade9465 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:29.331013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848377c3-a3da-4daf-bd91-a891e478fb83 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.374354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07a628-e81b-4613-bc48-9e36ed27872a tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.375266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07a628-e81b-4613-bc48-9e36ed27872a tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.375666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07a628-e81b-4613-bc48-9e36ed27872a tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.376058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07a628-e81b-4613-bc48-9e36ed27872a tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.376751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07a628-e81b-4613-bc48-9e36ed27872a tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.381184 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-cf07a628-e81b-4613-bc48-9e36ed27872a tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:27:29.381184 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:27:29.381184 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:27:29.382391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07a628-e81b-4613-bc48-9e36ed27872a tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:29.404251 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2814/5607] 10.222.0.23 () {58 vars in 1134 bytes} [Sun Oct 2 01:27:29 2022] GET /identity/v3/endpoints => generated 4050 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:29.409086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c14431-3579-4f71-a464-bb6960021508 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.427271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c14431-3579-4f71-a464-bb6960021508 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.443763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4c06e-c0ca-4518-b126-c84da90c97a4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.445161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4c06e-c0ca-4518-b126-c84da90c97a4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.445471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4c06e-c0ca-4518-b126-c84da90c97a4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.445988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4c06e-c0ca-4518-b126-c84da90c97a4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints/7a7954adec52407cadace1b86ade9465` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.459057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4c06e-c0ca-4518-b126-c84da90c97a4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b2a4c06e-c0ca-4518-b126-c84da90c97a4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Could not find endpoint: 7a7954adec52407cadace1b86ade9465.: keystone.exception.EndpointNotFound: Could not find endpoint: 7a7954adec52407cadace1b86ade9465. Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._iter().one() Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._only_one_row( Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:27:29.501702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 7a7954adec52407cadace1b86ade9465. Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:27:29.502977 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:27:29.504085 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 7a7954adec52407cadace1b86ade9465. Oct 02 01:27:29.505164 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:27:29.507223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07a628-e81b-4613-bc48-9e36ed27872a tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.508337 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2794/5608] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:29 2022] DELETE /identity/v3/endpoints/7a7954adec52407cadace1b86ade9465 => generated 114 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:27:29.517304 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:29.528867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07a628-e81b-4613-bc48-9e36ed27872a tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.542006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2ac4-32ae-4410-9a2b-f8a5a8006d7c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.542944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2ac4-32ae-4410-9a2b-f8a5a8006d7c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.543374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2ac4-32ae-4410-9a2b-f8a5a8006d7c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.543655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2ac4-32ae-4410-9a2b-f8a5a8006d7c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/regions/tempest-region-1576973608` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.544402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b2ac4-32ae-4410-9a2b-f8a5a8006d7c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1576973608)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.549769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b2ac4-32ae-4410-9a2b-f8a5a8006d7c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:29.582779 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-583b2ac4-32ae-4410-9a2b-f8a5a8006d7c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1576973608. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:27:29.582779 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:27:29.582779 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:27:29.597805 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2815/5609] 10.222.0.23 () {58 vars in 1209 bytes} [Sun Oct 2 01:27:29 2022] DELETE /identity/v3/regions/tempest-region-1576973608 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:29.599413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4c06e-c0ca-4518-b126-c84da90c97a4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.615440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4c06e-c0ca-4518-b126-c84da90c97a4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.655959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505423c9-b1ae-4b35-bc37-534a5b401183 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.656866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505423c9-b1ae-4b35-bc37-534a5b401183 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.657306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505423c9-b1ae-4b35-bc37-534a5b401183 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.657724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505423c9-b1ae-4b35-bc37-534a5b401183 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.658507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505423c9-b1ae-4b35-bc37-534a5b401183 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.660612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505423c9-b1ae-4b35-bc37-534a5b401183 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:29.690530 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2795/5610] 10.222.0.23 () {58 vars in 1134 bytes} [Sun Oct 2 01:27:29 2022] GET /identity/v3/endpoints => generated 4050 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:29.695386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2ac4-32ae-4410-9a2b-f8a5a8006d7c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.719958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2ac4-32ae-4410-9a2b-f8a5a8006d7c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.732739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e323fd-79a7-40eb-9f74-f69072dec9ef tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.733604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e323fd-79a7-40eb-9f74-f69072dec9ef tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.734087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e323fd-79a7-40eb-9f74-f69072dec9ef tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.734555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e323fd-79a7-40eb-9f74-f69072dec9ef tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.735287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e323fd-79a7-40eb-9f74-f69072dec9ef tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Adding query filter params (service_id=ddd467798c4b402d81f129f832b6494a) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:27:29.735609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e323fd-79a7-40eb-9f74-f69072dec9ef tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.737213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e323fd-79a7-40eb-9f74-f69072dec9ef tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:29.769489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505423c9-b1ae-4b35-bc37-534a5b401183 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.787622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505423c9-b1ae-4b35-bc37-534a5b401183 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.788331 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2816/5611] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:27:29 2022] GET /identity/v3/endpoints?service_id=ddd467798c4b402d81f129f832b6494a => generated 503 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:29.812546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002b3f5-b3b3-42ba-ae93-9671a08f7552 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.813237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002b3f5-b3b3-42ba-ae93-9671a08f7552 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.813681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002b3f5-b3b3-42ba-ae93-9671a08f7552 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.814090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002b3f5-b3b3-42ba-ae93-9671a08f7552 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.814927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002b3f5-b3b3-42ba-ae93-9671a08f7552 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Adding query filter params (service_id=f93b768decab4709abb4469b1b1250e7) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:27:29.815384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002b3f5-b3b3-42ba-ae93-9671a08f7552 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.817160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002b3f5-b3b3-42ba-ae93-9671a08f7552 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:29.841248 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2796/5612] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:27:29 2022] GET /identity/v3/endpoints?service_id=f93b768decab4709abb4469b1b1250e7 => generated 504 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:27:29.843110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e323fd-79a7-40eb-9f74-f69072dec9ef tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.855919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e323fd-79a7-40eb-9f74-f69072dec9ef tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.867338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128507c-8fdb-4c3e-bbf4-864c416e5425 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.867962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128507c-8fdb-4c3e-bbf4-864c416e5425 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.868414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128507c-8fdb-4c3e-bbf4-864c416e5425 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.868838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128507c-8fdb-4c3e-bbf4-864c416e5425 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.869657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128507c-8fdb-4c3e-bbf4-864c416e5425 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:27:29.870115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128507c-8fdb-4c3e-bbf4-864c416e5425 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.876060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128507c-8fdb-4c3e-bbf4-864c416e5425 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:29.901162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002b3f5-b3b3-42ba-ae93-9671a08f7552 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.902397 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2817/5613] 10.222.0.23 () {58 vars in 1167 bytes} [Sun Oct 2 01:27:29 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:29.915404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002b3f5-b3b3-42ba-ae93-9671a08f7552 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.931367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e2d20-4aae-4c9e-a367-5240daedb08f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.932601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e2d20-4aae-4c9e-a367-5240daedb08f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.933035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e2d20-4aae-4c9e-a367-5240daedb08f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.933460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e2d20-4aae-4c9e-a367-5240daedb08f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.934256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e2d20-4aae-4c9e-a367-5240daedb08f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:27:29.934747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e2d20-4aae-4c9e-a367-5240daedb08f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.936670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e2d20-4aae-4c9e-a367-5240daedb08f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:29.954549 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2797/5614] 10.222.0.23 () {58 vars in 1171 bytes} [Sun Oct 2 01:27:29 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:29.956370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128507c-8fdb-4c3e-bbf4-864c416e5425 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:29.970931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128507c-8fdb-4c3e-bbf4-864c416e5425 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:29.994450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43515e50-bfd7-4689-93fc-c194f6a7dee7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:29.994450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43515e50-bfd7-4689-93fc-c194f6a7dee7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:29.994450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43515e50-bfd7-4689-93fc-c194f6a7dee7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:29.994921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43515e50-bfd7-4689-93fc-c194f6a7dee7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:29.994921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43515e50-bfd7-4689-93fc-c194f6a7dee7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:29.994921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43515e50-bfd7-4689-93fc-c194f6a7dee7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:30.038023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e2d20-4aae-4c9e-a367-5240daedb08f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:30.039152 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2818/5615] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:29 2022] POST /identity/v3/services => generated 288 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:30.049588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e2d20-4aae-4c9e-a367-5240daedb08f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:30.091399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177982f7-b4d4-4bb0-8c68-eb3e36d7313e tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:30.091929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177982f7-b4d4-4bb0-8c68-eb3e36d7313e tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:30.092343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177982f7-b4d4-4bb0-8c68-eb3e36d7313e tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:30.092729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177982f7-b4d4-4bb0-8c68-eb3e36d7313e tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:30.093416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177982f7-b4d4-4bb0-8c68-eb3e36d7313e tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:30.095068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177982f7-b4d4-4bb0-8c68-eb3e36d7313e tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:30.134581 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-177982f7-b4d4-4bb0-8c68-eb3e36d7313e tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1576132566. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:27:30.134581 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:27:30.134581 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:27:30.192583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43515e50-bfd7-4689-93fc-c194f6a7dee7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:30.192858 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2798/5616] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 2 01:27:30 2022] POST /identity/v3/endpoints => generated 361 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:27:30.197535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43515e50-bfd7-4689-93fc-c194f6a7dee7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:30.236138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e3861-2c7f-4358-b632-3a7f67fa6a16 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:30.236791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e3861-2c7f-4358-b632-3a7f67fa6a16 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:30.237067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e3861-2c7f-4358-b632-3a7f67fa6a16 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:30.237347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e3861-2c7f-4358-b632-3a7f67fa6a16 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/regions/tempest-region-1576132566` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:30.237935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e3861-2c7f-4358-b632-3a7f67fa6a16 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1576132566)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:30.239035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e3861-2c7f-4358-b632-3a7f67fa6a16 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:30.245054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177982f7-b4d4-4bb0-8c68-eb3e36d7313e tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:30.252459 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2819/5617] 10.222.0.23 () {58 vars in 1206 bytes} [Sun Oct 2 01:27:30 2022] GET /identity/v3/regions/tempest-region-1576132566 => generated 180 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:30.261176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177982f7-b4d4-4bb0-8c68-eb3e36d7313e tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:30.275157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31c0ea-fccf-47fe-a695-6b029b063380 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:30.275822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31c0ea-fccf-47fe-a695-6b029b063380 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:30.276105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31c0ea-fccf-47fe-a695-6b029b063380 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:30.276376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31c0ea-fccf-47fe-a695-6b029b063380 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints/9172fb9663d84584a2632b543d8626c6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:30.288686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31c0ea-fccf-47fe-a695-6b029b063380 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=9172fb9663d84584a2632b543d8626c6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:30.291340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31c0ea-fccf-47fe-a695-6b029b063380 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:30.376094 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-4f31c0ea-fccf-47fe-a695-6b029b063380 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1953922466. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:27:30.376094 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:27:30.376094 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:27:30.421152 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2799/5618] 10.222.0.23 () {60 vars in 1256 bytes} [Sun Oct 2 01:27:30 2022] PATCH /identity/v3/endpoints/9172fb9663d84584a2632b543d8626c6 => generated 364 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:27:30.424885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e3861-2c7f-4358-b632-3a7f67fa6a16 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:30.447109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e3861-2c7f-4358-b632-3a7f67fa6a16 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:30.485302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1901-6f2a-473c-9b47-8a43522cf066 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:30.485970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1901-6f2a-473c-9b47-8a43522cf066 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:30.486259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1901-6f2a-473c-9b47-8a43522cf066 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:30.486548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1901-6f2a-473c-9b47-8a43522cf066 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/regions/tempest-region-1953922466` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:30.487193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b1901-6f2a-473c-9b47-8a43522cf066 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1953922466)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:30.488727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b1901-6f2a-473c-9b47-8a43522cf066 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:30.500238 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2820/5619] 10.222.0.23 () {58 vars in 1206 bytes} [Sun Oct 2 01:27:30 2022] GET /identity/v3/regions/tempest-region-1953922466 => generated 180 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:30.501344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31c0ea-fccf-47fe-a695-6b029b063380 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:30.518654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31c0ea-fccf-47fe-a695-6b029b063380 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:30.528720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73693f23-9674-4140-94fc-c6a553569722 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:30.529389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693f23-9674-4140-94fc-c6a553569722 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:30.530837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693f23-9674-4140-94fc-c6a553569722 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:30.531212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693f23-9674-4140-94fc-c6a553569722 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints/9172fb9663d84584a2632b543d8626c6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:30.544682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73693f23-9674-4140-94fc-c6a553569722 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=9172fb9663d84584a2632b543d8626c6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:30.546910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73693f23-9674-4140-94fc-c6a553569722 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:30.563476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-73693f23-9674-4140-94fc-c6a553569722 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '9172fb9663d84584a2632b543d8626c6', 'request_id': 'req-73693f23-9674-4140-94fc-c6a553569722'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:30.588790 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2800/5620] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:30 2022] DELETE /identity/v3/endpoints/9172fb9663d84584a2632b543d8626c6 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:27:30.597526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1901-6f2a-473c-9b47-8a43522cf066 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:30.642230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1901-6f2a-473c-9b47-8a43522cf066 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:30.667426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b6545-cba6-40c6-9d4a-5d30ee08732c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:30.668979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6545-cba6-40c6-9d4a-5d30ee08732c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:30.669533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6545-cba6-40c6-9d4a-5d30ee08732c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:30.670212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6545-cba6-40c6-9d4a-5d30ee08732c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/regions/tempest-region-1953922466` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:30.671619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b6545-cba6-40c6-9d4a-5d30ee08732c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1953922466)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:30.673627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b6545-cba6-40c6-9d4a-5d30ee08732c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:30.689529 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-e09b6545-cba6-40c6-9d4a-5d30ee08732c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1953922466. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:27:30.689529 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:27:30.689529 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:27:30.700067 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2821/5621] 10.222.0.23 () {58 vars in 1209 bytes} [Sun Oct 2 01:27:30 2022] DELETE /identity/v3/regions/tempest-region-1953922466 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:30.704413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73693f23-9674-4140-94fc-c6a553569722 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:30.727868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73693f23-9674-4140-94fc-c6a553569722 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:30.753867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49c980-3f39-41ac-aa2f-c526756ff3c7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:30.754502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49c980-3f39-41ac-aa2f-c526756ff3c7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:30.754810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49c980-3f39-41ac-aa2f-c526756ff3c7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:30.755087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49c980-3f39-41ac-aa2f-c526756ff3c7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/regions/tempest-region-1576132566` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:30.755674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49c980-3f39-41ac-aa2f-c526756ff3c7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1576132566)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:30.757455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49c980-3f39-41ac-aa2f-c526756ff3c7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:30.801826 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2801/5622] 10.222.0.23 () {58 vars in 1209 bytes} [Sun Oct 2 01:27:30 2022] DELETE /identity/v3/regions/tempest-region-1576132566 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:30.806406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b6545-cba6-40c6-9d4a-5d30ee08732c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:30.826076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b6545-cba6-40c6-9d4a-5d30ee08732c tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:30.881822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445faab-fe2f-43c5-9810-97de2b12fb99 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:30.882710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445faab-fe2f-43c5-9810-97de2b12fb99 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:30.883062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445faab-fe2f-43c5-9810-97de2b12fb99 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:30.883413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445faab-fe2f-43c5-9810-97de2b12fb99 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/services/45a78d9c67b34be294899f2770fd180c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:30.884240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445faab-fe2f-43c5-9810-97de2b12fb99 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_service(service_id=45a78d9c67b34be294899f2770fd180c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:30.887238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445faab-fe2f-43c5-9810-97de2b12fb99 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:30.940375 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2822/5623] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:30 2022] DELETE /identity/v3/services/45a78d9c67b34be294899f2770fd180c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:30.946004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49c980-3f39-41ac-aa2f-c526756ff3c7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:30.964405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49c980-3f39-41ac-aa2f-c526756ff3c7 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:30.997631 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:31.002486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc0ada-46a4-49a9-9af0-0d17cf244c9f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:31.006855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0ada-46a4-49a9-9af0-0d17cf244c9f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:31.007202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0ada-46a4-49a9-9af0-0d17cf244c9f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:31.007492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0ada-46a4-49a9-9af0-0d17cf244c9f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints/6c5f1cd6898e4f4482069d9fa5ec6473` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:31.020268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc0ada-46a4-49a9-9af0-0d17cf244c9f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=6c5f1cd6898e4f4482069d9fa5ec6473)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:31.022215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc0ada-46a4-49a9-9af0-0d17cf244c9f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:31.035402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-25dc0ada-46a4-49a9-9af0-0d17cf244c9f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '6c5f1cd6898e4f4482069d9fa5ec6473', 'request_id': 'req-25dc0ada-46a4-49a9-9af0-0d17cf244c9f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:31.059691 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2802/5624] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:30 2022] DELETE /identity/v3/endpoints/6c5f1cd6898e4f4482069d9fa5ec6473 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:31.064305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445faab-fe2f-43c5-9810-97de2b12fb99 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:31.081935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445faab-fe2f-43c5-9810-97de2b12fb99 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:31.127486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66891eb5-6bbe-4902-bbcb-8cf94988d7b3 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:31.128060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66891eb5-6bbe-4902-bbcb-8cf94988d7b3 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:31.128345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66891eb5-6bbe-4902-bbcb-8cf94988d7b3 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:31.128624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66891eb5-6bbe-4902-bbcb-8cf94988d7b3 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/regions/tempest-region-1244668399` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:31.129214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66891eb5-6bbe-4902-bbcb-8cf94988d7b3 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1244668399)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:31.130844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66891eb5-6bbe-4902-bbcb-8cf94988d7b3 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:31.158493 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-66891eb5-6bbe-4902-bbcb-8cf94988d7b3 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1244668399. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:27:31.158493 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:27:31.158493 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:27:31.171172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc0ada-46a4-49a9-9af0-0d17cf244c9f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:31.177508 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2823/5625] 10.222.0.23 () {58 vars in 1209 bytes} [Sun Oct 2 01:27:31 2022] DELETE /identity/v3/regions/tempest-region-1244668399 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:27:31.189947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc0ada-46a4-49a9-9af0-0d17cf244c9f tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:31.234435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450172-4597-4293-93a3-ae0ffc24c8af tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:31.234435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450172-4597-4293-93a3-ae0ffc24c8af tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:31.234435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450172-4597-4293-93a3-ae0ffc24c8af tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:31.234906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450172-4597-4293-93a3-ae0ffc24c8af tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/services/f93b768decab4709abb4469b1b1250e7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:31.234906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51450172-4597-4293-93a3-ae0ffc24c8af tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f93b768decab4709abb4469b1b1250e7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:31.234906 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-51450172-4597-4293-93a3-ae0ffc24c8af tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:27:31.234906 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:27:31.234906 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:27:31.235268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51450172-4597-4293-93a3-ae0ffc24c8af tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:31.293439 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2803/5626] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:31 2022] DELETE /identity/v3/services/f93b768decab4709abb4469b1b1250e7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:31.293868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66891eb5-6bbe-4902-bbcb-8cf94988d7b3 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:31.311948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66891eb5-6bbe-4902-bbcb-8cf94988d7b3 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:31.329628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74cffe-65e1-4cf5-863a-2b53ab2ae7f4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:31.330641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74cffe-65e1-4cf5-863a-2b53ab2ae7f4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:31.331160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74cffe-65e1-4cf5-863a-2b53ab2ae7f4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:31.331659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74cffe-65e1-4cf5-863a-2b53ab2ae7f4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/endpoints/5314d8c1b10c4feebb01a22c7164ba0f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:31.337138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74cffe-65e1-4cf5-863a-2b53ab2ae7f4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5314d8c1b10c4feebb01a22c7164ba0f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:31.338893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74cffe-65e1-4cf5-863a-2b53ab2ae7f4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:31.351914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd74cffe-65e1-4cf5-863a-2b53ab2ae7f4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5314d8c1b10c4feebb01a22c7164ba0f', 'request_id': 'req-bd74cffe-65e1-4cf5-863a-2b53ab2ae7f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:31.370963 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2824/5627] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:31 2022] DELETE /identity/v3/endpoints/5314d8c1b10c4feebb01a22c7164ba0f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:31.375586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450172-4597-4293-93a3-ae0ffc24c8af tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:31.391689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450172-4597-4293-93a3-ae0ffc24c8af tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:31.425046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb16c5-2640-4b31-babb-5c78ea0875f6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:31.425843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb16c5-2640-4b31-babb-5c78ea0875f6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:31.426241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb16c5-2640-4b31-babb-5c78ea0875f6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:31.427425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb16c5-2640-4b31-babb-5c78ea0875f6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/regions/tempest-region-1377910337` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:31.428401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb16c5-2640-4b31-babb-5c78ea0875f6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1377910337)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:31.430786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb16c5-2640-4b31-babb-5c78ea0875f6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:31.453188 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-fbcb16c5-2640-4b31-babb-5c78ea0875f6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1377910337. To ensure interoperability, identifiers should be a valid uuid. Oct 02 01:27:31.453188 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 02 01:27:31.453188 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:27:31.472887 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2804/5628] 10.222.0.23 () {58 vars in 1209 bytes} [Sun Oct 2 01:27:31 2022] DELETE /identity/v3/regions/tempest-region-1377910337 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:31.474277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74cffe-65e1-4cf5-863a-2b53ab2ae7f4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:31.486660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74cffe-65e1-4cf5-863a-2b53ab2ae7f4 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:31.503856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1ece3-d3a2-42d4-a6be-84b9e1fc1898 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39d31bf11074304b0faeb63a349cda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:31.504857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ece3-d3a2-42d4-a6be-84b9e1fc1898 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:31.505141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ece3-d3a2-42d4-a6be-84b9e1fc1898 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:31.505420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ece3-d3a2-42d4-a6be-84b9e1fc1898 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] PATH_INFO: `/v3/services/ddd467798c4b402d81f129f832b6494a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:31.506094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1ece3-d3a2-42d4-a6be-84b9e1fc1898 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ddd467798c4b402d81f129f832b6494a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:31.507730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1ece3-d3a2-42d4-a6be-84b9e1fc1898 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:31.509396 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:31.539114 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2825/5629] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:31 2022] DELETE /identity/v3/services/ddd467798c4b402d81f129f832b6494a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:31.540349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb16c5-2640-4b31-babb-5c78ea0875f6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:31.662643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb16c5-2640-4b31-babb-5c78ea0875f6 tempest-EndPointsTestJSON-1973676227 tempest-EndPointsTestJSON-1973676227-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:31.763421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:31.764165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:31.765123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:31.765408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] PATH_INFO: `/v3/users/13e85358685944ed89b6c3abffe88340` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:31.767396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e85358685944ed89b6c3abffe88340)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:31.769391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:31.933896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e85358685944ed89b6c3abffe88340'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:31.951069 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=13 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:31.958014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e85358685944ed89b6c3abffe88340'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:31.980252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e85358685944ed89b6c3abffe88340'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:32.024092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e85358685944ed89b6c3abffe88340'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:32.038568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e85358685944ed89b6c3abffe88340'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:32.049970 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2805/5630] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:27:31 2022] DELETE /identity/v3/users/13e85358685944ed89b6c3abffe88340 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:32.054081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aa4e3-abdd-482c-8c86-677d75c086f2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:32.054693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aa4e3-abdd-482c-8c86-677d75c086f2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:32.054693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aa4e3-abdd-482c-8c86-677d75c086f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:32.086369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-758aa4e3-abdd-482c-8c86-677d75c086f2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:32.087660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-758aa4e3-abdd-482c-8c86-677d75c086f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:32.263783 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2826/5631] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:32.273790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:32.275352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:32.406930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c0aab-6a23-4ea5-86dd-ad7c1b497a2b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:32.412469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f8a42-338f-4103-8831-3aa165cf4d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:32.413913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f8a42-338f-4103-8831-3aa165cf4d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:32.414395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f8a42-338f-4103-8831-3aa165cf4d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:32.414515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f8a42-338f-4103-8831-3aa165cf4d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:32.429630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f8a42-338f-4103-8831-3aa165cf4d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:32.431078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f8a42-338f-4103-8831-3aa165cf4d79 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:32.464195 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2806/5632] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:27:33.453806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aa4e3-abdd-482c-8c86-677d75c086f2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:33.456144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-758aa4e3-abdd-482c-8c86-677d75c086f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:33.478306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aa4e3-abdd-482c-8c86-677d75c086f2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:33.488439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:33.489444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:33.490512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:33.491428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] PATH_INFO: `/v3/projects/7ce2885c41b84891b0d65042005d94e4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:33.495700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce2885c41b84891b0d65042005d94e4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:33.502776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:33.625490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce2885c41b84891b0d65042005d94e4', 'request_id': 'req-97565593-85d3-42f8-b611-ca05276cf4fc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:33.637471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce2885c41b84891b0d65042005d94e4', 'request_id': 'req-97565593-85d3-42f8-b611-ca05276cf4fc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:33.660001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce2885c41b84891b0d65042005d94e4', 'request_id': 'req-97565593-85d3-42f8-b611-ca05276cf4fc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:33.687641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] The token cache is being invalidate because project 7ce2885c41b84891b0d65042005d94e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:27:33.688114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:33.689374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:33.697491 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2827/5633] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:33 2022] DELETE /identity/v3/projects/7ce2885c41b84891b0d65042005d94e4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:33.699087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f8a42-338f-4103-8831-3aa165cf4d79 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:33.719719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f8a42-338f-4103-8831-3aa165cf4d79 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:33.902669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:33.903481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:33.904042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:33.904446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] PATH_INFO: `/v3/users/a39d31bf11074304b0faeb63a349cda8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:33.906522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39d31bf11074304b0faeb63a349cda8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:33.909431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:34.047134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39d31bf11074304b0faeb63a349cda8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:34.090269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39d31bf11074304b0faeb63a349cda8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:34.091345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39d31bf11074304b0faeb63a349cda8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:34.130393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39d31bf11074304b0faeb63a349cda8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:34.136661 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:34.167746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39d31bf11074304b0faeb63a349cda8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:34.189554 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2807/5634] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:27:33 2022] DELETE /identity/v3/users/a39d31bf11074304b0faeb63a349cda8 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:34.431868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:34.434121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:34.671271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565593-85d3-42f8-b611-ca05276cf4fc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:34.698976 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:34.808489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f2d82-3a83-44c1-a0e2-623f21078484 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:34.809118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f2d82-3a83-44c1-a0e2-623f21078484 service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:34.809400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f2d82-3a83-44c1-a0e2-623f21078484 service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:34.810009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f2d82-3a83-44c1-a0e2-623f21078484 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:34.814239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d12f2d82-3a83-44c1-a0e2-623f21078484 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:34.972245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f2d82-3a83-44c1-a0e2-623f21078484 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:34.973710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f2d82-3a83-44c1-a0e2-623f21078484 service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:35.020620 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2828/5635] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:27:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:27:35.117366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:35.119721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:35.238785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbddb8-a7a5-4dda-8083-12e920aab773 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:35.242715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef7380-29fe-498f-8259-dc45d5dad8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:35.243335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef7380-29fe-498f-8259-dc45d5dad8dc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:35.243612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef7380-29fe-498f-8259-dc45d5dad8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:35.243886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef7380-29fe-498f-8259-dc45d5dad8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:35.245662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3aef7380-29fe-498f-8259-dc45d5dad8dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:35.259383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef7380-29fe-498f-8259-dc45d5dad8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:35.260990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef7380-29fe-498f-8259-dc45d5dad8dc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:35.283525 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2808/5636] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:27:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:27:35.455665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f2d82-3a83-44c1-a0e2-623f21078484 service glance] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:35.458536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d12f2d82-3a83-44c1-a0e2-623f21078484 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:35.508271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f2d82-3a83-44c1-a0e2-623f21078484 service glance] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:35.526733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50348dd1-1730-404f-9733-4d29f499a9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:35.527863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50348dd1-1730-404f-9733-4d29f499a9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:35.527863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50348dd1-1730-404f-9733-4d29f499a9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:35.528401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50348dd1-1730-404f-9733-4d29f499a9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:35.537028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-50348dd1-1730-404f-9733-4d29f499a9d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:35.576352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50348dd1-1730-404f-9733-4d29f499a9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:35.578011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50348dd1-1730-404f-9733-4d29f499a9d3 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:35.621395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef7380-29fe-498f-8259-dc45d5dad8dc service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:35.623677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3aef7380-29fe-498f-8259-dc45d5dad8dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:35.643081 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2829/5637] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:27:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:27:35.825890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef7380-29fe-498f-8259-dc45d5dad8dc service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:35.831772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:35.832776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:35.833384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:35.834177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] PATH_INFO: `/v3/projects/be7d9b3792cc48aaa3538cb3fe76f49b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:35.841338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7d9b3792cc48aaa3538cb3fe76f49b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:35.848022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:35.986593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'request_id': 'req-3b5a9c98-5656-4249-9e47-a8099a127a01'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:36.015387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'request_id': 'req-3b5a9c98-5656-4249-9e47-a8099a127a01'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:36.029217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7d9b3792cc48aaa3538cb3fe76f49b', 'request_id': 'req-3b5a9c98-5656-4249-9e47-a8099a127a01'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:36.053284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] The token cache is being invalidate because project be7d9b3792cc48aaa3538cb3fe76f49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:27:36.053585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:36.055221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3b5a9c98-5656-4249-9e47-a8099a127a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:36.064332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c431-8d2b-4517-b50b-173e0e19523f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:36.064943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c431-8d2b-4517-b50b-173e0e19523f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:36.064943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c431-8d2b-4517-b50b-173e0e19523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:36.067638 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2809/5638] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:35 2022] DELETE /identity/v3/projects/be7d9b3792cc48aaa3538cb3fe76f49b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:27:36.101241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ad98c431-8d2b-4517-b50b-173e0e19523f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:36.105240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ad98c431-8d2b-4517-b50b-173e0e19523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:36.284846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58a2ad-c69f-4060-b1bc-1e93d22ae184 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:36.285341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58a2ad-c69f-4060-b1bc-1e93d22ae184 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:36.285341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58a2ad-c69f-4060-b1bc-1e93d22ae184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:36.289132 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2830/5639] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:36.322999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bd58a2ad-c69f-4060-b1bc-1e93d22ae184 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:36.325262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bd58a2ad-c69f-4060-b1bc-1e93d22ae184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:36.353853 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2810/5640] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:36.358621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98c431-8d2b-4517-b50b-173e0e19523f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:36.378419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98c431-8d2b-4517-b50b-173e0e19523f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:36.393975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6009cc6-2b88-4943-ad64-f55e2f4743bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:36.394666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6009cc6-2b88-4943-ad64-f55e2f4743bd admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:36.395000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6009cc6-2b88-4943-ad64-f55e2f4743bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:36.395278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6009cc6-2b88-4943-ad64-f55e2f4743bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:36.396887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6009cc6-2b88-4943-ad64-f55e2f4743bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:27:36.397265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6009cc6-2b88-4943-ad64-f55e2f4743bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:36.398960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6009cc6-2b88-4943-ad64-f55e2f4743bd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:36.419286 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2831/5641] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:36.420476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58a2ad-c69f-4060-b1bc-1e93d22ae184 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:36.433520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58a2ad-c69f-4060-b1bc-1e93d22ae184 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:36.464206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe56e-b5a8-4899-be65-68c783256364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:36.465744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe56e-b5a8-4899-be65-68c783256364 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:36.469625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe56e-b5a8-4899-be65-68c783256364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:36.470857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe56e-b5a8-4899-be65-68c783256364 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:36.472090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fe56e-b5a8-4899-be65-68c783256364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:36.476612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fe56e-b5a8-4899-be65-68c783256364 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:36.556745 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:36.601130 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2811/5642] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:36 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:36.613054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6009cc6-2b88-4943-ad64-f55e2f4743bd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:36.622222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6009cc6-2b88-4943-ad64-f55e2f4743bd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:36.671780 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:36.792692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faae14b-aaed-40ff-8911-93335203a31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:36.794489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae14b-aaed-40ff-8911-93335203a31d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:36.794781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae14b-aaed-40ff-8911-93335203a31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:36.797801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae14b-aaed-40ff-8911-93335203a31d admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:36.798855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faae14b-aaed-40ff-8911-93335203a31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:36.804884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faae14b-aaed-40ff-8911-93335203a31d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:36.860733 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2832/5643] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:27:36 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:36.867162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe56e-b5a8-4899-be65-68c783256364 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:36.891391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe56e-b5a8-4899-be65-68c783256364 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:36.907723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692d663-7c2e-45a4-b5cf-fe5af07853db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:36.908298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d663-7c2e-45a4-b5cf-fe5af07853db admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:36.910712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d663-7c2e-45a4-b5cf-fe5af07853db admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:36.911194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d663-7c2e-45a4-b5cf-fe5af07853db admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:36.911893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692d663-7c2e-45a4-b5cf-fe5af07853db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:36.913515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692d663-7c2e-45a4-b5cf-fe5af07853db admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:36.943022 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2812/5644] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:36.948069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faae14b-aaed-40ff-8911-93335203a31d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:36.986324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faae14b-aaed-40ff-8911-93335203a31d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:37.010535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc9eea-aeff-4a75-9d52-4f5082078974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:37.011417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9eea-aeff-4a75-9d52-4f5082078974 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:37.011854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9eea-aeff-4a75-9d52-4f5082078974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:37.012289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9eea-aeff-4a75-9d52-4f5082078974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:37.013217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc9eea-aeff-4a75-9d52-4f5082078974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:37.015342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc9eea-aeff-4a75-9d52-4f5082078974 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:37.053018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692d663-7c2e-45a4-b5cf-fe5af07853db admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:37.057767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2833/5645] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:37.072472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692d663-7c2e-45a4-b5cf-fe5af07853db admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:37.101431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed44687-b292-46d1-8abe-89c3028c6246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:37.102138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed44687-b292-46d1-8abe-89c3028c6246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:37.102477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed44687-b292-46d1-8abe-89c3028c6246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:37.103059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed44687-b292-46d1-8abe-89c3028c6246 admin admin] PATH_INFO: `/v3/projects/2ac8e03e8637479f9869c24c9c399e2c/users/578c169b2f9d4bb880700f8d51547460/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:37.144215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed44687-b292-46d1-8abe-89c3028c6246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac8e03e8637479f9869c24c9c399e2c, user_id=578c169b2f9d4bb880700f8d51547460, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:37.148268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed44687-b292-46d1-8abe-89c3028c6246 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:37.184800 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2813/5646] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:27:37 2022] PUT /identity/v3/projects/2ac8e03e8637479f9869c24c9c399e2c/users/578c169b2f9d4bb880700f8d51547460/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:37.291752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20cd8-4d5c-4a93-8101-e5b35cada81b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:37.292396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20cd8-4d5c-4a93-8101-e5b35cada81b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:37.292396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20cd8-4d5c-4a93-8101-e5b35cada81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:37.366720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-17f20cd8-4d5c-4a93-8101-e5b35cada81b None None] MFA Rules not processed for user `578c169b2f9d4bb880700f8d51547460`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:37.369763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-17f20cd8-4d5c-4a93-8101-e5b35cada81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:37.588433 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2834/5647] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:37.589167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed44687-b292-46d1-8abe-89c3028c6246 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:37.812942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed44687-b292-46d1-8abe-89c3028c6246 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:37.823482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0094c83-e09f-4e5c-981e-d4cf51cc1507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:37.824559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0094c83-e09f-4e5c-981e-d4cf51cc1507 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:37.825887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0094c83-e09f-4e5c-981e-d4cf51cc1507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:37.826896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0094c83-e09f-4e5c-981e-d4cf51cc1507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:37.828480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0094c83-e09f-4e5c-981e-d4cf51cc1507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:37.835974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0094c83-e09f-4e5c-981e-d4cf51cc1507 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:37.908781 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2814/5648] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:37 2022] POST /identity/v3/projects => generated 375 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:37.913539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f20cd8-4d5c-4a93-8101-e5b35cada81b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:37.929611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f20cd8-4d5c-4a93-8101-e5b35cada81b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:38.081542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a8c9d-2862-48ee-96a9-cd784905f2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:38.083081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a8c9d-2862-48ee-96a9-cd784905f2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:38.083445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a8c9d-2862-48ee-96a9-cd784905f2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:38.083724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a8c9d-2862-48ee-96a9-cd784905f2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:38.084447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a8c9d-2862-48ee-96a9-cd784905f2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:38.087749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a8c9d-2862-48ee-96a9-cd784905f2e9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:38.162448 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2835/5649] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:27:37 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:38.166997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0094c83-e09f-4e5c-981e-d4cf51cc1507 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:38.192476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0094c83-e09f-4e5c-981e-d4cf51cc1507 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:38.224860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2624c5d-2be5-433d-b914-77fadf89ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:38.225568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2624c5d-2be5-433d-b914-77fadf89ed1c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:38.225851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2624c5d-2be5-433d-b914-77fadf89ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:38.226122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2624c5d-2be5-433d-b914-77fadf89ed1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:38.238941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2624c5d-2be5-433d-b914-77fadf89ed1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:38.240625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2624c5d-2be5-433d-b914-77fadf89ed1c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:38.295548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a8c9d-2862-48ee-96a9-cd784905f2e9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:38.299507 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2815/5650] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:38.312159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a8c9d-2862-48ee-96a9-cd784905f2e9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:38.334950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c93ff-a53c-4569-91cd-f687b6d8ae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:38.335732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c93ff-a53c-4569-91cd-f687b6d8ae41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:38.336089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c93ff-a53c-4569-91cd-f687b6d8ae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:38.336463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c93ff-a53c-4569-91cd-f687b6d8ae41 admin admin] PATH_INFO: `/v3/projects/08b292db75a04cb28c983ccea0707a4f/users/80628050ca934665b3ec7eccaa48bdd9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:38.386889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c93ff-a53c-4569-91cd-f687b6d8ae41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b292db75a04cb28c983ccea0707a4f, user_id=80628050ca934665b3ec7eccaa48bdd9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:38.390261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c93ff-a53c-4569-91cd-f687b6d8ae41 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:38.395424 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:38.424738 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2836/5651] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:27:38 2022] PUT /identity/v3/projects/08b292db75a04cb28c983ccea0707a4f/users/80628050ca934665b3ec7eccaa48bdd9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:27:38.428615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2624c5d-2be5-433d-b914-77fadf89ed1c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:38.442239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2624c5d-2be5-433d-b914-77fadf89ed1c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:38.912107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce9ed9-be16-4ceb-ba65-c6b560de7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:38.912107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce9ed9-be16-4ceb-ba65-c6b560de7b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:38.912107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce9ed9-be16-4ceb-ba65-c6b560de7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:38.912107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce9ed9-be16-4ceb-ba65-c6b560de7b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:39.038753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce9ed9-be16-4ceb-ba65-c6b560de7b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:39.038753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce9ed9-be16-4ceb-ba65-c6b560de7b82 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:39.038753 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2816/5652] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:39.043330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c93ff-a53c-4569-91cd-f687b6d8ae41 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:39.043330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c93ff-a53c-4569-91cd-f687b6d8ae41 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:39.043330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973c82f-a0b4-4fcf-806f-8e721238855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:39.043330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973c82f-a0b4-4fcf-806f-8e721238855f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:39.045570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973c82f-a0b4-4fcf-806f-8e721238855f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:39.045570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973c82f-a0b4-4fcf-806f-8e721238855f admin admin] PATH_INFO: `/v3/projects/08b292db75a04cb28c983ccea0707a4f/users/80628050ca934665b3ec7eccaa48bdd9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:39.045570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973c82f-a0b4-4fcf-806f-8e721238855f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b292db75a04cb28c983ccea0707a4f, user_id=80628050ca934665b3ec7eccaa48bdd9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:39.045570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973c82f-a0b4-4fcf-806f-8e721238855f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:39.047002 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2837/5653] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:27:38 2022] PUT /identity/v3/projects/08b292db75a04cb28c983ccea0707a4f/users/80628050ca934665b3ec7eccaa48bdd9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:39.059408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bfa93-61cd-478b-bdcb-7ad97fd12fe6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:39.059709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bfa93-61cd-478b-bdcb-7ad97fd12fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:39.059968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bfa93-61cd-478b-bdcb-7ad97fd12fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:39.146389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-563bfa93-61cd-478b-bdcb-7ad97fd12fe6 None None] MFA Rules not processed for user `80628050ca934665b3ec7eccaa48bdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:39.147694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-563bfa93-61cd-478b-bdcb-7ad97fd12fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:39.253095 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:39.294383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a67de5-2c67-425b-819b-d79e4262b268 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:39.294978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a67de5-2c67-425b-819b-d79e4262b268 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:39.295644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a67de5-2c67-425b-819b-d79e4262b268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:39.335983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-98a67de5-2c67-425b-819b-d79e4262b268 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:39.339958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-98a67de5-2c67-425b-819b-d79e4262b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:39.536684 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2817/5654] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:39.537809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bfa93-61cd-478b-bdcb-7ad97fd12fe6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:39.569715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bfa93-61cd-478b-bdcb-7ad97fd12fe6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:39.584854 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2838/5655] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:27:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 02 01:27:39.591650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28e1ec-e131-4b2d-ba2d-09d8a5400591 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80628050ca934665b3ec7eccaa48bdd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08b292db75a04cb28c983ccea0707a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:39.597225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28e1ec-e131-4b2d-ba2d-09d8a5400591 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:39.597592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28e1ec-e131-4b2d-ba2d-09d8a5400591 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:39.597964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28e1ec-e131-4b2d-ba2d-09d8a5400591 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:39.598805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28e1ec-e131-4b2d-ba2d-09d8a5400591 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:39.600815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28e1ec-e131-4b2d-ba2d-09d8a5400591 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:39.606331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a67de5-2c67-425b-819b-d79e4262b268 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:39.608253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-98a67de5-2c67-425b-819b-d79e4262b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:39.714195 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2818/5656] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:39 2022] POST /identity/v3/projects => generated 334 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:39.719221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28e1ec-e131-4b2d-ba2d-09d8a5400591 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:39.841201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a67de5-2c67-425b-819b-d79e4262b268 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:40.083649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28e1ec-e131-4b2d-ba2d-09d8a5400591 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:40.093751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0f9db-870e-4f6a-b9be-0afc12e4f162 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80628050ca934665b3ec7eccaa48bdd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08b292db75a04cb28c983ccea0707a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:40.095233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0f9db-870e-4f6a-b9be-0afc12e4f162 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:40.096708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0f9db-870e-4f6a-b9be-0afc12e4f162 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:40.097166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0f9db-870e-4f6a-b9be-0afc12e4f162 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:40.098137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0f9db-870e-4f6a-b9be-0afc12e4f162 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:40.101056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0f9db-870e-4f6a-b9be-0afc12e4f162 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:40.207460 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2819/5657] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:27:39 2022] POST /identity/v3/projects => generated 333 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:40.208744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0f9db-870e-4f6a-b9be-0afc12e4f162 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:40.252727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d645f15-48dd-49ba-854d-03f0bf52b493 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:40.253388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d645f15-48dd-49ba-854d-03f0bf52b493 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:40.253671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d645f15-48dd-49ba-854d-03f0bf52b493 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:40.253953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d645f15-48dd-49ba-854d-03f0bf52b493 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:40.283540 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:40.408949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0f9db-870e-4f6a-b9be-0afc12e4f162 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:40.441162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe5c3-a499-405b-b231-871761c26562 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80628050ca934665b3ec7eccaa48bdd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08b292db75a04cb28c983ccea0707a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:40.442260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe5c3-a499-405b-b231-871761c26562 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:40.443388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe5c3-a499-405b-b231-871761c26562 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:40.444219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe5c3-a499-405b-b231-871761c26562 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:40.446087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fe5c3-a499-405b-b231-871761c26562 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:40.454060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fe5c3-a499-405b-b231-871761c26562 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:40.471617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d645f15-48dd-49ba-854d-03f0bf52b493 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:40.474423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d645f15-48dd-49ba-854d-03f0bf52b493 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:40.504736 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2839/5658] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:27:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 899 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:27:40.577902 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:40.628988 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2820/5659] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:40 2022] POST /identity/v3/projects => generated 358 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:40.634144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d645f15-48dd-49ba-854d-03f0bf52b493 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:40.656042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d645f15-48dd-49ba-854d-03f0bf52b493 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:40.950293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c42e81-eadb-429a-99d9-728f64059d2a tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80628050ca934665b3ec7eccaa48bdd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08b292db75a04cb28c983ccea0707a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:40.950959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c42e81-eadb-429a-99d9-728f64059d2a tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:40.952837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c42e81-eadb-429a-99d9-728f64059d2a tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:40.953532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c42e81-eadb-429a-99d9-728f64059d2a tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:40.962435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c42e81-eadb-429a-99d9-728f64059d2a tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:40.964348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c42e81-eadb-429a-99d9-728f64059d2a tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:41.108576 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2840/5660] 10.222.0.23 () {58 vars in 1131 bytes} [Sun Oct 2 01:27:40 2022] GET /identity/v3/projects => generated 7200 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:27:41.121303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe5c3-a499-405b-b231-871761c26562 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:41.157440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe5c3-a499-405b-b231-871761c26562 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:41.202511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6d5f-8b69-4551-bb66-6d79fb48b6e2 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80628050ca934665b3ec7eccaa48bdd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08b292db75a04cb28c983ccea0707a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:41.205361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6d5f-8b69-4551-bb66-6d79fb48b6e2 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:41.207917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6d5f-8b69-4551-bb66-6d79fb48b6e2 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:41.210100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6d5f-8b69-4551-bb66-6d79fb48b6e2 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:41.210874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6d5f-8b69-4551-bb66-6d79fb48b6e2 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:27:41.211187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6d5f-8b69-4551-bb66-6d79fb48b6e2 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:41.226044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6d5f-8b69-4551-bb66-6d79fb48b6e2 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:41.314781 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2821/5661] 10.222.0.23 () {58 vars in 1158 bytes} [Sun Oct 2 01:27:41 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:41.325399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c42e81-eadb-429a-99d9-728f64059d2a tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:41.350958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c42e81-eadb-429a-99d9-728f64059d2a tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:41.363197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a7a8a-e955-472c-ab6c-2f803c325437 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80628050ca934665b3ec7eccaa48bdd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08b292db75a04cb28c983ccea0707a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:41.364080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a7a8a-e955-472c-ab6c-2f803c325437 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:41.364547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a7a8a-e955-472c-ab6c-2f803c325437 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:41.365037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a7a8a-e955-472c-ab6c-2f803c325437 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:41.366004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a7a8a-e955-472c-ab6c-2f803c325437 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Adding query filter params (parent_id=05a5e01c8f24453dbb2875b7acf50ff2) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:27:41.366581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a7a8a-e955-472c-ab6c-2f803c325437 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:41.369140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a7a8a-e955-472c-ab6c-2f803c325437 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:41.418773 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2841/5662] 10.222.0.23 () {58 vars in 1216 bytes} [Sun Oct 2 01:27:41 2022] GET /identity/v3/projects?parent_id=05a5e01c8f24453dbb2875b7acf50ff2 => generated 498 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:41.420938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6d5f-8b69-4551-bb66-6d79fb48b6e2 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:41.466659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6d5f-8b69-4551-bb66-6d79fb48b6e2 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:41.525278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80628050ca934665b3ec7eccaa48bdd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08b292db75a04cb28c983ccea0707a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:41.527567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:41.530875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:41.538849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] PATH_INFO: `/v3/projects/5a22d509098d414dadabca8654a45ab2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:41.546804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a22d509098d414dadabca8654a45ab2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:41.568208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:41.769860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a22d509098d414dadabca8654a45ab2', 'request_id': 'req-5ceeecc7-0776-4553-adbe-2ac0cdafa594'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:41.815140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a22d509098d414dadabca8654a45ab2', 'request_id': 'req-5ceeecc7-0776-4553-adbe-2ac0cdafa594'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:41.834086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a22d509098d414dadabca8654a45ab2', 'request_id': 'req-5ceeecc7-0776-4553-adbe-2ac0cdafa594'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:41.902360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] The token cache is being invalidate because project 5a22d509098d414dadabca8654a45ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:27:41.903015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:41.904419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:41.914324 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2822/5663] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:41 2022] DELETE /identity/v3/projects/5a22d509098d414dadabca8654a45ab2 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:41.921837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a7a8a-e955-472c-ab6c-2f803c325437 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:41.934952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e93a7a8a-e955-472c-ab6c-2f803c325437 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:41.965115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a7a8a-e955-472c-ab6c-2f803c325437 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:42.252923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80628050ca934665b3ec7eccaa48bdd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08b292db75a04cb28c983ccea0707a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:42.253581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:42.257465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:42.257764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] PATH_INFO: `/v3/projects/05a5e01c8f24453dbb2875b7acf50ff2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:42.263350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05a5e01c8f24453dbb2875b7acf50ff2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:42.265642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:42.419420 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:42.481831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a5e01c8f24453dbb2875b7acf50ff2', 'request_id': 'req-79d57e4d-981e-4e70-8701-cdca23014907'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:42.516570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a5e01c8f24453dbb2875b7acf50ff2', 'request_id': 'req-79d57e4d-981e-4e70-8701-cdca23014907'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:42.551503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a5e01c8f24453dbb2875b7acf50ff2', 'request_id': 'req-79d57e4d-981e-4e70-8701-cdca23014907'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:42.647134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] The token cache is being invalidate because project 05a5e01c8f24453dbb2875b7acf50ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:27:42.651139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:42.655163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:42.664085 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2842/5664] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:41 2022] DELETE /identity/v3/projects/05a5e01c8f24453dbb2875b7acf50ff2 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:42.667845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:42.705076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeecc7-0776-4553-adbe-2ac0cdafa594 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:43.000271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80628050ca934665b3ec7eccaa48bdd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08b292db75a04cb28c983ccea0707a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:43.001813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:43.002350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:43.002805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] PATH_INFO: `/v3/projects/5a8402993ef6479ba9dbbd1bdb464b8d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:43.013050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a8402993ef6479ba9dbbd1bdb464b8d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:43.015584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:43.148068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8402993ef6479ba9dbbd1bdb464b8d', 'request_id': 'req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:43.187393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8402993ef6479ba9dbbd1bdb464b8d', 'request_id': 'req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:43.199838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8402993ef6479ba9dbbd1bdb464b8d', 'request_id': 'req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:43.225416 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:43.245264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] The token cache is being invalidate because project 5a8402993ef6479ba9dbbd1bdb464b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:27:43.250155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:43.259582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4e43e9d3-9d4e-4371-93d9-37928cd2b4a7 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:43.261666 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2823/5665] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:42 2022] DELETE /identity/v3/projects/5a8402993ef6479ba9dbbd1bdb464b8d => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:43.265581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:43.267971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:43.758638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d57e4d-981e-4e70-8701-cdca23014907 tempest-ListProjectsTestJSON-486447275 tempest-ListProjectsTestJSON-486447275-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:43.971239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:43.974858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:43.975340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:43.975798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] PATH_INFO: `/v3/users/578c169b2f9d4bb880700f8d51547460` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:43.981308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=578c169b2f9d4bb880700f8d51547460)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:44.007053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:44.171985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578c169b2f9d4bb880700f8d51547460'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:44.226227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578c169b2f9d4bb880700f8d51547460'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:44.227125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578c169b2f9d4bb880700f8d51547460'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:44.251149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578c169b2f9d4bb880700f8d51547460'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:44.253614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578c169b2f9d4bb880700f8d51547460'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:44.255836 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:44.310854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53b437-74df-4d54-9860-a5959f977ea7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:44.311855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53b437-74df-4d54-9860-a5959f977ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:44.312456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53b437-74df-4d54-9860-a5959f977ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:44.316137 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2843/5666] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:27:43 2022] DELETE /identity/v3/users/578c169b2f9d4bb880700f8d51547460 => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:27:44.355652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1b53b437-74df-4d54-9860-a5959f977ea7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:44.360410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1b53b437-74df-4d54-9860-a5959f977ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:44.521011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:44.522954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:44.530719 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2824/5667] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:44.837132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714d1f-f35c-41a2-aae1-90beb59ceb4c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:44.856444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb93ec7-cba0-418c-a501-dea13e4049e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:44.857088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb93ec7-cba0-418c-a501-dea13e4049e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:44.863044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb93ec7-cba0-418c-a501-dea13e4049e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:44.863448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb93ec7-cba0-418c-a501-dea13e4049e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:44.907016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb93ec7-cba0-418c-a501-dea13e4049e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:44.908924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb93ec7-cba0-418c-a501-dea13e4049e4 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:44.947694 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2844/5668] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:27:46.527585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53b437-74df-4d54-9860-a5959f977ea7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:46.529004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1b53b437-74df-4d54-9860-a5959f977ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:46.560866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53b437-74df-4d54-9860-a5959f977ea7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:46.603253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:46.604380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:46.604856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:46.606997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] PATH_INFO: `/v3/projects/2ac8e03e8637479f9869c24c9c399e2c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:46.610294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac8e03e8637479f9869c24c9c399e2c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:46.612542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:46.715332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb93ec7-cba0-418c-a501-dea13e4049e4 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:46.728366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb93ec7-cba0-418c-a501-dea13e4049e4 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:46.761743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c797-ea7c-490b-a555-1972e68314aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:46.768706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c797-ea7c-490b-a555-1972e68314aa service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:46.768986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac8e03e8637479f9869c24c9c399e2c', 'request_id': 'req-56d48fc0-5189-42e2-8520-c8d222ab5494'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:46.769418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c797-ea7c-490b-a555-1972e68314aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:46.769845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c797-ea7c-490b-a555-1972e68314aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:46.787322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d3d1c797-ea7c-490b-a555-1972e68314aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:46.787868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac8e03e8637479f9869c24c9c399e2c', 'request_id': 'req-56d48fc0-5189-42e2-8520-c8d222ab5494'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:46.808863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac8e03e8637479f9869c24c9c399e2c', 'request_id': 'req-56d48fc0-5189-42e2-8520-c8d222ab5494'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:46.853418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] The token cache is being invalidate because project 2ac8e03e8637479f9869c24c9c399e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:27:46.854720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:46.864230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:46.866664 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2825/5669] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:46 2022] DELETE /identity/v3/projects/2ac8e03e8637479f9869c24c9c399e2c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:46.873395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:46.879797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:46.880018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1c797-ea7c-490b-a555-1972e68314aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:46.881571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1c797-ea7c-490b-a555-1972e68314aa service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:46.937039 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2845/5670] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:27:47.137639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d48fc0-5189-42e2-8520-c8d222ab5494 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:47.172030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce94f0-5f6d-4755-8827-0d80fe6485fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:47.172775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce94f0-5f6d-4755-8827-0d80fe6485fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:47.173472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce94f0-5f6d-4755-8827-0d80fe6485fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:47.173859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce94f0-5f6d-4755-8827-0d80fe6485fc admin admin] PATH_INFO: `/v3/users/80628050ca934665b3ec7eccaa48bdd9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:47.177066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce94f0-5f6d-4755-8827-0d80fe6485fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=80628050ca934665b3ec7eccaa48bdd9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:47.179250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce94f0-5f6d-4755-8827-0d80fe6485fc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:47.284366 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:47.369461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0cce94f0-5f6d-4755-8827-0d80fe6485fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80628050ca934665b3ec7eccaa48bdd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:47.440516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0cce94f0-5f6d-4755-8827-0d80fe6485fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80628050ca934665b3ec7eccaa48bdd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:47.441381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0cce94f0-5f6d-4755-8827-0d80fe6485fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80628050ca934665b3ec7eccaa48bdd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:47.464104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0cce94f0-5f6d-4755-8827-0d80fe6485fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80628050ca934665b3ec7eccaa48bdd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:47.506536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0cce94f0-5f6d-4755-8827-0d80fe6485fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80628050ca934665b3ec7eccaa48bdd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:47.532202 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2826/5671] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:27:46 2022] DELETE /identity/v3/users/80628050ca934665b3ec7eccaa48bdd9 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:48.799257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c797-ea7c-490b-a555-1972e68314aa service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:48.817735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c797-ea7c-490b-a555-1972e68314aa service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:48.953588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:48.954355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:48.957831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:48.958258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] PATH_INFO: `/v3/projects/08b292db75a04cb28c983ccea0707a4f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:48.976711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b292db75a04cb28c983ccea0707a4f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:48.981510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:49.166807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b292db75a04cb28c983ccea0707a4f', 'request_id': 'req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:49.178968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b292db75a04cb28c983ccea0707a4f', 'request_id': 'req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:49.192121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b292db75a04cb28c983ccea0707a4f', 'request_id': 'req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:49.220943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] The token cache is being invalidate because project 08b292db75a04cb28c983ccea0707a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:27:49.221555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:49.222995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ff5a3ed1-22b6-4fea-be46-04d0a38a2ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:49.225270 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2846/5672] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:48 2022] DELETE /identity/v3/projects/08b292db75a04cb28c983ccea0707a4f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:49.232144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b8863-d9b7-412a-b7b2-a9dd6dad3354 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:49.234247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b8863-d9b7-412a-b7b2-a9dd6dad3354 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:49.234532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b8863-d9b7-412a-b7b2-a9dd6dad3354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:49.359354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f78b8863-d9b7-412a-b7b2-a9dd6dad3354 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:49.361321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f78b8863-d9b7-412a-b7b2-a9dd6dad3354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:49.586454 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2827/5673] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:49.594538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1674eb-e8ad-4ec1-bb80-3a5fad7bdc62 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:49.596984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1674eb-e8ad-4ec1-bb80-3a5fad7bdc62 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:49.597596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1674eb-e8ad-4ec1-bb80-3a5fad7bdc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:49.663397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9e1674eb-e8ad-4ec1-bb80-3a5fad7bdc62 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:49.668761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9e1674eb-e8ad-4ec1-bb80-3a5fad7bdc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:49.714559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b8863-d9b7-412a-b7b2-a9dd6dad3354 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:49.728094 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2847/5674] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:49.736268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b8863-d9b7-412a-b7b2-a9dd6dad3354 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:49.760008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d576d1-8cf4-4c6a-866e-85ddddb05b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:49.760008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d576d1-8cf4-4c6a-866e-85ddddb05b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:49.761354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d576d1-8cf4-4c6a-866e-85ddddb05b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:49.761669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d576d1-8cf4-4c6a-866e-85ddddb05b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:49.762732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d576d1-8cf4-4c6a-866e-85ddddb05b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:27:49.763294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d576d1-8cf4-4c6a-866e-85ddddb05b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:49.778664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d576d1-8cf4-4c6a-866e-85ddddb05b90 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:49.838198 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2828/5675] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:49.843859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1674eb-e8ad-4ec1-bb80-3a5fad7bdc62 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:49.853535 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:49.868732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1674eb-e8ad-4ec1-bb80-3a5fad7bdc62 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:49.882791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb230cd-53df-4aef-874f-11bda995d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:49.884439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb230cd-53df-4aef-874f-11bda995d433 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:49.884727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb230cd-53df-4aef-874f-11bda995d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:49.885006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb230cd-53df-4aef-874f-11bda995d433 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:49.885778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb230cd-53df-4aef-874f-11bda995d433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:49.890029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb230cd-53df-4aef-874f-11bda995d433 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:49.997463 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2848/5676] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:49 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:49.999275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d576d1-8cf4-4c6a-866e-85ddddb05b90 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:50.021261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d576d1-8cf4-4c6a-866e-85ddddb05b90 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:50.202728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44520831-5680-4af3-a424-3e7dc347e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:50.203503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44520831-5680-4af3-a424-3e7dc347e4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:50.204829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44520831-5680-4af3-a424-3e7dc347e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:50.205152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44520831-5680-4af3-a424-3e7dc347e4d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:50.205836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44520831-5680-4af3-a424-3e7dc347e4d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:50.209317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44520831-5680-4af3-a424-3e7dc347e4d4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:50.348541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb230cd-53df-4aef-874f-11bda995d433 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:50.374360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb230cd-53df-4aef-874f-11bda995d433 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:50.385746 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2829/5677] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:27:49 2022] POST /identity/v3/users => generated 286 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:27:50.411455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c894f-bce7-412e-a2f5-8f8af7980201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:50.412151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c894f-bce7-412e-a2f5-8f8af7980201 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:50.412432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c894f-bce7-412e-a2f5-8f8af7980201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:50.412711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c894f-bce7-412e-a2f5-8f8af7980201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:50.413364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c894f-bce7-412e-a2f5-8f8af7980201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:50.427360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c894f-bce7-412e-a2f5-8f8af7980201 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:50.498950 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2849/5678] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:27:50.503194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44520831-5680-4af3-a424-3e7dc347e4d4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:50.527705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44520831-5680-4af3-a424-3e7dc347e4d4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:50.556146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fda03-e850-42c9-9183-c19d69064ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:50.560008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fda03-e850-42c9-9183-c19d69064ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:50.561628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fda03-e850-42c9-9183-c19d69064ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:50.563645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fda03-e850-42c9-9183-c19d69064ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:50.564827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fda03-e850-42c9-9183-c19d69064ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:50.576253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fda03-e850-42c9-9183-c19d69064ad8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:50.634175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c894f-bce7-412e-a2f5-8f8af7980201 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:50.647727 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2830/5679] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:50.659178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c894f-bce7-412e-a2f5-8f8af7980201 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:50.667007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f38e9-5dd3-44e1-b484-b829bf05c08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:50.667851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f38e9-5dd3-44e1-b484-b829bf05c08e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:50.668293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f38e9-5dd3-44e1-b484-b829bf05c08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:50.668690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f38e9-5dd3-44e1-b484-b829bf05c08e admin admin] PATH_INFO: `/v3/projects/61c8db8fde984a01bffb351f638462eb/users/3bdcc52e1d0c47bc8ab61888cd9e4671/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:50.693878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f38e9-5dd3-44e1-b484-b829bf05c08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c8db8fde984a01bffb351f638462eb, user_id=3bdcc52e1d0c47bc8ab61888cd9e4671, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:50.698061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f38e9-5dd3-44e1-b484-b829bf05c08e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:50.731815 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2850/5680] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:27:50 2022] PUT /identity/v3/projects/61c8db8fde984a01bffb351f638462eb/users/3bdcc52e1d0c47bc8ab61888cd9e4671/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:50.746128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e9d70-9481-4b20-a42c-6b0fbf187cac None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:50.746865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e9d70-9481-4b20-a42c-6b0fbf187cac None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:50.747396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e9d70-9481-4b20-a42c-6b0fbf187cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:50.794065 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:50.849272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1c4e9d70-9481-4b20-a42c-6b0fbf187cac None None] MFA Rules not processed for user `3bdcc52e1d0c47bc8ab61888cd9e4671`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:50.852355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1c4e9d70-9481-4b20-a42c-6b0fbf187cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:51.143728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f38e9-5dd3-44e1-b484-b829bf05c08e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:51.157217 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2831/5681] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:51.161798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f38e9-5dd3-44e1-b484-b829bf05c08e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:51.191149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16afa5f-646e-453a-a91f-1e941945fa23 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdcc52e1d0c47bc8ab61888cd9e4671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c8db8fde984a01bffb351f638462eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:51.192199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16afa5f-646e-453a-a91f-1e941945fa23 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:51.192769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16afa5f-646e-453a-a91f-1e941945fa23 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:51.193203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16afa5f-646e-453a-a91f-1e941945fa23 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] PATH_INFO: `/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/application_credentials` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:51.194993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16afa5f-646e-453a-a91f-1e941945fa23 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorizing `identity:create_application_credential(user_id=3bdcc52e1d0c47bc8ab61888cd9e4671)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:51.196577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16afa5f-646e-453a-a91f-1e941945fa23 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:51.416682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e9d70-9481-4b20-a42c-6b0fbf187cac None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:51.435239 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2851/5682] 10.222.0.23 () {60 vars in 1315 bytes} [Sun Oct 2 01:27:51 2022] POST /identity/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/application_credentials => generated 920 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:51.439103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e9d70-9481-4b20-a42c-6b0fbf187cac None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:51.449949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23729a0b-660f-45e3-b1a8-26df35f526b3 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdcc52e1d0c47bc8ab61888cd9e4671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c8db8fde984a01bffb351f638462eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:51.451361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23729a0b-660f-45e3-b1a8-26df35f526b3 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:51.451361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23729a0b-660f-45e3-b1a8-26df35f526b3 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:51.452040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23729a0b-660f-45e3-b1a8-26df35f526b3 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] PATH_INFO: `/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules/3d05888e9d2848d8982b392651b3d672` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:51.457260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23729a0b-660f-45e3-b1a8-26df35f526b3 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorizing `identity:delete_access_rule(user_id=3bdcc52e1d0c47bc8ab61888cd9e4671, access_rule_id=3d05888e9d2848d8982b392651b3d672)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:51.459320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23729a0b-660f-45e3-b1a8-26df35f526b3 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-23729a0b-660f-45e3-b1a8-26df35f526b3 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application session.delete(ref) Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application next(self.gen) Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application yield resource Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application next(self.gen) Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.session.rollback() Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.force_reraise() Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:27:51.542316 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise self.value Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application session.commit() Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._prepare_impl() Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.session.flush() Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._flush(objects) Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 01:27:51.543560 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application compat.raise_( Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application flush_context.execute() Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rec.execute(self) Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._synchronize( Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise AssertionError( Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 02 01:27:51.545346 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:27:51.547079 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:27:51.548200 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 02 01:27:51.548200 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 02 01:27:51.548200 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 02 01:27:51.548200 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 02 01:27:51.548200 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 02 01:27:51.548200 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:27:51.559823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16afa5f-646e-453a-a91f-1e941945fa23 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:51.562770 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2832/5683] 10.222.0.23 () {58 vars in 1362 bytes} [Sun Oct 2 01:27:51 2022] DELETE /identity/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules/3d05888e9d2848d8982b392651b3d672 => generated 89 bytes in 147 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 02 01:27:51.586501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16afa5f-646e-453a-a91f-1e941945fa23 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:51.600971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514cc01-6647-4a1e-8f99-4ac40c17ec12 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdcc52e1d0c47bc8ab61888cd9e4671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c8db8fde984a01bffb351f638462eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:51.602002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514cc01-6647-4a1e-8f99-4ac40c17ec12 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:51.604246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514cc01-6647-4a1e-8f99-4ac40c17ec12 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:51.604661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514cc01-6647-4a1e-8f99-4ac40c17ec12 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] PATH_INFO: `/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/application_credentials/b152a539e3bd48118bae85e3b70fa8ad` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:51.632135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514cc01-6647-4a1e-8f99-4ac40c17ec12 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3bdcc52e1d0c47bc8ab61888cd9e4671, application_credential_id=b152a539e3bd48118bae85e3b70fa8ad)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:51.643526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514cc01-6647-4a1e-8f99-4ac40c17ec12 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:51.750873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23729a0b-660f-45e3-b1a8-26df35f526b3 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:51.754563 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2852/5684] 10.222.0.23 () {58 vars in 1395 bytes} [Sun Oct 2 01:27:51 2022] DELETE /identity/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/application_credentials/b152a539e3bd48118bae85e3b70fa8ad => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:51.781736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23729a0b-660f-45e3-b1a8-26df35f526b3 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:51.798349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9b5b0-0fad-4d45-b478-d0b98afe186d tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdcc52e1d0c47bc8ab61888cd9e4671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c8db8fde984a01bffb351f638462eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:51.802919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b5b0-0fad-4d45-b478-d0b98afe186d tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:51.802919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b5b0-0fad-4d45-b478-d0b98afe186d tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:51.802919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b5b0-0fad-4d45-b478-d0b98afe186d tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] PATH_INFO: `/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:51.808577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9b5b0-0fad-4d45-b478-d0b98afe186d tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorizing `identity:list_access_rules(user_id=3bdcc52e1d0c47bc8ab61888cd9e4671)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:51.813842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9b5b0-0fad-4d45-b478-d0b98afe186d tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:51.824596 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2833/5685] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:27:51 2022] GET /identity/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules => generated 369 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:51.825515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514cc01-6647-4a1e-8f99-4ac40c17ec12 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:51.840774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514cc01-6647-4a1e-8f99-4ac40c17ec12 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:51.851157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708f044-9884-451a-be4e-8ca91087f416 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdcc52e1d0c47bc8ab61888cd9e4671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c8db8fde984a01bffb351f638462eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:51.851966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708f044-9884-451a-be4e-8ca91087f416 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:51.852260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708f044-9884-451a-be4e-8ca91087f416 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:51.852544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708f044-9884-451a-be4e-8ca91087f416 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] PATH_INFO: `/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules/3d05888e9d2848d8982b392651b3d672` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:51.859085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708f044-9884-451a-be4e-8ca91087f416 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorizing `identity:delete_access_rule(user_id=3bdcc52e1d0c47bc8ab61888cd9e4671, access_rule_id=3d05888e9d2848d8982b392651b3d672)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:51.861288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708f044-9884-451a-be4e-8ca91087f416 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:51.896697 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2853/5686] 10.222.0.23 () {58 vars in 1362 bytes} [Sun Oct 2 01:27:51 2022] DELETE /identity/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules/3d05888e9d2848d8982b392651b3d672 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:51.900807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9b5b0-0fad-4d45-b478-d0b98afe186d tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:51.914618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9b5b0-0fad-4d45-b478-d0b98afe186d tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:51.939555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3008f87-a7e4-46e0-bfe7-d5ad7e480ae4 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdcc52e1d0c47bc8ab61888cd9e4671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c8db8fde984a01bffb351f638462eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:51.940379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008f87-a7e4-46e0-bfe7-d5ad7e480ae4 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:51.949449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008f87-a7e4-46e0-bfe7-d5ad7e480ae4 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:51.951398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008f87-a7e4-46e0-bfe7-d5ad7e480ae4 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] PATH_INFO: `/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:51.964764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3008f87-a7e4-46e0-bfe7-d5ad7e480ae4 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorizing `identity:list_access_rules(user_id=3bdcc52e1d0c47bc8ab61888cd9e4671)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:51.968381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3008f87-a7e4-46e0-bfe7-d5ad7e480ae4 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:51.996891 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2834/5687] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:27:51 2022] GET /identity/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules => generated 158 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:51.997413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708f044-9884-451a-be4e-8ca91087f416 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:52.011617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708f044-9884-451a-be4e-8ca91087f416 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:52.040467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7166cbe-ad1e-455c-bc68-eedaf4619264 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdcc52e1d0c47bc8ab61888cd9e4671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c8db8fde984a01bffb351f638462eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:52.041432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7166cbe-ad1e-455c-bc68-eedaf4619264 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:52.041622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7166cbe-ad1e-455c-bc68-eedaf4619264 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:52.042419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7166cbe-ad1e-455c-bc68-eedaf4619264 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] PATH_INFO: `/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/application_credentials` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:52.042539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7166cbe-ad1e-455c-bc68-eedaf4619264 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorizing `identity:create_application_credential(user_id=3bdcc52e1d0c47bc8ab61888cd9e4671)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:52.047407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7166cbe-ad1e-455c-bc68-eedaf4619264 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:52.189776 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:52.369565 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2854/5688] 10.222.0.23 () {60 vars in 1315 bytes} [Sun Oct 2 01:27:51 2022] POST /identity/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/application_credentials => generated 921 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:52.372028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3008f87-a7e4-46e0-bfe7-d5ad7e480ae4 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:52.385878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3008f87-a7e4-46e0-bfe7-d5ad7e480ae4 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:52.445505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef82e-1606-4013-803d-ca0ec8d94227 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdcc52e1d0c47bc8ab61888cd9e4671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c8db8fde984a01bffb351f638462eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:52.446473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef82e-1606-4013-803d-ca0ec8d94227 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:52.446473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef82e-1606-4013-803d-ca0ec8d94227 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:52.446738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef82e-1606-4013-803d-ca0ec8d94227 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] PATH_INFO: `/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:52.463287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ef82e-1606-4013-803d-ca0ec8d94227 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorizing `identity:list_access_rules(user_id=3bdcc52e1d0c47bc8ab61888cd9e4671)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:52.469126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ef82e-1606-4013-803d-ca0ec8d94227 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:52.534676 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2835/5689] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:27:52 2022] GET /identity/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules => generated 369 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:27:52.539811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7166cbe-ad1e-455c-bc68-eedaf4619264 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:52.570853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7166cbe-ad1e-455c-bc68-eedaf4619264 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:52.594921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516223ae-9a0c-4d12-9012-a648127154d6 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdcc52e1d0c47bc8ab61888cd9e4671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c8db8fde984a01bffb351f638462eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:52.597045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516223ae-9a0c-4d12-9012-a648127154d6 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:52.597340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516223ae-9a0c-4d12-9012-a648127154d6 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:52.597624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516223ae-9a0c-4d12-9012-a648127154d6 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] PATH_INFO: `/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/application_credentials` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:52.598705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516223ae-9a0c-4d12-9012-a648127154d6 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorizing `identity:create_application_credential(user_id=3bdcc52e1d0c47bc8ab61888cd9e4671)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:52.599553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516223ae-9a0c-4d12-9012-a648127154d6 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:53.147414 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2855/5690] 10.222.0.23 () {60 vars in 1315 bytes} [Sun Oct 2 01:27:52 2022] POST /identity/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/application_credentials => generated 921 bytes in 605 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:27:53.150109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef82e-1606-4013-803d-ca0ec8d94227 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:53.162941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef82e-1606-4013-803d-ca0ec8d94227 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:53.183747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc24a6-4f02-4779-9dc0-065695b24675 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdcc52e1d0c47bc8ab61888cd9e4671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c8db8fde984a01bffb351f638462eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:53.186208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc24a6-4f02-4779-9dc0-065695b24675 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:53.186976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc24a6-4f02-4779-9dc0-065695b24675 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:53.189989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc24a6-4f02-4779-9dc0-065695b24675 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] PATH_INFO: `/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules/4d230376baed4c8a86d077d07955aa79` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:53.195392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc24a6-4f02-4779-9dc0-065695b24675 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorizing `identity:get_access_rule(user_id=3bdcc52e1d0c47bc8ab61888cd9e4671, access_rule_id=4d230376baed4c8a86d077d07955aa79)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:53.200676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc24a6-4f02-4779-9dc0-065695b24675 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:53.231830 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2836/5691] 10.222.0.23 () {58 vars in 1359 bytes} [Sun Oct 2 01:27:53 2022] GET /identity/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671/access_rules/4d230376baed4c8a86d077d07955aa79 => generated 229 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:53.233582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516223ae-9a0c-4d12-9012-a648127154d6 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:53.569854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516223ae-9a0c-4d12-9012-a648127154d6 tempest-AccessRulesV3Test-1450093926 tempest-AccessRulesV3Test-1450093926-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:53.594851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:53.595404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:53.595687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:53.595958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] PATH_INFO: `/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:53.602502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bdcc52e1d0c47bc8ab61888cd9e4671)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:53.604707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:53.793882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bdcc52e1d0c47bc8ab61888cd9e4671'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:53.800675 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:53.907426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bdcc52e1d0c47bc8ab61888cd9e4671'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:53.910394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bdcc52e1d0c47bc8ab61888cd9e4671'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:53.925653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bdcc52e1d0c47bc8ab61888cd9e4671'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:53.927121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bdcc52e1d0c47bc8ab61888cd9e4671'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:54.002268 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2856/5692] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:27:53 2022] DELETE /identity/v3/users/3bdcc52e1d0c47bc8ab61888cd9e4671 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:54.004061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2cc1-58ea-4965-9ba0-bc60f59cb462 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:54.005045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2cc1-58ea-4965-9ba0-bc60f59cb462 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:54.005490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2cc1-58ea-4965-9ba0-bc60f59cb462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:54.052397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2bda2cc1-58ea-4965-9ba0-bc60f59cb462 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:54.059388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2bda2cc1-58ea-4965-9ba0-bc60f59cb462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:54.262831 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2837/5693] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:54.300985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:54.302675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:54.575098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d9307-e559-44a7-8ddc-61bd782db119 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:54.596179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fad345-af71-4490-ba79-cd80b30dbf21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:54.596959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fad345-af71-4490-ba79-cd80b30dbf21 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:54.597377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fad345-af71-4490-ba79-cd80b30dbf21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:54.597504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fad345-af71-4490-ba79-cd80b30dbf21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:54.620395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fad345-af71-4490-ba79-cd80b30dbf21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:54.621889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fad345-af71-4490-ba79-cd80b30dbf21 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:54.645148 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2857/5694] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:27:57.634250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda2cc1-58ea-4965-9ba0-bc60f59cb462 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:57.636535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2bda2cc1-58ea-4965-9ba0-bc60f59cb462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:57.664082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda2cc1-58ea-4965-9ba0-bc60f59cb462 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:57.689042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:57.694138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:57.696031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:57.696474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] PATH_INFO: `/v3/projects/61c8db8fde984a01bffb351f638462eb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:57.700428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c8db8fde984a01bffb351f638462eb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:57.719299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:57.959320 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:57.971076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c8db8fde984a01bffb351f638462eb', 'request_id': 'req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:58.009516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c8db8fde984a01bffb351f638462eb', 'request_id': 'req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:58.052560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c8db8fde984a01bffb351f638462eb', 'request_id': 'req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:58.106145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] The token cache is being invalidate because project 61c8db8fde984a01bffb351f638462eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:27:58.112282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:58.125875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2bbf4963-01d3-44f1-97c2-f4cfc454cbdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:27:58.164806 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2838/5695] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:27:57 2022] DELETE /identity/v3/projects/61c8db8fde984a01bffb351f638462eb => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:58.171899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a62421-67b5-4e8c-909f-0d1fec2e1473 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:58.173799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a62421-67b5-4e8c-909f-0d1fec2e1473 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:58.174243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a62421-67b5-4e8c-909f-0d1fec2e1473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:58.253856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-08a62421-67b5-4e8c-909f-0d1fec2e1473 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:58.273905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-08a62421-67b5-4e8c-909f-0d1fec2e1473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:58.535688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857152-a8a5-4225-bec7-426749dee6ff None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:58.536030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857152-a8a5-4225-bec7-426749dee6ff None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:58.536251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857152-a8a5-4225-bec7-426749dee6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:58.537329 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2858/5696] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:58.600922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-50857152-a8a5-4225-bec7-426749dee6ff None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:58.610665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-50857152-a8a5-4225-bec7-426749dee6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:27:58.652081 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2839/5697] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:27:58.657052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a62421-67b5-4e8c-909f-0d1fec2e1473 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:58.676746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a62421-67b5-4e8c-909f-0d1fec2e1473 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:58.684868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6285b9-0a55-4873-929c-f35fc0d89c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:58.686388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6285b9-0a55-4873-929c-f35fc0d89c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:58.687005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6285b9-0a55-4873-929c-f35fc0d89c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:58.687500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6285b9-0a55-4873-929c-f35fc0d89c12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:58.688377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6285b9-0a55-4873-929c-f35fc0d89c12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:27:58.688901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6285b9-0a55-4873-929c-f35fc0d89c12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:58.690755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6285b9-0a55-4873-929c-f35fc0d89c12 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:58.745225 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2859/5698] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:27:58.750429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857152-a8a5-4225-bec7-426749dee6ff None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:58.770374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857152-a8a5-4225-bec7-426749dee6ff None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:58.787609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234dc91-2fa0-4a02-b8e1-b3df4e1ffc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:58.788647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234dc91-2fa0-4a02-b8e1-b3df4e1ffc72 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:58.789160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234dc91-2fa0-4a02-b8e1-b3df4e1ffc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:58.789665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234dc91-2fa0-4a02-b8e1-b3df4e1ffc72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:58.790529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234dc91-2fa0-4a02-b8e1-b3df4e1ffc72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:58.792728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234dc91-2fa0-4a02-b8e1-b3df4e1ffc72 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:58.862985 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2840/5699] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:27:58 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:58.867375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6285b9-0a55-4873-929c-f35fc0d89c12 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:58.887203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6285b9-0a55-4873-929c-f35fc0d89c12 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:58.975355 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:59.115311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcf218-5027-428a-a227-d090fb4e18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:59.116097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcf218-5027-428a-a227-d090fb4e18cb admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:59.119485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcf218-5027-428a-a227-d090fb4e18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:59.119882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcf218-5027-428a-a227-d090fb4e18cb admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:59.120765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcf218-5027-428a-a227-d090fb4e18cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:59.127626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcf218-5027-428a-a227-d090fb4e18cb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:59.204255 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2860/5700] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:27:58 2022] POST /identity/v3/users => generated 299 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:27:59.205438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234dc91-2fa0-4a02-b8e1-b3df4e1ffc72 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:59.223824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234dc91-2fa0-4a02-b8e1-b3df4e1ffc72 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:59.237717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228358a-544c-43eb-b71b-34492f5a77b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:59.238739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228358a-544c-43eb-b71b-34492f5a77b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:59.239260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228358a-544c-43eb-b71b-34492f5a77b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:59.239752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228358a-544c-43eb-b71b-34492f5a77b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:59.240624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228358a-544c-43eb-b71b-34492f5a77b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:59.242480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228358a-544c-43eb-b71b-34492f5a77b8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:59.264965 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2841/5701] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:27:59.269040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcf218-5027-428a-a227-d090fb4e18cb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:59.287287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcf218-5027-428a-a227-d090fb4e18cb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:59.294202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6068bc-8fc5-4182-9f69-3ec2177a9849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:59.296876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6068bc-8fc5-4182-9f69-3ec2177a9849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:59.297389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6068bc-8fc5-4182-9f69-3ec2177a9849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:59.298105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6068bc-8fc5-4182-9f69-3ec2177a9849 admin admin] PATH_INFO: `/v3/projects/bcb8e5a97ef24d8488d7b33d452543f8/users/9d7b1e48bbca4d96b7a6642f366cace8/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:59.336515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6068bc-8fc5-4182-9f69-3ec2177a9849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb8e5a97ef24d8488d7b33d452543f8, user_id=9d7b1e48bbca4d96b7a6642f366cace8, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:59.347163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6068bc-8fc5-4182-9f69-3ec2177a9849 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:59.389138 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2861/5702] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:27:59 2022] PUT /identity/v3/projects/bcb8e5a97ef24d8488d7b33d452543f8/users/9d7b1e48bbca4d96b7a6642f366cace8/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:27:59.390007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228358a-544c-43eb-b71b-34492f5a77b8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:59.414432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228358a-544c-43eb-b71b-34492f5a77b8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:59.624273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479b869-9270-442e-8906-6f1544233e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:59.625305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479b869-9270-442e-8906-6f1544233e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:59.625812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479b869-9270-442e-8906-6f1544233e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:59.626312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479b869-9270-442e-8906-6f1544233e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:59.627257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479b869-9270-442e-8906-6f1544233e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:59.629111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479b869-9270-442e-8906-6f1544233e2c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:59.670743 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2842/5703] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:27:59.672085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6068bc-8fc5-4182-9f69-3ec2177a9849 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:27:59.690293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6068bc-8fc5-4182-9f69-3ec2177a9849 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:27:59.720908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab194c7-64db-4e7d-b4ef-23e081adcba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:27:59.721599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab194c7-64db-4e7d-b4ef-23e081adcba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:59.721950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab194c7-64db-4e7d-b4ef-23e081adcba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:59.722142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab194c7-64db-4e7d-b4ef-23e081adcba8 admin admin] PATH_INFO: `/v3/projects/bcb8e5a97ef24d8488d7b33d452543f8/users/9d7b1e48bbca4d96b7a6642f366cace8/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:59.728234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab194c7-64db-4e7d-b4ef-23e081adcba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb8e5a97ef24d8488d7b33d452543f8, user_id=9d7b1e48bbca4d96b7a6642f366cace8, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:27:59.738385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab194c7-64db-4e7d-b4ef-23e081adcba8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:27:59.809417 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2862/5704] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:27:59 2022] PUT /identity/v3/projects/bcb8e5a97ef24d8488d7b33d452543f8/users/9d7b1e48bbca4d96b7a6642f366cace8/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:27:59.811546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418fc7-cdba-48be-a92a-14f0590af4dd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:27:59.812064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418fc7-cdba-48be-a92a-14f0590af4dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:27:59.812565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418fc7-cdba-48be-a92a-14f0590af4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:27:59.914069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-32418fc7-cdba-48be-a92a-14f0590af4dd None None] MFA Rules not processed for user `9d7b1e48bbca4d96b7a6642f366cace8`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:27:59.915755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-32418fc7-cdba-48be-a92a-14f0590af4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:00.244204 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2843/5705] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:27:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:00.255494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab194c7-64db-4e7d-b4ef-23e081adcba8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:00.590809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab194c7-64db-4e7d-b4ef-23e081adcba8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:00.603036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c79c36-9a32-4bb6-a527-f629c3ec68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:00.604013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c79c36-9a32-4bb6-a527-f629c3ec68af admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:00.604455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c79c36-9a32-4bb6-a527-f629c3ec68af admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:00.607933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c79c36-9a32-4bb6-a527-f629c3ec68af admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:00.609553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c79c36-9a32-4bb6-a527-f629c3ec68af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:00.615455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c79c36-9a32-4bb6-a527-f629c3ec68af admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:00.734264 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2863/5706] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:00 2022] POST /identity/v3/projects => generated 387 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:00.735142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32418fc7-cdba-48be-a92a-14f0590af4dd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:00.751891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32418fc7-cdba-48be-a92a-14f0590af4dd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:00.816906 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:01.037502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd2741-7f36-429d-b4f3-bc278ac86828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:01.038440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2741-7f36-429d-b4f3-bc278ac86828 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:01.038906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2741-7f36-429d-b4f3-bc278ac86828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:01.039353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2741-7f36-429d-b4f3-bc278ac86828 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:01.051678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd2741-7f36-429d-b4f3-bc278ac86828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:01.063083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd2741-7f36-429d-b4f3-bc278ac86828 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:01.128271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c79c36-9a32-4bb6-a527-f629c3ec68af admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:01.130021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f3c79c36-9a32-4bb6-a527-f629c3ec68af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:01.132151 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2844/5707] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:00 2022] POST /identity/v3/users => generated 294 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:28:01.143191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd2741-7f36-429d-b4f3-bc278ac86828 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:01.172497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd2741-7f36-429d-b4f3-bc278ac86828 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:01.190240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c79c36-9a32-4bb6-a527-f629c3ec68af admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:01.191425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbae13-e2b5-4b65-a25a-1eb919d88a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:01.194679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbae13-e2b5-4b65-a25a-1eb919d88a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:01.196312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbae13-e2b5-4b65-a25a-1eb919d88a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:01.197155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbae13-e2b5-4b65-a25a-1eb919d88a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:01.198821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbae13-e2b5-4b65-a25a-1eb919d88a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:01.205744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbae13-e2b5-4b65-a25a-1eb919d88a57 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:01.227002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:01.227671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:01.227956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:01.228233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] PATH_INFO: `/v3/users/fe1fa0967b8444279e5bad164b635df5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:01.231711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1fa0967b8444279e5bad164b635df5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:01.242454 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2845/5708] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:01.246439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbae13-e2b5-4b65-a25a-1eb919d88a57 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:01.251111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:01.269116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbae13-e2b5-4b65-a25a-1eb919d88a57 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:01.279836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dcc77-c047-40c5-8551-04dbd6c213f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:01.280816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dcc77-c047-40c5-8551-04dbd6c213f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:01.282301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dcc77-c047-40c5-8551-04dbd6c213f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:01.282833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dcc77-c047-40c5-8551-04dbd6c213f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:01.284303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dcc77-c047-40c5-8551-04dbd6c213f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:01.290724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dcc77-c047-40c5-8551-04dbd6c213f9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:01.317510 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2846/5709] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:01.319790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dcc77-c047-40c5-8551-04dbd6c213f9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:01.340328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dcc77-c047-40c5-8551-04dbd6c213f9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:01.374022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf0d75-dc01-4434-b295-d0453f249a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:01.375455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf0d75-dc01-4434-b295-d0453f249a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:01.375455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf0d75-dc01-4434-b295-d0453f249a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:01.376908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf0d75-dc01-4434-b295-d0453f249a80 admin admin] PATH_INFO: `/v3/projects/bbb8e268332143babb7c4fd51b571d8c/users/a36993851371477b9a0fde13765ad5f2/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:01.427586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf0d75-dc01-4434-b295-d0453f249a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb8e268332143babb7c4fd51b571d8c, user_id=a36993851371477b9a0fde13765ad5f2, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:01.434774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf0d75-dc01-4434-b295-d0453f249a80 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:01.484947 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2847/5710] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:01 2022] PUT /identity/v3/projects/bbb8e268332143babb7c4fd51b571d8c/users/a36993851371477b9a0fde13765ad5f2/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:01.489226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1fa0967b8444279e5bad164b635df5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:01.501205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5c09-82ea-4a18-ba14-f460c574ab59 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:01.501661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5c09-82ea-4a18-ba14-f460c574ab59 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:01.502065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5c09-82ea-4a18-ba14-f460c574ab59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:01.582355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1fa0967b8444279e5bad164b635df5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:01.586919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1fa0967b8444279e5bad164b635df5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:01.594540 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=84,keystone:INSERT=7,keystone:DELETE=9 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:01.608688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-983e5c09-82ea-4a18-ba14-f460c574ab59 None None] MFA Rules not processed for user `a36993851371477b9a0fde13765ad5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:01.613725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-983e5c09-82ea-4a18-ba14-f460c574ab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:01.616170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1fa0967b8444279e5bad164b635df5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:01.617630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1fa0967b8444279e5bad164b635df5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:01.672152 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2864/5711] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:01 2022] DELETE /identity/v3/users/fe1fa0967b8444279e5bad164b635df5 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:01.930688 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2848/5712] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:01.945931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:01.947886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:02.219671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cd909-e082-4862-863a-d6e33e2dc1b2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:02.241253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7b98d-bd8c-4da3-8af3-aa3c66be05ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:02.241894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7b98d-bd8c-4da3-8af3-aa3c66be05ef service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:02.245197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7b98d-bd8c-4da3-8af3-aa3c66be05ef service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:02.249073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7b98d-bd8c-4da3-8af3-aa3c66be05ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:02.256386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-59a7b98d-bd8c-4da3-8af3-aa3c66be05ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:02.619932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7b98d-bd8c-4da3-8af3-aa3c66be05ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:02.622086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7b98d-bd8c-4da3-8af3-aa3c66be05ef service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:02.651689 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2865/5713] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:02.794746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e5c09-82ea-4a18-ba14-f460c574ab59 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:02.796605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-983e5c09-82ea-4a18-ba14-f460c574ab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:02.992099 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:03.074188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e5c09-82ea-4a18-ba14-f460c574ab59 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:03.252980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:03.253645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:03.254104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:03.254397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] PATH_INFO: `/v3/projects/e8ab6dbed6cd4a09989164757910b06b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:03.258644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ab6dbed6cd4a09989164757910b06b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:03.261046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:03.375942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ab6dbed6cd4a09989164757910b06b', 'request_id': 'req-39f67eb2-acaa-440b-bbcc-14634e011cfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:03.403333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ab6dbed6cd4a09989164757910b06b', 'request_id': 'req-39f67eb2-acaa-440b-bbcc-14634e011cfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:03.433381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ab6dbed6cd4a09989164757910b06b', 'request_id': 'req-39f67eb2-acaa-440b-bbcc-14634e011cfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:03.459421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] The token cache is being invalidate because project e8ab6dbed6cd4a09989164757910b06b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:03.459768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:03.463004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:03.464998 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2849/5714] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:02 2022] DELETE /identity/v3/projects/e8ab6dbed6cd4a09989164757910b06b => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:03.470967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab987c-f471-4964-954d-28e1175307f8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:03.471460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab987c-f471-4964-954d-28e1175307f8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:03.471854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab987c-f471-4964-954d-28e1175307f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:03.540156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-06ab987c-f471-4964-954d-28e1175307f8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:03.541417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-06ab987c-f471-4964-954d-28e1175307f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:03.566862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:03.568077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:03.698664 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2866/5715] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:03.717157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3340-40d3-4e8a-97fb-74cf3ab566c4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:03.717443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3340-40d3-4e8a-97fb-74cf3ab566c4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:03.717725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3340-40d3-4e8a-97fb-74cf3ab566c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:03.773038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dc9a3340-40d3-4e8a-97fb-74cf3ab566c4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:03.777658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dc9a3340-40d3-4e8a-97fb-74cf3ab566c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:03.808443 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2867/5716] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:03.819093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a3340-40d3-4e8a-97fb-74cf3ab566c4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:03.831119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a3340-40d3-4e8a-97fb-74cf3ab566c4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:03.838041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67eb2-acaa-440b-bbcc-14634e011cfa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:03.867320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2829fa-7833-499b-8cf8-0d4a484878d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:03.869314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2829fa-7833-499b-8cf8-0d4a484878d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:03.870529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2829fa-7833-499b-8cf8-0d4a484878d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:03.871339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2829fa-7833-499b-8cf8-0d4a484878d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:03.872247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2829fa-7833-499b-8cf8-0d4a484878d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:03.872896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2829fa-7833-499b-8cf8-0d4a484878d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:03.874907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2829fa-7833-499b-8cf8-0d4a484878d4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:03.884113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8f8c1-a73d-41bb-afce-2500c83f8161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:03.884811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8f8c1-a73d-41bb-afce-2500c83f8161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:03.885047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8f8c1-a73d-41bb-afce-2500c83f8161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:03.887101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8f8c1-a73d-41bb-afce-2500c83f8161 admin admin] PATH_INFO: `/v3/users/9d7b1e48bbca4d96b7a6642f366cace8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:03.890904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8f8c1-a73d-41bb-afce-2500c83f8161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7b1e48bbca4d96b7a6642f366cace8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:03.899298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8f8c1-a73d-41bb-afce-2500c83f8161 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:03.941556 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2868/5717] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:03.943192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2829fa-7833-499b-8cf8-0d4a484878d4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:04.010688 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:04.012647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2829fa-7833-499b-8cf8-0d4a484878d4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:04.025236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643bf4b-f419-4d60-81bd-6ea518554549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:04.028474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643bf4b-f419-4d60-81bd-6ea518554549 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:04.029935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643bf4b-f419-4d60-81bd-6ea518554549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:04.030792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643bf4b-f419-4d60-81bd-6ea518554549 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:04.031693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643bf4b-f419-4d60-81bd-6ea518554549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:04.036479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643bf4b-f419-4d60-81bd-6ea518554549 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:04.077272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e8f8c1-a73d-41bb-afce-2500c83f8161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7b1e48bbca4d96b7a6642f366cace8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:04.102573 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:04.128299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e8f8c1-a73d-41bb-afce-2500c83f8161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7b1e48bbca4d96b7a6642f366cace8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:04.129330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e8f8c1-a73d-41bb-afce-2500c83f8161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7b1e48bbca4d96b7a6642f366cace8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:04.144872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e8f8c1-a73d-41bb-afce-2500c83f8161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7b1e48bbca4d96b7a6642f366cace8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:04.151139 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2869/5718] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:03 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:04.155531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643bf4b-f419-4d60-81bd-6ea518554549 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:04.157296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0643bf4b-f419-4d60-81bd-6ea518554549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:04.158074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e8f8c1-a73d-41bb-afce-2500c83f8161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7b1e48bbca4d96b7a6642f366cace8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:04.167134 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2850/5719] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:03 2022] DELETE /identity/v3/users/9d7b1e48bbca4d96b7a6642f366cace8 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:28:04.172877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff1a7-6c61-4bf0-b744-98951e12b754 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:04.174119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff1a7-6c61-4bf0-b744-98951e12b754 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:04.174850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff1a7-6c61-4bf0-b744-98951e12b754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:04.222692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f8cff1a7-6c61-4bf0-b744-98951e12b754 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:04.224681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f8cff1a7-6c61-4bf0-b744-98951e12b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:04.304364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643bf4b-f419-4d60-81bd-6ea518554549 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:04.411304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b2227-57a3-4fdd-ab7e-d65430929971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:04.412048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b2227-57a3-4fdd-ab7e-d65430929971 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:04.412330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b2227-57a3-4fdd-ab7e-d65430929971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:04.412606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b2227-57a3-4fdd-ab7e-d65430929971 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:04.413302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b2227-57a3-4fdd-ab7e-d65430929971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:04.415484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b2227-57a3-4fdd-ab7e-d65430929971 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:04.466519 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2870/5720] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:04 2022] POST /identity/v3/users => generated 287 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:28:04.470638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b2227-57a3-4fdd-ab7e-d65430929971 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:04.483809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b2227-57a3-4fdd-ab7e-d65430929971 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:04.489410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2580-b5e2-49e6-9d5d-742588ffcab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:04.490038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2580-b5e2-49e6-9d5d-742588ffcab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:04.490320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2580-b5e2-49e6-9d5d-742588ffcab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:04.490842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2580-b5e2-49e6-9d5d-742588ffcab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:04.491269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe2580-b5e2-49e6-9d5d-742588ffcab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:04.494451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe2580-b5e2-49e6-9d5d-742588ffcab3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:04.501443 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2851/5721] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:04.511562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cff1a7-6c61-4bf0-b744-98951e12b754 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:04.513445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f8cff1a7-6c61-4bf0-b744-98951e12b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:04.516348 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2871/5722] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:28:04.520613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2580-b5e2-49e6-9d5d-742588ffcab3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:04.532281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2580-b5e2-49e6-9d5d-742588ffcab3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:04.545915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca95170-18d2-4e93-b361-b13ce0f6d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:04.550497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95170-18d2-4e93-b361-b13ce0f6d92c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:04.550497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95170-18d2-4e93-b361-b13ce0f6d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:04.550497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95170-18d2-4e93-b361-b13ce0f6d92c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:04.550497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca95170-18d2-4e93-b361-b13ce0f6d92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:04.550917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca95170-18d2-4e93-b361-b13ce0f6d92c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:04.598977 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2872/5723] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:04.599997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca95170-18d2-4e93-b361-b13ce0f6d92c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:04.635382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca95170-18d2-4e93-b361-b13ce0f6d92c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:04.642056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce082465-a090-4790-9758-372eca4b6ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:04.642777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce082465-a090-4790-9758-372eca4b6ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:04.643739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce082465-a090-4790-9758-372eca4b6ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:04.644019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce082465-a090-4790-9758-372eca4b6ae3 admin admin] PATH_INFO: `/v3/projects/9c4d8943425647fabfcd0fff04733488/users/7160547fe5964123bf610168bf57625e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:04.663218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce082465-a090-4790-9758-372eca4b6ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4d8943425647fabfcd0fff04733488, user_id=7160547fe5964123bf610168bf57625e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:04.666221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce082465-a090-4790-9758-372eca4b6ae3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:04.684721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cff1a7-6c61-4bf0-b744-98951e12b754 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:04.693772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373fc5-7dbb-4d81-ab6b-6c9206480d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:04.694411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373fc5-7dbb-4d81-ab6b-6c9206480d20 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:04.696404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373fc5-7dbb-4d81-ab6b-6c9206480d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:04.696712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373fc5-7dbb-4d81-ab6b-6c9206480d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:04.712144 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2873/5724] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:04 2022] PUT /identity/v3/projects/9c4d8943425647fabfcd0fff04733488/users/7160547fe5964123bf610168bf57625e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:04.720576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f7e0f-8b5b-4d65-979d-965df0d50608 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:04.721173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f7e0f-8b5b-4d65-979d-965df0d50608 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:04.721303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f7e0f-8b5b-4d65-979d-965df0d50608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:04.726173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9373fc5-7dbb-4d81-ab6b-6c9206480d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:04.727802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9373fc5-7dbb-4d81-ab6b-6c9206480d20 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:04.779336 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2852/5725] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:28:04.842681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-633f7e0f-8b5b-4d65-979d-965df0d50608 None None] MFA Rules not processed for user `7160547fe5964123bf610168bf57625e`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:04.850904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-633f7e0f-8b5b-4d65-979d-965df0d50608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:04.996173 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:05.143779 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2874/5726] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:05.156367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373fc5-7dbb-4d81-ab6b-6c9206480d20 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:05.158806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f9373fc5-7dbb-4d81-ab6b-6c9206480d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:05.361161 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:05.427887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373fc5-7dbb-4d81-ab6b-6c9206480d20 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:05.600500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c04c94-e8e0-4001-b27a-57ef9613cb88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:05.600500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c04c94-e8e0-4001-b27a-57ef9613cb88 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:05.600500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c04c94-e8e0-4001-b27a-57ef9613cb88 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:05.600500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c04c94-e8e0-4001-b27a-57ef9613cb88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:05.614551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c04c94-e8e0-4001-b27a-57ef9613cb88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:05.616327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c04c94-e8e0-4001-b27a-57ef9613cb88 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:05.640842 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2853/5727] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:05.716666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f7e0f-8b5b-4d65-979d-965df0d50608 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:05.719516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-633f7e0f-8b5b-4d65-979d-965df0d50608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:05.987270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f7e0f-8b5b-4d65-979d-965df0d50608 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:06.015260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:06.016174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:06.016653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:06.017113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] PATH_INFO: `/v3/projects/bcb8e5a97ef24d8488d7b33d452543f8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:06.018556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb8e5a97ef24d8488d7b33d452543f8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:06.021955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:06.155134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb8e5a97ef24d8488d7b33d452543f8', 'request_id': 'req-832b265b-9644-4a4d-9ff4-95b482eb1c57'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.176563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb8e5a97ef24d8488d7b33d452543f8', 'request_id': 'req-832b265b-9644-4a4d-9ff4-95b482eb1c57'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.187978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb8e5a97ef24d8488d7b33d452543f8', 'request_id': 'req-832b265b-9644-4a4d-9ff4-95b482eb1c57'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.225070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] The token cache is being invalidate because project bcb8e5a97ef24d8488d7b33d452543f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:06.230888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.233285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.244675 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2875/5728] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:05 2022] DELETE /identity/v3/projects/bcb8e5a97ef24d8488d7b33d452543f8 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:06.246310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c04c94-e8e0-4001-b27a-57ef9613cb88 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:06.269898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:06.271087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c04c94-e8e0-4001-b27a-57ef9613cb88 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:06.272389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:06.365068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b265b-9644-4a4d-9ff4-95b482eb1c57 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:06.373537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:06.375101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:06.375477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:06.375833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] PATH_INFO: `/v3/users/7160547fe5964123bf610168bf57625e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:06.377117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7160547fe5964123bf610168bf57625e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:06.379280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:06.385352 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:06.417231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1755ce-2456-4fe8-9e1a-f5b999fd0f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:06.417917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1755ce-2456-4fe8-9e1a-f5b999fd0f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:06.418216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1755ce-2456-4fe8-9e1a-f5b999fd0f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:06.418490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1755ce-2456-4fe8-9e1a-f5b999fd0f72 admin admin] PATH_INFO: `/v3/users/a36993851371477b9a0fde13765ad5f2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:06.422293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1755ce-2456-4fe8-9e1a-f5b999fd0f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36993851371477b9a0fde13765ad5f2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:06.425762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1755ce-2456-4fe8-9e1a-f5b999fd0f72 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:06.483946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7160547fe5964123bf610168bf57625e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.523656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df1755ce-2456-4fe8-9e1a-f5b999fd0f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36993851371477b9a0fde13765ad5f2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.525915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7160547fe5964123bf610168bf57625e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.526690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7160547fe5964123bf610168bf57625e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.553385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df1755ce-2456-4fe8-9e1a-f5b999fd0f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36993851371477b9a0fde13765ad5f2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.554193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df1755ce-2456-4fe8-9e1a-f5b999fd0f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36993851371477b9a0fde13765ad5f2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.557326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7160547fe5964123bf610168bf57625e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.558343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7160547fe5964123bf610168bf57625e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.565012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df1755ce-2456-4fe8-9e1a-f5b999fd0f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36993851371477b9a0fde13765ad5f2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.567957 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:06.574667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df1755ce-2456-4fe8-9e1a-f5b999fd0f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36993851371477b9a0fde13765ad5f2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:06.585215 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2854/5729] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:06 2022] DELETE /identity/v3/users/a36993851371477b9a0fde13765ad5f2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:06.627536 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2876/5730] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:06 2022] DELETE /identity/v3/users/7160547fe5964123bf610168bf57625e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:28:06.636079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f377057-baa8-4485-8aad-8d146dae9ec5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:06.636955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f377057-baa8-4485-8aad-8d146dae9ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:06.639741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f377057-baa8-4485-8aad-8d146dae9ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:06.719098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0f377057-baa8-4485-8aad-8d146dae9ec5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:06.723983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0f377057-baa8-4485-8aad-8d146dae9ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:06.916348 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2855/5731] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:06.997214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:07.001375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:07.128724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99aecb6-517d-4ff9-ac8a-10b5935a4f30 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:07.132816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcacbd-03bb-4ddf-8726-e67e74791618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:07.133549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcacbd-03bb-4ddf-8726-e67e74791618 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:07.134101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcacbd-03bb-4ddf-8726-e67e74791618 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:07.134476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcacbd-03bb-4ddf-8726-e67e74791618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:07.156673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcacbd-03bb-4ddf-8726-e67e74791618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:07.159068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcacbd-03bb-4ddf-8726-e67e74791618 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:07.175998 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2877/5732] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:07.332465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f377057-baa8-4485-8aad-8d146dae9ec5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:07.334030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0f377057-baa8-4485-8aad-8d146dae9ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:07.363732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f377057-baa8-4485-8aad-8d146dae9ec5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:07.394029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:07.395611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:07.395905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:07.396234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] PATH_INFO: `/v3/projects/bbb8e268332143babb7c4fd51b571d8c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:07.401523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb8e268332143babb7c4fd51b571d8c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:07.409356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:07.536925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb8e268332143babb7c4fd51b571d8c', 'request_id': 'req-f2bd3181-04bc-4082-831a-d511808ab24d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:07.554544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb8e268332143babb7c4fd51b571d8c', 'request_id': 'req-f2bd3181-04bc-4082-831a-d511808ab24d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:07.566531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb8e268332143babb7c4fd51b571d8c', 'request_id': 'req-f2bd3181-04bc-4082-831a-d511808ab24d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:07.604922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] The token cache is being invalidate because project bbb8e268332143babb7c4fd51b571d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:07.604922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:07.608485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2bd3181-04bc-4082-831a-d511808ab24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:07.613041 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2856/5733] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:07 2022] DELETE /identity/v3/projects/bbb8e268332143babb7c4fd51b571d8c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:07.618184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90aa1a-b2e6-412b-9147-05d2fceddca8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:07.618496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90aa1a-b2e6-412b-9147-05d2fceddca8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:07.618804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90aa1a-b2e6-412b-9147-05d2fceddca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:07.703532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6d90aa1a-b2e6-412b-9147-05d2fceddca8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:07.705084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6d90aa1a-b2e6-412b-9147-05d2fceddca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:07.852965 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2878/5734] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:07.871809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c75ffc-9dc9-40ed-a319-5d5f8cfab06e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:07.871809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c75ffc-9dc9-40ed-a319-5d5f8cfab06e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:07.871809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c75ffc-9dc9-40ed-a319-5d5f8cfab06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:07.915072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e4c75ffc-9dc9-40ed-a319-5d5f8cfab06e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:07.918295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e4c75ffc-9dc9-40ed-a319-5d5f8cfab06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:07.929193 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2857/5735] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:07.936112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90aa1a-b2e6-412b-9147-05d2fceddca8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:07.953879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90aa1a-b2e6-412b-9147-05d2fceddca8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:07.968451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c75ffc-9dc9-40ed-a319-5d5f8cfab06e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:07.970409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e4c75ffc-9dc9-40ed-a319-5d5f8cfab06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:07.979502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60665eda-21c9-4a77-8757-2c2f6f12ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:07.980105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665eda-21c9-4a77-8757-2c2f6f12ac58 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:07.980388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665eda-21c9-4a77-8757-2c2f6f12ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:07.980663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665eda-21c9-4a77-8757-2c2f6f12ac58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:07.981325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60665eda-21c9-4a77-8757-2c2f6f12ac58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:07.981632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60665eda-21c9-4a77-8757-2c2f6f12ac58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:07.993425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c75ffc-9dc9-40ed-a319-5d5f8cfab06e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:07.999462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60665eda-21c9-4a77-8757-2c2f6f12ac58 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:08.007942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:08.009250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:08.009250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:08.009250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] PATH_INFO: `/v3/projects/9c4d8943425647fabfcd0fff04733488` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:08.011672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4d8943425647fabfcd0fff04733488)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:08.018490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:08.051503 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2879/5736] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:08.052694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60665eda-21c9-4a77-8757-2c2f6f12ac58 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:08.069129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60665eda-21c9-4a77-8757-2c2f6f12ac58 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:08.088785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff09e2b-8ba2-4170-868f-f857cc82bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:08.089896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff09e2b-8ba2-4170-868f-f857cc82bd1d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:08.090327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff09e2b-8ba2-4170-868f-f857cc82bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:08.090787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff09e2b-8ba2-4170-868f-f857cc82bd1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:08.091729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff09e2b-8ba2-4170-868f-f857cc82bd1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:08.094692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff09e2b-8ba2-4170-868f-f857cc82bd1d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:08.147172 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:08.205820 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2880/5737] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:08 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:08.207999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff09e2b-8ba2-4170-868f-f857cc82bd1d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:08.213176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4d8943425647fabfcd0fff04733488', 'request_id': 'req-7f6b36b1-fe20-435e-afe0-4a04628c11db'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:08.228201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4d8943425647fabfcd0fff04733488', 'request_id': 'req-7f6b36b1-fe20-435e-afe0-4a04628c11db'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:08.255807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4d8943425647fabfcd0fff04733488', 'request_id': 'req-7f6b36b1-fe20-435e-afe0-4a04628c11db'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:08.260109 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:08.292629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] The token cache is being invalidate because project 9c4d8943425647fabfcd0fff04733488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:08.292968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:08.293817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7f6b36b1-fe20-435e-afe0-4a04628c11db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:08.306471 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2858/5738] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:07 2022] DELETE /identity/v3/projects/9c4d8943425647fabfcd0fff04733488 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:28:08.308336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a05a5-5c5b-4aab-930b-ac00701bf506 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:08.308623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a05a5-5c5b-4aab-930b-ac00701bf506 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:08.308903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a05a5-5c5b-4aab-930b-ac00701bf506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:08.375312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-df0a05a5-5c5b-4aab-930b-ac00701bf506 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:08.385229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-df0a05a5-5c5b-4aab-930b-ac00701bf506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:08.409700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff09e2b-8ba2-4170-868f-f857cc82bd1d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:08.411430 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2859/5739] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:08.419158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051379b1-d551-4095-8467-4cb350d68636 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:08.419975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051379b1-d551-4095-8467-4cb350d68636 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:08.420233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051379b1-d551-4095-8467-4cb350d68636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:08.429802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95492a6-305c-4064-8bc0-e513753b247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:08.430616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95492a6-305c-4064-8bc0-e513753b247c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:08.430912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95492a6-305c-4064-8bc0-e513753b247c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:08.431188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95492a6-305c-4064-8bc0-e513753b247c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:08.431877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95492a6-305c-4064-8bc0-e513753b247c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:08.434017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95492a6-305c-4064-8bc0-e513753b247c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:08.456082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-051379b1-d551-4095-8467-4cb350d68636 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:08.461023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-051379b1-d551-4095-8467-4cb350d68636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:08.479641 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2881/5740] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:08 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:08.481043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95492a6-305c-4064-8bc0-e513753b247c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:08.482738 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2860/5741] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:28:08.486456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051379b1-d551-4095-8467-4cb350d68636 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:08.488033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b95492a6-305c-4064-8bc0-e513753b247c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:08.499813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051379b1-d551-4095-8467-4cb350d68636 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:08.505397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a776c40-dd83-4e48-ab89-ac7b0bd9af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:08.507557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a776c40-dd83-4e48-ab89-ac7b0bd9af9d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:08.508047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a776c40-dd83-4e48-ab89-ac7b0bd9af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:08.508392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a776c40-dd83-4e48-ab89-ac7b0bd9af9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:08.509823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a776c40-dd83-4e48-ab89-ac7b0bd9af9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:08.510459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a776c40-dd83-4e48-ab89-ac7b0bd9af9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:08.512454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a776c40-dd83-4e48-ab89-ac7b0bd9af9d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:08.514566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95492a6-305c-4064-8bc0-e513753b247c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:08.527845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1c432-48de-4059-b990-a7135c52504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:08.528519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1c432-48de-4059-b990-a7135c52504f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:08.529016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1c432-48de-4059-b990-a7135c52504f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:08.529471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1c432-48de-4059-b990-a7135c52504f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:08.530224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1c432-48de-4059-b990-a7135c52504f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:08.533375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1c432-48de-4059-b990-a7135c52504f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:08.536341 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2861/5742] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:28:08.538820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a776c40-dd83-4e48-ab89-ac7b0bd9af9d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:08.567875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a776c40-dd83-4e48-ab89-ac7b0bd9af9d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:08.568069 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2882/5743] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:08.569011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1c432-48de-4059-b990-a7135c52504f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:08.576923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7881b5-f53b-4211-ad6f-8418db867dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:08.579377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7881b5-f53b-4211-ad6f-8418db867dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:08.579664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7881b5-f53b-4211-ad6f-8418db867dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:08.579939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7881b5-f53b-4211-ad6f-8418db867dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:08.582797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7881b5-f53b-4211-ad6f-8418db867dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:08.584774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7881b5-f53b-4211-ad6f-8418db867dd7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:08.587036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1c432-48de-4059-b990-a7135c52504f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:08.595825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6371044-cac0-41f2-85cb-869a7b1615c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:08.596453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371044-cac0-41f2-85cb-869a7b1615c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:08.596736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371044-cac0-41f2-85cb-869a7b1615c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:08.597013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371044-cac0-41f2-85cb-869a7b1615c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:08.597663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6371044-cac0-41f2-85cb-869a7b1615c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:08.599316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6371044-cac0-41f2-85cb-869a7b1615c9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:08.627609 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2883/5744] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:28:08.628594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6371044-cac0-41f2-85cb-869a7b1615c9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:08.649202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6371044-cac0-41f2-85cb-869a7b1615c9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:08.650252 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2862/5745] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:08 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:08.655655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7881b5-f53b-4211-ad6f-8418db867dd7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:08.769210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647af03-2a4f-4a2b-95f8-6b65c8e3fb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:08.769891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647af03-2a4f-4a2b-95f8-6b65c8e3fb98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:08.770175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647af03-2a4f-4a2b-95f8-6b65c8e3fb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:08.770467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647af03-2a4f-4a2b-95f8-6b65c8e3fb98 admin admin] PATH_INFO: `/v3/projects/5c70ed9a8c1046cd81525aa173821c9b/users/b697cc8ca7e34eaf84fd0832a93bbcd2/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:08.817892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647af03-2a4f-4a2b-95f8-6b65c8e3fb98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c70ed9a8c1046cd81525aa173821c9b, user_id=b697cc8ca7e34eaf84fd0832a93bbcd2, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:08.820737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647af03-2a4f-4a2b-95f8-6b65c8e3fb98 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:08.857352 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2884/5746] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:08 2022] PUT /identity/v3/projects/5c70ed9a8c1046cd81525aa173821c9b/users/b697cc8ca7e34eaf84fd0832a93bbcd2/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:08.860215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2df40-352b-46ca-9a56-dbb0c5ca516d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:08.860446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2df40-352b-46ca-9a56-dbb0c5ca516d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:08.860775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2df40-352b-46ca-9a56-dbb0c5ca516d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:08.866806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7881b5-f53b-4211-ad6f-8418db867dd7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:08.916733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6ae2df40-352b-46ca-9a56-dbb0c5ca516d None None] MFA Rules not processed for user `b697cc8ca7e34eaf84fd0832a93bbcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:08.918221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6ae2df40-352b-46ca-9a56-dbb0c5ca516d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:09.000541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cab04-82ee-433c-a89b-247fb13c42e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:09.001178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cab04-82ee-433c-a89b-247fb13c42e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:09.001463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cab04-82ee-433c-a89b-247fb13c42e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:09.001739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cab04-82ee-433c-a89b-247fb13c42e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:09.002379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cab04-82ee-433c-a89b-247fb13c42e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:09.004404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cab04-82ee-433c-a89b-247fb13c42e6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:09.022065 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:09.053817 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2863/5747] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:08 2022] POST /identity/v3/users => generated 283 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:09.059689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cab04-82ee-433c-a89b-247fb13c42e6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:09.086257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cab04-82ee-433c-a89b-247fb13c42e6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:09.101406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18400a8e-d85b-47c8-9173-7e40d8d7c681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:09.102030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18400a8e-d85b-47c8-9173-7e40d8d7c681 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:09.102312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18400a8e-d85b-47c8-9173-7e40d8d7c681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:09.102587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18400a8e-d85b-47c8-9173-7e40d8d7c681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:09.103268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18400a8e-d85b-47c8-9173-7e40d8d7c681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:09.104909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18400a8e-d85b-47c8-9173-7e40d8d7c681 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:09.122996 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2885/5748] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:28:09.133502 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2864/5749] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:09.136448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2df40-352b-46ca-9a56-dbb0c5ca516d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:09.144391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18400a8e-d85b-47c8-9173-7e40d8d7c681 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:09.151410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-18400a8e-d85b-47c8-9173-7e40d8d7c681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:09.162410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2df40-352b-46ca-9a56-dbb0c5ca516d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:09.173991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cdcbe-1f2d-477c-802d-bd6a9b26afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:09.174636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cdcbe-1f2d-477c-802d-bd6a9b26afa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:09.174943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cdcbe-1f2d-477c-802d-bd6a9b26afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:09.175216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cdcbe-1f2d-477c-802d-bd6a9b26afa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:09.175866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cdcbe-1f2d-477c-802d-bd6a9b26afa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:09.177923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cdcbe-1f2d-477c-802d-bd6a9b26afa4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:09.204515 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2886/5750] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:09.205985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cdcbe-1f2d-477c-802d-bd6a9b26afa4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:09.227163 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:09.228138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cdcbe-1f2d-477c-802d-bd6a9b26afa4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:09.241467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ca62b-97b8-4b1f-bc06-d878b7553b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:09.242081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ca62b-97b8-4b1f-bc06-d878b7553b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:09.242367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ca62b-97b8-4b1f-bc06-d878b7553b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:09.242665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ca62b-97b8-4b1f-bc06-d878b7553b5e admin admin] PATH_INFO: `/v3/projects/4e8b1b52126e4e8dbc11a636fcee433b/users/47236ae9d23142d08f1ebba7031df01c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:09.276422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ca62b-97b8-4b1f-bc06-d878b7553b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8b1b52126e4e8dbc11a636fcee433b, user_id=47236ae9d23142d08f1ebba7031df01c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:09.280942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ca62b-97b8-4b1f-bc06-d878b7553b5e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:09.297859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18400a8e-d85b-47c8-9173-7e40d8d7c681 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:09.305166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423e13d-9068-41d6-9889-40f4629c8d3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:09.309337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423e13d-9068-41d6-9889-40f4629c8d3d service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:09.312044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423e13d-9068-41d6-9889-40f4629c8d3d service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:09.313213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423e13d-9068-41d6-9889-40f4629c8d3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:09.318384 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2887/5751] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:09 2022] PUT /identity/v3/projects/4e8b1b52126e4e8dbc11a636fcee433b/users/47236ae9d23142d08f1ebba7031df01c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:09.324710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423e13d-9068-41d6-9889-40f4629c8d3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:09.327437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423e13d-9068-41d6-9889-40f4629c8d3d service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:09.337286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea193418-1a05-42db-be03-2c2bef27bd45 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:09.338581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea193418-1a05-42db-be03-2c2bef27bd45 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:09.338896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea193418-1a05-42db-be03-2c2bef27bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:09.344089 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2865/5752] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:09.392724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ea193418-1a05-42db-be03-2c2bef27bd45 None None] MFA Rules not processed for user `47236ae9d23142d08f1ebba7031df01c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:09.394586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ea193418-1a05-42db-be03-2c2bef27bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:09.523514 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2888/5753] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:09.528016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423e13d-9068-41d6-9889-40f4629c8d3d service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:09.547648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423e13d-9068-41d6-9889-40f4629c8d3d service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:09.628665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21d61c-5dfd-4273-aa29-1881182a1f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:09.630341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d61c-5dfd-4273-aa29-1881182a1f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:09.630888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d61c-5dfd-4273-aa29-1881182a1f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:09.631367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d61c-5dfd-4273-aa29-1881182a1f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:09.632255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21d61c-5dfd-4273-aa29-1881182a1f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:09.636416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21d61c-5dfd-4273-aa29-1881182a1f4f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:09.645747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5767-4732-46d2-8b4c-1e623d93915d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:09.646039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5767-4732-46d2-8b4c-1e623d93915d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:09.646312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5767-4732-46d2-8b4c-1e623d93915d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:09.682277 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2866/5754] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:09 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:09.683556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21d61c-5dfd-4273-aa29-1881182a1f4f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:09.705379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b01e5767-4732-46d2-8b4c-1e623d93915d None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:09.706542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b01e5767-4732-46d2-8b4c-1e623d93915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:09.793138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21d61c-5dfd-4273-aa29-1881182a1f4f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:09.799464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63189978-6b16-40ad-a636-b09f7a08aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:09.800116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63189978-6b16-40ad-a636-b09f7a08aeef admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:09.800396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63189978-6b16-40ad-a636-b09f7a08aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:09.800670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63189978-6b16-40ad-a636-b09f7a08aeef admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:09.801844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63189978-6b16-40ad-a636-b09f7a08aeef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:09.804455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63189978-6b16-40ad-a636-b09f7a08aeef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:09.823259 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2889/5755] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:28:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:09.837447 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2867/5756] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:09 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:09.837607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e5767-4732-46d2-8b4c-1e623d93915d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:09.853976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e5767-4732-46d2-8b4c-1e623d93915d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:09.856454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63189978-6b16-40ad-a636-b09f7a08aeef admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:09.860261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-63189978-6b16-40ad-a636-b09f7a08aeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:09.876449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6cb37-f904-48a9-a935-dbc697be771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:09.877169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6cb37-f904-48a9-a935-dbc697be771c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:09.877360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6cb37-f904-48a9-a935-dbc697be771c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:09.877633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6cb37-f904-48a9-a935-dbc697be771c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:09.878284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6cb37-f904-48a9-a935-dbc697be771c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:09.879923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6cb37-f904-48a9-a935-dbc697be771c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:09.910793 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2890/5757] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:28:09.914935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6cb37-f904-48a9-a935-dbc697be771c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:09.940807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6cb37-f904-48a9-a935-dbc697be771c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:09.956118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468af6f-b37a-46c9-8339-4fa354422cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:09.956960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468af6f-b37a-46c9-8339-4fa354422cab admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:09.957072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468af6f-b37a-46c9-8339-4fa354422cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:09.957477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468af6f-b37a-46c9-8339-4fa354422cab admin admin] PATH_INFO: `/v3/projects/0f40d4d6f34c4e159549b4785bcbd4b4/users/c86a9494142343d4944280bce32ed70a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:09.987776 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:09.990512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468af6f-b37a-46c9-8339-4fa354422cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f40d4d6f34c4e159549b4785bcbd4b4, user_id=c86a9494142343d4944280bce32ed70a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:09.992936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468af6f-b37a-46c9-8339-4fa354422cab admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:10.001884 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:10.020938 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2891/5758] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:09 2022] PUT /identity/v3/projects/0f40d4d6f34c4e159549b4785bcbd4b4/users/c86a9494142343d4944280bce32ed70a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:10.024970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468af6f-b37a-46c9-8339-4fa354422cab admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:10.030274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63189978-6b16-40ad-a636-b09f7a08aeef admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:10.137315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5fa13-4328-4b59-b78b-71721b5b8a07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:10.139344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5fa13-4328-4b59-b78b-71721b5b8a07 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:10.139686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5fa13-4328-4b59-b78b-71721b5b8a07 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:10.139968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5fa13-4328-4b59-b78b-71721b5b8a07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:10.155270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468af6f-b37a-46c9-8339-4fa354422cab admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:10.171131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2dd3-cf32-4de9-bd1c-a96605682cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:10.171760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2dd3-cf32-4de9-bd1c-a96605682cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:10.172041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2dd3-cf32-4de9-bd1c-a96605682cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:10.172315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2dd3-cf32-4de9-bd1c-a96605682cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:10.172961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de2dd3-cf32-4de9-bd1c-a96605682cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:10.174582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de2dd3-cf32-4de9-bd1c-a96605682cb3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:10.201291 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2892/5759] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:10.205742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2dd3-cf32-4de9-bd1c-a96605682cb3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:10.222547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2dd3-cf32-4de9-bd1c-a96605682cb3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:10.233820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fd4e6-f1c1-4d84-89cf-a0414927d412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:10.234418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fd4e6-f1c1-4d84-89cf-a0414927d412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:10.234722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fd4e6-f1c1-4d84-89cf-a0414927d412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:10.234999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fd4e6-f1c1-4d84-89cf-a0414927d412 admin admin] PATH_INFO: `/v3/projects/0f40d4d6f34c4e159549b4785bcbd4b4/users/c86a9494142343d4944280bce32ed70a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:10.237078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fd4e6-f1c1-4d84-89cf-a0414927d412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f40d4d6f34c4e159549b4785bcbd4b4, user_id=c86a9494142343d4944280bce32ed70a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:10.239837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fd4e6-f1c1-4d84-89cf-a0414927d412 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:10.241262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5fa13-4328-4b59-b78b-71721b5b8a07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:10.243799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5fa13-4328-4b59-b78b-71721b5b8a07 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:10.259783 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2868/5760] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:28:10.262663 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2893/5761] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:10 2022] PUT /identity/v3/projects/0f40d4d6f34c4e159549b4785bcbd4b4/users/c86a9494142343d4944280bce32ed70a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:28:10.278358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c4cf5-f814-4a5a-944a-6c5104006a5e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:10.279492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c4cf5-f814-4a5a-944a-6c5104006a5e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:10.280153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c4cf5-f814-4a5a-944a-6c5104006a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:10.350275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2f3c4cf5-f814-4a5a-944a-6c5104006a5e None None] MFA Rules not processed for user `c86a9494142343d4944280bce32ed70a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:10.355248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2f3c4cf5-f814-4a5a-944a-6c5104006a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:10.516384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fd4e6-f1c1-4d84-89cf-a0414927d412 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:10.530618 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2869/5762] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:10.537151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fd4e6-f1c1-4d84-89cf-a0414927d412 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:10.555004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30cebe-ad06-4ee3-bb42-eddc5d8fb3de tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:10.555632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30cebe-ad06-4ee3-bb42-eddc5d8fb3de tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:10.555931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30cebe-ad06-4ee3-bb42-eddc5d8fb3de tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:10.556184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30cebe-ad06-4ee3-bb42-eddc5d8fb3de tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:10.556870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30cebe-ad06-4ee3-bb42-eddc5d8fb3de tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:10.558733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30cebe-ad06-4ee3-bb42-eddc5d8fb3de tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:10.600772 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2894/5763] 10.222.0.23 () {60 vars in 1150 bytes} [Sun Oct 2 01:28:10 2022] POST /identity/v3/domains => generated 276 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:28:10.617423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c4cf5-f814-4a5a-944a-6c5104006a5e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:10.645636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c4cf5-f814-4a5a-944a-6c5104006a5e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:10.673723 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:10.742676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468cced-1c25-466e-a676-6cfc7cdb3207 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:10.743538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468cced-1c25-466e-a676-6cfc7cdb3207 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:10.744119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468cced-1c25-466e-a676-6cfc7cdb3207 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:10.744643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468cced-1c25-466e-a676-6cfc7cdb3207 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:10.745662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468cced-1c25-466e-a676-6cfc7cdb3207 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:10.748359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468cced-1c25-466e-a676-6cfc7cdb3207 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:10.775156 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2870/5764] 10.222.0.23 () {60 vars in 1150 bytes} [Sun Oct 2 01:28:10 2022] POST /identity/v3/domains => generated 276 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:10.779541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30cebe-ad06-4ee3-bb42-eddc5d8fb3de tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:10.791718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30cebe-ad06-4ee3-bb42-eddc5d8fb3de tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:10.867130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffab24-8b59-4a4c-87ac-aaa1f69862c0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:10.867306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffab24-8b59-4a4c-87ac-aaa1f69862c0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:10.867584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffab24-8b59-4a4c-87ac-aaa1f69862c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:10.888652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22cf9e-eaf6-42cd-a1bc-fcf6fc9ad5fb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:10.889280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22cf9e-eaf6-42cd-a1bc-fcf6fc9ad5fb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:10.889642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22cf9e-eaf6-42cd-a1bc-fcf6fc9ad5fb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:10.889923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22cf9e-eaf6-42cd-a1bc-fcf6fc9ad5fb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:10.890791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22cf9e-eaf6-42cd-a1bc-fcf6fc9ad5fb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:10.891980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-81ffab24-8b59-4a4c-87ac-aaa1f69862c0 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:10.892413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22cf9e-eaf6-42cd-a1bc-fcf6fc9ad5fb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:10.893628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-81ffab24-8b59-4a4c-87ac-aaa1f69862c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:10.923094 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2895/5765] 10.222.0.23 () {60 vars in 1150 bytes} [Sun Oct 2 01:28:10 2022] POST /identity/v3/domains => generated 277 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:10.924337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22cf9e-eaf6-42cd-a1bc-fcf6fc9ad5fb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:11.031951 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2871/5766] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:28:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:28:11.048187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffab24-8b59-4a4c-87ac-aaa1f69862c0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:11.049414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22cf9e-eaf6-42cd-a1bc-fcf6fc9ad5fb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:11.056158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1004e8-d602-47aa-839e-35017fc3f639 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:11.057280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1004e8-d602-47aa-839e-35017fc3f639 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:11.057280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1004e8-d602-47aa-839e-35017fc3f639 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:11.057944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1004e8-d602-47aa-839e-35017fc3f639 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:11.058934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1004e8-d602-47aa-839e-35017fc3f639 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:11.061804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1004e8-d602-47aa-839e-35017fc3f639 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:11.071147 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:11.099936 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2896/5767] 10.222.0.23 () {60 vars in 1150 bytes} [Sun Oct 2 01:28:10 2022] POST /identity/v3/domains => generated 277 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:11.104944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1004e8-d602-47aa-839e-35017fc3f639 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:11.165088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffab24-8b59-4a4c-87ac-aaa1f69862c0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:11.237068 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:11.239352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1004e8-d602-47aa-839e-35017fc3f639 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:11.248586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:11.250152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:11.250442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:11.250751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/ed3dcef941c3401db2e364582094cca8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:11.263784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ed3dcef941c3401db2e364582094cca8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:11.264983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b620b0c-0367-41c0-aaba-ecd769def255 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:11.265667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b620b0c-0367-41c0-aaba-ecd769def255 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:11.265958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b620b0c-0367-41c0-aaba-ecd769def255 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:11.266065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:11.266399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b620b0c-0367-41c0-aaba-ecd769def255 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:11.300884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ed3dcef941c3401db2e364582094cca8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:11.307396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ed3dcef941c3401db2e364582094cca8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:11.438837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3dcef941c3401db2e364582094cca8', 'request_id': 'req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:11.450800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b620b0c-0367-41c0-aaba-ecd769def255 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:11.452957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b620b0c-0367-41c0-aaba-ecd769def255 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:11.456088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3dcef941c3401db2e364582094cca8', 'request_id': 'req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:11.467073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3dcef941c3401db2e364582094cca8', 'request_id': 'req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:11.484465 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2872/5768] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:11.508040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] The token cache is being invalidate because project ed3dcef941c3401db2e364582094cca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:11.508342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:11.522025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:11.536799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ed3dcef941c3401db2e364582094cca8', 'request_id': 'req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:11.541409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ed3dcef941c3401db2e364582094cca8', 'request_id': 'req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:11.542160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ed3dcef941c3401db2e364582094cca8', 'request_id': 'req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:11.550592 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2897/5769] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:28:11 2022] DELETE /identity/v3/domains/ed3dcef941c3401db2e364582094cca8 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:11.556072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b620b0c-0367-41c0-aaba-ecd769def255 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:11.588271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b620b0c-0367-41c0-aaba-ecd769def255 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:11.778945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ac5b0-cac4-446b-a061-1f3d2ec49200 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:11.780126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ac5b0-cac4-446b-a061-1f3d2ec49200 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:11.780500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ac5b0-cac4-446b-a061-1f3d2ec49200 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:11.781531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ac5b0-cac4-446b-a061-1f3d2ec49200 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:11.782263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ac5b0-cac4-446b-a061-1f3d2ec49200 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:11.787054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ac5b0-cac4-446b-a061-1f3d2ec49200 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:11.819012 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2873/5770] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:28:11 2022] POST /identity/v3/domains => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:11.823776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:11.826949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:11.860200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cbbcf-6ed7-458c-a56f-f17eabdcd35c tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:11.940958 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:12.058254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb43903-90ee-40ac-a87d-09c8641c7e53 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:12.059680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb43903-90ee-40ac-a87d-09c8641c7e53 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:12.060680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb43903-90ee-40ac-a87d-09c8641c7e53 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:12.064637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb43903-90ee-40ac-a87d-09c8641c7e53 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/dff802dd982949d08ba1ba1ded6c0034` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:12.113032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb43903-90ee-40ac-a87d-09c8641c7e53 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dff802dd982949d08ba1ba1ded6c0034)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:12.114772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb43903-90ee-40ac-a87d-09c8641c7e53 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:12.202972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0cb43903-90ee-40ac-a87d-09c8641c7e53 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.204017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0cb43903-90ee-40ac-a87d-09c8641c7e53 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.270298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0cb43903-90ee-40ac-a87d-09c8641c7e53 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.279566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0cb43903-90ee-40ac-a87d-09c8641c7e53 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.282269 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2898/5771] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:28:11 2022] PATCH /identity/v3/domains/dff802dd982949d08ba1ba1ded6c0034 => generated 249 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:28:12.286711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ac5b0-cac4-446b-a061-1f3d2ec49200 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:12.289082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2c1ac5b0-cac4-446b-a061-1f3d2ec49200 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:12.328834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ac5b0-cac4-446b-a061-1f3d2ec49200 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:12.406729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be1e00-02ff-4dcc-b818-c103322b2333 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:12.407019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be1e00-02ff-4dcc-b818-c103322b2333 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:12.407299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be1e00-02ff-4dcc-b818-c103322b2333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:12.442289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c5be1e00-02ff-4dcc-b818-c103322b2333 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:12.442974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c5be1e00-02ff-4dcc-b818-c103322b2333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:12.446207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:12.446916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:12.447205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:12.447485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/dff802dd982949d08ba1ba1ded6c0034` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:12.481312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dff802dd982949d08ba1ba1ded6c0034)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:12.488227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:12.556676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.566071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.568384 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:12.589951 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2899/5772] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:12.605028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be1e00-02ff-4dcc-b818-c103322b2333 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:12.606504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c5be1e00-02ff-4dcc-b818-c103322b2333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:12.715118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034', 'request_id': 'req-70a14437-cc9a-4ad6-b837-545c2416f928'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.731189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034', 'request_id': 'req-70a14437-cc9a-4ad6-b837-545c2416f928'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.743536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034', 'request_id': 'req-70a14437-cc9a-4ad6-b837-545c2416f928'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.811697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] The token cache is being invalidate because project dff802dd982949d08ba1ba1ded6c0034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:12.811990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.821266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.829463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be1e00-02ff-4dcc-b818-c103322b2333 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:12.855574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034', 'request_id': 'req-70a14437-cc9a-4ad6-b837-545c2416f928'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.862671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034', 'request_id': 'req-70a14437-cc9a-4ad6-b837-545c2416f928'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.864051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dff802dd982949d08ba1ba1ded6c0034', 'request_id': 'req-70a14437-cc9a-4ad6-b837-545c2416f928'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:12.901443 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2874/5773] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:28:12 2022] DELETE /identity/v3/domains/dff802dd982949d08ba1ba1ded6c0034 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:12.902537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:12.904927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:12.927249 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:13.014882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855bb8a-58de-44f0-a08f-5d78b208ebf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:13.020053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bb8a-58de-44f0-a08f-5d78b208ebf4 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:13.021101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bb8a-58de-44f0-a08f-5d78b208ebf4 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:13.022076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bb8a-58de-44f0-a08f-5d78b208ebf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:13.031837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c855bb8a-58de-44f0-a08f-5d78b208ebf4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:13.120244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a14437-cc9a-4ad6-b837-545c2416f928 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:13.145407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1215e2c-bdbf-4540-a116-95b06652264a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:13.146488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1215e2c-bdbf-4540-a116-95b06652264a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:13.147029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1215e2c-bdbf-4540-a116-95b06652264a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:13.147515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1215e2c-bdbf-4540-a116-95b06652264a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:13.148572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1215e2c-bdbf-4540-a116-95b06652264a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:13.154348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1215e2c-bdbf-4540-a116-95b06652264a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:13.208124 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2875/5774] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:28:12 2022] POST /identity/v3/domains => generated 279 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:13.211973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855bb8a-58de-44f0-a08f-5d78b208ebf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:13.213747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855bb8a-58de-44f0-a08f-5d78b208ebf4 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:13.214493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1215e2c-bdbf-4540-a116-95b06652264a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:13.237022 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2900/5775] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:13.391257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1215e2c-bdbf-4540-a116-95b06652264a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:13.398693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:13.399649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:13.400142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:13.400541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/ba3bba3894ad41a1bb18758cfe3fb821` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:13.412946 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:13.421954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ba3bba3894ad41a1bb18758cfe3fb821)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:13.426456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:13.485885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:13.488191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:13.578176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:13.580436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:13.587713 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2876/5776] 10.222.0.23 () {60 vars in 1250 bytes} [Sun Oct 2 01:28:13 2022] PATCH /identity/v3/domains/ba3bba3894ad41a1bb18758cfe3fb821 => generated 279 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:13.588692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b735e-987b-4b84-b50e-cd9c2d621f79 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:13.588978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b735e-987b-4b84-b50e-cd9c2d621f79 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:13.589326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b735e-987b-4b84-b50e-cd9c2d621f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:13.589568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:13.591760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:13.652952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b51b735e-987b-4b84-b50e-cd9c2d621f79 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:13.656411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b51b735e-987b-4b84-b50e-cd9c2d621f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:13.849467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378662a-7c04-49d8-9ac1-dec08bddb363 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:13.871047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8719aaa-087d-4457-8717-87895f34c25f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:13.881072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8719aaa-087d-4457-8717-87895f34c25f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:13.881403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8719aaa-087d-4457-8717-87895f34c25f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:13.881699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8719aaa-087d-4457-8717-87895f34c25f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/ba3bba3894ad41a1bb18758cfe3fb821` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:13.891277 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2901/5777] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 02 01:28:13.892388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b735e-987b-4b84-b50e-cd9c2d621f79 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:13.895474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b51b735e-987b-4b84-b50e-cd9c2d621f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:13.960720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8719aaa-087d-4457-8717-87895f34c25f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=ba3bba3894ad41a1bb18758cfe3fb821)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:13.981198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8719aaa-087d-4457-8717-87895f34c25f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:13.997777 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2877/5778] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:28:13 2022] GET /identity/v3/domains/ba3bba3894ad41a1bb18758cfe3fb821 => generated 279 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:14.009461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8719aaa-087d-4457-8717-87895f34c25f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:14.032646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8719aaa-087d-4457-8717-87895f34c25f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:14.049489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:14.050149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:14.050439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:14.050738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/ba3bba3894ad41a1bb18758cfe3fb821` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:14.052319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ba3bba3894ad41a1bb18758cfe3fb821)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:14.054638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:14.136594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:14.141359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b735e-987b-4b84-b50e-cd9c2d621f79 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:14.143101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:14.153912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6c37b-a253-4cc5-8530-8ed9a1d52da9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:14.155611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6c37b-a253-4cc5-8530-8ed9a1d52da9 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:14.155891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6c37b-a253-4cc5-8530-8ed9a1d52da9 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:14.156159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6c37b-a253-4cc5-8530-8ed9a1d52da9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:14.194162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6c37b-a253-4cc5-8530-8ed9a1d52da9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:14.197899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6c37b-a253-4cc5-8530-8ed9a1d52da9 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:14.234359 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2902/5779] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:14.318159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821', 'request_id': 'req-95e65297-9625-40db-bbe8-1de37fdbebc9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:14.345178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821', 'request_id': 'req-95e65297-9625-40db-bbe8-1de37fdbebc9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:14.360674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821', 'request_id': 'req-95e65297-9625-40db-bbe8-1de37fdbebc9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:14.385811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] The token cache is being invalidate because project ba3bba3894ad41a1bb18758cfe3fb821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:14.389293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:14.390900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:14.423037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821', 'request_id': 'req-95e65297-9625-40db-bbe8-1de37fdbebc9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:14.425693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821', 'request_id': 'req-95e65297-9625-40db-bbe8-1de37fdbebc9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:14.427124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ba3bba3894ad41a1bb18758cfe3fb821', 'request_id': 'req-95e65297-9625-40db-bbe8-1de37fdbebc9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:14.433193 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:14.478760 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2878/5780] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:28:14 2022] DELETE /identity/v3/domains/ba3bba3894ad41a1bb18758cfe3fb821 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:14.479806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6c37b-a253-4cc5-8530-8ed9a1d52da9 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:14.502226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6c37b-a253-4cc5-8530-8ed9a1d52da9 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:14.519306 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:14.723001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c0745-8e7e-495f-8ede-b8fa0f4b3c01 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:14.723760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c0745-8e7e-495f-8ede-b8fa0f4b3c01 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:14.724044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c0745-8e7e-495f-8ede-b8fa0f4b3c01 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:14.724427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c0745-8e7e-495f-8ede-b8fa0f4b3c01 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:14.725087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c0745-8e7e-495f-8ede-b8fa0f4b3c01 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:14.729220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c0745-8e7e-495f-8ede-b8fa0f4b3c01 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:14.789056 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2903/5781] 10.222.0.23 () {58 vars in 1128 bytes} [Sun Oct 2 01:28:14 2022] GET /identity/v3/domains => generated 1347 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:14.790300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:14.793802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:14.840155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e65297-9625-40db-bbe8-1de37fdbebc9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:14.860230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4af0e-4d55-4959-978e-3e0fab3a6958 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:14.860891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4af0e-4d55-4959-978e-3e0fab3a6958 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:14.861172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4af0e-4d55-4959-978e-3e0fab3a6958 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:14.861444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4af0e-4d55-4959-978e-3e0fab3a6958 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/ba3bba3894ad41a1bb18758cfe3fb821` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:14.880203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4af0e-4d55-4959-978e-3e0fab3a6958 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c3d4af0e-4d55-4959-978e-3e0fab3a6958 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Could not find domain: ba3bba3894ad41a1bb18758cfe3fb821.: keystone.exception.DomainNotFound: Could not find domain: ba3bba3894ad41a1bb18758cfe3fb821. Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ba3bba3894ad41a1bb18758cfe3fb821. Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:28:14.901114 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:28:14.902370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ba3bba3894ad41a1bb18758cfe3fb821. Oct 02 01:28:14.904193 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:28:14.910315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c0745-8e7e-495f-8ede-b8fa0f4b3c01 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:14.914687 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2879/5782] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:28:14 2022] PATCH /identity/v3/domains/ba3bba3894ad41a1bb18758cfe3fb821 => generated 112 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 02 01:28:14.935712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c0745-8e7e-495f-8ede-b8fa0f4b3c01 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:14.955666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f4754-6eee-4614-b225-4f15ff2bdde8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:14.978090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4af0e-4d55-4959-978e-3e0fab3a6958 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:14.978221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4754-6eee-4614-b225-4f15ff2bdde8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:14.978430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4754-6eee-4614-b225-4f15ff2bdde8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:14.978745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4754-6eee-4614-b225-4f15ff2bdde8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:14.980549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c3d4af0e-4d55-4959-978e-3e0fab3a6958 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:14.980703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f4754-6eee-4614-b225-4f15ff2bdde8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:14.990846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f4754-6eee-4614-b225-4f15ff2bdde8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:15.028285 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2904/5783] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:28:14 2022] POST /identity/v3/domains => generated 274 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:28:15.030109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f4754-6eee-4614-b225-4f15ff2bdde8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:15.218423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f4754-6eee-4614-b225-4f15ff2bdde8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:15.236057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4af0e-4d55-4959-978e-3e0fab3a6958 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:15.236433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126099b4-3e30-40a6-80aa-03e4171125f4 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:15.238791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126099b4-3e30-40a6-80aa-03e4171125f4 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:15.239293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126099b4-3e30-40a6-80aa-03e4171125f4 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:15.242008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126099b4-3e30-40a6-80aa-03e4171125f4 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:15.243133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126099b4-3e30-40a6-80aa-03e4171125f4 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:15.253565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126099b4-3e30-40a6-80aa-03e4171125f4 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:15.347678 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2905/5784] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:15 2022] POST /identity/v3/users => generated 348 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:15.349233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b6fd-840b-43fa-a43c-10611b333f69 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:15.349704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b6fd-840b-43fa-a43c-10611b333f69 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:15.350135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b6fd-840b-43fa-a43c-10611b333f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:15.397307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b7a2b6fd-840b-43fa-a43c-10611b333f69 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:15.403101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b7a2b6fd-840b-43fa-a43c-10611b333f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:15.425670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f98347-b75d-4309-bfe0-33b2b23db3e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:15.426426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f98347-b75d-4309-bfe0-33b2b23db3e4 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:15.429481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f98347-b75d-4309-bfe0-33b2b23db3e4 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:15.429694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f98347-b75d-4309-bfe0-33b2b23db3e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:15.434302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d1f98347-b75d-4309-bfe0-33b2b23db3e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:15.572911 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2906/5785] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:15.573774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2b6fd-840b-43fa-a43c-10611b333f69 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:15.585707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2b6fd-840b-43fa-a43c-10611b333f69 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:15.590342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b85279-06e2-4694-a40b-77a10d8760e1 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:15.591095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b85279-06e2-4694-a40b-77a10d8760e1 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:15.591386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b85279-06e2-4694-a40b-77a10d8760e1 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:15.591688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b85279-06e2-4694-a40b-77a10d8760e1 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/groups` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:15.592384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b85279-06e2-4694-a40b-77a10d8760e1 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:15.594199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b85279-06e2-4694-a40b-77a10d8760e1 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:15.616656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f98347-b75d-4309-bfe0-33b2b23db3e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:15.619012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f98347-b75d-4309-bfe0-33b2b23db3e4 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:15.622655 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2907/5786] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:28:15 2022] POST /identity/v3/groups => generated 325 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:15.622655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b85279-06e2-4694-a40b-77a10d8760e1 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:15.645286 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:15.660476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b85279-06e2-4694-a40b-77a10d8760e1 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:15.670735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0f928-28d6-43ce-9859-34b321679386 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:15.671783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f928-28d6-43ce-9859-34b321679386 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:15.672439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f928-28d6-43ce-9859-34b321679386 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:15.672913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f928-28d6-43ce-9859-34b321679386 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:15.677126 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2880/5787] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 655 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:28:15.678264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f98347-b75d-4309-bfe0-33b2b23db3e4 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:15.688321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0f928-28d6-43ce-9859-34b321679386 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:15.698822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0f928-28d6-43ce-9859-34b321679386 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:15.712869 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2908/5788] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:15.739846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f98347-b75d-4309-bfe0-33b2b23db3e4 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:15.753205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbe4ca-b474-48f7-968d-1ef59c990cf2 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:15.754031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe4ca-b474-48f7-968d-1ef59c990cf2 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:15.754472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe4ca-b474-48f7-968d-1ef59c990cf2 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:15.754928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe4ca-b474-48f7-968d-1ef59c990cf2 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/ff76beb0601e4d978f5bf852b15e50fa` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:15.761155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbe4ca-b474-48f7-968d-1ef59c990cf2 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ff76beb0601e4d978f5bf852b15e50fa)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:15.763740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbe4ca-b474-48f7-968d-1ef59c990cf2 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:15.842573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-33cbe4ca-b474-48f7-968d-1ef59c990cf2 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:15.843680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-33cbe4ca-b474-48f7-968d-1ef59c990cf2 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:15.855770 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:15.895817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-33cbe4ca-b474-48f7-968d-1ef59c990cf2 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:15.896431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-33cbe4ca-b474-48f7-968d-1ef59c990cf2 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:15.904621 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2881/5789] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:28:15 2022] PATCH /identity/v3/domains/ff76beb0601e4d978f5bf852b15e50fa => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:15.905549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0f928-28d6-43ce-9859-34b321679386 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:15.940979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0f928-28d6-43ce-9859-34b321679386 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:16.150398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:16.151431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:16.151786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:16.152582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/ff76beb0601e4d978f5bf852b15e50fa` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:16.182163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ff76beb0601e4d978f5bf852b15e50fa)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:16.187462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:16.191990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da03f2c-9dc5-43e6-bbb3-bde7c707c6f5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:16.192278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da03f2c-9dc5-43e6-bbb3-bde7c707c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:16.192551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da03f2c-9dc5-43e6-bbb3-bde7c707c6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:16.241888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1da03f2c-9dc5-43e6-bbb3-bde7c707c6f5 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:16.245039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1da03f2c-9dc5-43e6-bbb3-bde7c707c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:16.255690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.259487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.437895 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2882/5790] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:16.461120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da03f2c-9dc5-43e6-bbb3-bde7c707c6f5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:16.464362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1da03f2c-9dc5-43e6-bbb3-bde7c707c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:16.546122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860bcd05e0a04bdcb25e6b1bced2dd9f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.560711 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:16.577610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860bcd05e0a04bdcb25e6b1bced2dd9f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.579269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860bcd05e0a04bdcb25e6b1bced2dd9f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.601097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860bcd05e0a04bdcb25e6b1bced2dd9f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.601735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860bcd05e0a04bdcb25e6b1bced2dd9f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.638562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da03f2c-9dc5-43e6-bbb3-bde7c707c6f5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:16.738480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa', 'request_id': 'req-319b7fe5-439c-45e9-85e3-e8e7839a6257'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.758824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa', 'request_id': 'req-319b7fe5-439c-45e9-85e3-e8e7839a6257'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.766690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa', 'request_id': 'req-319b7fe5-439c-45e9-85e3-e8e7839a6257'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.783924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] The token cache is being invalidate because project ff76beb0601e4d978f5bf852b15e50fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:16.784285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.785110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.797060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa', 'request_id': 'req-319b7fe5-439c-45e9-85e3-e8e7839a6257'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.802142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa', 'request_id': 'req-319b7fe5-439c-45e9-85e3-e8e7839a6257'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.805163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ff76beb0601e4d978f5bf852b15e50fa', 'request_id': 'req-319b7fe5-439c-45e9-85e3-e8e7839a6257'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:16.859880 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2909/5791] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:28:15 2022] DELETE /identity/v3/domains/ff76beb0601e4d978f5bf852b15e50fa => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:16.864200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:16.867337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:16.883558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86516e-e462-43c2-837d-090a5a46aebc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:16.884101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86516e-e462-43c2-837d-090a5a46aebc service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:16.884185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86516e-e462-43c2-837d-090a5a46aebc service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:16.884417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86516e-e462-43c2-837d-090a5a46aebc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:16.887692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3d86516e-e462-43c2-837d-090a5a46aebc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:17.028131 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:17.057978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b7fe5-439c-45e9-85e3-e8e7839a6257 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:17.072424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8115c-39b6-4923-9ac3-a99eb870fea9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:17.073393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8115c-39b6-4923-9ac3-a99eb870fea9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:17.074926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8115c-39b6-4923-9ac3-a99eb870fea9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:17.076488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8115c-39b6-4923-9ac3-a99eb870fea9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/ff76beb0601e4d978f5bf852b15e50fa` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:17.079656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86516e-e462-43c2-837d-090a5a46aebc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:17.081376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86516e-e462-43c2-837d-090a5a46aebc service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:17.102994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8115c-39b6-4923-9ac3-a99eb870fea9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=ff76beb0601e4d978f5bf852b15e50fa)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:17.103209 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2883/5792] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:28:17.103911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a17e20-ea82-46a7-a035-5a298f7dc7fe None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:17.104199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a17e20-ea82-46a7-a035-5a298f7dc7fe None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:17.104866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8115c-39b6-4923-9ac3-a99eb870fea9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:17.108056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a17e20-ea82-46a7-a035-5a298f7dc7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-cbf8115c-39b6-4923-9ac3-a99eb870fea9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Could not find domain: ff76beb0601e4d978f5bf852b15e50fa.: keystone.exception.DomainNotFound: Could not find domain: ff76beb0601e4d978f5bf852b15e50fa. Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ff76beb0601e4d978f5bf852b15e50fa. Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:28:17.130520 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:28:17.131669 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ff76beb0601e4d978f5bf852b15e50fa. Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:17.132798 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2910/5793] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:28:16 2022] GET /identity/v3/domains/ff76beb0601e4d978f5bf852b15e50fa => generated 112 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:28:17.135981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8115c-39b6-4923-9ac3-a99eb870fea9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:17.151652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-14a17e20-ea82-46a7-a035-5a298f7dc7fe None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:17.152867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-14a17e20-ea82-46a7-a035-5a298f7dc7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:17.159014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8115c-39b6-4923-9ac3-a99eb870fea9 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:17.186837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c6f4-36e1-4172-9dc4-c4007307b31a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:17.188320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c6f4-36e1-4172-9dc4-c4007307b31a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:17.189595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c6f4-36e1-4172-9dc4-c4007307b31a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:17.190203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c6f4-36e1-4172-9dc4-c4007307b31a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/users/860bcd05e0a04bdcb25e6b1bced2dd9f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:17.203577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c6f4-36e1-4172-9dc4-c4007307b31a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:get_user(user_id=860bcd05e0a04bdcb25e6b1bced2dd9f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:17.206570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c6f4-36e1-4172-9dc4-c4007307b31a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-9c93c6f4-36e1-4172-9dc4-c4007307b31a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Could not find user: 860bcd05e0a04bdcb25e6b1bced2dd9f.: keystone.exception.UserNotFound: Could not find user: 860bcd05e0a04bdcb25e6b1bced2dd9f. Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 02 01:28:17.235956 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:28:17.237152 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 860bcd05e0a04bdcb25e6b1bced2dd9f. Oct 02 01:28:17.238244 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:17.240845 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2911/5794] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:28:17 2022] GET /identity/v3/users/860bcd05e0a04bdcb25e6b1bced2dd9f => generated 110 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:28:17.244950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c6f4-36e1-4172-9dc4-c4007307b31a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:17.298361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c6f4-36e1-4172-9dc4-c4007307b31a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:17.316492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b7ae-7a56-4aa5-bb54-425d0bbe82a7 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:17.317478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b7ae-7a56-4aa5-bb54-425d0bbe82a7 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:17.319288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b7ae-7a56-4aa5-bb54-425d0bbe82a7 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:17.320936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b7ae-7a56-4aa5-bb54-425d0bbe82a7 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/groups/9ac643045281494a8ab9080db535b8da` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:17.332113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56b7ae-7a56-4aa5-bb54-425d0bbe82a7 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:get_group(group_id=9ac643045281494a8ab9080db535b8da)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:17.338138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56b7ae-7a56-4aa5-bb54-425d0bbe82a7 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:17.363111 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2884/5795] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-dd56b7ae-7a56-4aa5-bb54-425d0bbe82a7 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Could not find group: 9ac643045281494a8ab9080db535b8da.: keystone.exception.GroupNotFound: Could not find group: 9ac643045281494a8ab9080db535b8da. Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 02 01:28:17.374584 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:28:17.375476 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 9ac643045281494a8ab9080db535b8da. Oct 02 01:28:17.376574 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:17.379543 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2912/5796] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:17 2022] GET /identity/v3/groups/9ac643045281494a8ab9080db535b8da => generated 111 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:28:17.381010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a17e20-ea82-46a7-a035-5a298f7dc7fe None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:17.383540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b7ae-7a56-4aa5-bb54-425d0bbe82a7 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:17.388671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dd56b7ae-7a56-4aa5-bb54-425d0bbe82a7 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:17.402764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a17e20-ea82-46a7-a035-5a298f7dc7fe None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:17.411651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52235dd-8622-4e3e-a46b-cfe04a2a1f49 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:17.412628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52235dd-8622-4e3e-a46b-cfe04a2a1f49 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:17.413142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52235dd-8622-4e3e-a46b-cfe04a2a1f49 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:17.413622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52235dd-8622-4e3e-a46b-cfe04a2a1f49 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/groups/9ac643045281494a8ab9080db535b8da` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:17.419705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52235dd-8622-4e3e-a46b-cfe04a2a1f49 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f52235dd-8622-4e3e-a46b-cfe04a2a1f49 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Could not find group: 9ac643045281494a8ab9080db535b8da.: keystone.exception.GroupNotFound: Could not find group: 9ac643045281494a8ab9080db535b8da. Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 02 01:28:17.426196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:28:17.427423 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 9ac643045281494a8ab9080db535b8da. Oct 02 01:28:17.428468 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:28:17.431362 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:17.435229 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2885/5797] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:28:17 2022] DELETE /identity/v3/groups/9ac643045281494a8ab9080db535b8da => generated 111 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:28:17.436728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52235dd-8622-4e3e-a46b-cfe04a2a1f49 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:17.440048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f52235dd-8622-4e3e-a46b-cfe04a2a1f49 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:17.551917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52235dd-8622-4e3e-a46b-cfe04a2a1f49 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:17.557431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b7ae-7a56-4aa5-bb54-425d0bbe82a7 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:17.558493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05e6aa-2671-43f7-9dc9-238f6444dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:17.559617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05e6aa-2671-43f7-9dc9-238f6444dfe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:17.563747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05e6aa-2671-43f7-9dc9-238f6444dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:17.564030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05e6aa-2671-43f7-9dc9-238f6444dfe5 admin admin] PATH_INFO: `/v3/users/b697cc8ca7e34eaf84fd0832a93bbcd2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:17.564145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a56ce7-ace9-4069-87c1-d5968af898b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:17.564759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a56ce7-ace9-4069-87c1-d5968af898b7 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:17.565040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a56ce7-ace9-4069-87c1-d5968af898b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:17.565312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a56ce7-ace9-4069-87c1-d5968af898b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:17.566055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05e6aa-2671-43f7-9dc9-238f6444dfe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b697cc8ca7e34eaf84fd0832a93bbcd2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:17.568074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05e6aa-2671-43f7-9dc9-238f6444dfe5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:17.588067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a56ce7-ace9-4069-87c1-d5968af898b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:17.589818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a56ce7-ace9-4069-87c1-d5968af898b7 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:17.613987 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2913/5798] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:17.616655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a56ce7-ace9-4069-87c1-d5968af898b7 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:17.641167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a56ce7-ace9-4069-87c1-d5968af898b7 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:17.646348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f1604-54b5-4520-b6b8-0a96f7dc751e tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:17.647044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1604-54b5-4520-b6b8-0a96f7dc751e tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:17.647331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1604-54b5-4520-b6b8-0a96f7dc751e tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:17.647757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1604-54b5-4520-b6b8-0a96f7dc751e tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/users/860bcd05e0a04bdcb25e6b1bced2dd9f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:17.655296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce05e6aa-2671-43f7-9dc9-238f6444dfe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b697cc8ca7e34eaf84fd0832a93bbcd2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:17.656877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f1604-54b5-4520-b6b8-0a96f7dc751e tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:delete_user(user_id=860bcd05e0a04bdcb25e6b1bced2dd9f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:17.659076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f1604-54b5-4520-b6b8-0a96f7dc751e tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-818f1604-54b5-4520-b6b8-0a96f7dc751e tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Could not find user: 860bcd05e0a04bdcb25e6b1bced2dd9f.: keystone.exception.UserNotFound: Could not find user: 860bcd05e0a04bdcb25e6b1bced2dd9f. Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 02 01:28:17.673111 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:28:17.673981 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 860bcd05e0a04bdcb25e6b1bced2dd9f. Oct 02 01:28:17.674959 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:17.678025 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2914/5799] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:17 2022] DELETE /identity/v3/users/860bcd05e0a04bdcb25e6b1bced2dd9f => generated 110 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:28:17.679362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f1604-54b5-4520-b6b8-0a96f7dc751e tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:17.699019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce05e6aa-2671-43f7-9dc9-238f6444dfe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b697cc8ca7e34eaf84fd0832a93bbcd2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:17.701104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce05e6aa-2671-43f7-9dc9-238f6444dfe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b697cc8ca7e34eaf84fd0832a93bbcd2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:17.720589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce05e6aa-2671-43f7-9dc9-238f6444dfe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b697cc8ca7e34eaf84fd0832a93bbcd2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:17.723465 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:17.732647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f1604-54b5-4520-b6b8-0a96f7dc751e tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:17.744199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ce05e6aa-2671-43f7-9dc9-238f6444dfe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b697cc8ca7e34eaf84fd0832a93bbcd2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:17.773012 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2886/5800] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:17 2022] DELETE /identity/v3/users/b697cc8ca7e34eaf84fd0832a93bbcd2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:17.773258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319fed-39b3-4849-bead-649a0dc34e7f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:17.774775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319fed-39b3-4849-bead-649a0dc34e7f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:17.775076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319fed-39b3-4849-bead-649a0dc34e7f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:17.775352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319fed-39b3-4849-bead-649a0dc34e7f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/ff76beb0601e4d978f5bf852b15e50fa` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:17.792322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebef0d-a81f-4f6a-99d3-11f2b59d3737 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:17.792962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebef0d-a81f-4f6a-99d3-11f2b59d3737 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:17.793539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebef0d-a81f-4f6a-99d3-11f2b59d3737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:17.802253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f319fed-39b3-4849-bead-649a0dc34e7f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-5f319fed-39b3-4849-bead-649a0dc34e7f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Could not find domain: ff76beb0601e4d978f5bf852b15e50fa.: keystone.exception.DomainNotFound: Could not find domain: ff76beb0601e4d978f5bf852b15e50fa. Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ff76beb0601e4d978f5bf852b15e50fa. Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:28:17.810885 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:28:17.811824 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ff76beb0601e4d978f5bf852b15e50fa. Oct 02 01:28:17.812656 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:17.834571 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2915/5801] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:28:17 2022] PATCH /identity/v3/domains/ff76beb0601e4d978f5bf852b15e50fa => generated 112 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:28:17.844808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319fed-39b3-4849-bead-649a0dc34e7f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:17.850336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-12ebef0d-a81f-4f6a-99d3-11f2b59d3737 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:17.851820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-12ebef0d-a81f-4f6a-99d3-11f2b59d3737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:17.852927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5f319fed-39b3-4849-bead-649a0dc34e7f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:17.893818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319fed-39b3-4849-bead-649a0dc34e7f tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:17.995407 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2887/5802] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:18.102408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebef0d-a81f-4f6a-99d3-11f2b59d3737 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:18.103957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-12ebef0d-a81f-4f6a-99d3-11f2b59d3737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:18.110117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452974f-3f6a-41eb-9edd-63dc743dd294 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:18.112579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452974f-3f6a-41eb-9edd-63dc743dd294 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:18.113049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452974f-3f6a-41eb-9edd-63dc743dd294 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:18.114796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452974f-3f6a-41eb-9edd-63dc743dd294 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:18.116774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452974f-3f6a-41eb-9edd-63dc743dd294 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:18.120830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452974f-3f6a-41eb-9edd-63dc743dd294 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:18.155997 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2916/5803] 10.222.0.23 () {58 vars in 1128 bytes} [Sun Oct 2 01:28:17 2022] GET /identity/v3/domains => generated 1347 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:18.159687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452974f-3f6a-41eb-9edd-63dc743dd294 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:18.180538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452974f-3f6a-41eb-9edd-63dc743dd294 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:18.195484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9c47a-14c0-4877-8d1d-583e14193feb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:18.196442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9c47a-14c0-4877-8d1d-583e14193feb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:18.197330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9c47a-14c0-4877-8d1d-583e14193feb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:18.199698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9c47a-14c0-4877-8d1d-583e14193feb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:18.200711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9c47a-14c0-4877-8d1d-583e14193feb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:18.201180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9c47a-14c0-4877-8d1d-583e14193feb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:18.205674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9c47a-14c0-4877-8d1d-583e14193feb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:18.255947 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2917/5804] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:18 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:18.259950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9c47a-14c0-4877-8d1d-583e14193feb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:18.302312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebef0d-a81f-4f6a-99d3-11f2b59d3737 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:18.310729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9c47a-14c0-4877-8d1d-583e14193feb tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:18.313717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869f871-ff45-46fa-97c8-3e0610549405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:18.314391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869f871-ff45-46fa-97c8-3e0610549405 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:18.314658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869f871-ff45-46fa-97c8-3e0610549405 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:18.314949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869f871-ff45-46fa-97c8-3e0610549405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:18.332153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e51b-ae79-415e-b594-7daaf33a5fec tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:18.333078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e51b-ae79-415e-b594-7daaf33a5fec tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:18.338207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869f871-ff45-46fa-97c8-3e0610549405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:18.339147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e51b-ae79-415e-b594-7daaf33a5fec tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:18.342246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e51b-ae79-415e-b594-7daaf33a5fec tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:18.343246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844e51b-ae79-415e-b594-7daaf33a5fec tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1550041438) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:18.344392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844e51b-ae79-415e-b594-7daaf33a5fec tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:18.349365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869f871-ff45-46fa-97c8-3e0610549405 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:18.352361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844e51b-ae79-415e-b594-7daaf33a5fec tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:18.379026 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2888/5805] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:18.422648 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2918/5806] 10.222.0.23 () {58 vars in 1199 bytes} [Sun Oct 2 01:28:18 2022] GET /identity/v3/domains?name=tempest-test_domain-1550041438 => generated 408 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:28:18.427930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869f871-ff45-46fa-97c8-3e0610549405 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:18.443730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869f871-ff45-46fa-97c8-3e0610549405 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:18.450408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ff8a-d1d6-4693-8828-c968bda15d7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:18.451358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ff8a-d1d6-4693-8828-c968bda15d7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:18.451799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ff8a-d1d6-4693-8828-c968bda15d7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:18.452490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ff8a-d1d6-4693-8828-c968bda15d7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/ff76beb0601e4d978f5bf852b15e50fa` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:18.461456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2ff8a-d1d6-4693-8828-c968bda15d7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a6c2ff8a-d1d6-4693-8828-c968bda15d7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Could not find domain: ff76beb0601e4d978f5bf852b15e50fa.: keystone.exception.DomainNotFound: Could not find domain: ff76beb0601e4d978f5bf852b15e50fa. Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ff76beb0601e4d978f5bf852b15e50fa. Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:28:18.467883 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:28:18.469119 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ff76beb0601e4d978f5bf852b15e50fa. Oct 02 01:28:18.470196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:28:18.473369 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2889/5807] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:28:18 2022] PATCH /identity/v3/domains/ff76beb0601e4d978f5bf852b15e50fa => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:28:18.479897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e51b-ae79-415e-b594-7daaf33a5fec tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:18.496935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e51b-ae79-415e-b594-7daaf33a5fec tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:18.521035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e27d0-e243-42f5-aee4-8584cf6e1e5a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:18.521824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e27d0-e243-42f5-aee4-8584cf6e1e5a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:18.521916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e27d0-e243-42f5-aee4-8584cf6e1e5a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:18.522148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e27d0-e243-42f5-aee4-8584cf6e1e5a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/373fb28d7c504afe88786259ddc6cab2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:18.550910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e27d0-e243-42f5-aee4-8584cf6e1e5a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=373fb28d7c504afe88786259ddc6cab2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:18.552564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e27d0-e243-42f5-aee4-8584cf6e1e5a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:18.663620 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2919/5808] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:28:18 2022] PATCH /identity/v3/domains/373fb28d7c504afe88786259ddc6cab2 => generated 277 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:18.666407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ff8a-d1d6-4693-8828-c968bda15d7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:18.681572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ff8a-d1d6-4693-8828-c968bda15d7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:18.697571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:18.700873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:18.702452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:18.702918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/373fb28d7c504afe88786259ddc6cab2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:18.780003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=373fb28d7c504afe88786259ddc6cab2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:18.789911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:18.895162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '373fb28d7c504afe88786259ddc6cab2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:18.903045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '373fb28d7c504afe88786259ddc6cab2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.018687 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:19.035631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373fb28d7c504afe88786259ddc6cab2', 'request_id': 'req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.062648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373fb28d7c504afe88786259ddc6cab2', 'request_id': 'req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.086234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373fb28d7c504afe88786259ddc6cab2', 'request_id': 'req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.115159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] The token cache is being invalidate because project 373fb28d7c504afe88786259ddc6cab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:19.115597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.118133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.143443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '373fb28d7c504afe88786259ddc6cab2', 'request_id': 'req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.144592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '373fb28d7c504afe88786259ddc6cab2', 'request_id': 'req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.149251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '373fb28d7c504afe88786259ddc6cab2', 'request_id': 'req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.182361 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2890/5809] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:28:18 2022] DELETE /identity/v3/domains/373fb28d7c504afe88786259ddc6cab2 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:19.183828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e27d0-e243-42f5-aee4-8584cf6e1e5a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:19.186651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8d6e27d0-e243-42f5-aee4-8584cf6e1e5a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:19.201920 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:19.227297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e27d0-e243-42f5-aee4-8584cf6e1e5a tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:19.368561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:19.369076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:19.370265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:19.370735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:19.371157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/748f67ec081b40f89dab3440257bd7eb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:19.371458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:19.401034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=748f67ec081b40f89dab3440257bd7eb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:19.402895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:19.473211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '748f67ec081b40f89dab3440257bd7eb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.483060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '748f67ec081b40f89dab3440257bd7eb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.535981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8bf86-77ad-4bd2-8e2f-945478c128f0 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:19.556521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '748f67ec081b40f89dab3440257bd7eb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.559051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '748f67ec081b40f89dab3440257bd7eb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.564300 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2920/5810] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:28:19 2022] PATCH /identity/v3/domains/748f67ec081b40f89dab3440257bd7eb => generated 277 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:19.568591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:19.571740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:19.708575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:19.709239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:19.710131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:19.710131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] PATH_INFO: `/v3/projects/5c70ed9a8c1046cd81525aa173821c9b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:19.711301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c70ed9a8c1046cd81525aa173821c9b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:19.713771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:19.720943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96a622-bed0-4ba6-b1ff-62e25083f247 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:19.741028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:19.745038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:19.745236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:19.746320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/748f67ec081b40f89dab3440257bd7eb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:19.800743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=748f67ec081b40f89dab3440257bd7eb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:19.805875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:19.836491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c70ed9a8c1046cd81525aa173821c9b', 'request_id': 'req-cfd50531-a325-4dfc-b786-0ef5b482681e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.851545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c70ed9a8c1046cd81525aa173821c9b', 'request_id': 'req-cfd50531-a325-4dfc-b786-0ef5b482681e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.868631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c70ed9a8c1046cd81525aa173821c9b', 'request_id': 'req-cfd50531-a325-4dfc-b786-0ef5b482681e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.876864 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:19.907510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] The token cache is being invalidate because project 5c70ed9a8c1046cd81525aa173821c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:19.907829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.910744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfd50531-a325-4dfc-b786-0ef5b482681e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.915551 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2891/5811] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:19 2022] DELETE /identity/v3/projects/5c70ed9a8c1046cd81525aa173821c9b => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:19.917043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bd6b3-dd5c-4615-adea-22d1f0135b1c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:19.917331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bd6b3-dd5c-4615-adea-22d1f0135b1c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:19.917606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bd6b3-dd5c-4615-adea-22d1f0135b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:19.923687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '748f67ec081b40f89dab3440257bd7eb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:19.942451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '748f67ec081b40f89dab3440257bd7eb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.009913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d17bd6b3-dd5c-4615-adea-22d1f0135b1c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:20.009913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d17bd6b3-dd5c-4615-adea-22d1f0135b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:20.046387 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:20.083839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748f67ec081b40f89dab3440257bd7eb', 'request_id': 'req-2b0c0e90-e961-4865-92c6-966ab72dec7b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.098415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748f67ec081b40f89dab3440257bd7eb', 'request_id': 'req-2b0c0e90-e961-4865-92c6-966ab72dec7b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.106250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748f67ec081b40f89dab3440257bd7eb', 'request_id': 'req-2b0c0e90-e961-4865-92c6-966ab72dec7b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.149395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] The token cache is being invalidate because project 748f67ec081b40f89dab3440257bd7eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:20.149696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.153597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.177925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '748f67ec081b40f89dab3440257bd7eb', 'request_id': 'req-2b0c0e90-e961-4865-92c6-966ab72dec7b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.185497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '748f67ec081b40f89dab3440257bd7eb', 'request_id': 'req-2b0c0e90-e961-4865-92c6-966ab72dec7b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.188534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '748f67ec081b40f89dab3440257bd7eb', 'request_id': 'req-2b0c0e90-e961-4865-92c6-966ab72dec7b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.196224 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2892/5812] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:28:20.204294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32596c77-147c-4283-bce8-1fa087ad74a2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:20.204907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32596c77-147c-4283-bce8-1fa087ad74a2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:20.205325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32596c77-147c-4283-bce8-1fa087ad74a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:20.206450 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2921/5813] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:28:19 2022] DELETE /identity/v3/domains/748f67ec081b40f89dab3440257bd7eb => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:20.211698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:20.213184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:20.230510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-32596c77-147c-4283-bce8-1fa087ad74a2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:20.234760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-32596c77-147c-4283-bce8-1fa087ad74a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:20.401024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c0e90-e961-4865-92c6-966ab72dec7b tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:20.410056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:20.410769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:20.411087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:20.411328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/e03ecb2994b24c7a8016b5debb1ac527` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:20.460229 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2893/5814] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:20.462202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32596c77-147c-4283-bce8-1fa087ad74a2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:20.484498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e03ecb2994b24c7a8016b5debb1ac527)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:20.486195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:20.501105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32596c77-147c-4283-bce8-1fa087ad74a2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:20.509501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e3a6e-d1fd-479b-858b-91a6459a84ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:20.510818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e3a6e-d1fd-479b-858b-91a6459a84ca admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:20.511082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e3a6e-d1fd-479b-858b-91a6459a84ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:20.511492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e3a6e-d1fd-479b-858b-91a6459a84ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:20.512276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e3a6e-d1fd-479b-858b-91a6459a84ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:20.512735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e3a6e-d1fd-479b-858b-91a6459a84ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:20.515307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e3a6e-d1fd-479b-858b-91a6459a84ca admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:20.533234 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2894/5815] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:20.534236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e3a6e-d1fd-479b-858b-91a6459a84ca admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:20.547192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e3a6e-d1fd-479b-858b-91a6459a84ca admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:20.549136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.550307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.556738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19035e-580b-43d0-8ea7-34ef14476a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:20.557546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19035e-580b-43d0-8ea7-34ef14476a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:20.558184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19035e-580b-43d0-8ea7-34ef14476a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:20.558613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19035e-580b-43d0-8ea7-34ef14476a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:20.561212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19035e-580b-43d0-8ea7-34ef14476a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:20.563799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19035e-580b-43d0-8ea7-34ef14476a00 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:20.596499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.597365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:20.601551 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2922/5816] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:28:20 2022] PATCH /identity/v3/domains/e03ecb2994b24c7a8016b5debb1ac527 => generated 277 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:20.605249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:20.610351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:20.621759 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2895/5817] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:20 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:20.623632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19035e-580b-43d0-8ea7-34ef14476a00 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:20.625872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6e19035e-580b-43d0-8ea7-34ef14476a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:20.715590 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:20.746518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19035e-580b-43d0-8ea7-34ef14476a00 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:20.767117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d4406-ba52-438d-85f5-1c33f72ddd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:20.767796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d4406-ba52-438d-85f5-1c33f72ddd69 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:20.768367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d4406-ba52-438d-85f5-1c33f72ddd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:20.769070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d4406-ba52-438d-85f5-1c33f72ddd69 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:20.769907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d4406-ba52-438d-85f5-1c33f72ddd69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:20.775589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d4406-ba52-438d-85f5-1c33f72ddd69 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:20.792205 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:20.824764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba2355-f62f-4389-a394-1fe91d1a7fe8 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:20.843068 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2896/5818] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:20 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:20.844854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d4406-ba52-438d-85f5-1c33f72ddd69 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:20.875480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d4406-ba52-438d-85f5-1c33f72ddd69 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:20.929784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23126b6-c075-430d-b0f4-ddb71794fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:20.930426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23126b6-c075-430d-b0f4-ddb71794fdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:20.930748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23126b6-c075-430d-b0f4-ddb71794fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:20.931036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23126b6-c075-430d-b0f4-ddb71794fdf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:20.931692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23126b6-c075-430d-b0f4-ddb71794fdf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:20.934397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23126b6-c075-430d-b0f4-ddb71794fdf6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:20.944732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86a9494142343d4944280bce32ed70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f40d4d6f34c4e159549b4785bcbd4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:20.945489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:20.945830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:20.946176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] PATH_INFO: `/v3/domains/e03ecb2994b24c7a8016b5debb1ac527` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:20.947156 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2897/5819] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:20.951377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23126b6-c075-430d-b0f4-ddb71794fdf6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:20.965065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23126b6-c075-430d-b0f4-ddb71794fdf6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:20.971050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d401f8-a351-4427-8cac-ac4985f9974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:20.971764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d401f8-a351-4427-8cac-ac4985f9974e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:20.972216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d401f8-a351-4427-8cac-ac4985f9974e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:20.982003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d401f8-a351-4427-8cac-ac4985f9974e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:20.983028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d401f8-a351-4427-8cac-ac4985f9974e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:20.984942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d401f8-a351-4427-8cac-ac4985f9974e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:20.986328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e03ecb2994b24c7a8016b5debb1ac527)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:20.992371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:21.005177 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2898/5820] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:21.006497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d401f8-a351-4427-8cac-ac4985f9974e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:21.030588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d401f8-a351-4427-8cac-ac4985f9974e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:21.043855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b78875-2df0-4756-8816-80b7396c1e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:21.048059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b78875-2df0-4756-8816-80b7396c1e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:21.048416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b78875-2df0-4756-8816-80b7396c1e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:21.048828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b78875-2df0-4756-8816-80b7396c1e23 admin admin] PATH_INFO: `/v3/projects/13980647c7dd408daa690558b2337b83/users/020314564f8541288eb4ef48fb052daf/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:21.084380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.087241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b78875-2df0-4756-8816-80b7396c1e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13980647c7dd408daa690558b2337b83, user_id=020314564f8541288eb4ef48fb052daf, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:21.090230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b78875-2df0-4756-8816-80b7396c1e23 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:21.091703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.138467 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2899/5821] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:21 2022] PUT /identity/v3/projects/13980647c7dd408daa690558b2337b83/users/020314564f8541288eb4ef48fb052daf/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:21.148965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847af92-3482-4c60-99c8-36324c05fa8c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:21.149363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847af92-3482-4c60-99c8-36324c05fa8c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:21.149719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847af92-3482-4c60-99c8-36324c05fa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:21.238704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527', 'request_id': 'req-a4f43717-eb2f-4752-9e86-70bed4469274'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.241806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3847af92-3482-4c60-99c8-36324c05fa8c None None] MFA Rules not processed for user `020314564f8541288eb4ef48fb052daf`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:21.243941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3847af92-3482-4c60-99c8-36324c05fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:21.256654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527', 'request_id': 'req-a4f43717-eb2f-4752-9e86-70bed4469274'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.273358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527', 'request_id': 'req-a4f43717-eb2f-4752-9e86-70bed4469274'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.308526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] The token cache is being invalidate because project e03ecb2994b24c7a8016b5debb1ac527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:21.308845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.310908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.327171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527', 'request_id': 'req-a4f43717-eb2f-4752-9e86-70bed4469274'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.334373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527', 'request_id': 'req-a4f43717-eb2f-4752-9e86-70bed4469274'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.336627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e03ecb2994b24c7a8016b5debb1ac527', 'request_id': 'req-a4f43717-eb2f-4752-9e86-70bed4469274'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.351107 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2923/5822] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:28:20 2022] DELETE /identity/v3/domains/e03ecb2994b24c7a8016b5debb1ac527 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:21.351805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:21.354581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:21.428102 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2900/5823] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:21.431929 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:21.433108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847af92-3482-4c60-99c8-36324c05fa8c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:21.434679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3847af92-3482-4c60-99c8-36324c05fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:21.464096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f43717-eb2f-4752-9e86-70bed4469274 tempest-DomainsTestJSON-1375776765 tempest-DomainsTestJSON-1375776765-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:21.477703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea863-ef5a-45ef-adc0-14e390df755a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:21.480628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea863-ef5a-45ef-adc0-14e390df755a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:21.480628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea863-ef5a-45ef-adc0-14e390df755a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:21.480983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea863-ef5a-45ef-adc0-14e390df755a admin admin] PATH_INFO: `/v3/users/47236ae9d23142d08f1ebba7031df01c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:21.486316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbea863-ef5a-45ef-adc0-14e390df755a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47236ae9d23142d08f1ebba7031df01c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:21.494009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbea863-ef5a-45ef-adc0-14e390df755a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:21.627270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fdbea863-ef5a-45ef-adc0-14e390df755a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47236ae9d23142d08f1ebba7031df01c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.629488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847af92-3482-4c60-99c8-36324c05fa8c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:21.642234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80fa40-5676-4cbd-a958-b0e4539b107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:21.642889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80fa40-5676-4cbd-a958-b0e4539b107a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:21.643169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80fa40-5676-4cbd-a958-b0e4539b107a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:21.643435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80fa40-5676-4cbd-a958-b0e4539b107a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:21.644071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80fa40-5676-4cbd-a958-b0e4539b107a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:21.648650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80fa40-5676-4cbd-a958-b0e4539b107a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:21.652552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fdbea863-ef5a-45ef-adc0-14e390df755a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47236ae9d23142d08f1ebba7031df01c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.653526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fdbea863-ef5a-45ef-adc0-14e390df755a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47236ae9d23142d08f1ebba7031df01c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.671421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fdbea863-ef5a-45ef-adc0-14e390df755a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47236ae9d23142d08f1ebba7031df01c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.672143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fdbea863-ef5a-45ef-adc0-14e390df755a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47236ae9d23142d08f1ebba7031df01c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:21.703667 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2924/5824] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:21 2022] DELETE /identity/v3/users/47236ae9d23142d08f1ebba7031df01c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:21.707632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618e2c-606f-4659-a645-504aa4ef43a8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:21.707918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618e2c-606f-4659-a645-504aa4ef43a8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:21.710002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618e2c-606f-4659-a645-504aa4ef43a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:21.722327 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2901/5825] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:21 2022] POST /identity/v3/projects => generated 375 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:21.727852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80fa40-5676-4cbd-a958-b0e4539b107a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:21.732679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5b80fa40-5676-4cbd-a958-b0e4539b107a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:21.755068 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:21.760479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-87618e2c-606f-4659-a645-504aa4ef43a8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:21.761789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-87618e2c-606f-4659-a645-504aa4ef43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:22.045551 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2925/5826] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:22.060707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80fa40-5676-4cbd-a958-b0e4539b107a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:22.064166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618e2c-606f-4659-a645-504aa4ef43a8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:22.065687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-87618e2c-606f-4659-a645-504aa4ef43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:22.077641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f2f3f-70a3-41ef-a860-3591933e2161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:22.078275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2f3f-70a3-41ef-a860-3591933e2161 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:22.078554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2f3f-70a3-41ef-a860-3591933e2161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:22.078865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2f3f-70a3-41ef-a860-3591933e2161 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:22.079557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f2f3f-70a3-41ef-a860-3591933e2161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:22.082113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f2f3f-70a3-41ef-a860-3591933e2161 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:22.140807 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2902/5827] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:21 2022] POST /identity/v3/users => generated 288 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:28:22.144970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f2f3f-70a3-41ef-a860-3591933e2161 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:22.164530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f2f3f-70a3-41ef-a860-3591933e2161 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:22.170051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd36e3-e790-4348-acb3-02a47f8b37f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:22.170794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd36e3-e790-4348-acb3-02a47f8b37f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:22.171124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd36e3-e790-4348-acb3-02a47f8b37f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:22.171405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd36e3-e790-4348-acb3-02a47f8b37f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:22.172592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd36e3-e790-4348-acb3-02a47f8b37f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:22.176910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd36e3-e790-4348-acb3-02a47f8b37f4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:22.194175 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2903/5828] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:22.197893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd36e3-e790-4348-acb3-02a47f8b37f4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:22.230875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd36e3-e790-4348-acb3-02a47f8b37f4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:22.248738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67324b2-9cc3-4b0b-aa23-d149f400ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:22.249369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67324b2-9cc3-4b0b-aa23-d149f400ea6d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:22.249713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67324b2-9cc3-4b0b-aa23-d149f400ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:22.249992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67324b2-9cc3-4b0b-aa23-d149f400ea6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:22.250750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67324b2-9cc3-4b0b-aa23-d149f400ea6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:22.255848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67324b2-9cc3-4b0b-aa23-d149f400ea6d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:22.270799 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:22.280126 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2904/5829] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:22.283665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67324b2-9cc3-4b0b-aa23-d149f400ea6d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:22.309033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67324b2-9cc3-4b0b-aa23-d149f400ea6d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:22.321114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db46c1d-e7d4-43bc-b708-535ec2d161b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:22.324147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46c1d-e7d4-43bc-b708-535ec2d161b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:22.324439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46c1d-e7d4-43bc-b708-535ec2d161b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:22.324718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46c1d-e7d4-43bc-b708-535ec2d161b4 admin admin] PATH_INFO: `/v3/projects/6cdc8e6b54874f6aac762a2da721b20b/users/8dab85252d36445c984fc3e0fd1dc8de/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:22.363595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618e2c-606f-4659-a645-504aa4ef43a8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:22.378714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e92909-0168-4634-9acd-0485f1208192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:22.379359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e92909-0168-4634-9acd-0485f1208192 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:22.379640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e92909-0168-4634-9acd-0485f1208192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:22.379913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e92909-0168-4634-9acd-0485f1208192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:22.380792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db46c1d-e7d4-43bc-b708-535ec2d161b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdc8e6b54874f6aac762a2da721b20b, user_id=8dab85252d36445c984fc3e0fd1dc8de, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:22.385428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db46c1d-e7d4-43bc-b708-535ec2d161b4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:22.400626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e92909-0168-4634-9acd-0485f1208192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:22.402475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e92909-0168-4634-9acd-0485f1208192 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:22.422660 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2905/5830] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:22 2022] PUT /identity/v3/projects/6cdc8e6b54874f6aac762a2da721b20b/users/8dab85252d36445c984fc3e0fd1dc8de/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:22.435484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e71861-1ce1-47ed-8d5f-dee6054520a9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:22.435762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e71861-1ce1-47ed-8d5f-dee6054520a9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:22.436032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e71861-1ce1-47ed-8d5f-dee6054520a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:22.442297 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2926/5831] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:22.547619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-11e71861-1ce1-47ed-8d5f-dee6054520a9 None None] MFA Rules not processed for user `8dab85252d36445c984fc3e0fd1dc8de`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:22.548877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-11e71861-1ce1-47ed-8d5f-dee6054520a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:22.735265 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2906/5832] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:28:22.743754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e92909-0168-4634-9acd-0485f1208192 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:22.747314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a2e92909-0168-4634-9acd-0485f1208192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:22.928565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e92909-0168-4634-9acd-0485f1208192 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:23.051879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935387d-e319-4253-95f4-1a8d5bfe042a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:23.053169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935387d-e319-4253-95f4-1a8d5bfe042a service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:23.053696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935387d-e319-4253-95f4-1a8d5bfe042a service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:23.054453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935387d-e319-4253-95f4-1a8d5bfe042a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:23.056313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5935387d-e319-4253-95f4-1a8d5bfe042a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:23.255619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935387d-e319-4253-95f4-1a8d5bfe042a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:23.257197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935387d-e319-4253-95f4-1a8d5bfe042a service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:23.313365 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2927/5833] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:23.596427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a27b5-e814-42f0-909c-2a653e1a0454 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:23.597317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a27b5-e814-42f0-909c-2a653e1a0454 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:23.597746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a27b5-e814-42f0-909c-2a653e1a0454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:23.636370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a99a27b5-e814-42f0-909c-2a653e1a0454 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:23.641338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a99a27b5-e814-42f0-909c-2a653e1a0454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:23.663075 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:23.731819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935387d-e319-4253-95f4-1a8d5bfe042a service glance] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:23.733282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5935387d-e319-4253-95f4-1a8d5bfe042a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:23.772072 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2907/5834] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:23.786105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a27b5-e814-42f0-909c-2a653e1a0454 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:23.787990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a99a27b5-e814-42f0-909c-2a653e1a0454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:23.867595 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:23.922101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935387d-e319-4253-95f4-1a8d5bfe042a service glance] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:23.929480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446cf85-3129-439f-8a81-c86c2e665ace service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:23.930383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446cf85-3129-439f-8a81-c86c2e665ace service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:23.930923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446cf85-3129-439f-8a81-c86c2e665ace service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:23.931686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446cf85-3129-439f-8a81-c86c2e665ace service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:23.935845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f446cf85-3129-439f-8a81-c86c2e665ace service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:24.035004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a27b5-e814-42f0-909c-2a653e1a0454 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:24.048789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea2cec-e0aa-4997-b3cd-9b4d3193c8af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:24.049338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2cec-e0aa-4997-b3cd-9b4d3193c8af service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:24.049753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2cec-e0aa-4997-b3cd-9b4d3193c8af service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:24.050031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2cec-e0aa-4997-b3cd-9b4d3193c8af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:24.069607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446cf85-3129-439f-8a81-c86c2e665ace service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:24.071334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446cf85-3129-439f-8a81-c86c2e665ace service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:24.074097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea2cec-e0aa-4997-b3cd-9b4d3193c8af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:24.076725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea2cec-e0aa-4997-b3cd-9b4d3193c8af service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:24.082034 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2928/5835] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:28:24.082901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446cf85-3129-439f-8a81-c86c2e665ace service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:24.084277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f446cf85-3129-439f-8a81-c86c2e665ace service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:24.092886 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2908/5836] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 01:28:24.277537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446cf85-3129-439f-8a81-c86c2e665ace service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:24.288908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:24.289709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:24.290086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:24.290586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] PATH_INFO: `/v3/projects/4e8b1b52126e4e8dbc11a636fcee433b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:24.291927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8b1b52126e4e8dbc11a636fcee433b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:24.294031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:24.409346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8b1b52126e4e8dbc11a636fcee433b', 'request_id': 'req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:24.417490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8b1b52126e4e8dbc11a636fcee433b', 'request_id': 'req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:24.427913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8b1b52126e4e8dbc11a636fcee433b', 'request_id': 'req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:24.466008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea2cec-e0aa-4997-b3cd-9b4d3193c8af service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:24.468261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c4ea2cec-e0aa-4997-b3cd-9b4d3193c8af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:24.477162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] The token cache is being invalidate because project 4e8b1b52126e4e8dbc11a636fcee433b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:24.477491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:24.480725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:24.488614 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2929/5837] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:24 2022] DELETE /identity/v3/projects/4e8b1b52126e4e8dbc11a636fcee433b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:24.492979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:24.494854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:24.517304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea2cec-e0aa-4997-b3cd-9b4d3193c8af service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:24.525874 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:24.662626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325c4ca-4d61-435d-8795-aa0a431c467e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:24.663209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325c4ca-4d61-435d-8795-aa0a431c467e service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:24.666959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325c4ca-4d61-435d-8795-aa0a431c467e service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:24.667476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325c4ca-4d61-435d-8795-aa0a431c467e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:24.670980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2325c4ca-4d61-435d-8795-aa0a431c467e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:24.712062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b27c-5879-4d0f-b9a3-ca4dee06689f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:24.745952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:24.746621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:24.746997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:24.747273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] PATH_INFO: `/v3/users/c86a9494142343d4944280bce32ed70a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:24.759472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86a9494142343d4944280bce32ed70a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:24.770408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:24.857919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325c4ca-4d61-435d-8795-aa0a431c467e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:24.863013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325c4ca-4d61-435d-8795-aa0a431c467e service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:24.894731 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2909/5838] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:24.942205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86a9494142343d4944280bce32ed70a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:24.979488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86a9494142343d4944280bce32ed70a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:24.980404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86a9494142343d4944280bce32ed70a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:24.995990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86a9494142343d4944280bce32ed70a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:25.003829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86a9494142343d4944280bce32ed70a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:25.037933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbe28b-4964-4e5e-aa58-8dfb3bef2598 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:25.038223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbe28b-4964-4e5e-aa58-8dfb3bef2598 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:25.038503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbe28b-4964-4e5e-aa58-8dfb3bef2598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:25.086236 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:25.092895 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2930/5839] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:24 2022] DELETE /identity/v3/users/c86a9494142343d4944280bce32ed70a => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:25.124095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-81cbe28b-4964-4e5e-aa58-8dfb3bef2598 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:25.128492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-81cbe28b-4964-4e5e-aa58-8dfb3bef2598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:25.291589 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2910/5840] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:28:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:25.330247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:25.334155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:25.514739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f80c1-de9f-4ab2-a992-dc1222fc640a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:25.526024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d6e0c-a10e-42d0-83f1-cc5fe3efe2e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:25.526736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d6e0c-a10e-42d0-83f1-cc5fe3efe2e8 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:25.527134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d6e0c-a10e-42d0-83f1-cc5fe3efe2e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:25.527411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d6e0c-a10e-42d0-83f1-cc5fe3efe2e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:25.554268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d6e0c-a10e-42d0-83f1-cc5fe3efe2e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:25.558866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d6e0c-a10e-42d0-83f1-cc5fe3efe2e8 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:25.596404 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2931/5841] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:25.981154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbe28b-4964-4e5e-aa58-8dfb3bef2598 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:25.988647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-81cbe28b-4964-4e5e-aa58-8dfb3bef2598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:26.212792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbe28b-4964-4e5e-aa58-8dfb3bef2598 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:26.222454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:26.224334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:26.224821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:26.225316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] PATH_INFO: `/v3/users/020314564f8541288eb4ef48fb052daf` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:26.245311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=020314564f8541288eb4ef48fb052daf)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:26.251328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:26.370043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020314564f8541288eb4ef48fb052daf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:26.437812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020314564f8541288eb4ef48fb052daf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:26.444263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020314564f8541288eb4ef48fb052daf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:26.502783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020314564f8541288eb4ef48fb052daf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:26.525710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020314564f8541288eb4ef48fb052daf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:26.536511 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2911/5842] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:25 2022] DELETE /identity/v3/users/020314564f8541288eb4ef48fb052daf => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:26.541443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd6b45-9573-4776-9e49-b1f37d478c95 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:26.542284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd6b45-9573-4776-9e49-b1f37d478c95 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:26.542899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd6b45-9573-4776-9e49-b1f37d478c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:26.602576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-69cd6b45-9573-4776-9e49-b1f37d478c95 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:26.604493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-69cd6b45-9573-4776-9e49-b1f37d478c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:26.619929 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:26.762749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:26.765043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:26.784553 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2932/5843] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:28:26.804130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22620f87-b055-488c-88b1-0dc384d5bfa1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:26.810828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:26.812214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:26.812582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:26.812968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] PATH_INFO: `/v3/projects/0f40d4d6f34c4e159549b4785bcbd4b4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:26.814271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f40d4d6f34c4e159549b4785bcbd4b4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:26.816549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:26.826831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd6b45-9573-4776-9e49-b1f37d478c95 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:26.828547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-69cd6b45-9573-4776-9e49-b1f37d478c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:26.911821 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:26.947678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f40d4d6f34c4e159549b4785bcbd4b4', 'request_id': 'req-6679c9ee-1607-4522-9ca9-c1a838ff6478'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:26.960384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f40d4d6f34c4e159549b4785bcbd4b4', 'request_id': 'req-6679c9ee-1607-4522-9ca9-c1a838ff6478'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:26.972669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f40d4d6f34c4e159549b4785bcbd4b4', 'request_id': 'req-6679c9ee-1607-4522-9ca9-c1a838ff6478'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:26.997703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] The token cache is being invalidate because project 0f40d4d6f34c4e159549b4785bcbd4b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:26.999141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:27.000315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6679c9ee-1607-4522-9ca9-c1a838ff6478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:27.003551 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2912/5844] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:26 2022] DELETE /identity/v3/projects/0f40d4d6f34c4e159549b4785bcbd4b4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:27.009123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae6af4-7d1c-46de-b7e3-dcf5f828f6dd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:27.009623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae6af4-7d1c-46de-b7e3-dcf5f828f6dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:27.009898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae6af4-7d1c-46de-b7e3-dcf5f828f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:27.071068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd6b45-9573-4776-9e49-b1f37d478c95 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:27.077949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3cae6af4-7d1c-46de-b7e3-dcf5f828f6dd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:27.080369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3cae6af4-7d1c-46de-b7e3-dcf5f828f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:27.220765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce934759-a9bf-41c8-9c8a-f9ce07e5bebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:27.226777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce934759-a9bf-41c8-9c8a-f9ce07e5bebe service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:27.227164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce934759-a9bf-41c8-9c8a-f9ce07e5bebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:27.227539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce934759-a9bf-41c8-9c8a-f9ce07e5bebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:27.237912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ce934759-a9bf-41c8-9c8a-f9ce07e5bebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:27.347685 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2913/5845] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:27.352844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bc8eb-3f16-4801-9f8a-907b95b7b5c0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:27.353354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bc8eb-3f16-4801-9f8a-907b95b7b5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:27.353850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bc8eb-3f16-4801-9f8a-907b95b7b5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:27.401854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5c5bc8eb-3f16-4801-9f8a-907b95b7b5c0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:27.411626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5c5bc8eb-3f16-4801-9f8a-907b95b7b5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:27.436347 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2914/5846] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:27.437265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce934759-a9bf-41c8-9c8a-f9ce07e5bebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:27.437654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bc8eb-3f16-4801-9f8a-907b95b7b5c0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:27.438986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce934759-a9bf-41c8-9c8a-f9ce07e5bebe service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:27.456452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bc8eb-3f16-4801-9f8a-907b95b7b5c0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:27.470683 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2933/5847] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:27.470844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bcc39-43b6-42e3-a0d8-fbbdc42fc2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:27.471774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bcc39-43b6-42e3-a0d8-fbbdc42fc2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:27.472065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bcc39-43b6-42e3-a0d8-fbbdc42fc2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:27.472343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bcc39-43b6-42e3-a0d8-fbbdc42fc2fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:27.473265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bcc39-43b6-42e3-a0d8-fbbdc42fc2fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:27.473486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bcc39-43b6-42e3-a0d8-fbbdc42fc2fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:27.475144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bcc39-43b6-42e3-a0d8-fbbdc42fc2fb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:27.509662 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2915/5848] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:27.511047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce934759-a9bf-41c8-9c8a-f9ce07e5bebe service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:27.527704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce934759-a9bf-41c8-9c8a-f9ce07e5bebe service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:27.540574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f67210-0494-4563-b08c-ff275f78afdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:27.541391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f67210-0494-4563-b08c-ff275f78afdd admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:27.542109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f67210-0494-4563-b08c-ff275f78afdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:27.543286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f67210-0494-4563-b08c-ff275f78afdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:27.544236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f67210-0494-4563-b08c-ff275f78afdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:27.546856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f67210-0494-4563-b08c-ff275f78afdd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:27.630510 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2934/5849] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:27 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:27.632570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bcc39-43b6-42e3-a0d8-fbbdc42fc2fb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:27.666738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bcc39-43b6-42e3-a0d8-fbbdc42fc2fb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:27.834085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ae0dc-c39b-43cf-b79e-33f46200541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:27.835741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ae0dc-c39b-43cf-b79e-33f46200541e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:27.836130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ae0dc-c39b-43cf-b79e-33f46200541e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:27.839892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ae0dc-c39b-43cf-b79e-33f46200541e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:27.842097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ae0dc-c39b-43cf-b79e-33f46200541e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:27.845702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ae0dc-c39b-43cf-b79e-33f46200541e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:27.893276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f67210-0494-4563-b08c-ff275f78afdd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:27.894201 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2916/5850] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:27 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:27.900956 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:27.906576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f67210-0494-4563-b08c-ff275f78afdd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:27.913605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc717e95-cb41-4a4a-952d-530efc8c6568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:27.914768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717e95-cb41-4a4a-952d-530efc8c6568 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:27.915262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717e95-cb41-4a4a-952d-530efc8c6568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:27.918298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717e95-cb41-4a4a-952d-530efc8c6568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:27.919783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc717e95-cb41-4a4a-952d-530efc8c6568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:27.921711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc717e95-cb41-4a4a-952d-530efc8c6568 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:27.941045 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2935/5851] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:27.945032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ae0dc-c39b-43cf-b79e-33f46200541e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:27.956790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ae0dc-c39b-43cf-b79e-33f46200541e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:27.964789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013ae8e-49ba-4513-97d6-ff01a09aa154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:27.965571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ae8e-49ba-4513-97d6-ff01a09aa154 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:27.966713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ae8e-49ba-4513-97d6-ff01a09aa154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:27.967044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ae8e-49ba-4513-97d6-ff01a09aa154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:27.968439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013ae8e-49ba-4513-97d6-ff01a09aa154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:27.973121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013ae8e-49ba-4513-97d6-ff01a09aa154 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:27.993545 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2917/5852] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:27.994526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc717e95-cb41-4a4a-952d-530efc8c6568 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:28.008002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc717e95-cb41-4a4a-952d-530efc8c6568 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:28.017866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c315e2-dd5c-4f76-8b47-6f77c1c14440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:28.018544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c315e2-dd5c-4f76-8b47-6f77c1c14440 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:28.018896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c315e2-dd5c-4f76-8b47-6f77c1c14440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:28.019189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c315e2-dd5c-4f76-8b47-6f77c1c14440 admin admin] PATH_INFO: `/v3/projects/9be4d2fff55b4a62ba841e47e0682f6d/users/e89ceff400ed413fb019317a10686680/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:28.052705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c315e2-dd5c-4f76-8b47-6f77c1c14440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be4d2fff55b4a62ba841e47e0682f6d, user_id=e89ceff400ed413fb019317a10686680, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:28.058540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c315e2-dd5c-4f76-8b47-6f77c1c14440 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:28.098378 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2936/5853] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:27 2022] PUT /identity/v3/projects/9be4d2fff55b4a62ba841e47e0682f6d/users/e89ceff400ed413fb019317a10686680/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:28:28.108840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813a0b1-c954-4b41-b96c-6c660391ff25 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:28.109319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813a0b1-c954-4b41-b96c-6c660391ff25 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:28.109411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813a0b1-c954-4b41-b96c-6c660391ff25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:28.196097 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:28.208593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8813a0b1-c954-4b41-b96c-6c660391ff25 None None] MFA Rules not processed for user `e89ceff400ed413fb019317a10686680`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:28.216264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8813a0b1-c954-4b41-b96c-6c660391ff25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:28.373155 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2918/5854] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:28.377236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c315e2-dd5c-4f76-8b47-6f77c1c14440 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:28.550780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c315e2-dd5c-4f76-8b47-6f77c1c14440 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:28.569954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6acb1-0643-4726-8ea0-07eec54427ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:28.572080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6acb1-0643-4726-8ea0-07eec54427ec admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:28.573963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6acb1-0643-4726-8ea0-07eec54427ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:28.577009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6acb1-0643-4726-8ea0-07eec54427ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:28.579217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6acb1-0643-4726-8ea0-07eec54427ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:28.589763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6acb1-0643-4726-8ea0-07eec54427ec admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:28.663080 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2937/5855] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:28 2022] POST /identity/v3/projects => generated 383 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:28.667760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813a0b1-c954-4b41-b96c-6c660391ff25 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:28.679446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6acb1-0643-4726-8ea0-07eec54427ec admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:28.685637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813a0b1-c954-4b41-b96c-6c660391ff25 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:28.686826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c6f6acb1-0643-4726-8ea0-07eec54427ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:28.833131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40860e93-fad3-4f92-bc2c-3b1fe3ef43f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:28.834380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860e93-fad3-4f92-bc2c-3b1fe3ef43f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:28.834886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860e93-fad3-4f92-bc2c-3b1fe3ef43f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:28.835312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860e93-fad3-4f92-bc2c-3b1fe3ef43f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:28.836129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40860e93-fad3-4f92-bc2c-3b1fe3ef43f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:28.839424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40860e93-fad3-4f92-bc2c-3b1fe3ef43f6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:28.868708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6acb1-0643-4726-8ea0-07eec54427ec admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:28.875794 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2919/5856] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:28 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:28.879021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40860e93-fad3-4f92-bc2c-3b1fe3ef43f6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:28.883732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:28.884486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:28.886787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:28.887150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] PATH_INFO: `/v3/projects/13980647c7dd408daa690558b2337b83` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:28.889042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=13980647c7dd408daa690558b2337b83)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:28.891236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:28.897956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40860e93-fad3-4f92-bc2c-3b1fe3ef43f6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:28.905759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb60143-af35-43f0-9462-0c92752ff1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:28.907341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb60143-af35-43f0-9462-0c92752ff1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:28.907837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb60143-af35-43f0-9462-0c92752ff1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:28.908360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb60143-af35-43f0-9462-0c92752ff1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:28.911368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb60143-af35-43f0-9462-0c92752ff1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:28.914035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb60143-af35-43f0-9462-0c92752ff1d6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:28.936098 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2920/5857] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:28.941540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb60143-af35-43f0-9462-0c92752ff1d6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:28.969315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb60143-af35-43f0-9462-0c92752ff1d6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:29.008039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5c42b-e60e-4685-a2ab-931f0b41397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:29.009432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5c42b-e60e-4685-a2ab-931f0b41397e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:29.010613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5c42b-e60e-4685-a2ab-931f0b41397e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:29.013719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5c42b-e60e-4685-a2ab-931f0b41397e admin admin] PATH_INFO: `/v3/projects/2561346665444790b0d4b168b2986868/users/04a6391becbf4d369a1da407fa3d314d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:29.029352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13980647c7dd408daa690558b2337b83', 'request_id': 'req-cb854b9e-8970-4644-8af9-72ed2215dbeb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:29.040167 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:29.041740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13980647c7dd408daa690558b2337b83', 'request_id': 'req-cb854b9e-8970-4644-8af9-72ed2215dbeb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:29.051173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13980647c7dd408daa690558b2337b83', 'request_id': 'req-cb854b9e-8970-4644-8af9-72ed2215dbeb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:29.072345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5c42b-e60e-4685-a2ab-931f0b41397e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2561346665444790b0d4b168b2986868, user_id=04a6391becbf4d369a1da407fa3d314d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:29.077145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5c42b-e60e-4685-a2ab-931f0b41397e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:29.079492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] The token cache is being invalidate because project 13980647c7dd408daa690558b2337b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:29.080106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:29.083395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:29.090533 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2938/5858] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:28 2022] DELETE /identity/v3/projects/13980647c7dd408daa690558b2337b83 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:29.093114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:29.095977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:29.117632 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2921/5859] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:28 2022] PUT /identity/v3/projects/2561346665444790b0d4b168b2986868/users/04a6391becbf4d369a1da407fa3d314d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:28:29.118811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5c42b-e60e-4685-a2ab-931f0b41397e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:29.120987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-25c5c42b-e60e-4685-a2ab-931f0b41397e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:29.253146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb854b9e-8970-4644-8af9-72ed2215dbeb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:29.363288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:29.364012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:29.364234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:29.364631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] PATH_INFO: `/v3/users/8dab85252d36445c984fc3e0fd1dc8de` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:29.365804 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:29.367304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dab85252d36445c984fc3e0fd1dc8de)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:29.369832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:29.376012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5c42b-e60e-4685-a2ab-931f0b41397e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:29.389005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e2a1c-6ab9-47a3-b1e8-f3b3b2027d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:29.389893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e2a1c-6ab9-47a3-b1e8-f3b3b2027d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:29.390692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e2a1c-6ab9-47a3-b1e8-f3b3b2027d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:29.391179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e2a1c-6ab9-47a3-b1e8-f3b3b2027d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:29.392044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e2a1c-6ab9-47a3-b1e8-f3b3b2027d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:29.393895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e2a1c-6ab9-47a3-b1e8-f3b3b2027d78 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:29.424317 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2922/5860] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:29.425552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e2a1c-6ab9-47a3-b1e8-f3b3b2027d78 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:29.440710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e2a1c-6ab9-47a3-b1e8-f3b3b2027d78 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:29.470653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f4138-b141-4ced-b397-8befccbcf3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:29.473622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f4138-b141-4ced-b397-8befccbcf3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:29.474496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f4138-b141-4ced-b397-8befccbcf3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:29.475878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f4138-b141-4ced-b397-8befccbcf3fc admin admin] PATH_INFO: `/v3/projects/2561346665444790b0d4b168b2986868/users/04a6391becbf4d369a1da407fa3d314d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:29.484130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f4138-b141-4ced-b397-8befccbcf3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2561346665444790b0d4b168b2986868, user_id=04a6391becbf4d369a1da407fa3d314d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:29.495638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dab85252d36445c984fc3e0fd1dc8de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:29.498116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f4138-b141-4ced-b397-8befccbcf3fc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:29.520321 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2923/5861] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:29 2022] PUT /identity/v3/projects/2561346665444790b0d4b168b2986868/users/04a6391becbf4d369a1da407fa3d314d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:29.537559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e69bf9-2563-4874-9941-9f9c3136d1b4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:29.538459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e69bf9-2563-4874-9941-9f9c3136d1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:29.539143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e69bf9-2563-4874-9941-9f9c3136d1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:29.539950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dab85252d36445c984fc3e0fd1dc8de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:29.542010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dab85252d36445c984fc3e0fd1dc8de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:29.561098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dab85252d36445c984fc3e0fd1dc8de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:29.562037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dab85252d36445c984fc3e0fd1dc8de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:29.615109 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2939/5862] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:29 2022] DELETE /identity/v3/users/8dab85252d36445c984fc3e0fd1dc8de => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:29.636851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b3e69bf9-2563-4874-9941-9f9c3136d1b4 None None] MFA Rules not processed for user `04a6391becbf4d369a1da407fa3d314d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:29.638440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b3e69bf9-2563-4874-9941-9f9c3136d1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:29.819907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:29.821407 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2924/5863] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:29.833744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f9727-6ca8-4782-837b-692e0f0f8075 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:29.850160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f2625-3e6b-4553-b245-2d6983371a11 tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a6391becbf4d369a1da407fa3d314d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561346665444790b0d4b168b2986868', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:29.850806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f2625-3e6b-4553-b245-2d6983371a11 tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:29.851080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f2625-3e6b-4553-b245-2d6983371a11 tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:29.851360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f2625-3e6b-4553-b245-2d6983371a11 tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:29.852223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f2625-3e6b-4553-b245-2d6983371a11 tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:29.854116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f2625-3e6b-4553-b245-2d6983371a11 tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:29.879467 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:29.922466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e69bf9-2563-4874-9941-9f9c3136d1b4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:29.923891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b3e69bf9-2563-4874-9941-9f9c3136d1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:29.936931 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2940/5864] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:29 2022] POST /identity/v3/projects => generated 359 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:30.051009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e69bf9-2563-4874-9941-9f9c3136d1b4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:30.058880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ad29-03c3-485d-800c-397d4b11309e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:30.059247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ad29-03c3-485d-800c-397d4b11309e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:30.059741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ad29-03c3-485d-800c-397d4b11309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:30.101277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6473ad29-03c3-485d-800c-397d4b11309e None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:30.102862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6473ad29-03c3-485d-800c-397d4b11309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:30.132716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af7a72-9bec-4bec-8f88-859bab810158 tempest-ProjectsNegativeTestJSON-1623504140 tempest-ProjectsNegativeTestJSON-1623504140-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e89ceff400ed413fb019317a10686680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be4d2fff55b4a62ba841e47e0682f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:30.134139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7a72-9bec-4bec-8f88-859bab810158 tempest-ProjectsNegativeTestJSON-1623504140 tempest-ProjectsNegativeTestJSON-1623504140-project] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:30.134569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7a72-9bec-4bec-8f88-859bab810158 tempest-ProjectsNegativeTestJSON-1623504140 tempest-ProjectsNegativeTestJSON-1623504140-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:30.135721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7a72-9bec-4bec-8f88-859bab810158 tempest-ProjectsNegativeTestJSON-1623504140 tempest-ProjectsNegativeTestJSON-1623504140-project] PATH_INFO: `/v3/projects/511dc93930fc4faf9257e31137dc3401` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:30.141958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af7a72-9bec-4bec-8f88-859bab810158 tempest-ProjectsNegativeTestJSON-1623504140 tempest-ProjectsNegativeTestJSON-1623504140-project] RBAC: Authorizing `identity:delete_project(project_id=511dc93930fc4faf9257e31137dc3401)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f9af7a72-9bec-4bec-8f88-859bab810158 tempest-ProjectsNegativeTestJSON-1623504140 tempest-ProjectsNegativeTestJSON-1623504140-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 02 01:28:30.172580 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 02 01:28:30.173675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 02 01:28:30.173675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 02 01:28:30.173675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 02 01:28:30.173675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 02 01:28:30.173675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 02 01:28:30.173675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 02 01:28:30.173675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 02 01:28:30.173675 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:28:30.179507 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2925/5865] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:29 2022] DELETE /identity/v3/projects/511dc93930fc4faf9257e31137dc3401 => generated 136 bytes in 257 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:28:30.183892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af7a72-9bec-4bec-8f88-859bab810158 tempest-ProjectsNegativeTestJSON-1623504140 tempest-ProjectsNegativeTestJSON-1623504140-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:30.247382 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:30.249626 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2941/5866] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:28:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:30.259166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473ad29-03c3-485d-800c-397d4b11309e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:30.261965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6473ad29-03c3-485d-800c-397d4b11309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:30.359043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af7a72-9bec-4bec-8f88-859bab810158 tempest-ProjectsNegativeTestJSON-1623504140 tempest-ProjectsNegativeTestJSON-1623504140-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:30.365964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a6391becbf4d369a1da407fa3d314d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561346665444790b0d4b168b2986868', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:30.379337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:30.381262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:30.381789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] PATH_INFO: `/v3/projects/511dc93930fc4faf9257e31137dc3401` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:30.411457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] RBAC: Authorizing `identity:delete_project(project_id=511dc93930fc4faf9257e31137dc3401)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:30.422134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:30.440794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473ad29-03c3-485d-800c-397d4b11309e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:30.458263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:30.459646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:30.461135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:30.461512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] PATH_INFO: `/v3/projects/6cdc8e6b54874f6aac762a2da721b20b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:30.464549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdc8e6b54874f6aac762a2da721b20b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:30.470183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:30.551907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511dc93930fc4faf9257e31137dc3401', 'request_id': 'req-7875df7a-4c31-4418-9e6c-58c0418c232d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:30.567630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511dc93930fc4faf9257e31137dc3401', 'request_id': 'req-7875df7a-4c31-4418-9e6c-58c0418c232d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:30.570315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511dc93930fc4faf9257e31137dc3401', 'request_id': 'req-7875df7a-4c31-4418-9e6c-58c0418c232d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:30.599901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] The token cache is being invalidate because project 511dc93930fc4faf9257e31137dc3401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:30.600757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:30.603030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:30.610627 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2926/5867] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:30 2022] DELETE /identity/v3/projects/511dc93930fc4faf9257e31137dc3401 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:30.612216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:30.615977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:30.651655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdc8e6b54874f6aac762a2da721b20b', 'request_id': 'req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:30.668135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdc8e6b54874f6aac762a2da721b20b', 'request_id': 'req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:30.685517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdc8e6b54874f6aac762a2da721b20b', 'request_id': 'req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:30.713598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] The token cache is being invalidate because project 6cdc8e6b54874f6aac762a2da721b20b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:30.713988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:30.715194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:30.724464 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2942/5868] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:30 2022] DELETE /identity/v3/projects/6cdc8e6b54874f6aac762a2da721b20b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:30.724464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:30.725873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:30.747131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875df7a-4c31-4418-9e6c-58c0418c232d tempest-ProjectsNegativeTestJSON-711122035 tempest-ProjectsNegativeTestJSON-711122035-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:30.786963 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:30.845300 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:30.863163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284318e0-6b38-454b-a5f4-b2a50e49e033 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:30.864201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284318e0-6b38-454b-a5f4-b2a50e49e033 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:30.866025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284318e0-6b38-454b-a5f4-b2a50e49e033 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:30.866565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284318e0-6b38-454b-a5f4-b2a50e49e033 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:30.871607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-284318e0-6b38-454b-a5f4-b2a50e49e033 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:30.876984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1f363-6a2e-4056-b40b-9c1ede1c037d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:30.883362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb2dae-52b0-4675-92a2-951c1d3b9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:30.884295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2dae-52b0-4675-92a2-951c1d3b9dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:30.884729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2dae-52b0-4675-92a2-951c1d3b9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:30.885154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2dae-52b0-4675-92a2-951c1d3b9dd0 admin admin] PATH_INFO: `/v3/users/e89ceff400ed413fb019317a10686680` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:30.894049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb2dae-52b0-4675-92a2-951c1d3b9dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89ceff400ed413fb019317a10686680)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:30.899272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb2dae-52b0-4675-92a2-951c1d3b9dd0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:31.017082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebcb2dae-52b0-4675-92a2-951c1d3b9dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89ceff400ed413fb019317a10686680'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:31.048024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebcb2dae-52b0-4675-92a2-951c1d3b9dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89ceff400ed413fb019317a10686680'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:31.048321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebcb2dae-52b0-4675-92a2-951c1d3b9dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89ceff400ed413fb019317a10686680'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:31.057563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebcb2dae-52b0-4675-92a2-951c1d3b9dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89ceff400ed413fb019317a10686680'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:31.060327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebcb2dae-52b0-4675-92a2-951c1d3b9dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89ceff400ed413fb019317a10686680'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:31.070021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284318e0-6b38-454b-a5f4-b2a50e49e033 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:31.071687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284318e0-6b38-454b-a5f4-b2a50e49e033 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:31.088894 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2943/5869] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:30 2022] DELETE /identity/v3/users/e89ceff400ed413fb019317a10686680 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:31.088894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca629ac8-ebb3-42a5-86c6-258a6cfff302 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:31.088894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca629ac8-ebb3-42a5-86c6-258a6cfff302 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:31.088894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca629ac8-ebb3-42a5-86c6-258a6cfff302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:31.094168 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2927/5870] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:28:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:28:31.095778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d7b98-c411-4940-b626-7c676c57b749 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:31.096159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d7b98-c411-4940-b626-7c676c57b749 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:31.096432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d7b98-c411-4940-b626-7c676c57b749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:31.145593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d86d7b98-c411-4940-b626-7c676c57b749 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:31.147547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ca629ac8-ebb3-42a5-86c6-258a6cfff302 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:31.147962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d86d7b98-c411-4940-b626-7c676c57b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:31.154741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ca629ac8-ebb3-42a5-86c6-258a6cfff302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:31.295198 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2944/5871] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:31.299284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e98b-5fda-4a63-a773-8083f45fa56c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:31.300059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e98b-5fda-4a63-a773-8083f45fa56c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:31.300059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e98b-5fda-4a63-a773-8083f45fa56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:31.354794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4307e98b-5fda-4a63-a773-8083f45fa56c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:31.361195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4307e98b-5fda-4a63-a773-8083f45fa56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:31.386775 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2928/5872] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:31.415023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d7b98-c411-4940-b626-7c676c57b749 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:31.417462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d86d7b98-c411-4940-b626-7c676c57b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:31.422091 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2945/5873] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:31.427111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307e98b-5fda-4a63-a773-8083f45fa56c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:31.447644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307e98b-5fda-4a63-a773-8083f45fa56c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:31.461515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a2df2-3142-4c58-a61c-e32cb44bc8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:31.462383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a2df2-3142-4c58-a61c-e32cb44bc8ac admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:31.467505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a2df2-3142-4c58-a61c-e32cb44bc8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:31.467986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a2df2-3142-4c58-a61c-e32cb44bc8ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:31.468835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a2df2-3142-4c58-a61c-e32cb44bc8ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:31.469296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a2df2-3142-4c58-a61c-e32cb44bc8ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:31.471115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a2df2-3142-4c58-a61c-e32cb44bc8ac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:31.511399 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2946/5874] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:31.513035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a2df2-3142-4c58-a61c-e32cb44bc8ac admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:31.539534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a2df2-3142-4c58-a61c-e32cb44bc8ac admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:31.557564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348caef0-7d76-486e-ada4-898cfc20f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:31.558635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348caef0-7d76-486e-ada4-898cfc20f654 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:31.559068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348caef0-7d76-486e-ada4-898cfc20f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:31.560105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348caef0-7d76-486e-ada4-898cfc20f654 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:31.561599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348caef0-7d76-486e-ada4-898cfc20f654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:31.564138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348caef0-7d76-486e-ada4-898cfc20f654 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:31.615966 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2947/5875] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:31 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:31.618426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348caef0-7d76-486e-ada4-898cfc20f654 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:31.632325 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:31.634870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d7b98-c411-4940-b626-7c676c57b749 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:31.720726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348caef0-7d76-486e-ada4-898cfc20f654 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:31.733208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6039fb-0eea-4faf-9413-1677423d774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:31.734110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6039fb-0eea-4faf-9413-1677423d774e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:31.736109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6039fb-0eea-4faf-9413-1677423d774e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:31.736904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6039fb-0eea-4faf-9413-1677423d774e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:31.740236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6039fb-0eea-4faf-9413-1677423d774e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:31.742415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6039fb-0eea-4faf-9413-1677423d774e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:31.784441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d49f1-e93c-4be1-a670-ae7d52a1bc13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:31.785078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d49f1-e93c-4be1-a670-ae7d52a1bc13 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:31.785357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d49f1-e93c-4be1-a670-ae7d52a1bc13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:31.785628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d49f1-e93c-4be1-a670-ae7d52a1bc13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:31.803181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d49f1-e93c-4be1-a670-ae7d52a1bc13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:31.804640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d49f1-e93c-4be1-a670-ae7d52a1bc13 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:31.813905 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2948/5876] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:31 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:31.816233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6039fb-0eea-4faf-9413-1677423d774e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:31.816390 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:31.828980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6039fb-0eea-4faf-9413-1677423d774e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:31.830370 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2929/5877] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:31.834939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd66bc7-80c6-4a32-8d6f-f40125500604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:31.835613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd66bc7-80c6-4a32-8d6f-f40125500604 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:31.836099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd66bc7-80c6-4a32-8d6f-f40125500604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:31.836216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd66bc7-80c6-4a32-8d6f-f40125500604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:31.836941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd66bc7-80c6-4a32-8d6f-f40125500604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:31.839557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd66bc7-80c6-4a32-8d6f-f40125500604 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:31.857341 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2949/5878] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:31.859010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d49f1-e93c-4be1-a670-ae7d52a1bc13 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:31.873702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d49f1-e93c-4be1-a670-ae7d52a1bc13 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:31.887221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591fa57-b94b-432d-89ba-af432fe1b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:31.887864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591fa57-b94b-432d-89ba-af432fe1b163 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:31.888164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591fa57-b94b-432d-89ba-af432fe1b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:31.888463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591fa57-b94b-432d-89ba-af432fe1b163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:31.889084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591fa57-b94b-432d-89ba-af432fe1b163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:31.890747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591fa57-b94b-432d-89ba-af432fe1b163 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:31.915632 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2930/5879] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:28:31.920942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd66bc7-80c6-4a32-8d6f-f40125500604 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:31.936926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd66bc7-80c6-4a32-8d6f-f40125500604 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:31.956068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e667c-ee0a-4e52-aa39-86475cee61a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:31.956815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e667c-ee0a-4e52-aa39-86475cee61a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:31.957021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e667c-ee0a-4e52-aa39-86475cee61a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:31.957320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e667c-ee0a-4e52-aa39-86475cee61a6 admin admin] PATH_INFO: `/v3/projects/4a309770f4984b2eab5c9238c6b6c849/users/5d973f7be95c4ffd80eec175d3c4d5f9/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:32.025149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e667c-ee0a-4e52-aa39-86475cee61a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a309770f4984b2eab5c9238c6b6c849, user_id=5d973f7be95c4ffd80eec175d3c4d5f9, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:32.035442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e667c-ee0a-4e52-aa39-86475cee61a6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:32.091521 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2950/5880] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:31 2022] PUT /identity/v3/projects/4a309770f4984b2eab5c9238c6b6c849/users/5d973f7be95c4ffd80eec175d3c4d5f9/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:32.102991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1aac8-1e84-4ade-ba59-0ad190603631 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:32.103276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1aac8-1e84-4ade-ba59-0ad190603631 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:32.103557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1aac8-1e84-4ade-ba59-0ad190603631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:32.172957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-38f1aac8-1e84-4ade-ba59-0ad190603631 None None] MFA Rules not processed for user `5d973f7be95c4ffd80eec175d3c4d5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:32.175237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-38f1aac8-1e84-4ade-ba59-0ad190603631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:32.479712 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2931/5881] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:32.485386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e667c-ee0a-4e52-aa39-86475cee61a6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:32.487460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-da5e667c-ee0a-4e52-aa39-86475cee61a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:32.656290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e667c-ee0a-4e52-aa39-86475cee61a6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:32.660513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194906b-1b3f-4158-aef9-ae3dd4f31bba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:32.661298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194906b-1b3f-4158-aef9-ae3dd4f31bba service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:32.661724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194906b-1b3f-4158-aef9-ae3dd4f31bba service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:32.662139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194906b-1b3f-4158-aef9-ae3dd4f31bba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:32.687149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194906b-1b3f-4158-aef9-ae3dd4f31bba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:32.688620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194906b-1b3f-4158-aef9-ae3dd4f31bba service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:32.733976 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2951/5882] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:32.775283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1aac8-1e84-4ade-ba59-0ad190603631 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:32.780632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-38f1aac8-1e84-4ade-ba59-0ad190603631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:33.020755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1aac8-1e84-4ade-ba59-0ad190603631 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:33.048155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:33.050835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:33.051310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:33.053459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] PATH_INFO: `/v3/projects/9be4d2fff55b4a62ba841e47e0682f6d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:33.056799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be4d2fff55b4a62ba841e47e0682f6d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:33.065574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:33.192403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be4d2fff55b4a62ba841e47e0682f6d', 'request_id': 'req-b995cf86-d3fa-49b5-9e50-01233ca8d202'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:33.203061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be4d2fff55b4a62ba841e47e0682f6d', 'request_id': 'req-b995cf86-d3fa-49b5-9e50-01233ca8d202'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:33.245921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be4d2fff55b4a62ba841e47e0682f6d', 'request_id': 'req-b995cf86-d3fa-49b5-9e50-01233ca8d202'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:33.290015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] The token cache is being invalidate because project 9be4d2fff55b4a62ba841e47e0682f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:33.290843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:33.292018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:33.298905 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2932/5883] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:32 2022] DELETE /identity/v3/projects/9be4d2fff55b4a62ba841e47e0682f6d => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:28:33.299866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194906b-1b3f-4158-aef9-ae3dd4f31bba service glance] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:33.351420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194906b-1b3f-4158-aef9-ae3dd4f31bba service glance] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:33.601386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10759d-b3bd-43b2-8590-ea76df20b337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:33.602103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10759d-b3bd-43b2-8590-ea76df20b337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:33.602322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10759d-b3bd-43b2-8590-ea76df20b337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:33.602591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10759d-b3bd-43b2-8590-ea76df20b337 admin admin] PATH_INFO: `/v3/users/04a6391becbf4d369a1da407fa3d314d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:33.611463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10759d-b3bd-43b2-8590-ea76df20b337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a6391becbf4d369a1da407fa3d314d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:33.613432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10759d-b3bd-43b2-8590-ea76df20b337 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:33.615281 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:33.627513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:33.630300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:33.707015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995cf86-d3fa-49b5-9e50-01233ca8d202 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:33.757839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:33.758494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:33.758802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:33.759076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] PATH_INFO: `/v3/users/5d973f7be95c4ffd80eec175d3c4d5f9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:33.771511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d973f7be95c4ffd80eec175d3c4d5f9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:33.773583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:33.790329 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:33.815138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7e10759d-b3bd-43b2-8590-ea76df20b337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a6391becbf4d369a1da407fa3d314d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:33.879332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7e10759d-b3bd-43b2-8590-ea76df20b337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a6391becbf4d369a1da407fa3d314d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:33.882587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7e10759d-b3bd-43b2-8590-ea76df20b337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a6391becbf4d369a1da407fa3d314d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:33.927182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7e10759d-b3bd-43b2-8590-ea76df20b337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a6391becbf4d369a1da407fa3d314d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:33.928540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7e10759d-b3bd-43b2-8590-ea76df20b337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a6391becbf4d369a1da407fa3d314d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:33.977794 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2952/5884] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:33 2022] DELETE /identity/v3/users/04a6391becbf4d369a1da407fa3d314d => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:33.994823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d973f7be95c4ffd80eec175d3c4d5f9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:34.025306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d973f7be95c4ffd80eec175d3c4d5f9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:34.026988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d973f7be95c4ffd80eec175d3c4d5f9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:34.047150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d973f7be95c4ffd80eec175d3c4d5f9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:34.077918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d973f7be95c4ffd80eec175d3c4d5f9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:34.096519 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2933/5885] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:33 2022] DELETE /identity/v3/users/5d973f7be95c4ffd80eec175d3c4d5f9 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:34.101003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3321127-3f8c-4e40-97dd-8b3a3fa3d7ea None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:34.101401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3321127-3f8c-4e40-97dd-8b3a3fa3d7ea None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:34.101675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3321127-3f8c-4e40-97dd-8b3a3fa3d7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:34.168481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a3321127-3f8c-4e40-97dd-8b3a3fa3d7ea None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:34.171259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a3321127-3f8c-4e40-97dd-8b3a3fa3d7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:34.396620 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2953/5886] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:34.410469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:34.413504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:34.569416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f5661-ab76-4da2-a1d1-257d9c998339 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:34.578959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c780df-1038-4863-bab6-19dc54882c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:34.579607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c780df-1038-4863-bab6-19dc54882c96 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:34.579880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c780df-1038-4863-bab6-19dc54882c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:34.580318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c780df-1038-4863-bab6-19dc54882c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:34.603752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c780df-1038-4863-bab6-19dc54882c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:34.605469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c780df-1038-4863-bab6-19dc54882c96 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:34.628132 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2934/5887] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:35.010527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3321127-3f8c-4e40-97dd-8b3a3fa3d7ea None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:35.013387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a3321127-3f8c-4e40-97dd-8b3a3fa3d7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:35.055079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3321127-3f8c-4e40-97dd-8b3a3fa3d7ea None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:35.067292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:35.068313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:35.068795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:35.069279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] PATH_INFO: `/v3/projects/2561346665444790b0d4b168b2986868` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:35.075375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2561346665444790b0d4b168b2986868)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:35.077756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:35.206408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2561346665444790b0d4b168b2986868', 'request_id': 'req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:35.233263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2561346665444790b0d4b168b2986868', 'request_id': 'req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:35.259408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2561346665444790b0d4b168b2986868', 'request_id': 'req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:35.311383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] The token cache is being invalidate because project 2561346665444790b0d4b168b2986868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:35.317648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:35.325190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-71d386d4-7b24-48f6-ae49-b3bbc769f4b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:35.331918 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2954/5888] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:35 2022] DELETE /identity/v3/projects/2561346665444790b0d4b168b2986868 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:35.337860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b2466-eacc-4e06-849d-1cc738007f87 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:35.338489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b2466-eacc-4e06-849d-1cc738007f87 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:35.338997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b2466-eacc-4e06-849d-1cc738007f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:35.395675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f91b2466-eacc-4e06-849d-1cc738007f87 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:35.402242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f91b2466-eacc-4e06-849d-1cc738007f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:35.648992 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2935/5889] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:35.656907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66e0b-b7fd-4776-be37-3ec5c7a32b16 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:35.657422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66e0b-b7fd-4776-be37-3ec5c7a32b16 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:35.657854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66e0b-b7fd-4776-be37-3ec5c7a32b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:35.673912 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:35.707972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e3d66e0b-b7fd-4776-be37-3ec5c7a32b16 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:35.711228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e3d66e0b-b7fd-4776-be37-3ec5c7a32b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:35.744217 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2955/5890] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:35.748471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b2466-eacc-4e06-849d-1cc738007f87 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:35.769296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b2466-eacc-4e06-849d-1cc738007f87 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:35.786544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538616d-7a0e-4592-8cc3-b3dece95bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:35.789315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538616d-7a0e-4592-8cc3-b3dece95bb11 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:35.789801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538616d-7a0e-4592-8cc3-b3dece95bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:35.790198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538616d-7a0e-4592-8cc3-b3dece95bb11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:35.796086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538616d-7a0e-4592-8cc3-b3dece95bb11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:35.798150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538616d-7a0e-4592-8cc3-b3dece95bb11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:35.808984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538616d-7a0e-4592-8cc3-b3dece95bb11 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:35.846745 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2936/5891] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:35.851031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d66e0b-b7fd-4776-be37-3ec5c7a32b16 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:35.865881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d66e0b-b7fd-4776-be37-3ec5c7a32b16 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:35.911993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af516979-7beb-4534-bae0-32ad9b6cd8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:35.912556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af516979-7beb-4534-bae0-32ad9b6cd8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:35.912847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af516979-7beb-4534-bae0-32ad9b6cd8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:35.913129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af516979-7beb-4534-bae0-32ad9b6cd8b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:35.913963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af516979-7beb-4534-bae0-32ad9b6cd8b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:35.920063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af516979-7beb-4534-bae0-32ad9b6cd8b6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:36.081506 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2956/5892] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:35 2022] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:36.084534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538616d-7a0e-4592-8cc3-b3dece95bb11 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:36.111807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538616d-7a0e-4592-8cc3-b3dece95bb11 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:36.133860 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:36.220505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af516979-7beb-4534-bae0-32ad9b6cd8b6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:36.223063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-af516979-7beb-4534-bae0-32ad9b6cd8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:36.394873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d456e-616d-400f-9994-610ad8a0b6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:36.395549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d456e-616d-400f-9994-610ad8a0b6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:36.400477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d456e-616d-400f-9994-610ad8a0b6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:36.402498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d456e-616d-400f-9994-610ad8a0b6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:36.406457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d456e-616d-400f-9994-610ad8a0b6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:36.408701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d456e-616d-400f-9994-610ad8a0b6e3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:36.510845 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2937/5893] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:36 2022] POST /identity/v3/users => generated 285 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:36.515077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af516979-7beb-4534-bae0-32ad9b6cd8b6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:36.517251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d456e-616d-400f-9994-610ad8a0b6e3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:36.535473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:36.536143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:36.536426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:36.536701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] PATH_INFO: `/v3/projects/4a309770f4984b2eab5c9238c6b6c849` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:36.539398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a309770f4984b2eab5c9238c6b6c849)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:36.541346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:36.545629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d456e-616d-400f-9994-610ad8a0b6e3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:36.552678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711b074-25f5-4acc-aab7-852332aa5a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:36.553687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711b074-25f5-4acc-aab7-852332aa5a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:36.554268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711b074-25f5-4acc-aab7-852332aa5a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:36.554808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711b074-25f5-4acc-aab7-852332aa5a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:36.555689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711b074-25f5-4acc-aab7-852332aa5a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:36.558453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711b074-25f5-4acc-aab7-852332aa5a6d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:36.578364 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2938/5894] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:36.583287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711b074-25f5-4acc-aab7-852332aa5a6d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:36.597896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711b074-25f5-4acc-aab7-852332aa5a6d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:36.610699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01c931-b5c8-4c7d-83ca-82c6330dce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:36.613284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01c931-b5c8-4c7d-83ca-82c6330dce21 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:36.613809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01c931-b5c8-4c7d-83ca-82c6330dce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:36.614910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01c931-b5c8-4c7d-83ca-82c6330dce21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:36.616183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01c931-b5c8-4c7d-83ca-82c6330dce21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:36.630711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01c931-b5c8-4c7d-83ca-82c6330dce21 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:36.658563 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2939/5895] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:36.668172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01c931-b5c8-4c7d-83ca-82c6330dce21 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:36.679026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a309770f4984b2eab5c9238c6b6c849', 'request_id': 'req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:36.682513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01c931-b5c8-4c7d-83ca-82c6330dce21 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:36.694273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a309770f4984b2eab5c9238c6b6c849', 'request_id': 'req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:36.705358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a309770f4984b2eab5c9238c6b6c849', 'request_id': 'req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:36.730529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] The token cache is being invalidate because project 4a309770f4984b2eab5c9238c6b6c849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:36.730863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:36.731850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3c9759d0-2c76-44b7-aaca-5097d2bc4c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:36.734632 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2957/5896] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:36 2022] DELETE /identity/v3/projects/4a309770f4984b2eab5c9238c6b6c849 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:36.740246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bda208-9ef6-473e-80dc-e46e5be2cc6d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:36.740539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bda208-9ef6-473e-80dc-e46e5be2cc6d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:36.740810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bda208-9ef6-473e-80dc-e46e5be2cc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:36.799160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-91bda208-9ef6-473e-80dc-e46e5be2cc6d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:36.800413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-91bda208-9ef6-473e-80dc-e46e5be2cc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:36.896589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8940ce-9d7c-4be5-beea-c29b17e37e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:36.897301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8940ce-9d7c-4be5-beea-c29b17e37e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:36.898100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8940ce-9d7c-4be5-beea-c29b17e37e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:36.898100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8940ce-9d7c-4be5-beea-c29b17e37e3e admin admin] PATH_INFO: `/v3/projects/14c31bb46bd34d4c8458e9f9ff999d28/users/13195daf693348369e2cd16e1b19f116/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:36.962129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8940ce-9d7c-4be5-beea-c29b17e37e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c31bb46bd34d4c8458e9f9ff999d28, user_id=13195daf693348369e2cd16e1b19f116, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:36.966543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8940ce-9d7c-4be5-beea-c29b17e37e3e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:37.070485 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2940/5897] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:36 2022] PUT /identity/v3/projects/14c31bb46bd34d4c8458e9f9ff999d28/users/13195daf693348369e2cd16e1b19f116/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:37.073004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f46b78-3e13-4ea8-93b0-6661894856b8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:37.073296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f46b78-3e13-4ea8-93b0-6661894856b8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:37.073574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f46b78-3e13-4ea8-93b0-6661894856b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:37.125632 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2958/5898] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:37.133192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf982-8187-49db-82af-06a89e22daa4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:37.134518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf982-8187-49db-82af-06a89e22daa4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:37.134918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf982-8187-49db-82af-06a89e22daa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:37.187849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a1f46b78-3e13-4ea8-93b0-6661894856b8 None None] MFA Rules not processed for user `13195daf693348369e2cd16e1b19f116`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:37.189689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a1f46b78-3e13-4ea8-93b0-6661894856b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:37.194228 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:37.234009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f3abf982-8187-49db-82af-06a89e22daa4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:37.243360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f3abf982-8187-49db-82af-06a89e22daa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:37.376095 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:37.434201 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2941/5899] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:37.440367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f46b78-3e13-4ea8-93b0-6661894856b8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:37.443330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a1f46b78-3e13-4ea8-93b0-6661894856b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:37.504601 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2959/5900] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:37.508790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abf982-8187-49db-82af-06a89e22daa4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:37.541465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abf982-8187-49db-82af-06a89e22daa4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:37.568040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ad354-b700-4779-ad64-b90aed29de60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:37.569538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ad354-b700-4779-ad64-b90aed29de60 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:37.569987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ad354-b700-4779-ad64-b90aed29de60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:37.570424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ad354-b700-4779-ad64-b90aed29de60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:37.571280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ad354-b700-4779-ad64-b90aed29de60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:37.571753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ad354-b700-4779-ad64-b90aed29de60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:37.575500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ad354-b700-4779-ad64-b90aed29de60 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:37.609688 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2960/5901] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:37.616810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f46b78-3e13-4ea8-93b0-6661894856b8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:37.618888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ad354-b700-4779-ad64-b90aed29de60 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:37.635462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f26b24-f206-4bb4-b79c-3bf59cd5995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:37.636310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f26b24-f206-4bb4-b79c-3bf59cd5995b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:37.636659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f26b24-f206-4bb4-b79c-3bf59cd5995b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:37.638011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f26b24-f206-4bb4-b79c-3bf59cd5995b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:37.638486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f26b24-f206-4bb4-b79c-3bf59cd5995b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:37.640738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ad354-b700-4779-ad64-b90aed29de60 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:37.644459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f26b24-f206-4bb4-b79c-3bf59cd5995b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:37.660879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da268288-3565-4d13-8c73-8aa12569c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:37.661705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da268288-3565-4d13-8c73-8aa12569c0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:37.662160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da268288-3565-4d13-8c73-8aa12569c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:37.662592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da268288-3565-4d13-8c73-8aa12569c0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:37.663416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da268288-3565-4d13-8c73-8aa12569c0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:37.665504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da268288-3565-4d13-8c73-8aa12569c0e4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:37.742681 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2961/5902] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:37 2022] POST /identity/v3/projects => generated 357 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:37.744215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da268288-3565-4d13-8c73-8aa12569c0e4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:37.753818 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2942/5903] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:37 2022] POST /identity/v3/projects => generated 367 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:37.765534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f26b24-f206-4bb4-b79c-3bf59cd5995b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:38.034068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f26b24-f206-4bb4-b79c-3bf59cd5995b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:38.054424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da268288-3565-4d13-8c73-8aa12569c0e4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:38.069558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ec780-e2da-47a2-ba88-e4855f643f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:38.073843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af5fe1-4ffe-4339-8ff5-a56f8800dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:38.077061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af5fe1-4ffe-4339-8ff5-a56f8800dc50 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:38.078194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ec780-e2da-47a2-ba88-e4855f643f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:38.078576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ec780-e2da-47a2-ba88-e4855f643f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:38.078895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ec780-e2da-47a2-ba88-e4855f643f6f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:38.080284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af5fe1-4ffe-4339-8ff5-a56f8800dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:38.080688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ec780-e2da-47a2-ba88-e4855f643f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:38.081824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af5fe1-4ffe-4339-8ff5-a56f8800dc50 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:38.083238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af5fe1-4ffe-4339-8ff5-a56f8800dc50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:38.085128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ec780-e2da-47a2-ba88-e4855f643f6f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:38.094940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af5fe1-4ffe-4339-8ff5-a56f8800dc50 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:38.169197 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2962/5904] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:37 2022] POST /identity/v3/users => generated 279 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:38.171942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af5fe1-4ffe-4339-8ff5-a56f8800dc50 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:38.174912 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2943/5905] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:37 2022] POST /identity/v3/users => generated 290 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:38.178407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ec780-e2da-47a2-ba88-e4855f643f6f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:38.199345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af5fe1-4ffe-4339-8ff5-a56f8800dc50 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:38.208156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ec780-e2da-47a2-ba88-e4855f643f6f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:38.212588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0fc58-4256-4f84-a329-1929009bcf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:38.215109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0fc58-4256-4f84-a329-1929009bcf44 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:38.215648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0fc58-4256-4f84-a329-1929009bcf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:38.216125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0fc58-4256-4f84-a329-1929009bcf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:38.217894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0fc58-4256-4f84-a329-1929009bcf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:38.221207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c5133-0b6b-450b-bbd7-c39602a0450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:38.221856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c5133-0b6b-450b-bbd7-c39602a0450a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:38.222123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c5133-0b6b-450b-bbd7-c39602a0450a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:38.222404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c5133-0b6b-450b-bbd7-c39602a0450a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:38.223123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c5133-0b6b-450b-bbd7-c39602a0450a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:38.227302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0fc58-4256-4f84-a329-1929009bcf44 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:38.229046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c5133-0b6b-450b-bbd7-c39602a0450a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:38.256372 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2944/5906] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:38.261929 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2963/5907] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:38.264050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0fc58-4256-4f84-a329-1929009bcf44 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:38.270323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c5133-0b6b-450b-bbd7-c39602a0450a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:38.288087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c5133-0b6b-450b-bbd7-c39602a0450a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:38.308329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0fc58-4256-4f84-a329-1929009bcf44 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:38.309368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466bd26-da46-4753-82a9-d62259fdefc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:38.310393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466bd26-da46-4753-82a9-d62259fdefc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:38.310877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466bd26-da46-4753-82a9-d62259fdefc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:38.311311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466bd26-da46-4753-82a9-d62259fdefc9 admin admin] PATH_INFO: `/v3/projects/01a2a82e2975492ca5f8bb9b73ea040b/users/37ea2951311c4d32929970d740256f4a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:38.334341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4df62-a653-4ae2-ac1e-38ef02dff07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:38.335712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4df62-a653-4ae2-ac1e-38ef02dff07d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:38.338457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4df62-a653-4ae2-ac1e-38ef02dff07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:38.339030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4df62-a653-4ae2-ac1e-38ef02dff07d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:38.341742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4df62-a653-4ae2-ac1e-38ef02dff07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:38.344336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4df62-a653-4ae2-ac1e-38ef02dff07d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:38.358854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466bd26-da46-4753-82a9-d62259fdefc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a2a82e2975492ca5f8bb9b73ea040b, user_id=37ea2951311c4d32929970d740256f4a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:38.367594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466bd26-da46-4753-82a9-d62259fdefc9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:38.392837 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2964/5908] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:38.395188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4df62-a653-4ae2-ac1e-38ef02dff07d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:38.408740 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2945/5909] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:38 2022] PUT /identity/v3/projects/01a2a82e2975492ca5f8bb9b73ea040b/users/37ea2951311c4d32929970d740256f4a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:38.415620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4df62-a653-4ae2-ac1e-38ef02dff07d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:38.419739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466bd26-da46-4753-82a9-d62259fdefc9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:38.527541 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:38.542623 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:38.606916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466bd26-da46-4753-82a9-d62259fdefc9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:38.623003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0f103-b8d7-4f47-8825-30f0a5d7bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:38.623650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0f103-b8d7-4f47-8825-30f0a5d7bee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:38.623937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0f103-b8d7-4f47-8825-30f0a5d7bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:38.624210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0f103-b8d7-4f47-8825-30f0a5d7bee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:38.624869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0f103-b8d7-4f47-8825-30f0a5d7bee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:38.626765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0f103-b8d7-4f47-8825-30f0a5d7bee0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:38.650874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28473d3-590d-4d3f-929d-f1e093fefa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:38.651549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28473d3-590d-4d3f-929d-f1e093fefa4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:38.651992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28473d3-590d-4d3f-929d-f1e093fefa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:38.652165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28473d3-590d-4d3f-929d-f1e093fefa4e admin admin] PATH_INFO: `/v3/projects/80ce3cc0882d490dad3b5e60638728a0/users/1bd63b354e7945f2ae632b8347404ca0/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:38.656521 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2946/5910] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:38.657864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0f103-b8d7-4f47-8825-30f0a5d7bee0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:38.680860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0f103-b8d7-4f47-8825-30f0a5d7bee0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:38.696194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c20421-f235-4121-9426-07fa2a8e71ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:38.697061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c20421-f235-4121-9426-07fa2a8e71ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:38.697350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c20421-f235-4121-9426-07fa2a8e71ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:38.697631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c20421-f235-4121-9426-07fa2a8e71ff admin admin] PATH_INFO: `/v3/projects/01a2a82e2975492ca5f8bb9b73ea040b/users/37ea2951311c4d32929970d740256f4a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:38.704083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c20421-f235-4121-9426-07fa2a8e71ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a2a82e2975492ca5f8bb9b73ea040b, user_id=37ea2951311c4d32929970d740256f4a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:38.707737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c20421-f235-4121-9426-07fa2a8e71ff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:38.739029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28473d3-590d-4d3f-929d-f1e093fefa4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ce3cc0882d490dad3b5e60638728a0, user_id=1bd63b354e7945f2ae632b8347404ca0, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:38.750238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28473d3-590d-4d3f-929d-f1e093fefa4e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:38.750905 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2947/5911] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:38 2022] PUT /identity/v3/projects/01a2a82e2975492ca5f8bb9b73ea040b/users/37ea2951311c4d32929970d740256f4a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:38.754837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7ee5d-e47a-4945-a9c6-e6e62578e7cc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:38.755799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7ee5d-e47a-4945-a9c6-e6e62578e7cc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:38.757557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7ee5d-e47a-4945-a9c6-e6e62578e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:38.827082 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2965/5912] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:38 2022] PUT /identity/v3/projects/80ce3cc0882d490dad3b5e60638728a0/users/1bd63b354e7945f2ae632b8347404ca0/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:38.841877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c0c8e-57a5-46d8-b8c7-0fa76edb8229 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:38.842161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c0c8e-57a5-46d8-b8c7-0fa76edb8229 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:38.842446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c0c8e-57a5-46d8-b8c7-0fa76edb8229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:38.930218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0dc7ee5d-e47a-4945-a9c6-e6e62578e7cc None None] MFA Rules not processed for user `37ea2951311c4d32929970d740256f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:38.936537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0dc7ee5d-e47a-4945-a9c6-e6e62578e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:38.969530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-218c0c8e-57a5-46d8-b8c7-0fa76edb8229 None None] MFA Rules not processed for user `1bd63b354e7945f2ae632b8347404ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:38.970794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-218c0c8e-57a5-46d8-b8c7-0fa76edb8229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:39.167755 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2966/5913] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:39.189284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c0c8e-57a5-46d8-b8c7-0fa76edb8229 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:39.224822 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2948/5914] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:39.226889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7ee5d-e47a-4945-a9c6-e6e62578e7cc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:39.247541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7ee5d-e47a-4945-a9c6-e6e62578e7cc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:39.256256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e452b-4868-4fcc-b823-504eb21f448d tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:39.257339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e452b-4868-4fcc-b823-504eb21f448d tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:39.257826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e452b-4868-4fcc-b823-504eb21f448d tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:39.258294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e452b-4868-4fcc-b823-504eb21f448d tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:39.259194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e452b-4868-4fcc-b823-504eb21f448d tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:39.261385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e452b-4868-4fcc-b823-504eb21f448d tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:39.298337 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2949/5915] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:28:39 2022] POST /identity/v3/services => generated 240 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:39.303872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e452b-4868-4fcc-b823-504eb21f448d tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:39.343625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c0c8e-57a5-46d8-b8c7-0fa76edb8229 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:39.377310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e452b-4868-4fcc-b823-504eb21f448d tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:39.395283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4c59-b3ac-4177-86d1-9abf8f222e27 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:39.397542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4c59-b3ac-4177-86d1-9abf8f222e27 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:39.397906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4c59-b3ac-4177-86d1-9abf8f222e27 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:39.398260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4c59-b3ac-4177-86d1-9abf8f222e27 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services/a8d29d49e9fb42a79a871a839d9aac90` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:39.400779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd4c59-b3ac-4177-86d1-9abf8f222e27 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a8d29d49e9fb42a79a871a839d9aac90)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:39.405047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd4c59-b3ac-4177-86d1-9abf8f222e27 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:39.425891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:39.428060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:39.431043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:39.431555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] PATH_INFO: `/v3/users/1bd63b354e7945f2ae632b8347404ca0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:39.433350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd63b354e7945f2ae632b8347404ca0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:39.439434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:39.464767 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2950/5916] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:39 2022] DELETE /identity/v3/services/a8d29d49e9fb42a79a871a839d9aac90 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:39.470149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4c59-b3ac-4177-86d1-9abf8f222e27 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:39.526479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4c59-b3ac-4177-86d1-9abf8f222e27 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:39.546961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e0d4f-4da2-4c5e-a8e2-2e845ca011c2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:39.550612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e0d4f-4da2-4c5e-a8e2-2e845ca011c2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:39.552068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e0d4f-4da2-4c5e-a8e2-2e845ca011c2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:39.553423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e0d4f-4da2-4c5e-a8e2-2e845ca011c2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:39.557040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e0d4f-4da2-4c5e-a8e2-2e845ca011c2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:39.566013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e0d4f-4da2-4c5e-a8e2-2e845ca011c2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:39.601827 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:39.614418 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2951/5917] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:39 2022] POST /identity/v3/services => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:28:39.615342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e0d4f-4da2-4c5e-a8e2-2e845ca011c2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:39.616857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd63b354e7945f2ae632b8347404ca0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:39.620506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c55e0d4f-4da2-4c5e-a8e2-2e845ca011c2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:39.672541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd63b354e7945f2ae632b8347404ca0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:39.674987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd63b354e7945f2ae632b8347404ca0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:39.699299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd63b354e7945f2ae632b8347404ca0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:39.701607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd63b354e7945f2ae632b8347404ca0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:39.767549 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2967/5918] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:39 2022] DELETE /identity/v3/users/1bd63b354e7945f2ae632b8347404ca0 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:39.767549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:39.768191 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:39.770868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:40.060125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e0d4f-4da2-4c5e-a8e2-2e845ca011c2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:40.199028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878e5bc-70f6-4de1-9b6a-fac6c623927c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:40.249531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0c813-a1c1-408e-ba35-d4fba0978bc1 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:40.250201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0c813-a1c1-408e-ba35-d4fba0978bc1 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:40.250491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0c813-a1c1-408e-ba35-d4fba0978bc1 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:40.255745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0c813-a1c1-408e-ba35-d4fba0978bc1 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services/1994b63fd3274c66ae4f762991cce532` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:40.256546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0c813-a1c1-408e-ba35-d4fba0978bc1 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:update_service(service_id=1994b63fd3274c66ae4f762991cce532)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:40.257614 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-c2b0c813-a1c1-408e-ba35-d4fba0978bc1 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:28:40.257614 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:28:40.257614 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:28:40.258534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0c813-a1c1-408e-ba35-d4fba0978bc1 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:40.315636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b850-c2b3-4697-956c-9c57a398db89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:40.318193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b850-c2b3-4697-956c-9c57a398db89 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:40.319773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b850-c2b3-4697-956c-9c57a398db89 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:40.322989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b850-c2b3-4697-956c-9c57a398db89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:40.329956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c6d2b850-c2b3-4697-956c-9c57a398db89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:40.351454 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2968/5919] 10.222.0.23 () {60 vars in 1252 bytes} [Sun Oct 2 01:28:39 2022] PATCH /identity/v3/services/1994b63fd3274c66ae4f762991cce532 => generated 283 bytes in 587 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:40.351454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703211-ed5b-4336-8ab3-03e7991bbda5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:40.351454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703211-ed5b-4336-8ab3-03e7991bbda5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:40.351853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703211-ed5b-4336-8ab3-03e7991bbda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:40.384382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-90703211-ed5b-4336-8ab3-03e7991bbda5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:40.386210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-90703211-ed5b-4336-8ab3-03e7991bbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:40.387903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2b850-c2b3-4697-956c-9c57a398db89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:40.394029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2b850-c2b3-4697-956c-9c57a398db89 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:40.432563 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2952/5920] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:39 2022] GET /identity/v3/auth/tokens => generated 3505 bytes in 818 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:40.435660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b850-c2b3-4697-956c-9c57a398db89 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:40.478569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b850-c2b3-4697-956c-9c57a398db89 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:40.556190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975b579-76e8-486a-b225-6ce46ea2b389 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:40.556847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b579-76e8-486a-b225-6ce46ea2b389 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:40.557137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b579-76e8-486a-b225-6ce46ea2b389 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:40.557418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b579-76e8-486a-b225-6ce46ea2b389 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services/1994b63fd3274c66ae4f762991cce532` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:40.560899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975b579-76e8-486a-b225-6ce46ea2b389 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:get_service(service_id=1994b63fd3274c66ae4f762991cce532)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:40.561765 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-6975b579-76e8-486a-b225-6ce46ea2b389 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:28:40.561765 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:28:40.561765 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:28:40.566170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975b579-76e8-486a-b225-6ce46ea2b389 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:40.591926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2953/5921] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:28:40 2022] GET /identity/v3/services/1994b63fd3274c66ae4f762991cce532 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:40.594639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975b579-76e8-486a-b225-6ce46ea2b389 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:40.643771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975b579-76e8-486a-b225-6ce46ea2b389 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:40.663850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c662f9-91fc-4750-8cf0-8edfb48e8ca5 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:40.664510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c662f9-91fc-4750-8cf0-8edfb48e8ca5 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:40.664804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c662f9-91fc-4750-8cf0-8edfb48e8ca5 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:40.665081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c662f9-91fc-4750-8cf0-8edfb48e8ca5 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services/1994b63fd3274c66ae4f762991cce532` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:40.665680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c662f9-91fc-4750-8cf0-8edfb48e8ca5 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1994b63fd3274c66ae4f762991cce532)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:40.674559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c662f9-91fc-4750-8cf0-8edfb48e8ca5 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:40.693926 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2969/5922] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:40.759687 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2954/5923] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:40 2022] DELETE /identity/v3/services/1994b63fd3274c66ae4f762991cce532 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:40.761135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703211-ed5b-4336-8ab3-03e7991bbda5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:40.783093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703211-ed5b-4336-8ab3-03e7991bbda5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:40.811546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c662f9-91fc-4750-8cf0-8edfb48e8ca5 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:40.813376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-18c662f9-91fc-4750-8cf0-8edfb48e8ca5 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:40.883212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc436cf1-428d-47e8-aa5f-49e189878be2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:40.883864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc436cf1-428d-47e8-aa5f-49e189878be2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:40.884157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc436cf1-428d-47e8-aa5f-49e189878be2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:40.884428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc436cf1-428d-47e8-aa5f-49e189878be2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services/1994b63fd3274c66ae4f762991cce532` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:40.892241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc436cf1-428d-47e8-aa5f-49e189878be2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:get_service(service_id=1994b63fd3274c66ae4f762991cce532)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:40.892241 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-dc436cf1-428d-47e8-aa5f-49e189878be2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:28:40.892241 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:28:40.892241 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:28:40.895685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc436cf1-428d-47e8-aa5f-49e189878be2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-dc436cf1-428d-47e8-aa5f-49e189878be2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Could not find service: 1994b63fd3274c66ae4f762991cce532.: keystone.exception.ServiceNotFound: Could not find service: 1994b63fd3274c66ae4f762991cce532. Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 1994b63fd3274c66ae4f762991cce532. Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:28:40.930581 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:28:40.931686 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 1994b63fd3274c66ae4f762991cce532. Oct 02 01:28:40.932675 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:28:40.939620 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2970/5924] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:28:40 2022] GET /identity/v3/services/1994b63fd3274c66ae4f762991cce532 => generated 113 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 02 01:28:40.947584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc436cf1-428d-47e8-aa5f-49e189878be2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:41.010261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc436cf1-428d-47e8-aa5f-49e189878be2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:41.029867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c6b16-218b-49d4-b92d-e4f90c37d580 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:41.030495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c6b16-218b-49d4-b92d-e4f90c37d580 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:41.030853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c6b16-218b-49d4-b92d-e4f90c37d580 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:41.031684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c6b16-218b-49d4-b92d-e4f90c37d580 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:41.032765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c6b16-218b-49d4-b92d-e4f90c37d580 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:41.034414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c6b16-218b-49d4-b92d-e4f90c37d580 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:41.130137 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2971/5925] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:40 2022] POST /identity/v3/services => generated 274 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:41.134212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c6b16-218b-49d4-b92d-e4f90c37d580 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:41.145280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c662f9-91fc-4750-8cf0-8edfb48e8ca5 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:41.171394 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:41.182731 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:41.236068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5582cf6-9070-4ed7-a7bc-beb7d0a9b48c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:41.238044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5582cf6-9070-4ed7-a7bc-beb7d0a9b48c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:41.254743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5582cf6-9070-4ed7-a7bc-beb7d0a9b48c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:41.257022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5582cf6-9070-4ed7-a7bc-beb7d0a9b48c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:41.276085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c6b16-218b-49d4-b92d-e4f90c37d580 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:41.287392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a839d0-e2f3-4ffa-96e1-7650730653a8 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:41.291345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a839d0-e2f3-4ffa-96e1-7650730653a8 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:41.292019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a839d0-e2f3-4ffa-96e1-7650730653a8 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:41.292956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5582cf6-9070-4ed7-a7bc-beb7d0a9b48c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:41.293353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a839d0-e2f3-4ffa-96e1-7650730653a8 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:41.294659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a839d0-e2f3-4ffa-96e1-7650730653a8 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:41.297413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a839d0-e2f3-4ffa-96e1-7650730653a8 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:41.298117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5582cf6-9070-4ed7-a7bc-beb7d0a9b48c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:41.346270 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2972/5926] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:41 2022] POST /identity/v3/services => generated 274 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:28:41.350257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a839d0-e2f3-4ffa-96e1-7650730653a8 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:41.385641 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2955/5927] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:40 2022] GET /identity/v3/auth/tokens => generated 3573 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:28:41.409784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a839d0-e2f3-4ffa-96e1-7650730653a8 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:41.422436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1d986-cb63-4799-8f1a-ee993527a4e0 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:41.423189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d986-cb63-4799-8f1a-ee993527a4e0 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:41.423564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d986-cb63-4799-8f1a-ee993527a4e0 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:41.423913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d986-cb63-4799-8f1a-ee993527a4e0 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:41.424925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1d986-cb63-4799-8f1a-ee993527a4e0 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:41.426646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1d986-cb63-4799-8f1a-ee993527a4e0 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:41.470899 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2973/5928] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:41 2022] POST /identity/v3/services => generated 272 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:41.471859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5582cf6-9070-4ed7-a7bc-beb7d0a9b48c service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:41.487839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5582cf6-9070-4ed7-a7bc-beb7d0a9b48c service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:41.576868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5726a-3852-4718-853e-761f50789d64 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:41.577667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5726a-3852-4718-853e-761f50789d64 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:41.578049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5726a-3852-4718-853e-761f50789d64 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:41.578623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5726a-3852-4718-853e-761f50789d64 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:41.579202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5726a-3852-4718-853e-761f50789d64 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:41.580801 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-91b5726a-3852-4718-853e-761f50789d64 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:28:41.580801 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:28:41.580801 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:28:41.581574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5726a-3852-4718-853e-761f50789d64 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:41.597735 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2956/5929] 10.222.0.23 () {58 vars in 1131 bytes} [Sun Oct 2 01:28:41 2022] GET /identity/v3/services => generated 2975 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:41.599134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1d986-cb63-4799-8f1a-ee993527a4e0 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:41.612071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1d986-cb63-4799-8f1a-ee993527a4e0 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:41.617947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861efdb1-4625-42cf-8b29-3e2205228269 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:41.618893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861efdb1-4625-42cf-8b29-3e2205228269 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:41.619316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861efdb1-4625-42cf-8b29-3e2205228269 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:41.619718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861efdb1-4625-42cf-8b29-3e2205228269 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:41.620621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861efdb1-4625-42cf-8b29-3e2205228269 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1919836437) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:41.621027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861efdb1-4625-42cf-8b29-3e2205228269 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:41.622820 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-861efdb1-4625-42cf-8b29-3e2205228269 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:28:41.622820 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:28:41.622820 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:28:41.624195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861efdb1-4625-42cf-8b29-3e2205228269 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:41.633543 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2974/5930] 10.222.0.23 () {58 vars in 1222 bytes} [Sun Oct 2 01:28:41 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1919836437 => generated 417 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:41.635177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5726a-3852-4718-853e-761f50789d64 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:41.655668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5726a-3852-4718-853e-761f50789d64 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:41.670515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c933ba4-fc42-404d-ae6f-bf4a27c06983 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:41.671748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c933ba4-fc42-404d-ae6f-bf4a27c06983 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:41.672295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c933ba4-fc42-404d-ae6f-bf4a27c06983 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:41.672854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c933ba4-fc42-404d-ae6f-bf4a27c06983 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:41.673918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c933ba4-fc42-404d-ae6f-bf4a27c06983 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-225004104) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:41.674466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c933ba4-fc42-404d-ae6f-bf4a27c06983 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:41.676791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c933ba4-fc42-404d-ae6f-bf4a27c06983 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:41.693966 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2957/5931] 10.222.0.23 () {58 vars in 1220 bytes} [Sun Oct 2 01:28:41 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-225004104 => generated 416 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:28:41.701290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861efdb1-4625-42cf-8b29-3e2205228269 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:41.725109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861efdb1-4625-42cf-8b29-3e2205228269 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:41.760323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e8a4e-4af6-469e-9686-b4afbc3e8ba2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:41.761203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8a4e-4af6-469e-9686-b4afbc3e8ba2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:41.761486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8a4e-4af6-469e-9686-b4afbc3e8ba2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:41.761765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8a4e-4af6-469e-9686-b4afbc3e8ba2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:41.767414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e8a4e-4af6-469e-9686-b4afbc3e8ba2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-40043252) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:41.767898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e8a4e-4af6-469e-9686-b4afbc3e8ba2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:41.772171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e8a4e-4af6-469e-9686-b4afbc3e8ba2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:41.794266 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2975/5932] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:28:41 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-40043252 => generated 413 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:41.795990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c933ba4-fc42-404d-ae6f-bf4a27c06983 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:41.820976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c933ba4-fc42-404d-ae6f-bf4a27c06983 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:41.849506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1a48e-5e08-423c-9dbc-9c691a032a8c tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:41.851015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1a48e-5e08-423c-9dbc-9c691a032a8c tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:41.853168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1a48e-5e08-423c-9dbc-9c691a032a8c tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:41.853723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1a48e-5e08-423c-9dbc-9c691a032a8c tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services/0a862cc3cc4a4889bcee7801a803e608` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:41.854840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1a48e-5e08-423c-9dbc-9c691a032a8c tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0a862cc3cc4a4889bcee7801a803e608)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:41.865510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1a48e-5e08-423c-9dbc-9c691a032a8c tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:41.912330 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2958/5933] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:41 2022] DELETE /identity/v3/services/0a862cc3cc4a4889bcee7801a803e608 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:41.921563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e8a4e-4af6-469e-9686-b4afbc3e8ba2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:41.944409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e8a4e-4af6-469e-9686-b4afbc3e8ba2 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:42.019827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71b3f6-292c-4541-9d3d-a276939be279 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:42.020469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b3f6-292c-4541-9d3d-a276939be279 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:42.020751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b3f6-292c-4541-9d3d-a276939be279 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:42.021024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b3f6-292c-4541-9d3d-a276939be279 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services/3d15ba619e2841819d79641caa0b8a30` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:42.021945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71b3f6-292c-4541-9d3d-a276939be279 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3d15ba619e2841819d79641caa0b8a30)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:42.023727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71b3f6-292c-4541-9d3d-a276939be279 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:42.088358 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2976/5934] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:41 2022] DELETE /identity/v3/services/3d15ba619e2841819d79641caa0b8a30 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:42.091524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1a48e-5e08-423c-9dbc-9c691a032a8c tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:42.115870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1a48e-5e08-423c-9dbc-9c691a032a8c tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:42.186024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763dab0-f3cf-4838-b691-f0177416bdaf tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ea2951311c4d32929970d740256f4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a2a82e2975492ca5f8bb9b73ea040b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:42.187002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763dab0-f3cf-4838-b691-f0177416bdaf tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:42.187292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763dab0-f3cf-4838-b691-f0177416bdaf tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:42.187571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763dab0-f3cf-4838-b691-f0177416bdaf tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] PATH_INFO: `/v3/services/6c9a9698d3ad49ca883b0e0a05b4b878` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:42.188176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763dab0-f3cf-4838-b691-f0177416bdaf tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6c9a9698d3ad49ca883b0e0a05b4b878)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:42.202060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763dab0-f3cf-4838-b691-f0177416bdaf tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:42.290080 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2959/5935] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:42 2022] DELETE /identity/v3/services/6c9a9698d3ad49ca883b0e0a05b4b878 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:42.296060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71b3f6-292c-4541-9d3d-a276939be279 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:42.297838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8d71b3f6-292c-4541-9d3d-a276939be279 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:42.378260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71b3f6-292c-4541-9d3d-a276939be279 tempest-ServicesTestJSON-573284791 tempest-ServicesTestJSON-573284791-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:42.437835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:42.438396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:42.438698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:42.438965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] PATH_INFO: `/v3/users/13195daf693348369e2cd16e1b19f116` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:42.443079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13195daf693348369e2cd16e1b19f116)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:42.445174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:42.578531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13195daf693348369e2cd16e1b19f116'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:42.627458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13195daf693348369e2cd16e1b19f116'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:42.632151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13195daf693348369e2cd16e1b19f116'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:42.653151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13195daf693348369e2cd16e1b19f116'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:42.654267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13195daf693348369e2cd16e1b19f116'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:42.687940 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2977/5936] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:42 2022] DELETE /identity/v3/users/13195daf693348369e2cd16e1b19f116 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:42.692374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6adf4-cd30-448b-977b-65c8f7c08d9f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:42.692664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6adf4-cd30-448b-977b-65c8f7c08d9f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:42.692944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6adf4-cd30-448b-977b-65c8f7c08d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:42.734171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-82d6adf4-cd30-448b-977b-65c8f7c08d9f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:42.735903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-82d6adf4-cd30-448b-977b-65c8f7c08d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:42.885589 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2960/5937] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:42.956860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:42.959581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:43.048533 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:43.179714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4f735-8422-41e1-b5f0-b9b703118238 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:43.186615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34870-431a-48d6-a285-809876b6e60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:43.187544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34870-431a-48d6-a285-809876b6e60e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:43.187923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34870-431a-48d6-a285-809876b6e60e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:43.188469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34870-431a-48d6-a285-809876b6e60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:43.227738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34870-431a-48d6-a285-809876b6e60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:43.229606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34870-431a-48d6-a285-809876b6e60e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:43.251773 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2978/5938] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:44.185759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6adf4-cd30-448b-977b-65c8f7c08d9f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:44.187320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-82d6adf4-cd30-448b-977b-65c8f7c08d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:44.212615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6adf4-cd30-448b-977b-65c8f7c08d9f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:44.231987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:44.232651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:44.232934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:44.233204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] PATH_INFO: `/v3/projects/14c31bb46bd34d4c8458e9f9ff999d28` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:44.242510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c31bb46bd34d4c8458e9f9ff999d28)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:44.251952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:44.467338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c31bb46bd34d4c8458e9f9ff999d28', 'request_id': 'req-38d597fa-1e52-423e-874f-303017d7b17b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:44.469590 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:44.484587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c31bb46bd34d4c8458e9f9ff999d28', 'request_id': 'req-38d597fa-1e52-423e-874f-303017d7b17b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:44.515658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c31bb46bd34d4c8458e9f9ff999d28', 'request_id': 'req-38d597fa-1e52-423e-874f-303017d7b17b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:44.555585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] The token cache is being invalidate because project 14c31bb46bd34d4c8458e9f9ff999d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:44.556155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:44.565152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:44.569959 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2961/5939] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:44 2022] DELETE /identity/v3/projects/14c31bb46bd34d4c8458e9f9ff999d28 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:44.571143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34870-431a-48d6-a285-809876b6e60e service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:44.588231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34870-431a-48d6-a285-809876b6e60e service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:44.735446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4847d8-ea5e-43d7-a465-64e596315faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:44.736190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4847d8-ea5e-43d7-a465-64e596315faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:44.736473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4847d8-ea5e-43d7-a465-64e596315faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:44.736749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4847d8-ea5e-43d7-a465-64e596315faf admin admin] PATH_INFO: `/v3/users/37ea2951311c4d32929970d740256f4a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:44.737993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4847d8-ea5e-43d7-a465-64e596315faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ea2951311c4d32929970d740256f4a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:44.740244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4847d8-ea5e-43d7-a465-64e596315faf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:44.843850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b4847d8-ea5e-43d7-a465-64e596315faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ea2951311c4d32929970d740256f4a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:44.870550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b4847d8-ea5e-43d7-a465-64e596315faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ea2951311c4d32929970d740256f4a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:44.871330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b4847d8-ea5e-43d7-a465-64e596315faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ea2951311c4d32929970d740256f4a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:44.905167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b4847d8-ea5e-43d7-a465-64e596315faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ea2951311c4d32929970d740256f4a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:44.906292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2b4847d8-ea5e-43d7-a465-64e596315faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ea2951311c4d32929970d740256f4a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:44.950395 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2979/5940] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:44 2022] DELETE /identity/v3/users/37ea2951311c4d32929970d740256f4a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:28:45.332674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:45.335129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:45.369515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d597fa-1e52-423e-874f-303017d7b17b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:45.723026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:45.725354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:45.726124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:45.726900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] PATH_INFO: `/v3/projects/80ce3cc0882d490dad3b5e60638728a0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:45.734289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ce3cc0882d490dad3b5e60638728a0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:45.741764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:45.884064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ce3cc0882d490dad3b5e60638728a0', 'request_id': 'req-b1e65b21-5bf0-4804-acf1-39c020793e25'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:45.912565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ce3cc0882d490dad3b5e60638728a0', 'request_id': 'req-b1e65b21-5bf0-4804-acf1-39c020793e25'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:45.946810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ce3cc0882d490dad3b5e60638728a0', 'request_id': 'req-b1e65b21-5bf0-4804-acf1-39c020793e25'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:46.014479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] The token cache is being invalidate because project 80ce3cc0882d490dad3b5e60638728a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:46.014815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:46.019713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b1e65b21-5bf0-4804-acf1-39c020793e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:46.021568 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2962/5941] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:45 2022] DELETE /identity/v3/projects/80ce3cc0882d490dad3b5e60638728a0 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:46.026397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5223f8-34c6-44c3-9547-89cc5c13069a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:46.026925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5223f8-34c6-44c3-9547-89cc5c13069a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:46.027039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5223f8-34c6-44c3-9547-89cc5c13069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:46.147519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2e5223f8-34c6-44c3-9547-89cc5c13069a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:46.155724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2e5223f8-34c6-44c3-9547-89cc5c13069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:46.289927 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:46.404728 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2980/5942] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:46.409663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe671c36-59e7-49c8-8b78-e9455c02a371 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:46.410494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe671c36-59e7-49c8-8b78-e9455c02a371 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:46.410951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe671c36-59e7-49c8-8b78-e9455c02a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:46.496332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fe671c36-59e7-49c8-8b78-e9455c02a371 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:46.499077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fe671c36-59e7-49c8-8b78-e9455c02a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:46.542049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5223f8-34c6-44c3-9547-89cc5c13069a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:46.542501 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2963/5943] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:28:46.553020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5223f8-34c6-44c3-9547-89cc5c13069a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:46.597124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853df00-af87-415c-abca-63095ec89854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:46.597882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853df00-af87-415c-abca-63095ec89854 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:46.602766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853df00-af87-415c-abca-63095ec89854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:46.603193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853df00-af87-415c-abca-63095ec89854 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:46.604010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853df00-af87-415c-abca-63095ec89854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:46.607415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853df00-af87-415c-abca-63095ec89854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:46.610283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853df00-af87-415c-abca-63095ec89854 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:46.708066 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2981/5944] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:28:46.711387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe671c36-59e7-49c8-8b78-e9455c02a371 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:46.726212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe671c36-59e7-49c8-8b78-e9455c02a371 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:46.775090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853df00-af87-415c-abca-63095ec89854 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:46.777165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a853df00-af87-415c-abca-63095ec89854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:46.815262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853df00-af87-415c-abca-63095ec89854 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:46.832126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:46.833147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:46.833651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:46.834132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] PATH_INFO: `/v3/projects/01a2a82e2975492ca5f8bb9b73ea040b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:46.841873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a2a82e2975492ca5f8bb9b73ea040b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:46.844487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:46.851547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34383c4-eada-42f0-871c-66f9bf0af6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:46.852166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34383c4-eada-42f0-871c-66f9bf0af6fd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:46.852448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34383c4-eada-42f0-871c-66f9bf0af6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:46.852792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34383c4-eada-42f0-871c-66f9bf0af6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:46.853520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34383c4-eada-42f0-871c-66f9bf0af6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:46.867980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34383c4-eada-42f0-871c-66f9bf0af6fd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:46.979044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a2a82e2975492ca5f8bb9b73ea040b', 'request_id': 'req-23ba20fd-c976-41ce-97c6-c4d3f77b1291'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:47.009625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a2a82e2975492ca5f8bb9b73ea040b', 'request_id': 'req-23ba20fd-c976-41ce-97c6-c4d3f77b1291'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:47.014857 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2964/5945] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:46 2022] POST /identity/v3/projects => generated 399 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:47.019235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34383c4-eada-42f0-871c-66f9bf0af6fd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:47.040632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a2a82e2975492ca5f8bb9b73ea040b', 'request_id': 'req-23ba20fd-c976-41ce-97c6-c4d3f77b1291'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:47.092241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] The token cache is being invalidate because project 01a2a82e2975492ca5f8bb9b73ea040b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:47.092688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:47.093815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-23ba20fd-c976-41ce-97c6-c4d3f77b1291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:47.095694 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2982/5946] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:46 2022] DELETE /identity/v3/projects/01a2a82e2975492ca5f8bb9b73ea040b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:28:47.100662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adf5f2-fa37-4410-809d-9ad1dc5eb095 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:47.108125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adf5f2-fa37-4410-809d-9ad1dc5eb095 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:47.109486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adf5f2-fa37-4410-809d-9ad1dc5eb095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:47.180532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-19adf5f2-fa37-4410-809d-9ad1dc5eb095 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:47.186318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-19adf5f2-fa37-4410-809d-9ad1dc5eb095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:47.192285 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:47.267570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34383c4-eada-42f0-871c-66f9bf0af6fd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:47.287404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b205d6-e675-43db-92c7-ee6e130ab918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:47.288271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b205d6-e675-43db-92c7-ee6e130ab918 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:47.288706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b205d6-e675-43db-92c7-ee6e130ab918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:47.289159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b205d6-e675-43db-92c7-ee6e130ab918 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:47.289948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b205d6-e675-43db-92c7-ee6e130ab918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:47.295964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b205d6-e675-43db-92c7-ee6e130ab918 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:47.359284 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2965/5947] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:47 2022] POST /identity/v3/users => generated 300 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:47.361604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b205d6-e675-43db-92c7-ee6e130ab918 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:47.363972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0b205d6-e675-43db-92c7-ee6e130ab918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:47.435304 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2983/5948] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:47.435304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adf5f2-fa37-4410-809d-9ad1dc5eb095 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:47.435304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-19adf5f2-fa37-4410-809d-9ad1dc5eb095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:47.446183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adf5f2-fa37-4410-809d-9ad1dc5eb095 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:47.455263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baf1b9-e302-431b-b5e7-5bc85a7aec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:47.455937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baf1b9-e302-431b-b5e7-5bc85a7aec6e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:47.456219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baf1b9-e302-431b-b5e7-5bc85a7aec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:47.456493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baf1b9-e302-431b-b5e7-5bc85a7aec6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:47.457160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baf1b9-e302-431b-b5e7-5bc85a7aec6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:47.459038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baf1b9-e302-431b-b5e7-5bc85a7aec6e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:47.494416 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2984/5949] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:47.494416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020b1d3-783c-44a3-b0f0-d2cb01b600cf None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:47.494416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020b1d3-783c-44a3-b0f0-d2cb01b600cf None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:47.494416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020b1d3-783c-44a3-b0f0-d2cb01b600cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:47.606288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b020b1d3-783c-44a3-b0f0-d2cb01b600cf None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:47.607690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b020b1d3-783c-44a3-b0f0-d2cb01b600cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:47.663013 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2985/5950] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:47.663934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020b1d3-783c-44a3-b0f0-d2cb01b600cf None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:47.688853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020b1d3-783c-44a3-b0f0-d2cb01b600cf None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:47.701176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7af5d-14de-4267-bd73-07fbc0c5966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:47.701799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7af5d-14de-4267-bd73-07fbc0c5966e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:47.702080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7af5d-14de-4267-bd73-07fbc0c5966e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:47.702353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7af5d-14de-4267-bd73-07fbc0c5966e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:47.703048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7af5d-14de-4267-bd73-07fbc0c5966e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:47.704652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7af5d-14de-4267-bd73-07fbc0c5966e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:47.729955 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2986/5951] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:47.731538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7af5d-14de-4267-bd73-07fbc0c5966e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:47.764773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7af5d-14de-4267-bd73-07fbc0c5966e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:47.778554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac01889-1381-45dc-a75c-17724bbd5b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:47.779849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac01889-1381-45dc-a75c-17724bbd5b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:47.779849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac01889-1381-45dc-a75c-17724bbd5b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:47.780127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac01889-1381-45dc-a75c-17724bbd5b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:47.790820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac01889-1381-45dc-a75c-17724bbd5b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:47.791192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac01889-1381-45dc-a75c-17724bbd5b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:47.792845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac01889-1381-45dc-a75c-17724bbd5b54 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:47.810530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b205d6-e675-43db-92c7-ee6e130ab918 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:47.818105 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2987/5952] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:47.818899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac01889-1381-45dc-a75c-17724bbd5b54 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:47.840279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb33f4b-cad1-4563-a8d7-c3410c4263a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:47.842525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac01889-1381-45dc-a75c-17724bbd5b54 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:47.842798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33f4b-cad1-4563-a8d7-c3410c4263a8 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:47.843085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33f4b-cad1-4563-a8d7-c3410c4263a8 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:47.844299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33f4b-cad1-4563-a8d7-c3410c4263a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:47.848110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776f482-6cc8-42ec-bc27-28aa7ec8fa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:47.848859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776f482-6cc8-42ec-bc27-28aa7ec8fa0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:47.849342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776f482-6cc8-42ec-bc27-28aa7ec8fa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:47.849796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776f482-6cc8-42ec-bc27-28aa7ec8fa0f admin admin] PATH_INFO: `/v3/projects/cf7ad0bcbd6d47eca0822dd1f708d678/users/e0f84e8314e34bf0b373f480ed21e015/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:47.851956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-adb33f4b-cad1-4563-a8d7-c3410c4263a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:47.852542 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:47.886590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776f482-6cc8-42ec-bc27-28aa7ec8fa0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7ad0bcbd6d47eca0822dd1f708d678, user_id=e0f84e8314e34bf0b373f480ed21e015, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:47.889773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776f482-6cc8-42ec-bc27-28aa7ec8fa0f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:47.927553 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2988/5953] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:47 2022] PUT /identity/v3/projects/cf7ad0bcbd6d47eca0822dd1f708d678/users/e0f84e8314e34bf0b373f480ed21e015/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:47.927553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776f482-6cc8-42ec-bc27-28aa7ec8fa0f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:47.929111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb33f4b-cad1-4563-a8d7-c3410c4263a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:47.946826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb33f4b-cad1-4563-a8d7-c3410c4263a8 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:48.006272 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2966/5954] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:48.016736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8908f-5b25-417f-8283-232eec0d62ef None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:48.017374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8908f-5b25-417f-8283-232eec0d62ef None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:48.017868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8908f-5b25-417f-8283-232eec0d62ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:48.126854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776f482-6cc8-42ec-bc27-28aa7ec8fa0f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:48.141038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aef8b-bafb-47e0-9e29-4e2b0cff0cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:48.141592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aef8b-bafb-47e0-9e29-4e2b0cff0cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:48.141870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aef8b-bafb-47e0-9e29-4e2b0cff0cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:48.142158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aef8b-bafb-47e0-9e29-4e2b0cff0cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:48.142854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aef8b-bafb-47e0-9e29-4e2b0cff0cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:48.145124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b5d8908f-5b25-417f-8283-232eec0d62ef None None] MFA Rules not processed for user `e0f84e8314e34bf0b373f480ed21e015`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:48.145269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aef8b-bafb-47e0-9e29-4e2b0cff0cc0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:48.149327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b5d8908f-5b25-417f-8283-232eec0d62ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:48.206659 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2989/5955] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:47 2022] POST /identity/v3/projects => generated 391 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:48.207984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aef8b-bafb-47e0-9e29-4e2b0cff0cc0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:48.353988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aef8b-bafb-47e0-9e29-4e2b0cff0cc0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:48.367753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a964a-04f6-4b9d-993e-19bc33d307a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:48.368287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a964a-04f6-4b9d-993e-19bc33d307a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:48.368626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a964a-04f6-4b9d-993e-19bc33d307a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:48.368842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a964a-04f6-4b9d-993e-19bc33d307a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:48.369481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a964a-04f6-4b9d-993e-19bc33d307a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:48.373220 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2967/5956] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:48.377094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a964a-04f6-4b9d-993e-19bc33d307a9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:48.377825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8908f-5b25-417f-8283-232eec0d62ef None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:48.411219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8908f-5b25-417f-8283-232eec0d62ef None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:48.432482 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2990/5957] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:48 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:48.433824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a964a-04f6-4b9d-993e-19bc33d307a9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:48.446269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0c7c2-0bd4-4dc1-b5b6-86b005166313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:48.446952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0c7c2-0bd4-4dc1-b5b6-86b005166313 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:48.447243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0c7c2-0bd4-4dc1-b5b6-86b005166313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:48.447525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0c7c2-0bd4-4dc1-b5b6-86b005166313 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:48.448175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0c7c2-0bd4-4dc1-b5b6-86b005166313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:48.453264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a964a-04f6-4b9d-993e-19bc33d307a9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:48.460052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0c7c2-0bd4-4dc1-b5b6-86b005166313 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:48.466647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee5c16-5e6a-4bc8-a1c9-55838362db9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:48.467284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee5c16-5e6a-4bc8-a1c9-55838362db9c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:48.467565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee5c16-5e6a-4bc8-a1c9-55838362db9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:48.467839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee5c16-5e6a-4bc8-a1c9-55838362db9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:48.468490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee5c16-5e6a-4bc8-a1c9-55838362db9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:48.470227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee5c16-5e6a-4bc8-a1c9-55838362db9c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:48.509990 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2991/5958] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:48.516490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee5c16-5e6a-4bc8-a1c9-55838362db9c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:48.540601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee5c16-5e6a-4bc8-a1c9-55838362db9c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:48.548270 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2968/5959] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:48 2022] POST /identity/v3/projects => generated 399 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:48.550509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0c7c2-0bd4-4dc1-b5b6-86b005166313 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:48.587219 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:48.738517 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:48.753565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0c7c2-0bd4-4dc1-b5b6-86b005166313 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:48.776479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d8214-d7f1-4cf4-a956-7f2bfd177534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:48.777109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d8214-d7f1-4cf4-a956-7f2bfd177534 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:48.777394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d8214-d7f1-4cf4-a956-7f2bfd177534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:48.777905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d8214-d7f1-4cf4-a956-7f2bfd177534 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:48.785642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d8214-d7f1-4cf4-a956-7f2bfd177534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:48.796293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d8214-d7f1-4cf4-a956-7f2bfd177534 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:48.805534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4286d-bb66-4643-b6e0-f90eff958f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:48.806173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4286d-bb66-4643-b6e0-f90eff958f6a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:48.806662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4286d-bb66-4643-b6e0-f90eff958f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:48.806997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4286d-bb66-4643-b6e0-f90eff958f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:48.807621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4286d-bb66-4643-b6e0-f90eff958f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:48.811386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4286d-bb66-4643-b6e0-f90eff958f6a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:48.840902 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2992/5960] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:48.843367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4286d-bb66-4643-b6e0-f90eff958f6a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:48.879590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4286d-bb66-4643-b6e0-f90eff958f6a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:48.892488 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2969/5961] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:48 2022] POST /identity/v3/users => generated 306 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:28:48.894899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c0bea-ce9b-4c8f-83ff-966ec54d421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:48.895591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c0bea-ce9b-4c8f-83ff-966ec54d421c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:48.895871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c0bea-ce9b-4c8f-83ff-966ec54d421c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:48.896076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d8214-d7f1-4cf4-a956-7f2bfd177534 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:48.896188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c0bea-ce9b-4c8f-83ff-966ec54d421c admin admin] PATH_INFO: `/v3/projects/59dd433735154745ae64c0ebd8fdb6de/users/add0d0649a29453cb0e8c60b66f95dd3/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:48.920087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d8214-d7f1-4cf4-a956-7f2bfd177534 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:48.931902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9d853-f3e1-468a-9b9e-c24ccbb49262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:48.932777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9d853-f3e1-468a-9b9e-c24ccbb49262 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:48.933521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9d853-f3e1-468a-9b9e-c24ccbb49262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:48.938497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9d853-f3e1-468a-9b9e-c24ccbb49262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:48.939470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9d853-f3e1-468a-9b9e-c24ccbb49262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:48.942398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9d853-f3e1-468a-9b9e-c24ccbb49262 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:48.951651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c0bea-ce9b-4c8f-83ff-966ec54d421c admin admin] RBAC: Authorizing `identity:create_grant(project_id=59dd433735154745ae64c0ebd8fdb6de, user_id=add0d0649a29453cb0e8c60b66f95dd3, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:48.959984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c0bea-ce9b-4c8f-83ff-966ec54d421c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:48.980668 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2970/5962] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:48.987438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9d853-f3e1-468a-9b9e-c24ccbb49262 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:49.030170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9d853-f3e1-468a-9b9e-c24ccbb49262 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:49.061301 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2993/5963] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:48 2022] PUT /identity/v3/projects/59dd433735154745ae64c0ebd8fdb6de/users/add0d0649a29453cb0e8c60b66f95dd3/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:49.064450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6adb6e-7792-48a2-9b21-021a5f1c4a16 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:49.069924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6adb6e-7792-48a2-9b21-021a5f1c4a16 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:49.069924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6adb6e-7792-48a2-9b21-021a5f1c4a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:49.222270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1f6adb6e-7792-48a2-9b21-021a5f1c4a16 None None] MFA Rules not processed for user `add0d0649a29453cb0e8c60b66f95dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:49.227324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1f6adb6e-7792-48a2-9b21-021a5f1c4a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:49.385934 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2994/5964] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:49.387946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6adb6e-7792-48a2-9b21-021a5f1c4a16 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:49.412378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6adb6e-7792-48a2-9b21-021a5f1c4a16 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:49.422412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859c75e-2749-4618-910f-92b99e06d690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:49.423128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859c75e-2749-4618-910f-92b99e06d690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:49.423818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859c75e-2749-4618-910f-92b99e06d690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:49.423818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859c75e-2749-4618-910f-92b99e06d690 admin admin] PATH_INFO: `/v3/projects/815e8e2abc514414ac9e886a01d4bcdf/users/b7875788e8d2498296edb041bd115fc5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:49.425757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688c298-f78f-4cd8-a35e-e49d20a82c7e tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:49.426425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688c298-f78f-4cd8-a35e-e49d20a82c7e tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:49.431127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688c298-f78f-4cd8-a35e-e49d20a82c7e tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:49.431471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688c298-f78f-4cd8-a35e-e49d20a82c7e tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:49.432196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688c298-f78f-4cd8-a35e-e49d20a82c7e tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:create_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:49.438037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688c298-f78f-4cd8-a35e-e49d20a82c7e tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:49.460667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859c75e-2749-4618-910f-92b99e06d690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815e8e2abc514414ac9e886a01d4bcdf, user_id=b7875788e8d2498296edb041bd115fc5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:49.463506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859c75e-2749-4618-910f-92b99e06d690 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:49.494633 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2971/5965] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:48 2022] PUT /identity/v3/projects/815e8e2abc514414ac9e886a01d4bcdf/users/b7875788e8d2498296edb041bd115fc5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:49.498744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859c75e-2749-4618-910f-92b99e06d690 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:49.666543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859c75e-2749-4618-910f-92b99e06d690 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:49.689405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248e7ba-b567-42da-a36c-f68e392ad68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:49.690057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e7ba-b567-42da-a36c-f68e392ad68d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:49.690333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e7ba-b567-42da-a36c-f68e392ad68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:49.690656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e7ba-b567-42da-a36c-f68e392ad68d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:49.691283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248e7ba-b567-42da-a36c-f68e392ad68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:49.712162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248e7ba-b567-42da-a36c-f68e392ad68d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:49.720837 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:49.736941 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2995/5966] 10.222.0.23 () {60 vars in 1314 bytes} [Sun Oct 2 01:28:49 2022] POST /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials => generated 788 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:49.744363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688c298-f78f-4cd8-a35e-e49d20a82c7e tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:49.763713 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2972/5967] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:49.773546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248e7ba-b567-42da-a36c-f68e392ad68d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:49.786990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688c298-f78f-4cd8-a35e-e49d20a82c7e tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:49.831798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248e7ba-b567-42da-a36c-f68e392ad68d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:49.870128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cadf96-de2a-49c1-a73d-5f2fc2789e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:49.871285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadf96-de2a-49c1-a73d-5f2fc2789e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:49.871881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadf96-de2a-49c1-a73d-5f2fc2789e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:49.872718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadf96-de2a-49c1-a73d-5f2fc2789e62 admin admin] PATH_INFO: `/v3/projects/815e8e2abc514414ac9e886a01d4bcdf/users/b7875788e8d2498296edb041bd115fc5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:49.881582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cadf96-de2a-49c1-a73d-5f2fc2789e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815e8e2abc514414ac9e886a01d4bcdf, user_id=b7875788e8d2498296edb041bd115fc5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:49.907912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cadf96-de2a-49c1-a73d-5f2fc2789e62 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:49.923897 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:49.983273 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2973/5968] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:49 2022] PUT /identity/v3/projects/815e8e2abc514414ac9e886a01d4bcdf/users/b7875788e8d2498296edb041bd115fc5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:49.986302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae45552-36df-415c-9df9-2bff587a6a94 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:49.986807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae45552-36df-415c-9df9-2bff587a6a94 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:49.987241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae45552-36df-415c-9df9-2bff587a6a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:49.991902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca3ebe-de36-4bc3-9e65-8994bc584363 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:49.992573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca3ebe-de36-4bc3-9e65-8994bc584363 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:49.992859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca3ebe-de36-4bc3-9e65-8994bc584363 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:49.993138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca3ebe-de36-4bc3-9e65-8994bc584363 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/1af7861685bf4e35a472c61db7a81ce8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:50.017507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca3ebe-de36-4bc3-9e65-8994bc584363 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:get_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3, application_credential_id=1af7861685bf4e35a472c61db7a81ce8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:50.019485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca3ebe-de36-4bc3-9e65-8994bc584363 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:50.021663 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2996/5969] 10.222.0.23 () {58 vars in 1392 bytes} [Sun Oct 2 01:28:49 2022] GET /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/1af7861685bf4e35a472c61db7a81ce8 => generated 688 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:50.027386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86b84-499b-4ba7-a8c6-eece1256d944 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:50.029341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86b84-499b-4ba7-a8c6-eece1256d944 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:50.029630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86b84-499b-4ba7-a8c6-eece1256d944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:50.063624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cde86b84-499b-4ba7-a8c6-eece1256d944 None None] MFA Rules not processed for user `add0d0649a29453cb0e8c60b66f95dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:50.068095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cde86b84-499b-4ba7-a8c6-eece1256d944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:50.173074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fae45552-36df-415c-9df9-2bff587a6a94 None None] MFA Rules not processed for user `b7875788e8d2498296edb041bd115fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:50.174439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fae45552-36df-415c-9df9-2bff587a6a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:50.350321 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2997/5970] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3424 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 02 01:28:50.356528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde86b84-499b-4ba7-a8c6-eece1256d944 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:50.427283 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2974/5971] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:49 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:28:50.439215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae45552-36df-415c-9df9-2bff587a6a94 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:50.446187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fae45552-36df-415c-9df9-2bff587a6a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:50.531272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde86b84-499b-4ba7-a8c6-eece1256d944 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:50.541072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6766251-7e12-4456-9602-350a639009ef tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:50.544216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6766251-7e12-4456-9602-350a639009ef tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:50.544806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6766251-7e12-4456-9602-350a639009ef tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:50.548652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6766251-7e12-4456-9602-350a639009ef tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/1af7861685bf4e35a472c61db7a81ce8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:50.549516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6766251-7e12-4456-9602-350a639009ef tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:delete_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3, application_credential_id=1af7861685bf4e35a472c61db7a81ce8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:50.551178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6766251-7e12-4456-9602-350a639009ef tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:50.594632 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2998/5972] 10.222.0.23 () {58 vars in 1395 bytes} [Sun Oct 2 01:28:50 2022] DELETE /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/1af7861685bf4e35a472c61db7a81ce8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:50.595693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6766251-7e12-4456-9602-350a639009ef tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:50.609704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae45552-36df-415c-9df9-2bff587a6a94 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:50.618760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6766251-7e12-4456-9602-350a639009ef tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:50.623468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bf718-1b22-41b7-8592-8b61b5c6516a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:50.624211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf718-1b22-41b7-8592-8b61b5c6516a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:50.624560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf718-1b22-41b7-8592-8b61b5c6516a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:50.624899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf718-1b22-41b7-8592-8b61b5c6516a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:50.640531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a03990-9ad7-4da8-80cb-d2a4086fe2c8 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:50.643047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03990-9ad7-4da8-80cb-d2a4086fe2c8 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:50.643346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03990-9ad7-4da8-80cb-d2a4086fe2c8 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:50.643630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03990-9ad7-4da8-80cb-d2a4086fe2c8 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:50.644340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a03990-9ad7-4da8-80cb-d2a4086fe2c8 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:create_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:50.645521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a03990-9ad7-4da8-80cb-d2a4086fe2c8 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:50.706209 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:50.860280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bf718-1b22-41b7-8592-8b61b5c6516a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:50.877728 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 2999/5973] 10.222.0.23 () {60 vars in 1315 bytes} [Sun Oct 2 01:28:50 2022] POST /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials => generated 920 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:50.881144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a03990-9ad7-4da8-80cb-d2a4086fe2c8 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:50.881687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bf718-1b22-41b7-8592-8b61b5c6516a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:50.925690 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2975/5974] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:50.926237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a03990-9ad7-4da8-80cb-d2a4086fe2c8 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:50.951011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93dc86-cf53-411b-bc5b-0af2a3b1ec98 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:50.951555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93dc86-cf53-411b-bc5b-0af2a3b1ec98 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:50.951843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93dc86-cf53-411b-bc5b-0af2a3b1ec98 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:50.956112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93dc86-cf53-411b-bc5b-0af2a3b1ec98 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/8a19cb081a774b5e9c918dbb63565c99` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:51.007419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93dc86-cf53-411b-bc5b-0af2a3b1ec98 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:delete_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3, application_credential_id=8a19cb081a774b5e9c918dbb63565c99)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:51.008983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93dc86-cf53-411b-bc5b-0af2a3b1ec98 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:51.122692 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3000/5975] 10.222.0.23 () {58 vars in 1395 bytes} [Sun Oct 2 01:28:50 2022] DELETE /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/8a19cb081a774b5e9c918dbb63565c99 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:51.127880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bf718-1b22-41b7-8592-8b61b5c6516a service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:51.143964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bf718-1b22-41b7-8592-8b61b5c6516a service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:51.160822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b4fee-385e-40a3-80f3-8ec3fa01a66f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:51.161829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b4fee-385e-40a3-80f3-8ec3fa01a66f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:51.162231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b4fee-385e-40a3-80f3-8ec3fa01a66f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:51.163627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b4fee-385e-40a3-80f3-8ec3fa01a66f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:51.164463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b4fee-385e-40a3-80f3-8ec3fa01a66f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:create_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:51.166887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b4fee-385e-40a3-80f3-8ec3fa01a66f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:51.274975 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:51.423591 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2976/5976] 10.222.0.23 () {60 vars in 1315 bytes} [Sun Oct 2 01:28:51 2022] POST /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials => generated 812 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:51.426748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93dc86-cf53-411b-bc5b-0af2a3b1ec98 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:51.442848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93dc86-cf53-411b-bc5b-0af2a3b1ec98 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:51.452542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487bd5d-5b9c-46ad-8d07-feaee91f9c8b tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:51.455361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487bd5d-5b9c-46ad-8d07-feaee91f9c8b tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:51.459499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487bd5d-5b9c-46ad-8d07-feaee91f9c8b tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:51.459904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487bd5d-5b9c-46ad-8d07-feaee91f9c8b tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/a20164a48c7f4851ae46b11d05823e58` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:51.496894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487bd5d-5b9c-46ad-8d07-feaee91f9c8b tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:delete_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3, application_credential_id=a20164a48c7f4851ae46b11d05823e58)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:51.498812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487bd5d-5b9c-46ad-8d07-feaee91f9c8b tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:51.562348 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3001/5977] 10.222.0.23 () {58 vars in 1395 bytes} [Sun Oct 2 01:28:51 2022] DELETE /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/a20164a48c7f4851ae46b11d05823e58 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:51.568571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b4fee-385e-40a3-80f3-8ec3fa01a66f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:51.588589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b4fee-385e-40a3-80f3-8ec3fa01a66f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:51.609317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1645d33-e28f-49c6-a5a5-4f68e71fc05c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:51.632390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1645d33-e28f-49c6-a5a5-4f68e71fc05c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:51.632943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1645d33-e28f-49c6-a5a5-4f68e71fc05c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:51.634104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1645d33-e28f-49c6-a5a5-4f68e71fc05c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:51.646664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1645d33-e28f-49c6-a5a5-4f68e71fc05c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:create_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:51.648081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1645d33-e28f-49c6-a5a5-4f68e71fc05c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:52.054043 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2977/5978] 10.222.0.23 () {60 vars in 1314 bytes} [Sun Oct 2 01:28:51 2022] POST /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials => generated 788 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:52.055199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487bd5d-5b9c-46ad-8d07-feaee91f9c8b tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:52.069044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487bd5d-5b9c-46ad-8d07-feaee91f9c8b tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:52.084752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc372540-3162-474e-a223-9f890ae017cd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:52.085406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372540-3162-474e-a223-9f890ae017cd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:52.085689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372540-3162-474e-a223-9f890ae017cd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:52.085965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372540-3162-474e-a223-9f890ae017cd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:52.086699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc372540-3162-474e-a223-9f890ae017cd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:create_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:52.087793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc372540-3162-474e-a223-9f890ae017cd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:52.284871 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3002/5979] 10.222.0.23 () {60 vars in 1314 bytes} [Sun Oct 2 01:28:52 2022] POST /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials => generated 788 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:52.288852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1645d33-e28f-49c6-a5a5-4f68e71fc05c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:52.312612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1645d33-e28f-49c6-a5a5-4f68e71fc05c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:52.317243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773de479-cd97-4c56-bd6e-2d9f43ae3519 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:52.317915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de479-cd97-4c56-bd6e-2d9f43ae3519 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:52.318197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de479-cd97-4c56-bd6e-2d9f43ae3519 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:52.318475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de479-cd97-4c56-bd6e-2d9f43ae3519 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:52.319886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773de479-cd97-4c56-bd6e-2d9f43ae3519 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:list_application_credentials(user_id=add0d0649a29453cb0e8c60b66f95dd3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:52.321668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773de479-cd97-4c56-bd6e-2d9f43ae3519 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:52.354539 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2978/5980] 10.222.0.23 () {58 vars in 1293 bytes} [Sun Oct 2 01:28:52 2022] GET /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials => generated 1500 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:52.359165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc372540-3162-474e-a223-9f890ae017cd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:52.369742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773de479-cd97-4c56-bd6e-2d9f43ae3519 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:52.377136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-773de479-cd97-4c56-bd6e-2d9f43ae3519 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:52.380666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc372540-3162-474e-a223-9f890ae017cd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:52.436180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9c034-1844-45c9-9881-c75c53dca4df tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:52.436879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9c034-1844-45c9-9881-c75c53dca4df tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:52.437156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9c034-1844-45c9-9881-c75c53dca4df tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:52.437425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9c034-1844-45c9-9881-c75c53dca4df tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/692874af081c429c8a23ca276c5a3a9e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:52.499710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9c034-1844-45c9-9881-c75c53dca4df tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:delete_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3, application_credential_id=692874af081c429c8a23ca276c5a3a9e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:52.501388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9c034-1844-45c9-9881-c75c53dca4df tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:52.562901 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:52.572148 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3003/5981] 10.222.0.23 () {58 vars in 1395 bytes} [Sun Oct 2 01:28:52 2022] DELETE /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/692874af081c429c8a23ca276c5a3a9e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:52.577991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9c034-1844-45c9-9881-c75c53dca4df tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:52.608310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9c034-1844-45c9-9881-c75c53dca4df tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:52.618211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c7c61-542e-4b8f-9a49-03b3ca38853a tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:52.619687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c7c61-542e-4b8f-9a49-03b3ca38853a tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:52.620922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c7c61-542e-4b8f-9a49-03b3ca38853a tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:52.621217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c7c61-542e-4b8f-9a49-03b3ca38853a tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/07ce58bd540648dc8b0160a26507ac48` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:52.648576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c7c61-542e-4b8f-9a49-03b3ca38853a tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:delete_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3, application_credential_id=07ce58bd540648dc8b0160a26507ac48)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:52.652236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c7c61-542e-4b8f-9a49-03b3ca38853a tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:52.683662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773de479-cd97-4c56-bd6e-2d9f43ae3519 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:52.702818 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3004/5982] 10.222.0.23 () {58 vars in 1395 bytes} [Sun Oct 2 01:28:52 2022] DELETE /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/07ce58bd540648dc8b0160a26507ac48 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:52.704282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c7c61-542e-4b8f-9a49-03b3ca38853a tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:52.709313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323fcb0-469b-4749-8b7a-2ae030cb9a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:52.709962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323fcb0-469b-4749-8b7a-2ae030cb9a7c service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:52.710247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323fcb0-469b-4749-8b7a-2ae030cb9a7c service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:52.710522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323fcb0-469b-4749-8b7a-2ae030cb9a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:52.725673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c7c61-542e-4b8f-9a49-03b3ca38853a tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:52.738533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323fcb0-469b-4749-8b7a-2ae030cb9a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:52.741603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82efe64-539d-45a7-91ad-84923d9826bd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:52.742382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efe64-539d-45a7-91ad-84923d9826bd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:52.742812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323fcb0-469b-4749-8b7a-2ae030cb9a7c service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:52.744274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efe64-539d-45a7-91ad-84923d9826bd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:52.744645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efe64-539d-45a7-91ad-84923d9826bd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:52.745803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82efe64-539d-45a7-91ad-84923d9826bd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:create_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:52.750189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82efe64-539d-45a7-91ad-84923d9826bd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:52.788941 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2979/5983] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:52 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:53.048646 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3005/5984] 10.222.0.23 () {60 vars in 1314 bytes} [Sun Oct 2 01:28:52 2022] POST /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials => generated 789 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:53.053305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323fcb0-469b-4749-8b7a-2ae030cb9a7c service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:53.067306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323fcb0-469b-4749-8b7a-2ae030cb9a7c service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:53.089144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c3fd4-1344-47be-982c-f085034cffda tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:53.092182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c3fd4-1344-47be-982c-f085034cffda tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:53.094626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c3fd4-1344-47be-982c-f085034cffda tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:53.095117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c3fd4-1344-47be-982c-f085034cffda tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:53.101473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c3fd4-1344-47be-982c-f085034cffda tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:create_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:53.119038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c3fd4-1344-47be-982c-f085034cffda tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:53.147510 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:53.525061 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2980/5985] 10.222.0.23 () {60 vars in 1314 bytes} [Sun Oct 2 01:28:53 2022] POST /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials => generated 788 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:53.531023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82efe64-539d-45a7-91ad-84923d9826bd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:53.548580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82efe64-539d-45a7-91ad-84923d9826bd tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:53.570774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6355cf3-da73-460b-89dc-92442852c893 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:53.575613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6355cf3-da73-460b-89dc-92442852c893 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:53.577191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6355cf3-da73-460b-89dc-92442852c893 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:53.577327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6355cf3-da73-460b-89dc-92442852c893 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:53.581194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6355cf3-da73-460b-89dc-92442852c893 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Adding query filter params (name=tempest-application_credential-389961593) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:53.581497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6355cf3-da73-460b-89dc-92442852c893 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:list_application_credentials(user_id=add0d0649a29453cb0e8c60b66f95dd3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:53.589536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6355cf3-da73-460b-89dc-92442852c893 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:53.671445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c3fd4-1344-47be-982c-f085034cffda tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:53.685105 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3006/5986] 10.222.0.23 () {58 vars in 1384 bytes} [Sun Oct 2 01:28:53 2022] GET /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials?name=tempest-application_credential-389961593 => generated 885 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:53.691093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c3fd4-1344-47be-982c-f085034cffda tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:53.733649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b33815-e6b7-4e60-bc73-274b3379794c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:53.739027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33815-e6b7-4e60-bc73-274b3379794c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:53.739885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33815-e6b7-4e60-bc73-274b3379794c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:53.742676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33815-e6b7-4e60-bc73-274b3379794c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/23a6e5da28624a6e8d444a98ad72a2b6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:53.829101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b33815-e6b7-4e60-bc73-274b3379794c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:delete_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3, application_credential_id=23a6e5da28624a6e8d444a98ad72a2b6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:53.829101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b33815-e6b7-4e60-bc73-274b3379794c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:54.026922 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2981/5987] 10.222.0.23 () {58 vars in 1395 bytes} [Sun Oct 2 01:28:53 2022] DELETE /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/23a6e5da28624a6e8d444a98ad72a2b6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:54.032174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6355cf3-da73-460b-89dc-92442852c893 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:54.053015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6355cf3-da73-460b-89dc-92442852c893 tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:54.067286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f3332-ac84-4ef3-b028-ebd8d5a03e4f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add0d0649a29453cb0e8c60b66f95dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59dd433735154745ae64c0ebd8fdb6de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:54.067961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3332-ac84-4ef3-b028-ebd8d5a03e4f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:54.071855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3332-ac84-4ef3-b028-ebd8d5a03e4f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:54.072149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3332-ac84-4ef3-b028-ebd8d5a03e4f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/edeabe108a0d4feab257da716a957680` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:54.110138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f3332-ac84-4ef3-b028-ebd8d5a03e4f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorizing `identity:delete_application_credential(user_id=add0d0649a29453cb0e8c60b66f95dd3, application_credential_id=edeabe108a0d4feab257da716a957680)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:54.115552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f3332-ac84-4ef3-b028-ebd8d5a03e4f tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:54.186992 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3007/5988] 10.222.0.23 () {58 vars in 1395 bytes} [Sun Oct 2 01:28:54 2022] DELETE /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3/application_credentials/edeabe108a0d4feab257da716a957680 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:54.191900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b33815-e6b7-4e60-bc73-274b3379794c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:54.342718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b33815-e6b7-4e60-bc73-274b3379794c tempest-ApplicationCredentialsV3Test-234038118 tempest-ApplicationCredentialsV3Test-234038118-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:54.357920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:54.358481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:54.358824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:54.359104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] PATH_INFO: `/v3/users/add0d0649a29453cb0e8c60b66f95dd3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:54.362095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=add0d0649a29453cb0e8c60b66f95dd3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:54.364946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:54.580283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add0d0649a29453cb0e8c60b66f95dd3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:54.647440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add0d0649a29453cb0e8c60b66f95dd3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:54.648368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add0d0649a29453cb0e8c60b66f95dd3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:54.666812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add0d0649a29453cb0e8c60b66f95dd3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:54.673085 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:54.677453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add0d0649a29453cb0e8c60b66f95dd3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:54.693133 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2982/5989] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:28:54 2022] DELETE /identity/v3/users/add0d0649a29453cb0e8c60b66f95dd3 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:54.697643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738fdf2-cc5c-4a6d-b838-0c7acc93f601 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:54.698219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738fdf2-cc5c-4a6d-b838-0c7acc93f601 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:54.698219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738fdf2-cc5c-4a6d-b838-0c7acc93f601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:54.822144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7738fdf2-cc5c-4a6d-b838-0c7acc93f601 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:54.823892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7738fdf2-cc5c-4a6d-b838-0c7acc93f601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:55.203463 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3008/5990] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:55.313531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:55.314867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:55.632381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ed7ff-6d98-4cae-b522-c0a97b2c01b8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:55.645896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64901b82-ba09-41f5-ac8d-b0106aae50a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:55.646117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901b82-ba09-41f5-ac8d-b0106aae50a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:55.646229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901b82-ba09-41f5-ac8d-b0106aae50a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:55.646489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901b82-ba09-41f5-ac8d-b0106aae50a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:55.717388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64901b82-ba09-41f5-ac8d-b0106aae50a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:55.721206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64901b82-ba09-41f5-ac8d-b0106aae50a0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:55.775337 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2983/5991] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:28:58.028103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738fdf2-cc5c-4a6d-b838-0c7acc93f601 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:58.029700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7738fdf2-cc5c-4a6d-b838-0c7acc93f601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:58.056735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738fdf2-cc5c-4a6d-b838-0c7acc93f601 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:58.087391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:58.088202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:58.088577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:58.088972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] PATH_INFO: `/v3/projects/59dd433735154745ae64c0ebd8fdb6de` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:58.091048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59dd433735154745ae64c0ebd8fdb6de)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:58.093229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:58.134117 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:58.205974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59dd433735154745ae64c0ebd8fdb6de', 'request_id': 'req-f083c5d7-4fb0-47d9-a589-1efac04901f9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:58.212630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59dd433735154745ae64c0ebd8fdb6de', 'request_id': 'req-f083c5d7-4fb0-47d9-a589-1efac04901f9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:58.220495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59dd433735154745ae64c0ebd8fdb6de', 'request_id': 'req-f083c5d7-4fb0-47d9-a589-1efac04901f9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:58.242048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] The token cache is being invalidate because project 59dd433735154745ae64c0ebd8fdb6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:28:58.242812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:58.243699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f083c5d7-4fb0-47d9-a589-1efac04901f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:28:58.247890 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3009/5992] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:28:58 2022] DELETE /identity/v3/projects/59dd433735154745ae64c0ebd8fdb6de => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:58.252514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35e26f-6306-44a5-a2a9-8e4e3dffa110 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:58.253546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35e26f-6306-44a5-a2a9-8e4e3dffa110 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:58.254053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35e26f-6306-44a5-a2a9-8e4e3dffa110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:58.454459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4a35e26f-6306-44a5-a2a9-8e4e3dffa110 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:58.455734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4a35e26f-6306-44a5-a2a9-8e4e3dffa110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:58.608427 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2984/5993] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:58.617459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013913c-5482-4020-842b-d81291b61660 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:58.618156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013913c-5482-4020-842b-d81291b61660 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:58.618516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013913c-5482-4020-842b-d81291b61660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:58.667686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e013913c-5482-4020-842b-d81291b61660 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:58.670107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e013913c-5482-4020-842b-d81291b61660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:28:58.706246 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3010/5994] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:28:58.710188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35e26f-6306-44a5-a2a9-8e4e3dffa110 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:58.724935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35e26f-6306-44a5-a2a9-8e4e3dffa110 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:58.740461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ebfe2-7c46-4430-9cde-cb38ef6e7886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:58.741463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ebfe2-7c46-4430-9cde-cb38ef6e7886 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:58.741761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ebfe2-7c46-4430-9cde-cb38ef6e7886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:58.742038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ebfe2-7c46-4430-9cde-cb38ef6e7886 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:58.742733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ebfe2-7c46-4430-9cde-cb38ef6e7886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:28:58.743046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ebfe2-7c46-4430-9cde-cb38ef6e7886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:58.744663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ebfe2-7c46-4430-9cde-cb38ef6e7886 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:58.773389 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2985/5995] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:28:58.774277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013913c-5482-4020-842b-d81291b61660 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:58.789140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013913c-5482-4020-842b-d81291b61660 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:58.799286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b42ef2-3c2f-4378-a433-0df61f5e991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:58.799981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b42ef2-3c2f-4378-a433-0df61f5e991b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:58.800215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b42ef2-3c2f-4378-a433-0df61f5e991b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:58.800483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b42ef2-3c2f-4378-a433-0df61f5e991b admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:58.801123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b42ef2-3c2f-4378-a433-0df61f5e991b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:58.803402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b42ef2-3c2f-4378-a433-0df61f5e991b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:58.878781 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3011/5996] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:28:58 2022] POST /identity/v3/projects => generated 361 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:28:58.882683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ebfe2-7c46-4430-9cde-cb38ef6e7886 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:58.901114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ebfe2-7c46-4430-9cde-cb38ef6e7886 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:59.135951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77567938-f6cc-49fc-ac6b-28fcb3b5aab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:59.136766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77567938-f6cc-49fc-ac6b-28fcb3b5aab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:59.137672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77567938-f6cc-49fc-ac6b-28fcb3b5aab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:59.138044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77567938-f6cc-49fc-ac6b-28fcb3b5aab2 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:59.138830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77567938-f6cc-49fc-ac6b-28fcb3b5aab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:59.141498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77567938-f6cc-49fc-ac6b-28fcb3b5aab2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:59.156033 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:28:59.197321 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2986/5997] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:28:58 2022] POST /identity/v3/users => generated 281 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:28:59.199047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b42ef2-3c2f-4378-a433-0df61f5e991b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:59.217493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b42ef2-3c2f-4378-a433-0df61f5e991b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:59.244414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57076c-b32c-4737-99be-e71aa8b407d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:59.245073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57076c-b32c-4737-99be-e71aa8b407d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:59.245357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57076c-b32c-4737-99be-e71aa8b407d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:59.245636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57076c-b32c-4737-99be-e71aa8b407d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:59.253934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57076c-b32c-4737-99be-e71aa8b407d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:59.262722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57076c-b32c-4737-99be-e71aa8b407d0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:59.340721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77567938-f6cc-49fc-ac6b-28fcb3b5aab2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:59.344532 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3012/5998] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:59.374385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77567938-f6cc-49fc-ac6b-28fcb3b5aab2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:59.388955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ceb2c-19d4-42ab-ae12-daffd2683157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:59.389599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ceb2c-19d4-42ab-ae12-daffd2683157 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:59.389934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ceb2c-19d4-42ab-ae12-daffd2683157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:59.390218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ceb2c-19d4-42ab-ae12-daffd2683157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:59.392765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ceb2c-19d4-42ab-ae12-daffd2683157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:59.397916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ceb2c-19d4-42ab-ae12-daffd2683157 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:59.438662 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2987/5999] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:28:59.440404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57076c-b32c-4737-99be-e71aa8b407d0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:28:59.453391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57076c-b32c-4737-99be-e71aa8b407d0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:28:59.476550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ff335-2a6d-4b46-83b2-4cded4d2792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:28:59.478038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff335-2a6d-4b46-83b2-4cded4d2792d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:59.481444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff335-2a6d-4b46-83b2-4cded4d2792d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:59.482453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff335-2a6d-4b46-83b2-4cded4d2792d admin admin] PATH_INFO: `/v3/projects/428f636169634315aa9b06cf709e8d2a/users/6d589a121ed34503be57d01e0038f144/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:59.507854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ff335-2a6d-4b46-83b2-4cded4d2792d admin admin] RBAC: Authorizing `identity:create_grant(project_id=428f636169634315aa9b06cf709e8d2a, user_id=6d589a121ed34503be57d01e0038f144, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:28:59.512153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ff335-2a6d-4b46-83b2-4cded4d2792d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:28:59.553582 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3013/6000] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:28:59 2022] PUT /identity/v3/projects/428f636169634315aa9b06cf709e8d2a/users/6d589a121ed34503be57d01e0038f144/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:28:59.556074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc14b1-edca-49dd-a3aa-e1b41f155548 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:28:59.558062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc14b1-edca-49dd-a3aa-e1b41f155548 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:28:59.558661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc14b1-edca-49dd-a3aa-e1b41f155548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:28:59.634540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e1bc14b1-edca-49dd-a3aa-e1b41f155548 None None] MFA Rules not processed for user `6d589a121ed34503be57d01e0038f144`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:28:59.642320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e1bc14b1-edca-49dd-a3aa-e1b41f155548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:00.002563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c5a7-3734-46a2-9a75-91f6f8791ad3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:00.002890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c5a7-3734-46a2-9a75-91f6f8791ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:00.003165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c5a7-3734-46a2-9a75-91f6f8791ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:00.018673 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2988/6001] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:28:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:00.061007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-10d2c5a7-3734-46a2-9a75-91f6f8791ad3 None None] MFA Rules not processed for user `6d589a121ed34503be57d01e0038f144`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:00.062480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-10d2c5a7-3734-46a2-9a75-91f6f8791ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:00.077140 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3014/6002] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:00 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:29:00.082165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c16ff1-5d7e-4370-b1d5-921208fc9911 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:00.082511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c16ff1-5d7e-4370-b1d5-921208fc9911 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:00.082856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c16ff1-5d7e-4370-b1d5-921208fc9911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:00.144078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-84c16ff1-5d7e-4370-b1d5-921208fc9911 None None] MFA Rules not processed for user `6d589a121ed34503be57d01e0038f144`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:00.153607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-84c16ff1-5d7e-4370-b1d5-921208fc9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:00.169847 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2989/6003] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:00 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:29:00.173672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2c5a7-3734-46a2-9a75-91f6f8791ad3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:00.192379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2c5a7-3734-46a2-9a75-91f6f8791ad3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:00.201664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf743c17-418a-4fff-8b2b-f9df839e9562 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d589a121ed34503be57d01e0038f144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '428f636169634315aa9b06cf709e8d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:00.203170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743c17-418a-4fff-8b2b-f9df839e9562 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] REQUEST_METHOD: `HEAD` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:00.203606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743c17-418a-4fff-8b2b-f9df839e9562 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:00.204130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743c17-418a-4fff-8b2b-f9df839e9562 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:00.219511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf743c17-418a-4fff-8b2b-f9df839e9562 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: Authorizing `identity:check_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:00.221583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf743c17-418a-4fff-8b2b-f9df839e9562 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:00.240074 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3015/6004] 10.222.0.23 () {56 vars in 1264 bytes} [Sun Oct 2 01:29:00 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 02 01:29:00.243827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c16ff1-5d7e-4370-b1d5-921208fc9911 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:00.259815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c16ff1-5d7e-4370-b1d5-921208fc9911 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:00.273972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf27001-9fa1-429b-a685-c43502738fdf tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d589a121ed34503be57d01e0038f144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '428f636169634315aa9b06cf709e8d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:00.275026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27001-9fa1-429b-a685-c43502738fdf tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:00.275479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27001-9fa1-429b-a685-c43502738fdf tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:00.275918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27001-9fa1-429b-a685-c43502738fdf tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:00.290197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf27001-9fa1-429b-a685-c43502738fdf tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:00.299307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf27001-9fa1-429b-a685-c43502738fdf tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:00.311485 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2990/6005] 10.222.0.23 () {56 vars in 1263 bytes} [Sun Oct 2 01:29:00 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 01:29:00.315499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf743c17-418a-4fff-8b2b-f9df839e9562 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:00.327992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf743c17-418a-4fff-8b2b-f9df839e9562 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:00.340607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ce40f-ed1d-4951-9ac2-5b438dcad534 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d589a121ed34503be57d01e0038f144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '428f636169634315aa9b06cf709e8d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:00.341518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ce40f-ed1d-4951-9ac2-5b438dcad534 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:00.341953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ce40f-ed1d-4951-9ac2-5b438dcad534 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:00.342379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ce40f-ed1d-4951-9ac2-5b438dcad534 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:00.371678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ce40f-ed1d-4951-9ac2-5b438dcad534 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:00.385900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ce40f-ed1d-4951-9ac2-5b438dcad534 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:00.457634 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3016/6006] 10.222.0.23 () {56 vars in 1266 bytes} [Sun Oct 2 01:29:00 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:00.470218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf27001-9fa1-429b-a685-c43502738fdf tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:00.489329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf27001-9fa1-429b-a685-c43502738fdf tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:00.507688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9504d85-6928-4727-80d5-0f6f3f60d9ac tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d589a121ed34503be57d01e0038f144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '428f636169634315aa9b06cf709e8d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:00.508614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504d85-6928-4727-80d5-0f6f3f60d9ac tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:00.509059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504d85-6928-4727-80d5-0f6f3f60d9ac tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:00.509485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504d85-6928-4727-80d5-0f6f3f60d9ac tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:00.516147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a9504d85-6928-4727-80d5-0f6f3f60d9ac tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a9504d85-6928-4727-80d5-0f6f3f60d9ac tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 02 01:29:00.599690 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 02 01:29:00.600775 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 02 01:29:00.601792 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:00.601792 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:00.601792 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 02 01:29:00.601792 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 02 01:29:00.601792 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 02 01:29:00.601792 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:00.601792 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2991/6007] 10.222.0.23 () {56 vars in 1264 bytes} [Sun Oct 2 01:29:00 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 02 01:29:00.607350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3aeee-fee1-4fa8-b857-81adc25d3728 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:00.607633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3aeee-fee1-4fa8-b857-81adc25d3728 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:00.607905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3aeee-fee1-4fa8-b857-81adc25d3728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:00.655819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-35d3aeee-fee1-4fa8-b857-81adc25d3728 None None] MFA Rules not processed for user `6d589a121ed34503be57d01e0038f144`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:00.657521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-35d3aeee-fee1-4fa8-b857-81adc25d3728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:00.736007 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3017/6008] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:00 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:29:00.740098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9504d85-6928-4727-80d5-0f6f3f60d9ac tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:00.773511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9504d85-6928-4727-80d5-0f6f3f60d9ac tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:00.796418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a587c-876a-4e3e-ba2f-3eab02a16ffc tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d589a121ed34503be57d01e0038f144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '428f636169634315aa9b06cf709e8d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:00.797053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a587c-876a-4e3e-ba2f-3eab02a16ffc tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:00.797332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a587c-876a-4e3e-ba2f-3eab02a16ffc tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:00.797610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a587c-876a-4e3e-ba2f-3eab02a16ffc tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:00.830284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a587c-876a-4e3e-ba2f-3eab02a16ffc tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:00.841268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a587c-876a-4e3e-ba2f-3eab02a16ffc tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:00.883564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3aeee-fee1-4fa8-b857-81adc25d3728 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:00.884988 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2992/6009] 10.222.0.23 () {56 vars in 1263 bytes} [Sun Oct 2 01:29:00 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 01:29:00.901219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3aeee-fee1-4fa8-b857-81adc25d3728 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:00.912429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb548a-1ae5-42da-8be1-a7f316dd083e tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d589a121ed34503be57d01e0038f144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '428f636169634315aa9b06cf709e8d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:00.913427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb548a-1ae5-42da-8be1-a7f316dd083e tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:00.913870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb548a-1ae5-42da-8be1-a7f316dd083e tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:00.914294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb548a-1ae5-42da-8be1-a7f316dd083e tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:00.929835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb548a-1ae5-42da-8be1-a7f316dd083e tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:00.933771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb548a-1ae5-42da-8be1-a7f316dd083e tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:00.976845 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3018/6010] 10.222.0.23 () {56 vars in 1266 bytes} [Sun Oct 2 01:29:00 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:00.982989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a587c-876a-4e3e-ba2f-3eab02a16ffc tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:01.010481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a587c-876a-4e3e-ba2f-3eab02a16ffc tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:01.031974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f211c7e-1ea3-42d4-b263-b9fdc18eb940 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d589a121ed34503be57d01e0038f144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '428f636169634315aa9b06cf709e8d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:01.032619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f211c7e-1ea3-42d4-b263-b9fdc18eb940 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:01.032892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f211c7e-1ea3-42d4-b263-b9fdc18eb940 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:01.033337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f211c7e-1ea3-42d4-b263-b9fdc18eb940 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:01.035671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f211c7e-1ea3-42d4-b263-b9fdc18eb940 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-9f211c7e-1ea3-42d4-b263-b9fdc18eb940 tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 02 01:29:01.061610 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 02 01:29:01.062947 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 02 01:29:01.064166 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:01.064166 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:01.064166 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 02 01:29:01.064166 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 02 01:29:01.064166 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 02 01:29:01.064166 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:01.067407 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2993/6011] 10.222.0.23 () {56 vars in 1263 bytes} [Sun Oct 2 01:29:00 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 01:29:01.072525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb548a-1ae5-42da-8be1-a7f316dd083e tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:01.192318 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:01.326378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb548a-1ae5-42da-8be1-a7f316dd083e tempest-TokensV3Test-2059362178 tempest-TokensV3Test-2059362178-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:01.337573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:01.338440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:01.338548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:01.338799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] PATH_INFO: `/v3/users/6d589a121ed34503be57d01e0038f144` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:01.342434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d589a121ed34503be57d01e0038f144)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:01.348093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:01.540960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d589a121ed34503be57d01e0038f144'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:01.591876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d589a121ed34503be57d01e0038f144'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:01.598493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d589a121ed34503be57d01e0038f144'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:01.622262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d589a121ed34503be57d01e0038f144'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:01.623223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d589a121ed34503be57d01e0038f144'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:01.729906 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3019/6012] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:01 2022] DELETE /identity/v3/users/6d589a121ed34503be57d01e0038f144 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:01.734885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe485f-51e0-4565-ab9e-5ac69c6c8b20 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:01.735874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe485f-51e0-4565-ab9e-5ac69c6c8b20 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:01.736364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe485f-51e0-4565-ab9e-5ac69c6c8b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:01.802057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-14fe485f-51e0-4565-ab9e-5ac69c6c8b20 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:01.803964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-14fe485f-51e0-4565-ab9e-5ac69c6c8b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:02.109226 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2994/6013] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:02.147357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:02.154361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:02.330493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8475f1-92e1-49b7-bbeb-8ad2ddbfec58 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:02.362947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25513a-60af-4343-affe-28c8c7383f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:02.364223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25513a-60af-4343-affe-28c8c7383f2e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:02.369196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25513a-60af-4343-affe-28c8c7383f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:02.369761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25513a-60af-4343-affe-28c8c7383f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:02.414541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25513a-60af-4343-affe-28c8c7383f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:02.416277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25513a-60af-4343-affe-28c8c7383f2e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:02.445418 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3020/6014] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:29:04.084727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe485f-51e0-4565-ab9e-5ac69c6c8b20 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:04.087211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-14fe485f-51e0-4565-ab9e-5ac69c6c8b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:04.123785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe485f-51e0-4565-ab9e-5ac69c6c8b20 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:04.136114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:04.138213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:04.138570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:04.140268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] PATH_INFO: `/v3/projects/428f636169634315aa9b06cf709e8d2a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:04.141613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=428f636169634315aa9b06cf709e8d2a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:04.145342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:04.184705 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:04.295125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '428f636169634315aa9b06cf709e8d2a', 'request_id': 'req-57717626-0242-4dd5-b418-0200d965a293'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:04.314821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '428f636169634315aa9b06cf709e8d2a', 'request_id': 'req-57717626-0242-4dd5-b418-0200d965a293'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:04.335418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '428f636169634315aa9b06cf709e8d2a', 'request_id': 'req-57717626-0242-4dd5-b418-0200d965a293'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:04.366040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] The token cache is being invalidate because project 428f636169634315aa9b06cf709e8d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:04.366693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:04.367548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57717626-0242-4dd5-b418-0200d965a293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:04.369258 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2995/6015] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:04 2022] DELETE /identity/v3/projects/428f636169634315aa9b06cf709e8d2a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:04.376433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5d156-a9b1-46b3-9120-2f207d34e71d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:04.376978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5d156-a9b1-46b3-9120-2f207d34e71d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:04.376978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5d156-a9b1-46b3-9120-2f207d34e71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:04.454144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1ec5d156-a9b1-46b3-9120-2f207d34e71d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:04.457521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1ec5d156-a9b1-46b3-9120-2f207d34e71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:04.638248 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:04.702642 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3021/6016] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:04.710157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1c43c-27e5-4177-913c-8bf01ba714a5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:04.710747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1c43c-27e5-4177-913c-8bf01ba714a5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:04.711183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1c43c-27e5-4177-913c-8bf01ba714a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:04.784466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a6d1c43c-27e5-4177-913c-8bf01ba714a5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:04.785679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a6d1c43c-27e5-4177-913c-8bf01ba714a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:04.811163 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2996/6017] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:29:04.815127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5d156-a9b1-46b3-9120-2f207d34e71d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:04.831116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5d156-a9b1-46b3-9120-2f207d34e71d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:04.853286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b85d9b-8748-426a-8ad1-4f9380d37361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:04.854171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85d9b-8748-426a-8ad1-4f9380d37361 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:04.854457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85d9b-8748-426a-8ad1-4f9380d37361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:04.865329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85d9b-8748-426a-8ad1-4f9380d37361 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:04.866068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b85d9b-8748-426a-8ad1-4f9380d37361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:04.866379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b85d9b-8748-426a-8ad1-4f9380d37361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:04.868056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b85d9b-8748-426a-8ad1-4f9380d37361 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:04.918038 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3022/6018] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:04.923064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1c43c-27e5-4177-913c-8bf01ba714a5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:04.938653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1c43c-27e5-4177-913c-8bf01ba714a5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:04.962946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e581c-044d-429d-bcf1-c76dcce5e4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:04.963735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e581c-044d-429d-bcf1-c76dcce5e4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:04.964133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e581c-044d-429d-bcf1-c76dcce5e4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:04.964523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e581c-044d-429d-bcf1-c76dcce5e4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:04.966459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e581c-044d-429d-bcf1-c76dcce5e4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:04.969197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e581c-044d-429d-bcf1-c76dcce5e4b8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:05.071199 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2997/6019] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:04 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:05.075604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b85d9b-8748-426a-8ad1-4f9380d37361 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:05.088975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b85d9b-8748-426a-8ad1-4f9380d37361 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:05.298287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe63cd-4796-429e-95e4-ae76270f0514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:05.302064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe63cd-4796-429e-95e4-ae76270f0514 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:05.302557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe63cd-4796-429e-95e4-ae76270f0514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:05.303337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe63cd-4796-429e-95e4-ae76270f0514 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:05.303990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe63cd-4796-429e-95e4-ae76270f0514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:05.320543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe63cd-4796-429e-95e4-ae76270f0514 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:05.391836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e581c-044d-429d-bcf1-c76dcce5e4b8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:05.393927 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3023/6020] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:05 2022] POST /identity/v3/users => generated 295 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:05.420105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e581c-044d-429d-bcf1-c76dcce5e4b8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:05.435604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88a005-bae7-4543-96a0-1aca71aa41dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:05.436665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88a005-bae7-4543-96a0-1aca71aa41dc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:05.437171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88a005-bae7-4543-96a0-1aca71aa41dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:05.437688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88a005-bae7-4543-96a0-1aca71aa41dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:05.438564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88a005-bae7-4543-96a0-1aca71aa41dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:05.443439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88a005-bae7-4543-96a0-1aca71aa41dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:05.512502 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2998/6021] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:05.516713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe63cd-4796-429e-95e4-ae76270f0514 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:05.536787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe63cd-4796-429e-95e4-ae76270f0514 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:05.555719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e3162-c3a8-44cc-978d-16356e5398c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:05.557793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e3162-c3a8-44cc-978d-16356e5398c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:05.558238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e3162-c3a8-44cc-978d-16356e5398c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:05.559491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e3162-c3a8-44cc-978d-16356e5398c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:05.560443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e3162-c3a8-44cc-978d-16356e5398c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:05.566928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e3162-c3a8-44cc-978d-16356e5398c3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:05.602130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88a005-bae7-4543-96a0-1aca71aa41dc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:05.602417 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3024/6022] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:05.630424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88a005-bae7-4543-96a0-1aca71aa41dc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:05.681454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298924b-d630-4ae9-8a9a-a6d4dae2af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:05.688677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298924b-d630-4ae9-8a9a-a6d4dae2af90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:05.688677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298924b-d630-4ae9-8a9a-a6d4dae2af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:05.688677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298924b-d630-4ae9-8a9a-a6d4dae2af90 admin admin] PATH_INFO: `/v3/projects/e4d292f1c592430b9c9e9d8fb5f4988c/users/afe75b9924ce40d38e2b325c3553c639/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:05.792421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298924b-d630-4ae9-8a9a-a6d4dae2af90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d292f1c592430b9c9e9d8fb5f4988c, user_id=afe75b9924ce40d38e2b325c3553c639, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:05.796539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298924b-d630-4ae9-8a9a-a6d4dae2af90 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:05.844306 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2999/6023] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:05 2022] PUT /identity/v3/projects/e4d292f1c592430b9c9e9d8fb5f4988c/users/afe75b9924ce40d38e2b325c3553c639/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:05.961996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cb517-5985-4413-9f8b-6132fc27555f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:05.962745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cb517-5985-4413-9f8b-6132fc27555f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:05.963171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cb517-5985-4413-9f8b-6132fc27555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:06.072622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c90cb517-5985-4413-9f8b-6132fc27555f None None] MFA Rules not processed for user `afe75b9924ce40d38e2b325c3553c639`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:06.078952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c90cb517-5985-4413-9f8b-6132fc27555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:06.285228 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3025/6024] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:06.307786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298924b-d630-4ae9-8a9a-a6d4dae2af90 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:06.310728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9298924b-d630-4ae9-8a9a-a6d4dae2af90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:06.499149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298924b-d630-4ae9-8a9a-a6d4dae2af90 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:06.506037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f10c5-c06c-4627-b48f-d667fa26efbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:06.506693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f10c5-c06c-4627-b48f-d667fa26efbc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:06.506972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f10c5-c06c-4627-b48f-d667fa26efbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:06.507248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f10c5-c06c-4627-b48f-d667fa26efbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:06.529537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f10c5-c06c-4627-b48f-d667fa26efbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:06.531043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f10c5-c06c-4627-b48f-d667fa26efbc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:06.550332 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3000/6025] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:06.591004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cb517-5985-4413-9f8b-6132fc27555f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:06.795926 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:06.857377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cb517-5985-4413-9f8b-6132fc27555f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:06.879783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:06.880454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:06.880736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:06.881013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] PATH_INFO: `/v3/users/afe75b9924ce40d38e2b325c3553c639` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:06.882259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe75b9924ce40d38e2b325c3553c639)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:06.887298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:07.076640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe75b9924ce40d38e2b325c3553c639'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:07.133686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe75b9924ce40d38e2b325c3553c639'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:07.135796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe75b9924ce40d38e2b325c3553c639'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:07.161746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe75b9924ce40d38e2b325c3553c639'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:07.163952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe75b9924ce40d38e2b325c3553c639'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:07.244557 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3026/6026] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:06 2022] DELETE /identity/v3/users/afe75b9924ce40d38e2b325c3553c639 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:07.255913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59afd9b-89e2-40db-8151-98210d9b7944 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:07.255913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59afd9b-89e2-40db-8151-98210d9b7944 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:07.255913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59afd9b-89e2-40db-8151-98210d9b7944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:07.347533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e59afd9b-89e2-40db-8151-98210d9b7944 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:07.349628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e59afd9b-89e2-40db-8151-98210d9b7944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:07.478808 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:07.535815 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3001/6027] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:07.559940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:07.561981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:07.737196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63bcfd-c77b-45c1-8222-fbc266384c2d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:07.751525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae2c1b-310b-4fb0-b64f-a3426bebadce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:07.752364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae2c1b-310b-4fb0-b64f-a3426bebadce service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:07.752883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae2c1b-310b-4fb0-b64f-a3426bebadce service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:07.753160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae2c1b-310b-4fb0-b64f-a3426bebadce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:07.783776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae2c1b-310b-4fb0-b64f-a3426bebadce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:07.796572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae2c1b-310b-4fb0-b64f-a3426bebadce service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:07.805946 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3027/6028] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:08.619886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59afd9b-89e2-40db-8151-98210d9b7944 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:08.623801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e59afd9b-89e2-40db-8151-98210d9b7944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:08.704952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59afd9b-89e2-40db-8151-98210d9b7944 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:08.720843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:08.721626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:08.721977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:08.722317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] PATH_INFO: `/v3/projects/e4d292f1c592430b9c9e9d8fb5f4988c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:08.732551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d292f1c592430b9c9e9d8fb5f4988c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:08.736414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:08.847137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d292f1c592430b9c9e9d8fb5f4988c', 'request_id': 'req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:08.874514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d292f1c592430b9c9e9d8fb5f4988c', 'request_id': 'req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:08.915307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d292f1c592430b9c9e9d8fb5f4988c', 'request_id': 'req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:08.953640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] The token cache is being invalidate because project e4d292f1c592430b9c9e9d8fb5f4988c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:08.953945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:08.954856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3a8c52e-305d-49aa-8df6-6758b20bc1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:08.961721 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3002/6029] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:08 2022] DELETE /identity/v3/projects/e4d292f1c592430b9c9e9d8fb5f4988c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:08.974849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053d36c-dc32-46c7-a6d9-8709d3a03cc7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:08.975439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053d36c-dc32-46c7-a6d9-8709d3a03cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:08.975853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053d36c-dc32-46c7-a6d9-8709d3a03cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:09.120346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b053d36c-dc32-46c7-a6d9-8709d3a03cc7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:09.125023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b053d36c-dc32-46c7-a6d9-8709d3a03cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:09.414369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e53d5-6f54-4d5c-b520-24ffa9f476cf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:09.414698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e53d5-6f54-4d5c-b520-24ffa9f476cf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:09.414974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e53d5-6f54-4d5c-b520-24ffa9f476cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:09.415783 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3028/6030] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:09.467031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2a4e53d5-6f54-4d5c-b520-24ffa9f476cf None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:09.468311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a4e53d5-6f54-4d5c-b520-24ffa9f476cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:09.485783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053d36c-dc32-46c7-a6d9-8709d3a03cc7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:09.487779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b053d36c-dc32-46c7-a6d9-8709d3a03cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:09.520964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053d36c-dc32-46c7-a6d9-8709d3a03cc7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:09.523092 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3003/6031] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:09.532415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e53d5-6f54-4d5c-b520-24ffa9f476cf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:09.548865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e506c80-9c5e-4fd1-9666-2e67a473d914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:09.550257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e506c80-9c5e-4fd1-9666-2e67a473d914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:09.550544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e506c80-9c5e-4fd1-9666-2e67a473d914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:09.550851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e506c80-9c5e-4fd1-9666-2e67a473d914 admin admin] PATH_INFO: `/v3/users/851539b28b7f4571bc4388ac1c57d2f0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:09.561108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e506c80-9c5e-4fd1-9666-2e67a473d914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851539b28b7f4571bc4388ac1c57d2f0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:09.563201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e506c80-9c5e-4fd1-9666-2e67a473d914 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:09.572407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e53d5-6f54-4d5c-b520-24ffa9f476cf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:09.577541 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:09.588278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ca72b-0fd2-4684-9a4c-b8f54f060bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:09.591385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ca72b-0fd2-4684-9a4c-b8f54f060bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:09.595291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ca72b-0fd2-4684-9a4c-b8f54f060bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:09.595576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ca72b-0fd2-4684-9a4c-b8f54f060bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:09.602927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ca72b-0fd2-4684-9a4c-b8f54f060bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:09.603248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ca72b-0fd2-4684-9a4c-b8f54f060bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:09.608529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ca72b-0fd2-4684-9a4c-b8f54f060bf9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:09.657063 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3004/6032] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:09.658773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ca72b-0fd2-4684-9a4c-b8f54f060bf9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:09.708008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ca72b-0fd2-4684-9a4c-b8f54f060bf9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:09.729590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6e491-a77b-4bb2-8146-9ee8f6f7c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:09.731023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6e491-a77b-4bb2-8146-9ee8f6f7c3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:09.731817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6e491-a77b-4bb2-8146-9ee8f6f7c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:09.732202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6e491-a77b-4bb2-8146-9ee8f6f7c3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:09.736889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6e491-a77b-4bb2-8146-9ee8f6f7c3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:09.739200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6e491-a77b-4bb2-8146-9ee8f6f7c3b8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:09.748487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e506c80-9c5e-4fd1-9666-2e67a473d914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851539b28b7f4571bc4388ac1c57d2f0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:09.788485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e506c80-9c5e-4fd1-9666-2e67a473d914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851539b28b7f4571bc4388ac1c57d2f0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:09.789400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e506c80-9c5e-4fd1-9666-2e67a473d914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851539b28b7f4571bc4388ac1c57d2f0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:09.813811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e506c80-9c5e-4fd1-9666-2e67a473d914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851539b28b7f4571bc4388ac1c57d2f0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:09.814802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e506c80-9c5e-4fd1-9666-2e67a473d914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851539b28b7f4571bc4388ac1c57d2f0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:09.882696 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3005/6033] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:09 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:09.883680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6e491-a77b-4bb2-8146-9ee8f6f7c3b8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:09.891920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-97e6e491-a77b-4bb2-8146-9ee8f6f7c3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:09.905197 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3029/6034] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:09 2022] DELETE /identity/v3/users/851539b28b7f4571bc4388ac1c57d2f0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:29:09.910709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0600be-664f-4bc3-b733-1842a30513e8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:09.911384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0600be-664f-4bc3-b733-1842a30513e8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:09.911864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0600be-664f-4bc3-b733-1842a30513e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:09.977256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bb0600be-664f-4bc3-b733-1842a30513e8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:09.997046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bb0600be-664f-4bc3-b733-1842a30513e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:10.199319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6e491-a77b-4bb2-8146-9ee8f6f7c3b8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:10.213342 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3030/6035] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:10.218593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2395e-37f7-4f2e-bfb4-2b8663eb6d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:10.219288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2395e-37f7-4f2e-bfb4-2b8663eb6d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:10.219747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2395e-37f7-4f2e-bfb4-2b8663eb6d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:10.220034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2395e-37f7-4f2e-bfb4-2b8663eb6d33 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:10.220683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2395e-37f7-4f2e-bfb4-2b8663eb6d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:10.267674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2395e-37f7-4f2e-bfb4-2b8663eb6d33 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:10.335901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0600be-664f-4bc3-b733-1842a30513e8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:10.337813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bb0600be-664f-4bc3-b733-1842a30513e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:10.407832 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3006/6036] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:09 2022] POST /identity/v3/users => generated 289 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:10.413610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2395e-37f7-4f2e-bfb4-2b8663eb6d33 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:10.437160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2395e-37f7-4f2e-bfb4-2b8663eb6d33 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:10.459018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68b29b-c114-4799-92ee-20e55af3d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:10.459653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68b29b-c114-4799-92ee-20e55af3d589 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:10.459937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68b29b-c114-4799-92ee-20e55af3d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:10.460340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68b29b-c114-4799-92ee-20e55af3d589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:10.460857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68b29b-c114-4799-92ee-20e55af3d589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:10.462493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68b29b-c114-4799-92ee-20e55af3d589 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:10.476526 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:10.493850 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3007/6037] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:29:10.498255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68b29b-c114-4799-92ee-20e55af3d589 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:10.514759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68b29b-c114-4799-92ee-20e55af3d589 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:10.524439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36361fc4-cec9-40d8-8661-cb25464cb808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:10.525354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36361fc4-cec9-40d8-8661-cb25464cb808 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:10.525645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36361fc4-cec9-40d8-8661-cb25464cb808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:10.526315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36361fc4-cec9-40d8-8661-cb25464cb808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:10.527660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36361fc4-cec9-40d8-8661-cb25464cb808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:10.531562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36361fc4-cec9-40d8-8661-cb25464cb808 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:10.564709 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3008/6038] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:29:10.568624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36361fc4-cec9-40d8-8661-cb25464cb808 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:10.584963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36361fc4-cec9-40d8-8661-cb25464cb808 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:10.600350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdcede-50f2-4f94-a4c9-821e5bc67b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:10.600866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdcede-50f2-4f94-a4c9-821e5bc67b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:10.601315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdcede-50f2-4f94-a4c9-821e5bc67b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:10.601594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdcede-50f2-4f94-a4c9-821e5bc67b83 admin admin] PATH_INFO: `/v3/projects/06c2a06a5ea340d09371c77a8e38591e/users/8592200c5eab4e7b83ece4622390b5af/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:10.611395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0600be-664f-4bc3-b733-1842a30513e8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:10.639688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdcede-50f2-4f94-a4c9-821e5bc67b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c2a06a5ea340d09371c77a8e38591e, user_id=8592200c5eab4e7b83ece4622390b5af, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:10.645151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdcede-50f2-4f94-a4c9-821e5bc67b83 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:10.648661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2a36c-72e8-4efc-adcc-ade759af8ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:10.662369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2a36c-72e8-4efc-adcc-ade759af8ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:10.662828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2a36c-72e8-4efc-adcc-ade759af8ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:10.680740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2a36c-72e8-4efc-adcc-ade759af8ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:10.685011 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3009/6039] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:10 2022] PUT /identity/v3/projects/06c2a06a5ea340d09371c77a8e38591e/users/8592200c5eab4e7b83ece4622390b5af/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:29:10.699730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a6290-657d-4da3-86ff-0f0ed636f3ae None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:10.700543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a6290-657d-4da3-86ff-0f0ed636f3ae None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:10.701001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a6290-657d-4da3-86ff-0f0ed636f3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:10.725042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2a36c-72e8-4efc-adcc-ade759af8ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:10.737197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2a36c-72e8-4efc-adcc-ade759af8ed7 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:10.773593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-885a6290-657d-4da3-86ff-0f0ed636f3ae None None] MFA Rules not processed for user `8592200c5eab4e7b83ece4622390b5af`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:10.775061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-885a6290-657d-4da3-86ff-0f0ed636f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:10.794114 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3031/6040] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:29:10.947860 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3010/6041] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:29:11.069553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2a36c-72e8-4efc-adcc-ade759af8ed7 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:11.088944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2a36c-72e8-4efc-adcc-ade759af8ed7 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:11.114482 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:11.260265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ed770-09e7-47ae-8bb3-a8d66790c239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:11.261141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ed770-09e7-47ae-8bb3-a8d66790c239 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:11.263467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ed770-09e7-47ae-8bb3-a8d66790c239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:11.263907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ed770-09e7-47ae-8bb3-a8d66790c239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:11.301296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ed770-09e7-47ae-8bb3-a8d66790c239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:11.307169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ed770-09e7-47ae-8bb3-a8d66790c239 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:11.332281 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3032/6042] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:29:12.003997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a6290-657d-4da3-86ff-0f0ed636f3ae None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:12.006352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-885a6290-657d-4da3-86ff-0f0ed636f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:12.231247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a6290-657d-4da3-86ff-0f0ed636f3ae None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:12.279219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:12.283710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:12.283997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:12.284279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] PATH_INFO: `/v3/projects/eadebca1e5e9421c837c5a34549af52b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:12.301952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadebca1e5e9421c837c5a34549af52b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:12.303966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:12.467440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadebca1e5e9421c837c5a34549af52b', 'request_id': 'req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:12.478960 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:12.484724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadebca1e5e9421c837c5a34549af52b', 'request_id': 'req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:12.494928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadebca1e5e9421c837c5a34549af52b', 'request_id': 'req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:12.541406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] The token cache is being invalidate because project eadebca1e5e9421c837c5a34549af52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:12.541716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:12.542582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c4ff3ed1-6897-4c90-bd6f-02b5a6d595ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:12.558092 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3011/6043] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:12 2022] DELETE /identity/v3/projects/eadebca1e5e9421c837c5a34549af52b => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:12.560869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f7e9a-e0cd-414a-8efb-57d2d3363eaf None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:12.562052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f7e9a-e0cd-414a-8efb-57d2d3363eaf None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:12.562503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f7e9a-e0cd-414a-8efb-57d2d3363eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:12.615943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c06f7e9a-e0cd-414a-8efb-57d2d3363eaf None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:12.617731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c06f7e9a-e0cd-414a-8efb-57d2d3363eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:12.826056 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3033/6044] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:12.827503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76307beb-51b6-4375-ae5e-92bb7dcad4e1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:12.828005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76307beb-51b6-4375-ae5e-92bb7dcad4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:12.828284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76307beb-51b6-4375-ae5e-92bb7dcad4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:12.862514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-76307beb-51b6-4375-ae5e-92bb7dcad4e1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:12.864039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-76307beb-51b6-4375-ae5e-92bb7dcad4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:12.894735 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3012/6045] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:12.899878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f7e9a-e0cd-414a-8efb-57d2d3363eaf None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:12.918820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f7e9a-e0cd-414a-8efb-57d2d3363eaf None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:12.938108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57890bf-2bb4-4ed6-ae19-c6730241197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:12.939025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57890bf-2bb4-4ed6-ae19-c6730241197d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:12.939478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57890bf-2bb4-4ed6-ae19-c6730241197d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:12.940149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57890bf-2bb4-4ed6-ae19-c6730241197d admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:12.940975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57890bf-2bb4-4ed6-ae19-c6730241197d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:12.941719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57890bf-2bb4-4ed6-ae19-c6730241197d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:12.956535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57890bf-2bb4-4ed6-ae19-c6730241197d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:13.053099 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3034/6046] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:13.054851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76307beb-51b6-4375-ae5e-92bb7dcad4e1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:13.120068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76307beb-51b6-4375-ae5e-92bb7dcad4e1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:13.160216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e5a4a-164b-43fd-b12f-e8d928d2e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:13.162479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e5a4a-164b-43fd-b12f-e8d928d2e05f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:13.162797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e5a4a-164b-43fd-b12f-e8d928d2e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:13.163140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e5a4a-164b-43fd-b12f-e8d928d2e05f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:13.163817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e5a4a-164b-43fd-b12f-e8d928d2e05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:13.165815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e5a4a-164b-43fd-b12f-e8d928d2e05f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:13.260587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57890bf-2bb4-4ed6-ae19-c6730241197d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:13.268611 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3013/6047] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:13 2022] POST /identity/v3/projects => generated 359 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:13.273120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57890bf-2bb4-4ed6-ae19-c6730241197d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:13.482285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82effc3-114e-4d2d-aefe-371fb88624b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:13.483258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82effc3-114e-4d2d-aefe-371fb88624b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:13.483804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82effc3-114e-4d2d-aefe-371fb88624b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:13.483804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82effc3-114e-4d2d-aefe-371fb88624b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:13.484578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82effc3-114e-4d2d-aefe-371fb88624b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:13.487202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82effc3-114e-4d2d-aefe-371fb88624b5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:13.563998 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3035/6048] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:13 2022] POST /identity/v3/users => generated 280 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:29:13.572192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e5a4a-164b-43fd-b12f-e8d928d2e05f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:13.593618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e5a4a-164b-43fd-b12f-e8d928d2e05f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:13.613145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fd909-d3cb-4366-8f67-0743c17e2ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:13.616850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fd909-d3cb-4366-8f67-0743c17e2ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:13.617491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fd909-d3cb-4366-8f67-0743c17e2ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:13.617979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fd909-d3cb-4366-8f67-0743c17e2ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:13.618931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fd909-d3cb-4366-8f67-0743c17e2ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:13.622513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fd909-d3cb-4366-8f67-0743c17e2ac1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:13.664031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82effc3-114e-4d2d-aefe-371fb88624b5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:13.688342 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3014/6049] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:13.708823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82effc3-114e-4d2d-aefe-371fb88624b5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:13.721340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793a348-8894-4285-9348-259a3f365b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:13.722377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793a348-8894-4285-9348-259a3f365b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:13.722987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793a348-8894-4285-9348-259a3f365b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:13.724624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793a348-8894-4285-9348-259a3f365b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:13.726438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793a348-8894-4285-9348-259a3f365b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:13.729788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793a348-8894-4285-9348-259a3f365b31 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:13.767039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fd909-d3cb-4366-8f67-0743c17e2ac1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:13.768924 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3036/6050] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:13.784679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fd909-d3cb-4366-8f67-0743c17e2ac1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:13.800252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6d445-fb3b-4702-af2f-6c657984bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:13.801162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d445-fb3b-4702-af2f-6c657984bc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:13.801566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d445-fb3b-4702-af2f-6c657984bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:13.801927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d445-fb3b-4702-af2f-6c657984bc0d admin admin] PATH_INFO: `/v3/projects/32001c34294243eb94f1c97e4de7aedb/users/723db45d54c949fcbdfb1d221f573ccb/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:13.841164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6d445-fb3b-4702-af2f-6c657984bc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32001c34294243eb94f1c97e4de7aedb, user_id=723db45d54c949fcbdfb1d221f573ccb, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:13.844468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6d445-fb3b-4702-af2f-6c657984bc0d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:13.876691 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3015/6051] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:13 2022] PUT /identity/v3/projects/32001c34294243eb94f1c97e4de7aedb/users/723db45d54c949fcbdfb1d221f573ccb/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:29:13.888523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69d374-c803-40ad-b9cb-69fd660443af None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:13.889176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69d374-c803-40ad-b9cb-69fd660443af None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:13.889675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69d374-c803-40ad-b9cb-69fd660443af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:13.997946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ac69d374-c803-40ad-b9cb-69fd660443af None None] MFA Rules not processed for user `723db45d54c949fcbdfb1d221f573ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:14.002464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ac69d374-c803-40ad-b9cb-69fd660443af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:14.054442 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:14.269235 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3037/6052] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:14.360113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6d445-fb3b-4702-af2f-6c657984bc0d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:14.362580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8cd6d445-fb3b-4702-af2f-6c657984bc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:14.510385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6d445-fb3b-4702-af2f-6c657984bc0d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:14.525975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c797764-be03-421b-8c06-7cedd6f9228b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:14.527011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797764-be03-421b-8c06-7cedd6f9228b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:14.528268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797764-be03-421b-8c06-7cedd6f9228b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:14.528758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797764-be03-421b-8c06-7cedd6f9228b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:14.545716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c797764-be03-421b-8c06-7cedd6f9228b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:14.547569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c797764-be03-421b-8c06-7cedd6f9228b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:14.604518 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3016/6053] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:15.096682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69d374-c803-40ad-b9cb-69fd660443af None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:15.104555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ac69d374-c803-40ad-b9cb-69fd660443af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:15.267370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69d374-c803-40ad-b9cb-69fd660443af None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:15.283634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63fc70-f64c-4d33-b823-45ee8a4d7205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:15.284841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63fc70-f64c-4d33-b823-45ee8a4d7205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:15.286796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63fc70-f64c-4d33-b823-45ee8a4d7205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:15.287321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63fc70-f64c-4d33-b823-45ee8a4d7205 admin admin] PATH_INFO: `/v3/users/a003e4392e9c4aa587573cb1dfa605e0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:15.291429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63fc70-f64c-4d33-b823-45ee8a4d7205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a003e4392e9c4aa587573cb1dfa605e0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:15.298778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63fc70-f64c-4d33-b823-45ee8a4d7205 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:15.409895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a63fc70-f64c-4d33-b823-45ee8a4d7205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a003e4392e9c4aa587573cb1dfa605e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:15.441387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a63fc70-f64c-4d33-b823-45ee8a4d7205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a003e4392e9c4aa587573cb1dfa605e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:15.442042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a63fc70-f64c-4d33-b823-45ee8a4d7205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a003e4392e9c4aa587573cb1dfa605e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:15.462509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a63fc70-f64c-4d33-b823-45ee8a4d7205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a003e4392e9c4aa587573cb1dfa605e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:15.463357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a63fc70-f64c-4d33-b823-45ee8a4d7205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a003e4392e9c4aa587573cb1dfa605e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:15.492085 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3038/6054] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:15 2022] DELETE /identity/v3/users/a003e4392e9c4aa587573cb1dfa605e0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:16.142657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c797764-be03-421b-8c06-7cedd6f9228b service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:16.170463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c797764-be03-421b-8c06-7cedd6f9228b service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:16.461650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:16.464036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:16.466772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:16.467201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] PATH_INFO: `/v3/projects/ca7d49167f014e31841f231f94b43e60` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:16.471397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca7d49167f014e31841f231f94b43e60)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:16.473518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:16.623208 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:16.705120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca7d49167f014e31841f231f94b43e60', 'request_id': 'req-55192dfe-652b-40bf-b32a-22ddf4217e63'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:16.757211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca7d49167f014e31841f231f94b43e60', 'request_id': 'req-55192dfe-652b-40bf-b32a-22ddf4217e63'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:16.787771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca7d49167f014e31841f231f94b43e60', 'request_id': 'req-55192dfe-652b-40bf-b32a-22ddf4217e63'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:16.853901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] The token cache is being invalidate because project ca7d49167f014e31841f231f94b43e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:16.856842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:16.869289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55192dfe-652b-40bf-b32a-22ddf4217e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:16.873591 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3017/6055] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:16 2022] DELETE /identity/v3/projects/ca7d49167f014e31841f231f94b43e60 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:16.880775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384c3e-41d1-4d7b-adfa-af57bc94fa40 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:16.881356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384c3e-41d1-4d7b-adfa-af57bc94fa40 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:16.881356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384c3e-41d1-4d7b-adfa-af57bc94fa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:16.980365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7c384c3e-41d1-4d7b-adfa-af57bc94fa40 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:16.981836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7c384c3e-41d1-4d7b-adfa-af57bc94fa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:17.135372 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:17.243812 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3039/6056] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:17.247304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a40a-7df7-4199-af4c-7ab2ff5b8b6a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:17.248150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a40a-7df7-4199-af4c-7ab2ff5b8b6a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:17.248580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a40a-7df7-4199-af4c-7ab2ff5b8b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:17.278793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b0a1a40a-7df7-4199-af4c-7ab2ff5b8b6a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:17.280601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b0a1a40a-7df7-4199-af4c-7ab2ff5b8b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:17.320310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c384c3e-41d1-4d7b-adfa-af57bc94fa40 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:17.321114 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3018/6057] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:17.379319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c384c3e-41d1-4d7b-adfa-af57bc94fa40 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:17.384631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cd819-49d4-4860-bc1a-b8e8879ac6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:17.385237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd819-49d4-4860-bc1a-b8e8879ac6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:17.385577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd819-49d4-4860-bc1a-b8e8879ac6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:17.385797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd819-49d4-4860-bc1a-b8e8879ac6d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:17.387235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cd819-49d4-4860-bc1a-b8e8879ac6d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:17.387479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cd819-49d4-4860-bc1a-b8e8879ac6d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:17.388989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cd819-49d4-4860-bc1a-b8e8879ac6d2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:17.409909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1a40a-7df7-4199-af4c-7ab2ff5b8b6a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:17.424675 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3040/6058] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:17.426134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1a40a-7df7-4199-af4c-7ab2ff5b8b6a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:17.437486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b6e1f-89a8-439c-a247-624533474397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:17.438244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b6e1f-89a8-439c-a247-624533474397 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:17.438634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b6e1f-89a8-439c-a247-624533474397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:17.439183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b6e1f-89a8-439c-a247-624533474397 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:17.440027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b6e1f-89a8-439c-a247-624533474397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:17.442800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b6e1f-89a8-439c-a247-624533474397 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:17.491860 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3019/6059] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:17 2022] POST /identity/v3/projects => generated 363 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:17.492022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cd819-49d4-4860-bc1a-b8e8879ac6d2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:17.511585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cd819-49d4-4860-bc1a-b8e8879ac6d2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:17.759139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45814a-cab7-4775-bcfc-b47a39f6194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:17.760509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45814a-cab7-4775-bcfc-b47a39f6194e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:17.760828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45814a-cab7-4775-bcfc-b47a39f6194e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:17.761157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45814a-cab7-4775-bcfc-b47a39f6194e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:17.762921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45814a-cab7-4775-bcfc-b47a39f6194e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:17.765255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45814a-cab7-4775-bcfc-b47a39f6194e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:17.847366 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3041/6060] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:17 2022] POST /identity/v3/users => generated 282 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:17.851272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b6e1f-89a8-439c-a247-624533474397 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:17.867890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b6e1f-89a8-439c-a247-624533474397 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:17.889105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558feef-4e46-40da-85da-bf276ccda595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:17.889779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558feef-4e46-40da-85da-bf276ccda595 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:17.890119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558feef-4e46-40da-85da-bf276ccda595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:17.890426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558feef-4e46-40da-85da-bf276ccda595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:17.891188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558feef-4e46-40da-85da-bf276ccda595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:17.892945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558feef-4e46-40da-85da-bf276ccda595 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:17.962692 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3020/6061] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:17.967466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45814a-cab7-4775-bcfc-b47a39f6194e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:17.981143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45814a-cab7-4775-bcfc-b47a39f6194e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:17.998018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c5187-6c62-4a0c-9ea0-76afe7a71509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:17.998706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5187-6c62-4a0c-9ea0-76afe7a71509 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:18.000270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5187-6c62-4a0c-9ea0-76afe7a71509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:18.000564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5187-6c62-4a0c-9ea0-76afe7a71509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:18.001228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c5187-6c62-4a0c-9ea0-76afe7a71509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:18.002869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c5187-6c62-4a0c-9ea0-76afe7a71509 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:18.049961 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3042/6062] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:18.053442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558feef-4e46-40da-85da-bf276ccda595 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:18.073100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558feef-4e46-40da-85da-bf276ccda595 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:18.092807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b48c-e64a-4441-963d-65d07ecde9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:18.093659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b48c-e64a-4441-963d-65d07ecde9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:18.093972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b48c-e64a-4441-963d-65d07ecde9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:18.094254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b48c-e64a-4441-963d-65d07ecde9c9 admin admin] PATH_INFO: `/v3/projects/662fabe024d34a819ffa5ea13a8c6d65/users/a36aa40c466343dd934de568a5f29e5b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:18.149117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462b48c-e64a-4441-963d-65d07ecde9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662fabe024d34a819ffa5ea13a8c6d65, user_id=a36aa40c466343dd934de568a5f29e5b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:18.156027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462b48c-e64a-4441-963d-65d07ecde9c9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:18.195251 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3021/6063] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:18 2022] PUT /identity/v3/projects/662fabe024d34a819ffa5ea13a8c6d65/users/a36aa40c466343dd934de568a5f29e5b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:18.207004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7fa4-a5b0-4a48-a0fd-41c7ce672660 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:18.207105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7fa4-a5b0-4a48-a0fd-41c7ce672660 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:18.207400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7fa4-a5b0-4a48-a0fd-41c7ce672660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:18.231940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b48c-e64a-4441-963d-65d07ecde9c9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:18.235376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2462b48c-e64a-4441-963d-65d07ecde9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:18.270634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4e7d7fa4-a5b0-4a48-a0fd-41c7ce672660 None None] MFA Rules not processed for user `a36aa40c466343dd934de568a5f29e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:18.271877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4e7d7fa4-a5b0-4a48-a0fd-41c7ce672660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:18.438845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b48c-e64a-4441-963d-65d07ecde9c9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:18.451360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988aa07-f221-402d-93e4-027dae1f7737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:18.453767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988aa07-f221-402d-93e4-027dae1f7737 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:18.454006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988aa07-f221-402d-93e4-027dae1f7737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:18.454285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988aa07-f221-402d-93e4-027dae1f7737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:18.466022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0988aa07-f221-402d-93e4-027dae1f7737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:18.608921 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3043/6064] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:18.620195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7fa4-a5b0-4a48-a0fd-41c7ce672660 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:18.625254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4e7d7fa4-a5b0-4a48-a0fd-41c7ce672660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:18.662831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988aa07-f221-402d-93e4-027dae1f7737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:18.669749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988aa07-f221-402d-93e4-027dae1f7737 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:18.687414 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:18.707514 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3022/6065] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:29:18.707852 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:18.811314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7fa4-a5b0-4a48-a0fd-41c7ce672660 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:18.850160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5f272-a295-44ff-affd-c056ddd73ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:18.851051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5f272-a295-44ff-affd-c056ddd73ed0 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:18.852340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5f272-a295-44ff-affd-c056ddd73ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:18.852340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5f272-a295-44ff-affd-c056ddd73ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:18.876839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5f272-a295-44ff-affd-c056ddd73ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:18.892617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5f272-a295-44ff-affd-c056ddd73ed0 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:18.908224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988aa07-f221-402d-93e4-027dae1f7737 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:18.910053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0988aa07-f221-402d-93e4-027dae1f7737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:18.989165 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3044/6066] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:19.045620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5f272-a295-44ff-affd-c056ddd73ed0 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:19.074399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5f272-a295-44ff-affd-c056ddd73ed0 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:19.114646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:19.115612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:19.118474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:19.125681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] PATH_INFO: `/v3/users/a36aa40c466343dd934de568a5f29e5b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:19.129487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36aa40c466343dd934de568a5f29e5b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:19.136216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:19.239648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988aa07-f221-402d-93e4-027dae1f7737 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:19.252115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf454e7-fd7f-4c26-805c-4fd3c496af46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:19.254356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf454e7-fd7f-4c26-805c-4fd3c496af46 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:19.255822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf454e7-fd7f-4c26-805c-4fd3c496af46 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:19.256120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf454e7-fd7f-4c26-805c-4fd3c496af46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:19.261998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-faf454e7-fd7f-4c26-805c-4fd3c496af46 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:19.302800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36aa40c466343dd934de568a5f29e5b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:19.317803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf454e7-fd7f-4c26-805c-4fd3c496af46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:19.323147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf454e7-fd7f-4c26-805c-4fd3c496af46 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:19.358516 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3023/6067] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:19.366032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36aa40c466343dd934de568a5f29e5b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:19.368704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36aa40c466343dd934de568a5f29e5b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:19.399033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36aa40c466343dd934de568a5f29e5b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:19.399823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36aa40c466343dd934de568a5f29e5b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:19.436401 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3045/6068] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:19 2022] DELETE /identity/v3/users/a36aa40c466343dd934de568a5f29e5b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:19.441101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bd968-5f66-438a-90a8-c384cddb2d39 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:19.441599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bd968-5f66-438a-90a8-c384cddb2d39 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:19.441696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bd968-5f66-438a-90a8-c384cddb2d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:19.491433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ad3bd968-5f66-438a-90a8-c384cddb2d39 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:19.494459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ad3bd968-5f66-438a-90a8-c384cddb2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:19.557857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:19.560040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:19.722103 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3024/6069] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:19.724731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bd968-5f66-438a-90a8-c384cddb2d39 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:19.728954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ad3bd968-5f66-438a-90a8-c384cddb2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:19.765128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bd968-5f66-438a-90a8-c384cddb2d39 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:19.767119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b339716-ab85-4be4-9d0e-e86851f283c7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:19.795455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c05a7-d59b-405c-a4f6-32930060f465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:19.795738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:19.797247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c05a7-d59b-405c-a4f6-32930060f465 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:19.797720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:19.798455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:19.798983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] PATH_INFO: `/v3/users/e0f84e8314e34bf0b373f480ed21e015` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:19.799574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c05a7-d59b-405c-a4f6-32930060f465 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:19.799908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c05a7-d59b-405c-a4f6-32930060f465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:19.801976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f84e8314e34bf0b373f480ed21e015)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:19.802817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dc6c05a7-d59b-405c-a4f6-32930060f465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:19.807285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:19.837875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c05a7-d59b-405c-a4f6-32930060f465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:19.840867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c05a7-d59b-405c-a4f6-32930060f465 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:19.866592 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3046/6070] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:19.868900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c05a7-d59b-405c-a4f6-32930060f465 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:19.871995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dc6c05a7-d59b-405c-a4f6-32930060f465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:19.912604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c05a7-d59b-405c-a4f6-32930060f465 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:19.917357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69737dfd-ac2f-4dba-8285-89bff34d1319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:19.919120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737dfd-ac2f-4dba-8285-89bff34d1319 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:19.919822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737dfd-ac2f-4dba-8285-89bff34d1319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:19.920505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737dfd-ac2f-4dba-8285-89bff34d1319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:19.929813 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:19.951025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f84e8314e34bf0b373f480ed21e015'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:19.952710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69737dfd-ac2f-4dba-8285-89bff34d1319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:19.957083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69737dfd-ac2f-4dba-8285-89bff34d1319 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:19.972007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f84e8314e34bf0b373f480ed21e015'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:19.974078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f84e8314e34bf0b373f480ed21e015'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:19.989653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f84e8314e34bf0b373f480ed21e015'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:20.001188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f84e8314e34bf0b373f480ed21e015'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:20.005537 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3047/6071] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:20.020114 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3025/6072] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:19 2022] DELETE /identity/v3/users/e0f84e8314e34bf0b373f480ed21e015 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:20.020913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaf87a-4add-49b0-a71e-f4bc34c22f36 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:20.024100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaf87a-4add-49b0-a71e-f4bc34c22f36 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:20.024869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaf87a-4add-49b0-a71e-f4bc34c22f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:20.085984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3cfaf87a-4add-49b0-a71e-f4bc34c22f36 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:20.087423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3cfaf87a-4add-49b0-a71e-f4bc34c22f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:20.253860 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3048/6073] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:20.276143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:20.279209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:20.315156 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:20.473524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9cf14-2dd0-4590-b930-76e23c52c7f1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:20.485324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7e179-724b-4d04-8496-2044fbfcf334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:20.485324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7e179-724b-4d04-8496-2044fbfcf334 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:20.485324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7e179-724b-4d04-8496-2044fbfcf334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:20.485324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7e179-724b-4d04-8496-2044fbfcf334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:20.509643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7e179-724b-4d04-8496-2044fbfcf334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:20.512578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7e179-724b-4d04-8496-2044fbfcf334 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:20.547015 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3026/6074] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:21.110468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaf87a-4add-49b0-a71e-f4bc34c22f36 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:21.115229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3cfaf87a-4add-49b0-a71e-f4bc34c22f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:21.146789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaf87a-4add-49b0-a71e-f4bc34c22f36 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:21.163107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:21.163942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:21.164331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:21.164812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] PATH_INFO: `/v3/projects/cf7ad0bcbd6d47eca0822dd1f708d678` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:21.184549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7ad0bcbd6d47eca0822dd1f708d678)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:21.186992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:21.279239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7e179-724b-4d04-8496-2044fbfcf334 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:21.294300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7ad0bcbd6d47eca0822dd1f708d678', 'request_id': 'req-ef55a23e-3106-4645-a439-8d15bdfa5cf0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:21.298815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7e179-724b-4d04-8496-2044fbfcf334 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:21.325014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7ad0bcbd6d47eca0822dd1f708d678', 'request_id': 'req-ef55a23e-3106-4645-a439-8d15bdfa5cf0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:21.342780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7ad0bcbd6d47eca0822dd1f708d678', 'request_id': 'req-ef55a23e-3106-4645-a439-8d15bdfa5cf0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:21.381224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] The token cache is being invalidate because project cf7ad0bcbd6d47eca0822dd1f708d678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:21.381718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:21.382956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:21.384811 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3049/6075] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:21 2022] DELETE /identity/v3/projects/cf7ad0bcbd6d47eca0822dd1f708d678 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:21.389358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:21.390960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:21.449253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d1948-9ec6-416d-b33c-8ba73ecacbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:21.450213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d1948-9ec6-416d-b33c-8ba73ecacbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:21.450571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d1948-9ec6-416d-b33c-8ba73ecacbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:21.451015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d1948-9ec6-416d-b33c-8ba73ecacbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:21.460130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-101d1948-9ec6-416d-b33c-8ba73ecacbc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:21.604503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d1948-9ec6-416d-b33c-8ba73ecacbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:21.606825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d1948-9ec6-416d-b33c-8ba73ecacbc6 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:21.625330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55a23e-3106-4645-a439-8d15bdfa5cf0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:21.634622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a37e70-b56c-478e-89f1-3242b821ea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:21.637621 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3027/6076] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:29:21.638174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a37e70-b56c-478e-89f1-3242b821ea75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:21.638544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a37e70-b56c-478e-89f1-3242b821ea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:21.640080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a37e70-b56c-478e-89f1-3242b821ea75 admin admin] PATH_INFO: `/v3/users/b7875788e8d2498296edb041bd115fc5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:21.643209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a37e70-b56c-478e-89f1-3242b821ea75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7875788e8d2498296edb041bd115fc5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:21.649355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a37e70-b56c-478e-89f1-3242b821ea75 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:21.713362 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:21.839217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a9a37e70-b56c-478e-89f1-3242b821ea75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7875788e8d2498296edb041bd115fc5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:21.895222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a9a37e70-b56c-478e-89f1-3242b821ea75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7875788e8d2498296edb041bd115fc5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:21.895222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a9a37e70-b56c-478e-89f1-3242b821ea75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7875788e8d2498296edb041bd115fc5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:21.912553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a9a37e70-b56c-478e-89f1-3242b821ea75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7875788e8d2498296edb041bd115fc5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:21.913454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a9a37e70-b56c-478e-89f1-3242b821ea75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7875788e8d2498296edb041bd115fc5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:21.942476 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3050/6077] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:21 2022] DELETE /identity/v3/users/b7875788e8d2498296edb041bd115fc5 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:22.186468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d1948-9ec6-416d-b33c-8ba73ecacbc6 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:22.188562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-101d1948-9ec6-416d-b33c-8ba73ecacbc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:22.217875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d1948-9ec6-416d-b33c-8ba73ecacbc6 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:22.385362 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:22.398804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:22.399701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:22.400181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:22.400646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] PATH_INFO: `/v3/projects/662fabe024d34a819ffa5ea13a8c6d65` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:22.402143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662fabe024d34a819ffa5ea13a8c6d65)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:22.404505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:22.579252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662fabe024d34a819ffa5ea13a8c6d65', 'request_id': 'req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:22.586532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662fabe024d34a819ffa5ea13a8c6d65', 'request_id': 'req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:22.598260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662fabe024d34a819ffa5ea13a8c6d65', 'request_id': 'req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:22.619663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] The token cache is being invalidate because project 662fabe024d34a819ffa5ea13a8c6d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:22.620362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:22.624010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:22.626684 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3028/6078] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:22 2022] DELETE /identity/v3/projects/662fabe024d34a819ffa5ea13a8c6d65 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:22.633931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d7021-4431-4eb7-b520-3fa9332fec23 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:22.634467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d7021-4431-4eb7-b520-3fa9332fec23 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:22.634678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d7021-4431-4eb7-b520-3fa9332fec23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:22.674909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-873d7021-4431-4eb7-b520-3fa9332fec23 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:22.678463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-873d7021-4431-4eb7-b520-3fa9332fec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:22.828514 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3051/6079] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:22.834128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:22.836261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:22.848609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ce25-4bca-4adf-9347-228c747932b7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:22.848965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ce25-4bca-4adf-9347-228c747932b7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:22.849448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ce25-4bca-4adf-9347-228c747932b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:22.861220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bda8e6-f8f7-445a-a073-3fcc50fb4cd7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:22.885994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:22.886737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:22.887025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:22.887306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] PATH_INFO: `/v3/projects/815e8e2abc514414ac9e886a01d4bcdf` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:22.904697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=815e8e2abc514414ac9e886a01d4bcdf)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:22.906745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:22.930212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5d19ce25-4bca-4adf-9347-228c747932b7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:22.931505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5d19ce25-4bca-4adf-9347-228c747932b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:22.955272 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3052/6080] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:22.956235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19ce25-4bca-4adf-9347-228c747932b7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:22.979411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19ce25-4bca-4adf-9347-228c747932b7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:22.987236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8923e-d37d-4729-8ec8-053a1b569915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:22.987928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8923e-d37d-4729-8ec8-053a1b569915 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:22.993293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8923e-d37d-4729-8ec8-053a1b569915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:22.993993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8923e-d37d-4729-8ec8-053a1b569915 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:22.994756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8923e-d37d-4729-8ec8-053a1b569915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:23.000485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8923e-d37d-4729-8ec8-053a1b569915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:23.005375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8923e-d37d-4729-8ec8-053a1b569915 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:23.037387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815e8e2abc514414ac9e886a01d4bcdf', 'request_id': 'req-11909b46-07bf-49b4-97b1-94f357a298b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:23.071847 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3053/6081] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:23.077879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8923e-d37d-4729-8ec8-053a1b569915 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:23.086665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815e8e2abc514414ac9e886a01d4bcdf', 'request_id': 'req-11909b46-07bf-49b4-97b1-94f357a298b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:23.118127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815e8e2abc514414ac9e886a01d4bcdf', 'request_id': 'req-11909b46-07bf-49b4-97b1-94f357a298b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:23.119817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8923e-d37d-4729-8ec8-053a1b569915 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:23.164247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] The token cache is being invalidate because project 815e8e2abc514414ac9e886a01d4bcdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:23.164568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:23.169348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11909b46-07bf-49b4-97b1-94f357a298b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:23.176084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3029/6082] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:22 2022] DELETE /identity/v3/projects/815e8e2abc514414ac9e886a01d4bcdf => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:23.181604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7c98b-c3eb-4eff-a0fe-2f5a9576aa72 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:23.181960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7c98b-c3eb-4eff-a0fe-2f5a9576aa72 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:23.182242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7c98b-c3eb-4eff-a0fe-2f5a9576aa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:23.248656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7bc7c98b-c3eb-4eff-a0fe-2f5a9576aa72 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:23.250049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7bc7c98b-c3eb-4eff-a0fe-2f5a9576aa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:23.331397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1a4ae-8feb-444d-af21-c134a36a205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:23.332195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1a4ae-8feb-444d-af21-c134a36a205f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:23.332469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1a4ae-8feb-444d-af21-c134a36a205f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:23.332745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1a4ae-8feb-444d-af21-c134a36a205f admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:23.333586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1a4ae-8feb-444d-af21-c134a36a205f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:23.339036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1a4ae-8feb-444d-af21-c134a36a205f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:23.434728 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3030/6083] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:23.435120 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3054/6084] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:23 2022] POST /identity/v3/projects => generated 391 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:23.445182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1a4ae-8feb-444d-af21-c134a36a205f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:23.445840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8457885-d458-4db6-9d64-b1042ca37b0c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:23.446229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8457885-d458-4db6-9d64-b1042ca37b0c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:23.446637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8457885-d458-4db6-9d64-b1042ca37b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:23.447417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-74e1a4ae-8feb-444d-af21-c134a36a205f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:23.453956 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:23.468670 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:23.496707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a8457885-d458-4db6-9d64-b1042ca37b0c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:23.500595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a8457885-d458-4db6-9d64-b1042ca37b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:23.577426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1a4ae-8feb-444d-af21-c134a36a205f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:23.585546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f739c31-09e9-48a0-8256-65f59817b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:23.586547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f739c31-09e9-48a0-8256-65f59817b20a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:23.587033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f739c31-09e9-48a0-8256-65f59817b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:23.588206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f739c31-09e9-48a0-8256-65f59817b20a admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:23.589012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f739c31-09e9-48a0-8256-65f59817b20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:23.592500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f739c31-09e9-48a0-8256-65f59817b20a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:23.646069 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3055/6085] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:23 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:23.654205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f739c31-09e9-48a0-8256-65f59817b20a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:23.679048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f739c31-09e9-48a0-8256-65f59817b20a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:23.697809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dfd21-6568-40d3-aee4-5990bd288e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:23.698443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dfd21-6568-40d3-aee4-5990bd288e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:23.698843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dfd21-6568-40d3-aee4-5990bd288e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:23.699151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dfd21-6568-40d3-aee4-5990bd288e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:23.699822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dfd21-6568-40d3-aee4-5990bd288e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:23.701532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dfd21-6568-40d3-aee4-5990bd288e2f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:23.733711 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3056/6086] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:29:23.738324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dfd21-6568-40d3-aee4-5990bd288e2f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:23.787583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dfd21-6568-40d3-aee4-5990bd288e2f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:23.800550 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3031/6087] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:23.805234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8457885-d458-4db6-9d64-b1042ca37b0c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:23.822314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d4b0b-9025-430b-9221-16112ad7b917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:23.825617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d4b0b-9025-430b-9221-16112ad7b917 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:23.825910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d4b0b-9025-430b-9221-16112ad7b917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:23.826199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d4b0b-9025-430b-9221-16112ad7b917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:23.826901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d4b0b-9025-430b-9221-16112ad7b917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:23.840594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d4b0b-9025-430b-9221-16112ad7b917 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:23.856228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8457885-d458-4db6-9d64-b1042ca37b0c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:23.882342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f747a0-ae9f-4305-a119-b811635f109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:23.885906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f747a0-ae9f-4305-a119-b811635f109d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:23.886200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f747a0-ae9f-4305-a119-b811635f109d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:23.891783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f747a0-ae9f-4305-a119-b811635f109d admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:23.892400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f747a0-ae9f-4305-a119-b811635f109d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:23.892682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f747a0-ae9f-4305-a119-b811635f109d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:23.895424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3057/6088] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:23.895555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f747a0-ae9f-4305-a119-b811635f109d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:23.899325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d4b0b-9025-430b-9221-16112ad7b917 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:23.927602 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3032/6089] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:23.932053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f747a0-ae9f-4305-a119-b811635f109d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:23.941972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d4b0b-9025-430b-9221-16112ad7b917 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:23.954207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1eb3dc-005c-4439-b6f2-4dc5a66a57c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:23.956120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eb3dc-005c-4439-b6f2-4dc5a66a57c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:23.956413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eb3dc-005c-4439-b6f2-4dc5a66a57c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:23.957751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eb3dc-005c-4439-b6f2-4dc5a66a57c3 admin admin] PATH_INFO: `/v3/projects/7205e8a3c3cc43249e8f3027ac8e93fd/users/d6422849873d44ce8196c468557d9c1e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:23.960563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f747a0-ae9f-4305-a119-b811635f109d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:23.976017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82ae25-42d4-4edb-9d75-b77da41010ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:23.976673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82ae25-42d4-4edb-9d75-b77da41010ac admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:23.976956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82ae25-42d4-4edb-9d75-b77da41010ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:23.977229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82ae25-42d4-4edb-9d75-b77da41010ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:23.977871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82ae25-42d4-4edb-9d75-b77da41010ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:23.979900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82ae25-42d4-4edb-9d75-b77da41010ac admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:23.995131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1eb3dc-005c-4439-b6f2-4dc5a66a57c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7205e8a3c3cc43249e8f3027ac8e93fd, user_id=d6422849873d44ce8196c468557d9c1e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:24.002328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1eb3dc-005c-4439-b6f2-4dc5a66a57c3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:24.054757 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3058/6090] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:23 2022] PUT /identity/v3/projects/7205e8a3c3cc43249e8f3027ac8e93fd/users/d6422849873d44ce8196c468557d9c1e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:24.072128 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3033/6091] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:23 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:29:24.073318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5653-7d0d-49e3-b4c1-3830784a905d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:24.073630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5653-7d0d-49e3-b4c1-3830784a905d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:24.074896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5653-7d0d-49e3-b4c1-3830784a905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:24.076305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82ae25-42d4-4edb-9d75-b77da41010ac admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:24.153226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a6ab5653-7d0d-49e3-b4c1-3830784a905d None None] MFA Rules not processed for user `d6422849873d44ce8196c468557d9c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:24.154555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a6ab5653-7d0d-49e3-b4c1-3830784a905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:24.253709 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3059/6092] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:24.258458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab5653-7d0d-49e3-b4c1-3830784a905d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:24.307164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82ae25-42d4-4edb-9d75-b77da41010ac admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:24.321431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c746a-ec96-47c5-a956-594b39be667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:24.322185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c746a-ec96-47c5-a956-594b39be667c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:24.322535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c746a-ec96-47c5-a956-594b39be667c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:24.322895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c746a-ec96-47c5-a956-594b39be667c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:24.323672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c746a-ec96-47c5-a956-594b39be667c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:24.327578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c746a-ec96-47c5-a956-594b39be667c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:24.330719 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:24.358250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab5653-7d0d-49e3-b4c1-3830784a905d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:24.365488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6715e8b-eccf-469e-a583-055305f2a116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:24.366204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6715e8b-eccf-469e-a583-055305f2a116 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:24.366593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6715e8b-eccf-469e-a583-055305f2a116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:24.367000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6715e8b-eccf-469e-a583-055305f2a116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:24.367799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6715e8b-eccf-469e-a583-055305f2a116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:24.370427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6715e8b-eccf-469e-a583-055305f2a116 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:24.377457 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3034/6093] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:24 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:29:24.380994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c746a-ec96-47c5-a956-594b39be667c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:24.403107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c746a-ec96-47c5-a956-594b39be667c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:24.415329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1dc6b-8e39-45a6-bd90-6a9062c829f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:24.417516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1dc6b-8e39-45a6-bd90-6a9062c829f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:24.418264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1dc6b-8e39-45a6-bd90-6a9062c829f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:24.420233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1dc6b-8e39-45a6-bd90-6a9062c829f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:24.421114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1dc6b-8e39-45a6-bd90-6a9062c829f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:24.426608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1dc6b-8e39-45a6-bd90-6a9062c829f7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:24.428550 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3060/6094] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:24 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:24.432284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6715e8b-eccf-469e-a583-055305f2a116 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:24.458924 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3035/6095] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:24.462362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1dc6b-8e39-45a6-bd90-6a9062c829f7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:24.498708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1dc6b-8e39-45a6-bd90-6a9062c829f7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:24.606286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6715e8b-eccf-469e-a583-055305f2a116 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:24.615978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80f6f-b26f-4772-b45b-04e279b04f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:24.616417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80f6f-b26f-4772-b45b-04e279b04f78 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:24.616965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80f6f-b26f-4772-b45b-04e279b04f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:24.617249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80f6f-b26f-4772-b45b-04e279b04f78 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:24.623099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b80f6f-b26f-4772-b45b-04e279b04f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:24.628638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b80f6f-b26f-4772-b45b-04e279b04f78 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:24.690900 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:24.763403 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3061/6096] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:24 2022] POST /identity/v3/users => generated 301 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:24.765659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80f6f-b26f-4772-b45b-04e279b04f78 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:24.767747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca6551-e769-4a9b-8134-f34603a90456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:24.769332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca6551-e769-4a9b-8134-f34603a90456 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:24.769619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca6551-e769-4a9b-8134-f34603a90456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:24.773273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca6551-e769-4a9b-8134-f34603a90456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:24.779212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca6551-e769-4a9b-8134-f34603a90456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:24.784081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca6551-e769-4a9b-8134-f34603a90456 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:24.819670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80f6f-b26f-4772-b45b-04e279b04f78 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:24.839397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91a2c5-6f18-4ba8-93b8-bb354d073a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:24.840041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91a2c5-6f18-4ba8-93b8-bb354d073a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:24.840326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91a2c5-6f18-4ba8-93b8-bb354d073a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:24.840626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91a2c5-6f18-4ba8-93b8-bb354d073a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:24.841705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91a2c5-6f18-4ba8-93b8-bb354d073a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:24.847032 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3036/6097] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:24.860124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca6551-e769-4a9b-8134-f34603a90456 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:24.864119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91a2c5-6f18-4ba8-93b8-bb354d073a9b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:24.904853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca6551-e769-4a9b-8134-f34603a90456 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:24.918626 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3062/6098] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:24.923935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91a2c5-6f18-4ba8-93b8-bb354d073a9b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:24.928401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f3d32-ef06-4c9d-8cad-ac74e9cba0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:24.932274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f3d32-ef06-4c9d-8cad-ac74e9cba0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:24.933912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f3d32-ef06-4c9d-8cad-ac74e9cba0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:24.934944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f3d32-ef06-4c9d-8cad-ac74e9cba0d2 admin admin] PATH_INFO: `/v3/projects/d51aae6f3eb447fdbb75375d2970bb1c/users/08c3c7e6906c441f95ad632601e26c3e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:24.958539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91a2c5-6f18-4ba8-93b8-bb354d073a9b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:24.990566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054beab1-c5ff-46ed-ab40-f93ab4edc7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:24.991490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054beab1-c5ff-46ed-ab40-f93ab4edc7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:24.991891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054beab1-c5ff-46ed-ab40-f93ab4edc7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:24.992656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054beab1-c5ff-46ed-ab40-f93ab4edc7f8 admin admin] PATH_INFO: `/v3/projects/5b19e81a7d2c49648a610a4a047ee428/users/75ca4d821512486cb130d969cfd94d58/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:24.993400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f3d32-ef06-4c9d-8cad-ac74e9cba0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51aae6f3eb447fdbb75375d2970bb1c, user_id=08c3c7e6906c441f95ad632601e26c3e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:24.997396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f3d32-ef06-4c9d-8cad-ac74e9cba0d2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:25.014764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054beab1-c5ff-46ed-ab40-f93ab4edc7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b19e81a7d2c49648a610a4a047ee428, user_id=75ca4d821512486cb130d969cfd94d58, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:25.019113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054beab1-c5ff-46ed-ab40-f93ab4edc7f8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:25.036116 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3037/6099] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:24 2022] PUT /identity/v3/projects/d51aae6f3eb447fdbb75375d2970bb1c/users/08c3c7e6906c441f95ad632601e26c3e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:25.050129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0d5c2-bcaf-44f5-88d1-cb60c2bc2891 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:25.050418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0d5c2-bcaf-44f5-88d1-cb60c2bc2891 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:25.050756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0d5c2-bcaf-44f5-88d1-cb60c2bc2891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:25.052237 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3063/6100] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:24 2022] PUT /identity/v3/projects/5b19e81a7d2c49648a610a4a047ee428/users/75ca4d821512486cb130d969cfd94d58/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:25.055897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054beab1-c5ff-46ed-ab40-f93ab4edc7f8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:25.092570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-75b0d5c2-bcaf-44f5-88d1-cb60c2bc2891 None None] MFA Rules not processed for user `08c3c7e6906c441f95ad632601e26c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:25.094361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-75b0d5c2-bcaf-44f5-88d1-cb60c2bc2891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:25.258696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054beab1-c5ff-46ed-ab40-f93ab4edc7f8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:25.268605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd29be9-4b24-45d2-bf5a-2eab682cb462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:25.269606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd29be9-4b24-45d2-bf5a-2eab682cb462 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:25.271947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd29be9-4b24-45d2-bf5a-2eab682cb462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:25.272341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd29be9-4b24-45d2-bf5a-2eab682cb462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:25.273781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd29be9-4b24-45d2-bf5a-2eab682cb462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:25.280736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd29be9-4b24-45d2-bf5a-2eab682cb462 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:25.322416 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3064/6101] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:25.323522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd29be9-4b24-45d2-bf5a-2eab682cb462 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:25.338391 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3038/6102] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:25.339725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0d5c2-bcaf-44f5-88d1-cb60c2bc2891 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:25.350996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd29be9-4b24-45d2-bf5a-2eab682cb462 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:25.352283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0d5c2-bcaf-44f5-88d1-cb60c2bc2891 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:25.357775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62d4fa-6fae-45bb-90cc-d9cdf024c492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:25.358899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62d4fa-6fae-45bb-90cc-d9cdf024c492 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:25.359325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62d4fa-6fae-45bb-90cc-d9cdf024c492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:25.359746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62d4fa-6fae-45bb-90cc-d9cdf024c492 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:25.360565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62d4fa-6fae-45bb-90cc-d9cdf024c492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:25.361968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d32e68-6ee1-4947-9273-b2a67a91318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:25.362920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62d4fa-6fae-45bb-90cc-d9cdf024c492 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:25.363699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d32e68-6ee1-4947-9273-b2a67a91318d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:25.366010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d32e68-6ee1-4947-9273-b2a67a91318d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:25.366477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d32e68-6ee1-4947-9273-b2a67a91318d admin admin] PATH_INFO: `/v3/projects/5b19e81a7d2c49648a610a4a047ee428/users/75ca4d821512486cb130d969cfd94d58/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:25.374362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d32e68-6ee1-4947-9273-b2a67a91318d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b19e81a7d2c49648a610a4a047ee428, user_id=75ca4d821512486cb130d969cfd94d58, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:25.377287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d32e68-6ee1-4947-9273-b2a67a91318d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:25.397583 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:25.417023 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3065/6103] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:25 2022] PUT /identity/v3/projects/5b19e81a7d2c49648a610a4a047ee428/users/75ca4d821512486cb130d969cfd94d58/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:25.423250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087de04-4940-4306-8eae-4c213b272010 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:25.425936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087de04-4940-4306-8eae-4c213b272010 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:25.426389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087de04-4940-4306-8eae-4c213b272010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:25.436465 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3039/6104] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:25 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:25.440312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62d4fa-6fae-45bb-90cc-d9cdf024c492 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:25.512847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7087de04-4940-4306-8eae-4c213b272010 None None] MFA Rules not processed for user `75ca4d821512486cb130d969cfd94d58`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:25.515181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7087de04-4940-4306-8eae-4c213b272010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:25.585025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62d4fa-6fae-45bb-90cc-d9cdf024c492 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:25.591100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef74fa-b1cb-4e06-a0bd-679697ad9649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:25.591738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef74fa-b1cb-4e06-a0bd-679697ad9649 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:25.592056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef74fa-b1cb-4e06-a0bd-679697ad9649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:25.593187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef74fa-b1cb-4e06-a0bd-679697ad9649 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:25.594495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef74fa-b1cb-4e06-a0bd-679697ad9649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:25.596088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef74fa-b1cb-4e06-a0bd-679697ad9649 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:25.637933 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3040/6105] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:25 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:29:25.645831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef74fa-b1cb-4e06-a0bd-679697ad9649 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:25.665918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef74fa-b1cb-4e06-a0bd-679697ad9649 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:25.690197 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3066/6106] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:25 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:25.695335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087de04-4940-4306-8eae-4c213b272010 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:25.698727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1994dbb-ef0c-4cde-89e4-a21b38e3d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:25.699773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1994dbb-ef0c-4cde-89e4-a21b38e3d4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:25.700450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1994dbb-ef0c-4cde-89e4-a21b38e3d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:25.700956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1994dbb-ef0c-4cde-89e4-a21b38e3d4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:25.701873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1994dbb-ef0c-4cde-89e4-a21b38e3d4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:25.704227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1994dbb-ef0c-4cde-89e4-a21b38e3d4fe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:25.716532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087de04-4940-4306-8eae-4c213b272010 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:25.725286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760af5d4-a737-461f-9ecc-6cfd62d41a6c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:25.726876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760af5d4-a737-461f-9ecc-6cfd62d41a6c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:25.727406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760af5d4-a737-461f-9ecc-6cfd62d41a6c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:25.727886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760af5d4-a737-461f-9ecc-6cfd62d41a6c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:25.728801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760af5d4-a737-461f-9ecc-6cfd62d41a6c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:25.735156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760af5d4-a737-461f-9ecc-6cfd62d41a6c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:25.743342 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3041/6107] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:25.745213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1994dbb-ef0c-4cde-89e4-a21b38e3d4fe admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:25.764721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1994dbb-ef0c-4cde-89e4-a21b38e3d4fe admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:25.777571 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3067/6108] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:29:25 2022] POST /identity/v3/domains => generated 277 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:25.780998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d9eb4-6fd7-4a24-bf81-673448a76aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:25.781335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9eb4-6fd7-4a24-bf81-673448a76aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:25.781695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9eb4-6fd7-4a24-bf81-673448a76aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:25.781835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760af5d4-a737-461f-9ecc-6cfd62d41a6c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:25.782160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9eb4-6fd7-4a24-bf81-673448a76aa0 admin admin] PATH_INFO: `/v3/projects/97a11a7b0fab4fd6a761c57cf8872911/users/290ea407fbdd43c1887fc854680f0671/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:25.784976 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:25.818062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d9eb4-6fd7-4a24-bf81-673448a76aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a11a7b0fab4fd6a761c57cf8872911, user_id=290ea407fbdd43c1887fc854680f0671, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:25.824718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d9eb4-6fd7-4a24-bf81-673448a76aa0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:25.857852 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3042/6109] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:25 2022] PUT /identity/v3/projects/97a11a7b0fab4fd6a761c57cf8872911/users/290ea407fbdd43c1887fc854680f0671/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:25.860163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d9eb4-6fd7-4a24-bf81-673448a76aa0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:25.958141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760af5d4-a737-461f-9ecc-6cfd62d41a6c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:26.033453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d9eb4-6fd7-4a24-bf81-673448a76aa0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:26.049716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8df01-482e-444b-8554-ed64027cf830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:26.085832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618b282-8cd1-4965-b735-dd7b761c83e3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:26.086455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618b282-8cd1-4965-b735-dd7b761c83e3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:26.086811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618b282-8cd1-4965-b735-dd7b761c83e3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:26.087047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618b282-8cd1-4965-b735-dd7b761c83e3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:26.087755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618b282-8cd1-4965-b735-dd7b761c83e3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=024e5708e3534af78e02ecc00d4cbb10)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:26.088732 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-3618b282-8cd1-4965-b735-dd7b761c83e3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:26.088732 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:29:26.088732 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:29:26.090408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618b282-8cd1-4965-b735-dd7b761c83e3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:26.093842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8df01-482e-444b-8554-ed64027cf830 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:26.096636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8df01-482e-444b-8554-ed64027cf830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:26.096935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8df01-482e-444b-8554-ed64027cf830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:26.097633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8df01-482e-444b-8554-ed64027cf830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:26.100410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8df01-482e-444b-8554-ed64027cf830 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:26.124521 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3043/6110] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:26.132715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8df01-482e-444b-8554-ed64027cf830 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:26.150124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8df01-482e-444b-8554-ed64027cf830 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:26.159405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6602b7-b3f0-4f46-90a7-1e8715a0178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:26.160536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6602b7-b3f0-4f46-90a7-1e8715a0178e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:26.166735 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:26.180787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6602b7-b3f0-4f46-90a7-1e8715a0178e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:26.181629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6602b7-b3f0-4f46-90a7-1e8715a0178e admin admin] PATH_INFO: `/v3/projects/97a11a7b0fab4fd6a761c57cf8872911/users/290ea407fbdd43c1887fc854680f0671/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:26.189586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6602b7-b3f0-4f46-90a7-1e8715a0178e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a11a7b0fab4fd6a761c57cf8872911, user_id=290ea407fbdd43c1887fc854680f0671, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:26.195384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6602b7-b3f0-4f46-90a7-1e8715a0178e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:26.201412 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3068/6111] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:29:25 2022] PUT /identity/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config => generated 138 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:29:26.202143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618b282-8cd1-4965-b735-dd7b761c83e3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:26.243143 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3044/6112] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:26 2022] PUT /identity/v3/projects/97a11a7b0fab4fd6a761c57cf8872911/users/290ea407fbdd43c1887fc854680f0671/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:26.243357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618b282-8cd1-4965-b735-dd7b761c83e3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:26.277423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e9222-ee0d-46e8-bf81-c3636f5738f8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:26.277863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e9222-ee0d-46e8-bf81-c3636f5738f8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:26.278170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e9222-ee0d-46e8-bf81-c3636f5738f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:26.341798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bb5e9222-ee0d-46e8-bf81-c3636f5738f8 None None] MFA Rules not processed for user `290ea407fbdd43c1887fc854680f0671`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:26.343071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bb5e9222-ee0d-46e8-bf81-c3636f5738f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:26.475794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd519f1-d393-4fc8-a9b7-ce36cb251702 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:26.476476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd519f1-d393-4fc8-a9b7-ce36cb251702 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:26.476910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd519f1-d393-4fc8-a9b7-ce36cb251702 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:26.477184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd519f1-d393-4fc8-a9b7-ce36cb251702 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:26.479543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd519f1-d393-4fc8-a9b7-ce36cb251702 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=024e5708e3534af78e02ecc00d4cbb10, group=identity)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:26.487092 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-7cd519f1-d393-4fc8-a9b7-ce36cb251702 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:26.487092 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:29:26.487092 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:29:26.488044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd519f1-d393-4fc8-a9b7-ce36cb251702 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:26.497671 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3045/6113] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:26.517691 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3069/6114] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:29:26 2022] GET /identity/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config/identity => generated 45 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:26.521577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e9222-ee0d-46e8-bf81-c3636f5738f8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:26.538471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e9222-ee0d-46e8-bf81-c3636f5738f8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:26.553541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f8edf-5102-4bdb-a7ce-a3cacdaedb53 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:26.554241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f8edf-5102-4bdb-a7ce-a3cacdaedb53 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:26.554527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f8edf-5102-4bdb-a7ce-a3cacdaedb53 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:26.554832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f8edf-5102-4bdb-a7ce-a3cacdaedb53 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config/identity/driver` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:26.556027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f8edf-5102-4bdb-a7ce-a3cacdaedb53 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=024e5708e3534af78e02ecc00d4cbb10, group=identity, option=driver)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:26.557065 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-176f8edf-5102-4bdb-a7ce-a3cacdaedb53 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:26.557065 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:29:26.557065 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:29:26.557983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f8edf-5102-4bdb-a7ce-a3cacdaedb53 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:26.582185 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3046/6115] 10.222.0.23 () {58 vars in 1296 bytes} [Sun Oct 2 01:29:26 2022] GET /identity/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config/identity/driver => generated 31 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 02 01:29:26.586229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd519f1-d393-4fc8-a9b7-ce36cb251702 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:26.594912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f8edf-5102-4bdb-a7ce-a3cacdaedb53 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:26.596643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-176f8edf-5102-4bdb-a7ce-a3cacdaedb53 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:26.611118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd519f1-d393-4fc8-a9b7-ce36cb251702 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:26.634025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e81b0-ee95-4f99-8768-84c11c0572f5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:26.634298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e81b0-ee95-4f99-8768-84c11c0572f5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:26.634580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e81b0-ee95-4f99-8768-84c11c0572f5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:26.635811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e81b0-ee95-4f99-8768-84c11c0572f5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config/ldap` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:26.640923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e81b0-ee95-4f99-8768-84c11c0572f5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=024e5708e3534af78e02ecc00d4cbb10, group=ldap)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:26.649710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e81b0-ee95-4f99-8768-84c11c0572f5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:26.673407 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3070/6116] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:29:26 2022] GET /identity/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config/ldap => generated 106 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:26.673407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e81b0-ee95-4f99-8768-84c11c0572f5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:26.703310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e81b0-ee95-4f99-8768-84c11c0572f5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:26.742837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7ee2-8494-42d2-8d88-a0f25a431d9e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:26.743509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7ee2-8494-42d2-8d88-a0f25a431d9e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:26.743839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7ee2-8494-42d2-8d88-a0f25a431d9e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:26.744066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7ee2-8494-42d2-8d88-a0f25a431d9e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config/ldap/url` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:26.747554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd7ee2-8494-42d2-8d88-a0f25a431d9e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=024e5708e3534af78e02ecc00d4cbb10, group=ldap, option=url)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:26.749644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd7ee2-8494-42d2-8d88-a0f25a431d9e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:26.759786 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:26.781069 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3071/6117] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:29:26 2022] GET /identity/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config/ldap/url => generated 46 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:26.783030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7ee2-8494-42d2-8d88-a0f25a431d9e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:26.805936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7ee2-8494-42d2-8d88-a0f25a431d9e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:26.831417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f8edf-5102-4bdb-a7ce-a3cacdaedb53 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:26.837330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643c397-587f-4ad2-8447-e7259c14c0bb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:26.838023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643c397-587f-4ad2-8447-e7259c14c0bb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:26.838309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643c397-587f-4ad2-8447-e7259c14c0bb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:26.838585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643c397-587f-4ad2-8447-e7259c14c0bb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config/ldap/user_tree_dn` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:26.840015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643c397-587f-4ad2-8447-e7259c14c0bb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=024e5708e3534af78e02ecc00d4cbb10, group=ldap, option=user_tree_dn)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:26.841149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdc7bd-e9ac-49fb-8fa1-fbd476a75f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:26.841670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643c397-587f-4ad2-8447-e7259c14c0bb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:26.851808 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3072/6118] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 2 01:29:26 2022] GET /identity/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config/ldap/user_tree_dn => generated 63 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 02 01:29:26.852394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdc7bd-e9ac-49fb-8fa1-fbd476a75f46 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:26.852681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdc7bd-e9ac-49fb-8fa1-fbd476a75f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:26.852958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdc7bd-e9ac-49fb-8fa1-fbd476a75f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:26.855531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643c397-587f-4ad2-8447-e7259c14c0bb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:26.896958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdc7bd-e9ac-49fb-8fa1-fbd476a75f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:26.897501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643c397-587f-4ad2-8447-e7259c14c0bb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:26.900126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdc7bd-e9ac-49fb-8fa1-fbd476a75f46 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:26.922959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3269e-6cf6-4ae8-a0e3-6ec46ec46fa3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:26.923620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3269e-6cf6-4ae8-a0e3-6ec46ec46fa3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:26.923903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3269e-6cf6-4ae8-a0e3-6ec46ec46fa3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:26.924176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3269e-6cf6-4ae8-a0e3-6ec46ec46fa3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:26.924782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3269e-6cf6-4ae8-a0e3-6ec46ec46fa3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=024e5708e3534af78e02ecc00d4cbb10)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:26.926986 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-d9e3269e-6cf6-4ae8-a0e3-6ec46ec46fa3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:26.926986 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:29:26.926986 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:29:26.927905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3269e-6cf6-4ae8-a0e3-6ec46ec46fa3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:26.942641 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3047/6119] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:29:26.967205 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3073/6120] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:29:26 2022] DELETE /identity/v3/domains/024e5708e3534af78e02ecc00d4cbb10/config => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:26.971884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdc7bd-e9ac-49fb-8fa1-fbd476a75f46 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:26.998272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdc7bd-e9ac-49fb-8fa1-fbd476a75f46 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:27.029010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:27.029664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:27.029946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:27.030221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/024e5708e3534af78e02ecc00d4cbb10` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:27.038438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=024e5708e3534af78e02ecc00d4cbb10)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:27.040272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:27.099118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.107344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.177949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.178730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.183099 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3048/6121] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:29:26 2022] PATCH /identity/v3/domains/024e5708e3534af78e02ecc00d4cbb10 => generated 278 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:27.187590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3269e-6cf6-4ae8-a0e3-6ec46ec46fa3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:27.189362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d9e3269e-6cf6-4ae8-a0e3-6ec46ec46fa3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:27.212631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3269e-6cf6-4ae8-a0e3-6ec46ec46fa3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:27.433860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:27.434881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:27.435478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:27.435797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/024e5708e3534af78e02ecc00d4cbb10` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:27.449947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=024e5708e3534af78e02ecc00d4cbb10)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:27.451739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:27.489271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.492783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.521694 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=3,keystone:INSERT=1,keystone:SELECT=96 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:27.585378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10', 'request_id': 'req-821a5bb3-298a-440d-9b03-8905ce2f785b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.600081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10', 'request_id': 'req-821a5bb3-298a-440d-9b03-8905ce2f785b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.625699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10', 'request_id': 'req-821a5bb3-298a-440d-9b03-8905ce2f785b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.665592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] The token cache is being invalidate because project 024e5708e3534af78e02ecc00d4cbb10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:27.666923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.668388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.703148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10', 'request_id': 'req-821a5bb3-298a-440d-9b03-8905ce2f785b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.713821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10', 'request_id': 'req-821a5bb3-298a-440d-9b03-8905ce2f785b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.719093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '024e5708e3534af78e02ecc00d4cbb10', 'request_id': 'req-821a5bb3-298a-440d-9b03-8905ce2f785b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:27.730752 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3074/6122] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:29:27 2022] DELETE /identity/v3/domains/024e5708e3534af78e02ecc00d4cbb10 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:27.731978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:27.744071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c41e8b-5d0d-4924-9382-992b651d0622 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:27.864345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce302b-16c6-4501-997a-f88f89691fd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:27.865122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce302b-16c6-4501-997a-f88f89691fd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:27.865542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce302b-16c6-4501-997a-f88f89691fd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:27.865919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce302b-16c6-4501-997a-f88f89691fd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:27.869057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce302b-16c6-4501-997a-f88f89691fd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:27.875013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce302b-16c6-4501-997a-f88f89691fd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:27.900019 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3049/6123] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:29:27 2022] POST /identity/v3/domains => generated 276 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:29:27.904555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:27.908039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:27.931639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5bb3-298a-440d-9b03-8905ce2f785b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:28.077938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876a532-64b7-4a1e-baaf-9c52121a4738 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:28.078623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876a532-64b7-4a1e-baaf-9c52121a4738 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:28.078917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876a532-64b7-4a1e-baaf-9c52121a4738 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:28.079198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876a532-64b7-4a1e-baaf-9c52121a4738 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/09aa734ecb124b0ebe2d47914143856a/config` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:28.081523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876a532-64b7-4a1e-baaf-9c52121a4738 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=09aa734ecb124b0ebe2d47914143856a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:28.085704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876a532-64b7-4a1e-baaf-9c52121a4738 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:28.180829 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3075/6124] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:29:27 2022] PUT /identity/v3/domains/09aa734ecb124b0ebe2d47914143856a/config => generated 138 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:28.187082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce302b-16c6-4501-997a-f88f89691fd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:28.202540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce302b-16c6-4501-997a-f88f89691fd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:28.215216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb135f-19c9-4452-aa70-38dfe0b50ba6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:28.215881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb135f-19c9-4452-aa70-38dfe0b50ba6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:28.216167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb135f-19c9-4452-aa70-38dfe0b50ba6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:28.217061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb135f-19c9-4452-aa70-38dfe0b50ba6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/09aa734ecb124b0ebe2d47914143856a/config` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:28.217758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb135f-19c9-4452-aa70-38dfe0b50ba6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=09aa734ecb124b0ebe2d47914143856a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:28.218999 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-50bb135f-19c9-4452-aa70-38dfe0b50ba6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:28.218999 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:29:28.218999 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:29:28.221644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb135f-19c9-4452-aa70-38dfe0b50ba6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:28.315531 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3050/6125] 10.222.0.23 () {60 vars in 1271 bytes} [Sun Oct 2 01:29:28 2022] PATCH /identity/v3/domains/09aa734ecb124b0ebe2d47914143856a/config => generated 142 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:28.322960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876a532-64b7-4a1e-baaf-9c52121a4738 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:28.340471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876a532-64b7-4a1e-baaf-9c52121a4738 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:28.359237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdedf01-78f7-48b5-b5d2-59ba9a3d7eab tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:28.359757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdedf01-78f7-48b5-b5d2-59ba9a3d7eab tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:28.362212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdedf01-78f7-48b5-b5d2-59ba9a3d7eab tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:28.362524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdedf01-78f7-48b5-b5d2-59ba9a3d7eab tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/09aa734ecb124b0ebe2d47914143856a/config` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:28.365386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdedf01-78f7-48b5-b5d2-59ba9a3d7eab tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=09aa734ecb124b0ebe2d47914143856a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:28.368897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdedf01-78f7-48b5-b5d2-59ba9a3d7eab tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:28.385479 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3076/6126] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:29:28 2022] GET /identity/v3/domains/09aa734ecb124b0ebe2d47914143856a/config => generated 142 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:28.387413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb135f-19c9-4452-aa70-38dfe0b50ba6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:28.397995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb135f-19c9-4452-aa70-38dfe0b50ba6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:28.407614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa630fa-5435-44be-89a9-4f6f3b273b59 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:28.408267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa630fa-5435-44be-89a9-4f6f3b273b59 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:28.408551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa630fa-5435-44be-89a9-4f6f3b273b59 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:28.408820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa630fa-5435-44be-89a9-4f6f3b273b59 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/09aa734ecb124b0ebe2d47914143856a/config` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:28.409422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa630fa-5435-44be-89a9-4f6f3b273b59 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=09aa734ecb124b0ebe2d47914143856a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:28.410519 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-dfa630fa-5435-44be-89a9-4f6f3b273b59 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:28.410519 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:29:28.410519 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:29:28.411458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa630fa-5435-44be-89a9-4f6f3b273b59 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:28.451433 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3051/6127] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:29:28 2022] DELETE /identity/v3/domains/09aa734ecb124b0ebe2d47914143856a/config => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:28.455631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdedf01-78f7-48b5-b5d2-59ba9a3d7eab tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:28.492420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdedf01-78f7-48b5-b5d2-59ba9a3d7eab tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:28.499082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb5615-e751-4b9c-892d-b7f346480c34 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:28.500065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb5615-e751-4b9c-892d-b7f346480c34 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:28.500606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb5615-e751-4b9c-892d-b7f346480c34 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:28.501705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb5615-e751-4b9c-892d-b7f346480c34 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/09aa734ecb124b0ebe2d47914143856a/config` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:28.503944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb5615-e751-4b9c-892d-b7f346480c34 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=09aa734ecb124b0ebe2d47914143856a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:28.506068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb5615-e751-4b9c-892d-b7f346480c34 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-8dfb5615-e751-4b9c-892d-b7f346480c34 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Could not find any options in domain configuration for domain 09aa734ecb124b0ebe2d47914143856a.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 09aa734ecb124b0ebe2d47914143856a. Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 02 01:29:28.520140 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 02 01:29:28.521419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 02 01:29:28.521419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 02 01:29:28.521419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:28.521419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:28.521419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 02 01:29:28.521419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 02 01:29:28.521419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 09aa734ecb124b0ebe2d47914143856a. Oct 02 01:29:28.521419 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:28.538902 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3077/6128] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:29:28 2022] GET /identity/v3/domains/09aa734ecb124b0ebe2d47914143856a/config => generated 151 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:29:28.543526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa630fa-5435-44be-89a9-4f6f3b273b59 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:28.554398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa630fa-5435-44be-89a9-4f6f3b273b59 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:28.577101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e985f71-b5af-4ed4-a7e5-d966fb9951d4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:28.577660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e985f71-b5af-4ed4-a7e5-d966fb9951d4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:28.577943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e985f71-b5af-4ed4-a7e5-d966fb9951d4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:28.578219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e985f71-b5af-4ed4-a7e5-d966fb9951d4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/09aa734ecb124b0ebe2d47914143856a/config` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:28.578862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e985f71-b5af-4ed4-a7e5-d966fb9951d4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=09aa734ecb124b0ebe2d47914143856a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:28.580513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e985f71-b5af-4ed4-a7e5-d966fb9951d4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:28.607672 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3052/6129] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:29:28 2022] DELETE /identity/v3/domains/09aa734ecb124b0ebe2d47914143856a/config => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:28.611878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb5615-e751-4b9c-892d-b7f346480c34 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:28.630264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb5615-e751-4b9c-892d-b7f346480c34 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:28.642669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:28.643746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:28.644299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:28.644655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/09aa734ecb124b0ebe2d47914143856a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:28.647880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=09aa734ecb124b0ebe2d47914143856a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:28.650075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:28.684692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '09aa734ecb124b0ebe2d47914143856a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:28.686095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '09aa734ecb124b0ebe2d47914143856a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:28.753061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '09aa734ecb124b0ebe2d47914143856a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:28.754654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '09aa734ecb124b0ebe2d47914143856a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:28.765176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e985f71-b5af-4ed4-a7e5-d966fb9951d4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:28.767100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7e985f71-b5af-4ed4-a7e5-d966fb9951d4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:28.776021 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3078/6130] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:29:28 2022] PATCH /identity/v3/domains/09aa734ecb124b0ebe2d47914143856a => generated 277 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:28.791324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e985f71-b5af-4ed4-a7e5-d966fb9951d4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:28.909583 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:28.956637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:28.958068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:28.959047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:28.959342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/09aa734ecb124b0ebe2d47914143856a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:29.023575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=09aa734ecb124b0ebe2d47914143856a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:29.027412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:29.104336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '09aa734ecb124b0ebe2d47914143856a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:29.112553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '09aa734ecb124b0ebe2d47914143856a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:29.239251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09aa734ecb124b0ebe2d47914143856a', 'request_id': 'req-255dd0a1-f065-462e-8ee6-05923d5d17b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:29.252348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09aa734ecb124b0ebe2d47914143856a', 'request_id': 'req-255dd0a1-f065-462e-8ee6-05923d5d17b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:29.272138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09aa734ecb124b0ebe2d47914143856a', 'request_id': 'req-255dd0a1-f065-462e-8ee6-05923d5d17b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:29.300254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] The token cache is being invalidate because project 09aa734ecb124b0ebe2d47914143856a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:29.300551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:29.301223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:29.319719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '09aa734ecb124b0ebe2d47914143856a', 'request_id': 'req-255dd0a1-f065-462e-8ee6-05923d5d17b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:29.320486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '09aa734ecb124b0ebe2d47914143856a', 'request_id': 'req-255dd0a1-f065-462e-8ee6-05923d5d17b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:29.321125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '09aa734ecb124b0ebe2d47914143856a', 'request_id': 'req-255dd0a1-f065-462e-8ee6-05923d5d17b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:29.346557 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3053/6131] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:29:28 2022] DELETE /identity/v3/domains/09aa734ecb124b0ebe2d47914143856a => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:29.351477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:29.359005 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:29.369982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f3ae1-451b-4cdb-bb70-44550826e33d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:29.517334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce606c-f3f4-4a85-8233-39890fd2a558 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:29.518180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce606c-f3f4-4a85-8233-39890fd2a558 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:29.520779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce606c-f3f4-4a85-8233-39890fd2a558 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:29.521287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce606c-f3f4-4a85-8233-39890fd2a558 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:29.522169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce606c-f3f4-4a85-8233-39890fd2a558 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:29.524630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce606c-f3f4-4a85-8233-39890fd2a558 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:29.548739 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3079/6132] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:29:29 2022] POST /identity/v3/domains => generated 277 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:29.552692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:29.554559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:29.568869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dd0a1-f065-462e-8ee6-05923d5d17b8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:29.713610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4a5cf-a0f3-4792-965a-5b68633a0105 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:29.718491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4a5cf-a0f3-4792-965a-5b68633a0105 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:29.719034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4a5cf-a0f3-4792-965a-5b68633a0105 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:29.719691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4a5cf-a0f3-4792-965a-5b68633a0105 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:29.721388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4a5cf-a0f3-4792-965a-5b68633a0105 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=e46f7899acff42ae854d13f2da4d3f4b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:29.722787 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-53a4a5cf-a0f3-4792-965a-5b68633a0105 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:29.722787 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:29:29.722787 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:29:29.724511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4a5cf-a0f3-4792-965a-5b68633a0105 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:29.850348 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:29.876512 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3054/6133] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:29:29 2022] PUT /identity/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config => generated 138 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:29.878215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce606c-f3f4-4a85-8233-39890fd2a558 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:29.896210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce606c-f3f4-4a85-8233-39890fd2a558 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:29.912057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecf7ea-25d1-428a-af78-3c7a3ea5a686 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:29.913017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecf7ea-25d1-428a-af78-3c7a3ea5a686 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:29.913451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecf7ea-25d1-428a-af78-3c7a3ea5a686 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:29.913874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecf7ea-25d1-428a-af78-3c7a3ea5a686 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:29.914743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecf7ea-25d1-428a-af78-3c7a3ea5a686 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=e46f7899acff42ae854d13f2da4d3f4b, group=identity)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:29.915896 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-52ecf7ea-25d1-428a-af78-3c7a3ea5a686 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:29.915896 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:29:29.915896 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:29:29.917147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecf7ea-25d1-428a-af78-3c7a3ea5a686 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:29.990200 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3080/6134] 10.222.0.23 () {60 vars in 1297 bytes} [Sun Oct 2 01:29:29 2022] PATCH /identity/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity => generated 177 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:29.991740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4a5cf-a0f3-4792-965a-5b68633a0105 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:30.007149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4a5cf-a0f3-4792-965a-5b68633a0105 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:30.021976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d840f-f86b-4cb6-b40d-b2f94257167d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:30.022957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d840f-f86b-4cb6-b40d-b2f94257167d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:30.023317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d840f-f86b-4cb6-b40d-b2f94257167d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:30.023668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d840f-f86b-4cb6-b40d-b2f94257167d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity/driver` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:30.024419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d840f-f86b-4cb6-b40d-b2f94257167d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=e46f7899acff42ae854d13f2da4d3f4b, group=identity, option=driver)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:30.029186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d840f-f86b-4cb6-b40d-b2f94257167d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:30.081608 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3055/6135] 10.222.0.23 () {60 vars in 1318 bytes} [Sun Oct 2 01:29:29 2022] PATCH /identity/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity/driver => generated 176 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:30.085318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecf7ea-25d1-428a-af78-3c7a3ea5a686 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:30.096880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecf7ea-25d1-428a-af78-3c7a3ea5a686 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:30.112358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecbc40-8d94-46df-a442-e9f1be3e81d5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:30.113045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbc40-8d94-46df-a442-e9f1be3e81d5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:30.113326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbc40-8d94-46df-a442-e9f1be3e81d5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:30.113603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbc40-8d94-46df-a442-e9f1be3e81d5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity/driver` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:30.114778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecbc40-8d94-46df-a442-e9f1be3e81d5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e46f7899acff42ae854d13f2da4d3f4b, group=identity, option=driver)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:30.116683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecbc40-8d94-46df-a442-e9f1be3e81d5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:30.140350 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3081/6136] 10.222.0.23 () {58 vars in 1299 bytes} [Sun Oct 2 01:29:30 2022] DELETE /identity/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity/driver => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:30.144837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d840f-f86b-4cb6-b40d-b2f94257167d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:30.161005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d840f-f86b-4cb6-b40d-b2f94257167d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:30.173987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3639a5-3562-4aae-9c24-6ad562ab1f2d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:30.189735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3639a5-3562-4aae-9c24-6ad562ab1f2d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:30.189735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3639a5-3562-4aae-9c24-6ad562ab1f2d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:30.189735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3639a5-3562-4aae-9c24-6ad562ab1f2d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity/driver` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:30.191450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3639a5-3562-4aae-9c24-6ad562ab1f2d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e46f7899acff42ae854d13f2da4d3f4b, group=identity, option=driver)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:30.197148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3639a5-3562-4aae-9c24-6ad562ab1f2d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ff3639a5-3562-4aae-9c24-6ad562ab1f2d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Could not find option driver in group identity in domain configuration for domain e46f7899acff42ae854d13f2da4d3f4b.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain e46f7899acff42ae854d13f2da4d3f4b. Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:30.234812 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 02 01:29:30.235914 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 02 01:29:30.235914 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 02 01:29:30.235914 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 02 01:29:30.235914 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:30.235914 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:30.235914 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 02 01:29:30.235914 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 02 01:29:30.235914 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain e46f7899acff42ae854d13f2da4d3f4b. Oct 02 01:29:30.235914 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:30.247449 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3056/6137] 10.222.0.23 () {58 vars in 1296 bytes} [Sun Oct 2 01:29:30 2022] GET /identity/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity/driver => generated 171 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:29:30.248607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecbc40-8d94-46df-a442-e9f1be3e81d5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:30.259638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecbc40-8d94-46df-a442-e9f1be3e81d5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:30.277606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcffd8-1c34-4921-b1ed-1c44621125cb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:30.278711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcffd8-1c34-4921-b1ed-1c44621125cb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:30.279267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcffd8-1c34-4921-b1ed-1c44621125cb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:30.279756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcffd8-1c34-4921-b1ed-1c44621125cb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:30.280588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcffd8-1c34-4921-b1ed-1c44621125cb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e46f7899acff42ae854d13f2da4d3f4b, group=identity)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:30.284223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcffd8-1c34-4921-b1ed-1c44621125cb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:30.319439 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3082/6138] 10.222.0.23 () {58 vars in 1278 bytes} [Sun Oct 2 01:29:30 2022] DELETE /identity/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:29:30.325166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3639a5-3562-4aae-9c24-6ad562ab1f2d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:30.341394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3639a5-3562-4aae-9c24-6ad562ab1f2d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:30.348933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5520832-f842-40e3-ad26-bb5cc8744d08 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:30.350933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5520832-f842-40e3-ad26-bb5cc8744d08 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:30.351593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5520832-f842-40e3-ad26-bb5cc8744d08 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:30.352258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5520832-f842-40e3-ad26-bb5cc8744d08 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:30.356153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5520832-f842-40e3-ad26-bb5cc8744d08 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e46f7899acff42ae854d13f2da4d3f4b, group=identity)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:30.360137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5520832-f842-40e3-ad26-bb5cc8744d08 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c5520832-f842-40e3-ad26-bb5cc8744d08 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Could not find group identity in domain configuration for domain e46f7899acff42ae854d13f2da4d3f4b.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain e46f7899acff42ae854d13f2da4d3f4b. Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:30.377751 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 02 01:29:30.378830 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 02 01:29:30.378830 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 02 01:29:30.378830 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 02 01:29:30.378830 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:30.378830 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:30.378830 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 02 01:29:30.378830 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 02 01:29:30.378830 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain e46f7899acff42ae854d13f2da4d3f4b. Oct 02 01:29:30.378830 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:30.381316 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3057/6139] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 2 01:29:30 2022] GET /identity/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config/identity => generated 154 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:29:30.387273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcffd8-1c34-4921-b1ed-1c44621125cb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:30.398589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcffd8-1c34-4921-b1ed-1c44621125cb tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:30.411385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995924f1-8a24-4d7a-b393-c383d5827bff tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:30.413076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995924f1-8a24-4d7a-b393-c383d5827bff tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:30.413564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995924f1-8a24-4d7a-b393-c383d5827bff tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:30.414030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995924f1-8a24-4d7a-b393-c383d5827bff tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:30.415106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995924f1-8a24-4d7a-b393-c383d5827bff tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e46f7899acff42ae854d13f2da4d3f4b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:30.416930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995924f1-8a24-4d7a-b393-c383d5827bff tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:30.431672 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3083/6140] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:29:30 2022] DELETE /identity/v3/domains/e46f7899acff42ae854d13f2da4d3f4b/config => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:30.436498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5520832-f842-40e3-ad26-bb5cc8744d08 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:30.453926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5520832-f842-40e3-ad26-bb5cc8744d08 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:30.459560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:30.460594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:30.460979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:30.461362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/e46f7899acff42ae854d13f2da4d3f4b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:30.463416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e46f7899acff42ae854d13f2da4d3f4b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:30.465543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:30.492638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:30.493529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:30.590145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:30.592399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:30.601342 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3058/6141] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:29:30 2022] PATCH /identity/v3/domains/e46f7899acff42ae854d13f2da4d3f4b => generated 278 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:29:30.606837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995924f1-8a24-4d7a-b393-c383d5827bff tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:30.608717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-995924f1-8a24-4d7a-b393-c383d5827bff tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:30.666357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995924f1-8a24-4d7a-b393-c383d5827bff tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:30.853240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:30.853988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:30.854235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:30.854513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/e46f7899acff42ae854d13f2da4d3f4b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:30.881147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e46f7899acff42ae854d13f2da4d3f4b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:30.882837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:30.897839 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:30.962177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:30.978572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:31.075915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b', 'request_id': 'req-481c1f13-4e78-40e9-b6d9-ba03f318c64b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:31.101168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b', 'request_id': 'req-481c1f13-4e78-40e9-b6d9-ba03f318c64b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:31.136343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b', 'request_id': 'req-481c1f13-4e78-40e9-b6d9-ba03f318c64b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:31.190953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] The token cache is being invalidate because project e46f7899acff42ae854d13f2da4d3f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:31.191336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:31.195032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:31.227608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b', 'request_id': 'req-481c1f13-4e78-40e9-b6d9-ba03f318c64b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:31.231989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b', 'request_id': 'req-481c1f13-4e78-40e9-b6d9-ba03f318c64b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:31.233582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e46f7899acff42ae854d13f2da4d3f4b', 'request_id': 'req-481c1f13-4e78-40e9-b6d9-ba03f318c64b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:31.246079 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3084/6142] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:29:30 2022] DELETE /identity/v3/domains/e46f7899acff42ae854d13f2da4d3f4b => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:31.251302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.263326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f2f67-55db-49d3-9467-823baa41ba5c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.389639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ac2e7-1de1-4c21-8f35-7271697d890e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.391494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ac2e7-1de1-4c21-8f35-7271697d890e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.392451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ac2e7-1de1-4c21-8f35-7271697d890e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.393150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ac2e7-1de1-4c21-8f35-7271697d890e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.394774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ac2e7-1de1-4c21-8f35-7271697d890e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:31.397604 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-9b5ac2e7-1de1-4c21-8f35-7271697d890e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:31.397604 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:29:31.397604 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:29:31.400190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ac2e7-1de1-4c21-8f35-7271697d890e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:31.412286 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3059/6143] 10.222.0.23 () {58 vars in 1173 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:31.415964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.418843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:31.440777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c1f13-4e78-40e9-b6d9-ba03f318c64b tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.470811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5f050-0ef6-4de2-8b6c-13dd88c8ce69 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.474465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f050-0ef6-4de2-8b6c-13dd88c8ce69 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.476537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f050-0ef6-4de2-8b6c-13dd88c8ce69 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.477974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f050-0ef6-4de2-8b6c-13dd88c8ce69 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.478801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5f050-0ef6-4de2-8b6c-13dd88c8ce69 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:31.481881 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-6de5f050-0ef6-4de2-8b6c-13dd88c8ce69 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:31.481881 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:29:31.481881 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:29:31.484840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5f050-0ef6-4de2-8b6c-13dd88c8ce69 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:31.492625 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3085/6144] 10.222.0.23 () {58 vars in 1200 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:31.505234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ac2e7-1de1-4c21-8f35-7271697d890e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.520052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ac2e7-1de1-4c21-8f35-7271697d890e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.528254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b082b9-56f1-4895-ace0-3a716ba95b1f tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.529390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b082b9-56f1-4895-ace0-3a716ba95b1f tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.529865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b082b9-56f1-4895-ace0-3a716ba95b1f tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.530369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b082b9-56f1-4895-ace0-3a716ba95b1f tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.531283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b082b9-56f1-4895-ace0-3a716ba95b1f tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:31.533457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b082b9-56f1-4895-ace0-3a716ba95b1f tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:31.536262 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3060/6145] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:31.540649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5f050-0ef6-4de2-8b6c-13dd88c8ce69 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.574744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5f050-0ef6-4de2-8b6c-13dd88c8ce69 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.592405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd75f8-a543-476c-b937-deca48bdab97 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.593071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd75f8-a543-476c-b937-deca48bdab97 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.593352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd75f8-a543-476c-b937-deca48bdab97 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.593627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd75f8-a543-476c-b937-deca48bdab97 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.594216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd75f8-a543-476c-b937-deca48bdab97 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:31.600697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd75f8-a543-476c-b937-deca48bdab97 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:31.602901 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3086/6146] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:31.606578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b082b9-56f1-4895-ace0-3a716ba95b1f tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.622776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b082b9-56f1-4895-ace0-3a716ba95b1f tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.639267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1c93-c571-4621-a94e-e8033304aa27 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.640251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1c93-c571-4621-a94e-e8033304aa27 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.641064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1c93-c571-4621-a94e-e8033304aa27 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.642389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1c93-c571-4621-a94e-e8033304aa27 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.643985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd1c93-c571-4621-a94e-e8033304aa27 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:31.646344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd1c93-c571-4621-a94e-e8033304aa27 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:31.648492 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3061/6147] 10.222.0.23 () {58 vars in 1188 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:31.656312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd75f8-a543-476c-b937-deca48bdab97 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.670895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd75f8-a543-476c-b937-deca48bdab97 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.686382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2a845-7c40-452a-b993-1fc53d8195f0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.687146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2a845-7c40-452a-b993-1fc53d8195f0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.687427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2a845-7c40-452a-b993-1fc53d8195f0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.687698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2a845-7c40-452a-b993-1fc53d8195f0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.688293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2a845-7c40-452a-b993-1fc53d8195f0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:31.689897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2a845-7c40-452a-b993-1fc53d8195f0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:31.691333 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3087/6148] 10.222.0.23 () {58 vars in 1200 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:31.695261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1c93-c571-4621-a94e-e8033304aa27 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.713536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1c93-c571-4621-a94e-e8033304aa27 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.736446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d8b58-3849-415d-94ea-6754ae7d36ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.740402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d8b58-3849-415d-94ea-6754ae7d36ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.740764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d8b58-3849-415d-94ea-6754ae7d36ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.741731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d8b58-3849-415d-94ea-6754ae7d36ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.742473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d8b58-3849-415d-94ea-6754ae7d36ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:31.746299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d8b58-3849-415d-94ea-6754ae7d36ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:31.752950 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3062/6149] 10.222.0.23 () {58 vars in 1203 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:31.754429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2a845-7c40-452a-b993-1fc53d8195f0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.774511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2a845-7c40-452a-b993-1fc53d8195f0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.787541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62238bdc-05d7-4737-b733-fa032ae577d0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.788256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62238bdc-05d7-4737-b733-fa032ae577d0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.788542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62238bdc-05d7-4737-b733-fa032ae577d0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.788843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62238bdc-05d7-4737-b733-fa032ae577d0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.789445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62238bdc-05d7-4737-b733-fa032ae577d0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:31.791086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62238bdc-05d7-4737-b733-fa032ae577d0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:31.796002 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3088/6150] 10.222.0.23 () {58 vars in 1209 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:31.797755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d8b58-3849-415d-94ea-6754ae7d36ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.813095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d8b58-3849-415d-94ea-6754ae7d36ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.818750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f03fb2-3209-4fb6-9f3f-0b4069f50cf2 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.819753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f03fb2-3209-4fb6-9f3f-0b4069f50cf2 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.820244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f03fb2-3209-4fb6-9f3f-0b4069f50cf2 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.820742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f03fb2-3209-4fb6-9f3f-0b4069f50cf2 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.821672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f03fb2-3209-4fb6-9f3f-0b4069f50cf2 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:31.823835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f03fb2-3209-4fb6-9f3f-0b4069f50cf2 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:31.828343 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3063/6151] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:31.830168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62238bdc-05d7-4737-b733-fa032ae577d0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.865450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62238bdc-05d7-4737-b733-fa032ae577d0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.882229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab497507-e229-4a40-8902-3a12ae5a0495 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.882967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab497507-e229-4a40-8902-3a12ae5a0495 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.883265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab497507-e229-4a40-8902-3a12ae5a0495 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.883542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab497507-e229-4a40-8902-3a12ae5a0495 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.884144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab497507-e229-4a40-8902-3a12ae5a0495 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:31.885759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab497507-e229-4a40-8902-3a12ae5a0495 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:31.895555 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3089/6152] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 02 01:29:31.899649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f03fb2-3209-4fb6-9f3f-0b4069f50cf2 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.925508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f03fb2-3209-4fb6-9f3f-0b4069f50cf2 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.947450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e2232-6dd8-4299-a59d-78d3914fa868 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.948133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e2232-6dd8-4299-a59d-78d3914fa868 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.948421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e2232-6dd8-4299-a59d-78d3914fa868 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.948768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e2232-6dd8-4299-a59d-78d3914fa868 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.949372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e2232-6dd8-4299-a59d-78d3914fa868 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:31.955587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e2232-6dd8-4299-a59d-78d3914fa868 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:31.956768 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3064/6153] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:31.960997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab497507-e229-4a40-8902-3a12ae5a0495 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:31.978816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab497507-e229-4a40-8902-3a12ae5a0495 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:31.996103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563f665-6c88-46d7-bab5-1d0b8d26287e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:31.997058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563f665-6c88-46d7-bab5-1d0b8d26287e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:31.997515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563f665-6c88-46d7-bab5-1d0b8d26287e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:31.998062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563f665-6c88-46d7-bab5-1d0b8d26287e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:31.998859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563f665-6c88-46d7-bab5-1d0b8d26287e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.000812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563f665-6c88-46d7-bab5-1d0b8d26287e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.002911 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3090/6154] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:31 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 02 01:29:32.006393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e2232-6dd8-4299-a59d-78d3914fa868 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.028331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e2232-6dd8-4299-a59d-78d3914fa868 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.043386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d8a9-9ac2-4c58-a9d5-3f7e05fe16c4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.044068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d8a9-9ac2-4c58-a9d5-3f7e05fe16c4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.044352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d8a9-9ac2-4c58-a9d5-3f7e05fe16c4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.044857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d8a9-9ac2-4c58-a9d5-3f7e05fe16c4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.045475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637d8a9-9ac2-4c58-a9d5-3f7e05fe16c4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.047151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637d8a9-9ac2-4c58-a9d5-3f7e05fe16c4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.051189 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3065/6155] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.052593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563f665-6c88-46d7-bab5-1d0b8d26287e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.067662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563f665-6c88-46d7-bab5-1d0b8d26287e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.084205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664a98f-bab6-46b9-bda1-e8d20817b83a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.084894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664a98f-bab6-46b9-bda1-e8d20817b83a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.085186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664a98f-bab6-46b9-bda1-e8d20817b83a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.085457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664a98f-bab6-46b9-bda1-e8d20817b83a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.088675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664a98f-bab6-46b9-bda1-e8d20817b83a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.096201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664a98f-bab6-46b9-bda1-e8d20817b83a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.099915 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3091/6156] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.104392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d8a9-9ac2-4c58-a9d5-3f7e05fe16c4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.119935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d8a9-9ac2-4c58-a9d5-3f7e05fe16c4 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.152878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88f10b-7b9a-48f1-a86e-9390e4f741e9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.153566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f10b-7b9a-48f1-a86e-9390e4f741e9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.153852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f10b-7b9a-48f1-a86e-9390e4f741e9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.154131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f10b-7b9a-48f1-a86e-9390e4f741e9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.154766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88f10b-7b9a-48f1-a86e-9390e4f741e9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.158500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88f10b-7b9a-48f1-a86e-9390e4f741e9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.160097 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3066/6157] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.163788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664a98f-bab6-46b9-bda1-e8d20817b83a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.179981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664a98f-bab6-46b9-bda1-e8d20817b83a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.195361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a32d-a906-471a-80b2-09dee3644fa9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.196034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a32d-a906-471a-80b2-09dee3644fa9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.196323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a32d-a906-471a-80b2-09dee3644fa9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.196604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a32d-a906-471a-80b2-09dee3644fa9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.197221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4a32d-a906-471a-80b2-09dee3644fa9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.199091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4a32d-a906-471a-80b2-09dee3644fa9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.200934 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3092/6158] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.204632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88f10b-7b9a-48f1-a86e-9390e4f741e9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.220985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88f10b-7b9a-48f1-a86e-9390e4f741e9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.231468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefd355-d150-4c26-9a89-32b005b3e2e1 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.231662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefd355-d150-4c26-9a89-32b005b3e2e1 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.231932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefd355-d150-4c26-9a89-32b005b3e2e1 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.232214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefd355-d150-4c26-9a89-32b005b3e2e1 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.234167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefd355-d150-4c26-9a89-32b005b3e2e1 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.237759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefd355-d150-4c26-9a89-32b005b3e2e1 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.241177 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3067/6159] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.244923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a32d-a906-471a-80b2-09dee3644fa9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.263663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a32d-a906-471a-80b2-09dee3644fa9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.277511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8081e-b231-4a8c-9cdd-e907ec8a60ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.278592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8081e-b231-4a8c-9cdd-e907ec8a60ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.279081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8081e-b231-4a8c-9cdd-e907ec8a60ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.279589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8081e-b231-4a8c-9cdd-e907ec8a60ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.280359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8081e-b231-4a8c-9cdd-e907ec8a60ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.282118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8081e-b231-4a8c-9cdd-e907ec8a60ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.287826 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3093/6160] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.290221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefd355-d150-4c26-9a89-32b005b3e2e1 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.303067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefd355-d150-4c26-9a89-32b005b3e2e1 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.316117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ba34d-2b9f-435f-8b07-c3f66acbbdd7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.316796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ba34d-2b9f-435f-8b07-c3f66acbbdd7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.317083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ba34d-2b9f-435f-8b07-c3f66acbbdd7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.317362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ba34d-2b9f-435f-8b07-c3f66acbbdd7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.317957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ba34d-2b9f-435f-8b07-c3f66acbbdd7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.319621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ba34d-2b9f-435f-8b07-c3f66acbbdd7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.322931 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3068/6161] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.327581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8081e-b231-4a8c-9cdd-e907ec8a60ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.341151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8081e-b231-4a8c-9cdd-e907ec8a60ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.366934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a1549-b9b0-4404-8fc1-617210e71476 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.367852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a1549-b9b0-4404-8fc1-617210e71476 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.368309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a1549-b9b0-4404-8fc1-617210e71476 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.368985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a1549-b9b0-4404-8fc1-617210e71476 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.370163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a1549-b9b0-4404-8fc1-617210e71476 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.372836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a1549-b9b0-4404-8fc1-617210e71476 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.379809 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3094/6162] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.382869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ba34d-2b9f-435f-8b07-c3f66acbbdd7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.399702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ba34d-2b9f-435f-8b07-c3f66acbbdd7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.414389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba54b1-89a1-4f7b-a569-fe252d6ff65c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.415572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba54b1-89a1-4f7b-a569-fe252d6ff65c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.416489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba54b1-89a1-4f7b-a569-fe252d6ff65c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.416949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba54b1-89a1-4f7b-a569-fe252d6ff65c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.418472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba54b1-89a1-4f7b-a569-fe252d6ff65c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.420160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba54b1-89a1-4f7b-a569-fe252d6ff65c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.424860 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3069/6163] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.428547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a1549-b9b0-4404-8fc1-617210e71476 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.445032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a1549-b9b0-4404-8fc1-617210e71476 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.459570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f576c30-4044-46e2-a627-f3d6bce5fcb8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.461176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576c30-4044-46e2-a627-f3d6bce5fcb8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.462122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576c30-4044-46e2-a627-f3d6bce5fcb8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.463611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576c30-4044-46e2-a627-f3d6bce5fcb8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.467077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f576c30-4044-46e2-a627-f3d6bce5fcb8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.470711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f576c30-4044-46e2-a627-f3d6bce5fcb8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.472167 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3095/6164] 10.222.0.23 () {58 vars in 1257 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 02 01:29:32.476718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba54b1-89a1-4f7b-a569-fe252d6ff65c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.491576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba54b1-89a1-4f7b-a569-fe252d6ff65c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.504879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a2583-2c9f-413f-b32d-e00daf2986b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.519651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a2583-2c9f-413f-b32d-e00daf2986b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.522586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a2583-2c9f-413f-b32d-e00daf2986b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.523625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a2583-2c9f-413f-b32d-e00daf2986b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.524269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a2583-2c9f-413f-b32d-e00daf2986b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.535109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a2583-2c9f-413f-b32d-e00daf2986b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.541819 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3070/6165] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.543412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f576c30-4044-46e2-a627-f3d6bce5fcb8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.565793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f576c30-4044-46e2-a627-f3d6bce5fcb8 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.577942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da058b37-947f-4c2f-b9df-4f795f6ee020 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.578624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058b37-947f-4c2f-b9df-4f795f6ee020 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.578938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058b37-947f-4c2f-b9df-4f795f6ee020 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.579216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058b37-947f-4c2f-b9df-4f795f6ee020 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.580359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da058b37-947f-4c2f-b9df-4f795f6ee020 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.581390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da058b37-947f-4c2f-b9df-4f795f6ee020 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.582926 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3096/6166] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.587094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a2583-2c9f-413f-b32d-e00daf2986b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.604062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a2583-2c9f-413f-b32d-e00daf2986b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.618068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfea0e-440d-4ea2-b7b4-c3365d15c2ed tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.618922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfea0e-440d-4ea2-b7b4-c3365d15c2ed tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.619041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfea0e-440d-4ea2-b7b4-c3365d15c2ed tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.619324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfea0e-440d-4ea2-b7b4-c3365d15c2ed tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.619926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfea0e-440d-4ea2-b7b4-c3365d15c2ed tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.622584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfea0e-440d-4ea2-b7b4-c3365d15c2ed tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.626463 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3071/6167] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.627662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da058b37-947f-4c2f-b9df-4f795f6ee020 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.638258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da058b37-947f-4c2f-b9df-4f795f6ee020 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.665773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4477c94-ba1c-4a59-b6a9-7f94694b43b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.666532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4477c94-ba1c-4a59-b6a9-7f94694b43b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.666845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4477c94-ba1c-4a59-b6a9-7f94694b43b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.667123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4477c94-ba1c-4a59-b6a9-7f94694b43b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.667785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4477c94-ba1c-4a59-b6a9-7f94694b43b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.670212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4477c94-ba1c-4a59-b6a9-7f94694b43b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.679338 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3097/6168] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.680392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfea0e-440d-4ea2-b7b4-c3365d15c2ed tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.696608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfea0e-440d-4ea2-b7b4-c3365d15c2ed tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.708148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b13e3d-462c-47fc-abae-5f051dea9535 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.709951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13e3d-462c-47fc-abae-5f051dea9535 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.710258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13e3d-462c-47fc-abae-5f051dea9535 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.710569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13e3d-462c-47fc-abae-5f051dea9535 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.713201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b13e3d-462c-47fc-abae-5f051dea9535 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.734762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b13e3d-462c-47fc-abae-5f051dea9535 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.738867 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3072/6169] 10.222.0.23 () {58 vars in 1290 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.740159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4477c94-ba1c-4a59-b6a9-7f94694b43b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.755868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4477c94-ba1c-4a59-b6a9-7f94694b43b5 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.765399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fa109-3414-4833-b405-17bff40326a0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.766908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa109-3414-4833-b405-17bff40326a0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.768412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa109-3414-4833-b405-17bff40326a0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.770173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa109-3414-4833-b405-17bff40326a0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.771045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fa109-3414-4833-b405-17bff40326a0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.775274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fa109-3414-4833-b405-17bff40326a0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.778647 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3098/6170] 10.222.0.23 () {58 vars in 1257 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 02 01:29:32.783458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b13e3d-462c-47fc-abae-5f051dea9535 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.798512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b13e3d-462c-47fc-abae-5f051dea9535 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.810131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9c717-32db-4451-ba2f-537ef8d51281 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.811115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9c717-32db-4451-ba2f-537ef8d51281 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.811438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9c717-32db-4451-ba2f-537ef8d51281 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.811758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9c717-32db-4451-ba2f-537ef8d51281 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.812409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9c717-32db-4451-ba2f-537ef8d51281 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.814098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9c717-32db-4451-ba2f-537ef8d51281 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.821420 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3073/6171] 10.222.0.23 () {58 vars in 1266 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.825803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fa109-3414-4833-b405-17bff40326a0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.840204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fa109-3414-4833-b405-17bff40326a0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.865995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8838978-3b08-4963-b451-7f7f2816c460 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.867115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838978-3b08-4963-b451-7f7f2816c460 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.867605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838978-3b08-4963-b451-7f7f2816c460 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.868071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838978-3b08-4963-b451-7f7f2816c460 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.869356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8838978-3b08-4963-b451-7f7f2816c460 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.872284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8838978-3b08-4963-b451-7f7f2816c460 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.874208 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3099/6172] 10.222.0.23 () {58 vars in 1308 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.877892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9c717-32db-4451-ba2f-537ef8d51281 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.890277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9c717-32db-4451-ba2f-537ef8d51281 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.912322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381653f3-bd2e-42c3-8586-9eb98a10c261 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.913005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381653f3-bd2e-42c3-8586-9eb98a10c261 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.913295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381653f3-bd2e-42c3-8586-9eb98a10c261 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.913578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381653f3-bd2e-42c3-8586-9eb98a10c261 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.914186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381653f3-bd2e-42c3-8586-9eb98a10c261 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.915956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381653f3-bd2e-42c3-8586-9eb98a10c261 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.917972 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3074/6173] 10.222.0.23 () {58 vars in 1290 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.921593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8838978-3b08-4963-b451-7f7f2816c460 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.937549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8838978-3b08-4963-b451-7f7f2816c460 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:32.947834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d9c50-d5e4-4c6f-9d89-12d19d4cbcd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:32.950435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d9c50-d5e4-4c6f-9d89-12d19d4cbcd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:32.951031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d9c50-d5e4-4c6f-9d89-12d19d4cbcd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:32.951549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d9c50-d5e4-4c6f-9d89-12d19d4cbcd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:32.954012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d9c50-d5e4-4c6f-9d89-12d19d4cbcd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:32.959288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d9c50-d5e4-4c6f-9d89-12d19d4cbcd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:32.962955 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3100/6174] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:32.965127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381653f3-bd2e-42c3-8586-9eb98a10c261 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:32.977568 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:32.986061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381653f3-bd2e-42c3-8586-9eb98a10c261 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.001234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e85ea-c80d-458d-9afb-189e4cc30b17 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.002171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e85ea-c80d-458d-9afb-189e4cc30b17 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.002679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e85ea-c80d-458d-9afb-189e4cc30b17 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.003135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e85ea-c80d-458d-9afb-189e4cc30b17 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.003931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e85ea-c80d-458d-9afb-189e4cc30b17 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.009642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e85ea-c80d-458d-9afb-189e4cc30b17 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.012893 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3075/6175] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:29:32 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.017186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d9c50-d5e4-4c6f-9d89-12d19d4cbcd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.031893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d9c50-d5e4-4c6f-9d89-12d19d4cbcd3 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.046924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5c0ad-c217-4eb9-831f-c14a57eadd13 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.047741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5c0ad-c217-4eb9-831f-c14a57eadd13 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.048112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5c0ad-c217-4eb9-831f-c14a57eadd13 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.048676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5c0ad-c217-4eb9-831f-c14a57eadd13 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.049479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5c0ad-c217-4eb9-831f-c14a57eadd13 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.051348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5c0ad-c217-4eb9-831f-c14a57eadd13 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.052794 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3101/6176] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.057438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e85ea-c80d-458d-9afb-189e4cc30b17 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.071050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e85ea-c80d-458d-9afb-189e4cc30b17 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.094428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b45454-5e1c-49de-af69-f3d969ec3ece tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.101138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b45454-5e1c-49de-af69-f3d969ec3ece tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.101349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b45454-5e1c-49de-af69-f3d969ec3ece tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.101587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b45454-5e1c-49de-af69-f3d969ec3ece tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.108426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b45454-5e1c-49de-af69-f3d969ec3ece tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.110853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b45454-5e1c-49de-af69-f3d969ec3ece tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.112123 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3076/6177] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.116240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5c0ad-c217-4eb9-831f-c14a57eadd13 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.134762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5c0ad-c217-4eb9-831f-c14a57eadd13 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.149260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f4a6c-3515-4c98-aa93-13b15eec7d01 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.150194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f4a6c-3515-4c98-aa93-13b15eec7d01 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.150722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f4a6c-3515-4c98-aa93-13b15eec7d01 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.151219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f4a6c-3515-4c98-aa93-13b15eec7d01 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.152136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f4a6c-3515-4c98-aa93-13b15eec7d01 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.154365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f4a6c-3515-4c98-aa93-13b15eec7d01 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.155872 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3102/6178] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.160315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b45454-5e1c-49de-af69-f3d969ec3ece tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.179828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b45454-5e1c-49de-af69-f3d969ec3ece tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.185533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910f77-0190-4edb-bb69-4da7f918f895 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.186202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910f77-0190-4edb-bb69-4da7f918f895 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.186543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910f77-0190-4edb-bb69-4da7f918f895 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.186858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910f77-0190-4edb-bb69-4da7f918f895 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.187877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9910f77-0190-4edb-bb69-4da7f918f895 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.200405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9910f77-0190-4edb-bb69-4da7f918f895 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.203291 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3077/6179] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.217045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f4a6c-3515-4c98-aa93-13b15eec7d01 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.250995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f4a6c-3515-4c98-aa93-13b15eec7d01 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.271635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f31ea-2142-42d6-b55b-a456594fa06c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.272433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f31ea-2142-42d6-b55b-a456594fa06c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.272810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f31ea-2142-42d6-b55b-a456594fa06c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.273185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f31ea-2142-42d6-b55b-a456594fa06c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.275120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f31ea-2142-42d6-b55b-a456594fa06c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.285399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f31ea-2142-42d6-b55b-a456594fa06c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.286970 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3103/6180] 10.222.0.23 () {58 vars in 1257 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.291007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910f77-0190-4edb-bb69-4da7f918f895 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.302736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910f77-0190-4edb-bb69-4da7f918f895 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.322231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97fd80-0dd4-476c-aba5-fb76361ab143 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.322938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97fd80-0dd4-476c-aba5-fb76361ab143 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.323224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97fd80-0dd4-476c-aba5-fb76361ab143 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.323504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97fd80-0dd4-476c-aba5-fb76361ab143 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.324803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97fd80-0dd4-476c-aba5-fb76361ab143 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.327021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97fd80-0dd4-476c-aba5-fb76361ab143 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.342091 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3078/6181] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.348490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f31ea-2142-42d6-b55b-a456594fa06c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.399788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f31ea-2142-42d6-b55b-a456594fa06c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.415534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f446ff-c527-494f-913c-df90ea3b333d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.416980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f446ff-c527-494f-913c-df90ea3b333d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.417435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f446ff-c527-494f-913c-df90ea3b333d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.417832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f446ff-c527-494f-913c-df90ea3b333d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.418566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f446ff-c527-494f-913c-df90ea3b333d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.420986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f446ff-c527-494f-913c-df90ea3b333d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.427092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97fd80-0dd4-476c-aba5-fb76361ab143 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.432745 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3104/6182] 10.222.0.23 () {58 vars in 1257 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.441803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97fd80-0dd4-476c-aba5-fb76361ab143 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.456341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e5274-80f0-4e60-9ba1-238e1da244be tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.457259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5274-80f0-4e60-9ba1-238e1da244be tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.458709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5274-80f0-4e60-9ba1-238e1da244be tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.459157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5274-80f0-4e60-9ba1-238e1da244be tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.461663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e5274-80f0-4e60-9ba1-238e1da244be tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.464871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e5274-80f0-4e60-9ba1-238e1da244be tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.472398 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3079/6183] 10.222.0.23 () {58 vars in 1293 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 02 01:29:33.476562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f446ff-c527-494f-913c-df90ea3b333d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.490225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f446ff-c527-494f-913c-df90ea3b333d tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.502145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679d061-f328-4a14-aef2-f2f95fabd632 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.503216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679d061-f328-4a14-aef2-f2f95fabd632 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.503741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679d061-f328-4a14-aef2-f2f95fabd632 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.504218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679d061-f328-4a14-aef2-f2f95fabd632 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.505031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679d061-f328-4a14-aef2-f2f95fabd632 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.509166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679d061-f328-4a14-aef2-f2f95fabd632 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.513041 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3105/6184] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.516829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e5274-80f0-4e60-9ba1-238e1da244be tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.530767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e5274-80f0-4e60-9ba1-238e1da244be tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.542777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a8c92-d245-4e35-af41-d39cb83ffa55 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.543570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a8c92-d245-4e35-af41-d39cb83ffa55 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.543959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a8c92-d245-4e35-af41-d39cb83ffa55 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.544330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a8c92-d245-4e35-af41-d39cb83ffa55 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.545027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a8c92-d245-4e35-af41-d39cb83ffa55 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.548237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a8c92-d245-4e35-af41-d39cb83ffa55 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.553775 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3080/6185] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.556356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679d061-f328-4a14-aef2-f2f95fabd632 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.569939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679d061-f328-4a14-aef2-f2f95fabd632 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.583004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fdd70-4b81-4eb0-9ef5-7aa760b970ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.583871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fdd70-4b81-4eb0-9ef5-7aa760b970ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.584240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fdd70-4b81-4eb0-9ef5-7aa760b970ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.584578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fdd70-4b81-4eb0-9ef5-7aa760b970ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.585242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fdd70-4b81-4eb0-9ef5-7aa760b970ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.588211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fdd70-4b81-4eb0-9ef5-7aa760b970ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.595675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a8c92-d245-4e35-af41-d39cb83ffa55 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.596178 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3106/6186] 10.222.0.23 () {58 vars in 1212 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.614057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a8c92-d245-4e35-af41-d39cb83ffa55 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.631337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882237ea-6e95-4ac6-bfb3-5f2c8d45d39c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.632153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882237ea-6e95-4ac6-bfb3-5f2c8d45d39c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.632547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882237ea-6e95-4ac6-bfb3-5f2c8d45d39c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.633082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882237ea-6e95-4ac6-bfb3-5f2c8d45d39c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.633743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882237ea-6e95-4ac6-bfb3-5f2c8d45d39c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.635605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882237ea-6e95-4ac6-bfb3-5f2c8d45d39c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.637661 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3081/6187] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.641430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fdd70-4b81-4eb0-9ef5-7aa760b970ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.654103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fdd70-4b81-4eb0-9ef5-7aa760b970ef tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.659556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61e65c-a7ea-479a-9fc9-b5bf4412ba76 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.660458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e65c-a7ea-479a-9fc9-b5bf4412ba76 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.660837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e65c-a7ea-479a-9fc9-b5bf4412ba76 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.661410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e65c-a7ea-479a-9fc9-b5bf4412ba76 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.662119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61e65c-a7ea-479a-9fc9-b5bf4412ba76 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.664001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61e65c-a7ea-479a-9fc9-b5bf4412ba76 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.666649 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3107/6188] 10.222.0.23 () {58 vars in 1215 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.670579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882237ea-6e95-4ac6-bfb3-5f2c8d45d39c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.685036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882237ea-6e95-4ac6-bfb3-5f2c8d45d39c tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.696510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787cf14-1a29-4055-9d9a-1f6b2a96a4a6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.699199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787cf14-1a29-4055-9d9a-1f6b2a96a4a6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.700466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787cf14-1a29-4055-9d9a-1f6b2a96a4a6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.702564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787cf14-1a29-4055-9d9a-1f6b2a96a4a6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.713726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787cf14-1a29-4055-9d9a-1f6b2a96a4a6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.723516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787cf14-1a29-4055-9d9a-1f6b2a96a4a6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.727543 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3082/6189] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.729296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61e65c-a7ea-479a-9fc9-b5bf4412ba76 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.744116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61e65c-a7ea-479a-9fc9-b5bf4412ba76 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.758733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b7adf-b76d-47c0-b158-2decd9ba9612 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.759575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7adf-b76d-47c0-b158-2decd9ba9612 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.759940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7adf-b76d-47c0-b158-2decd9ba9612 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.760200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7adf-b76d-47c0-b158-2decd9ba9612 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.760865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b7adf-b76d-47c0-b158-2decd9ba9612 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.764099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b7adf-b76d-47c0-b158-2decd9ba9612 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.772140 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3108/6190] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.773533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787cf14-1a29-4055-9d9a-1f6b2a96a4a6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.787921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787cf14-1a29-4055-9d9a-1f6b2a96a4a6 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.800048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b074e17-5a40-45cb-82f7-d7ad0c89bb22 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.800694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b074e17-5a40-45cb-82f7-d7ad0c89bb22 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.801029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b074e17-5a40-45cb-82f7-d7ad0c89bb22 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.801311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b074e17-5a40-45cb-82f7-d7ad0c89bb22 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.801898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b074e17-5a40-45cb-82f7-d7ad0c89bb22 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.805538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b074e17-5a40-45cb-82f7-d7ad0c89bb22 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.809191 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3083/6191] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.811754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b7adf-b76d-47c0-b158-2decd9ba9612 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.818366 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:33.825396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b7adf-b76d-47c0-b158-2decd9ba9612 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.869626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297e81d-02d5-44d7-b292-0ac2c20d61b7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.872154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297e81d-02d5-44d7-b292-0ac2c20d61b7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.872601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297e81d-02d5-44d7-b292-0ac2c20d61b7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.872882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297e81d-02d5-44d7-b292-0ac2c20d61b7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.873502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297e81d-02d5-44d7-b292-0ac2c20d61b7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.886928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297e81d-02d5-44d7-b292-0ac2c20d61b7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.888363 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3109/6192] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.892631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b074e17-5a40-45cb-82f7-d7ad0c89bb22 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.904118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b074e17-5a40-45cb-82f7-d7ad0c89bb22 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.909589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7dc08-2f42-4775-b847-6f0b20574617 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.910121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7dc08-2f42-4775-b847-6f0b20574617 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.910409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7dc08-2f42-4775-b847-6f0b20574617 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.910717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7dc08-2f42-4775-b847-6f0b20574617 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.911324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7dc08-2f42-4775-b847-6f0b20574617 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.912968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7dc08-2f42-4775-b847-6f0b20574617 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.914481 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3084/6193] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.918834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297e81d-02d5-44d7-b292-0ac2c20d61b7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.934708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297e81d-02d5-44d7-b292-0ac2c20d61b7 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.940911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8741aba-2ab7-41e7-9710-b16b0fb5fed9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:33.942067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8741aba-2ab7-41e7-9710-b16b0fb5fed9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:33.942642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8741aba-2ab7-41e7-9710-b16b0fb5fed9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:33.943175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8741aba-2ab7-41e7-9710-b16b0fb5fed9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:33.944099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8741aba-2ab7-41e7-9710-b16b0fb5fed9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:33.946344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8741aba-2ab7-41e7-9710-b16b0fb5fed9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:33.948234 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3110/6194] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:33.953605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7dc08-2f42-4775-b847-6f0b20574617 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:33.978676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7dc08-2f42-4775-b847-6f0b20574617 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:33.998419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccf3bf-127c-4376-acef-0767fc9ce43a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:34.000045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccf3bf-127c-4376-acef-0767fc9ce43a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:34.002079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccf3bf-127c-4376-acef-0767fc9ce43a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:34.002800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccf3bf-127c-4376-acef-0767fc9ce43a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:34.003646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccf3bf-127c-4376-acef-0767fc9ce43a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:34.008556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccf3bf-127c-4376-acef-0767fc9ce43a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:34.016612 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3085/6195] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:33 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:34.022144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8741aba-2ab7-41e7-9710-b16b0fb5fed9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:34.065714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8741aba-2ab7-41e7-9710-b16b0fb5fed9 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:34.078388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57c7f-b2ef-46c2-a520-adf2cc0bbee0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:34.080761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57c7f-b2ef-46c2-a520-adf2cc0bbee0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:34.081059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57c7f-b2ef-46c2-a520-adf2cc0bbee0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:34.081396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57c7f-b2ef-46c2-a520-adf2cc0bbee0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:34.084602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e57c7f-b2ef-46c2-a520-adf2cc0bbee0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:34.087489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e57c7f-b2ef-46c2-a520-adf2cc0bbee0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:34.092998 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3111/6196] 10.222.0.23 () {58 vars in 1278 bytes} [Sun Oct 2 01:29:34 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 02 01:29:34.099447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccf3bf-127c-4376-acef-0767fc9ce43a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:34.119710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccf3bf-127c-4376-acef-0767fc9ce43a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:34.144295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637e3d-299e-4e3e-83a7-c9848f2951da tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:34.146342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637e3d-299e-4e3e-83a7-c9848f2951da tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:34.146656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637e3d-299e-4e3e-83a7-c9848f2951da tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:34.146951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637e3d-299e-4e3e-83a7-c9848f2951da tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/e46f7899acff42ae854d13f2da4d3f4b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:34.173820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9637e3d-299e-4e3e-83a7-c9848f2951da tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d9637e3d-299e-4e3e-83a7-c9848f2951da tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Could not find domain: e46f7899acff42ae854d13f2da4d3f4b.: keystone.exception.DomainNotFound: Could not find domain: e46f7899acff42ae854d13f2da4d3f4b. Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e46f7899acff42ae854d13f2da4d3f4b. Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:34.190625 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:34.195067 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:29:34.196474 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e46f7899acff42ae854d13f2da4d3f4b. Oct 02 01:29:34.198036 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:34.198036 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3086/6197] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:29:34 2022] PATCH /identity/v3/domains/e46f7899acff42ae854d13f2da4d3f4b => generated 112 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:29:34.198196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57c7f-b2ef-46c2-a520-adf2cc0bbee0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:34.213224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57c7f-b2ef-46c2-a520-adf2cc0bbee0 tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:34.238350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc795-d3db-4dab-9b5a-a73d286d5d6a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:34.239392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc795-d3db-4dab-9b5a-a73d286d5d6a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:34.240939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc795-d3db-4dab-9b5a-a73d286d5d6a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:34.241503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc795-d3db-4dab-9b5a-a73d286d5d6a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/09aa734ecb124b0ebe2d47914143856a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:34.321910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc795-d3db-4dab-9b5a-a73d286d5d6a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-6e9fc795-d3db-4dab-9b5a-a73d286d5d6a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Could not find domain: 09aa734ecb124b0ebe2d47914143856a.: keystone.exception.DomainNotFound: Could not find domain: 09aa734ecb124b0ebe2d47914143856a. Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 09aa734ecb124b0ebe2d47914143856a. Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:34.334263 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:34.335639 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:29:34.336725 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 09aa734ecb124b0ebe2d47914143856a. Oct 02 01:29:34.338735 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:34.341006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637e3d-299e-4e3e-83a7-c9848f2951da tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:34.342193 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3112/6198] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:29:34 2022] PATCH /identity/v3/domains/09aa734ecb124b0ebe2d47914143856a => generated 112 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 02 01:29:34.352766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc795-d3db-4dab-9b5a-a73d286d5d6a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:34.357124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6e9fc795-d3db-4dab-9b5a-a73d286d5d6a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:34.362283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637e3d-299e-4e3e-83a7-c9848f2951da tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:34.377072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa715e1-5f44-4508-8638-bc6b656bce2e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75ca4d821512486cb130d969cfd94d58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b19e81a7d2c49648a610a4a047ee428', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:34.377793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa715e1-5f44-4508-8638-bc6b656bce2e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:34.378080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa715e1-5f44-4508-8638-bc6b656bce2e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:34.378356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa715e1-5f44-4508-8638-bc6b656bce2e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] PATH_INFO: `/v3/domains/024e5708e3534af78e02ecc00d4cbb10` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:34.407686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa715e1-5f44-4508-8638-bc6b656bce2e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-aaa715e1-5f44-4508-8638-bc6b656bce2e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Could not find domain: 024e5708e3534af78e02ecc00d4cbb10.: keystone.exception.DomainNotFound: Could not find domain: 024e5708e3534af78e02ecc00d4cbb10. Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 024e5708e3534af78e02ecc00d4cbb10. Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:34.423192 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:34.424254 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:29:34.425196 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 024e5708e3534af78e02ecc00d4cbb10. Oct 02 01:29:34.426747 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:34.427801 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3087/6199] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:29:34 2022] PATCH /identity/v3/domains/024e5708e3534af78e02ecc00d4cbb10 => generated 112 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 02 01:29:34.428771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa715e1-5f44-4508-8638-bc6b656bce2e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:34.444481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aaa715e1-5f44-4508-8638-bc6b656bce2e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:34.480625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc795-d3db-4dab-9b5a-a73d286d5d6a tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:34.488256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:34.489259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:34.489689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:34.490157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] PATH_INFO: `/v3/users/08c3c7e6906c441f95ad632601e26c3e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:34.491711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c3c7e6906c441f95ad632601e26c3e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:34.494292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:34.596203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c3c7e6906c441f95ad632601e26c3e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:34.618339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c3c7e6906c441f95ad632601e26c3e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:34.619122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c3c7e6906c441f95ad632601e26c3e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:34.629125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa715e1-5f44-4508-8638-bc6b656bce2e tempest-DomainConfigurationTestJSON-633682586 tempest-DomainConfigurationTestJSON-633682586-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:34.635123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c3c7e6906c441f95ad632601e26c3e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:34.637218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c3c7e6906c441f95ad632601e26c3e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:34.643663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45992b5-da77-4c34-811f-9420ae964599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:34.644532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45992b5-da77-4c34-811f-9420ae964599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:34.644923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45992b5-da77-4c34-811f-9420ae964599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:34.645284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45992b5-da77-4c34-811f-9420ae964599 admin admin] PATH_INFO: `/v3/users/d6422849873d44ce8196c468557d9c1e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:34.649410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45992b5-da77-4c34-811f-9420ae964599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6422849873d44ce8196c468557d9c1e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:34.651540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45992b5-da77-4c34-811f-9420ae964599 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:34.680998 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3113/6200] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:34 2022] DELETE /identity/v3/users/08c3c7e6906c441f95ad632601e26c3e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:34.684431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:34.686169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:34.766769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d45992b5-da77-4c34-811f-9420ae964599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6422849873d44ce8196c468557d9c1e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:34.790581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d45992b5-da77-4c34-811f-9420ae964599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6422849873d44ce8196c468557d9c1e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:34.791816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d45992b5-da77-4c34-811f-9420ae964599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6422849873d44ce8196c468557d9c1e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:34.813115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d45992b5-da77-4c34-811f-9420ae964599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6422849873d44ce8196c468557d9c1e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:34.827132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d45992b5-da77-4c34-811f-9420ae964599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6422849873d44ce8196c468557d9c1e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:34.836259 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3088/6201] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:34 2022] DELETE /identity/v3/users/d6422849873d44ce8196c468557d9c1e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:34.837710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db928f3-385d-4a91-b986-c7c57f8b99e1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:34.838100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db928f3-385d-4a91-b986-c7c57f8b99e1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:34.838476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db928f3-385d-4a91-b986-c7c57f8b99e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:34.859313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fa74c-8415-426f-9c75-24bf77aa9689 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:34.866641 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:34.932638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3db928f3-385d-4a91-b986-c7c57f8b99e1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:34.947085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3db928f3-385d-4a91-b986-c7c57f8b99e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:34.989554 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:35.064582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:35.066186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:35.066733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:35.069555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] PATH_INFO: `/v3/users/bfae16ed6efb490d8d953bb78a5c1a00` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:35.072611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfae16ed6efb490d8d953bb78a5c1a00)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:35.075668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:35.103456 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3089/6202] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:35.108644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6474611-f4e9-4c24-9c04-b84da66ad47b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:35.109735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6474611-f4e9-4c24-9c04-b84da66ad47b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:35.110203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6474611-f4e9-4c24-9c04-b84da66ad47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:35.157971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d6474611-f4e9-4c24-9c04-b84da66ad47b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:35.169884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6474611-f4e9-4c24-9c04-b84da66ad47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:35.202271 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3090/6203] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:35.202957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6474611-f4e9-4c24-9c04-b84da66ad47b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:35.210041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6474611-f4e9-4c24-9c04-b84da66ad47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:35.237450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfae16ed6efb490d8d953bb78a5c1a00'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:35.252433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfae16ed6efb490d8d953bb78a5c1a00'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:35.253329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfae16ed6efb490d8d953bb78a5c1a00'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:35.265175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfae16ed6efb490d8d953bb78a5c1a00'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:35.265864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfae16ed6efb490d8d953bb78a5c1a00'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:35.284099 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3114/6204] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:34 2022] DELETE /identity/v3/users/bfae16ed6efb490d8d953bb78a5c1a00 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:35.285158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:35.286820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:35.352051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6474611-f4e9-4c24-9c04-b84da66ad47b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:35.427422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c234c-32cb-4d16-82a6-fc8430189659 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:35.436166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed765531-a460-410f-ac2a-82fc5ddec89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:35.436904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765531-a460-410f-ac2a-82fc5ddec89d service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:35.437189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765531-a460-410f-ac2a-82fc5ddec89d service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:35.437462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765531-a460-410f-ac2a-82fc5ddec89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:35.443540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ed765531-a460-410f-ac2a-82fc5ddec89d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:35.443712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f73c7-af2d-466b-96a7-044696bfa6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:35.444413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f73c7-af2d-466b-96a7-044696bfa6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:35.444965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f73c7-af2d-466b-96a7-044696bfa6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:35.445526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f73c7-af2d-466b-96a7-044696bfa6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:35.448004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d34f73c7-af2d-466b-96a7-044696bfa6c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:35.568817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f73c7-af2d-466b-96a7-044696bfa6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:35.570285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f73c7-af2d-466b-96a7-044696bfa6c1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:35.579781 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:35.583066 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3091/6205] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:35.616854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed765531-a460-410f-ac2a-82fc5ddec89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:35.618709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed765531-a460-410f-ac2a-82fc5ddec89d service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:35.631858 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3115/6206] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:36.374502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f73c7-af2d-466b-96a7-044696bfa6c1 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:36.377184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d34f73c7-af2d-466b-96a7-044696bfa6c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:36.396807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f73c7-af2d-466b-96a7-044696bfa6c1 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:36.403744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:36.404621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:36.405067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:36.405500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] PATH_INFO: `/v3/projects/550c19f69633414698e9c62c717660ae` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:36.406958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=550c19f69633414698e9c62c717660ae)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:36.409914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:36.430496 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:36.510861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550c19f69633414698e9c62c717660ae', 'request_id': 'req-269c4129-4e3b-4a71-8bef-0ea2946a2bde'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:36.534308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550c19f69633414698e9c62c717660ae', 'request_id': 'req-269c4129-4e3b-4a71-8bef-0ea2946a2bde'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:36.551402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550c19f69633414698e9c62c717660ae', 'request_id': 'req-269c4129-4e3b-4a71-8bef-0ea2946a2bde'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:36.607834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] The token cache is being invalidate because project 550c19f69633414698e9c62c717660ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:36.609004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:36.613524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-269c4129-4e3b-4a71-8bef-0ea2946a2bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:36.634031 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3092/6207] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:36 2022] DELETE /identity/v3/projects/550c19f69633414698e9c62c717660ae => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:36.640916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd8e55-40a9-467e-9ce0-025a9192f83e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:36.641453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd8e55-40a9-467e-9ce0-025a9192f83e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:36.641453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd8e55-40a9-467e-9ce0-025a9192f83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:36.674531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6dbd8e55-40a9-467e-9ce0-025a9192f83e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:36.676068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6dbd8e55-40a9-467e-9ce0-025a9192f83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:36.867183 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3116/6208] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:36.875209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b54d-9eab-4a3d-b5ce-daee0c6998b3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:36.875499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b54d-9eab-4a3d-b5ce-daee0c6998b3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:36.875970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b54d-9eab-4a3d-b5ce-daee0c6998b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:36.919557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6073b54d-9eab-4a3d-b5ce-daee0c6998b3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:36.930858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6073b54d-9eab-4a3d-b5ce-daee0c6998b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:36.974629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd8e55-40a9-467e-9ce0-025a9192f83e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:36.975321 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3093/6209] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:29:36.987025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd8e55-40a9-467e-9ce0-025a9192f83e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:36.990930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073b54d-9eab-4a3d-b5ce-daee0c6998b3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:36.993134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6073b54d-9eab-4a3d-b5ce-daee0c6998b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:37.007548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e49729-1b79-4093-a098-8be1f64bf337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:37.010833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49729-1b79-4093-a098-8be1f64bf337 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:37.011337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49729-1b79-4093-a098-8be1f64bf337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:37.012118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49729-1b79-4093-a098-8be1f64bf337 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:37.013578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e49729-1b79-4093-a098-8be1f64bf337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:37.013816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073b54d-9eab-4a3d-b5ce-daee0c6998b3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:37.015849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e49729-1b79-4093-a098-8be1f64bf337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:37.056209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e49729-1b79-4093-a098-8be1f64bf337 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:37.087642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:37.089678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:37.091684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:37.092172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] PATH_INFO: `/v3/projects/d51aae6f3eb447fdbb75375d2970bb1c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:37.096149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51aae6f3eb447fdbb75375d2970bb1c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:37.099657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:37.117645 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3117/6210] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:37.124976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e49729-1b79-4093-a098-8be1f64bf337 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:37.148507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e49729-1b79-4093-a098-8be1f64bf337 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:37.158014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e00d2e-ee90-49e9-8238-de26d43f288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:37.158929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e00d2e-ee90-49e9-8238-de26d43f288f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:37.159247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e00d2e-ee90-49e9-8238-de26d43f288f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:37.159637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e00d2e-ee90-49e9-8238-de26d43f288f admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:37.160467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e00d2e-ee90-49e9-8238-de26d43f288f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:37.162587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e00d2e-ee90-49e9-8238-de26d43f288f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:37.209357 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3118/6211] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:37 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:37.215330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e00d2e-ee90-49e9-8238-de26d43f288f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:37.217906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-71e00d2e-ee90-49e9-8238-de26d43f288f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:37.234406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51aae6f3eb447fdbb75375d2970bb1c', 'request_id': 'req-cfe1ec57-6775-4793-ab37-062bd091b917'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.242429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51aae6f3eb447fdbb75375d2970bb1c', 'request_id': 'req-cfe1ec57-6775-4793-ab37-062bd091b917'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.252064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51aae6f3eb447fdbb75375d2970bb1c', 'request_id': 'req-cfe1ec57-6775-4793-ab37-062bd091b917'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.272264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] The token cache is being invalidate because project d51aae6f3eb447fdbb75375d2970bb1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:37.272626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.273433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.280647 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3094/6212] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:36 2022] DELETE /identity/v3/projects/d51aae6f3eb447fdbb75375d2970bb1c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:29:37.282431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:37.284923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:37.314631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e00d2e-ee90-49e9-8238-de26d43f288f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:37.388534 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:37.415750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:37.417796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:37.418158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:37.420728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] PATH_INFO: `/v3/projects/7205e8a3c3cc43249e8f3027ac8e93fd` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:37.423226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7205e8a3c3cc43249e8f3027ac8e93fd)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:37.428930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1ec57-6775-4793-ab37-062bd091b917 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:37.430326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:37.455899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a9034-3966-47db-850a-9d3e9dcb4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:37.456542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9034-3966-47db-850a-9d3e9dcb4263 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:37.456826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9034-3966-47db-850a-9d3e9dcb4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:37.458920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9034-3966-47db-850a-9d3e9dcb4263 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:37.460108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a9034-3966-47db-850a-9d3e9dcb4263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:37.463611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a9034-3966-47db-850a-9d3e9dcb4263 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:37.498999 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3095/6213] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:37 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:37.500977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a9034-3966-47db-850a-9d3e9dcb4263 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:37.511937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c1a9034-3966-47db-850a-9d3e9dcb4263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:37.542008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7205e8a3c3cc43249e8f3027ac8e93fd', 'request_id': 'req-d3bddea6-db84-48aa-85e0-b5bf00baba94'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.553324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a9034-3966-47db-850a-9d3e9dcb4263 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:37.559562 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:37.562613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7205e8a3c3cc43249e8f3027ac8e93fd', 'request_id': 'req-d3bddea6-db84-48aa-85e0-b5bf00baba94'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.580674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7205e8a3c3cc43249e8f3027ac8e93fd', 'request_id': 'req-d3bddea6-db84-48aa-85e0-b5bf00baba94'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.608603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] The token cache is being invalidate because project 7205e8a3c3cc43249e8f3027ac8e93fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:37.611143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.614625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.617912 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3119/6214] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:37 2022] DELETE /identity/v3/projects/7205e8a3c3cc43249e8f3027ac8e93fd => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:37.619186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:37.622485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:37.678403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:37.679333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:37.679333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:37.679604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] PATH_INFO: `/v3/users/290ea407fbdd43c1887fc854680f0671` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:37.682238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=290ea407fbdd43c1887fc854680f0671)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:37.685086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:37.771318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '290ea407fbdd43c1887fc854680f0671'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.793918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bddea6-db84-48aa-85e0-b5bf00baba94 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:37.801380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '290ea407fbdd43c1887fc854680f0671'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.802556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '290ea407fbdd43c1887fc854680f0671'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.816155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55c1c5-262e-4b18-9e4c-efa90d43f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:37.816786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55c1c5-262e-4b18-9e4c-efa90d43f50a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:37.817067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55c1c5-262e-4b18-9e4c-efa90d43f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:37.817339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55c1c5-262e-4b18-9e4c-efa90d43f50a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:37.817987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55c1c5-262e-4b18-9e4c-efa90d43f50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:37.820193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55c1c5-262e-4b18-9e4c-efa90d43f50a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:37.833053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '290ea407fbdd43c1887fc854680f0671'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.855712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '290ea407fbdd43c1887fc854680f0671'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:37.867882 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3120/6215] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:37.869337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55c1c5-262e-4b18-9e4c-efa90d43f50a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:37.883989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4d55c1c5-262e-4b18-9e4c-efa90d43f50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:37.891082 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3096/6216] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:37 2022] DELETE /identity/v3/users/290ea407fbdd43c1887fc854680f0671 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:37.893515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:37.905228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:37.929627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55c1c5-262e-4b18-9e4c-efa90d43f50a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:38.171823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a401d3d-40fd-43af-8763-c2b548d89251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:38.172482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a401d3d-40fd-43af-8763-c2b548d89251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:38.173785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a401d3d-40fd-43af-8763-c2b548d89251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:38.176740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efbf76-f1cd-4483-9c7e-420e0ba5cb7c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:38.178399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a401d3d-40fd-43af-8763-c2b548d89251 admin admin] PATH_INFO: `/v3/users/75ca4d821512486cb130d969cfd94d58` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:38.185286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a401d3d-40fd-43af-8763-c2b548d89251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ca4d821512486cb130d969cfd94d58)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:38.192100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a401d3d-40fd-43af-8763-c2b548d89251 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:38.203643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b36237-73b4-442d-8c67-a7bcb9ebcb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:38.204207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b36237-73b4-442d-8c67-a7bcb9ebcb00 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:38.204484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b36237-73b4-442d-8c67-a7bcb9ebcb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:38.204930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b36237-73b4-442d-8c67-a7bcb9ebcb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:38.205590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b36237-73b4-442d-8c67-a7bcb9ebcb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:38.207260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b36237-73b4-442d-8c67-a7bcb9ebcb00 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:38.254234 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3097/6217] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:38.266633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b36237-73b4-442d-8c67-a7bcb9ebcb00 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:38.275371 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:38.282116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b36237-73b4-442d-8c67-a7bcb9ebcb00 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:38.294513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1ef3-e362-4f9d-aef8-a8302285e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:38.295232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1ef3-e362-4f9d-aef8-a8302285e513 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:38.295507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1ef3-e362-4f9d-aef8-a8302285e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:38.295783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1ef3-e362-4f9d-aef8-a8302285e513 admin admin] PATH_INFO: `/v3/projects/11dc4a1c2bf6461280a4e7afb0528d33/users/378380bcf493466ab7cc4dfe4c8bc891/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:38.329289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2a401d3d-40fd-43af-8763-c2b548d89251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ca4d821512486cb130d969cfd94d58'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:38.340903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a1ef3-e362-4f9d-aef8-a8302285e513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11dc4a1c2bf6461280a4e7afb0528d33, user_id=378380bcf493466ab7cc4dfe4c8bc891, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:38.348422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a1ef3-e362-4f9d-aef8-a8302285e513 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:38.353753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2a401d3d-40fd-43af-8763-c2b548d89251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ca4d821512486cb130d969cfd94d58'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:38.355470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2a401d3d-40fd-43af-8763-c2b548d89251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ca4d821512486cb130d969cfd94d58'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:38.366446 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:38.372161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2a401d3d-40fd-43af-8763-c2b548d89251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ca4d821512486cb130d969cfd94d58'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:38.373094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2a401d3d-40fd-43af-8763-c2b548d89251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ca4d821512486cb130d969cfd94d58'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:38.379114 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3098/6218] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:38 2022] PUT /identity/v3/projects/11dc4a1c2bf6461280a4e7afb0528d33/users/378380bcf493466ab7cc4dfe4c8bc891/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:38.380059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1ef3-e362-4f9d-aef8-a8302285e513 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:38.385448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7e0a1ef3-e362-4f9d-aef8-a8302285e513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:38.403365 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3121/6219] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:37 2022] DELETE /identity/v3/users/75ca4d821512486cb130d969cfd94d58 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:38.409997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ea0c5-d670-48e4-a8fa-16db91c590f2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:38.412946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ea0c5-d670-48e4-a8fa-16db91c590f2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:38.414749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ea0c5-d670-48e4-a8fa-16db91c590f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:38.477359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6a0ea0c5-d670-48e4-a8fa-16db91c590f2 None None] MFA Rules not processed for user `378380bcf493466ab7cc4dfe4c8bc891`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:38.484883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6a0ea0c5-d670-48e4-a8fa-16db91c590f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:38.626525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1ef3-e362-4f9d-aef8-a8302285e513 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:38.731768 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3122/6220] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:38.735952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ea0c5-d670-48e4-a8fa-16db91c590f2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:38.739448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6a0ea0c5-d670-48e4-a8fa-16db91c590f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:38.796429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:38.797206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:38.797584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:38.797955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] PATH_INFO: `/v3/projects/97a11a7b0fab4fd6a761c57cf8872911` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:38.800332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a11a7b0fab4fd6a761c57cf8872911)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:38.802412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:38.891915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ea0c5-d670-48e4-a8fa-16db91c590f2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:38.900944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081714d-5bdc-4b26-9978-142466a004cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:38.902055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081714d-5bdc-4b26-9978-142466a004cf admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:38.902448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081714d-5bdc-4b26-9978-142466a004cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:38.903024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081714d-5bdc-4b26-9978-142466a004cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:38.903829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081714d-5bdc-4b26-9978-142466a004cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:38.906832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081714d-5bdc-4b26-9978-142466a004cf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:38.949644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a11a7b0fab4fd6a761c57cf8872911', 'request_id': 'req-c9d5846e-a20e-469e-84b0-fb64262fd548'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:38.949818 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3123/6221] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:38 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:38.953993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081714d-5bdc-4b26-9978-142466a004cf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:38.967111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a11a7b0fab4fd6a761c57cf8872911', 'request_id': 'req-c9d5846e-a20e-469e-84b0-fb64262fd548'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:38.991417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a11a7b0fab4fd6a761c57cf8872911', 'request_id': 'req-c9d5846e-a20e-469e-84b0-fb64262fd548'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:39.006946 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:39.047758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] The token cache is being invalidate because project 97a11a7b0fab4fd6a761c57cf8872911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:39.049045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:39.052218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9d5846e-a20e-469e-84b0-fb64262fd548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:39.063322 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3099/6222] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:38 2022] DELETE /identity/v3/projects/97a11a7b0fab4fd6a761c57cf8872911 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:39.066499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5b777-3126-4932-b070-e64536683fb7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.069598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5b777-3126-4932-b070-e64536683fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.070052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5b777-3126-4932-b070-e64536683fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.131736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f4c5b777-3126-4932-b070-e64536683fb7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:39.133340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f4c5b777-3126-4932-b070-e64536683fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:39.173040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081714d-5bdc-4b26-9978-142466a004cf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:39.184143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc175d-d6de-46dd-b37c-1a8a9edba3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:39.185813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc175d-d6de-46dd-b37c-1a8a9edba3ac admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.186103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc175d-d6de-46dd-b37c-1a8a9edba3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.187050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc175d-d6de-46dd-b37c-1a8a9edba3ac admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.189243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc175d-d6de-46dd-b37c-1a8a9edba3ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:39.195576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc175d-d6de-46dd-b37c-1a8a9edba3ac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:39.236459 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3124/6223] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:38 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:39.240938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc175d-d6de-46dd-b37c-1a8a9edba3ac admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:39.244052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a3cc175d-d6de-46dd-b37c-1a8a9edba3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:39.274082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc175d-d6de-46dd-b37c-1a8a9edba3ac admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:39.279474 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:39.288732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1572cd-9446-4b2b-98b6-e0b38fce73c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:39.289986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1572cd-9446-4b2b-98b6-e0b38fce73c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.289986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1572cd-9446-4b2b-98b6-e0b38fce73c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.289986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1572cd-9446-4b2b-98b6-e0b38fce73c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.290588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1572cd-9446-4b2b-98b6-e0b38fce73c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:39.293422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1572cd-9446-4b2b-98b6-e0b38fce73c4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:39.333020 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3125/6224] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:39.340808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1572cd-9446-4b2b-98b6-e0b38fce73c4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:39.356254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1572cd-9446-4b2b-98b6-e0b38fce73c4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:39.382398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8b5eb-ee15-4030-a0be-afaed1332732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:39.385687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8b5eb-ee15-4030-a0be-afaed1332732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.386034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8b5eb-ee15-4030-a0be-afaed1332732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.388598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8b5eb-ee15-4030-a0be-afaed1332732 admin admin] PATH_INFO: `/v3/projects/292ab10652a0453a87c87d33f2a58bde/users/ff2098a6a96e49e5baf11526e943f258/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.389189 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3100/6225] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:39.390433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5b777-3126-4932-b070-e64536683fb7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:39.392051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f4c5b777-3126-4932-b070-e64536683fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:39.408925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5b777-3126-4932-b070-e64536683fb7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:39.414791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:39.415677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.416126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.416566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] PATH_INFO: `/v3/projects/5b19e81a7d2c49648a610a4a047ee428` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.418480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b19e81a7d2c49648a610a4a047ee428)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:39.419946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8b5eb-ee15-4030-a0be-afaed1332732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292ab10652a0453a87c87d33f2a58bde, user_id=ff2098a6a96e49e5baf11526e943f258, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:39.421455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:39.422650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8b5eb-ee15-4030-a0be-afaed1332732 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:39.454378 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3126/6226] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:39 2022] PUT /identity/v3/projects/292ab10652a0453a87c87d33f2a58bde/users/ff2098a6a96e49e5baf11526e943f258/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:29:39.455699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1735a-bc27-4cc7-98d2-fa7e2c24f892 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.455992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1735a-bc27-4cc7-98d2-fa7e2c24f892 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.466787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1735a-bc27-4cc7-98d2-fa7e2c24f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.513691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7da1735a-bc27-4cc7-98d2-fa7e2c24f892 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:39.514951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7da1735a-bc27-4cc7-98d2-fa7e2c24f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:39.536406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b19e81a7d2c49648a610a4a047ee428', 'request_id': 'req-51392ed4-642f-4eb1-a532-988ead388ed7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:39.553851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b19e81a7d2c49648a610a4a047ee428', 'request_id': 'req-51392ed4-642f-4eb1-a532-988ead388ed7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:39.569510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b19e81a7d2c49648a610a4a047ee428', 'request_id': 'req-51392ed4-642f-4eb1-a532-988ead388ed7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:39.599461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] The token cache is being invalidate because project 5b19e81a7d2c49648a610a4a047ee428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:39.600105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:39.600972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:39.604487 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3101/6227] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:39 2022] DELETE /identity/v3/projects/5b19e81a7d2c49648a610a4a047ee428 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:39.606527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:39.619395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:39.650179 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3127/6228] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:39.654798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75fa1-d38a-4bf7-9bd5-8dbfadd33c93 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.654798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75fa1-d38a-4bf7-9bd5-8dbfadd33c93 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.654798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75fa1-d38a-4bf7-9bd5-8dbfadd33c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.726202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b1c75fa1-d38a-4bf7-9bd5-8dbfadd33c93 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:39.732807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b1c75fa1-d38a-4bf7-9bd5-8dbfadd33c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:39.778380 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3128/6229] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:39.778380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c75fa1-d38a-4bf7-9bd5-8dbfadd33c93 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:39.779657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51392ed4-642f-4eb1-a532-988ead388ed7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:39.795850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e9d11-dd8e-477f-a2b3-3fa5e5a86972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:39.796711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e9d11-dd8e-477f-a2b3-3fa5e5a86972 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.797111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e9d11-dd8e-477f-a2b3-3fa5e5a86972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.797392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e9d11-dd8e-477f-a2b3-3fa5e5a86972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.798040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e9d11-dd8e-477f-a2b3-3fa5e5a86972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:39.799435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c75fa1-d38a-4bf7-9bd5-8dbfadd33c93 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:39.803338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e9d11-dd8e-477f-a2b3-3fa5e5a86972 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:39.817117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8972f0-2b0b-41b0-9666-2cec0953caec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:39.818081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8972f0-2b0b-41b0-9666-2cec0953caec admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.818493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8972f0-2b0b-41b0-9666-2cec0953caec admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.818895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8972f0-2b0b-41b0-9666-2cec0953caec admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.819732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8972f0-2b0b-41b0-9666-2cec0953caec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:39.820050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8972f0-2b0b-41b0-9666-2cec0953caec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:39.821774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8972f0-2b0b-41b0-9666-2cec0953caec admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:39.835834 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3102/6230] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:39.840554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09239-bfec-4918-a8d5-50ccf4e39ebb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.840850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09239-bfec-4918-a8d5-50ccf4e39ebb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.841124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09239-bfec-4918-a8d5-50ccf4e39ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.854027 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3129/6231] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:39.858812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8972f0-2b0b-41b0-9666-2cec0953caec admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:39.872510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-36d09239-bfec-4918-a8d5-50ccf4e39ebb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:39.878819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-36d09239-bfec-4918-a8d5-50ccf4e39ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:39.893420 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3103/6232] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:39.894326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d09239-bfec-4918-a8d5-50ccf4e39ebb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:39.897715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8972f0-2b0b-41b0-9666-2cec0953caec admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:39.920826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499fa63-348d-4310-a2f9-4f480d4f0189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:39.923332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499fa63-348d-4310-a2f9-4f480d4f0189 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.923728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499fa63-348d-4310-a2f9-4f480d4f0189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.924118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499fa63-348d-4310-a2f9-4f480d4f0189 admin admin] PATH_INFO: `/v3/projects/292ab10652a0453a87c87d33f2a58bde/users/ff2098a6a96e49e5baf11526e943f258/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.927643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d09239-bfec-4918-a8d5-50ccf4e39ebb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:39.930840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499fa63-348d-4310-a2f9-4f480d4f0189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292ab10652a0453a87c87d33f2a58bde, user_id=ff2098a6a96e49e5baf11526e943f258, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:39.943283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499fa63-348d-4310-a2f9-4f480d4f0189 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:39.944000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f6e04-699d-402d-a295-5cfcb95e8f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:39.946102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f6e04-699d-402d-a295-5cfcb95e8f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:39.946391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f6e04-699d-402d-a295-5cfcb95e8f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:39.946693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f6e04-699d-402d-a295-5cfcb95e8f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:39.953996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f6e04-699d-402d-a295-5cfcb95e8f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:39.956179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f6e04-699d-402d-a295-5cfcb95e8f7e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:39.998547 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3130/6233] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:39 2022] PUT /identity/v3/projects/292ab10652a0453a87c87d33f2a58bde/users/ff2098a6a96e49e5baf11526e943f258/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:39.999624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499fa63-348d-4310-a2f9-4f480d4f0189 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:40.044390 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3104/6234] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:39 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:40.045990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4641ae-775d-45ce-abc1-03c9d07b6933 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:40.046282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4641ae-775d-45ce-abc1-03c9d07b6933 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:40.046554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4641ae-775d-45ce-abc1-03c9d07b6933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:40.096301 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:40.151376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0c4641ae-775d-45ce-abc1-03c9d07b6933 None None] MFA Rules not processed for user `ff2098a6a96e49e5baf11526e943f258`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:40.153310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0c4641ae-775d-45ce-abc1-03c9d07b6933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:40.173159 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:40.181040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499fa63-348d-4310-a2f9-4f480d4f0189 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:40.303511 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3105/6235] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:40.304612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4641ae-775d-45ce-abc1-03c9d07b6933 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:40.369590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8f427-f6e3-459c-aac3-8ca0436958dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:40.376430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f427-f6e3-459c-aac3-8ca0436958dc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:40.376917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f427-f6e3-459c-aac3-8ca0436958dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:40.377356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f427-f6e3-459c-aac3-8ca0436958dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:40.378213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8f427-f6e3-459c-aac3-8ca0436958dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:40.379339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8f427-f6e3-459c-aac3-8ca0436958dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:40.383428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8f427-f6e3-459c-aac3-8ca0436958dc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:40.420791 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3131/6236] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:40.422044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8f427-f6e3-459c-aac3-8ca0436958dc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:40.424158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c0a8f427-f6e3-459c-aac3-8ca0436958dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:40.474284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4641ae-775d-45ce-abc1-03c9d07b6933 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:40.488504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb75705-221c-445c-aef2-b833260d2c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:40.489186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75705-221c-445c-aef2-b833260d2c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:40.489481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75705-221c-445c-aef2-b833260d2c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:40.489759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75705-221c-445c-aef2-b833260d2c94 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:40.490403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb75705-221c-445c-aef2-b833260d2c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:40.495484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb75705-221c-445c-aef2-b833260d2c94 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:40.567507 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3106/6237] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:40 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:40.567507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb75705-221c-445c-aef2-b833260d2c94 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:40.594510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb75705-221c-445c-aef2-b833260d2c94 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:40.612568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae1cb-2c48-49ee-8a1e-1188ab0224e5 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:40.613263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae1cb-2c48-49ee-8a1e-1188ab0224e5 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:40.613614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae1cb-2c48-49ee-8a1e-1188ab0224e5 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:40.614048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae1cb-2c48-49ee-8a1e-1188ab0224e5 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:40.614982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ae1cb-2c48-49ee-8a1e-1188ab0224e5 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:40.617176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ae1cb-2c48-49ee-8a1e-1188ab0224e5 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:40.651432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8f427-f6e3-459c-aac3-8ca0436958dc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:40.669138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692bd9a-3c63-418f-b86f-76d7db552d5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:40.670275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692bd9a-3c63-418f-b86f-76d7db552d5d service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:40.670802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692bd9a-3c63-418f-b86f-76d7db552d5d service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:40.671246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692bd9a-3c63-418f-b86f-76d7db552d5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:40.675421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4692bd9a-3c63-418f-b86f-76d7db552d5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:40.694072 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3107/6238] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:40 2022] POST /identity/v3/projects => generated 350 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:40.702254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae1cb-2c48-49ee-8a1e-1188ab0224e5 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:40.722582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692bd9a-3c63-418f-b86f-76d7db552d5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:40.725652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692bd9a-3c63-418f-b86f-76d7db552d5d service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:40.758486 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3132/6239] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:40.767517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692bd9a-3c63-418f-b86f-76d7db552d5d service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:40.796467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692bd9a-3c63-418f-b86f-76d7db552d5d service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:40.817762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae1cb-2c48-49ee-8a1e-1188ab0224e5 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:40.829814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add0720-a975-4c6e-8285-8550d599e9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:40.830872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add0720-a975-4c6e-8285-8550d599e9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:40.831263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add0720-a975-4c6e-8285-8550d599e9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:40.831658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add0720-a975-4c6e-8285-8550d599e9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:40.832402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add0720-a975-4c6e-8285-8550d599e9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:40.852428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add0720-a975-4c6e-8285-8550d599e9c7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:40.945532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb03e6-4634-438b-b74b-d621fced98bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:40.946105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb03e6-4634-438b-b74b-d621fced98bc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:40.946508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb03e6-4634-438b-b74b-d621fced98bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:40.946820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb03e6-4634-438b-b74b-d621fced98bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:40.947846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb03e6-4634-438b-b74b-d621fced98bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:40.949800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb03e6-4634-438b-b74b-d621fced98bc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:41.000144 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:41.011406 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3133/6240] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:41.012856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb03e6-4634-438b-b74b-d621fced98bc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:41.029995 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3108/6241] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:40 2022] POST /identity/v3/projects => generated 373 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:41.032959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add0720-a975-4c6e-8285-8550d599e9c7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:41.060122 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:41.231636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb03e6-4634-438b-b74b-d621fced98bc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:41.297761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add0720-a975-4c6e-8285-8550d599e9c7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:41.319328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782b4c7-43f2-4e06-86b8-56123aa35f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:41.319968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782b4c7-43f2-4e06-86b8-56123aa35f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:41.321355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782b4c7-43f2-4e06-86b8-56123aa35f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:41.321559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782b4c7-43f2-4e06-86b8-56123aa35f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:41.322179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782b4c7-43f2-4e06-86b8-56123aa35f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:41.325753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782b4c7-43f2-4e06-86b8-56123aa35f4e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:41.352721 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3109/6242] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:41.358322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782b4c7-43f2-4e06-86b8-56123aa35f4e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:41.373335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782b4c7-43f2-4e06-86b8-56123aa35f4e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:41.401762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db855785-63b8-447d-8c52-6e6b58a6eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:41.402400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db855785-63b8-447d-8c52-6e6b58a6eb1a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:41.416946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db855785-63b8-447d-8c52-6e6b58a6eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:41.418164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db855785-63b8-447d-8c52-6e6b58a6eb1a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:41.419132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db855785-63b8-447d-8c52-6e6b58a6eb1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:41.421154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb9fa9-411f-4569-a9d0-ff49c6fab9b6 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:41.421790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9fa9-411f-4569-a9d0-ff49c6fab9b6 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:41.422881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db855785-63b8-447d-8c52-6e6b58a6eb1a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:41.424994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9fa9-411f-4569-a9d0-ff49c6fab9b6 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:41.425310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9fa9-411f-4569-a9d0-ff49c6fab9b6 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:41.425978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb9fa9-411f-4569-a9d0-ff49c6fab9b6 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:41.432066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb9fa9-411f-4569-a9d0-ff49c6fab9b6 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:41.463684 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3110/6243] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:41 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:41.466920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db855785-63b8-447d-8c52-6e6b58a6eb1a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:41.481634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db855785-63b8-447d-8c52-6e6b58a6eb1a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:41.488593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2583a-0556-41c6-8150-b8bbda114691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:41.489675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2583a-0556-41c6-8150-b8bbda114691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:41.490148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2583a-0556-41c6-8150-b8bbda114691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:41.490926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2583a-0556-41c6-8150-b8bbda114691 admin admin] PATH_INFO: `/v3/projects/217b510c8e524248a6becd6292b79b15/users/c4a5dec7466a413b9d4d1d262dad63b8/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:41.541614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2583a-0556-41c6-8150-b8bbda114691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217b510c8e524248a6becd6292b79b15, user_id=c4a5dec7466a413b9d4d1d262dad63b8, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:41.551679 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3134/6244] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:29:41 2022] POST /identity/v3/projects => generated 349 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:41.551679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7616b-5c93-4653-8d4b-ef882daf4046 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:41.552227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7616b-5c93-4653-8d4b-ef882daf4046 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:41.552227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7616b-5c93-4653-8d4b-ef882daf4046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:41.563164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2583a-0556-41c6-8150-b8bbda114691 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:41.596016 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3111/6245] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:41 2022] PUT /identity/v3/projects/217b510c8e524248a6becd6292b79b15/users/c4a5dec7466a413b9d4d1d262dad63b8/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:41.598855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2583a-0556-41c6-8150-b8bbda114691 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:41.638519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-31e7616b-5c93-4653-8d4b-ef882daf4046 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:41.639705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-31e7616b-5c93-4653-8d4b-ef882daf4046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:41.828205 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3135/6246] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:29:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:41.831228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2583a-0556-41c6-8150-b8bbda114691 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:41.833589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7616b-5c93-4653-8d4b-ef882daf4046 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:41.848962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0e1f1-f029-4412-84bf-1075200a0f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:41.851770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0e1f1-f029-4412-84bf-1075200a0f73 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:41.851770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0e1f1-f029-4412-84bf-1075200a0f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:41.852202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0e1f1-f029-4412-84bf-1075200a0f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:41.852760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0e1f1-f029-4412-84bf-1075200a0f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:41.859717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0e1f1-f029-4412-84bf-1075200a0f73 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:41.899057 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3112/6247] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:41.903675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd5e1-da70-4e29-9178-0cdafefdabd5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:41.905311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd5e1-da70-4e29-9178-0cdafefdabd5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:41.909304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd5e1-da70-4e29-9178-0cdafefdabd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:41.915915 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:41.971255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9c1dd5e1-da70-4e29-9178-0cdafefdabd5 None None] MFA Rules not processed for user `c4a5dec7466a413b9d4d1d262dad63b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:41.973224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c1dd5e1-da70-4e29-9178-0cdafefdabd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:42.055743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7616b-5c93-4653-8d4b-ef882daf4046 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:42.065160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e788b-6a11-4923-8932-392bf89cd8ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:42.065160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e788b-6a11-4923-8932-392bf89cd8ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:42.065563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e788b-6a11-4923-8932-392bf89cd8ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:42.065739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e788b-6a11-4923-8932-392bf89cd8ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/users/378380bcf493466ab7cc4dfe4c8bc891` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:42.066935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e788b-6a11-4923-8932-392bf89cd8ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:get_user(user_id=378380bcf493466ab7cc4dfe4c8bc891)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:42.069297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e788b-6a11-4923-8932-392bf89cd8ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:42.071008 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3136/6248] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:29:41 2022] GET /identity/v3/users/378380bcf493466ab7cc4dfe4c8bc891 => generated 287 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:42.071901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e788b-6a11-4923-8932-392bf89cd8ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:42.077176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1c6e788b-6a11-4923-8932-392bf89cd8ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:42.168770 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:42.222485 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3113/6249] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:42.225265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dd5e1-da70-4e29-9178-0cdafefdabd5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:42.239512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dd5e1-da70-4e29-9178-0cdafefdabd5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:42.244243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e788b-6a11-4923-8932-392bf89cd8ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:42.252534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d8cf0-e94b-40e3-bc95-fad362b89e17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:42.252690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db9c21-1179-4ce4-b433-6583f62411f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:42.253157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d8cf0-e94b-40e3-bc95-fad362b89e17 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:42.253439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d8cf0-e94b-40e3-bc95-fad362b89e17 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:42.253659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db9c21-1179-4ce4-b433-6583f62411f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:42.253759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d8cf0-e94b-40e3-bc95-fad362b89e17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:42.253838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db9c21-1179-4ce4-b433-6583f62411f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:42.254201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db9c21-1179-4ce4-b433-6583f62411f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:42.254668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db9c21-1179-4ce4-b433-6583f62411f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:42.256566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db9c21-1179-4ce4-b433-6583f62411f6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:42.267096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d8cf0-e94b-40e3-bc95-fad362b89e17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:42.269132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d8cf0-e94b-40e3-bc95-fad362b89e17 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:42.276360 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3114/6250] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:42.277795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db9c21-1179-4ce4-b433-6583f62411f6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:42.287512 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3137/6251] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:29:42.288556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d8cf0-e94b-40e3-bc95-fad362b89e17 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:42.290360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5c5d8cf0-e94b-40e3-bc95-fad362b89e17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:42.309298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db9c21-1179-4ce4-b433-6583f62411f6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:42.321896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd418e7-0b3c-41dc-a47d-a24e57e9e97c tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:42.322956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd418e7-0b3c-41dc-a47d-a24e57e9e97c tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:42.323671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd418e7-0b3c-41dc-a47d-a24e57e9e97c tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:42.324168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd418e7-0b3c-41dc-a47d-a24e57e9e97c tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:42.325195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd418e7-0b3c-41dc-a47d-a24e57e9e97c tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:42.327309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd418e7-0b3c-41dc-a47d-a24e57e9e97c tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:42.394107 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3115/6252] 10.222.0.23 () {60 vars in 1162 bytes} [Sun Oct 2 01:29:42 2022] POST /identity/v3/credentials => generated 429 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:42.400825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd418e7-0b3c-41dc-a47d-a24e57e9e97c tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:42.447739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd418e7-0b3c-41dc-a47d-a24e57e9e97c tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:42.473583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d8cf0-e94b-40e3-bc95-fad362b89e17 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:42.475864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b2e36-7660-4073-bc7a-61c2c1b12418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:42.481362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2e36-7660-4073-bc7a-61c2c1b12418 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:42.483273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9898e-5e7e-4028-88b7-21efd365670e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:42.485429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9898e-5e7e-4028-88b7-21efd365670e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:42.488156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9898e-5e7e-4028-88b7-21efd365670e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:42.488354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2e36-7660-4073-bc7a-61c2c1b12418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:42.489823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9898e-5e7e-4028-88b7-21efd365670e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:42.490151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2e36-7660-4073-bc7a-61c2c1b12418 admin admin] PATH_INFO: `/v3/projects/0973f69bfb57416f9beca56065387107/users/70ad39832dfc44bb867ce3d6aa0938b0/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:42.527755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9898e-5e7e-4028-88b7-21efd365670e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:42.534785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9898e-5e7e-4028-88b7-21efd365670e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:42.549789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b2e36-7660-4073-bc7a-61c2c1b12418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0973f69bfb57416f9beca56065387107, user_id=70ad39832dfc44bb867ce3d6aa0938b0, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:42.558377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b2e36-7660-4073-bc7a-61c2c1b12418 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:42.580309 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3138/6253] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:42.581906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9898e-5e7e-4028-88b7-21efd365670e service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:42.616645 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3116/6254] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:42 2022] PUT /identity/v3/projects/0973f69bfb57416f9beca56065387107/users/70ad39832dfc44bb867ce3d6aa0938b0/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:42.625307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9898e-5e7e-4028-88b7-21efd365670e service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:42.629292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279f8e0-6d21-4a03-b48a-3a2e287570b5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:42.629759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279f8e0-6d21-4a03-b48a-3a2e287570b5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:42.630232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279f8e0-6d21-4a03-b48a-3a2e287570b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:42.746993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8279f8e0-6d21-4a03-b48a-3a2e287570b5 None None] MFA Rules not processed for user `70ad39832dfc44bb867ce3d6aa0938b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:42.761765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8279f8e0-6d21-4a03-b48a-3a2e287570b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:42.834710 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:42.892750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7edc4-123d-42df-a46c-95113fbb58ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:42.892994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7edc4-123d-42df-a46c-95113fbb58ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:42.893308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7edc4-123d-42df-a46c-95113fbb58ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:42.893645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7edc4-123d-42df-a46c-95113fbb58ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/credentials/8f456a5ecaf0061d87a6c5159d367a50b62cbd419bbba6205b6892b31f7855b4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:42.897959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7edc4-123d-42df-a46c-95113fbb58ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=8f456a5ecaf0061d87a6c5159d367a50b62cbd419bbba6205b6892b31f7855b4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:42.899814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7edc4-123d-42df-a46c-95113fbb58ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:42.915650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7edc4-123d-42df-a46c-95113fbb58ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=8f456a5ecaf0061d87a6c5159d367a50b62cbd419bbba6205b6892b31f7855b4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:42.925802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7edc4-123d-42df-a46c-95113fbb58ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:42.969399 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3139/6255] 10.222.0.23 () {60 vars in 1358 bytes} [Sun Oct 2 01:29:42 2022] PATCH /identity/v3/credentials/8f456a5ecaf0061d87a6c5159d367a50b62cbd419bbba6205b6892b31f7855b4 => generated 436 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:42.973790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7edc4-123d-42df-a46c-95113fbb58ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.006090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7edc4-123d-42df-a46c-95113fbb58ea tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:43.024448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb50d1-bbc1-4cc0-8a6b-61d96b163cb1 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:43.025104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb50d1-bbc1-4cc0-8a6b-61d96b163cb1 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:43.025390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb50d1-bbc1-4cc0-8a6b-61d96b163cb1 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:43.025667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb50d1-bbc1-4cc0-8a6b-61d96b163cb1 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/credentials/8f456a5ecaf0061d87a6c5159d367a50b62cbd419bbba6205b6892b31f7855b4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:43.027548 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3117/6256] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:43.028523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279f8e0-6d21-4a03-b48a-3a2e287570b5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.037754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb50d1-bbc1-4cc0-8a6b-61d96b163cb1 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=8f456a5ecaf0061d87a6c5159d367a50b62cbd419bbba6205b6892b31f7855b4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.040754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb50d1-bbc1-4cc0-8a6b-61d96b163cb1 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.056741 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3140/6257] 10.222.0.23 () {58 vars in 1335 bytes} [Sun Oct 2 01:29:42 2022] GET /identity/v3/credentials/8f456a5ecaf0061d87a6c5159d367a50b62cbd419bbba6205b6892b31f7855b4 => generated 436 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:43.059497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb50d1-bbc1-4cc0-8a6b-61d96b163cb1 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.096346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb50d1-bbc1-4cc0-8a6b-61d96b163cb1 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:43.120409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fce9ad-467a-42fb-bb32-cd3c439d02cf tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:43.122283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fce9ad-467a-42fb-bb32-cd3c439d02cf tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:43.122772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fce9ad-467a-42fb-bb32-cd3c439d02cf tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:43.123065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fce9ad-467a-42fb-bb32-cd3c439d02cf tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/credentials/8f456a5ecaf0061d87a6c5159d367a50b62cbd419bbba6205b6892b31f7855b4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:43.131575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fce9ad-467a-42fb-bb32-cd3c439d02cf tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=8f456a5ecaf0061d87a6c5159d367a50b62cbd419bbba6205b6892b31f7855b4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.141463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fce9ad-467a-42fb-bb32-cd3c439d02cf tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.196900 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3141/6258] 10.222.0.23 () {58 vars in 1338 bytes} [Sun Oct 2 01:29:43 2022] DELETE /identity/v3/credentials/8f456a5ecaf0061d87a6c5159d367a50b62cbd419bbba6205b6892b31f7855b4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:43.202875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fce9ad-467a-42fb-bb32-cd3c439d02cf tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.240535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fce9ad-467a-42fb-bb32-cd3c439d02cf tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:43.253349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279f8e0-6d21-4a03-b48a-3a2e287570b5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:43.255870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d0eb6-905e-425a-88ca-015af2ada2d8 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:43.256560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0eb6-905e-425a-88ca-015af2ada2d8 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:43.256790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0eb6-905e-425a-88ca-015af2ada2d8 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:43.257090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0eb6-905e-425a-88ca-015af2ada2d8 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:43.257931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d0eb6-905e-425a-88ca-015af2ada2d8 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.263453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5a18e-b494-493e-9d08-106cfe418056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:43.263664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d0eb6-905e-425a-88ca-015af2ada2d8 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.264653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5a18e-b494-493e-9d08-106cfe418056 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:43.265139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5a18e-b494-493e-9d08-106cfe418056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:43.265655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5a18e-b494-493e-9d08-106cfe418056 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:43.268693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5a18e-b494-493e-9d08-106cfe418056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.271756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5a18e-b494-493e-9d08-106cfe418056 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.297537 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3142/6259] 10.222.0.23 () {60 vars in 1162 bytes} [Sun Oct 2 01:29:43 2022] POST /identity/v3/credentials => generated 430 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:29:43.301499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d0eb6-905e-425a-88ca-015af2ada2d8 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.324500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d0eb6-905e-425a-88ca-015af2ada2d8 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:43.332626 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3118/6260] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:43 2022] POST /identity/v3/projects => generated 373 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:43.338627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5a18e-b494-493e-9d08-106cfe418056 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.342914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f33a54-bcf7-421c-b280-5918beb37f05 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:43.343703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f33a54-bcf7-421c-b280-5918beb37f05 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:43.344154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f33a54-bcf7-421c-b280-5918beb37f05 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:43.344514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f33a54-bcf7-421c-b280-5918beb37f05 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:43.345145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f33a54-bcf7-421c-b280-5918beb37f05 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.347273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f33a54-bcf7-421c-b280-5918beb37f05 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.387949 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3143/6261] 10.222.0.23 () {60 vars in 1162 bytes} [Sun Oct 2 01:29:43 2022] POST /identity/v3/credentials => generated 429 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:29:43.391974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f33a54-bcf7-421c-b280-5918beb37f05 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.415705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f33a54-bcf7-421c-b280-5918beb37f05 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:43.419370 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:43.529877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5a18e-b494-493e-9d08-106cfe418056 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:43.544265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558138a2-e868-47dc-a24b-88edf6e76895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:43.545681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558138a2-e868-47dc-a24b-88edf6e76895 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:43.545966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558138a2-e868-47dc-a24b-88edf6e76895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:43.546233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558138a2-e868-47dc-a24b-88edf6e76895 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:43.548413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558138a2-e868-47dc-a24b-88edf6e76895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.554935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558138a2-e868-47dc-a24b-88edf6e76895 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.618684 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3119/6262] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:43 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:43.621966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558138a2-e868-47dc-a24b-88edf6e76895 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.624270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:43.624967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:43.625313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:43.625641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:43.626469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.628323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.663179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558138a2-e868-47dc-a24b-88edf6e76895 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:43.664193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.666718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.669151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.678396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.678535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8428a-0dbf-4428-b496-056974e8609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:43.679425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8428a-0dbf-4428-b496-056974e8609c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:43.679672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8428a-0dbf-4428-b496-056974e8609c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:43.679953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8428a-0dbf-4428-b496-056974e8609c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:43.682646 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3144/6263] 10.222.0.23 () {58 vars in 1140 bytes} [Sun Oct 2 01:29:43 2022] GET /identity/v3/credentials => generated 944 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:43.683007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8428a-0dbf-4428-b496-056974e8609c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.687543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8428a-0dbf-4428-b496-056974e8609c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.691695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.717120 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3120/6264] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:43.721798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8428a-0dbf-4428-b496-056974e8609c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.729206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260b057-07d7-4da7-ab46-98a8db12e3d4 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:43.746712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc436a4-c7ee-46d1-bce9-8a2ea8c0acdb tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:43.747387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc436a4-c7ee-46d1-bce9-8a2ea8c0acdb tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:43.747676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc436a4-c7ee-46d1-bce9-8a2ea8c0acdb tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:43.747960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc436a4-c7ee-46d1-bce9-8a2ea8c0acdb tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/credentials/a7b2bab38125db826ea5b8b8c377080df5625fe7641f6b8c844de5884cafedb1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:43.750858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8428a-0dbf-4428-b496-056974e8609c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:43.756364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc436a4-c7ee-46d1-bce9-8a2ea8c0acdb tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=a7b2bab38125db826ea5b8b8c377080df5625fe7641f6b8c844de5884cafedb1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.758150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc436a4-c7ee-46d1-bce9-8a2ea8c0acdb tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.768205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11851dd-8cfb-48d0-bf43-4313a106e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:43.772911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11851dd-8cfb-48d0-bf43-4313a106e028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:43.774527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11851dd-8cfb-48d0-bf43-4313a106e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:43.774527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11851dd-8cfb-48d0-bf43-4313a106e028 admin admin] PATH_INFO: `/v3/projects/fc5cee0fe6a2416b83cdf27f36973b51/users/b9a248b4a66b4635b303a99349e2c7b4/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:43.817831 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3145/6265] 10.222.0.23 () {58 vars in 1338 bytes} [Sun Oct 2 01:29:43 2022] DELETE /identity/v3/credentials/a7b2bab38125db826ea5b8b8c377080df5625fe7641f6b8c844de5884cafedb1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:43.822325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc436a4-c7ee-46d1-bce9-8a2ea8c0acdb tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.831428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11851dd-8cfb-48d0-bf43-4313a106e028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5cee0fe6a2416b83cdf27f36973b51, user_id=b9a248b4a66b4635b303a99349e2c7b4, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.834428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11851dd-8cfb-48d0-bf43-4313a106e028 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.851616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc436a4-c7ee-46d1-bce9-8a2ea8c0acdb tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:43.868079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7dfe6-1a95-4b7f-a75e-abc92950ce95 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:43.868732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7dfe6-1a95-4b7f-a75e-abc92950ce95 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:43.869038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7dfe6-1a95-4b7f-a75e-abc92950ce95 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:43.869435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7dfe6-1a95-4b7f-a75e-abc92950ce95 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/credentials/2b75f80f875d5cc48e31f710ca03dce04224f44d96cbfb91c5a20d9200bdc0c0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:43.872777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7dfe6-1a95-4b7f-a75e-abc92950ce95 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=2b75f80f875d5cc48e31f710ca03dce04224f44d96cbfb91c5a20d9200bdc0c0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:43.874548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7dfe6-1a95-4b7f-a75e-abc92950ce95 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:43.878333 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3121/6266] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:43 2022] PUT /identity/v3/projects/fc5cee0fe6a2416b83cdf27f36973b51/users/b9a248b4a66b4635b303a99349e2c7b4/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:43.884526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11851dd-8cfb-48d0-bf43-4313a106e028 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.915818 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3146/6267] 10.222.0.23 () {58 vars in 1338 bytes} [Sun Oct 2 01:29:43 2022] DELETE /identity/v3/credentials/2b75f80f875d5cc48e31f710ca03dce04224f44d96cbfb91c5a20d9200bdc0c0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:29:43.921609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7dfe6-1a95-4b7f-a75e-abc92950ce95 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:43.944746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7dfe6-1a95-4b7f-a75e-abc92950ce95 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:44.090170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:44.091029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:44.091273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:44.091752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/projects/15a996737dd546ad8835b5976f61436f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:44.096508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:delete_project(project_id=15a996737dd546ad8835b5976f61436f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:44.099254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:44.118927 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:44.188693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11851dd-8cfb-48d0-bf43-4313a106e028 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:44.264154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a996737dd546ad8835b5976f61436f', 'request_id': 'req-21e3e362-1faf-404f-88dd-8f6d92fbf732'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:44.284112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a996737dd546ad8835b5976f61436f', 'request_id': 'req-21e3e362-1faf-404f-88dd-8f6d92fbf732'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:44.303364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a996737dd546ad8835b5976f61436f', 'request_id': 'req-21e3e362-1faf-404f-88dd-8f6d92fbf732'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:44.353532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] The token cache is being invalidate because project 15a996737dd546ad8835b5976f61436f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:44.353845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:44.355276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:44.358577 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3147/6268] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:43 2022] DELETE /identity/v3/projects/15a996737dd546ad8835b5976f61436f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:44.364299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:44.371761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:44.435492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf86ef3-f9a6-45ad-a047-91521e1125ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:44.436249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf86ef3-f9a6-45ad-a047-91521e1125ba admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:44.436673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf86ef3-f9a6-45ad-a047-91521e1125ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:44.436796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf86ef3-f9a6-45ad-a047-91521e1125ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:44.447560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf86ef3-f9a6-45ad-a047-91521e1125ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:44.454493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf86ef3-f9a6-45ad-a047-91521e1125ba admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:44.490689 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3122/6269] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 606 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:44.491852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf86ef3-f9a6-45ad-a047-91521e1125ba admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:44.505730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2cf86ef3-f9a6-45ad-a047-91521e1125ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:44.534026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3e362-1faf-404f-88dd-8f6d92fbf732 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:44.541771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf86ef3-f9a6-45ad-a047-91521e1125ba admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:44.548075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63792669-227c-4cf5-aec6-373dcfe24767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:44.548925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792669-227c-4cf5-aec6-373dcfe24767 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:44.549142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792669-227c-4cf5-aec6-373dcfe24767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:44.549430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792669-227c-4cf5-aec6-373dcfe24767 admin admin] PATH_INFO: `/v3/projects/fc5cee0fe6a2416b83cdf27f36973b51/users/b9a248b4a66b4635b303a99349e2c7b4/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:44.550958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2098a6a96e49e5baf11526e943f258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '292ab10652a0453a87c87d33f2a58bde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:44.551627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:44.551776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63792669-227c-4cf5-aec6-373dcfe24767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5cee0fe6a2416b83cdf27f36973b51, user_id=b9a248b4a66b4635b303a99349e2c7b4, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:44.551946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:44.552341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] PATH_INFO: `/v3/projects/4a1d4f41196e400da59b9147d44d05cd` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:44.553537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a1d4f41196e400da59b9147d44d05cd)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:44.556221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:44.567326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63792669-227c-4cf5-aec6-373dcfe24767 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:44.592933 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:44.611128 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3123/6270] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:44 2022] PUT /identity/v3/projects/fc5cee0fe6a2416b83cdf27f36973b51/users/b9a248b4a66b4635b303a99349e2c7b4/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:29:44.623302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11de190-dc5a-49fc-a3b0-d558395df4f1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:44.623613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11de190-dc5a-49fc-a3b0-d558395df4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:44.623873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11de190-dc5a-49fc-a3b0-d558395df4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:44.685105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c11de190-dc5a-49fc-a3b0-d558395df4f1 None None] MFA Rules not processed for user `b9a248b4a66b4635b303a99349e2c7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:44.688216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c11de190-dc5a-49fc-a3b0-d558395df4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:44.726646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1d4f41196e400da59b9147d44d05cd', 'request_id': 'req-807f6085-c53b-4c32-8f72-07d5f14c4f43'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:44.741914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1d4f41196e400da59b9147d44d05cd', 'request_id': 'req-807f6085-c53b-4c32-8f72-07d5f14c4f43'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:44.759362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1d4f41196e400da59b9147d44d05cd', 'request_id': 'req-807f6085-c53b-4c32-8f72-07d5f14c4f43'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:44.788546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] The token cache is being invalidate because project 4a1d4f41196e400da59b9147d44d05cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:44.788850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:44.790922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:44.798872 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3148/6271] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:44 2022] DELETE /identity/v3/projects/4a1d4f41196e400da59b9147d44d05cd => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:44.799781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:44.803652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:44.845834 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:44.940818 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3124/6272] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:44.941848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11de190-dc5a-49fc-a3b0-d558395df4f1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:44.980589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f6085-c53b-4c32-8f72-07d5f14c4f43 tempest-CredentialsTestJSON-576614303 tempest-CredentialsTestJSON-576614303-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:44.996703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11de190-dc5a-49fc-a3b0-d558395df4f1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:45.002355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea31930-dca1-45a0-a9f8-511767eff5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:45.003288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea31930-dca1-45a0-a9f8-511767eff5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:45.003579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea31930-dca1-45a0-a9f8-511767eff5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:45.003890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea31930-dca1-45a0-a9f8-511767eff5e2 admin admin] PATH_INFO: `/v3/users/378380bcf493466ab7cc4dfe4c8bc891` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:45.007452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea31930-dca1-45a0-a9f8-511767eff5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378380bcf493466ab7cc4dfe4c8bc891)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:45.009761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea31930-dca1-45a0-a9f8-511767eff5e2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:45.013859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d12e6-2a4a-45d4-85e5-a11b6d57fb63 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:45.016411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d12e6-2a4a-45d4-85e5-a11b6d57fb63 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:45.017667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d12e6-2a4a-45d4-85e5-a11b6d57fb63 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:45.018889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d12e6-2a4a-45d4-85e5-a11b6d57fb63 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:45.021421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d12e6-2a4a-45d4-85e5-a11b6d57fb63 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:45.029496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d12e6-2a4a-45d4-85e5-a11b6d57fb63 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:45.081262 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3125/6273] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:44 2022] POST /identity/v3/services => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:45.111788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d12e6-2a4a-45d4-85e5-a11b6d57fb63 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:45.153673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5ea31930-dca1-45a0-a9f8-511767eff5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378380bcf493466ab7cc4dfe4c8bc891'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:45.178429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5ea31930-dca1-45a0-a9f8-511767eff5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378380bcf493466ab7cc4dfe4c8bc891'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:45.179901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5ea31930-dca1-45a0-a9f8-511767eff5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378380bcf493466ab7cc4dfe4c8bc891'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:45.197377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5ea31930-dca1-45a0-a9f8-511767eff5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378380bcf493466ab7cc4dfe4c8bc891'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:45.198104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5ea31930-dca1-45a0-a9f8-511767eff5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378380bcf493466ab7cc4dfe4c8bc891'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:45.201730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d12e6-2a4a-45d4-85e5-a11b6d57fb63 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:45.219472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d37eb-2862-44eb-86ec-11d45405b0d6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:45.220856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d37eb-2862-44eb-86ec-11d45405b0d6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:45.224408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d37eb-2862-44eb-86ec-11d45405b0d6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:45.236432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d37eb-2862-44eb-86ec-11d45405b0d6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:45.240361 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3149/6274] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:44 2022] DELETE /identity/v3/users/378380bcf493466ab7cc4dfe4c8bc891 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:29:45.255886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eb950-17ce-4a9f-845f-55915d996bf4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:45.258756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eb950-17ce-4a9f-845f-55915d996bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:45.259240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eb950-17ce-4a9f-845f-55915d996bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:45.259748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d37eb-2862-44eb-86ec-11d45405b0d6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:45.285234 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-d35d37eb-2862-44eb-86ec-11d45405b0d6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:45.285234 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:29:45.285234 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:29:45.290318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d37eb-2862-44eb-86ec-11d45405b0d6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:45.322350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0e0eb950-17ce-4a9f-845f-55915d996bf4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:45.322350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0e0eb950-17ce-4a9f-845f-55915d996bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:45.342186 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3126/6275] 10.222.0.23 () {60 vars in 1213 bytes} [Sun Oct 2 01:29:45 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:45.344529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d37eb-2862-44eb-86ec-11d45405b0d6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:45.347622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d35d37eb-2862-44eb-86ec-11d45405b0d6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:45.367587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d37eb-2862-44eb-86ec-11d45405b0d6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:45.521804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73494ddd-53bb-47ca-971c-a46903c14745 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:45.523762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73494ddd-53bb-47ca-971c-a46903c14745 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:45.525749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73494ddd-53bb-47ca-971c-a46903c14745 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:45.526030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73494ddd-53bb-47ca-971c-a46903c14745 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:45.531361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73494ddd-53bb-47ca-971c-a46903c14745 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:45.539837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73494ddd-53bb-47ca-971c-a46903c14745 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:45.583415 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3127/6276] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:45 2022] POST /identity/v3/services => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:45.593217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73494ddd-53bb-47ca-971c-a46903c14745 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:45.664782 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3150/6277] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3505 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:45.666576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73494ddd-53bb-47ca-971c-a46903c14745 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:45.672795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc35e6-95e2-4614-ba9f-28cec9f3fc35 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:45.673600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc35e6-95e2-4614-ba9f-28cec9f3fc35 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:45.676555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eb950-17ce-4a9f-845f-55915d996bf4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:45.678638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0e0eb950-17ce-4a9f-845f-55915d996bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:45.686732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc35e6-95e2-4614-ba9f-28cec9f3fc35 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:45.687083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc35e6-95e2-4614-ba9f-28cec9f3fc35 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:45.689648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc35e6-95e2-4614-ba9f-28cec9f3fc35 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:45.697299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc35e6-95e2-4614-ba9f-28cec9f3fc35 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:45.752652 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3128/6278] 10.222.0.23 () {60 vars in 1213 bytes} [Sun Oct 2 01:29:45 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:45.756783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc35e6-95e2-4614-ba9f-28cec9f3fc35 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:45.777669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc35e6-95e2-4614-ba9f-28cec9f3fc35 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:45.803482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c9e9-bf94-4e32-9672-1c64dc291a2b tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:45.804409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c9e9-bf94-4e32-9672-1c64dc291a2b tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:45.806279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c9e9-bf94-4e32-9672-1c64dc291a2b tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:45.806778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c9e9-bf94-4e32-9672-1c64dc291a2b tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:45.808427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7c9e9-bf94-4e32-9672-1c64dc291a2b tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:45.817150 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-c9c7c9e9-bf94-4e32-9672-1c64dc291a2b tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:45.817150 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:29:45.817150 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:29:45.826018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7c9e9-bf94-4e32-9672-1c64dc291a2b tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:45.830693 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:45.846835 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3129/6279] 10.222.0.23 () {58 vars in 1191 bytes} [Sun Oct 2 01:29:45 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:29:45.849933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c9e9-bf94-4e32-9672-1c64dc291a2b tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:45.891903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c9e9-bf94-4e32-9672-1c64dc291a2b tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:45.901935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2da91-0eb7-4948-9999-3f85f545c3c6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:45.913717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2da91-0eb7-4948-9999-3f85f545c3c6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:45.914322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2da91-0eb7-4948-9999-3f85f545c3c6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:45.914893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2da91-0eb7-4948-9999-3f85f545c3c6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0227851415a94d0487bb20837779ca94` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:45.918434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2da91-0eb7-4948-9999-3f85f545c3c6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=0227851415a94d0487bb20837779ca94)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:45.920426 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-8cf2da91-0eb7-4948-9999-3f85f545c3c6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:45.920426 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:29:45.920426 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:29:45.921796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2da91-0eb7-4948-9999-3f85f545c3c6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:45.934326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eb950-17ce-4a9f-845f-55915d996bf4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:45.950436 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3130/6280] 10.222.0.23 () {58 vars in 1290 bytes} [Sun Oct 2 01:29:45 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/0227851415a94d0487bb20837779ca94 => generated 334 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:45.951947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f506c-a6f8-4883-a5ba-c5383f4b11f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:45.952658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f506c-a6f8-4883-a5ba-c5383f4b11f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:45.957546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2da91-0eb7-4948-9999-3f85f545c3c6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:45.958138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f506c-a6f8-4883-a5ba-c5383f4b11f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:45.961965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f506c-a6f8-4883-a5ba-c5383f4b11f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:45.998904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2da91-0eb7-4948-9999-3f85f545c3c6 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:46.004233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f506c-a6f8-4883-a5ba-c5383f4b11f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:46.005977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f506c-a6f8-4883-a5ba-c5383f4b11f6 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:46.010301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f8907-abf9-4433-987f-9cad8bf64103 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:46.011121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f8907-abf9-4433-987f-9cad8bf64103 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:46.011410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f8907-abf9-4433-987f-9cad8bf64103 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:46.011693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f8907-abf9-4433-987f-9cad8bf64103 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0227851415a94d0487bb20837779ca94` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:46.012737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f8907-abf9-4433-987f-9cad8bf64103 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=0227851415a94d0487bb20837779ca94)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:46.014511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f8907-abf9-4433-987f-9cad8bf64103 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:46.029742 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:46.032764 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3151/6281] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:45 2022] GET /identity/v3/auth/tokens => generated 3505 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:29:46.044932 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3131/6282] 10.222.0.23 () {58 vars in 1291 bytes} [Sun Oct 2 01:29:45 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/0227851415a94d0487bb20837779ca94 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 02 01:29:46.047586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f506c-a6f8-4883-a5ba-c5383f4b11f6 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:46.064795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f506c-a6f8-4883-a5ba-c5383f4b11f6 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:46.082393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bda99-7f8a-4476-bcd3-e6bf7f5be183 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:46.083082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bda99-7f8a-4476-bcd3-e6bf7f5be183 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:46.083364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bda99-7f8a-4476-bcd3-e6bf7f5be183 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:46.083639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bda99-7f8a-4476-bcd3-e6bf7f5be183 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0227851415a94d0487bb20837779ca94` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:46.084256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bda99-7f8a-4476-bcd3-e6bf7f5be183 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=0227851415a94d0487bb20837779ca94)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:46.085956 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-fd6bda99-7f8a-4476-bcd3-e6bf7f5be183 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:46.085956 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:29:46.085956 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:29:46.086499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bda99-7f8a-4476-bcd3-e6bf7f5be183 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:46.143196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f8907-abf9-4433-987f-9cad8bf64103 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:46.150954 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3152/6283] 10.222.0.23 () {58 vars in 1293 bytes} [Sun Oct 2 01:29:46 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/0227851415a94d0487bb20837779ca94 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:46.169804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f8907-abf9-4433-987f-9cad8bf64103 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:46.191096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f19cb-6834-43bc-a3ed-f202de2e4656 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:46.191738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f19cb-6834-43bc-a3ed-f202de2e4656 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:46.192255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f19cb-6834-43bc-a3ed-f202de2e4656 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:46.192580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f19cb-6834-43bc-a3ed-f202de2e4656 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:46.193230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f19cb-6834-43bc-a3ed-f202de2e4656 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:46.195209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f19cb-6834-43bc-a3ed-f202de2e4656 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:46.206313 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3132/6284] 10.222.0.23 () {58 vars in 1191 bytes} [Sun Oct 2 01:29:46 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:29:46.210700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bda99-7f8a-4476-bcd3-e6bf7f5be183 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:46.249180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bda99-7f8a-4476-bcd3-e6bf7f5be183 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:46.272623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721abd1b-b2be-48b0-bff4-079ed63011d5 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:46.273622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721abd1b-b2be-48b0-bff4-079ed63011d5 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:46.274955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721abd1b-b2be-48b0-bff4-079ed63011d5 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:46.274955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721abd1b-b2be-48b0-bff4-079ed63011d5 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0227851415a94d0487bb20837779ca94` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:46.275198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721abd1b-b2be-48b0-bff4-079ed63011d5 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=0227851415a94d0487bb20837779ca94)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:46.277615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721abd1b-b2be-48b0-bff4-079ed63011d5 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-721abd1b-b2be-48b0-bff4-079ed63011d5 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Could not find Endpoint Group: 0227851415a94d0487bb20837779ca94.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 0227851415a94d0487bb20837779ca94. Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 02 01:29:46.320760 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 02 01:29:46.321976 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 02 01:29:46.321976 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 02 01:29:46.321976 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 02 01:29:46.321976 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 02 01:29:46.321976 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 0227851415a94d0487bb20837779ca94. Oct 02 01:29:46.321976 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:46.327789 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3153/6285] 10.222.0.23 () {58 vars in 1293 bytes} [Sun Oct 2 01:29:46 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/0227851415a94d0487bb20837779ca94 => generated 120 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:29:46.328220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f19cb-6834-43bc-a3ed-f202de2e4656 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:46.345415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f19cb-6834-43bc-a3ed-f202de2e4656 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:46.366483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15621d-cf4a-4920-8d6d-b0f7fa00cf9a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:46.367312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15621d-cf4a-4920-8d6d-b0f7fa00cf9a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:46.367652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15621d-cf4a-4920-8d6d-b0f7fa00cf9a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:46.367933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15621d-cf4a-4920-8d6d-b0f7fa00cf9a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/services/6e2277376b75449dbb3791212de82d29` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:46.368687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15621d-cf4a-4920-8d6d-b0f7fa00cf9a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6e2277376b75449dbb3791212de82d29)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:46.370548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15621d-cf4a-4920-8d6d-b0f7fa00cf9a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:46.428413 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3133/6286] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:46 2022] DELETE /identity/v3/services/6e2277376b75449dbb3791212de82d29 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:29:46.434493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721abd1b-b2be-48b0-bff4-079ed63011d5 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:46.455435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721abd1b-b2be-48b0-bff4-079ed63011d5 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:46.532729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30157b9c-2724-4e70-b4cf-05a92a8a8160 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:46.533603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30157b9c-2724-4e70-b4cf-05a92a8a8160 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:46.534195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30157b9c-2724-4e70-b4cf-05a92a8a8160 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:46.534768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30157b9c-2724-4e70-b4cf-05a92a8a8160 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:46.535750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30157b9c-2724-4e70-b4cf-05a92a8a8160 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:46.538285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30157b9c-2724-4e70-b4cf-05a92a8a8160 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:46.598358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15621d-cf4a-4920-8d6d-b0f7fa00cf9a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:46.600764 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3154/6287] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:46 2022] POST /identity/v3/services => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:29:46.610765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15621d-cf4a-4920-8d6d-b0f7fa00cf9a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:46.633888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ba211-17f2-4901-96bb-7949199a51b7 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:46.634523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ba211-17f2-4901-96bb-7949199a51b7 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:46.634839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ba211-17f2-4901-96bb-7949199a51b7 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:46.635117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ba211-17f2-4901-96bb-7949199a51b7 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:46.636999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ba211-17f2-4901-96bb-7949199a51b7 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:46.641192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ba211-17f2-4901-96bb-7949199a51b7 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:46.663492 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3134/6288] 10.222.0.23 () {60 vars in 1213 bytes} [Sun Oct 2 01:29:46 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:46.673828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30157b9c-2724-4e70-b4cf-05a92a8a8160 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:46.709802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30157b9c-2724-4e70-b4cf-05a92a8a8160 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:46.747578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef422ab6-9e6c-4251-81bd-6eef87593cad tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:46.749529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef422ab6-9e6c-4251-81bd-6eef87593cad tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:46.749827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef422ab6-9e6c-4251-81bd-6eef87593cad tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:46.755280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef422ab6-9e6c-4251-81bd-6eef87593cad tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/services` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:46.759742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef422ab6-9e6c-4251-81bd-6eef87593cad tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:46.780437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef422ab6-9e6c-4251-81bd-6eef87593cad tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:46.853381 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3155/6289] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:46 2022] POST /identity/v3/services => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:46.858248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ba211-17f2-4901-96bb-7949199a51b7 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:46.872722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ba211-17f2-4901-96bb-7949199a51b7 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:46.939450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15570bae-1fd5-4ff7-a89b-0fbecc919dfa tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:46.940113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15570bae-1fd5-4ff7-a89b-0fbecc919dfa tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:46.940400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15570bae-1fd5-4ff7-a89b-0fbecc919dfa tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:46.940684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15570bae-1fd5-4ff7-a89b-0fbecc919dfa tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9efa4485a53f467ea93cc252f174e205` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:46.941376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15570bae-1fd5-4ff7-a89b-0fbecc919dfa tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=9efa4485a53f467ea93cc252f174e205)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:46.942412 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-15570bae-1fd5-4ff7-a89b-0fbecc919dfa tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:46.942412 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:29:46.942412 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:29:46.943368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15570bae-1fd5-4ff7-a89b-0fbecc919dfa tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:47.006785 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3135/6290] 10.222.0.23 () {60 vars in 1313 bytes} [Sun Oct 2 01:29:46 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/9efa4485a53f467ea93cc252f174e205 => generated 336 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:47.007070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef422ab6-9e6c-4251-81bd-6eef87593cad tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:47.027735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef422ab6-9e6c-4251-81bd-6eef87593cad tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:47.041730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f958257-e38c-4f9a-9353-0c6637817ed9 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:47.046097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f958257-e38c-4f9a-9353-0c6637817ed9 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:47.046553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f958257-e38c-4f9a-9353-0c6637817ed9 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:47.047250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f958257-e38c-4f9a-9353-0c6637817ed9 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/services/7217b2371f3c4cdb97723a0666ca1ce4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:47.048854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f958257-e38c-4f9a-9353-0c6637817ed9 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7217b2371f3c4cdb97723a0666ca1ce4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:47.059515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f958257-e38c-4f9a-9353-0c6637817ed9 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:47.132519 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3156/6291] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:47 2022] DELETE /identity/v3/services/7217b2371f3c4cdb97723a0666ca1ce4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:47.137310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15570bae-1fd5-4ff7-a89b-0fbecc919dfa tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:47.153029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15570bae-1fd5-4ff7-a89b-0fbecc919dfa tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:47.186092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2b3b6-4a7b-4672-9081-f10cf21be0f4 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:47.189991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2b3b6-4a7b-4672-9081-f10cf21be0f4 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:47.190310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2b3b6-4a7b-4672-9081-f10cf21be0f4 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:47.190580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2b3b6-4a7b-4672-9081-f10cf21be0f4 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9efa4485a53f467ea93cc252f174e205` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:47.191224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2b3b6-4a7b-4672-9081-f10cf21be0f4 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=9efa4485a53f467ea93cc252f174e205)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:47.192272 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-a8d2b3b6-4a7b-4672-9081-f10cf21be0f4 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:29:47.192272 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:29:47.192272 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:29:47.193343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2b3b6-4a7b-4672-9081-f10cf21be0f4 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:47.220416 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3136/6292] 10.222.0.23 () {58 vars in 1293 bytes} [Sun Oct 2 01:29:47 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/9efa4485a53f467ea93cc252f174e205 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:47.224918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f958257-e38c-4f9a-9353-0c6637817ed9 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:47.240654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f958257-e38c-4f9a-9353-0c6637817ed9 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:47.247034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbefb18-039a-483a-bf4d-89f09c83b763 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:47.248110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbefb18-039a-483a-bf4d-89f09c83b763 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:47.248407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbefb18-039a-483a-bf4d-89f09c83b763 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:47.249022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbefb18-039a-483a-bf4d-89f09c83b763 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/services/251ed3d7941c4ff39bde9389bdf40f3a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:47.250620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbefb18-039a-483a-bf4d-89f09c83b763 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:delete_service(service_id=251ed3d7941c4ff39bde9389bdf40f3a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:47.254362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbefb18-039a-483a-bf4d-89f09c83b763 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:47.307906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2b3b6-4a7b-4672-9081-f10cf21be0f4 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:47.308351 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3157/6293] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:47 2022] DELETE /identity/v3/services/251ed3d7941c4ff39bde9389bdf40f3a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:47.320773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2b3b6-4a7b-4672-9081-f10cf21be0f4 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:47.370430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbefb18-039a-483a-bf4d-89f09c83b763 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:47.372204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9dbefb18-039a-483a-bf4d-89f09c83b763 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:47.382321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7af60-24fb-463e-b490-5e8e9dd8692a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:47.383009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7af60-24fb-463e-b490-5e8e9dd8692a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:47.383294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7af60-24fb-463e-b490-5e8e9dd8692a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:47.387919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7af60-24fb-463e-b490-5e8e9dd8692a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/32894a115c084b71bd3b878bde4aaf0a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:47.391586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7af60-24fb-463e-b490-5e8e9dd8692a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=32894a115c084b71bd3b878bde4aaf0a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:47.393412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7af60-24fb-463e-b490-5e8e9dd8692a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:47.439752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbefb18-039a-483a-bf4d-89f09c83b763 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:47.452025 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3137/6294] 10.222.0.23 () {58 vars in 1293 bytes} [Sun Oct 2 01:29:47 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/32894a115c084b71bd3b878bde4aaf0a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:47.456209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7af60-24fb-463e-b490-5e8e9dd8692a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:47.457490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:47.459527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:47.462430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:47.463770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] PATH_INFO: `/v3/projects/11dc4a1c2bf6461280a4e7afb0528d33` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:47.466896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11dc4a1c2bf6461280a4e7afb0528d33)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:47.473033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:47.490985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7af60-24fb-463e-b490-5e8e9dd8692a tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:47.509846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a316b-f573-41a3-bf13-36c79dbcf395 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a248b4a66b4635b303a99349e2c7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc5cee0fe6a2416b83cdf27f36973b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:47.510680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a316b-f573-41a3-bf13-36c79dbcf395 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:47.510942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a316b-f573-41a3-bf13-36c79dbcf395 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:47.511581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a316b-f573-41a3-bf13-36c79dbcf395 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] PATH_INFO: `/v3/services/c6dbf0dd6bbf4da682d3fca82c282ab1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:47.512481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a316b-f573-41a3-bf13-36c79dbcf395 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c6dbf0dd6bbf4da682d3fca82c282ab1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:47.515265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a316b-f573-41a3-bf13-36c79dbcf395 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:47.581584 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3138/6295] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:47 2022] DELETE /identity/v3/services/c6dbf0dd6bbf4da682d3fca82c282ab1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:29:47.585220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a316b-f573-41a3-bf13-36c79dbcf395 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:47.587296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f73a316b-f573-41a3-bf13-36c79dbcf395 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:47.625395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11dc4a1c2bf6461280a4e7afb0528d33', 'request_id': 'req-1303169f-b167-4f70-8f1f-4fca208376b3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:47.642637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11dc4a1c2bf6461280a4e7afb0528d33', 'request_id': 'req-1303169f-b167-4f70-8f1f-4fca208376b3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:47.660059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11dc4a1c2bf6461280a4e7afb0528d33', 'request_id': 'req-1303169f-b167-4f70-8f1f-4fca208376b3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:47.680666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a316b-f573-41a3-bf13-36c79dbcf395 tempest-EndPointGroupsTest-1688010024 tempest-EndPointGroupsTest-1688010024-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:47.683254 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:47.688863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] The token cache is being invalidate because project 11dc4a1c2bf6461280a4e7afb0528d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:47.689812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:47.691985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:47.701030 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3158/6296] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:47 2022] DELETE /identity/v3/projects/11dc4a1c2bf6461280a4e7afb0528d33 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:47.702348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:47.706998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:47.861704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:47.863877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:47.864170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:47.864996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] PATH_INFO: `/v3/users/70ad39832dfc44bb867ce3d6aa0938b0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:47.869768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ad39832dfc44bb867ce3d6aa0938b0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:47.874192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:47.905005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303169f-b167-4f70-8f1f-4fca208376b3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:47.921615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ca613-4614-4cbe-9750-dae2dc710d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:47.922364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ca613-4614-4cbe-9750-dae2dc710d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:47.924494 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:47.925766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ca613-4614-4cbe-9750-dae2dc710d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:47.927322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ca613-4614-4cbe-9750-dae2dc710d1b admin admin] PATH_INFO: `/v3/users/ff2098a6a96e49e5baf11526e943f258` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:47.935545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ca613-4614-4cbe-9750-dae2dc710d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2098a6a96e49e5baf11526e943f258)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:47.937758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ca613-4614-4cbe-9750-dae2dc710d1b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:48.060200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ad39832dfc44bb867ce3d6aa0938b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:48.071788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4e7ca613-4614-4cbe-9750-dae2dc710d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2098a6a96e49e5baf11526e943f258'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:48.114409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4e7ca613-4614-4cbe-9750-dae2dc710d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2098a6a96e49e5baf11526e943f258'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:48.115338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4e7ca613-4614-4cbe-9750-dae2dc710d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2098a6a96e49e5baf11526e943f258'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:48.132863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ad39832dfc44bb867ce3d6aa0938b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:48.137916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4e7ca613-4614-4cbe-9750-dae2dc710d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2098a6a96e49e5baf11526e943f258'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:48.138094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ad39832dfc44bb867ce3d6aa0938b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:48.138636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4e7ca613-4614-4cbe-9750-dae2dc710d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2098a6a96e49e5baf11526e943f258'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:48.162416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ad39832dfc44bb867ce3d6aa0938b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:48.178835 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3159/6297] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:47 2022] DELETE /identity/v3/users/ff2098a6a96e49e5baf11526e943f258 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:48.187372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ad39832dfc44bb867ce3d6aa0938b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:48.210834 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3139/6298] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:47 2022] DELETE /identity/v3/users/70ad39832dfc44bb867ce3d6aa0938b0 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:48.216083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266b15d-57b6-4fde-ae93-bf46ea149a1c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:48.216371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266b15d-57b6-4fde-ae93-bf46ea149a1c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:48.216649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266b15d-57b6-4fde-ae93-bf46ea149a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:48.678876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9266b15d-57b6-4fde-ae93-bf46ea149a1c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:48.680014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9266b15d-57b6-4fde-ae93-bf46ea149a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:48.825627 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3160/6299] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 611 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:48.860078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:48.861825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:49.044069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460ce69-ec5f-494b-a9ce-e9d9c5f63117 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:49.050078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050aed2-581d-44a7-ab80-1e39d3805ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:49.051013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050aed2-581d-44a7-ab80-1e39d3805ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:49.051300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050aed2-581d-44a7-ab80-1e39d3805ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:49.051653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050aed2-581d-44a7-ab80-1e39d3805ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:49.083043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050aed2-581d-44a7-ab80-1e39d3805ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:49.083043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050aed2-581d-44a7-ab80-1e39d3805ab8 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:49.129686 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3140/6300] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:50.521329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266b15d-57b6-4fde-ae93-bf46ea149a1c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:50.522822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9266b15d-57b6-4fde-ae93-bf46ea149a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:50.547978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266b15d-57b6-4fde-ae93-bf46ea149a1c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:50.569172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:50.571975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:50.572207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:50.572481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] PATH_INFO: `/v3/projects/292ab10652a0453a87c87d33f2a58bde` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:50.587229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=292ab10652a0453a87c87d33f2a58bde)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:50.597414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:50.640286 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:50.767379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292ab10652a0453a87c87d33f2a58bde', 'request_id': 'req-4fcb797e-216d-4f8c-a569-50d0995d72dc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:50.787824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292ab10652a0453a87c87d33f2a58bde', 'request_id': 'req-4fcb797e-216d-4f8c-a569-50d0995d72dc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:50.810895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292ab10652a0453a87c87d33f2a58bde', 'request_id': 'req-4fcb797e-216d-4f8c-a569-50d0995d72dc'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:50.848425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] The token cache is being invalidate because project 292ab10652a0453a87c87d33f2a58bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:50.848749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:50.894096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4fcb797e-216d-4f8c-a569-50d0995d72dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:50.901190 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3161/6301] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:50 2022] DELETE /identity/v3/projects/292ab10652a0453a87c87d33f2a58bde => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:50.906626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecfc26-8453-487f-a8af-f419233a825a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:50.908503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecfc26-8453-487f-a8af-f419233a825a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:50.908982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecfc26-8453-487f-a8af-f419233a825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:50.990972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-71ecfc26-8453-487f-a8af-f419233a825a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:50.992118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-71ecfc26-8453-487f-a8af-f419233a825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:51.143301 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3141/6302] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:51.255394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0260d5-2eb7-48e8-96c1-1dad4d321ad4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:51.256286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0260d5-2eb7-48e8-96c1-1dad4d321ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:51.257606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0260d5-2eb7-48e8-96c1-1dad4d321ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:51.289680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0e0260d5-2eb7-48e8-96c1-1dad4d321ad4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:51.291616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0e0260d5-2eb7-48e8-96c1-1dad4d321ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:51.316078 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3162/6303] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:51.320739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecfc26-8453-487f-a8af-f419233a825a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:51.342234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecfc26-8453-487f-a8af-f419233a825a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:51.362334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6fa19-ba0f-4393-81a6-9110d6a0dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:51.363042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6fa19-ba0f-4393-81a6-9110d6a0dbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:51.363504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6fa19-ba0f-4393-81a6-9110d6a0dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:51.363964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6fa19-ba0f-4393-81a6-9110d6a0dbf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:51.364646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6fa19-ba0f-4393-81a6-9110d6a0dbf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:51.364956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6fa19-ba0f-4393-81a6-9110d6a0dbf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:51.366641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6fa19-ba0f-4393-81a6-9110d6a0dbf1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:51.414617 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3142/6304] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:51.419411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0260d5-2eb7-48e8-96c1-1dad4d321ad4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:51.436004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0260d5-2eb7-48e8-96c1-1dad4d321ad4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:51.449749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f2c4c-9e51-45cc-a70f-ad1b755fdce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:51.450371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f2c4c-9e51-45cc-a70f-ad1b755fdce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:51.450670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f2c4c-9e51-45cc-a70f-ad1b755fdce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:51.451265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f2c4c-9e51-45cc-a70f-ad1b755fdce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:51.452061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f2c4c-9e51-45cc-a70f-ad1b755fdce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:51.454536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f2c4c-9e51-45cc-a70f-ad1b755fdce3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:51.506334 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3163/6305] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:51 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:51.511470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6fa19-ba0f-4393-81a6-9110d6a0dbf1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:51.530085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6fa19-ba0f-4393-81a6-9110d6a0dbf1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:51.575027 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:51.684443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f2c4c-9e51-45cc-a70f-ad1b755fdce3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:51.686639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e01f2c4c-9e51-45cc-a70f-ad1b755fdce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:51.766419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64249feb-b47a-4971-a251-ed6bb7d42b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:51.781951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64249feb-b47a-4971-a251-ed6bb7d42b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:51.782229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64249feb-b47a-4971-a251-ed6bb7d42b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:51.783235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64249feb-b47a-4971-a251-ed6bb7d42b73 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:51.784022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64249feb-b47a-4971-a251-ed6bb7d42b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:51.791050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64249feb-b47a-4971-a251-ed6bb7d42b73 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:51.854390 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3143/6306] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:51 2022] POST /identity/v3/users => generated 292 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:51.856738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64249feb-b47a-4971-a251-ed6bb7d42b73 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:51.862387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-64249feb-b47a-4971-a251-ed6bb7d42b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:51.894493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64249feb-b47a-4971-a251-ed6bb7d42b73 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:51.897914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f2c4c-9e51-45cc-a70f-ad1b755fdce3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:51.911127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:51.914492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:51.915201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:51.916167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] PATH_INFO: `/v3/users/723db45d54c949fcbdfb1d221f573ccb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:51.919642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=723db45d54c949fcbdfb1d221f573ccb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:51.920318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:51.920972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:51.921250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:51.922238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] PATH_INFO: `/v3/projects/0973f69bfb57416f9beca56065387107` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:51.928472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:51.930548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0973f69bfb57416f9beca56065387107)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:51.934705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:52.066317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0973f69bfb57416f9beca56065387107', 'request_id': 'req-8404bec7-01a2-4420-b0f5-573e62fb611b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.080423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0973f69bfb57416f9beca56065387107', 'request_id': 'req-8404bec7-01a2-4420-b0f5-573e62fb611b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.090725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0973f69bfb57416f9beca56065387107', 'request_id': 'req-8404bec7-01a2-4420-b0f5-573e62fb611b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.121699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] The token cache is being invalidate because project 0973f69bfb57416f9beca56065387107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:52.122093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.123473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.128298 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3164/6307] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:51 2022] DELETE /identity/v3/projects/0973f69bfb57416f9beca56065387107 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:52.129206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:52.131178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:52.142533 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:52.145275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723db45d54c949fcbdfb1d221f573ccb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.200816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723db45d54c949fcbdfb1d221f573ccb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.209558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723db45d54c949fcbdfb1d221f573ccb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.246479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723db45d54c949fcbdfb1d221f573ccb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.278445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723db45d54c949fcbdfb1d221f573ccb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.281989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404bec7-01a2-4420-b0f5-573e62fb611b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:52.290371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67863f-18f8-4333-ab54-b0362e459bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:52.291278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67863f-18f8-4333-ab54-b0362e459bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:52.291558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67863f-18f8-4333-ab54-b0362e459bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:52.291901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67863f-18f8-4333-ab54-b0362e459bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:52.293230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67863f-18f8-4333-ab54-b0362e459bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:52.295268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67863f-18f8-4333-ab54-b0362e459bbe admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:52.302336 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3144/6308] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:51 2022] DELETE /identity/v3/users/723db45d54c949fcbdfb1d221f573ccb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:52.303861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:52.307130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:52.322822 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3165/6309] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:52.325749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c37355-572c-4808-bbd7-5731f070e1f4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:52.326117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c37355-572c-4808-bbd7-5731f070e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:52.326459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c37355-572c-4808-bbd7-5731f070e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:52.367140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a2c37355-572c-4808-bbd7-5731f070e1f4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:52.377404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a2c37355-572c-4808-bbd7-5731f070e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:52.611516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf465-741e-4f62-95d4-053e07affcd6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:52.634127 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3166/6310] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:52.635737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c37355-572c-4808-bbd7-5731f070e1f4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:52.641938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a2c37355-572c-4808-bbd7-5731f070e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:52.643687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:52.645858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:52.648669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:52.651401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] PATH_INFO: `/v3/users/b9a248b4a66b4635b303a99349e2c7b4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:52.658838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a248b4a66b4635b303a99349e2c7b4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:52.661017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:52.728681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c37355-572c-4808-bbd7-5731f070e1f4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:52.748856 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:52.749784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b902-641a-4fb6-a578-886ac4d64111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:52.753155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b902-641a-4fb6-a578-886ac4d64111 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:52.753496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b902-641a-4fb6-a578-886ac4d64111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:52.753976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b902-641a-4fb6-a578-886ac4d64111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:52.758264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9b902-641a-4fb6-a578-886ac4d64111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:52.762850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9b902-641a-4fb6-a578-886ac4d64111 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:52.820990 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3167/6311] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:52.822094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b902-641a-4fb6-a578-886ac4d64111 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:52.827208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-87d9b902-641a-4fb6-a578-886ac4d64111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:52.840435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a248b4a66b4635b303a99349e2c7b4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.871251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a248b4a66b4635b303a99349e2c7b4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.872277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a248b4a66b4635b303a99349e2c7b4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.888100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a248b4a66b4635b303a99349e2c7b4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.896735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a248b4a66b4635b303a99349e2c7b4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:52.910732 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3145/6312] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:29:52 2022] DELETE /identity/v3/users/b9a248b4a66b4635b303a99349e2c7b4 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:52.911812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:52.916530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:53.061769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b902-641a-4fb6-a578-886ac4d64111 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:53.186804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a497d25-4ec5-403e-84f4-1f29571785b2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:53.192620 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:53.203748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d6504-c706-4395-9267-94ade64873b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:53.204652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6504-c706-4395-9267-94ade64873b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:53.205092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6504-c706-4395-9267-94ade64873b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:53.206119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6504-c706-4395-9267-94ade64873b9 admin admin] PATH_INFO: `/v3/projects/ef4eaea339984bcf87dd925882d1f87b/users/e4d2215c1936438bb06fecf12a0afed1/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:53.224802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ca026-f3ab-4db7-b02e-a6ebdb88d4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:53.226102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca026-f3ab-4db7-b02e-a6ebdb88d4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:53.226935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca026-f3ab-4db7-b02e-a6ebdb88d4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:53.227809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca026-f3ab-4db7-b02e-a6ebdb88d4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:53.234552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-162ca026-f3ab-4db7-b02e-a6ebdb88d4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:53.310344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d6504-c706-4395-9267-94ade64873b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4eaea339984bcf87dd925882d1f87b, user_id=e4d2215c1936438bb06fecf12a0afed1, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:53.321702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d6504-c706-4395-9267-94ade64873b9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:53.335198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ca026-f3ab-4db7-b02e-a6ebdb88d4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:53.337106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ca026-f3ab-4db7-b02e-a6ebdb88d4d4 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:53.372666 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3146/6313] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:52 2022] PUT /identity/v3/projects/ef4eaea339984bcf87dd925882d1f87b/users/e4d2215c1936438bb06fecf12a0afed1/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:53.388873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a1f3c-875a-44f1-ae30-71b5188b9584 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:53.391278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a1f3c-875a-44f1-ae30-71b5188b9584 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:53.391563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a1f3c-875a-44f1-ae30-71b5188b9584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:53.405017 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3168/6314] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:53.487251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-764a1f3c-875a-44f1-ae30-71b5188b9584 None None] MFA Rules not processed for user `e4d2215c1936438bb06fecf12a0afed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:53.492661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-764a1f3c-875a-44f1-ae30-71b5188b9584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:53.737121 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3147/6315] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:53.740767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ca026-f3ab-4db7-b02e-a6ebdb88d4d4 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:53.757865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ca026-f3ab-4db7-b02e-a6ebdb88d4d4 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:53.983824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b0b7-0e21-4b9e-a51d-d38bbc87ddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:53.984551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b0b7-0e21-4b9e-a51d-d38bbc87ddd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:53.984898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b0b7-0e21-4b9e-a51d-d38bbc87ddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:53.985244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b0b7-0e21-4b9e-a51d-d38bbc87ddd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:53.985966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2b0b7-0e21-4b9e-a51d-d38bbc87ddd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:53.988289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2b0b7-0e21-4b9e-a51d-d38bbc87ddd1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:54.084551 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3169/6316] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:53 2022] POST /identity/v3/projects => generated 383 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:54.089505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a1f3c-875a-44f1-ae30-71b5188b9584 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:54.131513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a1f3c-875a-44f1-ae30-71b5188b9584 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:54.141055 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:54.329601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb79fe4-7c2a-4a75-829b-3fb3916a6bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:54.330008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb79fe4-7c2a-4a75-829b-3fb3916a6bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:54.330350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb79fe4-7c2a-4a75-829b-3fb3916a6bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:54.330569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb79fe4-7c2a-4a75-829b-3fb3916a6bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:54.331245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb79fe4-7c2a-4a75-829b-3fb3916a6bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:54.333214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb79fe4-7c2a-4a75-829b-3fb3916a6bc1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:54.396542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b0b7-0e21-4b9e-a51d-d38bbc87ddd1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:54.401451 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3148/6317] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:54 2022] POST /identity/v3/users => generated 298 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:54.409490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b0b7-0e21-4b9e-a51d-d38bbc87ddd1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:54.433685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ffebc-0cef-44d4-99bb-bc0f16bc11d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:54.451602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ffebc-0cef-44d4-99bb-bc0f16bc11d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:54.452797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ffebc-0cef-44d4-99bb-bc0f16bc11d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:54.453092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ffebc-0cef-44d4-99bb-bc0f16bc11d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:54.453916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ffebc-0cef-44d4-99bb-bc0f16bc11d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:54.458983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ffebc-0cef-44d4-99bb-bc0f16bc11d6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:54.508767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3170/6318] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:54.511970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb79fe4-7c2a-4a75-829b-3fb3916a6bc1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:54.526790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb79fe4-7c2a-4a75-829b-3fb3916a6bc1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:54.541839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365174e2-a2d8-46ac-9d91-3f2bfe3f603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:54.544113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365174e2-a2d8-46ac-9d91-3f2bfe3f603f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:54.544380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365174e2-a2d8-46ac-9d91-3f2bfe3f603f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:54.544667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365174e2-a2d8-46ac-9d91-3f2bfe3f603f admin admin] PATH_INFO: `/v3/projects/a6ad6b772a41408795ffbcd4772efbc1/users/844c828ae49f4b389af367d377a49ba2/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:54.592987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365174e2-a2d8-46ac-9d91-3f2bfe3f603f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ad6b772a41408795ffbcd4772efbc1, user_id=844c828ae49f4b389af367d377a49ba2, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:54.600115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365174e2-a2d8-46ac-9d91-3f2bfe3f603f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:54.641761 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3149/6319] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:54 2022] PUT /identity/v3/projects/a6ad6b772a41408795ffbcd4772efbc1/users/844c828ae49f4b389af367d377a49ba2/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:54.642749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ffebc-0cef-44d4-99bb-bc0f16bc11d6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:54.659645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ffebc-0cef-44d4-99bb-bc0f16bc11d6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:54.758405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a7796-629a-4b34-9f3a-8f08650649c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:54.759891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a7796-629a-4b34-9f3a-8f08650649c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:54.760350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a7796-629a-4b34-9f3a-8f08650649c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:54.761490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a7796-629a-4b34-9f3a-8f08650649c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:54.762303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a7796-629a-4b34-9f3a-8f08650649c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:54.764095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a7796-629a-4b34-9f3a-8f08650649c7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:54.797399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365174e2-a2d8-46ac-9d91-3f2bfe3f603f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:54.811526 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3171/6320] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:29:54.816141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a7796-629a-4b34-9f3a-8f08650649c7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:54.821835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b38a7796-629a-4b34-9f3a-8f08650649c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:54.824441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365174e2-a2d8-46ac-9d91-3f2bfe3f603f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:54.857382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f28923-968b-4884-9fb2-2c41b04d64cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:54.860223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f28923-968b-4884-9fb2-2c41b04d64cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:54.862224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f28923-968b-4884-9fb2-2c41b04d64cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:54.862865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f28923-968b-4884-9fb2-2c41b04d64cc admin admin] PATH_INFO: `/v3/projects/a6ad6b772a41408795ffbcd4772efbc1/users/844c828ae49f4b389af367d377a49ba2/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:54.886799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f28923-968b-4884-9fb2-2c41b04d64cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ad6b772a41408795ffbcd4772efbc1, user_id=844c828ae49f4b389af367d377a49ba2, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:54.894925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a7796-629a-4b34-9f3a-8f08650649c7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:54.899340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f28923-968b-4884-9fb2-2c41b04d64cc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:54.933235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:54.940237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:54.940532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:54.942163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] PATH_INFO: `/v3/projects/32001c34294243eb94f1c97e4de7aedb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:54.948303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=32001c34294243eb94f1c97e4de7aedb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:54.957833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:54.966631 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3150/6321] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:54 2022] PUT /identity/v3/projects/a6ad6b772a41408795ffbcd4772efbc1/users/844c828ae49f4b389af367d377a49ba2/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:54.982068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c9341-3694-4c69-b809-7e8c8012b480 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:54.984154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c9341-3694-4c69-b809-7e8c8012b480 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:54.984472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c9341-3694-4c69-b809-7e8c8012b480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:55.147487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a52c9341-3694-4c69-b809-7e8c8012b480 None None] MFA Rules not processed for user `844c828ae49f4b389af367d377a49ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:55.151170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a52c9341-3694-4c69-b809-7e8c8012b480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:55.202151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32001c34294243eb94f1c97e4de7aedb', 'request_id': 'req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:55.205596 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:55.218187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32001c34294243eb94f1c97e4de7aedb', 'request_id': 'req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:55.242618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32001c34294243eb94f1c97e4de7aedb', 'request_id': 'req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:55.274566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] The token cache is being invalidate because project 32001c34294243eb94f1c97e4de7aedb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:55.274883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:55.284972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:55.291163 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3172/6322] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:54 2022] DELETE /identity/v3/projects/32001c34294243eb94f1c97e4de7aedb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:55.296360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:55.302203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:55.443156 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3151/6323] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:55.449371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108fb4e-d225-459e-8c31-13bdb8fae97b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:55.450171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108fb4e-d225-459e-8c31-13bdb8fae97b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:55.454136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108fb4e-d225-459e-8c31-13bdb8fae97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:55.508984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8108fb4e-d225-459e-8c31-13bdb8fae97b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:55.510593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8108fb4e-d225-459e-8c31-13bdb8fae97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:55.570730 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:55.630351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f89a8b-36e7-4fee-873f-ba3e15a2e6bf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:55.639359 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3152/6324] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:55.640466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108fb4e-d225-459e-8c31-13bdb8fae97b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:55.647179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:55.647846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:55.648126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:55.648455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] PATH_INFO: `/v3/projects/fc5cee0fe6a2416b83cdf27f36973b51` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:55.649621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5cee0fe6a2416b83cdf27f36973b51)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:55.652156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:55.782587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5cee0fe6a2416b83cdf27f36973b51', 'request_id': 'req-87e38026-3c24-4275-b243-3cf3ff7dc619'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:55.803271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5cee0fe6a2416b83cdf27f36973b51', 'request_id': 'req-87e38026-3c24-4275-b243-3cf3ff7dc619'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:55.817668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5cee0fe6a2416b83cdf27f36973b51', 'request_id': 'req-87e38026-3c24-4275-b243-3cf3ff7dc619'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:55.847347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] The token cache is being invalidate because project fc5cee0fe6a2416b83cdf27f36973b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:55.847800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:55.849028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87e38026-3c24-4275-b243-3cf3ff7dc619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:55.851466 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3173/6325] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:29:55 2022] DELETE /identity/v3/projects/fc5cee0fe6a2416b83cdf27f36973b51 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:55.856520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03025c92-f12b-465c-af20-82b4f00826e2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:55.859037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03025c92-f12b-465c-af20-82b4f00826e2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:55.859351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03025c92-f12b-465c-af20-82b4f00826e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:55.918261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-03025c92-f12b-465c-af20-82b4f00826e2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:55.919685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-03025c92-f12b-465c-af20-82b4f00826e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:56.001200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108fb4e-d225-459e-8c31-13bdb8fae97b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:56.096693 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3174/6326] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:56.098266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f23ccc-1232-421b-b926-2c91acc32c1b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:56.098525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f23ccc-1232-421b-b926-2c91acc32c1b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:56.098842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f23ccc-1232-421b-b926-2c91acc32c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:56.166180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-21f23ccc-1232-421b-b926-2c91acc32c1b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:56.168415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-21f23ccc-1232-421b-b926-2c91acc32c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:56.194859 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3175/6327] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:56.195969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f23ccc-1232-421b-b926-2c91acc32c1b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:56.208178 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:56.209405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2459c76-c166-425d-a29f-90b977f95abd tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:56.210064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2459c76-c166-425d-a29f-90b977f95abd tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:56.210423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2459c76-c166-425d-a29f-90b977f95abd tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:56.211240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2459c76-c166-425d-a29f-90b977f95abd tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:56.213558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2459c76-c166-425d-a29f-90b977f95abd tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:56.216282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2459c76-c166-425d-a29f-90b977f95abd tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:56.226132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f23ccc-1232-421b-b926-2c91acc32c1b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:56.239838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9af24-723a-44c2-81fc-fd080ec710d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:56.240755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9af24-723a-44c2-81fc-fd080ec710d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:56.240884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9af24-723a-44c2-81fc-fd080ec710d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:56.241187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9af24-723a-44c2-81fc-fd080ec710d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f2459c76-c166-425d-a29f-90b977f95abd tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invalid input for field 'name': '' is too short Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: Failed validating 'minLength' in schema['properties']['name']: Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: On instance['name']: Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: Failed validating 'minLength' in schema['properties']['name']: Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: On instance['name']: Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: '' Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise error Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application On instance['name']: Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application '' Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:56.241376 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 02 01:29:56.242847 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 02 01:29:56.243876 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 02 01:29:56.243876 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 02 01:29:56.243876 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:56.243876 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 02 01:29:56.243876 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:29:56.243876 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:56.243876 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application On instance['name']: Oct 02 01:29:56.243876 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application '' Oct 02 01:29:56.243876 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:56.244430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9af24-723a-44c2-81fc-fd080ec710d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:56.244430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9af24-723a-44c2-81fc-fd080ec710d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:56.248554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9af24-723a-44c2-81fc-fd080ec710d5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:56.256801 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3153/6328] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:29:55 2022] POST /identity/v3/domains => generated 283 bytes in 616 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 02 01:29:56.262837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70888e-2a34-4b08-8ac0-566e55c7eeb4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:56.263507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70888e-2a34-4b08-8ac0-566e55c7eeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:56.264200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70888e-2a34-4b08-8ac0-566e55c7eeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:56.280172 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3176/6329] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:56.280172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9af24-723a-44c2-81fc-fd080ec710d5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:56.287023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-abc9af24-723a-44c2-81fc-fd080ec710d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:56.320456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9af24-723a-44c2-81fc-fd080ec710d5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:56.322676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2c70888e-2a34-4b08-8ac0-566e55c7eeb4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:56.329748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2c70888e-2a34-4b08-8ac0-566e55c7eeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:56.330493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b871096-f751-415b-8774-6a1bcd2dc9e4 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:56.331250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b871096-f751-415b-8774-6a1bcd2dc9e4 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:56.331613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b871096-f751-415b-8774-6a1bcd2dc9e4 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:56.331956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b871096-f751-415b-8774-6a1bcd2dc9e4 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:56.332690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b871096-f751-415b-8774-6a1bcd2dc9e4 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:56.334364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b871096-f751-415b-8774-6a1bcd2dc9e4 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-7b871096-f751-415b-8774-6a1bcd2dc9e4 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: Failed validating 'maxLength' in schema['properties']['name']: Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: On instance['name']: Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: Failed validating 'maxLength' in schema['properties']['name']: Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: On instance['name']: Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise error Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:29:56.351414 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application On instance['name']: Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 02 01:29:56.352920 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application On instance['name']: Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 02 01:29:56.354162 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:56.355773 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3154/6330] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:56.357266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70888e-2a34-4b08-8ac0-566e55c7eeb4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:56.364810 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3177/6331] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:29:56 2022] POST /identity/v3/domains => generated 412 bytes in 87 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 02 01:29:56.366145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b871096-f751-415b-8774-6a1bcd2dc9e4 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:56.381549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70888e-2a34-4b08-8ac0-566e55c7eeb4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:56.395789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33b849-10aa-4081-95e1-d341a07e4c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:56.396495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33b849-10aa-4081-95e1-d341a07e4c5a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:56.396870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33b849-10aa-4081-95e1-d341a07e4c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:56.397209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33b849-10aa-4081-95e1-d341a07e4c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:56.399366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33b849-10aa-4081-95e1-d341a07e4c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:56.404562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b871096-f751-415b-8774-6a1bcd2dc9e4 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:56.405361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33b849-10aa-4081-95e1-d341a07e4c5a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:56.430741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0768-d9a9-418f-9592-e05a4c91aafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:56.431468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0768-d9a9-418f-9592-e05a4c91aafe admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:56.431992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0768-d9a9-418f-9592-e05a4c91aafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:56.432141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0768-d9a9-418f-9592-e05a4c91aafe admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:56.432980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c0768-d9a9-418f-9592-e05a4c91aafe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:29:56.435112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c0768-d9a9-418f-9592-e05a4c91aafe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:56.437002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c0768-d9a9-418f-9592-e05a4c91aafe admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:56.476927 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3178/6332] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:56.478056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0768-d9a9-418f-9592-e05a4c91aafe admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:56.492049 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3155/6333] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:56 2022] POST /identity/v3/projects => generated 353 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:56.492913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33b849-10aa-4081-95e1-d341a07e4c5a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:56.508808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0768-d9a9-418f-9592-e05a4c91aafe admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:56.677137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33b849-10aa-4081-95e1-d341a07e4c5a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:56.702115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb9d2c-5bbc-4feb-9cd3-60a5d2dbd861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:56.702800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb9d2c-5bbc-4feb-9cd3-60a5d2dbd861 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:56.703090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb9d2c-5bbc-4feb-9cd3-60a5d2dbd861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:56.703398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb9d2c-5bbc-4feb-9cd3-60a5d2dbd861 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:56.704042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb9d2c-5bbc-4feb-9cd3-60a5d2dbd861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:56.719905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb9d2c-5bbc-4feb-9cd3-60a5d2dbd861 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:56.768493 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:56.785558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6358fa-3582-4f93-abbb-3cdfde7e6e7b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:56.787772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6358fa-3582-4f93-abbb-3cdfde7e6e7b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:56.793397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6358fa-3582-4f93-abbb-3cdfde7e6e7b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:56.795199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6358fa-3582-4f93-abbb-3cdfde7e6e7b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:56.795782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6358fa-3582-4f93-abbb-3cdfde7e6e7b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:56.808766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6358fa-3582-4f93-abbb-3cdfde7e6e7b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:56.816302 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3156/6334] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:56 2022] POST /identity/v3/projects => generated 365 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:56.819480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb9d2c-5bbc-4feb-9cd3-60a5d2dbd861 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:56.891866 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3179/6335] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:29:56 2022] POST /identity/v3/domains => generated 275 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:56.891866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6358fa-3582-4f93-abbb-3cdfde7e6e7b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:57.016501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb9d2c-5bbc-4feb-9cd3-60a5d2dbd861 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:57.144869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6358fa-3582-4f93-abbb-3cdfde7e6e7b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:57.157881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2bc5-db0c-4fa7-b16d-52e8da56f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:57.158718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2bc5-db0c-4fa7-b16d-52e8da56f297 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:57.159008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2bc5-db0c-4fa7-b16d-52e8da56f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:57.159323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2bc5-db0c-4fa7-b16d-52e8da56f297 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:57.160021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a2bc5-db0c-4fa7-b16d-52e8da56f297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:57.168597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a2bc5-db0c-4fa7-b16d-52e8da56f297 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:57.181321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f546710-9834-48f1-8467-a7053daf5e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:57.182138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f546710-9834-48f1-8467-a7053daf5e36 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:57.182574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f546710-9834-48f1-8467-a7053daf5e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:57.183455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f546710-9834-48f1-8467-a7053daf5e36 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:57.184867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f546710-9834-48f1-8467-a7053daf5e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:57.188373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f546710-9834-48f1-8467-a7053daf5e36 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:57.220632 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3180/6336] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:56 2022] POST /identity/v3/users => generated 283 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:57.221560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2bc5-db0c-4fa7-b16d-52e8da56f297 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:57.249279 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3157/6337] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:56 2022] POST /identity/v3/users => generated 277 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:57.250222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f546710-9834-48f1-8467-a7053daf5e36 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:57.284033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f546710-9834-48f1-8467-a7053daf5e36 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:57.297963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a4a68-9a6d-4663-b22b-d0b8b9e4b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:57.298918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4a68-9a6d-4663-b22b-d0b8b9e4b42c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:57.299393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4a68-9a6d-4663-b22b-d0b8b9e4b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:57.300272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4a68-9a6d-4663-b22b-d0b8b9e4b42c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:57.303461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a4a68-9a6d-4663-b22b-d0b8b9e4b42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:57.307312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a4a68-9a6d-4663-b22b-d0b8b9e4b42c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:57.338141 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3158/6338] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:57.342148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a4a68-9a6d-4663-b22b-d0b8b9e4b42c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:57.348917 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:57.362403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2bc5-db0c-4fa7-b16d-52e8da56f297 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:57.363465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a4a68-9a6d-4663-b22b-d0b8b9e4b42c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:57.378264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de4b0e-6139-4c15-b53e-7c97b7ce8411 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:57.379764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd783d-b19e-48ce-8535-74ab1a6e909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:57.380408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de4b0e-6139-4c15-b53e-7c97b7ce8411 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:57.381953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de4b0e-6139-4c15-b53e-7c97b7ce8411 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:57.383101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de4b0e-6139-4c15-b53e-7c97b7ce8411 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains/ffe8fba3136c4e8894bd446e9ba34b8c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:57.384632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd783d-b19e-48ce-8535-74ab1a6e909a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:57.386970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd783d-b19e-48ce-8535-74ab1a6e909a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:57.387539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd783d-b19e-48ce-8535-74ab1a6e909a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:57.390134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd783d-b19e-48ce-8535-74ab1a6e909a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:57.394339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd783d-b19e-48ce-8535-74ab1a6e909a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:57.435541 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3159/6339] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:57.437351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd783d-b19e-48ce-8535-74ab1a6e909a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:57.441604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de4b0e-6139-4c15-b53e-7c97b7ce8411 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ffe8fba3136c4e8894bd446e9ba34b8c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:57.441604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de4b0e-6139-4c15-b53e-7c97b7ce8411 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:57.481489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd783d-b19e-48ce-8535-74ab1a6e909a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:57.489501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1a93d-c4fa-4786-bb24-262b31f2aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:57.490473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a93d-c4fa-4786-bb24-262b31f2aabe admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:57.491353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a93d-c4fa-4786-bb24-262b31f2aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:57.491945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a93d-c4fa-4786-bb24-262b31f2aabe admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:57.492938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1a93d-c4fa-4786-bb24-262b31f2aabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-42de4b0e-6139-4c15-b53e-7c97b7ce8411 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 02 01:29:57.494867 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 02 01:29:57.497387 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:57.497387 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:57.497387 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 02 01:29:57.497387 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 02 01:29:57.497387 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 02 01:29:57.497387 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 02 01:29:57.497387 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 02 01:29:57.497387 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:29:57.502628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1a93d-c4fa-4786-bb24-262b31f2aabe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:57.511026 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3181/6340] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:29:57 2022] DELETE /identity/v3/domains/ffe8fba3136c4e8894bd446e9ba34b8c => generated 120 bytes in 290 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:29:57.513258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de4b0e-6139-4c15-b53e-7c97b7ce8411 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:57.534568 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3160/6341] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:57.536243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1a93d-c4fa-4786-bb24-262b31f2aabe admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:57.544064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de4b0e-6139-4c15-b53e-7c97b7ce8411 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:57.565204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabcdff-4829-46e6-a5e4-6d0a254b24de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:57.566078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabcdff-4829-46e6-a5e4-6d0a254b24de admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:57.566522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabcdff-4829-46e6-a5e4-6d0a254b24de admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:57.567233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabcdff-4829-46e6-a5e4-6d0a254b24de admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:57.568609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabcdff-4829-46e6-a5e4-6d0a254b24de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:57.569861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1a93d-c4fa-4786-bb24-262b31f2aabe admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:57.570753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabcdff-4829-46e6-a5e4-6d0a254b24de admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:57.585257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53635a0d-7764-495e-9c05-26973486b0b9 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:57.586842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53635a0d-7764-495e-9c05-26973486b0b9 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:57.587412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53635a0d-7764-495e-9c05-26973486b0b9 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:57.588173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53635a0d-7764-495e-9c05-26973486b0b9 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains/ffe8fba3136c4e8894bd446e9ba34b8c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:57.591300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53635a0d-7764-495e-9c05-26973486b0b9 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ffe8fba3136c4e8894bd446e9ba34b8c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:57.596928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53635a0d-7764-495e-9c05-26973486b0b9 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:57.603546 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3182/6342] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:57.604774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabcdff-4829-46e6-a5e4-6d0a254b24de admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:57.629580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabcdff-4829-46e6-a5e4-6d0a254b24de admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:57.641698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabef89-d902-4a0c-b156-0ce72ebc17cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:57.642559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabef89-d902-4a0c-b156-0ce72ebc17cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:57.643092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabef89-d902-4a0c-b156-0ce72ebc17cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:57.643531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabef89-d902-4a0c-b156-0ce72ebc17cd admin admin] PATH_INFO: `/v3/projects/a8316f83d97748ec84508001d24a8673/users/74e942b33d30477da31392737af3ec13/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:57.669358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabef89-d902-4a0c-b156-0ce72ebc17cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8316f83d97748ec84508001d24a8673, user_id=74e942b33d30477da31392737af3ec13, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:57.673186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabef89-d902-4a0c-b156-0ce72ebc17cd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:57.678888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-53635a0d-7764-495e-9c05-26973486b0b9 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:57.681752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-53635a0d-7764-495e-9c05-26973486b0b9 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:57.708722 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3183/6343] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:57 2022] PUT /identity/v3/projects/a8316f83d97748ec84508001d24a8673/users/74e942b33d30477da31392737af3ec13/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:57.711802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabef89-d902-4a0c-b156-0ce72ebc17cd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:57.717812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ddabef89-d902-4a0c-b156-0ce72ebc17cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:57.780492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-53635a0d-7764-495e-9c05-26973486b0b9 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:57.782237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-53635a0d-7764-495e-9c05-26973486b0b9 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:57.790320 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3161/6344] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:29:57 2022] PATCH /identity/v3/domains/ffe8fba3136c4e8894bd446e9ba34b8c => generated 276 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:29:57.797308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d543d6-b4b5-41ba-a77c-1267157f123b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:57.797594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d543d6-b4b5-41ba-a77c-1267157f123b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:57.802082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d543d6-b4b5-41ba-a77c-1267157f123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:57.877198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabef89-d902-4a0c-b156-0ce72ebc17cd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:57.888877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ffd2-5ecb-4286-b7ea-b1b9afde3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:57.891652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ffd2-5ecb-4286-b7ea-b1b9afde3e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:57.893066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ffd2-5ecb-4286-b7ea-b1b9afde3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:57.893654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ffd2-5ecb-4286-b7ea-b1b9afde3e92 admin admin] PATH_INFO: `/v3/projects/2b6d9ae81c15411ea1642447536399ea/users/601e01864cc949d1a5354847aebbfa20/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:57.933791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082ffd2-5ecb-4286-b7ea-b1b9afde3e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6d9ae81c15411ea1642447536399ea, user_id=601e01864cc949d1a5354847aebbfa20, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:57.936483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082ffd2-5ecb-4286-b7ea-b1b9afde3e92 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:57.937734 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:57.962255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-50d543d6-b4b5-41ba-a77c-1267157f123b None None] MFA Rules not processed for user `74e942b33d30477da31392737af3ec13`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:57.963533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-50d543d6-b4b5-41ba-a77c-1267157f123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:58.069877 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3184/6345] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:57 2022] PUT /identity/v3/projects/2b6d9ae81c15411ea1642447536399ea/users/601e01864cc949d1a5354847aebbfa20/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:58.075636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ffd2-5ecb-4286-b7ea-b1b9afde3e92 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:58.079477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3082ffd2-5ecb-4286-b7ea-b1b9afde3e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:58.233997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ffd2-5ecb-4286-b7ea-b1b9afde3e92 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:58.241634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:58.244294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:58.244821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:58.245198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains/ffe8fba3136c4e8894bd446e9ba34b8c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:58.267643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ffe8fba3136c4e8894bd446e9ba34b8c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:58.270186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:58.357640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:58.361910 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3162/6346] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 565 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:58.362760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f94ba-c145-46b4-ba95-c11dfcdfd14b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:58.364202 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:58.371555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:58.372792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f94ba-c145-46b4-ba95-c11dfcdfd14b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:58.373264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f94ba-c145-46b4-ba95-c11dfcdfd14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:58.461452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-386f94ba-c145-46b4-ba95-c11dfcdfd14b None None] MFA Rules not processed for user `601e01864cc949d1a5354847aebbfa20`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:29:58.462773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-386f94ba-c145-46b4-ba95-c11dfcdfd14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:58.602291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c', 'request_id': 'req-ebff31bd-317c-405d-8330-49761555164b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:58.630880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c', 'request_id': 'req-ebff31bd-317c-405d-8330-49761555164b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:58.659729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c', 'request_id': 'req-ebff31bd-317c-405d-8330-49761555164b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:58.665653 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3163/6347] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:29:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:29:58.667392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f94ba-c145-46b4-ba95-c11dfcdfd14b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:58.683988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-386f94ba-c145-46b4-ba95-c11dfcdfd14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:58.701665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] The token cache is being invalidate because project ffe8fba3136c4e8894bd446e9ba34b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:29:58.702022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:58.704788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:58.728883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c', 'request_id': 'req-ebff31bd-317c-405d-8330-49761555164b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:58.737326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c', 'request_id': 'req-ebff31bd-317c-405d-8330-49761555164b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:58.738088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ffe8fba3136c4e8894bd446e9ba34b8c', 'request_id': 'req-ebff31bd-317c-405d-8330-49761555164b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:29:58.756991 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3185/6348] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:29:58 2022] DELETE /identity/v3/domains/ffe8fba3136c4e8894bd446e9ba34b8c => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:29:58.757864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:58.764092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:58.912079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f94ba-c145-46b4-ba95-c11dfcdfd14b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:59.038004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff31bd-317c-405d-8330-49761555164b tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:59.053260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b0fb9-d576-4c2d-b8d8-ffc7cb0e0322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:59.054345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b0fb9-d576-4c2d-b8d8-ffc7cb0e0322 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:59.054951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b0fb9-d576-4c2d-b8d8-ffc7cb0e0322 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:59.055442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b0fb9-d576-4c2d-b8d8-ffc7cb0e0322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:59.064632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5e3b0fb9-d576-4c2d-b8d8-ffc7cb0e0322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:59.081350 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:59.140725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3bafd-d74e-47f0-bc95-5e478e744638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:59.142933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3bafd-d74e-47f0-bc95-5e478e744638 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:59.144512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3bafd-d74e-47f0-bc95-5e478e744638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:59.145626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3bafd-d74e-47f0-bc95-5e478e744638 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:59.147537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3bafd-d74e-47f0-bc95-5e478e744638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:59.153241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3bafd-d74e-47f0-bc95-5e478e744638 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:59.234315 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3164/6349] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:29:58 2022] POST /identity/v3/projects => generated 365 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:59.234315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3bafd-d74e-47f0-bc95-5e478e744638 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:59.238988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0bb3bafd-d74e-47f0-bc95-5e478e744638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:59.260994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b0fb9-d576-4c2d-b8d8-ffc7cb0e0322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:59.265110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b0fb9-d576-4c2d-b8d8-ffc7cb0e0322 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:59.290716 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3186/6350] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:29:59.291723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b0fb9-d576-4c2d-b8d8-ffc7cb0e0322 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:59.298224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5e3b0fb9-d576-4c2d-b8d8-ffc7cb0e0322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:29:59.343126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b0fb9-d576-4c2d-b8d8-ffc7cb0e0322 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:59.398499 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:29:59.476013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3bafd-d74e-47f0-bc95-5e478e744638 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:59.494328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2999f-4e8e-4ad6-88cc-60e8f3110a77 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:59.496568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2999f-4e8e-4ad6-88cc-60e8f3110a77 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:59.496856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2999f-4e8e-4ad6-88cc-60e8f3110a77 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:59.497138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2999f-4e8e-4ad6-88cc-60e8f3110a77 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains/41343d6b8ad345b1b45b9594c5d3dc5a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:59.539772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2999f-4e8e-4ad6-88cc-60e8f3110a77 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:29:59.545985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c08e-45b9-4d59-91c9-f6c3095d74cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:59.546825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c08e-45b9-4d59-91c9-f6c3095d74cd admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:59.549512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c08e-45b9-4d59-91c9-f6c3095d74cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:59.550908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c08e-45b9-4d59-91c9-f6c3095d74cd admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:59.553530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501c08e-45b9-4d59-91c9-f6c3095d74cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-42c2999f-4e8e-4ad6-88cc-60e8f3110a77 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Could not find domain: 41343d6b8ad345b1b45b9594c5d3dc5a.: keystone.exception.DomainNotFound: Could not find domain: 41343d6b8ad345b1b45b9594c5d3dc5a. Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 41343d6b8ad345b1b45b9594c5d3dc5a. Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:29:59.563644 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:29:59.565251 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:29:59.566552 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 41343d6b8ad345b1b45b9594c5d3dc5a. Oct 02 01:29:59.567720 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:29:59.567812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501c08e-45b9-4d59-91c9-f6c3095d74cd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:59.571852 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3165/6351] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:29:59 2022] DELETE /identity/v3/domains/41343d6b8ad345b1b45b9594c5d3dc5a => generated 112 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:29:59.576035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2999f-4e8e-4ad6-88cc-60e8f3110a77 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:59.616332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2999f-4e8e-4ad6-88cc-60e8f3110a77 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:59.646383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c6a82-6019-4ad2-a6fe-78f64ce067cb tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:59.648544 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3187/6352] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:29:59 2022] POST /identity/v3/users => generated 289 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:59.650635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c6a82-6019-4ad2-a6fe-78f64ce067cb tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:59.650635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c6a82-6019-4ad2-a6fe-78f64ce067cb tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:59.653856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c08e-45b9-4d59-91c9-f6c3095d74cd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:59.654096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c6a82-6019-4ad2-a6fe-78f64ce067cb tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:59.661480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c6a82-6019-4ad2-a6fe-78f64ce067cb tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:59.670024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c6a82-6019-4ad2-a6fe-78f64ce067cb tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:59.702984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c08e-45b9-4d59-91c9-f6c3095d74cd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:59.717755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b5d9-0912-448c-9118-960bc0645dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:59.719932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b5d9-0912-448c-9118-960bc0645dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:59.728920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b5d9-0912-448c-9118-960bc0645dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:59.728920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b5d9-0912-448c-9118-960bc0645dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:59.729284 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3166/6353] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:29:59 2022] POST /identity/v3/domains => generated 252 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:29:59.729401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09b5d9-0912-448c-9118-960bc0645dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:59.729401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09b5d9-0912-448c-9118-960bc0645dc7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:59.730402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c6a82-6019-4ad2-a6fe-78f64ce067cb tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:59.758051 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3188/6354] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:29:59.762051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b5d9-0912-448c-9118-960bc0645dc7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:29:59.794102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b5d9-0912-448c-9118-960bc0645dc7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:59.912157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c6a82-6019-4ad2-a6fe-78f64ce067cb tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:29:59.924697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2631a-1819-43d7-a462-c19b82ec86b8 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:59.926836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2631a-1819-43d7-a462-c19b82ec86b8 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:59.927396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2631a-1819-43d7-a462-c19b82ec86b8 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:59.928956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2631a-1819-43d7-a462-c19b82ec86b8 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:59.930217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2631a-1819-43d7-a462-c19b82ec86b8 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:29:59.938956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2631a-1819-43d7-a462-c19b82ec86b8 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:29:59.944133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36da867-d87f-4bf3-9487-996fd2134836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:29:59.945641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da867-d87f-4bf3-9487-996fd2134836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:29:59.946686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da867-d87f-4bf3-9487-996fd2134836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:29:59.947648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da867-d87f-4bf3-9487-996fd2134836 admin admin] PATH_INFO: `/v3/projects/c44b373c68e74691b19f1b2a8bdfc932/users/8046a0f21cf54a5095d3dd8601c78bd6/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:29:59.987678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.sql.core [None req-5bf2631a-1819-43d7-a462-c19b82ec86b8 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-201661987' for key 'project.ixu_project_name_domain_id'") Oct 02 01:29:59.987678 n-d-master-1 devstack@keystone.service[81854]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 02 01:29:59.987678 n-d-master-1 devstack@keystone.service[81854]: [parameters: {'id': '1dedb75ff768422fb599f504ada0ddba', 'name': 'tempest-domain-dup-201661987', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 02 01:29:59.987678 n-d-master-1 devstack@keystone.service[81854]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81854) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5bf2631a-1819-43d7-a462-c19b82ec86b8 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-201661987.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-201661987. Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application conn.query(q) Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 01:30:00.010999 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application result.read() Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-201661987' for key 'project.ixu_project_name_domain_id'") Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 02 01:30:00.012228 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application next(self.gen) Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application yield resource Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application next(self.gen) Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.session.rollback() Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.force_reraise() Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise self.value Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application session.commit() Oct 02 01:30:00.013370 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._prepare_impl() Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.session.flush() Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._flush(objects) Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application compat.raise_( Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application flush_context.execute() Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 02 01:30:00.014383 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rec.execute(self) Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 02 01:30:00.015460 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application result = self._query(query) Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application conn.query(q) Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application result.read() Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 02 01:30:00.016459 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-201661987' for key 'project.ixu_project_name_domain_id'") Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [parameters: {'id': '1dedb75ff768422fb599f504ada0ddba', 'name': 'tempest-domain-dup-201661987', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:30:00.017473 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-201661987. Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:30:00.019990 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-201661987. Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:30:00.024702 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3167/6355] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:29:59 2022] POST /identity/v3/domains => generated 211 bytes in 284 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 02 01:30:00.027460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2631a-1819-43d7-a462-c19b82ec86b8 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:00.027648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36da867-d87f-4bf3-9487-996fd2134836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44b373c68e74691b19f1b2a8bdfc932, user_id=8046a0f21cf54a5095d3dd8601c78bd6, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:00.032334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36da867-d87f-4bf3-9487-996fd2134836 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:00.045637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2631a-1819-43d7-a462-c19b82ec86b8 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:00.068445 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3189/6356] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:29:59 2022] PUT /identity/v3/projects/c44b373c68e74691b19f1b2a8bdfc932/users/8046a0f21cf54a5095d3dd8601c78bd6/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:30:00.069087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:00.069087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:00.069087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:00.069347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains/d1e6f8ad189545f189d24202d78db507` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:00.070464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36da867-d87f-4bf3-9487-996fd2134836 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:00.126702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d1e6f8ad189545f189d24202d78db507)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:00.135285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:00.239687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd1e6f8ad189545f189d24202d78db507'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:00.245420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd1e6f8ad189545f189d24202d78db507'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:00.328286 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:00.343438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36da867-d87f-4bf3-9487-996fd2134836 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:00.345117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd1e6f8ad189545f189d24202d78db507'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:00.347441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd1e6f8ad189545f189d24202d78db507'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:00.354119 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3168/6357] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:30:00 2022] PATCH /identity/v3/domains/d1e6f8ad189545f189d24202d78db507 => generated 253 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:00.358614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:00.361247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:00.504214 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:00.657231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb51ac8-8666-4571-a1c2-6f48e7f55b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:00.657890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb51ac8-8666-4571-a1c2-6f48e7f55b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:00.658156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb51ac8-8666-4571-a1c2-6f48e7f55b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:00.658522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb51ac8-8666-4571-a1c2-6f48e7f55b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:00.659213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb51ac8-8666-4571-a1c2-6f48e7f55b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:00.660943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb51ac8-8666-4571-a1c2-6f48e7f55b5d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:00.719844 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3190/6358] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 650 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:00.725745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb62b07-d7a7-43e0-8013-f6f3b9d84ef2 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:00.728790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb51ac8-8666-4571-a1c2-6f48e7f55b5d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:00.748358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eeb51ac8-8666-4571-a1c2-6f48e7f55b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:00.764998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:00.765758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:00.766080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:00.766322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains/d1e6f8ad189545f189d24202d78db507` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:00.865448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb51ac8-8666-4571-a1c2-6f48e7f55b5d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:00.891827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d1e6f8ad189545f189d24202d78db507)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:00.893622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:00.903498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc6c12-d26c-4d44-b395-96b642c32c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:00.904206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc6c12-d26c-4d44-b395-96b642c32c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:00.904488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc6c12-d26c-4d44-b395-96b642c32c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:00.904938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc6c12-d26c-4d44-b395-96b642c32c73 admin admin] PATH_INFO: `/v3/projects/c44b373c68e74691b19f1b2a8bdfc932/users/8046a0f21cf54a5095d3dd8601c78bd6/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:00.917157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc6c12-d26c-4d44-b395-96b642c32c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44b373c68e74691b19f1b2a8bdfc932, user_id=8046a0f21cf54a5095d3dd8601c78bd6, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:00.944000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc6c12-d26c-4d44-b395-96b642c32c73 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:01.015036 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3191/6359] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:00 2022] PUT /identity/v3/projects/c44b373c68e74691b19f1b2a8bdfc932/users/8046a0f21cf54a5095d3dd8601c78bd6/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:01.016963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4805a-7b1b-453a-aab5-2befd7e3edf4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:01.017211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4805a-7b1b-453a-aab5-2befd7e3edf4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:01.018643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4805a-7b1b-453a-aab5-2befd7e3edf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:01.044028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd1e6f8ad189545f189d24202d78db507'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:01.055372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd1e6f8ad189545f189d24202d78db507'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:01.182429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1ae4805a-7b1b-453a-aab5-2befd7e3edf4 None None] MFA Rules not processed for user `8046a0f21cf54a5095d3dd8601c78bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:01.184481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e6f8ad189545f189d24202d78db507', 'request_id': 'req-9f3d6481-c931-4baa-9378-806bdccb99ff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:01.211034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1ae4805a-7b1b-453a-aab5-2befd7e3edf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:01.222677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e6f8ad189545f189d24202d78db507', 'request_id': 'req-9f3d6481-c931-4baa-9378-806bdccb99ff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:01.246434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e6f8ad189545f189d24202d78db507', 'request_id': 'req-9f3d6481-c931-4baa-9378-806bdccb99ff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:01.311434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] The token cache is being invalidate because project d1e6f8ad189545f189d24202d78db507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:01.311754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:01.313987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:01.431489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd1e6f8ad189545f189d24202d78db507', 'request_id': 'req-9f3d6481-c931-4baa-9378-806bdccb99ff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:01.436207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd1e6f8ad189545f189d24202d78db507', 'request_id': 'req-9f3d6481-c931-4baa-9378-806bdccb99ff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:01.437228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd1e6f8ad189545f189d24202d78db507', 'request_id': 'req-9f3d6481-c931-4baa-9378-806bdccb99ff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:01.459373 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3169/6360] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:00 2022] DELETE /identity/v3/domains/d1e6f8ad189545f189d24202d78db507 => generated 0 bytes in 1101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:01.472244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:01.498173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:01.700386 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:01.723303 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3192/6361] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 707 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:01.729277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4805a-7b1b-453a-aab5-2befd7e3edf4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:01.758914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4805a-7b1b-453a-aab5-2befd7e3edf4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:01.789614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d6481-c931-4baa-9378-806bdccb99ff tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:01.806735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b48e0-1f27-49d7-997f-7db1a5362440 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c828ae49f4b389af367d377a49ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6ad6b772a41408795ffbcd4772efbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:01.808301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b48e0-1f27-49d7-997f-7db1a5362440 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:01.808582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b48e0-1f27-49d7-997f-7db1a5362440 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:01.808859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b48e0-1f27-49d7-997f-7db1a5362440 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] PATH_INFO: `/v3/domains/ffe8fba3136c4e8894bd446e9ba34b8c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:01.813586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fa6a0-670d-4d11-99c2-29f8bceae0ea tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:01.814215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fa6a0-670d-4d11-99c2-29f8bceae0ea tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:01.814500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fa6a0-670d-4d11-99c2-29f8bceae0ea tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:01.814821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fa6a0-670d-4d11-99c2-29f8bceae0ea tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:01.823563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fa6a0-670d-4d11-99c2-29f8bceae0ea tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:01.825249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fa6a0-670d-4d11-99c2-29f8bceae0ea tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:01.827359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b48e0-1f27-49d7-997f-7db1a5362440 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d45b48e0-1f27-49d7-997f-7db1a5362440 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Could not find domain: ffe8fba3136c4e8894bd446e9ba34b8c.: keystone.exception.DomainNotFound: Could not find domain: ffe8fba3136c4e8894bd446e9ba34b8c. Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ffe8fba3136c4e8894bd446e9ba34b8c. Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:30:01.833074 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:30:01.834485 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:30:01.836020 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ffe8fba3136c4e8894bd446e9ba34b8c. Oct 02 01:30:01.837337 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:30:01.837337 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3170/6362] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:30:01 2022] PATCH /identity/v3/domains/ffe8fba3136c4e8894bd446e9ba34b8c => generated 112 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:30:01.840475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b48e0-1f27-49d7-997f-7db1a5362440 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:01.849026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d45b48e0-1f27-49d7-997f-7db1a5362440 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:01.902933 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3193/6363] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:30:01 2022] POST /identity/v3/domains => generated 276 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:01.904044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fa6a0-670d-4d11-99c2-29f8bceae0ea tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:02.010006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b48e0-1f27-49d7-997f-7db1a5362440 tempest-DomainsNegativeTestJSON-1331152754 tempest-DomainsNegativeTestJSON-1331152754-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:02.180484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fa6a0-670d-4d11-99c2-29f8bceae0ea tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:02.194568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fff269-22ba-4edf-8081-c4f6ffc9aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:02.195269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff269-22ba-4edf-8081-c4f6ffc9aaa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:02.195546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff269-22ba-4edf-8081-c4f6ffc9aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:02.195823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff269-22ba-4edf-8081-c4f6ffc9aaa3 admin admin] PATH_INFO: `/v3/users/e4d2215c1936438bb06fecf12a0afed1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:02.196169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a6412-a5b5-42ab-a2a7-9713faeef21a tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:02.198529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a6412-a5b5-42ab-a2a7-9713faeef21a tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:02.199396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a6412-a5b5-42ab-a2a7-9713faeef21a tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:02.199892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a6412-a5b5-42ab-a2a7-9713faeef21a tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:02.200032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fff269-22ba-4edf-8081-c4f6ffc9aaa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d2215c1936438bb06fecf12a0afed1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:02.200847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a6412-a5b5-42ab-a2a7-9713faeef21a tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:02.202045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fff269-22ba-4edf-8081-c4f6ffc9aaa3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:02.203171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a6412-a5b5-42ab-a2a7-9713faeef21a tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:02.286947 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3194/6364] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:01 2022] POST /identity/v3/users => generated 348 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:02.291109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a6412-a5b5-42ab-a2a7-9713faeef21a tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:02.311670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a6412-a5b5-42ab-a2a7-9713faeef21a tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:02.324683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9ec6a-9d87-4c8d-ac28-b8b7b4b817f9 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:02.325827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9ec6a-9d87-4c8d-ac28-b8b7b4b817f9 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:02.326296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9ec6a-9d87-4c8d-ac28-b8b7b4b817f9 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:02.328135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9ec6a-9d87-4c8d-ac28-b8b7b4b817f9 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:02.328982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9ec6a-9d87-4c8d-ac28-b8b7b4b817f9 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:02.333188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9ec6a-9d87-4c8d-ac28-b8b7b4b817f9 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:02.346833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-01fff269-22ba-4edf-8081-c4f6ffc9aaa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d2215c1936438bb06fecf12a0afed1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:02.356588 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:02.387542 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3195/6365] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:02 2022] POST /identity/v3/users => generated 322 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:30:02.392601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9ec6a-9d87-4c8d-ac28-b8b7b4b817f9 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:02.398348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-01fff269-22ba-4edf-8081-c4f6ffc9aaa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d2215c1936438bb06fecf12a0afed1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:02.403769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-01fff269-22ba-4edf-8081-c4f6ffc9aaa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d2215c1936438bb06fecf12a0afed1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:02.409938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9ec6a-9d87-4c8d-ac28-b8b7b4b817f9 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:02.425771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e240aab-7d35-449c-9b23-02a81824c784 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:02.428187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e240aab-7d35-449c-9b23-02a81824c784 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:02.428732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e240aab-7d35-449c-9b23-02a81824c784 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:02.429468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e240aab-7d35-449c-9b23-02a81824c784 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/users/c0bd0f0d147a4b9389a7ff782b4ad64a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:02.437326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-01fff269-22ba-4edf-8081-c4f6ffc9aaa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d2215c1936438bb06fecf12a0afed1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:02.473441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-01fff269-22ba-4edf-8081-c4f6ffc9aaa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d2215c1936438bb06fecf12a0afed1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:02.481240 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:02.482059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e240aab-7d35-449c-9b23-02a81824c784 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:get_user(user_id=c0bd0f0d147a4b9389a7ff782b4ad64a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:02.495174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e240aab-7d35-449c-9b23-02a81824c784 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:02.500277 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3171/6366] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:01 2022] DELETE /identity/v3/users/e4d2215c1936438bb06fecf12a0afed1 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:30:02.501861 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3196/6367] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:30:02 2022] GET /identity/v3/users/c0bd0f0d147a4b9389a7ff782b4ad64a => generated 348 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:02.503769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab7a9e-7feb-43f5-92a9-0482d7a3d94c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:02.506090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab7a9e-7feb-43f5-92a9-0482d7a3d94c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:02.506545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab7a9e-7feb-43f5-92a9-0482d7a3d94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:02.508212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e240aab-7d35-449c-9b23-02a81824c784 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:02.510983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8e240aab-7d35-449c-9b23-02a81824c784 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:02.549091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e240aab-7d35-449c-9b23-02a81824c784 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:02.552255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e1ab7a9e-7feb-43f5-92a9-0482d7a3d94c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:02.555381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e1ab7a9e-7feb-43f5-92a9-0482d7a3d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:02.663319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4a441-694a-49d7-a54c-605722fbf101 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:02.667983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4a441-694a-49d7-a54c-605722fbf101 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:02.668859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4a441-694a-49d7-a54c-605722fbf101 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:02.673760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4a441-694a-49d7-a54c-605722fbf101 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:02.675409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4a441-694a-49d7-a54c-605722fbf101 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Adding query filter params (domain_id=d8df48e716be48b38136a45c5bc2d1ec) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:02.676026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4a441-694a-49d7-a54c-605722fbf101 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:02.681946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4a441-694a-49d7-a54c-605722fbf101 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:02.726126 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3197/6368] 10.222.0.23 () {58 vars in 1207 bytes} [Sun Oct 2 01:30:02 2022] GET /identity/v3/users?domain_id=d8df48e716be48b38136a45c5bc2d1ec => generated 485 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:02.730307 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3172/6369] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:02.735114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4a441-694a-49d7-a54c-605722fbf101 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:02.755069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4a441-694a-49d7-a54c-605722fbf101 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:02.771200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab7a9e-7feb-43f5-92a9-0482d7a3d94c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:02.773004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e1ab7a9e-7feb-43f5-92a9-0482d7a3d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:02.784583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c02064-649e-4f11-a984-02a017caae76 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:02.785208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c02064-649e-4f11-a984-02a017caae76 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:02.785592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c02064-649e-4f11-a984-02a017caae76 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:02.786098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c02064-649e-4f11-a984-02a017caae76 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:02.786706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c02064-649e-4f11-a984-02a017caae76 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:02.788700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c02064-649e-4f11-a984-02a017caae76 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:02.949952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab7a9e-7feb-43f5-92a9-0482d7a3d94c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:02.955189 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3198/6370] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:02 2022] GET /identity/v3/users => generated 8575 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:02.962509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807200f-9213-4b77-8568-594ee540e902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:02.963423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807200f-9213-4b77-8568-594ee540e902 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:02.964251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807200f-9213-4b77-8568-594ee540e902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:02.964539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807200f-9213-4b77-8568-594ee540e902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:02.964968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c02064-649e-4f11-a984-02a017caae76 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:02.988812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c02064-649e-4f11-a984-02a017caae76 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:03.001219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807200f-9213-4b77-8568-594ee540e902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:03.002776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807200f-9213-4b77-8568-594ee540e902 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:03.007100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025bbdb-9628-4fab-a193-f6eb7124aa40 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:03.007973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025bbdb-9628-4fab-a193-f6eb7124aa40 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:03.008500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025bbdb-9628-4fab-a193-f6eb7124aa40 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:03.009013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025bbdb-9628-4fab-a193-f6eb7124aa40 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:03.015017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025bbdb-9628-4fab-a193-f6eb7124aa40 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Adding query filter params (name=tempest-test_user-2050900181) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:03.015644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025bbdb-9628-4fab-a193-f6eb7124aa40 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:03.018381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025bbdb-9628-4fab-a193-f6eb7124aa40 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:03.049489 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3173/6371] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:30:03.142278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807200f-9213-4b77-8568-594ee540e902 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:03.143997 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3199/6372] 10.222.0.23 () {58 vars in 1189 bytes} [Sun Oct 2 01:30:02 2022] GET /identity/v3/users?name=tempest-test_user-2050900181 => generated 476 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:30:03.160295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807200f-9213-4b77-8568-594ee540e902 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:03.181278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fa631-d840-4364-9a88-896e76a32d41 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:03.181931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa631-d840-4364-9a88-896e76a32d41 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:03.182221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa631-d840-4364-9a88-896e76a32d41 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:03.183072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa631-d840-4364-9a88-896e76a32d41 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:03.184160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fa631-d840-4364-9a88-896e76a32d41 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:03.184737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fa631-d840-4364-9a88-896e76a32d41 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:03.186667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fa631-d840-4364-9a88-896e76a32d41 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:03.284148 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3174/6373] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 2 01:30:03 2022] GET /identity/v3/users?enabled=False => generated 430 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:30:03.290949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025bbdb-9628-4fab-a193-f6eb7124aa40 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:03.310514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025bbdb-9628-4fab-a193-f6eb7124aa40 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:03.350968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:03.352533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:03.352817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:03.353097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/users/5641483fa347470d81f3d2e4d25f3750` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:03.396853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5641483fa347470d81f3d2e4d25f3750)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:03.402518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:03.580342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5641483fa347470d81f3d2e4d25f3750'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:03.647984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5641483fa347470d81f3d2e4d25f3750'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:03.655718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5641483fa347470d81f3d2e4d25f3750'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:03.678064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5641483fa347470d81f3d2e4d25f3750'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:03.679685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5641483fa347470d81f3d2e4d25f3750'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:03.736714 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3200/6374] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:03 2022] DELETE /identity/v3/users/5641483fa347470d81f3d2e4d25f3750 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:03.737835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fa631-d840-4364-9a88-896e76a32d41 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:03.740060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d1fa631-d840-4364-9a88-896e76a32d41 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:03.801753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fa631-d840-4364-9a88-896e76a32d41 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:04.154084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:04.154848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:04.155057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:04.155340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/users/c0bd0f0d147a4b9389a7ff782b4ad64a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:04.157713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c0bd0f0d147a4b9389a7ff782b4ad64a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:04.177488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:04.300921 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:04.337872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0bd0f0d147a4b9389a7ff782b4ad64a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:04.401658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0bd0f0d147a4b9389a7ff782b4ad64a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:04.403772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0bd0f0d147a4b9389a7ff782b4ad64a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:04.425648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0bd0f0d147a4b9389a7ff782b4ad64a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:04.464986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0bd0f0d147a4b9389a7ff782b4ad64a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:04.489360 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3175/6375] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:03 2022] DELETE /identity/v3/users/c0bd0f0d147a4b9389a7ff782b4ad64a => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:04.491413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:04.509493 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:04.519240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb3a73-f79c-4837-8b6e-847f2ecc3ab7 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:04.731809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:04.732620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:04.733013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:04.733406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/domains/d8df48e716be48b38136a45c5bc2d1ec` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:04.737856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d8df48e716be48b38136a45c5bc2d1ec)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:04.739774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:04.789678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:04.790613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:04.848494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:04.849663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:04.857706 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3201/6376] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:30:04 2022] PATCH /identity/v3/domains/d8df48e716be48b38136a45c5bc2d1ec => generated 277 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:04.861811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:04.863515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:04.897383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b65ab9-8602-4b99-95a6-efba660c22fd tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:04.980981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:04.985549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:05.112879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8046a0f21cf54a5095d3dd8601c78bd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44b373c68e74691b19f1b2a8bdfc932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:05.113281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:05.113790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:05.116495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] PATH_INFO: `/v3/domains/d8df48e716be48b38136a45c5bc2d1ec` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:05.142781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d8df48e716be48b38136a45c5bc2d1ec)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:05.144451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:05.159070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44febc5-aa24-4669-90b5-b7455f4983f1 tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:05.171781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:05.173723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:05.174330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:05.174529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] PATH_INFO: `/v3/projects/ef4eaea339984bcf87dd925882d1f87b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:05.178220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4eaea339984bcf87dd925882d1f87b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:05.183286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:05.207365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.214102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.362139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4eaea339984bcf87dd925882d1f87b', 'request_id': 'req-15e2d22d-a4a5-4801-80de-67ec29444a51'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.376802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec', 'request_id': 'req-c8ae7322-93dd-4b70-8645-1acd63be2cbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.378687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4eaea339984bcf87dd925882d1f87b', 'request_id': 'req-15e2d22d-a4a5-4801-80de-67ec29444a51'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.394198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec', 'request_id': 'req-c8ae7322-93dd-4b70-8645-1acd63be2cbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.415389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4eaea339984bcf87dd925882d1f87b', 'request_id': 'req-15e2d22d-a4a5-4801-80de-67ec29444a51'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.438824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec', 'request_id': 'req-c8ae7322-93dd-4b70-8645-1acd63be2cbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.444492 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:05.449672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] The token cache is being invalidate because project ef4eaea339984bcf87dd925882d1f87b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:05.459085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.465961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.469684 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3202/6377] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:04 2022] DELETE /identity/v3/projects/ef4eaea339984bcf87dd925882d1f87b => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:30:05.472651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] The token cache is being invalidate because project d8df48e716be48b38136a45c5bc2d1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:05.473122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.474666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:05.475040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.477781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:05.497958 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:05.500805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec', 'request_id': 'req-c8ae7322-93dd-4b70-8645-1acd63be2cbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.501946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec', 'request_id': 'req-c8ae7322-93dd-4b70-8645-1acd63be2cbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.502952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd8df48e716be48b38136a45c5bc2d1ec', 'request_id': 'req-c8ae7322-93dd-4b70-8645-1acd63be2cbe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.524066 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3176/6378] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:04 2022] DELETE /identity/v3/domains/d8df48e716be48b38136a45c5bc2d1ec => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:05.529891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:05.532711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:05.696297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2d22d-a4a5-4801-80de-67ec29444a51 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:05.748114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7322-93dd-4b70-8645-1acd63be2cbe tempest-UsersV3TestJSON-400201441 tempest-UsersV3TestJSON-400201441-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:05.760234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:05.765648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:05.766040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:05.766425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] PATH_INFO: `/v3/users/74e942b33d30477da31392737af3ec13` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:05.768969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e942b33d30477da31392737af3ec13)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:05.773279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:05.936603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf5007-d013-4b17-bf07-de71845edda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:05.940201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e942b33d30477da31392737af3ec13'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.942416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5007-d013-4b17-bf07-de71845edda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:05.942748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5007-d013-4b17-bf07-de71845edda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:05.943029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5007-d013-4b17-bf07-de71845edda3 admin admin] PATH_INFO: `/v3/users/844c828ae49f4b389af367d377a49ba2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:05.945092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf5007-d013-4b17-bf07-de71845edda3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=844c828ae49f4b389af367d377a49ba2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:05.951115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf5007-d013-4b17-bf07-de71845edda3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:05.981598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e942b33d30477da31392737af3ec13'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:05.983608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e942b33d30477da31392737af3ec13'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.009326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e942b33d30477da31392737af3ec13'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.023016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e942b33d30477da31392737af3ec13'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.046486 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3177/6379] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:05 2022] DELETE /identity/v3/users/74e942b33d30477da31392737af3ec13 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:06.058579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:06.062138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:06.115092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3abf5007-d013-4b17-bf07-de71845edda3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844c828ae49f4b389af367d377a49ba2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.147385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3abf5007-d013-4b17-bf07-de71845edda3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844c828ae49f4b389af367d377a49ba2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.148784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3abf5007-d013-4b17-bf07-de71845edda3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844c828ae49f4b389af367d377a49ba2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.180930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3abf5007-d013-4b17-bf07-de71845edda3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844c828ae49f4b389af367d377a49ba2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.186851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3abf5007-d013-4b17-bf07-de71845edda3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844c828ae49f4b389af367d377a49ba2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.224977 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3203/6380] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:05 2022] DELETE /identity/v3/users/844c828ae49f4b389af367d377a49ba2 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:30:06.227587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3859-0f99-4f65-8526-87532cb17247 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:06.232705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3859-0f99-4f65-8526-87532cb17247 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:06.233041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3859-0f99-4f65-8526-87532cb17247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:06.295487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1199e-35eb-473d-8ce2-a6373cc53b6c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:06.329162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-739e3859-0f99-4f65-8526-87532cb17247 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:06.330583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-739e3859-0f99-4f65-8526-87532cb17247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:06.333296 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:06.389528 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:06.484452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:06.484741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:06.485102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:06.485508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] PATH_INFO: `/v3/users/8592200c5eab4e7b83ece4622390b5af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:06.487406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8592200c5eab4e7b83ece4622390b5af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:06.489632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:06.493498 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3204/6381] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:06.515625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e3859-0f99-4f65-8526-87532cb17247 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:06.517152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-739e3859-0f99-4f65-8526-87532cb17247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:06.624315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8592200c5eab4e7b83ece4622390b5af'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.665474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e3859-0f99-4f65-8526-87532cb17247 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:06.693222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65799a-f5fd-46e5-a9bb-7806e8cd981d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:06.694297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65799a-f5fd-46e5-a9bb-7806e8cd981d service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:06.695117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65799a-f5fd-46e5-a9bb-7806e8cd981d service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:06.695354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8592200c5eab4e7b83ece4622390b5af'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.695635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65799a-f5fd-46e5-a9bb-7806e8cd981d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:06.696734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8592200c5eab4e7b83ece4622390b5af'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.705075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fe65799a-f5fd-46e5-a9bb-7806e8cd981d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:06.726335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8592200c5eab4e7b83ece4622390b5af'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.738432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65799a-f5fd-46e5-a9bb-7806e8cd981d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:06.740370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65799a-f5fd-46e5-a9bb-7806e8cd981d service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:06.746929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8592200c5eab4e7b83ece4622390b5af'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:06.764914 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3205/6382] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:30:06.804523 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3178/6383] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:06 2022] DELETE /identity/v3/users/8592200c5eab4e7b83ece4622390b5af => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:06.809859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc5516-9792-414a-a324-83c0a4f2b6da None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:06.810172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc5516-9792-414a-a324-83c0a4f2b6da None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:06.810413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc5516-9792-414a-a324-83c0a4f2b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:06.856993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-71bc5516-9792-414a-a324-83c0a4f2b6da None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:06.863041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-71bc5516-9792-414a-a324-83c0a4f2b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:07.030323 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3206/6384] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:07.082845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:07.084527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:07.278261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e27e9-0b10-49e2-a836-3b1fb543f718 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:07.293465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d6b3a-4387-4474-8557-0fc60c4485b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:07.294287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6b3a-4387-4474-8557-0fc60c4485b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:07.295615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6b3a-4387-4474-8557-0fc60c4485b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:07.296170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6b3a-4387-4474-8557-0fc60c4485b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:07.320391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d6b3a-4387-4474-8557-0fc60c4485b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:07.322025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d6b3a-4387-4474-8557-0fc60c4485b5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:07.368852 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3179/6385] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:07.698713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc5516-9792-414a-a324-83c0a4f2b6da None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:07.701461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-71bc5516-9792-414a-a324-83c0a4f2b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:07.744412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc5516-9792-414a-a324-83c0a4f2b6da None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:07.759525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:07.760179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:07.760545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:07.760846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] PATH_INFO: `/v3/users/601e01864cc949d1a5354847aebbfa20` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:07.762190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=601e01864cc949d1a5354847aebbfa20)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:07.764723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:07.858655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601e01864cc949d1a5354847aebbfa20'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:07.883902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d6b3a-4387-4474-8557-0fc60c4485b5 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:07.887308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b53d6b3a-4387-4474-8557-0fc60c4485b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:07.887639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601e01864cc949d1a5354847aebbfa20'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:07.888560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601e01864cc949d1a5354847aebbfa20'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:07.891820 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:07.902322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601e01864cc949d1a5354847aebbfa20'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:07.903298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601e01864cc949d1a5354847aebbfa20'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:07.947185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d6b3a-4387-4474-8557-0fc60c4485b5 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:07.997770 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3207/6386] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:07 2022] DELETE /identity/v3/users/601e01864cc949d1a5354847aebbfa20 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:07.998162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:08.002070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:08.003245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:08.004147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.004846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.005921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] PATH_INFO: `/v3/projects/a6ad6b772a41408795ffbcd4772efbc1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.009246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ad6b772a41408795ffbcd4772efbc1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:08.031845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:08.100910 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:08.122135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ad6b772a41408795ffbcd4772efbc1', 'request_id': 'req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.130739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ad6b772a41408795ffbcd4772efbc1', 'request_id': 'req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.142487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ad6b772a41408795ffbcd4772efbc1', 'request_id': 'req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.158883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5cabd-715d-4670-b42e-0c4352350321 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:08.167389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] The token cache is being invalidate because project a6ad6b772a41408795ffbcd4772efbc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:08.168039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.168972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-238700b1-efa2-4ac4-8e0e-ca956f2d1fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.171063 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3180/6387] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:07 2022] DELETE /identity/v3/projects/a6ad6b772a41408795ffbcd4772efbc1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:30:08.172553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31bff-a319-48eb-b85d-1aaa000e5ede None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.172988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31bff-a319-48eb-b85d-1aaa000e5ede None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.173454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31bff-a319-48eb-b85d-1aaa000e5ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.196775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6fc31bff-a319-48eb-b85d-1aaa000e5ede None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:08.199834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6fc31bff-a319-48eb-b85d-1aaa000e5ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:08.255949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:08.257072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.257569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.257921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] PATH_INFO: `/v3/projects/a8316f83d97748ec84508001d24a8673` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.261368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8316f83d97748ec84508001d24a8673)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:08.264319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:08.288783 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3181/6388] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:08.290065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc31bff-a319-48eb-b85d-1aaa000e5ede None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:08.300325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6fc31bff-a319-48eb-b85d-1aaa000e5ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:08.324127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc31bff-a319-48eb-b85d-1aaa000e5ede None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:08.335885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:08.336879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.337159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.337462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] PATH_INFO: `/v3/projects/06c2a06a5ea340d09371c77a8e38591e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.339524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c2a06a5ea340d09371c77a8e38591e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:08.341383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:08.359146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8316f83d97748ec84508001d24a8673', 'request_id': 'req-a80a287d-79c6-4984-a6b1-52967fd11953'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.368443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8316f83d97748ec84508001d24a8673', 'request_id': 'req-a80a287d-79c6-4984-a6b1-52967fd11953'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.377986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8316f83d97748ec84508001d24a8673', 'request_id': 'req-a80a287d-79c6-4984-a6b1-52967fd11953'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.401181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] The token cache is being invalidate because project a8316f83d97748ec84508001d24a8673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:08.402040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.402955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a80a287d-79c6-4984-a6b1-52967fd11953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.405112 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3208/6389] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:07 2022] DELETE /identity/v3/projects/a8316f83d97748ec84508001d24a8673 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:08.406800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6aa8-1c40-4466-b4fb-a84a6db6de08 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.407120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6aa8-1c40-4466-b4fb-a84a6db6de08 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.407573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6aa8-1c40-4466-b4fb-a84a6db6de08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.431031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-81ab6aa8-1c40-4466-b4fb-a84a6db6de08 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:08.433094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c2a06a5ea340d09371c77a8e38591e', 'request_id': 'req-862a079e-a250-4762-a19e-9e3f77baf5dc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.433643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-81ab6aa8-1c40-4466-b4fb-a84a6db6de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:08.442848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c2a06a5ea340d09371c77a8e38591e', 'request_id': 'req-862a079e-a250-4762-a19e-9e3f77baf5dc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.448891 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:08.453282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c2a06a5ea340d09371c77a8e38591e', 'request_id': 'req-862a079e-a250-4762-a19e-9e3f77baf5dc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.478583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] The token cache is being invalidate because project 06c2a06a5ea340d09371c77a8e38591e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:08.478999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.481599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.483272 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3182/6390] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:08 2022] DELETE /identity/v3/projects/06c2a06a5ea340d09371c77a8e38591e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:08.485898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:08.489360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:08.563207 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3209/6391] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:08.570552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab6aa8-1c40-4466-b4fb-a84a6db6de08 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:08.575123 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:08.576774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-81ab6aa8-1c40-4466-b4fb-a84a6db6de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:08.596196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab6aa8-1c40-4466-b4fb-a84a6db6de08 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:08.611137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:08.612084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.612600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.612907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a079e-a250-4762-a19e-9e3f77baf5dc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:08.613043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] PATH_INFO: `/v3/users/8046a0f21cf54a5095d3dd8601c78bd6` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.615496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8046a0f21cf54a5095d3dd8601c78bd6)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:08.620548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:08.622936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a3676-5d0a-425f-88b6-ae0552ea4924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:08.623984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a3676-5d0a-425f-88b6-ae0552ea4924 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.624704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a3676-5d0a-425f-88b6-ae0552ea4924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.625545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a3676-5d0a-425f-88b6-ae0552ea4924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.627622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-951a3676-5d0a-425f-88b6-ae0552ea4924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:08.643820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a3676-5d0a-425f-88b6-ae0552ea4924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:08.645656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a3676-5d0a-425f-88b6-ae0552ea4924 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:08.660012 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3183/6392] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:08.661279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0df8-64ac-4298-a383-e9584e1446c2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.661715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0df8-64ac-4298-a383-e9584e1446c2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.662018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0df8-64ac-4298-a383-e9584e1446c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.690435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-348a0df8-64ac-4298-a383-e9584e1446c2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:08.692212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-348a0df8-64ac-4298-a383-e9584e1446c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:08.708127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8046a0f21cf54a5095d3dd8601c78bd6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.708381 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3184/6393] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:08.710462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c3909-56cd-4c64-b463-4b30f37c1bb4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.710829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c3909-56cd-4c64-b463-4b30f37c1bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.711740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c3909-56cd-4c64-b463-4b30f37c1bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.732756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8046a0f21cf54a5095d3dd8601c78bd6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.734015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8046a0f21cf54a5095d3dd8601c78bd6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.740407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-690c3909-56cd-4c64-b463-4b30f37c1bb4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:08.742477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-690c3909-56cd-4c64-b463-4b30f37c1bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:08.747843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8046a0f21cf54a5095d3dd8601c78bd6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.749167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8046a0f21cf54a5095d3dd8601c78bd6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:08.764852 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3185/6394] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:08.766692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d684d6-cd34-42ea-ada4-8cc3a8b34fd7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.766933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d684d6-cd34-42ea-ada4-8cc3a8b34fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.767064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d684d6-cd34-42ea-ada4-8cc3a8b34fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.774470 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3210/6395] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:08 2022] DELETE /identity/v3/users/8046a0f21cf54a5095d3dd8601c78bd6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:08.775499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:08.819484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-79d684d6-cd34-42ea-ada4-8cc3a8b34fd7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:08.821352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79d684d6-cd34-42ea-ada4-8cc3a8b34fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:08.909030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6159a-6507-47fa-a720-e0482fcc1116 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:08.914073 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3186/6396] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:08.919715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d684d6-cd34-42ea-ada4-8cc3a8b34fd7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:08.920385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148236b-a09a-4584-817c-3099e260603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:08.921150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148236b-a09a-4584-817c-3099e260603a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.921540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148236b-a09a-4584-817c-3099e260603a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.921918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148236b-a09a-4584-817c-3099e260603a admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.923011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148236b-a09a-4584-817c-3099e260603a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:08.923429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148236b-a09a-4584-817c-3099e260603a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:08.926155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148236b-a09a-4584-817c-3099e260603a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:08.937707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d684d6-cd34-42ea-ada4-8cc3a8b34fd7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:08.946029 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3211/6397] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:08.947161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148236b-a09a-4584-817c-3099e260603a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:08.953470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32978ed-8056-4711-99e7-678fef0a17da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:08.954106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32978ed-8056-4711-99e7-678fef0a17da admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.954487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32978ed-8056-4711-99e7-678fef0a17da admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.954794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32978ed-8056-4711-99e7-678fef0a17da admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.955458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32978ed-8056-4711-99e7-678fef0a17da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:08.955761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32978ed-8056-4711-99e7-678fef0a17da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:08.959021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32978ed-8056-4711-99e7-678fef0a17da admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:08.959917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148236b-a09a-4584-817c-3099e260603a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:08.989444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf482dee-9028-4530-b4c4-98a8b37a83b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:08.991368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf482dee-9028-4530-b4c4-98a8b37a83b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:08.992330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf482dee-9028-4530-b4c4-98a8b37a83b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:08.993263 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3187/6398] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:08.993721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf482dee-9028-4530-b4c4-98a8b37a83b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:08.996634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32978ed-8056-4711-99e7-678fef0a17da admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:08.998544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf482dee-9028-4530-b4c4-98a8b37a83b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.005524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf482dee-9028-4530-b4c4-98a8b37a83b4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.008038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32978ed-8056-4711-99e7-678fef0a17da admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.015430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dae03c-66a0-4135-8c00-c98056d6a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.016068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dae03c-66a0-4135-8c00-c98056d6a54b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.016888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dae03c-66a0-4135-8c00-c98056d6a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.017234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dae03c-66a0-4135-8c00-c98056d6a54b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.018020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dae03c-66a0-4135-8c00-c98056d6a54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.019966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dae03c-66a0-4135-8c00-c98056d6a54b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.063864 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3188/6399] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:08 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:09.066229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dae03c-66a0-4135-8c00-c98056d6a54b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:09.082092 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3212/6400] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:08 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:09.086488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf482dee-9028-4530-b4c4-98a8b37a83b4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:09.100301 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:09.234250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf482dee-9028-4530-b4c4-98a8b37a83b4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.241532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4709562-fa3c-492c-a625-954fc300e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.241795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4709562-fa3c-492c-a625-954fc300e0aa admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.242085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4709562-fa3c-492c-a625-954fc300e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.242316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4709562-fa3c-492c-a625-954fc300e0aa admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.244709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4709562-fa3c-492c-a625-954fc300e0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.247701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4709562-fa3c-492c-a625-954fc300e0aa admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.287318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dae03c-66a0-4135-8c00-c98056d6a54b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.289168 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3213/6401] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:09 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:30:09.290072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4709562-fa3c-492c-a625-954fc300e0aa admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:09.294297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f4709562-fa3c-492c-a625-954fc300e0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:09.296668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cec96d-754f-4a25-8c52-bdc95db77407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.297725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cec96d-754f-4a25-8c52-bdc95db77407 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.298222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cec96d-754f-4a25-8c52-bdc95db77407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.298763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cec96d-754f-4a25-8c52-bdc95db77407 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.299914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cec96d-754f-4a25-8c52-bdc95db77407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.304343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cec96d-754f-4a25-8c52-bdc95db77407 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.332231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4709562-fa3c-492c-a625-954fc300e0aa admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.341160 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3189/6402] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:09 2022] POST /identity/v3/users => generated 292 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:09.341160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cec96d-754f-4a25-8c52-bdc95db77407 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:09.343125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.343926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.344944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.345175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] PATH_INFO: `/v3/projects/2b6d9ae81c15411ea1642447536399ea` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.346404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6d9ae81c15411ea1642447536399ea)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.348697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.353844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cec96d-754f-4a25-8c52-bdc95db77407 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.358887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8eec2-1261-40b5-8c33-1431bbef2264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.359504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8eec2-1261-40b5-8c33-1431bbef2264 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.359785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8eec2-1261-40b5-8c33-1431bbef2264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.360054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8eec2-1261-40b5-8c33-1431bbef2264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.360708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8eec2-1261-40b5-8c33-1431bbef2264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.362306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8eec2-1261-40b5-8c33-1431bbef2264 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.380514 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3190/6403] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:09.381469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8eec2-1261-40b5-8c33-1431bbef2264 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:09.400194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8eec2-1261-40b5-8c33-1431bbef2264 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.414311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6d9ae81c15411ea1642447536399ea', 'request_id': 'req-5bdf1aad-6314-4e45-9bd9-9b3dab237136'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:09.421287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6d9ae81c15411ea1642447536399ea', 'request_id': 'req-5bdf1aad-6314-4e45-9bd9-9b3dab237136'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:09.423127 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:09.431871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6d9ae81c15411ea1642447536399ea', 'request_id': 'req-5bdf1aad-6314-4e45-9bd9-9b3dab237136'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:09.451349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] The token cache is being invalidate because project 2b6d9ae81c15411ea1642447536399ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:09.451860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:09.452780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:09.455365 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3214/6404] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:09 2022] DELETE /identity/v3/projects/2b6d9ae81c15411ea1642447536399ea => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:09.456394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:09.458535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:09.489005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb0f37-ba25-4f4b-8bfb-6a8e3d0583e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.489803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb0f37-ba25-4f4b-8bfb-6a8e3d0583e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.490088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb0f37-ba25-4f4b-8bfb-6a8e3d0583e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.490361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb0f37-ba25-4f4b-8bfb-6a8e3d0583e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.491036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb0f37-ba25-4f4b-8bfb-6a8e3d0583e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.492648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb0f37-ba25-4f4b-8bfb-6a8e3d0583e8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.509402 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3191/6405] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:09.511068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1289b7b-9b20-4c6f-bb22-f65b67e37243 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.511419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1289b7b-9b20-4c6f-bb22-f65b67e37243 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.511688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1289b7b-9b20-4c6f-bb22-f65b67e37243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.553875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a1289b7b-9b20-4c6f-bb22-f65b67e37243 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:09.555123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a1289b7b-9b20-4c6f-bb22-f65b67e37243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:09.556623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1aad-6314-4e45-9bd9-9b3dab237136 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.563324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5447b1-8f9e-4ccc-bee5-094704e49d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.563957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5447b1-8f9e-4ccc-bee5-094704e49d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.564298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5447b1-8f9e-4ccc-bee5-094704e49d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.564519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5447b1-8f9e-4ccc-bee5-094704e49d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.565233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5447b1-8f9e-4ccc-bee5-094704e49d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.567852 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3192/6406] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:09.568397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5447b1-8f9e-4ccc-bee5-094704e49d2a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.568988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1289b7b-9b20-4c6f-bb22-f65b67e37243 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:09.570534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a1289b7b-9b20-4c6f-bb22-f65b67e37243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:09.584065 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3215/6407] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:09.585495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39d878-d342-447b-8f7e-b470fffe61c1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.585882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39d878-d342-447b-8f7e-b470fffe61c1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.586160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39d878-d342-447b-8f7e-b470fffe61c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.586535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1289b7b-9b20-4c6f-bb22-f65b67e37243 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.594385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bc25b-438f-4320-9eb1-dc8ff1cada39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.595135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bc25b-438f-4320-9eb1-dc8ff1cada39 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.595515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bc25b-438f-4320-9eb1-dc8ff1cada39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.596019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bc25b-438f-4320-9eb1-dc8ff1cada39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.596850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bc25b-438f-4320-9eb1-dc8ff1cada39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.600053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bc25b-438f-4320-9eb1-dc8ff1cada39 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.616641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0e39d878-d342-447b-8f7e-b470fffe61c1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:09.617905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0e39d878-d342-447b-8f7e-b470fffe61c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:09.618721 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3193/6408] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:09.619654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bc25b-438f-4320-9eb1-dc8ff1cada39 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:09.627792 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3216/6409] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:09.628798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39d878-d342-447b-8f7e-b470fffe61c1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:09.640872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39d878-d342-447b-8f7e-b470fffe61c1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.648132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9f465-f6b5-465c-a5f7-123525caf245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.649569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9f465-f6b5-465c-a5f7-123525caf245 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.649569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9f465-f6b5-465c-a5f7-123525caf245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.649768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9f465-f6b5-465c-a5f7-123525caf245 admin admin] PATH_INFO: `/v3/projects/039bfbfd17c043b081635e722431c113/users/20dd5694107443238a78eb1d883c1f17/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.653390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bc25b-438f-4320-9eb1-dc8ff1cada39 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.653908 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:09.667422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad14712-3cdf-4ddd-9de8-1e6ff467128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.668112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad14712-3cdf-4ddd-9de8-1e6ff467128e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.668394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad14712-3cdf-4ddd-9de8-1e6ff467128e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.668668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad14712-3cdf-4ddd-9de8-1e6ff467128e admin admin] PATH_INFO: `/v3/projects/f658327dd94f4bdca270442f50a4de9a/users/e6685c983edc4847ad58a32b3ac5ec74/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.678339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9f465-f6b5-465c-a5f7-123525caf245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039bfbfd17c043b081635e722431c113, user_id=20dd5694107443238a78eb1d883c1f17, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.688208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9f465-f6b5-465c-a5f7-123525caf245 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.717472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad14712-3cdf-4ddd-9de8-1e6ff467128e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f658327dd94f4bdca270442f50a4de9a, user_id=e6685c983edc4847ad58a32b3ac5ec74, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.720190 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3217/6410] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:09 2022] PUT /identity/v3/projects/039bfbfd17c043b081635e722431c113/users/20dd5694107443238a78eb1d883c1f17/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:09.720351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad14712-3cdf-4ddd-9de8-1e6ff467128e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.721218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9f465-f6b5-465c-a5f7-123525caf245 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:09.746161 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3194/6411] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:09 2022] PUT /identity/v3/projects/f658327dd94f4bdca270442f50a4de9a/users/e6685c983edc4847ad58a32b3ac5ec74/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:09.747644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c68a-abb0-41c8-b0d4-e1587157b5ed None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.748110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c68a-abb0-41c8-b0d4-e1587157b5ed None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.748510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c68a-abb0-41c8-b0d4-e1587157b5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.792626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2573c68a-abb0-41c8-b0d4-e1587157b5ed None None] MFA Rules not processed for user `20dd5694107443238a78eb1d883c1f17`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:09.793868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2573c68a-abb0-41c8-b0d4-e1587157b5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:09.816466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9f465-f6b5-465c-a5f7-123525caf245 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.927841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529730c-f304-40d4-a879-8e0949176cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.928524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529730c-f304-40d4-a879-8e0949176cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.928808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529730c-f304-40d4-a879-8e0949176cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.929080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529730c-f304-40d4-a879-8e0949176cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.930001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529730c-f304-40d4-a879-8e0949176cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:09.930305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529730c-f304-40d4-a879-8e0949176cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.932853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529730c-f304-40d4-a879-8e0949176cf2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:09.945734 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3195/6412] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:09.947186 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3218/6413] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:09.947727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726503a-382a-4a92-ae61-60381d3af3f6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.948276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726503a-382a-4a92-ae61-60381d3af3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.948541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529730c-f304-40d4-a879-8e0949176cf2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:09.948992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726503a-382a-4a92-ae61-60381d3af3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.950686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5529730c-f304-40d4-a879-8e0949176cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:09.983685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529730c-f304-40d4-a879-8e0949176cf2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:09.988676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:09.989313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:09.989596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:09.989871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] PATH_INFO: `/v3/projects/c44b373c68e74691b19f1b2a8bdfc932` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:09.991061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44b373c68e74691b19f1b2a8bdfc932)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:09.993197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:10.003529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0726503a-382a-4a92-ae61-60381d3af3f6 None None] MFA Rules not processed for user `e6685c983edc4847ad58a32b3ac5ec74`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:10.004990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0726503a-382a-4a92-ae61-60381d3af3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:10.074914 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:10.099148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44b373c68e74691b19f1b2a8bdfc932', 'request_id': 'req-f6479d73-1086-49e5-8d81-d61f25572d4a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:10.106558 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3196/6414] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:10.107816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726503a-382a-4a92-ae61-60381d3af3f6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:10.121866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726503a-382a-4a92-ae61-60381d3af3f6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:10.123544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44b373c68e74691b19f1b2a8bdfc932', 'request_id': 'req-f6479d73-1086-49e5-8d81-d61f25572d4a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:10.139680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44b373c68e74691b19f1b2a8bdfc932', 'request_id': 'req-f6479d73-1086-49e5-8d81-d61f25572d4a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:10.166352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] The token cache is being invalidate because project c44b373c68e74691b19f1b2a8bdfc932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:10.166768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:10.167475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:10.169818 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3219/6415] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:09 2022] DELETE /identity/v3/projects/c44b373c68e74691b19f1b2a8bdfc932 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:10.170529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:10.173502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:10.198671 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:10.237939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb426bc-476e-43ee-8bac-5450babddb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:10.239122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb426bc-476e-43ee-8bac-5450babddb4a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.239122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb426bc-476e-43ee-8bac-5450babddb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.240925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb426bc-476e-43ee-8bac-5450babddb4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.240925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb426bc-476e-43ee-8bac-5450babddb4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:10.243855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb426bc-476e-43ee-8bac-5450babddb4a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:10.280875 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3197/6416] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:10 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:10.281888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb426bc-476e-43ee-8bac-5450babddb4a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:10.283972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-beb426bc-476e-43ee-8bac-5450babddb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:10.291521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6479d73-1086-49e5-8d81-d61f25572d4a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:10.358544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27736f63-83a1-4c4b-b1d6-4ad3f211c51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:10.359636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27736f63-83a1-4c4b-b1d6-4ad3f211c51d service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.360141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27736f63-83a1-4c4b-b1d6-4ad3f211c51d service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.360686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27736f63-83a1-4c4b-b1d6-4ad3f211c51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.363246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-27736f63-83a1-4c4b-b1d6-4ad3f211c51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:10.373423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb426bc-476e-43ee-8bac-5450babddb4a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:10.388463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758bb64-5a6e-4193-8298-2a2aab078128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:10.389552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758bb64-5a6e-4193-8298-2a2aab078128 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.389552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758bb64-5a6e-4193-8298-2a2aab078128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.389785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758bb64-5a6e-4193-8298-2a2aab078128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.390269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758bb64-5a6e-4193-8298-2a2aab078128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:10.392313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758bb64-5a6e-4193-8298-2a2aab078128 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:10.439868 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3198/6417] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:10 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:10.439868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76406138-fcc0-4b62-8fe4-a93d80ff4ce0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.439868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76406138-fcc0-4b62-8fe4-a93d80ff4ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.439868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76406138-fcc0-4b62-8fe4-a93d80ff4ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.487684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-76406138-fcc0-4b62-8fe4-a93d80ff4ce0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:10.491375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-76406138-fcc0-4b62-8fe4-a93d80ff4ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:10.522888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27736f63-83a1-4c4b-b1d6-4ad3f211c51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:10.524347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27736f63-83a1-4c4b-b1d6-4ad3f211c51d service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:10.538588 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3220/6418] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:10.567447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27736f63-83a1-4c4b-b1d6-4ad3f211c51d service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:10.572189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-27736f63-83a1-4c4b-b1d6-4ad3f211c51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:10.605160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27736f63-83a1-4c4b-b1d6-4ad3f211c51d service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:10.642649 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3199/6419] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:10.644816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76406138-fcc0-4b62-8fe4-a93d80ff4ce0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:10.655236 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:10.664616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76406138-fcc0-4b62-8fe4-a93d80ff4ce0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:10.676040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b125a0-bc1f-4655-8c72-14c611fa1eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:10.677198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b125a0-bc1f-4655-8c72-14c611fa1eff admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.677629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b125a0-bc1f-4655-8c72-14c611fa1eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.678498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b125a0-bc1f-4655-8c72-14c611fa1eff admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.680003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b125a0-bc1f-4655-8c72-14c611fa1eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:10.684299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b125a0-bc1f-4655-8c72-14c611fa1eff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:10.694103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e291a-6b9e-44be-bcea-6deb083750e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:10.695438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e291a-6b9e-44be-bcea-6deb083750e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.696441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e291a-6b9e-44be-bcea-6deb083750e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.696910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e291a-6b9e-44be-bcea-6deb083750e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.698389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e291a-6b9e-44be-bcea-6deb083750e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:10.701524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e291a-6b9e-44be-bcea-6deb083750e2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:10.715248 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3200/6420] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:10 2022] POST /identity/v3/users => generated 292 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:10.717925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b7242-77c8-41d2-a05c-ab5f87db5e78 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.718371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b7242-77c8-41d2-a05c-ab5f87db5e78 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.718733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b7242-77c8-41d2-a05c-ab5f87db5e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.730973 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3221/6421] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:10 2022] POST /identity/v3/users => generated 303 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:10.731887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e291a-6b9e-44be-bcea-6deb083750e2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:10.747177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0e4b7242-77c8-41d2-a05c-ab5f87db5e78 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:10.749363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0e4b7242-77c8-41d2-a05c-ab5f87db5e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:10.758305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e291a-6b9e-44be-bcea-6deb083750e2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:10.762686 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3201/6422] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:10.763775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b7242-77c8-41d2-a05c-ab5f87db5e78 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:10.771314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe4875-396e-440c-86a8-9e74518f09ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:10.772026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe4875-396e-440c-86a8-9e74518f09ca admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.772389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe4875-396e-440c-86a8-9e74518f09ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.772804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe4875-396e-440c-86a8-9e74518f09ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.773534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe4875-396e-440c-86a8-9e74518f09ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:10.775401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe4875-396e-440c-86a8-9e74518f09ca admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:10.779024 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:10.783325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b7242-77c8-41d2-a05c-ab5f87db5e78 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:10.799463 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3222/6423] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:10.799616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508cce8-72ab-462e-9441-877b46a2a857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:10.799859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe4875-396e-440c-86a8-9e74518f09ca admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:10.799969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508cce8-72ab-462e-9441-877b46a2a857 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.799969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508cce8-72ab-462e-9441-877b46a2a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.799969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508cce8-72ab-462e-9441-877b46a2a857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.799969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508cce8-72ab-462e-9441-877b46a2a857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:10.805900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508cce8-72ab-462e-9441-877b46a2a857 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:10.811875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe4875-396e-440c-86a8-9e74518f09ca admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:10.817405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83a6b9-0bff-47b4-b759-ec3d9ea27f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:10.818766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83a6b9-0bff-47b4-b759-ec3d9ea27f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.819531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83a6b9-0bff-47b4-b759-ec3d9ea27f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.820116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83a6b9-0bff-47b4-b759-ec3d9ea27f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.821016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83a6b9-0bff-47b4-b759-ec3d9ea27f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:10.821527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83a6b9-0bff-47b4-b759-ec3d9ea27f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:10.823744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83a6b9-0bff-47b4-b759-ec3d9ea27f18 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:10.842842 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3202/6424] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:10.842842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508cce8-72ab-462e-9441-877b46a2a857 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:10.859616 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3223/6425] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:10.860499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83a6b9-0bff-47b4-b759-ec3d9ea27f18 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:10.865066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508cce8-72ab-462e-9441-877b46a2a857 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:10.884110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e887-849a-4826-82e8-a232815a9c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:10.889431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83a6b9-0bff-47b4-b759-ec3d9ea27f18 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:10.889693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e887-849a-4826-82e8-a232815a9c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.889693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e887-849a-4826-82e8-a232815a9c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.889693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e887-849a-4826-82e8-a232815a9c2a admin admin] PATH_INFO: `/v3/projects/e54ad4bbf3764a9191317edf15a5524d/users/349637d726974797b897ebff9dab72d7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.899075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ff9e-0faf-46da-b05b-2b3fda3d253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:10.901048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ff9e-0faf-46da-b05b-2b3fda3d253d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.901567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ff9e-0faf-46da-b05b-2b3fda3d253d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.901941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ff9e-0faf-46da-b05b-2b3fda3d253d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.902747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ff9e-0faf-46da-b05b-2b3fda3d253d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:10.910169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ff9e-0faf-46da-b05b-2b3fda3d253d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:10.938111 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3224/6426] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:10.938111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ff9e-0faf-46da-b05b-2b3fda3d253d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:10.947255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4e887-849a-4826-82e8-a232815a9c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54ad4bbf3764a9191317edf15a5524d, user_id=349637d726974797b897ebff9dab72d7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:10.963270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4e887-849a-4826-82e8-a232815a9c2a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:10.963503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ff9e-0faf-46da-b05b-2b3fda3d253d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:10.976293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38dfac-292c-476c-a7fb-d6982e282069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:10.976976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38dfac-292c-476c-a7fb-d6982e282069 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:10.977182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38dfac-292c-476c-a7fb-d6982e282069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:10.977439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38dfac-292c-476c-a7fb-d6982e282069 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:10.978122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38dfac-292c-476c-a7fb-d6982e282069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:10.982202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38dfac-292c-476c-a7fb-d6982e282069 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:11.008624 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3203/6427] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:10 2022] PUT /identity/v3/projects/e54ad4bbf3764a9191317edf15a5524d/users/349637d726974797b897ebff9dab72d7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:11.009481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e887-849a-4826-82e8-a232815a9c2a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:11.045140 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3225/6428] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:10 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:11.045140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38dfac-292c-476c-a7fb-d6982e282069 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:11.184158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38dfac-292c-476c-a7fb-d6982e282069 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:11.201072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4763f2f-7854-4856-9922-205f08ea75bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:11.201835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4763f2f-7854-4856-9922-205f08ea75bf admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:11.202122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4763f2f-7854-4856-9922-205f08ea75bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:11.202472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4763f2f-7854-4856-9922-205f08ea75bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:11.204329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4763f2f-7854-4856-9922-205f08ea75bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:11.210726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4763f2f-7854-4856-9922-205f08ea75bf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:11.223823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e887-849a-4826-82e8-a232815a9c2a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:11.235045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67266680-0036-4eed-a5b4-2fb65f11c4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:11.236254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266680-0036-4eed-a5b4-2fb65f11c4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:11.236731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266680-0036-4eed-a5b4-2fb65f11c4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:11.237237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266680-0036-4eed-a5b4-2fb65f11c4b1 admin admin] PATH_INFO: `/v3/projects/b91a9bfa07e14f6fb650924169a93a9c/users/f993b548a0ca4e7bbb6780153db61ec4/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:11.241061 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3226/6429] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:11.245094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4763f2f-7854-4856-9922-205f08ea75bf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:11.259302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4763f2f-7854-4856-9922-205f08ea75bf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:11.264981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67266680-0036-4eed-a5b4-2fb65f11c4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91a9bfa07e14f6fb650924169a93a9c, user_id=f993b548a0ca4e7bbb6780153db61ec4, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:11.267888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67266680-0036-4eed-a5b4-2fb65f11c4b1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:11.268704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb9075-2cb4-4fa5-933c-2a30c21461bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:11.269576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9075-2cb4-4fa5-933c-2a30c21461bb admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:11.270064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9075-2cb4-4fa5-933c-2a30c21461bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:11.270734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9075-2cb4-4fa5-933c-2a30c21461bb admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:11.272279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb9075-2cb4-4fa5-933c-2a30c21461bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:11.274524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb9075-2cb4-4fa5-933c-2a30c21461bb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:11.285301 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3204/6430] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:11 2022] PUT /identity/v3/projects/b91a9bfa07e14f6fb650924169a93a9c/users/f993b548a0ca4e7bbb6780153db61ec4/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:11.287304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67266680-0036-4eed-a5b4-2fb65f11c4b1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:11.304861 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3227/6431] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:11 2022] POST /identity/v3/users => generated 285 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:11.304861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb9075-2cb4-4fa5-933c-2a30c21461bb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:11.304861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-81cb9075-2cb4-4fa5-933c-2a30c21461bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:11.320664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb9075-2cb4-4fa5-933c-2a30c21461bb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:11.394687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67266680-0036-4eed-a5b4-2fb65f11c4b1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:11.395801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:11.396482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:11.396721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:11.396985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] PATH_INFO: `/v3/users/20dd5694107443238a78eb1d883c1f17` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:11.398148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20dd5694107443238a78eb1d883c1f17)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:11.400102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:11.403365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bf7a1-0fcd-456f-8fb6-5126fdc03d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:11.405066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bf7a1-0fcd-456f-8fb6-5126fdc03d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:11.405701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bf7a1-0fcd-456f-8fb6-5126fdc03d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:11.406949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bf7a1-0fcd-456f-8fb6-5126fdc03d11 admin admin] PATH_INFO: `/v3/projects/e54ad4bbf3764a9191317edf15a5524d/users/349637d726974797b897ebff9dab72d7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:11.413800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bf7a1-0fcd-456f-8fb6-5126fdc03d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54ad4bbf3764a9191317edf15a5524d, user_id=349637d726974797b897ebff9dab72d7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:11.416520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bf7a1-0fcd-456f-8fb6-5126fdc03d11 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:11.429774 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3205/6432] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:11 2022] PUT /identity/v3/projects/e54ad4bbf3764a9191317edf15a5524d/users/349637d726974797b897ebff9dab72d7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:11.431449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653529a-4115-4454-a617-54713802a019 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:11.431954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653529a-4115-4454-a617-54713802a019 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:11.433004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653529a-4115-4454-a617-54713802a019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:11.454281 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:11.460699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3653529a-4115-4454-a617-54713802a019 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:11.462914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3653529a-4115-4454-a617-54713802a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:11.480851 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:11.482232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20dd5694107443238a78eb1d883c1f17'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:11.512969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20dd5694107443238a78eb1d883c1f17'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:11.513870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20dd5694107443238a78eb1d883c1f17'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:11.527110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20dd5694107443238a78eb1d883c1f17'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:11.527905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20dd5694107443238a78eb1d883c1f17'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:11.561142 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3228/6433] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:11 2022] DELETE /identity/v3/users/20dd5694107443238a78eb1d883c1f17 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:11.561359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:11.568749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:11.572890 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3206/6434] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:11.575661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173070b5-934a-4de3-8a16-836b9670d0eb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:11.576231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173070b5-934a-4de3-8a16-836b9670d0eb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:11.576720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173070b5-934a-4de3-8a16-836b9670d0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:11.661431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-173070b5-934a-4de3-8a16-836b9670d0eb None None] MFA Rules not processed for user `349637d726974797b897ebff9dab72d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:11.662920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-173070b5-934a-4de3-8a16-836b9670d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:11.701367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa90911-786e-4215-a4ff-c53056eea815 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:11.709065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7275c08-5e7a-48ee-8327-67c0fc2bfefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:11.710565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7275c08-5e7a-48ee-8327-67c0fc2bfefb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:11.712288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7275c08-5e7a-48ee-8327-67c0fc2bfefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:11.712668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7275c08-5e7a-48ee-8327-67c0fc2bfefb admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:11.714312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7275c08-5e7a-48ee-8327-67c0fc2bfefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:11.719120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7275c08-5e7a-48ee-8327-67c0fc2bfefb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:11.742655 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3229/6435] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:11.744222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314a378-e794-4d4f-bd75-374fc0e13c8b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:11.744615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314a378-e794-4d4f-bd75-374fc0e13c8b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:11.746782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314a378-e794-4d4f-bd75-374fc0e13c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:11.794635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1314a378-e794-4d4f-bd75-374fc0e13c8b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:11.796015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1314a378-e794-4d4f-bd75-374fc0e13c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:11.818649 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3207/6436] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:11.819215 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3230/6437] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:11.820165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314a378-e794-4d4f-bd75-374fc0e13c8b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:11.820896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173070b5-934a-4de3-8a16-836b9670d0eb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:11.830645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-173070b5-934a-4de3-8a16-836b9670d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:11.841648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314a378-e794-4d4f-bd75-374fc0e13c8b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:11.852138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43dd7e-c583-4eec-8a62-200b509b377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:11.852827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43dd7e-c583-4eec-8a62-200b509b377d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:11.853114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43dd7e-c583-4eec-8a62-200b509b377d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:11.853391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43dd7e-c583-4eec-8a62-200b509b377d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:11.855063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43dd7e-c583-4eec-8a62-200b509b377d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:11.857157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43dd7e-c583-4eec-8a62-200b509b377d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:11.881058 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3231/6438] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:11.881058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43dd7e-c583-4eec-8a62-200b509b377d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:11.896895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43dd7e-c583-4eec-8a62-200b509b377d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:11.904024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e3b22-4758-40bc-a2f5-434f4227fdba tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:11.904573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e3b22-4758-40bc-a2f5-434f4227fdba tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:11.904862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e3b22-4758-40bc-a2f5-434f4227fdba tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:11.905138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e3b22-4758-40bc-a2f5-434f4227fdba tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:11.905818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e3b22-4758-40bc-a2f5-434f4227fdba tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:11.921824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e3b22-4758-40bc-a2f5-434f4227fdba tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:11.957828 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3232/6439] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:30:11 2022] POST /identity/v3/domains => generated 275 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:11.958700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173070b5-934a-4de3-8a16-836b9670d0eb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:11.959111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e3b22-4758-40bc-a2f5-434f4227fdba tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:11.964230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-be8e3b22-4758-40bc-a2f5-434f4227fdba tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:12.058783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e3b22-4758-40bc-a2f5-434f4227fdba tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:12.064081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e28aae-6396-4175-baef-e12404e01eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:12.065169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e28aae-6396-4175-baef-e12404e01eaf service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:12.065602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e28aae-6396-4175-baef-e12404e01eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:12.065887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e28aae-6396-4175-baef-e12404e01eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:12.077562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bfcbf-83bb-4ad9-b341-b1c0ab32d340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:12.078190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bfcbf-83bb-4ad9-b341-b1c0ab32d340 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:12.078472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bfcbf-83bb-4ad9-b341-b1c0ab32d340 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:12.078780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bfcbf-83bb-4ad9-b341-b1c0ab32d340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:12.100935 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:12.111317 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:12.160484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e28aae-6396-4175-baef-e12404e01eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:12.164329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e28aae-6396-4175-baef-e12404e01eaf service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:12.185843 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3233/6440] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:12.189435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e28aae-6396-4175-baef-e12404e01eaf service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:12.210370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e28aae-6396-4175-baef-e12404e01eaf service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:12.212260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bfcbf-83bb-4ad9-b341-b1c0ab32d340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:12.214515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bfcbf-83bb-4ad9-b341-b1c0ab32d340 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:12.224460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddba771-dce8-4dfe-b89f-9eb566031969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:12.226382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddba771-dce8-4dfe-b89f-9eb566031969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:12.227792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddba771-dce8-4dfe-b89f-9eb566031969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:12.228285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddba771-dce8-4dfe-b89f-9eb566031969 admin admin] PATH_INFO: `/v3/projects/f9c72e0561b74ad88c25388ed58188ee/users/c95021bacb5940f1bf850f2fb43f3436/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:12.243531 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3208/6441] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:12.246299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bfcbf-83bb-4ad9-b341-b1c0ab32d340 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:12.265220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddba771-dce8-4dfe-b89f-9eb566031969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c72e0561b74ad88c25388ed58188ee, user_id=c95021bacb5940f1bf850f2fb43f3436, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:12.275849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddba771-dce8-4dfe-b89f-9eb566031969 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:12.308303 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3234/6442] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:12 2022] PUT /identity/v3/projects/f9c72e0561b74ad88c25388ed58188ee/users/c95021bacb5940f1bf850f2fb43f3436/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:12.321761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c61f6-1408-439f-9c1b-c60f8564db20 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:12.322338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c61f6-1408-439f-9c1b-c60f8564db20 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:12.322949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c61f6-1408-439f-9c1b-c60f8564db20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:12.387416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-492c61f6-1408-439f-9c1b-c60f8564db20 None None] MFA Rules not processed for user `c95021bacb5940f1bf850f2fb43f3436`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:12.391010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-492c61f6-1408-439f-9c1b-c60f8564db20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:12.433352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bfcbf-83bb-4ad9-b341-b1c0ab32d340 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:12.578922 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3235/6443] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:30:12.583916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c61f6-1408-439f-9c1b-c60f8564db20 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:12.614005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ee10e-dd17-42ff-8b8c-70e8c9a46fdd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:12.615947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ee10e-dd17-42ff-8b8c-70e8c9a46fdd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:12.616244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ee10e-dd17-42ff-8b8c-70e8c9a46fdd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:12.620100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ee10e-dd17-42ff-8b8c-70e8c9a46fdd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:12.623733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ee10e-dd17-42ff-8b8c-70e8c9a46fdd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:12.630321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ee10e-dd17-42ff-8b8c-70e8c9a46fdd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:12.741513 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3209/6444] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:12 2022] POST /identity/v3/projects => generated 403 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:12.745647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ee10e-dd17-42ff-8b8c-70e8c9a46fdd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:12.748358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c61f6-1408-439f-9c1b-c60f8564db20 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:12.855750 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:12.857911 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:12.927554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ee10e-dd17-42ff-8b8c-70e8c9a46fdd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:12.929482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099d3ef-67dd-4ff6-ae86-c4ac13cc318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:12.930433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099d3ef-67dd-4ff6-ae86-c4ac13cc318b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:12.931039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099d3ef-67dd-4ff6-ae86-c4ac13cc318b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:12.931541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099d3ef-67dd-4ff6-ae86-c4ac13cc318b admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:12.933049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099d3ef-67dd-4ff6-ae86-c4ac13cc318b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:12.937023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099d3ef-67dd-4ff6-ae86-c4ac13cc318b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:12.939504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182cab6-0559-43d5-9cc3-214f7afc05b4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:12.955440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182cab6-0559-43d5-9cc3-214f7afc05b4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:12.970014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182cab6-0559-43d5-9cc3-214f7afc05b4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:12.971773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182cab6-0559-43d5-9cc3-214f7afc05b4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:12.973360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182cab6-0559-43d5-9cc3-214f7afc05b4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:12.982526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182cab6-0559-43d5-9cc3-214f7afc05b4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:13.036773 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3210/6445] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:30:12 2022] POST /identity/v3/groups => generated 301 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:13.038887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182cab6-0559-43d5-9cc3-214f7afc05b4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:13.042730 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3236/6446] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:12 2022] POST /identity/v3/projects => generated 369 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:30:13.045421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099d3ef-67dd-4ff6-ae86-c4ac13cc318b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:13.078126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182cab6-0559-43d5-9cc3-214f7afc05b4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:13.189288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099d3ef-67dd-4ff6-ae86-c4ac13cc318b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:13.202892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872550ba-cd87-4e2f-9aa0-559bc35501e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:13.203810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872550ba-cd87-4e2f-9aa0-559bc35501e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:13.204037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872550ba-cd87-4e2f-9aa0-559bc35501e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:13.204517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872550ba-cd87-4e2f-9aa0-559bc35501e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:13.205458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872550ba-cd87-4e2f-9aa0-559bc35501e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:13.210184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872550ba-cd87-4e2f-9aa0-559bc35501e7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:13.245938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474cac5-ecd5-4457-b63c-0985321951b0 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:13.246577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474cac5-ecd5-4457-b63c-0985321951b0 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:13.247025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474cac5-ecd5-4457-b63c-0985321951b0 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:13.247307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474cac5-ecd5-4457-b63c-0985321951b0 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:13.254648 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3237/6447] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:13 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:13.254928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474cac5-ecd5-4457-b63c-0985321951b0 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:13.257246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474cac5-ecd5-4457-b63c-0985321951b0 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:13.258245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872550ba-cd87-4e2f-9aa0-559bc35501e7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:13.280748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872550ba-cd87-4e2f-9aa0-559bc35501e7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:13.296230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8634e-53ed-4f0e-a476-020403692184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:13.296977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8634e-53ed-4f0e-a476-020403692184 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:13.297376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8634e-53ed-4f0e-a476-020403692184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:13.297749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8634e-53ed-4f0e-a476-020403692184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:13.298529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8634e-53ed-4f0e-a476-020403692184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:13.300290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8634e-53ed-4f0e-a476-020403692184 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:13.325709 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3238/6448] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:30:13.326796 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3211/6449] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:13 2022] POST /identity/v3/users => generated 445 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:13.327912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8634e-53ed-4f0e-a476-020403692184 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:13.331527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474cac5-ecd5-4457-b63c-0985321951b0 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:13.357086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8634e-53ed-4f0e-a476-020403692184 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:13.361390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474cac5-ecd5-4457-b63c-0985321951b0 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:13.395786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e1930-195e-4a86-b151-90f1c8cd8a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:13.411373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e1930-195e-4a86-b151-90f1c8cd8a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:13.414162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e1930-195e-4a86-b151-90f1c8cd8a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:13.415643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e1930-195e-4a86-b151-90f1c8cd8a0a admin admin] PATH_INFO: `/v3/projects/80f3fede041e49f6ad4cb9aa9715897e/users/e3ff4d3857e04b5eb1bdb1970ebf2fff/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:13.430901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a89029-b41e-4592-9074-a8e3903a90ff tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:13.437845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a89029-b41e-4592-9074-a8e3903a90ff tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:13.438468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a89029-b41e-4592-9074-a8e3903a90ff tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:13.438468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a89029-b41e-4592-9074-a8e3903a90ff tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:13.441398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a89029-b41e-4592-9074-a8e3903a90ff tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:13.447468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a89029-b41e-4592-9074-a8e3903a90ff tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:13.512669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e1930-195e-4a86-b151-90f1c8cd8a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f3fede041e49f6ad4cb9aa9715897e, user_id=e3ff4d3857e04b5eb1bdb1970ebf2fff, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:13.513528 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3212/6450] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:30:13 2022] POST /identity/v3/roles => generated 239 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:30:13.518471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a89029-b41e-4592-9074-a8e3903a90ff tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:13.522445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e1930-195e-4a86-b151-90f1c8cd8a0a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:13.566282 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3239/6451] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:13 2022] PUT /identity/v3/projects/80f3fede041e49f6ad4cb9aa9715897e/users/e3ff4d3857e04b5eb1bdb1970ebf2fff/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:13.566522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a89029-b41e-4592-9074-a8e3903a90ff tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:13.567818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e1930-195e-4a86-b151-90f1c8cd8a0a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:13.747967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e1930-195e-4a86-b151-90f1c8cd8a0a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:13.754185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7890f5-54cc-4630-8803-4df73057b48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:13.754973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7890f5-54cc-4630-8803-4df73057b48e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:13.755363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7890f5-54cc-4630-8803-4df73057b48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:13.755747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7890f5-54cc-4630-8803-4df73057b48e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:13.756567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7890f5-54cc-4630-8803-4df73057b48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:13.759043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7890f5-54cc-4630-8803-4df73057b48e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:13.759946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f8a4-bbed-443c-bc5c-e268746fe5e5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:13.760895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f8a4-bbed-443c-bc5c-e268746fe5e5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:13.761038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f8a4-bbed-443c-bc5c-e268746fe5e5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:13.761326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f8a4-bbed-443c-bc5c-e268746fe5e5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/groups/032c646bb10b48209a3aa9bfbcff0253/roles/500e638f87a446f98a60c17e45718c5c/inherited_to_projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:13.770311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775f8a4-bbed-443c-bc5c-e268746fe5e5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f049948dfe6249d1a40faf1a9fb9a728, group_id=032c646bb10b48209a3aa9bfbcff0253, role_id=500e638f87a446f98a60c17e45718c5c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:13.773097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775f8a4-bbed-443c-bc5c-e268746fe5e5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:13.775012 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3240/6452] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:13 2022] GET /identity/v3/roles => generated 1650 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:13.780385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7890f5-54cc-4630-8803-4df73057b48e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:13.794109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7890f5-54cc-4630-8803-4df73057b48e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:13.801011 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3213/6453] 10.222.0.23 () {60 vars in 1585 bytes} [Sun Oct 2 01:30:13 2022] PUT /identity/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/groups/032c646bb10b48209a3aa9bfbcff0253/roles/500e638f87a446f98a60c17e45718c5c/inherited_to_projects => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:13.805371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f8a4-bbed-443c-bc5c-e268746fe5e5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:13.812890 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:13.892987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696c575-2ad7-4456-a23b-2b17317f2f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:13.893860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696c575-2ad7-4456-a23b-2b17317f2f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:13.894240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696c575-2ad7-4456-a23b-2b17317f2f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:13.895545 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:13.896389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696c575-2ad7-4456-a23b-2b17317f2f69 admin admin] PATH_INFO: `/v3/projects/80f3fede041e49f6ad4cb9aa9715897e/users/e3ff4d3857e04b5eb1bdb1970ebf2fff/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:13.899785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696c575-2ad7-4456-a23b-2b17317f2f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f3fede041e49f6ad4cb9aa9715897e, user_id=e3ff4d3857e04b5eb1bdb1970ebf2fff, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:13.914503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696c575-2ad7-4456-a23b-2b17317f2f69 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:13.940615 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3241/6454] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:13 2022] PUT /identity/v3/projects/80f3fede041e49f6ad4cb9aa9715897e/users/e3ff4d3857e04b5eb1bdb1970ebf2fff/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:13.951310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e54c0f-cea1-440e-baa9-f67afaa5afc1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:13.952704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e54c0f-cea1-440e-baa9-f67afaa5afc1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:13.953509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e54c0f-cea1-440e-baa9-f67afaa5afc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:13.992921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f8a4-bbed-443c-bc5c-e268746fe5e5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:14.013596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d8e54c0f-cea1-440e-baa9-f67afaa5afc1 None None] MFA Rules not processed for user `e3ff4d3857e04b5eb1bdb1970ebf2fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:14.019102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d8e54c0f-cea1-440e-baa9-f67afaa5afc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:14.165447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299b732-4643-407c-b57b-c6c4e3484db7 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:14.166176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299b732-4643-407c-b57b-c6c4e3484db7 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:14.166725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299b732-4643-407c-b57b-c6c4e3484db7 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:14.167073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299b732-4643-407c-b57b-c6c4e3484db7 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/groups/032c646bb10b48209a3aa9bfbcff0253/roles/500e638f87a446f98a60c17e45718c5c/inherited_to_projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:14.172777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299b732-4643-407c-b57b-c6c4e3484db7 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f049948dfe6249d1a40faf1a9fb9a728, group_id=032c646bb10b48209a3aa9bfbcff0253, role_id=500e638f87a446f98a60c17e45718c5c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:14.174018 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-7299b732-4643-407c-b57b-c6c4e3484db7 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:14.174018 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:30:14.174018 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:30:14.180698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299b732-4643-407c-b57b-c6c4e3484db7 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:14.206394 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3214/6455] 10.222.0.23 () {58 vars in 1567 bytes} [Sun Oct 2 01:30:13 2022] HEAD /identity/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/groups/032c646bb10b48209a3aa9bfbcff0253/roles/500e638f87a446f98a60c17e45718c5c/inherited_to_projects => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:14.207514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299b732-4643-407c-b57b-c6c4e3484db7 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:14.216405 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3242/6456] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:14.222214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e54c0f-cea1-440e-baa9-f67afaa5afc1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:14.239971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299b732-4643-407c-b57b-c6c4e3484db7 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:14.242062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e54c0f-cea1-440e-baa9-f67afaa5afc1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:14.255815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:14.255815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:14.255815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:14.256241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/groups/032c646bb10b48209a3aa9bfbcff0253/roles/500e638f87a446f98a60c17e45718c5c/inherited_to_projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:14.257824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9eeeb4-34f1-43df-b7a1-e004cabd8d17 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ff4d3857e04b5eb1bdb1970ebf2fff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80f3fede041e49f6ad4cb9aa9715897e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:14.258658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eeeb4-34f1-43df-b7a1-e004cabd8d17 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:14.259099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eeeb4-34f1-43df-b7a1-e004cabd8d17 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:14.259523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eeeb4-34f1-43df-b7a1-e004cabd8d17 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] PATH_INFO: `/v3/policies` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:14.259976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f049948dfe6249d1a40faf1a9fb9a728, group_id=032c646bb10b48209a3aa9bfbcff0253, role_id=500e638f87a446f98a60c17e45718c5c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:14.261593 n-d-master-1 devstack@keystone.service[81853]: WARNING oslo_log.versionutils [None req-9b9eeeb4-34f1-43df-b7a1-e004cabd8d17 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 02 01:30:14.262419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9eeeb4-34f1-43df-b7a1-e004cabd8d17 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:14.263992 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-9b9eeeb4-34f1-43df-b7a1-e004cabd8d17 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:14.263992 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:30:14.263992 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:30:14.271916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:14.273424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9eeeb4-34f1-43df-b7a1-e004cabd8d17 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:14.282836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role 500e638f87a446f98a60c17e45718c5c was removed from group 032c646bb10b48209a3aa9bfbcff0253 on project f049948dfe6249d1a40faf1a9fb9a728. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:14.283290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:14.285000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:14.312018 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3243/6457] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:30:14 2022] POST /identity/v3/policies => generated 228 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:14.313427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9eeeb4-34f1-43df-b7a1-e004cabd8d17 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:14.325611 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3215/6458] 10.222.0.23 () {58 vars in 1569 bytes} [Sun Oct 2 01:30:14 2022] DELETE /identity/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/groups/032c646bb10b48209a3aa9bfbcff0253/roles/500e638f87a446f98a60c17e45718c5c/inherited_to_projects => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:14.326658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9b9eeeb4-34f1-43df-b7a1-e004cabd8d17 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:14.326805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:14.330010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:14.346446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9eeeb4-34f1-43df-b7a1-e004cabd8d17 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:14.471812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebab6f1-3e65-44b1-9652-1c556693d193 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:14.477889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:14.479727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:14.480112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:14.481169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles/500e638f87a446f98a60c17e45718c5c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:14.483739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe52f4-f819-4992-a549-6996316b7567 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ff4d3857e04b5eb1bdb1970ebf2fff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80f3fede041e49f6ad4cb9aa9715897e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:14.483906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=500e638f87a446f98a60c17e45718c5c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:14.484399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe52f4-f819-4992-a549-6996316b7567 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:14.484687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe52f4-f819-4992-a549-6996316b7567 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:14.484969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe52f4-f819-4992-a549-6996316b7567 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] PATH_INFO: `/v3/policies/aa93210dac394d23b3acc31405ffb070` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:14.485878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:14.486003 n-d-master-1 devstack@keystone.service[81853]: WARNING oslo_log.versionutils [None req-7ebe52f4-f819-4992-a549-6996316b7567 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 02 01:30:14.486389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe52f4-f819-4992-a549-6996316b7567 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=aa93210dac394d23b3acc31405ffb070)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:14.487659 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-7ebe52f4-f819-4992-a549-6996316b7567 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:14.487659 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:30:14.487659 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:30:14.488563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe52f4-f819-4992-a549-6996316b7567 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:14.534708 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3244/6459] 10.222.0.23 () {60 vars in 1252 bytes} [Sun Oct 2 01:30:14 2022] PATCH /identity/v3/policies/aa93210dac394d23b3acc31405ffb070 => generated 235 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:14.536065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe52f4-f819-4992-a549-6996316b7567 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:14.565658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe52f4-f819-4992-a549-6996316b7567 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:14.566834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role 500e638f87a446f98a60c17e45718c5c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:14.567144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:14.568169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:14.571289 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3216/6460] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:14 2022] DELETE /identity/v3/roles/500e638f87a446f98a60c17e45718c5c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:14.582053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:14.584972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13051089-de59-4b04-98a4-c43bc4b49a9e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ff4d3857e04b5eb1bdb1970ebf2fff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80f3fede041e49f6ad4cb9aa9715897e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:14.585640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13051089-de59-4b04-98a4-c43bc4b49a9e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:14.585925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13051089-de59-4b04-98a4-c43bc4b49a9e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:14.586201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13051089-de59-4b04-98a4-c43bc4b49a9e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] PATH_INFO: `/v3/policies/aa93210dac394d23b3acc31405ffb070` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:14.587040 n-d-master-1 devstack@keystone.service[81853]: WARNING oslo_log.versionutils [None req-13051089-de59-4b04-98a4-c43bc4b49a9e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 02 01:30:14.587608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13051089-de59-4b04-98a4-c43bc4b49a9e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=aa93210dac394d23b3acc31405ffb070)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:14.588887 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-13051089-de59-4b04-98a4-c43bc4b49a9e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:14.588887 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:30:14.588887 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:30:14.589810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13051089-de59-4b04-98a4-c43bc4b49a9e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:14.590982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:14.603304 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:14.624264 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3245/6461] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:14 2022] GET /identity/v3/policies/aa93210dac394d23b3acc31405ffb070 => generated 235 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:14.625555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13051089-de59-4b04-98a4-c43bc4b49a9e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:14.628634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-13051089-de59-4b04-98a4-c43bc4b49a9e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:14.648993 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:14.653860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13051089-de59-4b04-98a4-c43bc4b49a9e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:14.719098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf560212-ef4a-46cf-b7b1-126cf29a5c58 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:14.736122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38567bdc-e645-4890-9d15-466bae10e0d9 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:14.736709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38567bdc-e645-4890-9d15-466bae10e0d9 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:14.737011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38567bdc-e645-4890-9d15-466bae10e0d9 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:14.737287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38567bdc-e645-4890-9d15-466bae10e0d9 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:14.738576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38567bdc-e645-4890-9d15-466bae10e0d9 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:14.740387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38567bdc-e645-4890-9d15-466bae10e0d9 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:14.776983 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3217/6462] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:30:14 2022] POST /identity/v3/roles => generated 239 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:14.777199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b15ecf-0380-4eca-872a-f762e9f32a85 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ff4d3857e04b5eb1bdb1970ebf2fff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80f3fede041e49f6ad4cb9aa9715897e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:14.777345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38567bdc-e645-4890-9d15-466bae10e0d9 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:14.777441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b15ecf-0380-4eca-872a-f762e9f32a85 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:14.777441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b15ecf-0380-4eca-872a-f762e9f32a85 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:14.777441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b15ecf-0380-4eca-872a-f762e9f32a85 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] PATH_INFO: `/v3/policies/aa93210dac394d23b3acc31405ffb070` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:14.777441 n-d-master-1 devstack@keystone.service[81853]: WARNING oslo_log.versionutils [None req-54b15ecf-0380-4eca-872a-f762e9f32a85 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 02 01:30:14.777793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b15ecf-0380-4eca-872a-f762e9f32a85 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=aa93210dac394d23b3acc31405ffb070)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:14.779163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-38567bdc-e645-4890-9d15-466bae10e0d9 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:14.779491 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-54b15ecf-0380-4eca-872a-f762e9f32a85 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:14.779491 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:30:14.779491 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:30:14.780449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b15ecf-0380-4eca-872a-f762e9f32a85 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:14.805904 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3246/6463] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:14 2022] DELETE /identity/v3/policies/aa93210dac394d23b3acc31405ffb070 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:30:14.807437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b15ecf-0380-4eca-872a-f762e9f32a85 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:14.837938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b15ecf-0380-4eca-872a-f762e9f32a85 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:14.856426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be5184-d22a-4db4-8d65-eabbde463e7f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:14.857151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be5184-d22a-4db4-8d65-eabbde463e7f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:14.857434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be5184-d22a-4db4-8d65-eabbde463e7f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:14.857712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be5184-d22a-4db4-8d65-eabbde463e7f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/users/8edd7932977b4a17bc7123d8b302df03/roles/ba9835944e784f85abf043c52676baa4/inherited_to_projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:14.893992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be5184-d22a-4db4-8d65-eabbde463e7f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f049948dfe6249d1a40faf1a9fb9a728, user_id=8edd7932977b4a17bc7123d8b302df03, role_id=ba9835944e784f85abf043c52676baa4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:14.897417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be5184-d22a-4db4-8d65-eabbde463e7f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:14.906134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38567bdc-e645-4890-9d15-466bae10e0d9 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:14.918213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:14.920611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:14.921202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:14.924461 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3247/6464] 10.222.0.23 () {60 vars in 1582 bytes} [Sun Oct 2 01:30:14 2022] PUT /identity/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/users/8edd7932977b4a17bc7123d8b302df03/roles/ba9835944e784f85abf043c52676baa4/inherited_to_projects => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:14.924936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be5184-d22a-4db4-8d65-eabbde463e7f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:14.925783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] PATH_INFO: `/v3/projects/039bfbfd17c043b081635e722431c113` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:14.929465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039bfbfd17c043b081635e722431c113)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:14.931875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:15.091137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039bfbfd17c043b081635e722431c113', 'request_id': 'req-c953b3d6-b9ba-4218-8614-f1ae63087c11'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:15.102051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be5184-d22a-4db4-8d65-eabbde463e7f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:15.115659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039bfbfd17c043b081635e722431c113', 'request_id': 'req-c953b3d6-b9ba-4218-8614-f1ae63087c11'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:15.130086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039bfbfd17c043b081635e722431c113', 'request_id': 'req-c953b3d6-b9ba-4218-8614-f1ae63087c11'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:15.149854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] The token cache is being invalidate because project 039bfbfd17c043b081635e722431c113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:15.150418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:15.151595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:15.156986 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3218/6465] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:14 2022] DELETE /identity/v3/projects/039bfbfd17c043b081635e722431c113 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:15.158405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:15.160112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:15.238356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6fad-aeb4-4403-bccd-24657be08e75 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ff4d3857e04b5eb1bdb1970ebf2fff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80f3fede041e49f6ad4cb9aa9715897e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:15.241215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6fad-aeb4-4403-bccd-24657be08e75 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:15.241512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6fad-aeb4-4403-bccd-24657be08e75 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:15.241792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6fad-aeb4-4403-bccd-24657be08e75 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] PATH_INFO: `/v3/policies` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:15.244949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca6fad-aeb4-4403-bccd-24657be08e75 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:15.255764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca6fad-aeb4-4403-bccd-24657be08e75 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:15.306536 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3248/6466] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:30:14 2022] POST /identity/v3/policies => generated 230 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:15.314960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67210d52-5e74-4d5c-a2ab-706922d536c0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:15.316335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67210d52-5e74-4d5c-a2ab-706922d536c0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:15.316622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67210d52-5e74-4d5c-a2ab-706922d536c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:15.322781 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:15.374542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b3d6-b9ba-4218-8614-f1ae63087c11 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:15.393141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad13f-aa2c-477a-ab21-b1171b189b92 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:15.397913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad13f-aa2c-477a-ab21-b1171b189b92 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:15.398315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad13f-aa2c-477a-ab21-b1171b189b92 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:15.399354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad13f-aa2c-477a-ab21-b1171b189b92 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/users/8edd7932977b4a17bc7123d8b302df03/roles/ba9835944e784f85abf043c52676baa4/inherited_to_projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:15.401702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-67210d52-5e74-4d5c-a2ab-706922d536c0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:15.403486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-67210d52-5e74-4d5c-a2ab-706922d536c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:15.410765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ad13f-aa2c-477a-ab21-b1171b189b92 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f049948dfe6249d1a40faf1a9fb9a728, user_id=8edd7932977b4a17bc7123d8b302df03, role_id=ba9835944e784f85abf043c52676baa4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:15.420606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ad13f-aa2c-477a-ab21-b1171b189b92 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:15.423844 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:15.455376 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3219/6467] 10.222.0.23 () {58 vars in 1564 bytes} [Sun Oct 2 01:30:15 2022] HEAD /identity/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/users/8edd7932977b4a17bc7123d8b302df03/roles/ba9835944e784f85abf043c52676baa4/inherited_to_projects => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:15.457589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad13f-aa2c-477a-ab21-b1171b189b92 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:15.463282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-596ad13f-aa2c-477a-ab21-b1171b189b92 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:15.519328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad13f-aa2c-477a-ab21-b1171b189b92 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:15.536852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f21bf-19ca-4127-9529-aaa56cbe7b72 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ff4d3857e04b5eb1bdb1970ebf2fff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80f3fede041e49f6ad4cb9aa9715897e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:15.537481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f21bf-19ca-4127-9529-aaa56cbe7b72 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:15.537779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f21bf-19ca-4127-9529-aaa56cbe7b72 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:15.538058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f21bf-19ca-4127-9529-aaa56cbe7b72 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] PATH_INFO: `/v3/policies` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:15.542103 n-d-master-1 devstack@keystone.service[81854]: WARNING oslo_log.versionutils [None req-090f21bf-19ca-4127-9529-aaa56cbe7b72 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 02 01:30:15.542717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f21bf-19ca-4127-9529-aaa56cbe7b72 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:15.547480 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-090f21bf-19ca-4127-9529-aaa56cbe7b72 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:15.547480 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:30:15.547480 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:30:15.552315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f21bf-19ca-4127-9529-aaa56cbe7b72 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:15.603164 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3220/6468] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:30:15 2022] POST /identity/v3/policies => generated 229 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:15.608420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f21bf-19ca-4127-9529-aaa56cbe7b72 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:15.636508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f21bf-19ca-4127-9529-aaa56cbe7b72 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:15.654258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f855ff8-db9c-4532-bdf1-8b987ea2903a tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:15.655295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f855ff8-db9c-4532-bdf1-8b987ea2903a tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:15.655576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f855ff8-db9c-4532-bdf1-8b987ea2903a tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:15.655863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f855ff8-db9c-4532-bdf1-8b987ea2903a tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/users/8edd7932977b4a17bc7123d8b302df03/roles/ba9835944e784f85abf043c52676baa4/inherited_to_projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:15.661317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f855ff8-db9c-4532-bdf1-8b987ea2903a tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f049948dfe6249d1a40faf1a9fb9a728, user_id=8edd7932977b4a17bc7123d8b302df03, role_id=ba9835944e784f85abf043c52676baa4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:15.668609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f855ff8-db9c-4532-bdf1-8b987ea2903a tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:15.686931 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3249/6469] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:15.704370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67210d52-5e74-4d5c-a2ab-706922d536c0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:15.713734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8f855ff8-db9c-4532-bdf1-8b987ea2903a tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role ba9835944e784f85abf043c52676baa4 was removed from user 8edd7932977b4a17bc7123d8b302df03 on project f049948dfe6249d1a40faf1a9fb9a728. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:15.717987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8f855ff8-db9c-4532-bdf1-8b987ea2903a tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:15.720833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8f855ff8-db9c-4532-bdf1-8b987ea2903a tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:15.740952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67210d52-5e74-4d5c-a2ab-706922d536c0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:15.762180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80133c44-b081-4253-992c-72f07cfc26a6 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ff4d3857e04b5eb1bdb1970ebf2fff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80f3fede041e49f6ad4cb9aa9715897e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:15.762915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80133c44-b081-4253-992c-72f07cfc26a6 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:15.763206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80133c44-b081-4253-992c-72f07cfc26a6 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:15.765159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80133c44-b081-4253-992c-72f07cfc26a6 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] PATH_INFO: `/v3/policies` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:15.769088 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3221/6470] 10.222.0.23 () {58 vars in 1566 bytes} [Sun Oct 2 01:30:15 2022] DELETE /identity/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/users/8edd7932977b4a17bc7123d8b302df03/roles/ba9835944e784f85abf043c52676baa4/inherited_to_projects => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:15.770716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2e28-8079-4a00-b279-c07088a56b8c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:15.772222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80133c44-b081-4253-992c-72f07cfc26a6 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:15.779553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2e28-8079-4a00-b279-c07088a56b8c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:15.781329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80133c44-b081-4253-992c-72f07cfc26a6 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:15.781694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2e28-8079-4a00-b279-c07088a56b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:15.843435 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3250/6471] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:30:15 2022] POST /identity/v3/policies => generated 229 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:15.850831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591904d1-3122-4294-99c4-0f1ba79089e4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:15.850831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591904d1-3122-4294-99c4-0f1ba79089e4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:15.850831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591904d1-3122-4294-99c4-0f1ba79089e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:15.889791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-902c2e28-8079-4a00-b279-c07088a56b8c None None] MFA Rules not processed for user `f993b548a0ca4e7bbb6780153db61ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:15.895639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-902c2e28-8079-4a00-b279-c07088a56b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:15.910000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-591904d1-3122-4294-99c4-0f1ba79089e4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:15.912504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-591904d1-3122-4294-99c4-0f1ba79089e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:16.084104 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3222/6472] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:16.088305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c2e28-8079-4a00-b279-c07088a56b8c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:16.091578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-902c2e28-8079-4a00-b279-c07088a56b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:16.172008 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3251/6473] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:16.174266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591904d1-3122-4294-99c4-0f1ba79089e4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:16.174945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-591904d1-3122-4294-99c4-0f1ba79089e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:16.277836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c2e28-8079-4a00-b279-c07088a56b8c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:16.295549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:16.296584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:16.298406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:16.298934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles/ba9835944e784f85abf043c52676baa4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:16.306041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ba9835944e784f85abf043c52676baa4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:16.311830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:16.357784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591904d1-3122-4294-99c4-0f1ba79089e4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:16.370411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd355ce0-c9b0-4fc7-83a1-f90264916116 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ff4d3857e04b5eb1bdb1970ebf2fff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80f3fede041e49f6ad4cb9aa9715897e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:16.372883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd355ce0-c9b0-4fc7-83a1-f90264916116 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:16.374907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd355ce0-c9b0-4fc7-83a1-f90264916116 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:16.375313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd355ce0-c9b0-4fc7-83a1-f90264916116 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] PATH_INFO: `/v3/policies` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:16.379186 n-d-master-1 devstack@keystone.service[81853]: WARNING oslo_log.versionutils [None req-fd355ce0-c9b0-4fc7-83a1-f90264916116 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 02 01:30:16.382167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd355ce0-c9b0-4fc7-83a1-f90264916116 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:16.383956 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-fd355ce0-c9b0-4fc7-83a1-f90264916116 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:16.383956 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:30:16.383956 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:30:16.385852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd355ce0-c9b0-4fc7-83a1-f90264916116 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:16.399167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role ba9835944e784f85abf043c52676baa4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:16.400030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:16.401724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:16.409764 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3223/6474] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:16 2022] DELETE /identity/v3/roles/ba9835944e784f85abf043c52676baa4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:16.411335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:16.419203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:16.423867 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3252/6475] 10.222.0.23 () {58 vars in 1131 bytes} [Sun Oct 2 01:30:16 2022] GET /identity/v3/policies => generated 764 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:16.426584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd355ce0-c9b0-4fc7-83a1-f90264916116 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:16.432123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fd355ce0-c9b0-4fc7-83a1-f90264916116 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:16.470114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd355ce0-c9b0-4fc7-83a1-f90264916116 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:16.471513 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:16.538298 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:16.589237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb16d2-e96e-4940-b00d-15b2014f30b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:16.590163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb16d2-e96e-4940-b00d-15b2014f30b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:16.590510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb16d2-e96e-4940-b00d-15b2014f30b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:16.591024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb16d2-e96e-4940-b00d-15b2014f30b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:16.591761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb16d2-e96e-4940-b00d-15b2014f30b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:16.592140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb16d2-e96e-4940-b00d-15b2014f30b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:16.593237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99646792-f887-4dba-bd42-c5d1afee1545 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:16.594084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb16d2-e96e-4940-b00d-15b2014f30b3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:16.611330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb458ab4-bb8e-4746-ace8-e8924c96ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:16.612291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb458ab4-bb8e-4746-ace8-e8924c96ba99 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:16.614321 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3253/6476] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:16.614743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb458ab4-bb8e-4746-ace8-e8924c96ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:16.615187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb458ab4-bb8e-4746-ace8-e8924c96ba99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:16.615558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb16d2-e96e-4940-b00d-15b2014f30b3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:16.617326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb458ab4-bb8e-4746-ace8-e8924c96ba99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:16.617767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3bfb16d2-e96e-4940-b00d-15b2014f30b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:16.623859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb458ab4-bb8e-4746-ace8-e8924c96ba99 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:16.714075 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3224/6477] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:16 2022] POST /identity/v3/projects => generated 403 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:16.715353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb458ab4-bb8e-4746-ace8-e8924c96ba99 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:16.720097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fb458ab4-bb8e-4746-ace8-e8924c96ba99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:16.730566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb16d2-e96e-4940-b00d-15b2014f30b3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:16.866305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7d1f-ce58-49a4-a90c-e72dd6f31409 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:16.868063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7d1f-ce58-49a4-a90c-e72dd6f31409 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:16.869867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7d1f-ce58-49a4-a90c-e72dd6f31409 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:16.870409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7d1f-ce58-49a4-a90c-e72dd6f31409 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:16.871346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7d1f-ce58-49a4-a90c-e72dd6f31409 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:16.876651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7d1f-ce58-49a4-a90c-e72dd6f31409 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:16.912095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb458ab4-bb8e-4746-ace8-e8924c96ba99 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:16.922629 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3254/6478] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:30:16 2022] POST /identity/v3/roles => generated 240 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:16.924828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7d1f-ce58-49a4-a90c-e72dd6f31409 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:16.929189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9d5f0-ac42-49be-98ac-e5090c97602e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ff4d3857e04b5eb1bdb1970ebf2fff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80f3fede041e49f6ad4cb9aa9715897e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:16.929907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d5f0-ac42-49be-98ac-e5090c97602e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:16.930198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d5f0-ac42-49be-98ac-e5090c97602e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:16.930474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d5f0-ac42-49be-98ac-e5090c97602e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] PATH_INFO: `/v3/policies/8c2a8530c6ed4521a077e6adeb1c6453` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:16.931323 n-d-master-1 devstack@keystone.service[81854]: WARNING oslo_log.versionutils [None req-13a9d5f0-ac42-49be-98ac-e5090c97602e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 02 01:30:16.931945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9d5f0-ac42-49be-98ac-e5090c97602e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8c2a8530c6ed4521a077e6adeb1c6453)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:16.933735 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-13a9d5f0-ac42-49be-98ac-e5090c97602e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:16.933735 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:30:16.933735 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:30:16.934934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9d5f0-ac42-49be-98ac-e5090c97602e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.002833 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3225/6479] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:16 2022] DELETE /identity/v3/policies/8c2a8530c6ed4521a077e6adeb1c6453 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:17.022091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9d5f0-ac42-49be-98ac-e5090c97602e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:17.068151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7d1f-ce58-49a4-a90c-e72dd6f31409 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:17.075094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd043e-6c5e-4a11-9bfa-f3055b97ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:17.078967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd043e-6c5e-4a11-9bfa-f3055b97ac08 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:17.079430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd043e-6c5e-4a11-9bfa-f3055b97ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:17.079842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd043e-6c5e-4a11-9bfa-f3055b97ac08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:17.080580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd043e-6c5e-4a11-9bfa-f3055b97ac08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:17.082877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd043e-6c5e-4a11-9bfa-f3055b97ac08 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.117470 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:17.149772 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3255/6480] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:16 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:17.151109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd043e-6c5e-4a11-9bfa-f3055b97ac08 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:17.286347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9d5f0-ac42-49be-98ac-e5090c97602e tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:17.342176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd043e-6c5e-4a11-9bfa-f3055b97ac08 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:17.347265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875aa7d0-b3af-49a0-a427-2b4d2a0068c8 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:17.347949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875aa7d0-b3af-49a0-a427-2b4d2a0068c8 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:17.348231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875aa7d0-b3af-49a0-a427-2b4d2a0068c8 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:17.349184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875aa7d0-b3af-49a0-a427-2b4d2a0068c8 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/groups/032c646bb10b48209a3aa9bfbcff0253/roles/964b547dc739426ab8cbd8bd036ace57/inherited_to_projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:17.351585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875aa7d0-b3af-49a0-a427-2b4d2a0068c8 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f1491a4869cb4d48b0cae87b16527797, group_id=032c646bb10b48209a3aa9bfbcff0253, role_id=964b547dc739426ab8cbd8bd036ace57)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:17.357360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875aa7d0-b3af-49a0-a427-2b4d2a0068c8 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.381230 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3256/6481] 10.222.0.23 () {60 vars in 1582 bytes} [Sun Oct 2 01:30:17 2022] PUT /identity/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/groups/032c646bb10b48209a3aa9bfbcff0253/roles/964b547dc739426ab8cbd8bd036ace57/inherited_to_projects => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:17.388163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875aa7d0-b3af-49a0-a427-2b4d2a0068c8 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:17.396513 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:17.428258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4310b-ef16-43b5-97a8-ac01845725e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:17.428953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4310b-ef16-43b5-97a8-ac01845725e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:17.429333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4310b-ef16-43b5-97a8-ac01845725e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:17.429719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4310b-ef16-43b5-97a8-ac01845725e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:17.430579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4310b-ef16-43b5-97a8-ac01845725e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:17.434371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4310b-ef16-43b5-97a8-ac01845725e2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.481683 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3226/6482] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:17 2022] POST /identity/v3/users => generated 308 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:17.486063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4310b-ef16-43b5-97a8-ac01845725e2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:17.508926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4310b-ef16-43b5-97a8-ac01845725e2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:17.549884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875aa7d0-b3af-49a0-a427-2b4d2a0068c8 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:17.565905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582b84e-187d-4dda-b939-06409aabc613 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ff4d3857e04b5eb1bdb1970ebf2fff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80f3fede041e49f6ad4cb9aa9715897e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:17.566907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582b84e-187d-4dda-b939-06409aabc613 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:17.567398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582b84e-187d-4dda-b939-06409aabc613 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:17.567893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582b84e-187d-4dda-b939-06409aabc613 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] PATH_INFO: `/v3/policies/fe5038484191414d80548e5bf8f824f9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:17.571523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582b84e-187d-4dda-b939-06409aabc613 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=fe5038484191414d80548e5bf8f824f9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:17.574336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582b84e-187d-4dda-b939-06409aabc613 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.632664 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3257/6483] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:17 2022] DELETE /identity/v3/policies/fe5038484191414d80548e5bf8f824f9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:17.632664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582b84e-187d-4dda-b939-06409aabc613 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:17.660045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6578142-755e-4056-8b77-11fd929b858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:17.660671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578142-755e-4056-8b77-11fd929b858f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:17.660926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578142-755e-4056-8b77-11fd929b858f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:17.661226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578142-755e-4056-8b77-11fd929b858f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:17.661882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6578142-755e-4056-8b77-11fd929b858f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:17.679103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6578142-755e-4056-8b77-11fd929b858f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.716147 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3227/6484] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:17 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:17.716147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6578142-755e-4056-8b77-11fd929b858f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:17.731825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6578142-755e-4056-8b77-11fd929b858f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:17.738720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bc7f2-1baa-4bc9-a411-3a2a07a4b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:17.739349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc7f2-1baa-4bc9-a411-3a2a07a4b8ac admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:17.739681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc7f2-1baa-4bc9-a411-3a2a07a4b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:17.740403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc7f2-1baa-4bc9-a411-3a2a07a4b8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:17.741029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bc7f2-1baa-4bc9-a411-3a2a07a4b8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:17.742888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bc7f2-1baa-4bc9-a411-3a2a07a4b8ac admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.759475 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3228/6485] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:17 2022] GET /identity/v3/roles => generated 1651 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:17.761237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bc7f2-1baa-4bc9-a411-3a2a07a4b8ac admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:17.776194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bc7f2-1baa-4bc9-a411-3a2a07a4b8ac admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:17.784525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e40c9-9897-4acd-bc13-aa6b3bb1af2d tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ff4d3857e04b5eb1bdb1970ebf2fff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80f3fede041e49f6ad4cb9aa9715897e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:17.785140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e40c9-9897-4acd-bc13-aa6b3bb1af2d tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:17.785918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e40c9-9897-4acd-bc13-aa6b3bb1af2d tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:17.786046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582b84e-187d-4dda-b939-06409aabc613 tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:17.786148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e40c9-9897-4acd-bc13-aa6b3bb1af2d tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] PATH_INFO: `/v3/policies/3eda247af8564c529092e4e33d66b7ab` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:17.786836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e40c9-9897-4acd-bc13-aa6b3bb1af2d tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=3eda247af8564c529092e4e33d66b7ab)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:17.788791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e40c9-9897-4acd-bc13-aa6b3bb1af2d tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.800132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc2cc4-4f0d-4dcc-ae89-f7c41e119446 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:17.800802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2cc4-4f0d-4dcc-ae89-f7c41e119446 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:17.801882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2cc4-4f0d-4dcc-ae89-f7c41e119446 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:17.802755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2cc4-4f0d-4dcc-ae89-f7c41e119446 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/groups/032c646bb10b48209a3aa9bfbcff0253/roles/inherited_to_projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:17.807027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc2cc4-4f0d-4dcc-ae89-f7c41e119446 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=f1491a4869cb4d48b0cae87b16527797, group_id=032c646bb10b48209a3aa9bfbcff0253)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:17.809977 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3229/6486] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:17 2022] DELETE /identity/v3/policies/3eda247af8564c529092e4e33d66b7ab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:17.810217 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-7ecc2cc4-4f0d-4dcc-ae89-f7c41e119446 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:17.810217 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:30:17.810217 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:30:17.811308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e40c9-9897-4acd-bc13-aa6b3bb1af2d tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:17.816670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc2cc4-4f0d-4dcc-ae89-f7c41e119446 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.828303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e40c9-9897-4acd-bc13-aa6b3bb1af2d tempest-PoliciesTestJSON-1097632042 tempest-PoliciesTestJSON-1097632042-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:17.835244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d03707-99e6-4509-ab52-731bb959c4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:17.836098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03707-99e6-4509-ab52-731bb959c4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:17.836433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03707-99e6-4509-ab52-731bb959c4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:17.836844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03707-99e6-4509-ab52-731bb959c4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:17.837572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d03707-99e6-4509-ab52-731bb959c4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:17.839910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d03707-99e6-4509-ab52-731bb959c4d3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.858083 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3258/6487] 10.222.0.23 () {58 vars in 1464 bytes} [Sun Oct 2 01:30:17 2022] GET /identity/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/groups/032c646bb10b48209a3aa9bfbcff0253/roles/inherited_to_projects => generated 448 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:17.859330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc2cc4-4f0d-4dcc-ae89-f7c41e119446 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:17.865592 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3230/6488] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:17 2022] GET /identity/v3/roles => generated 1651 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:17.865592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d03707-99e6-4509-ab52-731bb959c4d3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:17.866366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c9d03707-99e6-4509-ab52-731bb959c4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:17.884764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d03707-99e6-4509-ab52-731bb959c4d3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:17.887086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc2cc4-4f0d-4dcc-ae89-f7c41e119446 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:17.891205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:17.892650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:17.892900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:17.893187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] PATH_INFO: `/v3/users/c95021bacb5940f1bf850f2fb43f3436` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:17.894699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c95021bacb5940f1bf850f2fb43f3436)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:17.895049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3bec2-4ee9-4c69-ab6b-7d79fbd8dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:17.895788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bec2-4ee9-4c69-ab6b-7d79fbd8dcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:17.896151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bec2-4ee9-4c69-ab6b-7d79fbd8dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:17.896494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bec2-4ee9-4c69-ab6b-7d79fbd8dcf2 admin admin] PATH_INFO: `/v3/projects/1638d90f444c4e7b8f6255e8d2040666/users/90a2d6edcaeb4d86825d1b79299f2530/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:17.898876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.911568 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:17.917176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3bec2-4ee9-4c69-ab6b-7d79fbd8dcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1638d90f444c4e7b8f6255e8d2040666, user_id=90a2d6edcaeb4d86825d1b79299f2530, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:17.921840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3bec2-4ee9-4c69-ab6b-7d79fbd8dcf2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:17.950750 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3259/6489] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:17 2022] PUT /identity/v3/projects/1638d90f444c4e7b8f6255e8d2040666/users/90a2d6edcaeb4d86825d1b79299f2530/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:17.954422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3bec2-4ee9-4c69-ab6b-7d79fbd8dcf2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:18.042015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c95021bacb5940f1bf850f2fb43f3436'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:18.060847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3bec2-4ee9-4c69-ab6b-7d79fbd8dcf2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:18.066326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5aa25b-abe1-400b-acd3-7086067625ca tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:18.067046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5aa25b-abe1-400b-acd3-7086067625ca tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:18.067328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5aa25b-abe1-400b-acd3-7086067625ca tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:18.067606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5aa25b-abe1-400b-acd3-7086067625ca tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/groups/032c646bb10b48209a3aa9bfbcff0253/roles/964b547dc739426ab8cbd8bd036ace57/inherited_to_projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:18.069980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5aa25b-abe1-400b-acd3-7086067625ca tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=f1491a4869cb4d48b0cae87b16527797, group_id=032c646bb10b48209a3aa9bfbcff0253, role_id=964b547dc739426ab8cbd8bd036ace57)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:18.073547 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-2f5aa25b-abe1-400b-acd3-7086067625ca tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:18.073547 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:30:18.073547 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:30:18.075357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c95021bacb5940f1bf850f2fb43f3436'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:18.076111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5aa25b-abe1-400b-acd3-7086067625ca tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:18.076307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c95021bacb5940f1bf850f2fb43f3436'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:18.085481 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3260/6490] 10.222.0.23 () {58 vars in 1564 bytes} [Sun Oct 2 01:30:17 2022] HEAD /identity/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/groups/032c646bb10b48209a3aa9bfbcff0253/roles/964b547dc739426ab8cbd8bd036ace57/inherited_to_projects => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:18.087270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5aa25b-abe1-400b-acd3-7086067625ca tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:18.090219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2f5aa25b-abe1-400b-acd3-7086067625ca tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:18.098377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c95021bacb5940f1bf850f2fb43f3436'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:18.114153 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=82,keystone:INSERT=7,keystone:DELETE=11 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:18.117712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c95021bacb5940f1bf850f2fb43f3436'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:18.134512 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3231/6491] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:17 2022] DELETE /identity/v3/users/c95021bacb5940f1bf850f2fb43f3436 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:18.134512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:18.141514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:18.203309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5aa25b-abe1-400b-acd3-7086067625ca tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:18.306779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96c95d-fac8-4129-9a14-1911f327401f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:18.325202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8090f-78f9-4da1-a058-62c9b09e6522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:18.325795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8090f-78f9-4da1-a058-62c9b09e6522 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:18.326081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8090f-78f9-4da1-a058-62c9b09e6522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:18.326713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8090f-78f9-4da1-a058-62c9b09e6522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:18.328466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8090f-78f9-4da1-a058-62c9b09e6522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:18.341246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8090f-78f9-4da1-a058-62c9b09e6522 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:18.356820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948528b2-6a15-4d71-beaf-9cf63fe54cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:18.357089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948528b2-6a15-4d71-beaf-9cf63fe54cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:18.357514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948528b2-6a15-4d71-beaf-9cf63fe54cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:18.357628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948528b2-6a15-4d71-beaf-9cf63fe54cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:18.362222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948528b2-6a15-4d71-beaf-9cf63fe54cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:18.369105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948528b2-6a15-4d71-beaf-9cf63fe54cd0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:18.373696 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3232/6492] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:18 2022] GET /identity/v3/roles => generated 1651 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:18.374835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8090f-78f9-4da1-a058-62c9b09e6522 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:18.380363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b7e8090f-78f9-4da1-a058-62c9b09e6522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:18.390275 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3261/6493] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:18 2022] GET /identity/v3/roles => generated 1651 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:18.394471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf4d64-5c08-4dbf-bba5-6bd8be64f2e0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:18.394770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf4d64-5c08-4dbf-bba5-6bd8be64f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:18.395044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf4d64-5c08-4dbf-bba5-6bd8be64f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:18.442877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0fbf4d64-5c08-4dbf-bba5-6bd8be64f2e0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:18.444320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0fbf4d64-5c08-4dbf-bba5-6bd8be64f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:18.465020 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3262/6494] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:18.465849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf4d64-5c08-4dbf-bba5-6bd8be64f2e0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:18.490407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf4d64-5c08-4dbf-bba5-6bd8be64f2e0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:18.516660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8f3d1-85a1-46e8-8472-b0838111d3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:18.517379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8f3d1-85a1-46e8-8472-b0838111d3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:18.517660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8f3d1-85a1-46e8-8472-b0838111d3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:18.517937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8f3d1-85a1-46e8-8472-b0838111d3f2 admin admin] PATH_INFO: `/v3/projects/1638d90f444c4e7b8f6255e8d2040666/users/90a2d6edcaeb4d86825d1b79299f2530/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:18.523791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8f3d1-85a1-46e8-8472-b0838111d3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1638d90f444c4e7b8f6255e8d2040666, user_id=90a2d6edcaeb4d86825d1b79299f2530, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:18.531273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8f3d1-85a1-46e8-8472-b0838111d3f2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:18.560807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8090f-78f9-4da1-a058-62c9b09e6522 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:18.569854 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3263/6495] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:18 2022] PUT /identity/v3/projects/1638d90f444c4e7b8f6255e8d2040666/users/90a2d6edcaeb4d86825d1b79299f2530/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:18.574488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8f3d1-85a1-46e8-8472-b0838111d3f2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:18.611558 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:18.703952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:18.704758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:18.705666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:18.705981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/groups/032c646bb10b48209a3aa9bfbcff0253/roles/964b547dc739426ab8cbd8bd036ace57/inherited_to_projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:18.709269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f1491a4869cb4d48b0cae87b16527797, group_id=032c646bb10b48209a3aa9bfbcff0253, role_id=964b547dc739426ab8cbd8bd036ace57)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:18.712630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:18.734989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role 964b547dc739426ab8cbd8bd036ace57 was removed from group 032c646bb10b48209a3aa9bfbcff0253 on domain f1491a4869cb4d48b0cae87b16527797. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:18.736556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:18.737705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:18.759344 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3233/6496] 10.222.0.23 () {58 vars in 1566 bytes} [Sun Oct 2 01:30:18 2022] DELETE /identity/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/groups/032c646bb10b48209a3aa9bfbcff0253/roles/964b547dc739426ab8cbd8bd036ace57/inherited_to_projects => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:18.762827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:18.764597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:18.764796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8f3d1-85a1-46e8-8472-b0838111d3f2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:18.809119 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:18.846703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8194ae-6add-47d0-925b-67dc87b260e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:18.847377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8194ae-6add-47d0-925b-67dc87b260e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:18.847658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8194ae-6add-47d0-925b-67dc87b260e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:18.847931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8194ae-6add-47d0-925b-67dc87b260e8 admin admin] PATH_INFO: `/v3/projects/e5dc437b22054597a181f7c66c4c9815/users/0fc69147312b4b93b90cc73e2e3396c5/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:18.856404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0b40-aee1-4497-a34e-f6bac6ce2578 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:18.863254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4df4a-0926-4e3f-896d-5f7f67f24e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:18.864790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4df4a-0926-4e3f-896d-5f7f67f24e0e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:18.865435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4df4a-0926-4e3f-896d-5f7f67f24e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:18.865724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4df4a-0926-4e3f-896d-5f7f67f24e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:18.867744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8194ae-6add-47d0-925b-67dc87b260e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5dc437b22054597a181f7c66c4c9815, user_id=0fc69147312b4b93b90cc73e2e3396c5, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:18.868040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-09e4df4a-0926-4e3f-896d-5f7f67f24e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:18.871668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8194ae-6add-47d0-925b-67dc87b260e8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:18.889843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4df4a-0926-4e3f-896d-5f7f67f24e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:18.892141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4df4a-0926-4e3f-896d-5f7f67f24e0e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:18.899423 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3264/6497] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:18 2022] PUT /identity/v3/projects/e5dc437b22054597a181f7c66c4c9815/users/0fc69147312b4b93b90cc73e2e3396c5/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:18.900660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8194ae-6add-47d0-925b-67dc87b260e8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:18.915459 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3234/6498] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:18.918030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6a8194ae-6add-47d0-925b-67dc87b260e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:18.919461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02756721-a0e3-42d3-b673-dc26c85fec93 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:18.920046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02756721-a0e3-42d3-b673-dc26c85fec93 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:18.920523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02756721-a0e3-42d3-b673-dc26c85fec93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:18.958434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-02756721-a0e3-42d3-b673-dc26c85fec93 None None] MFA Rules not processed for user `0fc69147312b4b93b90cc73e2e3396c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:18.960662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-02756721-a0e3-42d3-b673-dc26c85fec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:19.006732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8194ae-6add-47d0-925b-67dc87b260e8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:19.014058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:19.015415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:19.015415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:19.015415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles/964b547dc739426ab8cbd8bd036ace57` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:19.016878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=964b547dc739426ab8cbd8bd036ace57)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:19.019185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:19.064260 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3235/6499] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:19.076154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02756721-a0e3-42d3-b673-dc26c85fec93 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:19.078324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-02756721-a0e3-42d3-b673-dc26c85fec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:19.093316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role 964b547dc739426ab8cbd8bd036ace57 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:19.094583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:19.095657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:19.098566 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3265/6500] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:18 2022] DELETE /identity/v3/roles/964b547dc739426ab8cbd8bd036ace57 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:19.104498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:19.106483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:19.118933 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:19.171635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02756721-a0e3-42d3-b673-dc26c85fec93 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:19.209377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcd536-2ead-42aa-b09c-7bc837ea372d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:19.216420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70da33f-9393-4773-b3c3-6eebefb32131 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:19.217047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70da33f-9393-4773-b3c3-6eebefb32131 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:19.217334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70da33f-9393-4773-b3c3-6eebefb32131 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:19.217615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70da33f-9393-4773-b3c3-6eebefb32131 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:19.219050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70da33f-9393-4773-b3c3-6eebefb32131 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:19.221237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70da33f-9393-4773-b3c3-6eebefb32131 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:19.243415 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3266/6501] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:30:19 2022] POST /identity/v3/roles => generated 240 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:19.248276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799f89d-e0b9-4065-b43f-2286db5b5fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:19.248463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70da33f-9393-4773-b3c3-6eebefb32131 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:19.249719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799f89d-e0b9-4065-b43f-2286db5b5fdc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:19.250211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799f89d-e0b9-4065-b43f-2286db5b5fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:19.250816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799f89d-e0b9-4065-b43f-2286db5b5fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:19.254111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6799f89d-e0b9-4065-b43f-2286db5b5fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:19.261356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70da33f-9393-4773-b3c3-6eebefb32131 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:19.268433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12048296-b00d-45dd-b43a-c2e1e3e778fd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:19.269388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12048296-b00d-45dd-b43a-c2e1e3e778fd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:19.269673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12048296-b00d-45dd-b43a-c2e1e3e778fd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:19.269948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12048296-b00d-45dd-b43a-c2e1e3e778fd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/c50e03cb6b004ce8a1ed11aec9dd9cdb/inherited_to_projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:19.273200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12048296-b00d-45dd-b43a-c2e1e3e778fd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f1491a4869cb4d48b0cae87b16527797, user_id=8edd7932977b4a17bc7123d8b302df03, role_id=c50e03cb6b004ce8a1ed11aec9dd9cdb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:19.276596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12048296-b00d-45dd-b43a-c2e1e3e778fd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:19.303617 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3267/6502] 10.222.0.23 () {60 vars in 1579 bytes} [Sun Oct 2 01:30:19 2022] PUT /identity/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/c50e03cb6b004ce8a1ed11aec9dd9cdb/inherited_to_projects => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:30:19.304796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12048296-b00d-45dd-b43a-c2e1e3e778fd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:19.329134 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:19.403016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799f89d-e0b9-4065-b43f-2286db5b5fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:19.416236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799f89d-e0b9-4065-b43f-2286db5b5fdc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:19.442643 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3236/6503] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:30:19.458005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12048296-b00d-45dd-b43a-c2e1e3e778fd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:19.471660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210bdb-4df3-4ae9-9a24-8cc61fd6d31d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:19.472446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210bdb-4df3-4ae9-9a24-8cc61fd6d31d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:19.477526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210bdb-4df3-4ae9-9a24-8cc61fd6d31d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:19.477898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210bdb-4df3-4ae9-9a24-8cc61fd6d31d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/inherited_to_projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:19.482340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e210bdb-4df3-4ae9-9a24-8cc61fd6d31d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=f1491a4869cb4d48b0cae87b16527797, user_id=8edd7932977b4a17bc7123d8b302df03)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:19.485108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e210bdb-4df3-4ae9-9a24-8cc61fd6d31d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:19.517024 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3268/6504] 10.222.0.23 () {58 vars in 1461 bytes} [Sun Oct 2 01:30:19 2022] GET /identity/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/inherited_to_projects => generated 447 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:19.521106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799f89d-e0b9-4065-b43f-2286db5b5fdc service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:19.538910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799f89d-e0b9-4065-b43f-2286db5b5fdc service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:19.567479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012a047-9690-4f0b-9f5a-fb81381205e2 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:19.568543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a047-9690-4f0b-9f5a-fb81381205e2 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:19.571137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a047-9690-4f0b-9f5a-fb81381205e2 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:19.571636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a047-9690-4f0b-9f5a-fb81381205e2 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/c50e03cb6b004ce8a1ed11aec9dd9cdb/inherited_to_projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:19.578317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012a047-9690-4f0b-9f5a-fb81381205e2 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=f1491a4869cb4d48b0cae87b16527797, user_id=8edd7932977b4a17bc7123d8b302df03, role_id=c50e03cb6b004ce8a1ed11aec9dd9cdb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:19.582206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012a047-9690-4f0b-9f5a-fb81381205e2 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:19.589161 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3237/6505] 10.222.0.23 () {58 vars in 1561 bytes} [Sun Oct 2 01:30:19 2022] HEAD /identity/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/c50e03cb6b004ce8a1ed11aec9dd9cdb/inherited_to_projects => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:19.593438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210bdb-4df3-4ae9-9a24-8cc61fd6d31d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:19.607655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210bdb-4df3-4ae9-9a24-8cc61fd6d31d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:19.617067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910fe4-e642-436a-9a38-c25f4f1d4a71 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:19.619113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910fe4-e642-436a-9a38-c25f4f1d4a71 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:19.619264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910fe4-e642-436a-9a38-c25f4f1d4a71 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:19.619558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910fe4-e642-436a-9a38-c25f4f1d4a71 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/c50e03cb6b004ce8a1ed11aec9dd9cdb/inherited_to_projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:19.624212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65910fe4-e642-436a-9a38-c25f4f1d4a71 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f1491a4869cb4d48b0cae87b16527797, user_id=8edd7932977b4a17bc7123d8b302df03, role_id=c50e03cb6b004ce8a1ed11aec9dd9cdb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:19.628572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65910fe4-e642-436a-9a38-c25f4f1d4a71 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:19.637866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-65910fe4-e642-436a-9a38-c25f4f1d4a71 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role c50e03cb6b004ce8a1ed11aec9dd9cdb was removed from user 8edd7932977b4a17bc7123d8b302df03 on domain f1491a4869cb4d48b0cae87b16527797. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:19.638292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-65910fe4-e642-436a-9a38-c25f4f1d4a71 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:19.640531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-65910fe4-e642-436a-9a38-c25f4f1d4a71 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:19.658355 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3269/6506] 10.222.0.23 () {58 vars in 1563 bytes} [Sun Oct 2 01:30:19 2022] DELETE /identity/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/c50e03cb6b004ce8a1ed11aec9dd9cdb/inherited_to_projects => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:19.663572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012a047-9690-4f0b-9f5a-fb81381205e2 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:19.667961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f012a047-9690-4f0b-9f5a-fb81381205e2 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:19.684444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012a047-9690-4f0b-9f5a-fb81381205e2 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:19.798534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:19.800338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:19.802107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:19.802618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles/c50e03cb6b004ce8a1ed11aec9dd9cdb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:19.805506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c50e03cb6b004ce8a1ed11aec9dd9cdb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:19.808971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:19.875375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role c50e03cb6b004ce8a1ed11aec9dd9cdb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:19.875875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:19.876698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:19.879875 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3238/6507] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:19 2022] DELETE /identity/v3/roles/c50e03cb6b004ce8a1ed11aec9dd9cdb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:19.887508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910fe4-e642-436a-9a38-c25f4f1d4a71 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:19.902703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910fe4-e642-436a-9a38-c25f4f1d4a71 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:20.092020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaf075-99ba-4d84-8f7e-0d77687449fb tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:20.092723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaf075-99ba-4d84-8f7e-0d77687449fb tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:20.093169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaf075-99ba-4d84-8f7e-0d77687449fb tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:20.093297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaf075-99ba-4d84-8f7e-0d77687449fb tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:20.093990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaf075-99ba-4d84-8f7e-0d77687449fb tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:20.096425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaf075-99ba-4d84-8f7e-0d77687449fb tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:20.109425 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:20.134640 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3270/6508] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:30:19 2022] POST /identity/v3/roles => generated 239 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:20.134872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:20.136175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:20.159940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aa4df-12d0-4764-9b9f-4866fcd39a3e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:20.174530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc50122-7b20-4f5e-b001-a917b88acb0d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:20.175203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc50122-7b20-4f5e-b001-a917b88acb0d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:20.175488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc50122-7b20-4f5e-b001-a917b88acb0d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:20.175771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc50122-7b20-4f5e-b001-a917b88acb0d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:20.176421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc50122-7b20-4f5e-b001-a917b88acb0d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:20.178407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc50122-7b20-4f5e-b001-a917b88acb0d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:20.258647 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3239/6509] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:20 2022] POST /identity/v3/projects => generated 407 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:20.264612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaf075-99ba-4d84-8f7e-0d77687449fb tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:20.281452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaf075-99ba-4d84-8f7e-0d77687449fb tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:20.349999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc50122-7b20-4f5e-b001-a917b88acb0d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:20.351860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6dc50122-7b20-4f5e-b001-a917b88acb0d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:20.402261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04942d-02ca-4c83-9e52-e3242dcf1ecd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:20.405327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04942d-02ca-4c83-9e52-e3242dcf1ecd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:20.406159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04942d-02ca-4c83-9e52-e3242dcf1ecd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:20.406646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04942d-02ca-4c83-9e52-e3242dcf1ecd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/d956a272300e4370bf2c9196ef6c4313/inherited_to_projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:20.425761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04942d-02ca-4c83-9e52-e3242dcf1ecd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f1491a4869cb4d48b0cae87b16527797, user_id=8edd7932977b4a17bc7123d8b302df03, role_id=d956a272300e4370bf2c9196ef6c4313)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:20.435471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04942d-02ca-4c83-9e52-e3242dcf1ecd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:20.467526 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3271/6510] 10.222.0.23 () {60 vars in 1579 bytes} [Sun Oct 2 01:30:20 2022] PUT /identity/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/d956a272300e4370bf2c9196ef6c4313/inherited_to_projects => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:20.467757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04942d-02ca-4c83-9e52-e3242dcf1ecd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:20.483339 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:20.493665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc50122-7b20-4f5e-b001-a917b88acb0d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:20.616886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04942d-02ca-4c83-9e52-e3242dcf1ecd tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:20.623596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:20.624802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:20.624924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523be518-fb37-4ba4-8ebf-2113bf50ee0f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:20.625593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523be518-fb37-4ba4-8ebf-2113bf50ee0f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:20.626542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523be518-fb37-4ba4-8ebf-2113bf50ee0f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:20.626542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523be518-fb37-4ba4-8ebf-2113bf50ee0f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:20.627316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523be518-fb37-4ba4-8ebf-2113bf50ee0f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Adding query filter params (scope.project.id=f049948dfe6249d1a40faf1a9fb9a728, user.id=8edd7932977b4a17bc7123d8b302df03) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:20.627629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:20.627743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523be518-fb37-4ba4-8ebf-2113bf50ee0f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:20.628207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] PATH_INFO: `/v3/projects/f9c72e0561b74ad88c25388ed58188ee` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:20.628943 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-523be518-fb37-4ba4-8ebf-2113bf50ee0f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:20.628943 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:30:20.628943 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:30:20.630325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c72e0561b74ad88c25388ed58188ee)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:20.630593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523be518-fb37-4ba4-8ebf-2113bf50ee0f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:20.632959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:20.754531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c72e0561b74ad88c25388ed58188ee', 'request_id': 'req-c65654bd-e1ba-41f3-b00d-9dd63be42777'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:20.772574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c72e0561b74ad88c25388ed58188ee', 'request_id': 'req-c65654bd-e1ba-41f3-b00d-9dd63be42777'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:20.775688 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3272/6511] 10.222.0.23 () {58 vars in 1356 bytes} [Sun Oct 2 01:30:20 2022] GET /identity/v3/role_assignments?scope.project.id=f049948dfe6249d1a40faf1a9fb9a728&user.id=8edd7932977b4a17bc7123d8b302df03&effective => generated 648 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:20.782005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523be518-fb37-4ba4-8ebf-2113bf50ee0f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:20.790691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c72e0561b74ad88c25388ed58188ee', 'request_id': 'req-c65654bd-e1ba-41f3-b00d-9dd63be42777'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:20.824058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] The token cache is being invalidate because project f9c72e0561b74ad88c25388ed58188ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:20.824650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:20.827249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:20.832940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523be518-fb37-4ba4-8ebf-2113bf50ee0f tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:20.833541 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3240/6512] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:20 2022] DELETE /identity/v3/projects/f9c72e0561b74ad88c25388ed58188ee => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:30:20.833947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:20.839408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:20.916112 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:20.977492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3464803-e0ac-4878-8180-2c408ad58433 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:20.978113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3464803-e0ac-4878-8180-2c408ad58433 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:20.978476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3464803-e0ac-4878-8180-2c408ad58433 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:20.981636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3464803-e0ac-4878-8180-2c408ad58433 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:20.986894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3464803-e0ac-4878-8180-2c408ad58433 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Adding query filter params (scope.project.id=24100fd61b7f4e2580758ca2fd32714a, user.id=8edd7932977b4a17bc7123d8b302df03) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:20.987258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3464803-e0ac-4878-8180-2c408ad58433 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:20.989165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3464803-e0ac-4878-8180-2c408ad58433 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:21.103646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65654bd-e1ba-41f3-b00d-9dd63be42777 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:21.117905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:21.118828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:21.120486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:21.121811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] PATH_INFO: `/v3/users/e3ff4d3857e04b5eb1bdb1970ebf2fff` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:21.123268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ff4d3857e04b5eb1bdb1970ebf2fff)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:21.125574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:21.138514 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3273/6513] 10.222.0.23 () {58 vars in 1356 bytes} [Sun Oct 2 01:30:20 2022] GET /identity/v3/role_assignments?scope.project.id=24100fd61b7f4e2580758ca2fd32714a&user.id=8edd7932977b4a17bc7123d8b302df03&effective => generated 648 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:21.151416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3043-9a6b-454c-a2f1-496c3849b14c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:21.151942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3043-9a6b-454c-a2f1-496c3849b14c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:21.152422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3043-9a6b-454c-a2f1-496c3849b14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:21.201684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-284e3043-9a6b-454c-a2f1-496c3849b14c None None] MFA Rules not processed for user `90a2d6edcaeb4d86825d1b79299f2530`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:21.203257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-284e3043-9a6b-454c-a2f1-496c3849b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:21.261891 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:21.276518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ff4d3857e04b5eb1bdb1970ebf2fff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:21.304291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ff4d3857e04b5eb1bdb1970ebf2fff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:21.305307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ff4d3857e04b5eb1bdb1970ebf2fff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:21.330121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ff4d3857e04b5eb1bdb1970ebf2fff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:21.335147 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3274/6514] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:21.336093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e3043-9a6b-454c-a2f1-496c3849b14c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:21.341599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-284e3043-9a6b-454c-a2f1-496c3849b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:21.371768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e3043-9a6b-454c-a2f1-496c3849b14c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:21.372723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ff4d3857e04b5eb1bdb1970ebf2fff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:21.382976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:21.383648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:21.384003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:21.384188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/d956a272300e4370bf2c9196ef6c4313/inherited_to_projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:21.389259 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3241/6515] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:20 2022] DELETE /identity/v3/users/e3ff4d3857e04b5eb1bdb1970ebf2fff => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:21.389430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f1491a4869cb4d48b0cae87b16527797, user_id=8edd7932977b4a17bc7123d8b302df03, role_id=d956a272300e4370bf2c9196ef6c4313)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:21.391359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:21.405655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role d956a272300e4370bf2c9196ef6c4313 was removed from user 8edd7932977b4a17bc7123d8b302df03 on domain f1491a4869cb4d48b0cae87b16527797. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:21.405975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:21.406926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:21.438771 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3275/6516] 10.222.0.23 () {58 vars in 1563 bytes} [Sun Oct 2 01:30:21 2022] DELETE /identity/v3/OS-INHERIT/domains/f1491a4869cb4d48b0cae87b16527797/users/8edd7932977b4a17bc7123d8b302df03/roles/d956a272300e4370bf2c9196ef6c4313/inherited_to_projects => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:21.444956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:21.447356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:21.570646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7d14e-bb0e-4046-afe3-4a52e9fc1015 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:21.763067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b7e40-c7f5-49fe-8a42-5bba44066a40 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:21.763705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b7e40-c7f5-49fe-8a42-5bba44066a40 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:21.763989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b7e40-c7f5-49fe-8a42-5bba44066a40 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:21.764263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b7e40-c7f5-49fe-8a42-5bba44066a40 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:21.765000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b7e40-c7f5-49fe-8a42-5bba44066a40 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Adding query filter params (scope.project.id=f049948dfe6249d1a40faf1a9fb9a728, user.id=8edd7932977b4a17bc7123d8b302df03) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:21.765305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b7e40-c7f5-49fe-8a42-5bba44066a40 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:21.768713 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-5e6b7e40-c7f5-49fe-8a42-5bba44066a40 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:21.768713 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:30:21.768713 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:30:21.771551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b7e40-c7f5-49fe-8a42-5bba44066a40 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:21.944046 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3242/6517] 10.222.0.23 () {58 vars in 1356 bytes} [Sun Oct 2 01:30:21 2022] GET /identity/v3/role_assignments?scope.project.id=f049948dfe6249d1a40faf1a9fb9a728&user.id=8edd7932977b4a17bc7123d8b302df03&effective => generated 228 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:21.949247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:21.952625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:21.975452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6a022-a1c7-4a1c-9096-1b35324ca6ed tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:22.006232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e593123-4525-4e1e-b692-a9d517813394 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:22.009567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e593123-4525-4e1e-b692-a9d517813394 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:22.011051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e593123-4525-4e1e-b692-a9d517813394 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:22.011494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e593123-4525-4e1e-b692-a9d517813394 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:22.012429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e593123-4525-4e1e-b692-a9d517813394 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Adding query filter params (scope.project.id=24100fd61b7f4e2580758ca2fd32714a, user.id=8edd7932977b4a17bc7123d8b302df03) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:22.012804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e593123-4525-4e1e-b692-a9d517813394 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:22.015296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e593123-4525-4e1e-b692-a9d517813394 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:22.167486 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3276/6518] 10.222.0.23 () {58 vars in 1356 bytes} [Sun Oct 2 01:30:21 2022] GET /identity/v3/role_assignments?scope.project.id=24100fd61b7f4e2580758ca2fd32714a&user.id=8edd7932977b4a17bc7123d8b302df03&effective => generated 228 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:22.171644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b7e40-c7f5-49fe-8a42-5bba44066a40 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:22.219077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b7e40-c7f5-49fe-8a42-5bba44066a40 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:22.249608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:22.250275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:22.250564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:22.250877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/projects/24100fd61b7f4e2580758ca2fd32714a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:22.263059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_project(project_id=24100fd61b7f4e2580758ca2fd32714a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:22.268989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:22.345510 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:22.457975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24100fd61b7f4e2580758ca2fd32714a', 'request_id': 'req-fa4071ac-7d37-46d8-a125-57c8cbaee381'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:22.494024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24100fd61b7f4e2580758ca2fd32714a', 'request_id': 'req-fa4071ac-7d37-46d8-a125-57c8cbaee381'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:22.506060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24100fd61b7f4e2580758ca2fd32714a', 'request_id': 'req-fa4071ac-7d37-46d8-a125-57c8cbaee381'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:22.562938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] The token cache is being invalidate because project 24100fd61b7f4e2580758ca2fd32714a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:22.563504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:22.565538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:22.569514 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3243/6519] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:22 2022] DELETE /identity/v3/projects/24100fd61b7f4e2580758ca2fd32714a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:22.574114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e593123-4525-4e1e-b692-a9d517813394 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:22.575908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7e593123-4525-4e1e-b692-a9d517813394 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:22.597831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e593123-4525-4e1e-b692-a9d517813394 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:22.649840 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:22.668126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:22.669622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:22.782552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:22.784285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:22.785127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:22.809067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles/d956a272300e4370bf2c9196ef6c4313` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:22.813401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d956a272300e4370bf2c9196ef6c4313)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:22.824359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:23.070340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role d956a272300e4370bf2c9196ef6c4313 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:23.070670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:23.075063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:23.082503 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3277/6520] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:22 2022] DELETE /identity/v3/roles/d956a272300e4370bf2c9196ef6c4313 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:23.088125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:23.092937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:23.126413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4071ac-7d37-46d8-a125-57c8cbaee381 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:23.211305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d66c4a-2bb5-4953-8263-41dbdf0c17d6 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:23.216902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6ae94-975f-4c00-94bb-18e2be15ec6d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:23.217748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ae94-975f-4c00-94bb-18e2be15ec6d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:23.218515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ae94-975f-4c00-94bb-18e2be15ec6d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:23.218515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ae94-975f-4c00-94bb-18e2be15ec6d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:23.219197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6ae94-975f-4c00-94bb-18e2be15ec6d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:23.220974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6ae94-975f-4c00-94bb-18e2be15ec6d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:23.246102 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3278/6521] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:30:23 2022] POST /identity/v3/roles => generated 239 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:23.250290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6ae94-975f-4c00-94bb-18e2be15ec6d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:23.265595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6ae94-975f-4c00-94bb-18e2be15ec6d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:23.271493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c6c96-29c3-4fa1-935c-96ee6252dc6e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:23.272459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c6c96-29c3-4fa1-935c-96ee6252dc6e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:23.273054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c6c96-29c3-4fa1-935c-96ee6252dc6e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:23.273558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c6c96-29c3-4fa1-935c-96ee6252dc6e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:23.274417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c6c96-29c3-4fa1-935c-96ee6252dc6e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:23.276975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c6c96-29c3-4fa1-935c-96ee6252dc6e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:23.324382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11daf97-8480-4785-b928-6789dbe9b61f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:23.325066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11daf97-8480-4785-b928-6789dbe9b61f service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:23.326362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11daf97-8480-4785-b928-6789dbe9b61f service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:23.326690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11daf97-8480-4785-b928-6789dbe9b61f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:23.334458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b11daf97-8480-4785-b928-6789dbe9b61f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:23.342537 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3279/6522] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:23 2022] POST /identity/v3/projects => generated 408 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:23.347366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c6c96-29c3-4fa1-935c-96ee6252dc6e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:23.365970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11daf97-8480-4785-b928-6789dbe9b61f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:23.372460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11daf97-8480-4785-b928-6789dbe9b61f service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:23.420264 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3244/6523] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:23.454717 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:23.506260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c6c96-29c3-4fa1-935c-96ee6252dc6e tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:23.530213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6993-05d9-46ba-bfa7-b2def44928c4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:23.531064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6993-05d9-46ba-bfa7-b2def44928c4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:23.531541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6993-05d9-46ba-bfa7-b2def44928c4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:23.531821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6993-05d9-46ba-bfa7-b2def44928c4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/users/8edd7932977b4a17bc7123d8b302df03/roles/f7fc31e8980c4a05a1dd6953e0bab48e/inherited_to_projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:23.537815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca6993-05d9-46ba-bfa7-b2def44928c4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f049948dfe6249d1a40faf1a9fb9a728, user_id=8edd7932977b4a17bc7123d8b302df03, role_id=f7fc31e8980c4a05a1dd6953e0bab48e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:23.544619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca6993-05d9-46ba-bfa7-b2def44928c4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:23.569886 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3280/6524] 10.222.0.23 () {60 vars in 1582 bytes} [Sun Oct 2 01:30:23 2022] PUT /identity/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/users/8edd7932977b4a17bc7123d8b302df03/roles/f7fc31e8980c4a05a1dd6953e0bab48e/inherited_to_projects => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:23.574335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11daf97-8480-4785-b928-6789dbe9b61f service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:23.595871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11daf97-8480-4785-b928-6789dbe9b61f service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:23.694226 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:23.794947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6993-05d9-46ba-bfa7-b2def44928c4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:23.797382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f7ca6993-05d9-46ba-bfa7-b2def44928c4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:23.841445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad84bf-4ddf-4916-ac5f-e84d2393b0af tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:23.844680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad84bf-4ddf-4916-ac5f-e84d2393b0af tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:23.844978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad84bf-4ddf-4916-ac5f-e84d2393b0af tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:23.845255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad84bf-4ddf-4916-ac5f-e84d2393b0af tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:23.850127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad84bf-4ddf-4916-ac5f-e84d2393b0af tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Adding query filter params (scope.project.id=f731bdfb54394f079c76b833fb8c437b, user.id=8edd7932977b4a17bc7123d8b302df03) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:23.851113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad84bf-4ddf-4916-ac5f-e84d2393b0af tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:23.855991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad84bf-4ddf-4916-ac5f-e84d2393b0af tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:24.007465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6993-05d9-46ba-bfa7-b2def44928c4 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:24.023249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:24.023913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:24.024198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:24.024478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] PATH_INFO: `/v3/projects/80f3fede041e49f6ad4cb9aa9715897e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:24.032071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f3fede041e49f6ad4cb9aa9715897e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:24.034236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:24.058064 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3245/6525] 10.222.0.23 () {58 vars in 1356 bytes} [Sun Oct 2 01:30:23 2022] GET /identity/v3/role_assignments?scope.project.id=f731bdfb54394f079c76b833fb8c437b&user.id=8edd7932977b4a17bc7123d8b302df03&effective => generated 649 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:24.060153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1793e00-5877-43e1-a418-5fc9b57b5584 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:24.060700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1793e00-5877-43e1-a418-5fc9b57b5584 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:24.061209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1793e00-5877-43e1-a418-5fc9b57b5584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:24.109820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c1793e00-5877-43e1-a418-5fc9b57b5584 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:24.112823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c1793e00-5877-43e1-a418-5fc9b57b5584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:24.140774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f3fede041e49f6ad4cb9aa9715897e', 'request_id': 'req-0847a4e7-995c-4159-9c0b-8e80afaaa545'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:24.151763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f3fede041e49f6ad4cb9aa9715897e', 'request_id': 'req-0847a4e7-995c-4159-9c0b-8e80afaaa545'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:24.170018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f3fede041e49f6ad4cb9aa9715897e', 'request_id': 'req-0847a4e7-995c-4159-9c0b-8e80afaaa545'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:24.216238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] The token cache is being invalidate because project 80f3fede041e49f6ad4cb9aa9715897e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:24.217331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:24.218322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:24.220574 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3281/6526] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:23 2022] DELETE /identity/v3/projects/80f3fede041e49f6ad4cb9aa9715897e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:24.221653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:24.223284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:24.312645 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3246/6527] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:24.314057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9030d2-39ba-4b39-9660-ec5ae09254a5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:24.314401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9030d2-39ba-4b39-9660-ec5ae09254a5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:24.314917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9030d2-39ba-4b39-9660-ec5ae09254a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:24.341590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5b9030d2-39ba-4b39-9660-ec5ae09254a5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:24.343345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5b9030d2-39ba-4b39-9660-ec5ae09254a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:24.392095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847a4e7-995c-4159-9c0b-8e80afaaa545 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:24.405504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:24.406253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:24.406546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:24.406868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/users/8edd7932977b4a17bc7123d8b302df03/roles/f7fc31e8980c4a05a1dd6953e0bab48e/inherited_to_projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:24.413790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f049948dfe6249d1a40faf1a9fb9a728, user_id=8edd7932977b4a17bc7123d8b302df03, role_id=f7fc31e8980c4a05a1dd6953e0bab48e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:24.422562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:24.439044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role f7fc31e8980c4a05a1dd6953e0bab48e was removed from user 8edd7932977b4a17bc7123d8b302df03 on project f049948dfe6249d1a40faf1a9fb9a728. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:24.439445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:24.440290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:24.470581 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3282/6528] 10.222.0.23 () {58 vars in 1566 bytes} [Sun Oct 2 01:30:24 2022] DELETE /identity/v3/OS-INHERIT/projects/f049948dfe6249d1a40faf1a9fb9a728/users/8edd7932977b4a17bc7123d8b302df03/roles/f7fc31e8980c4a05a1dd6953e0bab48e/inherited_to_projects => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:24.472041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:24.475204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:24.488093 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:24.490559 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3247/6529] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:24.491875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9030d2-39ba-4b39-9660-ec5ae09254a5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:24.500137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5b9030d2-39ba-4b39-9660-ec5ae09254a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:24.568190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9030d2-39ba-4b39-9660-ec5ae09254a5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:24.650025 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:24.757033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129ed28-a351-4933-ba2e-2fff120e1d83 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:24.779739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e236c-c515-461a-b44b-e528f80a683c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:24.780466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1f65e-faef-45fa-90b0-798ea8db130c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:24.781144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e236c-c515-461a-b44b-e528f80a683c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:24.781244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e236c-c515-461a-b44b-e528f80a683c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:24.781754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e236c-c515-461a-b44b-e528f80a683c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:24.782164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1f65e-faef-45fa-90b0-798ea8db130c service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:24.782286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e236c-c515-461a-b44b-e528f80a683c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Adding query filter params (scope.project.id=f731bdfb54394f079c76b833fb8c437b, user.id=8edd7932977b4a17bc7123d8b302df03) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:24.782495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e236c-c515-461a-b44b-e528f80a683c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:24.783245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1f65e-faef-45fa-90b0-798ea8db130c service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:24.783731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1f65e-faef-45fa-90b0-798ea8db130c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:24.784399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e236c-c515-461a-b44b-e528f80a683c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:24.786564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dca1f65e-faef-45fa-90b0-798ea8db130c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:24.941561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1f65e-faef-45fa-90b0-798ea8db130c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:24.945284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1f65e-faef-45fa-90b0-798ea8db130c service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:24.952406 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3248/6530] 10.222.0.23 () {58 vars in 1356 bytes} [Sun Oct 2 01:30:24 2022] GET /identity/v3/role_assignments?scope.project.id=f731bdfb54394f079c76b833fb8c437b&user.id=8edd7932977b4a17bc7123d8b302df03&effective => generated 228 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:24.956790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c04983-c203-4eac-88dc-a325bc275798 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:24.957649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c04983-c203-4eac-88dc-a325bc275798 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:24.957970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c04983-c203-4eac-88dc-a325bc275798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:25.005377 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3283/6531] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:30:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:30:25.006257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1f65e-faef-45fa-90b0-798ea8db130c service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:25.008557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dca1f65e-faef-45fa-90b0-798ea8db130c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:25.041456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-26c04983-c203-4eac-88dc-a325bc275798 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:25.046561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-26c04983-c203-4eac-88dc-a325bc275798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:25.245519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1f65e-faef-45fa-90b0-798ea8db130c service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:25.287998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03816d-4066-4a3e-b26b-8773cf3582b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:25.288934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03816d-4066-4a3e-b26b-8773cf3582b0 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:25.289218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03816d-4066-4a3e-b26b-8773cf3582b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:25.289562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03816d-4066-4a3e-b26b-8773cf3582b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:25.299898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fe03816d-4066-4a3e-b26b-8773cf3582b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:25.337790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03816d-4066-4a3e-b26b-8773cf3582b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:25.340506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03816d-4066-4a3e-b26b-8773cf3582b0 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:25.387382 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3284/6532] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:25.388510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03816d-4066-4a3e-b26b-8773cf3582b0 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:25.399621 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3249/6533] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:25.411650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03816d-4066-4a3e-b26b-8773cf3582b0 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:25.418446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c04983-c203-4eac-88dc-a325bc275798 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:25.419784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:25.420836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:25.421544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:25.421983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/projects/f731bdfb54394f079c76b833fb8c437b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:25.423418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f731bdfb54394f079c76b833fb8c437b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:25.423573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-26c04983-c203-4eac-88dc-a325bc275798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:25.425650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:25.455966 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:25.485923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c04983-c203-4eac-88dc-a325bc275798 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:25.514508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:25.518408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:25.519143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:25.521033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] PATH_INFO: `/v3/users/f993b548a0ca4e7bbb6780153db61ec4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:25.525095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f731bdfb54394f079c76b833fb8c437b', 'request_id': 'req-847280b0-d029-4755-87bb-bb6f83b26a42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:25.525695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f993b548a0ca4e7bbb6780153db61ec4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:25.540855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f731bdfb54394f079c76b833fb8c437b', 'request_id': 'req-847280b0-d029-4755-87bb-bb6f83b26a42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:25.543268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:25.564558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f731bdfb54394f079c76b833fb8c437b', 'request_id': 'req-847280b0-d029-4755-87bb-bb6f83b26a42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:25.598300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] The token cache is being invalidate because project f731bdfb54394f079c76b833fb8c437b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:25.598645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:25.600398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:25.605353 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3285/6534] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:25 2022] DELETE /identity/v3/projects/f731bdfb54394f079c76b833fb8c437b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:25.611986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:25.618534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:25.740867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f993b548a0ca4e7bbb6780153db61ec4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:25.781816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f993b548a0ca4e7bbb6780153db61ec4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:25.782975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f993b548a0ca4e7bbb6780153db61ec4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:25.802000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f993b548a0ca4e7bbb6780153db61ec4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:25.804656 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:25.853233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f993b548a0ca4e7bbb6780153db61ec4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:25.871393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847280b0-d029-4755-87bb-bb6f83b26a42 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:25.875717 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3250/6535] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:25 2022] DELETE /identity/v3/users/f993b548a0ca4e7bbb6780153db61ec4 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:25.877338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:25.893356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:26.139682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65446a-d507-4252-b5ad-223473e16b96 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:26.149161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:26.149803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63974d-2c95-4e04-b590-4b04e682622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:26.151454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63974d-2c95-4e04-b590-4b04e682622c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:26.152352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:26.153140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63974d-2c95-4e04-b590-4b04e682622c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:26.153411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:26.153835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/roles/f7fc31e8980c4a05a1dd6953e0bab48e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:26.154336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63974d-2c95-4e04-b590-4b04e682622c admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:26.155919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63974d-2c95-4e04-b590-4b04e682622c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:26.157053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63974d-2c95-4e04-b590-4b04e682622c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:26.158776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f7fc31e8980c4a05a1dd6953e0bab48e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:26.160595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:26.161505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63974d-2c95-4e04-b590-4b04e682622c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:26.191577 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3286/6536] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 584 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:26.195909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63974d-2c95-4e04-b590-4b04e682622c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:26.200466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-df63974d-2c95-4e04-b590-4b04e682622c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:26.277211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invalidating the token cache because role f7fc31e8980c4a05a1dd6953e0bab48e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:26.277516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:26.278385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:26.280422 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3251/6537] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:25 2022] DELETE /identity/v3/roles/f7fc31e8980c4a05a1dd6953e0bab48e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:26.285312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63974d-2c95-4e04-b590-4b04e682622c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:26.285756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:26.286933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:26.470955 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:26.483995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c4df1-a3c5-4402-a37e-1a0452f5d5a5 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:26.491309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:26.492244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:26.492693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:26.493167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/users/8edd7932977b4a17bc7123d8b302df03` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:26.495122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8edd7932977b4a17bc7123d8b302df03)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:26.497903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:26.517416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a31c0f-3e6e-49f7-9005-80684fe92786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:26.518765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31c0f-3e6e-49f7-9005-80684fe92786 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:26.518949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31c0f-3e6e-49f7-9005-80684fe92786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:26.519546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31c0f-3e6e-49f7-9005-80684fe92786 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:26.522054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a31c0f-3e6e-49f7-9005-80684fe92786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:26.528774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a31c0f-3e6e-49f7-9005-80684fe92786 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:26.621695 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3287/6538] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:26 2022] POST /identity/v3/projects => generated 367 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:30:26.625655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a31c0f-3e6e-49f7-9005-80684fe92786 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:26.629893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1a31c0f-3e6e-49f7-9005-80684fe92786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:26.631919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edd7932977b4a17bc7123d8b302df03'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:26.650544 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:26.665879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edd7932977b4a17bc7123d8b302df03'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:26.668188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edd7932977b4a17bc7123d8b302df03'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:26.685302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edd7932977b4a17bc7123d8b302df03'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:26.702326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edd7932977b4a17bc7123d8b302df03'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:26.719329 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3252/6539] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:26 2022] DELETE /identity/v3/users/8edd7932977b4a17bc7123d8b302df03 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:26.723017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:26.725034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:26.766500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a31c0f-3e6e-49f7-9005-80684fe92786 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:26.883921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe30b7d-4ca1-4e18-93f9-ec1e0fb517b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:26.884678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe30b7d-4ca1-4e18-93f9-ec1e0fb517b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:26.885640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe30b7d-4ca1-4e18-93f9-ec1e0fb517b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:26.885987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe30b7d-4ca1-4e18-93f9-ec1e0fb517b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:26.886714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe30b7d-4ca1-4e18-93f9-ec1e0fb517b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:26.890667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe30b7d-4ca1-4e18-93f9-ec1e0fb517b6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:26.905179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99eff-3ab7-44cb-92d6-ac3718864264 tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:26.925043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e6169-fc9d-48d1-b253-d0aac268e10d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:26.926425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e6169-fc9d-48d1-b253-d0aac268e10d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:26.932884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e6169-fc9d-48d1-b253-d0aac268e10d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:26.933386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e6169-fc9d-48d1-b253-d0aac268e10d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/groups/032c646bb10b48209a3aa9bfbcff0253` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:26.934130 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3288/6540] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:26 2022] POST /identity/v3/users => generated 284 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:30:26.938918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e6169-fc9d-48d1-b253-d0aac268e10d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_group(group_id=032c646bb10b48209a3aa9bfbcff0253)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:26.941809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe30b7d-4ca1-4e18-93f9-ec1e0fb517b6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:26.945992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e6169-fc9d-48d1-b253-d0aac268e10d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:26.972279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bbe30b7d-4ca1-4e18-93f9-ec1e0fb517b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:27.018390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe30b7d-4ca1-4e18-93f9-ec1e0fb517b6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:27.036336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b05a78-a36e-400c-8e4f-5f5ed0603b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:27.038187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b05a78-a36e-400c-8e4f-5f5ed0603b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:27.039603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b05a78-a36e-400c-8e4f-5f5ed0603b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:27.041259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b05a78-a36e-400c-8e4f-5f5ed0603b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:27.042721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b05a78-a36e-400c-8e4f-5f5ed0603b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:27.052309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b05a78-a36e-400c-8e4f-5f5ed0603b83 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:27.073418 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3289/6541] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:27.075957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b05a78-a36e-400c-8e4f-5f5ed0603b83 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:27.078199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c0b05a78-a36e-400c-8e4f-5f5ed0603b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:27.130453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b05a78-a36e-400c-8e4f-5f5ed0603b83 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:27.160271 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3253/6542] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:30:26 2022] DELETE /identity/v3/groups/032c646bb10b48209a3aa9bfbcff0253 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:27.161403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:27.164028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:27.165314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:27.169089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] PATH_INFO: `/v3/projects/b91a9bfa07e14f6fb650924169a93a9c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:27.173304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e6169-fc9d-48d1-b253-d0aac268e10d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:27.175605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91a9bfa07e14f6fb650924169a93a9c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:27.177630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-929e6169-fc9d-48d1-b253-d0aac268e10d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:27.179227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:27.292290 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:27.300565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e6169-fc9d-48d1-b253-d0aac268e10d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:27.317804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91a9bfa07e14f6fb650924169a93a9c', 'request_id': 'req-87253afe-fa9a-4d9c-9d01-c76c30fe720e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:27.348009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91a9bfa07e14f6fb650924169a93a9c', 'request_id': 'req-87253afe-fa9a-4d9c-9d01-c76c30fe720e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:27.363399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91a9bfa07e14f6fb650924169a93a9c', 'request_id': 'req-87253afe-fa9a-4d9c-9d01-c76c30fe720e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:27.392663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] The token cache is being invalidate because project b91a9bfa07e14f6fb650924169a93a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:27.392966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:27.393723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:27.402222 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3290/6543] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:27 2022] DELETE /identity/v3/projects/b91a9bfa07e14f6fb650924169a93a9c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:27.403276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:27.406898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:27.518150 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:27.534143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92699f-45fe-4080-8bb3-ba68a4b7b8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:27.534902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92699f-45fe-4080-8bb3-ba68a4b7b8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:27.537775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92699f-45fe-4080-8bb3-ba68a4b7b8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:27.538115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92699f-45fe-4080-8bb3-ba68a4b7b8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:27.543750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dc92699f-45fe-4080-8bb3-ba68a4b7b8f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:27.612627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87253afe-fa9a-4d9c-9d01-c76c30fe720e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:27.629576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:27.630934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:27.631972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:27.633402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/projects/f049948dfe6249d1a40faf1a9fb9a728` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:27.639582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f049948dfe6249d1a40faf1a9fb9a728)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:27.645801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:27.737902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92699f-45fe-4080-8bb3-ba68a4b7b8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:27.739745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92699f-45fe-4080-8bb3-ba68a4b7b8f5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:27.784893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f049948dfe6249d1a40faf1a9fb9a728', 'request_id': 'req-f88acad0-fec7-491a-8f02-b1367d3f370c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:27.810647 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3254/6544] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:27.811395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92699f-45fe-4080-8bb3-ba68a4b7b8f5 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:27.813183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f049948dfe6249d1a40faf1a9fb9a728', 'request_id': 'req-f88acad0-fec7-491a-8f02-b1367d3f370c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:27.813480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dc92699f-45fe-4080-8bb3-ba68a4b7b8f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:27.836492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f049948dfe6249d1a40faf1a9fb9a728', 'request_id': 'req-f88acad0-fec7-491a-8f02-b1367d3f370c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:27.867912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] The token cache is being invalidate because project f049948dfe6249d1a40faf1a9fb9a728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:27.868201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:27.871009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:27.878723 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3291/6545] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:27 2022] DELETE /identity/v3/projects/f049948dfe6249d1a40faf1a9fb9a728 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:27.880165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:27.887040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:28.002587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92699f-45fe-4080-8bb3-ba68a4b7b8f5 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:28.097871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88acad0-fec7-491a-8f02-b1367d3f370c tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:28.107211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:28.108575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:28.109893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:28.111253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] PATH_INFO: `/v3/users/90a2d6edcaeb4d86825d1b79299f2530` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:28.115160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a2d6edcaeb4d86825d1b79299f2530)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:28.121447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:28.136600 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:28.198659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0595989-8bbe-40f1-8937-bb8f2deae9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:28.199265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0595989-8bbe-40f1-8937-bb8f2deae9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:28.199550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0595989-8bbe-40f1-8937-bb8f2deae9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:28.199822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0595989-8bbe-40f1-8937-bb8f2deae9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:28.200467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0595989-8bbe-40f1-8937-bb8f2deae9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:28.202164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0595989-8bbe-40f1-8937-bb8f2deae9fc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:28.240939 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3255/6546] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:28.240939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0595989-8bbe-40f1-8937-bb8f2deae9fc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:28.242838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0595989-8bbe-40f1-8937-bb8f2deae9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:28.270231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a2d6edcaeb4d86825d1b79299f2530'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:28.300086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a2d6edcaeb4d86825d1b79299f2530'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:28.301178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a2d6edcaeb4d86825d1b79299f2530'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:28.314842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a2d6edcaeb4d86825d1b79299f2530'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:28.316406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a2d6edcaeb4d86825d1b79299f2530'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:28.330927 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:28.379755 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3292/6547] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:27 2022] DELETE /identity/v3/users/90a2d6edcaeb4d86825d1b79299f2530 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:28.380541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:28.385876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:28.447994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0595989-8bbe-40f1-8937-bb8f2deae9fc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:28.617586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcea5b-2762-47b8-9429-009a241fc51d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:28.625710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a945f-1a8b-4feb-85fe-3d268cdcc469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:28.626404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a945f-1a8b-4feb-85fe-3d268cdcc469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:28.626719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a945f-1a8b-4feb-85fe-3d268cdcc469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:28.626997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a945f-1a8b-4feb-85fe-3d268cdcc469 admin admin] PATH_INFO: `/v3/projects/87bacaf7f70c4a7fbd3aaef1ecfaa3cd/users/6fdabaa7e7504a1c83dd15ccde5957f9/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:28.657830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a945f-1a8b-4feb-85fe-3d268cdcc469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87bacaf7f70c4a7fbd3aaef1ecfaa3cd, user_id=6fdabaa7e7504a1c83dd15ccde5957f9, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:28.660614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a945f-1a8b-4feb-85fe-3d268cdcc469 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:28.705317 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3293/6548] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:28 2022] PUT /identity/v3/projects/87bacaf7f70c4a7fbd3aaef1ecfaa3cd/users/6fdabaa7e7504a1c83dd15ccde5957f9/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:28.719556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cce26-a231-4a48-8462-a9dd1b6cca15 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:28.719860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cce26-a231-4a48-8462-a9dd1b6cca15 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:28.720147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cce26-a231-4a48-8462-a9dd1b6cca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:28.767327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:28.768016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:28.768279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:28.768718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/domains/f1491a4869cb4d48b0cae87b16527797` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:28.770342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f1491a4869cb4d48b0cae87b16527797)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:28.772480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:28.829100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5d2cce26-a231-4a48-8462-a9dd1b6cca15 None None] MFA Rules not processed for user `6fdabaa7e7504a1c83dd15ccde5957f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:28.831030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5d2cce26-a231-4a48-8462-a9dd1b6cca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:28.860273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:28.864125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:28.950592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:28.953929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:28.970367 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3256/6549] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:30:28 2022] PATCH /identity/v3/domains/f1491a4869cb4d48b0cae87b16527797 => generated 276 bytes in 730 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:28.971396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:28.979612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:28.987238 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:29.003121 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3294/6550] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:29.007001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cce26-a231-4a48-8462-a9dd1b6cca15 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:29.009934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5d2cce26-a231-4a48-8462-a9dd1b6cca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:29.221381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cce26-a231-4a48-8462-a9dd1b6cca15 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:29.314071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf04d7d-d234-4fc7-9952-4ef7589a945d tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:29.334054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349637d726974797b897ebff9dab72d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e54ad4bbf3764a9191317edf15a5524d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:29.339764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:29.341710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:29.343361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] PATH_INFO: `/v3/domains/f1491a4869cb4d48b0cae87b16527797` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:29.364342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a569fa-3adc-4307-b926-dfbd2ea31c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:29.365005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a569fa-3adc-4307-b926-dfbd2ea31c10 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:29.365290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a569fa-3adc-4307-b926-dfbd2ea31c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:29.365566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a569fa-3adc-4307-b926-dfbd2ea31c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:29.366508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a569fa-3adc-4307-b926-dfbd2ea31c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:29.369049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a569fa-3adc-4307-b926-dfbd2ea31c10 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:29.417627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f1491a4869cb4d48b0cae87b16527797)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:29.426262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:29.444141 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3295/6551] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:29 2022] POST /identity/v3/projects => generated 367 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:29.448377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a569fa-3adc-4307-b926-dfbd2ea31c10 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:29.452096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e0a569fa-3adc-4307-b926-dfbd2ea31c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:29.472664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:29.477960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:29.484763 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:29.576718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797', 'request_id': 'req-722bf01e-1627-4b87-b491-f3996520d4ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:29.584210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797', 'request_id': 'req-722bf01e-1627-4b87-b491-f3996520d4ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:29.598957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797', 'request_id': 'req-722bf01e-1627-4b87-b491-f3996520d4ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:29.638413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] The token cache is being invalidate because project f1491a4869cb4d48b0cae87b16527797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:29.639932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:29.642688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:29.649667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a569fa-3adc-4307-b926-dfbd2ea31c10 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:29.668559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797', 'request_id': 'req-722bf01e-1627-4b87-b491-f3996520d4ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:29.669007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797', 'request_id': 'req-722bf01e-1627-4b87-b491-f3996520d4ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:29.669728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f1491a4869cb4d48b0cae87b16527797', 'request_id': 'req-722bf01e-1627-4b87-b491-f3996520d4ee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:29.698105 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3257/6552] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:28 2022] DELETE /identity/v3/domains/f1491a4869cb4d48b0cae87b16527797 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:29.703055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:29.706023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:29.751647 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:29.856944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de2ec4-316b-4973-bb1f-bcd0afec4a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:29.858921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de2ec4-316b-4973-bb1f-bcd0afec4a32 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:29.859448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de2ec4-316b-4973-bb1f-bcd0afec4a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:29.859983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de2ec4-316b-4973-bb1f-bcd0afec4a32 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:29.864316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de2ec4-316b-4973-bb1f-bcd0afec4a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:29.872626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de2ec4-316b-4973-bb1f-bcd0afec4a32 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:29.951376 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3296/6553] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:29 2022] POST /identity/v3/users => generated 290 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:29.952600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de2ec4-316b-4973-bb1f-bcd0afec4a32 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:29.954745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-62de2ec4-316b-4973-bb1f-bcd0afec4a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:29.978084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de2ec4-316b-4973-bb1f-bcd0afec4a32 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:29.993855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:30.001126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:30.001501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:30.001863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] PATH_INFO: `/v3/projects/1638d90f444c4e7b8f6255e8d2040666` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:30.003905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1638d90f444c4e7b8f6255e8d2040666)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:30.008511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:30.026005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bf01e-1627-4b87-b491-f3996520d4ee tempest-InheritsV3TestJSON-448068949 tempest-InheritsV3TestJSON-448068949-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:30.052610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dea36-c87a-42f7-bed7-400dc24a4dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:30.053745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dea36-c87a-42f7-bed7-400dc24a4dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:30.054171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dea36-c87a-42f7-bed7-400dc24a4dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:30.055686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dea36-c87a-42f7-bed7-400dc24a4dfd admin admin] PATH_INFO: `/v3/users/e6685c983edc4847ad58a32b3ac5ec74` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:30.058748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1dea36-c87a-42f7-bed7-400dc24a4dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6685c983edc4847ad58a32b3ac5ec74)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:30.061857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1dea36-c87a-42f7-bed7-400dc24a4dfd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:30.151825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1638d90f444c4e7b8f6255e8d2040666', 'request_id': 'req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:30.186561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1638d90f444c4e7b8f6255e8d2040666', 'request_id': 'req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:30.216049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1638d90f444c4e7b8f6255e8d2040666', 'request_id': 'req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:30.220600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d1dea36-c87a-42f7-bed7-400dc24a4dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6685c983edc4847ad58a32b3ac5ec74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:30.253940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] The token cache is being invalidate because project 1638d90f444c4e7b8f6255e8d2040666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:30.256636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:30.259987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:30.265451 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3297/6554] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:29 2022] DELETE /identity/v3/projects/1638d90f444c4e7b8f6255e8d2040666 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:30.269679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:30.275369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d1dea36-c87a-42f7-bed7-400dc24a4dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6685c983edc4847ad58a32b3ac5ec74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:30.276328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:30.279487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d1dea36-c87a-42f7-bed7-400dc24a4dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6685c983edc4847ad58a32b3ac5ec74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:30.311060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d1dea36-c87a-42f7-bed7-400dc24a4dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6685c983edc4847ad58a32b3ac5ec74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:30.327493 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:30.336751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d1dea36-c87a-42f7-bed7-400dc24a4dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6685c983edc4847ad58a32b3ac5ec74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:30.368448 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3258/6555] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:29 2022] DELETE /identity/v3/users/e6685c983edc4847ad58a32b3ac5ec74 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:30.369787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc87f-ef05-4e5c-b5b2-c0d7e40e5b67 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:30.370077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc87f-ef05-4e5c-b5b2-c0d7e40e5b67 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:30.370364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc87f-ef05-4e5c-b5b2-c0d7e40e5b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:30.404960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0ffdc87f-ef05-4e5c-b5b2-c0d7e40e5b67 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:30.408812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ffdc87f-ef05-4e5c-b5b2-c0d7e40e5b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:30.548591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb2fb2-27ff-4a4a-b2be-9ba190f3736c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:30.585871 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3259/6556] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:30.594359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47b8f4-b34b-4981-81d5-43d5ad9b1409 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:30.594839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47b8f4-b34b-4981-81d5-43d5ad9b1409 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:30.596178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47b8f4-b34b-4981-81d5-43d5ad9b1409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:30.643360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ad47b8f4-b34b-4981-81d5-43d5ad9b1409 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:30.646592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ad47b8f4-b34b-4981-81d5-43d5ad9b1409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:30.660259 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3260/6557] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:30.661891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b265d5-f0b8-4a2b-aa8f-bd566de7b48b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:30.662387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b265d5-f0b8-4a2b-aa8f-bd566de7b48b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:30.663430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b265d5-f0b8-4a2b-aa8f-bd566de7b48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:30.705970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a3b265d5-f0b8-4a2b-aa8f-bd566de7b48b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:30.707526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a3b265d5-f0b8-4a2b-aa8f-bd566de7b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:30.724925 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3261/6558] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:30.725986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b265d5-f0b8-4a2b-aa8f-bd566de7b48b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:30.728222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a3b265d5-f0b8-4a2b-aa8f-bd566de7b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:30.732284 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:30.749203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cf34a-b806-4136-b681-7961f49c87c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:30.750093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cf34a-b806-4136-b681-7961f49c87c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:30.750710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cf34a-b806-4136-b681-7961f49c87c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:30.751144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cf34a-b806-4136-b681-7961f49c87c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:30.752299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cf34a-b806-4136-b681-7961f49c87c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:30.756146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cf34a-b806-4136-b681-7961f49c87c4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:30.777207 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3298/6559] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:30.779653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cf34a-b806-4136-b681-7961f49c87c4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:30.808018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cf34a-b806-4136-b681-7961f49c87c4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:30.824483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17704f8-cadf-4d0a-a7c1-f6b3a75a7daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:30.826120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17704f8-cadf-4d0a-a7c1-f6b3a75a7daf admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:30.832913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17704f8-cadf-4d0a-a7c1-f6b3a75a7daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:30.833475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17704f8-cadf-4d0a-a7c1-f6b3a75a7daf admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:30.834390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17704f8-cadf-4d0a-a7c1-f6b3a75a7daf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:30.835973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17704f8-cadf-4d0a-a7c1-f6b3a75a7daf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:30.844293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17704f8-cadf-4d0a-a7c1-f6b3a75a7daf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:30.886527 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3299/6560] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:30.893198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17704f8-cadf-4d0a-a7c1-f6b3a75a7daf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:30.900426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f17704f8-cadf-4d0a-a7c1-f6b3a75a7daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:30.906298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b265d5-f0b8-4a2b-aa8f-bd566de7b48b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:30.911921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc11793-53a0-4a9b-9368-398edab9925e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:30.912716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc11793-53a0-4a9b-9368-398edab9925e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:30.913110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc11793-53a0-4a9b-9368-398edab9925e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:30.915272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc11793-53a0-4a9b-9368-398edab9925e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:30.926409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc11793-53a0-4a9b-9368-398edab9925e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:30.928403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc11793-53a0-4a9b-9368-398edab9925e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:30.941670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17704f8-cadf-4d0a-a7c1-f6b3a75a7daf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:30.948899 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3262/6561] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:30.948899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc11793-53a0-4a9b-9368-398edab9925e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:30.968082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fc54c-4b4b-4ed0-b6c0-6fd2c42135be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:30.968438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fc54c-4b4b-4ed0-b6c0-6fd2c42135be admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:30.968730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fc54c-4b4b-4ed0-b6c0-6fd2c42135be admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:30.984100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fc54c-4b4b-4ed0-b6c0-6fd2c42135be admin admin] PATH_INFO: `/v3/projects/59cbb265b000498ca648dfbb5f010130/users/79c6fa20632e48fe83c1991cef1cb7f7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:31.007215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc11793-53a0-4a9b-9368-398edab9925e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:31.018660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1d45-6c65-49fe-9306-a3222dfcfa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:31.019630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1d45-6c65-49fe-9306-a3222dfcfa07 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:31.020092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1d45-6c65-49fe-9306-a3222dfcfa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:31.020521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1d45-6c65-49fe-9306-a3222dfcfa07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:31.021311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd1d45-6c65-49fe-9306-a3222dfcfa07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:31.030109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd1d45-6c65-49fe-9306-a3222dfcfa07 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:31.030751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fc54c-4b4b-4ed0-b6c0-6fd2c42135be admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cbb265b000498ca648dfbb5f010130, user_id=79c6fa20632e48fe83c1991cef1cb7f7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:31.038756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fc54c-4b4b-4ed0-b6c0-6fd2c42135be admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:31.079930 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3300/6562] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:30 2022] PUT /identity/v3/projects/59cbb265b000498ca648dfbb5f010130/users/79c6fa20632e48fe83c1991cef1cb7f7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:31.084287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fc54c-4b4b-4ed0-b6c0-6fd2c42135be admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:31.138169 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3263/6563] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:30 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:31.142708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1d45-6c65-49fe-9306-a3222dfcfa07 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:31.277748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fc54c-4b4b-4ed0-b6c0-6fd2c42135be admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:31.331521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1d45-6c65-49fe-9306-a3222dfcfa07 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:31.347797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469de1-78b1-4c30-ba6f-f2e0b44a938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:31.348520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469de1-78b1-4c30-ba6f-f2e0b44a938c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:31.351132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469de1-78b1-4c30-ba6f-f2e0b44a938c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:31.351361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469de1-78b1-4c30-ba6f-f2e0b44a938c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:31.352035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4469de1-78b1-4c30-ba6f-f2e0b44a938c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:31.358533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4469de1-78b1-4c30-ba6f-f2e0b44a938c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:31.384024 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:31.415574 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3264/6564] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:31 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:31.428797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469de1-78b1-4c30-ba6f-f2e0b44a938c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:31.463508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469de1-78b1-4c30-ba6f-f2e0b44a938c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:31.489909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b37832-cc92-44e6-a62a-a031b5dd8987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:31.495810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b37832-cc92-44e6-a62a-a031b5dd8987 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:31.496744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b37832-cc92-44e6-a62a-a031b5dd8987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:31.497748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b37832-cc92-44e6-a62a-a031b5dd8987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:31.499329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b37832-cc92-44e6-a62a-a031b5dd8987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:31.508689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b37832-cc92-44e6-a62a-a031b5dd8987 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:31.529291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373bc29-9f8d-4a41-bfcb-edb6d1bec7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:31.529930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373bc29-9f8d-4a41-bfcb-edb6d1bec7bb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:31.530207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373bc29-9f8d-4a41-bfcb-edb6d1bec7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:31.530484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373bc29-9f8d-4a41-bfcb-edb6d1bec7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:31.533418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373bc29-9f8d-4a41-bfcb-edb6d1bec7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:31.534055 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3265/6565] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:31.537644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373bc29-9f8d-4a41-bfcb-edb6d1bec7bb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:31.538358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b37832-cc92-44e6-a62a-a031b5dd8987 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:31.576312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b37832-cc92-44e6-a62a-a031b5dd8987 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:31.586913 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3301/6566] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:31.590417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373bc29-9f8d-4a41-bfcb-edb6d1bec7bb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:31.590553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5191ff2-037b-40b8-ab49-b3b6687444c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:31.591114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5191ff2-037b-40b8-ab49-b3b6687444c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:31.591397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5191ff2-037b-40b8-ab49-b3b6687444c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:31.591674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5191ff2-037b-40b8-ab49-b3b6687444c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:31.598558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5191ff2-037b-40b8-ab49-b3b6687444c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:31.602101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5191ff2-037b-40b8-ab49-b3b6687444c5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:31.620552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373bc29-9f8d-4a41-bfcb-edb6d1bec7bb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:31.627374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f42a1-be1e-4212-b6ea-207de344b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:31.629036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f42a1-be1e-4212-b6ea-207de344b50d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:31.629562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f42a1-be1e-4212-b6ea-207de344b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:31.630052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f42a1-be1e-4212-b6ea-207de344b50d admin admin] PATH_INFO: `/v3/projects/59cbb265b000498ca648dfbb5f010130/users/79c6fa20632e48fe83c1991cef1cb7f7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:31.632834 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3266/6567] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:31.634424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f42a1-be1e-4212-b6ea-207de344b50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cbb265b000498ca648dfbb5f010130, user_id=79c6fa20632e48fe83c1991cef1cb7f7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:31.638368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5191ff2-037b-40b8-ab49-b3b6687444c5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:31.639213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f42a1-be1e-4212-b6ea-207de344b50d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:31.668638 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3302/6568] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:31 2022] PUT /identity/v3/projects/59cbb265b000498ca648dfbb5f010130/users/79c6fa20632e48fe83c1991cef1cb7f7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:31.676603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5191ff2-037b-40b8-ab49-b3b6687444c5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:31.679053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569604-2263-4068-be2c-769e7b1efb8b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:31.679370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569604-2263-4068-be2c-769e7b1efb8b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:31.679628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569604-2263-4068-be2c-769e7b1efb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:31.742619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2d569604-2263-4068-be2c-769e7b1efb8b None None] MFA Rules not processed for user `79c6fa20632e48fe83c1991cef1cb7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:31.747928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2d569604-2263-4068-be2c-769e7b1efb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:31.848888 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:31.850243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a486d4a-9609-4987-b911-7763ea9d8ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:31.851832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486d4a-9609-4987-b911-7763ea9d8ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:31.856036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486d4a-9609-4987-b911-7763ea9d8ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:31.856333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486d4a-9609-4987-b911-7763ea9d8ed7 admin admin] PATH_INFO: `/v3/projects/0814a76aa84a4b3e8f308a80279b2393/users/5fe4c75f10d7402c9e7f0b14b4f7015d/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:31.907937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a486d4a-9609-4987-b911-7763ea9d8ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0814a76aa84a4b3e8f308a80279b2393, user_id=5fe4c75f10d7402c9e7f0b14b4f7015d, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:31.918722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a486d4a-9609-4987-b911-7763ea9d8ed7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:31.962510 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3267/6569] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:31 2022] PUT /identity/v3/projects/0814a76aa84a4b3e8f308a80279b2393/users/5fe4c75f10d7402c9e7f0b14b4f7015d/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:31.965890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306dad4-f3f5-4596-8a0e-fec9dc1f1b01 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:31.966282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306dad4-f3f5-4596-8a0e-fec9dc1f1b01 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:31.967958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306dad4-f3f5-4596-8a0e-fec9dc1f1b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:32.026773 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3303/6570] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:32.028515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d569604-2263-4068-be2c-769e7b1efb8b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:32.043403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d569604-2263-4068-be2c-769e7b1efb8b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:32.069386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b306dad4-f3f5-4596-8a0e-fec9dc1f1b01 None None] MFA Rules not processed for user `5fe4c75f10d7402c9e7f0b14b4f7015d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:32.076358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b306dad4-f3f5-4596-8a0e-fec9dc1f1b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:32.210037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf3bb5-c563-4e1e-9073-414031ac34de tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:32.214718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf3bb5-c563-4e1e-9073-414031ac34de tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:32.214718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf3bb5-c563-4e1e-9073-414031ac34de tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:32.214718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf3bb5-c563-4e1e-9073-414031ac34de tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:32.218503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf3bb5-c563-4e1e-9073-414031ac34de tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:32.224410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf3bb5-c563-4e1e-9073-414031ac34de tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:32.363921 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3304/6571] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:32 2022] POST /identity/v3/projects => generated 360 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:32.368496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf3bb5-c563-4e1e-9073-414031ac34de tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:32.384048 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3268/6572] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:32.388449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306dad4-f3f5-4596-8a0e-fec9dc1f1b01 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:32.603217 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:32.665420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306dad4-f3f5-4596-8a0e-fec9dc1f1b01 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:32.720426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf3bb5-c563-4e1e-9073-414031ac34de tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:32.748830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3e33c-728f-424d-bbda-85004c02c6dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:32.750220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3e33c-728f-424d-bbda-85004c02c6dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:32.750508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3e33c-728f-424d-bbda-85004c02c6dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:32.750850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3e33c-728f-424d-bbda-85004c02c6dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:32.751481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3e33c-728f-424d-bbda-85004c02c6dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:32.753588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3e33c-728f-424d-bbda-85004c02c6dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:32.818376 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3305/6573] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:32 2022] POST /identity/v3/users => generated 413 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:32.819874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3e33c-728f-424d-bbda-85004c02c6dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:32.828222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b3e3e33c-728f-424d-bbda-85004c02c6dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:32.901141 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:32.937447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a3d6-7c67-4bea-b525-a7bfaec2de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:32.938095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a3d6-7c67-4bea-b525-a7bfaec2de90 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:32.938380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a3d6-7c67-4bea-b525-a7bfaec2de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:32.938695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a3d6-7c67-4bea-b525-a7bfaec2de90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:32.939337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2a3d6-7c67-4bea-b525-a7bfaec2de90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:32.941298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2a3d6-7c67-4bea-b525-a7bfaec2de90 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:32.946752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3e33c-728f-424d-bbda-85004c02c6dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:32.954153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:32.955396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:32.955532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:32.955760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] PATH_INFO: `/v3/projects/f658327dd94f4bdca270442f50a4de9a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:32.956969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f658327dd94f4bdca270442f50a4de9a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:32.974723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:33.053015 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3269/6574] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:32 2022] POST /identity/v3/projects => generated 363 bytes in 665 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:33.053760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a3d6-7c67-4bea-b525-a7bfaec2de90 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:33.125240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f658327dd94f4bdca270442f50a4de9a', 'request_id': 'req-9425a650-a859-457f-94e2-fbb578b32ea3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:33.149099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f658327dd94f4bdca270442f50a4de9a', 'request_id': 'req-9425a650-a859-457f-94e2-fbb578b32ea3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:33.167973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f658327dd94f4bdca270442f50a4de9a', 'request_id': 'req-9425a650-a859-457f-94e2-fbb578b32ea3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:33.200111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] The token cache is being invalidate because project f658327dd94f4bdca270442f50a4de9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:33.200660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:33.203510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:33.209176 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3306/6575] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:32 2022] DELETE /identity/v3/projects/f658327dd94f4bdca270442f50a4de9a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:33.213782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:33.218816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:33.321381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a3d6-7c67-4bea-b525-a7bfaec2de90 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:33.533897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b85d08-a38e-47b6-9cba-70c789fbb2f7 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:33.535163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b85d08-a38e-47b6-9cba-70c789fbb2f7 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:33.535710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b85d08-a38e-47b6-9cba-70c789fbb2f7 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:33.536218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b85d08-a38e-47b6-9cba-70c789fbb2f7 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/users/7cb299cd54964cddbaeaedaa0e72e434` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:33.561459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b85d08-a38e-47b6-9cba-70c789fbb2f7 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:get_user(user_id=7cb299cd54964cddbaeaedaa0e72e434)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:33.585442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b85d08-a38e-47b6-9cba-70c789fbb2f7 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:33.592453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a650-a859-457f-94e2-fbb578b32ea3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:33.593706 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3270/6576] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:30:33 2022] GET /identity/v3/users/7cb299cd54964cddbaeaedaa0e72e434 => generated 413 bytes in 539 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:33.597517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b85d08-a38e-47b6-9cba-70c789fbb2f7 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:33.601653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0b85d08-a38e-47b6-9cba-70c789fbb2f7 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:33.607800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1632-d2f7-4358-980f-1b52552841bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:33.609491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1632-d2f7-4358-980f-1b52552841bd admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:33.614415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1632-d2f7-4358-980f-1b52552841bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:33.623542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1632-d2f7-4358-980f-1b52552841bd admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:33.626256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa1632-d2f7-4358-980f-1b52552841bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:33.633191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa1632-d2f7-4358-980f-1b52552841bd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:33.705415 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3307/6577] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:33 2022] POST /identity/v3/users => generated 288 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:33.705651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b85d08-a38e-47b6-9cba-70c789fbb2f7 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:33.705784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1632-d2f7-4358-980f-1b52552841bd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:33.716656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-62fa1632-d2f7-4358-980f-1b52552841bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:33.727637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:33.730095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:33.730410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:33.730721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] PATH_INFO: `/v3/users/349637d726974797b897ebff9dab72d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:33.733074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349637d726974797b897ebff9dab72d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:33.740257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:33.761348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1632-d2f7-4358-980f-1b52552841bd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:33.763129 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:33.780069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:33.792757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:33.793319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:33.793799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/users/7cb299cd54964cddbaeaedaa0e72e434` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:33.796594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7cb299cd54964cddbaeaedaa0e72e434)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:33.800022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:33.933153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb299cd54964cddbaeaedaa0e72e434'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:33.944039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349637d726974797b897ebff9dab72d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:33.958325 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:33.988967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb299cd54964cddbaeaedaa0e72e434'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:33.992935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb299cd54964cddbaeaedaa0e72e434'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:33.993877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349637d726974797b897ebff9dab72d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:33.997244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349637d726974797b897ebff9dab72d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:34.009176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb299cd54964cddbaeaedaa0e72e434'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:34.010440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb299cd54964cddbaeaedaa0e72e434'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:34.023203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349637d726974797b897ebff9dab72d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:34.035818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349637d726974797b897ebff9dab72d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:34.067416 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3271/6578] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:33 2022] DELETE /identity/v3/users/349637d726974797b897ebff9dab72d7 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:34.071974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:34.077014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:34.081866 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3308/6579] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:33 2022] DELETE /identity/v3/users/7cb299cd54964cddbaeaedaa0e72e434 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:34.085862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:34.094294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:34.316221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416e174-f0b2-4f5f-8fe3-6a17b1c5c6ca tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:34.317049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5b325-b463-4db5-b33d-38ababc03942 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:34.330900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:34.331485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:34.331772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:34.332057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/f1df452a79fe4d6baa6632672459346c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:34.335514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1df452a79fe4d6baa6632672459346c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:34.337470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:34.501198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1df452a79fe4d6baa6632672459346c', 'request_id': 'req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:34.521355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1df452a79fe4d6baa6632672459346c', 'request_id': 'req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:34.529819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb018-40eb-4adf-9ada-73c09fc66e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:34.530463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb018-40eb-4adf-9ada-73c09fc66e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:34.530783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb018-40eb-4adf-9ada-73c09fc66e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:34.537332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb018-40eb-4adf-9ada-73c09fc66e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:34.542044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb018-40eb-4adf-9ada-73c09fc66e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:34.548053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb018-40eb-4adf-9ada-73c09fc66e0d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:34.553946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1df452a79fe4d6baa6632672459346c', 'request_id': 'req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:34.597570 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3272/6580] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:34.601752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb018-40eb-4adf-9ada-73c09fc66e0d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:34.601996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project f1df452a79fe4d6baa6632672459346c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:34.602400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:34.604890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:34.607464 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3309/6581] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:34 2022] DELETE /identity/v3/projects/f1df452a79fe4d6baa6632672459346c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:34.613617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:34.617387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:34.636959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb018-40eb-4adf-9ada-73c09fc66e0d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:34.706862 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:34.813649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653bd98-f82d-4c92-8324-0432f2caa80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:34.813886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653bd98-f82d-4c92-8324-0432f2caa80f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:34.814150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653bd98-f82d-4c92-8324-0432f2caa80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:34.814429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653bd98-f82d-4c92-8324-0432f2caa80f admin admin] PATH_INFO: `/v3/projects/1ed71fa4a6514962b3b4b56807b6b9cd/users/757dcf027c394ba4b3a96dbf39fd135a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:34.871751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653bd98-f82d-4c92-8324-0432f2caa80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed71fa4a6514962b3b4b56807b6b9cd, user_id=757dcf027c394ba4b3a96dbf39fd135a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:34.877863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653bd98-f82d-4c92-8324-0432f2caa80f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:34.890985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc3ed-feff-48a2-82bb-fd0b485c3cfb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:34.901688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc1643-f369-45ce-a44f-dbb395289ce9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:34.903582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc1643-f369-45ce-a44f-dbb395289ce9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:34.904043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc1643-f369-45ce-a44f-dbb395289ce9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:34.905872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc1643-f369-45ce-a44f-dbb395289ce9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:34.906739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc1643-f369-45ce-a44f-dbb395289ce9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:34.909391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc1643-f369-45ce-a44f-dbb395289ce9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:34.913906 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3273/6582] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:34 2022] PUT /identity/v3/projects/1ed71fa4a6514962b3b4b56807b6b9cd/users/757dcf027c394ba4b3a96dbf39fd135a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:34.917923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653bd98-f82d-4c92-8324-0432f2caa80f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:34.921825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9653bd98-f82d-4c92-8324-0432f2caa80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:34.935626 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:34.955442 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3310/6583] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:34 2022] POST /identity/v3/projects => generated 348 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:34.956881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc1643-f369-45ce-a44f-dbb395289ce9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:35.157144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653bd98-f82d-4c92-8324-0432f2caa80f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:35.186838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc1643-f369-45ce-a44f-dbb395289ce9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:35.197654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75231f87-8c19-4b92-9d1a-4dbe12b18419 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:35.202181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75231f87-8c19-4b92-9d1a-4dbe12b18419 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:35.206247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75231f87-8c19-4b92-9d1a-4dbe12b18419 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:35.206247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75231f87-8c19-4b92-9d1a-4dbe12b18419 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:35.206495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75231f87-8c19-4b92-9d1a-4dbe12b18419 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:35.224160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75231f87-8c19-4b92-9d1a-4dbe12b18419 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:35.228578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75231f87-8c19-4b92-9d1a-4dbe12b18419 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:35.266402 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3311/6584] 10.222.0.23 () {58 vars in 1160 bytes} [Sun Oct 2 01:30:34 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:35.269699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75231f87-8c19-4b92-9d1a-4dbe12b18419 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:35.285937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75231f87-8c19-4b92-9d1a-4dbe12b18419 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:35.298241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679406cb-e034-40f2-9d29-bb3f971f14bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:35.301281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679406cb-e034-40f2-9d29-bb3f971f14bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:35.301739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679406cb-e034-40f2-9d29-bb3f971f14bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:35.302458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679406cb-e034-40f2-9d29-bb3f971f14bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:35.303345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679406cb-e034-40f2-9d29-bb3f971f14bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:35.312371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679406cb-e034-40f2-9d29-bb3f971f14bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:35.348459 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3312/6585] 10.222.0.23 () {58 vars in 1128 bytes} [Sun Oct 2 01:30:35 2022] GET /identity/v3/domains => generated 829 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:35.353385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679406cb-e034-40f2-9d29-bb3f971f14bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:35.370754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679406cb-e034-40f2-9d29-bb3f971f14bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:35.394179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1a8b6-76a2-4a28-a152-887d56396628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:35.395342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1a8b6-76a2-4a28-a152-887d56396628 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:35.395342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1a8b6-76a2-4a28-a152-887d56396628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:35.398293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1a8b6-76a2-4a28-a152-887d56396628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:35.402622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1a8b6-76a2-4a28-a152-887d56396628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:35.402622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1a8b6-76a2-4a28-a152-887d56396628 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:35.436482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:35.437449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:35.437906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:35.438352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/c127571cc7024fa095fe4ff4351de1f5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:35.442359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:update_project(project_id=c127571cc7024fa095fe4ff4351de1f5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:35.449030 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:35.449030 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:30:35.449030 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:30:35.451711 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3274/6586] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:30:35.452083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:35.455436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1a8b6-76a2-4a28-a152-887d56396628 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:35.476209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:35.477500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:35.498569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1a8b6-76a2-4a28-a152-887d56396628 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:35.554166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:35.555199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:35.564230 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3313/6587] 10.222.0.23 () {60 vars in 1252 bytes} [Sun Oct 2 01:30:35 2022] PATCH /identity/v3/projects/c127571cc7024fa095fe4ff4351de1f5 => generated 362 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:35.565188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:35.569031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:35.698547 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:35.711876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228acfd-82c7-4215-bedd-f868611c2217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:35.712566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228acfd-82c7-4215-bedd-f868611c2217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:35.712848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228acfd-82c7-4215-bedd-f868611c2217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:35.714293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228acfd-82c7-4215-bedd-f868611c2217 admin admin] PATH_INFO: `/v3/projects/1ed71fa4a6514962b3b4b56807b6b9cd/users/757dcf027c394ba4b3a96dbf39fd135a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:35.717825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228acfd-82c7-4215-bedd-f868611c2217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed71fa4a6514962b3b4b56807b6b9cd, user_id=757dcf027c394ba4b3a96dbf39fd135a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:35.725147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228acfd-82c7-4215-bedd-f868611c2217 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:35.783675 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3275/6588] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:35 2022] PUT /identity/v3/projects/1ed71fa4a6514962b3b4b56807b6b9cd/users/757dcf027c394ba4b3a96dbf39fd135a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:30:35.796149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860b59b-6cac-43b0-8dd4-f7e946868530 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:35.796565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860b59b-6cac-43b0-8dd4-f7e946868530 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:35.796942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860b59b-6cac-43b0-8dd4-f7e946868530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:35.813080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7e4e3-4225-437f-9bb2-3ab9f6ac774f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:35.931731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6860b59b-6cac-43b0-8dd4-f7e946868530 None None] MFA Rules not processed for user `757dcf027c394ba4b3a96dbf39fd135a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:35.938392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6860b59b-6cac-43b0-8dd4-f7e946868530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:36.052667 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:36.067421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:36.068575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:36.068865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:36.069146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/c127571cc7024fa095fe4ff4351de1f5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:36.084976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c127571cc7024fa095fe4ff4351de1f5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:36.087293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:36.125082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.130119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.274274 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3276/6589] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:36.275276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860b59b-6cac-43b0-8dd4-f7e946868530 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:36.279646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6860b59b-6cac-43b0-8dd4-f7e946868530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:36.291662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5', 'request_id': 'req-0ff4b0e8-cfda-47dd-a594-d16442d5e791'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.314446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5', 'request_id': 'req-0ff4b0e8-cfda-47dd-a594-d16442d5e791'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.335003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5', 'request_id': 'req-0ff4b0e8-cfda-47dd-a594-d16442d5e791'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.368867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project c127571cc7024fa095fe4ff4351de1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:36.371918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.373953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.426288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5', 'request_id': 'req-0ff4b0e8-cfda-47dd-a594-d16442d5e791'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.441000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5', 'request_id': 'req-0ff4b0e8-cfda-47dd-a594-d16442d5e791'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.445353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c127571cc7024fa095fe4ff4351de1f5', 'request_id': 'req-0ff4b0e8-cfda-47dd-a594-d16442d5e791'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.460853 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3314/6590] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:35 2022] DELETE /identity/v3/projects/c127571cc7024fa095fe4ff4351de1f5 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:36.467220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:36.470400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:36.516850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860b59b-6cac-43b0-8dd4-f7e946868530 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:36.727483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b0e8-cfda-47dd-a594-d16442d5e791 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:36.738896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:36.740158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:36.740548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:36.741212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] PATH_INFO: `/v3/users/c4a5dec7466a413b9d4d1d262dad63b8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:36.744742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a5dec7466a413b9d4d1d262dad63b8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:36.746986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:36.750776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:36.751456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:36.752134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:36.752134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] PATH_INFO: `/v3/projects/e54ad4bbf3764a9191317edf15a5524d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:36.753867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54ad4bbf3764a9191317edf15a5524d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:36.755870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:36.848876 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:36.911567 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:36.924877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a5dec7466a413b9d4d1d262dad63b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.944262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54ad4bbf3764a9191317edf15a5524d', 'request_id': 'req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.970028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a5dec7466a413b9d4d1d262dad63b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.971168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a5dec7466a413b9d4d1d262dad63b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:36.982098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a5dec7466a413b9d4d1d262dad63b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:37.003033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54ad4bbf3764a9191317edf15a5524d', 'request_id': 'req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:37.004639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a5dec7466a413b9d4d1d262dad63b8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:37.013525 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3277/6591] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:36 2022] DELETE /identity/v3/users/c4a5dec7466a413b9d4d1d262dad63b8 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:37.018212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:37.020150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:37.026043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54ad4bbf3764a9191317edf15a5524d', 'request_id': 'req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:37.071999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] The token cache is being invalidate because project e54ad4bbf3764a9191317edf15a5524d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:37.073156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:37.085488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:37.091929 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3315/6592] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:36 2022] DELETE /identity/v3/projects/e54ad4bbf3764a9191317edf15a5524d => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:37.091929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:37.091929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:37.241078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5c2db-f217-4594-8e4d-6cba78a8e69e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:37.252201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a095d2-cef1-4462-8532-d686ee189045 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:37.268352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20d643-e2b2-4253-88e9-92baf95fdc27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:37.269359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20d643-e2b2-4253-88e9-92baf95fdc27 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:37.269651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20d643-e2b2-4253-88e9-92baf95fdc27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:37.269934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20d643-e2b2-4253-88e9-92baf95fdc27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:37.277669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf20d643-e2b2-4253-88e9-92baf95fdc27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:37.499147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1c93f-6011-41ea-882c-f63f1c97a5f5 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:37.499811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1c93f-6011-41ea-882c-f63f1c97a5f5 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:37.506878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1c93f-6011-41ea-882c-f63f1c97a5f5 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:37.507174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1c93f-6011-41ea-882c-f63f1c97a5f5 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:37.507872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1c93f-6011-41ea-882c-f63f1c97a5f5 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:37.514125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1c93f-6011-41ea-882c-f63f1c97a5f5 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:37.532708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20d643-e2b2-4253-88e9-92baf95fdc27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:37.537821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20d643-e2b2-4253-88e9-92baf95fdc27 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:37.576329 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3278/6593] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:37.583332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4aa76-7a42-468e-88f4-bc8b11ffbe0a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:37.583332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4aa76-7a42-468e-88f4-bc8b11ffbe0a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:37.584107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4aa76-7a42-468e-88f4-bc8b11ffbe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:37.643416 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3316/6594] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:37 2022] POST /identity/v3/projects => generated 358 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:37.645415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-61e4aa76-7a42-468e-88f4-bc8b11ffbe0a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:37.654310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44db8e-8c82-48d8-8945-f2c3d8dc6486 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:37.655457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-61e4aa76-7a42-468e-88f4-bc8b11ffbe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:37.656337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44db8e-8c82-48d8-8945-f2c3d8dc6486 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:37.659799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44db8e-8c82-48d8-8945-f2c3d8dc6486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:37.807990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6b44db8e-8c82-48d8-8945-f2c3d8dc6486 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:37.812546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6b44db8e-8c82-48d8-8945-f2c3d8dc6486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:37.827164 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:37.940680 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3279/6595] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:37.954529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4aa76-7a42-468e-88f4-bc8b11ffbe0a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:38.008300 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:38.067713 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3317/6596] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:38.069900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44db8e-8c82-48d8-8945-f2c3d8dc6486 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:38.074124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6b44db8e-8c82-48d8-8945-f2c3d8dc6486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:38.173493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4aa76-7a42-468e-88f4-bc8b11ffbe0a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:38.188919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ca046-91c6-4fac-a16e-b81e59d2bd9d tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:38.188919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca046-91c6-4fac-a16e-b81e59d2bd9d tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:38.188919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca046-91c6-4fac-a16e-b81e59d2bd9d tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:38.189257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca046-91c6-4fac-a16e-b81e59d2bd9d tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/090f452b79e748d89f2e048869cbd868` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:38.190177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ca046-91c6-4fac-a16e-b81e59d2bd9d tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:get_project(project_id=090f452b79e748d89f2e048869cbd868)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:38.192620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ca046-91c6-4fac-a16e-b81e59d2bd9d tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:38.210137 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3280/6597] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:37 2022] GET /identity/v3/projects/090f452b79e748d89f2e048869cbd868 => generated 358 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:38.211916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ca046-91c6-4fac-a16e-b81e59d2bd9d tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:38.214887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f53ca046-91c6-4fac-a16e-b81e59d2bd9d tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:38.284230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44db8e-8c82-48d8-8945-f2c3d8dc6486 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:38.301353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d551549-02e3-4ad7-b115-659116bac5fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:38.301353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d551549-02e3-4ad7-b115-659116bac5fb service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:38.301353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d551549-02e3-4ad7-b115-659116bac5fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:38.301353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d551549-02e3-4ad7-b115-659116bac5fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:38.304526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8d551549-02e3-4ad7-b115-659116bac5fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:38.479463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ca046-91c6-4fac-a16e-b81e59d2bd9d tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:38.498279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156992c-0c27-419c-a66b-741d88a8ae71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:38.499441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156992c-0c27-419c-a66b-741d88a8ae71 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:38.500192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156992c-0c27-419c-a66b-741d88a8ae71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:38.500696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156992c-0c27-419c-a66b-741d88a8ae71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:38.505105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d551549-02e3-4ad7-b115-659116bac5fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:38.512311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d551549-02e3-4ad7-b115-659116bac5fb service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:38.519143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156992c-0c27-419c-a66b-741d88a8ae71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:38.521196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156992c-0c27-419c-a66b-741d88a8ae71 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:38.548643 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3318/6598] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:38.552413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af75a29-05ec-4552-9344-535962aee87d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:38.552736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af75a29-05ec-4552-9344-535962aee87d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:38.553013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af75a29-05ec-4552-9344-535962aee87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:38.556189 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3281/6599] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:38.559643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156992c-0c27-419c-a66b-741d88a8ae71 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:38.576254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156992c-0c27-419c-a66b-741d88a8ae71 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:38.590823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:38.591824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:38.592125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:38.592410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/090f452b79e748d89f2e048869cbd868` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:38.594830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=090f452b79e748d89f2e048869cbd868)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:38.596798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:38.623585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5af75a29-05ec-4552-9344-535962aee87d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:38.631187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5af75a29-05ec-4552-9344-535962aee87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:38.667864 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3319/6600] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:38.691993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af75a29-05ec-4552-9344-535962aee87d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:38.723259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af75a29-05ec-4552-9344-535962aee87d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:38.747407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090f452b79e748d89f2e048869cbd868', 'request_id': 'req-837fd0ef-21c2-4c16-bd00-2c22836bb97a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:38.780206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090f452b79e748d89f2e048869cbd868', 'request_id': 'req-837fd0ef-21c2-4c16-bd00-2c22836bb97a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:38.795962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090f452b79e748d89f2e048869cbd868', 'request_id': 'req-837fd0ef-21c2-4c16-bd00-2c22836bb97a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:38.826031 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:38.833916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project 090f452b79e748d89f2e048869cbd868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:38.834555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:38.835147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:38.838373 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3282/6601] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:38 2022] DELETE /identity/v3/projects/090f452b79e748d89f2e048869cbd868 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:38.846537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:38.849078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:38.908268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18568b37-573a-4989-8dd6-63e9e3e717a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:38.908899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18568b37-573a-4989-8dd6-63e9e3e717a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:38.909325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18568b37-573a-4989-8dd6-63e9e3e717a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:38.909830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18568b37-573a-4989-8dd6-63e9e3e717a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:38.910912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18568b37-573a-4989-8dd6-63e9e3e717a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:38.911369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18568b37-573a-4989-8dd6-63e9e3e717a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:38.913139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18568b37-573a-4989-8dd6-63e9e3e717a2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:38.935523 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3320/6602] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:38.939284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18568b37-573a-4989-8dd6-63e9e3e717a2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:38.947289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-18568b37-573a-4989-8dd6-63e9e3e717a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:39.000465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fd0ef-21c2-4c16-bd00-2c22836bb97a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:39.001335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18568b37-573a-4989-8dd6-63e9e3e717a2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:39.013150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cc662-f0ee-49ab-b7dc-5b9e4c82509f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:39.013763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc662-f0ee-49ab-b7dc-5b9e4c82509f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:39.014453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc662-f0ee-49ab-b7dc-5b9e4c82509f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:39.014666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc662-f0ee-49ab-b7dc-5b9e4c82509f admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:39.015566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cc662-f0ee-49ab-b7dc-5b9e4c82509f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:39.016878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e72854-b5bb-47c9-a44a-997bd4a40a2c tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:39.017513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e72854-b5bb-47c9-a44a-997bd4a40a2c tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:39.017795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e72854-b5bb-47c9-a44a-997bd4a40a2c tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:39.018072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e72854-b5bb-47c9-a44a-997bd4a40a2c tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:39.018260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cc662-f0ee-49ab-b7dc-5b9e4c82509f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:39.020826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e72854-b5bb-47c9-a44a-997bd4a40a2c tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:39.028218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e72854-b5bb-47c9-a44a-997bd4a40a2c tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:39.121085 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3321/6603] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:38 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:30:39.122171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cc662-f0ee-49ab-b7dc-5b9e4c82509f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:39.135636 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3283/6604] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:38 2022] POST /identity/v3/projects => generated 360 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:39.138564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e72854-b5bb-47c9-a44a-997bd4a40a2c tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:39.186848 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:39.365490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cc662-f0ee-49ab-b7dc-5b9e4c82509f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:39.495784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e72854-b5bb-47c9-a44a-997bd4a40a2c tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:39.531793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c963a-e61b-45ec-bcd5-4ceaf18c1cc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:39.547973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c963a-e61b-45ec-bcd5-4ceaf18c1cc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:39.550933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c963a-e61b-45ec-bcd5-4ceaf18c1cc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:39.551396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c963a-e61b-45ec-bcd5-4ceaf18c1cc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/ee08669273884692921efd6e76fdb852` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:39.555323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c963a-e61b-45ec-bcd5-4ceaf18c1cc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee08669273884692921efd6e76fdb852)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:39.568130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c963a-e61b-45ec-bcd5-4ceaf18c1cc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:39.579054 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3284/6605] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:39 2022] GET /identity/v3/projects/ee08669273884692921efd6e76fdb852 => generated 360 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:39.579967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c963a-e61b-45ec-bcd5-4ceaf18c1cc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:39.587691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f17c963a-e61b-45ec-bcd5-4ceaf18c1cc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:39.668128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbadb3-8bf2-4a29-b4b9-429a8b3b2d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:39.668768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbadb3-8bf2-4a29-b4b9-429a8b3b2d24 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:39.669050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbadb3-8bf2-4a29-b4b9-429a8b3b2d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:39.669321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbadb3-8bf2-4a29-b4b9-429a8b3b2d24 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:39.669963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbadb3-8bf2-4a29-b4b9-429a8b3b2d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:39.671942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbadb3-8bf2-4a29-b4b9-429a8b3b2d24 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:39.755771 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3322/6606] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:39 2022] POST /identity/v3/users => generated 284 bytes in 634 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:39.757179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbadb3-8bf2-4a29-b4b9-429a8b3b2d24 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:39.811541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbadb3-8bf2-4a29-b4b9-429a8b3b2d24 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:39.821075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c963a-e61b-45ec-bcd5-4ceaf18c1cc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:39.821422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:39.822269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:39.822836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:39.823481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/ee08669273884692921efd6e76fdb852` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:39.824777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee08669273884692921efd6e76fdb852)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:39.827542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:39.833116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:39.833785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:39.834658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:39.840287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] PATH_INFO: `/v3/projects/217b510c8e524248a6becd6292b79b15` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:39.843680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] RBAC: Authorizing `identity:delete_project(project_id=217b510c8e524248a6becd6292b79b15)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:39.855591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:39.934798 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:39.954414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee08669273884692921efd6e76fdb852', 'request_id': 'req-0645f7ee-0d67-40c6-8d08-fefe18d5681a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:39.969239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee08669273884692921efd6e76fdb852', 'request_id': 'req-0645f7ee-0d67-40c6-8d08-fefe18d5681a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:39.983783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee08669273884692921efd6e76fdb852', 'request_id': 'req-0645f7ee-0d67-40c6-8d08-fefe18d5681a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:39.996446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217b510c8e524248a6becd6292b79b15', 'request_id': 'req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:40.014577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project ee08669273884692921efd6e76fdb852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:40.014897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:40.017707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:40.018929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217b510c8e524248a6becd6292b79b15', 'request_id': 'req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:40.025444 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3323/6607] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:39 2022] DELETE /identity/v3/projects/ee08669273884692921efd6e76fdb852 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:40.027678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:40.034161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:40.037289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217b510c8e524248a6becd6292b79b15', 'request_id': 'req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:40.062758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] The token cache is being invalidate because project 217b510c8e524248a6becd6292b79b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:40.063053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:40.063861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:40.069671 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3285/6608] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:39 2022] DELETE /identity/v3/projects/217b510c8e524248a6becd6292b79b15 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:40.071018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:40.072711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:40.194501 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:40.283127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645f7ee-0d67-40c6-8d08-fefe18d5681a tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:40.314224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28a1a3-1fd6-4dfb-8d60-862749f1911b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:40.333275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10c8bc-6ef4-4a6e-a8ed-b3d76d006f59 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:40.335788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10c8bc-6ef4-4a6e-a8ed-b3d76d006f59 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:40.336079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10c8bc-6ef4-4a6e-a8ed-b3d76d006f59 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:40.336360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10c8bc-6ef4-4a6e-a8ed-b3d76d006f59 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:40.340833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10c8bc-6ef4-4a6e-a8ed-b3d76d006f59 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:40.344758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10c8bc-6ef4-4a6e-a8ed-b3d76d006f59 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:40.442084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3286/6609] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:30:40 2022] POST /identity/v3/projects => generated 348 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:40.446448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8137b9-c0e7-4649-8fc3-de4c99735093 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:40.447248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8137b9-c0e7-4649-8fc3-de4c99735093 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:40.447248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8137b9-c0e7-4649-8fc3-de4c99735093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:40.463215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bc7e0-0abf-4e41-98f8-78b74bab6289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:40.465594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bc7e0-0abf-4e41-98f8-78b74bab6289 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:40.465880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bc7e0-0abf-4e41-98f8-78b74bab6289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:40.466155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bc7e0-0abf-4e41-98f8-78b74bab6289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:40.467009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bc7e0-0abf-4e41-98f8-78b74bab6289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:40.473213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bc7e0-0abf-4e41-98f8-78b74bab6289 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:40.497818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9a8137b9-c0e7-4649-8fc3-de4c99735093 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:40.500073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9a8137b9-c0e7-4649-8fc3-de4c99735093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:40.510319 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3324/6610] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:40.511673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bc7e0-0abf-4e41-98f8-78b74bab6289 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:40.553831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bc7e0-0abf-4e41-98f8-78b74bab6289 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:40.695761 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3287/6611] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:40.696456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8137b9-c0e7-4649-8fc3-de4c99735093 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:40.703048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9a8137b9-c0e7-4649-8fc3-de4c99735093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:40.748159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8137b9-c0e7-4649-8fc3-de4c99735093 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:40.762030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca9501-ee79-466a-abe9-f87496fcadcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:40.762690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9501-ee79-466a-abe9-f87496fcadcc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:40.765123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9501-ee79-466a-abe9-f87496fcadcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:40.765427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9501-ee79-466a-abe9-f87496fcadcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:40.766099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca9501-ee79-466a-abe9-f87496fcadcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:40.767961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca9501-ee79-466a-abe9-f87496fcadcc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:40.771432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789521-b4f1-4c1e-82cc-40dd39a2ec90 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:40.772131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789521-b4f1-4c1e-82cc-40dd39a2ec90 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:40.772421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789521-b4f1-4c1e-82cc-40dd39a2ec90 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:40.772695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789521-b4f1-4c1e-82cc-40dd39a2ec90 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/08d5412a19f949838699a69afef20741` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:40.774920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789521-b4f1-4c1e-82cc-40dd39a2ec90 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:get_project(project_id=08d5412a19f949838699a69afef20741)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:40.780292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789521-b4f1-4c1e-82cc-40dd39a2ec90 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:40.782064 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3325/6612] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:40 2022] GET /identity/v3/projects/08d5412a19f949838699a69afef20741 => generated 348 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:40.783265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc6022-cb39-4c35-b627-57fb7cc4a35a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:40.783554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc6022-cb39-4c35-b627-57fb7cc4a35a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:40.783829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc6022-cb39-4c35-b627-57fb7cc4a35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:40.797637 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3288/6613] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:40.798562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca9501-ee79-466a-abe9-f87496fcadcc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:40.833070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca9501-ee79-466a-abe9-f87496fcadcc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:40.835929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a2fc6022-cb39-4c35-b627-57fb7cc4a35a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:40.837152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a2fc6022-cb39-4c35-b627-57fb7cc4a35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:40.845072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:40.845721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:40.846004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:40.846285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/08d5412a19f949838699a69afef20741` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:40.847841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=08d5412a19f949838699a69afef20741)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:40.850209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:40.864478 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3326/6614] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:40.865335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc6022-cb39-4c35-b627-57fb7cc4a35a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:40.891302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc6022-cb39-4c35-b627-57fb7cc4a35a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:40.918544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde7d14-4b65-4a29-8610-6f7b339f88db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:40.919265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde7d14-4b65-4a29-8610-6f7b339f88db admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:40.919551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde7d14-4b65-4a29-8610-6f7b339f88db admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:40.919836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde7d14-4b65-4a29-8610-6f7b339f88db admin admin] PATH_INFO: `/v3/projects/e06ae85b26d04f21a0948ecca3972e91/users/476a6c3b472d48fd8f879258cc10df5e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:40.946307 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:40.965209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde7d14-4b65-4a29-8610-6f7b339f88db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06ae85b26d04f21a0948ecca3972e91, user_id=476a6c3b472d48fd8f879258cc10df5e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:40.975403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde7d14-4b65-4a29-8610-6f7b339f88db admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:40.990575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d5412a19f949838699a69afef20741', 'request_id': 'req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:41.032142 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3327/6615] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:40 2022] PUT /identity/v3/projects/e06ae85b26d04f21a0948ecca3972e91/users/476a6c3b472d48fd8f879258cc10df5e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:41.034377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde7d14-4b65-4a29-8610-6f7b339f88db admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:41.039084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d5412a19f949838699a69afef20741', 'request_id': 'req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:41.141359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d5412a19f949838699a69afef20741', 'request_id': 'req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:41.258799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project 08d5412a19f949838699a69afef20741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:41.261426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:41.268471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0a1224b-e774-4f28-87a8-fffbd4dbe6d9 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:41.283678 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3289/6616] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:40 2022] DELETE /identity/v3/projects/08d5412a19f949838699a69afef20741 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:41.292180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c576f9-6062-44af-8f14-3b75bea64eaa None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:41.292348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c576f9-6062-44af-8f14-3b75bea64eaa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:41.292734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c576f9-6062-44af-8f14-3b75bea64eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:41.398417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-54c576f9-6062-44af-8f14-3b75bea64eaa None None] MFA Rules not processed for user `476a6c3b472d48fd8f879258cc10df5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:41.402822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-54c576f9-6062-44af-8f14-3b75bea64eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:41.429308 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:41.485251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde7d14-4b65-4a29-8610-6f7b339f88db admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:41.497010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50910cd-b7d1-4397-ba75-d1a8ed78caaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:41.497756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50910cd-b7d1-4397-ba75-d1a8ed78caaf admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:41.498069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50910cd-b7d1-4397-ba75-d1a8ed78caaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:41.498413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50910cd-b7d1-4397-ba75-d1a8ed78caaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:41.502845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50910cd-b7d1-4397-ba75-d1a8ed78caaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:41.503228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50910cd-b7d1-4397-ba75-d1a8ed78caaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:41.505063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50910cd-b7d1-4397-ba75-d1a8ed78caaf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:41.535829 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3328/6617] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:41.536785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50910cd-b7d1-4397-ba75-d1a8ed78caaf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:41.538639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e50910cd-b7d1-4397-ba75-d1a8ed78caaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:41.727341 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3290/6618] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:41.731992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c576f9-6062-44af-8f14-3b75bea64eaa None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:41.745984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-54c576f9-6062-44af-8f14-3b75bea64eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:41.776315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c576f9-6062-44af-8f14-3b75bea64eaa None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:41.790242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50910cd-b7d1-4397-ba75-d1a8ed78caaf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:41.794088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6357de7-b820-4f63-a80c-0c437c5d2112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:41.795600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357de7-b820-4f63-a80c-0c437c5d2112 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:41.797439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357de7-b820-4f63-a80c-0c437c5d2112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:41.798077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357de7-b820-4f63-a80c-0c437c5d2112 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:41.801274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6357de7-b820-4f63-a80c-0c437c5d2112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:41.806654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6357de7-b820-4f63-a80c-0c437c5d2112 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:41.807505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d196a5-a5ae-43b1-b11d-d1ef1008c8cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:41.808143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d196a5-a5ae-43b1-b11d-d1ef1008c8cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:41.808429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d196a5-a5ae-43b1-b11d-d1ef1008c8cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:41.808706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d196a5-a5ae-43b1-b11d-d1ef1008c8cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:41.809954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d196a5-a5ae-43b1-b11d-d1ef1008c8cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:41.813426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d196a5-a5ae-43b1-b11d-d1ef1008c8cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:41.851708 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3329/6619] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:30:41 2022] POST /identity/v3/domains => generated 275 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:41.852820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d196a5-a5ae-43b1-b11d-d1ef1008c8cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:41.855241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b5d196a5-a5ae-43b1-b11d-d1ef1008c8cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:41.864156 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3291/6620] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:41 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:41.865104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6357de7-b820-4f63-a80c-0c437c5d2112 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:41.867125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a6357de7-b820-4f63-a80c-0c437c5d2112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:41.984106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6357de7-b820-4f63-a80c-0c437c5d2112 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:42.008260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:42.008930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:42.009217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:42.009498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] PATH_INFO: `/v3/users/80154b381d5f4e8594b817e4ea2995f2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:42.019662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80154b381d5f4e8594b817e4ea2995f2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:42.032159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:42.033219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d196a5-a5ae-43b1-b11d-d1ef1008c8cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:42.047877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27f57-db28-47a4-a986-93d62bcba876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:42.048549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27f57-db28-47a4-a986-93d62bcba876 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:42.048839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27f57-db28-47a4-a986-93d62bcba876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:42.049117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27f57-db28-47a4-a986-93d62bcba876 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:42.051041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27f57-db28-47a4-a986-93d62bcba876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:42.054016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27f57-db28-47a4-a986-93d62bcba876 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:42.116507 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:42.116895 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3330/6621] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:41 2022] POST /identity/v3/projects => generated 367 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:42.117828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27f57-db28-47a4-a986-93d62bcba876 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:42.168911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80154b381d5f4e8594b817e4ea2995f2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:42.199993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80154b381d5f4e8594b817e4ea2995f2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:42.201019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80154b381d5f4e8594b817e4ea2995f2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:42.221555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80154b381d5f4e8594b817e4ea2995f2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:42.232827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80154b381d5f4e8594b817e4ea2995f2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:42.248086 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3292/6622] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:41 2022] DELETE /identity/v3/users/80154b381d5f4e8594b817e4ea2995f2 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:42.255185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:42.258447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:42.361420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27f57-db28-47a4-a986-93d62bcba876 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:42.390093 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:42.449200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bcd44-20c5-48c0-b06f-470ce37ca95a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:42.464467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aeecab-172b-4efc-8bb5-a41938152773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:42.465253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeecab-172b-4efc-8bb5-a41938152773 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:42.465540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeecab-172b-4efc-8bb5-a41938152773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:42.465817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeecab-172b-4efc-8bb5-a41938152773 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:42.466465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aeecab-172b-4efc-8bb5-a41938152773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:42.472611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aeecab-172b-4efc-8bb5-a41938152773 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:42.522361 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3293/6623] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:42 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:42.523239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aeecab-172b-4efc-8bb5-a41938152773 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:42.527434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-13aeecab-172b-4efc-8bb5-a41938152773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:42.541959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792c045-71a7-4ef3-b81b-43b63ff2cdcd tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:42.542824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792c045-71a7-4ef3-b81b-43b63ff2cdcd tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:42.543068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792c045-71a7-4ef3-b81b-43b63ff2cdcd tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:42.543349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792c045-71a7-4ef3-b81b-43b63ff2cdcd tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:42.544067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792c045-71a7-4ef3-b81b-43b63ff2cdcd tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:42.546342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aeecab-172b-4efc-8bb5-a41938152773 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:42.546722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792c045-71a7-4ef3-b81b-43b63ff2cdcd tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:42.552826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa0384-a85d-4f8f-8ce6-4718f365f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:42.553457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa0384-a85d-4f8f-8ce6-4718f365f3ce admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:42.554772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa0384-a85d-4f8f-8ce6-4718f365f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:42.554772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa0384-a85d-4f8f-8ce6-4718f365f3ce admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:42.556234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa0384-a85d-4f8f-8ce6-4718f365f3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:42.560797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa0384-a85d-4f8f-8ce6-4718f365f3ce admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:42.631772 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3294/6624] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:42 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:42.634634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab3f4-ae5e-4dff-8cf7-07fab85f858b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:42.635984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab3f4-ae5e-4dff-8cf7-07fab85f858b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:42.637482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab3f4-ae5e-4dff-8cf7-07fab85f858b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:42.656093 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3331/6625] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:42 2022] POST /identity/v3/projects => generated 404 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:42.657865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792c045-71a7-4ef3-b81b-43b63ff2cdcd tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:42.688566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6b8ab3f4-ae5e-4dff-8cf7-07fab85f858b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:42.692891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b8ab3f4-ae5e-4dff-8cf7-07fab85f858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:42.854433 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3295/6626] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:42.856061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ab3f4-ae5e-4dff-8cf7-07fab85f858b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:42.858486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b8ab3f4-ae5e-4dff-8cf7-07fab85f858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:42.891762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ab3f4-ae5e-4dff-8cf7-07fab85f858b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:42.893174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792c045-71a7-4ef3-b81b-43b63ff2cdcd tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:42.904220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:42.906507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:42.909688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:42.910253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] PATH_INFO: `/v3/users/5fe4c75f10d7402c9e7f0b14b4f7015d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:42.914517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe4c75f10d7402c9e7f0b14b4f7015d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:42.917766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846fd26-3cf6-4523-b658-6c064fb4adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:42.918415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846fd26-3cf6-4523-b658-6c064fb4adf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:42.918725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846fd26-3cf6-4523-b658-6c064fb4adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:42.919002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846fd26-3cf6-4523-b658-6c064fb4adf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:42.921334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:42.926754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846fd26-3cf6-4523-b658-6c064fb4adf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:42.933755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846fd26-3cf6-4523-b658-6c064fb4adf7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:42.951286 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=6,keystone:SELECT=87,keystone:INSERT=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:42.972443 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3332/6627] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:42.973293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846fd26-3cf6-4523-b658-6c064fb4adf7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:43.009035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846fd26-3cf6-4523-b658-6c064fb4adf7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:43.031490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76244a-c975-4ce2-ac3d-999a855f0ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:43.032266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76244a-c975-4ce2-ac3d-999a855f0ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:43.032551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76244a-c975-4ce2-ac3d-999a855f0ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:43.032820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76244a-c975-4ce2-ac3d-999a855f0ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:43.033917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76244a-c975-4ce2-ac3d-999a855f0ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:43.035809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76244a-c975-4ce2-ac3d-999a855f0ef6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:43.058552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe4c75f10d7402c9e7f0b14b4f7015d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:43.071139 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3333/6628] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:43.071912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76244a-c975-4ce2-ac3d-999a855f0ef6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:43.081629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7a76244a-c975-4ce2-ac3d-999a855f0ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:43.088183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe4c75f10d7402c9e7f0b14b4f7015d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:43.089263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe4c75f10d7402c9e7f0b14b4f7015d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:43.109177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe4c75f10d7402c9e7f0b14b4f7015d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:43.126349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe4c75f10d7402c9e7f0b14b4f7015d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:43.142540 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3296/6629] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:42 2022] DELETE /identity/v3/users/5fe4c75f10d7402c9e7f0b14b4f7015d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:43.146021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:43.149237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:43.287604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858c12-87ef-4713-882a-9d198e00e1be admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:43.292743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84362bb0-0475-4a56-9eb5-ab0530ee75cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:43.293562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84362bb0-0475-4a56-9eb5-ab0530ee75cc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:43.293998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84362bb0-0475-4a56-9eb5-ab0530ee75cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:43.294281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84362bb0-0475-4a56-9eb5-ab0530ee75cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:43.298324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-84362bb0-0475-4a56-9eb5-ab0530ee75cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:43.333516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76244a-c975-4ce2-ac3d-999a855f0ef6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:43.387503 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:43.476432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84362bb0-0475-4a56-9eb5-ab0530ee75cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:43.483281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84362bb0-0475-4a56-9eb5-ab0530ee75cc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:43.497177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce49e0-0cc5-450b-b1cc-c60d3e9f55b0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:43.497790 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3297/6630] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:43.498761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84362bb0-0475-4a56-9eb5-ab0530ee75cc service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:43.499609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce49e0-0cc5-450b-b1cc-c60d3e9f55b0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:43.499922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce49e0-0cc5-450b-b1cc-c60d3e9f55b0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:43.500190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce49e0-0cc5-450b-b1cc-c60d3e9f55b0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/d75d412275924ab68473cd956f8ff8d3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:43.500514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-84362bb0-0475-4a56-9eb5-ab0530ee75cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:43.502254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce49e0-0cc5-450b-b1cc-c60d3e9f55b0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:get_project(project_id=d75d412275924ab68473cd956f8ff8d3)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:43.506809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce49e0-0cc5-450b-b1cc-c60d3e9f55b0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:43.513089 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3334/6631] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:43 2022] GET /identity/v3/projects/d75d412275924ab68473cd956f8ff8d3 => generated 404 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:43.514177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce49e0-0cc5-450b-b1cc-c60d3e9f55b0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:43.520199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84362bb0-0475-4a56-9eb5-ab0530ee75cc service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:43.531717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f7ce49e0-0cc5-450b-b1cc-c60d3e9f55b0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:43.537896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05e42c-4b74-4b38-b773-9ee8c897a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:43.538537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e42c-4b74-4b38-b773-9ee8c897a7ee admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:43.538907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e42c-4b74-4b38-b773-9ee8c897a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:43.539192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e42c-4b74-4b38-b773-9ee8c897a7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:43.539864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05e42c-4b74-4b38-b773-9ee8c897a7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:43.542858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05e42c-4b74-4b38-b773-9ee8c897a7ee admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:43.561469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce49e0-0cc5-450b-b1cc-c60d3e9f55b0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:43.577846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476984a-aa57-47c2-b04a-16c1d5cef357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:43.578777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476984a-aa57-47c2-b04a-16c1d5cef357 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:43.579021 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3298/6632] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:43.579140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476984a-aa57-47c2-b04a-16c1d5cef357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:43.579502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476984a-aa57-47c2-b04a-16c1d5cef357 admin admin] PATH_INFO: `/v3/projects/43f67e5c3aac411082aaedbe79759b24/users/5536a53cb9bd4e3f8539401997e1cd43/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:43.580630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633326b3-1ceb-4ae5-9536-1df4eda3998a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:43.580926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633326b3-1ceb-4ae5-9536-1df4eda3998a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:43.581208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633326b3-1ceb-4ae5-9536-1df4eda3998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:43.628405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-633326b3-1ceb-4ae5-9536-1df4eda3998a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:43.638864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-633326b3-1ceb-4ae5-9536-1df4eda3998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:43.639028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476984a-aa57-47c2-b04a-16c1d5cef357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f67e5c3aac411082aaedbe79759b24, user_id=5536a53cb9bd4e3f8539401997e1cd43, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:43.639028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476984a-aa57-47c2-b04a-16c1d5cef357 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:43.661195 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3299/6633] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:43.662392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633326b3-1ceb-4ae5-9536-1df4eda3998a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:43.671313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-633326b3-1ceb-4ae5-9536-1df4eda3998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:43.711860 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3335/6634] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:43 2022] PUT /identity/v3/projects/43f67e5c3aac411082aaedbe79759b24/users/5536a53cb9bd4e3f8539401997e1cd43/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:43.716048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476984a-aa57-47c2-b04a-16c1d5cef357 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:43.718366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633326b3-1ceb-4ae5-9536-1df4eda3998a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:43.770958 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:43.942664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:43.943350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:43.945816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:43.948039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/d75d412275924ab68473cd956f8ff8d3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:43.957764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d75d412275924ab68473cd956f8ff8d3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:43.962175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476984a-aa57-47c2-b04a-16c1d5cef357 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:43.967354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:43.983879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c0b7-acca-427d-91be-f829b23085a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:43.984570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c0b7-acca-427d-91be-f829b23085a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:43.984852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c0b7-acca-427d-91be-f829b23085a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:43.985123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c0b7-acca-427d-91be-f829b23085a1 admin admin] PATH_INFO: `/v3/projects/8c7d0ffa32384024981901a5da42947e/users/4d57de79d3944dc08f20c7a4e2a41827/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:44.027937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586c0b7-acca-427d-91be-f829b23085a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7d0ffa32384024981901a5da42947e, user_id=4d57de79d3944dc08f20c7a4e2a41827, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:44.031305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586c0b7-acca-427d-91be-f829b23085a1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:44.083382 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3336/6635] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:43 2022] PUT /identity/v3/projects/8c7d0ffa32384024981901a5da42947e/users/4d57de79d3944dc08f20c7a4e2a41827/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:44.085020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c0b7-acca-427d-91be-f829b23085a1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:44.108845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75d412275924ab68473cd956f8ff8d3', 'request_id': 'req-f6d77584-ed68-4a1c-a7bf-6583b8343498'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.125029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75d412275924ab68473cd956f8ff8d3', 'request_id': 'req-f6d77584-ed68-4a1c-a7bf-6583b8343498'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.139263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75d412275924ab68473cd956f8ff8d3', 'request_id': 'req-f6d77584-ed68-4a1c-a7bf-6583b8343498'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.168320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project d75d412275924ab68473cd956f8ff8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:44.168628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.169321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.175547 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3300/6636] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:43 2022] DELETE /identity/v3/projects/d75d412275924ab68473cd956f8ff8d3 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:44.175547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:44.175811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:44.205325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c0b7-acca-427d-91be-f829b23085a1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:44.277299 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:44.308965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d77584-ed68-4a1c-a7bf-6583b8343498 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:44.323076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddc5c5-6514-4582-ba3f-d44a331973fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:44.324801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85afffa-e8ec-4b61-af36-6cb14bd88c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:44.325553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc5c5-6514-4582-ba3f-d44a331973fe service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:44.325742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85afffa-e8ec-4b61-af36-6cb14bd88c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:44.326089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85afffa-e8ec-4b61-af36-6cb14bd88c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:44.326452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85afffa-e8ec-4b61-af36-6cb14bd88c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:44.327623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc5c5-6514-4582-ba3f-d44a331973fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:44.328080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc5c5-6514-4582-ba3f-d44a331973fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:44.328202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85afffa-e8ec-4b61-af36-6cb14bd88c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:44.329946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85afffa-e8ec-4b61-af36-6cb14bd88c0c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:44.333567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4cddc5c5-6514-4582-ba3f-d44a331973fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:44.346692 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3337/6637] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:44.348413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfae6f-5701-4488-b358-45dd965d127b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:44.348771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfae6f-5701-4488-b358-45dd965d127b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:44.349124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfae6f-5701-4488-b358-45dd965d127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:44.372158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddc5c5-6514-4582-ba3f-d44a331973fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:44.374054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddc5c5-6514-4582-ba3f-d44a331973fe service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:44.390585 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3301/6638] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:44.391554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddc5c5-6514-4582-ba3f-d44a331973fe service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:44.395767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4cddc5c5-6514-4582-ba3f-d44a331973fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:44.404278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c9dfae6f-5701-4488-b358-45dd965d127b None None] MFA Rules not processed for user `4d57de79d3944dc08f20c7a4e2a41827`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:44.407518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c9dfae6f-5701-4488-b358-45dd965d127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:44.415816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddc5c5-6514-4582-ba3f-d44a331973fe service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:44.421501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:44.423237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:44.423528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:44.423808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] PATH_INFO: `/v3/projects/acd9c14e9d064f8a959c304ca86d41c0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:44.425667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd9c14e9d064f8a959c304ca86d41c0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:44.428435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:44.518543 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:44.524186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd9c14e9d064f8a959c304ca86d41c0', 'request_id': 'req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.536377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd9c14e9d064f8a959c304ca86d41c0', 'request_id': 'req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.549776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd9c14e9d064f8a959c304ca86d41c0', 'request_id': 'req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.580728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] The token cache is being invalidate because project acd9c14e9d064f8a959c304ca86d41c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:44.580728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.581091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.587671 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3302/6639] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:44 2022] DELETE /identity/v3/projects/acd9c14e9d064f8a959c304ca86d41c0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:44.590402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:44.592398 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3338/6640] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:44.593502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:44.594542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfae6f-5701-4488-b358-45dd965d127b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:44.597578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c9dfae6f-5701-4488-b358-45dd965d127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:44.624785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfae6f-5701-4488-b358-45dd965d127b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:44.728677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ccfde-67c9-46bc-8fcd-11c91440cbe3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:44.754275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:44.757593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:44.757888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:44.758179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/domains/f4aa04fe531c46b1b3ababfcf5d06708` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:44.763254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050bc28-843d-4d6b-b1e0-e514c9f28312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:44.763575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f4aa04fe531c46b1b3ababfcf5d06708)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:44.763942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050bc28-843d-4d6b-b1e0-e514c9f28312 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:44.764221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050bc28-843d-4d6b-b1e0-e514c9f28312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:44.764493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050bc28-843d-4d6b-b1e0-e514c9f28312 admin admin] PATH_INFO: `/v3/projects/43f67e5c3aac411082aaedbe79759b24/users/5536a53cb9bd4e3f8539401997e1cd43/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:44.766968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:44.771558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050bc28-843d-4d6b-b1e0-e514c9f28312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f67e5c3aac411082aaedbe79759b24, user_id=5536a53cb9bd4e3f8539401997e1cd43, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:44.775058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050bc28-843d-4d6b-b1e0-e514c9f28312 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:44.794798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.795452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.808688 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3339/6641] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:44 2022] PUT /identity/v3/projects/43f67e5c3aac411082aaedbe79759b24/users/5536a53cb9bd4e3f8539401997e1cd43/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:44.820628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050bc28-843d-4d6b-b1e0-e514c9f28312 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:44.823586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d050bc28-843d-4d6b-b1e0-e514c9f28312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:44.841786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.842417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:44.846178 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3303/6642] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:30:44 2022] PATCH /identity/v3/domains/f4aa04fe531c46b1b3ababfcf5d06708 => generated 276 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:44.847278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:44.850395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:44.922666 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:44.955747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050bc28-843d-4d6b-b1e0-e514c9f28312 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:45.026445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a967d1-877e-4807-bab7-aa1bda90ecc6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:45.032004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e4ef1-27d0-45e8-8136-b6d5a92bcbfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:45.033225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e4ef1-27d0-45e8-8136-b6d5a92bcbfb service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:45.033703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e4ef1-27d0-45e8-8136-b6d5a92bcbfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:45.034477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e4ef1-27d0-45e8-8136-b6d5a92bcbfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:45.037161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-046e4ef1-27d0-45e8-8136-b6d5a92bcbfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:45.066794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:45.067527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:45.068553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:45.073470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] PATH_INFO: `/v3/users/af52ff64992f48e691c2c45846b9998a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:45.074625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af52ff64992f48e691c2c45846b9998a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:45.080363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:45.193672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af52ff64992f48e691c2c45846b9998a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.207042 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:45.214328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e4ef1-27d0-45e8-8136-b6d5a92bcbfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:45.216338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e4ef1-27d0-45e8-8136-b6d5a92bcbfb service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:45.231240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af52ff64992f48e691c2c45846b9998a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.235299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af52ff64992f48e691c2c45846b9998a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.240293 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3304/6643] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:45.241892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49cf46-2329-4733-a9df-acc8abfbc13f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:45.242282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49cf46-2329-4733-a9df-acc8abfbc13f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:45.243098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49cf46-2329-4733-a9df-acc8abfbc13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:45.263318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af52ff64992f48e691c2c45846b9998a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.264977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af52ff64992f48e691c2c45846b9998a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.316000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ce49cf46-2329-4733-a9df-acc8abfbc13f None None] MFA Rules not processed for user `5536a53cb9bd4e3f8539401997e1cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:45.317464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ce49cf46-2329-4733-a9df-acc8abfbc13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:45.336938 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3340/6644] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:44 2022] DELETE /identity/v3/users/af52ff64992f48e691c2c45846b9998a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:45.338631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:45.343489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:45.565055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facc46f-28ce-4bc9-9719-6c68c2dcbe15 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:45.575318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:45.576230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:45.576419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:45.576674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/domains/f4aa04fe531c46b1b3ababfcf5d06708` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:45.580242 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3305/6645] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:45.581672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49cf46-2329-4733-a9df-acc8abfbc13f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:45.586393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ce49cf46-2329-4733-a9df-acc8abfbc13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:45.600350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f4aa04fe531c46b1b3ababfcf5d06708)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:45.602150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:45.618892 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:45.623238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49cf46-2329-4733-a9df-acc8abfbc13f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:45.653040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.659322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.760275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708', 'request_id': 'req-75eb6e68-3ab2-45cf-901a-579546b06408'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.771792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:45.772591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:45.773466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:45.774035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] PATH_INFO: `/v3/projects/0814a76aa84a4b3e8f308a80279b2393` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:45.776398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708', 'request_id': 'req-75eb6e68-3ab2-45cf-901a-579546b06408'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.779613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0814a76aa84a4b3e8f308a80279b2393)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:45.785554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:45.792641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708', 'request_id': 'req-75eb6e68-3ab2-45cf-901a-579546b06408'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.820882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project f4aa04fe531c46b1b3ababfcf5d06708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:45.821299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.822193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.843379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708', 'request_id': 'req-75eb6e68-3ab2-45cf-901a-579546b06408'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.850037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708', 'request_id': 'req-75eb6e68-3ab2-45cf-901a-579546b06408'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.853305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f4aa04fe531c46b1b3ababfcf5d06708', 'request_id': 'req-75eb6e68-3ab2-45cf-901a-579546b06408'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.879690 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3341/6646] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:45 2022] DELETE /identity/v3/domains/f4aa04fe531c46b1b3ababfcf5d06708 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:45.879690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:45.881905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:45.915544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0814a76aa84a4b3e8f308a80279b2393', 'request_id': 'req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.928432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0814a76aa84a4b3e8f308a80279b2393', 'request_id': 'req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.940400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0814a76aa84a4b3e8f308a80279b2393', 'request_id': 'req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.986040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] The token cache is being invalidate because project 0814a76aa84a4b3e8f308a80279b2393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:45.990049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:45.993193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:46.003310 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3306/6647] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:45 2022] DELETE /identity/v3/projects/0814a76aa84a4b3e8f308a80279b2393 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:46.004324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:46.005841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:46.057667 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:46.087019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb6e68-3ab2-45cf-901a-579546b06408 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:46.228540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ffb71-4d82-4d04-9c82-44be0bd3815c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:46.230949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875261fc-23de-404c-8875-35d991d0b1c7 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:46.231660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875261fc-23de-404c-8875-35d991d0b1c7 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:46.232018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875261fc-23de-404c-8875-35d991d0b1c7 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:46.232366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875261fc-23de-404c-8875-35d991d0b1c7 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:46.233394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875261fc-23de-404c-8875-35d991d0b1c7 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:46.236129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a78231-03bb-4ab2-99ee-223595ca8083 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:46.236801 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-875261fc-23de-404c-8875-35d991d0b1c7 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:46.236801 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:30:46.236801 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:30:46.237714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a78231-03bb-4ab2-99ee-223595ca8083 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:46.237714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a78231-03bb-4ab2-99ee-223595ca8083 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:46.238039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a78231-03bb-4ab2-99ee-223595ca8083 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:46.238527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875261fc-23de-404c-8875-35d991d0b1c7 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:46.239222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a78231-03bb-4ab2-99ee-223595ca8083 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:46.242017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a78231-03bb-4ab2-99ee-223595ca8083 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:46.250391 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:46.285675 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3342/6648] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:30:45 2022] POST /identity/v3/regions => generated 224 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:46.288925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875261fc-23de-404c-8875-35d991d0b1c7 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:46.294180 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3307/6649] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:30:46 2022] POST /identity/v3/domains => generated 276 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:46.295574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-875261fc-23de-404c-8875-35d991d0b1c7 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:46.296586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a78231-03bb-4ab2-99ee-223595ca8083 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:46.300868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-99a78231-03bb-4ab2-99ee-223595ca8083 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:46.485898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875261fc-23de-404c-8875-35d991d0b1c7 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:46.518100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a78231-03bb-4ab2-99ee-223595ca8083 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:46.545094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325ced1-f49f-4f16-b251-ddbfe931c45b tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:46.545743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325ced1-f49f-4f16-b251-ddbfe931c45b tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:46.546251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325ced1-f49f-4f16-b251-ddbfe931c45b tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:46.546495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325ced1-f49f-4f16-b251-ddbfe931c45b tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:46.547588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325ced1-f49f-4f16-b251-ddbfe931c45b tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:46.548635 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-9325ced1-f49f-4f16-b251-ddbfe931c45b tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:46.548635 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:30:46.548635 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:30:46.549554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325ced1-f49f-4f16-b251-ddbfe931c45b tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:46.586493 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3308/6650] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:30:46 2022] POST /identity/v3/regions => generated 223 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:46.587614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325ced1-f49f-4f16-b251-ddbfe931c45b tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:46.630125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:46.631568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:46.632028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:46.632624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] PATH_INFO: `/v3/users/757dcf027c394ba4b3a96dbf39fd135a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:46.633844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757dcf027c394ba4b3a96dbf39fd135a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:46.637432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:46.696677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325ced1-f49f-4f16-b251-ddbfe931c45b tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:46.705939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae99de-de15-4f96-8982-fa22209645c0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:46.706383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae99de-de15-4f96-8982-fa22209645c0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:46.706692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae99de-de15-4f96-8982-fa22209645c0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:46.706972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae99de-de15-4f96-8982-fa22209645c0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:46.707832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae99de-de15-4f96-8982-fa22209645c0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:46.710365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae99de-de15-4f96-8982-fa22209645c0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:46.714370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757dcf027c394ba4b3a96dbf39fd135a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:46.729872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757dcf027c394ba4b3a96dbf39fd135a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:46.730910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757dcf027c394ba4b3a96dbf39fd135a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:46.750342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757dcf027c394ba4b3a96dbf39fd135a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:46.751364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757dcf027c394ba4b3a96dbf39fd135a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:46.766384 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:46.769173 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:46.791286 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3309/6651] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:46 2022] POST /identity/v3/projects => generated 410 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:46.792472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae99de-de15-4f96-8982-fa22209645c0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:46.796387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-faae99de-de15-4f96-8982-fa22209645c0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:46.812252 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3343/6652] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:46 2022] DELETE /identity/v3/users/757dcf027c394ba4b3a96dbf39fd135a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:46.813810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:46.815862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:46.943821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b2b8d-2bdf-43a1-bf42-2eb15014d1b3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:46.986982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae99de-de15-4f96-8982-fa22209645c0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:46.999513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:46.999776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:47.000365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:47.000498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] PATH_INFO: `/v3/projects/33412b3a439a49799bc77800e1bc6e5e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:47.002527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33412b3a439a49799bc77800e1bc6e5e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:47.005227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:47.041563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26c710-0978-4cbf-af4f-6fbc008048f6 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:47.042698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26c710-0978-4cbf-af4f-6fbc008048f6 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:47.043493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26c710-0978-4cbf-af4f-6fbc008048f6 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:47.043879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26c710-0978-4cbf-af4f-6fbc008048f6 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions/a19deb6b-00c7-42ca-8f38-d6ae93285dc4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:47.044762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26c710-0978-4cbf-af4f-6fbc008048f6 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:create_region(region_id=a19deb6b-00c7-42ca-8f38-d6ae93285dc4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:47.046454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26c710-0978-4cbf-af4f-6fbc008048f6 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:47.078505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33412b3a439a49799bc77800e1bc6e5e', 'request_id': 'req-0420cc43-f8c9-4115-9fc3-ed55d6823699'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:47.079605 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3344/6653] 10.222.0.23 () {60 vars in 1259 bytes} [Sun Oct 2 01:30:46 2022] PUT /identity/v3/regions/a19deb6b-00c7-42ca-8f38-d6ae93285dc4 => generated 231 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:47.081195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26c710-0978-4cbf-af4f-6fbc008048f6 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:47.083734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2b26c710-0978-4cbf-af4f-6fbc008048f6 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:47.085676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33412b3a439a49799bc77800e1bc6e5e', 'request_id': 'req-0420cc43-f8c9-4115-9fc3-ed55d6823699'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:47.093777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33412b3a439a49799bc77800e1bc6e5e', 'request_id': 'req-0420cc43-f8c9-4115-9fc3-ed55d6823699'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:47.114888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] The token cache is being invalidate because project 33412b3a439a49799bc77800e1bc6e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:47.115682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:47.116507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:47.119009 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3310/6654] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:46 2022] DELETE /identity/v3/projects/33412b3a439a49799bc77800e1bc6e5e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:47.119926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:47.121506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:47.204582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26c710-0978-4cbf-af4f-6fbc008048f6 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:47.243680 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:47.250180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420cc43-f8c9-4115-9fc3-ed55d6823699 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:47.289501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186f898-f8da-4d31-a3ee-fc4777effc50 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:47.290383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186f898-f8da-4d31-a3ee-fc4777effc50 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:47.290877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186f898-f8da-4d31-a3ee-fc4777effc50 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:47.292854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186f898-f8da-4d31-a3ee-fc4777effc50 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions/a19deb6b-00c7-42ca-8f38-d6ae93285dc4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:47.293579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186f898-f8da-4d31-a3ee-fc4777effc50 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a19deb6b-00c7-42ca-8f38-d6ae93285dc4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:47.295768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186f898-f8da-4d31-a3ee-fc4777effc50 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:47.310789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c942421-ca68-4afd-8cc8-149d015cffaf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:47.311536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c942421-ca68-4afd-8cc8-149d015cffaf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:47.311976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c942421-ca68-4afd-8cc8-149d015cffaf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:47.312661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c942421-ca68-4afd-8cc8-149d015cffaf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:47.314004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c942421-ca68-4afd-8cc8-149d015cffaf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:47.316833 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:47.321292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c942421-ca68-4afd-8cc8-149d015cffaf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:47.333992 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3311/6655] 10.222.0.23 () {58 vars in 1242 bytes} [Sun Oct 2 01:30:47 2022] DELETE /identity/v3/regions/a19deb6b-00c7-42ca-8f38-d6ae93285dc4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:47.333992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbed03f-1107-440f-a013-ab5ab74965f8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:47.333992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbed03f-1107-440f-a013-ab5ab74965f8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:47.333992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbed03f-1107-440f-a013-ab5ab74965f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:47.398187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9cbed03f-1107-440f-a013-ab5ab74965f8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:47.404166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9cbed03f-1107-440f-a013-ab5ab74965f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:47.415800 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3345/6656] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:47 2022] POST /identity/v3/projects => generated 403 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:47.417154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c942421-ca68-4afd-8cc8-149d015cffaf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:47.535522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c942421-ca68-4afd-8cc8-149d015cffaf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:47.543940 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3312/6657] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:47.544937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbed03f-1107-440f-a013-ab5ab74965f8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:47.546380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9cbed03f-1107-440f-a013-ab5ab74965f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:47.578564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8878aa6-90ab-4295-86c5-8c5b21dc3d47 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:47.579269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8878aa6-90ab-4295-86c5-8c5b21dc3d47 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:47.579484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8878aa6-90ab-4295-86c5-8c5b21dc3d47 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:47.581531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8878aa6-90ab-4295-86c5-8c5b21dc3d47 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:47.581531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8878aa6-90ab-4295-86c5-8c5b21dc3d47 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:47.582044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8878aa6-90ab-4295-86c5-8c5b21dc3d47 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:47.612535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbed03f-1107-440f-a013-ab5ab74965f8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:47.623279 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3346/6658] 10.222.0.23 () {60 vars in 1150 bytes} [Sun Oct 2 01:30:47 2022] POST /identity/v3/regions => generated 254 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:47.624770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e552856-bd39-44aa-b830-9296540d7d84 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:47.625064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e552856-bd39-44aa-b830-9296540d7d84 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:47.625342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e552856-bd39-44aa-b830-9296540d7d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:47.671755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3e552856-bd39-44aa-b830-9296540d7d84 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:47.673088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3e552856-bd39-44aa-b830-9296540d7d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:47.769232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:47.770433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:47.771026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:47.771959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/37e45ecf7d4d424abd49473bd415697c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:47.774402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37e45ecf7d4d424abd49473bd415697c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:47.777527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:47.831113 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3347/6659] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:47.836600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e552856-bd39-44aa-b830-9296540d7d84 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:47.894002 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:47.899270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e552856-bd39-44aa-b830-9296540d7d84 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:47.920761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e45ecf7d4d424abd49473bd415697c', 'request_id': 'req-71518ca2-61c7-4284-8e20-090ef4b3e98f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:47.930254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e45ecf7d4d424abd49473bd415697c', 'request_id': 'req-71518ca2-61c7-4284-8e20-090ef4b3e98f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:47.937912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e45ecf7d4d424abd49473bd415697c', 'request_id': 'req-71518ca2-61c7-4284-8e20-090ef4b3e98f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:47.965301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project 37e45ecf7d4d424abd49473bd415697c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:47.965865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:47.967247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:47.972153 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3313/6660] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:47 2022] DELETE /identity/v3/projects/37e45ecf7d4d424abd49473bd415697c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:47.974047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:47.977762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:47.995459 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:48.028689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914e29e-3064-45de-8804-7bcd1701dc85 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:48.028689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914e29e-3064-45de-8804-7bcd1701dc85 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:48.028689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914e29e-3064-45de-8804-7bcd1701dc85 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:48.029109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914e29e-3064-45de-8804-7bcd1701dc85 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions/2149eaf5341649b483b510852b4389c4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:48.030382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914e29e-3064-45de-8804-7bcd1701dc85 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:update_region(region_id=2149eaf5341649b483b510852b4389c4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:48.033989 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-f914e29e-3064-45de-8804-7bcd1701dc85 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:30:48.033989 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:30:48.033989 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:30:48.038906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914e29e-3064-45de-8804-7bcd1701dc85 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:48.084763 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3348/6661] 10.222.0.23 () {60 vars in 1250 bytes} [Sun Oct 2 01:30:47 2022] PATCH /identity/v3/regions/2149eaf5341649b483b510852b4389c4 => generated 254 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:48.084763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914e29e-3064-45de-8804-7bcd1701dc85 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:48.095983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f914e29e-3064-45de-8804-7bcd1701dc85 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:48.143361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71518ca2-61c7-4284-8e20-090ef4b3e98f tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:48.176101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:48.176764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:48.177047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:48.178276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] PATH_INFO: `/v3/projects/1ed71fa4a6514962b3b4b56807b6b9cd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:48.181109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed71fa4a6514962b3b4b56807b6b9cd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:48.189036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:48.294567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914e29e-3064-45de-8804-7bcd1701dc85 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:48.311449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d454b1-8045-4b4b-bc20-501dbe80be0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:48.312278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d454b1-8045-4b4b-bc20-501dbe80be0c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:48.312554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d454b1-8045-4b4b-bc20-501dbe80be0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:48.312823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d454b1-8045-4b4b-bc20-501dbe80be0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:48.313492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d454b1-8045-4b4b-bc20-501dbe80be0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:48.313803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d454b1-8045-4b4b-bc20-501dbe80be0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:48.315546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d454b1-8045-4b4b-bc20-501dbe80be0c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:48.342309 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3349/6662] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:48.342309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d454b1-8045-4b4b-bc20-501dbe80be0c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:48.346282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-27d454b1-8045-4b4b-bc20-501dbe80be0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:48.359858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed71fa4a6514962b3b4b56807b6b9cd', 'request_id': 'req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:48.372491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed71fa4a6514962b3b4b56807b6b9cd', 'request_id': 'req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:48.381684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed71fa4a6514962b3b4b56807b6b9cd', 'request_id': 'req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:48.407233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] The token cache is being invalidate because project 1ed71fa4a6514962b3b4b56807b6b9cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:48.408309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:48.409297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:48.418061 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3314/6663] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:47 2022] DELETE /identity/v3/projects/1ed71fa4a6514962b3b4b56807b6b9cd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:48.418061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:48.419444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:48.527747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d454b1-8045-4b4b-bc20-501dbe80be0c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:48.580468 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:48.584126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c0da8-2447-4bc1-9d00-99c8e456d75e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:48.592007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d1db4-1617-4869-a0d1-e127c6e67e02 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:48.592839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d1db4-1617-4869-a0d1-e127c6e67e02 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:48.593300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d1db4-1617-4869-a0d1-e127c6e67e02 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:48.593619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d1db4-1617-4869-a0d1-e127c6e67e02 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions/2149eaf5341649b483b510852b4389c4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:48.599330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d1db4-1617-4869-a0d1-e127c6e67e02 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:get_region(region_id=2149eaf5341649b483b510852b4389c4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:48.599330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d1db4-1617-4869-a0d1-e127c6e67e02 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:48.615784 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3315/6664] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:30:48 2022] GET /identity/v3/regions/2149eaf5341649b483b510852b4389c4 => generated 254 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:48.618445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d1db4-1617-4869-a0d1-e127c6e67e02 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:48.639251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-690d1db4-1617-4869-a0d1-e127c6e67e02 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:48.697142 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:48.704400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:48.705062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:48.705355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:48.705633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/ae6f1148f67746f99399007e48eb311f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:48.710513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ae6f1148f67746f99399007e48eb311f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:48.712762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:48.820341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6f1148f67746f99399007e48eb311f', 'request_id': 'req-16c4ad25-2d62-4236-b82f-920a37d460e4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:48.835829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6f1148f67746f99399007e48eb311f', 'request_id': 'req-16c4ad25-2d62-4236-b82f-920a37d460e4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:48.849546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d1db4-1617-4869-a0d1-e127c6e67e02 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:48.855136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6f1148f67746f99399007e48eb311f', 'request_id': 'req-16c4ad25-2d62-4236-b82f-920a37d460e4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:48.879708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project ae6f1148f67746f99399007e48eb311f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:48.880077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:48.880866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-16c4ad25-2d62-4236-b82f-920a37d460e4 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:48.886936 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3350/6665] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:48 2022] DELETE /identity/v3/projects/ae6f1148f67746f99399007e48eb311f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:48.888504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268342ec-a57b-4ab4-97cf-7943bccf717b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:48.888801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268342ec-a57b-4ab4-97cf-7943bccf717b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:48.889080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268342ec-a57b-4ab4-97cf-7943bccf717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:48.913915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-268342ec-a57b-4ab4-97cf-7943bccf717b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:48.915225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-268342ec-a57b-4ab4-97cf-7943bccf717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:48.936715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4190951-40f3-4200-a268-140f0df1a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:48.937400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4190951-40f3-4200-a268-140f0df1a9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:48.937690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4190951-40f3-4200-a268-140f0df1a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:48.937988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4190951-40f3-4200-a268-140f0df1a9f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:48.938648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4190951-40f3-4200-a268-140f0df1a9f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:48.941314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4190951-40f3-4200-a268-140f0df1a9f0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:49.008634 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3316/6666] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:48 2022] POST /identity/v3/projects => generated 371 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:49.011237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4190951-40f3-4200-a268-140f0df1a9f0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:49.013647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c4190951-40f3-4200-a268-140f0df1a9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:49.070776 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3351/6667] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:49.073711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268342ec-a57b-4ab4-97cf-7943bccf717b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:49.073711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-268342ec-a57b-4ab4-97cf-7943bccf717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:49.142354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4190951-40f3-4200-a268-140f0df1a9f0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:49.150385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543c5f-770a-4b93-a84a-06fcdd44d7fc tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:49.151232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543c5f-770a-4b93-a84a-06fcdd44d7fc tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:49.151522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543c5f-770a-4b93-a84a-06fcdd44d7fc tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:49.151855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543c5f-770a-4b93-a84a-06fcdd44d7fc tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions/2149eaf5341649b483b510852b4389c4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:49.153132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07543c5f-770a-4b93-a84a-06fcdd44d7fc tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:delete_region(region_id=2149eaf5341649b483b510852b4389c4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:49.155608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07543c5f-770a-4b93-a84a-06fcdd44d7fc tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:49.207204 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:49.215035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268342ec-a57b-4ab4-97cf-7943bccf717b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:49.230581 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3317/6668] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:49 2022] DELETE /identity/v3/regions/2149eaf5341649b483b510852b4389c4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:49.233665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543c5f-770a-4b93-a84a-06fcdd44d7fc tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:49.240306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-07543c5f-770a-4b93-a84a-06fcdd44d7fc tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:49.293329 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:49.350942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543c5f-770a-4b93-a84a-06fcdd44d7fc tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:49.367745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08015537-afd2-4604-b316-4b4ecd37b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:49.368837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08015537-afd2-4604-b316-4b4ecd37b92f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:49.369737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08015537-afd2-4604-b316-4b4ecd37b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:49.370978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08015537-afd2-4604-b316-4b4ecd37b92f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:49.371923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08015537-afd2-4604-b316-4b4ecd37b92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:49.375961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08015537-afd2-4604-b316-4b4ecd37b92f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:49.406481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:49.407497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:49.407977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:49.408588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/domains/0eea1510cd8349038c0adfba7def82ae` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:49.410235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0eea1510cd8349038c0adfba7def82ae)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:49.412563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:49.418319 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3318/6669] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:49 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:49.423574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f6828-1f47-4889-92be-e1ac2b033431 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:49.424858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f6828-1f47-4889-92be-e1ac2b033431 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:49.425215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f6828-1f47-4889-92be-e1ac2b033431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:49.446010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0eea1510cd8349038c0adfba7def82ae'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:49.448708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0eea1510cd8349038c0adfba7def82ae'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:49.483671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c37f6828-1f47-4889-92be-e1ac2b033431 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:49.483671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c37f6828-1f47-4889-92be-e1ac2b033431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:49.501042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0eea1510cd8349038c0adfba7def82ae'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:49.503048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0eea1510cd8349038c0adfba7def82ae'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:49.514347 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3352/6670] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:30:49 2022] PATCH /identity/v3/domains/0eea1510cd8349038c0adfba7def82ae => generated 277 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:49.521187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:49.526206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:49.576527 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3319/6671] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:49.577683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f6828-1f47-4889-92be-e1ac2b033431 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:49.579337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c37f6828-1f47-4889-92be-e1ac2b033431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:49.610160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f6828-1f47-4889-92be-e1ac2b033431 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:49.617965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1655854-e19c-4f02-baae-9fd90360ec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:49.618628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1655854-e19c-4f02-baae-9fd90360ec9c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:49.619632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1655854-e19c-4f02-baae-9fd90360ec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:49.619632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1655854-e19c-4f02-baae-9fd90360ec9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:49.619863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1655854-e19c-4f02-baae-9fd90360ec9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:49.622417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1655854-e19c-4f02-baae-9fd90360ec9c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:49.643559 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3320/6672] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:49.644962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1655854-e19c-4f02-baae-9fd90360ec9c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:49.647533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f1655854-e19c-4f02-baae-9fd90360ec9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:49.700936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156385a-4666-469b-b7b9-46cc47d28adf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:49.716665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d951b-be4d-4167-8e44-59d2e4873ba1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:49.717356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d951b-be4d-4167-8e44-59d2e4873ba1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:49.717966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d951b-be4d-4167-8e44-59d2e4873ba1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:49.717966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d951b-be4d-4167-8e44-59d2e4873ba1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:49.719039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d951b-be4d-4167-8e44-59d2e4873ba1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:49.721428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d951b-be4d-4167-8e44-59d2e4873ba1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:49.737449 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3353/6673] 10.222.0.23 () {58 vars in 1128 bytes} [Sun Oct 2 01:30:49 2022] GET /identity/v3/regions => generated 669 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:49.738417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d951b-be4d-4167-8e44-59d2e4873ba1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:49.753609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d951b-be4d-4167-8e44-59d2e4873ba1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:49.758960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37478f-71f7-420c-8fc3-11018c8321d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:49.759584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37478f-71f7-420c-8fc3-11018c8321d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:49.759964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37478f-71f7-420c-8fc3-11018c8321d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:49.760245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37478f-71f7-420c-8fc3-11018c8321d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:49.761060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37478f-71f7-420c-8fc3-11018c8321d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:49.761375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37478f-71f7-420c-8fc3-11018c8321d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:49.763061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37478f-71f7-420c-8fc3-11018c8321d0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:49.768319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1655854-e19c-4f02-baae-9fd90360ec9c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:49.775830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:49.777298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:49.777815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:49.778622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/domains/0eea1510cd8349038c0adfba7def82ae` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:49.793813 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3354/6674] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:49.795217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37478f-71f7-420c-8fc3-11018c8321d0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:49.804527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0eea1510cd8349038c0adfba7def82ae)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:49.806435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:49.807975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37478f-71f7-420c-8fc3-11018c8321d0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:49.814710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9db0f4-f693-4626-b9c9-fc8eae5e01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:49.815621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9db0f4-f693-4626-b9c9-fc8eae5e01d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:49.816071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9db0f4-f693-4626-b9c9-fc8eae5e01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:49.816520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9db0f4-f693-4626-b9c9-fc8eae5e01d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:49.817337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9db0f4-f693-4626-b9c9-fc8eae5e01d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:49.819500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9db0f4-f693-4626-b9c9-fc8eae5e01d4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:49.839052 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3355/6675] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:49.839950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9db0f4-f693-4626-b9c9-fc8eae5e01d4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:49.854427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0eea1510cd8349038c0adfba7def82ae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:49.867157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0eea1510cd8349038c0adfba7def82ae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:49.910013 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:49.928734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9db0f4-f693-4626-b9c9-fc8eae5e01d4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:49.959794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec84e6-efc6-4762-96e5-154d6e6e54f1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:49.961541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec84e6-efc6-4762-96e5-154d6e6e54f1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:49.962736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec84e6-efc6-4762-96e5-154d6e6e54f1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:49.963834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec84e6-efc6-4762-96e5-154d6e6e54f1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions/2149eaf5341649b483b510852b4389c4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:49.965491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec84e6-efc6-4762-96e5-154d6e6e54f1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:delete_region(region_id=2149eaf5341649b483b510852b4389c4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:49.972056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec84e6-efc6-4762-96e5-154d6e6e54f1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:50.023402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eea1510cd8349038c0adfba7def82ae', 'request_id': 'req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:50.035402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eea1510cd8349038c0adfba7def82ae', 'request_id': 'req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:50.043541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eea1510cd8349038c0adfba7def82ae', 'request_id': 'req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:50.062990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project 0eea1510cd8349038c0adfba7def82ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:50.063356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:50.064259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:50.076121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0eea1510cd8349038c0adfba7def82ae', 'request_id': 'req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:50.077028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0eea1510cd8349038c0adfba7def82ae', 'request_id': 'req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:50.077800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0eea1510cd8349038c0adfba7def82ae', 'request_id': 'req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-92ec84e6-efc6-4762-96e5-154d6e6e54f1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Could not find region: 2149eaf5341649b483b510852b4389c4.: keystone.exception.RegionNotFound: Could not find region: 2149eaf5341649b483b510852b4389c4. Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 2149eaf5341649b483b510852b4389c4. Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:30:50.082433 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 2149eaf5341649b483b510852b4389c4. Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:30:50.083879 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3356/6676] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:49 2022] DELETE /identity/v3/regions/2149eaf5341649b483b510852b4389c4 => generated 112 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:30:50.089914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec84e6-efc6-4762-96e5-154d6e6e54f1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:50.091604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-92ec84e6-efc6-4762-96e5-154d6e6e54f1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:50.094972 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3321/6677] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:49 2022] DELETE /identity/v3/domains/0eea1510cd8349038c0adfba7def82ae => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:50.096124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:50.097844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:50.114870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec84e6-efc6-4762-96e5-154d6e6e54f1 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:50.134157 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:50.191003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144e199-47f7-4c2a-8a7e-e0d7d5dae9cc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:50.198859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761100b2-3e68-44b9-9487-f34c8c07a8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:50.199832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761100b2-3e68-44b9-9487-f34c8c07a8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:50.199832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761100b2-3e68-44b9-9487-f34c8c07a8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:50.200067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761100b2-3e68-44b9-9487-f34c8c07a8e7 admin admin] PATH_INFO: `/v3/projects/05c1b8d77344448f92a29a28fdd0ae63/users/fc18d7aa27d64e7087b97000debf6942/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:50.215996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f332a-ff36-45a5-933c-82dfab023fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:50.217095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f332a-ff36-45a5-933c-82dfab023fce admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:50.217775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f332a-ff36-45a5-933c-82dfab023fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:50.218904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f332a-ff36-45a5-933c-82dfab023fce admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:50.219766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f332a-ff36-45a5-933c-82dfab023fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:50.220960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761100b2-3e68-44b9-9487-f34c8c07a8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c1b8d77344448f92a29a28fdd0ae63, user_id=fc18d7aa27d64e7087b97000debf6942, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:50.223975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761100b2-3e68-44b9-9487-f34c8c07a8e7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:50.224507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f332a-ff36-45a5-933c-82dfab023fce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:50.249928 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3322/6678] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:50 2022] PUT /identity/v3/projects/05c1b8d77344448f92a29a28fdd0ae63/users/fc18d7aa27d64e7087b97000debf6942/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:50.251945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761100b2-3e68-44b9-9487-f34c8c07a8e7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:50.254676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-761100b2-3e68-44b9-9487-f34c8c07a8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:50.286035 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3357/6679] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:50 2022] POST /identity/v3/projects => generated 407 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:50.287232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f332a-ff36-45a5-933c-82dfab023fce admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:50.291641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-404f332a-ff36-45a5-933c-82dfab023fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:50.388516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761100b2-3e68-44b9-9487-f34c8c07a8e7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:50.406084 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:50.413457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f332a-ff36-45a5-933c-82dfab023fce admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:50.425052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f1036-d6ff-4a5d-86f9-7cda6a2b6aa6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:50.425281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f1036-d6ff-4a5d-86f9-7cda6a2b6aa6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:50.425527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f1036-d6ff-4a5d-86f9-7cda6a2b6aa6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:50.425905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f1036-d6ff-4a5d-86f9-7cda6a2b6aa6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:50.426800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f1036-d6ff-4a5d-86f9-7cda6a2b6aa6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:50.429136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f1036-d6ff-4a5d-86f9-7cda6a2b6aa6 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:50.507178 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3358/6680] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:50 2022] POST /identity/v3/projects => generated 376 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:50.509331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc05369-777f-4607-a104-124129fbeb65 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:50.510341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc05369-777f-4607-a104-124129fbeb65 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:50.510341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc05369-777f-4607-a104-124129fbeb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:50.528946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dd2f2-0b17-48fa-a018-3594d7642aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:50.530729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd2f2-0b17-48fa-a018-3594d7642aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:50.531698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd2f2-0b17-48fa-a018-3594d7642aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:50.532120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd2f2-0b17-48fa-a018-3594d7642aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:50.533900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dd2f2-0b17-48fa-a018-3594d7642aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:50.535957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dd2f2-0b17-48fa-a018-3594d7642aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:50.554995 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3323/6681] 10.222.0.23 () {58 vars in 1128 bytes} [Sun Oct 2 01:30:50 2022] GET /identity/v3/regions => generated 669 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:50.555361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dd2f2-0b17-48fa-a018-3594d7642aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:50.567374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-edc05369-777f-4607-a104-124129fbeb65 None None] MFA Rules not processed for user `fc18d7aa27d64e7087b97000debf6942`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:50.570205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-edc05369-777f-4607-a104-124129fbeb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:50.698732 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3359/6682] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:50.698732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc05369-777f-4607-a104-124129fbeb65 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:50.722249 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:50.761969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dd2f2-0b17-48fa-a018-3594d7642aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:50.839355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc05369-777f-4607-a104-124129fbeb65 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:50.856930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d92e1f-a6f7-4ade-abfa-3410e9ad3ad2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:50.858626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d92e1f-a6f7-4ade-abfa-3410e9ad3ad2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:50.859940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d92e1f-a6f7-4ade-abfa-3410e9ad3ad2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:50.861157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d92e1f-a6f7-4ade-abfa-3410e9ad3ad2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/0135406f35084a80bbf0a9d8eafb25c1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:50.863676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d92e1f-a6f7-4ade-abfa-3410e9ad3ad2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:get_project(project_id=0135406f35084a80bbf0a9d8eafb25c1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:50.866366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d92e1f-a6f7-4ade-abfa-3410e9ad3ad2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:50.868828 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3360/6683] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:50 2022] GET /identity/v3/projects/0135406f35084a80bbf0a9d8eafb25c1 => generated 376 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:50.869919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d92e1f-a6f7-4ade-abfa-3410e9ad3ad2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:50.939985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ef3ee-63f1-4ab9-9f04-b90a99b963eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:50.940725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ef3ee-63f1-4ab9-9f04-b90a99b963eb admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:50.940909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ef3ee-63f1-4ab9-9f04-b90a99b963eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:50.941442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ef3ee-63f1-4ab9-9f04-b90a99b963eb admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:50.942089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ef3ee-63f1-4ab9-9f04-b90a99b963eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:50.949290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ef3ee-63f1-4ab9-9f04-b90a99b963eb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:51.012206 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3324/6684] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:50 2022] POST /identity/v3/users => generated 304 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:51.016191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ef3ee-63f1-4ab9-9f04-b90a99b963eb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:51.020452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a3ef3ee-63f1-4ab9-9f04-b90a99b963eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:51.033321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d92e1f-a6f7-4ade-abfa-3410e9ad3ad2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:51.039639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95202cf-c1b7-4c12-b63a-a89a1cff789e tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:51.040400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95202cf-c1b7-4c12-b63a-a89a1cff789e tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:51.040825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95202cf-c1b7-4c12-b63a-a89a1cff789e tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:51.041888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95202cf-c1b7-4c12-b63a-a89a1cff789e tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:51.042766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95202cf-c1b7-4c12-b63a-a89a1cff789e tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:51.046684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95202cf-c1b7-4c12-b63a-a89a1cff789e tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:51.098717 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3361/6685] 10.222.0.23 () {60 vars in 1150 bytes} [Sun Oct 2 01:30:50 2022] POST /identity/v3/regions => generated 253 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:51.102408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95202cf-c1b7-4c12-b63a-a89a1cff789e tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:51.155551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95202cf-c1b7-4c12-b63a-a89a1cff789e tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:51.158857 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:51.167671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4b65e-6dac-45d6-8e7c-d492c5c97a49 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:51.168365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b65e-6dac-45d6-8e7c-d492c5c97a49 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:51.168611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b65e-6dac-45d6-8e7c-d492c5c97a49 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:51.169033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b65e-6dac-45d6-8e7c-d492c5c97a49 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:51.169698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4b65e-6dac-45d6-8e7c-d492c5c97a49 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:51.173414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4b65e-6dac-45d6-8e7c-d492c5c97a49 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:51.202841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ef3ee-63f1-4ab9-9f04-b90a99b963eb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:51.224598 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3362/6686] 10.222.0.23 () {58 vars in 1131 bytes} [Sun Oct 2 01:30:51 2022] GET /identity/v3/projects => generated 6545 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:51.224598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4b65e-6dac-45d6-8e7c-d492c5c97a49 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:51.230703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126aa10-d27c-4b4b-9c11-82ebc57e3357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:51.231492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126aa10-d27c-4b4b-9c11-82ebc57e3357 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:51.231967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126aa10-d27c-4b4b-9c11-82ebc57e3357 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:51.232344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126aa10-d27c-4b4b-9c11-82ebc57e3357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:51.251963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126aa10-d27c-4b4b-9c11-82ebc57e3357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:51.253876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126aa10-d27c-4b4b-9c11-82ebc57e3357 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:51.262874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4b65e-6dac-45d6-8e7c-d492c5c97a49 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:51.282618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b0fa7-dd59-4673-bcdf-a482e670b431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:51.283862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0fa7-dd59-4673-bcdf-a482e670b431 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:51.284519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0fa7-dd59-4673-bcdf-a482e670b431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:51.284640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0fa7-dd59-4673-bcdf-a482e670b431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:51.286099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b0fa7-dd59-4673-bcdf-a482e670b431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:51.298106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b0fa7-dd59-4673-bcdf-a482e670b431 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:51.317190 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3363/6687] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:51.318131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b0fa7-dd59-4673-bcdf-a482e670b431 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:51.319234 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3325/6688] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:51.320145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126aa10-d27c-4b4b-9c11-82ebc57e3357 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:51.352452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126aa10-d27c-4b4b-9c11-82ebc57e3357 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:51.364106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:51.364531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:51.364883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:51.365163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/0135406f35084a80bbf0a9d8eafb25c1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:51.367369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0135406f35084a80bbf0a9d8eafb25c1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:51.368952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b0fa7-dd59-4673-bcdf-a482e670b431 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:51.369835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:51.385649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12045ba1-0865-455a-bf03-1863b92fd33a tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:51.386355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12045ba1-0865-455a-bf03-1863b92fd33a tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:51.386555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12045ba1-0865-455a-bf03-1863b92fd33a tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:51.386864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12045ba1-0865-455a-bf03-1863b92fd33a tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:51.387587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12045ba1-0865-455a-bf03-1863b92fd33a tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Adding query filter params (parent_region_id=e354bd0de27c43c28e1088595d0caa1d) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:51.387915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12045ba1-0865-455a-bf03-1863b92fd33a tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:51.389265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12045ba1-0865-455a-bf03-1863b92fd33a tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:51.404497 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3364/6689] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:30:51 2022] GET /identity/v3/regions?parent_region_id=e354bd0de27c43c28e1088595d0caa1d => generated 399 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:51.405509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12045ba1-0865-455a-bf03-1863b92fd33a tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:51.440020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12045ba1-0865-455a-bf03-1863b92fd33a tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:51.466471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaab20c-1ce4-4c54-90a3-636c3eff491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:51.467128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab20c-1ce4-4c54-90a3-636c3eff491c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:51.467418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab20c-1ce4-4c54-90a3-636c3eff491c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:51.467995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab20c-1ce4-4c54-90a3-636c3eff491c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:51.469040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaab20c-1ce4-4c54-90a3-636c3eff491c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:51.471613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaab20c-1ce4-4c54-90a3-636c3eff491c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:51.507649 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3365/6690] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:51.508209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0135406f35084a80bbf0a9d8eafb25c1', 'request_id': 'req-ae8879da-332a-46a0-afb0-3900756c4cf1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:51.508604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaab20c-1ce4-4c54-90a3-636c3eff491c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:51.523223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0135406f35084a80bbf0a9d8eafb25c1', 'request_id': 'req-ae8879da-332a-46a0-afb0-3900756c4cf1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:51.535006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaab20c-1ce4-4c54-90a3-636c3eff491c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:51.538441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0135406f35084a80bbf0a9d8eafb25c1', 'request_id': 'req-ae8879da-332a-46a0-afb0-3900756c4cf1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:51.567825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project 0135406f35084a80bbf0a9d8eafb25c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:51.568426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:51.569887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:51.573009 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3326/6691] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:51 2022] DELETE /identity/v3/projects/0135406f35084a80bbf0a9d8eafb25c1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:51.574003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:51.580432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:51.612017 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:51.691208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:51.692017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:51.692362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:51.692701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] PATH_INFO: `/v3/users/fc18d7aa27d64e7087b97000debf6942` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:51.694358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc18d7aa27d64e7087b97000debf6942)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:51.698168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:51.738079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8879da-332a-46a0-afb0-3900756c4cf1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:51.743824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad3109-292d-4625-a102-590a08d71403 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:51.744994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad3109-292d-4625-a102-590a08d71403 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:51.745304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad3109-292d-4625-a102-590a08d71403 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:51.745559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad3109-292d-4625-a102-590a08d71403 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions/02f4953904324979b9eade46c9699986` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:51.746163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad3109-292d-4625-a102-590a08d71403 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:delete_region(region_id=02f4953904324979b9eade46c9699986)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:51.748913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad3109-292d-4625-a102-590a08d71403 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:51.776878 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3327/6692] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:51 2022] DELETE /identity/v3/regions/02f4953904324979b9eade46c9699986 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:51.778292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad3109-292d-4625-a102-590a08d71403 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:51.782705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-36ad3109-292d-4625-a102-590a08d71403 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:51.812264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc18d7aa27d64e7087b97000debf6942'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:51.828442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad3109-292d-4625-a102-590a08d71403 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:51.835615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc18d7aa27d64e7087b97000debf6942'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:51.837140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc18d7aa27d64e7087b97000debf6942'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:51.842087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb26e1-ed37-4b2f-b1d1-8ee3eeb8b7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:51.844600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb26e1-ed37-4b2f-b1d1-8ee3eeb8b7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:51.844956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb26e1-ed37-4b2f-b1d1-8ee3eeb8b7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:51.845982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb26e1-ed37-4b2f-b1d1-8ee3eeb8b7b4 admin admin] PATH_INFO: `/v3/projects/16043f0ed9a7480388c277119622948f/users/cc422edce0c04885985ddad994c029d5/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:51.850522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc18d7aa27d64e7087b97000debf6942'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:51.853043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc18d7aa27d64e7087b97000debf6942'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:51.866292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb26e1-ed37-4b2f-b1d1-8ee3eeb8b7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16043f0ed9a7480388c277119622948f, user_id=cc422edce0c04885985ddad994c029d5, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:51.870587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb26e1-ed37-4b2f-b1d1-8ee3eeb8b7b4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:51.874804 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:51.889021 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3366/6693] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:51 2022] DELETE /identity/v3/users/fc18d7aa27d64e7087b97000debf6942 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:51.890214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:51.896146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:51.914705 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3328/6694] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:51 2022] PUT /identity/v3/projects/16043f0ed9a7480388c277119622948f/users/cc422edce0c04885985ddad994c029d5/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:51.914705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb26e1-ed37-4b2f-b1d1-8ee3eeb8b7b4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:51.914705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8efb26e1-ed37-4b2f-b1d1-8ee3eeb8b7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:52.155601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65847c62-b026-4b6a-aa4e-730a9b6b59e0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:52.176998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb26e1-ed37-4b2f-b1d1-8ee3eeb8b7b4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:52.191212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cbf17-0a74-4f97-a730-c57a6916d92b tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:52.191855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cbf17-0a74-4f97-a730-c57a6916d92b tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:52.192171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cbf17-0a74-4f97-a730-c57a6916d92b tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:52.193113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cbf17-0a74-4f97-a730-c57a6916d92b tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:52.193239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cbf17-0a74-4f97-a730-c57a6916d92b tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:52.195837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cbf17-0a74-4f97-a730-c57a6916d92b tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:52.243210 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3367/6695] 10.222.0.23 () {60 vars in 1152 bytes} [Sun Oct 2 01:30:51 2022] POST /identity/v3/projects => generated 347 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:52.249165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b1c11-b2e1-4088-91c6-b2321c98c9e1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:52.249466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b1c11-b2e1-4088-91c6-b2321c98c9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:52.252396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b1c11-b2e1-4088-91c6-b2321c98c9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:52.278998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5527c-2e9a-4480-9ce9-847005014aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:52.280789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5527c-2e9a-4480-9ce9-847005014aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:52.281252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5527c-2e9a-4480-9ce9-847005014aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:52.281687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5527c-2e9a-4480-9ce9-847005014aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions/926084741edb434f88037dead605b954` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:52.293198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5527c-2e9a-4480-9ce9-847005014aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:delete_region(region_id=926084741edb434f88037dead605b954)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:52.298119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5527c-2e9a-4480-9ce9-847005014aad tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:52.336031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0e2b1c11-b2e1-4088-91c6-b2321c98c9e1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:52.337761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0e2b1c11-b2e1-4088-91c6-b2321c98c9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:52.345705 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3329/6696] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:51 2022] DELETE /identity/v3/regions/926084741edb434f88037dead605b954 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:52.348002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac48f0-7494-431d-9c7b-b23af20bc16d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:52.348450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac48f0-7494-431d-9c7b-b23af20bc16d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:52.349698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac48f0-7494-431d-9c7b-b23af20bc16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:52.409103 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:52.412049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3eac48f0-7494-431d-9c7b-b23af20bc16d None None] MFA Rules not processed for user `cc422edce0c04885985ddad994c029d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:52.414105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3eac48f0-7494-431d-9c7b-b23af20bc16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:52.545748 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3368/6697] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:52.546846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b1c11-b2e1-4088-91c6-b2321c98c9e1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:52.597771 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3330/6698] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:52.602760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac48f0-7494-431d-9c7b-b23af20bc16d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:52.638313 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:52.725488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b1c11-b2e1-4088-91c6-b2321c98c9e1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:52.746919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730111c4-4d5d-4769-b352-32efe3164555 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:52.747734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730111c4-4d5d-4769-b352-32efe3164555 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:52.748121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730111c4-4d5d-4769-b352-32efe3164555 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:52.748503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730111c4-4d5d-4769-b352-32efe3164555 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/43aeeb2275e64e13a5da49d2e35d31d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:52.757322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730111c4-4d5d-4769-b352-32efe3164555 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:update_project(project_id=43aeeb2275e64e13a5da49d2e35d31d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:52.760264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730111c4-4d5d-4769-b352-32efe3164555 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:52.772620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac48f0-7494-431d-9c7b-b23af20bc16d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:52.788613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2441e-edc5-467a-a4c6-a277cb301cd5 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5536a53cb9bd4e3f8539401997e1cd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f67e5c3aac411082aaedbe79759b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:52.789261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2441e-edc5-467a-a4c6-a277cb301cd5 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:52.789745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2441e-edc5-467a-a4c6-a277cb301cd5 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:52.790031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2441e-edc5-467a-a4c6-a277cb301cd5 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] PATH_INFO: `/v3/regions/e354bd0de27c43c28e1088595d0caa1d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:52.790652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2441e-edc5-467a-a4c6-a277cb301cd5 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorizing `identity:delete_region(region_id=e354bd0de27c43c28e1088595d0caa1d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:52.798914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2441e-edc5-467a-a4c6-a277cb301cd5 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:52.844048 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3331/6699] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:52 2022] DELETE /identity/v3/regions/e354bd0de27c43c28e1088595d0caa1d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:52.845332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2441e-edc5-467a-a4c6-a277cb301cd5 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:52.852015 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3369/6700] 10.222.0.23 () {60 vars in 1252 bytes} [Sun Oct 2 01:30:52 2022] PATCH /identity/v3/projects/43aeeb2275e64e13a5da49d2e35d31d4 => generated 361 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:52.852015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730111c4-4d5d-4769-b352-32efe3164555 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:52.853046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e3e2441e-edc5-467a-a4c6-a277cb301cd5 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:52.863230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-730111c4-4d5d-4769-b352-32efe3164555 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:52.896513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730111c4-4d5d-4769-b352-32efe3164555 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:52.934202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ba787-1a5c-4090-a2ad-a761278b2c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:52.935125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ba787-1a5c-4090-a2ad-a761278b2c38 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:52.935125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ba787-1a5c-4090-a2ad-a761278b2c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:52.935714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ba787-1a5c-4090-a2ad-a761278b2c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:52.936271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ba787-1a5c-4090-a2ad-a761278b2c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:52.938190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ba787-1a5c-4090-a2ad-a761278b2c38 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:53.011153 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3370/6701] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:52 2022] POST /identity/v3/projects => generated 409 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:53.012166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ba787-1a5c-4090-a2ad-a761278b2c38 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:53.015927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1b0ba787-1a5c-4090-a2ad-a761278b2c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:53.023717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2441e-edc5-467a-a4c6-a277cb301cd5 tempest-RegionsTestJSON-1275641874 tempest-RegionsTestJSON-1275641874-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:53.152012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda54842-016d-4d7d-aefc-e19cf915c2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:53.152651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda54842-016d-4d7d-aefc-e19cf915c2dc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:53.152926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda54842-016d-4d7d-aefc-e19cf915c2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:53.153192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda54842-016d-4d7d-aefc-e19cf915c2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:53.170078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ba787-1a5c-4090-a2ad-a761278b2c38 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:53.174038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda54842-016d-4d7d-aefc-e19cf915c2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:53.175556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda54842-016d-4d7d-aefc-e19cf915c2dc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:53.184903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:53.185931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:53.186128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:53.186355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] PATH_INFO: `/v3/users/476a6c3b472d48fd8f879258cc10df5e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:53.188288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=476a6c3b472d48fd8f879258cc10df5e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:53.190232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:53.196614 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:53.201665 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3332/6702] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:53.205124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda54842-016d-4d7d-aefc-e19cf915c2dc service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:53.339476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476a6c3b472d48fd8f879258cc10df5e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:53.349486 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:53.384443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476a6c3b472d48fd8f879258cc10df5e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:53.386889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476a6c3b472d48fd8f879258cc10df5e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:53.410427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476a6c3b472d48fd8f879258cc10df5e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:53.412237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476a6c3b472d48fd8f879258cc10df5e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:53.457758 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3371/6703] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:53 2022] DELETE /identity/v3/users/476a6c3b472d48fd8f879258cc10df5e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:53.464834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:53.468883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:53.472738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda54842-016d-4d7d-aefc-e19cf915c2dc service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:53.632156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf1e53-a7d8-4f07-b561-decfeed6ee99 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:53.639614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6f577-0154-4a17-812b-c5e43e97c356 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:53.640890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f577-0154-4a17-812b-c5e43e97c356 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:53.641172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f577-0154-4a17-812b-c5e43e97c356 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:53.642304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f577-0154-4a17-812b-c5e43e97c356 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/43aeeb2275e64e13a5da49d2e35d31d4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:53.646176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c8e1a-9b68-4793-8af0-9fa0add30396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:53.647312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c8e1a-9b68-4793-8af0-9fa0add30396 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:53.647597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c8e1a-9b68-4793-8af0-9fa0add30396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:53.647866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c8e1a-9b68-4793-8af0-9fa0add30396 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:53.649603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c8e1a-9b68-4793-8af0-9fa0add30396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:53.651492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c8e1a-9b68-4793-8af0-9fa0add30396 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:53.671696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6f577-0154-4a17-812b-c5e43e97c356 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:get_project(project_id=43aeeb2275e64e13a5da49d2e35d31d4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:53.673930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6f577-0154-4a17-812b-c5e43e97c356 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:53.678784 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3333/6704] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:53 2022] GET /identity/v3/projects/43aeeb2275e64e13a5da49d2e35d31d4 => generated 348 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:53.682180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f7748-4896-4f0e-81c5-2a5d1dd372ff None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:53.682332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f7748-4896-4f0e-81c5-2a5d1dd372ff None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:53.682686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f7748-4896-4f0e-81c5-2a5d1dd372ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:53.708418 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3372/6705] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:53 2022] POST /identity/v3/users => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:53.709418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c8e1a-9b68-4793-8af0-9fa0add30396 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:53.715728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9e5c8e1a-9b68-4793-8af0-9fa0add30396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:53.735472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c81f7748-4896-4f0e-81c5-2a5d1dd372ff None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:53.736708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c81f7748-4896-4f0e-81c5-2a5d1dd372ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:53.746753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c8e1a-9b68-4793-8af0-9fa0add30396 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:53.762378 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3334/6706] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:53.763846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:53.764497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:53.764781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:53.765054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/43aeeb2275e64e13a5da49d2e35d31d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:53.765726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f7748-4896-4f0e-81c5-2a5d1dd372ff None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:53.770697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=43aeeb2275e64e13a5da49d2e35d31d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:53.775942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:53.790088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f7748-4896-4f0e-81c5-2a5d1dd372ff None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:53.804091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524a64c-be7c-45ea-a7dc-c5c9b3746e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:53.804722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524a64c-be7c-45ea-a7dc-c5c9b3746e38 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:53.805000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524a64c-be7c-45ea-a7dc-c5c9b3746e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:53.805263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524a64c-be7c-45ea-a7dc-c5c9b3746e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:53.809938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524a64c-be7c-45ea-a7dc-c5c9b3746e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:53.813492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524a64c-be7c-45ea-a7dc-c5c9b3746e38 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:53.841887 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3335/6707] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:53.844870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524a64c-be7c-45ea-a7dc-c5c9b3746e38 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:53.848822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0524a64c-be7c-45ea-a7dc-c5c9b3746e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:53.901702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43aeeb2275e64e13a5da49d2e35d31d4', 'request_id': 'req-22baa7fb-8dc6-4481-8281-4b7d11473ab0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:53.922640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43aeeb2275e64e13a5da49d2e35d31d4', 'request_id': 'req-22baa7fb-8dc6-4481-8281-4b7d11473ab0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:53.945068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43aeeb2275e64e13a5da49d2e35d31d4', 'request_id': 'req-22baa7fb-8dc6-4481-8281-4b7d11473ab0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:53.945698 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:54.004805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project 43aeeb2275e64e13a5da49d2e35d31d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:54.006151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:54.012386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:54.014682 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3373/6708] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:53 2022] DELETE /identity/v3/projects/43aeeb2275e64e13a5da49d2e35d31d4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:54.019247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:54.024392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:54.064328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524a64c-be7c-45ea-a7dc-c5c9b3746e38 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:54.221230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0406a7-e780-437e-9e2a-b6c5c8398459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:54.221872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0406a7-e780-437e-9e2a-b6c5c8398459 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:54.222157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0406a7-e780-437e-9e2a-b6c5c8398459 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:54.222434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0406a7-e780-437e-9e2a-b6c5c8398459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:54.224980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baa7fb-8dc6-4481-8281-4b7d11473ab0 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:54.233378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ab0406a7-e780-437e-9e2a-b6c5c8398459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:54.246043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196466-79b3-4bdd-8693-15869e5b5ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:54.248784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196466-79b3-4bdd-8693-15869e5b5ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:54.249083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196466-79b3-4bdd-8693-15869e5b5ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:54.249372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196466-79b3-4bdd-8693-15869e5b5ff3 admin admin] PATH_INFO: `/v3/projects/a8e1d90d78d34e5e85d805c3b871712a/users/7d68e348798b4e61a3984670cf4943bd/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:54.290139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0406a7-e780-437e-9e2a-b6c5c8398459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:54.297491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0406a7-e780-437e-9e2a-b6c5c8398459 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:54.318874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e196466-79b3-4bdd-8693-15869e5b5ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e1d90d78d34e5e85d805c3b871712a, user_id=7d68e348798b4e61a3984670cf4943bd, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:54.325988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e196466-79b3-4bdd-8693-15869e5b5ff3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:54.330990 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3336/6709] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:54.331890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0406a7-e780-437e-9e2a-b6c5c8398459 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:54.338329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ab0406a7-e780-437e-9e2a-b6c5c8398459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:54.372213 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3374/6710] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:54 2022] PUT /identity/v3/projects/a8e1d90d78d34e5e85d805c3b871712a/users/7d68e348798b4e61a3984670cf4943bd/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:54.373194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196466-79b3-4bdd-8693-15869e5b5ff3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:54.383543 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:54.517529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0406a7-e780-437e-9e2a-b6c5c8398459 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:54.548207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196466-79b3-4bdd-8693-15869e5b5ff3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:54.561958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b90d7-cf6c-4849-b943-6d60142cac45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:54.562725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b90d7-cf6c-4849-b943-6d60142cac45 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:54.563016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b90d7-cf6c-4849-b943-6d60142cac45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:54.563344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b90d7-cf6c-4849-b943-6d60142cac45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:54.564050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b90d7-cf6c-4849-b943-6d60142cac45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:54.567754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b90d7-cf6c-4849-b943-6d60142cac45 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:54.596119 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3375/6711] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:54.601746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b90d7-cf6c-4849-b943-6d60142cac45 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:54.608666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e83b90d7-cf6c-4849-b943-6d60142cac45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:54.651871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b90d7-cf6c-4849-b943-6d60142cac45 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:54.662496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:54.664746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:54.665040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:54.665326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] PATH_INFO: `/v3/projects/05c1b8d77344448f92a29a28fdd0ae63` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:54.668489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05c1b8d77344448f92a29a28fdd0ae63)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:54.669534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b3368-f1b4-4cd9-abe5-320d055133fc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:54.671298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b3368-f1b4-4cd9-abe5-320d055133fc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:54.672816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:54.674529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b3368-f1b4-4cd9-abe5-320d055133fc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:54.674906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b3368-f1b4-4cd9-abe5-320d055133fc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:54.675770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b3368-f1b4-4cd9-abe5-320d055133fc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:54.677565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b3368-f1b4-4cd9-abe5-320d055133fc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:54.763306 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3337/6712] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:54 2022] POST /identity/v3/projects => generated 359 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:54.764414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b3368-f1b4-4cd9-abe5-320d055133fc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:54.773699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05c1b8d77344448f92a29a28fdd0ae63', 'request_id': 'req-a8456d05-5265-4616-aa78-f2f82a225a93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:54.805178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05c1b8d77344448f92a29a28fdd0ae63', 'request_id': 'req-a8456d05-5265-4616-aa78-f2f82a225a93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:54.871135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05c1b8d77344448f92a29a28fdd0ae63', 'request_id': 'req-a8456d05-5265-4616-aa78-f2f82a225a93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:54.881853 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=3,keystone:DELETE=7,keystone:SELECT=90 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:54.925064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] The token cache is being invalidate because project 05c1b8d77344448f92a29a28fdd0ae63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:54.926290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:54.927425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:54.930706 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3376/6713] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:54 2022] DELETE /identity/v3/projects/05c1b8d77344448f92a29a28fdd0ae63 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:54.933742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:54.938164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:54.981731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b3368-f1b4-4cd9-abe5-320d055133fc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:54.999619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5010b00-9028-4567-9b64-3a9b00edf0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:55.004543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5010b00-9028-4567-9b64-3a9b00edf0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:55.006548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5010b00-9028-4567-9b64-3a9b00edf0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:55.006911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5010b00-9028-4567-9b64-3a9b00edf0a3 admin admin] PATH_INFO: `/v3/projects/a8e1d90d78d34e5e85d805c3b871712a/users/7d68e348798b4e61a3984670cf4943bd/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:55.013348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5010b00-9028-4567-9b64-3a9b00edf0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e1d90d78d34e5e85d805c3b871712a, user_id=7d68e348798b4e61a3984670cf4943bd, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:55.020666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5010b00-9028-4567-9b64-3a9b00edf0a3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:55.086399 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3338/6714] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:54 2022] PUT /identity/v3/projects/a8e1d90d78d34e5e85d805c3b871712a/users/7d68e348798b4e61a3984670cf4943bd/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:55.086399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0b3ac-f329-4d94-8aa0-73d0d7a2387e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:55.086399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0b3ac-f329-4d94-8aa0-73d0d7a2387e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:55.086399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0b3ac-f329-4d94-8aa0-73d0d7a2387e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:55.137099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3fa0b3ac-f329-4d94-8aa0-73d0d7a2387e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:55.140227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3fa0b3ac-f329-4d94-8aa0-73d0d7a2387e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:55.176973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8456d05-5265-4616-aa78-f2f82a225a93 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:55.239579 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:55.323353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e6996-66d0-4c1a-848a-5040db9053f2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:55.324059 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3339/6715] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:55.324541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e6996-66d0-4c1a-848a-5040db9053f2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:55.324979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e6996-66d0-4c1a-848a-5040db9053f2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:55.325350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e6996-66d0-4c1a-848a-5040db9053f2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/8690b6801cb94a779c956f3ce4c3c491` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:55.331005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e6996-66d0-4c1a-848a-5040db9053f2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:update_project(project_id=8690b6801cb94a779c956f3ce4c3c491)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:55.334155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e6996-66d0-4c1a-848a-5040db9053f2 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:55.339630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4105a2-1723-4c4c-ae14-ccca99c5e09d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:55.339924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4105a2-1723-4c4c-ae14-ccca99c5e09d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:55.340206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4105a2-1723-4c4c-ae14-ccca99c5e09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:55.446336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ab4105a2-1723-4c4c-ae14-ccca99c5e09d None None] MFA Rules not processed for user `7d68e348798b4e61a3984670cf4943bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:55.448319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ab4105a2-1723-4c4c-ae14-ccca99c5e09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:55.461795 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3377/6716] 10.222.0.23 () {60 vars in 1252 bytes} [Sun Oct 2 01:30:54 2022] PATCH /identity/v3/projects/8690b6801cb94a779c956f3ce4c3c491 => generated 371 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:55.473219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba40e-3f08-49c8-8fa5-a2157e899b56 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:55.476134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba40e-3f08-49c8-8fa5-a2157e899b56 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:55.476548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba40e-3f08-49c8-8fa5-a2157e899b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:55.511641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e7cba40e-3f08-49c8-8fa5-a2157e899b56 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:55.513734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e7cba40e-3f08-49c8-8fa5-a2157e899b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:55.527620 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3378/6717] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:55.528738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cba40e-3f08-49c8-8fa5-a2157e899b56 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:55.545064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cba40e-3f08-49c8-8fa5-a2157e899b56 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:55.551199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ecd10-835a-47e7-9d8e-d217826d89dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:55.552366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ecd10-835a-47e7-9d8e-d217826d89dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:55.552816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ecd10-835a-47e7-9d8e-d217826d89dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:55.553014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ecd10-835a-47e7-9d8e-d217826d89dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/8690b6801cb94a779c956f3ce4c3c491` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:55.571758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ecd10-835a-47e7-9d8e-d217826d89dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:get_project(project_id=8690b6801cb94a779c956f3ce4c3c491)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:55.575178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ecd10-835a-47e7-9d8e-d217826d89dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:55.587644 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3379/6718] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:55 2022] GET /identity/v3/projects/8690b6801cb94a779c956f3ce4c3c491 => generated 358 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:55.591000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ecd10-835a-47e7-9d8e-d217826d89dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:55.621959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ecd10-835a-47e7-9d8e-d217826d89dc tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:55.641600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3af256-71ec-44d5-9eab-34938b969f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:55.641769 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3340/6719] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:55.641886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3af256-71ec-44d5-9eab-34938b969f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:55.641886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3af256-71ec-44d5-9eab-34938b969f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:55.642037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4105a2-1723-4c4c-ae14-ccca99c5e09d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:55.642116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3af256-71ec-44d5-9eab-34938b969f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:55.642116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3af256-71ec-44d5-9eab-34938b969f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:30:55.642116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3af256-71ec-44d5-9eab-34938b969f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:55.642351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3af256-71ec-44d5-9eab-34938b969f6d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:55.662217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4105a2-1723-4c4c-ae14-ccca99c5e09d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:55.668921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:55.670219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:55.670504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:55.670866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/8690b6801cb94a779c956f3ce4c3c491` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:55.672449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8690b6801cb94a779c956f3ce4c3c491)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:55.680312 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3380/6720] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:55.680507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:55.680599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3af256-71ec-44d5-9eab-34938b969f6d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:55.689693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ee3af256-71ec-44d5-9eab-34938b969f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:55.784414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8690b6801cb94a779c956f3ce4c3c491', 'request_id': 'req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:55.807198 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:55.816711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8690b6801cb94a779c956f3ce4c3c491', 'request_id': 'req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:55.834162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8690b6801cb94a779c956f3ce4c3c491', 'request_id': 'req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:55.858968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project 8690b6801cb94a779c956f3ce4c3c491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:55.859318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:55.861273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:55.868229 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3341/6721] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:55 2022] DELETE /identity/v3/projects/8690b6801cb94a779c956f3ce4c3c491 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:55.869248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:55.872662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:55.913432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3af256-71ec-44d5-9eab-34938b969f6d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:55.987291 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:56.033588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8cbe3-5d95-493b-96c1-bc70044b2ccf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:56.046069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3879e74-1780-40fe-a416-ea338c6751de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:56.046586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cc8b5-7210-4a7c-b41c-786f9c76415e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:56.047468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cc8b5-7210-4a7c-b41c-786f9c76415e service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:56.047776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cc8b5-7210-4a7c-b41c-786f9c76415e service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:56.047898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3879e74-1780-40fe-a416-ea338c6751de admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:56.048045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cc8b5-7210-4a7c-b41c-786f9c76415e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:56.048214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3879e74-1780-40fe-a416-ea338c6751de admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:56.048470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3879e74-1780-40fe-a416-ea338c6751de admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:56.050440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3879e74-1780-40fe-a416-ea338c6751de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:56.053268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9e9cc8b5-7210-4a7c-b41c-786f9c76415e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:56.055323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3879e74-1780-40fe-a416-ea338c6751de admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:56.164575 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3342/6722] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:55 2022] POST /identity/v3/projects => generated 375 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:56.165562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3879e74-1780-40fe-a416-ea338c6751de admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:56.173957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b3879e74-1780-40fe-a416-ea338c6751de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:56.265274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cc8b5-7210-4a7c-b41c-786f9c76415e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:56.267950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cc8b5-7210-4a7c-b41c-786f9c76415e service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:56.288814 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3381/6723] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:55 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:56.289694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cc8b5-7210-4a7c-b41c-786f9c76415e service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:56.292173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9e9cc8b5-7210-4a7c-b41c-786f9c76415e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:56.316620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cc8b5-7210-4a7c-b41c-786f9c76415e service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:56.447133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:56.449398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:56.449685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:56.450007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] PATH_INFO: `/v3/projects/e06ae85b26d04f21a0948ecca3972e91` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:56.454701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06ae85b26d04f21a0948ecca3972e91)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:56.460034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:56.462623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3879e74-1780-40fe-a416-ea338c6751de admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:56.477307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b990-c70c-413e-a8f6-654af59b21f1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:56.478107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b990-c70c-413e-a8f6-654af59b21f1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:56.480736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b990-c70c-413e-a8f6-654af59b21f1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:56.481141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b990-c70c-413e-a8f6-654af59b21f1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:56.482187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570b990-c70c-413e-a8f6-654af59b21f1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:56.489788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570b990-c70c-413e-a8f6-654af59b21f1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:56.554861 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:56.625087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06ae85b26d04f21a0948ecca3972e91', 'request_id': 'req-b118ec07-cbaa-4aa1-9212-bf7793932617'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:56.630098 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3343/6724] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:30:56 2022] POST /identity/v3/projects => generated 353 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:56.631322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b990-c70c-413e-a8f6-654af59b21f1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:56.654862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06ae85b26d04f21a0948ecca3972e91', 'request_id': 'req-b118ec07-cbaa-4aa1-9212-bf7793932617'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:56.689627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06ae85b26d04f21a0948ecca3972e91', 'request_id': 'req-b118ec07-cbaa-4aa1-9212-bf7793932617'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:56.731926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] The token cache is being invalidate because project e06ae85b26d04f21a0948ecca3972e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:56.732233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:56.736308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:56.742489 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3382/6725] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:56 2022] DELETE /identity/v3/projects/e06ae85b26d04f21a0948ecca3972e91 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:56.749202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:56.758069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:56.794687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b990-c70c-413e-a8f6-654af59b21f1 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:56.802016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169fc75-433b-4083-a0f6-f5d4049e45ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:56.803329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169fc75-433b-4083-a0f6-f5d4049e45ae admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:56.807531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169fc75-433b-4083-a0f6-f5d4049e45ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:56.808292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169fc75-433b-4083-a0f6-f5d4049e45ae admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:56.809446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169fc75-433b-4083-a0f6-f5d4049e45ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:56.824028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169fc75-433b-4083-a0f6-f5d4049e45ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:56.879684 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3344/6726] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:30:56 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:30:56.879684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169fc75-433b-4083-a0f6-f5d4049e45ae admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:56.887545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f169fc75-433b-4083-a0f6-f5d4049e45ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:56.983120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118ec07-cbaa-4aa1-9212-bf7793932617 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:57.035855 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:57.080083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169fc75-433b-4083-a0f6-f5d4049e45ae admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:57.088604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a503c95-b3bd-419f-84e8-deb73244cbb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:57.089397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a503c95-b3bd-419f-84e8-deb73244cbb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:57.092059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a503c95-b3bd-419f-84e8-deb73244cbb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:57.092412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a503c95-b3bd-419f-84e8-deb73244cbb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:57.098533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a503c95-b3bd-419f-84e8-deb73244cbb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:57.158955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33d0a0-44d8-426f-91b1-864635fa6bcf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:57.159684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33d0a0-44d8-426f-91b1-864635fa6bcf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:57.159902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33d0a0-44d8-426f-91b1-864635fa6bcf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:57.160201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33d0a0-44d8-426f-91b1-864635fa6bcf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/d423704d65ad43ddbe888f5cd5bd1b82` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:57.171382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33d0a0-44d8-426f-91b1-864635fa6bcf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:update_project(project_id=d423704d65ad43ddbe888f5cd5bd1b82)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:57.173564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33d0a0-44d8-426f-91b1-864635fa6bcf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:57.283738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a503c95-b3bd-419f-84e8-deb73244cbb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:57.287141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a503c95-b3bd-419f-84e8-deb73244cbb2 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:57.319673 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3383/6727] 10.222.0.23 () {60 vars in 1252 bytes} [Sun Oct 2 01:30:56 2022] PATCH /identity/v3/projects/d423704d65ad43ddbe888f5cd5bd1b82 => generated 368 bytes in 576 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:57.320412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33d0a0-44d8-426f-91b1-864635fa6bcf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:57.335747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ba33d0a0-44d8-426f-91b1-864635fa6bcf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:57.348354 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3345/6728] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:56 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:57.349746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a503c95-b3bd-419f-84e8-deb73244cbb2 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:57.357352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a503c95-b3bd-419f-84e8-deb73244cbb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:57.393626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33d0a0-44d8-426f-91b1-864635fa6bcf tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:57.395219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a503c95-b3bd-419f-84e8-deb73244cbb2 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:57.406848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:57.407502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:57.407782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:57.408055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] PATH_INFO: `/v3/users/5536a53cb9bd4e3f8539401997e1cd43` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:57.408490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9f3d5-d475-4782-97e0-f490d8d0c119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:57.409247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5536a53cb9bd4e3f8539401997e1cd43)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:57.409370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f3d5-d475-4782-97e0-f490d8d0c119 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:57.411128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f3d5-d475-4782-97e0-f490d8d0c119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:57.411282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:57.411597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f3d5-d475-4782-97e0-f490d8d0c119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:57.412480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9f3d5-d475-4782-97e0-f490d8d0c119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:57.417895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9f3d5-d475-4782-97e0-f490d8d0c119 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:57.456315 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3346/6729] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:57.458958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9f3d5-d475-4782-97e0-f490d8d0c119 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:57.494956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9f3d5-d475-4782-97e0-f490d8d0c119 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:57.503505 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:57.518731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7587d0-1acd-45ba-8ab5-b3d1f9cb29bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:57.520113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5536a53cb9bd4e3f8539401997e1cd43'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:57.527590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7587d0-1acd-45ba-8ab5-b3d1f9cb29bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:57.541812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7587d0-1acd-45ba-8ab5-b3d1f9cb29bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:57.542414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7587d0-1acd-45ba-8ab5-b3d1f9cb29bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/d423704d65ad43ddbe888f5cd5bd1b82` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:57.554509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5536a53cb9bd4e3f8539401997e1cd43'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:57.555408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5536a53cb9bd4e3f8539401997e1cd43'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:57.575256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7587d0-1acd-45ba-8ab5-b3d1f9cb29bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:get_project(project_id=d423704d65ad43ddbe888f5cd5bd1b82)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:57.580263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5536a53cb9bd4e3f8539401997e1cd43'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:57.580932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5536a53cb9bd4e3f8539401997e1cd43'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:57.583593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7587d0-1acd-45ba-8ab5-b3d1f9cb29bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:57.593170 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3347/6730] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:30:57 2022] GET /identity/v3/projects/d423704d65ad43ddbe888f5cd5bd1b82 => generated 355 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:30:57.593170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7587d0-1acd-45ba-8ab5-b3d1f9cb29bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:57.597899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de7587d0-1acd-45ba-8ab5-b3d1f9cb29bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:57.618105 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3384/6731] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:57 2022] DELETE /identity/v3/users/5536a53cb9bd4e3f8539401997e1cd43 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:57.622193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:57.625315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:57.632511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7587d0-1acd-45ba-8ab5-b3d1f9cb29bb tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:57.777567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99e0da-9778-4cd4-ab04-844b4495acc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:57.779358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99e0da-9778-4cd4-ab04-844b4495acc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:57.781886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99e0da-9778-4cd4-ab04-844b4495acc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:57.782613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99e0da-9778-4cd4-ab04-844b4495acc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:57.784589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99e0da-9778-4cd4-ab04-844b4495acc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:57.790319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99e0da-9778-4cd4-ab04-844b4495acc6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:57.821601 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3348/6732] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:30:57.825757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99e0da-9778-4cd4-ab04-844b4495acc6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:57.860804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99e0da-9778-4cd4-ab04-844b4495acc6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:57.871885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f4b53-7fc2-4424-9458-ba01cedc56c3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:57.872961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8d409-4c8e-4d04-afde-00d644d0439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:57.875239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8d409-4c8e-4d04-afde-00d644d0439a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:57.876853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8d409-4c8e-4d04-afde-00d644d0439a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:57.877837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8d409-4c8e-4d04-afde-00d644d0439a admin admin] PATH_INFO: `/v3/projects/eb508d5d15db4c5abcebe80998d8a1b2/users/e1876c58b568404db5171654ac0f4275/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:57.889003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:57.890302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:57.890302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:57.890524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/projects/d423704d65ad43ddbe888f5cd5bd1b82` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:57.892851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d423704d65ad43ddbe888f5cd5bd1b82)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:57.894885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:57.919737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8d409-4c8e-4d04-afde-00d644d0439a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb508d5d15db4c5abcebe80998d8a1b2, user_id=e1876c58b568404db5171654ac0f4275, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:57.925941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8d409-4c8e-4d04-afde-00d644d0439a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:57.955540 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3349/6733] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:30:57 2022] PUT /identity/v3/projects/eb508d5d15db4c5abcebe80998d8a1b2/users/e1876c58b568404db5171654ac0f4275/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:57.968263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ded9a-afe7-4e51-acba-db5037771670 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:57.968572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ded9a-afe7-4e51-acba-db5037771670 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:57.969387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ded9a-afe7-4e51-acba-db5037771670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:58.055699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-402ded9a-afe7-4e51-acba-db5037771670 None None] MFA Rules not processed for user `e1876c58b568404db5171654ac0f4275`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:58.060218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-402ded9a-afe7-4e51-acba-db5037771670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:58.088564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd423704d65ad43ddbe888f5cd5bd1b82', 'request_id': 'req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:58.124472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd423704d65ad43ddbe888f5cd5bd1b82', 'request_id': 'req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:58.148134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd423704d65ad43ddbe888f5cd5bd1b82', 'request_id': 'req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:58.183033 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:58.189895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] The token cache is being invalidate because project d423704d65ad43ddbe888f5cd5bd1b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:58.190981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:58.191805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:58.194111 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3385/6734] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:57 2022] DELETE /identity/v3/projects/d423704d65ad43ddbe888f5cd5bd1b82 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:58.199886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:58.203341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:58.340794 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3350/6735] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:30:58.345157 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:58.355462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ded9a-afe7-4e51-acba-db5037771670 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:58.356808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-402ded9a-afe7-4e51-acba-db5037771670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:58.426505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393f64f-cc0f-4b68-b8fe-3096e7d54ade tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:58.448183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff043cb-e0ed-4172-ba86-1163f4077866 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:58.450479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff043cb-e0ed-4172-ba86-1163f4077866 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:58.451689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff043cb-e0ed-4172-ba86-1163f4077866 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:58.453859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff043cb-e0ed-4172-ba86-1163f4077866 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/domains/0eea1510cd8349038c0adfba7def82ae` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:58.479589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff043cb-e0ed-4172-ba86-1163f4077866 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-7ff043cb-e0ed-4172-ba86-1163f4077866 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Could not find domain: 0eea1510cd8349038c0adfba7def82ae.: keystone.exception.DomainNotFound: Could not find domain: 0eea1510cd8349038c0adfba7def82ae. Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0eea1510cd8349038c0adfba7def82ae. Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:30:58.498576 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:30:58.500008 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0eea1510cd8349038c0adfba7def82ae. Oct 02 01:30:58.501214 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:30:58.505753 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3386/6736] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:30:58 2022] PATCH /identity/v3/domains/0eea1510cd8349038c0adfba7def82ae => generated 112 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 02 01:30:58.511644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff043cb-e0ed-4172-ba86-1163f4077866 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:58.560852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff043cb-e0ed-4172-ba86-1163f4077866 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:58.569952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53aa6-59f4-447b-8f14-4ceccb6eb859 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c6fa20632e48fe83c1991cef1cb7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59cbb265b000498ca648dfbb5f010130', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:58.570773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53aa6-59f4-447b-8f14-4ceccb6eb859 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:58.571260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53aa6-59f4-447b-8f14-4ceccb6eb859 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:58.571426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53aa6-59f4-447b-8f14-4ceccb6eb859 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] PATH_INFO: `/v3/domains/f4aa04fe531c46b1b3ababfcf5d06708` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:58.585721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb53aa6-59f4-447b-8f14-4ceccb6eb859 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-3bb53aa6-59f4-447b-8f14-4ceccb6eb859 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Could not find domain: f4aa04fe531c46b1b3ababfcf5d06708.: keystone.exception.DomainNotFound: Could not find domain: f4aa04fe531c46b1b3ababfcf5d06708. Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f4aa04fe531c46b1b3ababfcf5d06708. Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:30:58.591151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:30:58.592400 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f4aa04fe531c46b1b3ababfcf5d06708. Oct 02 01:30:58.593779 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:30:58.595300 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3387/6737] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:30:58 2022] PATCH /identity/v3/domains/f4aa04fe531c46b1b3ababfcf5d06708 => generated 112 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:30:58.596217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53aa6-59f4-447b-8f14-4ceccb6eb859 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:58.600567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ded9a-afe7-4e51-acba-db5037771670 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:58.601104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3bb53aa6-59f4-447b-8f14-4ceccb6eb859 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:58.607535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094f04-ed84-4222-8d26-6e55434f4970 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:58.608176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094f04-ed84-4222-8d26-6e55434f4970 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:58.608457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094f04-ed84-4222-8d26-6e55434f4970 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:58.608733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094f04-ed84-4222-8d26-6e55434f4970 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:58.620505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19094f04-ed84-4222-8d26-6e55434f4970 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:58.621987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19094f04-ed84-4222-8d26-6e55434f4970 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:58.634085 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3351/6738] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:58.859672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53aa6-59f4-447b-8f14-4ceccb6eb859 tempest-ProjectsTestJSON-744305034 tempest-ProjectsTestJSON-744305034-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:58.884237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:58.885815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:58.887628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:58.888147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] PATH_INFO: `/v3/users/6fdabaa7e7504a1c83dd15ccde5957f9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:58.893191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fdabaa7e7504a1c83dd15ccde5957f9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:58.898665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:59.031661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fdabaa7e7504a1c83dd15ccde5957f9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:59.074109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fdabaa7e7504a1c83dd15ccde5957f9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:59.081234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fdabaa7e7504a1c83dd15ccde5957f9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:59.107321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fdabaa7e7504a1c83dd15ccde5957f9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:59.108864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fdabaa7e7504a1c83dd15ccde5957f9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:59.154507 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3388/6739] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:30:58 2022] DELETE /identity/v3/users/6fdabaa7e7504a1c83dd15ccde5957f9 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:30:59.156293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfb69c-c1e0-4191-9c67-f3fc851ce1bc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:59.156659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfb69c-c1e0-4191-9c67-f3fc851ce1bc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:59.156998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfb69c-c1e0-4191-9c67-f3fc851ce1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:59.190091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-18dfb69c-c1e0-4191-9c67-f3fc851ce1bc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:59.194266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-18dfb69c-c1e0-4191-9c67-f3fc851ce1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:59.388466 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3352/6740] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:30:59.419929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:59.421512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:59.474811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfb69c-c1e0-4191-9c67-f3fc851ce1bc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:30:59.476323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-18dfb69c-c1e0-4191-9c67-f3fc851ce1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:30:59.505323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfb69c-c1e0-4191-9c67-f3fc851ce1bc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:59.539156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:59.540346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:59.540638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:59.541022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] PATH_INFO: `/v3/projects/43f67e5c3aac411082aaedbe79759b24` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:59.549829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f67e5c3aac411082aaedbe79759b24)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:59.553694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:59.726513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69a77-87e3-495f-b681-ade0ab2cdb29 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:30:59.743424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26869876-fd13-4992-83a8-f10f18556847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:30:59.745086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26869876-fd13-4992-83a8-f10f18556847 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:59.745488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26869876-fd13-4992-83a8-f10f18556847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:59.745788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26869876-fd13-4992-83a8-f10f18556847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:59.788801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26869876-fd13-4992-83a8-f10f18556847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:30:59.790649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26869876-fd13-4992-83a8-f10f18556847 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:30:59.797498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f67e5c3aac411082aaedbe79759b24', 'request_id': 'req-db1d9813-2023-4830-a315-55a45f8b61f8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:59.805108 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:59.809598 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:30:59.812396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f67e5c3aac411082aaedbe79759b24', 'request_id': 'req-db1d9813-2023-4830-a315-55a45f8b61f8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:59.829117 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3389/6741] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:30:59.831434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f67e5c3aac411082aaedbe79759b24', 'request_id': 'req-db1d9813-2023-4830-a315-55a45f8b61f8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:59.848945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] The token cache is being invalidate because project 43f67e5c3aac411082aaedbe79759b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:30:59.849709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:59.850891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db1d9813-2023-4830-a315-55a45f8b61f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:30:59.853232 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3353/6742] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:30:59 2022] DELETE /identity/v3/projects/43f67e5c3aac411082aaedbe79759b24 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:30:59.858965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74502c00-14a6-4ae9-a258-b2a45844dbba None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:30:59.859517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74502c00-14a6-4ae9-a258-b2a45844dbba None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:30:59.860300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74502c00-14a6-4ae9-a258-b2a45844dbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:30:59.907313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-74502c00-14a6-4ae9-a258-b2a45844dbba None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:30:59.911121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-74502c00-14a6-4ae9-a258-b2a45844dbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:00.093218 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3390/6743] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:00.102524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b5677-d628-4996-a12c-f6fbb82c8bf0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:00.103287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b5677-d628-4996-a12c-f6fbb82c8bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:00.103679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b5677-d628-4996-a12c-f6fbb82c8bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:00.154317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5d2b5677-d628-4996-a12c-f6fbb82c8bf0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:00.158705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5d2b5677-d628-4996-a12c-f6fbb82c8bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:00.185889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74502c00-14a6-4ae9-a258-b2a45844dbba None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:00.199887 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3354/6744] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:00.210552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74502c00-14a6-4ae9-a258-b2a45844dbba None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:00.220389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb77e8d-b82b-4f25-9a30-c0994f89f9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:00.221061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb77e8d-b82b-4f25-9a30-c0994f89f9fd admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:00.221407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb77e8d-b82b-4f25-9a30-c0994f89f9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:00.221685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb77e8d-b82b-4f25-9a30-c0994f89f9fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:00.222398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb77e8d-b82b-4f25-9a30-c0994f89f9fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:31:00.222795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb77e8d-b82b-4f25-9a30-c0994f89f9fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:00.224521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb77e8d-b82b-4f25-9a30-c0994f89f9fd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:00.265918 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3391/6745] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:00.271184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b5677-d628-4996-a12c-f6fbb82c8bf0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:00.285080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b5677-d628-4996-a12c-f6fbb82c8bf0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:00.316397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c20a3b-baef-4225-ba5e-b8f62e243f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:00.317077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c20a3b-baef-4225-ba5e-b8f62e243f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:00.317378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c20a3b-baef-4225-ba5e-b8f62e243f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:00.317646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c20a3b-baef-4225-ba5e-b8f62e243f4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:00.323511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c20a3b-baef-4225-ba5e-b8f62e243f4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:00.328181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c20a3b-baef-4225-ba5e-b8f62e243f4b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:00.397037 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3355/6746] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:00 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:00.401786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb77e8d-b82b-4f25-9a30-c0994f89f9fd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:00.420339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb77e8d-b82b-4f25-9a30-c0994f89f9fd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:00.610276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7d1dd-d24e-45c1-a61c-09f01ffc987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:00.611643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d1dd-d24e-45c1-a61c-09f01ffc987e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:00.612095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d1dd-d24e-45c1-a61c-09f01ffc987e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:00.612542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d1dd-d24e-45c1-a61c-09f01ffc987e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:00.613355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7d1dd-d24e-45c1-a61c-09f01ffc987e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:00.622818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7d1dd-d24e-45c1-a61c-09f01ffc987e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:00.662748 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3392/6747] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:00 2022] POST /identity/v3/users => generated 283 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:31:00.667374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c20a3b-baef-4225-ba5e-b8f62e243f4b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:00.686083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c20a3b-baef-4225-ba5e-b8f62e243f4b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:00.705739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40c28d-d3de-41e6-b5f0-6b70d6645808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:00.706386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40c28d-d3de-41e6-b5f0-6b70d6645808 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:00.706699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40c28d-d3de-41e6-b5f0-6b70d6645808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:00.706985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40c28d-d3de-41e6-b5f0-6b70d6645808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:00.707664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40c28d-d3de-41e6-b5f0-6b70d6645808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:00.711670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40c28d-d3de-41e6-b5f0-6b70d6645808 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:00.738749 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3356/6748] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:00.743472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7d1dd-d24e-45c1-a61c-09f01ffc987e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:00.769281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7d1dd-d24e-45c1-a61c-09f01ffc987e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:00.820426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039b3ec-1b47-4e36-9032-e3b3ce8f9159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:00.825660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039b3ec-1b47-4e36-9032-e3b3ce8f9159 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:00.826038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039b3ec-1b47-4e36-9032-e3b3ce8f9159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:00.827092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039b3ec-1b47-4e36-9032-e3b3ce8f9159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:00.829137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039b3ec-1b47-4e36-9032-e3b3ce8f9159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:00.840553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039b3ec-1b47-4e36-9032-e3b3ce8f9159 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:00.888716 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3393/6749] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:00.890339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40c28d-d3de-41e6-b5f0-6b70d6645808 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:00.933703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40c28d-d3de-41e6-b5f0-6b70d6645808 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:00.949694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd575a-89d4-4903-a1ed-c26ed0b09e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:00.950799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd575a-89d4-4903-a1ed-c26ed0b09e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:00.951281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd575a-89d4-4903-a1ed-c26ed0b09e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:00.951461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd575a-89d4-4903-a1ed-c26ed0b09e21 admin admin] PATH_INFO: `/v3/projects/85bcf25f5e9d440fa548313ef64d02a2/users/6f2df5d090bb436399f04c381f699855/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:01.027128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd575a-89d4-4903-a1ed-c26ed0b09e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bcf25f5e9d440fa548313ef64d02a2, user_id=6f2df5d090bb436399f04c381f699855, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:01.033680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd575a-89d4-4903-a1ed-c26ed0b09e21 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:01.097286 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3357/6750] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:00 2022] PUT /identity/v3/projects/85bcf25f5e9d440fa548313ef64d02a2/users/6f2df5d090bb436399f04c381f699855/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:01.109255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c68317-4b5d-45ed-a831-f520dffeb409 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:01.109999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c68317-4b5d-45ed-a831-f520dffeb409 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:01.110462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c68317-4b5d-45ed-a831-f520dffeb409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:01.264307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e4c68317-4b5d-45ed-a831-f520dffeb409 None None] MFA Rules not processed for user `6f2df5d090bb436399f04c381f699855`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:01.265576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e4c68317-4b5d-45ed-a831-f520dffeb409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:01.411343 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:01.432392 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3394/6751] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:01.437899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd575a-89d4-4903-a1ed-c26ed0b09e21 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:01.560039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c68317-4b5d-45ed-a831-f520dffeb409 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:01.563179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e4c68317-4b5d-45ed-a831-f520dffeb409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:01.614929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd575a-89d4-4903-a1ed-c26ed0b09e21 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:01.639306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c88d5-6a02-4fd1-86db-0eff76175f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:01.640387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c88d5-6a02-4fd1-86db-0eff76175f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:01.640914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c88d5-6a02-4fd1-86db-0eff76175f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:01.641434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c88d5-6a02-4fd1-86db-0eff76175f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:01.643068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c88d5-6a02-4fd1-86db-0eff76175f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:01.645442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c88d5-6a02-4fd1-86db-0eff76175f4e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:01.719221 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3358/6752] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:01 2022] POST /identity/v3/projects => generated 367 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:01.721657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c88d5-6a02-4fd1-86db-0eff76175f4e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:01.776747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c68317-4b5d-45ed-a831-f520dffeb409 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:01.845769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c88d5-6a02-4fd1-86db-0eff76175f4e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:01.851347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ec2ed-fff1-4562-a0d3-a8a0eb1ad9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:01.852404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ec2ed-fff1-4562-a0d3-a8a0eb1ad9aa admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:01.852700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ec2ed-fff1-4562-a0d3-a8a0eb1ad9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:01.852983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ec2ed-fff1-4562-a0d3-a8a0eb1ad9aa admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:01.855001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ec2ed-fff1-4562-a0d3-a8a0eb1ad9aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:01.857121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ec2ed-fff1-4562-a0d3-a8a0eb1ad9aa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:01.874767 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:01.914760 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3359/6753] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:01 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:01.917899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ec2ed-fff1-4562-a0d3-a8a0eb1ad9aa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:01.949351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ec2ed-fff1-4562-a0d3-a8a0eb1ad9aa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:01.984202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951a5f0-7c38-454b-a2b8-c1cfd5799df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:01.984708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951a5f0-7c38-454b-a2b8-c1cfd5799df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:01.984996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951a5f0-7c38-454b-a2b8-c1cfd5799df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:01.986066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951a5f0-7c38-454b-a2b8-c1cfd5799df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:01.988238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951a5f0-7c38-454b-a2b8-c1cfd5799df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:01.992635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951a5f0-7c38-454b-a2b8-c1cfd5799df5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:02.027894 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3360/6754] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:02.028778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951a5f0-7c38-454b-a2b8-c1cfd5799df5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:02.048103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:02.048770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:02.049032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:02.049305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] PATH_INFO: `/v3/projects/87bacaf7f70c4a7fbd3aaef1ecfaa3cd` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:02.050497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=87bacaf7f70c4a7fbd3aaef1ecfaa3cd)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:02.053944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:02.061023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951a5f0-7c38-454b-a2b8-c1cfd5799df5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:02.075445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f137120-1448-4056-886f-24bd9263e150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:02.076427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137120-1448-4056-886f-24bd9263e150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:02.076576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137120-1448-4056-886f-24bd9263e150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:02.076834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137120-1448-4056-886f-24bd9263e150 admin admin] PATH_INFO: `/v3/projects/88c6c697a14a4b47b9a9e0eb630435ca/users/c247b0a87e554da9aa34e10ccca37583/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:02.153270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f137120-1448-4056-886f-24bd9263e150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c6c697a14a4b47b9a9e0eb630435ca, user_id=c247b0a87e554da9aa34e10ccca37583, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:02.166726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f137120-1448-4056-886f-24bd9263e150 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:02.223039 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3361/6755] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:02 2022] PUT /identity/v3/projects/88c6c697a14a4b47b9a9e0eb630435ca/users/c247b0a87e554da9aa34e10ccca37583/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:02.224326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f137120-1448-4056-886f-24bd9263e150 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:02.232891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87bacaf7f70c4a7fbd3aaef1ecfaa3cd', 'request_id': 'req-2ece0d56-c33a-431c-8021-88410d490d4e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:02.260652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87bacaf7f70c4a7fbd3aaef1ecfaa3cd', 'request_id': 'req-2ece0d56-c33a-431c-8021-88410d490d4e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:02.285778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87bacaf7f70c4a7fbd3aaef1ecfaa3cd', 'request_id': 'req-2ece0d56-c33a-431c-8021-88410d490d4e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:02.318543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] The token cache is being invalidate because project 87bacaf7f70c4a7fbd3aaef1ecfaa3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:02.319332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:02.320293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:02.324848 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3395/6756] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:01 2022] DELETE /identity/v3/projects/87bacaf7f70c4a7fbd3aaef1ecfaa3cd => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:02.328338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:02.331528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:02.440734 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:02.449264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f137120-1448-4056-886f-24bd9263e150 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:02.464751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeda4b7-d3e5-449a-9bf7-164f7b17b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:02.465870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeda4b7-d3e5-449a-9bf7-164f7b17b48d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:02.466124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeda4b7-d3e5-449a-9bf7-164f7b17b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:02.466397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeda4b7-d3e5-449a-9bf7-164f7b17b48d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:02.467119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeda4b7-d3e5-449a-9bf7-164f7b17b48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:02.472594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeda4b7-d3e5-449a-9bf7-164f7b17b48d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:02.495457 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3362/6757] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:02.500823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeda4b7-d3e5-449a-9bf7-164f7b17b48d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:02.507832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-adeda4b7-d3e5-449a-9bf7-164f7b17b48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:02.531131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece0d56-c33a-431c-8021-88410d490d4e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:02.532220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeda4b7-d3e5-449a-9bf7-164f7b17b48d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:02.545467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa3b7a-5075-444c-8bbc-765c49fdb3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:02.546116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa3b7a-5075-444c-8bbc-765c49fdb3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:02.546489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa3b7a-5075-444c-8bbc-765c49fdb3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:02.546811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa3b7a-5075-444c-8bbc-765c49fdb3c9 admin admin] PATH_INFO: `/v3/projects/88c6c697a14a4b47b9a9e0eb630435ca/users/c247b0a87e554da9aa34e10ccca37583/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:02.549627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:02.552735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:02.553411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:02.553548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa3b7a-5075-444c-8bbc-765c49fdb3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c6c697a14a4b47b9a9e0eb630435ca, user_id=c247b0a87e554da9aa34e10ccca37583, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:02.554310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] PATH_INFO: `/v3/users/79c6fa20632e48fe83c1991cef1cb7f7` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:02.557198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa3b7a-5075-444c-8bbc-765c49fdb3c9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:02.558534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c6fa20632e48fe83c1991cef1cb7f7)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:02.564791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:02.583084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3363/6758] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:02 2022] PUT /identity/v3/projects/88c6c697a14a4b47b9a9e0eb630435ca/users/c247b0a87e554da9aa34e10ccca37583/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:02.595401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076bec8-461a-4a13-a280-3499ce2522fb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:02.595714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076bec8-461a-4a13-a280-3499ce2522fb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:02.595971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076bec8-461a-4a13-a280-3499ce2522fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:02.660665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5076bec8-461a-4a13-a280-3499ce2522fb None None] MFA Rules not processed for user `c247b0a87e554da9aa34e10ccca37583`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:02.662181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5076bec8-461a-4a13-a280-3499ce2522fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:02.765881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c6fa20632e48fe83c1991cef1cb7f7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:02.797769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c6fa20632e48fe83c1991cef1cb7f7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:02.798684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c6fa20632e48fe83c1991cef1cb7f7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:02.815554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c6fa20632e48fe83c1991cef1cb7f7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:02.816510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c6fa20632e48fe83c1991cef1cb7f7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:02.838186 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3364/6759] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:31:02.841170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076bec8-461a-4a13-a280-3499ce2522fb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:02.851205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076bec8-461a-4a13-a280-3499ce2522fb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:02.853188 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3396/6760] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:02 2022] DELETE /identity/v3/users/79c6fa20632e48fe83c1991cef1cb7f7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:02.911300 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:02.998100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab04a08-7aeb-48b0-8653-aa437b078460 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:02.999723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab04a08-7aeb-48b0-8653-aa437b078460 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:03.000016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab04a08-7aeb-48b0-8653-aa437b078460 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:03.000297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab04a08-7aeb-48b0-8653-aa437b078460 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:03.002046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab04a08-7aeb-48b0-8653-aa437b078460 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:03.009349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab04a08-7aeb-48b0-8653-aa437b078460 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:03.110453 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3365/6761] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:02 2022] POST /identity/v3/projects => generated 358 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:03.112040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:03.113627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:03.187288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2ebc7-ec4f-494e-a15f-8738340059c9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:03.357021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960501f-6385-4544-ac46-e6ea4d522a03 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:03.358119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960501f-6385-4544-ac46-e6ea4d522a03 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:03.359613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960501f-6385-4544-ac46-e6ea4d522a03 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:03.360022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960501f-6385-4544-ac46-e6ea4d522a03 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:03.360878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960501f-6385-4544-ac46-e6ea4d522a03 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:03.369463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960501f-6385-4544-ac46-e6ea4d522a03 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:03.444040 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3397/6762] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:03 2022] POST /identity/v3/users => generated 373 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:03.445300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab04a08-7aeb-48b0-8653-aa437b078460 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:03.462103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab04a08-7aeb-48b0-8653-aa437b078460 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:03.490004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427b227-2b15-4cd2-9382-0cc6caf3dab0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:03.490744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427b227-2b15-4cd2-9382-0cc6caf3dab0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:03.491096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427b227-2b15-4cd2-9382-0cc6caf3dab0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:03.491315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427b227-2b15-4cd2-9382-0cc6caf3dab0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/da407ed881e745a7b23e5bf3eef8ef1a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:03.539167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427b227-2b15-4cd2-9382-0cc6caf3dab0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:get_user(user_id=da407ed881e745a7b23e5bf3eef8ef1a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:03.543307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427b227-2b15-4cd2-9382-0cc6caf3dab0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:03.545581 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3366/6763] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:31:03 2022] GET /identity/v3/users/da407ed881e745a7b23e5bf3eef8ef1a => generated 373 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:31:03.550137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960501f-6385-4544-ac46-e6ea4d522a03 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:03.578820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960501f-6385-4544-ac46-e6ea4d522a03 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:03.602425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:03.602789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:03.603037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:03.603489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/da407ed881e745a7b23e5bf3eef8ef1a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:03.608292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:delete_user(user_id=da407ed881e745a7b23e5bf3eef8ef1a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:03.610944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:03.673588 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:03.694050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da407ed881e745a7b23e5bf3eef8ef1a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:03.732296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da407ed881e745a7b23e5bf3eef8ef1a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:03.734348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da407ed881e745a7b23e5bf3eef8ef1a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:03.755776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da407ed881e745a7b23e5bf3eef8ef1a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:03.757201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da407ed881e745a7b23e5bf3eef8ef1a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:03.806867 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3398/6764] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:03 2022] DELETE /identity/v3/users/da407ed881e745a7b23e5bf3eef8ef1a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:03.807825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427b227-2b15-4cd2-9382-0cc6caf3dab0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:03.810167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b427b227-2b15-4cd2-9382-0cc6caf3dab0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:03.854898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427b227-2b15-4cd2-9382-0cc6caf3dab0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:04.086340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:04.095159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:04.096039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:04.096530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects/9a19994c039b4e8f8072733a27e46fdd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:04.101431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9a19994c039b4e8f8072733a27e46fdd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:04.113683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:04.352226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a19994c039b4e8f8072733a27e46fdd', 'request_id': 'req-d7127c1e-f481-45c9-b94b-8678e934a5cd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:04.378546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a19994c039b4e8f8072733a27e46fdd', 'request_id': 'req-d7127c1e-f481-45c9-b94b-8678e934a5cd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:04.423376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a19994c039b4e8f8072733a27e46fdd', 'request_id': 'req-d7127c1e-f481-45c9-b94b-8678e934a5cd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:04.456510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] The token cache is being invalidate because project 9a19994c039b4e8f8072733a27e46fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:04.456510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:04.458860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:04.477674 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3367/6765] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:03 2022] DELETE /identity/v3/projects/9a19994c039b4e8f8072733a27e46fdd => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:04.477910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:04.503933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07331da1-5a62-4619-bc34-50e9a67456cb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:04.667464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ee5ec-be91-47cc-9381-576cd5858e68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:04.668215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ee5ec-be91-47cc-9381-576cd5858e68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:04.668596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ee5ec-be91-47cc-9381-576cd5858e68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:04.669109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ee5ec-be91-47cc-9381-576cd5858e68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:04.669980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ee5ec-be91-47cc-9381-576cd5858e68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:04.676515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ee5ec-be91-47cc-9381-576cd5858e68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:04.713453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:04.715666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:04.751398 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3399/6766] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:04 2022] POST /identity/v3/projects => generated 360 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:04.751398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ee5ec-be91-47cc-9381-576cd5858e68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:04.756459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8e0ee5ec-be91-47cc-9381-576cd5858e68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:04.850299 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:04.917678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ee5ec-be91-47cc-9381-576cd5858e68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:04.936700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b18971-e2d6-4dea-9157-3a51382ece13 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:04.937357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b18971-e2d6-4dea-9157-3a51382ece13 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:04.937636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b18971-e2d6-4dea-9157-3a51382ece13 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:04.937911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b18971-e2d6-4dea-9157-3a51382ece13 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:04.938570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b18971-e2d6-4dea-9157-3a51382ece13 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:04.939153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127c1e-f481-45c9-b94b-8678e934a5cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:04.940660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b18971-e2d6-4dea-9157-3a51382ece13 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:05.006258 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3400/6767] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:04 2022] POST /identity/v3/users => generated 417 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:31:05.007369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b18971-e2d6-4dea-9157-3a51382ece13 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:05.034554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b18971-e2d6-4dea-9157-3a51382ece13 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:05.058701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcd481-645b-45c9-a66c-98c88915fc4a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:05.062928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcd481-645b-45c9-a66c-98c88915fc4a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:05.063477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcd481-645b-45c9-a66c-98c88915fc4a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:05.063765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcd481-645b-45c9-a66c-98c88915fc4a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:05.064480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcd481-645b-45c9-a66c-98c88915fc4a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:05.067921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcd481-645b-45c9-a66c-98c88915fc4a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:05.121860 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3401/6768] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:31:05 2022] POST /identity/v3/roles => generated 238 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:05.122818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcd481-645b-45c9-a66c-98c88915fc4a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:05.170520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcd481-645b-45c9-a66c-98c88915fc4a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:05.180357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:05.182080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:05.182894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:05.183426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] PATH_INFO: `/v3/projects/59cbb265b000498ca648dfbb5f010130` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:05.184913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cbb265b000498ca648dfbb5f010130)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:05.194844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:05.199172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b8665-1eac-4fcd-b48b-3c4e3410d141 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:05.199846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b8665-1eac-4fcd-b48b-3c4e3410d141 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:05.200128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b8665-1eac-4fcd-b48b-3c4e3410d141 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:05.202123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b8665-1eac-4fcd-b48b-3c4e3410d141 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/0c2f13160d514bd297bb79821fea397f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:05.236627 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:05.250354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b8665-1eac-4fcd-b48b-3c4e3410d141 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:get_user(user_id=0c2f13160d514bd297bb79821fea397f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:05.257476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b8665-1eac-4fcd-b48b-3c4e3410d141 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:05.266232 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3402/6769] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:31:05 2022] GET /identity/v3/users/0c2f13160d514bd297bb79821fea397f => generated 417 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:05.267745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b8665-1eac-4fcd-b48b-3c4e3410d141 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:05.297791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b8665-1eac-4fcd-b48b-3c4e3410d141 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:05.318782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cbb265b000498ca648dfbb5f010130', 'request_id': 'req-63ccdcaa-c48f-4be5-a5dc-332cf81257da'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:05.353805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cbb265b000498ca648dfbb5f010130', 'request_id': 'req-63ccdcaa-c48f-4be5-a5dc-332cf81257da'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:05.377898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cbb265b000498ca648dfbb5f010130', 'request_id': 'req-63ccdcaa-c48f-4be5-a5dc-332cf81257da'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:05.413697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] The token cache is being invalidate because project 59cbb265b000498ca648dfbb5f010130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:05.414002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:05.420930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63ccdcaa-c48f-4be5-a5dc-332cf81257da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:05.423583 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3368/6770] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:04 2022] DELETE /identity/v3/projects/59cbb265b000498ca648dfbb5f010130 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:05.439431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194165-ae15-4642-a7ae-9d777d257f28 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:05.439431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194165-ae15-4642-a7ae-9d777d257f28 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:05.439431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194165-ae15-4642-a7ae-9d777d257f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:05.537898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-38194165-ae15-4642-a7ae-9d777d257f28 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:05.543051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-38194165-ae15-4642-a7ae-9d777d257f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:05.552527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3845f0b-0c19-4666-91f9-ed5412e9a54f tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:05.557903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845f0b-0c19-4666-91f9-ed5412e9a54f tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:05.558435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845f0b-0c19-4666-91f9-ed5412e9a54f tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:05.559842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845f0b-0c19-4666-91f9-ed5412e9a54f tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/roles/a43f06934a8848ad8329d5cf485a073a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:05.564586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3845f0b-0c19-4666-91f9-ed5412e9a54f tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:get_role(role_id=a43f06934a8848ad8329d5cf485a073a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:05.566975 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-a3845f0b-0c19-4666-91f9-ed5412e9a54f tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:31:05.566975 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:31:05.566975 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:31:05.569358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3845f0b-0c19-4666-91f9-ed5412e9a54f tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:05.575043 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3403/6771] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:31:05 2022] GET /identity/v3/roles/a43f06934a8848ad8329d5cf485a073a => generated 238 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:05.576453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3845f0b-0c19-4666-91f9-ed5412e9a54f tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:05.583061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a3845f0b-0c19-4666-91f9-ed5412e9a54f tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:05.612496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3845f0b-0c19-4666-91f9-ed5412e9a54f tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:05.624624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e701e-9314-4df6-8d6d-8889fe4f9a3b tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:05.626045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e701e-9314-4df6-8d6d-8889fe4f9a3b tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:05.628769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e701e-9314-4df6-8d6d-8889fe4f9a3b tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:05.629792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e701e-9314-4df6-8d6d-8889fe4f9a3b tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:05.632653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e701e-9314-4df6-8d6d-8889fe4f9a3b tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:05.635255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e701e-9314-4df6-8d6d-8889fe4f9a3b tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:05.729921 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3404/6772] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:05 2022] POST /identity/v3/projects => generated 360 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:05.734147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e701e-9314-4df6-8d6d-8889fe4f9a3b tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:05.759659 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3369/6773] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:05.770372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf71ec-fdd3-4297-93ef-bb0c549d17dc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:05.771385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf71ec-fdd3-4297-93ef-bb0c549d17dc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:05.771843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf71ec-fdd3-4297-93ef-bb0c549d17dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:05.795240 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:05.824104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7cdf71ec-fdd3-4297-93ef-bb0c549d17dc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:05.826627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7cdf71ec-fdd3-4297-93ef-bb0c549d17dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:05.890641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e701e-9314-4df6-8d6d-8889fe4f9a3b tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:05.901794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a5c5-611e-4862-987c-d302450ef420 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:05.902639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a5c5-611e-4862-987c-d302450ef420 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:05.903018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a5c5-611e-4862-987c-d302450ef420 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:05.904440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a5c5-611e-4862-987c-d302450ef420 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects/224767751c374bf885c2f84c4f7b5c15` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:05.911121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257a5c5-611e-4862-987c-d302450ef420 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:get_project(project_id=224767751c374bf885c2f84c4f7b5c15)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:05.913528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257a5c5-611e-4862-987c-d302450ef420 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:05.919113 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3405/6774] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:31:05 2022] GET /identity/v3/projects/224767751c374bf885c2f84c4f7b5c15 => generated 360 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:05.922842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a5c5-611e-4862-987c-d302450ef420 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:05.943623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a5c5-611e-4862-987c-d302450ef420 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:05.967374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cc266-1e11-415b-8783-098cfe8fd496 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:05.968262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc266-1e11-415b-8783-098cfe8fd496 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:05.968617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc266-1e11-415b-8783-098cfe8fd496 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:05.968980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc266-1e11-415b-8783-098cfe8fd496 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects/224767751c374bf885c2f84c4f7b5c15/users/0c2f13160d514bd297bb79821fea397f/roles/a43f06934a8848ad8329d5cf485a073a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:05.981603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cc266-1e11-415b-8783-098cfe8fd496 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=224767751c374bf885c2f84c4f7b5c15, user_id=0c2f13160d514bd297bb79821fea397f, role_id=a43f06934a8848ad8329d5cf485a073a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:05.984580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cc266-1e11-415b-8783-098cfe8fd496 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:06.007026 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3370/6775] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:06.008072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf71ec-fdd3-4297-93ef-bb0c549d17dc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:06.025060 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3406/6776] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:05 2022] PUT /identity/v3/projects/224767751c374bf885c2f84c4f7b5c15/users/0c2f13160d514bd297bb79821fea397f/roles/a43f06934a8848ad8329d5cf485a073a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:06.029854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cc266-1e11-415b-8783-098cfe8fd496 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:06.038968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf71ec-fdd3-4297-93ef-bb0c549d17dc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:06.147091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cc266-1e11-415b-8783-098cfe8fd496 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:06.152738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53eda8-e7ec-4663-9299-1dfacabebcd4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:06.154050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53eda8-e7ec-4663-9299-1dfacabebcd4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:06.154535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53eda8-e7ec-4663-9299-1dfacabebcd4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:06.155046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53eda8-e7ec-4663-9299-1dfacabebcd4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:06.155888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53eda8-e7ec-4663-9299-1dfacabebcd4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:06.171148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53eda8-e7ec-4663-9299-1dfacabebcd4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:06.220654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9c18a-b711-4810-b3f9-888fc05e099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:06.222233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9c18a-b711-4810-b3f9-888fc05e099e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:06.223060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9c18a-b711-4810-b3f9-888fc05e099e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:06.223512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9c18a-b711-4810-b3f9-888fc05e099e admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:06.224666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9c18a-b711-4810-b3f9-888fc05e099e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:31:06.225395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9c18a-b711-4810-b3f9-888fc05e099e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:06.229664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9c18a-b711-4810-b3f9-888fc05e099e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:06.240493 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:06.259629 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3371/6777] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:06.261769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9c18a-b711-4810-b3f9-888fc05e099e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:06.279810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9c18a-b711-4810-b3f9-888fc05e099e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:06.292200 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3407/6778] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:06 2022] POST /identity/v3/projects => generated 359 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:06.297576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53eda8-e7ec-4663-9299-1dfacabebcd4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:06.499725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b4f68-b8c4-4972-9034-4a6560c8e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:06.507521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b4f68-b8c4-4972-9034-4a6560c8e165 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:06.507982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b4f68-b8c4-4972-9034-4a6560c8e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:06.508355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b4f68-b8c4-4972-9034-4a6560c8e165 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:06.509121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b4f68-b8c4-4972-9034-4a6560c8e165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:06.515772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b4f68-b8c4-4972-9034-4a6560c8e165 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:06.527524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53eda8-e7ec-4663-9299-1dfacabebcd4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:06.543519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc1168-1a94-4c2a-8b77-ace866ed22fd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:06.545286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1168-1a94-4c2a-8b77-ace866ed22fd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:06.545571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1168-1a94-4c2a-8b77-ace866ed22fd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:06.545849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1168-1a94-4c2a-8b77-ace866ed22fd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects/97990019e3a54a26955930f1c7fa5522` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:06.551468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc1168-1a94-4c2a-8b77-ace866ed22fd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:get_project(project_id=97990019e3a54a26955930f1c7fa5522)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:06.562126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc1168-1a94-4c2a-8b77-ace866ed22fd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:06.566985 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3408/6779] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:31:06 2022] GET /identity/v3/projects/97990019e3a54a26955930f1c7fa5522 => generated 359 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:06.571570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc1168-1a94-4c2a-8b77-ace866ed22fd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:06.608937 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3372/6780] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:06 2022] POST /identity/v3/projects => generated 373 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:31:06.609177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc1168-1a94-4c2a-8b77-ace866ed22fd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:06.610760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b4f68-b8c4-4972-9034-4a6560c8e165 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:06.705154 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:06.780646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b4f68-b8c4-4972-9034-4a6560c8e165 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:06.793360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f0eb6-e4ef-41cc-b212-8746fe7070f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:06.795769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0eb6-e4ef-41cc-b212-8746fe7070f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:06.798196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0eb6-e4ef-41cc-b212-8746fe7070f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:06.798744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0eb6-e4ef-41cc-b212-8746fe7070f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:06.799669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f0eb6-e4ef-41cc-b212-8746fe7070f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:06.800640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef8341-3c31-48e1-a5b6-6bdf72e2f773 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:06.801318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef8341-3c31-48e1-a5b6-6bdf72e2f773 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:06.801664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef8341-3c31-48e1-a5b6-6bdf72e2f773 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:06.801944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef8341-3c31-48e1-a5b6-6bdf72e2f773 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects/97990019e3a54a26955930f1c7fa5522/users/0c2f13160d514bd297bb79821fea397f/roles/a43f06934a8848ad8329d5cf485a073a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:06.807194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f0eb6-e4ef-41cc-b212-8746fe7070f5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:06.809206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef8341-3c31-48e1-a5b6-6bdf72e2f773 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=97990019e3a54a26955930f1c7fa5522, user_id=0c2f13160d514bd297bb79821fea397f, role_id=a43f06934a8848ad8329d5cf485a073a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:06.825495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef8341-3c31-48e1-a5b6-6bdf72e2f773 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:06.851580 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3409/6781] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:06 2022] PUT /identity/v3/projects/97990019e3a54a26955930f1c7fa5522/users/0c2f13160d514bd297bb79821fea397f/roles/a43f06934a8848ad8329d5cf485a073a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:06.856997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef8341-3c31-48e1-a5b6-6bdf72e2f773 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:06.859594 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3373/6782] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:06 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:31:06.863385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f0eb6-e4ef-41cc-b212-8746fe7070f5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:06.875597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f0eb6-e4ef-41cc-b212-8746fe7070f5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:07.010865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3fb12-ff02-4502-b093-f018f4bb1159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:07.013009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3fb12-ff02-4502-b093-f018f4bb1159 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:07.013293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3fb12-ff02-4502-b093-f018f4bb1159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:07.013569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3fb12-ff02-4502-b093-f018f4bb1159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:07.014240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3fb12-ff02-4502-b093-f018f4bb1159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:07.026204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3fb12-ff02-4502-b093-f018f4bb1159 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:07.049363 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3374/6783] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:06 2022] GET /identity/v3/roles => generated 1649 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:07.051728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef8341-3c31-48e1-a5b6-6bdf72e2f773 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:07.053782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3fb12-ff02-4502-b093-f018f4bb1159 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:07.072635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09887dc-e062-4f5e-abc7-7455050e0bbf tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:07.075056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09887dc-e062-4f5e-abc7-7455050e0bbf tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:07.075419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09887dc-e062-4f5e-abc7-7455050e0bbf tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:07.075606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09887dc-e062-4f5e-abc7-7455050e0bbf tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/0c2f13160d514bd297bb79821fea397f/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:07.077453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09887dc-e062-4f5e-abc7-7455050e0bbf tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=0c2f13160d514bd297bb79821fea397f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:07.080964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3fb12-ff02-4502-b093-f018f4bb1159 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:07.087124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09887dc-e062-4f5e-abc7-7455050e0bbf tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:07.097884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac9fde-7a2b-404d-8fc6-7f8cab65dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:07.098526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac9fde-7a2b-404d-8fc6-7f8cab65dc19 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:07.100907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac9fde-7a2b-404d-8fc6-7f8cab65dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:07.101211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac9fde-7a2b-404d-8fc6-7f8cab65dc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:07.105104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac9fde-7a2b-404d-8fc6-7f8cab65dc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:07.111830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac9fde-7a2b-404d-8fc6-7f8cab65dc19 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:07.151462 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3375/6784] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:07 2022] GET /identity/v3/roles => generated 1649 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:07.157538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac9fde-7a2b-404d-8fc6-7f8cab65dc19 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:07.184673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac9fde-7a2b-404d-8fc6-7f8cab65dc19 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:07.198080 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:07.201973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b385e6-ef2e-4d8b-81ff-45b57f42e6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:07.203805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b385e6-ef2e-4d8b-81ff-45b57f42e6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:07.207430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b385e6-ef2e-4d8b-81ff-45b57f42e6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:07.210387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b385e6-ef2e-4d8b-81ff-45b57f42e6ff admin admin] PATH_INFO: `/v3/projects/bdcdebdc402e4af18c63922f1d0d6c7e/users/068c3224a600457b83fc870187f86dd6/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:07.215726 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3410/6785] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 2 01:31:06 2022] GET /identity/v3/users/0c2f13160d514bd297bb79821fea397f/projects => generated 843 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:07.217290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09887dc-e062-4f5e-abc7-7455050e0bbf tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:07.249298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09887dc-e062-4f5e-abc7-7455050e0bbf tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:07.253064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b385e6-ef2e-4d8b-81ff-45b57f42e6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdcdebdc402e4af18c63922f1d0d6c7e, user_id=068c3224a600457b83fc870187f86dd6, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:07.260115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:07.260955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b385e6-ef2e-4d8b-81ff-45b57f42e6ff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:07.261667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:07.262942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:07.263334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects/97990019e3a54a26955930f1c7fa5522` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:07.268094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:delete_project(project_id=97990019e3a54a26955930f1c7fa5522)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:07.272306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:07.296038 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3376/6786] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:07 2022] PUT /identity/v3/projects/bdcdebdc402e4af18c63922f1d0d6c7e/users/068c3224a600457b83fc870187f86dd6/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:07.308476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7dafd-ebfc-4381-8bf3-544a62be962c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:07.311051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7dafd-ebfc-4381-8bf3-544a62be962c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:07.311528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7dafd-ebfc-4381-8bf3-544a62be962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:07.393250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d7d7dafd-ebfc-4381-8bf3-544a62be962c None None] MFA Rules not processed for user `068c3224a600457b83fc870187f86dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:07.399296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d7d7dafd-ebfc-4381-8bf3-544a62be962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:07.430819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97990019e3a54a26955930f1c7fa5522', 'request_id': 'req-f9d545b8-9053-4446-8a5d-720f265049c0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:07.450517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97990019e3a54a26955930f1c7fa5522', 'request_id': 'req-f9d545b8-9053-4446-8a5d-720f265049c0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:07.470697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97990019e3a54a26955930f1c7fa5522', 'request_id': 'req-f9d545b8-9053-4446-8a5d-720f265049c0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:07.501742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] The token cache is being invalidate because project 97990019e3a54a26955930f1c7fa5522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:07.503238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:07.505855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:07.508735 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3411/6787] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:07 2022] DELETE /identity/v3/projects/97990019e3a54a26955930f1c7fa5522 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:07.513752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:07.518695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:07.625764 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3377/6788] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:07.630328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7dafd-ebfc-4381-8bf3-544a62be962c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:07.671107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7dafd-ebfc-4381-8bf3-544a62be962c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:07.685183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8c64-636a-4a21-b7a6-aa335ea8cf1e tempest-IdentityCatalogTest-155544321 tempest-IdentityCatalogTest-155544321-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068c3224a600457b83fc870187f86dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdcdebdc402e4af18c63922f1d0d6c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:07.686079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8c64-636a-4a21-b7a6-aa335ea8cf1e tempest-IdentityCatalogTest-155544321 tempest-IdentityCatalogTest-155544321-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:07.686360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8c64-636a-4a21-b7a6-aa335ea8cf1e tempest-IdentityCatalogTest-155544321 tempest-IdentityCatalogTest-155544321-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:07.686671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8c64-636a-4a21-b7a6-aa335ea8cf1e tempest-IdentityCatalogTest-155544321 tempest-IdentityCatalogTest-155544321-project] PATH_INFO: `/v3/auth/catalog` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:07.687267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e8c64-636a-4a21-b7a6-aa335ea8cf1e tempest-IdentityCatalogTest-155544321 tempest-IdentityCatalogTest-155544321-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:07.688383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e8c64-636a-4a21-b7a6-aa335ea8cf1e tempest-IdentityCatalogTest-155544321 tempest-IdentityCatalogTest-155544321-project] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:07.705150 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3378/6789] 10.222.0.23 () {58 vars in 1143 bytes} [Sun Oct 2 01:31:07 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:07.706152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8c64-636a-4a21-b7a6-aa335ea8cf1e tempest-IdentityCatalogTest-155544321 tempest-IdentityCatalogTest-155544321-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:07.720525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b74e8c64-636a-4a21-b7a6-aa335ea8cf1e tempest-IdentityCatalogTest-155544321 tempest-IdentityCatalogTest-155544321-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:07.736099 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:07.808769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d545b8-9053-4446-8a5d-720f265049c0 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:07.813888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:07.814535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:07.814865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:07.815148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects/224767751c374bf885c2f84c4f7b5c15` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:07.816286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:delete_project(project_id=224767751c374bf885c2f84c4f7b5c15)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:07.818364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:07.972818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8c64-636a-4a21-b7a6-aa335ea8cf1e tempest-IdentityCatalogTest-155544321 tempest-IdentityCatalogTest-155544321-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:07.980544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd68e8a-9955-4680-915e-774a4eb15869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:07.981726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd68e8a-9955-4680-915e-774a4eb15869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:07.982180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd68e8a-9955-4680-915e-774a4eb15869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:07.982390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd68e8a-9955-4680-915e-774a4eb15869 admin admin] PATH_INFO: `/v3/users/068c3224a600457b83fc870187f86dd6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:07.983953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd68e8a-9955-4680-915e-774a4eb15869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068c3224a600457b83fc870187f86dd6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:07.987109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd68e8a-9955-4680-915e-774a4eb15869 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:08.037436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224767751c374bf885c2f84c4f7b5c15', 'request_id': 'req-ae4c68b4-4691-4f99-b45e-22ba0503abac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.064313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224767751c374bf885c2f84c4f7b5c15', 'request_id': 'req-ae4c68b4-4691-4f99-b45e-22ba0503abac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.083014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224767751c374bf885c2f84c4f7b5c15', 'request_id': 'req-ae4c68b4-4691-4f99-b45e-22ba0503abac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.114247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] The token cache is being invalidate because project 224767751c374bf885c2f84c4f7b5c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:08.114960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.122535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.127918 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3412/6790] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:07 2022] DELETE /identity/v3/projects/224767751c374bf885c2f84c4f7b5c15 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:08.129484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:08.132833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:08.135756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6dd68e8a-9955-4680-915e-774a4eb15869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068c3224a600457b83fc870187f86dd6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.173491 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:08.223119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6dd68e8a-9955-4680-915e-774a4eb15869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068c3224a600457b83fc870187f86dd6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.224031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6dd68e8a-9955-4680-915e-774a4eb15869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068c3224a600457b83fc870187f86dd6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.246196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6dd68e8a-9955-4680-915e-774a4eb15869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068c3224a600457b83fc870187f86dd6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.256390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6dd68e8a-9955-4680-915e-774a4eb15869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068c3224a600457b83fc870187f86dd6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.284235 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3379/6791] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:07 2022] DELETE /identity/v3/users/068c3224a600457b83fc870187f86dd6 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:08.286722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac40553-d3f8-4b17-a090-d531daaac9d2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:08.287172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac40553-d3f8-4b17-a090-d531daaac9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:08.287554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac40553-d3f8-4b17-a090-d531daaac9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:08.338356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fac40553-d3f8-4b17-a090-d531daaac9d2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:08.339988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fac40553-d3f8-4b17-a090-d531daaac9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:08.357407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c68b4-4691-4f99-b45e-22ba0503abac tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:08.487038 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3380/6792] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:08.531228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac40553-d3f8-4b17-a090-d531daaac9d2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:08.533172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fac40553-d3f8-4b17-a090-d531daaac9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:08.564129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:08.564807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:08.565094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:08.565373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/roles/a43f06934a8848ad8329d5cf485a073a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:08.570879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a43f06934a8848ad8329d5cf485a073a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:08.575359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:08.593247 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:08.719251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invalidating the token cache because role a43f06934a8848ad8329d5cf485a073a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:08.719606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.723979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:08.726484 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3413/6793] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:08 2022] DELETE /identity/v3/roles/a43f06934a8848ad8329d5cf485a073a => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:08.731428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:08.735167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:08.745308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac40553-d3f8-4b17-a090-d531daaac9d2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:08.866932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121e6a-7da2-4140-b572-a62d3c95f3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:08.867732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121e6a-7da2-4140-b572-a62d3c95f3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:08.868081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121e6a-7da2-4140-b572-a62d3c95f3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:08.868426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121e6a-7da2-4140-b572-a62d3c95f3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:08.874115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-01121e6a-7da2-4140-b572-a62d3c95f3e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:08.956475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a61d72-a5c8-432b-8cb8-87109e158d09 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:08.968534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:08.969159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:08.969451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:08.969734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/0c2f13160d514bd297bb79821fea397f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:08.971527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0c2f13160d514bd297bb79821fea397f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:08.973459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:09.059282 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:09.077187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01121e6a-7da2-4140-b572-a62d3c95f3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:09.078066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01121e6a-7da2-4140-b572-a62d3c95f3e5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:09.095492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2f13160d514bd297bb79821fea397f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:09.101870 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3381/6794] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:31:09.127205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2f13160d514bd297bb79821fea397f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:09.128609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2f13160d514bd297bb79821fea397f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:09.154263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2f13160d514bd297bb79821fea397f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:09.155996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2f13160d514bd297bb79821fea397f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:09.236000 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3414/6795] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:08 2022] DELETE /identity/v3/users/0c2f13160d514bd297bb79821fea397f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:09.243578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121e6a-7da2-4140-b572-a62d3c95f3e5 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:09.313764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121e6a-7da2-4140-b572-a62d3c95f3e5 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:09.465828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:09.466784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:09.467230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:09.467655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects/a185672265e64377913f0c2e7fcd4089` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:09.469019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a185672265e64377913f0c2e7fcd4089)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:09.470988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:09.562467 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:09.591125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a185672265e64377913f0c2e7fcd4089', 'request_id': 'req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:09.604479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a185672265e64377913f0c2e7fcd4089', 'request_id': 'req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:09.615554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a185672265e64377913f0c2e7fcd4089', 'request_id': 'req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:09.642740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] The token cache is being invalidate because project a185672265e64377913f0c2e7fcd4089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:09.643048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:09.644874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-645c42c9-d7c9-4a3e-a8e8-b29814d5f57a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:09.656395 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3382/6796] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:09 2022] DELETE /identity/v3/projects/a185672265e64377913f0c2e7fcd4089 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:09.658360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:09.661654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:09.706874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd1b96-2fe6-4bc8-bf7a-9f7785941cec tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:09.888364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:09.889455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:09.892152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:09.892883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/6f2df5d090bb436399f04c381f699855` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:09.898967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:update_user(user_id=6f2df5d090bb436399f04c381f699855)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:09.900818 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:31:09.900818 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:31:09.900818 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:31:09.902382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:10.013531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6f2df5d090bb436399f04c381f699855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:10.042876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invalidating the token cache because user 6f2df5d090bb436399f04c381f699855 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:10.043467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:10.044334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:10.046948 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3415/6797] 10.222.0.23 () {60 vars in 1243 bytes} [Sun Oct 2 01:31:09 2022] PATCH /identity/v3/users/6f2df5d090bb436399f04c381f699855 => generated 296 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:10.051381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db7bc6-7cb6-4b5c-a09c-0d8af0bca2f4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:10.052019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db7bc6-7cb6-4b5c-a09c-0d8af0bca2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:10.052511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db7bc6-7cb6-4b5c-a09c-0d8af0bca2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:10.129817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e1db7bc6-7cb6-4b5c-a09c-0d8af0bca2f4 None None] MFA Rules not processed for user `6f2df5d090bb436399f04c381f699855`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:10.131685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e1db7bc6-7cb6-4b5c-a09c-0d8af0bca2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:10.140473 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3383/6798] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:10 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:10.144742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:10.146773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:10.171279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd9744-9a66-4be4-aae3-6df405bbd073 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:10.183937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:10.184999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:10.185530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:10.186303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/6f2df5d090bb436399f04c381f699855` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:10.189962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:update_user(user_id=6f2df5d090bb436399f04c381f699855)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:10.192341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:10.296121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6f2df5d090bb436399f04c381f699855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:10.310277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invalidating the token cache because user 6f2df5d090bb436399f04c381f699855 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:10.311294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:10.312844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:10.315127 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3416/6799] 10.222.0.23 () {60 vars in 1243 bytes} [Sun Oct 2 01:31:10 2022] PATCH /identity/v3/users/6f2df5d090bb436399f04c381f699855 => generated 296 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:10.319386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db7bc6-7cb6-4b5c-a09c-0d8af0bca2f4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:10.341990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db7bc6-7cb6-4b5c-a09c-0d8af0bca2f4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:10.358529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab11a5-80f5-4213-acba-4325d2ccfa68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:10.359277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab11a5-80f5-4213-acba-4325d2ccfa68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:10.359624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab11a5-80f5-4213-acba-4325d2ccfa68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:10.359963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab11a5-80f5-4213-acba-4325d2ccfa68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/6f2df5d090bb436399f04c381f699855` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:10.395425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab11a5-80f5-4213-acba-4325d2ccfa68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:update_user(user_id=6f2df5d090bb436399f04c381f699855)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:10.400206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab11a5-80f5-4213-acba-4325d2ccfa68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:10.510394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:10.511639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5fab11a5-80f5-4213-acba-4325d2ccfa68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6f2df5d090bb436399f04c381f699855'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:10.512077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:10.541896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5fab11a5-80f5-4213-acba-4325d2ccfa68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invalidating the token cache because user 6f2df5d090bb436399f04c381f699855 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:10.545917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5fab11a5-80f5-4213-acba-4325d2ccfa68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:10.547352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5fab11a5-80f5-4213-acba-4325d2ccfa68 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:10.550470 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3384/6800] 10.222.0.23 () {60 vars in 1243 bytes} [Sun Oct 2 01:31:10 2022] PATCH /identity/v3/users/6f2df5d090bb436399f04c381f699855 => generated 296 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:10.555398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0aaa8-93cc-4bf9-a74c-20ac0e8fd04d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:10.558023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0aaa8-93cc-4bf9-a74c-20ac0e8fd04d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:10.560434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0aaa8-93cc-4bf9-a74c-20ac0e8fd04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:10.723793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a0a0aaa8-93cc-4bf9-a74c-20ac0e8fd04d None None] MFA Rules not processed for user `6f2df5d090bb436399f04c381f699855`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:10.723793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a0a0aaa8-93cc-4bf9-a74c-20ac0e8fd04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:10.734378 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3385/6801] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:10 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:10.737882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0aaa8-93cc-4bf9-a74c-20ac0e8fd04d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:10.741456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a0a0aaa8-93cc-4bf9-a74c-20ac0e8fd04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:10.742356 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:10.808174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0aaa8-93cc-4bf9-a74c-20ac0e8fd04d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:10.818255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fac29-fe04-48c0-8774-7c9933aeab2e tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:10.823152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:10.828299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:10.828720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:10.829109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/6f2df5d090bb436399f04c381f699855` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:10.833083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:update_user(user_id=6f2df5d090bb436399f04c381f699855)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:10.839859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:10.840761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:10.841299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:10.841499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] PATH_INFO: `/v3/projects/bdcdebdc402e4af18c63922f1d0d6c7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:10.841911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:10.850439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdcdebdc402e4af18c63922f1d0d6c7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:10.855239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:10.976575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6f2df5d090bb436399f04c381f699855'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:11.002486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdcdebdc402e4af18c63922f1d0d6c7e', 'request_id': 'req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:11.011514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invalidating the token cache because user 6f2df5d090bb436399f04c381f699855 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:11.011926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:11.012760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:11.022664 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3386/6802] 10.222.0.23 () {60 vars in 1243 bytes} [Sun Oct 2 01:31:10 2022] PATCH /identity/v3/users/6f2df5d090bb436399f04c381f699855 => generated 296 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:11.025349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:11.027654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdcdebdc402e4af18c63922f1d0d6c7e', 'request_id': 'req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:11.031452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:11.042976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdcdebdc402e4af18c63922f1d0d6c7e', 'request_id': 'req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:11.070478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] The token cache is being invalidate because project bdcdebdc402e4af18c63922f1d0d6c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:11.070811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:11.072060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a35d94a-12ea-4855-b5ff-ab0438e3ce9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:11.073989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb971-44ea-4553-8544-fe526f34d89c tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:11.074792 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3417/6803] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:10 2022] DELETE /identity/v3/projects/bdcdebdc402e4af18c63922f1d0d6c7e => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:11.082426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50311d3-7891-4bc7-bede-b50ad34dcba6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:11.082825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50311d3-7891-4bc7-bede-b50ad34dcba6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:11.083120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50311d3-7891-4bc7-bede-b50ad34dcba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:11.129806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e50311d3-7891-4bc7-bede-b50ad34dcba6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:11.130979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e50311d3-7891-4bc7-bede-b50ad34dcba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:11.218540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778006-b2f3-4358-85e0-fb653eee67cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:11.219438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778006-b2f3-4358-85e0-fb653eee67cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:11.219952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778006-b2f3-4358-85e0-fb653eee67cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:11.220166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778006-b2f3-4358-85e0-fb653eee67cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:11.221007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef778006-b2f3-4358-85e0-fb653eee67cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:11.222974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef778006-b2f3-4358-85e0-fb653eee67cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:11.236722 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=9,keystone:INSERT=8,keystone:UPDATE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:11.267144 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3387/6804] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:31:11 2022] POST /identity/v3/users => generated 264 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:11.270308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778006-b2f3-4358-85e0-fb653eee67cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:11.292644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ef778006-b2f3-4358-85e0-fb653eee67cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:11.303187 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3418/6805] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:11.310268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958b6d-01fc-4a46-939a-3670eea6bcef None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:11.310563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958b6d-01fc-4a46-939a-3670eea6bcef None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:11.311100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958b6d-01fc-4a46-939a-3670eea6bcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:11.339776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778006-b2f3-4358-85e0-fb653eee67cd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:11.358478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-09958b6d-01fc-4a46-939a-3670eea6bcef None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:11.361957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dec928-7e8d-403f-9d50-f11a1cd00f57 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:11.362656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dec928-7e8d-403f-9d50-f11a1cd00f57 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:11.362956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dec928-7e8d-403f-9d50-f11a1cd00f57 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:11.363238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dec928-7e8d-403f-9d50-f11a1cd00f57 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/c7bc4affcc6f481c87c5f89f8b5a8949/password` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:11.367480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-09958b6d-01fc-4a46-939a-3670eea6bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:11.396566 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3419/6806] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:31:11.402236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09958b6d-01fc-4a46-939a-3670eea6bcef None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:11.425378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09958b6d-01fc-4a46-939a-3670eea6bcef None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:11.445154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731e6a1-0057-4cb6-8ba6-0e1fecc57c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:11.445790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731e6a1-0057-4cb6-8ba6-0e1fecc57c39 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:11.446069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731e6a1-0057-4cb6-8ba6-0e1fecc57c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:11.446341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731e6a1-0057-4cb6-8ba6-0e1fecc57c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:11.447298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731e6a1-0057-4cb6-8ba6-0e1fecc57c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:31:11.447950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731e6a1-0057-4cb6-8ba6-0e1fecc57c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:11.449071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731e6a1-0057-4cb6-8ba6-0e1fecc57c39 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:11.497889 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3420/6807] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:11.498868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731e6a1-0057-4cb6-8ba6-0e1fecc57c39 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:11.533356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731e6a1-0057-4cb6-8ba6-0e1fecc57c39 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:11.536146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-40dec928-7e8d-403f-9d50-f11a1cd00f57 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c7bc4affcc6f481c87c5f89f8b5a8949'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:11.543923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6be0-c3f7-4281-8707-f4e15f06ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:11.544787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6be0-c3f7-4281-8707-f4e15f06ec01 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:11.545342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6be0-c3f7-4281-8707-f4e15f06ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:11.545769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6be0-c3f7-4281-8707-f4e15f06ec01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:11.546721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6be0-c3f7-4281-8707-f4e15f06ec01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:11.549211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6be0-c3f7-4281-8707-f4e15f06ec01 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:11.560320 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3388/6808] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:11 2022] POST /identity/v3/users/c7bc4affcc6f481c87c5f89f8b5a8949/password => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:11.592612 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3421/6809] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:11 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:11.593692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dec928-7e8d-403f-9d50-f11a1cd00f57 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:11.613111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dec928-7e8d-403f-9d50-f11a1cd00f57 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:11.723703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dec98-0e45-4fd9-934e-1ddbaf115883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:11.726619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dec98-0e45-4fd9-934e-1ddbaf115883 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:11.726936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dec98-0e45-4fd9-934e-1ddbaf115883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:11.727216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dec98-0e45-4fd9-934e-1ddbaf115883 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:11.728060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dec98-0e45-4fd9-934e-1ddbaf115883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:11.737048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dec98-0e45-4fd9-934e-1ddbaf115883 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:11.801297 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3389/6810] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:11 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:11.802586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6be0-c3f7-4281-8707-f4e15f06ec01 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:11.825287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6be0-c3f7-4281-8707-f4e15f06ec01 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:11.829507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3f6eb-9863-4653-abe3-47d80f9020ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:11.830154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3f6eb-9863-4653-abe3-47d80f9020ea admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:11.830474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3f6eb-9863-4653-abe3-47d80f9020ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:11.832053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3f6eb-9863-4653-abe3-47d80f9020ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:11.832053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3f6eb-9863-4653-abe3-47d80f9020ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:11.833595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3f6eb-9863-4653-abe3-47d80f9020ea admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:11.849146 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3422/6811] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:11.850582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dec98-0e45-4fd9-934e-1ddbaf115883 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:11.864573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dec98-0e45-4fd9-934e-1ddbaf115883 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:11.894133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14282e99-d1a1-4e37-8272-d99d14736b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:11.895400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14282e99-d1a1-4e37-8272-d99d14736b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:11.895825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14282e99-d1a1-4e37-8272-d99d14736b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:11.896484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14282e99-d1a1-4e37-8272-d99d14736b6b admin admin] PATH_INFO: `/v3/projects/9d2bc4d142ac4132bbf6dd6a7c2940a1/users/ada70a6dd76e40db877ce82948b26571/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:11.932330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14282e99-d1a1-4e37-8272-d99d14736b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2bc4d142ac4132bbf6dd6a7c2940a1, user_id=ada70a6dd76e40db877ce82948b26571, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:11.936683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14282e99-d1a1-4e37-8272-d99d14736b6b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:11.983953 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3390/6812] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:11 2022] PUT /identity/v3/projects/9d2bc4d142ac4132bbf6dd6a7c2940a1/users/ada70a6dd76e40db877ce82948b26571/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:11.987922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3f6eb-9863-4653-abe3-47d80f9020ea admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:12.002682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3f6eb-9863-4653-abe3-47d80f9020ea admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:12.076902 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:12.171276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea52ba2-9ada-4c91-a2fb-252b66418ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:12.171906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea52ba2-9ada-4c91-a2fb-252b66418ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:12.172190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea52ba2-9ada-4c91-a2fb-252b66418ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:12.172465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea52ba2-9ada-4c91-a2fb-252b66418ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:12.173120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea52ba2-9ada-4c91-a2fb-252b66418ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:12.183015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea52ba2-9ada-4c91-a2fb-252b66418ea2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:12.215818 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3423/6813] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:31:12.220209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14282e99-d1a1-4e37-8272-d99d14736b6b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:12.238125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14282e99-d1a1-4e37-8272-d99d14736b6b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:12.253401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73795f-2c52-4d80-8fc8-f3f24c93b188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:12.254482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73795f-2c52-4d80-8fc8-f3f24c93b188 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:12.255728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73795f-2c52-4d80-8fc8-f3f24c93b188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:12.256162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73795f-2c52-4d80-8fc8-f3f24c93b188 admin admin] PATH_INFO: `/v3/projects/9d2bc4d142ac4132bbf6dd6a7c2940a1/users/ada70a6dd76e40db877ce82948b26571/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:12.271112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73795f-2c52-4d80-8fc8-f3f24c93b188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2bc4d142ac4132bbf6dd6a7c2940a1, user_id=ada70a6dd76e40db877ce82948b26571, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:12.274056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73795f-2c52-4d80-8fc8-f3f24c93b188 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:12.305577 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3391/6814] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:12 2022] PUT /identity/v3/projects/9d2bc4d142ac4132bbf6dd6a7c2940a1/users/ada70a6dd76e40db877ce82948b26571/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:12.318118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1d170-7f8a-418f-ba42-b3f1417c246b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:12.318416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1d170-7f8a-418f-ba42-b3f1417c246b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:12.318728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1d170-7f8a-418f-ba42-b3f1417c246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:12.414893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3fa1d170-7f8a-418f-ba42-b3f1417c246b None None] MFA Rules not processed for user `ada70a6dd76e40db877ce82948b26571`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:12.416824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3fa1d170-7f8a-418f-ba42-b3f1417c246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:12.565768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad58c-79c6-46e8-a2a2-f40dc1af8008 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:12.566329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad58c-79c6-46e8-a2a2-f40dc1af8008 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:12.566329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad58c-79c6-46e8-a2a2-f40dc1af8008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:12.607015 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3424/6815] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:12.611556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1d170-7f8a-418f-ba42-b3f1417c246b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:12.615629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b85ad58c-79c6-46e8-a2a2-f40dc1af8008 None None] MFA Rules not processed for user `c7bc4affcc6f481c87c5f89f8b5a8949`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:12.617691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b85ad58c-79c6-46e8-a2a2-f40dc1af8008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:12.642476 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3392/6816] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:12 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:12.645501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ad58c-79c6-46e8-a2a2-f40dc1af8008 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:12.825578 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:12.828730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1d170-7f8a-418f-ba42-b3f1417c246b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:12.841282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdba0b4-0924-4b46-81a7-572aca7f0f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:12.842257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdba0b4-0924-4b46-81a7-572aca7f0f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:12.842680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdba0b4-0924-4b46-81a7-572aca7f0f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:12.844312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdba0b4-0924-4b46-81a7-572aca7f0f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:12.846955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdba0b4-0924-4b46-81a7-572aca7f0f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:12.855231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdba0b4-0924-4b46-81a7-572aca7f0f44 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:12.855802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ad58c-79c6-46e8-a2a2-f40dc1af8008 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:12.867680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93094c86-0456-4cba-a107-2adf99b0e9e4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:12.871382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93094c86-0456-4cba-a107-2adf99b0e9e4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:12.872572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93094c86-0456-4cba-a107-2adf99b0e9e4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:12.872987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93094c86-0456-4cba-a107-2adf99b0e9e4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:12.891236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93094c86-0456-4cba-a107-2adf99b0e9e4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:12.894388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93094c86-0456-4cba-a107-2adf99b0e9e4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:12.916151 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3393/6817] 10.222.0.23 () {56 vars in 1263 bytes} [Sun Oct 2 01:31:12 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 02 01:31:12.919099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93094c86-0456-4cba-a107-2adf99b0e9e4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:12.933075 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3425/6818] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:12 2022] POST /identity/v3/projects => generated 387 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:12.934059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdba0b4-0924-4b46-81a7-572aca7f0f44 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:12.940176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93094c86-0456-4cba-a107-2adf99b0e9e4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:13.081814 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:13.110302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:13.112405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:13.114674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:13.115106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/c7bc4affcc6f481c87c5f89f8b5a8949` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:13.116564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c7bc4affcc6f481c87c5f89f8b5a8949)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:13.123352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:13.235503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7bc4affcc6f481c87c5f89f8b5a8949'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:13.242549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdba0b4-0924-4b46-81a7-572aca7f0f44 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:13.277112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac93c2-82be-4fa8-a32f-236a273f3314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:13.278419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7bc4affcc6f481c87c5f89f8b5a8949'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:13.279868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac93c2-82be-4fa8-a32f-236a273f3314 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:13.280176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac93c2-82be-4fa8-a32f-236a273f3314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:13.280457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac93c2-82be-4fa8-a32f-236a273f3314 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:13.280578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7bc4affcc6f481c87c5f89f8b5a8949'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:13.286756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac93c2-82be-4fa8-a32f-236a273f3314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:13.288971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac93c2-82be-4fa8-a32f-236a273f3314 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:13.313116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7bc4affcc6f481c87c5f89f8b5a8949'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:13.332279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7bc4affcc6f481c87c5f89f8b5a8949'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:13.367387 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3426/6820] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:12 2022] POST /identity/v3/users => generated 294 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:13.367681 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3394/6820] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:12 2022] DELETE /identity/v3/users/c7bc4affcc6f481c87c5f89f8b5a8949 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:13.368466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac93c2-82be-4fa8-a32f-236a273f3314 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:13.370922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:13.375466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5aac93c2-82be-4fa8-a32f-236a273f3314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:13.377115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:13.435016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac93c2-82be-4fa8-a32f-236a273f3314 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:13.567186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac0331-eaca-4f8c-a888-6842824a94eb tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:13.581059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347c5df-182b-4561-b614-10a1b3752997 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:13.582165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347c5df-182b-4561-b614-10a1b3752997 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:13.582579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347c5df-182b-4561-b614-10a1b3752997 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:13.589398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347c5df-182b-4561-b614-10a1b3752997 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:13.590328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347c5df-182b-4561-b614-10a1b3752997 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:13.592932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347c5df-182b-4561-b614-10a1b3752997 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:13.625117 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:13.653644 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3395/6821] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:13 2022] POST /identity/v3/users => generated 367 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:13.654957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347c5df-182b-4561-b614-10a1b3752997 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:13.657437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d964880-bab0-45e2-af08-389d54944f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:13.659288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d964880-bab0-45e2-af08-389d54944f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:13.660814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d964880-bab0-45e2-af08-389d54944f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:13.662014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d964880-bab0-45e2-af08-389d54944f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:13.662722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d964880-bab0-45e2-af08-389d54944f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:13.668126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347c5df-182b-4561-b614-10a1b3752997 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:13.670303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d964880-bab0-45e2-af08-389d54944f7b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:13.700490 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3427/6822] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:13.700490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d964880-bab0-45e2-af08-389d54944f7b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:13.703046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576475a3-2caa-4213-99cc-c9b3ea6b4d15 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:13.704048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576475a3-2caa-4213-99cc-c9b3ea6b4d15 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:13.705259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576475a3-2caa-4213-99cc-c9b3ea6b4d15 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:13.705779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576475a3-2caa-4213-99cc-c9b3ea6b4d15 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:13.706737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576475a3-2caa-4213-99cc-c9b3ea6b4d15 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:13.709268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576475a3-2caa-4213-99cc-c9b3ea6b4d15 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:13.726295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d964880-bab0-45e2-af08-389d54944f7b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:13.751004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f892c2f-34ef-4da9-be3a-66efffe7d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:13.760443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f892c2f-34ef-4da9-be3a-66efffe7d3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:13.761870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f892c2f-34ef-4da9-be3a-66efffe7d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:13.762121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f892c2f-34ef-4da9-be3a-66efffe7d3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:13.765151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f892c2f-34ef-4da9-be3a-66efffe7d3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:13.767371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f892c2f-34ef-4da9-be3a-66efffe7d3e7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:13.781160 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3396/6823] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:13 2022] POST /identity/v3/projects => generated 358 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:13.787249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576475a3-2caa-4213-99cc-c9b3ea6b4d15 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:13.795415 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3428/6824] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:13.797032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f892c2f-34ef-4da9-be3a-66efffe7d3e7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:13.819429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f892c2f-34ef-4da9-be3a-66efffe7d3e7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:13.982434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576475a3-2caa-4213-99cc-c9b3ea6b4d15 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:13.989394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7add7d-c57e-42a8-a314-8640890723b6 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:13.990640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7add7d-c57e-42a8-a314-8640890723b6 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:13.991086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7add7d-c57e-42a8-a314-8640890723b6 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:13.991513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7add7d-c57e-42a8-a314-8640890723b6 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/db1330c4975746119329de06905609a0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:14.003442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b18ea-b250-4e56-a86d-6c2135e0c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:14.004135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b18ea-b250-4e56-a86d-6c2135e0c06f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:14.004445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b18ea-b250-4e56-a86d-6c2135e0c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:14.004695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b18ea-b250-4e56-a86d-6c2135e0c06f admin admin] PATH_INFO: `/v3/projects/90a9ed3603bf4886953560478750f628/users/be67ec9175c74cceb6a8364ed4aff21d/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:14.012827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7add7d-c57e-42a8-a314-8640890723b6 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:update_user(user_id=db1330c4975746119329de06905609a0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:14.015982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7add7d-c57e-42a8-a314-8640890723b6 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:14.064090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b18ea-b250-4e56-a86d-6c2135e0c06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a9ed3603bf4886953560478750f628, user_id=be67ec9175c74cceb6a8364ed4aff21d, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:14.070005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b18ea-b250-4e56-a86d-6c2135e0c06f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:14.098406 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3397/6825] 10.222.0.23 () {60 vars in 1244 bytes} [Sun Oct 2 01:31:13 2022] PATCH /identity/v3/users/db1330c4975746119329de06905609a0 => generated 520 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:14.098963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7add7d-c57e-42a8-a314-8640890723b6 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:14.118452 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3429/6826] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:13 2022] PUT /identity/v3/projects/90a9ed3603bf4886953560478750f628/users/be67ec9175c74cceb6a8364ed4aff21d/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:14.128167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9f3a-9115-4de0-a3d8-378cc305b338 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:14.128457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9f3a-9115-4de0-a3d8-378cc305b338 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:14.128753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9f3a-9115-4de0-a3d8-378cc305b338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:14.135233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7add7d-c57e-42a8-a314-8640890723b6 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:14.172152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a41c9f3a-9115-4de0-a3d8-378cc305b338 None None] MFA Rules not processed for user `be67ec9175c74cceb6a8364ed4aff21d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:14.174192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a41c9f3a-9115-4de0-a3d8-378cc305b338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:14.208223 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:14.338777 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3430/6827] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:14.360931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c9f3a-9115-4de0-a3d8-378cc305b338 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:14.363012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a41c9f3a-9115-4de0-a3d8-378cc305b338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:14.395259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264899c-fd6a-4064-90f9-8e2dbd4d08a4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:14.396091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264899c-fd6a-4064-90f9-8e2dbd4d08a4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:14.396091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264899c-fd6a-4064-90f9-8e2dbd4d08a4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:14.396398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264899c-fd6a-4064-90f9-8e2dbd4d08a4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/db1330c4975746119329de06905609a0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:14.465940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264899c-fd6a-4064-90f9-8e2dbd4d08a4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:get_user(user_id=db1330c4975746119329de06905609a0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:14.468794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264899c-fd6a-4064-90f9-8e2dbd4d08a4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:14.472267 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3398/6828] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:31:14 2022] GET /identity/v3/users/db1330c4975746119329de06905609a0 => generated 388 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:14.476512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264899c-fd6a-4064-90f9-8e2dbd4d08a4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:14.489625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264899c-fd6a-4064-90f9-8e2dbd4d08a4 tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:14.497651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:14.498367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:14.499923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:14.500336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/projects/79aec8cbacef4ba0a15b70f46aacf1d6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:14.501551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:delete_project(project_id=79aec8cbacef4ba0a15b70f46aacf1d6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:14.504191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:14.544496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c9f3a-9115-4de0-a3d8-378cc305b338 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:14.554199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d86d0-5a30-4310-b0fc-85330d79788a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:14.555145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d86d0-5a30-4310-b0fc-85330d79788a service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:14.555531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d86d0-5a30-4310-b0fc-85330d79788a service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:14.555955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d86d0-5a30-4310-b0fc-85330d79788a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:14.565951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c09d86d0-5a30-4310-b0fc-85330d79788a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:14.584770 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:UPDATE=2,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:14.629484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79aec8cbacef4ba0a15b70f46aacf1d6', 'request_id': 'req-39d809fd-a73e-4ea2-984c-ec4d3451146a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:14.651046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79aec8cbacef4ba0a15b70f46aacf1d6', 'request_id': 'req-39d809fd-a73e-4ea2-984c-ec4d3451146a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:14.673372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79aec8cbacef4ba0a15b70f46aacf1d6', 'request_id': 'req-39d809fd-a73e-4ea2-984c-ec4d3451146a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:14.711762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] The token cache is being invalidate because project 79aec8cbacef4ba0a15b70f46aacf1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:14.712225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:14.714154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:14.719629 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3399/6829] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:14 2022] DELETE /identity/v3/projects/79aec8cbacef4ba0a15b70f46aacf1d6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:14.723623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:14.725862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:14.736354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d86d0-5a30-4310-b0fc-85330d79788a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:14.739723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d86d0-5a30-4310-b0fc-85330d79788a service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:14.756016 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3431/6830] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:14.834574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d809fd-a73e-4ea2-984c-ec4d3451146a tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:14.842706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82317c10-20dd-4330-b385-fbd5f0637efd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c247b0a87e554da9aa34e10ccca37583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c6c697a14a4b47b9a9e0eb630435ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:14.846195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82317c10-20dd-4330-b385-fbd5f0637efd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:14.846791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82317c10-20dd-4330-b385-fbd5f0637efd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:14.847242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82317c10-20dd-4330-b385-fbd5f0637efd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] PATH_INFO: `/v3/users/db1330c4975746119329de06905609a0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:14.849235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82317c10-20dd-4330-b385-fbd5f0637efd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorizing `identity:delete_user(user_id=db1330c4975746119329de06905609a0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:14.852078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82317c10-20dd-4330-b385-fbd5f0637efd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:14.924160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-82317c10-20dd-4330-b385-fbd5f0637efd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1330c4975746119329de06905609a0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:14.949587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-82317c10-20dd-4330-b385-fbd5f0637efd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1330c4975746119329de06905609a0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:14.951028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-82317c10-20dd-4330-b385-fbd5f0637efd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1330c4975746119329de06905609a0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:14.972943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-82317c10-20dd-4330-b385-fbd5f0637efd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1330c4975746119329de06905609a0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:14.996595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-82317c10-20dd-4330-b385-fbd5f0637efd tempest-UsersV3TestJSON-1294669269 tempest-UsersV3TestJSON-1294669269-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1330c4975746119329de06905609a0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:15.016579 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3400/6831] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:14 2022] DELETE /identity/v3/users/db1330c4975746119329de06905609a0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:15.021473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d86d0-5a30-4310-b0fc-85330d79788a service glance] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:15.023257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c09d86d0-5a30-4310-b0fc-85330d79788a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:15.254871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d86d0-5a30-4310-b0fc-85330d79788a service glance] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:15.299558 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:15.366542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:15.367793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:15.368249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:15.368533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] PATH_INFO: `/v3/users/6f2df5d090bb436399f04c381f699855` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:15.407266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2df5d090bb436399f04c381f699855)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:15.410077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:15.588547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2df5d090bb436399f04c381f699855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:15.669596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2df5d090bb436399f04c381f699855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:15.670689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2df5d090bb436399f04c381f699855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:15.701256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2df5d090bb436399f04c381f699855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:15.702008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2df5d090bb436399f04c381f699855'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:15.751655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f07e-a9d8-4bc0-8151-a313137d5ee1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:15.752203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f07e-a9d8-4bc0-8151-a313137d5ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:15.752486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f07e-a9d8-4bc0-8151-a313137d5ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:15.754488 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3432/6832] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:15 2022] DELETE /identity/v3/users/6f2df5d090bb436399f04c381f699855 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:15.829570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6532f07e-a9d8-4bc0-8151-a313137d5ee1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:15.836483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6532f07e-a9d8-4bc0-8151-a313137d5ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:15.950323 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:16.004099 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3401/6833] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:31:16.082661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:16.090248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:16.335932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f453d80-cc43-43c9-9694-9b8df2e42e24 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:16.349908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e10df-9b88-4545-996f-b9b7769823a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:16.350966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e10df-9b88-4545-996f-b9b7769823a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:16.351453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e10df-9b88-4545-996f-b9b7769823a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:16.351706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e10df-9b88-4545-996f-b9b7769823a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:16.374388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e10df-9b88-4545-996f-b9b7769823a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:16.383156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e10df-9b88-4545-996f-b9b7769823a3 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:16.399011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532f07e-a9d8-4bc0-8151-a313137d5ee1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:16.401305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6532f07e-a9d8-4bc0-8151-a313137d5ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:16.424714 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3433/6834] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:16.430892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532f07e-a9d8-4bc0-8151-a313137d5ee1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:16.458683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:16.459579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:16.460228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:16.460962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] PATH_INFO: `/v3/users/ada70a6dd76e40db877ce82948b26571` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:16.462243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada70a6dd76e40db877ce82948b26571)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:16.464723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:16.557340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada70a6dd76e40db877ce82948b26571'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:16.577464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada70a6dd76e40db877ce82948b26571'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:16.578670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada70a6dd76e40db877ce82948b26571'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:16.603488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada70a6dd76e40db877ce82948b26571'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:16.624090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada70a6dd76e40db877ce82948b26571'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:16.652891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c1f0c-9023-4470-b4c9-b2c1357866ec None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:16.653284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c1f0c-9023-4470-b4c9-b2c1357866ec None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:16.653884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c1f0c-9023-4470-b4c9-b2c1357866ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:16.662204 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3402/6835] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:16 2022] DELETE /identity/v3/users/ada70a6dd76e40db877ce82948b26571 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:16.738581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f82c1f0c-9023-4470-b4c9-b2c1357866ec None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:16.742672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f82c1f0c-9023-4470-b4c9-b2c1357866ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:16.817891 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:16.940089 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3434/6836] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:17.024709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:17.027082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:17.260250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7648b4-a414-4a8e-ad97-5598605796a5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:17.274299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c76b72-4859-40a4-a326-d32b246dd8d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:17.278674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76b72-4859-40a4-a326-d32b246dd8d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:17.278966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76b72-4859-40a4-a326-d32b246dd8d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:17.279241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76b72-4859-40a4-a326-d32b246dd8d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:17.323123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c76b72-4859-40a4-a326-d32b246dd8d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:17.325414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c76b72-4859-40a4-a326-d32b246dd8d7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:17.353976 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3403/6837] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:31:18.217836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c1f0c-9023-4470-b4c9-b2c1357866ec None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:18.219561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f82c1f0c-9023-4470-b4c9-b2c1357866ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:18.260351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c1f0c-9023-4470-b4c9-b2c1357866ec None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:18.274792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fe4fe-b360-4628-9115-bb574a8af774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:18.277962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fe4fe-b360-4628-9115-bb574a8af774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:18.277962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fe4fe-b360-4628-9115-bb574a8af774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:18.277962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fe4fe-b360-4628-9115-bb574a8af774 admin admin] PATH_INFO: `/v3/users/cc422edce0c04885985ddad994c029d5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:18.279315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fe4fe-b360-4628-9115-bb574a8af774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc422edce0c04885985ddad994c029d5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:18.281983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fe4fe-b360-4628-9115-bb574a8af774 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:18.338635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c76b72-4859-40a4-a326-d32b246dd8d7 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:18.342184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-32c76b72-4859-40a4-a326-d32b246dd8d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:18.363755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c76b72-4859-40a4-a326-d32b246dd8d7 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:18.374379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:18.379082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:18.385731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:18.386019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] PATH_INFO: `/v3/projects/85bcf25f5e9d440fa548313ef64d02a2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:18.389265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bcf25f5e9d440fa548313ef64d02a2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:18.394952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:18.405552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f0fe4fe-b360-4628-9115-bb574a8af774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc422edce0c04885985ddad994c029d5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:18.455850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f0fe4fe-b360-4628-9115-bb574a8af774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc422edce0c04885985ddad994c029d5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:18.457987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f0fe4fe-b360-4628-9115-bb574a8af774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc422edce0c04885985ddad994c029d5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:18.480822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f0fe4fe-b360-4628-9115-bb574a8af774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc422edce0c04885985ddad994c029d5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:18.481764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6f0fe4fe-b360-4628-9115-bb574a8af774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc422edce0c04885985ddad994c029d5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:18.529976 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3435/6838] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:18 2022] DELETE /identity/v3/users/cc422edce0c04885985ddad994c029d5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:18.534125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392267b9-e05d-4435-a0d4-5c886653f026 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:18.534410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392267b9-e05d-4435-a0d4-5c886653f026 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:18.534708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392267b9-e05d-4435-a0d4-5c886653f026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:18.547033 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:18.550134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bcf25f5e9d440fa548313ef64d02a2', 'request_id': 'req-0f8c0868-1758-441f-b89c-ee2771954a4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:18.566910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bcf25f5e9d440fa548313ef64d02a2', 'request_id': 'req-0f8c0868-1758-441f-b89c-ee2771954a4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:18.581504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bcf25f5e9d440fa548313ef64d02a2', 'request_id': 'req-0f8c0868-1758-441f-b89c-ee2771954a4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:18.592709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-392267b9-e05d-4435-a0d4-5c886653f026 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:18.595684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-392267b9-e05d-4435-a0d4-5c886653f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:18.600392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] The token cache is being invalidate because project 85bcf25f5e9d440fa548313ef64d02a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:18.601019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:18.601843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:18.612443 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3404/6839] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:18 2022] DELETE /identity/v3/projects/85bcf25f5e9d440fa548313ef64d02a2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:18.613775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:18.620825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:18.791861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0868-1758-441f-b89c-ee2771954a4b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:18.840735 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3436/6840] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:31:18.896196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392267b9-e05d-4435-a0d4-5c886653f026 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:18.897108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:18.897504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-392267b9-e05d-4435-a0d4-5c886653f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:18.898060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:18.899398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:18.900537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] PATH_INFO: `/v3/users/c247b0a87e554da9aa34e10ccca37583` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:18.902866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c247b0a87e554da9aa34e10ccca37583)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:18.905947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:19.021518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c247b0a87e554da9aa34e10ccca37583'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:19.055447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c247b0a87e554da9aa34e10ccca37583'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:19.056810 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:19.061760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c247b0a87e554da9aa34e10ccca37583'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:19.085812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c247b0a87e554da9aa34e10ccca37583'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:19.132480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392267b9-e05d-4435-a0d4-5c886653f026 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:19.132721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c247b0a87e554da9aa34e10ccca37583'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:19.160010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dac7a-bc66-427e-8dbc-9932cbb780cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:19.161204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dac7a-bc66-427e-8dbc-9932cbb780cf service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:19.161204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dac7a-bc66-427e-8dbc-9932cbb780cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:19.161204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dac7a-bc66-427e-8dbc-9932cbb780cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:19.164316 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3405/6841] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:18 2022] DELETE /identity/v3/users/c247b0a87e554da9aa34e10ccca37583 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:19.165687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-938dac7a-bc66-427e-8dbc-9932cbb780cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:19.216399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dac7a-bc66-427e-8dbc-9932cbb780cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:19.218111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dac7a-bc66-427e-8dbc-9932cbb780cf service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:19.246983 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3437/6842] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:31:19.694296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:19.695906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:19.704273 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:19.920158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c36e11-0011-4d01-9744-d32022fccb5e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:19.963065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:19.964150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:19.965559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:19.966054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] PATH_INFO: `/v3/projects/9d2bc4d142ac4132bbf6dd6a7c2940a1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:19.967620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2bc4d142ac4132bbf6dd6a7c2940a1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:19.970764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:20.090499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2bc4d142ac4132bbf6dd6a7c2940a1', 'request_id': 'req-590fa57f-4c8a-4215-ae3b-00e8507560c3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:20.100719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2bc4d142ac4132bbf6dd6a7c2940a1', 'request_id': 'req-590fa57f-4c8a-4215-ae3b-00e8507560c3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:20.119602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2bc4d142ac4132bbf6dd6a7c2940a1', 'request_id': 'req-590fa57f-4c8a-4215-ae3b-00e8507560c3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:20.158972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] The token cache is being invalidate because project 9d2bc4d142ac4132bbf6dd6a7c2940a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:20.158972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:20.160180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:20.170866 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3406/6843] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:19 2022] DELETE /identity/v3/projects/9d2bc4d142ac4132bbf6dd6a7c2940a1 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:20.172159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dac7a-bc66-427e-8dbc-9932cbb780cf service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:20.198722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dac7a-bc66-427e-8dbc-9932cbb780cf service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:20.398875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:20.402051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:20.402770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:20.403863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] PATH_INFO: `/v3/users/be67ec9175c74cceb6a8364ed4aff21d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:20.406308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=be67ec9175c74cceb6a8364ed4aff21d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:20.412532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:20.499696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be67ec9175c74cceb6a8364ed4aff21d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:20.553004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be67ec9175c74cceb6a8364ed4aff21d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:20.562292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be67ec9175c74cceb6a8364ed4aff21d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:20.590183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be67ec9175c74cceb6a8364ed4aff21d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:20.591145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be67ec9175c74cceb6a8364ed4aff21d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:20.641807 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3438/6844] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:20 2022] DELETE /identity/v3/users/be67ec9175c74cceb6a8364ed4aff21d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:20.906041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:20.908534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:20.932567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:20.934804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:20.936240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fa57f-4c8a-4215-ae3b-00e8507560c3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:21.096127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e3cdc-2620-4e46-b980-4af5e2977edc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:21.125998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:21.127806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:21.128159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:21.128497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] PATH_INFO: `/v3/users/4d57de79d3944dc08f20c7a4e2a41827` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:21.129940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d57de79d3944dc08f20c7a4e2a41827)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:21.134876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:21.156437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:21.157121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:21.157407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:21.157685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] PATH_INFO: `/v3/projects/16043f0ed9a7480388c277119622948f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:21.159706 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:21.163695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16043f0ed9a7480388c277119622948f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:21.175541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:21.300132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d57de79d3944dc08f20c7a4e2a41827'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.328632 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:21.370562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d57de79d3944dc08f20c7a4e2a41827'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.372383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d57de79d3944dc08f20c7a4e2a41827'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.382232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16043f0ed9a7480388c277119622948f', 'request_id': 'req-373a97ae-7719-4247-9ae3-e9e320c61266'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.392118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d57de79d3944dc08f20c7a4e2a41827'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.392848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d57de79d3944dc08f20c7a4e2a41827'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.409048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16043f0ed9a7480388c277119622948f', 'request_id': 'req-373a97ae-7719-4247-9ae3-e9e320c61266'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.427119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16043f0ed9a7480388c277119622948f', 'request_id': 'req-373a97ae-7719-4247-9ae3-e9e320c61266'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.432692 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3439/6845] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:20 2022] DELETE /identity/v3/users/4d57de79d3944dc08f20c7a4e2a41827 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:21.436348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:21.440512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:21.463284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] The token cache is being invalidate because project 16043f0ed9a7480388c277119622948f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:21.464052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.466880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-373a97ae-7719-4247-9ae3-e9e320c61266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.474927 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3407/6846] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:20 2022] DELETE /identity/v3/projects/16043f0ed9a7480388c277119622948f => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:21.476576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b444-5384-4e37-9e8a-4702991cb85f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:21.479658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b444-5384-4e37-9e8a-4702991cb85f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:21.480139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b444-5384-4e37-9e8a-4702991cb85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:21.531262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-93a7b444-5384-4e37-9e8a-4702991cb85f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:21.538559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93a7b444-5384-4e37-9e8a-4702991cb85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:21.584604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bb36f-09a2-4be6-8de9-a2c0618ce287 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:21.590426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:21.591130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:21.591415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:21.591694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] PATH_INFO: `/v3/projects/88c6c697a14a4b47b9a9e0eb630435ca` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:21.593043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c6c697a14a4b47b9a9e0eb630435ca)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:21.595787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:21.676598 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3408/6847] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:21.678142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7b444-5384-4e37-9e8a-4702991cb85f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:21.680721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93a7b444-5384-4e37-9e8a-4702991cb85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:21.697774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7b444-5384-4e37-9e8a-4702991cb85f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:21.700565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c6c697a14a4b47b9a9e0eb630435ca', 'request_id': 'req-297cbf73-d66b-4470-868b-a1937644179c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.706307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c6c697a14a4b47b9a9e0eb630435ca', 'request_id': 'req-297cbf73-d66b-4470-868b-a1937644179c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.715445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c6c697a14a4b47b9a9e0eb630435ca', 'request_id': 'req-297cbf73-d66b-4470-868b-a1937644179c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.742524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] The token cache is being invalidate because project 88c6c697a14a4b47b9a9e0eb630435ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:21.742855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.744416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.746058 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3440/6848] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:21 2022] DELETE /identity/v3/projects/88c6c697a14a4b47b9a9e0eb630435ca => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:21.746834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:21.748400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:21.771005 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:21.802962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:21.803695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:21.803978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:21.804517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] PATH_INFO: `/v3/users/7d68e348798b4e61a3984670cf4943bd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:21.805896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d68e348798b4e61a3984670cf4943bd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:21.808053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:21.843701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cbf73-d66b-4470-868b-a1937644179c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:21.850631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:21.851367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:21.851648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:21.851968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] PATH_INFO: `/v3/projects/90a9ed3603bf4886953560478750f628` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:21.854650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a9ed3603bf4886953560478750f628)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:21.857410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:21.876264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d68e348798b4e61a3984670cf4943bd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.895047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d68e348798b4e61a3984670cf4943bd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.896235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d68e348798b4e61a3984670cf4943bd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.898725 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:21.907117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d68e348798b4e61a3984670cf4943bd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.925049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d68e348798b4e61a3984670cf4943bd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.925284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a9ed3603bf4886953560478750f628', 'request_id': 'req-a3815077-6ce7-46c4-a87c-981ebe5d8b88'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.933781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a9ed3603bf4886953560478750f628', 'request_id': 'req-a3815077-6ce7-46c4-a87c-981ebe5d8b88'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.938420 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3409/6849] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:21 2022] DELETE /identity/v3/users/7d68e348798b4e61a3984670cf4943bd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:21.939572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:21.941153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:21.948044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a9ed3603bf4886953560478750f628', 'request_id': 'req-a3815077-6ce7-46c4-a87c-981ebe5d8b88'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.979652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] The token cache is being invalidate because project 90a9ed3603bf4886953560478750f628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:21.979955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.983503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3815077-6ce7-46c4-a87c-981ebe5d8b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:21.987118 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3441/6850] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:21 2022] DELETE /identity/v3/projects/90a9ed3603bf4886953560478750f628 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:21.993086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11e7fb-918b-42de-983a-3246b8dd47fc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:21.993432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11e7fb-918b-42de-983a-3246b8dd47fc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:21.994283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11e7fb-918b-42de-983a-3246b8dd47fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.017869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bd11e7fb-918b-42de-983a-3246b8dd47fc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:22.019160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bd11e7fb-918b-42de-983a-3246b8dd47fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:22.106578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0cb93-8dba-4481-881c-7380ec825ccb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.120741 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3442/6851] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:22.121027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfcb9d-ab20-4612-b3f3-1bf876c6572a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.122066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfcb9d-ab20-4612-b3f3-1bf876c6572a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.122201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f205b2-18da-4adf-b094-415f5b77f388 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.122484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f205b2-18da-4adf-b094-415f5b77f388 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.122902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f205b2-18da-4adf-b094-415f5b77f388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.124060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfcb9d-ab20-4612-b3f3-1bf876c6572a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.124572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfcb9d-ab20-4612-b3f3-1bf876c6572a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.131618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-90cfcb9d-ab20-4612-b3f3-1bf876c6572a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:22.145652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c5f205b2-18da-4adf-b094-415f5b77f388 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:22.153799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c5f205b2-18da-4adf-b094-415f5b77f388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:22.161608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfcb9d-ab20-4612-b3f3-1bf876c6572a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.163329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfcb9d-ab20-4612-b3f3-1bf876c6572a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.177868 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3410/6852] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:22.179431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134f27-4fd9-42d5-af77-8407354626af None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.179785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134f27-4fd9-42d5-af77-8407354626af None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.180193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134f27-4fd9-42d5-af77-8407354626af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.182225 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3443/6853] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:22.190650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6667f-5f73-42e2-9831-c93fb0ace9b4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.193354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6667f-5f73-42e2-9831-c93fb0ace9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.193925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6667f-5f73-42e2-9831-c93fb0ace9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.214415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-06134f27-4fd9-42d5-af77-8407354626af None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:22.215790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-06134f27-4fd9-42d5-af77-8407354626af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:22.228355 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3411/6854] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:22.239457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06134f27-4fd9-42d5-af77-8407354626af None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.250864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1db6667f-5f73-42e2-9831-c93fb0ace9b4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:22.258706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1db6667f-5f73-42e2-9831-c93fb0ace9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:22.270696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06134f27-4fd9-42d5-af77-8407354626af None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.285815 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3444/6855] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:22.289084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f43d2b-f530-4a50-970c-143569aaef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.289655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f43d2b-f530-4a50-970c-143569aaef96 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.289927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f43d2b-f530-4a50-970c-143569aaef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.290197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f43d2b-f530-4a50-970c-143569aaef96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.291052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f43d2b-f530-4a50-970c-143569aaef96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:31:22.291356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f43d2b-f530-4a50-970c-143569aaef96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.291916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6667f-5f73-42e2-9831-c93fb0ace9b4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.293002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f43d2b-f530-4a50-970c-143569aaef96 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.313369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6667f-5f73-42e2-9831-c93fb0ace9b4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.326724 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3412/6856] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:31:22.330490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f43d2b-f530-4a50-970c-143569aaef96 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.332317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fe641-3bbc-46c8-94c1-76a95b29e406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.332956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe641-3bbc-46c8-94c1-76a95b29e406 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.333237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe641-3bbc-46c8-94c1-76a95b29e406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.333507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe641-3bbc-46c8-94c1-76a95b29e406 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.334171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fe641-3bbc-46c8-94c1-76a95b29e406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:31:22.334476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fe641-3bbc-46c8-94c1-76a95b29e406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.340077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fe641-3bbc-46c8-94c1-76a95b29e406 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.351898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f43d2b-f530-4a50-970c-143569aaef96 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.365912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3e001-33c2-4a36-9019-dd3e01f43bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.367817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3e001-33c2-4a36-9019-dd3e01f43bde admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.368345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3e001-33c2-4a36-9019-dd3e01f43bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.369643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3e001-33c2-4a36-9019-dd3e01f43bde admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.371481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3e001-33c2-4a36-9019-dd3e01f43bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.372940 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3445/6857] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:22.375939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3e001-33c2-4a36-9019-dd3e01f43bde admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.380452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fe641-3bbc-46c8-94c1-76a95b29e406 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.403641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fe641-3bbc-46c8-94c1-76a95b29e406 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.413864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7660c3c-c4a5-4f33-85fa-f4923cdbc4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.414437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7660c3c-c4a5-4f33-85fa-f4923cdbc4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.414755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7660c3c-c4a5-4f33-85fa-f4923cdbc4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.415031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7660c3c-c4a5-4f33-85fa-f4923cdbc4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.416647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7660c3c-c4a5-4f33-85fa-f4923cdbc4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.418911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7660c3c-c4a5-4f33-85fa-f4923cdbc4c8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.462663 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3413/6858] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:22 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:22.465895 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:22.467392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3e001-33c2-4a36-9019-dd3e01f43bde admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.476102 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3446/6859] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:22 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:22.480789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7660c3c-c4a5-4f33-85fa-f4923cdbc4c8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.613700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7660c3c-c4a5-4f33-85fa-f4923cdbc4c8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.640271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa61c7-e429-4e14-b594-1c545b1f812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.643108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa61c7-e429-4e14-b594-1c545b1f812e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.643312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa61c7-e429-4e14-b594-1c545b1f812e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.643575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa61c7-e429-4e14-b594-1c545b1f812e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.646790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa61c7-e429-4e14-b594-1c545b1f812e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.649971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa61c7-e429-4e14-b594-1c545b1f812e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.700517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3e001-33c2-4a36-9019-dd3e01f43bde admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.706812 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3447/6860] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:22 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:22.710301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa61c7-e429-4e14-b594-1c545b1f812e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.711751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a1db0-a0a5-40e5-8d4b-58a7f3c5cbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.712896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a1db0-a0a5-40e5-8d4b-58a7f3c5cbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.714125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a1db0-a0a5-40e5-8d4b-58a7f3c5cbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.714656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a1db0-a0a5-40e5-8d4b-58a7f3c5cbe4 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.716655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a1db0-a0a5-40e5-8d4b-58a7f3c5cbe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.725270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a1db0-a0a5-40e5-8d4b-58a7f3c5cbe4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.746290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa61c7-e429-4e14-b594-1c545b1f812e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.756996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129bb28-f9a8-412d-a7e5-7b69e3eefc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.758808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129bb28-f9a8-412d-a7e5-7b69e3eefc7e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.759101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129bb28-f9a8-412d-a7e5-7b69e3eefc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.760702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129bb28-f9a8-412d-a7e5-7b69e3eefc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.761485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129bb28-f9a8-412d-a7e5-7b69e3eefc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.766173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129bb28-f9a8-412d-a7e5-7b69e3eefc7e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.788729 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3414/6861] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:22 2022] POST /identity/v3/users => generated 288 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:31:22.791830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a1db0-a0a5-40e5-8d4b-58a7f3c5cbe4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.792481 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3448/6862] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:22.797089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129bb28-f9a8-412d-a7e5-7b69e3eefc7e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.813390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a1db0-a0a5-40e5-8d4b-58a7f3c5cbe4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.818314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129bb28-f9a8-412d-a7e5-7b69e3eefc7e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.820204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc095a-45b0-47fd-8d14-edd2e6c25961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.820946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc095a-45b0-47fd-8d14-edd2e6c25961 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.821332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc095a-45b0-47fd-8d14-edd2e6c25961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.821711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc095a-45b0-47fd-8d14-edd2e6c25961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.822560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc095a-45b0-47fd-8d14-edd2e6c25961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.824496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc095a-45b0-47fd-8d14-edd2e6c25961 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.834286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c350c01-7168-49d3-82ef-1c12821fa728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.834997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c350c01-7168-49d3-82ef-1c12821fa728 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.835224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c350c01-7168-49d3-82ef-1c12821fa728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.837224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c350c01-7168-49d3-82ef-1c12821fa728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.837224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c350c01-7168-49d3-82ef-1c12821fa728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.839965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c350c01-7168-49d3-82ef-1c12821fa728 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.842575 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3415/6863] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:22.843624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc095a-45b0-47fd-8d14-edd2e6c25961 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.871055 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3449/6864] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:31:22.871997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c350c01-7168-49d3-82ef-1c12821fa728 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.872419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc095a-45b0-47fd-8d14-edd2e6c25961 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.875717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2c350c01-7168-49d3-82ef-1c12821fa728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:22.880995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2554df-5f04-4fdf-a92d-b65137838325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.881706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2554df-5f04-4fdf-a92d-b65137838325 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.882635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2554df-5f04-4fdf-a92d-b65137838325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.883471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2554df-5f04-4fdf-a92d-b65137838325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.884207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2554df-5f04-4fdf-a92d-b65137838325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.886206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2554df-5f04-4fdf-a92d-b65137838325 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.902268 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3416/6865] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:22.909482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c350c01-7168-49d3-82ef-1c12821fa728 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.910204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2554df-5f04-4fdf-a92d-b65137838325 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:22.924124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2554df-5f04-4fdf-a92d-b65137838325 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:22.924753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.925407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.925686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.925958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] PATH_INFO: `/v3/projects/8c7d0ffa32384024981901a5da42947e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.928201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7d0ffa32384024981901a5da42947e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.931852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4144e-0cba-4213-a808-3aca8328cb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:22.932803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4144e-0cba-4213-a808-3aca8328cb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:22.933259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4144e-0cba-4213-a808-3aca8328cb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:22.933707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4144e-0cba-4213-a808-3aca8328cb22 admin admin] PATH_INFO: `/v3/projects/6cd4a6e6fb02488f8ad1c40228011ccf/users/0959f9c0fb814808b1af17739027f0d5/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:22.939813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:22.960724 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:22.984556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4144e-0cba-4213-a808-3aca8328cb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd4a6e6fb02488f8ad1c40228011ccf, user_id=0959f9c0fb814808b1af17739027f0d5, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:22.992932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4144e-0cba-4213-a808-3aca8328cb22 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:23.043799 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3417/6866] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:22 2022] PUT /identity/v3/projects/6cd4a6e6fb02488f8ad1c40228011ccf/users/0959f9c0fb814808b1af17739027f0d5/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:23.044907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4144e-0cba-4213-a808-3aca8328cb22 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:23.047491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-84b4144e-0cba-4213-a808-3aca8328cb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:23.071496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7d0ffa32384024981901a5da42947e', 'request_id': 'req-fe8f0c48-524e-4603-ba02-0c852ed31886'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:23.098456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7d0ffa32384024981901a5da42947e', 'request_id': 'req-fe8f0c48-524e-4603-ba02-0c852ed31886'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:23.126536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7d0ffa32384024981901a5da42947e', 'request_id': 'req-fe8f0c48-524e-4603-ba02-0c852ed31886'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:23.152885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] The token cache is being invalidate because project 8c7d0ffa32384024981901a5da42947e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:23.153238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:23.154222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:23.156226 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3450/6867] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:22 2022] DELETE /identity/v3/projects/8c7d0ffa32384024981901a5da42947e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:23.157357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:23.159171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:23.252346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4144e-0cba-4213-a808-3aca8328cb22 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:23.257670 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:23.283692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f0c48-524e-4603-ba02-0c852ed31886 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:23.293231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4afc5d-b9f1-4d36-bc35-34f92c79eedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:23.294481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4afc5d-b9f1-4d36-bc35-34f92c79eedd admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:23.294802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4afc5d-b9f1-4d36-bc35-34f92c79eedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:23.295086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4afc5d-b9f1-4d36-bc35-34f92c79eedd admin admin] PATH_INFO: `/v3/projects/c34a3f03dd9444dfa7f7d81e1fef091d/users/d662bce564894d00bb4eafd00a7a7d36/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:23.351449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4afc5d-b9f1-4d36-bc35-34f92c79eedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34a3f03dd9444dfa7f7d81e1fef091d, user_id=d662bce564894d00bb4eafd00a7a7d36, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:23.357898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4afc5d-b9f1-4d36-bc35-34f92c79eedd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:23.375363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:23.375574 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3451/6868] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:23 2022] PUT /identity/v3/projects/c34a3f03dd9444dfa7f7d81e1fef091d/users/d662bce564894d00bb4eafd00a7a7d36/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:23.378895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:23.378895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:23.378895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] PATH_INFO: `/v3/projects/a8e1d90d78d34e5e85d805c3b871712a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:23.379167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b5b9e-4489-4ce0-96dc-785a9a007041 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:23.379167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b5b9e-4489-4ce0-96dc-785a9a007041 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:23.379167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b5b9e-4489-4ce0-96dc-785a9a007041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:23.383987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e1d90d78d34e5e85d805c3b871712a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:23.391636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:23.422039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-392b5b9e-4489-4ce0-96dc-785a9a007041 None None] MFA Rules not processed for user `0959f9c0fb814808b1af17739027f0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:23.423542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-392b5b9e-4489-4ce0-96dc-785a9a007041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:23.465333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e1d90d78d34e5e85d805c3b871712a', 'request_id': 'req-79d09803-432d-4d0b-8202-a1236544faf4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:23.473308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e1d90d78d34e5e85d805c3b871712a', 'request_id': 'req-79d09803-432d-4d0b-8202-a1236544faf4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:23.481753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e1d90d78d34e5e85d805c3b871712a', 'request_id': 'req-79d09803-432d-4d0b-8202-a1236544faf4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:23.511116 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3452/6869] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:23.512517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] The token cache is being invalidate because project a8e1d90d78d34e5e85d805c3b871712a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:23.512843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:23.513553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552cfc-ea7a-4df1-bedc-d37e6d372869 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:23.513753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79d09803-432d-4d0b-8202-a1236544faf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:23.514214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552cfc-ea7a-4df1-bedc-d37e6d372869 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:23.514693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552cfc-ea7a-4df1-bedc-d37e6d372869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:23.516884 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3418/6870] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:23 2022] DELETE /identity/v3/projects/a8e1d90d78d34e5e85d805c3b871712a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:23.521585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4967-e0c9-4329-b964-b6a5ef715355 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:23.521879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4967-e0c9-4329-b964-b6a5ef715355 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:23.522162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4967-e0c9-4329-b964-b6a5ef715355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:23.550807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c5552cfc-ea7a-4df1-bedc-d37e6d372869 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:23.551947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c5552cfc-ea7a-4df1-bedc-d37e6d372869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:23.601148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea4d4967-e0c9-4329-b964-b6a5ef715355 None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:23.602457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea4d4967-e0c9-4329-b964-b6a5ef715355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:23.629892 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:23.710682 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3453/6871] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:23.711894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5552cfc-ea7a-4df1-bedc-d37e6d372869 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:23.714054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c5552cfc-ea7a-4df1-bedc-d37e6d372869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:23.730970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5552cfc-ea7a-4df1-bedc-d37e6d372869 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:23.741922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c01442-f0fa-4811-8e74-49c70effa3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:23.760915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c01442-f0fa-4811-8e74-49c70effa3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:23.761357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c01442-f0fa-4811-8e74-49c70effa3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:23.761847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c01442-f0fa-4811-8e74-49c70effa3d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:23.762681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c01442-f0fa-4811-8e74-49c70effa3d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:23.765190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c01442-f0fa-4811-8e74-49c70effa3d0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:23.765410 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3419/6872] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:23.766230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a81a-d3fe-4991-826a-52e17d728f77 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:23.766518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a81a-d3fe-4991-826a-52e17d728f77 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:23.766839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a81a-d3fe-4991-826a-52e17d728f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:23.796998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6155a81a-d3fe-4991-826a-52e17d728f77 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:23.798223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6155a81a-d3fe-4991-826a-52e17d728f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:23.810533 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3420/6873] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:23.812736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8451936-9e0e-4d81-be88-56a9d66aa3fa None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:23.813178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8451936-9e0e-4d81-be88-56a9d66aa3fa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:23.813464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8451936-9e0e-4d81-be88-56a9d66aa3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:23.828928 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3454/6874] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:23 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:23.831653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c01442-f0fa-4811-8e74-49c70effa3d0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:23.855553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f8451936-9e0e-4d81-be88-56a9d66aa3fa None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:23.859347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f8451936-9e0e-4d81-be88-56a9d66aa3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:23.901053 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:23.945578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c01442-f0fa-4811-8e74-49c70effa3d0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:23.956655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a9061-b861-48d6-913f-29f9ef282049 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd662bce564894d00bb4eafd00a7a7d36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:23.957449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9061-b861-48d6-913f-29f9ef282049 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:23.957843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9061-b861-48d6-913f-29f9ef282049 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:23.958217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9061-b861-48d6-913f-29f9ef282049 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36/password` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:23.961600 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3421/6875] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:23.963519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287129-390f-42d7-9f2b-2e26c91ed33a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:23.965322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287129-390f-42d7-9f2b-2e26c91ed33a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:23.965322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287129-390f-42d7-9f2b-2e26c91ed33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.007883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-87287129-390f-42d7-9f2b-2e26c91ed33a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:24.012650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-87287129-390f-42d7-9f2b-2e26c91ed33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:24.021170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cd9a9061-b861-48d6-913f-29f9ef282049 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:24.024091 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3422/6876] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:24.028824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87287129-390f-42d7-9f2b-2e26c91ed33a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.039826 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3455/6877] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:23 2022] POST /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36/password => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:24.041634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a9061-b861-48d6-913f-29f9ef282049 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.042384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87287129-390f-42d7-9f2b-2e26c91ed33a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.045444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cd9a9061-b861-48d6-913f-29f9ef282049 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:24.047863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc76360-e116-4656-bb19-59915d75b736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:24.048542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc76360-e116-4656-bb19-59915d75b736 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:24.048830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc76360-e116-4656-bb19-59915d75b736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:24.049106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc76360-e116-4656-bb19-59915d75b736 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.049938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc76360-e116-4656-bb19-59915d75b736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:24.052331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc76360-e116-4656-bb19-59915d75b736 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:24.088024 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3423/6878] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:24 2022] POST /identity/v3/users => generated 292 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:24.089145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc76360-e116-4656-bb19-59915d75b736 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.115743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc76360-e116-4656-bb19-59915d75b736 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.124783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef096da9-b8ac-41ab-9875-5e829c49d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:24.126048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096da9-b8ac-41ab-9875-5e829c49d09d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:24.126704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096da9-b8ac-41ab-9875-5e829c49d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:24.127240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096da9-b8ac-41ab-9875-5e829c49d09d admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.129336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef096da9-b8ac-41ab-9875-5e829c49d09d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:31:24.129657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef096da9-b8ac-41ab-9875-5e829c49d09d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:24.132067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef096da9-b8ac-41ab-9875-5e829c49d09d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:24.155457 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3424/6879] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:24.156569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef096da9-b8ac-41ab-9875-5e829c49d09d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.170859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef096da9-b8ac-41ab-9875-5e829c49d09d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.181984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06b03b-4db5-4442-95c6-7e1ff6b76f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:24.182704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06b03b-4db5-4442-95c6-7e1ff6b76f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:24.182973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06b03b-4db5-4442-95c6-7e1ff6b76f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:24.183252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06b03b-4db5-4442-95c6-7e1ff6b76f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.183924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06b03b-4db5-4442-95c6-7e1ff6b76f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:31:24.184364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06b03b-4db5-4442-95c6-7e1ff6b76f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:24.189799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06b03b-4db5-4442-95c6-7e1ff6b76f42 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:24.209430 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3425/6880] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:24.210333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a9061-b861-48d6-913f-29f9ef282049 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.210559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06b03b-4db5-4442-95c6-7e1ff6b76f42 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.223814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c438ab-c5e1-4a85-8099-21ccc1e2e224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:24.226427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c438ab-c5e1-4a85-8099-21ccc1e2e224 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:24.226821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c438ab-c5e1-4a85-8099-21ccc1e2e224 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:24.226938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06b03b-4db5-4442-95c6-7e1ff6b76f42 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.229176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c438ab-c5e1-4a85-8099-21ccc1e2e224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.235844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683ab10-0c25-415a-86df-0dfbe189f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:24.236634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683ab10-0c25-415a-86df-0dfbe189f330 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:24.236988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683ab10-0c25-415a-86df-0dfbe189f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:24.237340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683ab10-0c25-415a-86df-0dfbe189f330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.238217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683ab10-0c25-415a-86df-0dfbe189f330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:24.239493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f7c438ab-c5e1-4a85-8099-21ccc1e2e224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:24.240878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683ab10-0c25-415a-86df-0dfbe189f330 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:24.256656 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3426/6881] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:24.263094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683ab10-0c25-415a-86df-0dfbe189f330 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.279042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683ab10-0c25-415a-86df-0dfbe189f330 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.285990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07def798-4442-4271-86d5-a505416a7065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:24.286803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07def798-4442-4271-86d5-a505416a7065 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:24.287155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07def798-4442-4271-86d5-a505416a7065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:24.287510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07def798-4442-4271-86d5-a505416a7065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.288381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07def798-4442-4271-86d5-a505416a7065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:24.293245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07def798-4442-4271-86d5-a505416a7065 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:24.352037 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3427/6882] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:24 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:24.353063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07def798-4442-4271-86d5-a505416a7065 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.386885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c438ab-c5e1-4a85-8099-21ccc1e2e224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:24.388785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c438ab-c5e1-4a85-8099-21ccc1e2e224 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:24.409076 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:24.419457 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3456/6883] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:24.420385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c438ab-c5e1-4a85-8099-21ccc1e2e224 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.433453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c438ab-c5e1-4a85-8099-21ccc1e2e224 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.468894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07def798-4442-4271-86d5-a505416a7065 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.475591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb68a1a-23e0-4ab4-a18a-9dbfc5be1127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:24.476539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68a1a-23e0-4ab4-a18a-9dbfc5be1127 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:24.477246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68a1a-23e0-4ab4-a18a-9dbfc5be1127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:24.477588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68a1a-23e0-4ab4-a18a-9dbfc5be1127 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.479030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb68a1a-23e0-4ab4-a18a-9dbfc5be1127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:24.481558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb68a1a-23e0-4ab4-a18a-9dbfc5be1127 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:24.522770 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:24.529621 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3428/6884] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:24 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:24.531441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb68a1a-23e0-4ab4-a18a-9dbfc5be1127 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.590576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ae497-1966-4661-b21d-9ea994e608ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:24.591128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ae497-1966-4661-b21d-9ea994e608ec admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:24.591429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ae497-1966-4661-b21d-9ea994e608ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:24.591767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ae497-1966-4661-b21d-9ea994e608ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.593103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ae497-1966-4661-b21d-9ea994e608ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:24.598510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ae497-1966-4661-b21d-9ea994e608ec admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:24.636568 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3457/6885] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:24.640985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ae497-1966-4661-b21d-9ea994e608ec admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.688090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ae497-1966-4661-b21d-9ea994e608ec admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.707568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4a643-0f77-45d1-b9ce-b28e36727f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:24.708657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4a643-0f77-45d1-b9ce-b28e36727f71 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:24.708898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4a643-0f77-45d1-b9ce-b28e36727f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:24.710340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4a643-0f77-45d1-b9ce-b28e36727f71 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.711026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4a643-0f77-45d1-b9ce-b28e36727f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:24.714308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb68a1a-23e0-4ab4-a18a-9dbfc5be1127 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.716889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4a643-0f77-45d1-b9ce-b28e36727f71 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:24.730848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2d231-31a7-4e8b-b6b6-ea0f8c8394c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:24.731895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d231-31a7-4e8b-b6b6-ea0f8c8394c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:24.732417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d231-31a7-4e8b-b6b6-ea0f8c8394c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:24.734968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d231-31a7-4e8b-b6b6-ea0f8c8394c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.741817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2d231-31a7-4e8b-b6b6-ea0f8c8394c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:24.749865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2d231-31a7-4e8b-b6b6-ea0f8c8394c1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:24.781168 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3458/6886] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:24 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:24.781168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4a643-0f77-45d1-b9ce-b28e36727f71 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.803826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4a643-0f77-45d1-b9ce-b28e36727f71 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.819272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05849dc4-b85d-4a22-9c9b-349a70b9c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:24.820669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05849dc4-b85d-4a22-9c9b-349a70b9c5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:24.821014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05849dc4-b85d-4a22-9c9b-349a70b9c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:24.821297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05849dc4-b85d-4a22-9c9b-349a70b9c5c1 admin admin] PATH_INFO: `/v3/projects/89e244257a4541d384974ac2542d912c/users/cfacff22441f4b64ae3bdaecba9f12e5/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:24.825924 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3429/6887] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:24 2022] POST /identity/v3/users => generated 283 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:24.828109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2d231-31a7-4e8b-b6b6-ea0f8c8394c1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:24.845345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05849dc4-b85d-4a22-9c9b-349a70b9c5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e244257a4541d384974ac2542d912c, user_id=cfacff22441f4b64ae3bdaecba9f12e5, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:24.848804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05849dc4-b85d-4a22-9c9b-349a70b9c5c1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:24.863919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2d231-31a7-4e8b-b6b6-ea0f8c8394c1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:24.868691 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3459/6888] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:24 2022] PUT /identity/v3/projects/89e244257a4541d384974ac2542d912c/users/cfacff22441f4b64ae3bdaecba9f12e5/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:24.869823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05849dc4-b85d-4a22-9c9b-349a70b9c5c1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:25.057524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830de17e-1e3e-4eca-9eec-a79322856b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:25.059560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de17e-1e3e-4eca-9eec-a79322856b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:25.059848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de17e-1e3e-4eca-9eec-a79322856b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:25.061635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de17e-1e3e-4eca-9eec-a79322856b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:25.064900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830de17e-1e3e-4eca-9eec-a79322856b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:25.071472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830de17e-1e3e-4eca-9eec-a79322856b57 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:25.078253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05849dc4-b85d-4a22-9c9b-349a70b9c5c1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:25.095909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd54f-e4cd-4bc1-8e01-51e76255fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:25.096886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd54f-e4cd-4bc1-8e01-51e76255fc20 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:25.098644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd54f-e4cd-4bc1-8e01-51e76255fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:25.099691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd54f-e4cd-4bc1-8e01-51e76255fc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:25.101265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd54f-e4cd-4bc1-8e01-51e76255fc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:25.106722 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3430/6889] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:25.108132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89436444-1b58-4415-8c04-df367d810c1a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:25.109880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd54f-e4cd-4bc1-8e01-51e76255fc20 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:25.110783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89436444-1b58-4415-8c04-df367d810c1a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:25.111088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89436444-1b58-4415-8c04-df367d810c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:25.138288 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3460/6890] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:25.140642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c87b4-f1b8-4c67-9e65-971076a60822 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:25.140642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c87b4-f1b8-4c67-9e65-971076a60822 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:25.140642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c87b4-f1b8-4c67-9e65-971076a60822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:25.190117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-89436444-1b58-4415-8c04-df367d810c1a None None] MFA Rules not processed for user `cfacff22441f4b64ae3bdaecba9f12e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:25.191913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-89436444-1b58-4415-8c04-df367d810c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:25.195260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-908c87b4-f1b8-4c67-9e65-971076a60822 None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:25.201232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-908c87b4-f1b8-4c67-9e65-971076a60822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:25.214192 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3461/6891] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:25 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:25.216542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c87b4-f1b8-4c67-9e65-971076a60822 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:25.256776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c87b4-f1b8-4c67-9e65-971076a60822 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:25.276078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d248368-afc6-4fa8-92ee-abf3ff170898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:25.276708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248368-afc6-4fa8-92ee-abf3ff170898 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:25.276988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248368-afc6-4fa8-92ee-abf3ff170898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:25.277265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248368-afc6-4fa8-92ee-abf3ff170898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:25.277904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d248368-afc6-4fa8-92ee-abf3ff170898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:25.279545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d248368-afc6-4fa8-92ee-abf3ff170898 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:25.287102 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:25.315200 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3462/6892] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:25.318283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d248368-afc6-4fa8-92ee-abf3ff170898 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:25.367971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d248368-afc6-4fa8-92ee-abf3ff170898 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:25.378505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c140-eddc-4855-8fb5-79937eb5570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:25.378989 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3431/6893] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:25.380186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c140-eddc-4855-8fb5-79937eb5570e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:25.380468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c140-eddc-4855-8fb5-79937eb5570e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:25.380741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c140-eddc-4855-8fb5-79937eb5570e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:25.381390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724c140-eddc-4855-8fb5-79937eb5570e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:25.383820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5fd58-4a52-4632-960c-f1502700a12d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:25.384660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5fd58-4a52-4632-960c-f1502700a12d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:25.385316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5fd58-4a52-4632-960c-f1502700a12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:25.387023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724c140-eddc-4855-8fb5-79937eb5570e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:25.416194 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3463/6894] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:25.419126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c140-eddc-4855-8fb5-79937eb5570e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:25.429078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0ab5fd58-4a52-4632-960c-f1502700a12d None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:25.431788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ab5fd58-4a52-4632-960c-f1502700a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:25.438234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c140-eddc-4855-8fb5-79937eb5570e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:25.452758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20586c70-21d9-4811-8b9a-2689fbf3708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:25.455476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20586c70-21d9-4811-8b9a-2689fbf3708b admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:25.455643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20586c70-21d9-4811-8b9a-2689fbf3708b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:25.455923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20586c70-21d9-4811-8b9a-2689fbf3708b admin admin] PATH_INFO: `/v3/projects/78069591bb38479bb631141ab7c24914/users/3949febecd4f488b83be4d7601e31f55/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:25.503170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20586c70-21d9-4811-8b9a-2689fbf3708b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78069591bb38479bb631141ab7c24914, user_id=3949febecd4f488b83be4d7601e31f55, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:25.511098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20586c70-21d9-4811-8b9a-2689fbf3708b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:25.549450 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3464/6895] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:25 2022] PUT /identity/v3/projects/78069591bb38479bb631141ab7c24914/users/3949febecd4f488b83be4d7601e31f55/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:25.561725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20586c70-21d9-4811-8b9a-2689fbf3708b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:25.590412 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3432/6896] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:25.591863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5fd58-4a52-4632-960c-f1502700a12d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:25.629713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5fd58-4a52-4632-960c-f1502700a12d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:25.646915 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:25.697890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20586c70-21d9-4811-8b9a-2689fbf3708b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:25.708101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb459a3-8818-43da-968b-bcb2ac1ddc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:25.708816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb459a3-8818-43da-968b-bcb2ac1ddc86 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:25.709405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb459a3-8818-43da-968b-bcb2ac1ddc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:25.709736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb459a3-8818-43da-968b-bcb2ac1ddc86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:25.711071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb459a3-8818-43da-968b-bcb2ac1ddc86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:25.713866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb459a3-8818-43da-968b-bcb2ac1ddc86 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:25.763448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7730f0-f80e-4cd1-9a87-b3a646ed2c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:25.766936 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3465/6897] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:25 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:25.766936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f8751-feaf-4a73-a1f0-307f45708e43 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:25.766936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f8751-feaf-4a73-a1f0-307f45708e43 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:25.766936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f8751-feaf-4a73-a1f0-307f45708e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:25.768541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7730f0-f80e-4cd1-9a87-b3a646ed2c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:25.769058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7730f0-f80e-4cd1-9a87-b3a646ed2c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:25.769620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7730f0-f80e-4cd1-9a87-b3a646ed2c24 admin admin] PATH_INFO: `/v3/projects/081d35d2b1ab4aa08f6dfc71610b82cb/users/7abbe9e0fcc849cebb8866935a2e3d71/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:25.788135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7730f0-f80e-4cd1-9a87-b3a646ed2c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=081d35d2b1ab4aa08f6dfc71610b82cb, user_id=7abbe9e0fcc849cebb8866935a2e3d71, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:25.791449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7730f0-f80e-4cd1-9a87-b3a646ed2c24 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:25.803622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-893f8751-feaf-4a73-a1f0-307f45708e43 None None] MFA Rules not processed for user `3949febecd4f488b83be4d7601e31f55`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:25.807960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-893f8751-feaf-4a73-a1f0-307f45708e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:25.829936 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3433/6898] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:25 2022] PUT /identity/v3/projects/081d35d2b1ab4aa08f6dfc71610b82cb/users/7abbe9e0fcc849cebb8866935a2e3d71/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:25.830964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7730f0-f80e-4cd1-9a87-b3a646ed2c24 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:26.004406 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3466/6899] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:26.004406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f8751-feaf-4a73-a1f0-307f45708e43 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:26.012934 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:26.017806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7730f0-f80e-4cd1-9a87-b3a646ed2c24 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:26.028727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7b0f0-5d0a-4821-b070-4ee1b14038e8 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd662bce564894d00bb4eafd00a7a7d36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:26.029542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b0f0-5d0a-4821-b070-4ee1b14038e8 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:26.029843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b0f0-5d0a-4821-b070-4ee1b14038e8 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:26.030190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b0f0-5d0a-4821-b070-4ee1b14038e8 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36/password` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-62a7b0f0-5d0a-4821-b070-4ee1b14038e8 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:31:26.123424 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 02 01:31:26.124962 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:31:26.125975 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3434/6900] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:25 2022] POST /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36/password => generated 188 bytes in 295 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 02 01:31:26.126512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8b628-473f-4aeb-b179-cd3222cf87b2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:26.126753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8b628-473f-4aeb-b179-cd3222cf87b2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:26.127039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8b628-473f-4aeb-b179-cd3222cf87b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:26.153433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f8751-feaf-4a73-a1f0-307f45708e43 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:26.159217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffbc11-bb9a-4b11-9262-26877fb10459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:26.160097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffbc11-bb9a-4b11-9262-26877fb10459 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:26.160621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffbc11-bb9a-4b11-9262-26877fb10459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:26.161255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffbc11-bb9a-4b11-9262-26877fb10459 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:26.163321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffbc11-bb9a-4b11-9262-26877fb10459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:26.167598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffbc11-bb9a-4b11-9262-26877fb10459 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:26.189576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-29f8b628-473f-4aeb-b179-cd3222cf87b2 None None] MFA Rules not processed for user `7abbe9e0fcc849cebb8866935a2e3d71`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:26.191416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-29f8b628-473f-4aeb-b179-cd3222cf87b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:26.206266 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3467/6901] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:25 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:26.208093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffbc11-bb9a-4b11-9262-26877fb10459 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:26.230413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffbc11-bb9a-4b11-9262-26877fb10459 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:26.258791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e7f57-6a2b-40f5-9516-73469442a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:26.260552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e7f57-6a2b-40f5-9516-73469442a334 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:26.261059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e7f57-6a2b-40f5-9516-73469442a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:26.261565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e7f57-6a2b-40f5-9516-73469442a334 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:26.262422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e7f57-6a2b-40f5-9516-73469442a334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:26.265950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e7f57-6a2b-40f5-9516-73469442a334 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:26.351727 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3435/6902] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:26.352643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8b628-473f-4aeb-b179-cd3222cf87b2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:26.374974 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3468/6903] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:26 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:26.377438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e7f57-6a2b-40f5-9516-73469442a334 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:26.377591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8b628-473f-4aeb-b179-cd3222cf87b2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:26.493688 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:26.520581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf5f08-6758-4baf-bbad-8cc4bdf34c18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd662bce564894d00bb4eafd00a7a7d36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:26.521284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5f08-6758-4baf-bbad-8cc4bdf34c18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:26.521569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5f08-6758-4baf-bbad-8cc4bdf34c18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:26.521848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5f08-6758-4baf-bbad-8cc4bdf34c18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36/password` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-e7cf5f08-6758-4baf-bbad-8cc4bdf34c18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:31:26.597343 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 02 01:31:26.598514 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:31:26.600816 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3436/6904] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:26 2022] POST /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36/password => generated 188 bytes in 248 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 02 01:31:26.612427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf5f08-6758-4baf-bbad-8cc4bdf34c18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:26.628009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf5f08-6758-4baf-bbad-8cc4bdf34c18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:26.629888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e7f57-6a2b-40f5-9516-73469442a334 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:26.638629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322331f-62f9-4f5a-84af-597b59072b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:26.639265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322331f-62f9-4f5a-84af-597b59072b49 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:26.639548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322331f-62f9-4f5a-84af-597b59072b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:26.639929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322331f-62f9-4f5a-84af-597b59072b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:26.640581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322331f-62f9-4f5a-84af-597b59072b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:26.642516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322331f-62f9-4f5a-84af-597b59072b49 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:26.648452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d926380-fdd3-4b1f-85e1-b47bfae693ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:26.649279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d926380-fdd3-4b1f-85e1-b47bfae693ca admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:26.649664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d926380-fdd3-4b1f-85e1-b47bfae693ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:26.650578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d926380-fdd3-4b1f-85e1-b47bfae693ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:26.651514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d926380-fdd3-4b1f-85e1-b47bfae693ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:26.653246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d926380-fdd3-4b1f-85e1-b47bfae693ca admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:26.683046 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3469/6905] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:26.684147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d926380-fdd3-4b1f-85e1-b47bfae693ca admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:26.718140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d926380-fdd3-4b1f-85e1-b47bfae693ca admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:26.720744 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3437/6906] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:26 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:26.721487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322331f-62f9-4f5a-84af-597b59072b49 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:26.806147 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:26.842736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322331f-62f9-4f5a-84af-597b59072b49 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:26.851689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f831d7-af5b-4ff8-b4c6-dcda32efacfd tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd662bce564894d00bb4eafd00a7a7d36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:26.852473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f831d7-af5b-4ff8-b4c6-dcda32efacfd tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:26.854376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f831d7-af5b-4ff8-b4c6-dcda32efacfd tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:26.854763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f831d7-af5b-4ff8-b4c6-dcda32efacfd tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36/password` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:26.881407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b16a69-b96c-4775-8aa9-6d9076c67d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:26.882159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b16a69-b96c-4775-8aa9-6d9076c67d0c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:26.882981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b16a69-b96c-4775-8aa9-6d9076c67d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:26.882981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b16a69-b96c-4775-8aa9-6d9076c67d0c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:26.885421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b16a69-b96c-4775-8aa9-6d9076c67d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:26.887683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b16a69-b96c-4775-8aa9-6d9076c67d0c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:26.933599 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3470/6907] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:26 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:26.934650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b16a69-b96c-4775-8aa9-6d9076c67d0c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:26.949756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b0f831d7-af5b-4ff8-b4c6-dcda32efacfd tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:26.958788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b16a69-b96c-4775-8aa9-6d9076c67d0c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:26.981868 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3438/6908] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:26 2022] POST /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36/password => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:26.984149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f831d7-af5b-4ff8-b4c6-dcda32efacfd tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:26.993848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa82cf-a1cc-40f1-9a48-6839d366b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:26.994561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa82cf-a1cc-40f1-9a48-6839d366b27d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:26.994906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa82cf-a1cc-40f1-9a48-6839d366b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:26.995191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa82cf-a1cc-40f1-9a48-6839d366b27d admin admin] PATH_INFO: `/v3/projects/3cd569e5e9a44d7fb9de9664a7d307b9/users/1a887ff81b134728946bb0104ab1931b/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.013231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f831d7-af5b-4ff8-b4c6-dcda32efacfd tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:27.023050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b5317-c53d-44a8-9d79-61ee1ecd0a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:27.024518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b5317-c53d-44a8-9d79-61ee1ecd0a7e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.024896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b5317-c53d-44a8-9d79-61ee1ecd0a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.025173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b5317-c53d-44a8-9d79-61ee1ecd0a7e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.026710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b5317-c53d-44a8-9d79-61ee1ecd0a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:27.029535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa82cf-a1cc-40f1-9a48-6839d366b27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd569e5e9a44d7fb9de9664a7d307b9, user_id=1a887ff81b134728946bb0104ab1931b, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:27.033973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b5317-c53d-44a8-9d79-61ee1ecd0a7e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:27.036648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa82cf-a1cc-40f1-9a48-6839d366b27d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:27.069070 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3471/6909] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:26 2022] PUT /identity/v3/projects/3cd569e5e9a44d7fb9de9664a7d307b9/users/1a887ff81b134728946bb0104ab1931b/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:27.071321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa82cf-a1cc-40f1-9a48-6839d366b27d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:27.090634 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3439/6910] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:26 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:27.091637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b5317-c53d-44a8-9d79-61ee1ecd0a7e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:27.104621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b5317-c53d-44a8-9d79-61ee1ecd0a7e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:27.229359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620daa86-2d4a-4b7d-bdbb-a80a3d5a51dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:27.229992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620daa86-2d4a-4b7d-bdbb-a80a3d5a51dc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.230191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620daa86-2d4a-4b7d-bdbb-a80a3d5a51dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.230449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620daa86-2d4a-4b7d-bdbb-a80a3d5a51dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.231150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620daa86-2d4a-4b7d-bdbb-a80a3d5a51dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:27.238618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620daa86-2d4a-4b7d-bdbb-a80a3d5a51dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:27.247547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa82cf-a1cc-40f1-9a48-6839d366b27d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:27.269340 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3440/6911] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:27.272214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6e4c2-88dd-41ba-9c3e-331dfb81d492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:27.273056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6e4c2-88dd-41ba-9c3e-331dfb81d492 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.273299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6e4c2-88dd-41ba-9c3e-331dfb81d492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.273506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620daa86-2d4a-4b7d-bdbb-a80a3d5a51dc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:27.273620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6e4c2-88dd-41ba-9c3e-331dfb81d492 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.274346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6e4c2-88dd-41ba-9c3e-331dfb81d492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:27.276698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6e4c2-88dd-41ba-9c3e-331dfb81d492 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:27.295475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620daa86-2d4a-4b7d-bdbb-a80a3d5a51dc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:27.315789 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3472/6912] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:27.316666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6e4c2-88dd-41ba-9c3e-331dfb81d492 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:27.317840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e7b94-07dc-4395-b44d-9be57ad0fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:27.319007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e7b94-07dc-4395-b44d-9be57ad0fa91 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.319313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e7b94-07dc-4395-b44d-9be57ad0fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.319595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e7b94-07dc-4395-b44d-9be57ad0fa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.320401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e7b94-07dc-4395-b44d-9be57ad0fa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:27.323392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e7b94-07dc-4395-b44d-9be57ad0fa91 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:27.348686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6e4c2-88dd-41ba-9c3e-331dfb81d492 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:27.359273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee16dd6-4361-43ab-9ed9-dbd7f7590fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:27.359974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee16dd6-4361-43ab-9ed9-dbd7f7590fab admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.360259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee16dd6-4361-43ab-9ed9-dbd7f7590fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.360542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee16dd6-4361-43ab-9ed9-dbd7f7590fab admin admin] PATH_INFO: `/v3/projects/3cd569e5e9a44d7fb9de9664a7d307b9/users/1a887ff81b134728946bb0104ab1931b/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.371358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee16dd6-4361-43ab-9ed9-dbd7f7590fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd569e5e9a44d7fb9de9664a7d307b9, user_id=1a887ff81b134728946bb0104ab1931b, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:27.375521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee16dd6-4361-43ab-9ed9-dbd7f7590fab admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:27.381290 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3441/6913] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:27.382828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e7b94-07dc-4395-b44d-9be57ad0fa91 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:27.398573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e7b94-07dc-4395-b44d-9be57ad0fa91 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:27.403320 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3473/6914] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:27 2022] PUT /identity/v3/projects/3cd569e5e9a44d7fb9de9664a7d307b9/users/1a887ff81b134728946bb0104ab1931b/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:27.404243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee16dd6-4361-43ab-9ed9-dbd7f7590fab admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:27.416147 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:27.561712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee16dd6-4361-43ab-9ed9-dbd7f7590fab admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:27.573858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7868e03-27a7-4736-bc6f-1d3c02759808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:27.574556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7868e03-27a7-4736-bc6f-1d3c02759808 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.574991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7868e03-27a7-4736-bc6f-1d3c02759808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.575277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7868e03-27a7-4736-bc6f-1d3c02759808 admin admin] PATH_INFO: `/v3/projects/1c87a2d43a014a77964f472d175213a3/users/c3c226b51e7b4e85a0522f5e31081e02/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.577978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018289d-e061-41f9-8ba9-4b747f9c96cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:27.578946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018289d-e061-41f9-8ba9-4b747f9c96cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.579400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018289d-e061-41f9-8ba9-4b747f9c96cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.579834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018289d-e061-41f9-8ba9-4b747f9c96cc admin admin] PATH_INFO: `/v3/projects/4df09d42a9e2491cb5a0024b19e35851/users/1529210b2b1540aead7bf1fabc9bfb2e/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.607808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018289d-e061-41f9-8ba9-4b747f9c96cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df09d42a9e2491cb5a0024b19e35851, user_id=1529210b2b1540aead7bf1fabc9bfb2e, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:27.610399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7868e03-27a7-4736-bc6f-1d3c02759808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c87a2d43a014a77964f472d175213a3, user_id=c3c226b51e7b4e85a0522f5e31081e02, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:27.612587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018289d-e061-41f9-8ba9-4b747f9c96cc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:27.617084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7868e03-27a7-4736-bc6f-1d3c02759808 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:27.633503 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3442/6915] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:27 2022] PUT /identity/v3/projects/4df09d42a9e2491cb5a0024b19e35851/users/1529210b2b1540aead7bf1fabc9bfb2e/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:27.638061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd4d48-fc62-4e45-a091-e5f185ee155d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.638746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd4d48-fc62-4e45-a091-e5f185ee155d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.639329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd4d48-fc62-4e45-a091-e5f185ee155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.649938 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3474/6916] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:27 2022] PUT /identity/v3/projects/1c87a2d43a014a77964f472d175213a3/users/c3c226b51e7b4e85a0522f5e31081e02/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:27.649938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7868e03-27a7-4736-bc6f-1d3c02759808 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:27.678066 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:27.706415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3bbd4d48-fc62-4e45-a091-e5f185ee155d None None] MFA Rules not processed for user `1a887ff81b134728946bb0104ab1931b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:27.708472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3bbd4d48-fc62-4e45-a091-e5f185ee155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:27.778499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7868e03-27a7-4736-bc6f-1d3c02759808 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:27.791736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862b239-993b-4ffe-b264-02f7020edb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:27.792376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862b239-993b-4ffe-b264-02f7020edb86 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.792668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862b239-993b-4ffe-b264-02f7020edb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.792948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862b239-993b-4ffe-b264-02f7020edb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.793603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862b239-993b-4ffe-b264-02f7020edb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:27.795263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862b239-993b-4ffe-b264-02f7020edb86 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:27.823989 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3475/6917] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:27.824970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862b239-993b-4ffe-b264-02f7020edb86 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:27.847923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862b239-993b-4ffe-b264-02f7020edb86 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:27.863724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686deec-ec20-49a2-8258-a4e13f03e7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:27.864451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686deec-ec20-49a2-8258-a4e13f03e7fb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.864747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686deec-ec20-49a2-8258-a4e13f03e7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.865219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686deec-ec20-49a2-8258-a4e13f03e7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.865901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686deec-ec20-49a2-8258-a4e13f03e7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:27.870973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686deec-ec20-49a2-8258-a4e13f03e7fb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:27.895803 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3476/6918] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:27.896725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686deec-ec20-49a2-8258-a4e13f03e7fb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:27.913618 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3443/6919] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:27.917547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd4d48-fc62-4e45-a091-e5f185ee155d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:27.922144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686deec-ec20-49a2-8258-a4e13f03e7fb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:27.935387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd4d48-fc62-4e45-a091-e5f185ee155d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:27.943452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47a87f-8e75-482d-afa1-26e00265fabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:27.944125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47a87f-8e75-482d-afa1-26e00265fabf admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.944413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47a87f-8e75-482d-afa1-26e00265fabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.944689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47a87f-8e75-482d-afa1-26e00265fabf admin admin] PATH_INFO: `/v3/projects/1c87a2d43a014a77964f472d175213a3/users/c3c226b51e7b4e85a0522f5e31081e02/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.947584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47a87f-8e75-482d-afa1-26e00265fabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c87a2d43a014a77964f472d175213a3, user_id=c3c226b51e7b4e85a0522f5e31081e02, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:27.950318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47a87f-8e75-482d-afa1-26e00265fabf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:27.973888 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3444/6920] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:27 2022] PUT /identity/v3/projects/1c87a2d43a014a77964f472d175213a3/users/c3c226b51e7b4e85a0522f5e31081e02/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:27.974958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47a87f-8e75-482d-afa1-26e00265fabf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:27.976874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f47a87f-8e75-482d-afa1-26e00265fabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:27.988465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3fb63-62dc-47b3-8136-2064dbda4148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:27.989159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fb63-62dc-47b3-8136-2064dbda4148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:27.989446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fb63-62dc-47b3-8136-2064dbda4148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:27.989726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fb63-62dc-47b3-8136-2064dbda4148 admin admin] PATH_INFO: `/v3/projects/4df09d42a9e2491cb5a0024b19e35851/users/1529210b2b1540aead7bf1fabc9bfb2e/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:27.993229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3fb63-62dc-47b3-8136-2064dbda4148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df09d42a9e2491cb5a0024b19e35851, user_id=1529210b2b1540aead7bf1fabc9bfb2e, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:28.000881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3fb63-62dc-47b3-8136-2064dbda4148 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:28.041767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3477/6921] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:27 2022] PUT /identity/v3/projects/4df09d42a9e2491cb5a0024b19e35851/users/1529210b2b1540aead7bf1fabc9bfb2e/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:28.043125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2a57-c1f1-466c-86d0-2609a2f50d16 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:28.043402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2a57-c1f1-466c-86d0-2609a2f50d16 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:28.044712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2a57-c1f1-466c-86d0-2609a2f50d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:28.114275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7a2a2a57-c1f1-466c-86d0-2609a2f50d16 None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:28.116441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7a2a2a57-c1f1-466c-86d0-2609a2f50d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:28.126692 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3478/6922] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:28 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:28.126692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0bf7-118b-4201-8b41-c6e5086c0a7e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:28.126692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0bf7-118b-4201-8b41-c6e5086c0a7e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:28.126692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0bf7-118b-4201-8b41-c6e5086c0a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:28.146643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47a87f-8e75-482d-afa1-26e00265fabf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:28.191452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-815e0bf7-118b-4201-8b41-c6e5086c0a7e None None] MFA Rules not processed for user `c3c226b51e7b4e85a0522f5e31081e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:28.192697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-815e0bf7-118b-4201-8b41-c6e5086c0a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:28.251049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900abf1-d9c1-4472-be92-8fefe9346cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:28.251683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900abf1-d9c1-4472-be92-8fefe9346cca service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:28.252128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900abf1-d9c1-4472-be92-8fefe9346cca service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:28.252411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900abf1-d9c1-4472-be92-8fefe9346cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:28.255061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f900abf1-d9c1-4472-be92-8fefe9346cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:28.275427 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:28.352489 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3479/6923] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:28.355028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656059a3-45a2-4dc8-9204-9de1f51e1b99 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:28.355319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656059a3-45a2-4dc8-9204-9de1f51e1b99 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:28.357674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656059a3-45a2-4dc8-9204-9de1f51e1b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:28.374371 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:28.399749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900abf1-d9c1-4472-be92-8fefe9346cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:28.401827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900abf1-d9c1-4472-be92-8fefe9346cca service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:28.421029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-656059a3-45a2-4dc8-9204-9de1f51e1b99 None None] MFA Rules not processed for user `1529210b2b1540aead7bf1fabc9bfb2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:28.422280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-656059a3-45a2-4dc8-9204-9de1f51e1b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:28.427007 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3445/6924] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:28.428734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b02f2e-b5be-4a76-bc0b-2300bec9c422 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:28.429024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b02f2e-b5be-4a76-bc0b-2300bec9c422 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:28.429937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b02f2e-b5be-4a76-bc0b-2300bec9c422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:28.476955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-37b02f2e-b5be-4a76-bc0b-2300bec9c422 None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:28.480042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37b02f2e-b5be-4a76-bc0b-2300bec9c422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:28.589721 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3480/6925] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:28.590709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656059a3-45a2-4dc8-9204-9de1f51e1b99 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:28.593794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-656059a3-45a2-4dc8-9204-9de1f51e1b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:28.617075 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3446/6926] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:28.617979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b02f2e-b5be-4a76-bc0b-2300bec9c422 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:28.642273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b02f2e-b5be-4a76-bc0b-2300bec9c422 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:28.654351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd469e-9230-40f1-9501-09c0bd1dad35 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd662bce564894d00bb4eafd00a7a7d36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:28.655198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd469e-9230-40f1-9501-09c0bd1dad35 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:28.655668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd469e-9230-40f1-9501-09c0bd1dad35 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:28.655953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd469e-9230-40f1-9501-09c0bd1dad35 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36/password` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:28.795675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656059a3-45a2-4dc8-9204-9de1f51e1b99 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:28.823569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b3f08-ce3b-4234-9e65-44a450cd3257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:28.824231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b3f08-ce3b-4234-9e65-44a450cd3257 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:28.824518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b3f08-ce3b-4234-9e65-44a450cd3257 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:28.824798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b3f08-ce3b-4234-9e65-44a450cd3257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:28.826691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fabd469e-9230-40f1-9501-09c0bd1dad35 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:28.862474 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3447/6927] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:28 2022] POST /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36/password => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:28.866728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b3f08-ce3b-4234-9e65-44a450cd3257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:28.871132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b3f08-ce3b-4234-9e65-44a450cd3257 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:28.883272 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3481/6928] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:29.031522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd469e-9230-40f1-9501-09c0bd1dad35 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:29.058399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd469e-9230-40f1-9501-09c0bd1dad35 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:29.068865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6c6d6-7b5f-4f0b-bb41-366f2da9f3b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:29.070216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c6d6-7b5f-4f0b-bb41-366f2da9f3b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:29.070801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c6d6-7b5f-4f0b-bb41-366f2da9f3b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:29.071306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c6d6-7b5f-4f0b-bb41-366f2da9f3b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:29.115974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6c6d6-7b5f-4f0b-bb41-366f2da9f3b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:29.118286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6c6d6-7b5f-4f0b-bb41-366f2da9f3b2 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:29.168473 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3448/6929] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:29.867980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f1e88-0dd0-4226-af78-e81ecc62b77b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:29.868484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f1e88-0dd0-4226-af78-e81ecc62b77b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:29.868484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f1e88-0dd0-4226-af78-e81ecc62b77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:29.917274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8d9f1e88-0dd0-4226-af78-e81ecc62b77b None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:29.919072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8d9f1e88-0dd0-4226-af78-e81ecc62b77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:29.934641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270f44b-0c2a-4d3e-ab09-4f9aa34c8b75 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:29.935551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270f44b-0c2a-4d3e-ab09-4f9aa34c8b75 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:29.936119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270f44b-0c2a-4d3e-ab09-4f9aa34c8b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:29.944660 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3482/6930] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:29 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:29.968183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f270f44b-0c2a-4d3e-ab09-4f9aa34c8b75 None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:29.976255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f270f44b-0c2a-4d3e-ab09-4f9aa34c8b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:30.008297 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3449/6931] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:30.010983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f1e88-0dd0-4226-af78-e81ecc62b77b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:30.032858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f1e88-0dd0-4226-af78-e81ecc62b77b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:30.046022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0831b56-1762-4f4f-af7f-ad4d41e9c2fe tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd662bce564894d00bb4eafd00a7a7d36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:30.050660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0831b56-1762-4f4f-af7f-ad4d41e9c2fe tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:30.052296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0831b56-1762-4f4f-af7f-ad4d41e9c2fe tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:30.053279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0831b56-1762-4f4f-af7f-ad4d41e9c2fe tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36/password` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:30.182982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e0831b56-1762-4f4f-af7f-ad4d41e9c2fe tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:30.223388 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3483/6932] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:30 2022] POST /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36/password => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:30.784669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270f44b-0c2a-4d3e-ab09-4f9aa34c8b75 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:30.816867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270f44b-0c2a-4d3e-ab09-4f9aa34c8b75 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:30.834548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bd65b-2d72-48fd-b1bf-79946cb81640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:30.835481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bd65b-2d72-48fd-b1bf-79946cb81640 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:30.835766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bd65b-2d72-48fd-b1bf-79946cb81640 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:30.836067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bd65b-2d72-48fd-b1bf-79946cb81640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:30.849390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a65bd65b-2d72-48fd-b1bf-79946cb81640 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:30.990974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bd65b-2d72-48fd-b1bf-79946cb81640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:30.992470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bd65b-2d72-48fd-b1bf-79946cb81640 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:31.111418 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3450/6933] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:31.233150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec183fa-24fc-4bc0-ae6b-10e1c316f0a9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:31.234249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec183fa-24fc-4bc0-ae6b-10e1c316f0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:31.234799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec183fa-24fc-4bc0-ae6b-10e1c316f0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:31.271073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7ec183fa-24fc-4bc0-ae6b-10e1c316f0a9 None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:31.272654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7ec183fa-24fc-4bc0-ae6b-10e1c316f0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:31.280960 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3484/6934] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:31 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:31.281991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f9912-7f79-4e17-8135-c13db0f7b669 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:31.282282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f9912-7f79-4e17-8135-c13db0f7b669 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:31.282559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f9912-7f79-4e17-8135-c13db0f7b669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:31.284444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec183fa-24fc-4bc0-ae6b-10e1c316f0a9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:31.305116 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:31.331345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e07f9912-7f79-4e17-8135-c13db0f7b669 None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:31.332581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e07f9912-7f79-4e17-8135-c13db0f7b669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:31.361434 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3451/6935] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:31.366013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f9912-7f79-4e17-8135-c13db0f7b669 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:31.373237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec183fa-24fc-4bc0-ae6b-10e1c316f0a9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:31.379330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868a134-ef1c-4b97-8d6b-7aa9ae6a7c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:31.380446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868a134-ef1c-4b97-8d6b-7aa9ae6a7c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:31.380957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868a134-ef1c-4b97-8d6b-7aa9ae6a7c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:31.381526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868a134-ef1c-4b97-8d6b-7aa9ae6a7c99 admin admin] PATH_INFO: `/v3/users/7abbe9e0fcc849cebb8866935a2e3d71` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:31.382961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868a134-ef1c-4b97-8d6b-7aa9ae6a7c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abbe9e0fcc849cebb8866935a2e3d71)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:31.386407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868a134-ef1c-4b97-8d6b-7aa9ae6a7c99 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:31.392902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f9912-7f79-4e17-8135-c13db0f7b669 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:31.412076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082b6f6-d139-46c1-b379-e85a40cc5e36 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd662bce564894d00bb4eafd00a7a7d36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:31.412711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082b6f6-d139-46c1-b379-e85a40cc5e36 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:31.412935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082b6f6-d139-46c1-b379-e85a40cc5e36 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:31.413214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082b6f6-d139-46c1-b379-e85a40cc5e36 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36/password` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:31.491027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7868a134-ef1c-4b97-8d6b-7aa9ae6a7c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abbe9e0fcc849cebb8866935a2e3d71'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:31.507605 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:31.523768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7868a134-ef1c-4b97-8d6b-7aa9ae6a7c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abbe9e0fcc849cebb8866935a2e3d71'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:31.525573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7868a134-ef1c-4b97-8d6b-7aa9ae6a7c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abbe9e0fcc849cebb8866935a2e3d71'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:31.527156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d082b6f6-d139-46c1-b379-e85a40cc5e36 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:31.561614 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3452/6936] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:31 2022] POST /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36/password => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:31.569365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082b6f6-d139-46c1-b379-e85a40cc5e36 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:31.579117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7868a134-ef1c-4b97-8d6b-7aa9ae6a7c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abbe9e0fcc849cebb8866935a2e3d71'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:31.579352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d082b6f6-d139-46c1-b379-e85a40cc5e36 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:31.581629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7868a134-ef1c-4b97-8d6b-7aa9ae6a7c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abbe9e0fcc849cebb8866935a2e3d71'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:31.599978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082b6f6-d139-46c1-b379-e85a40cc5e36 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:31.607702 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3485/6937] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:31 2022] DELETE /identity/v3/users/7abbe9e0fcc849cebb8866935a2e3d71 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:31.612157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bd71d-bd32-47ff-aebe-9aa5a8e42a26 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:31.612448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bd71d-bd32-47ff-aebe-9aa5a8e42a26 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:31.612723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bd71d-bd32-47ff-aebe-9aa5a8e42a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:31.647809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c40bd71d-bd32-47ff-aebe-9aa5a8e42a26 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:31.651548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c40bd71d-bd32-47ff-aebe-9aa5a8e42a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:31.696438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654eaee-2e36-42d0-843c-9db1940dd5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:31.697696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654eaee-2e36-42d0-843c-9db1940dd5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:31.698394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654eaee-2e36-42d0-843c-9db1940dd5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:31.698905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654eaee-2e36-42d0-843c-9db1940dd5c2 admin admin] PATH_INFO: `/v3/users/3949febecd4f488b83be4d7601e31f55` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:31.701134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654eaee-2e36-42d0-843c-9db1940dd5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3949febecd4f488b83be4d7601e31f55)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:31.703269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654eaee-2e36-42d0-843c-9db1940dd5c2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:31.798085 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3486/6938] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:31.808403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bd71d-bd32-47ff-aebe-9aa5a8e42a26 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:31.810675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c40bd71d-bd32-47ff-aebe-9aa5a8e42a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:31.816652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c654eaee-2e36-42d0-843c-9db1940dd5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3949febecd4f488b83be4d7601e31f55'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:31.847238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c654eaee-2e36-42d0-843c-9db1940dd5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3949febecd4f488b83be4d7601e31f55'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:31.849605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c654eaee-2e36-42d0-843c-9db1940dd5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3949febecd4f488b83be4d7601e31f55'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:31.870739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c654eaee-2e36-42d0-843c-9db1940dd5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3949febecd4f488b83be4d7601e31f55'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:31.882418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c654eaee-2e36-42d0-843c-9db1940dd5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3949febecd4f488b83be4d7601e31f55'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:31.901474 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3453/6939] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:31 2022] DELETE /identity/v3/users/3949febecd4f488b83be4d7601e31f55 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:31.910795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654537f9-7319-462e-8361-59ff75ddf5cc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:31.911188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654537f9-7319-462e-8361-59ff75ddf5cc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:31.912215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654537f9-7319-462e-8361-59ff75ddf5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:31.913733 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:31.949042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bd71d-bd32-47ff-aebe-9aa5a8e42a26 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:31.968008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-654537f9-7319-462e-8361-59ff75ddf5cc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:31.969798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-654537f9-7319-462e-8361-59ff75ddf5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:32.033386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0456ae7-5303-4552-b8ff-95acf4785d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:32.034373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0456ae7-5303-4552-b8ff-95acf4785d52 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:32.035629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0456ae7-5303-4552-b8ff-95acf4785d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:32.036117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0456ae7-5303-4552-b8ff-95acf4785d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:32.038166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b0456ae7-5303-4552-b8ff-95acf4785d52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:32.144495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0456ae7-5303-4552-b8ff-95acf4785d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:32.146014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0456ae7-5303-4552-b8ff-95acf4785d52 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:32.179246 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3487/6940] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:31:32.215009 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3454/6941] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:32.252760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0456ae7-5303-4552-b8ff-95acf4785d52 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:32.254875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b0456ae7-5303-4552-b8ff-95acf4785d52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:32.293506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0456ae7-5303-4552-b8ff-95acf4785d52 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:32.313049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890b75e-3440-4180-a9ad-da038576c603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:32.313914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890b75e-3440-4180-a9ad-da038576c603 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:32.314245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890b75e-3440-4180-a9ad-da038576c603 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:32.314564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890b75e-3440-4180-a9ad-da038576c603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:32.345542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890b75e-3440-4180-a9ad-da038576c603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:32.347154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890b75e-3440-4180-a9ad-da038576c603 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:32.393886 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3488/6942] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:32.556453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565078-ebca-4678-b1e2-7a47556c7b4e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:32.556899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565078-ebca-4678-b1e2-7a47556c7b4e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:32.557280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565078-ebca-4678-b1e2-7a47556c7b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:32.600253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f9565078-ebca-4678-b1e2-7a47556c7b4e None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:32.602081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f9565078-ebca-4678-b1e2-7a47556c7b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:32.611156 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3455/6943] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:32 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:33.615754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2110-8235-4fa6-9ed6-c20b992b39bd None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:33.616351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2110-8235-4fa6-9ed6-c20b992b39bd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:33.616455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2110-8235-4fa6-9ed6-c20b992b39bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:33.657623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6e3c2110-8235-4fa6-9ed6-c20b992b39bd None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:33.658950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6e3c2110-8235-4fa6-9ed6-c20b992b39bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:33.869887 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3489/6944] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:33.877264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48080b-052e-4a8f-8911-bdde8a3cb0e2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:33.877834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48080b-052e-4a8f-8911-bdde8a3cb0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:33.877834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48080b-052e-4a8f-8911-bdde8a3cb0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:33.887876 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:33.933132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7f48080b-052e-4a8f-8911-bdde8a3cb0e2 None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:33.934373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7f48080b-052e-4a8f-8911-bdde8a3cb0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:33.949626 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3456/6945] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:33 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:33.951033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d8f56-9014-4c95-96e3-60ed50017426 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:33.952088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d8f56-9014-4c95-96e3-60ed50017426 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:33.952674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d8f56-9014-4c95-96e3-60ed50017426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:34.086801 n-d-master-1 devstack@keystone.service[81853]: WARNING keystone.server.flask.application [None req-b99d8f56-9014-4c95-96e3-60ed50017426 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 02 01:31:34.091220 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3490/6946] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:33 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 143 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 02 01:31:34.095547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286c5d-23c7-4eb4-988d-7eaf92290d9c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:34.095933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286c5d-23c7-4eb4-988d-7eaf92290d9c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:34.098552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286c5d-23c7-4eb4-988d-7eaf92290d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:34.124213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d8f56-9014-4c95-96e3-60ed50017426 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:34.127232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b99d8f56-9014-4c95-96e3-60ed50017426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:34.178826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d8f56-9014-4c95-96e3-60ed50017426 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:34.193752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:34.194632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:34.194943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:34.195567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] PATH_INFO: `/v3/projects/081d35d2b1ab4aa08f6dfc71610b82cb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:34.199050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=081d35d2b1ab4aa08f6dfc71610b82cb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:34.202300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:34.218647 n-d-master-1 devstack@keystone.service[81854]: WARNING keystone.server.flask.application [None req-f8286c5d-23c7-4eb4-988d-7eaf92290d9c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 02 01:31:34.236409 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3457/6947] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:34 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 142 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 02 01:31:34.237876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9851b1-1218-473d-a90e-9bc2a22e5689 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:34.238500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9851b1-1218-473d-a90e-9bc2a22e5689 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:34.238500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9851b1-1218-473d-a90e-9bc2a22e5689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:34.239961 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:34.354975 n-d-master-1 devstack@keystone.service[81854]: WARNING keystone.server.flask.application [None req-ee9851b1-1218-473d-a90e-9bc2a22e5689 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 02 01:31:34.359168 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3458/6948] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:34 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 122 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 02 01:31:34.363297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9851b1-1218-473d-a90e-9bc2a22e5689 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:34.369616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee9851b1-1218-473d-a90e-9bc2a22e5689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:34.387296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081d35d2b1ab4aa08f6dfc71610b82cb', 'request_id': 'req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.416230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081d35d2b1ab4aa08f6dfc71610b82cb', 'request_id': 'req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.429509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081d35d2b1ab4aa08f6dfc71610b82cb', 'request_id': 'req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.469924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] The token cache is being invalidate because project 081d35d2b1ab4aa08f6dfc71610b82cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:34.470500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.473139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.477585 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3491/6949] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:34 2022] DELETE /identity/v3/projects/081d35d2b1ab4aa08f6dfc71610b82cb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:34.482123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:34.485889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:34.524395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9851b1-1218-473d-a90e-9bc2a22e5689 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:34.539480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:34.540925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:34.541404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:34.541750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] PATH_INFO: `/v3/projects/78069591bb38479bb631141ab7c24914` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:34.544670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] RBAC: Authorizing `identity:delete_project(project_id=78069591bb38479bb631141ab7c24914)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:34.546890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:34.635084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7c5a-7b9f-401b-a39c-b3d4f9c572ee admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:34.660247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78069591bb38479bb631141ab7c24914', 'request_id': 'req-388ced6d-992c-4ed8-a22a-874e0233049b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.677483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78069591bb38479bb631141ab7c24914', 'request_id': 'req-388ced6d-992c-4ed8-a22a-874e0233049b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.692666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78069591bb38479bb631141ab7c24914', 'request_id': 'req-388ced6d-992c-4ed8-a22a-874e0233049b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.722909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] The token cache is being invalidate because project 78069591bb38479bb631141ab7c24914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:34.723278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.727513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.734151 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3459/6950] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:34 2022] DELETE /identity/v3/projects/78069591bb38479bb631141ab7c24914 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:34.739807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:34.743692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:34.752228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:34.752881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:34.753558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:34.753558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] PATH_INFO: `/v3/users/c3c226b51e7b4e85a0522f5e31081e02` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:34.755500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c226b51e7b4e85a0522f5e31081e02)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:34.757369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:34.772724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ced6d-992c-4ed8-a22a-874e0233049b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:34.789823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:34.792145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:34.792439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:34.792856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] PATH_INFO: `/v3/users/1529210b2b1540aead7bf1fabc9bfb2e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:34.794360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1529210b2b1540aead7bf1fabc9bfb2e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:34.801966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:34.855686 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:34.859843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c226b51e7b4e85a0522f5e31081e02'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.896267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c226b51e7b4e85a0522f5e31081e02'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.896820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c226b51e7b4e85a0522f5e31081e02'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.931966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c226b51e7b4e85a0522f5e31081e02'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.932868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c226b51e7b4e85a0522f5e31081e02'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.936929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1529210b2b1540aead7bf1fabc9bfb2e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:34.937866 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:34.957712 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3492/6951] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:34 2022] DELETE /identity/v3/users/c3c226b51e7b4e85a0522f5e31081e02 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:35.003056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1529210b2b1540aead7bf1fabc9bfb2e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:35.004180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1529210b2b1540aead7bf1fabc9bfb2e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:35.026997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1529210b2b1540aead7bf1fabc9bfb2e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:35.046252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1529210b2b1540aead7bf1fabc9bfb2e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:35.064205 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3460/6952] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:34 2022] DELETE /identity/v3/users/1529210b2b1540aead7bf1fabc9bfb2e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:36.226536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:36.228708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:36.317307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:36.320161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:36.431340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8453bf-25af-49a7-b161-9db3f6cddf46 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:36.512442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c474f5f-cc60-4541-b1f5-16bfffb0a612 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:36.522829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:36.525238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:36.528201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:36.529473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] PATH_INFO: `/v3/projects/1c87a2d43a014a77964f472d175213a3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:36.533059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c87a2d43a014a77964f472d175213a3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:36.535356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:36.577875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:36.581364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:36.581867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:36.582367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] PATH_INFO: `/v3/projects/4df09d42a9e2491cb5a0024b19e35851` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:36.583909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df09d42a9e2491cb5a0024b19e35851)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:36.586742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:36.696295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c87a2d43a014a77964f472d175213a3', 'request_id': 'req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:36.713761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c87a2d43a014a77964f472d175213a3', 'request_id': 'req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:36.738727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c87a2d43a014a77964f472d175213a3', 'request_id': 'req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:36.776851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] The token cache is being invalidate because project 1c87a2d43a014a77964f472d175213a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:36.777171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:36.779732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d5c0e5-762e-49a3-81c0-7b1dd63c88b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:36.792229 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3461/6953] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:36 2022] DELETE /identity/v3/projects/1c87a2d43a014a77964f472d175213a3 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:36.794986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253586-092e-4e61-8437-c0ff885a7a35 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:36.795512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253586-092e-4e61-8437-c0ff885a7a35 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:36.795685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253586-092e-4e61-8437-c0ff885a7a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:36.802681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df09d42a9e2491cb5a0024b19e35851', 'request_id': 'req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:36.827751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df09d42a9e2491cb5a0024b19e35851', 'request_id': 'req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:36.844877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df09d42a9e2491cb5a0024b19e35851', 'request_id': 'req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:36.864940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-62253586-092e-4e61-8437-c0ff885a7a35 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:36.866424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62253586-092e-4e61-8437-c0ff885a7a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:36.890034 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:36.916955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] The token cache is being invalidate because project 4df09d42a9e2491cb5a0024b19e35851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:36.917253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:36.927594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-252d4c1d-e4b5-4ba9-abc8-906042bdbdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:36.935018 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3493/6954] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:36 2022] DELETE /identity/v3/projects/4df09d42a9e2491cb5a0024b19e35851 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:36.943129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5888c-908f-451d-8c34-a37fdd7ecbda None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:36.943412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5888c-908f-451d-8c34-a37fdd7ecbda None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:36.943692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5888c-908f-451d-8c34-a37fdd7ecbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.016691 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:37.030661 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3462/6955] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:37.039567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2cdaa-586f-4ee1-ab23-57dc26eff52b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.040096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2cdaa-586f-4ee1-ab23-57dc26eff52b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.040974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2cdaa-586f-4ee1-ab23-57dc26eff52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.043164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-89e5888c-908f-451d-8c34-a37fdd7ecbda None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:37.044395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-89e5888c-908f-451d-8c34-a37fdd7ecbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:37.088168 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3494/6956] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:37.095034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4bb2cdaa-586f-4ee1-ab23-57dc26eff52b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:37.096902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4bb2cdaa-586f-4ee1-ab23-57dc26eff52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:37.097366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159a7a9-7ee4-4d66-92cc-559045599d46 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.097909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159a7a9-7ee4-4d66-92cc-559045599d46 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.098075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159a7a9-7ee4-4d66-92cc-559045599d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.119254 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3463/6957] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:37.123347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2cdaa-586f-4ee1-ab23-57dc26eff52b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:37.141157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2cdaa-586f-4ee1-ab23-57dc26eff52b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:37.142969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8159a7a9-7ee4-4d66-92cc-559045599d46 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:37.144198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8159a7a9-7ee4-4d66-92cc-559045599d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:37.152013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756c9f-3406-4564-86be-09bf53a5f800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:37.152886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756c9f-3406-4564-86be-09bf53a5f800 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.153351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756c9f-3406-4564-86be-09bf53a5f800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.153786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756c9f-3406-4564-86be-09bf53a5f800 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.154702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3756c9f-3406-4564-86be-09bf53a5f800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:31:37.155496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3756c9f-3406-4564-86be-09bf53a5f800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:37.158497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3756c9f-3406-4564-86be-09bf53a5f800 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:37.176351 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3495/6958] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:31:37.178107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159a7a9-7ee4-4d66-92cc-559045599d46 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:37.190282 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3464/6959] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:37.193054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756c9f-3406-4564-86be-09bf53a5f800 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:37.199019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159a7a9-7ee4-4d66-92cc-559045599d46 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:37.216269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c696d-493e-4ed4-a810-b4a6f643ed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:37.216940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c696d-493e-4ed4-a810-b4a6f643ed8e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.217279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c696d-493e-4ed4-a810-b4a6f643ed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.217502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c696d-493e-4ed4-a810-b4a6f643ed8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.218286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c696d-493e-4ed4-a810-b4a6f643ed8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:31:37.218591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c696d-493e-4ed4-a810-b4a6f643ed8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:37.221723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c696d-493e-4ed4-a810-b4a6f643ed8e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:37.228554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756c9f-3406-4564-86be-09bf53a5f800 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:37.242328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb3d0b-3f4b-4f52-a947-f6b036dd839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:37.243075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3d0b-3f4b-4f52-a947-f6b036dd839a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.243922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3d0b-3f4b-4f52-a947-f6b036dd839a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.244220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3d0b-3f4b-4f52-a947-f6b036dd839a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.245455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb3d0b-3f4b-4f52-a947-f6b036dd839a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:37.249075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb3d0b-3f4b-4f52-a947-f6b036dd839a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:37.257781 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3496/6960] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:37.262194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c696d-493e-4ed4-a810-b4a6f643ed8e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:37.298836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c696d-493e-4ed4-a810-b4a6f643ed8e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:37.313184 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3465/6961] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:37 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:31:37.314342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb3d0b-3f4b-4f52-a947-f6b036dd839a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:37.318792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176f085-55e1-49e6-9c12-5a5dbbbbfd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:37.319404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176f085-55e1-49e6-9c12-5a5dbbbbfd3e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.325451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176f085-55e1-49e6-9c12-5a5dbbbbfd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.325751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176f085-55e1-49e6-9c12-5a5dbbbbfd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.326678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176f085-55e1-49e6-9c12-5a5dbbbbfd3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:37.337830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176f085-55e1-49e6-9c12-5a5dbbbbfd3e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:37.410849 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3497/6962] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:37 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:37.415637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176f085-55e1-49e6-9c12-5a5dbbbbfd3e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:37.459044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb3d0b-3f4b-4f52-a947-f6b036dd839a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:37.583529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176f085-55e1-49e6-9c12-5a5dbbbbfd3e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:37.600130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5301e3-7851-487d-bb7f-1180ab26bfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:37.602265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5301e3-7851-487d-bb7f-1180ab26bfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.602580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5301e3-7851-487d-bb7f-1180ab26bfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.603421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5301e3-7851-487d-bb7f-1180ab26bfd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.604075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5301e3-7851-487d-bb7f-1180ab26bfd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:37.612816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5301e3-7851-487d-bb7f-1180ab26bfd8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:37.620372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e758e-6e76-4503-ae8e-2dd6d7132788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:37.621015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e758e-6e76-4503-ae8e-2dd6d7132788 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.621299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e758e-6e76-4503-ae8e-2dd6d7132788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.621574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e758e-6e76-4503-ae8e-2dd6d7132788 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.622218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e758e-6e76-4503-ae8e-2dd6d7132788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:37.632397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e758e-6e76-4503-ae8e-2dd6d7132788 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:37.680640 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3498/6963] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:37 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:37.682457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5301e3-7851-487d-bb7f-1180ab26bfd8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:37.688076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5c5301e3-7851-487d-bb7f-1180ab26bfd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:37.691973 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3466/6964] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:37 2022] POST /identity/v3/users => generated 279 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:31:37.691973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e758e-6e76-4503-ae8e-2dd6d7132788 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:37.713246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e758e-6e76-4503-ae8e-2dd6d7132788 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:37.724660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570027b-a2ba-46b3-a682-9283fd22e001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:37.725856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570027b-a2ba-46b3-a682-9283fd22e001 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.726149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570027b-a2ba-46b3-a682-9283fd22e001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.726428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570027b-a2ba-46b3-a682-9283fd22e001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.727125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570027b-a2ba-46b3-a682-9283fd22e001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:37.729136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570027b-a2ba-46b3-a682-9283fd22e001 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:37.761917 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3467/6965] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:37.762897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570027b-a2ba-46b3-a682-9283fd22e001 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:37.789336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570027b-a2ba-46b3-a682-9283fd22e001 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:37.797704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10c3aa-a655-48e6-9980-a0ef486922bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:37.798959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c3aa-a655-48e6-9980-a0ef486922bf admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.799818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c3aa-a655-48e6-9980-a0ef486922bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.799818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c3aa-a655-48e6-9980-a0ef486922bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.800160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10c3aa-a655-48e6-9980-a0ef486922bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:37.801781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10c3aa-a655-48e6-9980-a0ef486922bf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:37.830496 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3468/6966] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:37.831061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10c3aa-a655-48e6-9980-a0ef486922bf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:37.856407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10c3aa-a655-48e6-9980-a0ef486922bf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:37.871239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd1c28-f24e-4362-bf4e-43e60ad47329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:37.871865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd1c28-f24e-4362-bf4e-43e60ad47329 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.872783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd1c28-f24e-4362-bf4e-43e60ad47329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.872905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd1c28-f24e-4362-bf4e-43e60ad47329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.873562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd1c28-f24e-4362-bf4e-43e60ad47329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:37.875542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd1c28-f24e-4362-bf4e-43e60ad47329 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:37.893230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5301e3-7851-487d-bb7f-1180ab26bfd8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:37.897858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c09ae4-28c6-4678-a7a1-654b8b086d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:37.898721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09ae4-28c6-4678-a7a1-654b8b086d85 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.899070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09ae4-28c6-4678-a7a1-654b8b086d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.899483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09ae4-28c6-4678-a7a1-654b8b086d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.903140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-47c09ae4-28c6-4678-a7a1-654b8b086d85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:37.904566 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3469/6967] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:37.905608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd1c28-f24e-4362-bf4e-43e60ad47329 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:37.926817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd1c28-f24e-4362-bf4e-43e60ad47329 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:37.941684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538f60b-4c26-4a67-a8a7-0f0dab5838ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:37.942336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f60b-4c26-4a67-a8a7-0f0dab5838ae admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:37.942706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f60b-4c26-4a67-a8a7-0f0dab5838ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:37.943820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f60b-4c26-4a67-a8a7-0f0dab5838ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:37.949287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538f60b-4c26-4a67-a8a7-0f0dab5838ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:37.955207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538f60b-4c26-4a67-a8a7-0f0dab5838ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:38.001108 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3470/6968] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:38.001108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538f60b-4c26-4a67-a8a7-0f0dab5838ae admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:38.035786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538f60b-4c26-4a67-a8a7-0f0dab5838ae admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:38.058410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db349b2-f17f-4f8a-b018-e610f1b5d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:38.061598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db349b2-f17f-4f8a-b018-e610f1b5d8fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:38.061890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db349b2-f17f-4f8a-b018-e610f1b5d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:38.062167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db349b2-f17f-4f8a-b018-e610f1b5d8fe admin admin] PATH_INFO: `/v3/projects/4c47532af47146329ffd339c1a568fd8/users/66aa8c34570e4e4ca4ae8fb9969b19e1/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:38.073477 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:38.078387 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:38.132581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db349b2-f17f-4f8a-b018-e610f1b5d8fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c47532af47146329ffd339c1a568fd8, user_id=66aa8c34570e4e4ca4ae8fb9969b19e1, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:38.135989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db349b2-f17f-4f8a-b018-e610f1b5d8fe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:38.151245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c09ae4-28c6-4678-a7a1-654b8b086d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:38.153028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c09ae4-28c6-4678-a7a1-654b8b086d85 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:38.182857 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3471/6969] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:37 2022] PUT /identity/v3/projects/4c47532af47146329ffd339c1a568fd8/users/66aa8c34570e4e4ca4ae8fb9969b19e1/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:38.182857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db349b2-f17f-4f8a-b018-e610f1b5d8fe admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:38.198531 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3499/6970] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:38.201618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d64ff-dd4a-4cbc-9216-ccd51774c16e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:38.203148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d64ff-dd4a-4cbc-9216-ccd51774c16e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:38.203663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d64ff-dd4a-4cbc-9216-ccd51774c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:38.307815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-298d64ff-dd4a-4cbc-9216-ccd51774c16e None None] MFA Rules not processed for user `66aa8c34570e4e4ca4ae8fb9969b19e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:38.309350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-298d64ff-dd4a-4cbc-9216-ccd51774c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:38.350454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db349b2-f17f-4f8a-b018-e610f1b5d8fe admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:38.375211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca20704-dd65-4975-ad1d-616d57d29125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:38.375912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca20704-dd65-4975-ad1d-616d57d29125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:38.376193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca20704-dd65-4975-ad1d-616d57d29125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:38.376472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca20704-dd65-4975-ad1d-616d57d29125 admin admin] PATH_INFO: `/v3/projects/badeee9374824418a7d264b637d4108f/users/532b108f8f6b4343817e584f5da50c42/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:38.434714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca20704-dd65-4975-ad1d-616d57d29125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badeee9374824418a7d264b637d4108f, user_id=532b108f8f6b4343817e584f5da50c42, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:38.437813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca20704-dd65-4975-ad1d-616d57d29125 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:38.482638 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3472/6971] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:38 2022] PUT /identity/v3/projects/badeee9374824418a7d264b637d4108f/users/532b108f8f6b4343817e584f5da50c42/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:38.567338 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3500/6972] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:38.647926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eeb0b-f637-4bb6-a772-21d2c6138065 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:38.647926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eeb0b-f637-4bb6-a772-21d2c6138065 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:38.648250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eeb0b-f637-4bb6-a772-21d2c6138065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:38.670124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d64ff-dd4a-4cbc-9216-ccd51774c16e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:38.671601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-298d64ff-dd4a-4cbc-9216-ccd51774c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:38.729741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-af2eeb0b-f637-4bb6-a772-21d2c6138065 None None] MFA Rules not processed for user `532b108f8f6b4343817e584f5da50c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:38.732943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-af2eeb0b-f637-4bb6-a772-21d2c6138065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:38.870648 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3473/6973] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:38.873153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2eeb0b-f637-4bb6-a772-21d2c6138065 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:38.877500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d64ff-dd4a-4cbc-9216-ccd51774c16e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:38.964662 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:38.981641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2eeb0b-f637-4bb6-a772-21d2c6138065 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:38.998711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ed9d5-8dc3-404c-8d9a-7d6737ae5bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:39.003024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ed9d5-8dc3-404c-8d9a-7d6737ae5bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:39.005010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ed9d5-8dc3-404c-8d9a-7d6737ae5bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:39.005368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ed9d5-8dc3-404c-8d9a-7d6737ae5bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:39.006692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ed9d5-8dc3-404c-8d9a-7d6737ae5bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:39.010905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ed9d5-8dc3-404c-8d9a-7d6737ae5bd9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:39.064588 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3474/6974] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:38 2022] POST /identity/v3/projects => generated 355 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:31:39.070064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ed9d5-8dc3-404c-8d9a-7d6737ae5bd9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:39.094131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cafa18-c3d2-4241-b91a-c315e6ceaf75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:39.094757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cafa18-c3d2-4241-b91a-c315e6ceaf75 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:39.095243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cafa18-c3d2-4241-b91a-c315e6ceaf75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:39.095526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cafa18-c3d2-4241-b91a-c315e6ceaf75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:39.242963 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:39.267141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ed9d5-8dc3-404c-8d9a-7d6737ae5bd9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:39.275707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d6b40-d4a0-401c-bbf6-1e1f91da4ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:39.276770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d6b40-d4a0-401c-bbf6-1e1f91da4ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:39.277282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d6b40-d4a0-401c-bbf6-1e1f91da4ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:39.277768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d6b40-d4a0-401c-bbf6-1e1f91da4ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:39.278784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d6b40-d4a0-401c-bbf6-1e1f91da4ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:39.283385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d6b40-d4a0-401c-bbf6-1e1f91da4ca4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:39.284677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cafa18-c3d2-4241-b91a-c315e6ceaf75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:39.291432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cafa18-c3d2-4241-b91a-c315e6ceaf75 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:39.325319 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3475/6975] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:39 2022] POST /identity/v3/users => generated 284 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:39.328637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d6b40-d4a0-401c-bbf6-1e1f91da4ca4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:39.331714 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3501/6976] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:39.348138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d6b40-d4a0-401c-bbf6-1e1f91da4ca4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:39.363303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d280ae-4a28-4c50-ae66-f9228709b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:39.365767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d280ae-4a28-4c50-ae66-f9228709b27d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:39.367919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d280ae-4a28-4c50-ae66-f9228709b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:39.369838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d280ae-4a28-4c50-ae66-f9228709b27d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:39.370774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d280ae-4a28-4c50-ae66-f9228709b27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:39.376762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d280ae-4a28-4c50-ae66-f9228709b27d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:39.416146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cafa18-c3d2-4241-b91a-c315e6ceaf75 service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:39.425645 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3476/6977] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:39.448735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cafa18-c3d2-4241-b91a-c315e6ceaf75 service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:39.463711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12229422-99e3-4905-a1b1-f189e14fff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:39.464481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12229422-99e3-4905-a1b1-f189e14fff34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:39.464904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12229422-99e3-4905-a1b1-f189e14fff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:39.465248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12229422-99e3-4905-a1b1-f189e14fff34 admin admin] PATH_INFO: `/v3/projects/d144d1777f804c3a89120656dde2c44a/users/987e9f2e9aa8468dafd48956704394df/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:39.495981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12229422-99e3-4905-a1b1-f189e14fff34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d144d1777f804c3a89120656dde2c44a, user_id=987e9f2e9aa8468dafd48956704394df, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:39.499524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12229422-99e3-4905-a1b1-f189e14fff34 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:39.535886 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3502/6978] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:39 2022] PUT /identity/v3/projects/d144d1777f804c3a89120656dde2c44a/users/987e9f2e9aa8468dafd48956704394df/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:39.540058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d280ae-4a28-4c50-ae66-f9228709b27d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:39.553270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d280ae-4a28-4c50-ae66-f9228709b27d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:39.712278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3500303-716b-4eb1-bd39-b0161a7fe0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:39.713224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500303-716b-4eb1-bd39-b0161a7fe0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:39.713520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500303-716b-4eb1-bd39-b0161a7fe0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:39.713801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500303-716b-4eb1-bd39-b0161a7fe0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:39.714468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3500303-716b-4eb1-bd39-b0161a7fe0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:39.719660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3500303-716b-4eb1-bd39-b0161a7fe0f3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:39.740860 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3477/6979] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:39.744839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12229422-99e3-4905-a1b1-f189e14fff34 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:39.760307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12229422-99e3-4905-a1b1-f189e14fff34 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:39.772062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c97a66-b06c-49c5-84a3-f1b3bd0fe370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:39.772804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c97a66-b06c-49c5-84a3-f1b3bd0fe370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:39.773084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c97a66-b06c-49c5-84a3-f1b3bd0fe370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:39.773362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c97a66-b06c-49c5-84a3-f1b3bd0fe370 admin admin] PATH_INFO: `/v3/projects/d144d1777f804c3a89120656dde2c44a/users/987e9f2e9aa8468dafd48956704394df/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:39.777209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c97a66-b06c-49c5-84a3-f1b3bd0fe370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d144d1777f804c3a89120656dde2c44a, user_id=987e9f2e9aa8468dafd48956704394df, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:39.783460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c97a66-b06c-49c5-84a3-f1b3bd0fe370 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:39.838060 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3503/6980] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:39 2022] PUT /identity/v3/projects/d144d1777f804c3a89120656dde2c44a/users/987e9f2e9aa8468dafd48956704394df/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:39.848040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edfa1d-ee8e-4c03-8530-df9b7dd77e23 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:39.848567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edfa1d-ee8e-4c03-8530-df9b7dd77e23 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:39.848911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edfa1d-ee8e-4c03-8530-df9b7dd77e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:39.928978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d5edfa1d-ee8e-4c03-8530-df9b7dd77e23 None None] MFA Rules not processed for user `987e9f2e9aa8468dafd48956704394df`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:39.931373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5edfa1d-ee8e-4c03-8530-df9b7dd77e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:40.059055 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:40.129310 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3478/6981] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:40.137221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c97a66-b06c-49c5-84a3-f1b3bd0fe370 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:40.286977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c97a66-b06c-49c5-84a3-f1b3bd0fe370 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:40.297875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68c9f7-1581-41cb-922e-dd5ecc9af778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:40.300059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c9f7-1581-41cb-922e-dd5ecc9af778 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:40.300059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c9f7-1581-41cb-922e-dd5ecc9af778 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:40.300059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c9f7-1581-41cb-922e-dd5ecc9af778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:40.325073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68c9f7-1581-41cb-922e-dd5ecc9af778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:40.327030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68c9f7-1581-41cb-922e-dd5ecc9af778 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:40.344169 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3504/6982] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:40.535426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edfa1d-ee8e-4c03-8530-df9b7dd77e23 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:40.555936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edfa1d-ee8e-4c03-8530-df9b7dd77e23 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:40.574589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc8368-cee3-4747-848a-fd78ec3ffafe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:40.589942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8368-cee3-4747-848a-fd78ec3ffafe service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:40.590298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8368-cee3-4747-848a-fd78ec3ffafe service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:40.590587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8368-cee3-4747-848a-fd78ec3ffafe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:40.851967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc8368-cee3-4747-848a-fd78ec3ffafe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:40.854864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc8368-cee3-4747-848a-fd78ec3ffafe service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:40.895013 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3479/6983] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:44.977517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68c9f7-1581-41cb-922e-dd5ecc9af778 service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:45.227057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68c9f7-1581-41cb-922e-dd5ecc9af778 service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:45.237149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeb854-9de3-448b-a8ba-532bcdaf4d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:45.239091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb854-9de3-448b-a8ba-532bcdaf4d0b service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:45.247615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb854-9de3-448b-a8ba-532bcdaf4d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:45.249149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb854-9de3-448b-a8ba-532bcdaf4d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:45.251776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-79aeb854-9de3-448b-a8ba-532bcdaf4d0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:45.339172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc8368-cee3-4747-848a-fd78ec3ffafe service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:45.340608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bcbc8368-cee3-4747-848a-fd78ec3ffafe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:45.475340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeb854-9de3-448b-a8ba-532bcdaf4d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:45.480483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeb854-9de3-448b-a8ba-532bcdaf4d0b service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:45.518960 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:45.540522 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3505/6984] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:45.541881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986d4a3-363e-4ded-a930-6cd29c6b044a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:45.542173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986d4a3-363e-4ded-a930-6cd29c6b044a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:45.542697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986d4a3-363e-4ded-a930-6cd29c6b044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:45.697338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d986d4a3-363e-4ded-a930-6cd29c6b044a None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:45.700916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d986d4a3-363e-4ded-a930-6cd29c6b044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:45.722989 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3506/6985] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:45 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:45.728577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986d4a3-363e-4ded-a930-6cd29c6b044a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:45.730516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d986d4a3-363e-4ded-a930-6cd29c6b044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:46.015994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986d4a3-363e-4ded-a930-6cd29c6b044a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:46.027232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaf1b2-9c0d-43aa-acf9-aa267b6e1b32 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd662bce564894d00bb4eafd00a7a7d36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:46.028903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaf1b2-9c0d-43aa-acf9-aa267b6e1b32 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:46.029822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaf1b2-9c0d-43aa-acf9-aa267b6e1b32 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:46.031108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaf1b2-9c0d-43aa-acf9-aa267b6e1b32 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36/password` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:46.054751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc8368-cee3-4747-848a-fd78ec3ffafe service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:46.065833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:46.067346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:46.068876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:46.069326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] PATH_INFO: `/v3/users/e1876c58b568404db5171654ac0f4275` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:46.073472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1876c58b568404db5171654ac0f4275)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:46.077171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:46.138270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8edaf1b2-9c0d-43aa-acf9-aa267b6e1b32 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:46.158756 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3507/6986] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:45 2022] POST /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36/password => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:46.201142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1876c58b568404db5171654ac0f4275'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:46.254000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1876c58b568404db5171654ac0f4275'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:46.255163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1876c58b568404db5171654ac0f4275'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:46.276504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1876c58b568404db5171654ac0f4275'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:46.289696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1876c58b568404db5171654ac0f4275'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:46.295886 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:46.309850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56096f-4cd8-49aa-927b-8fbcbc875aee None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:46.310491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56096f-4cd8-49aa-927b-8fbcbc875aee None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:46.311337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56096f-4cd8-49aa-927b-8fbcbc875aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:46.315039 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3480/6987] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:45 2022] DELETE /identity/v3/users/e1876c58b568404db5171654ac0f4275 => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:46.346100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1d56096f-4cd8-49aa-927b-8fbcbc875aee None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:46.350669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1d56096f-4cd8-49aa-927b-8fbcbc875aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:46.503127 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3508/6988] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:46.530890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:46.533133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:46.672918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fb596-4494-4530-ad80-6bc8d3eb08fc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:46.684770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355cc07-9d85-402a-a360-4e765034eea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:46.687481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355cc07-9d85-402a-a360-4e765034eea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:46.687878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355cc07-9d85-402a-a360-4e765034eea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:46.688261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355cc07-9d85-402a-a360-4e765034eea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:46.713583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355cc07-9d85-402a-a360-4e765034eea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:46.715758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355cc07-9d85-402a-a360-4e765034eea1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:46.760584 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3481/6989] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:47.164255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871385d0-4ae6-402c-b3e6-9c98a486972c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:47.164783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871385d0-4ae6-402c-b3e6-9c98a486972c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:47.164895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871385d0-4ae6-402c-b3e6-9c98a486972c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:47.220334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-871385d0-4ae6-402c-b3e6-9c98a486972c None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:47.224400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-871385d0-4ae6-402c-b3e6-9c98a486972c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:47.237440 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3509/6990] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:47 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:47.242137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5964d-74b5-4adc-aa5c-0d013f6c5bee None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:47.242424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5964d-74b5-4adc-aa5c-0d013f6c5bee None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:47.242724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5964d-74b5-4adc-aa5c-0d013f6c5bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:47.246905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3cc5964d-74b5-4adc-aa5c-0d013f6c5bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-3cc5964d-74b5-4adc-aa5c-0d013f6c5bee None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 02 01:31:47.422163 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:31:47.423807 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 02 01:31:47.428042 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:31:47.428820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9b30-3778-4051-8170-334308efad04 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:47.429083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9b30-3778-4051-8170-334308efad04 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:47.429288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9b30-3778-4051-8170-334308efad04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:47.432034 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3482/6991] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:47 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 01:31:47.703917 n-d-master-1 devstack@keystone.service[81853]: WARNING keystone.server.flask.application [None req-2f5a9b30-3778-4051-8170-334308efad04 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 02 01:31:47.708671 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3510/6992] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:47 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 281 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 02 01:31:47.713315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8649104-ccdf-4a10-9d3e-29395b84da0c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:47.714205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8649104-ccdf-4a10-9d3e-29395b84da0c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:47.715274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8649104-ccdf-4a10-9d3e-29395b84da0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:47.841932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d8649104-ccdf-4a10-9d3e-29395b84da0c None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:47.845102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d8649104-ccdf-4a10-9d3e-29395b84da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:47.865860 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3483/6993] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:47.870732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a9b30-3778-4051-8170-334308efad04 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:47.889622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a9b30-3778-4051-8170-334308efad04 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:47.907810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9987a-4ec1-4dff-adf9-4b9baea42dff tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd662bce564894d00bb4eafd00a7a7d36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:47.912243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9987a-4ec1-4dff-adf9-4b9baea42dff tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:47.912582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9987a-4ec1-4dff-adf9-4b9baea42dff tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:47.913788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9987a-4ec1-4dff-adf9-4b9baea42dff tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36/password` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:48.030725 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:UPDATE=4,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:48.036454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-19f9987a-4ec1-4dff-adf9-4b9baea42dff tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:48.056077 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3511/6994] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:47 2022] POST /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36/password => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:49.061573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1fa6f-035e-4b85-a806-4fda286bb96d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:49.062344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1fa6f-035e-4b85-a806-4fda286bb96d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:49.062636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1fa6f-035e-4b85-a806-4fda286bb96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:49.096165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9ee1fa6f-035e-4b85-a806-4fda286bb96d None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:49.098124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9ee1fa6f-035e-4b85-a806-4fda286bb96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:49.106372 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3484/6995] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:49 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:49.114951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe14f2-7d2c-479a-914f-25dbad32d399 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:49.116399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe14f2-7d2c-479a-914f-25dbad32d399 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:49.118723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe14f2-7d2c-479a-914f-25dbad32d399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:49.176199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dbfe14f2-7d2c-479a-914f-25dbad32d399 None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:49.182059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dbfe14f2-7d2c-479a-914f-25dbad32d399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:49.209321 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3512/6996] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:49.213073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1fa6f-035e-4b85-a806-4fda286bb96d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:49.232765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1fa6f-035e-4b85-a806-4fda286bb96d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:49.247180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827a5e9-6d5c-427a-b878-02515bf50b0f tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd662bce564894d00bb4eafd00a7a7d36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:49.249550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a5e9-6d5c-427a-b878-02515bf50b0f tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:49.249550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a5e9-6d5c-427a-b878-02515bf50b0f tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:49.250334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a5e9-6d5c-427a-b878-02515bf50b0f tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36/password` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:49.359768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3827a5e9-6d5c-427a-b878-02515bf50b0f tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:49.380204 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3485/6997] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:49 2022] POST /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36/password => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:49.710175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe14f2-7d2c-479a-914f-25dbad32d399 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:49.711858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dbfe14f2-7d2c-479a-914f-25dbad32d399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:49.736695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe14f2-7d2c-479a-914f-25dbad32d399 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:49.755749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:49.756658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:49.757557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:49.758237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] PATH_INFO: `/v3/projects/eb508d5d15db4c5abcebe80998d8a1b2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:49.763756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb508d5d15db4c5abcebe80998d8a1b2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:49.765994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:49.885871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb508d5d15db4c5abcebe80998d8a1b2', 'request_id': 'req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:49.906025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb508d5d15db4c5abcebe80998d8a1b2', 'request_id': 'req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:49.913030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb508d5d15db4c5abcebe80998d8a1b2', 'request_id': 'req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:49.941804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] The token cache is being invalidate because project eb508d5d15db4c5abcebe80998d8a1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:49.942344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:49.944224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b75352b5-ffea-4d2f-bcf8-4e681eae2bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:49.952226 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3513/6998] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:49 2022] DELETE /identity/v3/projects/eb508d5d15db4c5abcebe80998d8a1b2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:49.957090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb22c-c003-4792-ab27-e205d6bf8e0e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:49.957612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb22c-c003-4792-ab27-e205d6bf8e0e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:49.958045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb22c-c003-4792-ab27-e205d6bf8e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:49.991151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e3eeb22c-c003-4792-ab27-e205d6bf8e0e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:49.995788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e3eeb22c-c003-4792-ab27-e205d6bf8e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:50.137747 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:UPDATE=2,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:50.167788 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3486/6999] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:50.175607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb020e-ab96-4b63-9aa8-21bf26dbb0aa None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:50.176102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb020e-ab96-4b63-9aa8-21bf26dbb0aa None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:50.176294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb020e-ab96-4b63-9aa8-21bf26dbb0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:50.210760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7bfb020e-ab96-4b63-9aa8-21bf26dbb0aa None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:50.211932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7bfb020e-ab96-4b63-9aa8-21bf26dbb0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:50.230969 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3514/7000] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:50.235066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeb22c-c003-4792-ab27-e205d6bf8e0e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:50.245262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeb22c-c003-4792-ab27-e205d6bf8e0e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:50.259843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76673d53-52af-4a83-905b-565224fa3e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:50.260493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673d53-52af-4a83-905b-565224fa3e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:50.260768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673d53-52af-4a83-905b-565224fa3e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:50.261020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673d53-52af-4a83-905b-565224fa3e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:50.261684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76673d53-52af-4a83-905b-565224fa3e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:31:50.261984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76673d53-52af-4a83-905b-565224fa3e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:50.266968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76673d53-52af-4a83-905b-565224fa3e8e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:50.300660 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3487/7001] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:50.301840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb020e-ab96-4b63-9aa8-21bf26dbb0aa None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:50.312362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb020e-ab96-4b63-9aa8-21bf26dbb0aa None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:50.317536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6b7ac-51d4-416a-9b2f-c6afec2cdaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:50.318143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6b7ac-51d4-416a-9b2f-c6afec2cdaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:50.318423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6b7ac-51d4-416a-9b2f-c6afec2cdaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:50.318723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6b7ac-51d4-416a-9b2f-c6afec2cdaa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:50.319556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6b7ac-51d4-416a-9b2f-c6afec2cdaa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:50.322007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6b7ac-51d4-416a-9b2f-c6afec2cdaa5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:50.366707 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3515/7002] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:50 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:50.371142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76673d53-52af-4a83-905b-565224fa3e8e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:50.384964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1af19-8343-49c9-835d-3ba4d0551e73 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:50.385685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1af19-8343-49c9-835d-3ba4d0551e73 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:50.386182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1af19-8343-49c9-835d-3ba4d0551e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:50.395798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76673d53-52af-4a83-905b-565224fa3e8e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:50.437611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-22c1af19-8343-49c9-835d-3ba4d0551e73 None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:50.440047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-22c1af19-8343-49c9-835d-3ba4d0551e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:50.453607 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3516/7003] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:50 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:50.455378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d684bc-97d1-4fe7-b8c9-69da4f07360c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:50.456611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d684bc-97d1-4fe7-b8c9-69da4f07360c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:50.456923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d684bc-97d1-4fe7-b8c9-69da4f07360c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:50.494202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-83d684bc-97d1-4fe7-b8c9-69da4f07360c None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:50.495585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-83d684bc-97d1-4fe7-b8c9-69da4f07360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:50.564685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c08ec-a090-4d8f-b336-cf0cae0d771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:50.566912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c08ec-a090-4d8f-b336-cf0cae0d771c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:50.569865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c08ec-a090-4d8f-b336-cf0cae0d771c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:50.569865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c08ec-a090-4d8f-b336-cf0cae0d771c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:50.569865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c08ec-a090-4d8f-b336-cf0cae0d771c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:50.596514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c08ec-a090-4d8f-b336-cf0cae0d771c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:50.631963 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3517/7004] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:50.633368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d684bc-97d1-4fe7-b8c9-69da4f07360c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:50.654919 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3488/7005] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:50 2022] POST /identity/v3/users => generated 292 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:50.656035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c08ec-a090-4d8f-b336-cf0cae0d771c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:50.656998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d684bc-97d1-4fe7-b8c9-69da4f07360c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:50.661335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3fc14-cb5b-4759-b599-df9abc8e7f18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd662bce564894d00bb4eafd00a7a7d36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:50.661983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3fc14-cb5b-4759-b599-df9abc8e7f18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:50.662265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3fc14-cb5b-4759-b599-df9abc8e7f18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:50.662540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3fc14-cb5b-4759-b599-df9abc8e7f18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36/password` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:50.676317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c08ec-a090-4d8f-b336-cf0cae0d771c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:50.694139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6c046-bccf-4842-96a0-1aad0149a18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:50.695028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c046-bccf-4842-96a0-1aad0149a18b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:50.695487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c046-bccf-4842-96a0-1aad0149a18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:50.696988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c046-bccf-4842-96a0-1aad0149a18b admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:50.697719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6c046-bccf-4842-96a0-1aad0149a18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:50.705718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6c046-bccf-4842-96a0-1aad0149a18b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:50.747558 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3489/7006] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:50.748923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6c046-bccf-4842-96a0-1aad0149a18b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:50.755253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-09a3fc14-cb5b-4759-b599-df9abc8e7f18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:50.765184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6c046-bccf-4842-96a0-1aad0149a18b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:50.777430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8311-28fd-4cf8-aafc-07c6648b5e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:50.779873 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3518/7007] 10.222.0.23 () {60 vars in 1269 bytes} [Sun Oct 2 01:31:50 2022] POST /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36/password => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:50.780898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8311-28fd-4cf8-aafc-07c6648b5e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:50.781600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8311-28fd-4cf8-aafc-07c6648b5e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:50.782039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8311-28fd-4cf8-aafc-07c6648b5e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:50.782975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8311-28fd-4cf8-aafc-07c6648b5e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:50.784944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8311-28fd-4cf8-aafc-07c6648b5e4d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:50.804053 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3490/7008] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:50.804473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3fc14-cb5b-4759-b599-df9abc8e7f18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:50.811521 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=84,keystone:INSERT=5,keystone:DELETE=10,keystone:UPDATE=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:50.824245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3fc14-cb5b-4759-b599-df9abc8e7f18 tempest-IdentityV3UsersTest-1380619742 tempest-IdentityV3UsersTest-1380619742-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:50.834766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493862-8c74-4544-81cc-8d65f6db4478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:50.835460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493862-8c74-4544-81cc-8d65f6db4478 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:50.835742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493862-8c74-4544-81cc-8d65f6db4478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:50.836022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493862-8c74-4544-81cc-8d65f6db4478 admin admin] PATH_INFO: `/v3/projects/61231ab7c52a4c0da575ed01e16d6645/users/af07188b10554276a9a1ebbe516b51c8/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:50.868126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0493862-8c74-4544-81cc-8d65f6db4478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61231ab7c52a4c0da575ed01e16d6645, user_id=af07188b10554276a9a1ebbe516b51c8, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:50.870978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0493862-8c74-4544-81cc-8d65f6db4478 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:50.910258 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3519/7009] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:50 2022] PUT /identity/v3/projects/61231ab7c52a4c0da575ed01e16d6645/users/af07188b10554276a9a1ebbe516b51c8/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:31:50.914318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d81a-eba4-459d-99fb-16dfa1885cc2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:50.915566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d81a-eba4-459d-99fb-16dfa1885cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:50.916173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d81a-eba4-459d-99fb-16dfa1885cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:50.996938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4bc5d81a-eba4-459d-99fb-16dfa1885cc2 None None] MFA Rules not processed for user `af07188b10554276a9a1ebbe516b51c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:51.000161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4bc5d81a-eba4-459d-99fb-16dfa1885cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:51.193599 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3491/7010] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:51.211309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493862-8c74-4544-81cc-8d65f6db4478 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:51.214387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f0493862-8c74-4544-81cc-8d65f6db4478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:51.398816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493862-8c74-4544-81cc-8d65f6db4478 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:51.410227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea383024-70a1-4ef4-9adc-f3b83acb0bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:51.411003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383024-70a1-4ef4-9adc-f3b83acb0bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:51.411396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383024-70a1-4ef4-9adc-f3b83acb0bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:51.411736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383024-70a1-4ef4-9adc-f3b83acb0bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:51.432046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea383024-70a1-4ef4-9adc-f3b83acb0bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:51.433721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea383024-70a1-4ef4-9adc-f3b83acb0bc0 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:51.467350 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3520/7011] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:51.784489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787a4c5-f4c6-4dd4-a9cd-d4891f786d12 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:51.785026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787a4c5-f4c6-4dd4-a9cd-d4891f786d12 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:51.785409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787a4c5-f4c6-4dd4-a9cd-d4891f786d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:51.838415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3787a4c5-f4c6-4dd4-a9cd-d4891f786d12 None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:51.842867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3787a4c5-f4c6-4dd4-a9cd-d4891f786d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:51.859059 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3492/7012] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:51 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 02 01:31:52.865315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e7121-105a-46f2-833e-cda9e97e5f3f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:52.866965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e7121-105a-46f2-833e-cda9e97e5f3f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:52.867799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e7121-105a-46f2-833e-cda9e97e5f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:52.914482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-410e7121-105a-46f2-833e-cda9e97e5f3f None None] MFA Rules not processed for user `d662bce564894d00bb4eafd00a7a7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:52.918208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-410e7121-105a-46f2-833e-cda9e97e5f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:53.028164 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3521/7013] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:53.033304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787a4c5-f4c6-4dd4-a9cd-d4891f786d12 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:53.034844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3787a4c5-f4c6-4dd4-a9cd-d4891f786d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:53.079068 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:53.132688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787a4c5-f4c6-4dd4-a9cd-d4891f786d12 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:53.139046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:53.139996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:53.140816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:53.141516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] PATH_INFO: `/v3/users/d662bce564894d00bb4eafd00a7a7d36` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:53.142951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d662bce564894d00bb4eafd00a7a7d36)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:53.145326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:53.244720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:53.263462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:53.266788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:53.281756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:53.308783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd662bce564894d00bb4eafd00a7a7d36'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:53.339944 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3493/7014] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:31:53 2022] DELETE /identity/v3/users/d662bce564894d00bb4eafd00a7a7d36 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:53.342730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef7b60-d7f7-49ea-b272-0916c3679520 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:53.344670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef7b60-d7f7-49ea-b272-0916c3679520 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:53.345186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef7b60-d7f7-49ea-b272-0916c3679520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:53.372083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-71ef7b60-d7f7-49ea-b272-0916c3679520 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:53.375006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-71ef7b60-d7f7-49ea-b272-0916c3679520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:53.577329 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3522/7015] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:53.602118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:53.615503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:53.799647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b72825-a3f8-48c9-940f-3121d059ba9f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:53.823082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155c68a-8d29-44ff-8a32-1df2b8ef942f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:53.827676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c68a-8d29-44ff-8a32-1df2b8ef942f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:53.827786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c68a-8d29-44ff-8a32-1df2b8ef942f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:53.828168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c68a-8d29-44ff-8a32-1df2b8ef942f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:53.846833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155c68a-8d29-44ff-8a32-1df2b8ef942f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:53.850752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155c68a-8d29-44ff-8a32-1df2b8ef942f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:53.877922 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3494/7016] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:54.363150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4bafc-c322-458f-8934-f28cd2935f5c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:54.363614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4bafc-c322-458f-8934-f28cd2935f5c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:54.363737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4bafc-c322-458f-8934-f28cd2935f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:54.411731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d5b4bafc-c322-458f-8934-f28cd2935f5c None None] MFA Rules not processed for user `116490a90023449a83265db52a0debb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:54.412946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d5b4bafc-c322-458f-8934-f28cd2935f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:54.476175 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:54.559761 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3523/7017] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:54.738287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155c68a-8d29-44ff-8a32-1df2b8ef942f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:54.739927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5155c68a-8d29-44ff-8a32-1df2b8ef942f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:54.785177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155c68a-8d29-44ff-8a32-1df2b8ef942f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:54.797699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:54.798932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:54.800583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:54.802891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] PATH_INFO: `/v3/projects/c34a3f03dd9444dfa7f7d81e1fef091d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:54.805180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34a3f03dd9444dfa7f7d81e1fef091d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:54.810946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:54.925365 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:54.936184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'request_id': 'req-83c2f65f-6c68-4f66-b9e1-65912f30471b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:54.943441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'request_id': 'req-83c2f65f-6c68-4f66-b9e1-65912f30471b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:54.963605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34a3f03dd9444dfa7f7d81e1fef091d', 'request_id': 'req-83c2f65f-6c68-4f66-b9e1-65912f30471b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:55.006504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] The token cache is being invalidate because project c34a3f03dd9444dfa7f7d81e1fef091d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:31:55.006842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:55.012527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83c2f65f-6c68-4f66-b9e1-65912f30471b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:31:55.018387 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3495/7018] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:31:54 2022] DELETE /identity/v3/projects/c34a3f03dd9444dfa7f7d81e1fef091d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:55.025144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c21e3e-a56f-4233-875e-e5054467a087 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:55.026199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c21e3e-a56f-4233-875e-e5054467a087 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:55.026592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c21e3e-a56f-4233-875e-e5054467a087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:55.096644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c8c21e3e-a56f-4233-875e-e5054467a087 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:55.099442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c8c21e3e-a56f-4233-875e-e5054467a087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:55.369935 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3524/7019] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:55.377874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26fbe5-7a37-4eee-94cc-21037e1f7649 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:55.378630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26fbe5-7a37-4eee-94cc-21037e1f7649 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:55.378630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26fbe5-7a37-4eee-94cc-21037e1f7649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:55.439482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bc26fbe5-7a37-4eee-94cc-21037e1f7649 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:55.440232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bc26fbe5-7a37-4eee-94cc-21037e1f7649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:55.484445 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3496/7020] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:55.488748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c21e3e-a56f-4233-875e-e5054467a087 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:55.507138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c21e3e-a56f-4233-875e-e5054467a087 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:55.520505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342106bf-de65-4ac1-8635-9a9e724384a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:55.523348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342106bf-de65-4ac1-8635-9a9e724384a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:55.529027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342106bf-de65-4ac1-8635-9a9e724384a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:55.529626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342106bf-de65-4ac1-8635-9a9e724384a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:55.530779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342106bf-de65-4ac1-8635-9a9e724384a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:31:55.531366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342106bf-de65-4ac1-8635-9a9e724384a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:55.533661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342106bf-de65-4ac1-8635-9a9e724384a7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:55.587454 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3525/7021] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:31:55.591914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26fbe5-7a37-4eee-94cc-21037e1f7649 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:55.605457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26fbe5-7a37-4eee-94cc-21037e1f7649 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:55.633160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a768973-3919-453f-9a33-2686e03c7c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:55.634459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a768973-3919-453f-9a33-2686e03c7c34 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:55.634766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a768973-3919-453f-9a33-2686e03c7c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:55.635042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a768973-3919-453f-9a33-2686e03c7c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:55.635706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a768973-3919-453f-9a33-2686e03c7c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:55.637633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a768973-3919-453f-9a33-2686e03c7c34 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:55.773704 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3497/7022] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:55 2022] POST /identity/v3/projects => generated 397 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:31:55.775654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342106bf-de65-4ac1-8635-9a9e724384a7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:55.793993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342106bf-de65-4ac1-8635-9a9e724384a7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:55.984116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befd2cd-4a33-4bb4-ad73-445d622c66d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:55.986016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd2cd-4a33-4bb4-ad73-445d622c66d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:55.986683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd2cd-4a33-4bb4-ad73-445d622c66d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:55.988835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd2cd-4a33-4bb4-ad73-445d622c66d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:55.989644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befd2cd-4a33-4bb4-ad73-445d622c66d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:56.004583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befd2cd-4a33-4bb4-ad73-445d622c66d0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:56.096337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a768973-3919-453f-9a33-2686e03c7c34 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:56.097246 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3526/7023] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:55 2022] POST /identity/v3/users => generated 305 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:56.113873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a768973-3919-453f-9a33-2686e03c7c34 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:56.130528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889079-126f-4276-83ca-962319d973aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:56.131219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889079-126f-4276-83ca-962319d973aa admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:56.131568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889079-126f-4276-83ca-962319d973aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:56.131851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889079-126f-4276-83ca-962319d973aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:56.132564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c889079-126f-4276-83ca-962319d973aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:56.137003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c889079-126f-4276-83ca-962319d973aa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:56.161442 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3498/7024] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:56.166007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befd2cd-4a33-4bb4-ad73-445d622c66d0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:56.184702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befd2cd-4a33-4bb4-ad73-445d622c66d0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:56.198245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78f4c1-2d75-4efe-840b-40c3e50c9c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:56.200591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78f4c1-2d75-4efe-840b-40c3e50c9c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:56.200809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78f4c1-2d75-4efe-840b-40c3e50c9c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:56.201091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78f4c1-2d75-4efe-840b-40c3e50c9c14 admin admin] PATH_INFO: `/v3/projects/4e94a46a263b455db0cf94dfb3ca8055/users/770ef92bfd2f4e2195c49996b496cb86/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:56.264773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78f4c1-2d75-4efe-840b-40c3e50c9c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e94a46a263b455db0cf94dfb3ca8055, user_id=770ef92bfd2f4e2195c49996b496cb86, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:56.269766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78f4c1-2d75-4efe-840b-40c3e50c9c14 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:56.324879 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3527/7025] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:56 2022] PUT /identity/v3/projects/4e94a46a263b455db0cf94dfb3ca8055/users/770ef92bfd2f4e2195c49996b496cb86/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:56.325285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889079-126f-4276-83ca-962319d973aa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:56.340291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889079-126f-4276-83ca-962319d973aa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:56.472379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36b4d8-a672-412e-994a-489fb9b5a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:56.473332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36b4d8-a672-412e-994a-489fb9b5a935 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:56.473774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36b4d8-a672-412e-994a-489fb9b5a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:56.474221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36b4d8-a672-412e-994a-489fb9b5a935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:56.475066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36b4d8-a672-412e-994a-489fb9b5a935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:56.476873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36b4d8-a672-412e-994a-489fb9b5a935 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:56.511130 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3499/7026] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:56.515640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78f4c1-2d75-4efe-840b-40c3e50c9c14 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:56.548325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78f4c1-2d75-4efe-840b-40c3e50c9c14 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:56.559844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e569b6-9279-4942-9f09-afbd0b653192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:56.563029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e569b6-9279-4942-9f09-afbd0b653192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:56.564762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e569b6-9279-4942-9f09-afbd0b653192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:56.565046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e569b6-9279-4942-9f09-afbd0b653192 admin admin] PATH_INFO: `/v3/projects/4e94a46a263b455db0cf94dfb3ca8055/users/770ef92bfd2f4e2195c49996b496cb86/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:56.568544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e569b6-9279-4942-9f09-afbd0b653192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e94a46a263b455db0cf94dfb3ca8055, user_id=770ef92bfd2f4e2195c49996b496cb86, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:56.577533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e569b6-9279-4942-9f09-afbd0b653192 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:56.619767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3528/7027] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:56 2022] PUT /identity/v3/projects/4e94a46a263b455db0cf94dfb3ca8055/users/770ef92bfd2f4e2195c49996b496cb86/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:56.620608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2e99-264d-4b32-a28c-d1809559a2cd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:56.620906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2e99-264d-4b32-a28c-d1809559a2cd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:56.621187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2e99-264d-4b32-a28c-d1809559a2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:56.706177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ee8d2e99-264d-4b32-a28c-d1809559a2cd None None] MFA Rules not processed for user `770ef92bfd2f4e2195c49996b496cb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:56.707504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee8d2e99-264d-4b32-a28c-d1809559a2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:56.823499 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3500/7028] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:31:56.827680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e569b6-9279-4942-9f09-afbd0b653192 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:56.847475 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:56.922201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e569b6-9279-4942-9f09-afbd0b653192 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:56.951441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2ba6-13a1-4e62-9ce7-e64c18012cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:56.952126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2ba6-13a1-4e62-9ce7-e64c18012cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:56.952411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2ba6-13a1-4e62-9ce7-e64c18012cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:56.952740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2ba6-13a1-4e62-9ce7-e64c18012cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:56.956874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd2ba6-13a1-4e62-9ce7-e64c18012cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:56.966176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd2ba6-13a1-4e62-9ce7-e64c18012cb8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:57.122054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d2e99-264d-4b32-a28c-d1809559a2cd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:57.124804 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3529/7029] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:31:56 2022] POST /identity/v3/projects => generated 395 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:57.154191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d2e99-264d-4b32-a28c-d1809559a2cd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:57.234240 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:57.453575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bcbca-7c0b-4bbf-bdf9-648751f0740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:57.454238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bcbca-7c0b-4bbf-bdf9-648751f0740b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:57.455309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bcbca-7c0b-4bbf-bdf9-648751f0740b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:57.455747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bcbca-7c0b-4bbf-bdf9-648751f0740b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:57.456539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bcbca-7c0b-4bbf-bdf9-648751f0740b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:57.459672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bcbca-7c0b-4bbf-bdf9-648751f0740b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:57.532123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2ba6-13a1-4e62-9ce7-e64c18012cb8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:57.536096 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3501/7030] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:31:57 2022] POST /identity/v3/users => generated 298 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:31:57.548940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2ba6-13a1-4e62-9ce7-e64c18012cb8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:57.575658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54e4ee-3f00-4b21-8927-d3d4c0f267ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:57.580170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54e4ee-3f00-4b21-8927-d3d4c0f267ec admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:57.580461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54e4ee-3f00-4b21-8927-d3d4c0f267ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:57.580742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54e4ee-3f00-4b21-8927-d3d4c0f267ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:57.581427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54e4ee-3f00-4b21-8927-d3d4c0f267ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:57.586662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54e4ee-3f00-4b21-8927-d3d4c0f267ec admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:57.601622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bcbca-7c0b-4bbf-bdf9-648751f0740b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:57.604948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-985bcbca-7c0b-4bbf-bdf9-648751f0740b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:57.637889 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3530/7031] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:57.644543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54e4ee-3f00-4b21-8927-d3d4c0f267ec admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:57.666953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54e4ee-3f00-4b21-8927-d3d4c0f267ec admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:57.690152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe11bc7-c8f7-41c7-af55-adc37385f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:57.690896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11bc7-c8f7-41c7-af55-adc37385f0cb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:57.691175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11bc7-c8f7-41c7-af55-adc37385f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:57.691460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11bc7-c8f7-41c7-af55-adc37385f0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:57.692093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe11bc7-c8f7-41c7-af55-adc37385f0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:57.703095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe11bc7-c8f7-41c7-af55-adc37385f0cb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:57.753049 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3531/7032] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:31:57.754278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe11bc7-c8f7-41c7-af55-adc37385f0cb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:57.834862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe11bc7-c8f7-41c7-af55-adc37385f0cb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:57.862583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c2a5a-b131-4a1a-ac4f-c2cee3e5924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:57.865124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c2a5a-b131-4a1a-ac4f-c2cee3e5924c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:57.865583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c2a5a-b131-4a1a-ac4f-c2cee3e5924c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:57.866030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c2a5a-b131-4a1a-ac4f-c2cee3e5924c admin admin] PATH_INFO: `/v3/projects/15c7b6ef2c984c45ae687a99e5b670c0/users/4a05254a087f4a1dad356862680cd650/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:57.878260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bcbca-7c0b-4bbf-bdf9-648751f0740b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:57.887674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b0f45-3cfd-47a5-819c-3289e02b2c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:57.888321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0f45-3cfd-47a5-819c-3289e02b2c64 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:57.889882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0f45-3cfd-47a5-819c-3289e02b2c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:57.890166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b0f45-3cfd-47a5-819c-3289e02b2c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:57.896673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c61b0f45-3cfd-47a5-819c-3289e02b2c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:57.938028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b0f45-3cfd-47a5-819c-3289e02b2c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:57.938828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c2a5a-b131-4a1a-ac4f-c2cee3e5924c admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c7b6ef2c984c45ae687a99e5b670c0, user_id=4a05254a087f4a1dad356862680cd650, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:57.941441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b0f45-3cfd-47a5-819c-3289e02b2c64 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:57.942578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c2a5a-b131-4a1a-ac4f-c2cee3e5924c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:57.967520 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3502/7033] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:31:57.970076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b0f45-3cfd-47a5-819c-3289e02b2c64 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:57.989602 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3532/7034] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:31:57 2022] PUT /identity/v3/projects/15c7b6ef2c984c45ae687a99e5b670c0/users/4a05254a087f4a1dad356862680cd650/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:31:58.001502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f736f0f-4173-4f63-a272-8f8a2559a3d9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:58.002463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f736f0f-4173-4f63-a272-8f8a2559a3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:58.002923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f736f0f-4173-4f63-a272-8f8a2559a3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:58.026279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b0f45-3cfd-47a5-819c-3289e02b2c64 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:58.070548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5f736f0f-4173-4f63-a272-8f8a2559a3d9 None None] MFA Rules not processed for user `4a05254a087f4a1dad356862680cd650`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:31:58.072337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5f736f0f-4173-4f63-a272-8f8a2559a3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:58.164395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5e96c-1a3f-41b1-a9ed-5b328fe11347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:58.165629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5e96c-1a3f-41b1-a9ed-5b328fe11347 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:58.165914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5e96c-1a3f-41b1-a9ed-5b328fe11347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:58.166185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5e96c-1a3f-41b1-a9ed-5b328fe11347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:58.179651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-36c5e96c-1a3f-41b1-a9ed-5b328fe11347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:58.253851 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3533/7035] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:31:58.266214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f736f0f-4173-4f63-a272-8f8a2559a3d9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:31:58.267931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5f736f0f-4173-4f63-a272-8f8a2559a3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:31:58.385126 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:58.436478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f736f0f-4173-4f63-a272-8f8a2559a3d9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:31:58.450752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c1b3-ddd8-4765-b970-036f163edccf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:31:58.451477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c1b3-ddd8-4765-b970-036f163edccf service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:31:58.460431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c1b3-ddd8-4765-b970-036f163edccf service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:31:58.460431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c1b3-ddd8-4765-b970-036f163edccf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:31:58.461186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5e96c-1a3f-41b1-a9ed-5b328fe11347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:58.461186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5e96c-1a3f-41b1-a9ed-5b328fe11347 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:58.490270 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3503/7036] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:31:58.605799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969c1b3-ddd8-4765-b970-036f163edccf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:31:58.607454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969c1b3-ddd8-4765-b970-036f163edccf service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:31:58.641191 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3534/7037] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:32:00.012890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5e96c-1a3f-41b1-a9ed-5b328fe11347 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:00.019392 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:00.365179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5e96c-1a3f-41b1-a9ed-5b328fe11347 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:00.387658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c1b3-ddd8-4765-b970-036f163edccf service glance] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:00.389734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1969c1b3-ddd8-4765-b970-036f163edccf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:00.391419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4687e-2ba2-40c8-b172-dbf8f8aee2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:00.396165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4687e-2ba2-40c8-b172-dbf8f8aee2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:00.396457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4687e-2ba2-40c8-b172-dbf8f8aee2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:00.396803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4687e-2ba2-40c8-b172-dbf8f8aee2bc admin admin] PATH_INFO: `/v3/users/770ef92bfd2f4e2195c49996b496cb86` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:00.399030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4687e-2ba2-40c8-b172-dbf8f8aee2bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=770ef92bfd2f4e2195c49996b496cb86)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:00.410136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4687e-2ba2-40c8-b172-dbf8f8aee2bc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:00.652950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bac4687e-2ba2-40c8-b172-dbf8f8aee2bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '770ef92bfd2f4e2195c49996b496cb86'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:00.742302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bac4687e-2ba2-40c8-b172-dbf8f8aee2bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '770ef92bfd2f4e2195c49996b496cb86'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:00.745179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bac4687e-2ba2-40c8-b172-dbf8f8aee2bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '770ef92bfd2f4e2195c49996b496cb86'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:00.770426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bac4687e-2ba2-40c8-b172-dbf8f8aee2bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '770ef92bfd2f4e2195c49996b496cb86'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:00.796453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bac4687e-2ba2-40c8-b172-dbf8f8aee2bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '770ef92bfd2f4e2195c49996b496cb86'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:00.807566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c1b3-ddd8-4765-b970-036f163edccf service glance] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:00.828834 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3504/7038] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:00 2022] DELETE /identity/v3/users/770ef92bfd2f4e2195c49996b496cb86 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:00.833682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357a70-57f2-457c-9c06-0791cf06a8b2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:00.833972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357a70-57f2-457c-9c06-0791cf06a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:00.834250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357a70-57f2-457c-9c06-0791cf06a8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:00.840684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11de94-45ea-4245-9c99-1881c67168b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:00.841320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11de94-45ea-4245-9c99-1881c67168b6 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:00.841599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11de94-45ea-4245-9c99-1881c67168b6 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:00.841872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11de94-45ea-4245-9c99-1881c67168b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:00.848197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4f11de94-45ea-4245-9c99-1881c67168b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:00.893332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11de94-45ea-4245-9c99-1881c67168b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:00.895018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11de94-45ea-4245-9c99-1881c67168b6 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:00.899867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a2357a70-57f2-457c-9c06-0791cf06a8b2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:00.901095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a2357a70-57f2-457c-9c06-0791cf06a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:00.935509 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3535/7039] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:01.141763 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3505/7040] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:32:01.213112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11de94-45ea-4245-9c99-1881c67168b6 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:01.215240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4f11de94-45ea-4245-9c99-1881c67168b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:01.256079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11de94-45ea-4245-9c99-1881c67168b6 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:01.489951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bb5f9-f115-4b35-9740-825f44ff55c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:01.491822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb5f9-f115-4b35-9740-825f44ff55c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:01.492329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb5f9-f115-4b35-9740-825f44ff55c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:01.492812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb5f9-f115-4b35-9740-825f44ff55c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:01.508345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bb5f9-f115-4b35-9740-825f44ff55c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:01.511131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bb5f9-f115-4b35-9740-825f44ff55c3 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:01.526577 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3536/7041] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:05.250907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2357a70-57f2-457c-9c06-0791cf06a8b2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:05.253014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a2357a70-57f2-457c-9c06-0791cf06a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:05.276438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2357a70-57f2-457c-9c06-0791cf06a8b2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:05.281665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:05.282644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:05.283121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:05.283589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] PATH_INFO: `/v3/projects/4e94a46a263b455db0cf94dfb3ca8055` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:05.284967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e94a46a263b455db0cf94dfb3ca8055)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:05.287240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:05.313894 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:05.352252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e94a46a263b455db0cf94dfb3ca8055', 'request_id': 'req-400eb998-4645-4644-acb3-d1a3af4bc375'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:05.359723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e94a46a263b455db0cf94dfb3ca8055', 'request_id': 'req-400eb998-4645-4644-acb3-d1a3af4bc375'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:05.369349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e94a46a263b455db0cf94dfb3ca8055', 'request_id': 'req-400eb998-4645-4644-acb3-d1a3af4bc375'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:05.402780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] The token cache is being invalidate because project 4e94a46a263b455db0cf94dfb3ca8055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:05.403430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:05.405673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:05.411488 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3506/7042] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:05 2022] DELETE /identity/v3/projects/4e94a46a263b455db0cf94dfb3ca8055 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:05.412585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bb5f9-f115-4b35-9740-825f44ff55c3 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:05.431727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bb5f9-f115-4b35-9740-825f44ff55c3 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:05.455400 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:05.569547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa87d9d-1f2a-4a7f-8ef1-ef8c2f58e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:05.570618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa87d9d-1f2a-4a7f-8ef1-ef8c2f58e5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:05.571154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa87d9d-1f2a-4a7f-8ef1-ef8c2f58e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:05.571635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa87d9d-1f2a-4a7f-8ef1-ef8c2f58e5c4 admin admin] PATH_INFO: `/v3/users/4a05254a087f4a1dad356862680cd650` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:05.573180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa87d9d-1f2a-4a7f-8ef1-ef8c2f58e5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a05254a087f4a1dad356862680cd650)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:05.575431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa87d9d-1f2a-4a7f-8ef1-ef8c2f58e5c4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:05.648722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3fa87d9d-1f2a-4a7f-8ef1-ef8c2f58e5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a05254a087f4a1dad356862680cd650'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:05.662912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3fa87d9d-1f2a-4a7f-8ef1-ef8c2f58e5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a05254a087f4a1dad356862680cd650'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:05.663886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3fa87d9d-1f2a-4a7f-8ef1-ef8c2f58e5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a05254a087f4a1dad356862680cd650'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:05.673172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3fa87d9d-1f2a-4a7f-8ef1-ef8c2f58e5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a05254a087f4a1dad356862680cd650'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:05.674071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3fa87d9d-1f2a-4a7f-8ef1-ef8c2f58e5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a05254a087f4a1dad356862680cd650'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:05.694838 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3537/7043] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:05 2022] DELETE /identity/v3/users/4a05254a087f4a1dad356862680cd650 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:06.654224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:06.655946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:06.677944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eb998-4645-4644-acb3-d1a3af4bc375 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:06.896898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:06.897567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:06.897850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:06.898130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] PATH_INFO: `/v3/projects/15c7b6ef2c984c45ae687a99e5b670c0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:06.901836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c7b6ef2c984c45ae687a99e5b670c0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:06.903825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:07.123887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c7b6ef2c984c45ae687a99e5b670c0', 'request_id': 'req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:07.153829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c7b6ef2c984c45ae687a99e5b670c0', 'request_id': 'req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:07.186289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c7b6ef2c984c45ae687a99e5b670c0', 'request_id': 'req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:07.229830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] The token cache is being invalidate because project 15c7b6ef2c984c45ae687a99e5b670c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:07.230205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:07.230979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:07.238215 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3507/7044] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:06 2022] DELETE /identity/v3/projects/15c7b6ef2c984c45ae687a99e5b670c0 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:07.243756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b8318-3ec7-4c54-ad03-a9158394ef57 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:07.243756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b8318-3ec7-4c54-ad03-a9158394ef57 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:07.244472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b8318-3ec7-4c54-ad03-a9158394ef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:07.300224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f68b8318-3ec7-4c54-ad03-a9158394ef57 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:07.301478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f68b8318-3ec7-4c54-ad03-a9158394ef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:07.422381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:07.424246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:07.497302 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3538/7045] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:07.509235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c45fb-5bd0-46c3-a045-9322cc358a40 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:07.510251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c45fb-5bd0-46c3-a045-9322cc358a40 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:07.510786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c45fb-5bd0-46c3-a045-9322cc358a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:07.567170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d57c45fb-5bd0-46c3-a045-9322cc358a40 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:07.568794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d57c45fb-5bd0-46c3-a045-9322cc358a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:07.584740 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3539/7046] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:32:07.585970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c45fb-5bd0-46c3-a045-9322cc358a40 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:07.617090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c45fb-5bd0-46c3-a045-9322cc358a40 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:07.625058 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:07.627510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b3647-4b2a-4fcf-a9d2-12a7ecbf6668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:07.630336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b3647-4b2a-4fcf-a9d2-12a7ecbf6668 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:07.633185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b3647-4b2a-4fcf-a9d2-12a7ecbf6668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:07.634160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b3647-4b2a-4fcf-a9d2-12a7ecbf6668 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:07.638875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b3647-4b2a-4fcf-a9d2-12a7ecbf6668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:07.639352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b3647-4b2a-4fcf-a9d2-12a7ecbf6668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:07.641945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b3647-4b2a-4fcf-a9d2-12a7ecbf6668 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:07.669415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccccc90-dde9-417e-8fa0-3eab63f4bd2a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:07.677816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06e8ee-3e8f-45aa-8f9d-f79fa2690114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:07.679387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e8ee-3e8f-45aa-8f9d-f79fa2690114 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:07.679730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e8ee-3e8f-45aa-8f9d-f79fa2690114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:07.680011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e8ee-3e8f-45aa-8f9d-f79fa2690114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:07.698366 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3540/7047] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:07.700045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b3647-4b2a-4fcf-a9d2-12a7ecbf6668 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:07.705359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf06e8ee-3e8f-45aa-8f9d-f79fa2690114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:07.717532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b3647-4b2a-4fcf-a9d2-12a7ecbf6668 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:07.749725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dbf4f-b061-4a9a-901a-0973d73dfb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:07.752220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dbf4f-b061-4a9a-901a-0973d73dfb45 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:07.752897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dbf4f-b061-4a9a-901a-0973d73dfb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:07.753363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dbf4f-b061-4a9a-901a-0973d73dfb45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:07.753519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06e8ee-3e8f-45aa-8f9d-f79fa2690114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:07.755855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dbf4f-b061-4a9a-901a-0973d73dfb45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:07.760592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dbf4f-b061-4a9a-901a-0973d73dfb45 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:07.767172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06e8ee-3e8f-45aa-8f9d-f79fa2690114 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:07.808035 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3508/7048] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:32:07.808461 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:07.873071 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3541/7049] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:07 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:07.879490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06e8ee-3e8f-45aa-8f9d-f79fa2690114 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:07.896616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06e8ee-3e8f-45aa-8f9d-f79fa2690114 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:07.984414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c630a8-2175-4acf-86e0-d91b82ed352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:07.985038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c630a8-2175-4acf-86e0-d91b82ed352e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:07.985342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c630a8-2175-4acf-86e0-d91b82ed352e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:07.985612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c630a8-2175-4acf-86e0-d91b82ed352e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:07.986344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c630a8-2175-4acf-86e0-d91b82ed352e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:07.988307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c630a8-2175-4acf-86e0-d91b82ed352e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:08.052257 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3509/7050] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:07 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:32:08.055604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dbf4f-b061-4a9a-901a-0973d73dfb45 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:08.077286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dbf4f-b061-4a9a-901a-0973d73dfb45 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:08.091471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d7bc8-932c-4a8e-a03f-e9d04491b048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:08.097972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d7bc8-932c-4a8e-a03f-e9d04491b048 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:08.097972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d7bc8-932c-4a8e-a03f-e9d04491b048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:08.097972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d7bc8-932c-4a8e-a03f-e9d04491b048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:08.097972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d7bc8-932c-4a8e-a03f-e9d04491b048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:08.097972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d7bc8-932c-4a8e-a03f-e9d04491b048 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:08.128004 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3542/7051] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:08.131987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c630a8-2175-4acf-86e0-d91b82ed352e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:08.176537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c630a8-2175-4acf-86e0-d91b82ed352e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:08.188758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96356a6-15bf-4e39-a6e1-5cd0b3a65457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:08.189449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96356a6-15bf-4e39-a6e1-5cd0b3a65457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:08.191196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96356a6-15bf-4e39-a6e1-5cd0b3a65457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:08.191477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96356a6-15bf-4e39-a6e1-5cd0b3a65457 admin admin] PATH_INFO: `/v3/projects/15c9c09d348143ce915d7dbfaf7f1d7e/users/979349268c2346bd842f028df2ec9842/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:08.272165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96356a6-15bf-4e39-a6e1-5cd0b3a65457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c9c09d348143ce915d7dbfaf7f1d7e, user_id=979349268c2346bd842f028df2ec9842, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:08.282378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96356a6-15bf-4e39-a6e1-5cd0b3a65457 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:08.347361 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3510/7052] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:08 2022] PUT /identity/v3/projects/15c9c09d348143ce915d7dbfaf7f1d7e/users/979349268c2346bd842f028df2ec9842/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:08.351083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d7bc8-932c-4a8e-a03f-e9d04491b048 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:08.366248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d7bc8-932c-4a8e-a03f-e9d04491b048 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:08.510782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a66e83-1bdd-401e-8372-13764a05883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:08.511411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a66e83-1bdd-401e-8372-13764a05883f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:08.511696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a66e83-1bdd-401e-8372-13764a05883f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:08.511974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a66e83-1bdd-401e-8372-13764a05883f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:08.512620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a66e83-1bdd-401e-8372-13764a05883f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:08.514228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a66e83-1bdd-401e-8372-13764a05883f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:08.557510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96356a6-15bf-4e39-a6e1-5cd0b3a65457 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:08.567864 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3543/7053] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:08.581607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96356a6-15bf-4e39-a6e1-5cd0b3a65457 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:08.588149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934484f-eaa6-4a0a-84ab-fc98fd406021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:08.590579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934484f-eaa6-4a0a-84ab-fc98fd406021 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:08.590579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934484f-eaa6-4a0a-84ab-fc98fd406021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:08.590827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934484f-eaa6-4a0a-84ab-fc98fd406021 admin admin] PATH_INFO: `/v3/projects/15c9c09d348143ce915d7dbfaf7f1d7e/users/979349268c2346bd842f028df2ec9842/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:08.597792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934484f-eaa6-4a0a-84ab-fc98fd406021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c9c09d348143ce915d7dbfaf7f1d7e, user_id=979349268c2346bd842f028df2ec9842, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:08.606876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934484f-eaa6-4a0a-84ab-fc98fd406021 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:08.628593 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3511/7054] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:08 2022] PUT /identity/v3/projects/15c9c09d348143ce915d7dbfaf7f1d7e/users/979349268c2346bd842f028df2ec9842/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:08.639708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c10aa-e9de-4c22-9695-012b402d48f4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:08.640346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c10aa-e9de-4c22-9695-012b402d48f4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:08.640829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c10aa-e9de-4c22-9695-012b402d48f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:08.683251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-681c10aa-e9de-4c22-9695-012b402d48f4 None None] MFA Rules not processed for user `979349268c2346bd842f028df2ec9842`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:08.684842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-681c10aa-e9de-4c22-9695-012b402d48f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:08.942231 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3544/7055] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:08.947497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934484f-eaa6-4a0a-84ab-fc98fd406021 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:09.082503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934484f-eaa6-4a0a-84ab-fc98fd406021 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:09.090309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8682d-c034-4df6-9f84-af3f175416d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:09.091381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8682d-c034-4df6-9f84-af3f175416d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:09.091725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8682d-c034-4df6-9f84-af3f175416d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:09.091984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8682d-c034-4df6-9f84-af3f175416d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:09.092695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8682d-c034-4df6-9f84-af3f175416d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:09.095720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8682d-c034-4df6-9f84-af3f175416d5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:09.218432 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3512/7056] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:08 2022] POST /identity/v3/projects => generated 381 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:09.222225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c10aa-e9de-4c22-9695-012b402d48f4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:09.238984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c10aa-e9de-4c22-9695-012b402d48f4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:09.391761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7c50-0019-4c89-a4d1-6a370222ed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:09.394960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7c50-0019-4c89-a4d1-6a370222ed0f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:09.396443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7c50-0019-4c89-a4d1-6a370222ed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:09.396925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7c50-0019-4c89-a4d1-6a370222ed0f admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:09.397802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7c50-0019-4c89-a4d1-6a370222ed0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:09.401266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7c50-0019-4c89-a4d1-6a370222ed0f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:09.419651 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:09.440401 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3545/7057] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:09 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:32:09.444658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8682d-c034-4df6-9f84-af3f175416d5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:09.459121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8682d-c034-4df6-9f84-af3f175416d5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:09.466551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ec639-d014-4b05-9ae3-1b7c6ab592bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:09.468407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ec639-d014-4b05-9ae3-1b7c6ab592bd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:09.468711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ec639-d014-4b05-9ae3-1b7c6ab592bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:09.469043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ec639-d014-4b05-9ae3-1b7c6ab592bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:09.470292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ec639-d014-4b05-9ae3-1b7c6ab592bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:09.472180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ec639-d014-4b05-9ae3-1b7c6ab592bd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:09.489746 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3513/7058] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:09.492367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7c50-0019-4c89-a4d1-6a370222ed0f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:09.521113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7c50-0019-4c89-a4d1-6a370222ed0f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:09.532599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4486e-7a66-4c01-a9d4-bd9d7ac40909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:09.533224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4486e-7a66-4c01-a9d4-bd9d7ac40909 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:09.533521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4486e-7a66-4c01-a9d4-bd9d7ac40909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:09.533861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4486e-7a66-4c01-a9d4-bd9d7ac40909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:09.535965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4486e-7a66-4c01-a9d4-bd9d7ac40909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:09.537571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4486e-7a66-4c01-a9d4-bd9d7ac40909 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:09.554479 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3546/7059] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:09.558772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ec639-d014-4b05-9ae3-1b7c6ab592bd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:09.574975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ec639-d014-4b05-9ae3-1b7c6ab592bd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:09.589788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286e354-30b6-438e-8206-6f995922c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:09.590476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286e354-30b6-438e-8206-6f995922c1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:09.590780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286e354-30b6-438e-8206-6f995922c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:09.591057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286e354-30b6-438e-8206-6f995922c1eb admin admin] PATH_INFO: `/v3/projects/1f08d901454847789d7a3fd2db9c197d/users/3644e00e94a74641a7e658b7ff411e40/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:09.594270 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:09.625980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286e354-30b6-438e-8206-6f995922c1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f08d901454847789d7a3fd2db9c197d, user_id=3644e00e94a74641a7e658b7ff411e40, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:09.629172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286e354-30b6-438e-8206-6f995922c1eb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:09.652695 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3514/7060] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:09 2022] PUT /identity/v3/projects/1f08d901454847789d7a3fd2db9c197d/users/3644e00e94a74641a7e658b7ff411e40/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:09.664130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f71383-5431-455c-8dc3-03784ebf9ddd None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:09.666049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f71383-5431-455c-8dc3-03784ebf9ddd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:09.666803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f71383-5431-455c-8dc3-03784ebf9ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:09.745219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-80f71383-5431-455c-8dc3-03784ebf9ddd None None] MFA Rules not processed for user `3644e00e94a74641a7e658b7ff411e40`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:09.750320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-80f71383-5431-455c-8dc3-03784ebf9ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:09.943718 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3547/7061] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:09.957078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286e354-30b6-438e-8206-6f995922c1eb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:09.959978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e286e354-30b6-438e-8206-6f995922c1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:10.212878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286e354-30b6-438e-8206-6f995922c1eb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:10.226479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bf7f6-eb25-466c-8493-d6f2625e8306 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:10.226479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bf7f6-eb25-466c-8493-d6f2625e8306 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:10.226479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bf7f6-eb25-466c-8493-d6f2625e8306 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:10.226479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bf7f6-eb25-466c-8493-d6f2625e8306 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:10.431993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bf7f6-eb25-466c-8493-d6f2625e8306 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:10.433231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bf7f6-eb25-466c-8493-d6f2625e8306 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:10.456685 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3515/7062] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:32:11.936534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f71383-5431-455c-8dc3-03784ebf9ddd None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:12.070505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f71383-5431-455c-8dc3-03784ebf9ddd None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:12.089554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:12.091067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:12.091514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:12.091951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] PATH_INFO: `/v3/users/979349268c2346bd842f028df2ec9842` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:12.093442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=979349268c2346bd842f028df2ec9842)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:12.095679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:12.223690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979349268c2346bd842f028df2ec9842'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:12.249554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979349268c2346bd842f028df2ec9842'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:12.251045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979349268c2346bd842f028df2ec9842'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:12.272502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979349268c2346bd842f028df2ec9842'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:12.273308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979349268c2346bd842f028df2ec9842'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:12.275727 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:12.304623 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3548/7063] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:11 2022] DELETE /identity/v3/users/979349268c2346bd842f028df2ec9842 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:12.309828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413d29-1956-49af-97e7-9d99e98daa10 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:12.311083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413d29-1956-49af-97e7-9d99e98daa10 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:12.311529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413d29-1956-49af-97e7-9d99e98daa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:12.340437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-96413d29-1956-49af-97e7-9d99e98daa10 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:12.343994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96413d29-1956-49af-97e7-9d99e98daa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:12.387999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:12.389280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:12.630917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa9403-b2c5-4c75-90e9-0c2d9cfdb36e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:12.632414 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3516/7064] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:12.653616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8824bb1-4e6d-4a31-b86e-d493978daac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:12.654676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8824bb1-4e6d-4a31-b86e-d493978daac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:12.655222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8824bb1-4e6d-4a31-b86e-d493978daac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:12.655909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8824bb1-4e6d-4a31-b86e-d493978daac3 admin admin] PATH_INFO: `/v3/users/af07188b10554276a9a1ebbe516b51c8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:12.659284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8824bb1-4e6d-4a31-b86e-d493978daac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af07188b10554276a9a1ebbe516b51c8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:12.662479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8824bb1-4e6d-4a31-b86e-d493978daac3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:12.707967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413d29-1956-49af-97e7-9d99e98daa10 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:12.711439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96413d29-1956-49af-97e7-9d99e98daa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:12.844718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e8824bb1-4e6d-4a31-b86e-d493978daac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af07188b10554276a9a1ebbe516b51c8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:12.867289 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:12.885947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e8824bb1-4e6d-4a31-b86e-d493978daac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af07188b10554276a9a1ebbe516b51c8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:12.886926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e8824bb1-4e6d-4a31-b86e-d493978daac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af07188b10554276a9a1ebbe516b51c8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:12.905862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e8824bb1-4e6d-4a31-b86e-d493978daac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af07188b10554276a9a1ebbe516b51c8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:12.906790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e8824bb1-4e6d-4a31-b86e-d493978daac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af07188b10554276a9a1ebbe516b51c8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:12.917654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413d29-1956-49af-97e7-9d99e98daa10 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:12.923060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af5d10-72f9-44d1-9e6b-72729d1c3858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:12.923996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af5d10-72f9-44d1-9e6b-72729d1c3858 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:12.924461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af5d10-72f9-44d1-9e6b-72729d1c3858 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:12.924950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af5d10-72f9-44d1-9e6b-72729d1c3858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:12.927416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-59af5d10-72f9-44d1-9e6b-72729d1c3858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:12.948661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af5d10-72f9-44d1-9e6b-72729d1c3858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:12.952627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af5d10-72f9-44d1-9e6b-72729d1c3858 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:12.956838 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3549/7065] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:12 2022] DELETE /identity/v3/users/af07188b10554276a9a1ebbe516b51c8 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:12.958494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a9572-2977-41c2-b0a0-112914ab867e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:12.958925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a9572-2977-41c2-b0a0-112914ab867e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:12.959304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a9572-2977-41c2-b0a0-112914ab867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:12.987252 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3517/7066] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:32:13.008870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-684a9572-2977-41c2-b0a0-112914ab867e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:13.010343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-684a9572-2977-41c2-b0a0-112914ab867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:13.174863 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3550/7067] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:13.220943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af5d10-72f9-44d1-9e6b-72729d1c3858 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:13.222386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-59af5d10-72f9-44d1-9e6b-72729d1c3858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:13.257051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af5d10-72f9-44d1-9e6b-72729d1c3858 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:13.452723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e43b6-21de-4e30-9734-1a4c2df2d310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:13.453767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e43b6-21de-4e30-9734-1a4c2df2d310 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:13.454273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e43b6-21de-4e30-9734-1a4c2df2d310 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:13.454792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e43b6-21de-4e30-9734-1a4c2df2d310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:13.480356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e43b6-21de-4e30-9734-1a4c2df2d310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:13.481839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e43b6-21de-4e30-9734-1a4c2df2d310 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:13.507663 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3518/7068] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:14.503114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a9572-2977-41c2-b0a0-112914ab867e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:14.504611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-684a9572-2977-41c2-b0a0-112914ab867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:14.526790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a9572-2977-41c2-b0a0-112914ab867e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:14.539173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:14.547035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:14.547318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:14.547598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] PATH_INFO: `/v3/projects/15c9c09d348143ce915d7dbfaf7f1d7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:14.549295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c9c09d348143ce915d7dbfaf7f1d7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:14.551309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:14.565403 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:14.698145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c9c09d348143ce915d7dbfaf7f1d7e', 'request_id': 'req-b561fbf0-58c7-42db-849e-d03252013a4a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:14.729703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c9c09d348143ce915d7dbfaf7f1d7e', 'request_id': 'req-b561fbf0-58c7-42db-849e-d03252013a4a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:14.751302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c9c09d348143ce915d7dbfaf7f1d7e', 'request_id': 'req-b561fbf0-58c7-42db-849e-d03252013a4a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:14.787447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] The token cache is being invalidate because project 15c9c09d348143ce915d7dbfaf7f1d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:14.788006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:14.789640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:14.808274 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3551/7069] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:14 2022] DELETE /identity/v3/projects/15c9c09d348143ce915d7dbfaf7f1d7e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:14.812060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e43b6-21de-4e30-9734-1a4c2df2d310 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:14.828412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e43b6-21de-4e30-9734-1a4c2df2d310 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:15.106863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287c20c-09c9-4a51-be05-d447b53ac36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:15.107854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c20c-09c9-4a51-be05-d447b53ac36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:15.108442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c20c-09c9-4a51-be05-d447b53ac36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:15.109161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c20c-09c9-4a51-be05-d447b53ac36b admin admin] PATH_INFO: `/v3/users/3644e00e94a74641a7e658b7ff411e40` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:15.110657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287c20c-09c9-4a51-be05-d447b53ac36b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3644e00e94a74641a7e658b7ff411e40)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:15.113054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287c20c-09c9-4a51-be05-d447b53ac36b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:15.232153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9287c20c-09c9-4a51-be05-d447b53ac36b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3644e00e94a74641a7e658b7ff411e40'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:15.257424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9287c20c-09c9-4a51-be05-d447b53ac36b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3644e00e94a74641a7e658b7ff411e40'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:15.259347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9287c20c-09c9-4a51-be05-d447b53ac36b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3644e00e94a74641a7e658b7ff411e40'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:15.278789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9287c20c-09c9-4a51-be05-d447b53ac36b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3644e00e94a74641a7e658b7ff411e40'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:15.289710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9287c20c-09c9-4a51-be05-d447b53ac36b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3644e00e94a74641a7e658b7ff411e40'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:15.292504 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:15.302733 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3519/7070] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:14 2022] DELETE /identity/v3/users/3644e00e94a74641a7e658b7ff411e40 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:15.540018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:15.541585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:15.589556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561fbf0-58c7-42db-849e-d03252013a4a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:15.736305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:15.737315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:15.737808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:15.738259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] PATH_INFO: `/v3/projects/61231ab7c52a4c0da575ed01e16d6645` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:15.741109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61231ab7c52a4c0da575ed01e16d6645)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:15.744065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:15.861817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61231ab7c52a4c0da575ed01e16d6645', 'request_id': 'req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:15.874571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61231ab7c52a4c0da575ed01e16d6645', 'request_id': 'req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:15.888178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61231ab7c52a4c0da575ed01e16d6645', 'request_id': 'req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:15.924985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] The token cache is being invalidate because project 61231ab7c52a4c0da575ed01e16d6645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:15.926068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:15.928252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-24d00680-1cbd-40fc-a7fd-e6d47ca3efd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:15.933463 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3552/7071] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:15 2022] DELETE /identity/v3/projects/61231ab7c52a4c0da575ed01e16d6645 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:15.938343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392d835-6d31-4977-8d33-a6f4b82f2445 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:15.939339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392d835-6d31-4977-8d33-a6f4b82f2445 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:15.940349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392d835-6d31-4977-8d33-a6f4b82f2445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:16.000883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2392d835-6d31-4977-8d33-a6f4b82f2445 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:16.002109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2392d835-6d31-4977-8d33-a6f4b82f2445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:16.152907 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3520/7072] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:16.283026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2f4bb-2ec3-4b60-99a1-1017f698fed7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:16.283309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2f4bb-2ec3-4b60-99a1-1017f698fed7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:16.283587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2f4bb-2ec3-4b60-99a1-1017f698fed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:16.358146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f0e2f4bb-2ec3-4b60-99a1-1017f698fed7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:16.359404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f0e2f4bb-2ec3-4b60-99a1-1017f698fed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:16.378539 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3553/7073] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:16.384748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392d835-6d31-4977-8d33-a6f4b82f2445 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:16.399918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392d835-6d31-4977-8d33-a6f4b82f2445 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:16.432750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2879d-11a3-41e2-8adc-23f85b8d21c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:16.433647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2879d-11a3-41e2-8adc-23f85b8d21c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:16.434314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2879d-11a3-41e2-8adc-23f85b8d21c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:16.435407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2879d-11a3-41e2-8adc-23f85b8d21c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:16.436396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2879d-11a3-41e2-8adc-23f85b8d21c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:16.436935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2879d-11a3-41e2-8adc-23f85b8d21c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:16.439205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2879d-11a3-41e2-8adc-23f85b8d21c6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:16.473077 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3521/7074] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:16.476159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2f4bb-2ec3-4b60-99a1-1017f698fed7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:16.489818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2f4bb-2ec3-4b60-99a1-1017f698fed7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:16.501142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174d24-cac3-4fbb-9ddd-90e576e47c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:16.501844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174d24-cac3-4fbb-9ddd-90e576e47c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:16.502184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174d24-cac3-4fbb-9ddd-90e576e47c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:16.502404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174d24-cac3-4fbb-9ddd-90e576e47c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:16.507382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88174d24-cac3-4fbb-9ddd-90e576e47c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:16.510190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88174d24-cac3-4fbb-9ddd-90e576e47c9c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:16.557084 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:16.587696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2879d-11a3-41e2-8adc-23f85b8d21c6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:16.593429 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3554/7075] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:16 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:16.603717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2879d-11a3-41e2-8adc-23f85b8d21c6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:16.691943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41580945-2d24-4f5d-9366-9ebb23e1a348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:16.693218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41580945-2d24-4f5d-9366-9ebb23e1a348 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:16.693504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41580945-2d24-4f5d-9366-9ebb23e1a348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:16.693776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41580945-2d24-4f5d-9366-9ebb23e1a348 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:16.694952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41580945-2d24-4f5d-9366-9ebb23e1a348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:16.697555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41580945-2d24-4f5d-9366-9ebb23e1a348 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:16.731926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174d24-cac3-4fbb-9ddd-90e576e47c9c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:16.734135 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3522/7076] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:16 2022] POST /identity/v3/users => generated 279 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:16.750008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174d24-cac3-4fbb-9ddd-90e576e47c9c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:16.765413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94e7c9-71e3-4a23-b4c5-b45e6d84e501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:16.766311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e7c9-71e3-4a23-b4c5-b45e6d84e501 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:16.766608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e7c9-71e3-4a23-b4c5-b45e6d84e501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:16.766886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e7c9-71e3-4a23-b4c5-b45e6d84e501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:16.768833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94e7c9-71e3-4a23-b4c5-b45e6d84e501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:16.770468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94e7c9-71e3-4a23-b4c5-b45e6d84e501 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:16.807211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41580945-2d24-4f5d-9366-9ebb23e1a348 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:16.811560 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3555/7077] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:16.836095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41580945-2d24-4f5d-9366-9ebb23e1a348 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:16.844274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade6508-73e0-4146-8bc5-f3954d72ceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:16.845541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade6508-73e0-4146-8bc5-f3954d72ceca admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:16.845940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade6508-73e0-4146-8bc5-f3954d72ceca admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:16.846314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade6508-73e0-4146-8bc5-f3954d72ceca admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:16.847134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade6508-73e0-4146-8bc5-f3954d72ceca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:16.850935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade6508-73e0-4146-8bc5-f3954d72ceca admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:16.894425 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3523/7078] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:16.898901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94e7c9-71e3-4a23-b4c5-b45e6d84e501 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:16.924306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94e7c9-71e3-4a23-b4c5-b45e6d84e501 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:16.947033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29042cc3-edbd-4133-9285-bd9160217fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:16.948044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29042cc3-edbd-4133-9285-bd9160217fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:16.948750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29042cc3-edbd-4133-9285-bd9160217fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:16.949682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29042cc3-edbd-4133-9285-bd9160217fd5 admin admin] PATH_INFO: `/v3/projects/6c84c23d8389438c9678a3f460fa7683/users/1c4717b3aa5e4526993cbb0e0e098aa2/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:17.058283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29042cc3-edbd-4133-9285-bd9160217fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c84c23d8389438c9678a3f460fa7683, user_id=1c4717b3aa5e4526993cbb0e0e098aa2, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:17.061416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29042cc3-edbd-4133-9285-bd9160217fd5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:17.100569 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3556/7079] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:16 2022] PUT /identity/v3/projects/6c84c23d8389438c9678a3f460fa7683/users/1c4717b3aa5e4526993cbb0e0e098aa2/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:17.113282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7780-1ed0-48d5-86a2-55b92ec54814 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:17.113815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7780-1ed0-48d5-86a2-55b92ec54814 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:17.114632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7780-1ed0-48d5-86a2-55b92ec54814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:17.273403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-69ca7780-1ed0-48d5-86a2-55b92ec54814 None None] MFA Rules not processed for user `1c4717b3aa5e4526993cbb0e0e098aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:17.275062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-69ca7780-1ed0-48d5-86a2-55b92ec54814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:17.294304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29042cc3-edbd-4133-9285-bd9160217fd5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:17.297051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-29042cc3-edbd-4133-9285-bd9160217fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:17.506025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29042cc3-edbd-4133-9285-bd9160217fd5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:17.543387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:17.545022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:17.545407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:17.545691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] PATH_INFO: `/v3/users/66aa8c34570e4e4ca4ae8fb9969b19e1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:17.547307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66aa8c34570e4e4ca4ae8fb9969b19e1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:17.553508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:17.583335 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:17.627838 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3524/7080] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:17.681080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca7780-1ed0-48d5-86a2-55b92ec54814 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:17.685003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-69ca7780-1ed0-48d5-86a2-55b92ec54814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:17.708324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66aa8c34570e4e4ca4ae8fb9969b19e1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:17.725212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca7780-1ed0-48d5-86a2-55b92ec54814 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:17.751436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:17.752105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:17.752395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:17.752656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] PATH_INFO: `/v3/projects/1f08d901454847789d7a3fd2db9c197d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:17.755704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f08d901454847789d7a3fd2db9c197d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:17.756930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66aa8c34570e4e4ca4ae8fb9969b19e1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:17.757707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:17.761464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66aa8c34570e4e4ca4ae8fb9969b19e1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:17.789055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66aa8c34570e4e4ca4ae8fb9969b19e1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:17.791986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66aa8c34570e4e4ca4ae8fb9969b19e1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:17.828081 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3557/7081] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:17 2022] DELETE /identity/v3/users/66aa8c34570e4e4ca4ae8fb9969b19e1 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:17.829483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:17.834765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:17.892739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f08d901454847789d7a3fd2db9c197d', 'request_id': 'req-94115882-4002-4677-b855-c3a4b3a63c29'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:17.901201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f08d901454847789d7a3fd2db9c197d', 'request_id': 'req-94115882-4002-4677-b855-c3a4b3a63c29'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:17.920003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f08d901454847789d7a3fd2db9c197d', 'request_id': 'req-94115882-4002-4677-b855-c3a4b3a63c29'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:17.944916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] The token cache is being invalidate because project 1f08d901454847789d7a3fd2db9c197d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:17.945216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:17.946971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-94115882-4002-4677-b855-c3a4b3a63c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:17.952023 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3525/7082] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:17 2022] DELETE /identity/v3/projects/1f08d901454847789d7a3fd2db9c197d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:17.953492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ffc5-3891-41bb-9252-f8b3863c2e90 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:17.953620 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:17.953828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ffc5-3891-41bb-9252-f8b3863c2e90 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:17.954051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ffc5-3891-41bb-9252-f8b3863c2e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:17.997461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceac55-51a7-48f5-96e7-51568bfaffe9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:18.004210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7307ffc5-3891-41bb-9252-f8b3863c2e90 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:18.005391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7307ffc5-3891-41bb-9252-f8b3863c2e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:18.158061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0b3ba-2bb6-411f-8283-ad035eafba5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:18.158842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0b3ba-2bb6-411f-8283-ad035eafba5e service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:18.159157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0b3ba-2bb6-411f-8283-ad035eafba5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:18.159389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0b3ba-2bb6-411f-8283-ad035eafba5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:18.163291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bba0b3ba-2bb6-411f-8283-ad035eafba5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:18.191556 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3526/7083] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:18.197001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e885b5-a2ed-4387-8f5c-3fdac1ccafbc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:18.197287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e885b5-a2ed-4387-8f5c-3fdac1ccafbc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:18.199612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e885b5-a2ed-4387-8f5c-3fdac1ccafbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:18.271476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e7e885b5-a2ed-4387-8f5c-3fdac1ccafbc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:18.274914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e7e885b5-a2ed-4387-8f5c-3fdac1ccafbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:18.287388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0b3ba-2bb6-411f-8283-ad035eafba5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:18.289098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0b3ba-2bb6-411f-8283-ad035eafba5e service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:18.303268 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3558/7084] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:18.304417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0b3ba-2bb6-411f-8283-ad035eafba5e service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:18.306443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bba0b3ba-2bb6-411f-8283-ad035eafba5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:18.307962 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3527/7085] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:18.316287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376fc79-8413-48ba-853b-faa60f73aab2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:18.316738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376fc79-8413-48ba-853b-faa60f73aab2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:18.317026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376fc79-8413-48ba-853b-faa60f73aab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:18.380617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9376fc79-8413-48ba-853b-faa60f73aab2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:18.382286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9376fc79-8413-48ba-853b-faa60f73aab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:18.408502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0b3ba-2bb6-411f-8283-ad035eafba5e service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:18.415607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d696b1-b447-4e32-989a-f84e0a7bf3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:18.416497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d696b1-b447-4e32-989a-f84e0a7bf3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:18.417067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d696b1-b447-4e32-989a-f84e0a7bf3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:18.421109 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3528/7086] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:18.421109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376fc79-8413-48ba-853b-faa60f73aab2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:18.422134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9376fc79-8413-48ba-853b-faa60f73aab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:18.422551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d696b1-b447-4e32-989a-f84e0a7bf3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:18.444411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d696b1-b447-4e32-989a-f84e0a7bf3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:18.446680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d696b1-b447-4e32-989a-f84e0a7bf3e6 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:18.458704 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3559/7087] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:18.459758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d696b1-b447-4e32-989a-f84e0a7bf3e6 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:18.464350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376fc79-8413-48ba-853b-faa60f73aab2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:18.471453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d696b1-b447-4e32-989a-f84e0a7bf3e6 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:18.478275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a50bf3-963d-4fc2-b8a1-70e49c48958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:18.479122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a50bf3-963d-4fc2-b8a1-70e49c48958b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:18.479618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a50bf3-963d-4fc2-b8a1-70e49c48958b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:18.480045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a50bf3-963d-4fc2-b8a1-70e49c48958b admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:18.480808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a50bf3-963d-4fc2-b8a1-70e49c48958b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:18.481309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a50bf3-963d-4fc2-b8a1-70e49c48958b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:18.483369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:18.484023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:18.484647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:18.484788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a50bf3-963d-4fc2-b8a1-70e49c48958b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:18.484897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] PATH_INFO: `/v3/users/1c4717b3aa5e4526993cbb0e0e098aa2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:18.491841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4717b3aa5e4526993cbb0e0e098aa2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:18.493836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:18.506491 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3560/7088] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:18.507939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a50bf3-963d-4fc2-b8a1-70e49c48958b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:18.583528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a50bf3-963d-4fc2-b8a1-70e49c48958b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:18.596126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3edad-c8a0-4f4b-8b08-cf8cc3f75d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:18.597149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3edad-c8a0-4f4b-8b08-cf8cc3f75d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:18.597617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3edad-c8a0-4f4b-8b08-cf8cc3f75d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:18.598158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3edad-c8a0-4f4b-8b08-cf8cc3f75d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:18.600426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3edad-c8a0-4f4b-8b08-cf8cc3f75d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:18.607219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3edad-c8a0-4f4b-8b08-cf8cc3f75d61 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:18.663009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4717b3aa5e4526993cbb0e0e098aa2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:18.689004 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:18.689212 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3561/7089] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:18 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:18.690113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3edad-c8a0-4f4b-8b08-cf8cc3f75d61 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:18.693319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4ee3edad-c8a0-4f4b-8b08-cf8cc3f75d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:18.698531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4717b3aa5e4526993cbb0e0e098aa2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:18.699737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4717b3aa5e4526993cbb0e0e098aa2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:18.720153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4717b3aa5e4526993cbb0e0e098aa2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:18.737675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4717b3aa5e4526993cbb0e0e098aa2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:18.742997 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:18.755894 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3529/7090] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:18 2022] DELETE /identity/v3/users/1c4717b3aa5e4526993cbb0e0e098aa2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:18.756465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:18.764653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:18.858183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3edad-c8a0-4f4b-8b08-cf8cc3f75d61 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:18.898754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f3a9c-668f-4655-b9f7-6cecf62a8ff3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:18.914856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a7b52-68b6-4d1f-957f-390cec70842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:18.915618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7b52-68b6-4d1f-957f-390cec70842b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:18.915866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7b52-68b6-4d1f-957f-390cec70842b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:18.916191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7b52-68b6-4d1f-957f-390cec70842b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:18.916853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7b52-68b6-4d1f-957f-390cec70842b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:18.918899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7b52-68b6-4d1f-957f-390cec70842b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:18.977483 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3530/7091] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:18 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:18.978838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01b74e-fd3d-47e1-9404-1eea6e8a01a9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:18.979790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01b74e-fd3d-47e1-9404-1eea6e8a01a9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:18.980081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01b74e-fd3d-47e1-9404-1eea6e8a01a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:19.014782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da75280-ea88-41b0-87b3-bc92f3ddf36d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:19.015419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da75280-ea88-41b0-87b3-bc92f3ddf36d service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:19.015702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da75280-ea88-41b0-87b3-bc92f3ddf36d service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:19.015982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da75280-ea88-41b0-87b3-bc92f3ddf36d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:19.020599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2d01b74e-fd3d-47e1-9404-1eea6e8a01a9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:19.021864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d01b74e-fd3d-47e1-9404-1eea6e8a01a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:19.023077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9da75280-ea88-41b0-87b3-bc92f3ddf36d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:19.045894 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3531/7092] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:19.046819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01b74e-fd3d-47e1-9404-1eea6e8a01a9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:19.054756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da75280-ea88-41b0-87b3-bc92f3ddf36d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:19.057751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da75280-ea88-41b0-87b3-bc92f3ddf36d service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:19.067771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01b74e-fd3d-47e1-9404-1eea6e8a01a9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:19.080845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21724096-d267-4103-b958-497e185278a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:19.081922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21724096-d267-4103-b958-497e185278a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:19.081922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21724096-d267-4103-b958-497e185278a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:19.082131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21724096-d267-4103-b958-497e185278a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:19.082865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21724096-d267-4103-b958-497e185278a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:19.086127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21724096-d267-4103-b958-497e185278a8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:19.089246 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3562/7093] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:19.090058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da75280-ea88-41b0-87b3-bc92f3ddf36d service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:19.093964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9da75280-ea88-41b0-87b3-bc92f3ddf36d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:19.112659 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3532/7094] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:19.115421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21724096-d267-4103-b958-497e185278a8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:19.144909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21724096-d267-4103-b958-497e185278a8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:19.159721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6ee9-548a-4c13-a65f-489042d8cea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:19.160519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6ee9-548a-4c13-a65f-489042d8cea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:19.160805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6ee9-548a-4c13-a65f-489042d8cea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:19.161060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6ee9-548a-4c13-a65f-489042d8cea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:19.163459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6ee9-548a-4c13-a65f-489042d8cea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:19.166028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6ee9-548a-4c13-a65f-489042d8cea1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:19.199312 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3533/7095] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:19.200243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6ee9-548a-4c13-a65f-489042d8cea1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:19.227519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6ee9-548a-4c13-a65f-489042d8cea1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:19.241782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abb832-c101-4ea9-a9a8-44ca4a091798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:19.244031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abb832-c101-4ea9-a9a8-44ca4a091798 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:19.244319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abb832-c101-4ea9-a9a8-44ca4a091798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:19.244594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abb832-c101-4ea9-a9a8-44ca4a091798 admin admin] PATH_INFO: `/v3/projects/6893e417a55c4788826feb91b17dbec0/users/bd6e51135cc046098baa8a338de87a93/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:19.259503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da75280-ea88-41b0-87b3-bc92f3ddf36d service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:19.272155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f054a-bfd0-4915-9e3c-4f3955921ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:19.275521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f054a-bfd0-4915-9e3c-4f3955921ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:19.275521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f054a-bfd0-4915-9e3c-4f3955921ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:19.289763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f054a-bfd0-4915-9e3c-4f3955921ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:19.310798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abb832-c101-4ea9-a9a8-44ca4a091798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6893e417a55c4788826feb91b17dbec0, user_id=bd6e51135cc046098baa8a338de87a93, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:19.314747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abb832-c101-4ea9-a9a8-44ca4a091798 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:19.320604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f054a-bfd0-4915-9e3c-4f3955921ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:19.323160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f054a-bfd0-4915-9e3c-4f3955921ed5 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:19.343942 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3534/7096] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:19 2022] PUT /identity/v3/projects/6893e417a55c4788826feb91b17dbec0/users/bd6e51135cc046098baa8a338de87a93/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:19.345529 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3563/7097] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:19.354921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82a185-7f2b-44ad-a340-a4da57bf23eb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:19.355611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82a185-7f2b-44ad-a340-a4da57bf23eb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:19.356088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82a185-7f2b-44ad-a340-a4da57bf23eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:19.420252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ac82a185-7f2b-44ad-a340-a4da57bf23eb None None] MFA Rules not processed for user `bd6e51135cc046098baa8a338de87a93`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:19.425276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ac82a185-7f2b-44ad-a340-a4da57bf23eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:19.581223 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3535/7098] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:19.587645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f054a-bfd0-4915-9e3c-4f3955921ed5 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:19.600854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f054a-bfd0-4915-9e3c-4f3955921ed5 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:19.699268 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:19.737261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed322a-6be6-4931-9192-d0ec0211a410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:19.737962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed322a-6be6-4931-9192-d0ec0211a410 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:19.738225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed322a-6be6-4931-9192-d0ec0211a410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:19.739039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed322a-6be6-4931-9192-d0ec0211a410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:19.739690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed322a-6be6-4931-9192-d0ec0211a410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:19.744972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed322a-6be6-4931-9192-d0ec0211a410 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:19.807217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82a185-7f2b-44ad-a340-a4da57bf23eb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:19.813619 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:19.815393 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3564/7099] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:19 2022] POST /identity/v3/projects => generated 369 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:19.824762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82a185-7f2b-44ad-a340-a4da57bf23eb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:19.956037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c81fd-fab7-4d10-9399-fcd4bc31492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:19.956679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c81fd-fab7-4d10-9399-fcd4bc31492d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:19.956963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c81fd-fab7-4d10-9399-fcd4bc31492d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:19.957243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c81fd-fab7-4d10-9399-fcd4bc31492d admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:19.957901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c81fd-fab7-4d10-9399-fcd4bc31492d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:19.983892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c81fd-fab7-4d10-9399-fcd4bc31492d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:20.024997 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3536/7100] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:19 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:32:20.026493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed322a-6be6-4931-9192-d0ec0211a410 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:20.045658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed322a-6be6-4931-9192-d0ec0211a410 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:20.054809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6588-9626-4fc7-b714-2a053de226b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:20.055627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6588-9626-4fc7-b714-2a053de226b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:20.055913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6588-9626-4fc7-b714-2a053de226b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:20.056564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6588-9626-4fc7-b714-2a053de226b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:20.057038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f6588-9626-4fc7-b714-2a053de226b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:20.058689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f6588-9626-4fc7-b714-2a053de226b9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:20.089060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c81fd-fab7-4d10-9399-fcd4bc31492d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:20.096402 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3565/7101] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:20.105057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6588-9626-4fc7-b714-2a053de226b9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:20.106021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c81fd-fab7-4d10-9399-fcd4bc31492d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:20.108004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a80f6588-9626-4fc7-b714-2a053de226b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:20.127703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0534c-c448-4d42-81f9-f209a2fe6fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:20.128715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0534c-c448-4d42-81f9-f209a2fe6fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:20.129155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0534c-c448-4d42-81f9-f209a2fe6fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:20.131724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0534c-c448-4d42-81f9-f209a2fe6fe9 admin admin] PATH_INFO: `/v3/projects/59cbf4a592ec417a9df4131974824ec6/users/46dd31be3fa54a488a85c25c29086b26/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:20.154542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6588-9626-4fc7-b714-2a053de226b9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:20.175883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:20.176783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:20.177406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:20.178399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] PATH_INFO: `/v3/projects/4c47532af47146329ffd339c1a568fd8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:20.180480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0534c-c448-4d42-81f9-f209a2fe6fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cbf4a592ec417a9df4131974824ec6, user_id=46dd31be3fa54a488a85c25c29086b26, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:20.181308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c47532af47146329ffd339c1a568fd8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:20.185738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0534c-c448-4d42-81f9-f209a2fe6fe9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:20.187325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:20.233353 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3537/7102] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:20 2022] PUT /identity/v3/projects/59cbf4a592ec417a9df4131974824ec6/users/46dd31be3fa54a488a85c25c29086b26/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:20.237185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0534c-c448-4d42-81f9-f209a2fe6fe9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:20.338435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c47532af47146329ffd339c1a568fd8', 'request_id': 'req-f645608c-1366-496e-a923-82b70cdf55eb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:20.362914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c47532af47146329ffd339c1a568fd8', 'request_id': 'req-f645608c-1366-496e-a923-82b70cdf55eb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:20.376843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c47532af47146329ffd339c1a568fd8', 'request_id': 'req-f645608c-1366-496e-a923-82b70cdf55eb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:20.411139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] The token cache is being invalidate because project 4c47532af47146329ffd339c1a568fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:20.411440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:20.412188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:20.427234 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3566/7103] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:20 2022] DELETE /identity/v3/projects/4c47532af47146329ffd339c1a568fd8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:20.428323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:20.453610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:20.480186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0534c-c448-4d42-81f9-f209a2fe6fe9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:20.758218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083ec4f-e510-4def-b65a-c0275b2cd729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:20.765806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083ec4f-e510-4def-b65a-c0275b2cd729 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:20.766423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645608c-1366-496e-a923-82b70cdf55eb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:20.766953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083ec4f-e510-4def-b65a-c0275b2cd729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:20.770324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083ec4f-e510-4def-b65a-c0275b2cd729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:20.776028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083ec4f-e510-4def-b65a-c0275b2cd729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:20.781846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083ec4f-e510-4def-b65a-c0275b2cd729 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:20.800900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c079efa-98eb-487b-a78e-08914a535dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:20.802407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c079efa-98eb-487b-a78e-08914a535dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:20.807248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c079efa-98eb-487b-a78e-08914a535dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:20.809990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c079efa-98eb-487b-a78e-08914a535dcb admin admin] PATH_INFO: `/v3/users/532b108f8f6b4343817e584f5da50c42` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:20.816864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c079efa-98eb-487b-a78e-08914a535dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=532b108f8f6b4343817e584f5da50c42)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:20.819088 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3538/7104] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 582 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:32:20.826333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083ec4f-e510-4def-b65a-c0275b2cd729 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:20.828211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c079efa-98eb-487b-a78e-08914a535dcb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:20.834932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7083ec4f-e510-4def-b65a-c0275b2cd729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:20.901173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083ec4f-e510-4def-b65a-c0275b2cd729 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:20.924078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f42bac-d20c-4192-b4ad-6e6dff6cd3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:20.924817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f42bac-d20c-4192-b4ad-6e6dff6cd3db admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:20.925106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f42bac-d20c-4192-b4ad-6e6dff6cd3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:20.925381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f42bac-d20c-4192-b4ad-6e6dff6cd3db admin admin] PATH_INFO: `/v3/projects/59cbf4a592ec417a9df4131974824ec6/users/46dd31be3fa54a488a85c25c29086b26/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:20.939125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f42bac-d20c-4192-b4ad-6e6dff6cd3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cbf4a592ec417a9df4131974824ec6, user_id=46dd31be3fa54a488a85c25c29086b26, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:20.955302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f42bac-d20c-4192-b4ad-6e6dff6cd3db admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:20.984478 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:20.986577 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:20.994999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c079efa-98eb-487b-a78e-08914a535dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532b108f8f6b4343817e584f5da50c42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:21.010432 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3539/7105] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:20 2022] PUT /identity/v3/projects/59cbf4a592ec417a9df4131974824ec6/users/46dd31be3fa54a488a85c25c29086b26/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:21.022093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070fe0-013f-47c7-97b7-300f08eb3a3e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:21.022279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070fe0-013f-47c7-97b7-300f08eb3a3e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:21.022501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070fe0-013f-47c7-97b7-300f08eb3a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:21.026939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c079efa-98eb-487b-a78e-08914a535dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532b108f8f6b4343817e584f5da50c42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:21.028620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c079efa-98eb-487b-a78e-08914a535dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532b108f8f6b4343817e584f5da50c42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:21.043308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c079efa-98eb-487b-a78e-08914a535dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532b108f8f6b4343817e584f5da50c42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:21.044524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6c079efa-98eb-487b-a78e-08914a535dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532b108f8f6b4343817e584f5da50c42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:21.089719 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3567/7106] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:20 2022] DELETE /identity/v3/users/532b108f8f6b4343817e584f5da50c42 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:21.095275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45ac1-327a-4496-8e68-18c150cc344f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:21.096386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45ac1-327a-4496-8e68-18c150cc344f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:21.096386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45ac1-327a-4496-8e68-18c150cc344f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:21.099887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4b070fe0-013f-47c7-97b7-300f08eb3a3e None None] MFA Rules not processed for user `46dd31be3fa54a488a85c25c29086b26`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:21.101265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b070fe0-013f-47c7-97b7-300f08eb3a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:21.159929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-68e45ac1-327a-4496-8e68-18c150cc344f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:21.162637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-68e45ac1-327a-4496-8e68-18c150cc344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:21.287805 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3540/7107] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:32:21.312909 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3568/7108] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:21.374444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b070fe0-013f-47c7-97b7-300f08eb3a3e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:21.376474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b070fe0-013f-47c7-97b7-300f08eb3a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:21.381214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e45ac1-327a-4496-8e68-18c150cc344f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:21.383941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-68e45ac1-327a-4496-8e68-18c150cc344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:21.546908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e45ac1-327a-4496-8e68-18c150cc344f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:21.560615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e0992-eec7-44ca-a389-e107639043c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:21.561157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e0992-eec7-44ca-a389-e107639043c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:21.561438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e0992-eec7-44ca-a389-e107639043c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:21.561714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e0992-eec7-44ca-a389-e107639043c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:21.591004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b070fe0-013f-47c7-97b7-300f08eb3a3e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:21.603862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32eea45-cc8c-4cc3-9786-82faaef3efa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:21.604545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eea45-cc8c-4cc3-9786-82faaef3efa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:21.604770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eea45-cc8c-4cc3-9786-82faaef3efa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:21.605039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eea45-cc8c-4cc3-9786-82faaef3efa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:21.623548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32eea45-cc8c-4cc3-9786-82faaef3efa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:21.625030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32eea45-cc8c-4cc3-9786-82faaef3efa0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:21.635850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e0992-eec7-44ca-a389-e107639043c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:21.637424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e0992-eec7-44ca-a389-e107639043c3 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:21.652280 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3541/7109] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:21.675505 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3569/7110] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:22.268203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32eea45-cc8c-4cc3-9786-82faaef3efa0 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:22.269776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f32eea45-cc8c-4cc3-9786-82faaef3efa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:22.297262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32eea45-cc8c-4cc3-9786-82faaef3efa0 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:22.307402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:22.308157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:22.308360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:22.311748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] PATH_INFO: `/v3/projects/6c84c23d8389438c9678a3f460fa7683` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:22.313284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c84c23d8389438c9678a3f460fa7683)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:22.315246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:22.377107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c84c23d8389438c9678a3f460fa7683', 'request_id': 'req-f3b37ca7-8050-4d7f-800c-f9dd23275101'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:22.386520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c84c23d8389438c9678a3f460fa7683', 'request_id': 'req-f3b37ca7-8050-4d7f-800c-f9dd23275101'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:22.413415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c84c23d8389438c9678a3f460fa7683', 'request_id': 'req-f3b37ca7-8050-4d7f-800c-f9dd23275101'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:22.454387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] The token cache is being invalidate because project 6c84c23d8389438c9678a3f460fa7683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:22.454767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:22.455493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:22.461813 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3542/7111] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:22 2022] DELETE /identity/v3/projects/6c84c23d8389438c9678a3f460fa7683 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:22.466932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5492e6-36ea-43ee-9340-6751343758a4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:22.467458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5492e6-36ea-43ee-9340-6751343758a4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:22.467458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5492e6-36ea-43ee-9340-6751343758a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:22.503990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1e5492e6-36ea-43ee-9340-6751343758a4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:22.505970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1e5492e6-36ea-43ee-9340-6751343758a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:22.610446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:22.611969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:22.630657 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:22.668724 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3570/7112] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:22.678515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3c521-da78-4950-a35c-7e974a6c2d6b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:22.678864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3c521-da78-4950-a35c-7e974a6c2d6b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:22.680937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3c521-da78-4950-a35c-7e974a6c2d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:22.695382 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:22.713897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-96b3c521-da78-4950-a35c-7e974a6c2d6b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:22.716784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-96b3c521-da78-4950-a35c-7e974a6c2d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:22.734798 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3571/7113] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:22.740386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3c521-da78-4950-a35c-7e974a6c2d6b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:22.756483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b37ca7-8050-4d7f-800c-f9dd23275101 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:22.767703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3c521-da78-4950-a35c-7e974a6c2d6b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:22.767962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996714f-3ebc-4290-a6a0-bf602c1760e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:22.767962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996714f-3ebc-4290-a6a0-bf602c1760e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:22.768523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996714f-3ebc-4290-a6a0-bf602c1760e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:22.768812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996714f-3ebc-4290-a6a0-bf602c1760e4 admin admin] PATH_INFO: `/v3/users/0959f9c0fb814808b1af17739027f0d5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:22.770816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996714f-3ebc-4290-a6a0-bf602c1760e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0959f9c0fb814808b1af17739027f0d5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:22.771976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d809b5-7133-4237-91d0-1aaa2883e7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:22.772605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d809b5-7133-4237-91d0-1aaa2883e7ea admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:22.773036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d809b5-7133-4237-91d0-1aaa2883e7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:22.775745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d809b5-7133-4237-91d0-1aaa2883e7ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:22.776551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996714f-3ebc-4290-a6a0-bf602c1760e4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:22.782449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d809b5-7133-4237-91d0-1aaa2883e7ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:22.783444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d809b5-7133-4237-91d0-1aaa2883e7ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:22.787744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d809b5-7133-4237-91d0-1aaa2883e7ea admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:22.827888 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3572/7114] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:22.832954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d809b5-7133-4237-91d0-1aaa2883e7ea admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:22.869613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d809b5-7133-4237-91d0-1aaa2883e7ea admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:22.881988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b93e93-7818-4de1-9a48-843e5f3d6bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:22.883273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b93e93-7818-4de1-9a48-843e5f3d6bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:22.883799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b93e93-7818-4de1-9a48-843e5f3d6bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:22.884391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b93e93-7818-4de1-9a48-843e5f3d6bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:22.885219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b93e93-7818-4de1-9a48-843e5f3d6bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:22.887446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b93e93-7818-4de1-9a48-843e5f3d6bc5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:22.897223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2996714f-3ebc-4290-a6a0-bf602c1760e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0959f9c0fb814808b1af17739027f0d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:22.940853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2996714f-3ebc-4290-a6a0-bf602c1760e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0959f9c0fb814808b1af17739027f0d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:22.943896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2996714f-3ebc-4290-a6a0-bf602c1760e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0959f9c0fb814808b1af17739027f0d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:22.950854 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3573/7115] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:22 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:22.953656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b93e93-7818-4de1-9a48-843e5f3d6bc5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:22.957832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-64b93e93-7818-4de1-9a48-843e5f3d6bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:22.974261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2996714f-3ebc-4290-a6a0-bf602c1760e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0959f9c0fb814808b1af17739027f0d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:22.990170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2996714f-3ebc-4290-a6a0-bf602c1760e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0959f9c0fb814808b1af17739027f0d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:23.004933 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3543/7116] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:22 2022] DELETE /identity/v3/users/0959f9c0fb814808b1af17739027f0d5 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:23.009511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2ec5f-558c-4e50-b85b-a0c40cf50723 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:23.009868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2ec5f-558c-4e50-b85b-a0c40cf50723 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:23.010233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2ec5f-558c-4e50-b85b-a0c40cf50723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:23.055314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-33f2ec5f-558c-4e50-b85b-a0c40cf50723 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:23.058645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-33f2ec5f-558c-4e50-b85b-a0c40cf50723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:23.154928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b93e93-7818-4de1-9a48-843e5f3d6bc5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:23.238823 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3544/7117] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:23.251671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2ec5f-558c-4e50-b85b-a0c40cf50723 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:23.252915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-33f2ec5f-558c-4e50-b85b-a0c40cf50723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:23.288771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ea1eb-3ce2-44fd-80b4-beb5c41d13a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:23.289403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea1eb-3ce2-44fd-80b4-beb5c41d13a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:23.290915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea1eb-3ce2-44fd-80b4-beb5c41d13a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:23.291205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea1eb-3ce2-44fd-80b4-beb5c41d13a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:23.291969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ea1eb-3ce2-44fd-80b4-beb5c41d13a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:23.295305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ea1eb-3ce2-44fd-80b4-beb5c41d13a0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:23.317601 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:23.347720 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3574/7118] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:22 2022] POST /identity/v3/users => generated 288 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:23.351128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ea1eb-3ce2-44fd-80b4-beb5c41d13a0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:23.374263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ea1eb-3ce2-44fd-80b4-beb5c41d13a0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:23.379456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2ec5f-558c-4e50-b85b-a0c40cf50723 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:23.386506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228137fc-3b40-4487-b7af-4f2700b0dc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:23.390306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d003cd9-1d32-4b20-97b5-b723fa679b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:23.390306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d003cd9-1d32-4b20-97b5-b723fa679b7d service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:23.390306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d003cd9-1d32-4b20-97b5-b723fa679b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:23.390306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d003cd9-1d32-4b20-97b5-b723fa679b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:23.391315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228137fc-3b40-4487-b7af-4f2700b0dc13 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:23.391619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228137fc-3b40-4487-b7af-4f2700b0dc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:23.391875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228137fc-3b40-4487-b7af-4f2700b0dc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:23.392539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228137fc-3b40-4487-b7af-4f2700b0dc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:23.399983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228137fc-3b40-4487-b7af-4f2700b0dc13 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:23.415583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d003cd9-1d32-4b20-97b5-b723fa679b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:23.417057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d003cd9-1d32-4b20-97b5-b723fa679b7d service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:23.421503 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3575/7119] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:23.423163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228137fc-3b40-4487-b7af-4f2700b0dc13 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:23.436325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228137fc-3b40-4487-b7af-4f2700b0dc13 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:23.452218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63bd36-1fce-4359-af84-f254f3c415ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:23.455446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63bd36-1fce-4359-af84-f254f3c415ca admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:23.455446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63bd36-1fce-4359-af84-f254f3c415ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:23.455446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63bd36-1fce-4359-af84-f254f3c415ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:23.455446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63bd36-1fce-4359-af84-f254f3c415ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:23.456179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63bd36-1fce-4359-af84-f254f3c415ca admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:23.456308 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3545/7120] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:23.506179 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3576/7121] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:32:23.510392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d003cd9-1d32-4b20-97b5-b723fa679b7d service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:23.527406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d003cd9-1d32-4b20-97b5-b723fa679b7d service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:23.532673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c730c0-631b-4cc9-84b3-c13e6f74ce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:23.533373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c730c0-631b-4cc9-84b3-c13e6f74ce70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:23.533733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c730c0-631b-4cc9-84b3-c13e6f74ce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:23.534114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c730c0-631b-4cc9-84b3-c13e6f74ce70 admin admin] PATH_INFO: `/v3/projects/9b1361383fec4262a1ff96e56c02a3af/users/d6d7040d82644525b7f82dc9aa35ad22/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:23.550987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c730c0-631b-4cc9-84b3-c13e6f74ce70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1361383fec4262a1ff96e56c02a3af, user_id=d6d7040d82644525b7f82dc9aa35ad22, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:23.554125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c730c0-631b-4cc9-84b3-c13e6f74ce70 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:23.576078 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3546/7122] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:23 2022] PUT /identity/v3/projects/9b1361383fec4262a1ff96e56c02a3af/users/d6d7040d82644525b7f82dc9aa35ad22/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:23.588093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d0fee-865a-4921-95df-98ef2c92f418 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:23.588505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d0fee-865a-4921-95df-98ef2c92f418 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:23.588894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d0fee-865a-4921-95df-98ef2c92f418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:23.621068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c730c0-631b-4cc9-84b3-c13e6f74ce70 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:23.622857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-77c730c0-631b-4cc9-84b3-c13e6f74ce70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:23.664500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0b2d0fee-865a-4921-95df-98ef2c92f418 None None] MFA Rules not processed for user `d6d7040d82644525b7f82dc9aa35ad22`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:23.665955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0b2d0fee-865a-4921-95df-98ef2c92f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:23.732682 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:23.747797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c730c0-631b-4cc9-84b3-c13e6f74ce70 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:23.785385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:23.786201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:23.786481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:23.786861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] PATH_INFO: `/v3/projects/badeee9374824418a7d264b637d4108f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:23.788637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=badeee9374824418a7d264b637d4108f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:23.791265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:23.863239 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3577/7123] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:23.865026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d0fee-865a-4921-95df-98ef2c92f418 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:23.891664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d0fee-865a-4921-95df-98ef2c92f418 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:23.920188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badeee9374824418a7d264b637d4108f', 'request_id': 'req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:23.932605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badeee9374824418a7d264b637d4108f', 'request_id': 'req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:23.957628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badeee9374824418a7d264b637d4108f', 'request_id': 'req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:23.998787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] The token cache is being invalidate because project badeee9374824418a7d264b637d4108f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:23.999250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.001161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.006093 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3547/7124] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:23 2022] DELETE /identity/v3/projects/badeee9374824418a7d264b637d4108f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:24.010849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:24.019899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:24.090645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574430f-e2ab-47ad-88ac-09be28c15fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:24.095436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574430f-e2ab-47ad-88ac-09be28c15fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:24.097438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574430f-e2ab-47ad-88ac-09be28c15fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:24.097799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574430f-e2ab-47ad-88ac-09be28c15fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:24.098589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574430f-e2ab-47ad-88ac-09be28c15fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:24.113197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574430f-e2ab-47ad-88ac-09be28c15fe1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:24.148218 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:24.202767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fb8fc-e44f-48b1-a2ca-016fa0b5eca1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:24.209813 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3578/7125] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:23 2022] POST /identity/v3/projects => generated 375 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:32:24.214103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574430f-e2ab-47ad-88ac-09be28c15fe1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:24.216593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8574430f-e2ab-47ad-88ac-09be28c15fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:24.218459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:24.219121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:24.219399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:24.219674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] PATH_INFO: `/v3/users/987e9f2e9aa8468dafd48956704394df` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:24.225201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] RBAC: Authorizing `identity:delete_user(user_id=987e9f2e9aa8468dafd48956704394df)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:24.233500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:24.349172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987e9f2e9aa8468dafd48956704394df'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.387345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987e9f2e9aa8468dafd48956704394df'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.388216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987e9f2e9aa8468dafd48956704394df'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.413174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987e9f2e9aa8468dafd48956704394df'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.423410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987e9f2e9aa8468dafd48956704394df'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.435600 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3548/7126] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:24 2022] DELETE /identity/v3/users/987e9f2e9aa8468dafd48956704394df => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:24.445019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574430f-e2ab-47ad-88ac-09be28c15fe1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:24.533644 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:24.550633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82139980-bdd1-48f7-9c5b-eb59e6f7cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:24.551565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82139980-bdd1-48f7-9c5b-eb59e6f7cc18 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:24.551960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82139980-bdd1-48f7-9c5b-eb59e6f7cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:24.552308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82139980-bdd1-48f7-9c5b-eb59e6f7cc18 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:24.553162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82139980-bdd1-48f7-9c5b-eb59e6f7cc18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:24.555494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82139980-bdd1-48f7-9c5b-eb59e6f7cc18 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:24.575586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:24.577865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:24.614576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31f3df-dbea-494b-88f5-1d663df4d95a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:24.616396 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3579/7127] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:24 2022] POST /identity/v3/users => generated 294 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:24.621057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82139980-bdd1-48f7-9c5b-eb59e6f7cc18 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:24.624061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-82139980-bdd1-48f7-9c5b-eb59e6f7cc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:24.630963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:24.631771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:24.632109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:24.632487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] PATH_INFO: `/v3/projects/6cd4a6e6fb02488f8ad1c40228011ccf` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:24.636784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd4a6e6fb02488f8ad1c40228011ccf)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:24.638955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:24.650129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82139980-bdd1-48f7-9c5b-eb59e6f7cc18 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:24.656973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d585d-e5b7-4ba0-beb7-e1a8455ca768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:24.658150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d585d-e5b7-4ba0-beb7-e1a8455ca768 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:24.658823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d585d-e5b7-4ba0-beb7-e1a8455ca768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:24.659343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d585d-e5b7-4ba0-beb7-e1a8455ca768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:24.660247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d585d-e5b7-4ba0-beb7-e1a8455ca768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:24.662220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d585d-e5b7-4ba0-beb7-e1a8455ca768 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:24.678379 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3580/7128] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:24.683188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d585d-e5b7-4ba0-beb7-e1a8455ca768 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:24.696906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d585d-e5b7-4ba0-beb7-e1a8455ca768 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:24.716023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd4a6e6fb02488f8ad1c40228011ccf', 'request_id': 'req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.728671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd4a6e6fb02488f8ad1c40228011ccf', 'request_id': 'req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.744320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd4a6e6fb02488f8ad1c40228011ccf', 'request_id': 'req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.771946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] The token cache is being invalidate because project 6cd4a6e6fb02488f8ad1c40228011ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:24.772340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.773646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.776468 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3549/7129] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:24 2022] DELETE /identity/v3/projects/6cd4a6e6fb02488f8ad1c40228011ccf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:24.782177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:24.786686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:24.789476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71694e-ba3e-48d0-a2b2-e69df9f9ba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:24.791155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71694e-ba3e-48d0-a2b2-e69df9f9ba5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:24.791781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71694e-ba3e-48d0-a2b2-e69df9f9ba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:24.792287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71694e-ba3e-48d0-a2b2-e69df9f9ba5d admin admin] PATH_INFO: `/v3/projects/53076b2939c64d1ab6b175ff62e59d38/users/a2376ebb47b745b4878cddf0a133fec4/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:24.804388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca740f8f-f607-45a7-a7c8-e5ed514e8eb1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:24.812917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71694e-ba3e-48d0-a2b2-e69df9f9ba5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=53076b2939c64d1ab6b175ff62e59d38, user_id=a2376ebb47b745b4878cddf0a133fec4, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:24.817370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71694e-ba3e-48d0-a2b2-e69df9f9ba5d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:24.818935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:24.819594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:24.819885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:24.820154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] PATH_INFO: `/v3/users/cfacff22441f4b64ae3bdaecba9f12e5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:24.822355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfacff22441f4b64ae3bdaecba9f12e5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:24.826299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:24.848246 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3581/7130] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:24 2022] PUT /identity/v3/projects/53076b2939c64d1ab6b175ff62e59d38/users/a2376ebb47b745b4878cddf0a133fec4/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:24.854718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71694e-ba3e-48d0-a2b2-e69df9f9ba5d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:24.857346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ef71694e-ba3e-48d0-a2b2-e69df9f9ba5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:24.892025 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=76,keystone:DELETE=22,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:24.923682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfacff22441f4b64ae3bdaecba9f12e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.952523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfacff22441f4b64ae3bdaecba9f12e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.954947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfacff22441f4b64ae3bdaecba9f12e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.980852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfacff22441f4b64ae3bdaecba9f12e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:24.991217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfacff22441f4b64ae3bdaecba9f12e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:25.002864 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3550/7131] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:24 2022] DELETE /identity/v3/users/cfacff22441f4b64ae3bdaecba9f12e5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:25.014124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71694e-ba3e-48d0-a2b2-e69df9f9ba5d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:25.110292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c8025-848d-4251-8640-4c9ba7ee95f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:25.113935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8025-848d-4251-8640-4c9ba7ee95f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:25.116452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8025-848d-4251-8640-4c9ba7ee95f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:25.116738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8025-848d-4251-8640-4c9ba7ee95f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:25.118308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c8025-848d-4251-8640-4c9ba7ee95f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:25.126219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c8025-848d-4251-8640-4c9ba7ee95f3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:25.154240 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3582/7132] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:25.158515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:25.162487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:25.179841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0250a-e4e0-452b-9941-0977b4198c78 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:25.186089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c11462-3840-42e0-ab31-0fe2c2172366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:25.188032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c11462-3840-42e0-ab31-0fe2c2172366 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:25.188278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c11462-3840-42e0-ab31-0fe2c2172366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:25.188519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c11462-3840-42e0-ab31-0fe2c2172366 admin admin] PATH_INFO: `/v3/projects/53076b2939c64d1ab6b175ff62e59d38/users/a2376ebb47b745b4878cddf0a133fec4/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:25.191090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c11462-3840-42e0-ab31-0fe2c2172366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53076b2939c64d1ab6b175ff62e59d38, user_id=a2376ebb47b745b4878cddf0a133fec4, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:25.195421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c11462-3840-42e0-ab31-0fe2c2172366 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:25.218942 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3551/7133] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:25 2022] PUT /identity/v3/projects/53076b2939c64d1ab6b175ff62e59d38/users/a2376ebb47b745b4878cddf0a133fec4/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:25.232252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddcdcf-9cfb-4a88-8b7e-b5268a9ce628 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:25.233227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddcdcf-9cfb-4a88-8b7e-b5268a9ce628 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:25.233503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddcdcf-9cfb-4a88-8b7e-b5268a9ce628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:25.251933 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:25.304323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7bddcdcf-9cfb-4a88-8b7e-b5268a9ce628 None None] MFA Rules not processed for user `a2376ebb47b745b4878cddf0a133fec4`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:25.310846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7bddcdcf-9cfb-4a88-8b7e-b5268a9ce628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:25.419747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c11462-3840-42e0-ab31-0fe2c2172366 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:25.422081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-49c11462-3840-42e0-ab31-0fe2c2172366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:25.480338 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3583/7134] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:32:25.502679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddcdcf-9cfb-4a88-8b7e-b5268a9ce628 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:25.503907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7bddcdcf-9cfb-4a88-8b7e-b5268a9ce628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:25.627064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c11462-3840-42e0-ab31-0fe2c2172366 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:25.636498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:25.637462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:25.637915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:25.639937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] PATH_INFO: `/v3/projects/d144d1777f804c3a89120656dde2c44a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:25.641695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d144d1777f804c3a89120656dde2c44a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:25.644587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:25.698590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddcdcf-9cfb-4a88-8b7e-b5268a9ce628 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:25.705615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c40df0-7413-4ea2-8e2b-49f0808b03cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:25.706955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40df0-7413-4ea2-8e2b-49f0808b03cd service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:25.707221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40df0-7413-4ea2-8e2b-49f0808b03cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:25.707694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40df0-7413-4ea2-8e2b-49f0808b03cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:25.714445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c1c40df0-7413-4ea2-8e2b-49f0808b03cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:25.753276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd144d1777f804c3a89120656dde2c44a', 'request_id': 'req-be28e1c5-efa7-483a-8563-d57c1bb739d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:25.764864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd144d1777f804c3a89120656dde2c44a', 'request_id': 'req-be28e1c5-efa7-483a-8563-d57c1bb739d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:25.777569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd144d1777f804c3a89120656dde2c44a', 'request_id': 'req-be28e1c5-efa7-483a-8563-d57c1bb739d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:25.804551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] The token cache is being invalidate because project d144d1777f804c3a89120656dde2c44a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:25.804849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:25.807933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be28e1c5-efa7-483a-8563-d57c1bb739d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:25.810565 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3552/7135] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:25 2022] DELETE /identity/v3/projects/d144d1777f804c3a89120656dde2c44a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:25.818131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d57d84-f348-40f3-83a0-2b8807360f9a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:25.818411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d57d84-f348-40f3-83a0-2b8807360f9a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:25.818767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d57d84-f348-40f3-83a0-2b8807360f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:25.864153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c40df0-7413-4ea2-8e2b-49f0808b03cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:25.865622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c40df0-7413-4ea2-8e2b-49f0808b03cd service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:25.869469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e2d57d84-f348-40f3-83a0-2b8807360f9a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:25.870726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e2d57d84-f348-40f3-83a0-2b8807360f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:25.886700 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3584/7136] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:25.931143 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:26.007586 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3553/7137] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:32:26.018381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3e075-7fc3-4457-9248-eccd26a6b61c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:26.019011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3e075-7fc3-4457-9248-eccd26a6b61c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:26.020176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3e075-7fc3-4457-9248-eccd26a6b61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:26.064580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5bd3e075-7fc3-4457-9248-eccd26a6b61c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:26.067431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5bd3e075-7fc3-4457-9248-eccd26a6b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:26.103869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d57d84-f348-40f3-83a0-2b8807360f9a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:26.104130 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3585/7138] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:26.119472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d57d84-f348-40f3-83a0-2b8807360f9a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:26.137328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36142c7e-1365-48b9-8db4-70692a03e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:26.140661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36142c7e-1365-48b9-8db4-70692a03e076 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:26.141850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36142c7e-1365-48b9-8db4-70692a03e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:26.143242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36142c7e-1365-48b9-8db4-70692a03e076 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:26.144817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36142c7e-1365-48b9-8db4-70692a03e076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:26.147534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36142c7e-1365-48b9-8db4-70692a03e076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:26.155109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36142c7e-1365-48b9-8db4-70692a03e076 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:26.195850 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3554/7139] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:26.201539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3e075-7fc3-4457-9248-eccd26a6b61c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:26.217905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3e075-7fc3-4457-9248-eccd26a6b61c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:26.230798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534ac14-df4a-4a97-88d1-684f35126937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:26.231598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534ac14-df4a-4a97-88d1-684f35126937 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:26.234210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534ac14-df4a-4a97-88d1-684f35126937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:26.236359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534ac14-df4a-4a97-88d1-684f35126937 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:26.236359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534ac14-df4a-4a97-88d1-684f35126937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:26.238570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534ac14-df4a-4a97-88d1-684f35126937 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:26.305904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36142c7e-1365-48b9-8db4-70692a03e076 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:26.306384 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3586/7140] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:26 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:26.320547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36142c7e-1365-48b9-8db4-70692a03e076 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:26.338748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534ac14-df4a-4a97-88d1-684f35126937 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:26.344813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7534ac14-df4a-4a97-88d1-684f35126937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:26.366556 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:26.482101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534ac14-df4a-4a97-88d1-684f35126937 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:26.491478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53eb5c-8b32-4035-94de-e138286a1aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:26.493729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53eb5c-8b32-4035-94de-e138286a1aab service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:26.494116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53eb5c-8b32-4035-94de-e138286a1aab service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:26.494503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53eb5c-8b32-4035-94de-e138286a1aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:26.496591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ee53eb5c-8b32-4035-94de-e138286a1aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:26.536923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53eb5c-8b32-4035-94de-e138286a1aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:26.537132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fdc5e-75d0-4bf6-b706-ed024362464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:26.537589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53eb5c-8b32-4035-94de-e138286a1aab service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:26.537693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fdc5e-75d0-4bf6-b706-ed024362464a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:26.537693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fdc5e-75d0-4bf6-b706-ed024362464a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:26.537693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fdc5e-75d0-4bf6-b706-ed024362464a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:26.538871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fdc5e-75d0-4bf6-b706-ed024362464a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:26.541556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fdc5e-75d0-4bf6-b706-ed024362464a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:26.566348 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3587/7141] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:26.568350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53eb5c-8b32-4035-94de-e138286a1aab service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:26.573137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ee53eb5c-8b32-4035-94de-e138286a1aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:26.590876 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3555/7142] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:26 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:32:26.591646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fdc5e-75d0-4bf6-b706-ed024362464a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:26.599688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d0fdc5e-75d0-4bf6-b706-ed024362464a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:26.612254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53eb5c-8b32-4035-94de-e138286a1aab service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:26.626821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:26.627316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fdc5e-75d0-4bf6-b706-ed024362464a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:26.627549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:26.627849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:26.628104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] PATH_INFO: `/v3/users/bd6e51135cc046098baa8a338de87a93` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:26.633290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd6e51135cc046098baa8a338de87a93)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:26.640682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:26.658506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:26.659195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:26.659480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:26.659756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] PATH_INFO: `/v3/projects/89e244257a4541d384974ac2542d912c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:26.661355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e244257a4541d384974ac2542d912c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:26.663425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:26.765631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e244257a4541d384974ac2542d912c', 'request_id': 'req-03c54731-5a58-4e84-a86b-799ec9c197bc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:26.775171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e244257a4541d384974ac2542d912c', 'request_id': 'req-03c54731-5a58-4e84-a86b-799ec9c197bc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:26.785120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e244257a4541d384974ac2542d912c', 'request_id': 'req-03c54731-5a58-4e84-a86b-799ec9c197bc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:26.788040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd6e51135cc046098baa8a338de87a93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:26.813961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd6e51135cc046098baa8a338de87a93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:26.815880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd6e51135cc046098baa8a338de87a93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:26.821706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] The token cache is being invalidate because project 89e244257a4541d384974ac2542d912c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:26.824403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:26.825732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:26.831014 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3556/7143] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:26 2022] DELETE /identity/v3/projects/89e244257a4541d384974ac2542d912c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:26.831946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:26.838243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:26.839682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd6e51135cc046098baa8a338de87a93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:26.840524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd6e51135cc046098baa8a338de87a93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:26.864699 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3588/7144] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:26 2022] DELETE /identity/v3/users/bd6e51135cc046098baa8a338de87a93 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:26.866065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:26.870544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:26.917190 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:27.005666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c54731-5a58-4e84-a86b-799ec9c197bc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:27.080019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0a1af-525f-42bb-95f3-b8430114db88 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:27.093487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:27.094151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:27.094429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:27.094726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] PATH_INFO: `/v3/users/1a887ff81b134728946bb0104ab1931b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:27.098254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a887ff81b134728946bb0104ab1931b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:27.101701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:27.120116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188140b-59dc-428e-9762-2ee99e69cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:27.121107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188140b-59dc-428e-9762-2ee99e69cc28 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:27.121549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188140b-59dc-428e-9762-2ee99e69cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:27.122049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188140b-59dc-428e-9762-2ee99e69cc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:27.123239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188140b-59dc-428e-9762-2ee99e69cc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:27.125455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188140b-59dc-428e-9762-2ee99e69cc28 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:27.138582 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3557/7145] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:27.140422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95d056-dc6e-4523-a376-7e452b7c475a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:27.140910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95d056-dc6e-4523-a376-7e452b7c475a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:27.142017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95d056-dc6e-4523-a376-7e452b7c475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:27.149802 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:27.173047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dd95d056-dc6e-4523-a376-7e452b7c475a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:27.174962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dd95d056-dc6e-4523-a376-7e452b7c475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:27.186940 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3558/7146] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:27.186940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95d056-dc6e-4523-a376-7e452b7c475a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:27.216943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95d056-dc6e-4523-a376-7e452b7c475a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:27.231281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f27fa-1482-4d93-818e-fab9ab268d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:27.234937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f27fa-1482-4d93-818e-fab9ab268d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:27.235273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f27fa-1482-4d93-818e-fab9ab268d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:27.235554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f27fa-1482-4d93-818e-fab9ab268d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:27.236239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f27fa-1482-4d93-818e-fab9ab268d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:27.244759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f27fa-1482-4d93-818e-fab9ab268d56 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:27.268716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a887ff81b134728946bb0104ab1931b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:27.279066 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3559/7147] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:27.279979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f27fa-1482-4d93-818e-fab9ab268d56 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:27.286548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-052f27fa-1482-4d93-818e-fab9ab268d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:27.324584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a887ff81b134728946bb0104ab1931b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:27.325944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a887ff81b134728946bb0104ab1931b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:27.353521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a887ff81b134728946bb0104ab1931b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:27.361055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a887ff81b134728946bb0104ab1931b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:27.421360 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3589/7148] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:26 2022] DELETE /identity/v3/users/1a887ff81b134728946bb0104ab1931b => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:27.423637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:27.445461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:27.447280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f27fa-1482-4d93-818e-fab9ab268d56 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:27.556305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756baf8-de41-4ec7-acb4-c3df87818277 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:27.566106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249c6f-947c-4b4d-ae86-329a4f76c8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:27.568862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249c6f-947c-4b4d-ae86-329a4f76c8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:27.569197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249c6f-947c-4b4d-ae86-329a4f76c8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:27.569478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249c6f-947c-4b4d-ae86-329a4f76c8c6 admin admin] PATH_INFO: `/v3/projects/0be20d63e33b46d98e1e863616465b4e/users/e87f219e3ac74ea8bda354a050e26ad0/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:27.596015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243184b-0403-4215-bcdf-4fc6d9d45cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:27.596774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243184b-0403-4215-bcdf-4fc6d9d45cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:27.597189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243184b-0403-4215-bcdf-4fc6d9d45cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:27.597491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243184b-0403-4215-bcdf-4fc6d9d45cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:27.600736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5243184b-0403-4215-bcdf-4fc6d9d45cf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:27.621614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243184b-0403-4215-bcdf-4fc6d9d45cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:27.623717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243184b-0403-4215-bcdf-4fc6d9d45cf3 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:27.626502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6249c6f-947c-4b4d-ae86-329a4f76c8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be20d63e33b46d98e1e863616465b4e, user_id=e87f219e3ac74ea8bda354a050e26ad0, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:27.629317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6249c6f-947c-4b4d-ae86-329a4f76c8c6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:27.639033 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3560/7149] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:27.685166 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3590/7150] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:27 2022] PUT /identity/v3/projects/0be20d63e33b46d98e1e863616465b4e/users/e87f219e3ac74ea8bda354a050e26ad0/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:27.689860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f74ca8-7428-4a6f-af48-8aa884f230c2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:27.690367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f74ca8-7428-4a6f-af48-8aa884f230c2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:27.690949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f74ca8-7428-4a6f-af48-8aa884f230c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:27.765948 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:27.769669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c8f74ca8-7428-4a6f-af48-8aa884f230c2 None None] MFA Rules not processed for user `e87f219e3ac74ea8bda354a050e26ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:27.771742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8f74ca8-7428-4a6f-af48-8aa884f230c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:27.958992 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3561/7151] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:27.972558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249c6f-947c-4b4d-ae86-329a4f76c8c6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:28.143867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249c6f-947c-4b4d-ae86-329a4f76c8c6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:28.180151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0c437-e89a-4b23-a206-8e21ccefbce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:28.183218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c437-e89a-4b23-a206-8e21ccefbce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:28.185736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c437-e89a-4b23-a206-8e21ccefbce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:28.186147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c437-e89a-4b23-a206-8e21ccefbce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:28.187037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0c437-e89a-4b23-a206-8e21ccefbce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:28.189385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0c437-e89a-4b23-a206-8e21ccefbce7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:28.265917 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:28.286115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f74ca8-7428-4a6f-af48-8aa884f230c2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:28.286243 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3591/7152] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:27 2022] POST /identity/v3/projects => generated 375 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:28.308176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f74ca8-7428-4a6f-af48-8aa884f230c2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:28.442487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113c8b7-3a84-495e-a6b4-e274f9c54ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:28.442487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113c8b7-3a84-495e-a6b4-e274f9c54ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:28.442487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113c8b7-3a84-495e-a6b4-e274f9c54ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:28.442487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113c8b7-3a84-495e-a6b4-e274f9c54ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:28.443055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113c8b7-3a84-495e-a6b4-e274f9c54ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:28.452352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113c8b7-3a84-495e-a6b4-e274f9c54ca2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:28.503781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0c437-e89a-4b23-a206-8e21ccefbce7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:28.505674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e5a0c437-e89a-4b23-a206-8e21ccefbce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:28.517721 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3562/7153] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:28 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:28.520536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113c8b7-3a84-495e-a6b4-e274f9c54ca2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:28.523583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0113c8b7-3a84-495e-a6b4-e274f9c54ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:28.542026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113c8b7-3a84-495e-a6b4-e274f9c54ca2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:28.543517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0c437-e89a-4b23-a206-8e21ccefbce7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:28.557886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:28.558630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:28.559313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:28.559313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] PATH_INFO: `/v3/projects/6893e417a55c4788826feb91b17dbec0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:28.564410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6893e417a55c4788826feb91b17dbec0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:28.565729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:28.583094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:28.584268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:28.585071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:28.588712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] PATH_INFO: `/v3/projects/3cd569e5e9a44d7fb9de9664a7d307b9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:28.595321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd569e5e9a44d7fb9de9664a7d307b9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:28.603226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:28.697183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6893e417a55c4788826feb91b17dbec0', 'request_id': 'req-03971477-c711-43c9-a44c-77e32fdb8619'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:28.710926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd569e5e9a44d7fb9de9664a7d307b9', 'request_id': 'req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:28.715405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6893e417a55c4788826feb91b17dbec0', 'request_id': 'req-03971477-c711-43c9-a44c-77e32fdb8619'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:28.722321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd569e5e9a44d7fb9de9664a7d307b9', 'request_id': 'req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:28.733833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6893e417a55c4788826feb91b17dbec0', 'request_id': 'req-03971477-c711-43c9-a44c-77e32fdb8619'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:28.735445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd569e5e9a44d7fb9de9664a7d307b9', 'request_id': 'req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:28.773808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] The token cache is being invalidate because project 6893e417a55c4788826feb91b17dbec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:28.775252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:28.777409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] The token cache is being invalidate because project 3cd569e5e9a44d7fb9de9664a7d307b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:28.778349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:28.778723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:28.779586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:28.782901 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3563/7154] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:28 2022] DELETE /identity/v3/projects/3cd569e5e9a44d7fb9de9664a7d307b9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:28.783468 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3592/7155] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:28 2022] DELETE /identity/v3/projects/6893e417a55c4788826feb91b17dbec0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:28.790404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:28.792618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:28.794305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:28.799066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:28.826562 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:28.983702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03971477-c711-43c9-a44c-77e32fdb8619 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:28.995457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbac16d-fdf0-4006-9ebd-bd71afecabfa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:29.001323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:29.002682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:29.002945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:29.003215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] PATH_INFO: `/v3/users/46dd31be3fa54a488a85c25c29086b26` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:29.014234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46dd31be3fa54a488a85c25c29086b26)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:29.014234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:29.014772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ee03c-affd-42ad-9523-529a3b03ab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:29.014909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ee03c-affd-42ad-9523-529a3b03ab09 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:29.015163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ee03c-affd-42ad-9523-529a3b03ab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:29.016137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ee03c-affd-42ad-9523-529a3b03ab09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:29.017872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ee03c-affd-42ad-9523-529a3b03ab09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:29.023569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ee03c-affd-42ad-9523-529a3b03ab09 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:29.050948 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3564/7156] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:29.052367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83e145-4afb-45ee-8c74-fea9870aa7b3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:29.052754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83e145-4afb-45ee-8c74-fea9870aa7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:29.053107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83e145-4afb-45ee-8c74-fea9870aa7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:29.078590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fe83e145-4afb-45ee-8c74-fea9870aa7b3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:29.080262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fe83e145-4afb-45ee-8c74-fea9870aa7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:29.092214 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3565/7157] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:29.094312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83e145-4afb-45ee-8c74-fea9870aa7b3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:29.115223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83e145-4afb-45ee-8c74-fea9870aa7b3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:29.138948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab5763-1a4f-4bc6-b241-c63f53143a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:29.139647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab5763-1a4f-4bc6-b241-c63f53143a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:29.139933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab5763-1a4f-4bc6-b241-c63f53143a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:29.140206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab5763-1a4f-4bc6-b241-c63f53143a17 admin admin] PATH_INFO: `/v3/projects/01625a5ed95f4476b73bfc6cebc16c75/users/de3fb271d4c34d9e9b7dbcc30ed12462/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:29.188457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab5763-1a4f-4bc6-b241-c63f53143a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01625a5ed95f4476b73bfc6cebc16c75, user_id=de3fb271d4c34d9e9b7dbcc30ed12462, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:29.191384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab5763-1a4f-4bc6-b241-c63f53143a17 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:29.200734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46dd31be3fa54a488a85c25c29086b26'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:29.221454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46dd31be3fa54a488a85c25c29086b26'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:29.223091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46dd31be3fa54a488a85c25c29086b26'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:29.237029 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3566/7158] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:29 2022] PUT /identity/v3/projects/01625a5ed95f4476b73bfc6cebc16c75/users/de3fb271d4c34d9e9b7dbcc30ed12462/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:29.239101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46dd31be3fa54a488a85c25c29086b26'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:29.239785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9859f-fbb4-4b7e-aa3b-369067a9960c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:29.239926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46dd31be3fa54a488a85c25c29086b26'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:29.240617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9859f-fbb4-4b7e-aa3b-369067a9960c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:29.241530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9859f-fbb4-4b7e-aa3b-369067a9960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:29.262185 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:29.271455 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3593/7159] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:28 2022] DELETE /identity/v3/users/46dd31be3fa54a488a85c25c29086b26 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:29.271990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f4c9859f-fbb4-4b7e-aa3b-369067a9960c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:29.273521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:29.278436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f4c9859f-fbb4-4b7e-aa3b-369067a9960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:29.278824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:29.446966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5330303-8911-4e4d-90e6-4dc01e2618a0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:29.464834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87d4b4-24bd-4305-a970-b3e92b87e441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:29.465528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87d4b4-24bd-4305-a970-b3e92b87e441 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:29.465976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87d4b4-24bd-4305-a970-b3e92b87e441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:29.466309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87d4b4-24bd-4305-a970-b3e92b87e441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:29.467575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87d4b4-24bd-4305-a970-b3e92b87e441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:29.469567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87d4b4-24bd-4305-a970-b3e92b87e441 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:29.474654 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3567/7160] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:29.479686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9859f-fbb4-4b7e-aa3b-369067a9960c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:29.494632 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3594/7161] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:29.494806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9859f-fbb4-4b7e-aa3b-369067a9960c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:29.497527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87d4b4-24bd-4305-a970-b3e92b87e441 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:29.501191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3f2d6-8f0e-4904-9066-24c45b417b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:29.513551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3f2d6-8f0e-4904-9066-24c45b417b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:29.515049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3f2d6-8f0e-4904-9066-24c45b417b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:29.515777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3f2d6-8f0e-4904-9066-24c45b417b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:29.516996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3f2d6-8f0e-4904-9066-24c45b417b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:29.517688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3f2d6-8f0e-4904-9066-24c45b417b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:29.520028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3f2d6-8f0e-4904-9066-24c45b417b7c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:29.521172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87d4b4-24bd-4305-a970-b3e92b87e441 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:29.536533 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3568/7162] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:29.543004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e834a2-bed2-4784-8f04-802267dc1def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:29.543975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e834a2-bed2-4784-8f04-802267dc1def admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:29.544437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e834a2-bed2-4784-8f04-802267dc1def admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:29.544723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e834a2-bed2-4784-8f04-802267dc1def admin admin] PATH_INFO: `/v3/projects/01625a5ed95f4476b73bfc6cebc16c75/users/de3fb271d4c34d9e9b7dbcc30ed12462/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:29.548495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3f2d6-8f0e-4904-9066-24c45b417b7c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:29.549065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e834a2-bed2-4784-8f04-802267dc1def admin admin] RBAC: Authorizing `identity:create_grant(project_id=01625a5ed95f4476b73bfc6cebc16c75, user_id=de3fb271d4c34d9e9b7dbcc30ed12462, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:29.560603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e834a2-bed2-4784-8f04-802267dc1def admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:29.589722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3f2d6-8f0e-4904-9066-24c45b417b7c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:29.600825 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3595/7163] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:29 2022] PUT /identity/v3/projects/01625a5ed95f4476b73bfc6cebc16c75/users/de3fb271d4c34d9e9b7dbcc30ed12462/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:29.602418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d83269-cd36-47c2-a4ec-17155a5b4317 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:29.602789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d83269-cd36-47c2-a4ec-17155a5b4317 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:29.603138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d83269-cd36-47c2-a4ec-17155a5b4317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:29.695095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-84d83269-cd36-47c2-a4ec-17155a5b4317 None None] MFA Rules not processed for user `de3fb271d4c34d9e9b7dbcc30ed12462`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:29.696756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-84d83269-cd36-47c2-a4ec-17155a5b4317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:29.699703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ff240-29e0-437e-b62c-cd234522bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:29.700335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff240-29e0-437e-b62c-cd234522bf78 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:29.700620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff240-29e0-437e-b62c-cd234522bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:29.700895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff240-29e0-437e-b62c-cd234522bf78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:29.701540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ff240-29e0-437e-b62c-cd234522bf78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:29.703933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ff240-29e0-437e-b62c-cd234522bf78 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:29.724864 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:29.746710 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3569/7164] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:29 2022] POST /identity/v3/projects => generated 405 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:29.750450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ff240-29e0-437e-b62c-cd234522bf78 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:29.877881 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3596/7165] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:29.890590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d83269-cd36-47c2-a4ec-17155a5b4317 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:29.892245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-84d83269-cd36-47c2-a4ec-17155a5b4317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:29.953294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ff240-29e0-437e-b62c-cd234522bf78 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:29.988567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b66214-cdf4-4e72-9352-309ef94e683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:29.993428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b66214-cdf4-4e72-9352-309ef94e683c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:29.993854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b66214-cdf4-4e72-9352-309ef94e683c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:29.994578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b66214-cdf4-4e72-9352-309ef94e683c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:30.003526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b66214-cdf4-4e72-9352-309ef94e683c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:30.010048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b66214-cdf4-4e72-9352-309ef94e683c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:30.082305 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3570/7166] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:29 2022] POST /identity/v3/users => generated 303 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:30.085700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b66214-cdf4-4e72-9352-309ef94e683c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:30.109828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b66214-cdf4-4e72-9352-309ef94e683c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:30.112979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d83269-cd36-47c2-a4ec-17155a5b4317 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:30.124993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ca914-c9ad-4e6c-b312-8c22aad6cf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:30.125703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ca914-c9ad-4e6c-b312-8c22aad6cf10 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:30.126461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ca914-c9ad-4e6c-b312-8c22aad6cf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:30.128115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ca914-c9ad-4e6c-b312-8c22aad6cf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:30.128883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ca914-c9ad-4e6c-b312-8c22aad6cf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:30.130894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ca914-c9ad-4e6c-b312-8c22aad6cf10 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:30.155345 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3571/7167] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:30.158210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ca914-c9ad-4e6c-b312-8c22aad6cf10 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:30.161837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e34ca914-c9ad-4e6c-b312-8c22aad6cf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:30.178083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ca914-c9ad-4e6c-b312-8c22aad6cf10 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:30.183304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:30.184072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:30.184441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:30.184642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] PATH_INFO: `/v3/projects/59cbf4a592ec417a9df4131974824ec6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:30.186107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cbf4a592ec417a9df4131974824ec6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:30.188475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:30.193854 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:30.261065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342bb3c-fa9a-4c9d-ad94-b31f570c678b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:30.261722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342bb3c-fa9a-4c9d-ad94-b31f570c678b service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:30.262253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342bb3c-fa9a-4c9d-ad94-b31f570c678b service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:30.262531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342bb3c-fa9a-4c9d-ad94-b31f570c678b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:30.264475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b342bb3c-fa9a-4c9d-ad94-b31f570c678b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:30.319494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cbf4a592ec417a9df4131974824ec6', 'request_id': 'req-a0e6109b-c41a-454e-9767-07fb1f1f61c4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:30.331806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cbf4a592ec417a9df4131974824ec6', 'request_id': 'req-a0e6109b-c41a-454e-9767-07fb1f1f61c4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:30.348420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cbf4a592ec417a9df4131974824ec6', 'request_id': 'req-a0e6109b-c41a-454e-9767-07fb1f1f61c4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:30.371661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] The token cache is being invalidate because project 59cbf4a592ec417a9df4131974824ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:30.372486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:30.373400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:30.375586 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3572/7168] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:30 2022] DELETE /identity/v3/projects/59cbf4a592ec417a9df4131974824ec6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:30.377498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:30.379199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:30.384139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342bb3c-fa9a-4c9d-ad94-b31f570c678b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:30.386109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342bb3c-fa9a-4c9d-ad94-b31f570c678b service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:30.406284 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3597/7169] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:30.408842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293cb6c-29ea-4c62-a6fe-d7c8f33e75ce None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:30.409142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293cb6c-29ea-4c62-a6fe-d7c8f33e75ce None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:30.409421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293cb6c-29ea-4c62-a6fe-d7c8f33e75ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:30.445234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4293cb6c-29ea-4c62-a6fe-d7c8f33e75ce None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:30.446576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4293cb6c-29ea-4c62-a6fe-d7c8f33e75ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:30.522560 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3598/7170] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:30.531390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ffb4f-b6eb-4d15-8fde-7f96f0eaaf78 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:30.532015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ffb4f-b6eb-4d15-8fde-7f96f0eaaf78 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:30.532414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ffb4f-b6eb-4d15-8fde-7f96f0eaaf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:30.571662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6e9ffb4f-b6eb-4d15-8fde-7f96f0eaaf78 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:30.573209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6e9ffb4f-b6eb-4d15-8fde-7f96f0eaaf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:30.581990 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:30.584133 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3599/7171] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:32:30.588660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ffb4f-b6eb-4d15-8fde-7f96f0eaaf78 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:30.593765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6109b-c41a-454e-9767-07fb1f1f61c4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:30.606308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dc9f4-8052-479b-bb9a-0500cb6c2231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:30.607560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dc9f4-8052-479b-bb9a-0500cb6c2231 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:30.608254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dc9f4-8052-479b-bb9a-0500cb6c2231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:30.609108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dc9f4-8052-479b-bb9a-0500cb6c2231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:30.610272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dc9f4-8052-479b-bb9a-0500cb6c2231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:30.613485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dc9f4-8052-479b-bb9a-0500cb6c2231 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:30.632421 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3573/7172] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:30.636996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dc9f4-8052-479b-bb9a-0500cb6c2231 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:30.641666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ffb4f-b6eb-4d15-8fde-7f96f0eaaf78 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:30.652281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dc9f4-8052-479b-bb9a-0500cb6c2231 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:30.660215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231b0c8-58b6-4bc2-835c-33f9331acc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:30.662255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231b0c8-58b6-4bc2-835c-33f9331acc40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:30.662406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723294a-8499-4778-b9f5-74d1257a768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:30.662908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723294a-8499-4778-b9f5-74d1257a768e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:30.663189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723294a-8499-4778-b9f5-74d1257a768e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:30.663462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723294a-8499-4778-b9f5-74d1257a768e admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:30.664152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723294a-8499-4778-b9f5-74d1257a768e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:30.664275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231b0c8-58b6-4bc2-835c-33f9331acc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:30.664453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723294a-8499-4778-b9f5-74d1257a768e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:30.665050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231b0c8-58b6-4bc2-835c-33f9331acc40 admin admin] PATH_INFO: `/v3/projects/003dfbc1e0a84d0ab43bd267266ebb87/users/8d509ab6e08042d79a74b91cee0334d2/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:30.666834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723294a-8499-4778-b9f5-74d1257a768e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:30.701060 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3600/7173] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:30.720028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723294a-8499-4778-b9f5-74d1257a768e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:30.746485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723294a-8499-4778-b9f5-74d1257a768e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:30.747617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d88baa-38ce-475e-8376-d5b7c91a0d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:30.748317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d88baa-38ce-475e-8376-d5b7c91a0d8b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:30.748672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d88baa-38ce-475e-8376-d5b7c91a0d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:30.749015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d88baa-38ce-475e-8376-d5b7c91a0d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:30.749729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d88baa-38ce-475e-8376-d5b7c91a0d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:30.751792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d88baa-38ce-475e-8376-d5b7c91a0d8b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:30.760316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231b0c8-58b6-4bc2-835c-33f9331acc40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=003dfbc1e0a84d0ab43bd267266ebb87, user_id=8d509ab6e08042d79a74b91cee0334d2, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:30.763671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231b0c8-58b6-4bc2-835c-33f9331acc40 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:30.794705 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3574/7174] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:30 2022] PUT /identity/v3/projects/003dfbc1e0a84d0ab43bd267266ebb87/users/8d509ab6e08042d79a74b91cee0334d2/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:30.808449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16218fd9-fee4-41c1-a48e-8351514b934c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:30.808739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16218fd9-fee4-41c1-a48e-8351514b934c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:30.809067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16218fd9-fee4-41c1-a48e-8351514b934c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:30.874544 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3601/7175] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:30 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:30.880797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d88baa-38ce-475e-8376-d5b7c91a0d8b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:30.889275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-16218fd9-fee4-41c1-a48e-8351514b934c None None] MFA Rules not processed for user `8d509ab6e08042d79a74b91cee0334d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:30.892374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-16218fd9-fee4-41c1-a48e-8351514b934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:31.005013 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:31.033688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d88baa-38ce-475e-8376-d5b7c91a0d8b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:31.038865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bd23f-4004-47fb-a590-1a082b25d271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:31.039439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd23f-4004-47fb-a590-1a082b25d271 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:31.041456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd23f-4004-47fb-a590-1a082b25d271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:31.041789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd23f-4004-47fb-a590-1a082b25d271 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:31.042349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bd23f-4004-47fb-a590-1a082b25d271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:31.044372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bd23f-4004-47fb-a590-1a082b25d271 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:31.098372 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3602/7176] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:30 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:31.099344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bd23f-4004-47fb-a590-1a082b25d271 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:31.118134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bd23f-4004-47fb-a590-1a082b25d271 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:31.126802 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3575/7177] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:31.130957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16218fd9-fee4-41c1-a48e-8351514b934c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:31.132891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a49a86-ebb7-4b10-8e10-aed58a331cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:31.133972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a49a86-ebb7-4b10-8e10-aed58a331cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:31.134538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a49a86-ebb7-4b10-8e10-aed58a331cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:31.134697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a49a86-ebb7-4b10-8e10-aed58a331cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:31.135321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a49a86-ebb7-4b10-8e10-aed58a331cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:31.138381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a49a86-ebb7-4b10-8e10-aed58a331cf9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:31.160619 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3603/7178] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:32:31.165539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a49a86-ebb7-4b10-8e10-aed58a331cf9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:31.173004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16218fd9-fee4-41c1-a48e-8351514b934c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:31.186980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a49a86-ebb7-4b10-8e10-aed58a331cf9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:31.192993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fab713-6a79-4492-be49-822ba9626514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:31.195057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fab713-6a79-4492-be49-822ba9626514 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:31.195593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fab713-6a79-4492-be49-822ba9626514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:31.197794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fab713-6a79-4492-be49-822ba9626514 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:31.200567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fab713-6a79-4492-be49-822ba9626514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:31.203910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fab713-6a79-4492-be49-822ba9626514 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:31.208427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6544651-3273-4999-86fc-60aa40dd19b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:31.210704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544651-3273-4999-86fc-60aa40dd19b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:31.212485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544651-3273-4999-86fc-60aa40dd19b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:31.214260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544651-3273-4999-86fc-60aa40dd19b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:31.216251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6544651-3273-4999-86fc-60aa40dd19b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:31.220931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6544651-3273-4999-86fc-60aa40dd19b3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:31.248680 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3604/7179] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:31.254744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6544651-3273-4999-86fc-60aa40dd19b3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:31.283705 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3576/7180] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:31 2022] POST /identity/v3/projects => generated 405 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:31.288621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fab713-6a79-4492-be49-822ba9626514 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:31.290139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6544651-3273-4999-86fc-60aa40dd19b3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:31.393942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bd73a-0467-4777-b5f4-c8659ec8ae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:31.394781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd73a-0467-4777-b5f4-c8659ec8ae57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:31.395467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd73a-0467-4777-b5f4-c8659ec8ae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:31.396533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd73a-0467-4777-b5f4-c8659ec8ae57 admin admin] PATH_INFO: `/v3/projects/3260a1fe79f84de191014cb0a13f3d98/users/1c0929ffc0c64138a728fa3d3aa6d664/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:31.422825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bd73a-0467-4777-b5f4-c8659ec8ae57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3260a1fe79f84de191014cb0a13f3d98, user_id=1c0929ffc0c64138a728fa3d3aa6d664, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:31.425912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bd73a-0467-4777-b5f4-c8659ec8ae57 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:31.427576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fab713-6a79-4492-be49-822ba9626514 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:31.438248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3276585-5b80-4dfa-bc02-811f77e15ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:31.439183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3276585-5b80-4dfa-bc02-811f77e15ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:31.439955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3276585-5b80-4dfa-bc02-811f77e15ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:31.440957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3276585-5b80-4dfa-bc02-811f77e15ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:31.443442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3276585-5b80-4dfa-bc02-811f77e15ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:31.447142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3276585-5b80-4dfa-bc02-811f77e15ea2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:31.456646 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3605/7181] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:31 2022] PUT /identity/v3/projects/3260a1fe79f84de191014cb0a13f3d98/users/1c0929ffc0c64138a728fa3d3aa6d664/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:31.470582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3bb0-4b3f-4caf-accf-240df2beee4b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:31.470582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3bb0-4b3f-4caf-accf-240df2beee4b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:31.471016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3bb0-4b3f-4caf-accf-240df2beee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:31.494320 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3577/7182] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:31 2022] POST /identity/v3/users => generated 309 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:31.496631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3276585-5b80-4dfa-bc02-811f77e15ea2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:31.517754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3276585-5b80-4dfa-bc02-811f77e15ea2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:31.520954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-acaa3bb0-4b3f-4caf-accf-240df2beee4b None None] MFA Rules not processed for user `1c0929ffc0c64138a728fa3d3aa6d664`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:31.522403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-acaa3bb0-4b3f-4caf-accf-240df2beee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:31.557975 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:31.637619 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3606/7183] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:32:31.642696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa3bb0-4b3f-4caf-accf-240df2beee4b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:31.672688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4741b0-06a0-4f69-823b-ae8e3015cc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:31.673623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4741b0-06a0-4f69-823b-ae8e3015cc02 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:31.674250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4741b0-06a0-4f69-823b-ae8e3015cc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:31.674726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4741b0-06a0-4f69-823b-ae8e3015cc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:31.675537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4741b0-06a0-4f69-823b-ae8e3015cc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:31.677470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4741b0-06a0-4f69-823b-ae8e3015cc02 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:31.684806 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:31.690680 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3578/7184] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:31.695118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4741b0-06a0-4f69-823b-ae8e3015cc02 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:31.707280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4741b0-06a0-4f69-823b-ae8e3015cc02 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:31.719752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2814cbb-5d2f-4ad0-af8f-443c7956033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:31.720789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2814cbb-5d2f-4ad0-af8f-443c7956033b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:31.721069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2814cbb-5d2f-4ad0-af8f-443c7956033b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:31.721343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2814cbb-5d2f-4ad0-af8f-443c7956033b admin admin] PATH_INFO: `/v3/projects/4d18b37c9088428fbcd61a6d00faac84/users/9f18b7a248094f3e9872b4b5deb9d871/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:31.764741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2814cbb-5d2f-4ad0-af8f-443c7956033b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d18b37c9088428fbcd61a6d00faac84, user_id=9f18b7a248094f3e9872b4b5deb9d871, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:31.769600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2814cbb-5d2f-4ad0-af8f-443c7956033b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:31.805610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa3bb0-4b3f-4caf-accf-240df2beee4b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:31.817175 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3579/7185] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:31 2022] PUT /identity/v3/projects/4d18b37c9088428fbcd61a6d00faac84/users/9f18b7a248094f3e9872b4b5deb9d871/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:31.821197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2814cbb-5d2f-4ad0-af8f-443c7956033b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:31.973003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2814cbb-5d2f-4ad0-af8f-443c7956033b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:31.978700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a6ed2-f574-4e16-8cd0-d0a8dc1a58f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:31.979336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a6ed2-f574-4e16-8cd0-d0a8dc1a58f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:31.979621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a6ed2-f574-4e16-8cd0-d0a8dc1a58f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:31.979900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a6ed2-f574-4e16-8cd0-d0a8dc1a58f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:31.981083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a6ed2-f574-4e16-8cd0-d0a8dc1a58f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:31.982163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a6ed2-f574-4e16-8cd0-d0a8dc1a58f0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:31.991094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52709e5-c8b8-4c4e-b1e4-5eb43d22bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:31.991352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52709e5-c8b8-4c4e-b1e4-5eb43d22bf3a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:31.991500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52709e5-c8b8-4c4e-b1e4-5eb43d22bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:31.991772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52709e5-c8b8-4c4e-b1e4-5eb43d22bf3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:31.992404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52709e5-c8b8-4c4e-b1e4-5eb43d22bf3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:31.997186 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3580/7186] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:31.998259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a6ed2-f574-4e16-8cd0-d0a8dc1a58f0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:32.001203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e07a6ed2-f574-4e16-8cd0-d0a8dc1a58f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:32.007052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52709e5-c8b8-4c4e-b1e4-5eb43d22bf3a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:32.017396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a6ed2-f574-4e16-8cd0-d0a8dc1a58f0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:32.022919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:32.023773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:32.025318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:32.026518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] PATH_INFO: `/v3/users/0fc69147312b4b93b90cc73e2e3396c5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:32.027924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc69147312b4b93b90cc73e2e3396c5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:32.030274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:32.064205 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3607/7187] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:31 2022] POST /identity/v3/projects => generated 373 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:32:32.066103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52709e5-c8b8-4c4e-b1e4-5eb43d22bf3a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:32.128826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc69147312b4b93b90cc73e2e3396c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:32.159702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc69147312b4b93b90cc73e2e3396c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:32.160475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc69147312b4b93b90cc73e2e3396c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:32.189870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc69147312b4b93b90cc73e2e3396c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:32.198738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc69147312b4b93b90cc73e2e3396c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:32.204517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52709e5-c8b8-4c4e-b1e4-5eb43d22bf3a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:32.205237 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3581/7188] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:31 2022] DELETE /identity/v3/users/0fc69147312b4b93b90cc73e2e3396c5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:32.206150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:32.207668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:32.220605 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:32.304101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381a955-f9e9-46cd-948d-8ac0d8dd2cfb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:32.310950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ebf7d-b8e4-451e-af87-4b2d2e1af750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:32.311810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ebf7d-b8e4-451e-af87-4b2d2e1af750 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:32.312214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ebf7d-b8e4-451e-af87-4b2d2e1af750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:32.312499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ebf7d-b8e4-451e-af87-4b2d2e1af750 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:32.313400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ebf7d-b8e4-451e-af87-4b2d2e1af750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:32.318555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ebf7d-b8e4-451e-af87-4b2d2e1af750 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:32.343279 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:32.356396 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3582/7189] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:32 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:32.358300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bc719-586b-426a-a016-caa4bcd525b7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:32.358914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bc719-586b-426a-a016-caa4bcd525b7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:32.359402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bc719-586b-426a-a016-caa4bcd525b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:32.363169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf8fc8-c075-4793-9f4d-afa7fc0c78bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:32.363933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf8fc8-c075-4793-9f4d-afa7fc0c78bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:32.364335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf8fc8-c075-4793-9f4d-afa7fc0c78bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:32.364981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf8fc8-c075-4793-9f4d-afa7fc0c78bf admin admin] PATH_INFO: `/v3/projects/4d18b37c9088428fbcd61a6d00faac84/users/9f18b7a248094f3e9872b4b5deb9d871/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:32.372451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf8fc8-c075-4793-9f4d-afa7fc0c78bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d18b37c9088428fbcd61a6d00faac84, user_id=9f18b7a248094f3e9872b4b5deb9d871, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:32.376149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf8fc8-c075-4793-9f4d-afa7fc0c78bf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:32.403282 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3608/7190] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:32 2022] PUT /identity/v3/projects/4d18b37c9088428fbcd61a6d00faac84/users/9f18b7a248094f3e9872b4b5deb9d871/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:32.404157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-df5bc719-586b-426a-a016-caa4bcd525b7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:32.404638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf8fc8-c075-4793-9f4d-afa7fc0c78bf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:32.406592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-df5bc719-586b-426a-a016-caa4bcd525b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:32.512430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf8fc8-c075-4793-9f4d-afa7fc0c78bf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:32.518003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc7ae8-06d3-4f28-9dee-c38d703a9743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:32.518750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc7ae8-06d3-4f28-9dee-c38d703a9743 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:32.519107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc7ae8-06d3-4f28-9dee-c38d703a9743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:32.519457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc7ae8-06d3-4f28-9dee-c38d703a9743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:32.520440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc7ae8-06d3-4f28-9dee-c38d703a9743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:32.522704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc7ae8-06d3-4f28-9dee-c38d703a9743 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:32.538307 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3609/7191] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:32.540198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7049f8-5491-4eb6-bd28-0b0a647a0f2b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:32.540561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7049f8-5491-4eb6-bd28-0b0a647a0f2b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:32.540950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7049f8-5491-4eb6-bd28-0b0a647a0f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:32.546019 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3583/7192] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:32.546941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bc719-586b-426a-a016-caa4bcd525b7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:32.563796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bc719-586b-426a-a016-caa4bcd525b7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:32.569563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052557d2-ef52-4a86-bdd3-e8b7f250a01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:32.570463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052557d2-ef52-4a86-bdd3-e8b7f250a01b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:32.570639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052557d2-ef52-4a86-bdd3-e8b7f250a01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:32.571432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052557d2-ef52-4a86-bdd3-e8b7f250a01b admin admin] PATH_INFO: `/v3/projects/0831c17398ad40cb8f78678f2884bd24/users/6bd089292afa4d67a9d4472b43ede0d5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:32.575683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2e7049f8-5491-4eb6-bd28-0b0a647a0f2b None None] MFA Rules not processed for user `9f18b7a248094f3e9872b4b5deb9d871`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:32.577739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2e7049f8-5491-4eb6-bd28-0b0a647a0f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:32.590859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052557d2-ef52-4a86-bdd3-e8b7f250a01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0831c17398ad40cb8f78678f2884bd24, user_id=6bd089292afa4d67a9d4472b43ede0d5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:32.594370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052557d2-ef52-4a86-bdd3-e8b7f250a01b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:32.616301 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3584/7193] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:32 2022] PUT /identity/v3/projects/0831c17398ad40cb8f78678f2884bd24/users/6bd089292afa4d67a9d4472b43ede0d5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:32.618838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052557d2-ef52-4a86-bdd3-e8b7f250a01b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:32.622815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-052557d2-ef52-4a86-bdd3-e8b7f250a01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:32.678220 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3610/7194] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:32.678220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7049f8-5491-4eb6-bd28-0b0a647a0f2b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:32.713182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052557d2-ef52-4a86-bdd3-e8b7f250a01b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:32.727188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7049f8-5491-4eb6-bd28-0b0a647a0f2b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:32.735392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa752-4dc2-4a97-98ba-5bcf167cdea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:32.738457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa752-4dc2-4a97-98ba-5bcf167cdea7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:32.739141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa752-4dc2-4a97-98ba-5bcf167cdea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:32.739598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa752-4dc2-4a97-98ba-5bcf167cdea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:32.783840 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:32.807630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359490-6af7-45e9-8d43-176263e15864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:32.808244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359490-6af7-45e9-8d43-176263e15864 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:32.808583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359490-6af7-45e9-8d43-176263e15864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:32.808869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359490-6af7-45e9-8d43-176263e15864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:32.809518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d359490-6af7-45e9-8d43-176263e15864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:32.811223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d359490-6af7-45e9-8d43-176263e15864 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:32.823420 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3611/7195] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:32.824447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359490-6af7-45e9-8d43-176263e15864 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:32.826327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3d359490-6af7-45e9-8d43-176263e15864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:32.848266 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:32.866460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caa752-4dc2-4a97-98ba-5bcf167cdea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:32.868459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caa752-4dc2-4a97-98ba-5bcf167cdea7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:32.884357 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3585/7196] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:32.885563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa752-4dc2-4a97-98ba-5bcf167cdea7 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:32.896754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa752-4dc2-4a97-98ba-5bcf167cdea7 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:32.902564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00561c87-cc3d-4d01-b89b-b59107b58575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:32.903537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00561c87-cc3d-4d01-b89b-b59107b58575 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:32.904212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00561c87-cc3d-4d01-b89b-b59107b58575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:32.904508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00561c87-cc3d-4d01-b89b-b59107b58575 admin admin] PATH_INFO: `/v3/projects/0831c17398ad40cb8f78678f2884bd24/users/6bd089292afa4d67a9d4472b43ede0d5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:32.907048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00561c87-cc3d-4d01-b89b-b59107b58575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0831c17398ad40cb8f78678f2884bd24, user_id=6bd089292afa4d67a9d4472b43ede0d5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:32.910653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00561c87-cc3d-4d01-b89b-b59107b58575 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:32.928100 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3586/7197] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:32 2022] PUT /identity/v3/projects/0831c17398ad40cb8f78678f2884bd24/users/6bd089292afa4d67a9d4472b43ede0d5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:32.940055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859580b-664e-43c3-af39-5d34d063a0c0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:32.950410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359490-6af7-45e9-8d43-176263e15864 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:32.951345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859580b-664e-43c3-af39-5d34d063a0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:32.952488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859580b-664e-43c3-af39-5d34d063a0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:33.004633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8859580b-664e-43c3-af39-5d34d063a0c0 None None] MFA Rules not processed for user `6bd089292afa4d67a9d4472b43ede0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:33.006160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8859580b-664e-43c3-af39-5d34d063a0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:33.033122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99489d0-45be-40af-aa63-bb533b67dc6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:33.033762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99489d0-45be-40af-aa63-bb533b67dc6b service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:33.034050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99489d0-45be-40af-aa63-bb533b67dc6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:33.034326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99489d0-45be-40af-aa63-bb533b67dc6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:33.117539 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3587/7198] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:32:33.118698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859580b-664e-43c3-af39-5d34d063a0c0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:33.120133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8859580b-664e-43c3-af39-5d34d063a0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:33.173250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99489d0-45be-40af-aa63-bb533b67dc6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:33.175132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99489d0-45be-40af-aa63-bb533b67dc6b service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:33.193793 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3612/7199] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:32 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:33.196153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99489d0-45be-40af-aa63-bb533b67dc6b service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:33.209189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99489d0-45be-40af-aa63-bb533b67dc6b service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:33.215952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb895dfa-745c-430d-9a11-cb621d8d9d96 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bd089292afa4d67a9d4472b43ede0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0831c17398ad40cb8f78678f2884bd24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:33.221797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb895dfa-745c-430d-9a11-cb621d8d9d96 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:33.222320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb895dfa-745c-430d-9a11-cb621d8d9d96 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:33.223251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb895dfa-745c-430d-9a11-cb621d8d9d96 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:33.229972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb895dfa-745c-430d-9a11-cb621d8d9d96 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:33.229972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb895dfa-745c-430d-9a11-cb621d8d9d96 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:33.229972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb895dfa-745c-430d-9a11-cb621d8d9d96 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:33.231291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859580b-664e-43c3-af39-5d34d063a0c0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:33.240373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:33.252112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:33.253398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:33.254007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] PATH_INFO: `/v3/projects/e5dc437b22054597a181f7c66c4c9815` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:33.257248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5dc437b22054597a181f7c66c4c9815)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:33.260516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:33.273699 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3613/7200] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:33.274954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb895dfa-745c-430d-9a11-cb621d8d9d96 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:33.286997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb895dfa-745c-430d-9a11-cb621d8d9d96 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:33.294160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84735a9-35d6-485a-8216-cabb07339e75 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bd089292afa4d67a9d4472b43ede0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0831c17398ad40cb8f78678f2884bd24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:33.295048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84735a9-35d6-485a-8216-cabb07339e75 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:33.295435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84735a9-35d6-485a-8216-cabb07339e75 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:33.295825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84735a9-35d6-485a-8216-cabb07339e75 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:33.296617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84735a9-35d6-485a-8216-cabb07339e75 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:33.299078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84735a9-35d6-485a-8216-cabb07339e75 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:33.350442 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:33.356920 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3614/7201] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:33 2022] POST /identity/v3/projects => generated 349 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:33.360985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84735a9-35d6-485a-8216-cabb07339e75 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:33.369742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5dc437b22054597a181f7c66c4c9815', 'request_id': 'req-7d14bc5a-a217-4c5c-85f6-889a17f091b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:33.385959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5dc437b22054597a181f7c66c4c9815', 'request_id': 'req-7d14bc5a-a217-4c5c-85f6-889a17f091b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:33.410670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5dc437b22054597a181f7c66c4c9815', 'request_id': 'req-7d14bc5a-a217-4c5c-85f6-889a17f091b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:33.431201 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:33.446956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] The token cache is being invalidate because project e5dc437b22054597a181f7c66c4c9815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:33.447589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:33.449060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:33.451529 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3588/7202] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:33 2022] DELETE /identity/v3/projects/e5dc437b22054597a181f7c66c4c9815 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:33.452352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:33.453910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:33.469146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84735a9-35d6-485a-8216-cabb07339e75 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:33.475150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5903228-a97d-4697-8d79-e78d2ea5496e tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bd089292afa4d67a9d4472b43ede0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0831c17398ad40cb8f78678f2884bd24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:33.476333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5903228-a97d-4697-8d79-e78d2ea5496e tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:33.476333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5903228-a97d-4697-8d79-e78d2ea5496e tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:33.476634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5903228-a97d-4697-8d79-e78d2ea5496e tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:33.477788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5903228-a97d-4697-8d79-e78d2ea5496e tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:33.478220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5903228-a97d-4697-8d79-e78d2ea5496e tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:33.479972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5903228-a97d-4697-8d79-e78d2ea5496e tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:33.495091 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3615/7203] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:33.496769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51608-d673-49f1-b383-ca6a31ec5df5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:33.497063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51608-d673-49f1-b383-ca6a31ec5df5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:33.497390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51608-d673-49f1-b383-ca6a31ec5df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:33.519826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fbb51608-d673-49f1-b383-ca6a31ec5df5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:33.521100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fbb51608-d673-49f1-b383-ca6a31ec5df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:33.597771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14bc5a-a217-4c5c-85f6-889a17f091b0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:33.638828 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3616/7204] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:33.639796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51608-d673-49f1-b383-ca6a31ec5df5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:33.644636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fbb51608-d673-49f1-b383-ca6a31ec5df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:33.671752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:33.672678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:33.673157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:33.673596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] PATH_INFO: `/v3/users/8d509ab6e08042d79a74b91cee0334d2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:33.675490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d509ab6e08042d79a74b91cee0334d2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:33.677978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:33.751667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51608-d673-49f1-b383-ca6a31ec5df5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:33.754404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d509ab6e08042d79a74b91cee0334d2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:33.755403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cf804-b7e7-4950-ab29-ee69198f3c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:33.756479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf804-b7e7-4950-ab29-ee69198f3c8b service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:33.757053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf804-b7e7-4950-ab29-ee69198f3c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:33.757215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf804-b7e7-4950-ab29-ee69198f3c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:33.759861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3a3cf804-b7e7-4950-ab29-ee69198f3c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:33.771828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d509ab6e08042d79a74b91cee0334d2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:33.773272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d509ab6e08042d79a74b91cee0334d2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:33.774240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cf804-b7e7-4950-ab29-ee69198f3c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:33.775645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cf804-b7e7-4950-ab29-ee69198f3c8b service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:33.788899 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3617/7205] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:33.792603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d509ab6e08042d79a74b91cee0334d2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:33.796192 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:33.803016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24fba3-0a56-4f9d-900b-4cfc6419ed48 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:33.803302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24fba3-0a56-4f9d-900b-4cfc6419ed48 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:33.803575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24fba3-0a56-4f9d-900b-4cfc6419ed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:33.807616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d509ab6e08042d79a74b91cee0334d2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:33.824967 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3589/7206] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:33 2022] DELETE /identity/v3/users/8d509ab6e08042d79a74b91cee0334d2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:33.826488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:33.828777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:33.868980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cd24fba3-0a56-4f9d-900b-4cfc6419ed48 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:33.871991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cd24fba3-0a56-4f9d-900b-4cfc6419ed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:33.942791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46deb-ea43-438a-88cc-282cccef0181 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:33.950395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:33.951101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:33.951381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:33.951657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] PATH_INFO: `/v3/users/d6d7040d82644525b7f82dc9aa35ad22` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:33.953145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d7040d82644525b7f82dc9aa35ad22)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:33.955895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:34.037429 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3618/7207] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:34.039302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924f193-c559-4d39-8785-33f92072c5ab None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:34.039911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924f193-c559-4d39-8785-33f92072c5ab None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:34.041367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924f193-c559-4d39-8785-33f92072c5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:34.073161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d7040d82644525b7f82dc9aa35ad22'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:34.095712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f924f193-c559-4d39-8785-33f92072c5ab None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:34.100191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f924f193-c559-4d39-8785-33f92072c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:34.109419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d7040d82644525b7f82dc9aa35ad22'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:34.110216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d7040d82644525b7f82dc9aa35ad22'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:34.114345 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3619/7208] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:34.114345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924f193-c559-4d39-8785-33f92072c5ab None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:34.124399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d7040d82644525b7f82dc9aa35ad22'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:34.140679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924f193-c559-4d39-8785-33f92072c5ab None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:34.147265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d7040d82644525b7f82dc9aa35ad22'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:34.147948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9d450-654d-46fc-87a7-ea0da8601d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:34.148780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9d450-654d-46fc-87a7-ea0da8601d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:34.150342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9d450-654d-46fc-87a7-ea0da8601d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:34.151025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9d450-654d-46fc-87a7-ea0da8601d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:34.152137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9d450-654d-46fc-87a7-ea0da8601d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:34.152639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9d450-654d-46fc-87a7-ea0da8601d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:34.155480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9d450-654d-46fc-87a7-ea0da8601d72 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:34.164037 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3590/7209] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:33 2022] DELETE /identity/v3/users/d6d7040d82644525b7f82dc9aa35ad22 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:34.164037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:34.164584 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:34.166332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:34.179696 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3620/7210] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:34.182515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71addaef-0444-429c-b563-4c2a286db955 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:34.184652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71addaef-0444-429c-b563-4c2a286db955 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:34.186688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71addaef-0444-429c-b563-4c2a286db955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:34.232850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-71addaef-0444-429c-b563-4c2a286db955 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:34.234239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-71addaef-0444-429c-b563-4c2a286db955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:34.284737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eba8f-4a21-4da6-96a7-19f81dda0df6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:34.291743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aeca8-2dca-47e7-a5ef-92a4def1e893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:34.292062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aeca8-2dca-47e7-a5ef-92a4def1e893 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:34.292443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aeca8-2dca-47e7-a5ef-92a4def1e893 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:34.293057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aeca8-2dca-47e7-a5ef-92a4def1e893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:34.295246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a93aeca8-2dca-47e7-a5ef-92a4def1e893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:34.325145 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:34.421020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93aeca8-2dca-47e7-a5ef-92a4def1e893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:34.423209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93aeca8-2dca-47e7-a5ef-92a4def1e893 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:34.463337 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3621/7211] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:34.469900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71addaef-0444-429c-b563-4c2a286db955 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:34.475203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-71addaef-0444-429c-b563-4c2a286db955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:34.483937 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3591/7212] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:34.504357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71addaef-0444-429c-b563-4c2a286db955 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:34.505551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aeca8-2dca-47e7-a5ef-92a4def1e893 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:34.507125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a93aeca8-2dca-47e7-a5ef-92a4def1e893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:34.522479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dc5ca-c287-49d7-af36-4599f1a072f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:34.525194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dc5ca-c287-49d7-af36-4599f1a072f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:34.525194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dc5ca-c287-49d7-af36-4599f1a072f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:34.525194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dc5ca-c287-49d7-af36-4599f1a072f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:34.526765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1dc5ca-c287-49d7-af36-4599f1a072f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:34.531477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aeca8-2dca-47e7-a5ef-92a4def1e893 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:34.531767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1dc5ca-c287-49d7-af36-4599f1a072f7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:34.544407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe970-5455-4430-84e4-54495899e7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:34.545173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe970-5455-4430-84e4-54495899e7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:34.545558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe970-5455-4430-84e4-54495899e7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:34.545925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe970-5455-4430-84e4-54495899e7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:34.574643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbe970-5455-4430-84e4-54495899e7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:34.576327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbe970-5455-4430-84e4-54495899e7e0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:34.577714 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3622/7213] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:34 2022] POST /identity/v3/projects => generated 361 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:34.581902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dc5ca-c287-49d7-af36-4599f1a072f7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:34.606535 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3592/7214] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:34.834311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dc5ca-c287-49d7-af36-4599f1a072f7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:34.850271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a28691-0593-4188-9af1-ec1a9490ba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:34.851580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a28691-0593-4188-9af1-ec1a9490ba5f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:34.855024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a28691-0593-4188-9af1-ec1a9490ba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:34.855443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a28691-0593-4188-9af1-ec1a9490ba5f admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:34.856561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a28691-0593-4188-9af1-ec1a9490ba5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:34.866287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a28691-0593-4188-9af1-ec1a9490ba5f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:34.917087 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3623/7215] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:34 2022] POST /identity/v3/users => generated 281 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:34.918567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe970-5455-4430-84e4-54495899e7e0 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:34.936011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe970-5455-4430-84e4-54495899e7e0 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:34.949039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059d98b-7242-4b59-bc21-51552eb3aefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:34.950321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d98b-7242-4b59-bc21-51552eb3aefa admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:34.950868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d98b-7242-4b59-bc21-51552eb3aefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:34.951321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d98b-7242-4b59-bc21-51552eb3aefa admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:34.953139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059d98b-7242-4b59-bc21-51552eb3aefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:34.957632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059d98b-7242-4b59-bc21-51552eb3aefa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:34.991723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a28691-0593-4188-9af1-ec1a9490ba5f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:34.994415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b4a28691-0593-4188-9af1-ec1a9490ba5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:35.010714 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3593/7216] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:35.018577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059d98b-7242-4b59-bc21-51552eb3aefa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:35.036689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a28691-0593-4188-9af1-ec1a9490ba5f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:35.051004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059d98b-7242-4b59-bc21-51552eb3aefa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:35.058099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:35.058792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:35.059076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:35.059356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] PATH_INFO: `/v3/projects/9b1361383fec4262a1ff96e56c02a3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:35.061184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1361383fec4262a1ff96e56c02a3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:35.064023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:35.065627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9a8fb-c14e-4136-bcb6-a73cd4a84e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:35.067014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9a8fb-c14e-4136-bcb6-a73cd4a84e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:35.067673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9a8fb-c14e-4136-bcb6-a73cd4a84e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:35.068110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9a8fb-c14e-4136-bcb6-a73cd4a84e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:35.070239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9a8fb-c14e-4136-bcb6-a73cd4a84e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:35.073254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9a8fb-c14e-4136-bcb6-a73cd4a84e90 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:35.104679 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3594/7217] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:35.109091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9a8fb-c14e-4136-bcb6-a73cd4a84e90 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:35.135040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9a8fb-c14e-4136-bcb6-a73cd4a84e90 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:35.151620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bddb8-7289-4622-951d-b92f9383dfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:35.152750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bddb8-7289-4622-951d-b92f9383dfb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:35.153286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bddb8-7289-4622-951d-b92f9383dfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:35.153732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bddb8-7289-4622-951d-b92f9383dfb8 admin admin] PATH_INFO: `/v3/projects/1bdf7e95f92c461c98a043af0d10ac43/users/83972a83638545179841dedbb1b9931a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:35.192980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1361383fec4262a1ff96e56c02a3af', 'request_id': 'req-3dd417e9-7d9c-426a-a17a-1e87b89932f9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.198173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bddb8-7289-4622-951d-b92f9383dfb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdf7e95f92c461c98a043af0d10ac43, user_id=83972a83638545179841dedbb1b9931a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:35.202009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bddb8-7289-4622-951d-b92f9383dfb8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:35.206579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1361383fec4262a1ff96e56c02a3af', 'request_id': 'req-3dd417e9-7d9c-426a-a17a-1e87b89932f9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.209088 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:35.221212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1361383fec4262a1ff96e56c02a3af', 'request_id': 'req-3dd417e9-7d9c-426a-a17a-1e87b89932f9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.238850 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3595/7218] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:35 2022] PUT /identity/v3/projects/1bdf7e95f92c461c98a043af0d10ac43/users/83972a83638545179841dedbb1b9931a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:35.255860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec89f-3e8a-4194-8e46-36acefd3e016 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:35.256198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec89f-3e8a-4194-8e46-36acefd3e016 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:35.260555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec89f-3e8a-4194-8e46-36acefd3e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:35.273570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] The token cache is being invalidate because project 9b1361383fec4262a1ff96e56c02a3af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:35.275810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.276933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.283111 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3624/7219] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:34 2022] DELETE /identity/v3/projects/9b1361383fec4262a1ff96e56c02a3af => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:35.284214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:35.285819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:35.327273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bfdec89f-3e8a-4194-8e46-36acefd3e016 None None] MFA Rules not processed for user `83972a83638545179841dedbb1b9931a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:35.328826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bfdec89f-3e8a-4194-8e46-36acefd3e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:35.424871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd417e9-7d9c-426a-a17a-1e87b89932f9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:35.464565 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3596/7220] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:32:35.466276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdec89f-3e8a-4194-8e46-36acefd3e016 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:35.482951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bfdec89f-3e8a-4194-8e46-36acefd3e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:35.590268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:35.590945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:35.591227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:35.591490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] PATH_INFO: `/v3/users/a2376ebb47b745b4878cddf0a133fec4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:35.592640 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:35.596723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2376ebb47b745b4878cddf0a133fec4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:35.598919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:35.632983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdec89f-3e8a-4194-8e46-36acefd3e016 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:35.644971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:35.647251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:35.647817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:35.649347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] PATH_INFO: `/v3/projects/003dfbc1e0a84d0ab43bd267266ebb87` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:35.651990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=003dfbc1e0a84d0ab43bd267266ebb87)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:35.654823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:35.701630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2376ebb47b745b4878cddf0a133fec4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.737330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2376ebb47b745b4878cddf0a133fec4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.738424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2376ebb47b745b4878cddf0a133fec4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.758335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2376ebb47b745b4878cddf0a133fec4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.759924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2376ebb47b745b4878cddf0a133fec4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.766638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003dfbc1e0a84d0ab43bd267266ebb87', 'request_id': 'req-f10ea8e1-1fe2-4128-ba02-1341fd113805'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.773103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003dfbc1e0a84d0ab43bd267266ebb87', 'request_id': 'req-f10ea8e1-1fe2-4128-ba02-1341fd113805'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.781534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003dfbc1e0a84d0ab43bd267266ebb87', 'request_id': 'req-f10ea8e1-1fe2-4128-ba02-1341fd113805'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.794939 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3625/7221] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:35 2022] DELETE /identity/v3/users/a2376ebb47b745b4878cddf0a133fec4 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:35.795567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:35.796924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:35.800643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] The token cache is being invalidate because project 003dfbc1e0a84d0ab43bd267266ebb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:35.801089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.801872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:35.809166 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3597/7222] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:35 2022] DELETE /identity/v3/projects/003dfbc1e0a84d0ab43bd267266ebb87 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:35.810465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:35.812040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:35.867031 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:35.905635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ea8e1-1fe2-4128-ba02-1341fd113805 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:35.972684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c69e27-aec0-4bb0-bf24-5a02f6f2a92f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:35.979218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ced57-459f-4eb0-91e2-25afec540b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:35.980957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ced57-459f-4eb0-91e2-25afec540b9c service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:35.981650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ced57-459f-4eb0-91e2-25afec540b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:35.982084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ced57-459f-4eb0-91e2-25afec540b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:35.982539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:35.983458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:35.983842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:35.984211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] PATH_INFO: `/v3/users/9f18b7a248094f3e9872b4b5deb9d871` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:35.985568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f18b7a248094f3e9872b4b5deb9d871)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:35.985892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0f5ced57-459f-4eb0-91e2-25afec540b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:35.988423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:36.026521 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:36.057620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f18b7a248094f3e9872b4b5deb9d871'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:36.076865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f18b7a248094f3e9872b4b5deb9d871'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:36.077824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f18b7a248094f3e9872b4b5deb9d871'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:36.079646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ced57-459f-4eb0-91e2-25afec540b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:36.081708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ced57-459f-4eb0-91e2-25afec540b9c service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:36.097037 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3626/7223] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:36.104774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f18b7a248094f3e9872b4b5deb9d871'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:36.124307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f18b7a248094f3e9872b4b5deb9d871'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:36.136929 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3598/7224] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:35 2022] DELETE /identity/v3/users/9f18b7a248094f3e9872b4b5deb9d871 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:37.017238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ced57-459f-4eb0-91e2-25afec540b9c service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:37.021008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0f5ced57-459f-4eb0-91e2-25afec540b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:37.138633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ced57-459f-4eb0-91e2-25afec540b9c service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:37.140905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:37.148445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:37.282775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bd089292afa4d67a9d4472b43ede0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0831c17398ad40cb8f78678f2884bd24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:37.283337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:37.283621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:37.283896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] PATH_INFO: `/v3/projects/f70012d959c84b0badd2139089845672` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:37.287321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f70012d959c84b0badd2139089845672)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:37.289513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fecb4-05c0-4588-ab9e-efe15e40099f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:37.289654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:37.295937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:37.297091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:37.297458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:37.297636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] PATH_INFO: `/v3/projects/53076b2939c64d1ab6b175ff62e59d38` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:37.298845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53076b2939c64d1ab6b175ff62e59d38)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:37.302578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:37.346155 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:37.378014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53076b2939c64d1ab6b175ff62e59d38', 'request_id': 'req-033f44ee-c3d5-41af-ad75-21bf9182d288'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.386014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70012d959c84b0badd2139089845672', 'request_id': 'req-89ad5e89-27e8-4259-afae-206f1682fce7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.386904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53076b2939c64d1ab6b175ff62e59d38', 'request_id': 'req-033f44ee-c3d5-41af-ad75-21bf9182d288'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.392998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70012d959c84b0badd2139089845672', 'request_id': 'req-89ad5e89-27e8-4259-afae-206f1682fce7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.395097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53076b2939c64d1ab6b175ff62e59d38', 'request_id': 'req-033f44ee-c3d5-41af-ad75-21bf9182d288'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.400100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70012d959c84b0badd2139089845672', 'request_id': 'req-89ad5e89-27e8-4259-afae-206f1682fce7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.411933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] The token cache is being invalidate because project 53076b2939c64d1ab6b175ff62e59d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:37.412310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.412918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.418551 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3599/7225] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:37 2022] DELETE /identity/v3/projects/53076b2939c64d1ab6b175ff62e59d38 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:37.419288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] The token cache is being invalidate because project f70012d959c84b0badd2139089845672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:37.419421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:37.419621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.420761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:37.421547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.429988 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3627/7226] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:37 2022] DELETE /identity/v3/projects/f70012d959c84b0badd2139089845672 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:37.431012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:37.432737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:37.467825 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:37.505655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f44ee-c3d5-41af-ad75-21bf9182d288 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:37.515280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad5e89-27e8-4259-afae-206f1682fce7 tempest-QuotasNegativeTest-2111289266 tempest-QuotasNegativeTest-2111289266-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:37.524063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c23431-985d-4e11-a7d9-3c0bf48d04f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:37.525361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23431-985d-4e11-a7d9-3c0bf48d04f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:37.525650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23431-985d-4e11-a7d9-3c0bf48d04f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:37.525973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23431-985d-4e11-a7d9-3c0bf48d04f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:37.528188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-07c23431-985d-4e11-a7d9-3c0bf48d04f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:37.576142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:37.577200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:37.577534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:37.577847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] PATH_INFO: `/v3/projects/4d18b37c9088428fbcd61a6d00faac84` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:37.579047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d18b37c9088428fbcd61a6d00faac84)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:37.581194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:37.630932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c23431-985d-4e11-a7d9-3c0bf48d04f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:37.632570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c23431-985d-4e11-a7d9-3c0bf48d04f8 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:37.648415 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3628/7227] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:37.649966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a766-e5f5-4b7c-abf7-ff8ddb1f9cec None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:37.650255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a766-e5f5-4b7c-abf7-ff8ddb1f9cec None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:37.650531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a766-e5f5-4b7c-abf7-ff8ddb1f9cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:37.651800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d18b37c9088428fbcd61a6d00faac84', 'request_id': 'req-f5faf436-153d-4050-bfed-ba67d8e0dec5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.663946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d18b37c9088428fbcd61a6d00faac84', 'request_id': 'req-f5faf436-153d-4050-bfed-ba67d8e0dec5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.676978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e426a766-e5f5-4b7c-abf7-ff8ddb1f9cec None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:37.678650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e426a766-e5f5-4b7c-abf7-ff8ddb1f9cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:37.683158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d18b37c9088428fbcd61a6d00faac84', 'request_id': 'req-f5faf436-153d-4050-bfed-ba67d8e0dec5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.704466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] The token cache is being invalidate because project 4d18b37c9088428fbcd61a6d00faac84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:37.704772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.705453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:37.707160 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3600/7228] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:37 2022] DELETE /identity/v3/projects/4d18b37c9088428fbcd61a6d00faac84 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:37.712164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:37.713643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:37.808885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faf436-153d-4050-bfed-ba67d8e0dec5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:37.822416 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:37.827329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:37.831337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:37.832736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:37.833390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] PATH_INFO: `/v3/users/1c0929ffc0c64138a728fa3d3aa6d664` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:37.834872 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3629/7229] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:37.838847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed106a2-8125-4baa-a637-7ca4ed61ee74 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:37.838847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed106a2-8125-4baa-a637-7ca4ed61ee74 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:37.838847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed106a2-8125-4baa-a637-7ca4ed61ee74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:37.846048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c0929ffc0c64138a728fa3d3aa6d664)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:37.854735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:37.874043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fed106a2-8125-4baa-a637-7ca4ed61ee74 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:37.875351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fed106a2-8125-4baa-a637-7ca4ed61ee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:37.888312 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:37.888578 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3630/7230] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:37.896542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556db55-0f9b-4f86-a390-6681d2a9f707 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:37.896834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556db55-0f9b-4f86-a390-6681d2a9f707 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:37.897310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556db55-0f9b-4f86-a390-6681d2a9f707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:37.924796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6556db55-0f9b-4f86-a390-6681d2a9f707 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:37.929564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6556db55-0f9b-4f86-a390-6681d2a9f707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:37.952917 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3631/7231] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:37.954435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2544c5-a079-4d94-8586-a4703fb426da None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:37.956294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2544c5-a079-4d94-8586-a4703fb426da None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:37.957675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2544c5-a079-4d94-8586-a4703fb426da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:37.993001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c0929ffc0c64138a728fa3d3aa6d664'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:38.020622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9f2544c5-a079-4d94-8586-a4703fb426da None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:38.023694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9f2544c5-a079-4d94-8586-a4703fb426da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:38.029637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c0929ffc0c64138a728fa3d3aa6d664'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:38.030529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c0929ffc0c64138a728fa3d3aa6d664'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:38.054671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c0929ffc0c64138a728fa3d3aa6d664'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:38.058413 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3632/7232] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:38.064038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2544c5-a079-4d94-8586-a4703fb426da None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.067843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9f2544c5-a079-4d94-8586-a4703fb426da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:38.074191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c0929ffc0c64138a728fa3d3aa6d664'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:38.105539 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3601/7233] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:37 2022] DELETE /identity/v3/users/1c0929ffc0c64138a728fa3d3aa6d664 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:38.106472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.112466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2544c5-a079-4d94-8586-a4703fb426da None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.217866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a0c29-b350-41d5-956d-a9b29ce849cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.218933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0c29-b350-41d5-956d-a9b29ce849cb admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.219469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0c29-b350-41d5-956d-a9b29ce849cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.220359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0c29-b350-41d5-956d-a9b29ce849cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.226587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a0c29-b350-41d5-956d-a9b29ce849cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:38.227811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a0c29-b350-41d5-956d-a9b29ce849cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.232982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f353b9-02d3-4321-816b-f01b17d3cfd7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.233792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a0c29-b350-41d5-956d-a9b29ce849cb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.239199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1568d-fdac-462c-8d28-bb6e22a68812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.239917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1568d-fdac-462c-8d28-bb6e22a68812 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.240267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1568d-fdac-462c-8d28-bb6e22a68812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.240942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1568d-fdac-462c-8d28-bb6e22a68812 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.242163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1568d-fdac-462c-8d28-bb6e22a68812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:38.242569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1568d-fdac-462c-8d28-bb6e22a68812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.245038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1568d-fdac-462c-8d28-bb6e22a68812 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.255532 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3633/7234] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:38.257688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831ba18-3d5f-4f6e-8aae-16802e3aca3e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.258222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831ba18-3d5f-4f6e-8aae-16802e3aca3e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.258742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831ba18-3d5f-4f6e-8aae-16802e3aca3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.271628 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3602/7235] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:32:38.272756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1568d-fdac-462c-8d28-bb6e22a68812 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.281672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9831ba18-3d5f-4f6e-8aae-16802e3aca3e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:38.283383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9831ba18-3d5f-4f6e-8aae-16802e3aca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:38.286339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1568d-fdac-462c-8d28-bb6e22a68812 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.293051 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3634/7236] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:38.294226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefee3f0-565b-4712-be9d-0f1c9fea5435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.294877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831ba18-3d5f-4f6e-8aae-16802e3aca3e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.295604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefee3f0-565b-4712-be9d-0f1c9fea5435 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.295888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefee3f0-565b-4712-be9d-0f1c9fea5435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.296248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefee3f0-565b-4712-be9d-0f1c9fea5435 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.296896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefee3f0-565b-4712-be9d-0f1c9fea5435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.305018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefee3f0-565b-4712-be9d-0f1c9fea5435 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.308774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831ba18-3d5f-4f6e-8aae-16802e3aca3e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.316475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce6b70-5eb9-4dbd-88f3-2caaed1071ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.317651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6b70-5eb9-4dbd-88f3-2caaed1071ce admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.318349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6b70-5eb9-4dbd-88f3-2caaed1071ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.319019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6b70-5eb9-4dbd-88f3-2caaed1071ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.320040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce6b70-5eb9-4dbd-88f3-2caaed1071ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.324309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce6b70-5eb9-4dbd-88f3-2caaed1071ce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.377312 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3635/7237] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:38 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:38.377312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce6b70-5eb9-4dbd-88f3-2caaed1071ce admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.378910 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3603/7238] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:38 2022] POST /identity/v3/projects => generated 397 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:38.379842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefee3f0-565b-4712-be9d-0f1c9fea5435 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.382159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-46ce6b70-5eb9-4dbd-88f3-2caaed1071ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:38.475342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce6b70-5eb9-4dbd-88f3-2caaed1071ce admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.488843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefee3f0-565b-4712-be9d-0f1c9fea5435 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.494396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1689625-e1ba-4ecb-99a5-74b41c322176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.495058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689625-e1ba-4ecb-99a5-74b41c322176 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.495347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689625-e1ba-4ecb-99a5-74b41c322176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.495629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689625-e1ba-4ecb-99a5-74b41c322176 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.496964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1689625-e1ba-4ecb-99a5-74b41c322176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.499906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1689625-e1ba-4ecb-99a5-74b41c322176 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.512954 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:38.540174 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3604/7239] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:38 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:38.540663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1689625-e1ba-4ecb-99a5-74b41c322176 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.562787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1689625-e1ba-4ecb-99a5-74b41c322176 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.581575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47cf8f-e6d2-4026-8b0f-e5415cfab6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.582587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47cf8f-e6d2-4026-8b0f-e5415cfab6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.582903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47cf8f-e6d2-4026-8b0f-e5415cfab6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.583185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47cf8f-e6d2-4026-8b0f-e5415cfab6e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.583831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47cf8f-e6d2-4026-8b0f-e5415cfab6e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.585824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47cf8f-e6d2-4026-8b0f-e5415cfab6e7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.592658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5945d-f6f7-4b18-821b-6ec7b0073649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.593453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5945d-f6f7-4b18-821b-6ec7b0073649 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.593643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5945d-f6f7-4b18-821b-6ec7b0073649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.593904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5945d-f6f7-4b18-821b-6ec7b0073649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.618806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5945d-f6f7-4b18-821b-6ec7b0073649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.620285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5945d-f6f7-4b18-821b-6ec7b0073649 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.637045 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3636/7240] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:38.640528 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3605/7241] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:38 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:38.640669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5945d-f6f7-4b18-821b-6ec7b0073649 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.642184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47cf8f-e6d2-4026-8b0f-e5415cfab6e7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.643914 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:38.650351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5945d-f6f7-4b18-821b-6ec7b0073649 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.657482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de84a-1324-4e54-9866-98f2010b2f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.658314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de84a-1324-4e54-9866-98f2010b2f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.658863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de84a-1324-4e54-9866-98f2010b2f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.659233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de84a-1324-4e54-9866-98f2010b2f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.660009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9de84a-1324-4e54-9866-98f2010b2f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.661792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9de84a-1324-4e54-9866-98f2010b2f63 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.669052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47cf8f-e6d2-4026-8b0f-e5415cfab6e7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.677135 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3637/7242] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:38.681582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd9426-c915-4010-860c-0fa1ca5ffa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.682754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de84a-1324-4e54-9866-98f2010b2f63 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.682910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd9426-c915-4010-860c-0fa1ca5ffa39 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.682910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd9426-c915-4010-860c-0fa1ca5ffa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.682910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd9426-c915-4010-860c-0fa1ca5ffa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.683434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd9426-c915-4010-860c-0fa1ca5ffa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.685248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd9426-c915-4010-860c-0fa1ca5ffa39 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.702212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de84a-1324-4e54-9866-98f2010b2f63 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.705711 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3606/7243] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:32:38.709661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd9426-c915-4010-860c-0fa1ca5ffa39 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.714001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797afb9-195f-4b35-a71e-49acaff40990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.714661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797afb9-195f-4b35-a71e-49acaff40990 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.714946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797afb9-195f-4b35-a71e-49acaff40990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.715373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797afb9-195f-4b35-a71e-49acaff40990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.716039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797afb9-195f-4b35-a71e-49acaff40990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.717822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797afb9-195f-4b35-a71e-49acaff40990 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.733890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd9426-c915-4010-860c-0fa1ca5ffa39 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.743958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595e5e0-59d1-49ae-b4b9-4d26a8d93279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.744529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595e5e0-59d1-49ae-b4b9-4d26a8d93279 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.744817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595e5e0-59d1-49ae-b4b9-4d26a8d93279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.745094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595e5e0-59d1-49ae-b4b9-4d26a8d93279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.745751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595e5e0-59d1-49ae-b4b9-4d26a8d93279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.746090 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3638/7244] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:38.747577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595e5e0-59d1-49ae-b4b9-4d26a8d93279 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.750439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797afb9-195f-4b35-a71e-49acaff40990 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.764125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797afb9-195f-4b35-a71e-49acaff40990 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.770843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0801b37-61f2-4fae-a4f0-eab6b3387e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.771553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0801b37-61f2-4fae-a4f0-eab6b3387e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.771854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0801b37-61f2-4fae-a4f0-eab6b3387e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.772188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0801b37-61f2-4fae-a4f0-eab6b3387e2c admin admin] PATH_INFO: `/v3/projects/688c28c4dbe84c969d86edb97d1d3276/users/7ea25d2081c64c7ebdebb7714e090f52/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.778492 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3607/7245] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:32:38.782761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595e5e0-59d1-49ae-b4b9-4d26a8d93279 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:38.797251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0801b37-61f2-4fae-a4f0-eab6b3387e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=688c28c4dbe84c969d86edb97d1d3276, user_id=7ea25d2081c64c7ebdebb7714e090f52, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.800261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0801b37-61f2-4fae-a4f0-eab6b3387e2c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.801240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595e5e0-59d1-49ae-b4b9-4d26a8d93279 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:38.811901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31770ed3-492e-4e8f-9ce8-1ddb40015dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:38.813225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31770ed3-492e-4e8f-9ce8-1ddb40015dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.814326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31770ed3-492e-4e8f-9ce8-1ddb40015dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.814326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31770ed3-492e-4e8f-9ce8-1ddb40015dbd admin admin] PATH_INFO: `/v3/projects/d1c26f046c8848dea856f2e267c5b46c/users/08ab54f9bdae4c6ea623a7e00a2bab8a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.825554 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3639/7246] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:38 2022] PUT /identity/v3/projects/688c28c4dbe84c969d86edb97d1d3276/users/7ea25d2081c64c7ebdebb7714e090f52/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:38.836478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b21ffb-6b34-4983-a5f1-52d67138d5d3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.837397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b21ffb-6b34-4983-a5f1-52d67138d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.837926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b21ffb-6b34-4983-a5f1-52d67138d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.861103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31770ed3-492e-4e8f-9ce8-1ddb40015dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c26f046c8848dea856f2e267c5b46c, user_id=08ab54f9bdae4c6ea623a7e00a2bab8a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:38.868753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31770ed3-492e-4e8f-9ce8-1ddb40015dbd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:38.923110 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3608/7247] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:38 2022] PUT /identity/v3/projects/d1c26f046c8848dea856f2e267c5b46c/users/08ab54f9bdae4c6ea623a7e00a2bab8a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:38.939244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b0b21ffb-6b34-4983-a5f1-52d67138d5d3 None None] MFA Rules not processed for user `7ea25d2081c64c7ebdebb7714e090f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:38.940253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb70e9-b409-40b5-9b66-91f16a838620 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:38.940601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb70e9-b409-40b5-9b66-91f16a838620 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:38.940884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb70e9-b409-40b5-9b66-91f16a838620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:38.943001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b0b21ffb-6b34-4983-a5f1-52d67138d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:38.983219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-99bb70e9-b409-40b5-9b66-91f16a838620 None None] MFA Rules not processed for user `08ab54f9bdae4c6ea623a7e00a2bab8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:38.984458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-99bb70e9-b409-40b5-9b66-91f16a838620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:39.082770 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3609/7248] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:39.103868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb70e9-b409-40b5-9b66-91f16a838620 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:39.105450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-99bb70e9-b409-40b5-9b66-91f16a838620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:39.124821 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3640/7249] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:39.125771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b21ffb-6b34-4983-a5f1-52d67138d5d3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:39.216740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb70e9-b409-40b5-9b66-91f16a838620 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:39.220969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0586554-abf4-4bf1-a05f-5a8e2900794e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:39.221584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0586554-abf4-4bf1-a05f-5a8e2900794e service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:39.221865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0586554-abf4-4bf1-a05f-5a8e2900794e service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:39.222306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0586554-abf4-4bf1-a05f-5a8e2900794e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:39.232664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0586554-abf4-4bf1-a05f-5a8e2900794e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:39.235382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0586554-abf4-4bf1-a05f-5a8e2900794e service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:39.248863 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3610/7250] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:39.249881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0586554-abf4-4bf1-a05f-5a8e2900794e service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:39.251297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0586554-abf4-4bf1-a05f-5a8e2900794e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:39.269816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0586554-abf4-4bf1-a05f-5a8e2900794e service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:39.276432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:39.277096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:39.277374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:39.277645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] PATH_INFO: `/v3/projects/3260a1fe79f84de191014cb0a13f3d98` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:39.278997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3260a1fe79f84de191014cb0a13f3d98)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:39.281999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:39.286156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b21ffb-6b34-4983-a5f1-52d67138d5d3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:39.304790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785e12-9acd-4f88-9958-e4de6772cf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:39.307257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785e12-9acd-4f88-9958-e4de6772cf7a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:39.307540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785e12-9acd-4f88-9958-e4de6772cf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:39.307817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785e12-9acd-4f88-9958-e4de6772cf7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:39.308471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785e12-9acd-4f88-9958-e4de6772cf7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:39.314514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785e12-9acd-4f88-9958-e4de6772cf7a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:39.323870 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:39.377346 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3641/7251] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:39 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:39.378208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785e12-9acd-4f88-9958-e4de6772cf7a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:39.391561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3260a1fe79f84de191014cb0a13f3d98', 'request_id': 'req-7c9da8c0-732e-40cd-97e8-b778544b1a74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:39.403480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3260a1fe79f84de191014cb0a13f3d98', 'request_id': 'req-7c9da8c0-732e-40cd-97e8-b778544b1a74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:39.416447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3260a1fe79f84de191014cb0a13f3d98', 'request_id': 'req-7c9da8c0-732e-40cd-97e8-b778544b1a74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:39.449611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] The token cache is being invalidate because project 3260a1fe79f84de191014cb0a13f3d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:39.449936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:39.450707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:39.456971 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3611/7252] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:39 2022] DELETE /identity/v3/projects/3260a1fe79f84de191014cb0a13f3d98 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:39.458494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:39.463684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:39.471811 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:39.538905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785e12-9acd-4f88-9958-e4de6772cf7a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:39.544885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e26d-174b-4013-b090-67bf35e3b321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:39.545622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e26d-174b-4013-b090-67bf35e3b321 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:39.546589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e26d-174b-4013-b090-67bf35e3b321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:39.547021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e26d-174b-4013-b090-67bf35e3b321 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:39.548294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5e26d-174b-4013-b090-67bf35e3b321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:39.550487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5e26d-174b-4013-b090-67bf35e3b321 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:39.601035 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3642/7253] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:39 2022] POST /identity/v3/users => generated 295 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:32:39.603257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e26d-174b-4013-b090-67bf35e3b321 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:39.606584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bdd5e26d-174b-4013-b090-67bf35e3b321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:39.635892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e26d-174b-4013-b090-67bf35e3b321 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:39.645229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9da8c0-732e-40cd-97e8-b778544b1a74 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:39.648051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e061c-2671-4468-8261-2b1576cd6fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:39.649785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e061c-2671-4468-8261-2b1576cd6fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:39.650248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e061c-2671-4468-8261-2b1576cd6fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:39.650916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e061c-2671-4468-8261-2b1576cd6fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:39.652084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e061c-2671-4468-8261-2b1576cd6fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:39.656268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e061c-2671-4468-8261-2b1576cd6fe7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:39.659151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:39.659900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:39.660075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:39.660370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] PATH_INFO: `/v3/users/6bd089292afa4d67a9d4472b43ede0d5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:39.666350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd089292afa4d67a9d4472b43ede0d5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:39.668366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:39.681930 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3643/7254] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:39.688295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e061c-2671-4468-8261-2b1576cd6fe7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:39.707561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e061c-2671-4468-8261-2b1576cd6fe7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:39.720287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45392abf-487f-494a-b0cf-18403fe96f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:39.721037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392abf-487f-494a-b0cf-18403fe96f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:39.721423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392abf-487f-494a-b0cf-18403fe96f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:39.722135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392abf-487f-494a-b0cf-18403fe96f83 admin admin] PATH_INFO: `/v3/projects/acb251945cdc4c3c98053c53bb3a135d/users/384048175b724e5a9225641e8a3b03f3/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:39.764265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45392abf-487f-494a-b0cf-18403fe96f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb251945cdc4c3c98053c53bb3a135d, user_id=384048175b724e5a9225641e8a3b03f3, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:39.765508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd089292afa4d67a9d4472b43ede0d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:39.771211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45392abf-487f-494a-b0cf-18403fe96f83 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:39.796159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd089292afa4d67a9d4472b43ede0d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:39.796837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd089292afa4d67a9d4472b43ede0d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:39.799202 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3644/7255] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:39 2022] PUT /identity/v3/projects/acb251945cdc4c3c98053c53bb3a135d/users/384048175b724e5a9225641e8a3b03f3/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:39.804363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45392abf-487f-494a-b0cf-18403fe96f83 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:39.808910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-45392abf-487f-494a-b0cf-18403fe96f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:39.809828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd089292afa4d67a9d4472b43ede0d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:39.819426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd089292afa4d67a9d4472b43ede0d5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:39.838136 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3612/7256] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:39 2022] DELETE /identity/v3/users/6bd089292afa4d67a9d4472b43ede0d5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:40.006694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45392abf-487f-494a-b0cf-18403fe96f83 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:40.156350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d5a2f-2a62-4b14-a05b-a2c1ecf137bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:40.166722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d5a2f-2a62-4b14-a05b-a2c1ecf137bf admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:40.166722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d5a2f-2a62-4b14-a05b-a2c1ecf137bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:40.166722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d5a2f-2a62-4b14-a05b-a2c1ecf137bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:40.166722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d5a2f-2a62-4b14-a05b-a2c1ecf137bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:40.167426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d5a2f-2a62-4b14-a05b-a2c1ecf137bf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:40.194922 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3645/7257] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:40.198968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:40.221349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad715b-a738-4eca-8514-87dbee435604 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:40.252315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0100c-ace8-4372-9897-525e771f72d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:40.264256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0100c-ace8-4372-9897-525e771f72d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:40.264659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0100c-ace8-4372-9897-525e771f72d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:40.264826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0100c-ace8-4372-9897-525e771f72d8 admin admin] PATH_INFO: `/v3/projects/acb251945cdc4c3c98053c53bb3a135d/users/384048175b724e5a9225641e8a3b03f3/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:40.303338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0100c-ace8-4372-9897-525e771f72d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb251945cdc4c3c98053c53bb3a135d, user_id=384048175b724e5a9225641e8a3b03f3, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:40.332253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0100c-ace8-4372-9897-525e771f72d8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:40.407631 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3613/7258] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:40 2022] PUT /identity/v3/projects/acb251945cdc4c3c98053c53bb3a135d/users/384048175b724e5a9225641e8a3b03f3/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:40.424782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01663922-e08a-47e9-9c9a-2c110353fde7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:40.424956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01663922-e08a-47e9-9c9a-2c110353fde7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:40.425222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01663922-e08a-47e9-9c9a-2c110353fde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:40.501773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-01663922-e08a-47e9-9c9a-2c110353fde7 None None] MFA Rules not processed for user `384048175b724e5a9225641e8a3b03f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:40.504689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-01663922-e08a-47e9-9c9a-2c110353fde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:40.552544 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:40.723982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0100c-ace8-4372-9897-525e771f72d8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:40.725997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d1e0100c-ace8-4372-9897-525e771f72d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:40.753158 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3646/7259] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:40.762573 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:40.765989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01663922-e08a-47e9-9c9a-2c110353fde7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:40.770562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-01663922-e08a-47e9-9c9a-2c110353fde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:40.875930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0100c-ace8-4372-9897-525e771f72d8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:40.890632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:40.895432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:40.895432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:40.895432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] PATH_INFO: `/v3/projects/0831c17398ad40cb8f78678f2884bd24` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:40.895740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0831c17398ad40cb8f78678f2884bd24)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:40.901861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:40.907282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01663922-e08a-47e9-9c9a-2c110353fde7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:40.921810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bb640-9278-4956-a889-b2124b460621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:40.922805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bb640-9278-4956-a889-b2124b460621 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:40.923088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bb640-9278-4956-a889-b2124b460621 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:40.924234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bb640-9278-4956-a889-b2124b460621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:40.928676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-062bb640-9278-4956-a889-b2124b460621 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:41.037171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0831c17398ad40cb8f78678f2884bd24', 'request_id': 'req-57d19fd2-172e-4052-b5a3-1e885f98641b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:41.043728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bb640-9278-4956-a889-b2124b460621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:41.047708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0831c17398ad40cb8f78678f2884bd24', 'request_id': 'req-57d19fd2-172e-4052-b5a3-1e885f98641b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:41.049972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bb640-9278-4956-a889-b2124b460621 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:41.059932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0831c17398ad40cb8f78678f2884bd24', 'request_id': 'req-57d19fd2-172e-4052-b5a3-1e885f98641b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:41.068873 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3647/7260] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:41.103435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] The token cache is being invalidate because project 0831c17398ad40cb8f78678f2884bd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:41.103948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:41.104807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57d19fd2-172e-4052-b5a3-1e885f98641b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:41.111571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813ad3-8a4d-4bf2-9c25-dcd770d36e2a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:41.112097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813ad3-8a4d-4bf2-9c25-dcd770d36e2a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:41.112566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813ad3-8a4d-4bf2-9c25-dcd770d36e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:41.115478 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3614/7261] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:40 2022] DELETE /identity/v3/projects/0831c17398ad40cb8f78678f2884bd24 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:41.147368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8c813ad3-8a4d-4bf2-9c25-dcd770d36e2a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:41.148587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8c813ad3-8a4d-4bf2-9c25-dcd770d36e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:41.268159 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3648/7262] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:41.276662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f7372-7f98-4ae4-9c59-34ef5c775a6e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:41.277211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f7372-7f98-4ae4-9c59-34ef5c775a6e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:41.278312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f7372-7f98-4ae4-9c59-34ef5c775a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:41.301200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-954f7372-7f98-4ae4-9c59-34ef5c775a6e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:41.302653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-954f7372-7f98-4ae4-9c59-34ef5c775a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:41.317578 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3615/7263] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:41.318003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c813ad3-8a4d-4bf2-9c25-dcd770d36e2a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:41.329153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c813ad3-8a4d-4bf2-9c25-dcd770d36e2a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:41.337264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ab21e-759a-4408-b8f5-a216b9f8fbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:41.338332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ab21e-759a-4408-b8f5-a216b9f8fbbf admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:41.338635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ab21e-759a-4408-b8f5-a216b9f8fbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:41.339270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ab21e-759a-4408-b8f5-a216b9f8fbbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:41.340043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ab21e-759a-4408-b8f5-a216b9f8fbbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:41.340357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ab21e-759a-4408-b8f5-a216b9f8fbbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:41.342370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ab21e-759a-4408-b8f5-a216b9f8fbbf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:41.345352 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:41.358639 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3649/7264] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:32:41.363090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f7372-7f98-4ae4-9c59-34ef5c775a6e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:41.374697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f7372-7f98-4ae4-9c59-34ef5c775a6e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:41.386215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eb77e-b0b8-4908-bc4d-f2c398936a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:41.387222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb77e-b0b8-4908-bc4d-f2c398936a4a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:41.387718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb77e-b0b8-4908-bc4d-f2c398936a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:41.388163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb77e-b0b8-4908-bc4d-f2c398936a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:41.389351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4eb77e-b0b8-4908-bc4d-f2c398936a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:41.391705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4eb77e-b0b8-4908-bc4d-f2c398936a4a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:41.438877 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3616/7265] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:41 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:41.443766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ab21e-759a-4408-b8f5-a216b9f8fbbf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:41.456097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ab21e-759a-4408-b8f5-a216b9f8fbbf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:41.657822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49df007-6005-450f-bbf8-b3dd0902d5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:41.658473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49df007-6005-450f-bbf8-b3dd0902d5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:41.658788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49df007-6005-450f-bbf8-b3dd0902d5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:41.660147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49df007-6005-450f-bbf8-b3dd0902d5e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:41.662100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49df007-6005-450f-bbf8-b3dd0902d5e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:41.664116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49df007-6005-450f-bbf8-b3dd0902d5e0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:41.695152 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3650/7266] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:41 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:41.699486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eb77e-b0b8-4908-bc4d-f2c398936a4a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:41.717365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eb77e-b0b8-4908-bc4d-f2c398936a4a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:41.736381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227acd1-3679-48f1-80ac-21e42dc8cdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:41.742902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227acd1-3679-48f1-80ac-21e42dc8cdc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:41.742902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227acd1-3679-48f1-80ac-21e42dc8cdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:41.748921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227acd1-3679-48f1-80ac-21e42dc8cdc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:41.748921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227acd1-3679-48f1-80ac-21e42dc8cdc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:41.748921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227acd1-3679-48f1-80ac-21e42dc8cdc0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:41.765385 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3617/7267] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:41.766668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49df007-6005-450f-bbf8-b3dd0902d5e0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:41.778649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49df007-6005-450f-bbf8-b3dd0902d5e0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:41.783784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a9d09-1ac6-4ce5-b269-075c79274c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:41.784405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a9d09-1ac6-4ce5-b269-075c79274c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:41.784729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a9d09-1ac6-4ce5-b269-075c79274c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:41.785009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a9d09-1ac6-4ce5-b269-075c79274c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:41.785667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a9d09-1ac6-4ce5-b269-075c79274c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:41.787582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a9d09-1ac6-4ce5-b269-075c79274c7e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:41.807313 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3651/7268] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:41.807484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227acd1-3679-48f1-80ac-21e42dc8cdc0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:41.826343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227acd1-3679-48f1-80ac-21e42dc8cdc0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:41.831793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8efd1-da83-4fa7-9480-ff3b7f5529d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:41.832462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8efd1-da83-4fa7-9480-ff3b7f5529d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:41.832740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8efd1-da83-4fa7-9480-ff3b7f5529d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:41.833012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8efd1-da83-4fa7-9480-ff3b7f5529d6 admin admin] PATH_INFO: `/v3/projects/ffc69ae44a0a4e83b172f791dad09fbc/users/3622ecc1ffe44cd3946f6a46277169cc/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:41.879655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8efd1-da83-4fa7-9480-ff3b7f5529d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc69ae44a0a4e83b172f791dad09fbc, user_id=3622ecc1ffe44cd3946f6a46277169cc, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:41.885759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8efd1-da83-4fa7-9480-ff3b7f5529d6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:41.921729 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3618/7269] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:41 2022] PUT /identity/v3/projects/ffc69ae44a0a4e83b172f791dad09fbc/users/3622ecc1ffe44cd3946f6a46277169cc/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:41.922509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4fb25-b906-43d9-a9d9-a587798a2691 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:41.922834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4fb25-b906-43d9-a9d9-a587798a2691 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:41.923117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4fb25-b906-43d9-a9d9-a587798a2691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:41.966315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-23e4fb25-b906-43d9-a9d9-a587798a2691 None None] MFA Rules not processed for user `3622ecc1ffe44cd3946f6a46277169cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:41.972170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-23e4fb25-b906-43d9-a9d9-a587798a2691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:42.072088 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3652/7270] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:42.076611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8efd1-da83-4fa7-9480-ff3b7f5529d6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:42.163139 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:42.234330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8efd1-da83-4fa7-9480-ff3b7f5529d6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:42.239685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b8169-8358-47f4-801c-220a5576f89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:42.240311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b8169-8358-47f4-801c-220a5576f89d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:42.240727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b8169-8358-47f4-801c-220a5576f89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:42.241008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b8169-8358-47f4-801c-220a5576f89d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:42.241644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b8169-8358-47f4-801c-220a5576f89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:42.244423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b8169-8358-47f4-801c-220a5576f89d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:42.298797 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3619/7271] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:42 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:32:42.299471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4fb25-b906-43d9-a9d9-a587798a2691 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:42.332589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4fb25-b906-43d9-a9d9-a587798a2691 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:42.440204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc082d06-199d-4d97-9121-c4b10d5ac470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:42.441495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc082d06-199d-4d97-9121-c4b10d5ac470 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:42.441846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc082d06-199d-4d97-9121-c4b10d5ac470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:42.442331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc082d06-199d-4d97-9121-c4b10d5ac470 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:42.443565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc082d06-199d-4d97-9121-c4b10d5ac470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:42.453187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc082d06-199d-4d97-9121-c4b10d5ac470 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:42.471319 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:42.489772 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3653/7272] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:32:42 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:32:42.494001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b8169-8358-47f4-801c-220a5576f89d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:42.507041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b8169-8358-47f4-801c-220a5576f89d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:42.513838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821fc3-a2f6-4165-a7c5-148e298c6b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:42.515727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821fc3-a2f6-4165-a7c5-148e298c6b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:42.516226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821fc3-a2f6-4165-a7c5-148e298c6b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:42.517610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821fc3-a2f6-4165-a7c5-148e298c6b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:42.518631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0821fc3-a2f6-4165-a7c5-148e298c6b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:42.521050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0821fc3-a2f6-4165-a7c5-148e298c6b0a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:42.540878 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3620/7273] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:42.545105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc082d06-199d-4d97-9121-c4b10d5ac470 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:42.561194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc082d06-199d-4d97-9121-c4b10d5ac470 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:42.573126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17849110-bb32-4fef-88b1-f2ab79a963ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:42.574168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849110-bb32-4fef-88b1-f2ab79a963ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:42.575975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849110-bb32-4fef-88b1-f2ab79a963ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:42.577686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849110-bb32-4fef-88b1-f2ab79a963ac admin admin] PATH_INFO: `/v3/projects/be337cdf6e7f4b7cab7d4f84d37832f7/users/c09e42a16d3a4b5a951f2859750e5359/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:42.621605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17849110-bb32-4fef-88b1-f2ab79a963ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=be337cdf6e7f4b7cab7d4f84d37832f7, user_id=c09e42a16d3a4b5a951f2859750e5359, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:42.629332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17849110-bb32-4fef-88b1-f2ab79a963ac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:42.660922 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3654/7274] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:42 2022] PUT /identity/v3/projects/be337cdf6e7f4b7cab7d4f84d37832f7/users/c09e42a16d3a4b5a951f2859750e5359/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:42.666734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821fc3-a2f6-4165-a7c5-148e298c6b0a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:42.691498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821fc3-a2f6-4165-a7c5-148e298c6b0a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:42.819708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12407bbc-c6b2-4ea4-a5db-97e160eefead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:42.821112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12407bbc-c6b2-4ea4-a5db-97e160eefead admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:42.832028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12407bbc-c6b2-4ea4-a5db-97e160eefead admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:42.832435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12407bbc-c6b2-4ea4-a5db-97e160eefead admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:42.833277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12407bbc-c6b2-4ea4-a5db-97e160eefead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:42.838683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12407bbc-c6b2-4ea4-a5db-97e160eefead admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:42.853913 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3621/7275] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:32:42.854680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17849110-bb32-4fef-88b1-f2ab79a963ac admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:42.871719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17849110-bb32-4fef-88b1-f2ab79a963ac admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:42.876956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21eb4b-12e4-456b-a53b-1e4d035ffecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:42.877770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21eb4b-12e4-456b-a53b-1e4d035ffecb admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:42.878119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21eb4b-12e4-456b-a53b-1e4d035ffecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:42.878458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21eb4b-12e4-456b-a53b-1e4d035ffecb admin admin] PATH_INFO: `/v3/projects/be337cdf6e7f4b7cab7d4f84d37832f7/users/c09e42a16d3a4b5a951f2859750e5359/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:42.880462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21eb4b-12e4-456b-a53b-1e4d035ffecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=be337cdf6e7f4b7cab7d4f84d37832f7, user_id=c09e42a16d3a4b5a951f2859750e5359, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:42.884549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21eb4b-12e4-456b-a53b-1e4d035ffecb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:42.945000 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3655/7276] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:32:42 2022] PUT /identity/v3/projects/be337cdf6e7f4b7cab7d4f84d37832f7/users/c09e42a16d3a4b5a951f2859750e5359/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:42.948448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3534ea8-7dd8-4209-bb3d-3ff718036484 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:42.949444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3534ea8-7dd8-4209-bb3d-3ff718036484 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:42.949908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3534ea8-7dd8-4209-bb3d-3ff718036484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:43.001189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d3534ea8-7dd8-4209-bb3d-3ff718036484 None None] MFA Rules not processed for user `c09e42a16d3a4b5a951f2859750e5359`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:43.027363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d3534ea8-7dd8-4209-bb3d-3ff718036484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:43.256021 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3622/7277] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:43.267184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21eb4b-12e4-456b-a53b-1e4d035ffecb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:43.268932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6f21eb4b-12e4-456b-a53b-1e4d035ffecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:43.371883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21eb4b-12e4-456b-a53b-1e4d035ffecb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:43.376079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c6309-07fa-4af4-9c89-b7ced287e0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:43.376847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c6309-07fa-4af4-9c89-b7ced287e0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:43.377198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c6309-07fa-4af4-9c89-b7ced287e0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:43.377525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c6309-07fa-4af4-9c89-b7ced287e0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:43.388162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c6309-07fa-4af4-9c89-b7ced287e0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:43.389693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c6309-07fa-4af4-9c89-b7ced287e0a4 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:43.404941 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3656/7278] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:43.999953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3534ea8-7dd8-4209-bb3d-3ff718036484 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:44.001777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d3534ea8-7dd8-4209-bb3d-3ff718036484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:44.066206 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:44.107651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3534ea8-7dd8-4209-bb3d-3ff718036484 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:44.146258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8796f-4422-477c-9879-e7d9a7b632d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:44.147842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8796f-4422-477c-9879-e7d9a7b632d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:44.148606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8796f-4422-477c-9879-e7d9a7b632d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:44.151170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8796f-4422-477c-9879-e7d9a7b632d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:44.161346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1fa8796f-4422-477c-9879-e7d9a7b632d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:44.348366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8796f-4422-477c-9879-e7d9a7b632d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:44.350126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8796f-4422-477c-9879-e7d9a7b632d9 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:44.374966 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3623/7279] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:53.397490 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=3,keystone:SELECT=43 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:54.362548 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=35 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:55.220680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c6309-07fa-4af4-9c89-b7ced287e0a4 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:55.222713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0c1c6309-07fa-4af4-9c89-b7ced287e0a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:55.232320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8796f-4422-477c-9879-e7d9a7b632d9 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:55.256797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8796f-4422-477c-9879-e7d9a7b632d9 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:55.265948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67598168-496e-4432-b076-44791d2850d5 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09e42a16d3a4b5a951f2859750e5359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be337cdf6e7f4b7cab7d4f84d37832f7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:55.266586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598168-496e-4432-b076-44791d2850d5 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:55.271231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598168-496e-4432-b076-44791d2850d5 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:55.271717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598168-496e-4432-b076-44791d2850d5 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:55.272504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67598168-496e-4432-b076-44791d2850d5 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:55.272787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67598168-496e-4432-b076-44791d2850d5 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:55.279764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67598168-496e-4432-b076-44791d2850d5 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:55.311870 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3624/7280] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:32:55.315865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67598168-496e-4432-b076-44791d2850d5 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:55.333656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67598168-496e-4432-b076-44791d2850d5 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:55.345787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dbe12-21ff-42d6-8df2-10400cd3877e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09e42a16d3a4b5a951f2859750e5359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be337cdf6e7f4b7cab7d4f84d37832f7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:55.346517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dbe12-21ff-42d6-8df2-10400cd3877e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:55.352626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dbe12-21ff-42d6-8df2-10400cd3877e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:55.352853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dbe12-21ff-42d6-8df2-10400cd3877e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:55.353599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dbe12-21ff-42d6-8df2-10400cd3877e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:55.356117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dbe12-21ff-42d6-8df2-10400cd3877e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:55.455123 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3625/7281] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:32:55 2022] POST /identity/v3/projects => generated 348 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:32:55.459166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dbe12-21ff-42d6-8df2-10400cd3877e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:55.507736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c6309-07fa-4af4-9c89-b7ced287e0a4 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:55.621130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dbe12-21ff-42d6-8df2-10400cd3877e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:55.633130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3834bf-9b6a-4e26-96ee-270939213352 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09e42a16d3a4b5a951f2859750e5359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be337cdf6e7f4b7cab7d4f84d37832f7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:55.633764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3834bf-9b6a-4e26-96ee-270939213352 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:55.634046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3834bf-9b6a-4e26-96ee-270939213352 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:55.634326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3834bf-9b6a-4e26-96ee-270939213352 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:55.635027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3834bf-9b6a-4e26-96ee-270939213352 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:32:55.635338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3834bf-9b6a-4e26-96ee-270939213352 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:55.636966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3834bf-9b6a-4e26-96ee-270939213352 tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:55.672178 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3626/7282] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:32:55.710471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:55.712046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:55.712302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:55.712578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] PATH_INFO: `/v3/users/08ab54f9bdae4c6ea623a7e00a2bab8a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:55.715187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ab54f9bdae4c6ea623a7e00a2bab8a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:55.719956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:55.882044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ab54f9bdae4c6ea623a7e00a2bab8a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:55.910307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ab54f9bdae4c6ea623a7e00a2bab8a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:55.911079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ab54f9bdae4c6ea623a7e00a2bab8a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:55.935636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ab54f9bdae4c6ea623a7e00a2bab8a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:55.936989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ab54f9bdae4c6ea623a7e00a2bab8a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:55.957727 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3657/7283] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:55 2022] DELETE /identity/v3/users/08ab54f9bdae4c6ea623a7e00a2bab8a => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:55.962736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf920-5cdb-4fc3-a736-0a9e7870db9a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:55.962954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf920-5cdb-4fc3-a736-0a9e7870db9a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:55.963230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf920-5cdb-4fc3-a736-0a9e7870db9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:56.017641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-beebf920-5cdb-4fc3-a736-0a9e7870db9a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:56.022301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-beebf920-5cdb-4fc3-a736-0a9e7870db9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:56.193898 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3627/7284] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:56.203720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:56.205273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:56.251627 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:56.319934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b4399-90c8-4640-a372-772b0a278b80 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:56.326890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8b3eb-97d2-46c6-8c61-0efc51ff2870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:56.327772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8b3eb-97d2-46c6-8c61-0efc51ff2870 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:56.329418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8b3eb-97d2-46c6-8c61-0efc51ff2870 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:56.329883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8b3eb-97d2-46c6-8c61-0efc51ff2870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:56.362300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8b3eb-97d2-46c6-8c61-0efc51ff2870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:56.364749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8b3eb-97d2-46c6-8c61-0efc51ff2870 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:56.391767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3658/7285] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:57.637203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebf920-5cdb-4fc3-a736-0a9e7870db9a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:57.639305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-beebf920-5cdb-4fc3-a736-0a9e7870db9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:57.869051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebf920-5cdb-4fc3-a736-0a9e7870db9a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:57.885309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09e42a16d3a4b5a951f2859750e5359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be337cdf6e7f4b7cab7d4f84d37832f7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:57.885309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:57.885309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:57.887411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] PATH_INFO: `/v3/projects/13e0be25f2fc429983a32eb5f190e0b9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:57.890570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: Authorizing `identity:delete_project(project_id=13e0be25f2fc429983a32eb5f190e0b9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:57.914110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:57.922398 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:58.006363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8b3eb-97d2-46c6-8c61-0efc51ff2870 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:58.007950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4ed8b3eb-97d2-46c6-8c61-0efc51ff2870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:58.049853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8b3eb-97d2-46c6-8c61-0efc51ff2870 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:58.073497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:58.074155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:58.074440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:58.074750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] PATH_INFO: `/v3/projects/d1c26f046c8848dea856f2e267c5b46c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:58.095555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c26f046c8848dea856f2e267c5b46c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:58.108414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:58.136505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e0be25f2fc429983a32eb5f190e0b9', 'request_id': 'req-45e7ce02-fa13-407e-9988-b616c6c2113e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.171818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e0be25f2fc429983a32eb5f190e0b9', 'request_id': 'req-45e7ce02-fa13-407e-9988-b616c6c2113e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.185032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e0be25f2fc429983a32eb5f190e0b9', 'request_id': 'req-45e7ce02-fa13-407e-9988-b616c6c2113e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.248007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] The token cache is being invalidate because project 13e0be25f2fc429983a32eb5f190e0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:58.252137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.254738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.262419 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3628/7286] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:57 2022] DELETE /identity/v3/projects/13e0be25f2fc429983a32eb5f190e0b9 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:58.263705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:58.268359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:58.282497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c26f046c8848dea856f2e267c5b46c', 'request_id': 'req-cadc6316-016a-4457-9192-9a401a9cacb2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.303084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c26f046c8848dea856f2e267c5b46c', 'request_id': 'req-cadc6316-016a-4457-9192-9a401a9cacb2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.316918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c26f046c8848dea856f2e267c5b46c', 'request_id': 'req-cadc6316-016a-4457-9192-9a401a9cacb2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.366856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] The token cache is being invalidate because project d1c26f046c8848dea856f2e267c5b46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:32:58.367172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.369791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.373478 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3659/7287] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:32:58 2022] DELETE /identity/v3/projects/d1c26f046c8848dea856f2e267c5b46c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:32:58.377271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:58.384067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:58.518976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7ce02-fa13-407e-9988-b616c6c2113e tempest-RoutersIpV6AdminTest-1100336498 tempest-RoutersIpV6AdminTest-1100336498-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:58.576144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc6316-016a-4457-9192-9a401a9cacb2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:58.599968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de77e72-b204-4980-a6ea-87f0ba424d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:58.600954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de77e72-b204-4980-a6ea-87f0ba424d97 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:58.601413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de77e72-b204-4980-a6ea-87f0ba424d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:58.602461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de77e72-b204-4980-a6ea-87f0ba424d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:58.612740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2de77e72-b204-4980-a6ea-87f0ba424d97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:58.684231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:58.687836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:58.688844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:58.690736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] PATH_INFO: `/v3/users/7ea25d2081c64c7ebdebb7714e090f52` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:58.702004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea25d2081c64c7ebdebb7714e090f52)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:58.706360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:58.811560 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:58.829254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea25d2081c64c7ebdebb7714e090f52'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.839965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de77e72-b204-4980-a6ea-87f0ba424d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:58.846315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de77e72-b204-4980-a6ea-87f0ba424d97 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:58.868491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea25d2081c64c7ebdebb7714e090f52'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.871338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea25d2081c64c7ebdebb7714e090f52'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.889018 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3660/7288] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:32:58.890741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea25d2081c64c7ebdebb7714e090f52'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.902499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea25d2081c64c7ebdebb7714e090f52'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:32:58.922162 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3629/7289] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:32:58 2022] DELETE /identity/v3/users/7ea25d2081c64c7ebdebb7714e090f52 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:32:58.927044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7e6d-a35e-482c-975d-78ea55762d6a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:58.927335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7e6d-a35e-482c-975d-78ea55762d6a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:58.927606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7e6d-a35e-482c-975d-78ea55762d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:59.008829 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:32:59.044030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-00de7e6d-a35e-482c-975d-78ea55762d6a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:32:59.045296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-00de7e6d-a35e-482c-975d-78ea55762d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:59.222000 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3661/7290] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:32:59.267664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:32:59.269403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:32:59.454198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478d4e4-739c-4da7-a1f4-086ccbf24936 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:32:59.464244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1cc8d-67b7-42f9-a7ea-5be470d0b6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:32:59.465113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1cc8d-67b7-42f9-a7ea-5be470d0b6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:32:59.465387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1cc8d-67b7-42f9-a7ea-5be470d0b6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:32:59.465661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1cc8d-67b7-42f9-a7ea-5be470d0b6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:32:59.490501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1cc8d-67b7-42f9-a7ea-5be470d0b6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:32:59.495457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1cc8d-67b7-42f9-a7ea-5be470d0b6e0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:32:59.527168 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3630/7291] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:33:01.109102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de7e6d-a35e-482c-975d-78ea55762d6a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:01.111775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-00de7e6d-a35e-482c-975d-78ea55762d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:01.138711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de7e6d-a35e-482c-975d-78ea55762d6a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:01.151112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:01.152154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:01.152391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:01.152666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] PATH_INFO: `/v3/projects/688c28c4dbe84c969d86edb97d1d3276` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:01.155253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688c28c4dbe84c969d86edb97d1d3276)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:01.157255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:01.296816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688c28c4dbe84c969d86edb97d1d3276', 'request_id': 'req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:01.306587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688c28c4dbe84c969d86edb97d1d3276', 'request_id': 'req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:01.315937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688c28c4dbe84c969d86edb97d1d3276', 'request_id': 'req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:01.333352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] The token cache is being invalidate because project 688c28c4dbe84c969d86edb97d1d3276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:33:01.335122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:01.337471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:01.339728 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3662/7292] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:33:01 2022] DELETE /identity/v3/projects/688c28c4dbe84c969d86edb97d1d3276 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:01.344534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1cc8d-67b7-42f9-a7ea-5be470d0b6e0 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:01.358020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1cc8d-67b7-42f9-a7ea-5be470d0b6e0 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:01.483772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f22535-4c4a-4506-a11f-9a3e6d3b83c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:01.484901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22535-4c4a-4506-a11f-9a3e6d3b83c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:01.485453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22535-4c4a-4506-a11f-9a3e6d3b83c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:01.485973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22535-4c4a-4506-a11f-9a3e6d3b83c1 admin admin] PATH_INFO: `/v3/users/384048175b724e5a9225641e8a3b03f3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:01.488342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f22535-4c4a-4506-a11f-9a3e6d3b83c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384048175b724e5a9225641e8a3b03f3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:01.492016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f22535-4c4a-4506-a11f-9a3e6d3b83c1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:01.612915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7f22535-4c4a-4506-a11f-9a3e6d3b83c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384048175b724e5a9225641e8a3b03f3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:01.634165 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:01.636898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7f22535-4c4a-4506-a11f-9a3e6d3b83c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384048175b724e5a9225641e8a3b03f3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:01.637829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7f22535-4c4a-4506-a11f-9a3e6d3b83c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384048175b724e5a9225641e8a3b03f3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:01.666023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7f22535-4c4a-4506-a11f-9a3e6d3b83c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384048175b724e5a9225641e8a3b03f3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:01.678020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d7f22535-4c4a-4506-a11f-9a3e6d3b83c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384048175b724e5a9225641e8a3b03f3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:01.718132 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3631/7293] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:33:01 2022] DELETE /identity/v3/users/384048175b724e5a9225641e8a3b03f3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:02.510543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:02.510543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:02.552880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfd24c-dc06-4f1c-b22b-4fb6c0f4c025 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:02.700345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:02.700924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:02.701212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:02.701491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] PATH_INFO: `/v3/projects/acb251945cdc4c3c98053c53bb3a135d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:02.703902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb251945cdc4c3c98053c53bb3a135d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:02.705877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:02.819075 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:02.847838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb251945cdc4c3c98053c53bb3a135d', 'request_id': 'req-18258f0d-48d8-47eb-8c74-4373fce73906'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:02.860994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb251945cdc4c3c98053c53bb3a135d', 'request_id': 'req-18258f0d-48d8-47eb-8c74-4373fce73906'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:02.871120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb251945cdc4c3c98053c53bb3a135d', 'request_id': 'req-18258f0d-48d8-47eb-8c74-4373fce73906'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:02.911565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] The token cache is being invalidate because project acb251945cdc4c3c98053c53bb3a135d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:33:02.912165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:02.913420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18258f0d-48d8-47eb-8c74-4373fce73906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:02.918880 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3663/7294] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:33:02 2022] DELETE /identity/v3/projects/acb251945cdc4c3c98053c53bb3a135d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:02.923503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ff936-745c-4552-8cf5-9a16540760dc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:02.924032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ff936-745c-4552-8cf5-9a16540760dc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:02.924125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ff936-745c-4552-8cf5-9a16540760dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:02.971166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7d8ff936-745c-4552-8cf5-9a16540760dc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:02.976199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7d8ff936-745c-4552-8cf5-9a16540760dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:03.151727 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3632/7295] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:03.152905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b41b38-bb69-459b-8efc-c7a8bd112004 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:03.153197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b41b38-bb69-459b-8efc-c7a8bd112004 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:03.153500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b41b38-bb69-459b-8efc-c7a8bd112004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:03.195023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a4b41b38-bb69-459b-8efc-c7a8bd112004 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:03.196789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a4b41b38-bb69-459b-8efc-c7a8bd112004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:03.216095 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3664/7296] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:03.217392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ff936-745c-4552-8cf5-9a16540760dc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:03.229823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ff936-745c-4552-8cf5-9a16540760dc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:03.235717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63c712-0a25-4de4-bd0c-f069a8c3c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:03.236512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63c712-0a25-4de4-bd0c-f069a8c3c39f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:03.236889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63c712-0a25-4de4-bd0c-f069a8c3c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:03.237258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63c712-0a25-4de4-bd0c-f069a8c3c39f admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:03.238166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63c712-0a25-4de4-bd0c-f069a8c3c39f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:33:03.238807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63c712-0a25-4de4-bd0c-f069a8c3c39f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:03.240637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63c712-0a25-4de4-bd0c-f069a8c3c39f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:03.260883 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3633/7297] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:33:03.262161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b41b38-bb69-459b-8efc-c7a8bd112004 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:03.279637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b41b38-bb69-459b-8efc-c7a8bd112004 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:03.291310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce79af0-84e9-4187-b4ce-98fd45b6ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:03.291946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79af0-84e9-4187-b4ce-98fd45b6ae93 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:03.292227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79af0-84e9-4187-b4ce-98fd45b6ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:03.292506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79af0-84e9-4187-b4ce-98fd45b6ae93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:03.293154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce79af0-84e9-4187-b4ce-98fd45b6ae93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:03.295173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce79af0-84e9-4187-b4ce-98fd45b6ae93 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:03.367056 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3665/7298] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:33:03 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:03.371454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63c712-0a25-4de4-bd0c-f069a8c3c39f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:03.422395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63c712-0a25-4de4-bd0c-f069a8c3c39f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:03.516758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b503b-5673-4321-88f2-710123ce805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:03.516973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b503b-5673-4321-88f2-710123ce805f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:03.517257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b503b-5673-4321-88f2-710123ce805f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:03.517504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b503b-5673-4321-88f2-710123ce805f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:03.518210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b503b-5673-4321-88f2-710123ce805f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:03.520503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b503b-5673-4321-88f2-710123ce805f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:03.559067 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3634/7299] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:33:03 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:03.562697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce79af0-84e9-4187-b4ce-98fd45b6ae93 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:03.580757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce79af0-84e9-4187-b4ce-98fd45b6ae93 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:03.595581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f4c52-d260-47f2-b825-c443c3a862f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:03.597132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f4c52-d260-47f2-b825-c443c3a862f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:03.598534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f4c52-d260-47f2-b825-c443c3a862f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:03.599078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f4c52-d260-47f2-b825-c443c3a862f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:03.603063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f4c52-d260-47f2-b825-c443c3a862f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:03.606335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f4c52-d260-47f2-b825-c443c3a862f8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:03.640835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b503b-5673-4321-88f2-710123ce805f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:03.641005 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3666/7300] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:33:03.656206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b503b-5673-4321-88f2-710123ce805f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:03.661476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1927c-946e-45b4-96ec-dfb7323e0698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:03.662529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1927c-946e-45b4-96ec-dfb7323e0698 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:03.662912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1927c-946e-45b4-96ec-dfb7323e0698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:03.663271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1927c-946e-45b4-96ec-dfb7323e0698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:03.664856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1927c-946e-45b4-96ec-dfb7323e0698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:03.668582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1927c-946e-45b4-96ec-dfb7323e0698 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:03.711688 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3635/7301] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:03.713325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f4c52-d260-47f2-b825-c443c3a862f8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:03.727729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f4c52-d260-47f2-b825-c443c3a862f8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:03.781637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631d9db-4bfe-48f7-acfe-8c2b0ddc3df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:03.781863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631d9db-4bfe-48f7-acfe-8c2b0ddc3df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:03.782149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631d9db-4bfe-48f7-acfe-8c2b0ddc3df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:03.782441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631d9db-4bfe-48f7-acfe-8c2b0ddc3df8 admin admin] PATH_INFO: `/v3/projects/7b9715961eae4fc19ddd017f2469504e/users/7dd0ed8618f9444aa231d097c8646b44/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:03.816922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631d9db-4bfe-48f7-acfe-8c2b0ddc3df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9715961eae4fc19ddd017f2469504e, user_id=7dd0ed8618f9444aa231d097c8646b44, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:03.821834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631d9db-4bfe-48f7-acfe-8c2b0ddc3df8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:03.842961 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3667/7302] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:33:03 2022] PUT /identity/v3/projects/7b9715961eae4fc19ddd017f2469504e/users/7dd0ed8618f9444aa231d097c8646b44/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:03.854836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50743f-ea8f-48dc-b746-2d141989f0d5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:03.855414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50743f-ea8f-48dc-b746-2d141989f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:03.856167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50743f-ea8f-48dc-b746-2d141989f0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:03.895171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea50743f-ea8f-48dc-b746-2d141989f0d5 None None] MFA Rules not processed for user `7dd0ed8618f9444aa231d097c8646b44`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:03.898104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea50743f-ea8f-48dc-b746-2d141989f0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:03.991203 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:04.092670 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3636/7303] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:04.097777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631d9db-4bfe-48f7-acfe-8c2b0ddc3df8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:04.254730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631d9db-4bfe-48f7-acfe-8c2b0ddc3df8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:04.268695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce1df0-9ac7-4b8d-8620-206fd07b95ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:04.269396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce1df0-9ac7-4b8d-8620-206fd07b95ba admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:04.269605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce1df0-9ac7-4b8d-8620-206fd07b95ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:04.269876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce1df0-9ac7-4b8d-8620-206fd07b95ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:04.270519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce1df0-9ac7-4b8d-8620-206fd07b95ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:04.277354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce1df0-9ac7-4b8d-8620-206fd07b95ba admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:04.378025 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3668/7304] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:33:04 2022] POST /identity/v3/projects => generated 387 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:04.394196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50743f-ea8f-48dc-b746-2d141989f0d5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:04.458250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50743f-ea8f-48dc-b746-2d141989f0d5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:04.594168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22276e15-f04c-4b9e-b95e-a12a37928bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:04.595092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276e15-f04c-4b9e-b95e-a12a37928bca admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:04.596593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276e15-f04c-4b9e-b95e-a12a37928bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:04.597079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276e15-f04c-4b9e-b95e-a12a37928bca admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:04.598297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22276e15-f04c-4b9e-b95e-a12a37928bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:04.606101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22276e15-f04c-4b9e-b95e-a12a37928bca admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:04.664543 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3637/7305] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:33:04 2022] POST /identity/v3/users => generated 300 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:04.668736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce1df0-9ac7-4b8d-8620-206fd07b95ba admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:04.685126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce1df0-9ac7-4b8d-8620-206fd07b95ba admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:04.702427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc3028-f5dd-45a3-b386-cdd91014693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:04.703533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3028-f5dd-45a3-b386-cdd91014693a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:04.704095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3028-f5dd-45a3-b386-cdd91014693a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:04.704661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3028-f5dd-45a3-b386-cdd91014693a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:04.705661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc3028-f5dd-45a3-b386-cdd91014693a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:04.707641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc3028-f5dd-45a3-b386-cdd91014693a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:04.727228 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3669/7306] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:04.731518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22276e15-f04c-4b9e-b95e-a12a37928bca admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:04.741670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22276e15-f04c-4b9e-b95e-a12a37928bca admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:04.747613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b31bd-7db4-44b6-ba68-54450747095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:04.748279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b31bd-7db4-44b6-ba68-54450747095c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:04.748560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b31bd-7db4-44b6-ba68-54450747095c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:04.748837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b31bd-7db4-44b6-ba68-54450747095c admin admin] PATH_INFO: `/v3/projects/56e4d6d1fcad4642978c7abd80ee7796/users/ccdf08531c6e4e34963fa1d931b78e16/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:04.767085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b31bd-7db4-44b6-ba68-54450747095c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e4d6d1fcad4642978c7abd80ee7796, user_id=ccdf08531c6e4e34963fa1d931b78e16, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:04.770504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b31bd-7db4-44b6-ba68-54450747095c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:04.789459 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3638/7307] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:33:04 2022] PUT /identity/v3/projects/56e4d6d1fcad4642978c7abd80ee7796/users/ccdf08531c6e4e34963fa1d931b78e16/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:04.793310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc3028-f5dd-45a3-b386-cdd91014693a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:04.804349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc3028-f5dd-45a3-b386-cdd91014693a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:04.838255 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:04.884120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f2d8b-eb1c-4f34-9bf2-bd1266f942b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:04.884864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2d8b-eb1c-4f34-9bf2-bd1266f942b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:04.885143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2d8b-eb1c-4f34-9bf2-bd1266f942b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:04.885414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2d8b-eb1c-4f34-9bf2-bd1266f942b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:04.886211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f2d8b-eb1c-4f34-9bf2-bd1266f942b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:04.887851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f2d8b-eb1c-4f34-9bf2-bd1266f942b8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:04.899372 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3670/7308] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:04.904037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b31bd-7db4-44b6-ba68-54450747095c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:04.915613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b31bd-7db4-44b6-ba68-54450747095c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:04.921369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91763f1-7d9d-40b1-9bce-bb110d48aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:04.922120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91763f1-7d9d-40b1-9bce-bb110d48aee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:04.922471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91763f1-7d9d-40b1-9bce-bb110d48aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:04.922879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91763f1-7d9d-40b1-9bce-bb110d48aee6 admin admin] PATH_INFO: `/v3/projects/56e4d6d1fcad4642978c7abd80ee7796/users/ccdf08531c6e4e34963fa1d931b78e16/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:04.925304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91763f1-7d9d-40b1-9bce-bb110d48aee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e4d6d1fcad4642978c7abd80ee7796, user_id=ccdf08531c6e4e34963fa1d931b78e16, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:04.928263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91763f1-7d9d-40b1-9bce-bb110d48aee6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:04.941940 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3639/7309] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:33:04 2022] PUT /identity/v3/projects/56e4d6d1fcad4642978c7abd80ee7796/users/ccdf08531c6e4e34963fa1d931b78e16/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:04.956975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5219c-fa64-44eb-85a9-9a86fea255ca None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:04.957278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5219c-fa64-44eb-85a9-9a86fea255ca None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:04.957536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5219c-fa64-44eb-85a9-9a86fea255ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:05.012856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3cf5219c-fa64-44eb-85a9-9a86fea255ca None None] MFA Rules not processed for user `ccdf08531c6e4e34963fa1d931b78e16`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:05.014284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3cf5219c-fa64-44eb-85a9-9a86fea255ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:05.094519 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3671/7310] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:05.106072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91763f1-7d9d-40b1-9bce-bb110d48aee6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:05.108004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c91763f1-7d9d-40b1-9bce-bb110d48aee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:05.184306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91763f1-7d9d-40b1-9bce-bb110d48aee6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:05.188027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a557f0-8c40-4173-a6fa-4838f7f133ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:05.188898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a557f0-8c40-4173-a6fa-4838f7f133ea service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:05.189185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a557f0-8c40-4173-a6fa-4838f7f133ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:05.189464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a557f0-8c40-4173-a6fa-4838f7f133ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:05.200497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a557f0-8c40-4173-a6fa-4838f7f133ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:05.201821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a557f0-8c40-4173-a6fa-4838f7f133ea service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:05.213044 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3640/7311] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:33:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:33:06.088872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5219c-fa64-44eb-85a9-9a86fea255ca None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:06.206117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5219c-fa64-44eb-85a9-9a86fea255ca None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:06.213977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:06.214664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:06.214964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:06.215211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] PATH_INFO: `/v3/users/7dd0ed8618f9444aa231d097c8646b44` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:06.216601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd0ed8618f9444aa231d097c8646b44)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:06.218760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:06.323636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd0ed8618f9444aa231d097c8646b44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:06.335292 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:06.351879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd0ed8618f9444aa231d097c8646b44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:06.352628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd0ed8618f9444aa231d097c8646b44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:06.372587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd0ed8618f9444aa231d097c8646b44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:06.373229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd0ed8618f9444aa231d097c8646b44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:06.397982 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3672/7312] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:33:06 2022] DELETE /identity/v3/users/7dd0ed8618f9444aa231d097c8646b44 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:06.402895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f6897-817c-4c16-abf2-957a0460963f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:06.403840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f6897-817c-4c16-abf2-957a0460963f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:06.404275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f6897-817c-4c16-abf2-957a0460963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:06.445401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d89f6897-817c-4c16-abf2-957a0460963f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:06.459067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d89f6897-817c-4c16-abf2-957a0460963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:06.507286 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:06.598509 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3641/7313] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:06.624030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:06.626474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:06.786218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93feb569-d2f3-4fe2-b1a1-029afbbe01af admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:06.799002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfd7c4-aa23-408a-9046-c1592125a83c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:06.799503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfd7c4-aa23-408a-9046-c1592125a83c service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:06.799789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfd7c4-aa23-408a-9046-c1592125a83c service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:06.800231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfd7c4-aa23-408a-9046-c1592125a83c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:06.840696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfd7c4-aa23-408a-9046-c1592125a83c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:06.842475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfd7c4-aa23-408a-9046-c1592125a83c service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:06.871753 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3673/7314] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:33:08.345500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f6897-817c-4c16-abf2-957a0460963f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:08.347139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d89f6897-817c-4c16-abf2-957a0460963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:08.374215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f6897-817c-4c16-abf2-957a0460963f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:08.388758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:08.389984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:08.390321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:08.391475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] PATH_INFO: `/v3/projects/7b9715961eae4fc19ddd017f2469504e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:08.393290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9715961eae4fc19ddd017f2469504e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:08.396029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:08.533033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9715961eae4fc19ddd017f2469504e', 'request_id': 'req-822c0094-492a-462a-97cf-c5bcbbf42bb6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:08.552119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9715961eae4fc19ddd017f2469504e', 'request_id': 'req-822c0094-492a-462a-97cf-c5bcbbf42bb6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:08.576684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9715961eae4fc19ddd017f2469504e', 'request_id': 'req-822c0094-492a-462a-97cf-c5bcbbf42bb6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:08.604095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] The token cache is being invalidate because project 7b9715961eae4fc19ddd017f2469504e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:33:08.604956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:08.606024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:08.607988 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3642/7315] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:33:08 2022] DELETE /identity/v3/projects/7b9715961eae4fc19ddd017f2469504e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:08.612965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfd7c4-aa23-408a-9046-c1592125a83c service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:08.638720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfd7c4-aa23-408a-9046-c1592125a83c service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:08.746506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a51e69-ac2a-4a2d-a035-1a157911b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:08.747511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a51e69-ac2a-4a2d-a035-1a157911b302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:08.747801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a51e69-ac2a-4a2d-a035-1a157911b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:08.748075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a51e69-ac2a-4a2d-a035-1a157911b302 admin admin] PATH_INFO: `/v3/users/ccdf08531c6e4e34963fa1d931b78e16` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:08.750407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a51e69-ac2a-4a2d-a035-1a157911b302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccdf08531c6e4e34963fa1d931b78e16)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:08.753187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a51e69-ac2a-4a2d-a035-1a157911b302 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:08.841662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-42a51e69-ac2a-4a2d-a035-1a157911b302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccdf08531c6e4e34963fa1d931b78e16'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:08.868582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-42a51e69-ac2a-4a2d-a035-1a157911b302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccdf08531c6e4e34963fa1d931b78e16'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:08.869979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-42a51e69-ac2a-4a2d-a035-1a157911b302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccdf08531c6e4e34963fa1d931b78e16'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:08.889098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-42a51e69-ac2a-4a2d-a035-1a157911b302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccdf08531c6e4e34963fa1d931b78e16'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:08.890093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-42a51e69-ac2a-4a2d-a035-1a157911b302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccdf08531c6e4e34963fa1d931b78e16'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:08.901346 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:08.951263 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3674/7316] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:33:08 2022] DELETE /identity/v3/users/ccdf08531c6e4e34963fa1d931b78e16 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:10.305837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:10.308482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:10.339803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c0094-492a-462a-97cf-c5bcbbf42bb6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:10.481825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:10.482721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:10.483181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:10.483454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] PATH_INFO: `/v3/projects/56e4d6d1fcad4642978c7abd80ee7796` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:10.484964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e4d6d1fcad4642978c7abd80ee7796)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:10.487923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:10.599991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e4d6d1fcad4642978c7abd80ee7796', 'request_id': 'req-4b779134-3579-4659-ad31-87e049b6484b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:10.608367 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:10.612085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e4d6d1fcad4642978c7abd80ee7796', 'request_id': 'req-4b779134-3579-4659-ad31-87e049b6484b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:10.630413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e4d6d1fcad4642978c7abd80ee7796', 'request_id': 'req-4b779134-3579-4659-ad31-87e049b6484b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:10.654155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] The token cache is being invalidate because project 56e4d6d1fcad4642978c7abd80ee7796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:33:10.655324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:10.656251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b779134-3579-4659-ad31-87e049b6484b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:10.659380 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3643/7317] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:33:10 2022] DELETE /identity/v3/projects/56e4d6d1fcad4642978c7abd80ee7796 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:10.664815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce68ed-21f7-4074-86e1-fa423676aed1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:10.665473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce68ed-21f7-4074-86e1-fa423676aed1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:10.665473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce68ed-21f7-4074-86e1-fa423676aed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:10.695680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-83ce68ed-21f7-4074-86e1-fa423676aed1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:10.698906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-83ce68ed-21f7-4074-86e1-fa423676aed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:10.892708 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3675/7318] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:10.894202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9b2eb-b7ad-49a5-bf5b-1815359b91d0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:10.894831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9b2eb-b7ad-49a5-bf5b-1815359b91d0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:10.895219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9b2eb-b7ad-49a5-bf5b-1815359b91d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:10.949892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-72a9b2eb-b7ad-49a5-bf5b-1815359b91d0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:10.952751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-72a9b2eb-b7ad-49a5-bf5b-1815359b91d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:10.980185 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3644/7319] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:10.983861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce68ed-21f7-4074-86e1-fa423676aed1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:10.997386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce68ed-21f7-4074-86e1-fa423676aed1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:11.002841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14d009-9056-4037-a6f2-917b37cf17b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:11.003683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14d009-9056-4037-a6f2-917b37cf17b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:11.004161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14d009-9056-4037-a6f2-917b37cf17b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:11.004599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14d009-9056-4037-a6f2-917b37cf17b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:11.005434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14d009-9056-4037-a6f2-917b37cf17b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:33:11.005903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14d009-9056-4037-a6f2-917b37cf17b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:11.007745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14d009-9056-4037-a6f2-917b37cf17b5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:11.026203 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3676/7320] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:33:11.027231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9b2eb-b7ad-49a5-bf5b-1815359b91d0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:11.042195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9b2eb-b7ad-49a5-bf5b-1815359b91d0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:11.058548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2775f4-458b-402c-91de-3daec64d3c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:11.059371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2775f4-458b-402c-91de-3daec64d3c65 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:11.059753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2775f4-458b-402c-91de-3daec64d3c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:11.060092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2775f4-458b-402c-91de-3daec64d3c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:11.061742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2775f4-458b-402c-91de-3daec64d3c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:11.064827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2775f4-458b-402c-91de-3daec64d3c65 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:11.150696 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3645/7321] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:33:11 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:33:11.153057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14d009-9056-4037-a6f2-917b37cf17b5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:11.184072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14d009-9056-4037-a6f2-917b37cf17b5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:11.309454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc87fe4-e154-4fb6-a07b-592294689790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:11.310087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc87fe4-e154-4fb6-a07b-592294689790 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:11.310375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc87fe4-e154-4fb6-a07b-592294689790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:11.310681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc87fe4-e154-4fb6-a07b-592294689790 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:11.311576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc87fe4-e154-4fb6-a07b-592294689790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:11.313541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc87fe4-e154-4fb6-a07b-592294689790 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:11.360752 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3677/7322] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:33:11 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:11.364547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2775f4-458b-402c-91de-3daec64d3c65 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:11.382584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2775f4-458b-402c-91de-3daec64d3c65 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:11.391209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141063a-2420-4999-93fb-512b38dfc537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:11.391967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141063a-2420-4999-93fb-512b38dfc537 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:11.392355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141063a-2420-4999-93fb-512b38dfc537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:11.392732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141063a-2420-4999-93fb-512b38dfc537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:11.393474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141063a-2420-4999-93fb-512b38dfc537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:11.402528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141063a-2420-4999-93fb-512b38dfc537 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:11.428917 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3646/7323] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:11.430566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc87fe4-e154-4fb6-a07b-592294689790 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:11.446717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc87fe4-e154-4fb6-a07b-592294689790 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:11.462549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574d456-3c95-44d5-ad1a-efcaf44e1a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:11.463345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574d456-3c95-44d5-ad1a-efcaf44e1a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:11.463726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574d456-3c95-44d5-ad1a-efcaf44e1a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:11.464103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574d456-3c95-44d5-ad1a-efcaf44e1a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:11.464848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574d456-3c95-44d5-ad1a-efcaf44e1a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:11.466537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574d456-3c95-44d5-ad1a-efcaf44e1a05 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:11.494103 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3678/7324] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:11.496714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141063a-2420-4999-93fb-512b38dfc537 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:11.513622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141063a-2420-4999-93fb-512b38dfc537 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:11.525318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055895f-7b41-4cd4-96d6-70272961689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:11.526122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055895f-7b41-4cd4-96d6-70272961689a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:11.526488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055895f-7b41-4cd4-96d6-70272961689a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:11.526873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055895f-7b41-4cd4-96d6-70272961689a admin admin] PATH_INFO: `/v3/projects/36c54a6e9861492697a97e31870c8b75/users/ba242671199a4aea9a14acdaa03ae3af/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:11.561581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055895f-7b41-4cd4-96d6-70272961689a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c54a6e9861492697a97e31870c8b75, user_id=ba242671199a4aea9a14acdaa03ae3af, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:11.565297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055895f-7b41-4cd4-96d6-70272961689a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:11.593906 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3647/7325] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:33:11 2022] PUT /identity/v3/projects/36c54a6e9861492697a97e31870c8b75/users/ba242671199a4aea9a14acdaa03ae3af/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:11.606678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7eb3d-24fa-42e8-afe1-53f0c84800b2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:11.607087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7eb3d-24fa-42e8-afe1-53f0c84800b2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:11.607467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7eb3d-24fa-42e8-afe1-53f0c84800b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:11.661878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0de7eb3d-24fa-42e8-afe1-53f0c84800b2 None None] MFA Rules not processed for user `ba242671199a4aea9a14acdaa03ae3af`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:11.671156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0de7eb3d-24fa-42e8-afe1-53f0c84800b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:11.768092 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:11.820795 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3679/7326] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:11.824438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055895f-7b41-4cd4-96d6-70272961689a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:11.976185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055895f-7b41-4cd4-96d6-70272961689a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:11.981361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961b089-2298-4de4-8442-6f20d75a06f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:11.982133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961b089-2298-4de4-8442-6f20d75a06f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:11.982520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961b089-2298-4de4-8442-6f20d75a06f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:11.983065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961b089-2298-4de4-8442-6f20d75a06f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:11.984058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961b089-2298-4de4-8442-6f20d75a06f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:11.986100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961b089-2298-4de4-8442-6f20d75a06f9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:12.032225 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3648/7327] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:33:11 2022] POST /identity/v3/projects => generated 383 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:12.034801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7eb3d-24fa-42e8-afe1-53f0c84800b2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:12.053271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7eb3d-24fa-42e8-afe1-53f0c84800b2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:12.216806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7758d-523c-4e4e-be6d-dccfa6b03512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:12.217831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7758d-523c-4e4e-be6d-dccfa6b03512 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:12.218192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7758d-523c-4e4e-be6d-dccfa6b03512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:12.218542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7758d-523c-4e4e-be6d-dccfa6b03512 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:12.221797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7758d-523c-4e4e-be6d-dccfa6b03512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:12.229554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7758d-523c-4e4e-be6d-dccfa6b03512 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:12.279924 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3680/7328] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:33:12 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:12.281553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961b089-2298-4de4-8442-6f20d75a06f9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:12.341968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961b089-2298-4de4-8442-6f20d75a06f9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:12.369858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbeddd3-78c0-49a7-ad86-5cd61695a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:12.372955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbeddd3-78c0-49a7-ad86-5cd61695a1bb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:12.374377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbeddd3-78c0-49a7-ad86-5cd61695a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:12.376962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbeddd3-78c0-49a7-ad86-5cd61695a1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:12.379096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbeddd3-78c0-49a7-ad86-5cd61695a1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:12.386822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbeddd3-78c0-49a7-ad86-5cd61695a1bb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:12.435280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7758d-523c-4e4e-be6d-dccfa6b03512 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:12.437436 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3649/7329] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:12.453234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7758d-523c-4e4e-be6d-dccfa6b03512 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:12.471987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc791a-8d50-4d32-9bc6-fa78a6945a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:12.473741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc791a-8d50-4d32-9bc6-fa78a6945a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:12.473741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc791a-8d50-4d32-9bc6-fa78a6945a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:12.473741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc791a-8d50-4d32-9bc6-fa78a6945a38 admin admin] PATH_INFO: `/v3/projects/fa25d17f37d542e59ed4bc27b5af9212/users/21a6da7aa9094a4b99351cf062a9d442/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:12.542224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc791a-8d50-4d32-9bc6-fa78a6945a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa25d17f37d542e59ed4bc27b5af9212, user_id=21a6da7aa9094a4b99351cf062a9d442, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:12.548576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc791a-8d50-4d32-9bc6-fa78a6945a38 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:12.604903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbeddd3-78c0-49a7-ad86-5cd61695a1bb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:12.605568 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3681/7330] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:33:12 2022] PUT /identity/v3/projects/fa25d17f37d542e59ed4bc27b5af9212/users/21a6da7aa9094a4b99351cf062a9d442/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:12.623505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbeddd3-78c0-49a7-ad86-5cd61695a1bb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:12.814337 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:12.836074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273329e-a55f-4dd1-b2e5-5c7e7c3ed23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:12.837067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273329e-a55f-4dd1-b2e5-5c7e7c3ed23d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:12.837398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273329e-a55f-4dd1-b2e5-5c7e7c3ed23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:12.837712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273329e-a55f-4dd1-b2e5-5c7e7c3ed23d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:12.841593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273329e-a55f-4dd1-b2e5-5c7e7c3ed23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:12.843925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273329e-a55f-4dd1-b2e5-5c7e7c3ed23d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:12.869228 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3650/7331] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:12.873854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc791a-8d50-4d32-9bc6-fa78a6945a38 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:12.893863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc791a-8d50-4d32-9bc6-fa78a6945a38 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:12.911602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690c66b-064c-47ad-8f5b-c323a7d347c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:12.912466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690c66b-064c-47ad-8f5b-c323a7d347c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:12.912782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690c66b-064c-47ad-8f5b-c323a7d347c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:12.913027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690c66b-064c-47ad-8f5b-c323a7d347c0 admin admin] PATH_INFO: `/v3/projects/fa25d17f37d542e59ed4bc27b5af9212/users/21a6da7aa9094a4b99351cf062a9d442/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:12.923615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690c66b-064c-47ad-8f5b-c323a7d347c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa25d17f37d542e59ed4bc27b5af9212, user_id=21a6da7aa9094a4b99351cf062a9d442, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:12.932086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690c66b-064c-47ad-8f5b-c323a7d347c0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:12.982892 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3682/7332] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:33:12 2022] PUT /identity/v3/projects/fa25d17f37d542e59ed4bc27b5af9212/users/21a6da7aa9094a4b99351cf062a9d442/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:12.989371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6802f6-c935-4bab-8a6a-06f15362489b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:12.989659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6802f6-c935-4bab-8a6a-06f15362489b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:12.989949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6802f6-c935-4bab-8a6a-06f15362489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:13.068703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6b6802f6-c935-4bab-8a6a-06f15362489b None None] MFA Rules not processed for user `21a6da7aa9094a4b99351cf062a9d442`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:13.072903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b6802f6-c935-4bab-8a6a-06f15362489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:13.370419 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3651/7333] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:13.383778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690c66b-064c-47ad-8f5b-c323a7d347c0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:13.385891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2690c66b-064c-47ad-8f5b-c323a7d347c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:13.583573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690c66b-064c-47ad-8f5b-c323a7d347c0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:13.594041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4127b5f-4d5b-40a5-8d30-fc4026748c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:13.594791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4127b5f-4d5b-40a5-8d30-fc4026748c34 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:13.596562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4127b5f-4d5b-40a5-8d30-fc4026748c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:13.596898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4127b5f-4d5b-40a5-8d30-fc4026748c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:13.803809 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:13.812321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4127b5f-4d5b-40a5-8d30-fc4026748c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:13.815139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4127b5f-4d5b-40a5-8d30-fc4026748c34 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:13.839442 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3683/7334] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:33:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:33:15.392871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6802f6-c935-4bab-8a6a-06f15362489b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:15.394344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b6802f6-c935-4bab-8a6a-06f15362489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:15.563205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6802f6-c935-4bab-8a6a-06f15362489b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:15.577677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4051a-c7b5-46bf-bd45-648a5f1e3944 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:15.578437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4051a-c7b5-46bf-bd45-648a5f1e3944 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:15.578840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4051a-c7b5-46bf-bd45-648a5f1e3944 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:15.579215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4051a-c7b5-46bf-bd45-648a5f1e3944 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:15.585431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5fb4051a-c7b5-46bf-bd45-648a5f1e3944 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:15.729621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4051a-c7b5-46bf-bd45-648a5f1e3944 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:15.734282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4051a-c7b5-46bf-bd45-648a5f1e3944 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:15.781817 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3652/7335] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:33:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 655 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:33:16.506571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e01ba9-1298-4008-91ad-57879e2c9a90 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:16.507087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e01ba9-1298-4008-91ad-57879e2c9a90 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:16.507181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e01ba9-1298-4008-91ad-57879e2c9a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:16.589444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-02e01ba9-1298-4008-91ad-57879e2c9a90 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:16.591002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-02e01ba9-1298-4008-91ad-57879e2c9a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:16.772413 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3684/7336] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:16.850708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4051a-c7b5-46bf-bd45-648a5f1e3944 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:16.882565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4051a-c7b5-46bf-bd45-648a5f1e3944 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:16.895747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807429-1c74-4810-adba-db5583513fb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:16.896755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807429-1c74-4810-adba-db5583513fb2 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:16.897213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807429-1c74-4810-adba-db5583513fb2 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:16.897680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807429-1c74-4810-adba-db5583513fb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:16.913095 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:16.927823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a807429-1c74-4810-adba-db5583513fb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:16.940337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a807429-1c74-4810-adba-db5583513fb2 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:16.969032 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3653/7337] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:33:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:33:18.865654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e01ba9-1298-4008-91ad-57879e2c9a90 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:18.867157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-02e01ba9-1298-4008-91ad-57879e2c9a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:19.225390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e01ba9-1298-4008-91ad-57879e2c9a90 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:19.244862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:19.245895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:19.246424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:19.247065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] PATH_INFO: `/v3/users/e87f219e3ac74ea8bda354a050e26ad0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:19.249693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87f219e3ac74ea8bda354a050e26ad0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:19.252099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:19.398023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87f219e3ac74ea8bda354a050e26ad0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:19.458409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87f219e3ac74ea8bda354a050e26ad0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:19.459489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87f219e3ac74ea8bda354a050e26ad0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:19.482790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87f219e3ac74ea8bda354a050e26ad0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:19.484389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87f219e3ac74ea8bda354a050e26ad0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:19.518424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3685/7338] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:33:18 2022] DELETE /identity/v3/users/e87f219e3ac74ea8bda354a050e26ad0 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:19.524203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dacb2-be1b-490d-be7b-7e7a123f2ad8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:19.526299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dacb2-be1b-490d-be7b-7e7a123f2ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:19.526764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dacb2-be1b-490d-be7b-7e7a123f2ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:19.571390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0b2dacb2-be1b-490d-be7b-7e7a123f2ad8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:19.573776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b2dacb2-be1b-490d-be7b-7e7a123f2ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:19.758453 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3654/7339] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:19.872585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:19.875125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:19.914078 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:20.116898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a1e4e-f143-4c6f-8ef1-7c3f8b68ce62 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:20.128272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637e36-adc0-452d-a4bd-27c636812480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:20.143359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637e36-adc0-452d-a4bd-27c636812480 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:20.143692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637e36-adc0-452d-a4bd-27c636812480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:20.143977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637e36-adc0-452d-a4bd-27c636812480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:20.178700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d637e36-adc0-452d-a4bd-27c636812480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:20.180338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d637e36-adc0-452d-a4bd-27c636812480 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:20.211501 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3686/7340] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:33:21.681797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dacb2-be1b-490d-be7b-7e7a123f2ad8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:21.683928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b2dacb2-be1b-490d-be7b-7e7a123f2ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:21.725169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dacb2-be1b-490d-be7b-7e7a123f2ad8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:21.762239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:21.766704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:21.769313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:21.769827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] PATH_INFO: `/v3/projects/0be20d63e33b46d98e1e863616465b4e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:21.772623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be20d63e33b46d98e1e863616465b4e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:21.776536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:21.889274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be20d63e33b46d98e1e863616465b4e', 'request_id': 'req-860b2260-12f3-4673-853f-a8e0333477b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:21.901658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be20d63e33b46d98e1e863616465b4e', 'request_id': 'req-860b2260-12f3-4673-853f-a8e0333477b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:21.910065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be20d63e33b46d98e1e863616465b4e', 'request_id': 'req-860b2260-12f3-4673-853f-a8e0333477b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:21.931988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] The token cache is being invalidate because project 0be20d63e33b46d98e1e863616465b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:33:21.932841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:21.933921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:21.938699 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3655/7341] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:33:21 2022] DELETE /identity/v3/projects/0be20d63e33b46d98e1e863616465b4e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:21.940107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637e36-adc0-452d-a4bd-27c636812480 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:21.957352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637e36-adc0-452d-a4bd-27c636812480 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:22.128864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c48f3-64b6-4441-a64f-d2b3ea8481dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:22.129922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c48f3-64b6-4441-a64f-d2b3ea8481dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:22.130815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c48f3-64b6-4441-a64f-d2b3ea8481dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:22.133009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c48f3-64b6-4441-a64f-d2b3ea8481dc admin admin] PATH_INFO: `/v3/users/de3fb271d4c34d9e9b7dbcc30ed12462` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:22.135213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c48f3-64b6-4441-a64f-d2b3ea8481dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3fb271d4c34d9e9b7dbcc30ed12462)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:22.141377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c48f3-64b6-4441-a64f-d2b3ea8481dc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:22.255517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-238c48f3-64b6-4441-a64f-d2b3ea8481dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3fb271d4c34d9e9b7dbcc30ed12462'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:22.293155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-238c48f3-64b6-4441-a64f-d2b3ea8481dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3fb271d4c34d9e9b7dbcc30ed12462'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:22.294530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-238c48f3-64b6-4441-a64f-d2b3ea8481dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3fb271d4c34d9e9b7dbcc30ed12462'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:22.306410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-238c48f3-64b6-4441-a64f-d2b3ea8481dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3fb271d4c34d9e9b7dbcc30ed12462'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:22.309111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-238c48f3-64b6-4441-a64f-d2b3ea8481dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3fb271d4c34d9e9b7dbcc30ed12462'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:22.333103 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3687/7342] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:33:21 2022] DELETE /identity/v3/users/de3fb271d4c34d9e9b7dbcc30ed12462 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:33:22.864305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:22.865753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:22.908123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b2260-12f3-4673-853f-a8e0333477b9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:23.086592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:23.092137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:23.092436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:23.092714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] PATH_INFO: `/v3/projects/01625a5ed95f4476b73bfc6cebc16c75` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:23.115211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01625a5ed95f4476b73bfc6cebc16c75)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:23.117983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:23.194649 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:23.305269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01625a5ed95f4476b73bfc6cebc16c75', 'request_id': 'req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:23.323278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01625a5ed95f4476b73bfc6cebc16c75', 'request_id': 'req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:23.345638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01625a5ed95f4476b73bfc6cebc16c75', 'request_id': 'req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:23.415088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] The token cache is being invalidate because project 01625a5ed95f4476b73bfc6cebc16c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:33:23.415488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:23.420489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-15bccd29-0d0f-4c7b-b88a-ddba2c1d1453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:23.429003 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3656/7343] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:33:22 2022] DELETE /identity/v3/projects/01625a5ed95f4476b73bfc6cebc16c75 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:23.431954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba52755-177a-43ad-8134-d1da232d37c1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:23.432455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba52755-177a-43ad-8134-d1da232d37c1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:23.432570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba52755-177a-43ad-8134-d1da232d37c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:23.482267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6ba52755-177a-43ad-8134-d1da232d37c1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:23.485026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6ba52755-177a-43ad-8134-d1da232d37c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:23.565275 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:23.713982 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3688/7344] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:23.729889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ec50-14fd-457e-8857-e7e2c016c720 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:23.730714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ec50-14fd-457e-8857-e7e2c016c720 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:23.731227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ec50-14fd-457e-8857-e7e2c016c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:23.771304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3e98ec50-14fd-457e-8857-e7e2c016c720 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:23.772769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3e98ec50-14fd-457e-8857-e7e2c016c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:23.786353 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3657/7345] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:23.791982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba52755-177a-43ad-8134-d1da232d37c1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:23.810614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba52755-177a-43ad-8134-d1da232d37c1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:23.829223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b33d-7b4e-480e-ad79-2367881b1ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:23.829860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b33d-7b4e-480e-ad79-2367881b1ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:23.830143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b33d-7b4e-480e-ad79-2367881b1ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:23.830417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b33d-7b4e-480e-ad79-2367881b1ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:23.831107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925b33d-7b4e-480e-ad79-2367881b1ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:33:23.831412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925b33d-7b4e-480e-ad79-2367881b1ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:23.833027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925b33d-7b4e-480e-ad79-2367881b1ae6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:23.857394 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3689/7346] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:33:23.858716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98ec50-14fd-457e-8857-e7e2c016c720 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:23.869761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98ec50-14fd-457e-8857-e7e2c016c720 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:23.884774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8c5e-c14e-46db-a9cb-00570aa9fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:23.885681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8c5e-c14e-46db-a9cb-00570aa9fa0a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:23.886268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8c5e-c14e-46db-a9cb-00570aa9fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:23.886774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8c5e-c14e-46db-a9cb-00570aa9fa0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:23.887765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d8c5e-c14e-46db-a9cb-00570aa9fa0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:23.889999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d8c5e-c14e-46db-a9cb-00570aa9fa0a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:23.958831 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3658/7347] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:33:23 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:23.967720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b33d-7b4e-480e-ad79-2367881b1ae6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:23.990061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b33d-7b4e-480e-ad79-2367881b1ae6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:24.223987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7461eab-0d2c-4d9e-b09f-6199aa0accf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:24.224633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7461eab-0d2c-4d9e-b09f-6199aa0accf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:24.224914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7461eab-0d2c-4d9e-b09f-6199aa0accf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:24.225183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7461eab-0d2c-4d9e-b09f-6199aa0accf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:24.228650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7461eab-0d2c-4d9e-b09f-6199aa0accf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:24.234820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7461eab-0d2c-4d9e-b09f-6199aa0accf8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:24.298422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8c5e-c14e-46db-a9cb-00570aa9fa0a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:24.302447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-df2d8c5e-c14e-46db-a9cb-00570aa9fa0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:24.335473 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3690/7348] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:33:23 2022] POST /identity/v3/users => generated 289 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:24.343217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7461eab-0d2c-4d9e-b09f-6199aa0accf8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:24.382267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7461eab-0d2c-4d9e-b09f-6199aa0accf8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:24.399194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f1a92-c782-459a-a5cc-291116c85789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:24.399507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1a92-c782-459a-a5cc-291116c85789 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:24.399791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1a92-c782-459a-a5cc-291116c85789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:24.400060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1a92-c782-459a-a5cc-291116c85789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:24.408263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f1a92-c782-459a-a5cc-291116c85789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:24.409914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f1a92-c782-459a-a5cc-291116c85789 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:24.427898 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3691/7349] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:24.429596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8c5e-c14e-46db-a9cb-00570aa9fa0a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:24.432013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f1a92-c782-459a-a5cc-291116c85789 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:24.447691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3579275-f51a-446c-95cf-ecad0de6cb3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:24.448618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579275-f51a-446c-95cf-ecad0de6cb3c service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:24.449150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579275-f51a-446c-95cf-ecad0de6cb3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:24.449549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579275-f51a-446c-95cf-ecad0de6cb3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:24.456155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f3579275-f51a-446c-95cf-ecad0de6cb3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:24.467327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f1a92-c782-459a-a5cc-291116c85789 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:24.482095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75e682-e0a8-4ad1-85ac-739b5b862d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:24.483007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e682-e0a8-4ad1-85ac-739b5b862d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:24.483314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e682-e0a8-4ad1-85ac-739b5b862d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:24.483588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75e682-e0a8-4ad1-85ac-739b5b862d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:24.484282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75e682-e0a8-4ad1-85ac-739b5b862d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:24.485898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75e682-e0a8-4ad1-85ac-739b5b862d15 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:24.510150 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3692/7350] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:24.511166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75e682-e0a8-4ad1-85ac-739b5b862d15 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:24.537005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75e682-e0a8-4ad1-85ac-739b5b862d15 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:24.547468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7231656-8790-4330-b33a-ec2692f182c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:24.548105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231656-8790-4330-b33a-ec2692f182c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:24.548386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231656-8790-4330-b33a-ec2692f182c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:24.548659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231656-8790-4330-b33a-ec2692f182c7 admin admin] PATH_INFO: `/v3/projects/7c48c00badeb420d9c4a270e3116e271/users/6eacc5fa3dc14e549ba8a9aba8bf9e41/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:24.587747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7231656-8790-4330-b33a-ec2692f182c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c48c00badeb420d9c4a270e3116e271, user_id=6eacc5fa3dc14e549ba8a9aba8bf9e41, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:24.598821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7231656-8790-4330-b33a-ec2692f182c7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:24.610174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3579275-f51a-446c-95cf-ecad0de6cb3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:24.612127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3579275-f51a-446c-95cf-ecad0de6cb3c service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:24.636932 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3693/7351] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:33:24 2022] PUT /identity/v3/projects/7c48c00badeb420d9c4a270e3116e271/users/6eacc5fa3dc14e549ba8a9aba8bf9e41/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:24.639023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f92c3-ebad-4dbe-b662-d13e5840d819 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:24.639316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f92c3-ebad-4dbe-b662-d13e5840d819 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:24.639580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f92c3-ebad-4dbe-b662-d13e5840d819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:24.644753 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3659/7352] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:33:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:33:24.711958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b46f92c3-ebad-4dbe-b662-d13e5840d819 None None] MFA Rules not processed for user `6eacc5fa3dc14e549ba8a9aba8bf9e41`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:24.713215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b46f92c3-ebad-4dbe-b662-d13e5840d819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:24.830884 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:24.856272 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3694/7353] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:33:24.868685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3579275-f51a-446c-95cf-ecad0de6cb3c service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:24.870642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f3579275-f51a-446c-95cf-ecad0de6cb3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:24.909858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3579275-f51a-446c-95cf-ecad0de6cb3c service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:24.995570 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:25.067796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a7070-a148-479c-8692-44ade1a4651e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:25.068691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a7070-a148-479c-8692-44ade1a4651e service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:25.070682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a7070-a148-479c-8692-44ade1a4651e service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:25.071148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a7070-a148-479c-8692-44ade1a4651e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:25.097853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a7070-a148-479c-8692-44ade1a4651e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:25.099752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a7070-a148-479c-8692-44ade1a4651e service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:25.136848 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3660/7354] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:33:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:33:34.851213 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:35.118292 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=13 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:46.425277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f92c3-ebad-4dbe-b662-d13e5840d819 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:46.427669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b46f92c3-ebad-4dbe-b662-d13e5840d819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:46.610431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f92c3-ebad-4dbe-b662-d13e5840d819 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:46.636498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:46.637161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:46.637441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:46.637743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] PATH_INFO: `/v3/users/ba242671199a4aea9a14acdaa03ae3af` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:46.639319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba242671199a4aea9a14acdaa03ae3af)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:46.641226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:46.790829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba242671199a4aea9a14acdaa03ae3af'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:46.837145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba242671199a4aea9a14acdaa03ae3af'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:46.837865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba242671199a4aea9a14acdaa03ae3af'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:46.870494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba242671199a4aea9a14acdaa03ae3af'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:46.871572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba242671199a4aea9a14acdaa03ae3af'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:46.910884 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3695/7355] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:33:46 2022] DELETE /identity/v3/users/ba242671199a4aea9a14acdaa03ae3af => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:46.912568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c29f72-4b91-4bfd-8604-79cec0b1083d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:46.913053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c29f72-4b91-4bfd-8604-79cec0b1083d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:46.913179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c29f72-4b91-4bfd-8604-79cec0b1083d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:46.958200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f9c29f72-4b91-4bfd-8604-79cec0b1083d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:46.959835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f9c29f72-4b91-4bfd-8604-79cec0b1083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:47.127224 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3661/7356] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:47.154230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:47.155757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:47.279177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c45238-80a8-4af8-932a-dedef3aad171 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:47.286265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b549a72-0d29-4147-aef2-585bd99ed7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:47.286969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b549a72-0d29-4147-aef2-585bd99ed7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:47.287811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b549a72-0d29-4147-aef2-585bd99ed7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:47.288103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b549a72-0d29-4147-aef2-585bd99ed7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:47.314937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b549a72-0d29-4147-aef2-585bd99ed7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:47.318503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b549a72-0d29-4147-aef2-585bd99ed7f8 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:47.340676 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3696/7357] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:33:49.267754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c29f72-4b91-4bfd-8604-79cec0b1083d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:49.269439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f9c29f72-4b91-4bfd-8604-79cec0b1083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:49.463537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c29f72-4b91-4bfd-8604-79cec0b1083d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:49.480022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c5c8b-acdc-4d7b-a836-5653c1153a29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:49.480985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c5c8b-acdc-4d7b-a836-5653c1153a29 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:49.481431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c5c8b-acdc-4d7b-a836-5653c1153a29 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:49.481950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c5c8b-acdc-4d7b-a836-5653c1153a29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:49.484522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f34c5c8b-acdc-4d7b-a836-5653c1153a29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:49.504091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c5c8b-acdc-4d7b-a836-5653c1153a29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:49.505960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c5c8b-acdc-4d7b-a836-5653c1153a29 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:49.538231 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3662/7358] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:33:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:33:49.694699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b549a72-0d29-4147-aef2-585bd99ed7f8 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:49.696107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7b549a72-0d29-4147-aef2-585bd99ed7f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:49.716205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b549a72-0d29-4147-aef2-585bd99ed7f8 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:49.731710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:49.732483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:49.732774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:49.733064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] PATH_INFO: `/v3/projects/36c54a6e9861492697a97e31870c8b75` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:49.735664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c54a6e9861492697a97e31870c8b75)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:49.737630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:49.782733 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:49.919765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c54a6e9861492697a97e31870c8b75', 'request_id': 'req-5e04eabc-afce-4d02-aa12-b9df447153f6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:49.933475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c54a6e9861492697a97e31870c8b75', 'request_id': 'req-5e04eabc-afce-4d02-aa12-b9df447153f6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:49.949915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c54a6e9861492697a97e31870c8b75', 'request_id': 'req-5e04eabc-afce-4d02-aa12-b9df447153f6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:49.987570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] The token cache is being invalidate because project 36c54a6e9861492697a97e31870c8b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:33:49.988157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:49.989142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:49.991503 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3697/7359] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:33:49 2022] DELETE /identity/v3/projects/36c54a6e9861492697a97e31870c8b75 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:49.995499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c5c8b-acdc-4d7b-a836-5653c1153a29 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:50.010787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c5c8b-acdc-4d7b-a836-5653c1153a29 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:50.207974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612e1f-14a9-44d2-a599-2565485f223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:50.209393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612e1f-14a9-44d2-a599-2565485f223e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:50.209692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612e1f-14a9-44d2-a599-2565485f223e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:50.211174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612e1f-14a9-44d2-a599-2565485f223e admin admin] PATH_INFO: `/v3/users/21a6da7aa9094a4b99351cf062a9d442` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:50.215060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd612e1f-14a9-44d2-a599-2565485f223e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a6da7aa9094a4b99351cf062a9d442)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:50.217206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd612e1f-14a9-44d2-a599-2565485f223e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:50.308699 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:50.336247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd612e1f-14a9-44d2-a599-2565485f223e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a6da7aa9094a4b99351cf062a9d442'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:50.376113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd612e1f-14a9-44d2-a599-2565485f223e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a6da7aa9094a4b99351cf062a9d442'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:50.377094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd612e1f-14a9-44d2-a599-2565485f223e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a6da7aa9094a4b99351cf062a9d442'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:50.401244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd612e1f-14a9-44d2-a599-2565485f223e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a6da7aa9094a4b99351cf062a9d442'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:50.425214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd612e1f-14a9-44d2-a599-2565485f223e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a6da7aa9094a4b99351cf062a9d442'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:50.505673 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3663/7360] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:33:49 2022] DELETE /identity/v3/users/21a6da7aa9094a4b99351cf062a9d442 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:33:51.967763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:51.970883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:52.000906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04eabc-afce-4d02-aa12-b9df447153f6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:52.210300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:52.212940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:52.215845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:52.216302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] PATH_INFO: `/v3/projects/fa25d17f37d542e59ed4bc27b5af9212` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:52.219817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa25d17f37d542e59ed4bc27b5af9212)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:52.222766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:52.327827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa25d17f37d542e59ed4bc27b5af9212', 'request_id': 'req-af730764-2d93-4456-9dca-a6d50b63cd41'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:52.341137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa25d17f37d542e59ed4bc27b5af9212', 'request_id': 'req-af730764-2d93-4456-9dca-a6d50b63cd41'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:52.357990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa25d17f37d542e59ed4bc27b5af9212', 'request_id': 'req-af730764-2d93-4456-9dca-a6d50b63cd41'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:52.385028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] The token cache is being invalidate because project fa25d17f37d542e59ed4bc27b5af9212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:33:52.386025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:52.389205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-af730764-2d93-4456-9dca-a6d50b63cd41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:52.391302 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3698/7361] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:33:51 2022] DELETE /identity/v3/projects/fa25d17f37d542e59ed4bc27b5af9212 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:52.397429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f52e9-3599-4e1f-a6cc-6e65c858ce1f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:52.397995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f52e9-3599-4e1f-a6cc-6e65c858ce1f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:52.397995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f52e9-3599-4e1f-a6cc-6e65c858ce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:52.441198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-799f52e9-3599-4e1f-a6cc-6e65c858ce1f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:52.446720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-799f52e9-3599-4e1f-a6cc-6e65c858ce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:52.600262 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3664/7362] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:52.610015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d82a3-aa07-4cfc-b299-1b0d71af9582 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:52.610736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d82a3-aa07-4cfc-b299-1b0d71af9582 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:52.611203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d82a3-aa07-4cfc-b299-1b0d71af9582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:52.653416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-eb8d82a3-aa07-4cfc-b299-1b0d71af9582 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:52.655013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eb8d82a3-aa07-4cfc-b299-1b0d71af9582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:52.676968 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3699/7363] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:52.682647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f52e9-3599-4e1f-a6cc-6e65c858ce1f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:52.697219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f52e9-3599-4e1f-a6cc-6e65c858ce1f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:52.712000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b60a4c-e459-40ba-8d28-3e3dee6fd27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:52.713045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b60a4c-e459-40ba-8d28-3e3dee6fd27e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:52.713751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b60a4c-e459-40ba-8d28-3e3dee6fd27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:52.714231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b60a4c-e459-40ba-8d28-3e3dee6fd27e admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:52.715433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b60a4c-e459-40ba-8d28-3e3dee6fd27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:33:52.717255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b60a4c-e459-40ba-8d28-3e3dee6fd27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:52.721486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b60a4c-e459-40ba-8d28-3e3dee6fd27e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:52.753912 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3665/7364] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:33:52.758636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d82a3-aa07-4cfc-b299-1b0d71af9582 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:52.771142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d82a3-aa07-4cfc-b299-1b0d71af9582 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:52.786421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce546c1c-91b4-48a9-b06f-011a1da1cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:52.787392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546c1c-91b4-48a9-b06f-011a1da1cb56 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:52.787861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546c1c-91b4-48a9-b06f-011a1da1cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:52.788373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546c1c-91b4-48a9-b06f-011a1da1cb56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:52.789313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce546c1c-91b4-48a9-b06f-011a1da1cb56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:52.791446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce546c1c-91b4-48a9-b06f-011a1da1cb56 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:52.900266 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3700/7365] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:33:52 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:52.901548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b60a4c-e459-40ba-8d28-3e3dee6fd27e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:52.912838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b60a4c-e459-40ba-8d28-3e3dee6fd27e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:53.061982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd08f2-5c58-4085-a14a-26fd3a98aa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:53.062989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd08f2-5c58-4085-a14a-26fd3a98aa50 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:53.062989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd08f2-5c58-4085-a14a-26fd3a98aa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:53.063309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd08f2-5c58-4085-a14a-26fd3a98aa50 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:53.063908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd08f2-5c58-4085-a14a-26fd3a98aa50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:53.066036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd08f2-5c58-4085-a14a-26fd3a98aa50 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:53.165983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce546c1c-91b4-48a9-b06f-011a1da1cb56 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:53.173963 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3666/7366] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:33:52 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:53.182168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce546c1c-91b4-48a9-b06f-011a1da1cb56 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:53.228196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3c9ce-382e-41a9-b787-904348bde535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:53.237851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3c9ce-382e-41a9-b787-904348bde535 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:53.238330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3c9ce-382e-41a9-b787-904348bde535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:53.239745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3c9ce-382e-41a9-b787-904348bde535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:53.241195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3c9ce-382e-41a9-b787-904348bde535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:53.246565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3c9ce-382e-41a9-b787-904348bde535 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:53.261699 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:53.303107 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3701/7367] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:53.307240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd08f2-5c58-4085-a14a-26fd3a98aa50 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:53.325076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd08f2-5c58-4085-a14a-26fd3a98aa50 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:53.333583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf7bfb-e4d4-41d3-a136-cb2463ffe753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:53.336265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7bfb-e4d4-41d3-a136-cb2463ffe753 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:53.337265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7bfb-e4d4-41d3-a136-cb2463ffe753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:53.338217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7bfb-e4d4-41d3-a136-cb2463ffe753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:53.340100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf7bfb-e4d4-41d3-a136-cb2463ffe753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:53.342439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf7bfb-e4d4-41d3-a136-cb2463ffe753 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:53.362706 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3667/7368] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:53.366447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3c9ce-382e-41a9-b787-904348bde535 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:53.396690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3c9ce-382e-41a9-b787-904348bde535 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:53.407025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137f492-bc23-489c-b36c-ef977f67a809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:53.409370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137f492-bc23-489c-b36c-ef977f67a809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:53.409981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137f492-bc23-489c-b36c-ef977f67a809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:53.410473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137f492-bc23-489c-b36c-ef977f67a809 admin admin] PATH_INFO: `/v3/projects/e3e464ede34b4784a6389d636e5f2694/users/a9f17ac09c0b4e09b65ad25bf7c24d6b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:53.447195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137f492-bc23-489c-b36c-ef977f67a809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e464ede34b4784a6389d636e5f2694, user_id=a9f17ac09c0b4e09b65ad25bf7c24d6b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:53.450452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137f492-bc23-489c-b36c-ef977f67a809 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:53.486392 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3702/7369] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:33:53 2022] PUT /identity/v3/projects/e3e464ede34b4784a6389d636e5f2694/users/a9f17ac09c0b4e09b65ad25bf7c24d6b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:33:53.501615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100c02e-4958-4e45-b394-077336711950 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:53.502565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100c02e-4958-4e45-b394-077336711950 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:53.503176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100c02e-4958-4e45-b394-077336711950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:53.556423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8100c02e-4958-4e45-b394-077336711950 None None] MFA Rules not processed for user `a9f17ac09c0b4e09b65ad25bf7c24d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:53.559078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8100c02e-4958-4e45-b394-077336711950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:53.564208 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:53.673082 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3668/7370] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:53.686519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137f492-bc23-489c-b36c-ef977f67a809 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:53.688552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0137f492-bc23-489c-b36c-ef977f67a809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:53.838627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137f492-bc23-489c-b36c-ef977f67a809 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:53.847200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8d1b5-2c36-4048-8526-2609f4fc03d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:53.847797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d1b5-2c36-4048-8526-2609f4fc03d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:53.848080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d1b5-2c36-4048-8526-2609f4fc03d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:53.848365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d1b5-2c36-4048-8526-2609f4fc03d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:53.867944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8d1b5-2c36-4048-8526-2609f4fc03d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:53.869333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8d1b5-2c36-4048-8526-2609f4fc03d4 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:53.889651 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3703/7371] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:33:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:33:53.914553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100c02e-4958-4e45-b394-077336711950 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:54.043241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100c02e-4958-4e45-b394-077336711950 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:54.049777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:54.051003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:54.052205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:54.052747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] PATH_INFO: `/v3/users/a9f17ac09c0b4e09b65ad25bf7c24d6b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:54.059182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f17ac09c0b4e09b65ad25bf7c24d6b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:54.061512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:54.165817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f17ac09c0b4e09b65ad25bf7c24d6b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:54.197118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f17ac09c0b4e09b65ad25bf7c24d6b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:54.197904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f17ac09c0b4e09b65ad25bf7c24d6b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:54.214389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f17ac09c0b4e09b65ad25bf7c24d6b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:54.230902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f17ac09c0b4e09b65ad25bf7c24d6b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:54.285232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1abe9e-b224-4e49-ba6f-909f832aea05 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:54.285709 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3669/7372] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:33:53 2022] DELETE /identity/v3/users/a9f17ac09c0b4e09b65ad25bf7c24d6b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:54.285831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1abe9e-b224-4e49-ba6f-909f832aea05 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:54.285831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1abe9e-b224-4e49-ba6f-909f832aea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:54.333224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9b1abe9e-b224-4e49-ba6f-909f832aea05 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:54.334474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9b1abe9e-b224-4e49-ba6f-909f832aea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:54.503149 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3704/7373] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:33:54.552941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:54.556159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:54.612311 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:54.723142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d14536-e623-47bb-ac5b-69fb47ce9ce4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:54.736513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c4b9-f26a-49e5-8668-929643ebd711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:54.737310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c4b9-f26a-49e5-8668-929643ebd711 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:54.737592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c4b9-f26a-49e5-8668-929643ebd711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:54.737868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c4b9-f26a-49e5-8668-929643ebd711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:54.759973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8c4b9-f26a-49e5-8668-929643ebd711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:54.761458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8c4b9-f26a-49e5-8668-929643ebd711 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:54.795118 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3670/7374] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:33:56.343244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1abe9e-b224-4e49-ba6f-909f832aea05 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:56.344953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9b1abe9e-b224-4e49-ba6f-909f832aea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:56.366626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1abe9e-b224-4e49-ba6f-909f832aea05 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:56.379496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:56.380567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:56.381082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:56.381561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] PATH_INFO: `/v3/projects/e3e464ede34b4784a6389d636e5f2694` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:56.383681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e464ede34b4784a6389d636e5f2694)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:56.393237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:56.517009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e464ede34b4784a6389d636e5f2694', 'request_id': 'req-18bb8e01-b1e2-4169-851e-783b94d9ee24'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:56.532562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e464ede34b4784a6389d636e5f2694', 'request_id': 'req-18bb8e01-b1e2-4169-851e-783b94d9ee24'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:56.552913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e464ede34b4784a6389d636e5f2694', 'request_id': 'req-18bb8e01-b1e2-4169-851e-783b94d9ee24'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:56.617140 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:56.628839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] The token cache is being invalidate because project e3e464ede34b4784a6389d636e5f2694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:33:56.629458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:56.632040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-18bb8e01-b1e2-4169-851e-783b94d9ee24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:33:56.637845 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3705/7375] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:33:56 2022] DELETE /identity/v3/projects/e3e464ede34b4784a6389d636e5f2694 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:33:56.644109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eda800-6056-426b-9002-c44bf303d79e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:56.645186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eda800-6056-426b-9002-c44bf303d79e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:56.645642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eda800-6056-426b-9002-c44bf303d79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:56.693123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b9eda800-6056-426b-9002-c44bf303d79e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:56.700423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b9eda800-6056-426b-9002-c44bf303d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:56.824333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936745b-0a21-42e0-b6f6-403d2210e187 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:56.824683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936745b-0a21-42e0-b6f6-403d2210e187 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:56.824901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936745b-0a21-42e0-b6f6-403d2210e187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:56.830102 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3671/7376] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:56.857506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6936745b-0a21-42e0-b6f6-403d2210e187 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:56.858396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6936745b-0a21-42e0-b6f6-403d2210e187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:56.873364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eda800-6056-426b-9002-c44bf303d79e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:56.885725 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3706/7377] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:56.886979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eda800-6056-426b-9002-c44bf303d79e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:56.893092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d245706-7664-4c0c-8c1e-3e127a876910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:56.893358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d245706-7664-4c0c-8c1e-3e127a876910 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:56.893701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d245706-7664-4c0c-8c1e-3e127a876910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:56.894047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d245706-7664-4c0c-8c1e-3e127a876910 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:56.895977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d245706-7664-4c0c-8c1e-3e127a876910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:33:56.895977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d245706-7664-4c0c-8c1e-3e127a876910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:56.897632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d245706-7664-4c0c-8c1e-3e127a876910 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:56.918525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936745b-0a21-42e0-b6f6-403d2210e187 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:56.926096 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3672/7378] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:33:56.932126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936745b-0a21-42e0-b6f6-403d2210e187 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:56.959093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03346b-d149-4a12-aba2-4cb9c5a6c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:56.959787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03346b-d149-4a12-aba2-4cb9c5a6c6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:56.960073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03346b-d149-4a12-aba2-4cb9c5a6c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:56.960344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03346b-d149-4a12-aba2-4cb9c5a6c6b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:56.961395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03346b-d149-4a12-aba2-4cb9c5a6c6b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:56.964399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03346b-d149-4a12-aba2-4cb9c5a6c6b7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:57.031120 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3707/7379] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:33:56 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:57.035721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d245706-7664-4c0c-8c1e-3e127a876910 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:57.049250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d245706-7664-4c0c-8c1e-3e127a876910 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:57.137726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757748b-0895-4d33-9663-9a1e362c30a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:57.138508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757748b-0895-4d33-9663-9a1e362c30a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:57.138836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757748b-0895-4d33-9663-9a1e362c30a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:57.139123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757748b-0895-4d33-9663-9a1e362c30a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:57.139856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757748b-0895-4d33-9663-9a1e362c30a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:57.142067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757748b-0895-4d33-9663-9a1e362c30a3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:57.200216 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3673/7380] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:33:57 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:33:57.204298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03346b-d149-4a12-aba2-4cb9c5a6c6b7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:57.218177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03346b-d149-4a12-aba2-4cb9c5a6c6b7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:57.228107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b363-08d7-49e8-b211-fda98caca7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:57.230022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b363-08d7-49e8-b211-fda98caca7aa admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:57.230494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b363-08d7-49e8-b211-fda98caca7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:57.231582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b363-08d7-49e8-b211-fda98caca7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:57.236655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5b363-08d7-49e8-b211-fda98caca7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:57.240460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5b363-08d7-49e8-b211-fda98caca7aa admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:57.261633 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3708/7381] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:33:57.262528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757748b-0895-4d33-9663-9a1e362c30a3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:57.285674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757748b-0895-4d33-9663-9a1e362c30a3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:57.292879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3fa69-3e5e-44a1-96e1-56dd558ec142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:57.294035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3fa69-3e5e-44a1-96e1-56dd558ec142 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:57.300856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3fa69-3e5e-44a1-96e1-56dd558ec142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:57.301497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3fa69-3e5e-44a1-96e1-56dd558ec142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:57.302627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3fa69-3e5e-44a1-96e1-56dd558ec142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:57.309291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3fa69-3e5e-44a1-96e1-56dd558ec142 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:57.328087 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3674/7382] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:33:57.332053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b363-08d7-49e8-b211-fda98caca7aa admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:57.345387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b363-08d7-49e8-b211-fda98caca7aa admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:57.350787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435fed9-24a3-4e9f-acdb-faa768680db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:57.352121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fed9-24a3-4e9f-acdb-faa768680db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:57.352448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fed9-24a3-4e9f-acdb-faa768680db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:57.352978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fed9-24a3-4e9f-acdb-faa768680db2 admin admin] PATH_INFO: `/v3/projects/60ab7653665f4476ad393d258750eef0/users/b8c99483af9545e19c0d6247e9aec84b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:57.371544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435fed9-24a3-4e9f-acdb-faa768680db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ab7653665f4476ad393d258750eef0, user_id=b8c99483af9545e19c0d6247e9aec84b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:57.375583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435fed9-24a3-4e9f-acdb-faa768680db2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:57.403711 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3709/7383] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:33:57 2022] PUT /identity/v3/projects/60ab7653665f4476ad393d258750eef0/users/b8c99483af9545e19c0d6247e9aec84b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:33:57.405777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dedc49-d05d-4ebe-a251-5c8b0d9115d9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:57.406065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dedc49-d05d-4ebe-a251-5c8b0d9115d9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:57.406348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dedc49-d05d-4ebe-a251-5c8b0d9115d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:57.440867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-53dedc49-d05d-4ebe-a251-5c8b0d9115d9 None None] MFA Rules not processed for user `b8c99483af9545e19c0d6247e9aec84b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:33:57.442477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-53dedc49-d05d-4ebe-a251-5c8b0d9115d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:57.494412 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:33:57.617087 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3675/7384] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:33:57.627786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435fed9-24a3-4e9f-acdb-faa768680db2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:33:57.629858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d435fed9-24a3-4e9f-acdb-faa768680db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:33:57.742582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435fed9-24a3-4e9f-acdb-faa768680db2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:33:57.747273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e39c9-5621-4503-b281-40887c407791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:33:57.748065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e39c9-5621-4503-b281-40887c407791 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:33:57.748496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e39c9-5621-4503-b281-40887c407791 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:33:57.748848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e39c9-5621-4503-b281-40887c407791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:33:57.762927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e39c9-5621-4503-b281-40887c407791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:33:57.764651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e39c9-5621-4503-b281-40887c407791 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:33:57.790313 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3710/7385] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:33:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:03.309978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dedc49-d05d-4ebe-a251-5c8b0d9115d9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:03.313230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-53dedc49-d05d-4ebe-a251-5c8b0d9115d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:03.431389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dedc49-d05d-4ebe-a251-5c8b0d9115d9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:03.436826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:03.437678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:03.438192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:03.438851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] PATH_INFO: `/v3/users/3622ecc1ffe44cd3946f6a46277169cc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:03.440616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3622ecc1ffe44cd3946f6a46277169cc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:03.443002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:03.569290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3622ecc1ffe44cd3946f6a46277169cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:03.609792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3622ecc1ffe44cd3946f6a46277169cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:03.611911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3622ecc1ffe44cd3946f6a46277169cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:03.642772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3622ecc1ffe44cd3946f6a46277169cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:03.659012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3622ecc1ffe44cd3946f6a46277169cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:03.682149 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3676/7386] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:34:03 2022] DELETE /identity/v3/users/3622ecc1ffe44cd3946f6a46277169cc => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:03.684260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8902a-cfd6-4b49-9109-3a1aacaac8c0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:03.684747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8902a-cfd6-4b49-9109-3a1aacaac8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:03.685011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8902a-cfd6-4b49-9109-3a1aacaac8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:03.749069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b4b8902a-cfd6-4b49-9109-3a1aacaac8c0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:03.750222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b4b8902a-cfd6-4b49-9109-3a1aacaac8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:03.945655 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3711/7387] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:03.972850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:03.974320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:04.116128 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:04.140387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e46d0-0b2c-4c2b-9150-8431c07ad66e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:04.151270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd541173-0fba-4660-85e5-2a5961c6f07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:04.152120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd541173-0fba-4660-85e5-2a5961c6f07e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:04.152410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd541173-0fba-4660-85e5-2a5961c6f07e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:04.153206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd541173-0fba-4660-85e5-2a5961c6f07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:04.175920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd541173-0fba-4660-85e5-2a5961c6f07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:04.180147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd541173-0fba-4660-85e5-2a5961c6f07e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:04.204013 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3677/7388] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:05.221174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8902a-cfd6-4b49-9109-3a1aacaac8c0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:05.222691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b4b8902a-cfd6-4b49-9109-3a1aacaac8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:05.244231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8902a-cfd6-4b49-9109-3a1aacaac8c0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:05.259731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:05.260400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:05.260684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:05.260957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] PATH_INFO: `/v3/projects/ffc69ae44a0a4e83b172f791dad09fbc` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:05.263289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc69ae44a0a4e83b172f791dad09fbc)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:05.266535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:05.370551 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:05.415082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc69ae44a0a4e83b172f791dad09fbc', 'request_id': 'req-46346e53-bcc3-41d8-b6e1-c5eec122a544'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:05.422067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc69ae44a0a4e83b172f791dad09fbc', 'request_id': 'req-46346e53-bcc3-41d8-b6e1-c5eec122a544'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:05.444313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc69ae44a0a4e83b172f791dad09fbc', 'request_id': 'req-46346e53-bcc3-41d8-b6e1-c5eec122a544'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:05.511801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] The token cache is being invalidate because project ffc69ae44a0a4e83b172f791dad09fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:34:05.512771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:05.514980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46346e53-bcc3-41d8-b6e1-c5eec122a544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:05.541261 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3712/7389] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:34:05 2022] DELETE /identity/v3/projects/ffc69ae44a0a4e83b172f791dad09fbc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:05.548138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd541173-0fba-4660-85e5-2a5961c6f07e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:05.576428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd541173-0fba-4660-85e5-2a5961c6f07e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:05.685364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028a851-2c47-47be-9396-187ee3da1e1c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:05.686456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028a851-2c47-47be-9396-187ee3da1e1c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:05.688456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028a851-2c47-47be-9396-187ee3da1e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:05.747610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2028a851-2c47-47be-9396-187ee3da1e1c None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:05.753525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2028a851-2c47-47be-9396-187ee3da1e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:05.814975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:05.815812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:05.816102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:05.816349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] PATH_INFO: `/v3/users/c09e42a16d3a4b5a951f2859750e5359` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:05.834585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09e42a16d3a4b5a951f2859750e5359)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:05.838046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:06.040033 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3713/7390] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:34:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:06.052821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028a851-2c47-47be-9396-187ee3da1e1c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:06.054880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2028a851-2c47-47be-9396-187ee3da1e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:06.072129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09e42a16d3a4b5a951f2859750e5359'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:06.112629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09e42a16d3a4b5a951f2859750e5359'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:06.115925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09e42a16d3a4b5a951f2859750e5359'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:06.133819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09e42a16d3a4b5a951f2859750e5359'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:06.149164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09e42a16d3a4b5a951f2859750e5359'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:06.174748 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3678/7391] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:34:05 2022] DELETE /identity/v3/users/c09e42a16d3a4b5a951f2859750e5359 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:06.300943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028a851-2c47-47be-9396-187ee3da1e1c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:06.545299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303a4a7-9dbd-4169-bf5a-762576a0550e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:06.548318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a4a7-9dbd-4169-bf5a-762576a0550e service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:06.548672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a4a7-9dbd-4169-bf5a-762576a0550e service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:06.549144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a4a7-9dbd-4169-bf5a-762576a0550e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:06.563101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f303a4a7-9dbd-4169-bf5a-762576a0550e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:06.605646 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:06.728984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:06.730593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:06.851566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303a4a7-9dbd-4169-bf5a-762576a0550e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:06.856028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303a4a7-9dbd-4169-bf5a-762576a0550e service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:06.933092 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3714/7392] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:34:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:34:06.942576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303a4a7-9dbd-4169-bf5a-762576a0550e service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:06.944306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f303a4a7-9dbd-4169-bf5a-762576a0550e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:07.014091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb539-3828-48dc-8958-ecad7a2535d1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:07.026565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:07.027262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:07.027549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:07.027826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] PATH_INFO: `/v3/projects/be337cdf6e7f4b7cab7d4f84d37832f7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:07.030504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be337cdf6e7f4b7cab7d4f84d37832f7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:07.032663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:07.046979 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:07.149860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be337cdf6e7f4b7cab7d4f84d37832f7', 'request_id': 'req-169e0031-879c-4dec-aa89-9d8650615d93'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:07.163306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be337cdf6e7f4b7cab7d4f84d37832f7', 'request_id': 'req-169e0031-879c-4dec-aa89-9d8650615d93'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:07.180758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be337cdf6e7f4b7cab7d4f84d37832f7', 'request_id': 'req-169e0031-879c-4dec-aa89-9d8650615d93'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:07.215677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] The token cache is being invalidate because project be337cdf6e7f4b7cab7d4f84d37832f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:34:07.216740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:07.218181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-169e0031-879c-4dec-aa89-9d8650615d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:07.221780 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3679/7393] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:34:06 2022] DELETE /identity/v3/projects/be337cdf6e7f4b7cab7d4f84d37832f7 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:07.227294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e8e1c-9617-487c-8e4a-9989ce6d1d18 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:07.229106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e8e1c-9617-487c-8e4a-9989ce6d1d18 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:07.231051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e8e1c-9617-487c-8e4a-9989ce6d1d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:07.283133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-904e8e1c-9617-487c-8e4a-9989ce6d1d18 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:07.284874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-904e8e1c-9617-487c-8e4a-9989ce6d1d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:07.337526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303a4a7-9dbd-4169-bf5a-762576a0550e service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:07.485280 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3680/7394] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:07.505167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7465-ae21-436f-beb3-3ad9144e5674 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:07.505946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7465-ae21-436f-beb3-3ad9144e5674 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:07.505946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7465-ae21-436f-beb3-3ad9144e5674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:07.570510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55180-ab95-4924-9de8-2902b7957912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:07.583663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55180-ab95-4924-9de8-2902b7957912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:07.583943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55180-ab95-4924-9de8-2902b7957912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:07.589733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55180-ab95-4924-9de8-2902b7957912 admin admin] PATH_INFO: `/v3/users/b8c99483af9545e19c0d6247e9aec84b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:07.602740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55180-ab95-4924-9de8-2902b7957912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c99483af9545e19c0d6247e9aec84b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:07.608051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-951d7465-ae21-436f-beb3-3ad9144e5674 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:07.609231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-951d7465-ae21-436f-beb3-3ad9144e5674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:07.619829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55180-ab95-4924-9de8-2902b7957912 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:07.659500 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3681/7395] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:07.660182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7465-ae21-436f-beb3-3ad9144e5674 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:07.702683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7465-ae21-436f-beb3-3ad9144e5674 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:07.738361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626b0e0-55fd-4bbb-8882-44cabd97649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:07.739079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626b0e0-55fd-4bbb-8882-44cabd97649e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:07.739404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626b0e0-55fd-4bbb-8882-44cabd97649e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:07.739538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626b0e0-55fd-4bbb-8882-44cabd97649e admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:07.740211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626b0e0-55fd-4bbb-8882-44cabd97649e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:34:07.740528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626b0e0-55fd-4bbb-8882-44cabd97649e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:07.742527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626b0e0-55fd-4bbb-8882-44cabd97649e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:07.800170 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3682/7396] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:34:07.801324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626b0e0-55fd-4bbb-8882-44cabd97649e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:07.832154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626b0e0-55fd-4bbb-8882-44cabd97649e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:07.854546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183075b3-df24-4cd4-a4c2-482b27622f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:07.855521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183075b3-df24-4cd4-a4c2-482b27622f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:07.855800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183075b3-df24-4cd4-a4c2-482b27622f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:07.856068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183075b3-df24-4cd4-a4c2-482b27622f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:07.875594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183075b3-df24-4cd4-a4c2-482b27622f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:07.888112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183075b3-df24-4cd4-a4c2-482b27622f5c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:07.910344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1de55180-ab95-4924-9de8-2902b7957912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c99483af9545e19c0d6247e9aec84b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:07.951864 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3683/7397] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:07 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:07.956285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183075b3-df24-4cd4-a4c2-482b27622f5c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:07.990338 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:08.004145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1de55180-ab95-4924-9de8-2902b7957912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c99483af9545e19c0d6247e9aec84b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:08.005123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1de55180-ab95-4924-9de8-2902b7957912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c99483af9545e19c0d6247e9aec84b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:08.020827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1de55180-ab95-4924-9de8-2902b7957912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c99483af9545e19c0d6247e9aec84b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:08.021846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1de55180-ab95-4924-9de8-2902b7957912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c99483af9545e19c0d6247e9aec84b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:08.048387 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3715/7398] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:34:06 2022] DELETE /identity/v3/users/b8c99483af9545e19c0d6247e9aec84b => generated 0 bytes in 1112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:08.051569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cbdbe-36fc-4721-96b9-846abf1d35ab None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:08.051569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cbdbe-36fc-4721-96b9-846abf1d35ab None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:08.051569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cbdbe-36fc-4721-96b9-846abf1d35ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:08.144020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-596cbdbe-36fc-4721-96b9-846abf1d35ab None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:08.149095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-596cbdbe-36fc-4721-96b9-846abf1d35ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:08.172588 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:08.263015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183075b3-df24-4cd4-a4c2-482b27622f5c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:08.561920 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3716/7399] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:08.571791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cbdbe-36fc-4721-96b9-846abf1d35ab None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:08.583881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-596cbdbe-36fc-4721-96b9-846abf1d35ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:08.689046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae9cd0-c728-43c8-a73f-7944dfa36d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:08.689779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae9cd0-c728-43c8-a73f-7944dfa36d07 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:08.690165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae9cd0-c728-43c8-a73f-7944dfa36d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:08.690829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae9cd0-c728-43c8-a73f-7944dfa36d07 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:08.691639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae9cd0-c728-43c8-a73f-7944dfa36d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:08.695174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae9cd0-c728-43c8-a73f-7944dfa36d07 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:08.766721 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3684/7400] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:07 2022] POST /identity/v3/users => generated 283 bytes in 811 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:08.771196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae9cd0-c728-43c8-a73f-7944dfa36d07 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:08.779758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f7ae9cd0-c728-43c8-a73f-7944dfa36d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:08.817187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae9cd0-c728-43c8-a73f-7944dfa36d07 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:08.841321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034978ca-59cc-49ed-93c4-64bbf5dc70b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:08.848337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034978ca-59cc-49ed-93c4-64bbf5dc70b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:08.849212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034978ca-59cc-49ed-93c4-64bbf5dc70b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:08.850030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034978ca-59cc-49ed-93c4-64bbf5dc70b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:08.856381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034978ca-59cc-49ed-93c4-64bbf5dc70b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:08.862799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034978ca-59cc-49ed-93c4-64bbf5dc70b3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:08.906126 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3685/7401] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:08.909862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cbdbe-36fc-4721-96b9-846abf1d35ab None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:08.912976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034978ca-59cc-49ed-93c4-64bbf5dc70b3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:08.923897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0696ea-8833-4674-b6bf-92fd46eca588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:08.924929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0696ea-8833-4674-b6bf-92fd46eca588 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:08.925435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0696ea-8833-4674-b6bf-92fd46eca588 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:08.925929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0696ea-8833-4674-b6bf-92fd46eca588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:08.956969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034978ca-59cc-49ed-93c4-64bbf5dc70b3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:08.978393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0696ea-8833-4674-b6bf-92fd46eca588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:08.981624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0696ea-8833-4674-b6bf-92fd46eca588 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:09.011627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55283ed2-5672-440c-a385-f2d112a8259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:09.016673 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3717/7402] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:09.041871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55283ed2-5672-440c-a385-f2d112a8259c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:09.044547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55283ed2-5672-440c-a385-f2d112a8259c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:09.045530 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55283ed2-5672-440c-a385-f2d112a8259c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:09.050835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55283ed2-5672-440c-a385-f2d112a8259c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:09.057047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55283ed2-5672-440c-a385-f2d112a8259c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:09.145536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0696ea-8833-4674-b6bf-92fd46eca588 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:09.153888 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3686/7403] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:09.161000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0696ea-8833-4674-b6bf-92fd46eca588 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:09.181327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175138d3-9e81-4eda-ad62-7da41d041212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:09.182022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175138d3-9e81-4eda-ad62-7da41d041212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:09.182452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175138d3-9e81-4eda-ad62-7da41d041212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:09.182559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175138d3-9e81-4eda-ad62-7da41d041212 admin admin] PATH_INFO: `/v3/projects/bfb241db2b434ad5a8a2bf94e52ff830/users/b4b2240357bc4938a6230c6b4e10fe9b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:09.231604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175138d3-9e81-4eda-ad62-7da41d041212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb241db2b434ad5a8a2bf94e52ff830, user_id=b4b2240357bc4938a6230c6b4e10fe9b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:09.239987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175138d3-9e81-4eda-ad62-7da41d041212 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:09.288181 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3718/7404] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:09 2022] PUT /identity/v3/projects/bfb241db2b434ad5a8a2bf94e52ff830/users/b4b2240357bc4938a6230c6b4e10fe9b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:09.399838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6984d-0919-4a4e-a3aa-683c9d0a2870 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:09.400204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6984d-0919-4a4e-a3aa-683c9d0a2870 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:09.400550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6984d-0919-4a4e-a3aa-683c9d0a2870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:09.513869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-56e6984d-0919-4a4e-a3aa-683c9d0a2870 None None] MFA Rules not processed for user `b4b2240357bc4938a6230c6b4e10fe9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:09.523617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-56e6984d-0919-4a4e-a3aa-683c9d0a2870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:09.786137 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3687/7405] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:34:09.792297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175138d3-9e81-4eda-ad62-7da41d041212 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:09.942354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6984d-0919-4a4e-a3aa-683c9d0a2870 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:09.943837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-56e6984d-0919-4a4e-a3aa-683c9d0a2870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:09.964254 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:09.979689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175138d3-9e81-4eda-ad62-7da41d041212 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:10.006648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10970c1-0082-4497-916f-9688c144bfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:10.006889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10970c1-0082-4497-916f-9688c144bfce admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:10.007201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10970c1-0082-4497-916f-9688c144bfce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:10.008008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10970c1-0082-4497-916f-9688c144bfce admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:10.008678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10970c1-0082-4497-916f-9688c144bfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:10.015461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10970c1-0082-4497-916f-9688c144bfce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:10.137544 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3719/7406] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:09 2022] POST /identity/v3/projects => generated 365 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:10.155343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10970c1-0082-4497-916f-9688c144bfce admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:10.195751 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:10.220851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6984d-0919-4a4e-a3aa-683c9d0a2870 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:10.361790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10970c1-0082-4497-916f-9688c144bfce admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:10.386231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccdcbf-607b-4a6b-a8cf-cb4ae9962e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:10.388123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccdcbf-607b-4a6b-a8cf-cb4ae9962e76 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:10.388123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccdcbf-607b-4a6b-a8cf-cb4ae9962e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:10.392217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccdcbf-607b-4a6b-a8cf-cb4ae9962e76 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:10.393104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccdcbf-607b-4a6b-a8cf-cb4ae9962e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:10.396346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccdcbf-607b-4a6b-a8cf-cb4ae9962e76 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:10.502821 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3720/7407] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:10 2022] POST /identity/v3/users => generated 289 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:10.510632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccdcbf-607b-4a6b-a8cf-cb4ae9962e76 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:10.516277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:10.519044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:10.519454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:10.522512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] PATH_INFO: `/v3/projects/60ab7653665f4476ad393d258750eef0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:10.527699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ab7653665f4476ad393d258750eef0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:10.534519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:10.549388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccdcbf-607b-4a6b-a8cf-cb4ae9962e76 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:10.581601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adea2d-7b6c-4569-91e0-db88727680d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:10.600336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adea2d-7b6c-4569-91e0-db88727680d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:10.600626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adea2d-7b6c-4569-91e0-db88727680d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:10.601454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adea2d-7b6c-4569-91e0-db88727680d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:10.609161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adea2d-7b6c-4569-91e0-db88727680d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:10.626446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adea2d-7b6c-4569-91e0-db88727680d4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:10.687996 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3721/7408] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:10.692877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adea2d-7b6c-4569-91e0-db88727680d4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:10.718985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adea2d-7b6c-4569-91e0-db88727680d4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:10.785077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ab7653665f4476ad393d258750eef0', 'request_id': 'req-b67ca13f-7bab-40b5-8f98-6b09f1bca347'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:10.819444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ab7653665f4476ad393d258750eef0', 'request_id': 'req-b67ca13f-7bab-40b5-8f98-6b09f1bca347'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:10.867012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ab7653665f4476ad393d258750eef0', 'request_id': 'req-b67ca13f-7bab-40b5-8f98-6b09f1bca347'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:10.935696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] The token cache is being invalidate because project 60ab7653665f4476ad393d258750eef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:34:10.937494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:10.942356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b67ca13f-7bab-40b5-8f98-6b09f1bca347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:10.953679 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3688/7409] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:34:09 2022] DELETE /identity/v3/projects/60ab7653665f4476ad393d258750eef0 => generated 0 bytes in 1012 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:10.970458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1f52-e6c5-4a09-a955-67555b7ba427 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:10.970864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1f52-e6c5-4a09-a955-67555b7ba427 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:10.971066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1f52-e6c5-4a09-a955-67555b7ba427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:11.065207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b73a1f52-e6c5-4a09-a955-67555b7ba427 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:11.073629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b73a1f52-e6c5-4a09-a955-67555b7ba427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:11.079336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401558ca-be69-4408-a103-78b9bc1288cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:11.080022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401558ca-be69-4408-a103-78b9bc1288cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:11.080318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401558ca-be69-4408-a103-78b9bc1288cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:11.081144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401558ca-be69-4408-a103-78b9bc1288cc admin admin] PATH_INFO: `/v3/projects/4d00c15c50434fc2a262f0fae65d569c/users/ac26fcd3dc2b4ae984f26fa7a5312c2d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:11.123053 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3689/7410] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:11.133545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0156-1cab-40d5-9c75-72cce42dd73d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:11.133996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0156-1cab-40d5-9c75-72cce42dd73d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:11.134472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0156-1cab-40d5-9c75-72cce42dd73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:11.154196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401558ca-be69-4408-a103-78b9bc1288cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d00c15c50434fc2a262f0fae65d569c, user_id=ac26fcd3dc2b4ae984f26fa7a5312c2d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:11.175739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401558ca-be69-4408-a103-78b9bc1288cc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:11.191097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-61cd0156-1cab-40d5-9c75-72cce42dd73d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:11.194192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-61cd0156-1cab-40d5-9c75-72cce42dd73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:11.231049 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3690/7411] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:11.232279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd0156-1cab-40d5-9c75-72cce42dd73d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:11.255704 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3722/7412] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:10 2022] PUT /identity/v3/projects/4d00c15c50434fc2a262f0fae65d569c/users/ac26fcd3dc2b4ae984f26fa7a5312c2d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:11.258425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401558ca-be69-4408-a103-78b9bc1288cc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:11.269033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-401558ca-be69-4408-a103-78b9bc1288cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:11.273783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd0156-1cab-40d5-9c75-72cce42dd73d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:11.409955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a3ea-d951-4615-a41f-76bd767f91e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:11.410973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a3ea-d951-4615-a41f-76bd767f91e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:11.411494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a3ea-d951-4615-a41f-76bd767f91e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:11.412004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a3ea-d951-4615-a41f-76bd767f91e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:11.413535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a3ea-d951-4615-a41f-76bd767f91e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:34:11.415665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a3ea-d951-4615-a41f-76bd767f91e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:11.417548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a3ea-d951-4615-a41f-76bd767f91e8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:11.450179 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3691/7413] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:34:11.454912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a3ea-d951-4615-a41f-76bd767f91e8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:11.480039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a3ea-d951-4615-a41f-76bd767f91e8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:11.488162 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:11.496662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243112dc-50b4-4404-990c-f85166958269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:11.499075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243112dc-50b4-4404-990c-f85166958269 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:11.499358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243112dc-50b4-4404-990c-f85166958269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:11.499629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243112dc-50b4-4404-990c-f85166958269 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:11.501572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243112dc-50b4-4404-990c-f85166958269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:11.503587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243112dc-50b4-4404-990c-f85166958269 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:11.546509 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:11.553780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401558ca-be69-4408-a103-78b9bc1288cc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:11.578022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e19cf-c7c0-402d-bb5c-24f5351d1d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:11.578839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e19cf-c7c0-402d-bb5c-24f5351d1d98 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:11.578951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e19cf-c7c0-402d-bb5c-24f5351d1d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:11.580386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e19cf-c7c0-402d-bb5c-24f5351d1d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:11.581844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e19cf-c7c0-402d-bb5c-24f5351d1d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:11.587268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e19cf-c7c0-402d-bb5c-24f5351d1d98 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:11.595722 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3692/7414] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:11 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:11.602215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243112dc-50b4-4404-990c-f85166958269 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:11.621388 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3723/7415] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:11.623852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e19cf-c7c0-402d-bb5c-24f5351d1d98 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:11.647543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e19cf-c7c0-402d-bb5c-24f5351d1d98 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:11.845227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8335379-cea6-4998-9170-353e9c6a438b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:11.846023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8335379-cea6-4998-9170-353e9c6a438b admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:11.846351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8335379-cea6-4998-9170-353e9c6a438b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:11.846641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8335379-cea6-4998-9170-353e9c6a438b admin admin] PATH_INFO: `/v3/projects/4d00c15c50434fc2a262f0fae65d569c/users/ac26fcd3dc2b4ae984f26fa7a5312c2d/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:11.858101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8335379-cea6-4998-9170-353e9c6a438b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d00c15c50434fc2a262f0fae65d569c, user_id=ac26fcd3dc2b4ae984f26fa7a5312c2d, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:11.861332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8335379-cea6-4998-9170-353e9c6a438b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:11.930452 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3724/7416] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:11 2022] PUT /identity/v3/projects/4d00c15c50434fc2a262f0fae65d569c/users/ac26fcd3dc2b4ae984f26fa7a5312c2d/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:11.940142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243112dc-50b4-4404-990c-f85166958269 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:11.942122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc80bc-c9ca-4214-aad2-f64e83dfe5fa None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:11.942512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc80bc-c9ca-4214-aad2-f64e83dfe5fa None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:11.942934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc80bc-c9ca-4214-aad2-f64e83dfe5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:12.001219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e8dc80bc-c9ca-4214-aad2-f64e83dfe5fa None None] MFA Rules not processed for user `ac26fcd3dc2b4ae984f26fa7a5312c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:12.002355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e8dc80bc-c9ca-4214-aad2-f64e83dfe5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:12.145241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f1fe4-1d10-4173-a36f-3adf74eb6d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:12.148095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f1fe4-1d10-4173-a36f-3adf74eb6d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:12.148409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f1fe4-1d10-4173-a36f-3adf74eb6d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:12.148726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f1fe4-1d10-4173-a36f-3adf74eb6d6f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:12.149463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f1fe4-1d10-4173-a36f-3adf74eb6d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:12.154633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f1fe4-1d10-4173-a36f-3adf74eb6d6f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:12.308264 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3693/7417] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:11 2022] POST /identity/v3/users => generated 288 bytes in 708 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:12.313251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f1fe4-1d10-4173-a36f-3adf74eb6d6f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:12.334781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f1fe4-1d10-4173-a36f-3adf74eb6d6f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:12.360617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00be49-22ed-43d0-a23f-3c3dac16a3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:12.361355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00be49-22ed-43d0-a23f-3c3dac16a3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:12.361708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00be49-22ed-43d0-a23f-3c3dac16a3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:12.362024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00be49-22ed-43d0-a23f-3c3dac16a3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:12.363048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00be49-22ed-43d0-a23f-3c3dac16a3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:12.364770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00be49-22ed-43d0-a23f-3c3dac16a3a7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:12.424062 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3694/7418] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:12.425036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00be49-22ed-43d0-a23f-3c3dac16a3a7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:12.461959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00be49-22ed-43d0-a23f-3c3dac16a3a7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:12.480664 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3725/7419] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:12.481381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5f6a1-a0d5-4eca-a9e0-1b94cb2fb2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:12.481951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5f6a1-a0d5-4eca-a9e0-1b94cb2fb2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:12.482234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5f6a1-a0d5-4eca-a9e0-1b94cb2fb2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:12.482496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5f6a1-a0d5-4eca-a9e0-1b94cb2fb2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:12.483187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5f6a1-a0d5-4eca-a9e0-1b94cb2fb2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:12.492905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5f6a1-a0d5-4eca-a9e0-1b94cb2fb2c0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:12.511849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc80bc-c9ca-4214-aad2-f64e83dfe5fa None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:12.513324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e8dc80bc-c9ca-4214-aad2-f64e83dfe5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:12.540197 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3695/7420] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:12.551743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5f6a1-a0d5-4eca-a9e0-1b94cb2fb2c0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:12.581255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5f6a1-a0d5-4eca-a9e0-1b94cb2fb2c0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:12.611490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a41f27-fde0-48be-ba8f-e2b58e88d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:12.613418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41f27-fde0-48be-ba8f-e2b58e88d015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:12.613418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41f27-fde0-48be-ba8f-e2b58e88d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:12.613418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41f27-fde0-48be-ba8f-e2b58e88d015 admin admin] PATH_INFO: `/v3/projects/8875d6c71c524ec398498c980360c2a4/users/23b0502f8dae496180c4baf19d484666/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:12.709125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a41f27-fde0-48be-ba8f-e2b58e88d015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8875d6c71c524ec398498c980360c2a4, user_id=23b0502f8dae496180c4baf19d484666, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:12.716665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a41f27-fde0-48be-ba8f-e2b58e88d015 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:12.875866 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3696/7421] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:12 2022] PUT /identity/v3/projects/8875d6c71c524ec398498c980360c2a4/users/23b0502f8dae496180c4baf19d484666/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:12.877010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc80bc-c9ca-4214-aad2-f64e83dfe5fa None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:12.911325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524489-6977-4422-bf8f-181a39a02497 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:12.911649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524489-6977-4422-bf8f-181a39a02497 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:12.912048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524489-6977-4422-bf8f-181a39a02497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:12.925166 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:13.009265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-57524489-6977-4422-bf8f-181a39a02497 None None] MFA Rules not processed for user `23b0502f8dae496180c4baf19d484666`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:13.018260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-57524489-6977-4422-bf8f-181a39a02497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:13.042908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce0147-9e3a-4da2-a17c-0e4ab80d3fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:13.047598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0147-9e3a-4da2-a17c-0e4ab80d3fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:13.047598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0147-9e3a-4da2-a17c-0e4ab80d3fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:13.047598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0147-9e3a-4da2-a17c-0e4ab80d3fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:13.114578 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:13.233061 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3697/7422] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:34:13.233844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57524489-6977-4422-bf8f-181a39a02497 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:13.245383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce0147-9e3a-4da2-a17c-0e4ab80d3fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:13.249273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce0147-9e3a-4da2-a17c-0e4ab80d3fc5 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:13.280874 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3726/7423] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:13.525299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57524489-6977-4422-bf8f-181a39a02497 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:13.539485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399226e8-877f-4ce3-8977-c2bc465f001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:13.542418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399226e8-877f-4ce3-8977-c2bc465f001b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:13.542739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399226e8-877f-4ce3-8977-c2bc465f001b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:13.543022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399226e8-877f-4ce3-8977-c2bc465f001b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:13.543792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399226e8-877f-4ce3-8977-c2bc465f001b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:13.548877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399226e8-877f-4ce3-8977-c2bc465f001b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:13.641353 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3698/7424] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:13 2022] POST /identity/v3/projects => generated 377 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:13.641550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce0147-9e3a-4da2-a17c-0e4ab80d3fc5 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:13.659803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce0147-9e3a-4da2-a17c-0e4ab80d3fc5 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:13.938714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339d1a-accf-41ef-8823-bbaf62074e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:13.945398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339d1a-accf-41ef-8823-bbaf62074e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:13.963878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339d1a-accf-41ef-8823-bbaf62074e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:13.979461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339d1a-accf-41ef-8823-bbaf62074e49 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:13.980323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c339d1a-accf-41ef-8823-bbaf62074e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:13.998508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c339d1a-accf-41ef-8823-bbaf62074e49 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:14.087537 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3727/7425] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:13 2022] POST /identity/v3/users => generated 289 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:14.089799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399226e8-877f-4ce3-8977-c2bc465f001b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:14.103290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399226e8-877f-4ce3-8977-c2bc465f001b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:14.112131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e514e-223d-47ce-a49a-4914f3dbaab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:14.112801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e514e-223d-47ce-a49a-4914f3dbaab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:14.113022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e514e-223d-47ce-a49a-4914f3dbaab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:14.113708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e514e-223d-47ce-a49a-4914f3dbaab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:14.114379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e514e-223d-47ce-a49a-4914f3dbaab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:14.116243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e514e-223d-47ce-a49a-4914f3dbaab2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:14.150032 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3699/7426] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:14.151319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339d1a-accf-41ef-8823-bbaf62074e49 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:14.168543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339d1a-accf-41ef-8823-bbaf62074e49 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:14.183290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868d917-f74e-4010-8a29-2f62d62864dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:14.184333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d917-f74e-4010-8a29-2f62d62864dc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:14.184747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d917-f74e-4010-8a29-2f62d62864dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:14.185094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d917-f74e-4010-8a29-2f62d62864dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:14.189526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868d917-f74e-4010-8a29-2f62d62864dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:14.194498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868d917-f74e-4010-8a29-2f62d62864dc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:14.256519 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3728/7427] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:14.258160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e514e-223d-47ce-a49a-4914f3dbaab2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:14.273877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e514e-223d-47ce-a49a-4914f3dbaab2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:14.294654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57026943-258f-410a-8042-1da4e9592c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:14.296871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026943-258f-410a-8042-1da4e9592c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:14.297584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026943-258f-410a-8042-1da4e9592c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:14.298114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026943-258f-410a-8042-1da4e9592c10 admin admin] PATH_INFO: `/v3/projects/fdbe83d5055344948d9527678474f436/users/c9b76dc4c74740798a5422e3280e0d49/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:14.330773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57026943-258f-410a-8042-1da4e9592c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbe83d5055344948d9527678474f436, user_id=c9b76dc4c74740798a5422e3280e0d49, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:14.334248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57026943-258f-410a-8042-1da4e9592c10 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:14.384555 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3700/7428] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:14 2022] PUT /identity/v3/projects/fdbe83d5055344948d9527678474f436/users/c9b76dc4c74740798a5422e3280e0d49/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:14.505557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77719-9123-464d-ba92-8afd7217990c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:14.505825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77719-9123-464d-ba92-8afd7217990c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:14.506104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77719-9123-464d-ba92-8afd7217990c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:14.566638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e1e77719-9123-464d-ba92-8afd7217990c None None] MFA Rules not processed for user `c9b76dc4c74740798a5422e3280e0d49`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:14.567410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e1e77719-9123-464d-ba92-8afd7217990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:14.625219 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:14.806654 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3729/7429] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:14.809545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57026943-258f-410a-8042-1da4e9592c10 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:14.986061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57026943-258f-410a-8042-1da4e9592c10 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:15.000458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160ad01-7725-4af1-a94e-d1a62da622b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:15.001683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160ad01-7725-4af1-a94e-d1a62da622b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:15.009905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160ad01-7725-4af1-a94e-d1a62da622b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:15.010470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160ad01-7725-4af1-a94e-d1a62da622b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:15.012051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160ad01-7725-4af1-a94e-d1a62da622b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:15.015952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160ad01-7725-4af1-a94e-d1a62da622b6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:15.099039 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3701/7430] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:14 2022] POST /identity/v3/projects => generated 377 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:15.103871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77719-9123-464d-ba92-8afd7217990c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:15.145766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77719-9123-464d-ba92-8afd7217990c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:15.310105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d9d3c-4a6a-43bc-ba20-7a6f9ce05aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:15.310870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d9d3c-4a6a-43bc-ba20-7a6f9ce05aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:15.311221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d9d3c-4a6a-43bc-ba20-7a6f9ce05aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:15.311497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d9d3c-4a6a-43bc-ba20-7a6f9ce05aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:15.312134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d9d3c-4a6a-43bc-ba20-7a6f9ce05aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:15.314824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d9d3c-4a6a-43bc-ba20-7a6f9ce05aa2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:15.363351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160ad01-7725-4af1-a94e-d1a62da622b6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:15.376993 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3730/7431] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:15 2022] POST /identity/v3/users => generated 295 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:15.381915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160ad01-7725-4af1-a94e-d1a62da622b6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:15.405307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b1b4-f4f0-4f17-8777-31084c49ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:15.411001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b1b4-f4f0-4f17-8777-31084c49ba46 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:15.412522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b1b4-f4f0-4f17-8777-31084c49ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:15.412803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b1b4-f4f0-4f17-8777-31084c49ba46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:15.415589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307b1b4-f4f0-4f17-8777-31084c49ba46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:15.417256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307b1b4-f4f0-4f17-8777-31084c49ba46 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:15.438797 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:15.477104 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3702/7432] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:15.480856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d9d3c-4a6a-43bc-ba20-7a6f9ce05aa2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:15.496867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d9d3c-4a6a-43bc-ba20-7a6f9ce05aa2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:15.522741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0a515-f995-4f4f-9561-f44a8a0962ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:15.524852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0a515-f995-4f4f-9561-f44a8a0962ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:15.526882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0a515-f995-4f4f-9561-f44a8a0962ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:15.528252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0a515-f995-4f4f-9561-f44a8a0962ec admin admin] PATH_INFO: `/v3/projects/1c5ba755146f45cf98c12cee9dca2a9b/users/c926a69196634fa185032716476e0663/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:15.605870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0a515-f995-4f4f-9561-f44a8a0962ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5ba755146f45cf98c12cee9dca2a9b, user_id=c926a69196634fa185032716476e0663, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:15.612036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0a515-f995-4f4f-9561-f44a8a0962ec admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:15.679189 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3731/7433] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:15 2022] PUT /identity/v3/projects/1c5ba755146f45cf98c12cee9dca2a9b/users/c926a69196634fa185032716476e0663/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:15.685456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b1b4-f4f0-4f17-8777-31084c49ba46 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:15.728984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b1b4-f4f0-4f17-8777-31084c49ba46 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:15.910078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f2ca5-f153-45c6-a73b-9e02b899d4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:15.910830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2ca5-f153-45c6-a73b-9e02b899d4fc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:15.911120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2ca5-f153-45c6-a73b-9e02b899d4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:15.911401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2ca5-f153-45c6-a73b-9e02b899d4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:15.912081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f2ca5-f153-45c6-a73b-9e02b899d4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:15.916320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f2ca5-f153-45c6-a73b-9e02b899d4fc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:15.980880 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3703/7434] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:15.985643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0a515-f995-4f4f-9561-f44a8a0962ec admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:16.015131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0a515-f995-4f4f-9561-f44a8a0962ec admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:16.039525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fca1-d118-4efc-8234-68553015f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:16.042817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fca1-d118-4efc-8234-68553015f42d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:16.044490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fca1-d118-4efc-8234-68553015f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:16.044948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fca1-d118-4efc-8234-68553015f42d admin admin] PATH_INFO: `/v3/projects/1c5ba755146f45cf98c12cee9dca2a9b/users/c926a69196634fa185032716476e0663/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:16.054695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fca1-d118-4efc-8234-68553015f42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5ba755146f45cf98c12cee9dca2a9b, user_id=c926a69196634fa185032716476e0663, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:16.061064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fca1-d118-4efc-8234-68553015f42d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:16.113617 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3732/7435] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:15 2022] PUT /identity/v3/projects/1c5ba755146f45cf98c12cee9dca2a9b/users/c926a69196634fa185032716476e0663/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:16.127497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784829c-7cb8-491c-ba2c-d99b10d0be99 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:16.128723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784829c-7cb8-491c-ba2c-d99b10d0be99 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:16.130270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784829c-7cb8-491c-ba2c-d99b10d0be99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:16.216250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6784829c-7cb8-491c-ba2c-d99b10d0be99 None None] MFA Rules not processed for user `c926a69196634fa185032716476e0663`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:16.221190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6784829c-7cb8-491c-ba2c-d99b10d0be99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:16.441915 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3704/7436] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:16.458298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fca1-d118-4efc-8234-68553015f42d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:16.461281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5b07fca1-d118-4efc-8234-68553015f42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:16.635554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fca1-d118-4efc-8234-68553015f42d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:16.645758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324c1e-9993-4169-8d60-0c05e0943f87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:16.646389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324c1e-9993-4169-8d60-0c05e0943f87 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:16.648246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324c1e-9993-4169-8d60-0c05e0943f87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:16.648950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324c1e-9993-4169-8d60-0c05e0943f87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:16.753935 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:16.837887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5324c1e-9993-4169-8d60-0c05e0943f87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:16.851744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5324c1e-9993-4169-8d60-0c05e0943f87 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:16.895747 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3733/7437] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:18.537392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784829c-7cb8-491c-ba2c-d99b10d0be99 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:18.645972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784829c-7cb8-491c-ba2c-d99b10d0be99 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:18.651699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a097d91-3ac5-4688-b6e6-83f2bd6399e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:18.662647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097d91-3ac5-4688-b6e6-83f2bd6399e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:18.669883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097d91-3ac5-4688-b6e6-83f2bd6399e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:18.670890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097d91-3ac5-4688-b6e6-83f2bd6399e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:18.673165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7a097d91-3ac5-4688-b6e6-83f2bd6399e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:18.777285 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:18.830085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a097d91-3ac5-4688-b6e6-83f2bd6399e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:18.830085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a097d91-3ac5-4688-b6e6-83f2bd6399e1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:18.868695 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3705/7438] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:21.283700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324c1e-9993-4169-8d60-0c05e0943f87 service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:21.285843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a5324c1e-9993-4169-8d60-0c05e0943f87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:21.313034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324c1e-9993-4169-8d60-0c05e0943f87 service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:21.317551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2a0cd-a3c0-4586-bda5-62bfa49c2f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:21.318698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2a0cd-a3c0-4586-bda5-62bfa49c2f79 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:21.319485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2a0cd-a3c0-4586-bda5-62bfa49c2f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:21.320830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2a0cd-a3c0-4586-bda5-62bfa49c2f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:21.471706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2a0cd-a3c0-4586-bda5-62bfa49c2f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:21.473348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2a0cd-a3c0-4586-bda5-62bfa49c2f79 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:21.510709 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3734/7439] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:34:22.894265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a097d91-3ac5-4688-b6e6-83f2bd6399e1 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:22.914647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a097d91-3ac5-4688-b6e6-83f2bd6399e1 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:22.928267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adb227-bd1c-41a4-8f05-43a06df82d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:22.929080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adb227-bd1c-41a4-8f05-43a06df82d15 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:22.937858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adb227-bd1c-41a4-8f05-43a06df82d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:22.938162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adb227-bd1c-41a4-8f05-43a06df82d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:23.011663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adb227-bd1c-41a4-8f05-43a06df82d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:23.013146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adb227-bd1c-41a4-8f05-43a06df82d15 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:23.047840 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3706/7440] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:23.162238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2a0cd-a3c0-4586-bda5-62bfa49c2f79 service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:23.335841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2a0cd-a3c0-4586-bda5-62bfa49c2f79 service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:23.345491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:23.347449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:23.352700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:23.353337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] PATH_INFO: `/v3/users/b4b2240357bc4938a6230c6b4e10fe9b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:23.354962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b2240357bc4938a6230c6b4e10fe9b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:23.360268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:23.445668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b2240357bc4938a6230c6b4e10fe9b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:23.473658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b2240357bc4938a6230c6b4e10fe9b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:23.475295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b2240357bc4938a6230c6b4e10fe9b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:23.495396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b2240357bc4938a6230c6b4e10fe9b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:23.496091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b2240357bc4938a6230c6b4e10fe9b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:23.526730 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:23.534207 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3735/7441] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:34:23 2022] DELETE /identity/v3/users/b4b2240357bc4938a6230c6b4e10fe9b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:23.538969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5b09-05e3-45b4-97ea-d73dc60904bf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:23.539513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5b09-05e3-45b4-97ea-d73dc60904bf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:23.539969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5b09-05e3-45b4-97ea-d73dc60904bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:23.577684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3a0a5b09-05e3-45b4-97ea-d73dc60904bf None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:23.579249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a0a5b09-05e3-45b4-97ea-d73dc60904bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:23.779118 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3707/7442] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:23.790578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:23.792508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:23.952681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070ad42-e767-4ff8-b967-3f42a2950caa admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:23.979806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e1e0e-16a9-4d48-9501-3ef41ece36d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:23.980292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e1e0e-16a9-4d48-9501-3ef41ece36d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:23.980677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e1e0e-16a9-4d48-9501-3ef41ece36d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:23.981093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e1e0e-16a9-4d48-9501-3ef41ece36d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:23.992371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e1e0e-16a9-4d48-9501-3ef41ece36d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:23.994099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e1e0e-16a9-4d48-9501-3ef41ece36d8 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:24.010341 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3736/7443] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:24.698648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a5b09-05e3-45b4-97ea-d73dc60904bf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:24.700148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a0a5b09-05e3-45b4-97ea-d73dc60904bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:24.732991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a5b09-05e3-45b4-97ea-d73dc60904bf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:24.763866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:24.776576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:24.776865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:24.777143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] PATH_INFO: `/v3/projects/bfb241db2b434ad5a8a2bf94e52ff830` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:24.781299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb241db2b434ad5a8a2bf94e52ff830)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:24.783339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:24.894154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb241db2b434ad5a8a2bf94e52ff830', 'request_id': 'req-6b817a03-a549-4970-bff7-71df6801f6ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:24.901513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb241db2b434ad5a8a2bf94e52ff830', 'request_id': 'req-6b817a03-a549-4970-bff7-71df6801f6ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:24.909762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb241db2b434ad5a8a2bf94e52ff830', 'request_id': 'req-6b817a03-a549-4970-bff7-71df6801f6ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:24.953154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] The token cache is being invalidate because project bfb241db2b434ad5a8a2bf94e52ff830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:34:24.958373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:24.979227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:24.983046 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3708/7444] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:34:24 2022] DELETE /identity/v3/projects/bfb241db2b434ad5a8a2bf94e52ff830 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:24.986998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e1e0e-16a9-4d48-9501-3ef41ece36d8 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:25.001691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e1e0e-16a9-4d48-9501-3ef41ece36d8 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:25.074655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed182a4-97e5-4678-8579-244581ff0a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:25.075569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed182a4-97e5-4678-8579-244581ff0a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:25.076091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed182a4-97e5-4678-8579-244581ff0a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:25.076535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed182a4-97e5-4678-8579-244581ff0a10 admin admin] PATH_INFO: `/v3/users/ac26fcd3dc2b4ae984f26fa7a5312c2d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:25.078378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed182a4-97e5-4678-8579-244581ff0a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac26fcd3dc2b4ae984f26fa7a5312c2d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:25.080858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed182a4-97e5-4678-8579-244581ff0a10 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:25.203466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5ed182a4-97e5-4678-8579-244581ff0a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac26fcd3dc2b4ae984f26fa7a5312c2d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:25.237902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5ed182a4-97e5-4678-8579-244581ff0a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac26fcd3dc2b4ae984f26fa7a5312c2d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:25.248016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5ed182a4-97e5-4678-8579-244581ff0a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac26fcd3dc2b4ae984f26fa7a5312c2d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:25.273499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5ed182a4-97e5-4678-8579-244581ff0a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac26fcd3dc2b4ae984f26fa7a5312c2d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:25.274217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5ed182a4-97e5-4678-8579-244581ff0a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac26fcd3dc2b4ae984f26fa7a5312c2d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:25.303227 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3737/7445] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:34:24 2022] DELETE /identity/v3/users/ac26fcd3dc2b4ae984f26fa7a5312c2d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:25.956942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:25.975509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:26.028246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b817a03-a549-4970-bff7-71df6801f6ea admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:26.179868 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:26.229570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:26.232714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:26.233452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:26.234542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] PATH_INFO: `/v3/projects/4d00c15c50434fc2a262f0fae65d569c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:26.237146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d00c15c50434fc2a262f0fae65d569c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:26.245050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:26.359396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d00c15c50434fc2a262f0fae65d569c', 'request_id': 'req-8fb576af-e7e6-4df7-b23b-4d879bfef55b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:26.371313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d00c15c50434fc2a262f0fae65d569c', 'request_id': 'req-8fb576af-e7e6-4df7-b23b-4d879bfef55b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:26.378753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d00c15c50434fc2a262f0fae65d569c', 'request_id': 'req-8fb576af-e7e6-4df7-b23b-4d879bfef55b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:26.405573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] The token cache is being invalidate because project 4d00c15c50434fc2a262f0fae65d569c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:34:26.405573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:26.406294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8fb576af-e7e6-4df7-b23b-4d879bfef55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:26.412440 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3709/7446] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:34:25 2022] DELETE /identity/v3/projects/4d00c15c50434fc2a262f0fae65d569c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:26.414345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1eda6-870b-4cff-99fa-a1bd93ff72b9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:26.415378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1eda6-870b-4cff-99fa-a1bd93ff72b9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:26.417354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1eda6-870b-4cff-99fa-a1bd93ff72b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:26.458089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ebb1eda6-870b-4cff-99fa-a1bd93ff72b9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:26.459540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ebb1eda6-870b-4cff-99fa-a1bd93ff72b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:26.501325 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:26.665977 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3738/7447] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:26.667698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feefcc-7394-4066-9525-542808a382e3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:26.667986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feefcc-7394-4066-9525-542808a382e3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:26.668263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feefcc-7394-4066-9525-542808a382e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:26.728142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-08feefcc-7394-4066-9525-542808a382e3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:26.729408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-08feefcc-7394-4066-9525-542808a382e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:26.760526 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3710/7448] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:26.764744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1eda6-870b-4cff-99fa-a1bd93ff72b9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:26.781532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1eda6-870b-4cff-99fa-a1bd93ff72b9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:26.797203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199810-0268-4bc0-9dd1-d2dc63af0efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:26.798162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199810-0268-4bc0-9dd1-d2dc63af0efd admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:26.798701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199810-0268-4bc0-9dd1-d2dc63af0efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:26.799273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199810-0268-4bc0-9dd1-d2dc63af0efd admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:26.806472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91199810-0268-4bc0-9dd1-d2dc63af0efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:34:26.807057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91199810-0268-4bc0-9dd1-d2dc63af0efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:26.808895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91199810-0268-4bc0-9dd1-d2dc63af0efd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:26.850154 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3739/7449] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:34:26.855757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feefcc-7394-4066-9525-542808a382e3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:26.869919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feefcc-7394-4066-9525-542808a382e3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:26.879932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572c54a-819d-49e5-b252-c09bc8697787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:26.880570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572c54a-819d-49e5-b252-c09bc8697787 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:26.880855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572c54a-819d-49e5-b252-c09bc8697787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:26.881134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572c54a-819d-49e5-b252-c09bc8697787 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:26.881782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572c54a-819d-49e5-b252-c09bc8697787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:26.892424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572c54a-819d-49e5-b252-c09bc8697787 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:26.951068 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3711/7450] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:26 2022] POST /identity/v3/projects => generated 395 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:26.956849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199810-0268-4bc0-9dd1-d2dc63af0efd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:26.996953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199810-0268-4bc0-9dd1-d2dc63af0efd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:27.083736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942a66c-266f-40d8-81fe-3c3c1228c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:27.084588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942a66c-266f-40d8-81fe-3c3c1228c0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:27.085274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942a66c-266f-40d8-81fe-3c3c1228c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:27.085739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942a66c-266f-40d8-81fe-3c3c1228c0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:27.086633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942a66c-266f-40d8-81fe-3c3c1228c0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:27.088857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942a66c-266f-40d8-81fe-3c3c1228c0c1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:27.122416 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3740/7451] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:26 2022] POST /identity/v3/users => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:27.123736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572c54a-819d-49e5-b252-c09bc8697787 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:27.137839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572c54a-819d-49e5-b252-c09bc8697787 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:27.143986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dce78b-910c-439e-a732-e65677af73c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:27.144828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dce78b-910c-439e-a732-e65677af73c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:27.145112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dce78b-910c-439e-a732-e65677af73c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:27.145459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dce78b-910c-439e-a732-e65677af73c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:27.147348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dce78b-910c-439e-a732-e65677af73c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:27.151269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dce78b-910c-439e-a732-e65677af73c3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:27.180579 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3712/7452] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:34:27.181914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942a66c-266f-40d8-81fe-3c3c1228c0c1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:27.193657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942a66c-266f-40d8-81fe-3c3c1228c0c1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:27.201625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c974a65-bf58-425e-a8fe-51bff953c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:27.202533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c974a65-bf58-425e-a8fe-51bff953c6ed admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:27.202910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c974a65-bf58-425e-a8fe-51bff953c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:27.203232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c974a65-bf58-425e-a8fe-51bff953c6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:27.203957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c974a65-bf58-425e-a8fe-51bff953c6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:27.206130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c974a65-bf58-425e-a8fe-51bff953c6ed admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:27.219830 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3741/7453] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:27.223723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dce78b-910c-439e-a732-e65677af73c3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:27.245309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dce78b-910c-439e-a732-e65677af73c3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:27.263739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12f746-3d8c-40e7-a92f-cd2d4c5df0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:27.264852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12f746-3d8c-40e7-a92f-cd2d4c5df0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:27.265381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12f746-3d8c-40e7-a92f-cd2d4c5df0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:27.265909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12f746-3d8c-40e7-a92f-cd2d4c5df0f8 admin admin] PATH_INFO: `/v3/projects/651f8d05e90743f2abf34d29c67c8fae/users/3de1190a68164329b5b48f0f90c82a5d/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:27.306099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12f746-3d8c-40e7-a92f-cd2d4c5df0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=651f8d05e90743f2abf34d29c67c8fae, user_id=3de1190a68164329b5b48f0f90c82a5d, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:27.309520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12f746-3d8c-40e7-a92f-cd2d4c5df0f8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:27.341700 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3713/7454] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:27 2022] PUT /identity/v3/projects/651f8d05e90743f2abf34d29c67c8fae/users/3de1190a68164329b5b48f0f90c82a5d/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:34:27.352594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d242d03-461e-4e3a-b414-eb77a0320e1d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:27.353286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d242d03-461e-4e3a-b414-eb77a0320e1d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:27.353812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d242d03-461e-4e3a-b414-eb77a0320e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:27.413186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8d242d03-461e-4e3a-b414-eb77a0320e1d None None] MFA Rules not processed for user `3de1190a68164329b5b48f0f90c82a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:27.414527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8d242d03-461e-4e3a-b414-eb77a0320e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:27.501189 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3742/7455] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:27.511629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12f746-3d8c-40e7-a92f-cd2d4c5df0f8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:27.513716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed12f746-3d8c-40e7-a92f-cd2d4c5df0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:27.627675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12f746-3d8c-40e7-a92f-cd2d4c5df0f8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:27.633497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9033b80-3b96-4f33-a870-2a71cf2e9889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:27.634200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033b80-3b96-4f33-a870-2a71cf2e9889 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:27.634628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033b80-3b96-4f33-a870-2a71cf2e9889 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:27.635041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033b80-3b96-4f33-a870-2a71cf2e9889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:27.646408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9033b80-3b96-4f33-a870-2a71cf2e9889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:27.648669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9033b80-3b96-4f33-a870-2a71cf2e9889 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:27.665420 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3714/7456] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:27 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:29.756395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d242d03-461e-4e3a-b414-eb77a0320e1d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:29.758679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8d242d03-461e-4e3a-b414-eb77a0320e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:29.792504 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:29.984772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d242d03-461e-4e3a-b414-eb77a0320e1d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:30.014130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:30.014827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:30.015109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:30.020214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] PATH_INFO: `/v3/users/6eacc5fa3dc14e549ba8a9aba8bf9e41` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:30.026481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eacc5fa3dc14e549ba8a9aba8bf9e41)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:30.029387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:30.203586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eacc5fa3dc14e549ba8a9aba8bf9e41'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:30.228633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eacc5fa3dc14e549ba8a9aba8bf9e41'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:30.229611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eacc5fa3dc14e549ba8a9aba8bf9e41'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:30.250399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eacc5fa3dc14e549ba8a9aba8bf9e41'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:30.251155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eacc5fa3dc14e549ba8a9aba8bf9e41'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:30.295968 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3743/7457] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:34:29 2022] DELETE /identity/v3/users/6eacc5fa3dc14e549ba8a9aba8bf9e41 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:30.300315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b00387-9bce-4814-a630-f8dc43670630 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:30.300794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b00387-9bce-4814-a630-f8dc43670630 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:30.300916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b00387-9bce-4814-a630-f8dc43670630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:30.340551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-84b00387-9bce-4814-a630-f8dc43670630 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:30.341792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-84b00387-9bce-4814-a630-f8dc43670630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:30.361868 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:30.470251 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3715/7458] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:30.511735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:30.512865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:30.636089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9babf-7a2b-464c-af66-e466c0f42827 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:30.647620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8426b-9d10-4c20-8b84-f7c1536d1c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:30.648496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8426b-9d10-4c20-8b84-f7c1536d1c19 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:30.648767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8426b-9d10-4c20-8b84-f7c1536d1c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:30.649618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8426b-9d10-4c20-8b84-f7c1536d1c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:30.677838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8426b-9d10-4c20-8b84-f7c1536d1c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:30.680553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8426b-9d10-4c20-8b84-f7c1536d1c19 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:30.706121 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3744/7459] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:32.028791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccf143-2931-41fb-9f1b-1fc61436181b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:32.029318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccf143-2931-41fb-9f1b-1fc61436181b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:32.029614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccf143-2931-41fb-9f1b-1fc61436181b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:32.079804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bbccf143-2931-41fb-9f1b-1fc61436181b None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:32.085511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bbccf143-2931-41fb-9f1b-1fc61436181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:32.177730 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3716/7460] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:34:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:32.203533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8426b-9d10-4c20-8b84-f7c1536d1c19 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:32.205741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0ee8426b-9d10-4c20-8b84-f7c1536d1c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:32.308509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccf143-2931-41fb-9f1b-1fc61436181b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:32.311316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bbccf143-2931-41fb-9f1b-1fc61436181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:32.335427 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:32.345445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccf143-2931-41fb-9f1b-1fc61436181b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:32.362242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:32.363213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:32.363694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:32.364352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] PATH_INFO: `/v3/projects/7c48c00badeb420d9c4a270e3116e271` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:32.368110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c48c00badeb420d9c4a270e3116e271)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:32.370566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:32.418718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8426b-9d10-4c20-8b84-f7c1536d1c19 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:32.433206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e914c5a-2351-4a40-bf1c-85d23d08a4ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:32.433982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e914c5a-2351-4a40-bf1c-85d23d08a4ef service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:32.434277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e914c5a-2351-4a40-bf1c-85d23d08a4ef service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:32.434554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e914c5a-2351-4a40-bf1c-85d23d08a4ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:32.469527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e914c5a-2351-4a40-bf1c-85d23d08a4ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:32.469527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e914c5a-2351-4a40-bf1c-85d23d08a4ef service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:32.480645 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3745/7461] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:34:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:34:32.581269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c48c00badeb420d9c4a270e3116e271', 'request_id': 'req-258ac2f3-5ef6-47a9-80dd-d127d622388f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:32.617726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c48c00badeb420d9c4a270e3116e271', 'request_id': 'req-258ac2f3-5ef6-47a9-80dd-d127d622388f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:32.638426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c48c00badeb420d9c4a270e3116e271', 'request_id': 'req-258ac2f3-5ef6-47a9-80dd-d127d622388f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:32.673492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] The token cache is being invalidate because project 7c48c00badeb420d9c4a270e3116e271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:34:32.678273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:32.680120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-258ac2f3-5ef6-47a9-80dd-d127d622388f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:32.682431 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3717/7462] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:34:32 2022] DELETE /identity/v3/projects/7c48c00badeb420d9c4a270e3116e271 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:32.688023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc2260-3895-48f0-bead-d1ede6c02898 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:32.688379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc2260-3895-48f0-bead-d1ede6c02898 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:32.688708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc2260-3895-48f0-bead-d1ede6c02898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:32.752033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-81fc2260-3895-48f0-bead-d1ede6c02898 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:32.756562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-81fc2260-3895-48f0-bead-d1ede6c02898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:33.042379 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3746/7463] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:33.050004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f68ef-4a8c-4903-9ba6-0b9e6958c7e9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:33.051143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f68ef-4a8c-4903-9ba6-0b9e6958c7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:33.051696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f68ef-4a8c-4903-9ba6-0b9e6958c7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:33.128829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a62f68ef-4a8c-4903-9ba6-0b9e6958c7e9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:33.137766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a62f68ef-4a8c-4903-9ba6-0b9e6958c7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:33.169741 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3718/7464] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:33.174271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc2260-3895-48f0-bead-d1ede6c02898 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:33.196472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc2260-3895-48f0-bead-d1ede6c02898 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:33.222078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c255314-da5d-446f-98d2-788a9582254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:33.224404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255314-da5d-446f-98d2-788a9582254f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:33.224689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255314-da5d-446f-98d2-788a9582254f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:33.226750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255314-da5d-446f-98d2-788a9582254f admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:33.227637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c255314-da5d-446f-98d2-788a9582254f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:34:33.228126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c255314-da5d-446f-98d2-788a9582254f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:33.233009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c255314-da5d-446f-98d2-788a9582254f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:33.281572 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3747/7465] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:34:33.285999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f68ef-4a8c-4903-9ba6-0b9e6958c7e9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:33.307240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f68ef-4a8c-4903-9ba6-0b9e6958c7e9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:33.331319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaede635-2c28-4e82-b0d5-5a76d333a3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:33.331957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaede635-2c28-4e82-b0d5-5a76d333a3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:33.332232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaede635-2c28-4e82-b0d5-5a76d333a3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:33.332504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaede635-2c28-4e82-b0d5-5a76d333a3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:33.333142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaede635-2c28-4e82-b0d5-5a76d333a3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:33.335152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaede635-2c28-4e82-b0d5-5a76d333a3dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:33.442896 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3719/7466] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:33 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:34:33.447010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c255314-da5d-446f-98d2-788a9582254f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:33.465239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c255314-da5d-446f-98d2-788a9582254f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:33.636098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c8974-a6bf-48e3-affb-d6620aa83ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:33.639713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c8974-a6bf-48e3-affb-d6620aa83ade admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:33.640885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c8974-a6bf-48e3-affb-d6620aa83ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:33.641175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c8974-a6bf-48e3-affb-d6620aa83ade admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:33.641848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c8974-a6bf-48e3-affb-d6620aa83ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:33.649414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c8974-a6bf-48e3-affb-d6620aa83ade admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:33.710742 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3748/7467] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:33 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:33.714433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaede635-2c28-4e82-b0d5-5a76d333a3dc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:33.736837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaede635-2c28-4e82-b0d5-5a76d333a3dc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:33.751737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017ddf-7790-4b2b-b606-72327c0afc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:33.752296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017ddf-7790-4b2b-b606-72327c0afc1b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:33.752583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017ddf-7790-4b2b-b606-72327c0afc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:33.752852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017ddf-7790-4b2b-b606-72327c0afc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:33.753500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab017ddf-7790-4b2b-b606-72327c0afc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:33.755156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab017ddf-7790-4b2b-b606-72327c0afc1b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:33.793065 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3720/7468] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:33.796932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c8974-a6bf-48e3-affb-d6620aa83ade admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:33.814400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c8974-a6bf-48e3-affb-d6620aa83ade admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:33.825112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233f901-97fb-41ac-944a-8f94b7e3c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:33.826300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233f901-97fb-41ac-944a-8f94b7e3c4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:33.827050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233f901-97fb-41ac-944a-8f94b7e3c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:33.827717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233f901-97fb-41ac-944a-8f94b7e3c4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:33.828571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233f901-97fb-41ac-944a-8f94b7e3c4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:33.830530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233f901-97fb-41ac-944a-8f94b7e3c4d4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:33.851868 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3749/7469] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:33.860288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017ddf-7790-4b2b-b606-72327c0afc1b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:33.872084 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:33.880587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017ddf-7790-4b2b-b606-72327c0afc1b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:33.901478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584097a-da34-4605-8be4-be3915520392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:33.902538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584097a-da34-4605-8be4-be3915520392 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:33.902779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584097a-da34-4605-8be4-be3915520392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:33.903016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584097a-da34-4605-8be4-be3915520392 admin admin] PATH_INFO: `/v3/projects/e3d1b3bb7d3e4d6e9ac2e77cd77a4642/users/6a1352ee9dbe4587800e17d8b3287252/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:33.945525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584097a-da34-4605-8be4-be3915520392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d1b3bb7d3e4d6e9ac2e77cd77a4642, user_id=6a1352ee9dbe4587800e17d8b3287252, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:33.948659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584097a-da34-4605-8be4-be3915520392 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:34.001267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad861d9-6013-4134-9e0d-5d2247928541 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:34.002430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad861d9-6013-4134-9e0d-5d2247928541 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:34.002896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad861d9-6013-4134-9e0d-5d2247928541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:34.006813 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3721/7470] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:33 2022] PUT /identity/v3/projects/e3d1b3bb7d3e4d6e9ac2e77cd77a4642/users/6a1352ee9dbe4587800e17d8b3287252/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:34.062473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cad861d9-6013-4134-9e0d-5d2247928541 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:34.063746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cad861d9-6013-4134-9e0d-5d2247928541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:34.119648 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:34.236060 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3750/7471] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:34.373532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584097a-da34-4605-8be4-be3915520392 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:34.376409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a584097a-da34-4605-8be4-be3915520392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:34.532572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584097a-da34-4605-8be4-be3915520392 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:34.543391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31a76b-6375-4bb5-b405-f691ad1e61f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:34.544044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31a76b-6375-4bb5-b405-f691ad1e61f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:34.544329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31a76b-6375-4bb5-b405-f691ad1e61f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:34.550770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31a76b-6375-4bb5-b405-f691ad1e61f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:34.572013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31a76b-6375-4bb5-b405-f691ad1e61f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:34.573878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31a76b-6375-4bb5-b405-f691ad1e61f1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:34.605953 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3722/7472] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:35.973062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad861d9-6013-4134-9e0d-5d2247928541 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:35.977357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cad861d9-6013-4134-9e0d-5d2247928541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:35.993135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad861d9-6013-4134-9e0d-5d2247928541 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:35.999077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8ca4c-ebd9-4772-aa12-3d19e49159e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:36.000162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8ca4c-ebd9-4772-aa12-3d19e49159e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:36.000669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8ca4c-ebd9-4772-aa12-3d19e49159e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:36.001161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8ca4c-ebd9-4772-aa12-3d19e49159e6 admin admin] PATH_INFO: `/v3/users/23b0502f8dae496180c4baf19d484666` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:36.002871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8ca4c-ebd9-4772-aa12-3d19e49159e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b0502f8dae496180c4baf19d484666)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:36.005086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8ca4c-ebd9-4772-aa12-3d19e49159e6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:36.065501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26d8ca4c-ebd9-4772-aa12-3d19e49159e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b0502f8dae496180c4baf19d484666'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:36.081818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26d8ca4c-ebd9-4772-aa12-3d19e49159e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b0502f8dae496180c4baf19d484666'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:36.082905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26d8ca4c-ebd9-4772-aa12-3d19e49159e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b0502f8dae496180c4baf19d484666'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:36.095258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26d8ca4c-ebd9-4772-aa12-3d19e49159e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b0502f8dae496180c4baf19d484666'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:36.096452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-26d8ca4c-ebd9-4772-aa12-3d19e49159e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b0502f8dae496180c4baf19d484666'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:36.118300 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3751/7473] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:34:35 2022] DELETE /identity/v3/users/23b0502f8dae496180c4baf19d484666 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:36.119779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bb2d5-f30c-4f85-aa4a-9cad69bc8225 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:36.120757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bb2d5-f30c-4f85-aa4a-9cad69bc8225 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:36.121317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bb2d5-f30c-4f85-aa4a-9cad69bc8225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:36.166417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a76bb2d5-f30c-4f85-aa4a-9cad69bc8225 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:36.169923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a76bb2d5-f30c-4f85-aa4a-9cad69bc8225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:36.312700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e454-6371-4042-89bc-d8237b28031c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:36.313061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e454-6371-4042-89bc-d8237b28031c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:36.313407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e454-6371-4042-89bc-d8237b28031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:36.338332 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3723/7474] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:36.356162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bb2d5-f30c-4f85-aa4a-9cad69bc8225 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:36.357656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a76bb2d5-f30c-4f85-aa4a-9cad69bc8225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:36.379311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f556e454-6371-4042-89bc-d8237b28031c None None] MFA Rules not processed for user `6a1352ee9dbe4587800e17d8b3287252`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:36.380328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f556e454-6371-4042-89bc-d8237b28031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:36.489400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bb2d5-f30c-4f85-aa4a-9cad69bc8225 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:36.495681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b8494-837d-4d4a-a414-3190d27b2906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:36.497908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b8494-837d-4d4a-a414-3190d27b2906 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:36.498380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b8494-837d-4d4a-a414-3190d27b2906 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:36.502800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b8494-837d-4d4a-a414-3190d27b2906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:36.539231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b8494-837d-4d4a-a414-3190d27b2906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:36.545343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b8494-837d-4d4a-a414-3190d27b2906 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:36.550693 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3752/7475] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:36.558990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e454-6371-4042-89bc-d8237b28031c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:36.561151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f556e454-6371-4042-89bc-d8237b28031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:36.574317 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3724/7476] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:36.608799 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:36.648505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e454-6371-4042-89bc-d8237b28031c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:36.659338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef100092-9751-4b6a-be6d-5738f93ab9ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:36.660720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef100092-9751-4b6a-be6d-5738f93ab9ec service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:36.661195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef100092-9751-4b6a-be6d-5738f93ab9ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:36.661797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef100092-9751-4b6a-be6d-5738f93ab9ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:36.673994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef100092-9751-4b6a-be6d-5738f93ab9ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:36.675898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef100092-9751-4b6a-be6d-5738f93ab9ec service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:36.704249 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3753/7477] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:37.284001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b8494-837d-4d4a-a414-3190d27b2906 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:37.288671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6f3b8494-837d-4d4a-a414-3190d27b2906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:37.342591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b8494-837d-4d4a-a414-3190d27b2906 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:37.372353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:37.376900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:37.377591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:37.378322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] PATH_INFO: `/v3/projects/8875d6c71c524ec398498c980360c2a4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:37.381152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8875d6c71c524ec398498c980360c2a4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:37.391545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:37.445386 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:37.497460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8875d6c71c524ec398498c980360c2a4', 'request_id': 'req-db33ef4b-a6fb-4c72-bebf-963a698eda16'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.514367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8875d6c71c524ec398498c980360c2a4', 'request_id': 'req-db33ef4b-a6fb-4c72-bebf-963a698eda16'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.521501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8875d6c71c524ec398498c980360c2a4', 'request_id': 'req-db33ef4b-a6fb-4c72-bebf-963a698eda16'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.528965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef100092-9751-4b6a-be6d-5738f93ab9ec service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:37.531771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ef100092-9751-4b6a-be6d-5738f93ab9ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:37.552363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] The token cache is being invalidate because project 8875d6c71c524ec398498c980360c2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:34:37.552708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.560577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.565233 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3725/7478] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:34:37 2022] DELETE /identity/v3/projects/8875d6c71c524ec398498c980360c2a4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:37.566570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:37.568761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:37.581458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef100092-9751-4b6a-be6d-5738f93ab9ec service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:37.701499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33ef4b-a6fb-4c72-bebf-963a698eda16 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:37.713474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c94ad5-3c2f-4deb-8c64-3e8a30f76846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:37.714353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c94ad5-3c2f-4deb-8c64-3e8a30f76846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:37.714830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c94ad5-3c2f-4deb-8c64-3e8a30f76846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:37.715290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c94ad5-3c2f-4deb-8c64-3e8a30f76846 admin admin] PATH_INFO: `/v3/users/c9b76dc4c74740798a5422e3280e0d49` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:37.717255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c94ad5-3c2f-4deb-8c64-3e8a30f76846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b76dc4c74740798a5422e3280e0d49)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:37.720380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c94ad5-3c2f-4deb-8c64-3e8a30f76846 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:37.841190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70c94ad5-3c2f-4deb-8c64-3e8a30f76846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b76dc4c74740798a5422e3280e0d49'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.842158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:37.845322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:37.845805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:37.846356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] PATH_INFO: `/v3/users/83972a83638545179841dedbb1b9931a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:37.850554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83972a83638545179841dedbb1b9931a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:37.852881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:37.872614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70c94ad5-3c2f-4deb-8c64-3e8a30f76846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b76dc4c74740798a5422e3280e0d49'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.873514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70c94ad5-3c2f-4deb-8c64-3e8a30f76846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b76dc4c74740798a5422e3280e0d49'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.897334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70c94ad5-3c2f-4deb-8c64-3e8a30f76846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b76dc4c74740798a5422e3280e0d49'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.907746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70c94ad5-3c2f-4deb-8c64-3e8a30f76846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b76dc4c74740798a5422e3280e0d49'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.925631 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3726/7479] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:34:37 2022] DELETE /identity/v3/users/c9b76dc4c74740798a5422e3280e0d49 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:37.969376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83972a83638545179841dedbb1b9931a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.983403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83972a83638545179841dedbb1b9931a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.985038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83972a83638545179841dedbb1b9931a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.996192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83972a83638545179841dedbb1b9931a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:37.997228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83972a83638545179841dedbb1b9931a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:38.013162 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3754/7480] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:34:37 2022] DELETE /identity/v3/users/83972a83638545179841dedbb1b9931a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:38.017813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80346da-b011-4cb6-a36c-b2405be775a0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:38.017956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80346da-b011-4cb6-a36c-b2405be775a0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:38.018235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80346da-b011-4cb6-a36c-b2405be775a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:38.051699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a80346da-b011-4cb6-a36c-b2405be775a0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:38.053271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a80346da-b011-4cb6-a36c-b2405be775a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:38.087289 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:38.218210 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3727/7481] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:38.339386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:38.341029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:38.470368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80346da-b011-4cb6-a36c-b2405be775a0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:38.472442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a80346da-b011-4cb6-a36c-b2405be775a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:38.487409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989710-b699-4e05-95df-036cbeea68e0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:38.494127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015be39-45ea-4fc9-ae9a-8d11958a2937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:38.495164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015be39-45ea-4fc9-ae9a-8d11958a2937 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:38.495453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015be39-45ea-4fc9-ae9a-8d11958a2937 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:38.495729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015be39-45ea-4fc9-ae9a-8d11958a2937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:38.512234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015be39-45ea-4fc9-ae9a-8d11958a2937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:38.514093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015be39-45ea-4fc9-ae9a-8d11958a2937 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:38.520836 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:38.526907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80346da-b011-4cb6-a36c-b2405be775a0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:38.535724 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3755/7482] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:38.542788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:38.543992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:38.544755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:38.547102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] PATH_INFO: `/v3/projects/fdbe83d5055344948d9527678474f436` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:38.552191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbe83d5055344948d9527678474f436)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:38.556262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:38.679811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbe83d5055344948d9527678474f436', 'request_id': 'req-d9660487-c99f-4022-b4fd-0dbb1921430c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:38.687080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbe83d5055344948d9527678474f436', 'request_id': 'req-d9660487-c99f-4022-b4fd-0dbb1921430c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:38.697751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbe83d5055344948d9527678474f436', 'request_id': 'req-d9660487-c99f-4022-b4fd-0dbb1921430c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:38.731731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] The token cache is being invalidate because project fdbe83d5055344948d9527678474f436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:34:38.732098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:38.733638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:38.736205 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3728/7483] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:34:38 2022] DELETE /identity/v3/projects/fdbe83d5055344948d9527678474f436 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:34:38.741106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015be39-45ea-4fc9-ae9a-8d11958a2937 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:38.762403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015be39-45ea-4fc9-ae9a-8d11958a2937 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:38.852835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459eb02-537d-46f8-bccd-fe7f993bc5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:38.854244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459eb02-537d-46f8-bccd-fe7f993bc5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:38.854816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459eb02-537d-46f8-bccd-fe7f993bc5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:38.855313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459eb02-537d-46f8-bccd-fe7f993bc5e4 admin admin] PATH_INFO: `/v3/users/c926a69196634fa185032716476e0663` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:38.856966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459eb02-537d-46f8-bccd-fe7f993bc5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c926a69196634fa185032716476e0663)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:38.859826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459eb02-537d-46f8-bccd-fe7f993bc5e4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:38.924732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d459eb02-537d-46f8-bccd-fe7f993bc5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c926a69196634fa185032716476e0663'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:38.948079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d459eb02-537d-46f8-bccd-fe7f993bc5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c926a69196634fa185032716476e0663'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:38.948909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d459eb02-537d-46f8-bccd-fe7f993bc5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c926a69196634fa185032716476e0663'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:38.983221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d459eb02-537d-46f8-bccd-fe7f993bc5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c926a69196634fa185032716476e0663'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:38.984038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d459eb02-537d-46f8-bccd-fe7f993bc5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c926a69196634fa185032716476e0663'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:39.001981 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3756/7484] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:34:38 2022] DELETE /identity/v3/users/c926a69196634fa185032716476e0663 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:39.090889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:39.093416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:39.127767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9660487-c99f-4022-b4fd-0dbb1921430c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:39.266413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:39.267202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:39.267582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:39.267956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] PATH_INFO: `/v3/projects/1bdf7e95f92c461c98a043af0d10ac43` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:39.269254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bdf7e95f92c461c98a043af0d10ac43)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:39.271342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:39.381027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdf7e95f92c461c98a043af0d10ac43', 'request_id': 'req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:39.384196 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:39.401233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdf7e95f92c461c98a043af0d10ac43', 'request_id': 'req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:39.414892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdf7e95f92c461c98a043af0d10ac43', 'request_id': 'req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:39.437581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] The token cache is being invalidate because project 1bdf7e95f92c461c98a043af0d10ac43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:34:39.438314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:39.439208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:39.447850 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3729/7485] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:34:39 2022] DELETE /identity/v3/projects/1bdf7e95f92c461c98a043af0d10ac43 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:39.450140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb7bca-55bf-4f37-a9b9-9ea786d8fedc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:39.450710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb7bca-55bf-4f37-a9b9-9ea786d8fedc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:39.451252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb7bca-55bf-4f37-a9b9-9ea786d8fedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:39.492203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e7cb7bca-55bf-4f37-a9b9-9ea786d8fedc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:39.493651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e7cb7bca-55bf-4f37-a9b9-9ea786d8fedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:39.500420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:39.502765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:39.613551 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3757/7486] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:39.621263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd30d4-17b5-4e8a-8899-cba97aa8b340 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:39.621881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd30d4-17b5-4e8a-8899-cba97aa8b340 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:39.622346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd30d4-17b5-4e8a-8899-cba97aa8b340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:39.640630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6631d5c-e1a0-4224-9541-0d1f27bc06d1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:39.655516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:39.656255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:39.656860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:39.657176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] PATH_INFO: `/v3/projects/1c5ba755146f45cf98c12cee9dca2a9b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:39.661423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5ba755146f45cf98c12cee9dca2a9b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:39.665650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a1fd30d4-17b5-4e8a-8899-cba97aa8b340 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:39.666972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:39.669428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1fd30d4-17b5-4e8a-8899-cba97aa8b340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:39.696964 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3758/7487] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:39.700989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd30d4-17b5-4e8a-8899-cba97aa8b340 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:39.715204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd30d4-17b5-4e8a-8899-cba97aa8b340 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:39.724733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2bc87-acbe-4150-9bf2-c3cb11038adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:39.726237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2bc87-acbe-4150-9bf2-c3cb11038adf admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:39.726802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2bc87-acbe-4150-9bf2-c3cb11038adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:39.728531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2bc87-acbe-4150-9bf2-c3cb11038adf admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:39.731962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2bc87-acbe-4150-9bf2-c3cb11038adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:34:39.736339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2bc87-acbe-4150-9bf2-c3cb11038adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:39.742104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2bc87-acbe-4150-9bf2-c3cb11038adf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:39.760653 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:39.766723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5ba755146f45cf98c12cee9dca2a9b', 'request_id': 'req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:39.775332 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3759/7488] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:34:39.777038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5ba755146f45cf98c12cee9dca2a9b', 'request_id': 'req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:39.777710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2bc87-acbe-4150-9bf2-c3cb11038adf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:39.784338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5ba755146f45cf98c12cee9dca2a9b', 'request_id': 'req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:39.803678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2bc87-acbe-4150-9bf2-c3cb11038adf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:39.807017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] The token cache is being invalidate because project 1c5ba755146f45cf98c12cee9dca2a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:34:39.807320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:39.808301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f527d798-6bac-4a1c-b7e6-f4bda069a5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:39.810105 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3730/7489] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:34:39 2022] DELETE /identity/v3/projects/1c5ba755146f45cf98c12cee9dca2a9b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:39.814849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4da7c-1e2b-47c6-810f-8893bec6beee None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:39.815328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4da7c-1e2b-47c6-810f-8893bec6beee None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:39.816031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4da7c-1e2b-47c6-810f-8893bec6beee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:39.843132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-70c4da7c-1e2b-47c6-810f-8893bec6beee None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:39.844635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70c4da7c-1e2b-47c6-810f-8893bec6beee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:39.927660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f6f0-07c3-47b4-98aa-a6eb5747f99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:39.928086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f6f0-07c3-47b4-98aa-a6eb5747f99e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:39.928597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f6f0-07c3-47b4-98aa-a6eb5747f99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:39.929706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f6f0-07c3-47b4-98aa-a6eb5747f99e admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:39.930430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689f6f0-07c3-47b4-98aa-a6eb5747f99e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:39.932842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689f6f0-07c3-47b4-98aa-a6eb5747f99e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:39.955802 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3731/7490] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:39.971705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d73c8-60cb-4b90-9ec0-def324ccb810 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:39.972423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d73c8-60cb-4b90-9ec0-def324ccb810 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:39.973992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d73c8-60cb-4b90-9ec0-def324ccb810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:39.986229 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3760/7491] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:39 2022] POST /identity/v3/projects => generated 357 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:39.987492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f6f0-07c3-47b4-98aa-a6eb5747f99e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:39.991014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5689f6f0-07c3-47b4-98aa-a6eb5747f99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:40.022464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-741d73c8-60cb-4b90-9ec0-def324ccb810 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:40.025362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-741d73c8-60cb-4b90-9ec0-def324ccb810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:40.035801 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:40.072734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f6f0-07c3-47b4-98aa-a6eb5747f99e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:40.099661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dee872-1bac-44d3-958f-967cdaf9ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:40.100304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dee872-1bac-44d3-958f-967cdaf9ffef admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.101359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dee872-1bac-44d3-958f-967cdaf9ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.101829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dee872-1bac-44d3-958f-967cdaf9ffef admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.104990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dee872-1bac-44d3-958f-967cdaf9ffef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:40.110703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dee872-1bac-44d3-958f-967cdaf9ffef admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:40.126420 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3732/7492] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:40.130627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d73c8-60cb-4b90-9ec0-def324ccb810 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:40.145693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d73c8-60cb-4b90-9ec0-def324ccb810 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:40.156268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5a933-af1d-4872-bc15-5458e3e20cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:40.156927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5a933-af1d-4872-bc15-5458e3e20cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.157398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5a933-af1d-4872-bc15-5458e3e20cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.158008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5a933-af1d-4872-bc15-5458e3e20cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.158708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5a933-af1d-4872-bc15-5458e3e20cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:34:40.159682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5a933-af1d-4872-bc15-5458e3e20cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:40.161296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5a933-af1d-4872-bc15-5458e3e20cf7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:40.169695 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3761/7493] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:39 2022] POST /identity/v3/users => generated 279 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:40.179353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dee872-1bac-44d3-958f-967cdaf9ffef admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:40.190027 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3733/7494] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:34:40.193414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dee872-1bac-44d3-958f-967cdaf9ffef admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:40.195777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5a933-af1d-4872-bc15-5458e3e20cf7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:40.199570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9701-bbca-42da-a770-1a159f084042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:40.200777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9701-bbca-42da-a770-1a159f084042 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.201258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9701-bbca-42da-a770-1a159f084042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.201750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9701-bbca-42da-a770-1a159f084042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.202642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac9701-bbca-42da-a770-1a159f084042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:40.204477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac9701-bbca-42da-a770-1a159f084042 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:40.215129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5a933-af1d-4872-bc15-5458e3e20cf7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:40.221032 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3762/7495] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:40.222270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9701-bbca-42da-a770-1a159f084042 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:40.228681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af892f-c522-492f-b1d0-98c8044a8d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:40.229382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af892f-c522-492f-b1d0-98c8044a8d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.229664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af892f-c522-492f-b1d0-98c8044a8d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.229946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af892f-c522-492f-b1d0-98c8044a8d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.230587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af892f-c522-492f-b1d0-98c8044a8d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:40.232553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af892f-c522-492f-b1d0-98c8044a8d52 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:40.234589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9701-bbca-42da-a770-1a159f084042 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:40.239809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9db6ba-8fe4-4bf1-9333-c0e17d2b7166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:40.240512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9db6ba-8fe4-4bf1-9333-c0e17d2b7166 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.240929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9db6ba-8fe4-4bf1-9333-c0e17d2b7166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.241820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9db6ba-8fe4-4bf1-9333-c0e17d2b7166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.242567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9db6ba-8fe4-4bf1-9333-c0e17d2b7166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:40.244447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9db6ba-8fe4-4bf1-9333-c0e17d2b7166 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:40.260427 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3763/7496] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:40.261438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9db6ba-8fe4-4bf1-9333-c0e17d2b7166 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:40.273211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9db6ba-8fe4-4bf1-9333-c0e17d2b7166 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:40.282893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1dd24-903a-4d84-9cf2-1f47a7529b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:40.283704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1dd24-903a-4d84-9cf2-1f47a7529b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.284272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1dd24-903a-4d84-9cf2-1f47a7529b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.286678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1dd24-903a-4d84-9cf2-1f47a7529b5b admin admin] PATH_INFO: `/v3/projects/82bef40e62a9457d8c188aa8b624bd20/users/50db4aa789bd4e4ea570d4f4c8d5e861/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.290671 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3734/7497] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:40 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:40.306478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1dd24-903a-4d84-9cf2-1f47a7529b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bef40e62a9457d8c188aa8b624bd20, user_id=50db4aa789bd4e4ea570d4f4c8d5e861, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:40.308684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af892f-c522-492f-b1d0-98c8044a8d52 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:40.309698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1dd24-903a-4d84-9cf2-1f47a7529b5b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:40.330535 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3764/7498] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:40 2022] PUT /identity/v3/projects/82bef40e62a9457d8c188aa8b624bd20/users/50db4aa789bd4e4ea570d4f4c8d5e861/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:40.345098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613711d-608f-44e7-ba85-7f87be214a81 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.345574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613711d-608f-44e7-ba85-7f87be214a81 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.346979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613711d-608f-44e7-ba85-7f87be214a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.424123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4613711d-608f-44e7-ba85-7f87be214a81 None None] MFA Rules not processed for user `50db4aa789bd4e4ea570d4f4c8d5e861`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:40.425611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4613711d-608f-44e7-ba85-7f87be214a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:40.446824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af892f-c522-492f-b1d0-98c8044a8d52 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:40.454208 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:40.549362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e4351-2a1b-4762-a565-aa4de900ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:40.550402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e4351-2a1b-4762-a565-aa4de900ba1e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.550801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e4351-2a1b-4762-a565-aa4de900ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.551215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e4351-2a1b-4762-a565-aa4de900ba1e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.552447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e4351-2a1b-4762-a565-aa4de900ba1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:40.555006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e4351-2a1b-4762-a565-aa4de900ba1e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:40.608729 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3735/7499] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:40 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:40.609846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e4351-2a1b-4762-a565-aa4de900ba1e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:40.627159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e4351-2a1b-4762-a565-aa4de900ba1e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:40.637713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326cd89-7cce-49a2-8b27-4d732ff25182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:40.639992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326cd89-7cce-49a2-8b27-4d732ff25182 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.640648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326cd89-7cce-49a2-8b27-4d732ff25182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.641146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326cd89-7cce-49a2-8b27-4d732ff25182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.642007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326cd89-7cce-49a2-8b27-4d732ff25182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:40.652054 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3765/7500] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:40.657409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326cd89-7cce-49a2-8b27-4d732ff25182 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:40.680465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613711d-608f-44e7-ba85-7f87be214a81 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:40.682218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4613711d-608f-44e7-ba85-7f87be214a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:40.700956 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3736/7501] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:40.706748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326cd89-7cce-49a2-8b27-4d732ff25182 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:40.726804 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:40.736917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326cd89-7cce-49a2-8b27-4d732ff25182 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:40.750043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313ffc6-58e4-44d8-ab3b-60f5379e752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:40.750736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313ffc6-58e4-44d8-ab3b-60f5379e752e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.751024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313ffc6-58e4-44d8-ab3b-60f5379e752e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.751293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313ffc6-58e4-44d8-ab3b-60f5379e752e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.753916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313ffc6-58e4-44d8-ab3b-60f5379e752e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:40.755972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313ffc6-58e4-44d8-ab3b-60f5379e752e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:40.786210 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3737/7502] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:40.788934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313ffc6-58e4-44d8-ab3b-60f5379e752e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:40.814173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313ffc6-58e4-44d8-ab3b-60f5379e752e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:40.827707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613711d-608f-44e7-ba85-7f87be214a81 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:40.837725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72f1ff-c55d-4a95-99da-6522dedf01b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:40.838498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72f1ff-c55d-4a95-99da-6522dedf01b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.838878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72f1ff-c55d-4a95-99da-6522dedf01b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.839545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72f1ff-c55d-4a95-99da-6522dedf01b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.840678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8b3f5-b95a-4868-a996-260fbecd5f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:40.841431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b3f5-b95a-4868-a996-260fbecd5f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.841781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b3f5-b95a-4868-a996-260fbecd5f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.842129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b3f5-b95a-4868-a996-260fbecd5f53 admin admin] PATH_INFO: `/v3/projects/ad9f0e28e1a0470e956227005815e777/users/24e88c7ee5ee4667a1242595db55dba1/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:40.863709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8b3f5-b95a-4868-a996-260fbecd5f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9f0e28e1a0470e956227005815e777, user_id=24e88c7ee5ee4667a1242595db55dba1, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:40.867335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72f1ff-c55d-4a95-99da-6522dedf01b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:40.867827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8b3f5-b95a-4868-a996-260fbecd5f53 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:40.875376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72f1ff-c55d-4a95-99da-6522dedf01b2 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:40.885221 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3738/7503] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:40 2022] PUT /identity/v3/projects/ad9f0e28e1a0470e956227005815e777/users/24e88c7ee5ee4667a1242595db55dba1/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:40.911869 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3766/7504] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:34:40.923113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa44fe4-8bd4-4eea-92a9-1874573d4f06 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:40.926002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa44fe4-8bd4-4eea-92a9-1874573d4f06 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:40.926562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa44fe4-8bd4-4eea-92a9-1874573d4f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:41.021639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5fa44fe4-8bd4-4eea-92a9-1874573d4f06 None None] MFA Rules not processed for user `24e88c7ee5ee4667a1242595db55dba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:41.026284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5fa44fe4-8bd4-4eea-92a9-1874573d4f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:41.172647 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3739/7505] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:41.183042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72f1ff-c55d-4a95-99da-6522dedf01b2 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:41.219769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72f1ff-c55d-4a95-99da-6522dedf01b2 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:41.364787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa75cf3-1780-4802-b491-9bf0521b4804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:41.365660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa75cf3-1780-4802-b491-9bf0521b4804 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:41.365835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa75cf3-1780-4802-b491-9bf0521b4804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:41.366266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa75cf3-1780-4802-b491-9bf0521b4804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:41.368965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa75cf3-1780-4802-b491-9bf0521b4804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:41.370303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa75cf3-1780-4802-b491-9bf0521b4804 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:41.457986 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3767/7506] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:41 2022] POST /identity/v3/projects => generated 383 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:41.462318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa44fe4-8bd4-4eea-92a9-1874573d4f06 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:41.480859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa44fe4-8bd4-4eea-92a9-1874573d4f06 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:41.594588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6959fc-087a-4be4-a9aa-a6b60458830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:41.596100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6959fc-087a-4be4-a9aa-a6b60458830b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:41.596479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6959fc-087a-4be4-a9aa-a6b60458830b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:41.596848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6959fc-087a-4be4-a9aa-a6b60458830b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:41.597605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6959fc-087a-4be4-a9aa-a6b60458830b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:41.600059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6959fc-087a-4be4-a9aa-a6b60458830b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:41.629662 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3740/7507] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:41 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:41.633632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa75cf3-1780-4802-b491-9bf0521b4804 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:41.652225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa75cf3-1780-4802-b491-9bf0521b4804 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:41.658785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0205ee5-02a7-485d-acbb-c63ef41eeb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:41.659541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0205ee5-02a7-485d-acbb-c63ef41eeb91 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:41.660125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0205ee5-02a7-485d-acbb-c63ef41eeb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:41.660506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0205ee5-02a7-485d-acbb-c63ef41eeb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:41.661258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0205ee5-02a7-485d-acbb-c63ef41eeb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:41.663269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0205ee5-02a7-485d-acbb-c63ef41eeb91 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:41.678714 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3768/7508] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:34:41.682480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6959fc-087a-4be4-a9aa-a6b60458830b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:41.699085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6959fc-087a-4be4-a9aa-a6b60458830b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:41.712991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf131e-fa15-4bbd-8fb4-f4e6d15ceafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:41.713780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf131e-fa15-4bbd-8fb4-f4e6d15ceafc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:41.714173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf131e-fa15-4bbd-8fb4-f4e6d15ceafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:41.714549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf131e-fa15-4bbd-8fb4-f4e6d15ceafc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:41.715330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf131e-fa15-4bbd-8fb4-f4e6d15ceafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:41.717055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf131e-fa15-4bbd-8fb4-f4e6d15ceafc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:41.743939 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3741/7509] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:34:41.748289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0205ee5-02a7-485d-acbb-c63ef41eeb91 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:41.767400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0205ee5-02a7-485d-acbb-c63ef41eeb91 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:41.773630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178c892-5b11-450c-b97c-1c87eda15c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:41.774568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178c892-5b11-450c-b97c-1c87eda15c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:41.775100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178c892-5b11-450c-b97c-1c87eda15c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:41.775572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178c892-5b11-450c-b97c-1c87eda15c19 admin admin] PATH_INFO: `/v3/projects/5dc9e5ba7eae4aaab95fe9d6a178271c/users/e7e65a42cdf54924821754ba5c977f8b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:41.794865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178c892-5b11-450c-b97c-1c87eda15c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc9e5ba7eae4aaab95fe9d6a178271c, user_id=e7e65a42cdf54924821754ba5c977f8b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:41.798098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178c892-5b11-450c-b97c-1c87eda15c19 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:41.818316 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3769/7510] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:41 2022] PUT /identity/v3/projects/5dc9e5ba7eae4aaab95fe9d6a178271c/users/e7e65a42cdf54924821754ba5c977f8b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:41.830181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a3953-8458-4b34-8e7d-67be53913185 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:41.830472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a3953-8458-4b34-8e7d-67be53913185 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:41.830912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a3953-8458-4b34-8e7d-67be53913185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:41.888040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-983a3953-8458-4b34-8e7d-67be53913185 None None] MFA Rules not processed for user `e7e65a42cdf54924821754ba5c977f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:41.890852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-983a3953-8458-4b34-8e7d-67be53913185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:41.985595 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:42.223490 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3742/7511] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:42.224847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178c892-5b11-450c-b97c-1c87eda15c19 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:42.257433 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:42.396837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178c892-5b11-450c-b97c-1c87eda15c19 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:42.403492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63755800-a67f-42c5-b9a7-90bb1e8724ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:42.404137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63755800-a67f-42c5-b9a7-90bb1e8724ef admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:42.404412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63755800-a67f-42c5-b9a7-90bb1e8724ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:42.404690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63755800-a67f-42c5-b9a7-90bb1e8724ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:42.405338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63755800-a67f-42c5-b9a7-90bb1e8724ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:42.408161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63755800-a67f-42c5-b9a7-90bb1e8724ef admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:42.462241 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3770/7512] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:42 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:42.466398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a3953-8458-4b34-8e7d-67be53913185 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:42.481072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a3953-8458-4b34-8e7d-67be53913185 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:42.618879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1249a-f410-4f2f-9548-2b5e967736af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:42.620512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1249a-f410-4f2f-9548-2b5e967736af admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:42.621019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1249a-f410-4f2f-9548-2b5e967736af admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:42.621482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1249a-f410-4f2f-9548-2b5e967736af admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:42.622337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1249a-f410-4f2f-9548-2b5e967736af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:42.624595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1249a-f410-4f2f-9548-2b5e967736af admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:42.664836 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3743/7513] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:42 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:34:42.666497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63755800-a67f-42c5-b9a7-90bb1e8724ef admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:42.678507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63755800-a67f-42c5-b9a7-90bb1e8724ef admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:42.685367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2656e-90ac-4f9a-9d87-8aa03a8db3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:42.686379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2656e-90ac-4f9a-9d87-8aa03a8db3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:42.686671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2656e-90ac-4f9a-9d87-8aa03a8db3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:42.687025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2656e-90ac-4f9a-9d87-8aa03a8db3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:42.687713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2656e-90ac-4f9a-9d87-8aa03a8db3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:42.689767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2656e-90ac-4f9a-9d87-8aa03a8db3b9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:42.705877 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3771/7514] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:42.710259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1249a-f410-4f2f-9548-2b5e967736af admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:42.723690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1249a-f410-4f2f-9548-2b5e967736af admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:42.731989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27e80-ef3c-4e59-b479-52714e55d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:42.732686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27e80-ef3c-4e59-b479-52714e55d323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:42.733162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27e80-ef3c-4e59-b479-52714e55d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:42.733650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27e80-ef3c-4e59-b479-52714e55d323 admin admin] PATH_INFO: `/v3/projects/26b6ffad59ee4847b788e4d897cc8941/users/c0cf893c8e90477facb79d72580416b5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:42.754817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe27e80-ef3c-4e59-b479-52714e55d323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b6ffad59ee4847b788e4d897cc8941, user_id=c0cf893c8e90477facb79d72580416b5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:42.770667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe27e80-ef3c-4e59-b479-52714e55d323 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:42.808166 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3744/7515] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:42 2022] PUT /identity/v3/projects/26b6ffad59ee4847b788e4d897cc8941/users/c0cf893c8e90477facb79d72580416b5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:34:42.812252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2656e-90ac-4f9a-9d87-8aa03a8db3b9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:42.826164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2656e-90ac-4f9a-9d87-8aa03a8db3b9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:42.954270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a0615-1115-4c42-a7f6-f7a095f87064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:42.955194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a0615-1115-4c42-a7f6-f7a095f87064 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:42.956698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a0615-1115-4c42-a7f6-f7a095f87064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:42.957091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a0615-1115-4c42-a7f6-f7a095f87064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:42.957990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a0615-1115-4c42-a7f6-f7a095f87064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:42.960799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a0615-1115-4c42-a7f6-f7a095f87064 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:42.975633 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3772/7516] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:42.980209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27e80-ef3c-4e59-b479-52714e55d323 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:43.002264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27e80-ef3c-4e59-b479-52714e55d323 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:43.009907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31883e39-271d-4edf-88d0-ce637978c403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:43.011421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883e39-271d-4edf-88d0-ce637978c403 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:43.012206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883e39-271d-4edf-88d0-ce637978c403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:43.012599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883e39-271d-4edf-88d0-ce637978c403 admin admin] PATH_INFO: `/v3/projects/26b6ffad59ee4847b788e4d897cc8941/users/c0cf893c8e90477facb79d72580416b5/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:43.015145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31883e39-271d-4edf-88d0-ce637978c403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b6ffad59ee4847b788e4d897cc8941, user_id=c0cf893c8e90477facb79d72580416b5, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:43.018096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31883e39-271d-4edf-88d0-ce637978c403 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:43.032878 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3745/7517] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:42 2022] PUT /identity/v3/projects/26b6ffad59ee4847b788e4d897cc8941/users/c0cf893c8e90477facb79d72580416b5/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:43.044107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2235e90-f098-4ee9-8ec9-bae45c53181e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:43.044557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2235e90-f098-4ee9-8ec9-bae45c53181e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:43.044941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2235e90-f098-4ee9-8ec9-bae45c53181e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:43.104761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d2235e90-f098-4ee9-8ec9-bae45c53181e None None] MFA Rules not processed for user `c0cf893c8e90477facb79d72580416b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:43.106630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d2235e90-f098-4ee9-8ec9-bae45c53181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:43.211942 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3773/7518] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:43.223320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31883e39-271d-4edf-88d0-ce637978c403 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:43.225238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31883e39-271d-4edf-88d0-ce637978c403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:43.418978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31883e39-271d-4edf-88d0-ce637978c403 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:43.434493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b010e6-3fbf-4d4e-831d-589d7bcb3d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:43.435184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b010e6-3fbf-4d4e-831d-589d7bcb3d17 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:43.435649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b010e6-3fbf-4d4e-831d-589d7bcb3d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:43.435944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b010e6-3fbf-4d4e-831d-589d7bcb3d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:43.529354 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:43.588663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b010e6-3fbf-4d4e-831d-589d7bcb3d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:43.590359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b010e6-3fbf-4d4e-831d-589d7bcb3d17 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:43.609887 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3746/7519] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:45.220405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2235e90-f098-4ee9-8ec9-bae45c53181e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:45.222493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d2235e90-f098-4ee9-8ec9-bae45c53181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:45.229487 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:45.333269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2235e90-f098-4ee9-8ec9-bae45c53181e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:45.347654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13875322-086d-4191-9bda-dd10261eff50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:45.348411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13875322-086d-4191-9bda-dd10261eff50 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:45.348697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13875322-086d-4191-9bda-dd10261eff50 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:45.348978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13875322-086d-4191-9bda-dd10261eff50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:45.359774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-13875322-086d-4191-9bda-dd10261eff50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:45.380148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13875322-086d-4191-9bda-dd10261eff50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:45.381903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13875322-086d-4191-9bda-dd10261eff50 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:45.413617 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3774/7520] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:46.907025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b010e6-3fbf-4d4e-831d-589d7bcb3d17 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:46.938399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b010e6-3fbf-4d4e-831d-589d7bcb3d17 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:46.947194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a2e2a-d0db-4a38-93f3-3a103db47494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:46.949335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a2e2a-d0db-4a38-93f3-3a103db47494 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:46.949846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a2e2a-d0db-4a38-93f3-3a103db47494 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:46.950221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a2e2a-d0db-4a38-93f3-3a103db47494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:47.116222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a2e2a-d0db-4a38-93f3-3a103db47494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:47.119220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a2e2a-d0db-4a38-93f3-3a103db47494 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:47.151001 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3747/7521] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:48.439490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13875322-086d-4191-9bda-dd10261eff50 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:48.459412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13875322-086d-4191-9bda-dd10261eff50 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:48.483308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb2e82-3aee-4a09-84b1-476256b40a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:48.483952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb2e82-3aee-4a09-84b1-476256b40a9f service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:48.484234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb2e82-3aee-4a09-84b1-476256b40a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:48.484507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb2e82-3aee-4a09-84b1-476256b40a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:48.509872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb2e82-3aee-4a09-84b1-476256b40a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:48.511581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb2e82-3aee-4a09-84b1-476256b40a9f service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:48.534819 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3775/7522] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:52.106087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a2e2a-d0db-4a38-93f3-3a103db47494 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:52.107860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-493a2e2a-d0db-4a38-93f3-3a103db47494 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:52.377861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a2e2a-d0db-4a38-93f3-3a103db47494 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:52.392120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:52.397002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:52.398520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:52.399731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] PATH_INFO: `/v3/users/3de1190a68164329b5b48f0f90c82a5d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:52.402544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de1190a68164329b5b48f0f90c82a5d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:52.404813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:52.533131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de1190a68164329b5b48f0f90c82a5d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:52.587282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de1190a68164329b5b48f0f90c82a5d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:52.588106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de1190a68164329b5b48f0f90c82a5d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:52.611927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de1190a68164329b5b48f0f90c82a5d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:52.625251 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:52.664099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de1190a68164329b5b48f0f90c82a5d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:52.727283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75854dc8-f48c-4d49-80bd-29e4815d1a51 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:52.728950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75854dc8-f48c-4d49-80bd-29e4815d1a51 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:52.729733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75854dc8-f48c-4d49-80bd-29e4815d1a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:52.735636 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3748/7523] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:34:52 2022] DELETE /identity/v3/users/3de1190a68164329b5b48f0f90c82a5d => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:52.820757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-75854dc8-f48c-4d49-80bd-29e4815d1a51 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:52.823699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-75854dc8-f48c-4d49-80bd-29e4815d1a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:53.018389 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3776/7524] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:53.084419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:53.087210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:53.224242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61576bec-6601-4b13-a949-67ec984c868b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:53.234394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39388cfa-c0bc-4808-aaaa-1e9e0a29712b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:53.235382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388cfa-c0bc-4808-aaaa-1e9e0a29712b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:53.238010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388cfa-c0bc-4808-aaaa-1e9e0a29712b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:53.238010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388cfa-c0bc-4808-aaaa-1e9e0a29712b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:53.277751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39388cfa-c0bc-4808-aaaa-1e9e0a29712b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:53.277751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39388cfa-c0bc-4808-aaaa-1e9e0a29712b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:53.284665 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3749/7525] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:34:53.770224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75854dc8-f48c-4d49-80bd-29e4815d1a51 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:53.771796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-75854dc8-f48c-4d49-80bd-29e4815d1a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:53.790423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75854dc8-f48c-4d49-80bd-29e4815d1a51 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:53.804011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:53.804670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:53.804952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:53.805228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] PATH_INFO: `/v3/projects/651f8d05e90743f2abf34d29c67c8fae` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:53.810419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=651f8d05e90743f2abf34d29c67c8fae)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:53.819027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:53.993276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '651f8d05e90743f2abf34d29c67c8fae', 'request_id': 'req-a61f4faf-1df8-4823-94a0-96b93a329668'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:54.009625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '651f8d05e90743f2abf34d29c67c8fae', 'request_id': 'req-a61f4faf-1df8-4823-94a0-96b93a329668'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:54.023840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '651f8d05e90743f2abf34d29c67c8fae', 'request_id': 'req-a61f4faf-1df8-4823-94a0-96b93a329668'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:54.051748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] The token cache is being invalidate because project 651f8d05e90743f2abf34d29c67c8fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:34:54.052132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:54.052700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a61f4faf-1df8-4823-94a0-96b93a329668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:34:54.057246 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3777/7526] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:34:53 2022] DELETE /identity/v3/projects/651f8d05e90743f2abf34d29c67c8fae => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:54.062029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dc866-6d57-4eac-9607-3e169cba22c1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:54.062319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dc866-6d57-4eac-9607-3e169cba22c1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:54.062621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dc866-6d57-4eac-9607-3e169cba22c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:54.104907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a64dc866-6d57-4eac-9607-3e169cba22c1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:54.106653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a64dc866-6d57-4eac-9607-3e169cba22c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:54.301653 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3750/7527] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:54.310469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7996461-305e-4661-b079-dea2dcd0f6c0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:54.310787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7996461-305e-4661-b079-dea2dcd0f6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:54.311066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7996461-305e-4661-b079-dea2dcd0f6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:54.329822 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:54.400257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b7996461-305e-4661-b079-dea2dcd0f6c0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:54.414383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b7996461-305e-4661-b079-dea2dcd0f6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:54.473273 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3778/7528] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:54.481795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dc866-6d57-4eac-9607-3e169cba22c1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:54.501542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dc866-6d57-4eac-9607-3e169cba22c1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:54.518067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aac82a-df40-490a-bd1c-be2c3b228ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:54.519142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aac82a-df40-490a-bd1c-be2c3b228ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:54.520468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aac82a-df40-490a-bd1c-be2c3b228ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:54.520468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aac82a-df40-490a-bd1c-be2c3b228ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:54.520468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aac82a-df40-490a-bd1c-be2c3b228ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:34:54.520737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aac82a-df40-490a-bd1c-be2c3b228ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:54.522330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aac82a-df40-490a-bd1c-be2c3b228ab7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:54.560459 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3751/7529] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:34:54.568931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7996461-305e-4661-b079-dea2dcd0f6c0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:54.595105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7996461-305e-4661-b079-dea2dcd0f6c0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:54.611660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acca856-c46b-4bb0-a818-076cbcf22580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:54.612471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca856-c46b-4bb0-a818-076cbcf22580 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:54.612755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca856-c46b-4bb0-a818-076cbcf22580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:54.613026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca856-c46b-4bb0-a818-076cbcf22580 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:54.613664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acca856-c46b-4bb0-a818-076cbcf22580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:54.621947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acca856-c46b-4bb0-a818-076cbcf22580 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:54.733850 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3779/7530] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:34:54 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:34:54.735066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aac82a-df40-490a-bd1c-be2c3b228ab7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:54.750023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aac82a-df40-490a-bd1c-be2c3b228ab7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:54.965459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8b526-4d03-44f4-84f0-0be489ea5a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:54.966245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b526-4d03-44f4-84f0-0be489ea5a09 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:54.966646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b526-4d03-44f4-84f0-0be489ea5a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:54.967014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b526-4d03-44f4-84f0-0be489ea5a09 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:54.967959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8b526-4d03-44f4-84f0-0be489ea5a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:54.971120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8b526-4d03-44f4-84f0-0be489ea5a09 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:55.033100 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3752/7531] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:34:54 2022] POST /identity/v3/users => generated 295 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:34:55.043852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acca856-c46b-4bb0-a818-076cbcf22580 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:55.069208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acca856-c46b-4bb0-a818-076cbcf22580 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:55.083970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420e4d4-40ee-4688-b630-022ecc2c76e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:55.084622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e4d4-40ee-4688-b630-022ecc2c76e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:55.085420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e4d4-40ee-4688-b630-022ecc2c76e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:55.085867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e4d4-40ee-4688-b630-022ecc2c76e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:55.087013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420e4d4-40ee-4688-b630-022ecc2c76e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:55.088900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420e4d4-40ee-4688-b630-022ecc2c76e2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:55.132919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8b526-4d03-44f4-84f0-0be489ea5a09 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:55.134500 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3780/7532] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:55.157069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8b526-4d03-44f4-84f0-0be489ea5a09 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:55.206082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c362f-7d17-44ce-a686-d6bb03e93138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:55.212146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c362f-7d17-44ce-a686-d6bb03e93138 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:55.212397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c362f-7d17-44ce-a686-d6bb03e93138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:55.213303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c362f-7d17-44ce-a686-d6bb03e93138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:55.214709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c362f-7d17-44ce-a686-d6bb03e93138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:55.226885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c362f-7d17-44ce-a686-d6bb03e93138 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:55.235666 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:34:55.270926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3753/7533] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:34:55.274874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420e4d4-40ee-4688-b630-022ecc2c76e2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:55.303263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420e4d4-40ee-4688-b630-022ecc2c76e2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:55.316051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bb20f-7ec9-46c5-92d0-4094486ed952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:55.316992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bb20f-7ec9-46c5-92d0-4094486ed952 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:55.317293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bb20f-7ec9-46c5-92d0-4094486ed952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:55.317565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bb20f-7ec9-46c5-92d0-4094486ed952 admin admin] PATH_INFO: `/v3/projects/a3cf22a12b2042e189748b5c9f57c999/users/3c18ab23b8c04b94a417514e84688a14/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:55.341765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bb20f-7ec9-46c5-92d0-4094486ed952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cf22a12b2042e189748b5c9f57c999, user_id=3c18ab23b8c04b94a417514e84688a14, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:55.345077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bb20f-7ec9-46c5-92d0-4094486ed952 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:55.385215 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3781/7534] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:34:55 2022] PUT /identity/v3/projects/a3cf22a12b2042e189748b5c9f57c999/users/3c18ab23b8c04b94a417514e84688a14/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:34:55.400872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd1a95-528b-4f50-82b4-73a541f75142 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:55.402124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd1a95-528b-4f50-82b4-73a541f75142 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:55.402466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd1a95-528b-4f50-82b4-73a541f75142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:55.465572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cfdd1a95-528b-4f50-82b4-73a541f75142 None None] MFA Rules not processed for user `3c18ab23b8c04b94a417514e84688a14`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:34:55.470356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cfdd1a95-528b-4f50-82b4-73a541f75142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:55.640953 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3754/7535] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:34:55.680191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bb20f-7ec9-46c5-92d0-4094486ed952 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:34:55.688093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-868bb20f-7ec9-46c5-92d0-4094486ed952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:34:55.879440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bb20f-7ec9-46c5-92d0-4094486ed952 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:34:55.886287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa268c4-150c-4a68-ab96-64424cbf7a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:34:55.887464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa268c4-150c-4a68-ab96-64424cbf7a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:34:55.887464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa268c4-150c-4a68-ab96-64424cbf7a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:34:55.887846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa268c4-150c-4a68-ab96-64424cbf7a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:34:55.903769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa268c4-150c-4a68-ab96-64424cbf7a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:34:55.905271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa268c4-150c-4a68-ab96-64424cbf7a05 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:34:55.917560 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3782/7536] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:34:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:01.563918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd1a95-528b-4f50-82b4-73a541f75142 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:01.565409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cfdd1a95-528b-4f50-82b4-73a541f75142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:01.749555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd1a95-528b-4f50-82b4-73a541f75142 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:01.749555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:01.749954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:01.751240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:01.751240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] PATH_INFO: `/v3/users/24e88c7ee5ee4667a1242595db55dba1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:01.763656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e88c7ee5ee4667a1242595db55dba1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:01.763656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:01.859579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e88c7ee5ee4667a1242595db55dba1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:01.875543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e88c7ee5ee4667a1242595db55dba1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:01.876448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e88c7ee5ee4667a1242595db55dba1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:01.892261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e88c7ee5ee4667a1242595db55dba1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:01.902195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e88c7ee5ee4667a1242595db55dba1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:01.915637 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3755/7537] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:01 2022] DELETE /identity/v3/users/24e88c7ee5ee4667a1242595db55dba1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:01.917451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba896f-d386-4ec8-b09d-c446026fde05 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:01.917944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba896f-d386-4ec8-b09d-c446026fde05 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:01.918220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba896f-d386-4ec8-b09d-c446026fde05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:01.967644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e2ba896f-d386-4ec8-b09d-c446026fde05 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:01.971225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e2ba896f-d386-4ec8-b09d-c446026fde05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:02.217059 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3783/7538] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:02.259721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:02.261696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:02.279234 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:02.420506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97cc7a-3d2b-49ef-be4c-9ceed004738d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:02.424839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd9912-70d5-4032-b819-0320792e6cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:02.425652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd9912-70d5-4032-b819-0320792e6cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:02.426045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd9912-70d5-4032-b819-0320792e6cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:02.426421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd9912-70d5-4032-b819-0320792e6cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:02.453597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd9912-70d5-4032-b819-0320792e6cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:02.455496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd9912-70d5-4032-b819-0320792e6cb0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:02.477777 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3756/7539] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:03.452586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba896f-d386-4ec8-b09d-c446026fde05 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:03.454149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e2ba896f-d386-4ec8-b09d-c446026fde05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:03.479894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba896f-d386-4ec8-b09d-c446026fde05 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:03.485552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:03.486661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:03.487051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:03.487442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] PATH_INFO: `/v3/projects/ad9f0e28e1a0470e956227005815e777` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:03.489215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9f0e28e1a0470e956227005815e777)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:03.508658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:03.619611 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:03.633984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9f0e28e1a0470e956227005815e777', 'request_id': 'req-3a7fc78d-f03b-4876-9712-3ac4159c6642'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:03.677976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9f0e28e1a0470e956227005815e777', 'request_id': 'req-3a7fc78d-f03b-4876-9712-3ac4159c6642'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:03.696501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9f0e28e1a0470e956227005815e777', 'request_id': 'req-3a7fc78d-f03b-4876-9712-3ac4159c6642'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:03.728159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] The token cache is being invalidate because project ad9f0e28e1a0470e956227005815e777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:03.728619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:03.729386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:03.731094 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3784/7540] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:35:03 2022] DELETE /identity/v3/projects/ad9f0e28e1a0470e956227005815e777 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:03.735318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd9912-70d5-4032-b819-0320792e6cb0 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:03.746157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd9912-70d5-4032-b819-0320792e6cb0 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:03.994113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:03.994812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:03.995092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:03.995369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] PATH_INFO: `/v3/users/e7e65a42cdf54924821754ba5c977f8b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:04.001241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e65a42cdf54924821754ba5c977f8b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:04.003295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:04.192770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e65a42cdf54924821754ba5c977f8b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:04.273169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e65a42cdf54924821754ba5c977f8b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:04.273945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e65a42cdf54924821754ba5c977f8b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:04.293113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e65a42cdf54924821754ba5c977f8b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:04.315258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e65a42cdf54924821754ba5c977f8b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:04.324985 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3757/7541] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:03 2022] DELETE /identity/v3/users/e7e65a42cdf54924821754ba5c977f8b => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:04.949235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:04.950716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:04.982555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fc78d-f03b-4876-9712-3ac4159c6642 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:05.122723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:05.123739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:05.124285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:05.124798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] PATH_INFO: `/v3/projects/5dc9e5ba7eae4aaab95fe9d6a178271c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:05.127090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc9e5ba7eae4aaab95fe9d6a178271c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:05.129442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:05.245245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc9e5ba7eae4aaab95fe9d6a178271c', 'request_id': 'req-c8c11779-8923-4260-85c9-1ad1215d9fd8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:05.252823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc9e5ba7eae4aaab95fe9d6a178271c', 'request_id': 'req-c8c11779-8923-4260-85c9-1ad1215d9fd8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:05.260628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc9e5ba7eae4aaab95fe9d6a178271c', 'request_id': 'req-c8c11779-8923-4260-85c9-1ad1215d9fd8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:05.279614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] The token cache is being invalidate because project 5dc9e5ba7eae4aaab95fe9d6a178271c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:05.280243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:05.281631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:05.283699 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3785/7542] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:35:04 2022] DELETE /identity/v3/projects/5dc9e5ba7eae4aaab95fe9d6a178271c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:05.288606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:05.290007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:05.308143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977f1c4-c2eb-4ee3-ae35-7c55409048a8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:05.338863 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:05.387708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1667f-9f62-4790-a8f5-cae44271d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:05.388991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1667f-9f62-4790-a8f5-cae44271d718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:05.389508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1667f-9f62-4790-a8f5-cae44271d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:05.389982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1667f-9f62-4790-a8f5-cae44271d718 admin admin] PATH_INFO: `/v3/users/c0cf893c8e90477facb79d72580416b5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:05.391569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1667f-9f62-4790-a8f5-cae44271d718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0cf893c8e90477facb79d72580416b5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:05.394118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1667f-9f62-4790-a8f5-cae44271d718 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:05.474576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a3e1667f-9f62-4790-a8f5-cae44271d718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0cf893c8e90477facb79d72580416b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:05.504457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a3e1667f-9f62-4790-a8f5-cae44271d718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0cf893c8e90477facb79d72580416b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:05.505652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a3e1667f-9f62-4790-a8f5-cae44271d718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0cf893c8e90477facb79d72580416b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:05.516429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a3e1667f-9f62-4790-a8f5-cae44271d718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0cf893c8e90477facb79d72580416b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:05.528700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a3e1667f-9f62-4790-a8f5-cae44271d718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0cf893c8e90477facb79d72580416b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:05.542735 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3758/7543] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:05 2022] DELETE /identity/v3/users/c0cf893c8e90477facb79d72580416b5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:06.295020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:06.297204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:06.312512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c11779-8923-4260-85c9-1ad1215d9fd8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:06.416792 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:06.427759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:06.428773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:06.430476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:06.431045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] PATH_INFO: `/v3/projects/26b6ffad59ee4847b788e4d897cc8941` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:06.432630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b6ffad59ee4847b788e4d897cc8941)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:06.435992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:06.534330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b6ffad59ee4847b788e4d897cc8941', 'request_id': 'req-394c60c5-25af-45ae-97ca-907aa6765295'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:06.550606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b6ffad59ee4847b788e4d897cc8941', 'request_id': 'req-394c60c5-25af-45ae-97ca-907aa6765295'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:06.561968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b6ffad59ee4847b788e4d897cc8941', 'request_id': 'req-394c60c5-25af-45ae-97ca-907aa6765295'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:06.595124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] The token cache is being invalidate because project 26b6ffad59ee4847b788e4d897cc8941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:06.595353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:06.596072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-394c60c5-25af-45ae-97ca-907aa6765295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:06.602169 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3786/7544] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:35:06 2022] DELETE /identity/v3/projects/26b6ffad59ee4847b788e4d897cc8941 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:06.604652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db403ba2-d6a0-4903-8874-482e1baf9138 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:06.605485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db403ba2-d6a0-4903-8874-482e1baf9138 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:06.605772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db403ba2-d6a0-4903-8874-482e1baf9138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:06.650815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-db403ba2-d6a0-4903-8874-482e1baf9138 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:06.652373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-db403ba2-d6a0-4903-8874-482e1baf9138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:06.829316 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3759/7545] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:06.831086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423d73-140c-4a44-a99f-27ecb54e6d08 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:06.831402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423d73-140c-4a44-a99f-27ecb54e6d08 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:06.831705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423d73-140c-4a44-a99f-27ecb54e6d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:06.878744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4c423d73-140c-4a44-a99f-27ecb54e6d08 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:06.879992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4c423d73-140c-4a44-a99f-27ecb54e6d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:06.913340 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3787/7546] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:06.917470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db403ba2-d6a0-4903-8874-482e1baf9138 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:06.942973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db403ba2-d6a0-4903-8874-482e1baf9138 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:06.956172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169e22e-83b7-4bd5-96ca-fd9a2df2e143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:06.957339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169e22e-83b7-4bd5-96ca-fd9a2df2e143 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:06.957794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169e22e-83b7-4bd5-96ca-fd9a2df2e143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:06.958261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169e22e-83b7-4bd5-96ca-fd9a2df2e143 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:06.959175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169e22e-83b7-4bd5-96ca-fd9a2df2e143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:35:06.960262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169e22e-83b7-4bd5-96ca-fd9a2df2e143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:06.962650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169e22e-83b7-4bd5-96ca-fd9a2df2e143 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:06.991594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423d73-140c-4a44-a99f-27ecb54e6d08 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:07.001241 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3760/7547] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:35:07.004681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423d73-140c-4a44-a99f-27ecb54e6d08 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:07.035755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdf9cb-f297-4063-912d-8edf973e930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:07.037180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf9cb-f297-4063-912d-8edf973e930e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:07.038021 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf9cb-f297-4063-912d-8edf973e930e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:07.038848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf9cb-f297-4063-912d-8edf973e930e admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:07.039919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdf9cb-f297-4063-912d-8edf973e930e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:07.042324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdf9cb-f297-4063-912d-8edf973e930e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:07.103138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169e22e-83b7-4bd5-96ca-fd9a2df2e143 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:07.111297 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3788/7548] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:35:06 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:07.120170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169e22e-83b7-4bd5-96ca-fd9a2df2e143 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:07.177363 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:07.214346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90948dab-c6cc-4c1b-806f-4fee93e2ff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:07.215035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90948dab-c6cc-4c1b-806f-4fee93e2ff23 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:07.215912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90948dab-c6cc-4c1b-806f-4fee93e2ff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:07.216380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90948dab-c6cc-4c1b-806f-4fee93e2ff23 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:07.217122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90948dab-c6cc-4c1b-806f-4fee93e2ff23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:07.220525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90948dab-c6cc-4c1b-806f-4fee93e2ff23 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:07.254642 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3761/7549] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:35:07 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:07.259151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdf9cb-f297-4063-912d-8edf973e930e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:07.277571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdf9cb-f297-4063-912d-8edf973e930e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:07.303372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9556e-8acf-4780-b624-ce0a3dc43f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:07.308841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9556e-8acf-4780-b624-ce0a3dc43f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:07.310092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9556e-8acf-4780-b624-ce0a3dc43f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:07.310384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9556e-8acf-4780-b624-ce0a3dc43f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:07.317241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9556e-8acf-4780-b624-ce0a3dc43f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:07.319628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9556e-8acf-4780-b624-ce0a3dc43f9e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:07.351282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90948dab-c6cc-4c1b-806f-4fee93e2ff23 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:07.352863 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3789/7550] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:07.370129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90948dab-c6cc-4c1b-806f-4fee93e2ff23 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:07.377853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c34fb4-cc81-4f0b-9e76-abf7bbf94b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:07.378484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c34fb4-cc81-4f0b-9e76-abf7bbf94b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:07.378815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c34fb4-cc81-4f0b-9e76-abf7bbf94b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:07.379095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c34fb4-cc81-4f0b-9e76-abf7bbf94b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:07.379751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c34fb4-cc81-4f0b-9e76-abf7bbf94b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:07.382125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c34fb4-cc81-4f0b-9e76-abf7bbf94b67 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:07.410361 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3762/7551] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:07.412377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9556e-8acf-4780-b624-ce0a3dc43f9e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:07.429308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9556e-8acf-4780-b624-ce0a3dc43f9e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:07.437227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1893da6-be12-4928-9010-ffc874013818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:07.438095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893da6-be12-4928-9010-ffc874013818 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:07.438517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893da6-be12-4928-9010-ffc874013818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:07.438987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893da6-be12-4928-9010-ffc874013818 admin admin] PATH_INFO: `/v3/projects/9cd5011b4b1c48809d36075a7086d2da/users/c3c2adcbca124733904414c88b325597/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:07.465734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1893da6-be12-4928-9010-ffc874013818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd5011b4b1c48809d36075a7086d2da, user_id=c3c2adcbca124733904414c88b325597, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:07.469933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1893da6-be12-4928-9010-ffc874013818 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:07.494764 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3790/7552] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:07 2022] PUT /identity/v3/projects/9cd5011b4b1c48809d36075a7086d2da/users/c3c2adcbca124733904414c88b325597/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:07.496439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb015d3f-7cde-4641-ab0d-9709c0a6ffec None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:07.496731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb015d3f-7cde-4641-ab0d-9709c0a6ffec None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:07.497030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb015d3f-7cde-4641-ab0d-9709c0a6ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:07.531190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-eb015d3f-7cde-4641-ab0d-9709c0a6ffec None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:07.532440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb015d3f-7cde-4641-ab0d-9709c0a6ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:07.640263 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3763/7553] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:07.652401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1893da6-be12-4928-9010-ffc874013818 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:07.655181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d1893da6-be12-4928-9010-ffc874013818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:08.038835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1893da6-be12-4928-9010-ffc874013818 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:08.042627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ce322-f1d1-4508-9ff2-55e0cb4eba28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:08.043378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ce322-f1d1-4508-9ff2-55e0cb4eba28 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:08.043684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ce322-f1d1-4508-9ff2-55e0cb4eba28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:08.043958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ce322-f1d1-4508-9ff2-55e0cb4eba28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:08.070570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ce322-f1d1-4508-9ff2-55e0cb4eba28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:08.072319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ce322-f1d1-4508-9ff2-55e0cb4eba28 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:08.088891 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3791/7554] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:08.722372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb015d3f-7cde-4641-ab0d-9709c0a6ffec None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:08.726236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb015d3f-7cde-4641-ab0d-9709c0a6ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:08.875978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb015d3f-7cde-4641-ab0d-9709c0a6ffec None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:08.887401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f097678-d9cf-4e04-9b2b-7f121f7eab1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:08.888137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f097678-d9cf-4e04-9b2b-7f121f7eab1d service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:08.888483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f097678-d9cf-4e04-9b2b-7f121f7eab1d service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:08.888820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f097678-d9cf-4e04-9b2b-7f121f7eab1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:08.891037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2f097678-d9cf-4e04-9b2b-7f121f7eab1d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:09.067197 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:09.073576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f097678-d9cf-4e04-9b2b-7f121f7eab1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:09.080097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f097678-d9cf-4e04-9b2b-7f121f7eab1d service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:09.101785 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3764/7555] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:35:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:35:11.441869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e0888-6e3f-4429-a1e8-8d88f6b190ba None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:11.442387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e0888-6e3f-4429-a1e8-8d88f6b190ba None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:11.442387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e0888-6e3f-4429-a1e8-8d88f6b190ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:11.500690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-709e0888-6e3f-4429-a1e8-8d88f6b190ba None None] MFA Rules not processed for user `c3c2adcbca124733904414c88b325597`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:11.504145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-709e0888-6e3f-4429-a1e8-8d88f6b190ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:11.529983 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:11.653638 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3792/7556] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:11.657839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f097678-d9cf-4e04-9b2b-7f121f7eab1d service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:11.681868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f097678-d9cf-4e04-9b2b-7f121f7eab1d service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:11.700122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0774a-c936-457d-a615-25b026ec6b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:11.700866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0774a-c936-457d-a615-25b026ec6b2d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:11.701162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0774a-c936-457d-a615-25b026ec6b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:11.701401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0774a-c936-457d-a615-25b026ec6b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:11.702048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0774a-c936-457d-a615-25b026ec6b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:11.704028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0774a-c936-457d-a615-25b026ec6b2d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:11.738341 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3765/7557] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:35:11 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:11.742965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e0888-6e3f-4429-a1e8-8d88f6b190ba None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:11.757699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e0888-6e3f-4429-a1e8-8d88f6b190ba None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:11.924801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1adc6-862d-48a8-bbca-d4be79d53737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:11.926512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1adc6-862d-48a8-bbca-d4be79d53737 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:11.928443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1adc6-862d-48a8-bbca-d4be79d53737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:11.929627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1adc6-862d-48a8-bbca-d4be79d53737 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:11.932007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1adc6-862d-48a8-bbca-d4be79d53737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:11.935403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1adc6-862d-48a8-bbca-d4be79d53737 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:11.988747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0774a-c936-457d-a615-25b026ec6b2d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:11.988861 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3793/7558] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:35:11 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:12.013258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0774a-c936-457d-a615-25b026ec6b2d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:12.025985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4c1aa-419c-4549-8a6c-01e37f9c0d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:12.026407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c1aa-419c-4549-8a6c-01e37f9c0d6f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:12.027041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c1aa-419c-4549-8a6c-01e37f9c0d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:12.027041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c1aa-419c-4549-8a6c-01e37f9c0d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:12.027915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4c1aa-419c-4549-8a6c-01e37f9c0d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:12.058343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4c1aa-419c-4549-8a6c-01e37f9c0d6f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:12.081388 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3766/7559] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:35:12.086070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1adc6-862d-48a8-bbca-d4be79d53737 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:12.116565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1adc6-862d-48a8-bbca-d4be79d53737 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:12.122007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba7fbc-c6a5-4df7-af55-b8aeb13b7d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:12.122739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba7fbc-c6a5-4df7-af55-b8aeb13b7d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:12.123024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba7fbc-c6a5-4df7-af55-b8aeb13b7d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:12.123442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba7fbc-c6a5-4df7-af55-b8aeb13b7d01 admin admin] PATH_INFO: `/v3/projects/e9d76ecfc8814fb0be946bf49cf58775/users/b660dc23c365416cb728498b3631dfd9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:12.141853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba7fbc-c6a5-4df7-af55-b8aeb13b7d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d76ecfc8814fb0be946bf49cf58775, user_id=b660dc23c365416cb728498b3631dfd9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:12.145415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba7fbc-c6a5-4df7-af55-b8aeb13b7d01 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:12.188619 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3794/7560] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:12 2022] PUT /identity/v3/projects/e9d76ecfc8814fb0be946bf49cf58775/users/b660dc23c365416cb728498b3631dfd9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:12.191965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4c1aa-419c-4549-8a6c-01e37f9c0d6f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:12.219152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4c1aa-419c-4549-8a6c-01e37f9c0d6f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:12.295658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb2b87-3cad-4d36-8c7e-8327b0043ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:12.296728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2b87-3cad-4d36-8c7e-8327b0043ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:12.297349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2b87-3cad-4d36-8c7e-8327b0043ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:12.297766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2b87-3cad-4d36-8c7e-8327b0043ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:12.298564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb2b87-3cad-4d36-8c7e-8327b0043ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:12.301558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb2b87-3cad-4d36-8c7e-8327b0043ae9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:12.315901 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3767/7561] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:12.321574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba7fbc-c6a5-4df7-af55-b8aeb13b7d01 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:12.348068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba7fbc-c6a5-4df7-af55-b8aeb13b7d01 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:12.362653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63a198-1001-4d74-a5e6-ae7ba050703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:12.365885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a198-1001-4d74-a5e6-ae7ba050703e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:12.366976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a198-1001-4d74-a5e6-ae7ba050703e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:12.367698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a198-1001-4d74-a5e6-ae7ba050703e admin admin] PATH_INFO: `/v3/projects/e9d76ecfc8814fb0be946bf49cf58775/users/b660dc23c365416cb728498b3631dfd9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:12.374505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a198-1001-4d74-a5e6-ae7ba050703e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d76ecfc8814fb0be946bf49cf58775, user_id=b660dc23c365416cb728498b3631dfd9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:12.382135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a198-1001-4d74-a5e6-ae7ba050703e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:12.420948 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3795/7562] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:12 2022] PUT /identity/v3/projects/e9d76ecfc8814fb0be946bf49cf58775/users/b660dc23c365416cb728498b3631dfd9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:14.198724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb2b87-3cad-4d36-8c7e-8327b0043ae9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:14.201116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-72bb2b87-3cad-4d36-8c7e-8327b0043ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:14.219280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb2b87-3cad-4d36-8c7e-8327b0043ae9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:14.313033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a3d26-d00c-4de1-9952-f782c8a50532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:14.313765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a3d26-d00c-4de1-9952-f782c8a50532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:14.314236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a3d26-d00c-4de1-9952-f782c8a50532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:14.314997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a3d26-d00c-4de1-9952-f782c8a50532 admin admin] PATH_INFO: `/v3/users/3c18ab23b8c04b94a417514e84688a14` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:14.316879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a3d26-d00c-4de1-9952-f782c8a50532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c18ab23b8c04b94a417514e84688a14)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:14.335324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a3d26-d00c-4de1-9952-f782c8a50532 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:14.487187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-263a3d26-d00c-4de1-9952-f782c8a50532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c18ab23b8c04b94a417514e84688a14'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:14.502556 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:14.518858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63a198-1001-4d74-a5e6-ae7ba050703e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:14.520158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-263a3d26-d00c-4de1-9952-f782c8a50532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c18ab23b8c04b94a417514e84688a14'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:14.521346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bf63a198-1001-4d74-a5e6-ae7ba050703e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:14.522943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-263a3d26-d00c-4de1-9952-f782c8a50532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c18ab23b8c04b94a417514e84688a14'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:14.569096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-263a3d26-d00c-4de1-9952-f782c8a50532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c18ab23b8c04b94a417514e84688a14'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:14.584855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-263a3d26-d00c-4de1-9952-f782c8a50532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c18ab23b8c04b94a417514e84688a14'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:14.602258 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3768/7563] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:14 2022] DELETE /identity/v3/users/3c18ab23b8c04b94a417514e84688a14 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:14.606535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ec60e-7190-41ca-90d8-555d5f083724 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:14.606912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ec60e-7190-41ca-90d8-555d5f083724 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:14.608331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ec60e-7190-41ca-90d8-555d5f083724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:14.665818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a42ec60e-7190-41ca-90d8-555d5f083724 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:14.667127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a42ec60e-7190-41ca-90d8-555d5f083724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:14.709278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63a198-1001-4d74-a5e6-ae7ba050703e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:14.748068 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:14.817106 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3769/7564] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:35:14.874162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494227c-068d-443d-bc4d-19dff7efc5bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:14.874162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494227c-068d-443d-bc4d-19dff7efc5bf service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:14.874162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494227c-068d-443d-bc4d-19dff7efc5bf service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:14.874469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494227c-068d-443d-bc4d-19dff7efc5bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:14.880442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d494227c-068d-443d-bc4d-19dff7efc5bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:14.885965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ec60e-7190-41ca-90d8-555d5f083724 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:14.887448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a42ec60e-7190-41ca-90d8-555d5f083724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:14.909532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494227c-068d-443d-bc4d-19dff7efc5bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:14.911198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494227c-068d-443d-bc4d-19dff7efc5bf service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:14.945223 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3796/7565] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:15.074753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ec60e-7190-41ca-90d8-555d5f083724 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:15.080745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e8407-ff6e-43d7-babc-2a8f0355a668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:15.088992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8407-ff6e-43d7-babc-2a8f0355a668 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:15.088992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8407-ff6e-43d7-babc-2a8f0355a668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:15.088992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8407-ff6e-43d7-babc-2a8f0355a668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:15.107217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e8407-ff6e-43d7-babc-2a8f0355a668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:15.108967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e8407-ff6e-43d7-babc-2a8f0355a668 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:15.134678 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3770/7566] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:15.267844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095027a-a53f-4d07-a185-7b20a0514eb7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:15.268160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095027a-a53f-4d07-a185-7b20a0514eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:15.268764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095027a-a53f-4d07-a185-7b20a0514eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:15.306297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3095027a-a53f-4d07-a185-7b20a0514eb7 None None] MFA Rules not processed for user `b660dc23c365416cb728498b3631dfd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:15.308604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3095027a-a53f-4d07-a185-7b20a0514eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:15.420093 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3797/7567] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:15.432532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416e8f8-dfbf-4ec3-b8b2-2673d3d0dbfd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:15.434550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416e8f8-dfbf-4ec3-b8b2-2673d3d0dbfd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:15.435337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416e8f8-dfbf-4ec3-b8b2-2673d3d0dbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:15.561588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a416e8f8-dfbf-4ec3-b8b2-2673d3d0dbfd None None] MFA Rules not processed for user `c3c2adcbca124733904414c88b325597`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:15.565244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a416e8f8-dfbf-4ec3-b8b2-2673d3d0dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:15.605784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095027a-a53f-4d07-a185-7b20a0514eb7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:15.612914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3095027a-a53f-4d07-a185-7b20a0514eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:15.682752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095027a-a53f-4d07-a185-7b20a0514eb7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:15.700622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:15.701278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:15.704091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:15.704390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] PATH_INFO: `/v3/projects/a3cf22a12b2042e189748b5c9f57c999` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:15.707828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3cf22a12b2042e189748b5c9f57c999)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:15.715603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:15.723133 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3771/7568] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:15.742513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416e8f8-dfbf-4ec3-b8b2-2673d3d0dbfd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:15.743987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a416e8f8-dfbf-4ec3-b8b2-2673d3d0dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:15.778505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416e8f8-dfbf-4ec3-b8b2-2673d3d0dbfd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:15.790765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b05821-c16c-498b-bf75-9d9625cb1673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:15.791538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b05821-c16c-498b-bf75-9d9625cb1673 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:15.791827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b05821-c16c-498b-bf75-9d9625cb1673 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:15.792107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b05821-c16c-498b-bf75-9d9625cb1673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:15.801049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-43b05821-c16c-498b-bf75-9d9625cb1673 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:15.836460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b05821-c16c-498b-bf75-9d9625cb1673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:15.838095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b05821-c16c-498b-bf75-9d9625cb1673 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:15.847495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3cf22a12b2042e189748b5c9f57c999', 'request_id': 'req-84be5446-6c27-4b12-937c-91ac519a8329'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:15.860056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3cf22a12b2042e189748b5c9f57c999', 'request_id': 'req-84be5446-6c27-4b12-937c-91ac519a8329'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:15.866970 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3772/7569] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:15.867839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3cf22a12b2042e189748b5c9f57c999', 'request_id': 'req-84be5446-6c27-4b12-937c-91ac519a8329'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:15.886412 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:15.890587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] The token cache is being invalidate because project a3cf22a12b2042e189748b5c9f57c999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:15.891148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:15.891836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-84be5446-6c27-4b12-937c-91ac519a8329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:15.893938 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3798/7570] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:35:15 2022] DELETE /identity/v3/projects/a3cf22a12b2042e189748b5c9f57c999 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:15.899627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db772d-c5c3-4ed4-8a4a-bd20c21cea8a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:15.901324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db772d-c5c3-4ed4-8a4a-bd20c21cea8a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:15.901716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db772d-c5c3-4ed4-8a4a-bd20c21cea8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:15.948017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e5db772d-c5c3-4ed4-8a4a-bd20c21cea8a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:15.959089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e5db772d-c5c3-4ed4-8a4a-bd20c21cea8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:16.014383 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:16.136298 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3773/7571] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:16.143890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4faf8-6a65-4846-b78b-1803b9e05169 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:16.144373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4faf8-6a65-4846-b78b-1803b9e05169 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:16.144798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4faf8-6a65-4846-b78b-1803b9e05169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:16.204573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fbb4faf8-6a65-4846-b78b-1803b9e05169 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:16.206031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fbb4faf8-6a65-4846-b78b-1803b9e05169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:16.253468 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3799/7572] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:16.258284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db772d-c5c3-4ed4-8a4a-bd20c21cea8a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:16.276169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db772d-c5c3-4ed4-8a4a-bd20c21cea8a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:16.284679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf420c-0b03-4552-94a7-99ae479fe22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:16.285410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf420c-0b03-4552-94a7-99ae479fe22d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:16.285761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf420c-0b03-4552-94a7-99ae479fe22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:16.288199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf420c-0b03-4552-94a7-99ae479fe22d admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:16.288383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf420c-0b03-4552-94a7-99ae479fe22d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:35:16.288763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf420c-0b03-4552-94a7-99ae479fe22d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:16.292280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf420c-0b03-4552-94a7-99ae479fe22d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:16.325036 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3774/7573] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:16.329271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4faf8-6a65-4846-b78b-1803b9e05169 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:16.347350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4faf8-6a65-4846-b78b-1803b9e05169 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:16.373540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c0a8e-212f-42e8-af30-903664200bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:16.374417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c0a8e-212f-42e8-af30-903664200bfe admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:16.374874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c0a8e-212f-42e8-af30-903664200bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:16.375288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c0a8e-212f-42e8-af30-903664200bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:16.376646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c0a8e-212f-42e8-af30-903664200bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:16.379627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c0a8e-212f-42e8-af30-903664200bfe admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:16.434724 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3800/7574] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:35:16 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:16.435869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf420c-0b03-4552-94a7-99ae479fe22d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:16.457331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf420c-0b03-4552-94a7-99ae479fe22d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:16.514268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c0a8e-212f-42e8-af30-903664200bfe admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:16.518540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c18c0a8e-212f-42e8-af30-903664200bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:16.618003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b9c8b-a171-4cf7-8096-0e22eeb4bb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:16.621078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9c8b-a171-4cf7-8096-0e22eeb4bb5b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:16.621640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9c8b-a171-4cf7-8096-0e22eeb4bb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:16.622111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9c8b-a171-4cf7-8096-0e22eeb4bb5b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:16.623097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b9c8b-a171-4cf7-8096-0e22eeb4bb5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:16.629113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b9c8b-a171-4cf7-8096-0e22eeb4bb5b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:16.664810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c0a8e-212f-42e8-af30-903664200bfe admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:16.675528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1dcb0-d6f4-4400-ad3f-255dbed2298a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:16.676173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dcb0-d6f4-4400-ad3f-255dbed2298a service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:16.676458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dcb0-d6f4-4400-ad3f-255dbed2298a service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:16.676736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dcb0-d6f4-4400-ad3f-255dbed2298a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:16.686636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c6f1dcb0-d6f4-4400-ad3f-255dbed2298a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:16.713324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1dcb0-d6f4-4400-ad3f-255dbed2298a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:16.715296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1dcb0-d6f4-4400-ad3f-255dbed2298a service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:16.727446 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3775/7575] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:35:16 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:16.737020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b9c8b-a171-4cf7-8096-0e22eeb4bb5b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:16.737620 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3801/7576] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:16.759841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b9c8b-a171-4cf7-8096-0e22eeb4bb5b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:16.800019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235920ba-3fcb-46ef-85ab-0847206d8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:16.801104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235920ba-3fcb-46ef-85ab-0847206d8e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:16.801559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235920ba-3fcb-46ef-85ab-0847206d8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:16.802174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235920ba-3fcb-46ef-85ab-0847206d8e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:16.807339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235920ba-3fcb-46ef-85ab-0847206d8e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:16.809631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235920ba-3fcb-46ef-85ab-0847206d8e07 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:16.840765 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3776/7577] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:16.844611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1dcb0-d6f4-4400-ad3f-255dbed2298a service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:16.865026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1dcb0-d6f4-4400-ad3f-255dbed2298a service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:16.881399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bd4d7-7c8c-4e15-8607-c40abdbb9cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:16.882418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bd4d7-7c8c-4e15-8607-c40abdbb9cec admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:16.882729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bd4d7-7c8c-4e15-8607-c40abdbb9cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:16.883003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bd4d7-7c8c-4e15-8607-c40abdbb9cec admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:16.883657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bd4d7-7c8c-4e15-8607-c40abdbb9cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:16.885422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bd4d7-7c8c-4e15-8607-c40abdbb9cec admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:16.920817 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3802/7578] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:16.922086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235920ba-3fcb-46ef-85ab-0847206d8e07 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:16.936353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235920ba-3fcb-46ef-85ab-0847206d8e07 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:16.949261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bebe19-fd44-493a-9f83-1aa2f50a91a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:16.950045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bebe19-fd44-493a-9f83-1aa2f50a91a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:16.950997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bebe19-fd44-493a-9f83-1aa2f50a91a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:16.951538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bebe19-fd44-493a-9f83-1aa2f50a91a6 admin admin] PATH_INFO: `/v3/projects/517b54dbdeb540d6b6565698b291dd58/users/ea560b4b6d0c4486a0cb5ab73ff8e4de/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:17.000948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bebe19-fd44-493a-9f83-1aa2f50a91a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=517b54dbdeb540d6b6565698b291dd58, user_id=ea560b4b6d0c4486a0cb5ab73ff8e4de, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:17.003929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bebe19-fd44-493a-9f83-1aa2f50a91a6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:17.039428 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3777/7579] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:16 2022] PUT /identity/v3/projects/517b54dbdeb540d6b6565698b291dd58/users/ea560b4b6d0c4486a0cb5ab73ff8e4de/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:17.050220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3253-ae32-4d85-b6c5-035fa0cde298 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:17.050514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3253-ae32-4d85-b6c5-035fa0cde298 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:17.050822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3253-ae32-4d85-b6c5-035fa0cde298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:17.141345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a4ae3253-ae32-4d85-b6c5-035fa0cde298 None None] MFA Rules not processed for user `ea560b4b6d0c4486a0cb5ab73ff8e4de`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:17.143697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a4ae3253-ae32-4d85-b6c5-035fa0cde298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:17.288338 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3803/7580] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:17.334489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bebe19-fd44-493a-9f83-1aa2f50a91a6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:17.342014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c1bebe19-fd44-493a-9f83-1aa2f50a91a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:17.479840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bebe19-fd44-493a-9f83-1aa2f50a91a6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:17.484256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6788a9-f403-45c3-a7e2-c35156ee878c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:17.485083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6788a9-f403-45c3-a7e2-c35156ee878c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:17.485670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6788a9-f403-45c3-a7e2-c35156ee878c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:17.486152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6788a9-f403-45c3-a7e2-c35156ee878c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:17.549296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6788a9-f403-45c3-a7e2-c35156ee878c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:17.552968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6788a9-f403-45c3-a7e2-c35156ee878c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:17.561186 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:17.577730 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3778/7581] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:17.598311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae3253-ae32-4d85-b6c5-035fa0cde298 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:17.699766 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:17.751040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae3253-ae32-4d85-b6c5-035fa0cde298 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:17.764698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:17.767275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:17.768461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:17.768889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] PATH_INFO: `/v3/users/ea560b4b6d0c4486a0cb5ab73ff8e4de` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:17.772482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea560b4b6d0c4486a0cb5ab73ff8e4de)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:17.776618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:17.924559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea560b4b6d0c4486a0cb5ab73ff8e4de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:17.948999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea560b4b6d0c4486a0cb5ab73ff8e4de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:17.949995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea560b4b6d0c4486a0cb5ab73ff8e4de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:17.962003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea560b4b6d0c4486a0cb5ab73ff8e4de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:17.962774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea560b4b6d0c4486a0cb5ab73ff8e4de'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:17.991673 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3804/7582] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:17 2022] DELETE /identity/v3/users/ea560b4b6d0c4486a0cb5ab73ff8e4de => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:17.996294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b18e15-3c86-4ddc-9919-ad13736ee2cc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:17.996583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b18e15-3c86-4ddc-9919-ad13736ee2cc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:17.996862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b18e15-3c86-4ddc-9919-ad13736ee2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:18.051873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-79b18e15-3c86-4ddc-9919-ad13736ee2cc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:18.053375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79b18e15-3c86-4ddc-9919-ad13736ee2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:18.188413 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3779/7583] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:18.208126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:18.210136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:18.321460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f851930-9e7a-4914-a529-89e45d51e297 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:18.326077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2137a1-e055-41f2-babd-45ae27a67a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:18.326926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2137a1-e055-41f2-babd-45ae27a67a48 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:18.327424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2137a1-e055-41f2-babd-45ae27a67a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:18.327839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2137a1-e055-41f2-babd-45ae27a67a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:18.342096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2137a1-e055-41f2-babd-45ae27a67a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:18.343940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2137a1-e055-41f2-babd-45ae27a67a48 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:18.362476 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3805/7584] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:20.211297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b18e15-3c86-4ddc-9919-ad13736ee2cc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:20.213565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79b18e15-3c86-4ddc-9919-ad13736ee2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:20.238248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b18e15-3c86-4ddc-9919-ad13736ee2cc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:20.247453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:20.248815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:20.249274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:20.249749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] PATH_INFO: `/v3/projects/517b54dbdeb540d6b6565698b291dd58` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:20.258986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=517b54dbdeb540d6b6565698b291dd58)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:20.261195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:20.387470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517b54dbdeb540d6b6565698b291dd58', 'request_id': 'req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:20.444679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517b54dbdeb540d6b6565698b291dd58', 'request_id': 'req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:20.460024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517b54dbdeb540d6b6565698b291dd58', 'request_id': 'req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:20.542180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] The token cache is being invalidate because project 517b54dbdeb540d6b6565698b291dd58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:20.542304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:20.543620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2dfe876-8b71-4eb2-b8fb-42d4d5d486b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:20.551079 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3780/7585] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:35:20 2022] DELETE /identity/v3/projects/517b54dbdeb540d6b6565698b291dd58 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:20.556060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b001c-2416-48c6-b103-30f8c291a0f4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:20.556518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b001c-2416-48c6-b103-30f8c291a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:20.556699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b001c-2416-48c6-b103-30f8c291a0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:20.594488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-188b001c-2416-48c6-b103-30f8c291a0f4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:20.595889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-188b001c-2416-48c6-b103-30f8c291a0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:20.752424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3806/7586] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:20.764964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c5fbb-92b3-4fa0-a75b-a072cda70962 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:20.765323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c5fbb-92b3-4fa0-a75b-a072cda70962 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:20.765687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c5fbb-92b3-4fa0-a75b-a072cda70962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:20.810197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-036c5fbb-92b3-4fa0-a75b-a072cda70962 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:20.812550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-036c5fbb-92b3-4fa0-a75b-a072cda70962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:20.875258 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3781/7587] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:20.875362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b001c-2416-48c6-b103-30f8c291a0f4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:20.889248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b001c-2416-48c6-b103-30f8c291a0f4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:20.905551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e4ca8-51e0-40ae-80b8-f6e3143518e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:20.906198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4ca8-51e0-40ae-80b8-f6e3143518e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:20.906478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4ca8-51e0-40ae-80b8-f6e3143518e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:20.906852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4ca8-51e0-40ae-80b8-f6e3143518e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:20.917871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e4ca8-51e0-40ae-80b8-f6e3143518e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:35:20.918313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e4ca8-51e0-40ae-80b8-f6e3143518e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:20.923579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e4ca8-51e0-40ae-80b8-f6e3143518e7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:20.977652 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3807/7588] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:35:20.980098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c5fbb-92b3-4fa0-a75b-a072cda70962 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:21.001918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c5fbb-92b3-4fa0-a75b-a072cda70962 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:21.019061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eee572-a369-4f41-9764-ee5e260a2f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:21.021335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eee572-a369-4f41-9764-ee5e260a2f73 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:21.025470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eee572-a369-4f41-9764-ee5e260a2f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:21.026070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eee572-a369-4f41-9764-ee5e260a2f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:21.027882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eee572-a369-4f41-9764-ee5e260a2f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:21.036982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eee572-a369-4f41-9764-ee5e260a2f73 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:21.137272 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3782/7589] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:35:20 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:21.141947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e4ca8-51e0-40ae-80b8-f6e3143518e7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:21.151304 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:21.155250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e4ca8-51e0-40ae-80b8-f6e3143518e7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:21.289670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809f1c0-0a76-4e5b-b3fd-d8050c8cc921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:21.290565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809f1c0-0a76-4e5b-b3fd-d8050c8cc921 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:21.291077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809f1c0-0a76-4e5b-b3fd-d8050c8cc921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:21.291530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809f1c0-0a76-4e5b-b3fd-d8050c8cc921 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:21.293319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809f1c0-0a76-4e5b-b3fd-d8050c8cc921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:21.295725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809f1c0-0a76-4e5b-b3fd-d8050c8cc921 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:21.332022 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3808/7590] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:35:21 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:21.336282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eee572-a369-4f41-9764-ee5e260a2f73 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:21.353027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eee572-a369-4f41-9764-ee5e260a2f73 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:21.372407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20759ab7-00dc-472c-8aec-7a80b1bb6b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:21.373053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759ab7-00dc-472c-8aec-7a80b1bb6b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:21.373339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759ab7-00dc-472c-8aec-7a80b1bb6b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:21.373615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759ab7-00dc-472c-8aec-7a80b1bb6b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:21.374767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20759ab7-00dc-472c-8aec-7a80b1bb6b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:21.378460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20759ab7-00dc-472c-8aec-7a80b1bb6b54 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:21.417606 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3783/7591] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:21.428543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809f1c0-0a76-4e5b-b3fd-d8050c8cc921 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:21.451898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809f1c0-0a76-4e5b-b3fd-d8050c8cc921 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:21.480086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20759ab7-00dc-472c-8aec-7a80b1bb6b54 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:21.486730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20759ab7-00dc-472c-8aec-7a80b1bb6b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:21.493001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245294f3-c6dd-48c9-94b6-f0b53d6dd39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:21.499899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245294f3-c6dd-48c9-94b6-f0b53d6dd39c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:21.500285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245294f3-c6dd-48c9-94b6-f0b53d6dd39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:21.500566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245294f3-c6dd-48c9-94b6-f0b53d6dd39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:21.501276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245294f3-c6dd-48c9-94b6-f0b53d6dd39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:21.506212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245294f3-c6dd-48c9-94b6-f0b53d6dd39c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:21.544259 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3809/7592] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:21.546757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245294f3-c6dd-48c9-94b6-f0b53d6dd39c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:21.570889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245294f3-c6dd-48c9-94b6-f0b53d6dd39c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:21.632445 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:21.641024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309e30-d126-4d47-b911-d32193ae00fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:21.645502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309e30-d126-4d47-b911-d32193ae00fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:21.649282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309e30-d126-4d47-b911-d32193ae00fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:21.649807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309e30-d126-4d47-b911-d32193ae00fc admin admin] PATH_INFO: `/v3/projects/49735b875052451e8714cd9c540b86c9/users/858534b2a0ca4aaa8de34ff8d6f91aee/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:21.671392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20759ab7-00dc-472c-8aec-7a80b1bb6b54 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:21.684519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d9e4-ca6b-4c6c-85fa-d5afeda361f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:21.685478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d9e4-ca6b-4c6c-85fa-d5afeda361f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:21.686080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d9e4-ca6b-4c6c-85fa-d5afeda361f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:21.686509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d9e4-ca6b-4c6c-85fa-d5afeda361f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:21.691143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4434d9e4-ca6b-4c6c-85fa-d5afeda361f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:21.707498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14309e30-d126-4d47-b911-d32193ae00fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=49735b875052451e8714cd9c540b86c9, user_id=858534b2a0ca4aaa8de34ff8d6f91aee, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:21.711474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14309e30-d126-4d47-b911-d32193ae00fc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:21.720498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434d9e4-ca6b-4c6c-85fa-d5afeda361f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:21.722107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434d9e4-ca6b-4c6c-85fa-d5afeda361f4 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:21.782866 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3810/7593] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:21 2022] PUT /identity/v3/projects/49735b875052451e8714cd9c540b86c9/users/858534b2a0ca4aaa8de34ff8d6f91aee/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:21.789728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd0298-d508-487c-ba02-c2afc9b93482 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:21.790063 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3784/7594] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:35:21.790794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd0298-d508-487c-ba02-c2afc9b93482 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:21.791310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd0298-d508-487c-ba02-c2afc9b93482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:21.829887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-46bd0298-d508-487c-ba02-c2afc9b93482 None None] MFA Rules not processed for user `858534b2a0ca4aaa8de34ff8d6f91aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:21.831344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-46bd0298-d508-487c-ba02-c2afc9b93482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:21.989796 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3811/7595] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:22.018361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d9e4-ca6b-4c6c-85fa-d5afeda361f4 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:22.019892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4434d9e4-ca6b-4c6c-85fa-d5afeda361f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:22.039567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d9e4-ca6b-4c6c-85fa-d5afeda361f4 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:22.145125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd06a93-b0cc-423f-a005-f6a881c22d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:22.146158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd06a93-b0cc-423f-a005-f6a881c22d11 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:22.146679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd06a93-b0cc-423f-a005-f6a881c22d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:22.147173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd06a93-b0cc-423f-a005-f6a881c22d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:22.178992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd06a93-b0cc-423f-a005-f6a881c22d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:22.182758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd06a93-b0cc-423f-a005-f6a881c22d11 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:22.193911 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3785/7596] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:27.954014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd0298-d508-487c-ba02-c2afc9b93482 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:27.975017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd0298-d508-487c-ba02-c2afc9b93482 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:27.988699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d475b-7804-4262-b4a7-7a71685ef8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:27.989669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d475b-7804-4262-b4a7-7a71685ef8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:27.990092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d475b-7804-4262-b4a7-7a71685ef8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:27.990675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d475b-7804-4262-b4a7-7a71685ef8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:27.992622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4e4d475b-7804-4262-b4a7-7a71685ef8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:28.125786 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:28.199801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d475b-7804-4262-b4a7-7a71685ef8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:28.201450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d475b-7804-4262-b4a7-7a71685ef8a7 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:28.235115 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3812/7597] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:29.132241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd06a93-b0cc-423f-a005-f6a881c22d11 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:29.160085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd06a93-b0cc-423f-a005-f6a881c22d11 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:29.205624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f64f1f-3520-45d3-b996-de6c31ea9395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:29.206539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f64f1f-3520-45d3-b996-de6c31ea9395 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:29.206989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f64f1f-3520-45d3-b996-de6c31ea9395 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:29.207951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f64f1f-3520-45d3-b996-de6c31ea9395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:29.209989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-14f64f1f-3520-45d3-b996-de6c31ea9395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:29.348668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f64f1f-3520-45d3-b996-de6c31ea9395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:29.350402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f64f1f-3520-45d3-b996-de6c31ea9395 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:29.362070 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3786/7598] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:34.352892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d475b-7804-4262-b4a7-7a71685ef8a7 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:34.354336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4e4d475b-7804-4262-b4a7-7a71685ef8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:34.548379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d475b-7804-4262-b4a7-7a71685ef8a7 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:34.555050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423e450-e40f-45c7-b875-cf0f2f3541c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:34.555801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e450-e40f-45c7-b875-cf0f2f3541c9 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:34.556085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e450-e40f-45c7-b875-cf0f2f3541c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:34.556369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e450-e40f-45c7-b875-cf0f2f3541c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:34.558141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7423e450-e40f-45c7-b875-cf0f2f3541c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:34.573978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423e450-e40f-45c7-b875-cf0f2f3541c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:34.576002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423e450-e40f-45c7-b875-cf0f2f3541c9 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:34.594479 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3813/7599] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:36.969741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f64f1f-3520-45d3-b996-de6c31ea9395 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:37.004465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423e450-e40f-45c7-b875-cf0f2f3541c9 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:37.015984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7423e450-e40f-45c7-b875-cf0f2f3541c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:37.022158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f64f1f-3520-45d3-b996-de6c31ea9395 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:37.045280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad39a46-bb23-4275-bc89-598cf204dc1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:37.046131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad39a46-bb23-4275-bc89-598cf204dc1a service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:37.048272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad39a46-bb23-4275-bc89-598cf204dc1a service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:37.048703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad39a46-bb23-4275-bc89-598cf204dc1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:37.054152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4ad39a46-bb23-4275-bc89-598cf204dc1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:37.075699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423e450-e40f-45c7-b875-cf0f2f3541c9 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:37.088713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d35cff-857d-466d-aa7e-443090e8e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:37.089773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d35cff-857d-466d-aa7e-443090e8e811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:37.090291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d35cff-857d-466d-aa7e-443090e8e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:37.091563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d35cff-857d-466d-aa7e-443090e8e811 admin admin] PATH_INFO: `/v3/users/116490a90023449a83265db52a0debb1` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:37.093169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d35cff-857d-466d-aa7e-443090e8e811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=116490a90023449a83265db52a0debb1)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:37.096385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d35cff-857d-466d-aa7e-443090e8e811 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:37.098000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad39a46-bb23-4275-bc89-598cf204dc1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:37.099964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad39a46-bb23-4275-bc89-598cf204dc1a service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:37.116959 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3787/7600] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:37.276248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93d35cff-857d-466d-aa7e-443090e8e811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116490a90023449a83265db52a0debb1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:37.319024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93d35cff-857d-466d-aa7e-443090e8e811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116490a90023449a83265db52a0debb1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:37.321585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93d35cff-857d-466d-aa7e-443090e8e811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116490a90023449a83265db52a0debb1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:37.333604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93d35cff-857d-466d-aa7e-443090e8e811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116490a90023449a83265db52a0debb1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:37.334242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93d35cff-857d-466d-aa7e-443090e8e811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116490a90023449a83265db52a0debb1'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:37.351521 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3814/7601] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:37 2022] DELETE /identity/v3/users/116490a90023449a83265db52a0debb1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:37.736983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad39a46-bb23-4275-bc89-598cf204dc1a service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:37.761823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad39a46-bb23-4275-bc89-598cf204dc1a service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:37.843636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:37.844596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:37.844892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:37.845222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] PATH_INFO: `/v3/projects/d9b8b20b7702433486fbb08f8e801d57` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:37.846430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b8b20b7702433486fbb08f8e801d57)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:37.849208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:37.865413 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:37.954096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b8b20b7702433486fbb08f8e801d57', 'request_id': 'req-0d07c246-812d-421d-afcc-a5c489dcc141'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:37.961697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b8b20b7702433486fbb08f8e801d57', 'request_id': 'req-0d07c246-812d-421d-afcc-a5c489dcc141'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:37.970266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b8b20b7702433486fbb08f8e801d57', 'request_id': 'req-0d07c246-812d-421d-afcc-a5c489dcc141'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:37.989126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] The token cache is being invalidate because project d9b8b20b7702433486fbb08f8e801d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:37.989410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:37.990116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0d07c246-812d-421d-afcc-a5c489dcc141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:37.995287 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3788/7602] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:35:37 2022] DELETE /identity/v3/projects/d9b8b20b7702433486fbb08f8e801d57 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:38.001002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64afc1-a4f0-4e02-bb84-217117a79f6a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:38.001314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64afc1-a4f0-4e02-bb84-217117a79f6a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:38.001562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64afc1-a4f0-4e02-bb84-217117a79f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:38.023924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5f64afc1-a4f0-4e02-bb84-217117a79f6a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:38.025387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5f64afc1-a4f0-4e02-bb84-217117a79f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:38.060599 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:38.106457 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3815/7603] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:38.108668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c1668-63ad-473e-8ace-33656b526192 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:38.108908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c1668-63ad-473e-8ace-33656b526192 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:38.109266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c1668-63ad-473e-8ace-33656b526192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:38.135835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-453c1668-63ad-473e-8ace-33656b526192 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:38.137238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-453c1668-63ad-473e-8ace-33656b526192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:38.168985 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3789/7604] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:38.173663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64afc1-a4f0-4e02-bb84-217117a79f6a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:38.194669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64afc1-a4f0-4e02-bb84-217117a79f6a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:38.240710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1acac5-2d56-4801-8b9e-6e6ebb310126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:38.241052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1acac5-2d56-4801-8b9e-6e6ebb310126 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:38.241339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1acac5-2d56-4801-8b9e-6e6ebb310126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:38.241681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1acac5-2d56-4801-8b9e-6e6ebb310126 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:38.242361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1acac5-2d56-4801-8b9e-6e6ebb310126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:35:38.242687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1acac5-2d56-4801-8b9e-6e6ebb310126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:38.244320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1acac5-2d56-4801-8b9e-6e6ebb310126 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:38.257010 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3816/7605] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:38.262045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c1668-63ad-473e-8ace-33656b526192 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:38.279318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c1668-63ad-473e-8ace-33656b526192 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:38.345026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3196d3-6f4c-45a5-9683-fbb6d8087d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:38.345658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3196d3-6f4c-45a5-9683-fbb6d8087d18 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:38.345937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3196d3-6f4c-45a5-9683-fbb6d8087d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:38.346209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3196d3-6f4c-45a5-9683-fbb6d8087d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:38.346871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3196d3-6f4c-45a5-9683-fbb6d8087d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:38.350686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3196d3-6f4c-45a5-9683-fbb6d8087d18 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:38.414705 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3790/7606] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:35:38 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:38.423522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1acac5-2d56-4801-8b9e-6e6ebb310126 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:38.445334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1acac5-2d56-4801-8b9e-6e6ebb310126 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:38.588888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b7fd0-c916-422f-97e4-35f726fd191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:38.589912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7fd0-c916-422f-97e4-35f726fd191d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:38.590249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7fd0-c916-422f-97e4-35f726fd191d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:38.590592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7fd0-c916-422f-97e4-35f726fd191d admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:38.594346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b7fd0-c916-422f-97e4-35f726fd191d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:38.597073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b7fd0-c916-422f-97e4-35f726fd191d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:38.648715 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3817/7607] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:35:38 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:38.653339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3196d3-6f4c-45a5-9683-fbb6d8087d18 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:38.670865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3196d3-6f4c-45a5-9683-fbb6d8087d18 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:38.687036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acd8e6-d075-4abf-a1c1-037e47cc97f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:38.687036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acd8e6-d075-4abf-a1c1-037e47cc97f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:38.687036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acd8e6-d075-4abf-a1c1-037e47cc97f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:38.691803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acd8e6-d075-4abf-a1c1-037e47cc97f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:38.691803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acd8e6-d075-4abf-a1c1-037e47cc97f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:38.693198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acd8e6-d075-4abf-a1c1-037e47cc97f7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:38.715128 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3791/7608] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:38.719194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b7fd0-c916-422f-97e4-35f726fd191d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:38.732212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b7fd0-c916-422f-97e4-35f726fd191d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:38.739152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c54b6-898f-4d0b-87c9-0ed46258f9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:38.740147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c54b6-898f-4d0b-87c9-0ed46258f9ca admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:38.741191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c54b6-898f-4d0b-87c9-0ed46258f9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:38.741679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c54b6-898f-4d0b-87c9-0ed46258f9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:38.742543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c54b6-898f-4d0b-87c9-0ed46258f9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:38.745140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c54b6-898f-4d0b-87c9-0ed46258f9ca admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:38.761272 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3818/7609] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:38.765368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acd8e6-d075-4abf-a1c1-037e47cc97f7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:38.795083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acd8e6-d075-4abf-a1c1-037e47cc97f7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:38.817344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960ea19-ba9c-4c72-b934-573c24f9a5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:38.818263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960ea19-ba9c-4c72-b934-573c24f9a5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:38.818673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960ea19-ba9c-4c72-b934-573c24f9a5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:38.819184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960ea19-ba9c-4c72-b934-573c24f9a5b2 admin admin] PATH_INFO: `/v3/projects/285bb2fed4dc40fd93504f91e0e37b56/users/0df07cc6ef134ef5a5d8b1983368b5f4/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:38.836681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960ea19-ba9c-4c72-b934-573c24f9a5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285bb2fed4dc40fd93504f91e0e37b56, user_id=0df07cc6ef134ef5a5d8b1983368b5f4, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:38.841415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960ea19-ba9c-4c72-b934-573c24f9a5b2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:38.865247 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3792/7610] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:38 2022] PUT /identity/v3/projects/285bb2fed4dc40fd93504f91e0e37b56/users/0df07cc6ef134ef5a5d8b1983368b5f4/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:38.876378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49a27a-5820-4a10-a7bf-78083c20cb87 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:38.877024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49a27a-5820-4a10-a7bf-78083c20cb87 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:38.877505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49a27a-5820-4a10-a7bf-78083c20cb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:38.936295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1f49a27a-5820-4a10-a7bf-78083c20cb87 None None] MFA Rules not processed for user `0df07cc6ef134ef5a5d8b1983368b5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:38.942628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1f49a27a-5820-4a10-a7bf-78083c20cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:39.135086 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3819/7611] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:39.140585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960ea19-ba9c-4c72-b934-573c24f9a5b2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:39.283608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960ea19-ba9c-4c72-b934-573c24f9a5b2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:39.290935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8ee8e-d242-459c-9b15-3b356f1b3f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:39.291840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ee8e-d242-459c-9b15-3b356f1b3f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:39.292316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ee8e-d242-459c-9b15-3b356f1b3f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:39.292879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ee8e-d242-459c-9b15-3b356f1b3f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:39.293920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8ee8e-d242-459c-9b15-3b356f1b3f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:39.296201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8ee8e-d242-459c-9b15-3b356f1b3f5c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:39.343612 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3793/7612] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:35:39 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:39.345905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49a27a-5820-4a10-a7bf-78083c20cb87 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:39.364988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49a27a-5820-4a10-a7bf-78083c20cb87 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:39.412172 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:39.474265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c09aa7-7e1e-490b-ae74-1168e3b97738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:39.475155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c09aa7-7e1e-490b-ae74-1168e3b97738 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:39.476969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c09aa7-7e1e-490b-ae74-1168e3b97738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:39.491235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c09aa7-7e1e-490b-ae74-1168e3b97738 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:39.492081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c09aa7-7e1e-490b-ae74-1168e3b97738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:39.506645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c09aa7-7e1e-490b-ae74-1168e3b97738 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:39.550020 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3820/7613] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:35:39 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:39.555102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8ee8e-d242-459c-9b15-3b356f1b3f5c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:39.598462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8ee8e-d242-459c-9b15-3b356f1b3f5c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:39.614276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7ede-7eab-49fa-b888-e1a313134b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:39.615337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7ede-7eab-49fa-b888-e1a313134b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:39.615830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7ede-7eab-49fa-b888-e1a313134b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:39.616309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7ede-7eab-49fa-b888-e1a313134b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:39.617404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f7ede-7eab-49fa-b888-e1a313134b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:39.619268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f7ede-7eab-49fa-b888-e1a313134b60 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:39.637467 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3794/7614] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:39.638494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c09aa7-7e1e-490b-ae74-1168e3b97738 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:39.656409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c09aa7-7e1e-490b-ae74-1168e3b97738 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:39.666164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0c60c-3a66-4150-a034-6f4243a15c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:39.667015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0c60c-3a66-4150-a034-6f4243a15c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:39.667415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0c60c-3a66-4150-a034-6f4243a15c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:39.667770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0c60c-3a66-4150-a034-6f4243a15c38 admin admin] PATH_INFO: `/v3/projects/8a264fc1ca5e44c09591c78f7363e35b/users/36d9fbb2322044ddae25e7323425385a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:39.704945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0c60c-3a66-4150-a034-6f4243a15c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a264fc1ca5e44c09591c78f7363e35b, user_id=36d9fbb2322044ddae25e7323425385a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:39.709287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0c60c-3a66-4150-a034-6f4243a15c38 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:39.734013 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3821/7615] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:39 2022] PUT /identity/v3/projects/8a264fc1ca5e44c09591c78f7363e35b/users/36d9fbb2322044ddae25e7323425385a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:39.735290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7ede-7eab-49fa-b888-e1a313134b60 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:39.749532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7ede-7eab-49fa-b888-e1a313134b60 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:39.759432 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:39.857575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ebd8f-3949-4709-a742-db9f234867cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:39.858125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ebd8f-3949-4709-a742-db9f234867cc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:39.858414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ebd8f-3949-4709-a742-db9f234867cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:39.858740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ebd8f-3949-4709-a742-db9f234867cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:39.860166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ebd8f-3949-4709-a742-db9f234867cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:39.864488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ebd8f-3949-4709-a742-db9f234867cc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:39.875711 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3795/7616] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:39.880905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0c60c-3a66-4150-a034-6f4243a15c38 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:39.895668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0c60c-3a66-4150-a034-6f4243a15c38 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:39.903582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56345c7-d732-42e4-bab8-eefb773b4d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:39.904260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56345c7-d732-42e4-bab8-eefb773b4d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:39.904540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56345c7-d732-42e4-bab8-eefb773b4d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:39.904809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56345c7-d732-42e4-bab8-eefb773b4d08 admin admin] PATH_INFO: `/v3/projects/8a264fc1ca5e44c09591c78f7363e35b/users/36d9fbb2322044ddae25e7323425385a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:39.906788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56345c7-d732-42e4-bab8-eefb773b4d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a264fc1ca5e44c09591c78f7363e35b, user_id=36d9fbb2322044ddae25e7323425385a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:39.927779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56345c7-d732-42e4-bab8-eefb773b4d08 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:39.987326 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3822/7617] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:39 2022] PUT /identity/v3/projects/8a264fc1ca5e44c09591c78f7363e35b/users/36d9fbb2322044ddae25e7323425385a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:40.000217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62939f7-3cb4-43cf-9fda-b200ddaa9cb6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:40.000505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62939f7-3cb4-43cf-9fda-b200ddaa9cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:40.001248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62939f7-3cb4-43cf-9fda-b200ddaa9cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:40.107246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e62939f7-3cb4-43cf-9fda-b200ddaa9cb6 None None] MFA Rules not processed for user `36d9fbb2322044ddae25e7323425385a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:40.110443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e62939f7-3cb4-43cf-9fda-b200ddaa9cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:40.259573 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3796/7618] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:40.263899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56345c7-d732-42e4-bab8-eefb773b4d08 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:40.275820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56345c7-d732-42e4-bab8-eefb773b4d08 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:40.280369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f9c45-dabc-4739-b41d-d5d593da16ab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:40.280982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f9c45-dabc-4739-b41d-d5d593da16ab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:40.281261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f9c45-dabc-4739-b41d-d5d593da16ab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:40.281539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f9c45-dabc-4739-b41d-d5d593da16ab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:40.282265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f9c45-dabc-4739-b41d-d5d593da16ab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:40.284068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f9c45-dabc-4739-b41d-d5d593da16ab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:40.310503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62939f7-3cb4-43cf-9fda-b200ddaa9cb6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:40.312270 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3823/7619] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:35:40 2022] POST /identity/v3/roles => generated 235 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:40.335115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62939f7-3cb4-43cf-9fda-b200ddaa9cb6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:40.351490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e1b3b-79c3-4dad-9cec-165ad5f26802 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:40.352134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1b3b-79c3-4dad-9cec-165ad5f26802 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:40.352417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1b3b-79c3-4dad-9cec-165ad5f26802 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:40.352696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1b3b-79c3-4dad-9cec-165ad5f26802 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:40.353446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e1b3b-79c3-4dad-9cec-165ad5f26802 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:40.355142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e1b3b-79c3-4dad-9cec-165ad5f26802 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:40.376524 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3797/7620] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:35:40 2022] POST /identity/v3/roles => generated 234 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:40.380736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f9c45-dabc-4739-b41d-d5d593da16ab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:40.392098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f9c45-dabc-4739-b41d-d5d593da16ab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:40.397524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481263a-0d2f-4511-8dd1-a862283edc26 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:40.398137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481263a-0d2f-4511-8dd1-a862283edc26 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:40.398420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481263a-0d2f-4511-8dd1-a862283edc26 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:40.398726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481263a-0d2f-4511-8dd1-a862283edc26 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:40.399392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481263a-0d2f-4511-8dd1-a862283edc26 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:40.401336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481263a-0d2f-4511-8dd1-a862283edc26 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:40.442791 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3824/7621] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:35:40 2022] POST /identity/v3/roles => generated 234 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:40.447647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e1b3b-79c3-4dad-9cec-165ad5f26802 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:40.467643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e1b3b-79c3-4dad-9cec-165ad5f26802 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:40.484030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313f462-a3c3-425b-a409-b167958158f9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:40.486221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313f462-a3c3-425b-a409-b167958158f9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:40.486586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313f462-a3c3-425b-a409-b167958158f9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:40.486999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313f462-a3c3-425b-a409-b167958158f9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:40.487835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313f462-a3c3-425b-a409-b167958158f9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:40.489911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313f462-a3c3-425b-a409-b167958158f9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:40.536240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481263a-0d2f-4511-8dd1-a862283edc26 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:40.536947 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3798/7622] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:35:40 2022] POST /identity/v3/domains => generated 275 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:40.571248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481263a-0d2f-4511-8dd1-a862283edc26 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:40.702922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979f8fb-4f80-44be-a1fb-d78f1f101f9f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:40.703892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979f8fb-4f80-44be-a1fb-d78f1f101f9f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:40.704421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979f8fb-4f80-44be-a1fb-d78f1f101f9f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:40.705108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979f8fb-4f80-44be-a1fb-d78f1f101f9f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:40.705991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979f8fb-4f80-44be-a1fb-d78f1f101f9f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:40.709499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979f8fb-4f80-44be-a1fb-d78f1f101f9f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:40.771558 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3825/7623] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:35:40 2022] POST /identity/v3/projects => generated 399 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:40.772813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313f462-a3c3-425b-a409-b167958158f9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:40.783648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313f462-a3c3-425b-a409-b167958158f9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:40.934577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab743b-d77e-4497-aa40-e328a711a905 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:40.936731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab743b-d77e-4497-aa40-e328a711a905 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:40.937438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab743b-d77e-4497-aa40-e328a711a905 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:40.937941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab743b-d77e-4497-aa40-e328a711a905 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/groups` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:40.938867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab743b-d77e-4497-aa40-e328a711a905 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:40.941614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab743b-d77e-4497-aa40-e328a711a905 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:40.959222 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:40.974543 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3799/7624] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 2 01:35:40 2022] POST /identity/v3/groups => generated 301 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:40.975935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979f8fb-4f80-44be-a1fb-d78f1f101f9f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:40.991777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979f8fb-4f80-44be-a1fb-d78f1f101f9f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:41.044560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3047b76-53aa-4e05-b691-f469859e2e61 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:41.044560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047b76-53aa-4e05-b691-f469859e2e61 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:41.045108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047b76-53aa-4e05-b691-f469859e2e61 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:41.045646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047b76-53aa-4e05-b691-f469859e2e61 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:41.047557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3047b76-53aa-4e05-b691-f469859e2e61 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:41.058259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3047b76-53aa-4e05-b691-f469859e2e61 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:41.073822 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3826/7625] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:35:40 2022] POST /identity/v3/roles => generated 235 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:41.078042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab743b-d77e-4497-aa40-e328a711a905 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:41.096665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab743b-d77e-4497-aa40-e328a711a905 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:41.107858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7178ca-2a87-4dcb-b22b-95d9b848fd2a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:41.109765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7178ca-2a87-4dcb-b22b-95d9b848fd2a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:41.114938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7178ca-2a87-4dcb-b22b-95d9b848fd2a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:41.117226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7178ca-2a87-4dcb-b22b-95d9b848fd2a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:41.117226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7178ca-2a87-4dcb-b22b-95d9b848fd2a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:41.118023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7178ca-2a87-4dcb-b22b-95d9b848fd2a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:41.149900 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3800/7626] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:35:41 2022] POST /identity/v3/users => generated 442 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:41.151221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3047b76-53aa-4e05-b691-f469859e2e61 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:41.163816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3047b76-53aa-4e05-b691-f469859e2e61 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:41.168889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2ce4a-a191-41b7-b373-2f80ca64de84 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:41.169604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2ce4a-a191-41b7-b373-2f80ca64de84 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:41.169953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2ce4a-a191-41b7-b373-2f80ca64de84 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:41.171057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2ce4a-a191-41b7-b373-2f80ca64de84 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:41.171961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2ce4a-a191-41b7-b373-2f80ca64de84 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:41.173116 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-7cb2ce4a-a191-41b7-b373-2f80ca64de84 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:41.173116 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:41.173116 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:41.174084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2ce4a-a191-41b7-b373-2f80ca64de84 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:41.204346 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3827/7627] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:35:41 2022] POST /identity/v3/roles => generated 270 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:41.206226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7178ca-2a87-4dcb-b22b-95d9b848fd2a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:41.224247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7178ca-2a87-4dcb-b22b-95d9b848fd2a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:41.234660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0e436-3f8f-4310-800e-6de62ba27476 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:41.235343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0e436-3f8f-4310-800e-6de62ba27476 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:41.235807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0e436-3f8f-4310-800e-6de62ba27476 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:41.236276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0e436-3f8f-4310-800e-6de62ba27476 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/6dfec730ab284fa4bdf69aa28eb33825` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:41.287112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0e436-3f8f-4310-800e-6de62ba27476 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_grant(project_id=78dcc3df4fe74b7fb8a982c4c508d612, user_id=156fac971af3406eb37fac686488b922, role_id=6dfec730ab284fa4bdf69aa28eb33825)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:41.293053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0e436-3f8f-4310-800e-6de62ba27476 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:41.312512 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3801/7628] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:41 2022] PUT /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/6dfec730ab284fa4bdf69aa28eb33825 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:41.317433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2ce4a-a191-41b7-b373-2f80ca64de84 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:41.326464 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:41.333439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2ce4a-a191-41b7-b373-2f80ca64de84 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:41.490161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118a864-af87-4ee3-b699-819f2efdb08f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:41.490842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118a864-af87-4ee3-b699-819f2efdb08f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:41.491313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118a864-af87-4ee3-b699-819f2efdb08f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:41.491595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118a864-af87-4ee3-b699-819f2efdb08f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:41.492340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118a864-af87-4ee3-b699-819f2efdb08f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Adding query filter params (scope.project.id=78dcc3df4fe74b7fb8a982c4c508d612, user.id=156fac971af3406eb37fac686488b922) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:35:41.492654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118a864-af87-4ee3-b699-819f2efdb08f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:41.497567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118a864-af87-4ee3-b699-819f2efdb08f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:41.565941 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3828/7629] 10.222.0.23 () {58 vars in 1356 bytes} [Sun Oct 2 01:35:41 2022] GET /identity/v3/role_assignments?scope.project.id=78dcc3df4fe74b7fb8a982c4c508d612&user.id=156fac971af3406eb37fac686488b922&effective => generated 228 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:41.569510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0e436-3f8f-4310-800e-6de62ba27476 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:41.600669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0e436-3f8f-4310-800e-6de62ba27476 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:41.616158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce3117-7fb3-4711-9398-467a6922fdf8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:41.616978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce3117-7fb3-4711-9398-467a6922fdf8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:41.617271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce3117-7fb3-4711-9398-467a6922fdf8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:41.617555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce3117-7fb3-4711-9398-467a6922fdf8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/6dfec730ab284fa4bdf69aa28eb33825` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:41.622343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce3117-7fb3-4711-9398-467a6922fdf8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=78dcc3df4fe74b7fb8a982c4c508d612, user_id=156fac971af3406eb37fac686488b922, role_id=6dfec730ab284fa4bdf69aa28eb33825)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:41.632214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce3117-7fb3-4711-9398-467a6922fdf8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:41.650086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63ce3117-7fb3-4711-9398-467a6922fdf8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role 6dfec730ab284fa4bdf69aa28eb33825 was removed from user 156fac971af3406eb37fac686488b922 on project 78dcc3df4fe74b7fb8a982c4c508d612. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:41.650834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63ce3117-7fb3-4711-9398-467a6922fdf8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:41.652436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63ce3117-7fb3-4711-9398-467a6922fdf8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:41.689499 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3802/7630] 10.222.0.23 () {58 vars in 1467 bytes} [Sun Oct 2 01:35:41 2022] DELETE /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/6dfec730ab284fa4bdf69aa28eb33825 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:41.691365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118a864-af87-4ee3-b699-819f2efdb08f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:41.695452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c118a864-af87-4ee3-b699-819f2efdb08f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:41.744565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118a864-af87-4ee3-b699-819f2efdb08f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:41.952501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:41.953158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:41.953441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:41.953716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/6dfec730ab284fa4bdf69aa28eb33825` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:41.954886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=6dfec730ab284fa4bdf69aa28eb33825)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:41.955970 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:41.955970 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:41.955970 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:41.957415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:42.014584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role 6dfec730ab284fa4bdf69aa28eb33825 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:42.014907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:42.016258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:42.021655 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3829/7631] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:41 2022] DELETE /identity/v3/roles/6dfec730ab284fa4bdf69aa28eb33825 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:42.029268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce3117-7fb3-4711-9398-467a6922fdf8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:42.045887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce3117-7fb3-4711-9398-467a6922fdf8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:42.242540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788439f6-fa29-4999-862a-8c6861e426a4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:42.244126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788439f6-fa29-4999-862a-8c6861e426a4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:42.244538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788439f6-fa29-4999-862a-8c6861e426a4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:42.244918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788439f6-fa29-4999-862a-8c6861e426a4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/e89ba30d37bb446cb3774b4801ccb08e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:42.251637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788439f6-fa29-4999-862a-8c6861e426a4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_grant(project_id=78dcc3df4fe74b7fb8a982c4c508d612, user_id=156fac971af3406eb37fac686488b922, role_id=e89ba30d37bb446cb3774b4801ccb08e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:42.256514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788439f6-fa29-4999-862a-8c6861e426a4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:42.281517 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3803/7632] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:42 2022] PUT /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/e89ba30d37bb446cb3774b4801ccb08e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:42.286939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:42.289000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:42.337696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c10a1-27d2-4b7f-8fa1-46b7a6231d8f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:42.382955 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:42.455440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443bf53-059d-403e-b397-0f4f6a5d60ef tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:42.457551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443bf53-059d-403e-b397-0f4f6a5d60ef tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:42.458095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443bf53-059d-403e-b397-0f4f6a5d60ef tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:42.459179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443bf53-059d-403e-b397-0f4f6a5d60ef tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:42.461205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443bf53-059d-403e-b397-0f4f6a5d60ef tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:42.462828 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-e443bf53-059d-403e-b397-0f4f6a5d60ef tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:42.462828 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:42.462828 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:42.464312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443bf53-059d-403e-b397-0f4f6a5d60ef tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:42.500867 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3830/7633] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:42 2022] PUT /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 520 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:35:42.501607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788439f6-fa29-4999-862a-8c6861e426a4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:42.518003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788439f6-fa29-4999-862a-8c6861e426a4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:42.664658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594abb8-0edc-4693-bfce-ab74e5ff7fdd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:42.665583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594abb8-0edc-4693-bfce-ab74e5ff7fdd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:42.667421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594abb8-0edc-4693-bfce-ab74e5ff7fdd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:42.668833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594abb8-0edc-4693-bfce-ab74e5ff7fdd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:42.669888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594abb8-0edc-4693-bfce-ab74e5ff7fdd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Adding query filter params (scope.project.id=78dcc3df4fe74b7fb8a982c4c508d612, user.id=156fac971af3406eb37fac686488b922) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:35:42.676739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594abb8-0edc-4693-bfce-ab74e5ff7fdd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:42.679637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594abb8-0edc-4693-bfce-ab74e5ff7fdd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:42.761780 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:42.787231 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3804/7634] 10.222.0.23 () {58 vars in 1356 bytes} [Sun Oct 2 01:35:42 2022] GET /identity/v3/role_assignments?scope.project.id=78dcc3df4fe74b7fb8a982c4c508d612&user.id=156fac971af3406eb37fac686488b922&effective => generated 1061 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:42.788645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443bf53-059d-403e-b397-0f4f6a5d60ef tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:42.800119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443bf53-059d-403e-b397-0f4f6a5d60ef tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:42.807277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069781d-8feb-4ccf-af8c-d0d3beab59f4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:42.809032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069781d-8feb-4ccf-af8c-d0d3beab59f4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:42.809523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069781d-8feb-4ccf-af8c-d0d3beab59f4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:42.810198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069781d-8feb-4ccf-af8c-d0d3beab59f4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:42.830494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069781d-8feb-4ccf-af8c-d0d3beab59f4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:42.834984 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-d069781d-8feb-4ccf-af8c-d0d3beab59f4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:42.834984 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:42.834984 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:42.838816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069781d-8feb-4ccf-af8c-d0d3beab59f4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:42.867664 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3831/7635] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:42 2022] DELETE /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:42.869028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594abb8-0edc-4693-bfce-ab74e5ff7fdd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:42.880509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594abb8-0edc-4693-bfce-ab74e5ff7fdd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:42.996192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8f02-9591-4e8e-a27f-9594d2d21921 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:42.996702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8f02-9591-4e8e-a27f-9594d2d21921 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:42.997015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8f02-9591-4e8e-a27f-9594d2d21921 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:43.001739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8f02-9591-4e8e-a27f-9594d2d21921 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:43.002725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a8f02-9591-4e8e-a27f-9594d2d21921 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Adding query filter params (scope.project.id=78dcc3df4fe74b7fb8a982c4c508d612, user.id=156fac971af3406eb37fac686488b922) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:35:43.003057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a8f02-9591-4e8e-a27f-9594d2d21921 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:43.007628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a8f02-9591-4e8e-a27f-9594d2d21921 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:43.119206 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3805/7636] 10.222.0.23 () {58 vars in 1356 bytes} [Sun Oct 2 01:35:42 2022] GET /identity/v3/role_assignments?scope.project.id=78dcc3df4fe74b7fb8a982c4c508d612&user.id=156fac971af3406eb37fac686488b922&effective => generated 577 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:43.123047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069781d-8feb-4ccf-af8c-d0d3beab59f4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:43.132958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8f02-9591-4e8e-a27f-9594d2d21921 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:43.136167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9d1a8f02-9591-4e8e-a27f-9594d2d21921 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:43.146568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069781d-8feb-4ccf-af8c-d0d3beab59f4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:43.159079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e4801-238b-4c41-a6dc-a6f309db3bf3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:43.160567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4801-238b-4c41-a6dc-a6f309db3bf3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:43.161094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4801-238b-4c41-a6dc-a6f309db3bf3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:43.161479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4801-238b-4c41-a6dc-a6f309db3bf3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:43.165293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e4801-238b-4c41-a6dc-a6f309db3bf3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:43.172043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e4801-238b-4c41-a6dc-a6f309db3bf3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-678e4801-238b-4c41-a6dc-a6f309db3bf3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] e89ba30d37bb446cb3774b4801ccb08e does not imply a7a1addaeff14d08a7817ba67e312dbb.: keystone.exception.ImpliedRoleNotFound: e89ba30d37bb446cb3774b4801ccb08e does not imply a7a1addaeff14d08a7817ba67e312dbb. Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = query.one() Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._iter().one() Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._only_one_row( Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:35:43.202340 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 02 01:35:43.203534 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 02 01:35:43.204623 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 02 01:35:43.204623 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 02 01:35:43.204623 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 02 01:35:43.204623 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e89ba30d37bb446cb3774b4801ccb08e does not imply a7a1addaeff14d08a7817ba67e312dbb. Oct 02 01:35:43.204623 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:35:43.206965 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3832/7637] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:43 2022] DELETE /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 137 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:35:43.210828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e4801-238b-4c41-a6dc-a6f309db3bf3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:43.233221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e4801-238b-4c41-a6dc-a6f309db3bf3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:43.240143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:43.241063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:43.241474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:43.241818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/e89ba30d37bb446cb3774b4801ccb08e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:43.245625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=78dcc3df4fe74b7fb8a982c4c508d612, user_id=156fac971af3406eb37fac686488b922, role_id=e89ba30d37bb446cb3774b4801ccb08e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:43.249003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:43.255953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role e89ba30d37bb446cb3774b4801ccb08e was removed from user 156fac971af3406eb37fac686488b922 on project 78dcc3df4fe74b7fb8a982c4c508d612. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:43.256416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:43.257334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:43.277566 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3833/7638] 10.222.0.23 () {58 vars in 1467 bytes} [Sun Oct 2 01:35:43 2022] DELETE /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/e89ba30d37bb446cb3774b4801ccb08e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:43.286207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:43.293387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:43.302899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8f02-9591-4e8e-a27f-9594d2d21921 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:43.384495 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:43.400402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c706a-b905-495c-8f7f-03b9477989e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:43.401318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c706a-b905-495c-8f7f-03b9477989e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:43.401702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c706a-b905-495c-8f7f-03b9477989e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:43.402075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c706a-b905-495c-8f7f-03b9477989e1 admin admin] PATH_INFO: `/v3/users/858534b2a0ca4aaa8de34ff8d6f91aee` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:43.403409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c706a-b905-495c-8f7f-03b9477989e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=858534b2a0ca4aaa8de34ff8d6f91aee)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:43.405589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c706a-b905-495c-8f7f-03b9477989e1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:43.427685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fd50b-e016-4968-a40b-aa50172bdef8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:43.432586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f713c-4b05-44d5-b2fa-6de22d0a9451 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:43.433204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f713c-4b05-44d5-b2fa-6de22d0a9451 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:43.433487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f713c-4b05-44d5-b2fa-6de22d0a9451 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:43.433762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f713c-4b05-44d5-b2fa-6de22d0a9451 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:43.434436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f713c-4b05-44d5-b2fa-6de22d0a9451 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:43.444594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f713c-4b05-44d5-b2fa-6de22d0a9451 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:43.481249 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3834/7639] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:35:43 2022] POST /identity/v3/roles => generated 271 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:43.481845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d67c706a-b905-495c-8f7f-03b9477989e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858534b2a0ca4aaa8de34ff8d6f91aee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:43.485407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f713c-4b05-44d5-b2fa-6de22d0a9451 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:43.499706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f713c-4b05-44d5-b2fa-6de22d0a9451 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:43.506440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad6b19-061c-4284-929d-1056ef191ab4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:43.507625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad6b19-061c-4284-929d-1056ef191ab4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:43.509910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d67c706a-b905-495c-8f7f-03b9477989e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858534b2a0ca4aaa8de34ff8d6f91aee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:43.510710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d67c706a-b905-495c-8f7f-03b9477989e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858534b2a0ca4aaa8de34ff8d6f91aee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:43.525208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d67c706a-b905-495c-8f7f-03b9477989e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858534b2a0ca4aaa8de34ff8d6f91aee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:43.535717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d67c706a-b905-495c-8f7f-03b9477989e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858534b2a0ca4aaa8de34ff8d6f91aee'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:43.539073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad6b19-061c-4284-929d-1056ef191ab4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:43.539343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad6b19-061c-4284-929d-1056ef191ab4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:43.540595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad6b19-061c-4284-929d-1056ef191ab4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Adding query filter params (domain_id=c536c12b682448cb8ef96400a70cd912) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:35:43.541063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad6b19-061c-4284-929d-1056ef191ab4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:43.542419 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-02ad6b19-061c-4284-929d-1056ef191ab4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:43.542419 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:43.542419 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:43.543414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad6b19-061c-4284-929d-1056ef191ab4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:43.566646 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3806/7640] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:43 2022] DELETE /identity/v3/users/858534b2a0ca4aaa8de34ff8d6f91aee => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:43.568219 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3835/7641] 10.222.0.23 () {58 vars in 1207 bytes} [Sun Oct 2 01:35:43 2022] GET /identity/v3/roles?domain_id=c536c12b682448cb8ef96400a70cd912 => generated 408 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:35:43.568402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce07628-50cd-49b2-aebf-8fed6351d62a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:43.568722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce07628-50cd-49b2-aebf-8fed6351d62a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:43.569114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce07628-50cd-49b2-aebf-8fed6351d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:43.573189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad6b19-061c-4284-929d-1056ef191ab4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:43.575376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-02ad6b19-061c-4284-929d-1056ef191ab4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:43.624765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad6b19-061c-4284-929d-1056ef191ab4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:43.627605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3ce07628-50cd-49b2-aebf-8fed6351d62a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:43.631193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3ce07628-50cd-49b2-aebf-8fed6351d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:43.762400 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:43.773281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:43.774158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:43.774586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:43.775046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/5cdf409950034aee85620b8a1edf133c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:43.776585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=5cdf409950034aee85620b8a1edf133c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:43.778499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:43.797121 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3807/7642] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:35:43.813796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce07628-50cd-49b2-aebf-8fed6351d62a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:43.815687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3ce07628-50cd-49b2-aebf-8fed6351d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:43.836039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role 5cdf409950034aee85620b8a1edf133c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:43.836342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:43.837070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:43.839752 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3836/7643] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:43 2022] DELETE /identity/v3/roles/5cdf409950034aee85620b8a1edf133c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:43.845199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:43.850165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:43.968272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce07628-50cd-49b2-aebf-8fed6351d62a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:44.020894 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:44.077759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61506f-b9ae-4903-9a54-00d836f1c613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:44.091294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32a51-4de9-484b-b060-a6170ed3e7c0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:44.091457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fc75e-455d-42fb-8b94-c84094f374e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:44.092117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32a51-4de9-484b-b060-a6170ed3e7c0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:44.092539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32a51-4de9-484b-b060-a6170ed3e7c0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:44.092912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32a51-4de9-484b-b060-a6170ed3e7c0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:44.093703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe32a51-4de9-484b-b060-a6170ed3e7c0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Adding query filter params (domain_id=c536c12b682448cb8ef96400a70cd912) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:35:44.094121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe32a51-4de9-484b-b060-a6170ed3e7c0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:44.094805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc75e-455d-42fb-8b94-c84094f374e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:44.095146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc75e-455d-42fb-8b94-c84094f374e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:44.096325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe32a51-4de9-484b-b060-a6170ed3e7c0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:44.099048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc75e-455d-42fb-8b94-c84094f374e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:44.105432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a47fc75e-455d-42fb-8b94-c84094f374e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:44.110674 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3837/7644] 10.222.0.23 () {58 vars in 1207 bytes} [Sun Oct 2 01:35:43 2022] GET /identity/v3/roles?domain_id=c536c12b682448cb8ef96400a70cd912 => generated 148 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:35:44.115602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32a51-4de9-484b-b060-a6170ed3e7c0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:44.138398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32a51-4de9-484b-b060-a6170ed3e7c0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:44.156996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072cb94-1aa3-4faa-8611-b4cdaeedd5cd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:44.157953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072cb94-1aa3-4faa-8611-b4cdaeedd5cd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:44.158332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072cb94-1aa3-4faa-8611-b4cdaeedd5cd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:44.158745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072cb94-1aa3-4faa-8611-b4cdaeedd5cd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/5cdf409950034aee85620b8a1edf133c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:44.215726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072cb94-1aa3-4faa-8611-b4cdaeedd5cd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-3072cb94-1aa3-4faa-8611-b4cdaeedd5cd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Could not find role: 5cdf409950034aee85620b8a1edf133c.: keystone.exception.RoleNotFound: Could not find role: 5cdf409950034aee85620b8a1edf133c. Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 02 01:35:44.230659 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:35:44.231664 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 5cdf409950034aee85620b8a1edf133c. Oct 02 01:35:44.232924 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:35:44.239582 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3838/7645] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:44 2022] DELETE /identity/v3/roles/5cdf409950034aee85620b8a1edf133c => generated 110 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:35:44.245235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072cb94-1aa3-4faa-8611-b4cdaeedd5cd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:44.275111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072cb94-1aa3-4faa-8611-b4cdaeedd5cd tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:44.290122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a84ad-b277-481d-9a23-0cb2b28526e9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:44.293065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a84ad-b277-481d-9a23-0cb2b28526e9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:44.295405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a84ad-b277-481d-9a23-0cb2b28526e9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:44.295821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a84ad-b277-481d-9a23-0cb2b28526e9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/c536c12b682448cb8ef96400a70cd912/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:44.313176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a84ad-b277-481d-9a23-0cb2b28526e9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c536c12b682448cb8ef96400a70cd912, group_id=8972039e07914aca8d6d8d604bfcfb51, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:44.315960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fc75e-455d-42fb-8b94-c84094f374e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:44.317427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fc75e-455d-42fb-8b94-c84094f374e9 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:44.319421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a84ad-b277-481d-9a23-0cb2b28526e9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:44.335551 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3808/7646] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:35:44.390696 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3839/7647] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:44 2022] PUT /identity/v3/domains/c536c12b682448cb8ef96400a70cd912/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:44.395864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fc75e-455d-42fb-8b94-c84094f374e9 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:44.413131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fc75e-455d-42fb-8b94-c84094f374e9 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:44.487787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58ec5d-b9fb-4b5b-b509-9d78bcb2541a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:44.488679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58ec5d-b9fb-4b5b-b509-9d78bcb2541a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:44.489745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58ec5d-b9fb-4b5b-b509-9d78bcb2541a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:44.489745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58ec5d-b9fb-4b5b-b509-9d78bcb2541a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/c536c12b682448cb8ef96400a70cd912/groups/8972039e07914aca8d6d8d604bfcfb51/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:44.492678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58ec5d-b9fb-4b5b-b509-9d78bcb2541a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=c536c12b682448cb8ef96400a70cd912, group_id=8972039e07914aca8d6d8d604bfcfb51)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:44.494181 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-8b58ec5d-b9fb-4b5b-b509-9d78bcb2541a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:44.494181 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:35:44.494181 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:35:44.498906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58ec5d-b9fb-4b5b-b509-9d78bcb2541a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:44.539121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a84ad-b277-481d-9a23-0cb2b28526e9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:44.539675 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3809/7648] 10.222.0.23 () {58 vars in 1365 bytes} [Sun Oct 2 01:35:44 2022] GET /identity/v3/domains/c536c12b682448cb8ef96400a70cd912/groups/8972039e07914aca8d6d8d604bfcfb51/roles => generated 410 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:44.569995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a84ad-b277-481d-9a23-0cb2b28526e9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:44.575984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aaed3-0e7c-4fdd-9d4e-7ec43d8d466f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:44.576669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aaed3-0e7c-4fdd-9d4e-7ec43d8d466f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:44.577007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aaed3-0e7c-4fdd-9d4e-7ec43d8d466f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:44.577345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aaed3-0e7c-4fdd-9d4e-7ec43d8d466f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/c536c12b682448cb8ef96400a70cd912/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:44.581200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66aaed3-0e7c-4fdd-9d4e-7ec43d8d466f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=c536c12b682448cb8ef96400a70cd912, group_id=8972039e07914aca8d6d8d604bfcfb51, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:44.589047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66aaed3-0e7c-4fdd-9d4e-7ec43d8d466f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:44.634688 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3840/7649] 10.222.0.23 () {58 vars in 1465 bytes} [Sun Oct 2 01:35:44 2022] HEAD /identity/v3/domains/c536c12b682448cb8ef96400a70cd912/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:44.636239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58ec5d-b9fb-4b5b-b509-9d78bcb2541a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:44.656116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58ec5d-b9fb-4b5b-b509-9d78bcb2541a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:44.669827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:44.670516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:44.670829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:44.671108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/c536c12b682448cb8ef96400a70cd912/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:44.678225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c536c12b682448cb8ef96400a70cd912, group_id=8972039e07914aca8d6d8d604bfcfb51, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:44.681072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:44.695974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role f664a93eaed5448e9f58f07effc7c3d4 was removed from group 8972039e07914aca8d6d8d604bfcfb51 on domain c536c12b682448cb8ef96400a70cd912. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:44.696275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:44.697242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:44.727758 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3810/7650] 10.222.0.23 () {58 vars in 1467 bytes} [Sun Oct 2 01:35:44 2022] DELETE /identity/v3/domains/c536c12b682448cb8ef96400a70cd912/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:44.733521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aaed3-0e7c-4fdd-9d4e-7ec43d8d466f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:44.735393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d66aaed3-0e7c-4fdd-9d4e-7ec43d8d466f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:44.756028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aaed3-0e7c-4fdd-9d4e-7ec43d8d466f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:44.813127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:44.815230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:44.945085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19db0ce-5e67-4ad8-bfd1-840a4c468754 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:44.945857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19db0ce-5e67-4ad8-bfd1-840a4c468754 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:44.946258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19db0ce-5e67-4ad8-bfd1-840a4c468754 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:44.946465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19db0ce-5e67-4ad8-bfd1-840a4c468754 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:44.950575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19db0ce-5e67-4ad8-bfd1-840a4c468754 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_grant(project_id=78dcc3df4fe74b7fb8a982c4c508d612, group_id=8972039e07914aca8d6d8d604bfcfb51, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:44.957447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19db0ce-5e67-4ad8-bfd1-840a4c468754 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:44.960472 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:44.992813 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3841/7651] 10.222.0.23 () {60 vars in 1486 bytes} [Sun Oct 2 01:35:44 2022] PUT /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:44.996873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19db0ce-5e67-4ad8-bfd1-840a4c468754 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:45.007374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a4726-999e-4f00-8684-e2138e980932 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:45.021250 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:45.189259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19db0ce-5e67-4ad8-bfd1-840a4c468754 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:45.198854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b3042-3a3f-4f5f-a236-63a1932051d5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:45.199554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b3042-3a3f-4f5f-a236-63a1932051d5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:45.199839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b3042-3a3f-4f5f-a236-63a1932051d5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:45.200124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b3042-3a3f-4f5f-a236-63a1932051d5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/groups/8972039e07914aca8d6d8d604bfcfb51/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:45.201953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b3042-3a3f-4f5f-a236-63a1932051d5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_grants(project_id=78dcc3df4fe74b7fb8a982c4c508d612, group_id=8972039e07914aca8d6d8d604bfcfb51)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:45.204955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b3042-3a3f-4f5f-a236-63a1932051d5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:45.222932 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3842/7652] 10.222.0.23 () {58 vars in 1368 bytes} [Sun Oct 2 01:35:44 2022] GET /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/groups/8972039e07914aca8d6d8d604bfcfb51/roles => generated 411 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:35:45.226994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b3042-3a3f-4f5f-a236-63a1932051d5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:45.247438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:45.248172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:45.248566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:45.248952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] PATH_INFO: `/v3/projects/49735b875052451e8714cd9c540b86c9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:45.250471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49735b875052451e8714cd9c540b86c9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:45.252059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b3042-3a3f-4f5f-a236-63a1932051d5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:45.256386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:45.280571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437036e0-6b4d-43f2-a95b-cd3ddc332b06 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:45.281244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437036e0-6b4d-43f2-a95b-cd3ddc332b06 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:45.281530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437036e0-6b4d-43f2-a95b-cd3ddc332b06 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:45.281811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437036e0-6b4d-43f2-a95b-cd3ddc332b06 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/groups/8972039e07914aca8d6d8d604bfcfb51/users/156fac971af3406eb37fac686488b922` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:45.283557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437036e0-6b4d-43f2-a95b-cd3ddc332b06 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8972039e07914aca8d6d8d604bfcfb51, user_id=156fac971af3406eb37fac686488b922)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:45.290470 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-437036e0-6b4d-43f2-a95b-cd3ddc332b06 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:45.290470 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:45.290470 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:45.292584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437036e0-6b4d-43f2-a95b-cd3ddc332b06 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:45.388371 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3843/7653] 10.222.0.23 () {60 vars in 1360 bytes} [Sun Oct 2 01:35:45 2022] PUT /identity/v3/groups/8972039e07914aca8d6d8d604bfcfb51/users/156fac971af3406eb37fac686488b922 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:45.394072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340dc3-b942-4a99-b912-a40f90bcadfc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:45.394452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340dc3-b942-4a99-b912-a40f90bcadfc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:45.394942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340dc3-b942-4a99-b912-a40f90bcadfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:45.403237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49735b875052451e8714cd9c540b86c9', 'request_id': 'req-7fafde4b-9aaa-451c-8f6b-fcb70240310f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:45.430107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49735b875052451e8714cd9c540b86c9', 'request_id': 'req-7fafde4b-9aaa-451c-8f6b-fcb70240310f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:45.448649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49735b875052451e8714cd9c540b86c9', 'request_id': 'req-7fafde4b-9aaa-451c-8f6b-fcb70240310f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:45.474560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] The token cache is being invalidate because project 49735b875052451e8714cd9c540b86c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:45.475337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:45.477823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7fafde4b-9aaa-451c-8f6b-fcb70240310f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:45.489819 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3811/7654] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:35:44 2022] DELETE /identity/v3/projects/49735b875052451e8714cd9c540b86c9 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:45.491738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0845e-8dd5-47e8-911e-2c45a68b2dad None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:45.492030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0845e-8dd5-47e8-911e-2c45a68b2dad None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:45.492308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0845e-8dd5-47e8-911e-2c45a68b2dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:45.517467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7b340dc3-b942-4a99-b912-a40f90bcadfc None None] MFA Rules not processed for user `156fac971af3406eb37fac686488b922`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:45.518731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7b340dc3-b942-4a99-b912-a40f90bcadfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:45.541860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d5d0845e-8dd5-47e8-911e-2c45a68b2dad None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:45.554559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5d0845e-8dd5-47e8-911e-2c45a68b2dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:45.765553 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3812/7655] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:45.773680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273233e-b22f-49c1-b736-bc2a567b3c0b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:45.773941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273233e-b22f-49c1-b736-bc2a567b3c0b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:45.774221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273233e-b22f-49c1-b736-bc2a567b3c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:45.796475 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3844/7656] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:45.811914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b340dc3-b942-4a99-b912-a40f90bcadfc None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:45.819060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7b340dc3-b942-4a99-b912-a40f90bcadfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:45.863455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d273233e-b22f-49c1-b736-bc2a567b3c0b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:45.867426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d273233e-b22f-49c1-b736-bc2a567b3c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:45.898713 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3813/7657] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:35:45.900410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273233e-b22f-49c1-b736-bc2a567b3c0b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:45.927380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273233e-b22f-49c1-b736-bc2a567b3c0b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:45.928943 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:45.949581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3f6ee-4936-4517-b44b-d4bd77cf6c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:45.950392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f6ee-4936-4517-b44b-d4bd77cf6c1b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:45.950799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f6ee-4936-4517-b44b-d4bd77cf6c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:45.951175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f6ee-4936-4517-b44b-d4bd77cf6c1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:45.952043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3f6ee-4936-4517-b44b-d4bd77cf6c1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:35:45.952492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3f6ee-4936-4517-b44b-d4bd77cf6c1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:45.960516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3f6ee-4936-4517-b44b-d4bd77cf6c1b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:45.989799 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3814/7658] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:45.995027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3f6ee-4936-4517-b44b-d4bd77cf6c1b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.011684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3f6ee-4936-4517-b44b-d4bd77cf6c1b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.036616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed6343-5e25-4c7d-9e30-fd544975881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.037361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed6343-5e25-4c7d-9e30-fd544975881f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.038766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed6343-5e25-4c7d-9e30-fd544975881f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.039145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed6343-5e25-4c7d-9e30-fd544975881f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.039899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed6343-5e25-4c7d-9e30-fd544975881f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.049894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed6343-5e25-4c7d-9e30-fd544975881f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.067797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b340dc3-b942-4a99-b912-a40f90bcadfc None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.075326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a419e48-3063-4ac8-be2c-3e97dfe76ea3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.076242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a419e48-3063-4ac8-be2c-3e97dfe76ea3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.076907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a419e48-3063-4ac8-be2c-3e97dfe76ea3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.077345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a419e48-3063-4ac8-be2c-3e97dfe76ea3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.080761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a419e48-3063-4ac8-be2c-3e97dfe76ea3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:check_grant(project_id=78dcc3df4fe74b7fb8a982c4c508d612, group_id=8972039e07914aca8d6d8d604bfcfb51, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.084740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a419e48-3063-4ac8-be2c-3e97dfe76ea3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.092570 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:46.095265 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3845/7659] 10.222.0.23 () {58 vars in 1468 bytes} [Sun Oct 2 01:35:45 2022] HEAD /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:46.099401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a419e48-3063-4ac8-be2c-3e97dfe76ea3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.115372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a419e48-3063-4ac8-be2c-3e97dfe76ea3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.121116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.122308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.122796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.123147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.126089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=78dcc3df4fe74b7fb8a982c4c508d612, group_id=8972039e07914aca8d6d8d604bfcfb51, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.131122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.140996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role f664a93eaed5448e9f58f07effc7c3d4 was removed from group 8972039e07914aca8d6d8d604bfcfb51 on project 78dcc3df4fe74b7fb8a982c4c508d612. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:46.141381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:46.142311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:46.147070 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3815/7660] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:35:45 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:35:46.151152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed6343-5e25-4c7d-9e30-fd544975881f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.154039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-72ed6343-5e25-4c7d-9e30-fd544975881f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:46.172687 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3846/7661] 10.222.0.23 () {58 vars in 1470 bytes} [Sun Oct 2 01:35:46 2022] DELETE /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:46.181618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.183634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:46.319141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed6343-5e25-4c7d-9e30-fd544975881f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.373297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638c742-6164-4857-be0b-2557808e8323 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.397308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be278414-8d46-41d3-9a6e-af587d13ff16 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.398054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278414-8d46-41d3-9a6e-af587d13ff16 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.398446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278414-8d46-41d3-9a6e-af587d13ff16 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.398762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278414-8d46-41d3-9a6e-af587d13ff16 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/groups/8972039e07914aca8d6d8d604bfcfb51/users/156fac971af3406eb37fac686488b922` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.415685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be278414-8d46-41d3-9a6e-af587d13ff16 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8972039e07914aca8d6d8d604bfcfb51, user_id=156fac971af3406eb37fac686488b922)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.417861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be278414-8d46-41d3-9a6e-af587d13ff16 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.438938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-be278414-8d46-41d3-9a6e-af587d13ff16 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '156fac971af3406eb37fac686488b922'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:46.477335 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3847/7662] 10.222.0.23 () {58 vars in 1344 bytes} [Sun Oct 2 01:35:46 2022] DELETE /identity/v3/groups/8972039e07914aca8d6d8d604bfcfb51/users/156fac971af3406eb37fac686488b922 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:46.478571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be278414-8d46-41d3-9a6e-af587d13ff16 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.526129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d144c89-2f62-4355-bbc5-25acc779b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.527294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d144c89-2f62-4355-bbc5-25acc779b65f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.527903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d144c89-2f62-4355-bbc5-25acc779b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.528321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d144c89-2f62-4355-bbc5-25acc779b65f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.529136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d144c89-2f62-4355-bbc5-25acc779b65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.532869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d144c89-2f62-4355-bbc5-25acc779b65f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.581482 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3816/7663] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:35:46 2022] POST /identity/v3/users => generated 289 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:35:46.586943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d144c89-2f62-4355-bbc5-25acc779b65f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.619783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be278414-8d46-41d3-9a6e-af587d13ff16 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.625372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d144c89-2f62-4355-bbc5-25acc779b65f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.630538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c177a-7469-4066-9412-a0a33c0abf22 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.632035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c177a-7469-4066-9412-a0a33c0abf22 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.632676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c177a-7469-4066-9412-a0a33c0abf22 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.633257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c177a-7469-4066-9412-a0a33c0abf22 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/system/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.636009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c177a-7469-4066-9412-a0a33c0abf22 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=8972039e07914aca8d6d8d604bfcfb51, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.637395 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-c20c177a-7469-4066-9412-a0a33c0abf22 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:46.637395 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:46.637395 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:46.639149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c177a-7469-4066-9412-a0a33c0abf22 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.665669 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3848/7664] 10.222.0.23 () {60 vars in 1381 bytes} [Sun Oct 2 01:35:46 2022] PUT /identity/v3/system/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:46.669856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c177a-7469-4066-9412-a0a33c0abf22 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.685345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c177a-7469-4066-9412-a0a33c0abf22 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.692305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad158826-9535-4350-9308-b2991120f3d0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.693280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad158826-9535-4350-9308-b2991120f3d0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.693741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad158826-9535-4350-9308-b2991120f3d0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.694122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad158826-9535-4350-9308-b2991120f3d0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/system/groups/8972039e07914aca8d6d8d604bfcfb51/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.695797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad158826-9535-4350-9308-b2991120f3d0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=8972039e07914aca8d6d8d604bfcfb51)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.697617 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-ad158826-9535-4350-9308-b2991120f3d0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:46.697617 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:46.697617 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:46.699077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad158826-9535-4350-9308-b2991120f3d0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.718271 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3849/7665] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 2 01:35:46 2022] GET /identity/v3/system/groups/8972039e07914aca8d6d8d604bfcfb51/roles => generated 376 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:46.723370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad158826-9535-4350-9308-b2991120f3d0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.736523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad158826-9535-4350-9308-b2991120f3d0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.741822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de509fcf-7348-45a0-9303-1f42260589e3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.743333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de509fcf-7348-45a0-9303-1f42260589e3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.743710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de509fcf-7348-45a0-9303-1f42260589e3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.744057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de509fcf-7348-45a0-9303-1f42260589e3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/system/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.745925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de509fcf-7348-45a0-9303-1f42260589e3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=8972039e07914aca8d6d8d604bfcfb51, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.747047 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-de509fcf-7348-45a0-9303-1f42260589e3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:46.747047 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:46.747047 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:46.748340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de509fcf-7348-45a0-9303-1f42260589e3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.759726 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3850/7666] 10.222.0.23 () {58 vars in 1363 bytes} [Sun Oct 2 01:35:46 2022] HEAD /identity/v3/system/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:46.760773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de509fcf-7348-45a0-9303-1f42260589e3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.768328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80400488-0317-45bf-8e7b-3b2e1d0ebe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.769204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80400488-0317-45bf-8e7b-3b2e1d0ebe03 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.770280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80400488-0317-45bf-8e7b-3b2e1d0ebe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.770665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80400488-0317-45bf-8e7b-3b2e1d0ebe03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.771399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80400488-0317-45bf-8e7b-3b2e1d0ebe03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.772631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de509fcf-7348-45a0-9303-1f42260589e3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.773255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80400488-0317-45bf-8e7b-3b2e1d0ebe03 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.778210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163d1bf-b844-4fec-bdab-c7834fb2effb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.779180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163d1bf-b844-4fec-bdab-c7834fb2effb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.779693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163d1bf-b844-4fec-bdab-c7834fb2effb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.780182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163d1bf-b844-4fec-bdab-c7834fb2effb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/system/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.782172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163d1bf-b844-4fec-bdab-c7834fb2effb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=8972039e07914aca8d6d8d604bfcfb51, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.783515 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-d163d1bf-b844-4fec-bdab-c7834fb2effb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:46.783515 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:46.783515 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:46.785060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163d1bf-b844-4fec-bdab-c7834fb2effb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.801161 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3851/7667] 10.222.0.23 () {58 vars in 1365 bytes} [Sun Oct 2 01:35:46 2022] DELETE /identity/v3/system/groups/8972039e07914aca8d6d8d604bfcfb51/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:46.809295 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3817/7668] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:46 2022] GET /identity/v3/roles => generated 2322 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:46.809621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163d1bf-b844-4fec-bdab-c7834fb2effb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.810401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80400488-0317-45bf-8e7b-3b2e1d0ebe03 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.824902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80400488-0317-45bf-8e7b-3b2e1d0ebe03 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.831371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1778e7-6231-4289-b059-4efd2194d7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.832150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1778e7-6231-4289-b059-4efd2194d7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.832535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1778e7-6231-4289-b059-4efd2194d7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.832918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1778e7-6231-4289-b059-4efd2194d7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.833132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163d1bf-b844-4fec-bdab-c7834fb2effb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.833766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1778e7-6231-4289-b059-4efd2194d7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.835626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1778e7-6231-4289-b059-4efd2194d7a3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.846257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aba13-884c-4e03-86fa-dcda0e35c0ce tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.847758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aba13-884c-4e03-86fa-dcda0e35c0ce tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.848495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aba13-884c-4e03-86fa-dcda0e35c0ce tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.848790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aba13-884c-4e03-86fa-dcda0e35c0ce tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/c536c12b682448cb8ef96400a70cd912/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.855608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228aba13-884c-4e03-86fa-dcda0e35c0ce tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c536c12b682448cb8ef96400a70cd912, user_id=156fac971af3406eb37fac686488b922, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.857221 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3818/7669] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:46 2022] GET /identity/v3/roles => generated 2322 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:46.858198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1778e7-6231-4289-b059-4efd2194d7a3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.863353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228aba13-884c-4e03-86fa-dcda0e35c0ce tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.873677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1778e7-6231-4289-b059-4efd2194d7a3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:46.882673 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:46.890207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65944071-b1ad-4152-840f-a80c289e8c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:46.894671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65944071-b1ad-4152-840f-a80c289e8c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.894842 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3852/7670] 10.222.0.23 () {60 vars in 1480 bytes} [Sun Oct 2 01:35:46 2022] PUT /identity/v3/domains/c536c12b682448cb8ef96400a70cd912/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:46.894952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65944071-b1ad-4152-840f-a80c289e8c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.894952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65944071-b1ad-4152-840f-a80c289e8c90 admin admin] PATH_INFO: `/v3/projects/c954629e3886445399259f775f3ecdc4/users/f6110809508e45c8b6c771c6ac8c49b7/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:46.896274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aba13-884c-4e03-86fa-dcda0e35c0ce tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:46.917294 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:46.930840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65944071-b1ad-4152-840f-a80c289e8c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c954629e3886445399259f775f3ecdc4, user_id=f6110809508e45c8b6c771c6ac8c49b7, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:46.934936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65944071-b1ad-4152-840f-a80c289e8c90 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:46.988386 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3819/7671] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:46 2022] PUT /identity/v3/projects/c954629e3886445399259f775f3ecdc4/users/f6110809508e45c8b6c771c6ac8c49b7/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:46.989984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a8c25-c92b-4c7d-9f8a-871a922427ea None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:46.995115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a8c25-c92b-4c7d-9f8a-871a922427ea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:46.995518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a8c25-c92b-4c7d-9f8a-871a922427ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:47.032727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aba13-884c-4e03-86fa-dcda0e35c0ce tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:47.057372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-377a8c25-c92b-4c7d-9f8a-871a922427ea None None] MFA Rules not processed for user `f6110809508e45c8b6c771c6ac8c49b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:47.058534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-377a8c25-c92b-4c7d-9f8a-871a922427ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:47.209667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7e60-dd58-45a4-8749-32d21de90acf tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:47.210351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7e60-dd58-45a4-8749-32d21de90acf tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:47.210661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7e60-dd58-45a4-8749-32d21de90acf tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:47.210943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7e60-dd58-45a4-8749-32d21de90acf tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/c536c12b682448cb8ef96400a70cd912/users/156fac971af3406eb37fac686488b922/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:47.212666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a7e60-dd58-45a4-8749-32d21de90acf tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=c536c12b682448cb8ef96400a70cd912, user_id=156fac971af3406eb37fac686488b922)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:47.215292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a7e60-dd58-45a4-8749-32d21de90acf tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:47.231304 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3820/7672] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:47.242815 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3853/7673] 10.222.0.23 () {58 vars in 1362 bytes} [Sun Oct 2 01:35:46 2022] GET /identity/v3/domains/c536c12b682448cb8ef96400a70cd912/users/156fac971af3406eb37fac686488b922/roles => generated 409 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:35:47.244097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a8c25-c92b-4c7d-9f8a-871a922427ea None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:47.257250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7e60-dd58-45a4-8749-32d21de90acf tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:47.258906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a8c25-c92b-4c7d-9f8a-871a922427ea None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:47.259036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8e9a7e60-dd58-45a4-8749-32d21de90acf tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:47.266413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9701-0dfd-468e-8985-f94eb80c32b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:47.266800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9701-0dfd-468e-8985-f94eb80c32b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:47.267094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9701-0dfd-468e-8985-f94eb80c32b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:47.267375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9701-0dfd-468e-8985-f94eb80c32b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/c536c12b682448cb8ef96400a70cd912/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:47.272271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd9701-0dfd-468e-8985-f94eb80c32b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=c536c12b682448cb8ef96400a70cd912, user_id=156fac971af3406eb37fac686488b922, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:47.275759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd9701-0dfd-468e-8985-f94eb80c32b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:47.289549 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3821/7674] 10.222.0.23 () {58 vars in 1462 bytes} [Sun Oct 2 01:35:47 2022] HEAD /identity/v3/domains/c536c12b682448cb8ef96400a70cd912/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:47.290778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9701-0dfd-468e-8985-f94eb80c32b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:47.324653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9701-0dfd-468e-8985-f94eb80c32b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:47.335133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:47.336284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:47.336714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:47.337094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/c536c12b682448cb8ef96400a70cd912/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:47.340029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c536c12b682448cb8ef96400a70cd912, user_id=156fac971af3406eb37fac686488b922, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:47.344954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:47.357733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role f664a93eaed5448e9f58f07effc7c3d4 was removed from user 156fac971af3406eb37fac686488b922 on domain c536c12b682448cb8ef96400a70cd912. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:47.358145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:47.359263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:47.393262 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3822/7675] 10.222.0.23 () {58 vars in 1464 bytes} [Sun Oct 2 01:35:47 2022] DELETE /identity/v3/domains/c536c12b682448cb8ef96400a70cd912/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:47.396607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:47.398181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:47.413732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7e60-dd58-45a4-8749-32d21de90acf tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:47.548187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65547004-bcd9-4f68-9aa3-d7f9e029cf33 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:47.557910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86e425-100d-400c-9ae0-d9721854dad1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:47.558749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86e425-100d-400c-9ae0-d9721854dad1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:47.559042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86e425-100d-400c-9ae0-d9721854dad1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:47.559328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86e425-100d-400c-9ae0-d9721854dad1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:47.561992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86e425-100d-400c-9ae0-d9721854dad1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_grant(project_id=78dcc3df4fe74b7fb8a982c4c508d612, user_id=156fac971af3406eb37fac686488b922, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:47.565066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78c22-54db-4c30-8151-67d292884576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:47.566310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78c22-54db-4c30-8151-67d292884576 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:47.566589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78c22-54db-4c30-8151-67d292884576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:47.566887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78c22-54db-4c30-8151-67d292884576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:47.568835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86e425-100d-400c-9ae0-d9721854dad1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:47.576183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dbe78c22-54db-4c30-8151-67d292884576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:47.595328 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3823/7676] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:35:47 2022] PUT /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:47.601630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86e425-100d-400c-9ae0-d9721854dad1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:47.604944 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:47.702133 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:47.736785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe78c22-54db-4c30-8151-67d292884576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:47.740046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe78c22-54db-4c30-8151-67d292884576 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:47.745225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86e425-100d-400c-9ae0-d9721854dad1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:47.751819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62230e6-9f80-4f2e-8805-996b384883b2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:47.752509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62230e6-9f80-4f2e-8805-996b384883b2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:47.753070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62230e6-9f80-4f2e-8805-996b384883b2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:47.765384 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3854/7677] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:35:47.765825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62230e6-9f80-4f2e-8805-996b384883b2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:47.767782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62230e6-9f80-4f2e-8805-996b384883b2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_grants(project_id=78dcc3df4fe74b7fb8a982c4c508d612, user_id=156fac971af3406eb37fac686488b922)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:47.771218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62230e6-9f80-4f2e-8805-996b384883b2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:47.795060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78c22-54db-4c30-8151-67d292884576 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:47.806810 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3824/7678] 10.222.0.23 () {58 vars in 1365 bytes} [Sun Oct 2 01:35:47 2022] GET /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles => generated 410 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:47.808632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78c22-54db-4c30-8151-67d292884576 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:47.814296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d939ca7-7aed-4a53-90e6-e98d19cf7f81 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:47.815300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939ca7-7aed-4a53-90e6-e98d19cf7f81 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:47.815858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939ca7-7aed-4a53-90e6-e98d19cf7f81 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:47.816198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939ca7-7aed-4a53-90e6-e98d19cf7f81 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:47.818585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d939ca7-7aed-4a53-90e6-e98d19cf7f81 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:check_grant(project_id=78dcc3df4fe74b7fb8a982c4c508d612, user_id=156fac971af3406eb37fac686488b922, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:47.822070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d939ca7-7aed-4a53-90e6-e98d19cf7f81 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:47.836353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62230e6-9f80-4f2e-8805-996b384883b2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:47.860285 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3855/7679] 10.222.0.23 () {58 vars in 1465 bytes} [Sun Oct 2 01:35:47 2022] HEAD /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:47.863604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62230e6-9f80-4f2e-8805-996b384883b2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:47.883582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37957867-6068-4ed2-a0bb-f5961c81889b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:47.884286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957867-6068-4ed2-a0bb-f5961c81889b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:47.884539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957867-6068-4ed2-a0bb-f5961c81889b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:47.884878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957867-6068-4ed2-a0bb-f5961c81889b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:47.889785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37957867-6068-4ed2-a0bb-f5961c81889b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=78dcc3df4fe74b7fb8a982c4c508d612, user_id=156fac971af3406eb37fac686488b922, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:47.899543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37957867-6068-4ed2-a0bb-f5961c81889b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:47.914410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37957867-6068-4ed2-a0bb-f5961c81889b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role f664a93eaed5448e9f58f07effc7c3d4 was removed from user 156fac971af3406eb37fac686488b922 on project 78dcc3df4fe74b7fb8a982c4c508d612. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:47.914739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37957867-6068-4ed2-a0bb-f5961c81889b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:47.918716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37957867-6068-4ed2-a0bb-f5961c81889b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:47.954220 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3825/7680] 10.222.0.23 () {58 vars in 1467 bytes} [Sun Oct 2 01:35:47 2022] DELETE /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:47.954638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d939ca7-7aed-4a53-90e6-e98d19cf7f81 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:47.964416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2d939ca7-7aed-4a53-90e6-e98d19cf7f81 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:48.017435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d939ca7-7aed-4a53-90e6-e98d19cf7f81 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:48.192389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79270e63-b36b-42fa-a12e-44b947a32999 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:48.195684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79270e63-b36b-42fa-a12e-44b947a32999 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:48.197154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79270e63-b36b-42fa-a12e-44b947a32999 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:48.197561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79270e63-b36b-42fa-a12e-44b947a32999 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/system/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:48.204127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79270e63-b36b-42fa-a12e-44b947a32999 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=156fac971af3406eb37fac686488b922, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:48.207302 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-79270e63-b36b-42fa-a12e-44b947a32999 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:48.207302 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:48.207302 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:48.209594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79270e63-b36b-42fa-a12e-44b947a32999 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:48.237795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37957867-6068-4ed2-a0bb-f5961c81889b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:48.238043 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3856/7681] 10.222.0.23 () {60 vars in 1378 bytes} [Sun Oct 2 01:35:47 2022] PUT /identity/v3/system/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:48.256805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37957867-6068-4ed2-a0bb-f5961c81889b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:48.272523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b56c8-7c59-4a73-8a62-89909d5aecb9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:48.274828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b56c8-7c59-4a73-8a62-89909d5aecb9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:48.275260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b56c8-7c59-4a73-8a62-89909d5aecb9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:48.275591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b56c8-7c59-4a73-8a62-89909d5aecb9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/system/users/156fac971af3406eb37fac686488b922/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:48.278296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b56c8-7c59-4a73-8a62-89909d5aecb9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=156fac971af3406eb37fac686488b922)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:48.282161 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-629b56c8-7c59-4a73-8a62-89909d5aecb9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:48.282161 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:35:48.282161 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:35:48.291053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b56c8-7c59-4a73-8a62-89909d5aecb9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:48.327239 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3826/7682] 10.222.0.23 () {58 vars in 1260 bytes} [Sun Oct 2 01:35:48 2022] GET /identity/v3/system/users/156fac971af3406eb37fac686488b922/roles => generated 375 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:48.339175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79270e63-b36b-42fa-a12e-44b947a32999 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:48.365094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79270e63-b36b-42fa-a12e-44b947a32999 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:48.387358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd204-4601-4c89-a336-0c99594c8eab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:48.387712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd204-4601-4c89-a336-0c99594c8eab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:48.387970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd204-4601-4c89-a336-0c99594c8eab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:48.388251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd204-4601-4c89-a336-0c99594c8eab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/system/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:48.390353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cd204-4601-4c89-a336-0c99594c8eab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=156fac971af3406eb37fac686488b922, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:48.391460 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-696cd204-4601-4c89-a336-0c99594c8eab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:48.391460 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:48.391460 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:48.392566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cd204-4601-4c89-a336-0c99594c8eab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:48.447450 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3857/7683] 10.222.0.23 () {58 vars in 1360 bytes} [Sun Oct 2 01:35:48 2022] HEAD /identity/v3/system/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:48.451905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b56c8-7c59-4a73-8a62-89909d5aecb9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:48.468885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b56c8-7c59-4a73-8a62-89909d5aecb9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:48.482891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bb486-464f-4d24-ac02-238e9f9146fe tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:48.483954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb486-464f-4d24-ac02-238e9f9146fe tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:48.484448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb486-464f-4d24-ac02-238e9f9146fe tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:48.484935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb486-464f-4d24-ac02-238e9f9146fe tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/system/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:48.486944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bb486-464f-4d24-ac02-238e9f9146fe tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=156fac971af3406eb37fac686488b922, role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:48.489693 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-532bb486-464f-4d24-ac02-238e9f9146fe tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:48.489693 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:35:48.489693 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:35:48.493437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bb486-464f-4d24-ac02-238e9f9146fe tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:48.514384 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3827/7684] 10.222.0.23 () {58 vars in 1362 bytes} [Sun Oct 2 01:35:48 2022] DELETE /identity/v3/system/users/156fac971af3406eb37fac686488b922/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:48.522971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd204-4601-4c89-a336-0c99594c8eab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:48.539220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd204-4601-4c89-a336-0c99594c8eab tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:48.546632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58532e31-de16-4d77-93e7-cf2830e88671 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:48.561824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58532e31-de16-4d77-93e7-cf2830e88671 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:48.562398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58532e31-de16-4d77-93e7-cf2830e88671 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:48.562790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58532e31-de16-4d77-93e7-cf2830e88671 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:48.564269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58532e31-de16-4d77-93e7-cf2830e88671 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:48.571292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58532e31-de16-4d77-93e7-cf2830e88671 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:48.600087 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3858/7685] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:35:48 2022] POST /identity/v3/roles => generated 269 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:48.605029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bb486-464f-4d24-ac02-238e9f9146fe tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:48.619632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bb486-464f-4d24-ac02-238e9f9146fe tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:48.634864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7659937-c6ee-4a5d-a6f7-62860a1f6ae9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:48.638324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7659937-c6ee-4a5d-a6f7-62860a1f6ae9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:48.638690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7659937-c6ee-4a5d-a6f7-62860a1f6ae9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:48.639168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7659937-c6ee-4a5d-a6f7-62860a1f6ae9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:48.639904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7659937-c6ee-4a5d-a6f7-62860a1f6ae9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:48.640960 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-b7659937-c6ee-4a5d-a6f7-62860a1f6ae9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:48.640960 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:35:48.640960 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:35:48.645557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7659937-c6ee-4a5d-a6f7-62860a1f6ae9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:48.681237 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3828/7686] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:35:48 2022] POST /identity/v3/roles => generated 269 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:48.686651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58532e31-de16-4d77-93e7-cf2830e88671 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:48.700654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58532e31-de16-4d77-93e7-cf2830e88671 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:48.720418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb5c5-dfa0-43e9-8c8f-c382db539762 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:48.721248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb5c5-dfa0-43e9-8c8f-c382db539762 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:48.722492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb5c5-dfa0-43e9-8c8f-c382db539762 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:48.724933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb5c5-dfa0-43e9-8c8f-c382db539762 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/309868ebee314680931f790b1c331cd2/implies/4fbf2fbf58984239ba1d80329542b5f4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:48.726909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fb5c5-dfa0-43e9-8c8f-c382db539762 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=309868ebee314680931f790b1c331cd2, implied_role_id=4fbf2fbf58984239ba1d80329542b5f4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:48.733541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fb5c5-dfa0-43e9-8c8f-c382db539762 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:48.858947 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3859/7687] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:48 2022] PUT /identity/v3/roles/309868ebee314680931f790b1c331cd2/implies/4fbf2fbf58984239ba1d80329542b5f4 => generated 529 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:48.863736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7659937-c6ee-4a5d-a6f7-62860a1f6ae9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:48.877548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7659937-c6ee-4a5d-a6f7-62860a1f6ae9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:49.004653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c353de-774e-4f3c-9537-27b51944f89d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:49.005915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c353de-774e-4f3c-9537-27b51944f89d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:49.006203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c353de-774e-4f3c-9537-27b51944f89d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:49.008830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c353de-774e-4f3c-9537-27b51944f89d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:49.010630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c353de-774e-4f3c-9537-27b51944f89d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:49.015909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c353de-774e-4f3c-9537-27b51944f89d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:49.079816 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3829/7688] 10.222.0.23 () {60 vars in 1149 bytes} [Sun Oct 2 01:35:48 2022] POST /identity/v3/domains => generated 276 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:49.081110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb5c5-dfa0-43e9-8c8f-c382db539762 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:49.097123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb5c5-dfa0-43e9-8c8f-c382db539762 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:49.187032 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:49.220079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e740f0-0c1e-4095-985a-d5419d9a65f2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:49.223300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e740f0-0c1e-4095-985a-d5419d9a65f2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:49.223661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e740f0-0c1e-4095-985a-d5419d9a65f2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:49.224135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e740f0-0c1e-4095-985a-d5419d9a65f2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:49.226182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e740f0-0c1e-4095-985a-d5419d9a65f2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:49.229492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e740f0-0c1e-4095-985a-d5419d9a65f2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:49.288639 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3860/7689] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:35:49 2022] POST /identity/v3/roles => generated 269 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:35:49.293877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c353de-774e-4f3c-9537-27b51944f89d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:49.309441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c353de-774e-4f3c-9537-27b51944f89d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:49.359519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494e8c3-adf6-4db4-b295-06d6e392b7a8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:49.361388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494e8c3-adf6-4db4-b295-06d6e392b7a8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:49.363899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494e8c3-adf6-4db4-b295-06d6e392b7a8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:49.367614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494e8c3-adf6-4db4-b295-06d6e392b7a8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/309868ebee314680931f790b1c331cd2/implies/bdfc8367474a4679bed528e89317b5c0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:49.386417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494e8c3-adf6-4db4-b295-06d6e392b7a8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=309868ebee314680931f790b1c331cd2, implied_role_id=bdfc8367474a4679bed528e89317b5c0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:49.390032 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-a494e8c3-adf6-4db4-b295-06d6e392b7a8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:49.390032 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:35:49.390032 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:35:49.391892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494e8c3-adf6-4db4-b295-06d6e392b7a8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:49.467937 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3830/7690] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:49 2022] PUT /identity/v3/roles/309868ebee314680931f790b1c331cd2/implies/bdfc8367474a4679bed528e89317b5c0 => generated 529 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:49.471742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e740f0-0c1e-4095-985a-d5419d9a65f2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:49.489142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e740f0-0c1e-4095-985a-d5419d9a65f2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:49.571471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917bae-6a34-49c1-9758-daea773747f0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:49.572183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917bae-6a34-49c1-9758-daea773747f0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:49.572617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917bae-6a34-49c1-9758-daea773747f0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:49.572903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917bae-6a34-49c1-9758-daea773747f0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/309868ebee314680931f790b1c331cd2/implies/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:49.574936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917bae-6a34-49c1-9758-daea773747f0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=309868ebee314680931f790b1c331cd2, implied_role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:49.576741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917bae-6a34-49c1-9758-daea773747f0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:49.612355 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3861/7691] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:49 2022] PUT /identity/v3/roles/309868ebee314680931f790b1c331cd2/implies/f664a93eaed5448e9f58f07effc7c3d4 => generated 525 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:49.615930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494e8c3-adf6-4db4-b295-06d6e392b7a8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:49.660420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494e8c3-adf6-4db4-b295-06d6e392b7a8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:49.739031 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:49.758826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96977e8-e04d-4662-be56-e6718facb132 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:49.759654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96977e8-e04d-4662-be56-e6718facb132 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:49.760078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96977e8-e04d-4662-be56-e6718facb132 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:49.760365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96977e8-e04d-4662-be56-e6718facb132 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/f664a93eaed5448e9f58f07effc7c3d4/implies/309868ebee314680931f790b1c331cd2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:49.762966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96977e8-e04d-4662-be56-e6718facb132 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f664a93eaed5448e9f58f07effc7c3d4, implied_role_id=309868ebee314680931f790b1c331cd2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:49.764993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96977e8-e04d-4662-be56-e6718facb132 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d96977e8-e04d-4662-be56-e6718facb132 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] 309868ebee314680931f790b1c331cd2 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 309868ebee314680931f790b1c331cd2 cannot be an implied roles. Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 02 01:35:49.789098 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 02 01:35:49.790131 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:35:49.790131 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:35:49.790131 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 02 01:35:49.790131 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 02 01:35:49.790131 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 309868ebee314680931f790b1c331cd2 cannot be an implied roles. Oct 02 01:35:49.790131 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:35:49.794021 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3831/7692] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:49 2022] PUT /identity/v3/roles/f664a93eaed5448e9f58f07effc7c3d4/implies/309868ebee314680931f790b1c331cd2 => generated 116 bytes in 178 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:35:49.795946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917bae-6a34-49c1-9758-daea773747f0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:49.818735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917bae-6a34-49c1-9758-daea773747f0 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:49.826527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a94b3-461f-4e6f-8287-5181311e3bf9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:49.827453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a94b3-461f-4e6f-8287-5181311e3bf9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:49.827691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a94b3-461f-4e6f-8287-5181311e3bf9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:49.829854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a94b3-461f-4e6f-8287-5181311e3bf9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/309868ebee314680931f790b1c331cd2/implies/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:49.832036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a94b3-461f-4e6f-8287-5181311e3bf9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=309868ebee314680931f790b1c331cd2, implied_role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:49.835608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a94b3-461f-4e6f-8287-5181311e3bf9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:49.849492 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3862/7693] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:49 2022] DELETE /identity/v3/roles/309868ebee314680931f790b1c331cd2/implies/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:49.853429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96977e8-e04d-4662-be56-e6718facb132 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:49.867700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96977e8-e04d-4662-be56-e6718facb132 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:50.002559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a0efc-d4c6-4c1c-9f2b-a1fa7a4fbec4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:50.003702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a0efc-d4c6-4c1c-9f2b-a1fa7a4fbec4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:50.004253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a0efc-d4c6-4c1c-9f2b-a1fa7a4fbec4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:50.004810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a0efc-d4c6-4c1c-9f2b-a1fa7a4fbec4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/309868ebee314680931f790b1c331cd2/implies/bdfc8367474a4679bed528e89317b5c0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:50.007061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a0efc-d4c6-4c1c-9f2b-a1fa7a4fbec4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=309868ebee314680931f790b1c331cd2, implied_role_id=bdfc8367474a4679bed528e89317b5c0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:50.009033 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-9d7a0efc-d4c6-4c1c-9f2b-a1fa7a4fbec4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:50.009033 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:35:50.009033 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:35:50.010212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a0efc-d4c6-4c1c-9f2b-a1fa7a4fbec4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:50.025610 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3832/7694] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:49 2022] DELETE /identity/v3/roles/309868ebee314680931f790b1c331cd2/implies/bdfc8367474a4679bed528e89317b5c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:50.029436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a94b3-461f-4e6f-8287-5181311e3bf9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:50.046845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a94b3-461f-4e6f-8287-5181311e3bf9 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:50.140327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361eb8e-e7a6-4e13-b0c8-b1ddff4b137c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:50.140985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361eb8e-e7a6-4e13-b0c8-b1ddff4b137c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:50.141266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361eb8e-e7a6-4e13-b0c8-b1ddff4b137c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:50.141604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361eb8e-e7a6-4e13-b0c8-b1ddff4b137c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/bdfc8367474a4679bed528e89317b5c0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:50.143180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361eb8e-e7a6-4e13-b0c8-b1ddff4b137c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=bdfc8367474a4679bed528e89317b5c0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:50.146227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361eb8e-e7a6-4e13-b0c8-b1ddff4b137c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:50.196916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f361eb8e-e7a6-4e13-b0c8-b1ddff4b137c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role bdfc8367474a4679bed528e89317b5c0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:50.197391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f361eb8e-e7a6-4e13-b0c8-b1ddff4b137c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.198455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f361eb8e-e7a6-4e13-b0c8-b1ddff4b137c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.204139 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3863/7695] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:50 2022] DELETE /identity/v3/roles/bdfc8367474a4679bed528e89317b5c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:50.206515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a0efc-d4c6-4c1c-9f2b-a1fa7a4fbec4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:50.208563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9d7a0efc-d4c6-4c1c-9f2b-a1fa7a4fbec4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:50.224706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a0efc-d4c6-4c1c-9f2b-a1fa7a4fbec4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:50.296825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:50.297856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:50.298217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:50.298761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/fef51062c3c74401833ef8f308361c5c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:50.311991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fef51062c3c74401833ef8f308361c5c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:50.313781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:50.341391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fef51062c3c74401833ef8f308361c5c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.342130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fef51062c3c74401833ef8f308361c5c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.384767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fef51062c3c74401833ef8f308361c5c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.386446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fef51062c3c74401833ef8f308361c5c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.395511 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3833/7696] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:35:50 2022] PATCH /identity/v3/domains/fef51062c3c74401833ef8f308361c5c => generated 277 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:50.397439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361eb8e-e7a6-4e13-b0c8-b1ddff4b137c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:50.410867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361eb8e-e7a6-4e13-b0c8-b1ddff4b137c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:50.462350 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:50.551408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:50.552285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:50.552466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:50.552748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/fef51062c3c74401833ef8f308361c5c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:50.579180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fef51062c3c74401833ef8f308361c5c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:50.582643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:50.625176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fef51062c3c74401833ef8f308361c5c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.632947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fef51062c3c74401833ef8f308361c5c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.742446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef51062c3c74401833ef8f308361c5c', 'request_id': 'req-a207f5b5-3944-477f-88f2-98b677bbe3f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.750197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef51062c3c74401833ef8f308361c5c', 'request_id': 'req-a207f5b5-3944-477f-88f2-98b677bbe3f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.759724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef51062c3c74401833ef8f308361c5c', 'request_id': 'req-a207f5b5-3944-477f-88f2-98b677bbe3f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.798441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] The token cache is being invalidate because project fef51062c3c74401833ef8f308361c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:50.799412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.805673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.841179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fef51062c3c74401833ef8f308361c5c', 'request_id': 'req-a207f5b5-3944-477f-88f2-98b677bbe3f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.848222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fef51062c3c74401833ef8f308361c5c', 'request_id': 'req-a207f5b5-3944-477f-88f2-98b677bbe3f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.851952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fef51062c3c74401833ef8f308361c5c', 'request_id': 'req-a207f5b5-3944-477f-88f2-98b677bbe3f5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:50.866729 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3864/7697] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:35:50 2022] DELETE /identity/v3/domains/fef51062c3c74401833ef8f308361c5c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:50.870857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:50.872457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:50.888497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4235336-22f6-49fe-8c0e-9c68677f7837 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:50.956928 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:51.011669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271344bc-f25c-4077-ad0b-0f0825a27533 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:51.013195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271344bc-f25c-4077-ad0b-0f0825a27533 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:51.013664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271344bc-f25c-4077-ad0b-0f0825a27533 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:51.014035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271344bc-f25c-4077-ad0b-0f0825a27533 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/309868ebee314680931f790b1c331cd2/implies/4fbf2fbf58984239ba1d80329542b5f4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:51.017331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271344bc-f25c-4077-ad0b-0f0825a27533 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=309868ebee314680931f790b1c331cd2, implied_role_id=4fbf2fbf58984239ba1d80329542b5f4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:51.019923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271344bc-f25c-4077-ad0b-0f0825a27533 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:51.043519 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3834/7698] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:50 2022] DELETE /identity/v3/roles/309868ebee314680931f790b1c331cd2/implies/4fbf2fbf58984239ba1d80329542b5f4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:51.044764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:51.050229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:51.070152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207f5b5-3944-477f-88f2-98b677bbe3f5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:51.227776 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:51.237945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d90a47-14c7-40ae-b6f5-820788b0f7de tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:51.239831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d90a47-14c7-40ae-b6f5-820788b0f7de tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:51.240334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d90a47-14c7-40ae-b6f5-820788b0f7de tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:51.241646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d90a47-14c7-40ae-b6f5-820788b0f7de tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/4fbf2fbf58984239ba1d80329542b5f4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:51.243887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d90a47-14c7-40ae-b6f5-820788b0f7de tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=4fbf2fbf58984239ba1d80329542b5f4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:51.245848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d90a47-14c7-40ae-b6f5-820788b0f7de tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:51.327633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-94d90a47-14c7-40ae-b6f5-820788b0f7de tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role 4fbf2fbf58984239ba1d80329542b5f4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:51.327971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-94d90a47-14c7-40ae-b6f5-820788b0f7de tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:51.330888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-94d90a47-14c7-40ae-b6f5-820788b0f7de tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:51.337205 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3865/7699] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:51 2022] DELETE /identity/v3/roles/4fbf2fbf58984239ba1d80329542b5f4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:51.338429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271344bc-f25c-4077-ad0b-0f0825a27533 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:51.340686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-271344bc-f25c-4077-ad0b-0f0825a27533 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:51.367350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271344bc-f25c-4077-ad0b-0f0825a27533 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:51.501876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:51.504755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:51.505263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:51.505898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/309868ebee314680931f790b1c331cd2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:51.509231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=309868ebee314680931f790b1c331cd2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:51.510880 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:51.510880 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:35:51.510880 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:35:51.513534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:51.595015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role 309868ebee314680931f790b1c331cd2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:51.595349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:51.597349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:51.605192 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3835/7700] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:51 2022] DELETE /identity/v3/roles/309868ebee314680931f790b1c331cd2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:51.610240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d90a47-14c7-40ae-b6f5-820788b0f7de tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:51.630782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d90a47-14c7-40ae-b6f5-820788b0f7de tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:51.752337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31ba0c-fabb-40b2-b372-d8df9cc13f50 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:51.756125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31ba0c-fabb-40b2-b372-d8df9cc13f50 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:51.756453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31ba0c-fabb-40b2-b372-d8df9cc13f50 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:51.756788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31ba0c-fabb-40b2-b372-d8df9cc13f50 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:51.762416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31ba0c-fabb-40b2-b372-d8df9cc13f50 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:51.771210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31ba0c-fabb-40b2-b372-d8df9cc13f50 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:51.826711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:51.828242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:51.836864 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3866/7701] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:51 2022] PUT /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 520 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:51.848248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f95a96-8538-4987-890a-90dd104db87b tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:52.044391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:52.045061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:52.045291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:52.045702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:52.048997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:52.050209 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:52.050209 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:35:52.050209 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:35:52.051160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:52.052069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:52.052938 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:52.052938 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:35:52.052938 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:35:52.053774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:52.061205 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3836/7702] 10.222.0.23 () {58 vars in 1345 bytes} [Sun Oct 2 01:35:51 2022] HEAD /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:52.066696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31ba0c-fabb-40b2-b372-d8df9cc13f50 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:52.110095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31ba0c-fabb-40b2-b372-d8df9cc13f50 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:52.119493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9736d91-1733-4ab6-a2e7-8a692f4859b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:52.120437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9736d91-1733-4ab6-a2e7-8a692f4859b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:52.121099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9736d91-1733-4ab6-a2e7-8a692f4859b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:52.121543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9736d91-1733-4ab6-a2e7-8a692f4859b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:52.124370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9736d91-1733-4ab6-a2e7-8a692f4859b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:52.126704 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-a9736d91-1733-4ab6-a2e7-8a692f4859b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:52.126704 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:52.126704 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:52.129176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9736d91-1733-4ab6-a2e7-8a692f4859b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:52.142549 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3867/7703] 10.222.0.23 () {58 vars in 1344 bytes} [Sun Oct 2 01:35:52 2022] GET /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 520 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:52.147673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:52.161102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9ba71-1eac-4108-9b12-b87cb820beea tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:52.176783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0ad9c-c748-4023-9bc2-d3286be249b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:52.177901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0ad9c-c748-4023-9bc2-d3286be249b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:52.178868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0ad9c-c748-4023-9bc2-d3286be249b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:52.179300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0ad9c-c748-4023-9bc2-d3286be249b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:52.183030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0ad9c-c748-4023-9bc2-d3286be249b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:52.187165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0ad9c-c748-4023-9bc2-d3286be249b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:52.214476 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3837/7704] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:52 2022] DELETE /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:52.215974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9736d91-1733-4ab6-a2e7-8a692f4859b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:52.228126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9736d91-1733-4ab6-a2e7-8a692f4859b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:52.329072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40cf19-56ef-4919-8531-1d9f34208597 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:52.330257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40cf19-56ef-4919-8531-1d9f34208597 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:52.331650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40cf19-56ef-4919-8531-1d9f34208597 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:52.331975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40cf19-56ef-4919-8531-1d9f34208597 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:52.334863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40cf19-56ef-4919-8531-1d9f34208597 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:52.337146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40cf19-56ef-4919-8531-1d9f34208597 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-ab40cf19-56ef-4919-8531-1d9f34208597 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] e89ba30d37bb446cb3774b4801ccb08e does not imply a7a1addaeff14d08a7817ba67e312dbb.: keystone.exception.ImpliedRoleNotFound: e89ba30d37bb446cb3774b4801ccb08e does not imply a7a1addaeff14d08a7817ba67e312dbb. Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = query.one() Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._iter().one() Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._only_one_row( Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:35:52.350100 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 02 01:35:52.351186 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 02 01:35:52.352036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 02 01:35:52.352036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e89ba30d37bb446cb3774b4801ccb08e does not imply a7a1addaeff14d08a7817ba67e312dbb. Oct 02 01:35:52.352036 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:35:52.352036 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3868/7705] 10.222.0.23 () {58 vars in 1344 bytes} [Sun Oct 2 01:35:52 2022] GET /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 137 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 02 01:35:52.357727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0ad9c-c748-4023-9bc2-d3286be249b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:52.370818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0ad9c-c748-4023-9bc2-d3286be249b6 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:52.389919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4da28f-9585-4b5d-af48-ed7ccbbe4d2f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:52.390771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4da28f-9585-4b5d-af48-ed7ccbbe4d2f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:52.391153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4da28f-9585-4b5d-af48-ed7ccbbe4d2f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:52.391570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4da28f-9585-4b5d-af48-ed7ccbbe4d2f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:52.394942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4da28f-9585-4b5d-af48-ed7ccbbe4d2f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:52.397390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4da28f-9585-4b5d-af48-ed7ccbbe4d2f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-af4da28f-9585-4b5d-af48-ed7ccbbe4d2f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] e89ba30d37bb446cb3774b4801ccb08e does not imply a7a1addaeff14d08a7817ba67e312dbb.: keystone.exception.ImpliedRoleNotFound: e89ba30d37bb446cb3774b4801ccb08e does not imply a7a1addaeff14d08a7817ba67e312dbb. Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = query.one() Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._iter().one() Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._only_one_row( Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:35:52.410005 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 02 01:35:52.412392 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 02 01:35:52.414209 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 02 01:35:52.414209 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 02 01:35:52.414209 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 02 01:35:52.414209 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e89ba30d37bb446cb3774b4801ccb08e does not imply a7a1addaeff14d08a7817ba67e312dbb. Oct 02 01:35:52.414209 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 01:35:52.421565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40cf19-56ef-4919-8531-1d9f34208597 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:52.431097 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3838/7706] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:52 2022] DELETE /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 137 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:35:52.443845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40cf19-56ef-4919-8531-1d9f34208597 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:52.457456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6a851-cfc8-4a1c-b0a4-004eb34ad025 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:52.458215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6a851-cfc8-4a1c-b0a4-004eb34ad025 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:52.458570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6a851-cfc8-4a1c-b0a4-004eb34ad025 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:52.458944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6a851-cfc8-4a1c-b0a4-004eb34ad025 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:52.461879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6a851-cfc8-4a1c-b0a4-004eb34ad025 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:52.463759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6a851-cfc8-4a1c-b0a4-004eb34ad025 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:52.524922 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3869/7707] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:52 2022] PUT /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 520 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:52.529375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4da28f-9585-4b5d-af48-ed7ccbbe4d2f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:52.544170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4da28f-9585-4b5d-af48-ed7ccbbe4d2f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:52.571722 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:52.677058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e81afd-f076-48d4-8e93-49592234e3a5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:52.678497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e81afd-f076-48d4-8e93-49592234e3a5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:52.679141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e81afd-f076-48d4-8e93-49592234e3a5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:52.679573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e81afd-f076-48d4-8e93-49592234e3a5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/8b1feabc92d54b4db125d8e0c1bf85b2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:52.681760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e81afd-f076-48d4-8e93-49592234e3a5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=8b1feabc92d54b4db125d8e0c1bf85b2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:52.686504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e81afd-f076-48d4-8e93-49592234e3a5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:52.743667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6a851-cfc8-4a1c-b0a4-004eb34ad025 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:52.743860 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3839/7708] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:52 2022] PUT /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/8b1feabc92d54b4db125d8e0c1bf85b2 => generated 520 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:52.759442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6a851-cfc8-4a1c-b0a4-004eb34ad025 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:52.760763 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:52.945367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa191e-c3ff-45c6-b2f1-77708a4a65b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:52.945750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa191e-c3ff-45c6-b2f1-77708a4a65b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:52.946139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa191e-c3ff-45c6-b2f1-77708a4a65b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:52.948139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa191e-c3ff-45c6-b2f1-77708a4a65b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2/implies/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:52.955197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa191e-c3ff-45c6-b2f1-77708a4a65b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8b1feabc92d54b4db125d8e0c1bf85b2, implied_role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:52.981487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa191e-c3ff-45c6-b2f1-77708a4a65b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:53.001796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e81afd-f076-48d4-8e93-49592234e3a5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:53.004932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-56e81afd-f076-48d4-8e93-49592234e3a5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:53.044548 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3870/7709] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:52 2022] PUT /identity/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2/implies/f664a93eaed5448e9f58f07effc7c3d4 => generated 520 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:53.056132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa191e-c3ff-45c6-b2f1-77708a4a65b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:53.195812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa191e-c3ff-45c6-b2f1-77708a4a65b5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:53.211921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f76e1-66e5-432e-978d-a20973f28380 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:53.212381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e81afd-f076-48d4-8e93-49592234e3a5 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:53.212843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f76e1-66e5-432e-978d-a20973f28380 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:53.213153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f76e1-66e5-432e-978d-a20973f28380 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:53.213632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f76e1-66e5-432e-978d-a20973f28380 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:53.215326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f76e1-66e5-432e-978d-a20973f28380 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:53.217621 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-a51f76e1-66e5-432e-978d-a20973f28380 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:53.217621 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:53.217621 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:53.220990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f76e1-66e5-432e-978d-a20973f28380 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:53.245212 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3871/7710] 10.222.0.23 () {58 vars in 1152 bytes} [Sun Oct 2 01:35:53 2022] GET /identity/v3/role_inferences => generated 1605 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:35:53.250102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f76e1-66e5-432e-978d-a20973f28380 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:53.274023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f76e1-66e5-432e-978d-a20973f28380 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:53.294548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b42fe2-4394-44af-861e-747f7b18271d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:53.295392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b42fe2-4394-44af-861e-747f7b18271d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:53.295706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b42fe2-4394-44af-861e-747f7b18271d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:53.301164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b42fe2-4394-44af-861e-747f7b18271d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2/implies/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:53.302863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b42fe2-4394-44af-861e-747f7b18271d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8b1feabc92d54b4db125d8e0c1bf85b2, implied_role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:53.308438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b42fe2-4394-44af-861e-747f7b18271d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:53.312855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:53.314764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:53.316038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:53.316775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] PATH_INFO: `/v3/users/c3c2adcbca124733904414c88b325597` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:53.318676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c2adcbca124733904414c88b325597)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:53.320987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:53.331153 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3872/7711] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:53 2022] DELETE /identity/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2/implies/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:53.335464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b42fe2-4394-44af-861e-747f7b18271d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:53.385384 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:53.399004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c2adcbca124733904414c88b325597'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:53.436472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c2adcbca124733904414c88b325597'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:53.437551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c2adcbca124733904414c88b325597'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:53.449309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b42fe2-4394-44af-861e-747f7b18271d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:53.450410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c2adcbca124733904414c88b325597'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:53.458079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0a693-c819-45bd-8a0e-ea363a1b7603 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:53.459060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0a693-c819-45bd-8a0e-ea363a1b7603 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:53.459494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0a693-c819-45bd-8a0e-ea363a1b7603 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:53.459844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0a693-c819-45bd-8a0e-ea363a1b7603 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/8b1feabc92d54b4db125d8e0c1bf85b2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:53.462698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0a693-c819-45bd-8a0e-ea363a1b7603 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=8b1feabc92d54b4db125d8e0c1bf85b2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:53.463343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c2adcbca124733904414c88b325597'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:53.465162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0a693-c819-45bd-8a0e-ea363a1b7603 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:53.477826 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3840/7712] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:52 2022] DELETE /identity/v3/users/c3c2adcbca124733904414c88b325597 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:53.489704 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3873/7713] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:53 2022] DELETE /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/8b1feabc92d54b4db125d8e0c1bf85b2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:53.493974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:53.495922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:53.643967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0983-9f0f-47ae-a46f-18cdc4bbd027 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:53.728423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5427db-7024-41e0-99c6-56ed69409aae tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:53.729032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5427db-7024-41e0-99c6-56ed69409aae tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:53.729423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5427db-7024-41e0-99c6-56ed69409aae tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:53.729905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5427db-7024-41e0-99c6-56ed69409aae tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:53.735579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5427db-7024-41e0-99c6-56ed69409aae tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:53.738464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5427db-7024-41e0-99c6-56ed69409aae tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:53.760639 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3841/7714] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:53 2022] DELETE /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:53.766071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0a693-c819-45bd-8a0e-ea363a1b7603 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:53.773850 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:53.787962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0a693-c819-45bd-8a0e-ea363a1b7603 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:53.881318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a6426-863a-454b-913f-7f9543a3b613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:53.885938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a6426-863a-454b-913f-7f9543a3b613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:53.886640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a6426-863a-454b-913f-7f9543a3b613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:53.887108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a6426-863a-454b-913f-7f9543a3b613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:53.888027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a6426-863a-454b-913f-7f9543a3b613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:53.893923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a6426-863a-454b-913f-7f9543a3b613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:53.894608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5427db-7024-41e0-99c6-56ed69409aae tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:53.896544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bf5427db-7024-41e0-99c6-56ed69409aae tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:53.927119 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3874/7715] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:53 2022] GET /identity/v3/roles => generated 2322 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:53.931758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a6426-863a-454b-913f-7f9543a3b613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:53.960468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a6426-863a-454b-913f-7f9543a3b613 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:53.965893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d16f03-6421-4165-9019-39a19ce47e60 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:53.966628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16f03-6421-4165-9019-39a19ce47e60 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:53.967000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16f03-6421-4165-9019-39a19ce47e60 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:53.967295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16f03-6421-4165-9019-39a19ce47e60 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:53.968156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d16f03-6421-4165-9019-39a19ce47e60 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:53.978358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d16f03-6421-4165-9019-39a19ce47e60 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:54.016842 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3875/7716] 10.222.0.23 () {60 vars in 1143 bytes} [Sun Oct 2 01:35:53 2022] POST /identity/v3/roles => generated 234 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:35:54.018674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d16f03-6421-4165-9019-39a19ce47e60 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:54.041937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d16f03-6421-4165-9019-39a19ce47e60 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:54.046632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5427db-7024-41e0-99c6-56ed69409aae tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:54.055977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8495d-0848-4707-a153-0f8b53c945c1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:54.056956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8495d-0848-4707-a153-0f8b53c945c1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:54.057446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8495d-0848-4707-a153-0f8b53c945c1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:54.057872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8495d-0848-4707-a153-0f8b53c945c1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/f320f88bf3594bee944f97da01838519` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:54.059858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8495d-0848-4707-a153-0f8b53c945c1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:update_role(role_id=f320f88bf3594bee944f97da01838519)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:54.062088 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-e8b8495d-0848-4707-a153-0f8b53c945c1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:54.062088 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:54.062088 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:54.063200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8495d-0848-4707-a153-0f8b53c945c1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:54.063833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:54.065155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:54.065155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:54.065380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] PATH_INFO: `/v3/projects/9cd5011b4b1c48809d36075a7086d2da` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:54.069394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd5011b4b1c48809d36075a7086d2da)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:54.071465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:54.089408 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:54.134977 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3876/7717] 10.222.0.23 () {60 vars in 1243 bytes} [Sun Oct 2 01:35:54 2022] PATCH /identity/v3/roles/f320f88bf3594bee944f97da01838519 => generated 236 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:54.136397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8495d-0848-4707-a153-0f8b53c945c1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:54.150099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8495d-0848-4707-a153-0f8b53c945c1 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:54.158181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e71e8-a727-4b0f-81d0-987d5ad98948 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:54.159820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e71e8-a727-4b0f-81d0-987d5ad98948 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:54.160174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e71e8-a727-4b0f-81d0-987d5ad98948 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:54.160464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e71e8-a727-4b0f-81d0-987d5ad98948 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/f320f88bf3594bee944f97da01838519` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:54.185418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e71e8-a727-4b0f-81d0-987d5ad98948 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:get_role(role_id=f320f88bf3594bee944f97da01838519)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:54.187209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e71e8-a727-4b0f-81d0-987d5ad98948 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:54.195751 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3877/7718] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 2 01:35:54 2022] GET /identity/v3/roles/f320f88bf3594bee944f97da01838519 => generated 236 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:54.196479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e71e8-a727-4b0f-81d0-987d5ad98948 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:54.200829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd5011b4b1c48809d36075a7086d2da', 'request_id': 'req-afe71971-d542-4ea5-b0af-e810cad843ba'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.215647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd5011b4b1c48809d36075a7086d2da', 'request_id': 'req-afe71971-d542-4ea5-b0af-e810cad843ba'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.219051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e71e8-a727-4b0f-81d0-987d5ad98948 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:54.233167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd5011b4b1c48809d36075a7086d2da', 'request_id': 'req-afe71971-d542-4ea5-b0af-e810cad843ba'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.263302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] The token cache is being invalidate because project 9cd5011b4b1c48809d36075a7086d2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:54.270098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.272686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.275712 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3842/7719] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:35:53 2022] DELETE /identity/v3/projects/9cd5011b4b1c48809d36075a7086d2da => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:54.280100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:54.286305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:54.349611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbe8cb-9330-424e-a9d2-cc1ec89f0023 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:54.351181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbe8cb-9330-424e-a9d2-cc1ec89f0023 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:54.351480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbe8cb-9330-424e-a9d2-cc1ec89f0023 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:54.352146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbe8cb-9330-424e-a9d2-cc1ec89f0023 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:54.354871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbe8cb-9330-424e-a9d2-cc1ec89f0023 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:54.360492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbe8cb-9330-424e-a9d2-cc1ec89f0023 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:54.395256 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3878/7720] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:35:54 2022] GET /identity/v3/roles => generated 2549 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:35:54.396598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbe8cb-9330-424e-a9d2-cc1ec89f0023 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:54.398736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f1dbe8cb-9330-424e-a9d2-cc1ec89f0023 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:54.418276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbe8cb-9330-424e-a9d2-cc1ec89f0023 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:54.424117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:54.425750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:54.426023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:54.426310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/f320f88bf3594bee944f97da01838519` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:54.427809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f320f88bf3594bee944f97da01838519)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:54.429431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:54.443814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe71971-d542-4ea5-b0af-e810cad843ba admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:54.456849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:54.457827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:54.458260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:54.458705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] PATH_INFO: `/v3/users/b660dc23c365416cb728498b3631dfd9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:54.461877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b660dc23c365416cb728498b3631dfd9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:54.464287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:54.500393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role f320f88bf3594bee944f97da01838519 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:54.501645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.503191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.505696 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3879/7721] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:54 2022] DELETE /identity/v3/roles/f320f88bf3594bee944f97da01838519 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:54.512619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:54.514844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:54.523834 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:54.584519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b660dc23c365416cb728498b3631dfd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.603776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286abded-5e66-4ccb-b0b8-f2436ef3b55a tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:54.607702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b660dc23c365416cb728498b3631dfd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.608596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b660dc23c365416cb728498b3631dfd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.610190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a8f41-2482-4811-b411-c65a8ac5240c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:54.611147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a8f41-2482-4811-b411-c65a8ac5240c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:54.611526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a8f41-2482-4811-b411-c65a8ac5240c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:54.612097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a8f41-2482-4811-b411-c65a8ac5240c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:54.614554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a8f41-2482-4811-b411-c65a8ac5240c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:54.617001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a8f41-2482-4811-b411-c65a8ac5240c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:54.622157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b660dc23c365416cb728498b3631dfd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.632410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b660dc23c365416cb728498b3631dfd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:54.639729 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3843/7722] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:54 2022] DELETE /identity/v3/users/b660dc23c365416cb728498b3631dfd9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:54.659342 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3880/7723] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:54 2022] PUT /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 520 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:54.660576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:54.662799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:54.684746 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:54.813784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86c93b-5db6-4cff-add1-aeab3ea6589e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:54.914789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a8f41-2482-4811-b411-c65a8ac5240c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:54.932778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e58a8f41-2482-4811-b411-c65a8ac5240c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:54.967838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ed6e4-2f2c-433d-aaa2-7908e6559dd7 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:54.967838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ed6e4-2f2c-433d-aaa2-7908e6559dd7 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:54.967838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ed6e4-2f2c-433d-aaa2-7908e6559dd7 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:54.968220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ed6e4-2f2c-433d-aaa2-7908e6559dd7 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/8b1feabc92d54b4db125d8e0c1bf85b2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:54.979373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ed6e4-2f2c-433d-aaa2-7908e6559dd7 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=8b1feabc92d54b4db125d8e0c1bf85b2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:54.979373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ed6e4-2f2c-433d-aaa2-7908e6559dd7 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:55.031668 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3844/7724] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:54 2022] PUT /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/8b1feabc92d54b4db125d8e0c1bf85b2 => generated 520 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:55.036968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ed6e4-2f2c-433d-aaa2-7908e6559dd7 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:55.093777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a8f41-2482-4811-b411-c65a8ac5240c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:55.198284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ed6e4-2f2c-433d-aaa2-7908e6559dd7 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:55.223010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b3b4c-58ff-41eb-a316-96af5b3bdd25 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:55.224071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3b4c-58ff-41eb-a316-96af5b3bdd25 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:55.224494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3b4c-58ff-41eb-a316-96af5b3bdd25 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:55.225735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3b4c-58ff-41eb-a316-96af5b3bdd25 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2/implies/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:55.228790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b3b4c-58ff-41eb-a316-96af5b3bdd25 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8b1feabc92d54b4db125d8e0c1bf85b2, implied_role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:55.231217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b3b4c-58ff-41eb-a316-96af5b3bdd25 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:55.257909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:55.259051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:55.259358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:55.259640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] PATH_INFO: `/v3/projects/e9d76ecfc8814fb0be946bf49cf58775` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:55.262703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d76ecfc8814fb0be946bf49cf58775)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:55.264667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:55.266023 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3845/7725] 10.222.0.23 () {60 vars in 1363 bytes} [Sun Oct 2 01:35:55 2022] PUT /identity/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2/implies/f664a93eaed5448e9f58f07effc7c3d4 => generated 520 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:35:55.306002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b3b4c-58ff-41eb-a316-96af5b3bdd25 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:55.367676 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:55.378343 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:55.404192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d76ecfc8814fb0be946bf49cf58775', 'request_id': 'req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:55.425198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d76ecfc8814fb0be946bf49cf58775', 'request_id': 'req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:55.453782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d76ecfc8814fb0be946bf49cf58775', 'request_id': 'req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:55.484424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] The token cache is being invalidate because project e9d76ecfc8814fb0be946bf49cf58775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:55.484800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:55.485711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:55.490542 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3881/7726] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:35:54 2022] DELETE /identity/v3/projects/e9d76ecfc8814fb0be946bf49cf58775 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:55.516369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b3b4c-58ff-41eb-a316-96af5b3bdd25 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:55.644531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d35eb0-e4ed-4907-a568-e6147d7a27c3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:55.645112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35eb0-e4ed-4907-a568-e6147d7a27c3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:55.645457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35eb0-e4ed-4907-a568-e6147d7a27c3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:55.645872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35eb0-e4ed-4907-a568-e6147d7a27c3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2/implies` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:55.647116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d35eb0-e4ed-4907-a568-e6147d7a27c3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=8b1feabc92d54b4db125d8e0c1bf85b2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:55.648706 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-c1d35eb0-e4ed-4907-a568-e6147d7a27c3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:55.648706 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:35:55.648706 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:35:55.649641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d35eb0-e4ed-4907-a568-e6147d7a27c3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:55.660005 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3846/7727] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:35:55 2022] GET /identity/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2/implies => generated 489 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:55.664197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:55.665693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:55.699692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c7917-b9be-4d4e-ab7d-69ad7307531e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:55.709029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5c526-244d-4ebd-a5a2-10ab4c99c5d4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:55.709805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5c526-244d-4ebd-a5a2-10ab4c99c5d4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:55.710164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5c526-244d-4ebd-a5a2-10ab4c99c5d4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:55.710627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5c526-244d-4ebd-a5a2-10ab4c99c5d4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:55.713834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5c526-244d-4ebd-a5a2-10ab4c99c5d4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:55.715003 n-d-master-1 devstack@keystone.service[81853]: WARNING py.warnings [None req-b9e5c526-244d-4ebd-a5a2-10ab4c99c5d4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:35:55.715003 n-d-master-1 devstack@keystone.service[81853]: warnings.warn(msg) Oct 02 01:35:55.715003 n-d-master-1 devstack@keystone.service[81853]: Oct 02 01:35:55.716059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5c526-244d-4ebd-a5a2-10ab4c99c5d4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:55.738192 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3882/7728] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 2 01:35:55 2022] GET /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies => generated 659 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:55.742441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d35eb0-e4ed-4907-a568-e6147d7a27c3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:55.757428 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d35eb0-e4ed-4907-a568-e6147d7a27c3 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:55.787298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700697b5-944f-4ba9-a1fa-57cb601059cb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:55.788115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700697b5-944f-4ba9-a1fa-57cb601059cb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:55.788413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700697b5-944f-4ba9-a1fa-57cb601059cb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:55.788727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700697b5-944f-4ba9-a1fa-57cb601059cb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2/implies/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:55.792541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700697b5-944f-4ba9-a1fa-57cb601059cb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8b1feabc92d54b4db125d8e0c1bf85b2, implied_role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:55.794203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700697b5-944f-4ba9-a1fa-57cb601059cb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:55.822874 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3847/7729] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:55 2022] DELETE /identity/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2/implies/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:55.824473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5c526-244d-4ebd-a5a2-10ab4c99c5d4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:55.838980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5c526-244d-4ebd-a5a2-10ab4c99c5d4 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:56.034756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17fb13-9360-4b8c-b99d-0d7d9f02052f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:56.035253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17fb13-9360-4b8c-b99d-0d7d9f02052f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:56.035768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17fb13-9360-4b8c-b99d-0d7d9f02052f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:56.036055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17fb13-9360-4b8c-b99d-0d7d9f02052f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/8b1feabc92d54b4db125d8e0c1bf85b2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:56.039169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17fb13-9360-4b8c-b99d-0d7d9f02052f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=8b1feabc92d54b4db125d8e0c1bf85b2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:56.041974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17fb13-9360-4b8c-b99d-0d7d9f02052f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:56.064899 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3883/7730] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:55 2022] DELETE /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/8b1feabc92d54b4db125d8e0c1bf85b2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:56.070119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700697b5-944f-4ba9-a1fa-57cb601059cb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:56.088843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700697b5-944f-4ba9-a1fa-57cb601059cb tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:56.233955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9512dec-552f-4f8f-9998-103b62e7d5b8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:56.236966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512dec-552f-4f8f-9998-103b62e7d5b8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:56.238866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512dec-552f-4f8f-9998-103b62e7d5b8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:56.239160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512dec-552f-4f8f-9998-103b62e7d5b8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:56.243511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9512dec-552f-4f8f-9998-103b62e7d5b8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e89ba30d37bb446cb3774b4801ccb08e, implied_role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:56.246943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9512dec-552f-4f8f-9998-103b62e7d5b8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:56.271826 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3848/7731] 10.222.0.23 () {58 vars in 1347 bytes} [Sun Oct 2 01:35:56 2022] DELETE /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e/implies/a7a1addaeff14d08a7817ba67e312dbb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:35:56.277483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17fb13-9360-4b8c-b99d-0d7d9f02052f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:56.297559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17fb13-9360-4b8c-b99d-0d7d9f02052f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:56.451733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3bc1f-f059-43a5-b453-8b5105054957 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:56.452581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3bc1f-f059-43a5-b453-8b5105054957 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:56.453796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3bc1f-f059-43a5-b453-8b5105054957 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:56.454206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3bc1f-f059-43a5-b453-8b5105054957 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/fef51062c3c74401833ef8f308361c5c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:56.463398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3bc1f-f059-43a5-b453-8b5105054957 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-8fd3bc1f-f059-43a5-b453-8b5105054957 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Could not find domain: fef51062c3c74401833ef8f308361c5c.: keystone.exception.DomainNotFound: Could not find domain: fef51062c3c74401833ef8f308361c5c. Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fef51062c3c74401833ef8f308361c5c. Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:35:56.469826 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:35:56.471151 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fef51062c3c74401833ef8f308361c5c. Oct 02 01:35:56.472022 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:35:56.473137 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3884/7732] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:35:56 2022] PATCH /identity/v3/domains/fef51062c3c74401833ef8f308361c5c => generated 112 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:35:56.475612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9512dec-552f-4f8f-9998-103b62e7d5b8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:56.492380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9512dec-552f-4f8f-9998-103b62e7d5b8 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:56.500746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:56.501430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:56.501705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:56.501987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/users/156fac971af3406eb37fac686488b922` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:56.505934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_user(user_id=156fac971af3406eb37fac686488b922)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:56.508936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:56.597553 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:56.606461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156fac971af3406eb37fac686488b922'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:56.633657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156fac971af3406eb37fac686488b922'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:56.639086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156fac971af3406eb37fac686488b922'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:56.661591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156fac971af3406eb37fac686488b922'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:56.678134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156fac971af3406eb37fac686488b922'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:56.684556 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3849/7733] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:56 2022] DELETE /identity/v3/users/156fac971af3406eb37fac686488b922 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:56.688719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3bc1f-f059-43a5-b453-8b5105054957 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:56.693470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8fd3bc1f-f059-43a5-b453-8b5105054957 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:56.721663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3bc1f-f059-43a5-b453-8b5105054957 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:56.827158 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:56.847096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:56.847985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:56.848595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:56.849326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/f664a93eaed5448e9f58f07effc7c3d4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:56.851827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f664a93eaed5448e9f58f07effc7c3d4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:56.853613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:56.953742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role f664a93eaed5448e9f58f07effc7c3d4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:56.954165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:56.956825 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:56.959315 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3885/7734] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:56 2022] DELETE /identity/v3/roles/f664a93eaed5448e9f58f07effc7c3d4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:56.971104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:56.994965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85e369-bbd7-48b4-82c5-86e02ff50e3f tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:57.121823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98621cd-90eb-4311-8b65-5aa9903fa545 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:57.123723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98621cd-90eb-4311-8b65-5aa9903fa545 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:57.125377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98621cd-90eb-4311-8b65-5aa9903fa545 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:57.126466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98621cd-90eb-4311-8b65-5aa9903fa545 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/groups/8972039e07914aca8d6d8d604bfcfb51` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:57.130705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98621cd-90eb-4311-8b65-5aa9903fa545 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8972039e07914aca8d6d8d604bfcfb51)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:57.135067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98621cd-90eb-4311-8b65-5aa9903fa545 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:57.226658 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3850/7735] 10.222.0.23 () {58 vars in 1227 bytes} [Sun Oct 2 01:35:56 2022] DELETE /identity/v3/groups/8972039e07914aca8d6d8d604bfcfb51 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:57.229153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:57.230734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:57.249955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6cdf8-69a8-4b91-9953-0a8bb87e6e0c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:57.410022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:57.410788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:57.411143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:57.411419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:57.412585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_project(project_id=78dcc3df4fe74b7fb8a982c4c508d612)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:57.414698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:57.485748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78dcc3df4fe74b7fb8a982c4c508d612', 'request_id': 'req-5314582e-5a6a-43aa-9d26-7de356a01a1c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:57.501160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78dcc3df4fe74b7fb8a982c4c508d612', 'request_id': 'req-5314582e-5a6a-43aa-9d26-7de356a01a1c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:57.512648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78dcc3df4fe74b7fb8a982c4c508d612', 'request_id': 'req-5314582e-5a6a-43aa-9d26-7de356a01a1c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:57.535316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] The token cache is being invalidate because project 78dcc3df4fe74b7fb8a982c4c508d612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:57.535619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:57.538025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:57.539875 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3886/7736] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:35:57 2022] DELETE /identity/v3/projects/78dcc3df4fe74b7fb8a982c4c508d612 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:57.543594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98621cd-90eb-4311-8b65-5aa9903fa545 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:57.545689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a98621cd-90eb-4311-8b65-5aa9903fa545 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:57.570129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98621cd-90eb-4311-8b65-5aa9903fa545 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:57.724209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:57.724949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:57.725299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:57.725644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/c536c12b682448cb8ef96400a70cd912` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:57.727009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c536c12b682448cb8ef96400a70cd912)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:57.733452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:57.762402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:57.763954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:57.779152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c536c12b682448cb8ef96400a70cd912'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:57.779902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c536c12b682448cb8ef96400a70cd912'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:57.788021 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:57.825588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c536c12b682448cb8ef96400a70cd912'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:57.826443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c536c12b682448cb8ef96400a70cd912'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:57.833765 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3851/7737] 10.222.0.23 () {60 vars in 1249 bytes} [Sun Oct 2 01:35:57 2022] PATCH /identity/v3/domains/c536c12b682448cb8ef96400a70cd912 => generated 276 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:35:57.835471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:57.838782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:57.856335 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:57.896408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314582e-5a6a-43aa-9d26-7de356a01a1c tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:58.007375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81052747-c6c5-4a25-bfc3-0c726ba63081 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:58.022387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df2b19-1f1b-46db-bf32-e01a05120e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:58.023069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2b19-1f1b-46db-bf32-e01a05120e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:58.023364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2b19-1f1b-46db-bf32-e01a05120e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:58.023610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2b19-1f1b-46db-bf32-e01a05120e2b admin admin] PATH_INFO: `/v3/users/f6110809508e45c8b6c771c6ac8c49b7` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:58.025138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:58.025805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:58.026101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:58.026387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/domains/c536c12b682448cb8ef96400a70cd912` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:58.027476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df2b19-1f1b-46db-bf32-e01a05120e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6110809508e45c8b6c771c6ac8c49b7)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:58.029324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df2b19-1f1b-46db-bf32-e01a05120e2b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:58.051110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c536c12b682448cb8ef96400a70cd912)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:58.054255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:58.110621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c536c12b682448cb8ef96400a70cd912'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.123584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c536c12b682448cb8ef96400a70cd912'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.170809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-32df2b19-1f1b-46db-bf32-e01a05120e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6110809508e45c8b6c771c6ac8c49b7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.200389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-32df2b19-1f1b-46db-bf32-e01a05120e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6110809508e45c8b6c771c6ac8c49b7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.201379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-32df2b19-1f1b-46db-bf32-e01a05120e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6110809508e45c8b6c771c6ac8c49b7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.222837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-32df2b19-1f1b-46db-bf32-e01a05120e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6110809508e45c8b6c771c6ac8c49b7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.223629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-32df2b19-1f1b-46db-bf32-e01a05120e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6110809508e45c8b6c771c6ac8c49b7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.245233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c536c12b682448cb8ef96400a70cd912', 'request_id': 'req-b2f41de9-2c16-4ffa-8f9a-dab265999401'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.248902 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3887/7738] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:57 2022] DELETE /identity/v3/users/f6110809508e45c8b6c771c6ac8c49b7 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:58.255506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bea2f-6669-4b2b-a340-78b3af491899 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:58.255891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bea2f-6669-4b2b-a340-78b3af491899 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:58.256165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bea2f-6669-4b2b-a340-78b3af491899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:58.261139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c536c12b682448cb8ef96400a70cd912', 'request_id': 'req-b2f41de9-2c16-4ffa-8f9a-dab265999401'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.297645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c536c12b682448cb8ef96400a70cd912', 'request_id': 'req-b2f41de9-2c16-4ffa-8f9a-dab265999401'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.317055 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-198bea2f-6669-4b2b-a340-78b3af491899 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:58.318349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-198bea2f-6669-4b2b-a340-78b3af491899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:58.337182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] The token cache is being invalidate because project c536c12b682448cb8ef96400a70cd912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:58.337718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.338847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.365065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c536c12b682448cb8ef96400a70cd912', 'request_id': 'req-b2f41de9-2c16-4ffa-8f9a-dab265999401'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.365846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c536c12b682448cb8ef96400a70cd912', 'request_id': 'req-b2f41de9-2c16-4ffa-8f9a-dab265999401'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.366478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c536c12b682448cb8ef96400a70cd912', 'request_id': 'req-b2f41de9-2c16-4ffa-8f9a-dab265999401'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.390212 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3852/7739] 10.222.0.23 () {58 vars in 1230 bytes} [Sun Oct 2 01:35:57 2022] DELETE /identity/v3/domains/c536c12b682448cb8ef96400a70cd912 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:58.396105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:58.399017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:58.466831 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:58.508496 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3888/7740] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:58.516157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bea2f-6669-4b2b-a340-78b3af491899 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:58.518157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-198bea2f-6669-4b2b-a340-78b3af491899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:58.541956 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:58.571333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f41de9-2c16-4ffa-8f9a-dab265999401 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:58.661389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bea2f-6669-4b2b-a340-78b3af491899 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:58.671322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:58.672514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:58.672935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:58.673311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69464698-edc1-4440-8866-fa056c033874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:58.673467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:58.675047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464698-edc1-4440-8866-fa056c033874 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:58.675333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464698-edc1-4440-8866-fa056c033874 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:58.675607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464698-edc1-4440-8866-fa056c033874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:58.676249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8b1feabc92d54b4db125d8e0c1bf85b2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:58.678265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:58.695889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69464698-edc1-4440-8866-fa056c033874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:58.697388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69464698-edc1-4440-8866-fa056c033874 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:58.721262 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3889/7741] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:35:58.761274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role 8b1feabc92d54b4db125d8e0c1bf85b2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:58.764092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.767884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:58.777539 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3853/7742] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:58 2022] DELETE /identity/v3/roles/8b1feabc92d54b4db125d8e0c1bf85b2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:58.781261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69464698-edc1-4440-8866-fa056c033874 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:58.799426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69464698-edc1-4440-8866-fa056c033874 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:58.925824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:58.926641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:58.928019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:58.928667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/a7a1addaeff14d08a7817ba67e312dbb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:58.931644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a7a1addaeff14d08a7817ba67e312dbb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:58.933431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:59.009828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role a7a1addaeff14d08a7817ba67e312dbb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:59.010252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.011911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.015097 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3890/7743] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:58 2022] DELETE /identity/v3/roles/a7a1addaeff14d08a7817ba67e312dbb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:59.018493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:59.020430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:59.036771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d54b-00b3-4f9f-a1e5-167166bcc98d tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:59.202719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d9fbb2322044ddae25e7323425385a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a264fc1ca5e44c09591c78f7363e35b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:59.203426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:59.203713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:59.203986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] PATH_INFO: `/v3/roles/e89ba30d37bb446cb3774b4801ccb08e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:59.206980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e89ba30d37bb446cb3774b4801ccb08e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:59.208626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:59.319901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invalidating the token cache because role e89ba30d37bb446cb3774b4801ccb08e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:59.320201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.321130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.330734 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3854/7744] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:59 2022] DELETE /identity/v3/roles/e89ba30d37bb446cb3774b4801ccb08e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:59.334533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:59.336039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:59.485070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b76ce8-61ea-4c15-a41b-d5a63276bec2 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:59.540453 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:59.608770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3046672-9443-481d-a68e-1d1c1f2638ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:59.609772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046672-9443-481d-a68e-1d1c1f2638ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:59.610119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046672-9443-481d-a68e-1d1c1f2638ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:59.610410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046672-9443-481d-a68e-1d1c1f2638ce admin admin] PATH_INFO: `/v3/users/0df07cc6ef134ef5a5d8b1983368b5f4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:59.612442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3046672-9443-481d-a68e-1d1c1f2638ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df07cc6ef134ef5a5d8b1983368b5f4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:59.614575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3046672-9443-481d-a68e-1d1c1f2638ce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:59.672587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:59.675052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:59.692168 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:35:59.708053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63143c07-03b3-49df-89ea-e967150c9811 tempest-RolesV3TestJSON-1183294872 tempest-RolesV3TestJSON-1183294872-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:35:59.710668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b3046672-9443-481d-a68e-1d1c1f2638ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df07cc6ef134ef5a5d8b1983368b5f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.712884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:35:59.713545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:59.713822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:59.714101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] PATH_INFO: `/v3/projects/c954629e3886445399259f775f3ecdc4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:59.717835 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c954629e3886445399259f775f3ecdc4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:35:59.719848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:35:59.747460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b3046672-9443-481d-a68e-1d1c1f2638ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df07cc6ef134ef5a5d8b1983368b5f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.750562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b3046672-9443-481d-a68e-1d1c1f2638ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df07cc6ef134ef5a5d8b1983368b5f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.776896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b3046672-9443-481d-a68e-1d1c1f2638ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df07cc6ef134ef5a5d8b1983368b5f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.777550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b3046672-9443-481d-a68e-1d1c1f2638ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df07cc6ef134ef5a5d8b1983368b5f4'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.813369 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3891/7745] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:35:59 2022] DELETE /identity/v3/users/0df07cc6ef134ef5a5d8b1983368b5f4 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:59.818510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5e5e0-0abd-49c8-8550-b4ddf3487eaa None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:59.819478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5e5e0-0abd-49c8-8550-b4ddf3487eaa None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:59.819754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5e5e0-0abd-49c8-8550-b4ddf3487eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:59.852534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c954629e3886445399259f775f3ecdc4', 'request_id': 'req-231834a0-af38-4daa-8522-6621f4fd15dd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.878952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c954629e3886445399259f775f3ecdc4', 'request_id': 'req-231834a0-af38-4daa-8522-6621f4fd15dd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.886026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4ba5e5e0-0abd-49c8-8550-b4ddf3487eaa None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:59.887293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4ba5e5e0-0abd-49c8-8550-b4ddf3487eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:59.889558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c954629e3886445399259f775f3ecdc4', 'request_id': 'req-231834a0-af38-4daa-8522-6621f4fd15dd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.913069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] The token cache is being invalidate because project c954629e3886445399259f775f3ecdc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:35:59.913427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.915017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-231834a0-af38-4daa-8522-6621f4fd15dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:35:59.927126 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3855/7746] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:35:59 2022] DELETE /identity/v3/projects/c954629e3886445399259f775f3ecdc4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:35:59.928889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c7d9-6743-4ce2-ba6a-e02825f3f7ed None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:35:59.929206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c7d9-6743-4ce2-ba6a-e02825f3f7ed None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:35:59.929487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c7d9-6743-4ce2-ba6a-e02825f3f7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:35:59.987689 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3892/7747] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:35:59.993400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5e5e0-0abd-49c8-8550-b4ddf3487eaa None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:35:59.994907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4ba5e5e0-0abd-49c8-8550-b4ddf3487eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:35:59.998092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b5f0c7d9-6743-4ce2-ba6a-e02825f3f7ed None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:35:59.999504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b5f0c7d9-6743-4ce2-ba6a-e02825f3f7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:00.011111 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3856/7748] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:00.020039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1dca-6cdd-4f54-ae6b-9f4f3ceccdae None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:00.020289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1dca-6cdd-4f54-ae6b-9f4f3ceccdae None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:00.020562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1dca-6cdd-4f54-ae6b-9f4f3ceccdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:00.047542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-855d1dca-6cdd-4f54-ae6b-9f4f3ceccdae None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:00.049477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-855d1dca-6cdd-4f54-ae6b-9f4f3ceccdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:00.062849 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3857/7749] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:00.065783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1dca-6cdd-4f54-ae6b-9f4f3ceccdae None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:00.079240 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:00.079871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1dca-6cdd-4f54-ae6b-9f4f3ceccdae None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:00.093392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5fe62-50d5-43d3-9295-d6683e282001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:00.094372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5e5e0-0abd-49c8-8550-b4ddf3487eaa None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:00.094793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5fe62-50d5-43d3-9295-d6683e282001 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:00.095414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5fe62-50d5-43d3-9295-d6683e282001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:00.097563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5fe62-50d5-43d3-9295-d6683e282001 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:00.098450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5fe62-50d5-43d3-9295-d6683e282001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:36:00.098980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5fe62-50d5-43d3-9295-d6683e282001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:00.100892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5fe62-50d5-43d3-9295-d6683e282001 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:00.103734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927466b-2aad-442a-a7e9-8e9ea7aae7da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:00.107188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927466b-2aad-442a-a7e9-8e9ea7aae7da service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:00.107554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927466b-2aad-442a-a7e9-8e9ea7aae7da service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:00.107908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927466b-2aad-442a-a7e9-8e9ea7aae7da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:00.122052 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3858/7750] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:36:00.124015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5fe62-50d5-43d3-9295-d6683e282001 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:00.136416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927466b-2aad-442a-a7e9-8e9ea7aae7da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:00.138175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927466b-2aad-442a-a7e9-8e9ea7aae7da service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:00.140853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5fe62-50d5-43d3-9295-d6683e282001 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:00.148506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca114fcb-9a9b-4856-939f-1b87df20a532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:00.149405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca114fcb-9a9b-4856-939f-1b87df20a532 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:00.149869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca114fcb-9a9b-4856-939f-1b87df20a532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:00.150323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca114fcb-9a9b-4856-939f-1b87df20a532 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:00.151211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca114fcb-9a9b-4856-939f-1b87df20a532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:00.153668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca114fcb-9a9b-4856-939f-1b87df20a532 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:00.168192 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3893/7751] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:36:00.209620 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3859/7752] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:00 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:00.214028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927466b-2aad-442a-a7e9-8e9ea7aae7da service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:00.230074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927466b-2aad-442a-a7e9-8e9ea7aae7da service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:00.340625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886f0c2-e542-456a-b6bb-f8d8448213cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:00.342882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886f0c2-e542-456a-b6bb-f8d8448213cb admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:00.343259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886f0c2-e542-456a-b6bb-f8d8448213cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:00.343634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886f0c2-e542-456a-b6bb-f8d8448213cb admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:00.344442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886f0c2-e542-456a-b6bb-f8d8448213cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:00.348281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886f0c2-e542-456a-b6bb-f8d8448213cb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:00.415864 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3894/7753] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:00 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:00.420088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca114fcb-9a9b-4856-939f-1b87df20a532 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:00.436054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca114fcb-9a9b-4856-939f-1b87df20a532 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:00.441669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09cff-cb28-4a83-9b4a-18ce82b0d7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:00.454075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09cff-cb28-4a83-9b4a-18ce82b0d7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:00.454733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09cff-cb28-4a83-9b4a-18ce82b0d7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:00.455876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09cff-cb28-4a83-9b4a-18ce82b0d7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:00.457379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d09cff-cb28-4a83-9b4a-18ce82b0d7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:00.462506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d09cff-cb28-4a83-9b4a-18ce82b0d7b2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:00.487590 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3860/7754] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:00.492135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886f0c2-e542-456a-b6bb-f8d8448213cb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:00.507561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886f0c2-e542-456a-b6bb-f8d8448213cb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:00.519348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a4f67-087a-4a81-8cbb-dbeae5afde67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:00.519991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4f67-087a-4a81-8cbb-dbeae5afde67 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:00.520270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4f67-087a-4a81-8cbb-dbeae5afde67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:00.520546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4f67-087a-4a81-8cbb-dbeae5afde67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:00.523409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a4f67-087a-4a81-8cbb-dbeae5afde67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:00.525078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a4f67-087a-4a81-8cbb-dbeae5afde67 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:00.551347 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3895/7755] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:00.555271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09cff-cb28-4a83-9b4a-18ce82b0d7b2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:00.567086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09cff-cb28-4a83-9b4a-18ce82b0d7b2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:00.573470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66b786-71a4-47f4-a68f-0458370bd604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:00.575064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66b786-71a4-47f4-a68f-0458370bd604 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:00.575430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66b786-71a4-47f4-a68f-0458370bd604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:00.575790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66b786-71a4-47f4-a68f-0458370bd604 admin admin] PATH_INFO: `/v3/projects/194b80e864e84bd49f540b6032d65b20/users/35032fdb83dc43d5b26d4e828d07873a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:00.600578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66b786-71a4-47f4-a68f-0458370bd604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194b80e864e84bd49f540b6032d65b20, user_id=35032fdb83dc43d5b26d4e828d07873a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:00.605646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66b786-71a4-47f4-a68f-0458370bd604 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:00.641691 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3861/7756] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:00 2022] PUT /identity/v3/projects/194b80e864e84bd49f540b6032d65b20/users/35032fdb83dc43d5b26d4e828d07873a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:00.645511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eb9e8-2898-4654-ade3-350a73225a31 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:00.645869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eb9e8-2898-4654-ade3-350a73225a31 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:00.646101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eb9e8-2898-4654-ade3-350a73225a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:00.702190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d80eb9e8-2898-4654-ade3-350a73225a31 None None] MFA Rules not processed for user `35032fdb83dc43d5b26d4e828d07873a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:00.706935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d80eb9e8-2898-4654-ade3-350a73225a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:00.779810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66b786-71a4-47f4-a68f-0458370bd604 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:00.783976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1a66b786-71a4-47f4-a68f-0458370bd604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:00.831526 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3896/7757] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:00.836597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80eb9e8-2898-4654-ade3-350a73225a31 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:00.924205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66b786-71a4-47f4-a68f-0458370bd604 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:00.936623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:00.937285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:00.937568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:00.939979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] PATH_INFO: `/v3/projects/285bb2fed4dc40fd93504f91e0e37b56` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:00.941763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285bb2fed4dc40fd93504f91e0e37b56)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:00.946567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:00.959974 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:00.977649 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:00.985724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80eb9e8-2898-4654-ade3-350a73225a31 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:01.009737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd071f72-2ff0-46d3-8707-876bad2b99ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:01.010366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd071f72-2ff0-46d3-8707-876bad2b99ee admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:01.010667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd071f72-2ff0-46d3-8707-876bad2b99ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:01.010942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd071f72-2ff0-46d3-8707-876bad2b99ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:01.011579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd071f72-2ff0-46d3-8707-876bad2b99ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:01.013498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd071f72-2ff0-46d3-8707-876bad2b99ee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:01.076010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285bb2fed4dc40fd93504f91e0e37b56', 'request_id': 'req-a29e4e39-45ee-41a0-8c4c-842878cc3939'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:01.080662 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3897/7758] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:00 2022] POST /identity/v3/projects => generated 371 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:01.084588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd071f72-2ff0-46d3-8707-876bad2b99ee admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:01.087336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285bb2fed4dc40fd93504f91e0e37b56', 'request_id': 'req-a29e4e39-45ee-41a0-8c4c-842878cc3939'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:01.097264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285bb2fed4dc40fd93504f91e0e37b56', 'request_id': 'req-a29e4e39-45ee-41a0-8c4c-842878cc3939'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:01.129590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] The token cache is being invalidate because project 285bb2fed4dc40fd93504f91e0e37b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:01.129895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:01.130765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:01.132771 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3862/7759] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:00 2022] DELETE /identity/v3/projects/285bb2fed4dc40fd93504f91e0e37b56 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:01.136593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:01.139465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:01.240152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd071f72-2ff0-46d3-8707-876bad2b99ee admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:01.257524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40defcad-deb2-47cf-8d99-5e7b597661bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:01.258260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40defcad-deb2-47cf-8d99-5e7b597661bc admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:01.258536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40defcad-deb2-47cf-8d99-5e7b597661bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:01.258988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40defcad-deb2-47cf-8d99-5e7b597661bc admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:01.260968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40defcad-deb2-47cf-8d99-5e7b597661bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:01.266708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40defcad-deb2-47cf-8d99-5e7b597661bc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:01.299270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e4e39-45ee-41a0-8c4c-842878cc3939 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:01.312395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:01.316800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:01.316800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:01.317007 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3898/7760] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:01 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:36:01.317196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] PATH_INFO: `/v3/users/36d9fbb2322044ddae25e7323425385a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:01.318679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40defcad-deb2-47cf-8d99-5e7b597661bc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:01.319343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d9fbb2322044ddae25e7323425385a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:01.322095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:01.322328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-40defcad-deb2-47cf-8d99-5e7b597661bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:01.351421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40defcad-deb2-47cf-8d99-5e7b597661bc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:01.362510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb1228-390e-430f-a4b5-124164cdd065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:01.363210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb1228-390e-430f-a4b5-124164cdd065 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:01.363545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb1228-390e-430f-a4b5-124164cdd065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:01.364817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb1228-390e-430f-a4b5-124164cdd065 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:01.365611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb1228-390e-430f-a4b5-124164cdd065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:01.368235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb1228-390e-430f-a4b5-124164cdd065 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:01.386156 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3899/7761] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:36:01.387345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb1228-390e-430f-a4b5-124164cdd065 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:01.405266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d9fbb2322044ddae25e7323425385a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:01.406128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb1228-390e-430f-a4b5-124164cdd065 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:01.413672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ed1f2-403b-45ae-ae7b-4b4d0a535f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:01.415545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ed1f2-403b-45ae-ae7b-4b4d0a535f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:01.415940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ed1f2-403b-45ae-ae7b-4b4d0a535f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:01.416340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ed1f2-403b-45ae-ae7b-4b4d0a535f1d admin admin] PATH_INFO: `/v3/projects/35d5eb48117d4659b82d6844f1b83842/users/0d3fd09f06874622b33c4d5318e64df9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:01.434181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d9fbb2322044ddae25e7323425385a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:01.436605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d9fbb2322044ddae25e7323425385a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:01.458179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ed1f2-403b-45ae-ae7b-4b4d0a535f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d5eb48117d4659b82d6844f1b83842, user_id=0d3fd09f06874622b33c4d5318e64df9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:01.469268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d9fbb2322044ddae25e7323425385a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:01.480052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ed1f2-403b-45ae-ae7b-4b4d0a535f1d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:01.484087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d9fbb2322044ddae25e7323425385a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:01.493483 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3863/7762] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:01 2022] DELETE /identity/v3/users/36d9fbb2322044ddae25e7323425385a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:01.507680 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3900/7763] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:01 2022] PUT /identity/v3/projects/35d5eb48117d4659b82d6844f1b83842/users/0d3fd09f06874622b33c4d5318e64df9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:01.510660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:01.512252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:01.546093 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:01.655843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9f1c-099c-46b4-829b-ad64ce189a31 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:01.803092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e1a13-b3f1-4b68-a3ef-ab34ce6f1415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:01.807062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e1a13-b3f1-4b68-a3ef-ab34ce6f1415 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:01.807467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e1a13-b3f1-4b68-a3ef-ab34ce6f1415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:01.807891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e1a13-b3f1-4b68-a3ef-ab34ce6f1415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:01.808889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e1a13-b3f1-4b68-a3ef-ab34ce6f1415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:01.815144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e1a13-b3f1-4b68-a3ef-ab34ce6f1415 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:01.834987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ed1f2-403b-45ae-ae7b-4b4d0a535f1d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:01.837569 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3864/7764] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:01.848770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ed1f2-403b-45ae-ae7b-4b4d0a535f1d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:01.866197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064885c2-2001-49c3-ae21-0acd18a1e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:01.867201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064885c2-2001-49c3-ae21-0acd18a1e297 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:01.867627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064885c2-2001-49c3-ae21-0acd18a1e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:01.868049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064885c2-2001-49c3-ae21-0acd18a1e297 admin admin] PATH_INFO: `/v3/projects/35d5eb48117d4659b82d6844f1b83842/users/0d3fd09f06874622b33c4d5318e64df9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:01.874260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064885c2-2001-49c3-ae21-0acd18a1e297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d5eb48117d4659b82d6844f1b83842, user_id=0d3fd09f06874622b33c4d5318e64df9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:01.877943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064885c2-2001-49c3-ae21-0acd18a1e297 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:01.915499 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3901/7765] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:01 2022] PUT /identity/v3/projects/35d5eb48117d4659b82d6844f1b83842/users/0d3fd09f06874622b33c4d5318e64df9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:36:01.920340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9f19e-1c0c-47cf-9967-391c52fbf9a6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:01.920906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9f19e-1c0c-47cf-9967-391c52fbf9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:01.921429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9f19e-1c0c-47cf-9967-391c52fbf9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:02.027862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-85c9f19e-1c0c-47cf-9967-391c52fbf9a6 None None] MFA Rules not processed for user `0d3fd09f06874622b33c4d5318e64df9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:02.029165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-85c9f19e-1c0c-47cf-9967-391c52fbf9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:02.185092 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3865/7766] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:02.200883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064885c2-2001-49c3-ae21-0acd18a1e297 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:02.202346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-064885c2-2001-49c3-ae21-0acd18a1e297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:02.315209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064885c2-2001-49c3-ae21-0acd18a1e297 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:02.328759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e4f32-26fc-4eaa-8438-0cf386015fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:02.330329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e4f32-26fc-4eaa-8438-0cf386015fdc service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:02.331965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e4f32-26fc-4eaa-8438-0cf386015fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:02.334125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e4f32-26fc-4eaa-8438-0cf386015fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:02.350526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e4f32-26fc-4eaa-8438-0cf386015fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:02.352808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e4f32-26fc-4eaa-8438-0cf386015fdc service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:02.367237 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3902/7767] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:02.509681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9f19e-1c0c-47cf-9967-391c52fbf9a6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:02.515856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-85c9f19e-1c0c-47cf-9967-391c52fbf9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:02.576273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9f19e-1c0c-47cf-9967-391c52fbf9a6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:02.584735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f5859-980a-49d2-9b90-b86672900769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:02.585372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f5859-980a-49d2-9b90-b86672900769 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:02.585655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f5859-980a-49d2-9b90-b86672900769 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:02.585932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f5859-980a-49d2-9b90-b86672900769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:02.592013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b56f5859-980a-49d2-9b90-b86672900769 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:02.656556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e4f32-26fc-4eaa-8438-0cf386015fdc service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:02.658808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0c7e4f32-26fc-4eaa-8438-0cf386015fdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:02.692547 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:02.727772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f5859-980a-49d2-9b90-b86672900769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:02.729032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f5859-980a-49d2-9b90-b86672900769 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:02.736296 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:02.742277 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3866/7768] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:02.817603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e4f32-26fc-4eaa-8438-0cf386015fdc service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:02.852158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:02.854187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:02.854476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:02.856212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] PATH_INFO: `/v3/projects/8a264fc1ca5e44c09591c78f7363e35b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:02.859292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a264fc1ca5e44c09591c78f7363e35b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:02.863589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:02.977507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a264fc1ca5e44c09591c78f7363e35b', 'request_id': 'req-11741e0f-1b1f-469a-821d-ed38ef774cf5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:02.996091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a264fc1ca5e44c09591c78f7363e35b', 'request_id': 'req-11741e0f-1b1f-469a-821d-ed38ef774cf5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:03.003369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a264fc1ca5e44c09591c78f7363e35b', 'request_id': 'req-11741e0f-1b1f-469a-821d-ed38ef774cf5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:03.025803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] The token cache is being invalidate because project 8a264fc1ca5e44c09591c78f7363e35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:03.026164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:03.026874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-11741e0f-1b1f-469a-821d-ed38ef774cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:03.032263 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3903/7769] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:02 2022] DELETE /identity/v3/projects/8a264fc1ca5e44c09591c78f7363e35b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:03.034042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7985e-1796-49ca-8ccf-c6c6ac6dedbb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.034839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7985e-1796-49ca-8ccf-c6c6ac6dedbb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.035277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7985e-1796-49ca-8ccf-c6c6ac6dedbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.075181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-97f7985e-1796-49ca-8ccf-c6c6ac6dedbb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:03.076417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-97f7985e-1796-49ca-8ccf-c6c6ac6dedbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:03.183017 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3867/7770] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:03.193457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430dc1b-f537-4419-9e61-d7fe5f203068 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.193763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430dc1b-f537-4419-9e61-d7fe5f203068 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.194011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430dc1b-f537-4419-9e61-d7fe5f203068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.218654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b430dc1b-f537-4419-9e61-d7fe5f203068 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:03.219903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b430dc1b-f537-4419-9e61-d7fe5f203068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:03.234372 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3904/7771] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:03.234952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7985e-1796-49ca-8ccf-c6c6ac6dedbb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:03.245954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7985e-1796-49ca-8ccf-c6c6ac6dedbb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:03.254951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530955-30e4-44cc-b38f-2288404a1a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:03.255579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530955-30e4-44cc-b38f-2288404a1a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.255860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530955-30e4-44cc-b38f-2288404a1a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.256132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530955-30e4-44cc-b38f-2288404a1a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.256791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9530955-30e4-44cc-b38f-2288404a1a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:36:03.257150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9530955-30e4-44cc-b38f-2288404a1a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:03.259601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9530955-30e4-44cc-b38f-2288404a1a24 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:03.276592 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3868/7772] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:36:03.283372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430dc1b-f537-4419-9e61-d7fe5f203068 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:03.295084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430dc1b-f537-4419-9e61-d7fe5f203068 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:03.301338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbbc6b-68a1-46c8-bd5d-23283993259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:03.302051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbbc6b-68a1-46c8-bd5d-23283993259a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.302404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbbc6b-68a1-46c8-bd5d-23283993259a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.302792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbbc6b-68a1-46c8-bd5d-23283993259a admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.303546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbbc6b-68a1-46c8-bd5d-23283993259a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:03.305826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbbc6b-68a1-46c8-bd5d-23283993259a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:03.348259 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3905/7773] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:03 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:03.349095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530955-30e4-44cc-b38f-2288404a1a24 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:03.364294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530955-30e4-44cc-b38f-2288404a1a24 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:03.449848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d0e8d-483d-4c37-9383-26b4cb898609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:03.450757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d0e8d-483d-4c37-9383-26b4cb898609 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.451049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d0e8d-483d-4c37-9383-26b4cb898609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.451328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d0e8d-483d-4c37-9383-26b4cb898609 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.452153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d0e8d-483d-4c37-9383-26b4cb898609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:03.454508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d0e8d-483d-4c37-9383-26b4cb898609 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:03.491549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbbc6b-68a1-46c8-bd5d-23283993259a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:03.503384 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3869/7774] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:03 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:36:03.507148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbbc6b-68a1-46c8-bd5d-23283993259a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:03.512219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debd6c-5aa2-4bcf-982b-1796e9adc7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:03.512972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debd6c-5aa2-4bcf-982b-1796e9adc7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.513255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debd6c-5aa2-4bcf-982b-1796e9adc7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.513810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debd6c-5aa2-4bcf-982b-1796e9adc7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.514379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debd6c-5aa2-4bcf-982b-1796e9adc7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:03.516401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debd6c-5aa2-4bcf-982b-1796e9adc7f3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:03.533781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d0e8d-483d-4c37-9383-26b4cb898609 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:03.546136 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3906/7775] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:03.549605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d0e8d-483d-4c37-9383-26b4cb898609 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:03.557411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce56f3-65da-4097-b582-7d205cefad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:03.557693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce56f3-65da-4097-b582-7d205cefad7f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.557983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce56f3-65da-4097-b582-7d205cefad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.558260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce56f3-65da-4097-b582-7d205cefad7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.558936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce56f3-65da-4097-b582-7d205cefad7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:03.560564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce56f3-65da-4097-b582-7d205cefad7f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:03.579580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debd6c-5aa2-4bcf-982b-1796e9adc7f3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:03.598402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debd6c-5aa2-4bcf-982b-1796e9adc7f3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:03.598511 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3870/7776] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:03.598591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9751f-ab2d-443d-9dc3-c4a934837db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:03.599234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9751f-ab2d-443d-9dc3-c4a934837db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.599546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9751f-ab2d-443d-9dc3-c4a934837db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.599823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9751f-ab2d-443d-9dc3-c4a934837db6 admin admin] PATH_INFO: `/v3/projects/658f5b1095bd4906921358b04a453428/users/f59673db93204962b491adcae8c4e656/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.615836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9751f-ab2d-443d-9dc3-c4a934837db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658f5b1095bd4906921358b04a453428, user_id=f59673db93204962b491adcae8c4e656, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:03.618639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9751f-ab2d-443d-9dc3-c4a934837db6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:03.637411 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3907/7777] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:03 2022] PUT /identity/v3/projects/658f5b1095bd4906921358b04a453428/users/f59673db93204962b491adcae8c4e656/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:03.648375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32a8c-0d1b-4a08-a476-5c4937b4e93c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.648666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32a8c-0d1b-4a08-a476-5c4937b4e93c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.648944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f32a8c-0d1b-4a08-a476-5c4937b4e93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.679373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-24f32a8c-0d1b-4a08-a476-5c4937b4e93c None None] MFA Rules not processed for user `f59673db93204962b491adcae8c4e656`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:03.680595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-24f32a8c-0d1b-4a08-a476-5c4937b4e93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:03.730832 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:03.777312 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3871/7778] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:03.781869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9751f-ab2d-443d-9dc3-c4a934837db6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:03.793370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9751f-ab2d-443d-9dc3-c4a934837db6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:03.798265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b03a-6b1a-4124-aead-0f2a9f6742b4 tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59673db93204962b491adcae8c4e656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658f5b1095bd4906921358b04a453428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:03.799721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b03a-6b1a-4124-aead-0f2a9f6742b4 tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.800077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b03a-6b1a-4124-aead-0f2a9f6742b4 tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.800425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b03a-6b1a-4124-aead-0f2a9f6742b4 tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] PATH_INFO: `/v3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.805864 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3908/7779] 10.222.0.23 () {58 vars in 1104 bytes} [Sun Oct 2 01:36:03 2022] GET /identity/v3 => generated 255 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:36:03.807142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f32a8c-0d1b-4a08-a476-5c4937b4e93c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:03.816956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f32a8c-0d1b-4a08-a476-5c4937b4e93c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:03.822729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be248fb-b979-4995-8d76-a9c729037373 tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59673db93204962b491adcae8c4e656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658f5b1095bd4906921358b04a453428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:03.823562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be248fb-b979-4995-8d76-a9c729037373 tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.823688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be248fb-b979-4995-8d76-a9c729037373 tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.823931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be248fb-b979-4995-8d76-a9c729037373 tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] PATH_INFO: `/v3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.825446 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3872/7780] 10.222.0.23 () {58 vars in 1104 bytes} [Sun Oct 2 01:36:03 2022] GET /identity/v3 => generated 255 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:36:03.830897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b03a-6b1a-4124-aead-0f2a9f6742b4 tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:03.842589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b03a-6b1a-4124-aead-0f2a9f6742b4 tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:03.847538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c8b6d-9f30-4006-8a54-828079d2339f tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59673db93204962b491adcae8c4e656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658f5b1095bd4906921358b04a453428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:03.848263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c8b6d-9f30-4006-8a54-828079d2339f tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.848618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c8b6d-9f30-4006-8a54-828079d2339f tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.848967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c8b6d-9f30-4006-8a54-828079d2339f tempest-TestApiDiscovery-52078393 tempest-TestApiDiscovery-52078393-project] PATH_INFO: `/v3` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.854891 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3909/7781] 10.222.0.23 () {58 vars in 1104 bytes} [Sun Oct 2 01:36:03 2022] GET /identity/v3 => generated 255 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:36:03.857502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fe87-b78b-4cc0-91fc-cbf569ede5d0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.858040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fe87-b78b-4cc0-91fc-cbf569ede5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.858761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fe87-b78b-4cc0-91fc-cbf569ede5d0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.862221 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3873/7782] 10.222.0.23 () {56 vars in 895 bytes} [Sun Oct 2 01:36:03 2022] GET /identity/ => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:36:03.867327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9316cd-c6ec-4bb8-9ba1-884939b5f5f2 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:03.867678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9316cd-c6ec-4bb8-9ba1-884939b5f5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:03.868047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9316cd-c6ec-4bb8-9ba1-884939b5f5f2 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:03.869690 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3910/7783] 10.222.0.23 () {56 vars in 895 bytes} [Sun Oct 2 01:36:03 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:36:03.874523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48fe87-b78b-4cc0-91fc-cbf569ede5d0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:03.999549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48fe87-b78b-4cc0-91fc-cbf569ede5d0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:04.006071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:04.007712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:04.010332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:04.010646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] PATH_INFO: `/v3/users/f59673db93204962b491adcae8c4e656` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:04.012928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59673db93204962b491adcae8c4e656)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:04.016107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:04.103622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59673db93204962b491adcae8c4e656'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:04.132053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59673db93204962b491adcae8c4e656'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:04.132931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59673db93204962b491adcae8c4e656'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:04.144999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59673db93204962b491adcae8c4e656'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:04.160962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59673db93204962b491adcae8c4e656'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:04.174699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044ad6-0224-47c5-8c95-cfb61e4fabc3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:04.175851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044ad6-0224-47c5-8c95-cfb61e4fabc3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:04.176320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044ad6-0224-47c5-8c95-cfb61e4fabc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:04.182798 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3874/7784] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:03 2022] DELETE /identity/v3/users/f59673db93204962b491adcae8c4e656 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:36:04.204227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bf044ad6-0224-47c5-8c95-cfb61e4fabc3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:04.205903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bf044ad6-0224-47c5-8c95-cfb61e4fabc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:04.283345 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:04.331398 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3911/7785] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:04.342028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:04.343660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:04.476452 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:04.488133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4d751-b310-47df-9410-1b6fe93bca01 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:04.496424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc9091-19c6-47ee-bb79-48e21eaf5951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:04.497639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc9091-19c6-47ee-bb79-48e21eaf5951 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:04.499116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc9091-19c6-47ee-bb79-48e21eaf5951 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:04.502243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc9091-19c6-47ee-bb79-48e21eaf5951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:04.532047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc9091-19c6-47ee-bb79-48e21eaf5951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:04.535104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc9091-19c6-47ee-bb79-48e21eaf5951 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:04.558194 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3875/7786] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:05.184819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf044ad6-0224-47c5-8c95-cfb61e4fabc3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:05.186879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bf044ad6-0224-47c5-8c95-cfb61e4fabc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:05.207346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf044ad6-0224-47c5-8c95-cfb61e4fabc3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:05.219544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:05.220922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:05.221741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:05.222375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] PATH_INFO: `/v3/projects/658f5b1095bd4906921358b04a453428` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:05.224053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=658f5b1095bd4906921358b04a453428)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:05.226318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:05.329793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658f5b1095bd4906921358b04a453428', 'request_id': 'req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:05.347571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658f5b1095bd4906921358b04a453428', 'request_id': 'req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:05.358185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658f5b1095bd4906921358b04a453428', 'request_id': 'req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:05.390537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] The token cache is being invalidate because project 658f5b1095bd4906921358b04a453428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:05.391714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:05.394012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-973957df-14f6-4f45-a4ad-0b5b25f0cc1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:05.404406 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3912/7787] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:05 2022] DELETE /identity/v3/projects/658f5b1095bd4906921358b04a453428 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:05.409763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a1b2-7705-43a0-a6c5-c69c00935483 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:05.410257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a1b2-7705-43a0-a6c5-c69c00935483 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:05.410352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a1b2-7705-43a0-a6c5-c69c00935483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:05.475887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1492a1b2-7705-43a0-a6c5-c69c00935483 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:05.477127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1492a1b2-7705-43a0-a6c5-c69c00935483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:05.589487 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3876/7788] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:05.597948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1541e2-cd52-4978-a793-579e035e6c84 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:05.598182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1541e2-cd52-4978-a793-579e035e6c84 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:05.598949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1541e2-cd52-4978-a793-579e035e6c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:05.645517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-da1541e2-cd52-4978-a793-579e035e6c84 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:05.647348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-da1541e2-cd52-4978-a793-579e035e6c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:05.668751 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3913/7789] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:05.672816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492a1b2-7705-43a0-a6c5-c69c00935483 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:05.685410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492a1b2-7705-43a0-a6c5-c69c00935483 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:05.698845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cee279-93b5-449f-8c0f-b306be9bfa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:05.699479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cee279-93b5-449f-8c0f-b306be9bfa2f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:05.700071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cee279-93b5-449f-8c0f-b306be9bfa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:05.700071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cee279-93b5-449f-8c0f-b306be9bfa2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:05.700683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cee279-93b5-449f-8c0f-b306be9bfa2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:36:05.700989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cee279-93b5-449f-8c0f-b306be9bfa2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:05.705318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cee279-93b5-449f-8c0f-b306be9bfa2f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:05.728930 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3877/7790] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:36:05.733463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1541e2-cd52-4978-a793-579e035e6c84 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:05.750438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1541e2-cd52-4978-a793-579e035e6c84 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:05.765248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac08766-e658-4a3b-9c1f-700558249dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:05.766337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac08766-e658-4a3b-9c1f-700558249dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:05.766995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac08766-e658-4a3b-9c1f-700558249dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:05.769356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac08766-e658-4a3b-9c1f-700558249dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:05.770778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac08766-e658-4a3b-9c1f-700558249dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:05.773956 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac08766-e658-4a3b-9c1f-700558249dfe admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:05.880260 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3914/7791] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:05 2022] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:05.884148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cee279-93b5-449f-8c0f-b306be9bfa2f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:05.910476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cee279-93b5-449f-8c0f-b306be9bfa2f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:06.156666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630afc42-d9a0-4fc9-adc2-cc34d127bb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:06.157307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afc42-d9a0-4fc9-adc2-cc34d127bb3b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:06.157683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afc42-d9a0-4fc9-adc2-cc34d127bb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:06.158665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afc42-d9a0-4fc9-adc2-cc34d127bb3b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:06.159868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630afc42-d9a0-4fc9-adc2-cc34d127bb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:06.165719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630afc42-d9a0-4fc9-adc2-cc34d127bb3b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:06.231235 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3878/7792] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:05 2022] POST /identity/v3/users => generated 306 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:36:06.235845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac08766-e658-4a3b-9c1f-700558249dfe admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:06.271462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac08766-e658-4a3b-9c1f-700558249dfe admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:06.282075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d5a14-edb1-4f6b-be36-0704c66b17b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:06.282855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d5a14-edb1-4f6b-be36-0704c66b17b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:06.283249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d5a14-edb1-4f6b-be36-0704c66b17b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:06.283595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d5a14-edb1-4f6b-be36-0704c66b17b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:06.284355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d5a14-edb1-4f6b-be36-0704c66b17b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:06.286157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d5a14-edb1-4f6b-be36-0704c66b17b1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:06.300419 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3915/7793] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:06.304326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630afc42-d9a0-4fc9-adc2-cc34d127bb3b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:06.333603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630afc42-d9a0-4fc9-adc2-cc34d127bb3b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:06.344474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb900755-c9d1-466f-9c4a-d44fb822decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:06.345513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb900755-c9d1-466f-9c4a-d44fb822decc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:06.346305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb900755-c9d1-466f-9c4a-d44fb822decc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:06.346814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb900755-c9d1-466f-9c4a-d44fb822decc admin admin] PATH_INFO: `/v3/projects/dd756d15e44a429ea48fb5cc22abba8e/users/671ced291f6842088f5b74c51f24ef84/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:06.368767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb900755-c9d1-466f-9c4a-d44fb822decc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd756d15e44a429ea48fb5cc22abba8e, user_id=671ced291f6842088f5b74c51f24ef84, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:06.371980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb900755-c9d1-466f-9c4a-d44fb822decc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:06.395362 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3879/7794] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:06 2022] PUT /identity/v3/projects/dd756d15e44a429ea48fb5cc22abba8e/users/671ced291f6842088f5b74c51f24ef84/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:36:06.396300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d5a14-edb1-4f6b-be36-0704c66b17b1 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:06.412844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d5a14-edb1-4f6b-be36-0704c66b17b1 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:06.529898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44424be-e97b-4cd0-b4c0-e6ffd169cea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:06.530813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44424be-e97b-4cd0-b4c0-e6ffd169cea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:06.531105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44424be-e97b-4cd0-b4c0-e6ffd169cea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:06.531386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44424be-e97b-4cd0-b4c0-e6ffd169cea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:06.532041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44424be-e97b-4cd0-b4c0-e6ffd169cea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:06.534448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44424be-e97b-4cd0-b4c0-e6ffd169cea4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:06.559768 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3916/7795] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:36:06.559982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb900755-c9d1-466f-9c4a-d44fb822decc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:06.581185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb900755-c9d1-466f-9c4a-d44fb822decc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:06.596241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b62f-13ae-41d1-a72c-e9696a3fa9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:06.597221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b62f-13ae-41d1-a72c-e9696a3fa9ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:06.597988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b62f-13ae-41d1-a72c-e9696a3fa9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:06.598285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b62f-13ae-41d1-a72c-e9696a3fa9ab admin admin] PATH_INFO: `/v3/projects/dd756d15e44a429ea48fb5cc22abba8e/users/671ced291f6842088f5b74c51f24ef84/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:06.606352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863b62f-13ae-41d1-a72c-e9696a3fa9ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd756d15e44a429ea48fb5cc22abba8e, user_id=671ced291f6842088f5b74c51f24ef84, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:06.613032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863b62f-13ae-41d1-a72c-e9696a3fa9ab admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:06.640138 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3880/7796] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:06 2022] PUT /identity/v3/projects/dd756d15e44a429ea48fb5cc22abba8e/users/671ced291f6842088f5b74c51f24ef84/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:36:06.641587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f47fa-f4ae-4e5b-b9b8-562b140b1a43 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:06.642511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f47fa-f4ae-4e5b-b9b8-562b140b1a43 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:06.642968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f47fa-f4ae-4e5b-b9b8-562b140b1a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:06.683281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-071f47fa-f4ae-4e5b-b9b8-562b140b1a43 None None] MFA Rules not processed for user `671ced291f6842088f5b74c51f24ef84`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:06.684522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-071f47fa-f4ae-4e5b-b9b8-562b140b1a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:06.708552 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:06.840583 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3917/7797] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:06 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:06.845017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b62f-13ae-41d1-a72c-e9696a3fa9ab admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:06.922305 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:06.986876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b62f-13ae-41d1-a72c-e9696a3fa9ab admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:07.000297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e09cae-69cd-4a1c-8142-fe8e846f4a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:07.000297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09cae-69cd-4a1c-8142-fe8e846f4a0d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:07.000297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09cae-69cd-4a1c-8142-fe8e846f4a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:07.000297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09cae-69cd-4a1c-8142-fe8e846f4a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:07.000629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e09cae-69cd-4a1c-8142-fe8e846f4a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:07.000629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e09cae-69cd-4a1c-8142-fe8e846f4a0d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:07.070501 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3881/7798] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:06 2022] POST /identity/v3/projects => generated 399 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:07.074574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f47fa-f4ae-4e5b-b9b8-562b140b1a43 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:07.092612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f47fa-f4ae-4e5b-b9b8-562b140b1a43 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:07.214914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c62fc-8d21-40af-8ba1-f24c77da38e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:07.215923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c62fc-8d21-40af-8ba1-f24c77da38e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:07.216424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c62fc-8d21-40af-8ba1-f24c77da38e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:07.216902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c62fc-8d21-40af-8ba1-f24c77da38e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:07.217764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c62fc-8d21-40af-8ba1-f24c77da38e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:07.222161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c62fc-8d21-40af-8ba1-f24c77da38e9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:07.269084 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3918/7799] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:07 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:36:07.271261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e09cae-69cd-4a1c-8142-fe8e846f4a0d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:07.283945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e09cae-69cd-4a1c-8142-fe8e846f4a0d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:07.304496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea946f-bf0f-4164-a5fb-ab2034ecfe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:07.305408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea946f-bf0f-4164-a5fb-ab2034ecfe18 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:07.305899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea946f-bf0f-4164-a5fb-ab2034ecfe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:07.306404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea946f-bf0f-4164-a5fb-ab2034ecfe18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:07.307305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea946f-bf0f-4164-a5fb-ab2034ecfe18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:07.309565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea946f-bf0f-4164-a5fb-ab2034ecfe18 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:07.340123 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3882/7800] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:07.341490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c62fc-8d21-40af-8ba1-f24c77da38e9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:07.376450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c62fc-8d21-40af-8ba1-f24c77da38e9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:07.405209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff8923-a092-41ba-b5dc-9b54ade1ed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:07.405864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8923-a092-41ba-b5dc-9b54ade1ed9d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:07.407993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8923-a092-41ba-b5dc-9b54ade1ed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:07.409390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8923-a092-41ba-b5dc-9b54ade1ed9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:07.413833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff8923-a092-41ba-b5dc-9b54ade1ed9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:07.415574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff8923-a092-41ba-b5dc-9b54ade1ed9d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:07.457969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea946f-bf0f-4164-a5fb-ab2034ecfe18 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:07.458408 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3919/7801] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:07.473386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea946f-bf0f-4164-a5fb-ab2034ecfe18 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:07.493899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f51dd-c8a1-45e1-aa48-da8eaff6e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:07.494633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f51dd-c8a1-45e1-aa48-da8eaff6e6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:07.494917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f51dd-c8a1-45e1-aa48-da8eaff6e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:07.495196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f51dd-c8a1-45e1-aa48-da8eaff6e6b9 admin admin] PATH_INFO: `/v3/projects/f6b0a5b202ee45b0b0758c3294379acf/users/0c6dc48473f54d0bb6dd69c204985467/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:07.541555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f51dd-c8a1-45e1-aa48-da8eaff6e6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b0a5b202ee45b0b0758c3294379acf, user_id=0c6dc48473f54d0bb6dd69c204985467, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:07.544533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f51dd-c8a1-45e1-aa48-da8eaff6e6b9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:07.578703 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3883/7802] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:07 2022] PUT /identity/v3/projects/f6b0a5b202ee45b0b0758c3294379acf/users/0c6dc48473f54d0bb6dd69c204985467/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:07.583283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167f88f-5d7e-4e0c-af5a-9d9f822dd4ce None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:07.583600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167f88f-5d7e-4e0c-af5a-9d9f822dd4ce None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:07.583878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167f88f-5d7e-4e0c-af5a-9d9f822dd4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:07.645244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9167f88f-5d7e-4e0c-af5a-9d9f822dd4ce None None] MFA Rules not processed for user `0c6dc48473f54d0bb6dd69c204985467`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:07.647128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9167f88f-5d7e-4e0c-af5a-9d9f822dd4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:07.827528 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3920/7803] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:07.840565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f51dd-c8a1-45e1-aa48-da8eaff6e6b9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:07.842425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5b5f51dd-c8a1-45e1-aa48-da8eaff6e6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:07.995048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f51dd-c8a1-45e1-aa48-da8eaff6e6b9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:07.999327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b20a7-fe64-4b51-b509-85ebfbfd4b3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:07.999327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b20a7-fe64-4b51-b509-85ebfbfd4b3f service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:07.999895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b20a7-fe64-4b51-b509-85ebfbfd4b3f service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:07.999895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b20a7-fe64-4b51-b509-85ebfbfd4b3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:08.074588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b20a7-fe64-4b51-b509-85ebfbfd4b3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:08.075953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b20a7-fe64-4b51-b509-85ebfbfd4b3f service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:08.100473 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3884/7804] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:08.866805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167f88f-5d7e-4e0c-af5a-9d9f822dd4ce None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:08.900520 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:09.069244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167f88f-5d7e-4e0c-af5a-9d9f822dd4ce None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:09.086022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:09.086712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:09.086994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:09.087270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] PATH_INFO: `/v3/users/671ced291f6842088f5b74c51f24ef84` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:09.096227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] RBAC: Authorizing `identity:delete_user(user_id=671ced291f6842088f5b74c51f24ef84)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:09.104879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:09.216651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671ced291f6842088f5b74c51f24ef84'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:09.239733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671ced291f6842088f5b74c51f24ef84'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:09.240488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671ced291f6842088f5b74c51f24ef84'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:09.250826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671ced291f6842088f5b74c51f24ef84'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:09.252851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671ced291f6842088f5b74c51f24ef84'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:09.286423 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3921/7805] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:08 2022] DELETE /identity/v3/users/671ced291f6842088f5b74c51f24ef84 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:09.288145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9a66d-9857-4d68-ac7f-96ab6abef4df None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:09.288590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9a66d-9857-4d68-ac7f-96ab6abef4df None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:09.288681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9a66d-9857-4d68-ac7f-96ab6abef4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:09.327012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e0b9a66d-9857-4d68-ac7f-96ab6abef4df None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:09.328231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0b9a66d-9857-4d68-ac7f-96ab6abef4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:09.371595 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:09.516497 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3885/7806] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:09.523560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:09.525008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:09.637876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca434903-015a-4d67-a56f-c6a8562c512c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:09.652946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632cd3-23c3-432f-ae4b-1fa02df7a548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:09.653576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632cd3-23c3-432f-ae4b-1fa02df7a548 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:09.653851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632cd3-23c3-432f-ae4b-1fa02df7a548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:09.654122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632cd3-23c3-432f-ae4b-1fa02df7a548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:09.675498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632cd3-23c3-432f-ae4b-1fa02df7a548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:09.676957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632cd3-23c3-432f-ae4b-1fa02df7a548 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:09.703075 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3922/7807] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:10.707837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9a66d-9857-4d68-ac7f-96ab6abef4df None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:10.709294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0b9a66d-9857-4d68-ac7f-96ab6abef4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:10.732451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9a66d-9857-4d68-ac7f-96ab6abef4df None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:10.744479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:10.745392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:10.745900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:10.746688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] PATH_INFO: `/v3/projects/dd756d15e44a429ea48fb5cc22abba8e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:10.748372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd756d15e44a429ea48fb5cc22abba8e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:10.764075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:10.907992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd756d15e44a429ea48fb5cc22abba8e', 'request_id': 'req-c0da6009-cba1-4a40-a129-ce1babf0c2c2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:10.949833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd756d15e44a429ea48fb5cc22abba8e', 'request_id': 'req-c0da6009-cba1-4a40-a129-ce1babf0c2c2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:10.981956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd756d15e44a429ea48fb5cc22abba8e', 'request_id': 'req-c0da6009-cba1-4a40-a129-ce1babf0c2c2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:11.018916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] The token cache is being invalidate because project dd756d15e44a429ea48fb5cc22abba8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:11.019209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:11.020039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:11.026252 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3886/7808] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:10 2022] DELETE /identity/v3/projects/dd756d15e44a429ea48fb5cc22abba8e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:11.030252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632cd3-23c3-432f-ae4b-1fa02df7a548 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:11.043017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632cd3-23c3-432f-ae4b-1fa02df7a548 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:11.148789 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:11.189269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1da88-4eed-4e67-a0aa-faa3ad97dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:11.190165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1da88-4eed-4e67-a0aa-faa3ad97dce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:11.190793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1da88-4eed-4e67-a0aa-faa3ad97dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:11.191369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1da88-4eed-4e67-a0aa-faa3ad97dce6 admin admin] PATH_INFO: `/v3/users/0c6dc48473f54d0bb6dd69c204985467` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:11.192738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1da88-4eed-4e67-a0aa-faa3ad97dce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6dc48473f54d0bb6dd69c204985467)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:11.195920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1da88-4eed-4e67-a0aa-faa3ad97dce6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:11.306568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7f1da88-4eed-4e67-a0aa-faa3ad97dce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6dc48473f54d0bb6dd69c204985467'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:11.326284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7f1da88-4eed-4e67-a0aa-faa3ad97dce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6dc48473f54d0bb6dd69c204985467'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:11.327292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7f1da88-4eed-4e67-a0aa-faa3ad97dce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6dc48473f54d0bb6dd69c204985467'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:11.341303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7f1da88-4eed-4e67-a0aa-faa3ad97dce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6dc48473f54d0bb6dd69c204985467'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:11.342117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7f1da88-4eed-4e67-a0aa-faa3ad97dce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6dc48473f54d0bb6dd69c204985467'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:11.367640 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3923/7809] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:11 2022] DELETE /identity/v3/users/0c6dc48473f54d0bb6dd69c204985467 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:12.223564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:12.225002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:12.262951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da6009-cba1-4a40-a129-ce1babf0c2c2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:12.375535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:12.377203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:12.377664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:12.378107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] PATH_INFO: `/v3/projects/f6b0a5b202ee45b0b0758c3294379acf` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:12.379513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b0a5b202ee45b0b0758c3294379acf)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:12.381770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:12.459773 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:12.461862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b0a5b202ee45b0b0758c3294379acf', 'request_id': 'req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:12.470645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b0a5b202ee45b0b0758c3294379acf', 'request_id': 'req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:12.481102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b0a5b202ee45b0b0758c3294379acf', 'request_id': 'req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:12.497367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] The token cache is being invalidate because project f6b0a5b202ee45b0b0758c3294379acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:12.497933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:12.498948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92cf35b2-cb53-4a61-a5c6-b0df67ffafe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:12.502014 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3887/7810] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:12 2022] DELETE /identity/v3/projects/f6b0a5b202ee45b0b0758c3294379acf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:12.507951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2d429-e902-4161-8ddc-2317c9430a8b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:12.507951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2d429-e902-4161-8ddc-2317c9430a8b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:12.507951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2d429-e902-4161-8ddc-2317c9430a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:12.554370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d1c2d429-e902-4161-8ddc-2317c9430a8b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:12.555782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d1c2d429-e902-4161-8ddc-2317c9430a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:12.636206 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3924/7811] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:12.646195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a95ac-aae9-4c58-9edf-3b00b340e4e1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:12.646484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a95ac-aae9-4c58-9edf-3b00b340e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:12.646788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a95ac-aae9-4c58-9edf-3b00b340e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:12.694520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5c4a95ac-aae9-4c58-9edf-3b00b340e4e1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:12.695666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5c4a95ac-aae9-4c58-9edf-3b00b340e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:12.709084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3888/7812] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:12.713143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2d429-e902-4161-8ddc-2317c9430a8b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:12.729526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2d429-e902-4161-8ddc-2317c9430a8b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:12.749963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434dce7-fcf7-4a12-b8ae-a8b855e0f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:12.750665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434dce7-fcf7-4a12-b8ae-a8b855e0f107 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:12.751070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434dce7-fcf7-4a12-b8ae-a8b855e0f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:12.751588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434dce7-fcf7-4a12-b8ae-a8b855e0f107 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:12.752338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434dce7-fcf7-4a12-b8ae-a8b855e0f107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:36:12.752625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434dce7-fcf7-4a12-b8ae-a8b855e0f107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:12.754268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434dce7-fcf7-4a12-b8ae-a8b855e0f107 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:12.770795 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3925/7813] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:36:12.775089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a95ac-aae9-4c58-9edf-3b00b340e4e1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:12.786987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a95ac-aae9-4c58-9edf-3b00b340e4e1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:12.793289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02ba30-1d72-4461-a840-03fdfa88862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:12.794180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02ba30-1d72-4461-a840-03fdfa88862b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:12.794676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02ba30-1d72-4461-a840-03fdfa88862b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:12.795129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02ba30-1d72-4461-a840-03fdfa88862b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:12.795928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02ba30-1d72-4461-a840-03fdfa88862b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:12.798639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02ba30-1d72-4461-a840-03fdfa88862b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:12.858189 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3889/7814] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:12 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:12.862444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434dce7-fcf7-4a12-b8ae-a8b855e0f107 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:12.879876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434dce7-fcf7-4a12-b8ae-a8b855e0f107 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:12.986871 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:13.009393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc8a7b-7abc-45b6-a1e8-f48f90eddafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:13.010159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8a7b-7abc-45b6-a1e8-f48f90eddafa admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:13.010538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8a7b-7abc-45b6-a1e8-f48f90eddafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:13.010946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8a7b-7abc-45b6-a1e8-f48f90eddafa admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:13.011713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc8a7b-7abc-45b6-a1e8-f48f90eddafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:13.015526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc8a7b-7abc-45b6-a1e8-f48f90eddafa admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:13.051326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02ba30-1d72-4461-a840-03fdfa88862b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:13.063075 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3926/7815] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:12 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:13.070782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02ba30-1d72-4461-a840-03fdfa88862b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:13.086209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdf301-7c47-4376-ac4e-fae174d777c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:13.092620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf301-7c47-4376-ac4e-fae174d777c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:13.093004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf301-7c47-4376-ac4e-fae174d777c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:13.093294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf301-7c47-4376-ac4e-fae174d777c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:13.094468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdf301-7c47-4376-ac4e-fae174d777c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:13.097519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdf301-7c47-4376-ac4e-fae174d777c3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:13.114644 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3890/7816] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:13.116708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc8a7b-7abc-45b6-a1e8-f48f90eddafa admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:13.134430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc8a7b-7abc-45b6-a1e8-f48f90eddafa admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:13.143294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b08e7-72eb-466f-9ba2-490427f28204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:13.143914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b08e7-72eb-466f-9ba2-490427f28204 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:13.144194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b08e7-72eb-466f-9ba2-490427f28204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:13.144466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b08e7-72eb-466f-9ba2-490427f28204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:13.145115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b08e7-72eb-466f-9ba2-490427f28204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:13.146756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b08e7-72eb-466f-9ba2-490427f28204 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:13.179740 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3927/7817] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:13.180854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdf301-7c47-4376-ac4e-fae174d777c3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:13.199633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdf301-7c47-4376-ac4e-fae174d777c3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:13.224182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e1b9f-9246-444b-bf02-832ab91d6724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:13.225628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1b9f-9246-444b-bf02-832ab91d6724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:13.228054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1b9f-9246-444b-bf02-832ab91d6724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:13.230196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1b9f-9246-444b-bf02-832ab91d6724 admin admin] PATH_INFO: `/v3/projects/8a2e4f00f8724aebbfd26879989c3e48/users/8160a9fba8b54d2780c55b59305d751f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:13.302863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e1b9f-9246-444b-bf02-832ab91d6724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2e4f00f8724aebbfd26879989c3e48, user_id=8160a9fba8b54d2780c55b59305d751f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:13.305620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e1b9f-9246-444b-bf02-832ab91d6724 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:13.342848 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3891/7818] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:13 2022] PUT /identity/v3/projects/8a2e4f00f8724aebbfd26879989c3e48/users/8160a9fba8b54d2780c55b59305d751f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:13.354721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaccc9e-b8f4-4f5b-8992-2277b4740cc3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:13.355537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaccc9e-b8f4-4f5b-8992-2277b4740cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:13.356630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaccc9e-b8f4-4f5b-8992-2277b4740cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:13.399826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8eaccc9e-b8f4-4f5b-8992-2277b4740cc3 None None] MFA Rules not processed for user `8160a9fba8b54d2780c55b59305d751f`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:13.401503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8eaccc9e-b8f4-4f5b-8992-2277b4740cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:13.523331 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3928/7819] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:13.525491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e1b9f-9246-444b-bf02-832ab91d6724 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:13.717689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e1b9f-9246-444b-bf02-832ab91d6724 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:13.728267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e46806-bcb6-4d7d-bd96-e4a75e53230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:13.728909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e46806-bcb6-4d7d-bd96-e4a75e53230c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:13.729188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e46806-bcb6-4d7d-bd96-e4a75e53230c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:13.729462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e46806-bcb6-4d7d-bd96-e4a75e53230c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:13.730113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e46806-bcb6-4d7d-bd96-e4a75e53230c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:13.732108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e46806-bcb6-4d7d-bd96-e4a75e53230c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:13.801396 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3892/7820] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:13 2022] POST /identity/v3/projects => generated 385 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:13.802954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaccc9e-b8f4-4f5b-8992-2277b4740cc3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:13.821267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaccc9e-b8f4-4f5b-8992-2277b4740cc3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:13.942736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034415-9a57-4a7c-84a2-9b03f29fb30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:13.943549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034415-9a57-4a7c-84a2-9b03f29fb30c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:13.943826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034415-9a57-4a7c-84a2-9b03f29fb30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:13.944096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034415-9a57-4a7c-84a2-9b03f29fb30c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:13.944724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96034415-9a57-4a7c-84a2-9b03f29fb30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:13.946914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96034415-9a57-4a7c-84a2-9b03f29fb30c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:13.992506 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3929/7821] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:13 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:36:13.995925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e46806-bcb6-4d7d-bd96-e4a75e53230c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:14.011865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e46806-bcb6-4d7d-bd96-e4a75e53230c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:14.018176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03ec16-6399-4f8e-ac44-8123deac1531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:14.019073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ec16-6399-4f8e-ac44-8123deac1531 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:14.019532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ec16-6399-4f8e-ac44-8123deac1531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:14.019951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ec16-6399-4f8e-ac44-8123deac1531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:14.021472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03ec16-6399-4f8e-ac44-8123deac1531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:14.023883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03ec16-6399-4f8e-ac44-8123deac1531 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:14.041084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3893/7822] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:14.046080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034415-9a57-4a7c-84a2-9b03f29fb30c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:14.060533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034415-9a57-4a7c-84a2-9b03f29fb30c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:14.073744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19165c8d-43d6-47dd-bb9e-2bd0c97cbfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:14.074864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19165c8d-43d6-47dd-bb9e-2bd0c97cbfde admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:14.075073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19165c8d-43d6-47dd-bb9e-2bd0c97cbfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:14.075298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19165c8d-43d6-47dd-bb9e-2bd0c97cbfde admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:14.075982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19165c8d-43d6-47dd-bb9e-2bd0c97cbfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:14.077634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19165c8d-43d6-47dd-bb9e-2bd0c97cbfde admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:14.090019 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3930/7823] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:14.097751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03ec16-6399-4f8e-ac44-8123deac1531 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:14.112517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03ec16-6399-4f8e-ac44-8123deac1531 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:14.119369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace26a6-56d4-4e6d-883a-e62f08b39d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:14.120271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace26a6-56d4-4e6d-883a-e62f08b39d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:14.120649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace26a6-56d4-4e6d-883a-e62f08b39d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:14.121030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace26a6-56d4-4e6d-883a-e62f08b39d3e admin admin] PATH_INFO: `/v3/projects/4ca9c2fce0e54e27819d8b5a99aee18b/users/aa5db56a14364853a9a8abf898fc488f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:14.140816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace26a6-56d4-4e6d-883a-e62f08b39d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca9c2fce0e54e27819d8b5a99aee18b, user_id=aa5db56a14364853a9a8abf898fc488f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:14.144122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace26a6-56d4-4e6d-883a-e62f08b39d3e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:14.173868 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3894/7824] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:14 2022] PUT /identity/v3/projects/4ca9c2fce0e54e27819d8b5a99aee18b/users/aa5db56a14364853a9a8abf898fc488f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:14.196696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e614c1-915d-4fb7-805f-bbb5e1c4514d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:14.197080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e614c1-915d-4fb7-805f-bbb5e1c4514d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:14.197362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e614c1-915d-4fb7-805f-bbb5e1c4514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:14.264877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-10e614c1-915d-4fb7-805f-bbb5e1c4514d None None] MFA Rules not processed for user `aa5db56a14364853a9a8abf898fc488f`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:14.266095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-10e614c1-915d-4fb7-805f-bbb5e1c4514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:14.331815 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:14.547201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace26a6-56d4-4e6d-883a-e62f08b39d3e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:14.548405 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3931/7825] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:14.549781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ace26a6-56d4-4e6d-883a-e62f08b39d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:14.580584 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:14.707191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace26a6-56d4-4e6d-883a-e62f08b39d3e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:14.732997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f723b6-d87b-47fa-91b8-46d8b730f83b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:14.733849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f723b6-d87b-47fa-91b8-46d8b730f83b service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:14.734156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f723b6-d87b-47fa-91b8-46d8b730f83b service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:14.734439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f723b6-d87b-47fa-91b8-46d8b730f83b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:14.835421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f723b6-d87b-47fa-91b8-46d8b730f83b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:14.836964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f723b6-d87b-47fa-91b8-46d8b730f83b service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:14.848473 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3895/7826] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:36:15.049286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e614c1-915d-4fb7-805f-bbb5e1c4514d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:15.072709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e614c1-915d-4fb7-805f-bbb5e1c4514d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:15.092322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436afee-6f98-4021-9f22-fe0b74660986 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:15.092949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436afee-6f98-4021-9f22-fe0b74660986 service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:15.093227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436afee-6f98-4021-9f22-fe0b74660986 service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:15.093495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436afee-6f98-4021-9f22-fe0b74660986 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:15.117136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436afee-6f98-4021-9f22-fe0b74660986 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:15.118633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436afee-6f98-4021-9f22-fe0b74660986 service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:15.149033 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3932/7827] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:15.964893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f723b6-d87b-47fa-91b8-46d8b730f83b service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:16.132190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f723b6-d87b-47fa-91b8-46d8b730f83b service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:16.143809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:16.144367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:16.144973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:16.145389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] PATH_INFO: `/v3/users/8160a9fba8b54d2780c55b59305d751f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:16.147493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8160a9fba8b54d2780c55b59305d751f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:16.149902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:16.259008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8160a9fba8b54d2780c55b59305d751f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:16.286934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8160a9fba8b54d2780c55b59305d751f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:16.287829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8160a9fba8b54d2780c55b59305d751f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:16.300566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8160a9fba8b54d2780c55b59305d751f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:16.310275 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:16.333448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8160a9fba8b54d2780c55b59305d751f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:16.347290 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3896/7828] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:15 2022] DELETE /identity/v3/users/8160a9fba8b54d2780c55b59305d751f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:16.352274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffe547-351c-45d4-9736-eea4db193f0d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:16.353238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffe547-351c-45d4-9736-eea4db193f0d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:16.353703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffe547-351c-45d4-9736-eea4db193f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:16.395145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-21ffe547-351c-45d4-9736-eea4db193f0d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:16.397639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-21ffe547-351c-45d4-9736-eea4db193f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:16.577808 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3933/7829] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:16.599438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:16.601883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:16.761248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f5f76-5e65-4470-8796-0c1c71f12f3a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:16.772025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ac5f4-41b1-46dc-9c0a-21d1bf05a95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:16.772881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ac5f4-41b1-46dc-9c0a-21d1bf05a95e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:16.776213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ac5f4-41b1-46dc-9c0a-21d1bf05a95e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:16.776619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ac5f4-41b1-46dc-9c0a-21d1bf05a95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:16.806457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ac5f4-41b1-46dc-9c0a-21d1bf05a95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:16.814667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ac5f4-41b1-46dc-9c0a-21d1bf05a95e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:16.859073 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3897/7830] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:17.687582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffe547-351c-45d4-9736-eea4db193f0d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:17.691684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-21ffe547-351c-45d4-9736-eea4db193f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:17.722479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffe547-351c-45d4-9736-eea4db193f0d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:17.738148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:17.739255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:17.739845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:17.740298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] PATH_INFO: `/v3/projects/8a2e4f00f8724aebbfd26879989c3e48` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:17.750271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2e4f00f8724aebbfd26879989c3e48)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:17.753217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:17.926348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2e4f00f8724aebbfd26879989c3e48', 'request_id': 'req-e043f842-b9df-4bb1-8057-cd9b2fe77207'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:17.949504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2e4f00f8724aebbfd26879989c3e48', 'request_id': 'req-e043f842-b9df-4bb1-8057-cd9b2fe77207'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:17.974833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2e4f00f8724aebbfd26879989c3e48', 'request_id': 'req-e043f842-b9df-4bb1-8057-cd9b2fe77207'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:18.012763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] The token cache is being invalidate because project 8a2e4f00f8724aebbfd26879989c3e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:18.013349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:18.015439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:18.022179 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3934/7831] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:17 2022] DELETE /identity/v3/projects/8a2e4f00f8724aebbfd26879989c3e48 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:18.022964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ac5f4-41b1-46dc-9c0a-21d1bf05a95e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:18.042798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ac5f4-41b1-46dc-9c0a-21d1bf05a95e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:18.316851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db7e00-507d-4a21-9cc5-bbe0cd639bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:18.318021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7e00-507d-4a21-9cc5-bbe0cd639bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:18.318969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7e00-507d-4a21-9cc5-bbe0cd639bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:18.319328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7e00-507d-4a21-9cc5-bbe0cd639bd9 admin admin] PATH_INFO: `/v3/users/aa5db56a14364853a9a8abf898fc488f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:18.328073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db7e00-507d-4a21-9cc5-bbe0cd639bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5db56a14364853a9a8abf898fc488f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:18.334085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db7e00-507d-4a21-9cc5-bbe0cd639bd9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:18.495270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6db7e00-507d-4a21-9cc5-bbe0cd639bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5db56a14364853a9a8abf898fc488f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:18.538713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6db7e00-507d-4a21-9cc5-bbe0cd639bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5db56a14364853a9a8abf898fc488f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:18.538713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6db7e00-507d-4a21-9cc5-bbe0cd639bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5db56a14364853a9a8abf898fc488f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:18.557532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6db7e00-507d-4a21-9cc5-bbe0cd639bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5db56a14364853a9a8abf898fc488f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:18.589551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6db7e00-507d-4a21-9cc5-bbe0cd639bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5db56a14364853a9a8abf898fc488f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:18.618586 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3898/7832] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:18 2022] DELETE /identity/v3/users/aa5db56a14364853a9a8abf898fc488f => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:19.546320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:19.550348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:19.581868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043f842-b9df-4bb1-8057-cd9b2fe77207 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:19.698290 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:19.844647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:19.845693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:19.850274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:19.850817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] PATH_INFO: `/v3/projects/4ca9c2fce0e54e27819d8b5a99aee18b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:19.852378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca9c2fce0e54e27819d8b5a99aee18b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:19.855992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:20.131607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca9c2fce0e54e27819d8b5a99aee18b', 'request_id': 'req-3b45c4ed-aefe-49fb-91c8-41223183b56b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:20.174118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca9c2fce0e54e27819d8b5a99aee18b', 'request_id': 'req-3b45c4ed-aefe-49fb-91c8-41223183b56b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:20.223981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca9c2fce0e54e27819d8b5a99aee18b', 'request_id': 'req-3b45c4ed-aefe-49fb-91c8-41223183b56b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:20.298247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] The token cache is being invalidate because project 4ca9c2fce0e54e27819d8b5a99aee18b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:20.304095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:20.310973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3b45c4ed-aefe-49fb-91c8-41223183b56b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:20.320550 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3935/7833] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:19 2022] DELETE /identity/v3/projects/4ca9c2fce0e54e27819d8b5a99aee18b => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:20.326469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429a3f5-87da-4568-85c9-10e4d77a239e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:20.327114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429a3f5-87da-4568-85c9-10e4d77a239e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:20.327114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429a3f5-87da-4568-85c9-10e4d77a239e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:20.365972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e429a3f5-87da-4568-85c9-10e4d77a239e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:20.367513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e429a3f5-87da-4568-85c9-10e4d77a239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:20.456472 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:20.776869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09abe5-4063-4176-a71b-125dc9aebe17 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:20.778319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09abe5-4063-4176-a71b-125dc9aebe17 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:20.778636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09abe5-4063-4176-a71b-125dc9aebe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:20.808967 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3899/7834] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:20.824479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106530eb-e4f6-470e-a590-3d7bcd5c0124 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:20.825286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106530eb-e4f6-470e-a590-3d7bcd5c0124 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:20.825427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106530eb-e4f6-470e-a590-3d7bcd5c0124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:20.873641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3c09abe5-4063-4176-a71b-125dc9aebe17 None None] MFA Rules not processed for user `6a1352ee9dbe4587800e17d8b3287252`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:20.875511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3c09abe5-4063-4176-a71b-125dc9aebe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:20.918448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-106530eb-e4f6-470e-a590-3d7bcd5c0124 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:20.923791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-106530eb-e4f6-470e-a590-3d7bcd5c0124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:21.089012 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3900/7835] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:21.089012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106530eb-e4f6-470e-a590-3d7bcd5c0124 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:21.089012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106530eb-e4f6-470e-a590-3d7bcd5c0124 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:21.243831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752a300-6f2a-43dd-8d75-18c78cd47ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:21.243831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752a300-6f2a-43dd-8d75-18c78cd47ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:21.243831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752a300-6f2a-43dd-8d75-18c78cd47ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:21.243831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752a300-6f2a-43dd-8d75-18c78cd47ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:21.247462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752a300-6f2a-43dd-8d75-18c78cd47ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:36:21.247462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752a300-6f2a-43dd-8d75-18c78cd47ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:21.247462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752a300-6f2a-43dd-8d75-18c78cd47ef3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:21.247778 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3936/7836] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:36:21.252587 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3901/7837] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:36:21.253972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09abe5-4063-4176-a71b-125dc9aebe17 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:21.324030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09abe5-4063-4176-a71b-125dc9aebe17 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:21.348324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03bf4-ecfa-48d2-b8e0-ce4b84a3c285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:21.348886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03bf4-ecfa-48d2-b8e0-ce4b84a3c285 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:21.349168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03bf4-ecfa-48d2-b8e0-ce4b84a3c285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:21.349443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03bf4-ecfa-48d2-b8e0-ce4b84a3c285 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:21.350094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd03bf4-ecfa-48d2-b8e0-ce4b84a3c285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:21.372344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd03bf4-ecfa-48d2-b8e0-ce4b84a3c285 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:21.445116 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3937/7838] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:21 2022] POST /identity/v3/projects => generated 363 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:21.449124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752a300-6f2a-43dd-8d75-18c78cd47ef3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:21.467175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752a300-6f2a-43dd-8d75-18c78cd47ef3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:21.770517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58635a-aa41-4ec3-aa2d-6ac1e9aa1c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:21.771199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58635a-aa41-4ec3-aa2d-6ac1e9aa1c1e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:21.771455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58635a-aa41-4ec3-aa2d-6ac1e9aa1c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:21.771725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58635a-aa41-4ec3-aa2d-6ac1e9aa1c1e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:21.772369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58635a-aa41-4ec3-aa2d-6ac1e9aa1c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:21.776044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58635a-aa41-4ec3-aa2d-6ac1e9aa1c1e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:21.867226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03bf4-ecfa-48d2-b8e0-ce4b84a3c285 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:21.876495 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3902/7839] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:21 2022] POST /identity/v3/users => generated 282 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:21.884534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03bf4-ecfa-48d2-b8e0-ce4b84a3c285 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:21.902889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f3e37-f7cc-429d-bcd3-081b2f38f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:21.903724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f3e37-f7cc-429d-bcd3-081b2f38f39a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:21.904672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f3e37-f7cc-429d-bcd3-081b2f38f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:21.904672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f3e37-f7cc-429d-bcd3-081b2f38f39a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:21.905090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f3e37-f7cc-429d-bcd3-081b2f38f39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:21.906949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f3e37-f7cc-429d-bcd3-081b2f38f39a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:21.957782 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3938/7840] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:21.962043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58635a-aa41-4ec3-aa2d-6ac1e9aa1c1e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:21.983552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58635a-aa41-4ec3-aa2d-6ac1e9aa1c1e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:22.013422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36f622-9a37-4da4-9c4b-cd350c79c475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:22.015094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f622-9a37-4da4-9c4b-cd350c79c475 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:22.018154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f622-9a37-4da4-9c4b-cd350c79c475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:22.018549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f622-9a37-4da4-9c4b-cd350c79c475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:22.019274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36f622-9a37-4da4-9c4b-cd350c79c475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:22.020930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36f622-9a37-4da4-9c4b-cd350c79c475 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:22.052720 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3903/7841] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:22.056810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f3e37-f7cc-429d-bcd3-081b2f38f39a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:22.080443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f3e37-f7cc-429d-bcd3-081b2f38f39a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:22.103446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c850b4-e2fa-4e80-aca0-3640a6774861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:22.104427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c850b4-e2fa-4e80-aca0-3640a6774861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:22.104846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c850b4-e2fa-4e80-aca0-3640a6774861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:22.105251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c850b4-e2fa-4e80-aca0-3640a6774861 admin admin] PATH_INFO: `/v3/projects/26d02b0dd02b416b87686af334b7c7d9/users/9786d7875c4a454ba1cf28ed052f59d7/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:22.145570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c850b4-e2fa-4e80-aca0-3640a6774861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d02b0dd02b416b87686af334b7c7d9, user_id=9786d7875c4a454ba1cf28ed052f59d7, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:22.153656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c850b4-e2fa-4e80-aca0-3640a6774861 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:22.210378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1089607-8974-4041-9923-30ba161bc815 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:22.215764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1089607-8974-4041-9923-30ba161bc815 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:22.216665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1089607-8974-4041-9923-30ba161bc815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:22.221815 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3939/7842] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:22 2022] PUT /identity/v3/projects/26d02b0dd02b416b87686af334b7c7d9/users/9786d7875c4a454ba1cf28ed052f59d7/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:22.309352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c1089607-8974-4041-9923-30ba161bc815 None None] MFA Rules not processed for user `9786d7875c4a454ba1cf28ed052f59d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:22.310709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c1089607-8974-4041-9923-30ba161bc815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:22.553182 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3904/7843] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:22.565401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c850b4-e2fa-4e80-aca0-3640a6774861 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:22.567177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a9c850b4-e2fa-4e80-aca0-3640a6774861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:22.599131 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:22.725459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c850b4-e2fa-4e80-aca0-3640a6774861 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:22.737368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afaee4-040b-4af3-a634-ade0e6b923c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:22.738000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afaee4-040b-4af3-a634-ade0e6b923c4 service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:22.738279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afaee4-040b-4af3-a634-ade0e6b923c4 service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:22.738782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afaee4-040b-4af3-a634-ade0e6b923c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:22.759807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afaee4-040b-4af3-a634-ade0e6b923c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:22.761263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afaee4-040b-4af3-a634-ade0e6b923c4 service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:22.782760 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3940/7844] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:23.931526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1089607-8974-4041-9923-30ba161bc815 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:23.945748 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:24.148171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1089607-8974-4041-9923-30ba161bc815 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:24.157951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:24.158878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:24.160508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:24.160940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] PATH_INFO: `/v3/users/9786d7875c4a454ba1cf28ed052f59d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:24.163279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9786d7875c4a454ba1cf28ed052f59d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:24.167894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:24.331243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9786d7875c4a454ba1cf28ed052f59d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:24.361510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9786d7875c4a454ba1cf28ed052f59d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:24.365384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9786d7875c4a454ba1cf28ed052f59d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:24.413317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9786d7875c4a454ba1cf28ed052f59d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:24.425353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9786d7875c4a454ba1cf28ed052f59d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:24.445279 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3905/7845] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:23 2022] DELETE /identity/v3/users/9786d7875c4a454ba1cf28ed052f59d7 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:24.452173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b802a3-2856-4c08-b903-d3368a87cda2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:24.453114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b802a3-2856-4c08-b903-d3368a87cda2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:24.453609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b802a3-2856-4c08-b903-d3368a87cda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:24.510140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d0b802a3-2856-4c08-b903-d3368a87cda2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:24.511762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d0b802a3-2856-4c08-b903-d3368a87cda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:24.704368 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3941/7846] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:24.710912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:24.713056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:24.945207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597a7e8-2169-4a6c-a4b2-c9cea59e7ce7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:24.962763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e73e8-45a3-439a-b29f-0ad01ee7f1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:24.963869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e73e8-45a3-439a-b29f-0ad01ee7f1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:24.964406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e73e8-45a3-439a-b29f-0ad01ee7f1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:24.965575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e73e8-45a3-439a-b29f-0ad01ee7f1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:24.987909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e73e8-45a3-439a-b29f-0ad01ee7f1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:24.989615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e73e8-45a3-439a-b29f-0ad01ee7f1b9 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:25.018423 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3906/7847] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:25.913928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b802a3-2856-4c08-b903-d3368a87cda2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:25.915401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d0b802a3-2856-4c08-b903-d3368a87cda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:25.933737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b802a3-2856-4c08-b903-d3368a87cda2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:25.951319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:25.951922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:25.952206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:25.952476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] PATH_INFO: `/v3/projects/26d02b0dd02b416b87686af334b7c7d9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:25.953857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d02b0dd02b416b87686af334b7c7d9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:25.956007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:26.129796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d02b0dd02b416b87686af334b7c7d9', 'request_id': 'req-22db5bdc-4e83-4f8e-b307-5efa8bc86189'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:26.167521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d02b0dd02b416b87686af334b7c7d9', 'request_id': 'req-22db5bdc-4e83-4f8e-b307-5efa8bc86189'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:26.185701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d02b0dd02b416b87686af334b7c7d9', 'request_id': 'req-22db5bdc-4e83-4f8e-b307-5efa8bc86189'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:26.232876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] The token cache is being invalidate because project 26d02b0dd02b416b87686af334b7c7d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:26.233461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:26.234923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-22db5bdc-4e83-4f8e-b307-5efa8bc86189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:26.239034 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3942/7848] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:25 2022] DELETE /identity/v3/projects/26d02b0dd02b416b87686af334b7c7d9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:26.243658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75fa3d-dfd7-4d87-a380-2d71546e7fd7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:26.244587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75fa3d-dfd7-4d87-a380-2d71546e7fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:26.245048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75fa3d-dfd7-4d87-a380-2d71546e7fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:26.272775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7c75fa3d-dfd7-4d87-a380-2d71546e7fd7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:26.274914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c75fa3d-dfd7-4d87-a380-2d71546e7fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:26.327781 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:26.408406 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3907/7849] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:26.417694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190c498-186d-458c-a674-2fed511aef02 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:26.417881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190c498-186d-458c-a674-2fed511aef02 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:26.418362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190c498-186d-458c-a674-2fed511aef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:26.451348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6190c498-186d-458c-a674-2fed511aef02 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:26.453907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6190c498-186d-458c-a674-2fed511aef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:26.462876 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3943/7850] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:26.468397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75fa3d-dfd7-4d87-a380-2d71546e7fd7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:26.502593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75fa3d-dfd7-4d87-a380-2d71546e7fd7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:26.529619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b213d4-1c80-4d77-ad75-c28ca900c5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:26.530182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b213d4-1c80-4d77-ad75-c28ca900c5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:26.530465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b213d4-1c80-4d77-ad75-c28ca900c5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:26.530787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b213d4-1c80-4d77-ad75-c28ca900c5c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:26.532240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b213d4-1c80-4d77-ad75-c28ca900c5c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:36:26.532551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b213d4-1c80-4d77-ad75-c28ca900c5c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:26.534184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b213d4-1c80-4d77-ad75-c28ca900c5c9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:26.581293 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3908/7851] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:36:26.586012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190c498-186d-458c-a674-2fed511aef02 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:26.629762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190c498-186d-458c-a674-2fed511aef02 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:26.643864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380584c0-d36a-4a6d-84c0-9a3d21e9edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:26.646447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380584c0-d36a-4a6d-84c0-9a3d21e9edde admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:26.647048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380584c0-d36a-4a6d-84c0-9a3d21e9edde admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:26.657470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380584c0-d36a-4a6d-84c0-9a3d21e9edde admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:26.661388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380584c0-d36a-4a6d-84c0-9a3d21e9edde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:26.676190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380584c0-d36a-4a6d-84c0-9a3d21e9edde admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:26.752168 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3944/7852] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:26 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:26.756218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b213d4-1c80-4d77-ad75-c28ca900c5c9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:26.768266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b213d4-1c80-4d77-ad75-c28ca900c5c9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:26.965272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41739b79-555c-477b-b6a7-0cf495bbd5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:26.966066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41739b79-555c-477b-b6a7-0cf495bbd5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:26.966442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41739b79-555c-477b-b6a7-0cf495bbd5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:26.966836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41739b79-555c-477b-b6a7-0cf495bbd5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:26.967735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41739b79-555c-477b-b6a7-0cf495bbd5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:26.970476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41739b79-555c-477b-b6a7-0cf495bbd5b8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:26.998531 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3909/7853] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:26 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:27.002947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380584c0-d36a-4a6d-84c0-9a3d21e9edde admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:27.036826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380584c0-d36a-4a6d-84c0-9a3d21e9edde admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:27.051940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99827878-8be6-4a9a-a0e0-bd91006b2620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:27.052732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99827878-8be6-4a9a-a0e0-bd91006b2620 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:27.053017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99827878-8be6-4a9a-a0e0-bd91006b2620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:27.053290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99827878-8be6-4a9a-a0e0-bd91006b2620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:27.054210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99827878-8be6-4a9a-a0e0-bd91006b2620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:27.055923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99827878-8be6-4a9a-a0e0-bd91006b2620 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:27.061571 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:27.081692 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3945/7854] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:27.083336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41739b79-555c-477b-b6a7-0cf495bbd5b8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:27.095470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41739b79-555c-477b-b6a7-0cf495bbd5b8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:27.102918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acd6cc-03f7-46ef-b325-714465e0cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:27.104111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd6cc-03f7-46ef-b325-714465e0cfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:27.104578 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd6cc-03f7-46ef-b325-714465e0cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:27.105034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd6cc-03f7-46ef-b325-714465e0cfb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:27.105893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acd6cc-03f7-46ef-b325-714465e0cfb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:27.116386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acd6cc-03f7-46ef-b325-714465e0cfb9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:27.136565 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3910/7855] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:27.140987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99827878-8be6-4a9a-a0e0-bd91006b2620 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:27.159676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99827878-8be6-4a9a-a0e0-bd91006b2620 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:27.177183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b2d9c-d07a-4c72-a810-daa777c8026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:27.179423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2d9c-d07a-4c72-a810-daa777c8026f admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:27.179892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2d9c-d07a-4c72-a810-daa777c8026f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:27.181646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2d9c-d07a-4c72-a810-daa777c8026f admin admin] PATH_INFO: `/v3/projects/f60b1519680349c49b70905446be4a0b/users/875f09f827854baba38196383f4ea4b3/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:27.222840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b2d9c-d07a-4c72-a810-daa777c8026f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60b1519680349c49b70905446be4a0b, user_id=875f09f827854baba38196383f4ea4b3, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:27.231267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b2d9c-d07a-4c72-a810-daa777c8026f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:27.262661 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3946/7856] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:27 2022] PUT /identity/v3/projects/f60b1519680349c49b70905446be4a0b/users/875f09f827854baba38196383f4ea4b3/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:27.271747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadb4be-39a6-4c68-b0f3-dda0a78a522e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:27.272588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadb4be-39a6-4c68-b0f3-dda0a78a522e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:27.274038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadb4be-39a6-4c68-b0f3-dda0a78a522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:27.339900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8aadb4be-39a6-4c68-b0f3-dda0a78a522e None None] MFA Rules not processed for user `875f09f827854baba38196383f4ea4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:27.342508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8aadb4be-39a6-4c68-b0f3-dda0a78a522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:27.479290 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3911/7857] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:27.483920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b2d9c-d07a-4c72-a810-daa777c8026f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:27.602582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b2d9c-d07a-4c72-a810-daa777c8026f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:27.609012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54cfbc-ce52-4424-bba2-1f0c706f5570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:27.610862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54cfbc-ce52-4424-bba2-1f0c706f5570 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:27.611291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54cfbc-ce52-4424-bba2-1f0c706f5570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:27.611830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54cfbc-ce52-4424-bba2-1f0c706f5570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:27.612625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54cfbc-ce52-4424-bba2-1f0c706f5570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:27.615154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54cfbc-ce52-4424-bba2-1f0c706f5570 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:27.670891 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3947/7858] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:27 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:27.676228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadb4be-39a6-4c68-b0f3-dda0a78a522e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:27.700151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadb4be-39a6-4c68-b0f3-dda0a78a522e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:27.747001 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:27.847613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41962f-e3d4-4265-a753-172d7624dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:27.848253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41962f-e3d4-4265-a753-172d7624dc3a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:27.848537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41962f-e3d4-4265-a753-172d7624dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:27.852093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41962f-e3d4-4265-a753-172d7624dc3a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:27.853125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41962f-e3d4-4265-a753-172d7624dc3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:27.857763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41962f-e3d4-4265-a753-172d7624dc3a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:27.904845 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3912/7859] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:27 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:27.909901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54cfbc-ce52-4424-bba2-1f0c706f5570 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:27.921261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54cfbc-ce52-4424-bba2-1f0c706f5570 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:27.927706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69804260-9e6b-4d24-9ed8-fd4459e820e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:27.928335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69804260-9e6b-4d24-9ed8-fd4459e820e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:27.928618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69804260-9e6b-4d24-9ed8-fd4459e820e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:27.928893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69804260-9e6b-4d24-9ed8-fd4459e820e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:27.929597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69804260-9e6b-4d24-9ed8-fd4459e820e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:27.931350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69804260-9e6b-4d24-9ed8-fd4459e820e8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:27.959814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41962f-e3d4-4265-a753-172d7624dc3a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:27.974898 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3948/7860] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:27.983782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41962f-e3d4-4265-a753-172d7624dc3a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:27.998582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b387d-5c68-4590-ae12-eec9d1542890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:27.999521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b387d-5c68-4590-ae12-eec9d1542890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:28.000471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b387d-5c68-4590-ae12-eec9d1542890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:28.000855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b387d-5c68-4590-ae12-eec9d1542890 admin admin] PATH_INFO: `/v3/projects/9f7bada7c8c2415c9dfc308a7f9039d9/users/8da9a50b61104817bdd27cd53ea3f32b/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:28.045240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b387d-5c68-4590-ae12-eec9d1542890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7bada7c8c2415c9dfc308a7f9039d9, user_id=8da9a50b61104817bdd27cd53ea3f32b, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:28.048354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b387d-5c68-4590-ae12-eec9d1542890 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:28.072037 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3913/7861] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:27 2022] PUT /identity/v3/projects/9f7bada7c8c2415c9dfc308a7f9039d9/users/8da9a50b61104817bdd27cd53ea3f32b/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:36:28.076635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69804260-9e6b-4d24-9ed8-fd4459e820e8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:28.096503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69804260-9e6b-4d24-9ed8-fd4459e820e8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:28.246552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee2aa1-17fe-4dda-a7ba-6f8c161a9ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:28.247246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2aa1-17fe-4dda-a7ba-6f8c161a9ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:28.247530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2aa1-17fe-4dda-a7ba-6f8c161a9ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:28.247803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2aa1-17fe-4dda-a7ba-6f8c161a9ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:28.248461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee2aa1-17fe-4dda-a7ba-6f8c161a9ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:28.261456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee2aa1-17fe-4dda-a7ba-6f8c161a9ec1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:28.304165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b387d-5c68-4590-ae12-eec9d1542890 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:28.305289 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3949/7862] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:28.323672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b387d-5c68-4590-ae12-eec9d1542890 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:28.340152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778be5b7-40c8-4c48-a89e-8536740cc10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:28.340857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778be5b7-40c8-4c48-a89e-8536740cc10a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:28.341138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778be5b7-40c8-4c48-a89e-8536740cc10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:28.341411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778be5b7-40c8-4c48-a89e-8536740cc10a admin admin] PATH_INFO: `/v3/projects/9f7bada7c8c2415c9dfc308a7f9039d9/users/8da9a50b61104817bdd27cd53ea3f32b/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:28.348236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778be5b7-40c8-4c48-a89e-8536740cc10a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7bada7c8c2415c9dfc308a7f9039d9, user_id=8da9a50b61104817bdd27cd53ea3f32b, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:28.351114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778be5b7-40c8-4c48-a89e-8536740cc10a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:28.367591 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3914/7863] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:28 2022] PUT /identity/v3/projects/9f7bada7c8c2415c9dfc308a7f9039d9/users/8da9a50b61104817bdd27cd53ea3f32b/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:36:28.378915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abf3dd-b78d-45b8-ada3-6a47001fb2fe None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:28.379225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abf3dd-b78d-45b8-ada3-6a47001fb2fe None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:28.379476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abf3dd-b78d-45b8-ada3-6a47001fb2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:28.536705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a3abf3dd-b78d-45b8-ada3-6a47001fb2fe None None] MFA Rules not processed for user `8da9a50b61104817bdd27cd53ea3f32b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:28.537915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a3abf3dd-b78d-45b8-ada3-6a47001fb2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:28.674642 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:28.800055 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3950/7864] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:28.816192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778be5b7-40c8-4c48-a89e-8536740cc10a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:28.818361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-778be5b7-40c8-4c48-a89e-8536740cc10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:29.034379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778be5b7-40c8-4c48-a89e-8536740cc10a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:29.044690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbaff0-5a6c-477d-aa3d-48f49dd5268d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:29.045336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbaff0-5a6c-477d-aa3d-48f49dd5268d service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:29.045713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbaff0-5a6c-477d-aa3d-48f49dd5268d service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:29.046085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbaff0-5a6c-477d-aa3d-48f49dd5268d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:29.156724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbaff0-5a6c-477d-aa3d-48f49dd5268d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:29.162824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbaff0-5a6c-477d-aa3d-48f49dd5268d service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:29.185774 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3915/7865] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:30.054256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abf3dd-b78d-45b8-ada3-6a47001fb2fe None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:30.076412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abf3dd-b78d-45b8-ada3-6a47001fb2fe None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:30.086306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57808d3c-b87d-45af-9ffc-ea3ff2583380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:30.088358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57808d3c-b87d-45af-9ffc-ea3ff2583380 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:30.088901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57808d3c-b87d-45af-9ffc-ea3ff2583380 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:30.089325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57808d3c-b87d-45af-9ffc-ea3ff2583380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:30.126979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57808d3c-b87d-45af-9ffc-ea3ff2583380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:30.129632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57808d3c-b87d-45af-9ffc-ea3ff2583380 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:30.153549 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3951/7866] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:36:30.617049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbaff0-5a6c-477d-aa3d-48f49dd5268d service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:30.618504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-48dbaff0-5a6c-477d-aa3d-48f49dd5268d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:30.697995 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:30.757991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbaff0-5a6c-477d-aa3d-48f49dd5268d service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:30.767630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e0bcd-6343-429e-9d33-da4be8600168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:30.768203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e0bcd-6343-429e-9d33-da4be8600168 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:30.768487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e0bcd-6343-429e-9d33-da4be8600168 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:30.768992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e0bcd-6343-429e-9d33-da4be8600168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:30.771827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bf3e0bcd-6343-429e-9d33-da4be8600168 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:30.968601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e0bcd-6343-429e-9d33-da4be8600168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:30.971482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e0bcd-6343-429e-9d33-da4be8600168 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:30.988340 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3916/7867] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:37.292269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57808d3c-b87d-45af-9ffc-ea3ff2583380 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:37.293967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-57808d3c-b87d-45af-9ffc-ea3ff2583380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:37.319547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57808d3c-b87d-45af-9ffc-ea3ff2583380 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:37.328294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a66b17-ea97-4d7e-b644-4e8e993ddf01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:37.329546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a66b17-ea97-4d7e-b644-4e8e993ddf01 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:37.330286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a66b17-ea97-4d7e-b644-4e8e993ddf01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:37.330571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a66b17-ea97-4d7e-b644-4e8e993ddf01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:37.332594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-95a66b17-ea97-4d7e-b644-4e8e993ddf01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:37.451078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a66b17-ea97-4d7e-b644-4e8e993ddf01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:37.454302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a66b17-ea97-4d7e-b644-4e8e993ddf01 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:37.485816 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3952/7868] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:40.979273 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=44 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:45.215919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e0bcd-6343-429e-9d33-da4be8600168 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:45.357476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e0bcd-6343-429e-9d33-da4be8600168 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:45.371934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:45.372546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:45.372829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:45.373107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] PATH_INFO: `/v3/users/875f09f827854baba38196383f4ea4b3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:45.379557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=875f09f827854baba38196383f4ea4b3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:45.382859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:45.471513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '875f09f827854baba38196383f4ea4b3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:45.488560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '875f09f827854baba38196383f4ea4b3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:45.489576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '875f09f827854baba38196383f4ea4b3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:45.519601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '875f09f827854baba38196383f4ea4b3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:45.541478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '875f09f827854baba38196383f4ea4b3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:45.558734 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3917/7869] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:45 2022] DELETE /identity/v3/users/875f09f827854baba38196383f4ea4b3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:45.558958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774f224-1059-4318-8566-d409b8bf3272 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:45.558958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774f224-1059-4318-8566-d409b8bf3272 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:45.558958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774f224-1059-4318-8566-d409b8bf3272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:45.622174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7774f224-1059-4318-8566-d409b8bf3272 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:45.627678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7774f224-1059-4318-8566-d409b8bf3272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:45.781994 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3953/7870] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:36:45.793398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:45.796527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:45.936820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b356b-c76f-4409-a242-bd889262e1ed admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:45.945922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005b4c6-88e1-4fbe-a2ea-06b40e7e7672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:45.946563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b4c6-88e1-4fbe-a2ea-06b40e7e7672 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:45.946875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b4c6-88e1-4fbe-a2ea-06b40e7e7672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:45.947150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b4c6-88e1-4fbe-a2ea-06b40e7e7672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:45.974137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005b4c6-88e1-4fbe-a2ea-06b40e7e7672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:45.975794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005b4c6-88e1-4fbe-a2ea-06b40e7e7672 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:46.001437 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3918/7871] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:46.380146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774f224-1059-4318-8566-d409b8bf3272 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:46.382230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7774f224-1059-4318-8566-d409b8bf3272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:46.421713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774f224-1059-4318-8566-d409b8bf3272 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:46.435537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:46.438189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:46.438710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:46.439508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] PATH_INFO: `/v3/projects/f60b1519680349c49b70905446be4a0b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:46.441274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60b1519680349c49b70905446be4a0b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:46.445559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:46.513093 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:46.531394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60b1519680349c49b70905446be4a0b', 'request_id': 'req-50882464-7d5c-407c-a1be-e47d9b6d6e78'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:46.539779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60b1519680349c49b70905446be4a0b', 'request_id': 'req-50882464-7d5c-407c-a1be-e47d9b6d6e78'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:46.549370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60b1519680349c49b70905446be4a0b', 'request_id': 'req-50882464-7d5c-407c-a1be-e47d9b6d6e78'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:46.579505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] The token cache is being invalidate because project f60b1519680349c49b70905446be4a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:46.580143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:46.580563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:46.582117 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3954/7872] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:46 2022] DELETE /identity/v3/projects/f60b1519680349c49b70905446be4a0b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:46.586090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005b4c6-88e1-4fbe-a2ea-06b40e7e7672 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:46.601851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005b4c6-88e1-4fbe-a2ea-06b40e7e7672 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:46.643626 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:46.703321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce03cfc-991e-477f-b927-aed1787df861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:46.704213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03cfc-991e-477f-b927-aed1787df861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:46.704695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03cfc-991e-477f-b927-aed1787df861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:46.705184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03cfc-991e-477f-b927-aed1787df861 admin admin] PATH_INFO: `/v3/users/8da9a50b61104817bdd27cd53ea3f32b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:46.706533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce03cfc-991e-477f-b927-aed1787df861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da9a50b61104817bdd27cd53ea3f32b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:46.709111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce03cfc-991e-477f-b927-aed1787df861 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:46.775268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7ce03cfc-991e-477f-b927-aed1787df861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da9a50b61104817bdd27cd53ea3f32b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:46.794893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7ce03cfc-991e-477f-b927-aed1787df861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da9a50b61104817bdd27cd53ea3f32b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:46.796651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7ce03cfc-991e-477f-b927-aed1787df861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da9a50b61104817bdd27cd53ea3f32b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:46.807553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7ce03cfc-991e-477f-b927-aed1787df861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da9a50b61104817bdd27cd53ea3f32b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:46.838492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7ce03cfc-991e-477f-b927-aed1787df861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da9a50b61104817bdd27cd53ea3f32b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:46.852568 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3919/7873] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:46 2022] DELETE /identity/v3/users/8da9a50b61104817bdd27cd53ea3f32b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:47.132026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:47.133755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:47.154768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50882464-7d5c-407c-a1be-e47d9b6d6e78 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:47.257870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:47.258829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:47.259535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:47.259975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] PATH_INFO: `/v3/projects/9f7bada7c8c2415c9dfc308a7f9039d9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:47.261353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7bada7c8c2415c9dfc308a7f9039d9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:47.264496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:47.325191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7bada7c8c2415c9dfc308a7f9039d9', 'request_id': 'req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:47.332853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7bada7c8c2415c9dfc308a7f9039d9', 'request_id': 'req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:47.340164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7bada7c8c2415c9dfc308a7f9039d9', 'request_id': 'req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:47.362654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] The token cache is being invalidate because project 9f7bada7c8c2415c9dfc308a7f9039d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:47.363203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:47.364235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7c7a3803-a942-4f1e-9e92-913aa2b0cf69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:47.366243 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3955/7874] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:47 2022] DELETE /identity/v3/projects/9f7bada7c8c2415c9dfc308a7f9039d9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:47.372359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ce4e-3894-40f1-b88b-985d7c262adb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:47.372359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ce4e-3894-40f1-b88b-985d7c262adb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:47.372625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ce4e-3894-40f1-b88b-985d7c262adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:47.397506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ffa6ce4e-3894-40f1-b88b-985d7c262adb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:47.401709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ffa6ce4e-3894-40f1-b88b-985d7c262adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:47.502158 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3920/7875] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:47.510118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a4c5-5dd7-4e7d-9af9-2af3199a980b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:47.510743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a4c5-5dd7-4e7d-9af9-2af3199a980b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:47.511217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a4c5-5dd7-4e7d-9af9-2af3199a980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:47.545180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5c42a4c5-5dd7-4e7d-9af9-2af3199a980b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:47.548170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5c42a4c5-5dd7-4e7d-9af9-2af3199a980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:47.558523 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3956/7876] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:36:47.565961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6ce4e-3894-40f1-b88b-985d7c262adb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:47.579123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6ce4e-3894-40f1-b88b-985d7c262adb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:47.584820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55ea11-3721-407e-ae18-c98a806e3d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:47.585619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55ea11-3721-407e-ae18-c98a806e3d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:47.585996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55ea11-3721-407e-ae18-c98a806e3d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:47.586373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55ea11-3721-407e-ae18-c98a806e3d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:47.587896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55ea11-3721-407e-ae18-c98a806e3d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:36:47.593314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55ea11-3721-407e-ae18-c98a806e3d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:47.595315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55ea11-3721-407e-ae18-c98a806e3d26 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:47.620345 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3921/7877] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:36:47.621600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42a4c5-5dd7-4e7d-9af9-2af3199a980b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:47.633600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42a4c5-5dd7-4e7d-9af9-2af3199a980b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:47.643985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567f4a7-5f08-4e8a-b664-d8f487475dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:47.644724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f4a7-5f08-4e8a-b664-d8f487475dce admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:47.645106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f4a7-5f08-4e8a-b664-d8f487475dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:47.645480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f4a7-5f08-4e8a-b664-d8f487475dce admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:47.650008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567f4a7-5f08-4e8a-b664-d8f487475dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:47.652361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567f4a7-5f08-4e8a-b664-d8f487475dce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:47.699450 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3957/7878] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:47 2022] POST /identity/v3/projects => generated 411 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:47.703895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55ea11-3721-407e-ae18-c98a806e3d26 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:47.735421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55ea11-3721-407e-ae18-c98a806e3d26 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:47.809626 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:47.904307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46025d4-7c3a-479f-a327-2af7a5780890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:47.908592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46025d4-7c3a-479f-a327-2af7a5780890 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:47.908988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46025d4-7c3a-479f-a327-2af7a5780890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:47.909978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46025d4-7c3a-479f-a327-2af7a5780890 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:47.911204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46025d4-7c3a-479f-a327-2af7a5780890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:47.914966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46025d4-7c3a-479f-a327-2af7a5780890 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:47.991282 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3922/7879] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:47 2022] POST /identity/v3/users => generated 306 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:36:47.995341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567f4a7-5f08-4e8a-b664-d8f487475dce admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:48.024525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567f4a7-5f08-4e8a-b664-d8f487475dce admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:48.031527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714bfd8-f098-4e29-a597-d225f2f73e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:48.033577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714bfd8-f098-4e29-a597-d225f2f73e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:48.033876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714bfd8-f098-4e29-a597-d225f2f73e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:48.034154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714bfd8-f098-4e29-a597-d225f2f73e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:48.034845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714bfd8-f098-4e29-a597-d225f2f73e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:48.036596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714bfd8-f098-4e29-a597-d225f2f73e13 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:48.049063 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3958/7880] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:48.052856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46025d4-7c3a-479f-a327-2af7a5780890 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:48.067818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46025d4-7c3a-479f-a327-2af7a5780890 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:48.080898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493d2d2-93ab-4c34-ae8d-3567e859eefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:48.087000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493d2d2-93ab-4c34-ae8d-3567e859eefe admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:48.089908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493d2d2-93ab-4c34-ae8d-3567e859eefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:48.090050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493d2d2-93ab-4c34-ae8d-3567e859eefe admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:48.092979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493d2d2-93ab-4c34-ae8d-3567e859eefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:48.103037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493d2d2-93ab-4c34-ae8d-3567e859eefe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:48.117846 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3923/7881] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:36:48.121670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714bfd8-f098-4e29-a597-d225f2f73e13 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:48.143056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714bfd8-f098-4e29-a597-d225f2f73e13 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:48.156736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f4cc-e882-4ffd-9d19-0f7b5030373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:48.157738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f4cc-e882-4ffd-9d19-0f7b5030373c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:48.158192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f4cc-e882-4ffd-9d19-0f7b5030373c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:48.159206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f4cc-e882-4ffd-9d19-0f7b5030373c admin admin] PATH_INFO: `/v3/projects/cb491171eb4145e9a4396ec5c6e95fe7/users/869ed13cbe724b04be08bd9dfff5961d/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:48.179164 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:48.184586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9f4cc-e882-4ffd-9d19-0f7b5030373c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb491171eb4145e9a4396ec5c6e95fe7, user_id=869ed13cbe724b04be08bd9dfff5961d, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:48.190735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9f4cc-e882-4ffd-9d19-0f7b5030373c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:48.214117 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3959/7882] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:48 2022] PUT /identity/v3/projects/cb491171eb4145e9a4396ec5c6e95fe7/users/869ed13cbe724b04be08bd9dfff5961d/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:36:48.225277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e98f8-c7cc-489f-82f3-bbcb7ac99e80 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:48.225573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e98f8-c7cc-489f-82f3-bbcb7ac99e80 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:48.225854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e98f8-c7cc-489f-82f3-bbcb7ac99e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:48.272554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1f4e98f8-c7cc-489f-82f3-bbcb7ac99e80 None None] MFA Rules not processed for user `869ed13cbe724b04be08bd9dfff5961d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:48.274817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f4e98f8-c7cc-489f-82f3-bbcb7ac99e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:48.383954 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3924/7883] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:48.388272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f4cc-e882-4ffd-9d19-0f7b5030373c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:48.483327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f4cc-e882-4ffd-9d19-0f7b5030373c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:48.489011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54356-007a-41af-b10d-96e2befa66cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:48.489573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54356-007a-41af-b10d-96e2befa66cc admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:48.489999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54356-007a-41af-b10d-96e2befa66cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:48.490388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54356-007a-41af-b10d-96e2befa66cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:48.490954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54356-007a-41af-b10d-96e2befa66cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:48.493247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54356-007a-41af-b10d-96e2befa66cc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:48.547575 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3960/7884] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:48 2022] POST /identity/v3/projects => generated 409 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:48.548955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e98f8-c7cc-489f-82f3-bbcb7ac99e80 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:48.566582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e98f8-c7cc-489f-82f3-bbcb7ac99e80 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:48.655492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756ebd-80ea-4f9b-b3cc-058585c99bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:48.656805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756ebd-80ea-4f9b-b3cc-058585c99bfe admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:48.657474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756ebd-80ea-4f9b-b3cc-058585c99bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:48.657910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756ebd-80ea-4f9b-b3cc-058585c99bfe admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:48.658733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a756ebd-80ea-4f9b-b3cc-058585c99bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:48.661173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a756ebd-80ea-4f9b-b3cc-058585c99bfe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:48.700555 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3925/7885] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:48 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:48.705475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54356-007a-41af-b10d-96e2befa66cc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:48.722469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54356-007a-41af-b10d-96e2befa66cc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:48.736407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f0795-5298-48bf-b1ea-83512402c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:48.737253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0795-5298-48bf-b1ea-83512402c24c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:48.737622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0795-5298-48bf-b1ea-83512402c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:48.738120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0795-5298-48bf-b1ea-83512402c24c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:48.739553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f0795-5298-48bf-b1ea-83512402c24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:48.741728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f0795-5298-48bf-b1ea-83512402c24c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:48.755216 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3961/7886] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:48.759116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756ebd-80ea-4f9b-b3cc-058585c99bfe admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:48.776392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756ebd-80ea-4f9b-b3cc-058585c99bfe admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:48.785023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff43551-3cda-4c66-9b46-33961d7bc484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:48.787461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff43551-3cda-4c66-9b46-33961d7bc484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:48.796797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff43551-3cda-4c66-9b46-33961d7bc484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:48.797480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff43551-3cda-4c66-9b46-33961d7bc484 admin admin] PATH_INFO: `/v3/projects/dfaa915059174d09bb51bc7a85b4a87c/users/3e09d13f57064e4bafbd650a11c1b973/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:48.830826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff43551-3cda-4c66-9b46-33961d7bc484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfaa915059174d09bb51bc7a85b4a87c, user_id=3e09d13f57064e4bafbd650a11c1b973, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:48.833533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff43551-3cda-4c66-9b46-33961d7bc484 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:48.858835 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3926/7887] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:48 2022] PUT /identity/v3/projects/dfaa915059174d09bb51bc7a85b4a87c/users/3e09d13f57064e4bafbd650a11c1b973/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:36:48.859279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f0795-5298-48bf-b1ea-83512402c24c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:48.871038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f0795-5298-48bf-b1ea-83512402c24c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:48.943789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd641e-6950-4acc-97fd-11a1ec398582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:48.945013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd641e-6950-4acc-97fd-11a1ec398582 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:48.945295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd641e-6950-4acc-97fd-11a1ec398582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:48.945566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd641e-6950-4acc-97fd-11a1ec398582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:48.946216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd641e-6950-4acc-97fd-11a1ec398582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:48.947890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd641e-6950-4acc-97fd-11a1ec398582 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:48.973991 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3962/7888] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:36:48.980115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff43551-3cda-4c66-9b46-33961d7bc484 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:48.988323 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:48.996489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff43551-3cda-4c66-9b46-33961d7bc484 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:49.003320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f6e86-1782-498c-96ff-7ca8b4f26956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:49.004257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f6e86-1782-498c-96ff-7ca8b4f26956 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:49.004866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f6e86-1782-498c-96ff-7ca8b4f26956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:49.005329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f6e86-1782-498c-96ff-7ca8b4f26956 admin admin] PATH_INFO: `/v3/projects/dfaa915059174d09bb51bc7a85b4a87c/users/3e09d13f57064e4bafbd650a11c1b973/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:49.007551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f6e86-1782-498c-96ff-7ca8b4f26956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfaa915059174d09bb51bc7a85b4a87c, user_id=3e09d13f57064e4bafbd650a11c1b973, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:49.010615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f6e86-1782-498c-96ff-7ca8b4f26956 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:49.035111 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3927/7889] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:48 2022] PUT /identity/v3/projects/dfaa915059174d09bb51bc7a85b4a87c/users/3e09d13f57064e4bafbd650a11c1b973/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:49.036448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5952f9-ec56-4dd4-bdaf-b30f9e580d9d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:49.038343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5952f9-ec56-4dd4-bdaf-b30f9e580d9d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:49.038845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5952f9-ec56-4dd4-bdaf-b30f9e580d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:49.084022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cd5952f9-ec56-4dd4-bdaf-b30f9e580d9d None None] MFA Rules not processed for user `3e09d13f57064e4bafbd650a11c1b973`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:49.085713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cd5952f9-ec56-4dd4-bdaf-b30f9e580d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:49.170810 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:49.208669 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3963/7890] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:49 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:36:49.220702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f6e86-1782-498c-96ff-7ca8b4f26956 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:49.222692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-213f6e86-1782-498c-96ff-7ca8b4f26956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:49.317973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f6e86-1782-498c-96ff-7ca8b4f26956 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:49.325794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f582d-5478-4fef-b8e3-a27a57d6404d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:49.326729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f582d-5478-4fef-b8e3-a27a57d6404d service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:49.327114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f582d-5478-4fef-b8e3-a27a57d6404d service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:49.327493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f582d-5478-4fef-b8e3-a27a57d6404d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:49.350508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f582d-5478-4fef-b8e3-a27a57d6404d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:49.353129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f582d-5478-4fef-b8e3-a27a57d6404d service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:49.386555 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3928/7891] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:49 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:36:49.687504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5952f9-ec56-4dd4-bdaf-b30f9e580d9d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:49.688967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cd5952f9-ec56-4dd4-bdaf-b30f9e580d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:49.799616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5952f9-ec56-4dd4-bdaf-b30f9e580d9d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:49.809735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:49.810409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:49.810758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:49.811039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] PATH_INFO: `/v3/users/50db4aa789bd4e4ea570d4f4c8d5e861` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:49.812520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50db4aa789bd4e4ea570d4f4c8d5e861)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:49.814522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:49.893180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50db4aa789bd4e4ea570d4f4c8d5e861'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:49.913690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50db4aa789bd4e4ea570d4f4c8d5e861'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:49.914721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50db4aa789bd4e4ea570d4f4c8d5e861'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:49.927030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50db4aa789bd4e4ea570d4f4c8d5e861'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:49.929128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50db4aa789bd4e4ea570d4f4c8d5e861'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:49.948465 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3964/7892] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:49 2022] DELETE /identity/v3/users/50db4aa789bd4e4ea570d4f4c8d5e861 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:49.957249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b4f67-68bd-4a1e-8e79-5dc6d1e9664a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:49.957796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b4f67-68bd-4a1e-8e79-5dc6d1e9664a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:49.957796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b4f67-68bd-4a1e-8e79-5dc6d1e9664a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:49.992736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e95b4f67-68bd-4a1e-8e79-5dc6d1e9664a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:49.994175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e95b4f67-68bd-4a1e-8e79-5dc6d1e9664a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:50.082660 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3929/7893] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:36:50.093151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:50.095451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:50.183117 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d8673-39b9-4128-b477-4ddf8cba10a4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:50.189561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71faf35-c569-4d06-85c2-627086666226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:50.190846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71faf35-c569-4d06-85c2-627086666226 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:50.191242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71faf35-c569-4d06-85c2-627086666226 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:50.191756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71faf35-c569-4d06-85c2-627086666226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:50.206705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71faf35-c569-4d06-85c2-627086666226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:50.211471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71faf35-c569-4d06-85c2-627086666226 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:50.225383 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3965/7894] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:36:50.463825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b4f67-68bd-4a1e-8e79-5dc6d1e9664a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:50.466534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e95b4f67-68bd-4a1e-8e79-5dc6d1e9664a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:50.543819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b4f67-68bd-4a1e-8e79-5dc6d1e9664a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:50.564265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:50.568961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:50.569270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:50.570994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] PATH_INFO: `/v3/projects/82bef40e62a9457d8c188aa8b624bd20` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:50.573993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82bef40e62a9457d8c188aa8b624bd20)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:50.578796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:50.675010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82bef40e62a9457d8c188aa8b624bd20', 'request_id': 'req-8758568b-7f9e-4b9d-84f9-94985958f0f1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:50.680537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82bef40e62a9457d8c188aa8b624bd20', 'request_id': 'req-8758568b-7f9e-4b9d-84f9-94985958f0f1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:50.691291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82bef40e62a9457d8c188aa8b624bd20', 'request_id': 'req-8758568b-7f9e-4b9d-84f9-94985958f0f1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:50.710193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] The token cache is being invalidate because project 82bef40e62a9457d8c188aa8b624bd20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:50.710958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:50.711697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8758568b-7f9e-4b9d-84f9-94985958f0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:50.714677 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3930/7895] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:50 2022] DELETE /identity/v3/projects/82bef40e62a9457d8c188aa8b624bd20 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:50.719898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d60cf-548e-4726-9ac5-48ec6324ef59 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:50.719898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d60cf-548e-4726-9ac5-48ec6324ef59 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:50.719898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d60cf-548e-4726-9ac5-48ec6324ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:50.751684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6e3d60cf-548e-4726-9ac5-48ec6324ef59 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:50.752913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6e3d60cf-548e-4726-9ac5-48ec6324ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:50.758425 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:50.847419 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3966/7896] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:50.860112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16f186-f96e-4a97-af8b-d11fd55b6967 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:50.860645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16f186-f96e-4a97-af8b-d11fd55b6967 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:50.861130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16f186-f96e-4a97-af8b-d11fd55b6967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:50.886316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cc16f186-f96e-4a97-af8b-d11fd55b6967 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:50.887957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc16f186-f96e-4a97-af8b-d11fd55b6967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:50.900164 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3931/7897] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:50.901381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d60cf-548e-4726-9ac5-48ec6324ef59 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:50.912867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d60cf-548e-4726-9ac5-48ec6324ef59 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:50.917985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70373f-2eef-4c6c-a2c1-d8c73f3c6977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:50.918651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70373f-2eef-4c6c-a2c1-d8c73f3c6977 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:50.919049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70373f-2eef-4c6c-a2c1-d8c73f3c6977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:50.919337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70373f-2eef-4c6c-a2c1-d8c73f3c6977 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:50.920414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70373f-2eef-4c6c-a2c1-d8c73f3c6977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:36:50.920832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70373f-2eef-4c6c-a2c1-d8c73f3c6977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:50.922682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70373f-2eef-4c6c-a2c1-d8c73f3c6977 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:50.936854 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3967/7898] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:36:50.941504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16f186-f96e-4a97-af8b-d11fd55b6967 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:50.952121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16f186-f96e-4a97-af8b-d11fd55b6967 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:50.957843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93968b-29d4-4084-b52c-1d7ffb0aa415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:50.958652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93968b-29d4-4084-b52c-1d7ffb0aa415 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:50.958894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93968b-29d4-4084-b52c-1d7ffb0aa415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:50.959509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93968b-29d4-4084-b52c-1d7ffb0aa415 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:50.960174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93968b-29d4-4084-b52c-1d7ffb0aa415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:50.964515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93968b-29d4-4084-b52c-1d7ffb0aa415 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:50.970195 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:51.005289 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3932/7899] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:50 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:51.009100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70373f-2eef-4c6c-a2c1-d8c73f3c6977 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:51.020597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70373f-2eef-4c6c-a2c1-d8c73f3c6977 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:51.120215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e239d71-4883-484f-9177-d317bbe636b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:51.120880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e239d71-4883-484f-9177-d317bbe636b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:51.121320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e239d71-4883-484f-9177-d317bbe636b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:51.122535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e239d71-4883-484f-9177-d317bbe636b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:51.122987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e239d71-4883-484f-9177-d317bbe636b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:51.127728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e239d71-4883-484f-9177-d317bbe636b7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:51.164653 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3968/7900] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:51 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:51.165648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93968b-29d4-4084-b52c-1d7ffb0aa415 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:51.179105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93968b-29d4-4084-b52c-1d7ffb0aa415 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:51.191055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b26e04-181c-42f9-82f3-b5840a8b1be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:51.192094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b26e04-181c-42f9-82f3-b5840a8b1be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:51.192520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b26e04-181c-42f9-82f3-b5840a8b1be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:51.192847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b26e04-181c-42f9-82f3-b5840a8b1be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:51.195008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b26e04-181c-42f9-82f3-b5840a8b1be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:51.198866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b26e04-181c-42f9-82f3-b5840a8b1be7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:51.226816 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3933/7901] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:36:51.235178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e239d71-4883-484f-9177-d317bbe636b7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:51.257225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e239d71-4883-484f-9177-d317bbe636b7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:51.265814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec48fda-a6b5-42fa-b757-4034d5c1aee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:51.266828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48fda-a6b5-42fa-b757-4034d5c1aee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:51.267407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48fda-a6b5-42fa-b757-4034d5c1aee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:51.267756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48fda-a6b5-42fa-b757-4034d5c1aee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:51.268516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec48fda-a6b5-42fa-b757-4034d5c1aee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:51.270525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec48fda-a6b5-42fa-b757-4034d5c1aee4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:51.294134 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3969/7902] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:51.295662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b26e04-181c-42f9-82f3-b5840a8b1be7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:51.311452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b26e04-181c-42f9-82f3-b5840a8b1be7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:51.316822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcef901-3bce-43b9-b04a-34fa5b17004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:51.317598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef901-3bce-43b9-b04a-34fa5b17004e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:51.318911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef901-3bce-43b9-b04a-34fa5b17004e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:51.319346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef901-3bce-43b9-b04a-34fa5b17004e admin admin] PATH_INFO: `/v3/projects/42d7d241233b43ec86a39420acce7250/users/8370e6810872483b89544086128c02a8/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:51.344151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcef901-3bce-43b9-b04a-34fa5b17004e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d7d241233b43ec86a39420acce7250, user_id=8370e6810872483b89544086128c02a8, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:51.348173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcef901-3bce-43b9-b04a-34fa5b17004e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:51.378650 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3934/7903] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:51 2022] PUT /identity/v3/projects/42d7d241233b43ec86a39420acce7250/users/8370e6810872483b89544086128c02a8/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:36:51.383000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b38869-c356-454d-ad8b-6a2fcb574255 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:51.383283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b38869-c356-454d-ad8b-6a2fcb574255 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:51.383558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b38869-c356-454d-ad8b-6a2fcb574255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:51.426049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-19b38869-c356-454d-ad8b-6a2fcb574255 None None] MFA Rules not processed for user `8370e6810872483b89544086128c02a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:51.429511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-19b38869-c356-454d-ad8b-6a2fcb574255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:51.555679 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3970/7904] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:51.566152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcef901-3bce-43b9-b04a-34fa5b17004e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:51.576193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-abcef901-3bce-43b9-b04a-34fa5b17004e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:51.721885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcef901-3bce-43b9-b04a-34fa5b17004e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:51.726347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076a64-60a6-4b40-9ffb-b4b78e49339b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:51.727063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076a64-60a6-4b40-9ffb-b4b78e49339b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:51.727296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076a64-60a6-4b40-9ffb-b4b78e49339b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:51.727751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076a64-60a6-4b40-9ffb-b4b78e49339b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:51.747658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81076a64-60a6-4b40-9ffb-b4b78e49339b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:51.750089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81076a64-60a6-4b40-9ffb-b4b78e49339b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:51.763260 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3935/7905] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:52.486941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b38869-c356-454d-ad8b-6a2fcb574255 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:52.489355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-19b38869-c356-454d-ad8b-6a2fcb574255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:52.517397 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:52.626721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b38869-c356-454d-ad8b-6a2fcb574255 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:52.632522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:52.633664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:52.634994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:52.635288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] PATH_INFO: `/v3/users/869ed13cbe724b04be08bd9dfff5961d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:52.636802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=869ed13cbe724b04be08bd9dfff5961d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:52.639476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:52.741519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869ed13cbe724b04be08bd9dfff5961d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:52.776920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869ed13cbe724b04be08bd9dfff5961d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:52.779648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869ed13cbe724b04be08bd9dfff5961d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:52.797508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869ed13cbe724b04be08bd9dfff5961d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:52.798311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869ed13cbe724b04be08bd9dfff5961d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:52.827662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39f2e3-1394-4eb0-8c98-c881240f92d0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:52.828086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39f2e3-1394-4eb0-8c98-c881240f92d0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:52.828402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39f2e3-1394-4eb0-8c98-c881240f92d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:52.830098 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3971/7906] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:52 2022] DELETE /identity/v3/users/869ed13cbe724b04be08bd9dfff5961d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:52.866909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8c39f2e3-1394-4eb0-8c98-c881240f92d0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:52.868501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8c39f2e3-1394-4eb0-8c98-c881240f92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:53.095143 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3936/7907] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:53.106622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:53.108998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:53.250991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb930-3495-422c-aa3e-9d2cf67f9622 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:53.256454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488f534-0dfd-4424-9982-8b119c845703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:53.257510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488f534-0dfd-4424-9982-8b119c845703 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:53.258216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488f534-0dfd-4424-9982-8b119c845703 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:53.258788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488f534-0dfd-4424-9982-8b119c845703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:53.274264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488f534-0dfd-4424-9982-8b119c845703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:53.276124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488f534-0dfd-4424-9982-8b119c845703 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:53.299169 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3972/7908] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:36:53.912766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39f2e3-1394-4eb0-8c98-c881240f92d0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:53.914693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8c39f2e3-1394-4eb0-8c98-c881240f92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:53.936921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39f2e3-1394-4eb0-8c98-c881240f92d0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:53.980143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:53.981113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:53.982307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:53.982731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] PATH_INFO: `/v3/projects/cb491171eb4145e9a4396ec5c6e95fe7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:53.986764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb491171eb4145e9a4396ec5c6e95fe7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:53.991465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:54.084304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb491171eb4145e9a4396ec5c6e95fe7', 'request_id': 'req-46b980e4-3402-439e-a9fd-46274d6ece76'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:54.088631 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:54.099351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb491171eb4145e9a4396ec5c6e95fe7', 'request_id': 'req-46b980e4-3402-439e-a9fd-46274d6ece76'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:54.111143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb491171eb4145e9a4396ec5c6e95fe7', 'request_id': 'req-46b980e4-3402-439e-a9fd-46274d6ece76'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:54.141837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] The token cache is being invalidate because project cb491171eb4145e9a4396ec5c6e95fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:54.142154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:54.143631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:54.147388 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3937/7909] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:53 2022] DELETE /identity/v3/projects/cb491171eb4145e9a4396ec5c6e95fe7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:54.151789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488f534-0dfd-4424-9982-8b119c845703 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:54.163397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488f534-0dfd-4424-9982-8b119c845703 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:54.229238 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:54.289874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89709fe4-e989-46df-b343-7eee748a7284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:54.295367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89709fe4-e989-46df-b343-7eee748a7284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:54.296101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89709fe4-e989-46df-b343-7eee748a7284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:54.296489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89709fe4-e989-46df-b343-7eee748a7284 admin admin] PATH_INFO: `/v3/users/3e09d13f57064e4bafbd650a11c1b973` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:54.298874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89709fe4-e989-46df-b343-7eee748a7284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e09d13f57064e4bafbd650a11c1b973)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:54.304496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89709fe4-e989-46df-b343-7eee748a7284 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:54.503948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89709fe4-e989-46df-b343-7eee748a7284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e09d13f57064e4bafbd650a11c1b973'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:54.535977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89709fe4-e989-46df-b343-7eee748a7284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e09d13f57064e4bafbd650a11c1b973'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:54.538763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89709fe4-e989-46df-b343-7eee748a7284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e09d13f57064e4bafbd650a11c1b973'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:54.565939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89709fe4-e989-46df-b343-7eee748a7284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e09d13f57064e4bafbd650a11c1b973'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:54.566585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-89709fe4-e989-46df-b343-7eee748a7284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e09d13f57064e4bafbd650a11c1b973'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:54.591008 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3973/7910] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:36:54 2022] DELETE /identity/v3/users/3e09d13f57064e4bafbd650a11c1b973 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:54.888731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:54.890975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:54.915819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b980e4-3402-439e-a9fd-46274d6ece76 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:55.024019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:55.024825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:55.025117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:55.025374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] PATH_INFO: `/v3/projects/dfaa915059174d09bb51bc7a85b4a87c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:55.026779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfaa915059174d09bb51bc7a85b4a87c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:55.028745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:55.117071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfaa915059174d09bb51bc7a85b4a87c', 'request_id': 'req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:55.135242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfaa915059174d09bb51bc7a85b4a87c', 'request_id': 'req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:55.145647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfaa915059174d09bb51bc7a85b4a87c', 'request_id': 'req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:55.192004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] The token cache is being invalidate because project dfaa915059174d09bb51bc7a85b4a87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:36:55.192513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:55.193473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bd1e3f10-9b40-4d9f-a28e-a6a2cb1db93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:36:55.195495 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3938/7911] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:36:54 2022] DELETE /identity/v3/projects/dfaa915059174d09bb51bc7a85b4a87c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:55.201844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ff27-800b-46d0-afd7-5e2b378c9aa6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:55.202341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ff27-800b-46d0-afd7-5e2b378c9aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:55.202437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ff27-800b-46d0-afd7-5e2b378c9aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:55.235688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e994ff27-800b-46d0-afd7-5e2b378c9aa6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:55.238702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e994ff27-800b-46d0-afd7-5e2b378c9aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:55.384771 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3974/7912] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:55.395279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd0d9-921a-4bb6-bf83-694b4e866bc3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:55.395597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd0d9-921a-4bb6-bf83-694b4e866bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:55.396006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd0d9-921a-4bb6-bf83-694b4e866bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:55.426743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5ecfd0d9-921a-4bb6-bf83-694b4e866bc3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:55.437962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5ecfd0d9-921a-4bb6-bf83-694b4e866bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:55.465623 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3939/7913] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:55.466929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994ff27-800b-46d0-afd7-5e2b378c9aa6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:55.483395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994ff27-800b-46d0-afd7-5e2b378c9aa6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:55.521050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a2e43-5993-4fdd-a2e4-a10c7ecead9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:55.526717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2e43-5993-4fdd-a2e4-a10c7ecead9d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:55.527294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2e43-5993-4fdd-a2e4-a10c7ecead9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:55.527771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2e43-5993-4fdd-a2e4-a10c7ecead9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:55.528972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a2e43-5993-4fdd-a2e4-a10c7ecead9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:36:55.529528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a2e43-5993-4fdd-a2e4-a10c7ecead9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:55.531645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a2e43-5993-4fdd-a2e4-a10c7ecead9d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:55.548284 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3975/7914] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:36:55.552271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfd0d9-921a-4bb6-bf83-694b4e866bc3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:55.564758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfd0d9-921a-4bb6-bf83-694b4e866bc3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:55.571135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a530cf-03b3-41c8-ac20-2aa3ef33c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:55.572272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a530cf-03b3-41c8-ac20-2aa3ef33c2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:55.572708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a530cf-03b3-41c8-ac20-2aa3ef33c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:55.573133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a530cf-03b3-41c8-ac20-2aa3ef33c2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:55.573938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a530cf-03b3-41c8-ac20-2aa3ef33c2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:55.580146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a530cf-03b3-41c8-ac20-2aa3ef33c2b4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:55.665793 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3940/7915] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:55 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:55.670053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a2e43-5993-4fdd-a2e4-a10c7ecead9d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:55.687871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a2e43-5993-4fdd-a2e4-a10c7ecead9d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:55.801459 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:55.852964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241894ec-4d75-4fd6-8caf-b0ab9f0d0308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:55.853593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241894ec-4d75-4fd6-8caf-b0ab9f0d0308 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:55.854163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241894ec-4d75-4fd6-8caf-b0ab9f0d0308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:55.854757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241894ec-4d75-4fd6-8caf-b0ab9f0d0308 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:55.855632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241894ec-4d75-4fd6-8caf-b0ab9f0d0308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:55.858759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241894ec-4d75-4fd6-8caf-b0ab9f0d0308 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:55.909486 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3976/7916] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:55 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:55.912305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a530cf-03b3-41c8-ac20-2aa3ef33c2b4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:55.942726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a530cf-03b3-41c8-ac20-2aa3ef33c2b4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:55.953788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee8f42-fb9f-4a32-bff3-5e48c74c1c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:55.954618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee8f42-fb9f-4a32-bff3-5e48c74c1c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:55.954907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee8f42-fb9f-4a32-bff3-5e48c74c1c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:55.955184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee8f42-fb9f-4a32-bff3-5e48c74c1c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:55.955884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee8f42-fb9f-4a32-bff3-5e48c74c1c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:55.961119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee8f42-fb9f-4a32-bff3-5e48c74c1c30 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:55.973665 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3941/7917] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:55.977997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241894ec-4d75-4fd6-8caf-b0ab9f0d0308 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:56.006294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241894ec-4d75-4fd6-8caf-b0ab9f0d0308 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:56.019188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f73312-6eb5-425c-821d-12cfd132886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:56.019983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73312-6eb5-425c-821d-12cfd132886a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:56.020380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73312-6eb5-425c-821d-12cfd132886a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:56.020833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73312-6eb5-425c-821d-12cfd132886a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:56.021989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f73312-6eb5-425c-821d-12cfd132886a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:56.024684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f73312-6eb5-425c-821d-12cfd132886a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:56.073081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee8f42-fb9f-4a32-bff3-5e48c74c1c30 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:56.073837 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3977/7918] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:36:56.090647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee8f42-fb9f-4a32-bff3-5e48c74c1c30 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:56.105568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63657-55bc-481b-9a79-444f263348e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:56.106573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63657-55bc-481b-9a79-444f263348e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:56.107005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63657-55bc-481b-9a79-444f263348e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:56.108374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63657-55bc-481b-9a79-444f263348e2 admin admin] PATH_INFO: `/v3/projects/bb530988bd5a4008aff36ff4628a5163/users/9f726784437d4a11bd9ff691ed33fabf/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:56.140629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63657-55bc-481b-9a79-444f263348e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb530988bd5a4008aff36ff4628a5163, user_id=9f726784437d4a11bd9ff691ed33fabf, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:56.153207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63657-55bc-481b-9a79-444f263348e2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:56.191675 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3942/7919] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:56 2022] PUT /identity/v3/projects/bb530988bd5a4008aff36ff4628a5163/users/9f726784437d4a11bd9ff691ed33fabf/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:56.204423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7376973-49c4-48a8-a4ca-93e4ffb65e7b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:56.204894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7376973-49c4-48a8-a4ca-93e4ffb65e7b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:56.205713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7376973-49c4-48a8-a4ca-93e4ffb65e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:56.257971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c7376973-49c4-48a8-a4ca-93e4ffb65e7b None None] MFA Rules not processed for user `9f726784437d4a11bd9ff691ed33fabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:56.259627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c7376973-49c4-48a8-a4ca-93e4ffb65e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:56.434770 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3978/7920] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:56.439257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63657-55bc-481b-9a79-444f263348e2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:56.458548 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:56.622105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63657-55bc-481b-9a79-444f263348e2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:56.631240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791358c3-e6fe-4c16-a6d4-a7d1aadbb97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:56.632359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791358c3-e6fe-4c16-a6d4-a7d1aadbb97d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:56.632648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791358c3-e6fe-4c16-a6d4-a7d1aadbb97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:56.632932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791358c3-e6fe-4c16-a6d4-a7d1aadbb97d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:56.633587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791358c3-e6fe-4c16-a6d4-a7d1aadbb97d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:56.636536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791358c3-e6fe-4c16-a6d4-a7d1aadbb97d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:56.702665 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3943/7921] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:36:56 2022] POST /identity/v3/projects => generated 377 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:36:56.706498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7376973-49c4-48a8-a4ca-93e4ffb65e7b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:56.723553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7376973-49c4-48a8-a4ca-93e4ffb65e7b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:56.829393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e497-3d21-4e46-8be9-a638f3482fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:56.830098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e497-3d21-4e46-8be9-a638f3482fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:56.830444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e497-3d21-4e46-8be9-a638f3482fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:56.830856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e497-3d21-4e46-8be9-a638f3482fc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:56.831495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895e497-3d21-4e46-8be9-a638f3482fc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:56.833475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895e497-3d21-4e46-8be9-a638f3482fc5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:56.864442 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3979/7922] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:36:56 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:36:56.868588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791358c3-e6fe-4c16-a6d4-a7d1aadbb97d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:56.881869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791358c3-e6fe-4c16-a6d4-a7d1aadbb97d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:56.894813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613d142-5ca1-49e0-9eb5-fb95acdcdcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:56.894813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d142-5ca1-49e0-9eb5-fb95acdcdcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:56.894813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d142-5ca1-49e0-9eb5-fb95acdcdcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:56.894813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d142-5ca1-49e0-9eb5-fb95acdcdcc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:56.895308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613d142-5ca1-49e0-9eb5-fb95acdcdcc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:56.896864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613d142-5ca1-49e0-9eb5-fb95acdcdcc2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:56.917160 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3944/7923] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:56.918830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e497-3d21-4e46-8be9-a638f3482fc5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:56.933381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e497-3d21-4e46-8be9-a638f3482fc5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:56.940310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ef38-cde9-4323-9319-dbfb9cde6ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:56.941823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ef38-cde9-4323-9319-dbfb9cde6ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:56.942329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ef38-cde9-4323-9319-dbfb9cde6ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:56.942875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ef38-cde9-4323-9319-dbfb9cde6ad4 admin admin] PATH_INFO: `/v3/projects/91897df65e3c4d32a542c3cc0348be6e/users/179718b1bbcf49ad91ed67887568dab7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:56.967357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6ef38-cde9-4323-9319-dbfb9cde6ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91897df65e3c4d32a542c3cc0348be6e, user_id=179718b1bbcf49ad91ed67887568dab7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:56.970677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6ef38-cde9-4323-9319-dbfb9cde6ad4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:56.989700 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3980/7924] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:56 2022] PUT /identity/v3/projects/91897df65e3c4d32a542c3cc0348be6e/users/179718b1bbcf49ad91ed67887568dab7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:56.993485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613d142-5ca1-49e0-9eb5-fb95acdcdcc2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:57.005418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613d142-5ca1-49e0-9eb5-fb95acdcdcc2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:57.145271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746791a-dc03-4119-abc2-2ef0d5ffbdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:57.146836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746791a-dc03-4119-abc2-2ef0d5ffbdea admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:57.147349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746791a-dc03-4119-abc2-2ef0d5ffbdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:57.147816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746791a-dc03-4119-abc2-2ef0d5ffbdea admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:57.148710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746791a-dc03-4119-abc2-2ef0d5ffbdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:57.151286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746791a-dc03-4119-abc2-2ef0d5ffbdea admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:57.167037 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3945/7925] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:36:57.171606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ef38-cde9-4323-9319-dbfb9cde6ad4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:57.188373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ef38-cde9-4323-9319-dbfb9cde6ad4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:57.207345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a64c3b-e78d-4d66-ae32-842c78eb2aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:57.207345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a64c3b-e78d-4d66-ae32-842c78eb2aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:57.207345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a64c3b-e78d-4d66-ae32-842c78eb2aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:57.207345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a64c3b-e78d-4d66-ae32-842c78eb2aa7 admin admin] PATH_INFO: `/v3/projects/91897df65e3c4d32a542c3cc0348be6e/users/179718b1bbcf49ad91ed67887568dab7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:57.208209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a64c3b-e78d-4d66-ae32-842c78eb2aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91897df65e3c4d32a542c3cc0348be6e, user_id=179718b1bbcf49ad91ed67887568dab7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:57.208209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a64c3b-e78d-4d66-ae32-842c78eb2aa7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:57.208209 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:57.221829 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3981/7926] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:36:57 2022] PUT /identity/v3/projects/91897df65e3c4d32a542c3cc0348be6e/users/179718b1bbcf49ad91ed67887568dab7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:36:57.232080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c3eb-16f8-4c4b-b5f9-7f4cd0bf67e4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:57.232840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c3eb-16f8-4c4b-b5f9-7f4cd0bf67e4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:57.233517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c3eb-16f8-4c4b-b5f9-7f4cd0bf67e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:57.333746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ab90c3eb-16f8-4c4b-b5f9-7f4cd0bf67e4 None None] MFA Rules not processed for user `179718b1bbcf49ad91ed67887568dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:36:57.337635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ab90c3eb-16f8-4c4b-b5f9-7f4cd0bf67e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:57.490002 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:36:57.509118 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3946/7927] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:36:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:36:57.515086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a64c3b-e78d-4d66-ae32-842c78eb2aa7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:36:57.517489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b6a64c3b-e78d-4d66-ae32-842c78eb2aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:36:57.660719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a64c3b-e78d-4d66-ae32-842c78eb2aa7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:36:57.670670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f684b-2bea-45d8-ac53-2d716fd2f809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:36:57.673316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f684b-2bea-45d8-ac53-2d716fd2f809 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:36:57.673839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f684b-2bea-45d8-ac53-2d716fd2f809 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:36:57.674996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f684b-2bea-45d8-ac53-2d716fd2f809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:36:57.694190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f684b-2bea-45d8-ac53-2d716fd2f809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:36:57.696534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f684b-2bea-45d8-ac53-2d716fd2f809 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:36:57.710332 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3982/7928] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:36:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:00.327492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90c3eb-16f8-4c4b-b5f9-7f4cd0bf67e4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:00.433552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90c3eb-16f8-4c4b-b5f9-7f4cd0bf67e4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:00.439710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:00.440444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:00.441023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:00.441382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] PATH_INFO: `/v3/users/9f726784437d4a11bd9ff691ed33fabf` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:00.442680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f726784437d4a11bd9ff691ed33fabf)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:00.444732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:00.512381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f726784437d4a11bd9ff691ed33fabf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:00.546932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f726784437d4a11bd9ff691ed33fabf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:00.548071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f726784437d4a11bd9ff691ed33fabf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:00.561522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f726784437d4a11bd9ff691ed33fabf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:00.572351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f726784437d4a11bd9ff691ed33fabf'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:00.582858 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3947/7929] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:00 2022] DELETE /identity/v3/users/9f726784437d4a11bd9ff691ed33fabf => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:00.586471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916ccb3-9827-4f17-be04-34a31cc53157 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:00.586974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916ccb3-9827-4f17-be04-34a31cc53157 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:00.587177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916ccb3-9827-4f17-be04-34a31cc53157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:00.608346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3916ccb3-9827-4f17-be04-34a31cc53157 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:00.609829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3916ccb3-9827-4f17-be04-34a31cc53157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:00.709015 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3983/7930] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:00.721836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:00.724248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:00.858684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4406b-0fc9-4e75-a089-03741eca502e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:00.864263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b636d4-d5bd-4d14-90e1-788e702d4f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:00.864889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b636d4-d5bd-4d14-90e1-788e702d4f50 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:00.865169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b636d4-d5bd-4d14-90e1-788e702d4f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:00.865495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b636d4-d5bd-4d14-90e1-788e702d4f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:00.881429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b636d4-d5bd-4d14-90e1-788e702d4f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:00.883475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b636d4-d5bd-4d14-90e1-788e702d4f50 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:00.897790 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3948/7931] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:01.359142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916ccb3-9827-4f17-be04-34a31cc53157 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:01.361161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3916ccb3-9827-4f17-be04-34a31cc53157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:01.377083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916ccb3-9827-4f17-be04-34a31cc53157 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:01.384737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe2a2a-e2c8-4ed3-be63-025c7fb33d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:01.385981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2a2a-e2c8-4ed3-be63-025c7fb33d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:01.386712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2a2a-e2c8-4ed3-be63-025c7fb33d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:01.387573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2a2a-e2c8-4ed3-be63-025c7fb33d1a admin admin] PATH_INFO: `/v3/users/8370e6810872483b89544086128c02a8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:01.390229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe2a2a-e2c8-4ed3-be63-025c7fb33d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8370e6810872483b89544086128c02a8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:01.392320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe2a2a-e2c8-4ed3-be63-025c7fb33d1a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:01.468761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1afe2a2a-e2c8-4ed3-be63-025c7fb33d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8370e6810872483b89544086128c02a8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:01.492816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1afe2a2a-e2c8-4ed3-be63-025c7fb33d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8370e6810872483b89544086128c02a8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:01.493189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1afe2a2a-e2c8-4ed3-be63-025c7fb33d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8370e6810872483b89544086128c02a8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:01.503757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1afe2a2a-e2c8-4ed3-be63-025c7fb33d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8370e6810872483b89544086128c02a8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:01.504874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1afe2a2a-e2c8-4ed3-be63-025c7fb33d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8370e6810872483b89544086128c02a8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:01.516804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b636d4-d5bd-4d14-90e1-788e702d4f50 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:01.519761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79b636d4-d5bd-4d14-90e1-788e702d4f50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:01.524528 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3984/7932] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:01 2022] DELETE /identity/v3/users/8370e6810872483b89544086128c02a8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:01.527674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e0db-2819-4422-9b53-8abab999bb58 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:01.527973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e0db-2819-4422-9b53-8abab999bb58 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:01.528344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e0db-2819-4422-9b53-8abab999bb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:01.556335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b636d4-d5bd-4d14-90e1-788e702d4f50 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:01.579501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-57b9e0db-2819-4422-9b53-8abab999bb58 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:01.581117 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:01.581246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-57b9e0db-2819-4422-9b53-8abab999bb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:01.589561 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:01.648439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:01.648946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:01.649223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:01.649523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] PATH_INFO: `/v3/projects/bb530988bd5a4008aff36ff4628a5163` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:01.650873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb530988bd5a4008aff36ff4628a5163)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:01.653095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:01.671091 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3985/7933] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:01.681140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9e0db-2819-4422-9b53-8abab999bb58 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:01.687705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-57b9e0db-2819-4422-9b53-8abab999bb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:01.726511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb530988bd5a4008aff36ff4628a5163', 'request_id': 'req-bb0f4498-3320-4f22-8221-cfd396b552fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:01.735824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb530988bd5a4008aff36ff4628a5163', 'request_id': 'req-bb0f4498-3320-4f22-8221-cfd396b552fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:01.760894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb530988bd5a4008aff36ff4628a5163', 'request_id': 'req-bb0f4498-3320-4f22-8221-cfd396b552fa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:01.782313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] The token cache is being invalidate because project bb530988bd5a4008aff36ff4628a5163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:01.782645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:01.783378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:01.787270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9e0db-2819-4422-9b53-8abab999bb58 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:01.790688 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3949/7934] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:01 2022] DELETE /identity/v3/projects/bb530988bd5a4008aff36ff4628a5163 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:01.792750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:01.795200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:01.876916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54a932-3a39-43a9-a58e-1ec621d25de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:01.877536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54a932-3a39-43a9-a58e-1ec621d25de7 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:01.878256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54a932-3a39-43a9-a58e-1ec621d25de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:01.878540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54a932-3a39-43a9-a58e-1ec621d25de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:01.880636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7f54a932-3a39-43a9-a58e-1ec621d25de7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:01.926746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4498-3320-4f22-8221-cfd396b552fa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:01.933128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:01.933842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:01.935083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:01.936058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] PATH_INFO: `/v3/users/179718b1bbcf49ad91ed67887568dab7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:01.940939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=179718b1bbcf49ad91ed67887568dab7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:01.943507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:02.033696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54a932-3a39-43a9-a58e-1ec621d25de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:02.037167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54a932-3a39-43a9-a58e-1ec621d25de7 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:02.043482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179718b1bbcf49ad91ed67887568dab7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.051198 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3986/7935] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:37:02.052104 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:02.063927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179718b1bbcf49ad91ed67887568dab7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.064986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179718b1bbcf49ad91ed67887568dab7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.080885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179718b1bbcf49ad91ed67887568dab7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.090460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179718b1bbcf49ad91ed67887568dab7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.113370 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3950/7936] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:01 2022] DELETE /identity/v3/users/179718b1bbcf49ad91ed67887568dab7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:02.506858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54a932-3a39-43a9-a58e-1ec621d25de7 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:02.508283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7f54a932-3a39-43a9-a58e-1ec621d25de7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:02.541274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54a932-3a39-43a9-a58e-1ec621d25de7 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:02.551967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:02.553509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:02.574923 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:02.715650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:02.717555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:02.717995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:02.720091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] PATH_INFO: `/v3/projects/42d7d241233b43ec86a39420acce7250` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:02.722049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d7d241233b43ec86a39420acce7250)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:02.725360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:02.726403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebdb73-cbd6-4164-bf62-15c424862748 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:02.741163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:02.742144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:02.742636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:02.743222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] PATH_INFO: `/v3/projects/91897df65e3c4d32a542c3cc0348be6e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:02.746400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] RBAC: Authorizing `identity:delete_project(project_id=91897df65e3c4d32a542c3cc0348be6e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:02.749464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:02.856023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91897df65e3c4d32a542c3cc0348be6e', 'request_id': 'req-9c14cf73-bd6f-41f8-9bdb-783f346b463c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.867072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d7d241233b43ec86a39420acce7250', 'request_id': 'req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.870583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91897df65e3c4d32a542c3cc0348be6e', 'request_id': 'req-9c14cf73-bd6f-41f8-9bdb-783f346b463c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.879839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d7d241233b43ec86a39420acce7250', 'request_id': 'req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.891973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91897df65e3c4d32a542c3cc0348be6e', 'request_id': 'req-9c14cf73-bd6f-41f8-9bdb-783f346b463c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.900992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d7d241233b43ec86a39420acce7250', 'request_id': 'req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.925129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] The token cache is being invalidate because project 42d7d241233b43ec86a39420acce7250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:02.925425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.930441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-490ea8cc-b94c-4fc5-8266-c7c3d3f45d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.932596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] The token cache is being invalidate because project 91897df65e3c4d32a542c3cc0348be6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:02.933224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.934004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9c14cf73-bd6f-41f8-9bdb-783f346b463c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:02.938822 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3987/7938] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:02 2022] DELETE /identity/v3/projects/42d7d241233b43ec86a39420acce7250 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:02.938932 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3951/7938] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:02 2022] DELETE /identity/v3/projects/91897df65e3c4d32a542c3cc0348be6e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:02.939014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c824-a8a4-4fbd-aeec-5ed541219e78 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:02.939014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c824-a8a4-4fbd-aeec-5ed541219e78 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:02.939014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c824-a8a4-4fbd-aeec-5ed541219e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:02.941182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c387-8dfd-4c9b-81d3-a954dd407f4c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:02.942185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c387-8dfd-4c9b-81d3-a954dd407f4c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:02.943317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c387-8dfd-4c9b-81d3-a954dd407f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:02.973427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-71f4c387-8dfd-4c9b-81d3-a954dd407f4c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:02.975845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-71f4c387-8dfd-4c9b-81d3-a954dd407f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:03.007284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9af9c824-a8a4-4fbd-aeec-5ed541219e78 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:03.008499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9af9c824-a8a4-4fbd-aeec-5ed541219e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:03.066325 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3952/7939] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:03.067819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c628d7-e2c3-4cc4-a780-065f7c20d4fc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.068106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c628d7-e2c3-4cc4-a780-065f7c20d4fc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.068376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c628d7-e2c3-4cc4-a780-065f7c20d4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.085612 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:03.114638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-83c628d7-e2c3-4cc4-a780-065f7c20d4fc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:03.115864 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-83c628d7-e2c3-4cc4-a780-065f7c20d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:03.148003 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3988/7940] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:03.149795 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3953/7941] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:03.154292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c824-a8a4-4fbd-aeec-5ed541219e78 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:03.155186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e162551-b454-4680-b3ea-8a42c9d93992 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.155474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e162551-b454-4680-b3ea-8a42c9d93992 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.155736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e162551-b454-4680-b3ea-8a42c9d93992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.172249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c824-a8a4-4fbd-aeec-5ed541219e78 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:03.177362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e82a2-6899-4a3b-acb8-232d08ddc51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:03.178208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e82a2-6899-4a3b-acb8-232d08ddc51b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.178445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e82a2-6899-4a3b-acb8-232d08ddc51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.178763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e82a2-6899-4a3b-acb8-232d08ddc51b admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.179422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e82a2-6899-4a3b-acb8-232d08ddc51b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:03.179850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e82a2-6899-4a3b-acb8-232d08ddc51b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:03.181534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e82a2-6899-4a3b-acb8-232d08ddc51b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:03.201274 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3989/7942] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:37:03.202796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e82a2-6899-4a3b-acb8-232d08ddc51b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:03.220433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4e162551-b454-4680-b3ea-8a42c9d93992 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:03.221832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4e162551-b454-4680-b3ea-8a42c9d93992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:03.223708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e82a2-6899-4a3b-acb8-232d08ddc51b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:03.229255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283dec9-6841-4000-8c46-806609f6a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:03.230056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283dec9-6841-4000-8c46-806609f6a4ba admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.230421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283dec9-6841-4000-8c46-806609f6a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.230928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283dec9-6841-4000-8c46-806609f6a4ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.231636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283dec9-6841-4000-8c46-806609f6a4ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:03.233915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283dec9-6841-4000-8c46-806609f6a4ba admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:03.242267 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3954/7943] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:03.246466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e162551-b454-4680-b3ea-8a42c9d93992 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:03.264122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e162551-b454-4680-b3ea-8a42c9d93992 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:03.272826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d1b37-3e79-4910-9cca-2ad8c1b102c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:03.273776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d1b37-3e79-4910-9cca-2ad8c1b102c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.274161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d1b37-3e79-4910-9cca-2ad8c1b102c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.274540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d1b37-3e79-4910-9cca-2ad8c1b102c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.275708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d1b37-3e79-4910-9cca-2ad8c1b102c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:03.276145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d1b37-3e79-4910-9cca-2ad8c1b102c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:03.279030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d1b37-3e79-4910-9cca-2ad8c1b102c0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:03.295937 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3990/7944] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:03 2022] POST /identity/v3/projects => generated 393 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:03.303239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283dec9-6841-4000-8c46-806609f6a4ba admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:03.319572 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3955/7945] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:37:03.323592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d1b37-3e79-4910-9cca-2ad8c1b102c0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:03.332309 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:03.359671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d1b37-3e79-4910-9cca-2ad8c1b102c0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:03.432568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283dec9-6841-4000-8c46-806609f6a4ba admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:03.440445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0292cf0-6771-40a0-90da-a0a096a7d9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:03.441180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0292cf0-6771-40a0-90da-a0a096a7d9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.441530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0292cf0-6771-40a0-90da-a0a096a7d9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.441807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0292cf0-6771-40a0-90da-a0a096a7d9d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.442510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0292cf0-6771-40a0-90da-a0a096a7d9d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:03.445422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0292cf0-6771-40a0-90da-a0a096a7d9d4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:03.480206 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3991/7946] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:03 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:03.484647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0292cf0-6771-40a0-90da-a0a096a7d9d4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:03.488549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17d0ae-f3f6-47fb-887d-6694ff1ee5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:03.489437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d0ae-f3f6-47fb-887d-6694ff1ee5ca admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.489855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d0ae-f3f6-47fb-887d-6694ff1ee5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.490199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d0ae-f3f6-47fb-887d-6694ff1ee5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.491339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17d0ae-f3f6-47fb-887d-6694ff1ee5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:03.494460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17d0ae-f3f6-47fb-887d-6694ff1ee5ca admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:03.500805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0292cf0-6771-40a0-90da-a0a096a7d9d4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:03.507964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd393b59-67f8-43f8-878c-e0463f31ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:03.508791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393b59-67f8-43f8-878c-e0463f31ef20 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.509549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393b59-67f8-43f8-878c-e0463f31ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.509995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393b59-67f8-43f8-878c-e0463f31ef20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.511554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd393b59-67f8-43f8-878c-e0463f31ef20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:03.514135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd393b59-67f8-43f8-878c-e0463f31ef20 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:03.527692 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3992/7947] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:03.532424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd393b59-67f8-43f8-878c-e0463f31ef20 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:03.554298 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3956/7948] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:03 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:03.555896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17d0ae-f3f6-47fb-887d-6694ff1ee5ca admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:03.558961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd393b59-67f8-43f8-878c-e0463f31ef20 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:03.671949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfd8b3-aa2e-43c4-9a88-078493be6450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:03.672591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfd8b3-aa2e-43c4-9a88-078493be6450 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.673899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfd8b3-aa2e-43c4-9a88-078493be6450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.674395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfd8b3-aa2e-43c4-9a88-078493be6450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.678802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17d0ae-f3f6-47fb-887d-6694ff1ee5ca admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:03.678951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfd8b3-aa2e-43c4-9a88-078493be6450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:03.682508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfd8b3-aa2e-43c4-9a88-078493be6450 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:03.685536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456074fb-ccb4-48be-a931-ccbaf275f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:03.686346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456074fb-ccb4-48be-a931-ccbaf275f688 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.687200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456074fb-ccb4-48be-a931-ccbaf275f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.687750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456074fb-ccb4-48be-a931-ccbaf275f688 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.688654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456074fb-ccb4-48be-a931-ccbaf275f688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:03.691191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456074fb-ccb4-48be-a931-ccbaf275f688 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:03.708529 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3993/7949] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:03.716608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfd8b3-aa2e-43c4-9a88-078493be6450 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:03.748695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfd8b3-aa2e-43c4-9a88-078493be6450 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:03.753073 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3957/7950] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:03 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:03.756779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a2caf-24e9-44aa-a3ac-03e62da1a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:03.757760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a2caf-24e9-44aa-a3ac-03e62da1a627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.758280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a2caf-24e9-44aa-a3ac-03e62da1a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.758791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a2caf-24e9-44aa-a3ac-03e62da1a627 admin admin] PATH_INFO: `/v3/projects/36469b0be3994eb08886c8dfa423a64e/users/bae6819d7c9c4172b8ded91b9fec4641/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.760654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456074fb-ccb4-48be-a931-ccbaf275f688 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:03.779203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a2caf-24e9-44aa-a3ac-03e62da1a627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36469b0be3994eb08886c8dfa423a64e, user_id=bae6819d7c9c4172b8ded91b9fec4641, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:03.782880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a2caf-24e9-44aa-a3ac-03e62da1a627 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:03.788503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456074fb-ccb4-48be-a931-ccbaf275f688 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:03.797537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8157ad3-3188-4826-9813-c50a4d46f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:03.800223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8157ad3-3188-4826-9813-c50a4d46f77d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.800515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8157ad3-3188-4826-9813-c50a4d46f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.800798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8157ad3-3188-4826-9813-c50a4d46f77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.803184 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3994/7951] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:03 2022] PUT /identity/v3/projects/36469b0be3994eb08886c8dfa423a64e/users/bae6819d7c9c4172b8ded91b9fec4641/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:03.810915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8157ad3-3188-4826-9813-c50a4d46f77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:03.813702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912f7de-d370-4d8f-a3a5-c7a48113cf31 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:03.816080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912f7de-d370-4d8f-a3a5-c7a48113cf31 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:03.817138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8157ad3-3188-4826-9813-c50a4d46f77d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:03.817801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912f7de-d370-4d8f-a3a5-c7a48113cf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:03.849368 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3958/7952] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:03.852828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8157ad3-3188-4826-9813-c50a4d46f77d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:03.877138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2912f7de-d370-4d8f-a3a5-c7a48113cf31 None None] MFA Rules not processed for user `bae6819d7c9c4172b8ded91b9fec4641`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:03.879073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2912f7de-d370-4d8f-a3a5-c7a48113cf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:03.884250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8157ad3-3188-4826-9813-c50a4d46f77d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:03.957966 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:03.971018 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:03.997608 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3995/7953] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:04.002244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912f7de-d370-4d8f-a3a5-c7a48113cf31 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:04.003361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf167e0-62c9-46e8-9c5e-bd5a0a564b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:04.004225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf167e0-62c9-46e8-9c5e-bd5a0a564b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:04.004717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf167e0-62c9-46e8-9c5e-bd5a0a564b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:04.005197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf167e0-62c9-46e8-9c5e-bd5a0a564b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:04.006081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf167e0-62c9-46e8-9c5e-bd5a0a564b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:04.008163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf167e0-62c9-46e8-9c5e-bd5a0a564b09 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:04.015982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912f7de-d370-4d8f-a3a5-c7a48113cf31 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:04.021410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6623ef-6253-4bcc-a8cc-1d25b3282364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:04.022019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6623ef-6253-4bcc-a8cc-1d25b3282364 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:04.025198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6623ef-6253-4bcc-a8cc-1d25b3282364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:04.025198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6623ef-6253-4bcc-a8cc-1d25b3282364 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:04.025198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6623ef-6253-4bcc-a8cc-1d25b3282364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:04.025683 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3959/7954] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:04.026510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6623ef-6253-4bcc-a8cc-1d25b3282364 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:04.026990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf167e0-62c9-46e8-9c5e-bd5a0a564b09 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:04.037951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf167e0-62c9-46e8-9c5e-bd5a0a564b09 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:04.045154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebe54d-d157-490a-a85d-00530047074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:04.046203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebe54d-d157-490a-a85d-00530047074d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:04.046563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebe54d-d157-490a-a85d-00530047074d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:04.046948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebe54d-d157-490a-a85d-00530047074d admin admin] PATH_INFO: `/v3/projects/381f435f94204d58873853d740070c2e/users/2cd27bae841041c3a95ad081cabce6a1/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:04.065998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebe54d-d157-490a-a85d-00530047074d admin admin] RBAC: Authorizing `identity:create_grant(project_id=381f435f94204d58873853d740070c2e, user_id=2cd27bae841041c3a95ad081cabce6a1, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:04.069051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebe54d-d157-490a-a85d-00530047074d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:04.073911 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3996/7955] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:04 2022] POST /identity/v3/projects => generated 393 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:04.078390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6623ef-6253-4bcc-a8cc-1d25b3282364 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:04.093784 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3960/7956] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:04 2022] PUT /identity/v3/projects/381f435f94204d58873853d740070c2e/users/2cd27bae841041c3a95ad081cabce6a1/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:04.105129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c6f0c-219a-4783-9ae9-fe50df6f39cc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:04.105478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c6f0c-219a-4783-9ae9-fe50df6f39cc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:04.105823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c6f0c-219a-4783-9ae9-fe50df6f39cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:04.142873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d57c6f0c-219a-4783-9ae9-fe50df6f39cc None None] MFA Rules not processed for user `2cd27bae841041c3a95ad081cabce6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:04.145336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d57c6f0c-219a-4783-9ae9-fe50df6f39cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:04.221226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6623ef-6253-4bcc-a8cc-1d25b3282364 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:04.243562 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3961/7957] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:04.244806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c6f0c-219a-4783-9ae9-fe50df6f39cc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:04.246448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d57c6f0c-219a-4783-9ae9-fe50df6f39cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:04.311283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677bc06-f570-4283-9dd5-f5880ac063d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:04.312678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677bc06-f570-4283-9dd5-f5880ac063d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:04.313040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677bc06-f570-4283-9dd5-f5880ac063d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:04.313898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677bc06-f570-4283-9dd5-f5880ac063d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:04.315479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677bc06-f570-4283-9dd5-f5880ac063d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:04.317638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677bc06-f570-4283-9dd5-f5880ac063d7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:04.340288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c6f0c-219a-4783-9ae9-fe50df6f39cc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:04.348785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8309bb-cacb-4955-8da4-3219332ec21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:04.349458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8309bb-cacb-4955-8da4-3219332ec21f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:04.349748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8309bb-cacb-4955-8da4-3219332ec21f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:04.350013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8309bb-cacb-4955-8da4-3219332ec21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:04.356873 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3997/7958] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:04 2022] POST /identity/v3/users => generated 303 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:37:04.358299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677bc06-f570-4283-9dd5-f5880ac063d7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:04.361801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8309bb-cacb-4955-8da4-3219332ec21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:04.363479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8309bb-cacb-4955-8da4-3219332ec21f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:04.371761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677bc06-f570-4283-9dd5-f5880ac063d7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:04.375912 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3962/7959] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:04.377301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663e536-6877-489c-a5fc-5c09d2c11dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:04.378280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663e536-6877-489c-a5fc-5c09d2c11dda admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:04.378951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663e536-6877-489c-a5fc-5c09d2c11dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:04.379392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663e536-6877-489c-a5fc-5c09d2c11dda admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:04.380250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663e536-6877-489c-a5fc-5c09d2c11dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:04.382344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663e536-6877-489c-a5fc-5c09d2c11dda admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:04.400750 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3998/7960] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:04.401958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8309bb-cacb-4955-8da4-3219332ec21f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:04.417472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8309bb-cacb-4955-8da4-3219332ec21f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:04.427881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b1982-5bef-4aa0-a5fc-e63e3e8b937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:04.428662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b1982-5bef-4aa0-a5fc-e63e3e8b937c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:04.428947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b1982-5bef-4aa0-a5fc-e63e3e8b937c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:04.429228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b1982-5bef-4aa0-a5fc-e63e3e8b937c admin admin] PATH_INFO: `/v3/projects/d1d3a73fc5df4d4ba3ffc9cb137fc1df/users/50db79189cb64600b87f29db1ddf1ecb/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:04.466977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b1982-5bef-4aa0-a5fc-e63e3e8b937c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d3a73fc5df4d4ba3ffc9cb137fc1df, user_id=50db79189cb64600b87f29db1ddf1ecb, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:04.474702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b1982-5bef-4aa0-a5fc-e63e3e8b937c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:04.505499 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3963/7961] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:04 2022] PUT /identity/v3/projects/d1d3a73fc5df4d4ba3ffc9cb137fc1df/users/50db79189cb64600b87f29db1ddf1ecb/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:04.509549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663e536-6877-489c-a5fc-5c09d2c11dda admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:04.538626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663e536-6877-489c-a5fc-5c09d2c11dda admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:04.643592 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:04.652327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a54b3e-dfd5-4ff4-b646-ed892e3893cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:04.652951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a54b3e-dfd5-4ff4-b646-ed892e3893cc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:04.653305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a54b3e-dfd5-4ff4-b646-ed892e3893cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:04.654020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a54b3e-dfd5-4ff4-b646-ed892e3893cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:04.655120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a54b3e-dfd5-4ff4-b646-ed892e3893cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:04.657137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a54b3e-dfd5-4ff4-b646-ed892e3893cc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:04.678357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b1982-5bef-4aa0-a5fc-e63e3e8b937c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:04.684976 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 3999/7962] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:04.691414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b1982-5bef-4aa0-a5fc-e63e3e8b937c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:04.697739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1fdd7-038a-498f-bb1c-5ddcbb4c9899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:04.699066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1fdd7-038a-498f-bb1c-5ddcbb4c9899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:04.699504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1fdd7-038a-498f-bb1c-5ddcbb4c9899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:04.700657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1fdd7-038a-498f-bb1c-5ddcbb4c9899 admin admin] PATH_INFO: `/v3/projects/d1d3a73fc5df4d4ba3ffc9cb137fc1df/users/50db79189cb64600b87f29db1ddf1ecb/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:04.703307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1fdd7-038a-498f-bb1c-5ddcbb4c9899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d3a73fc5df4d4ba3ffc9cb137fc1df, user_id=50db79189cb64600b87f29db1ddf1ecb, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:04.706546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1fdd7-038a-498f-bb1c-5ddcbb4c9899 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:04.737355 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3964/7963] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:04 2022] PUT /identity/v3/projects/d1d3a73fc5df4d4ba3ffc9cb137fc1df/users/50db79189cb64600b87f29db1ddf1ecb/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:04.738306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24135524-b9da-46ba-93d1-1fab62304d18 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:04.739393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24135524-b9da-46ba-93d1-1fab62304d18 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:04.740698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24135524-b9da-46ba-93d1-1fab62304d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:04.783521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-24135524-b9da-46ba-93d1-1fab62304d18 None None] MFA Rules not processed for user `50db79189cb64600b87f29db1ddf1ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:04.784881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-24135524-b9da-46ba-93d1-1fab62304d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:04.868230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1fdd7-038a-498f-bb1c-5ddcbb4c9899 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:04.879202 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:04.941286 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4000/7964] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:04.954174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24135524-b9da-46ba-93d1-1fab62304d18 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:04.955970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-24135524-b9da-46ba-93d1-1fab62304d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:04.991131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1fdd7-038a-498f-bb1c-5ddcbb4c9899 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:05.002652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:05.003319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:05.003607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:05.003946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] PATH_INFO: `/v3/users/2cd27bae841041c3a95ad081cabce6a1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:05.005118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd27bae841041c3a95ad081cabce6a1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:05.007111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:05.058929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24135524-b9da-46ba-93d1-1fab62304d18 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:05.065538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8aa9a-31df-470b-ae39-bafbdac394eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:05.067445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8aa9a-31df-470b-ae39-bafbdac394eb service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:05.067899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8aa9a-31df-470b-ae39-bafbdac394eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:05.068275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8aa9a-31df-470b-ae39-bafbdac394eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:05.073941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd27bae841041c3a95ad081cabce6a1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:05.083205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8aa9a-31df-470b-ae39-bafbdac394eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:05.085734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8aa9a-31df-470b-ae39-bafbdac394eb service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:05.089981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd27bae841041c3a95ad081cabce6a1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:05.091729 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd27bae841041c3a95ad081cabce6a1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:05.102090 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4001/7965] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:37:05.108686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd27bae841041c3a95ad081cabce6a1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:05.124029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd27bae841041c3a95ad081cabce6a1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:05.133561 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3965/7966] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:04 2022] DELETE /identity/v3/users/2cd27bae841041c3a95ad081cabce6a1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:05.139481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef35e3-9b07-4dc1-b82e-7a35f23d70f0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:05.139777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef35e3-9b07-4dc1-b82e-7a35f23d70f0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:05.140038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef35e3-9b07-4dc1-b82e-7a35f23d70f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:05.162708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8aef35e3-9b07-4dc1-b82e-7a35f23d70f0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:05.163939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8aef35e3-9b07-4dc1-b82e-7a35f23d70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:05.237429 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4002/7967] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:05.248515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:05.250020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:05.383891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a868-9625-4b64-a480-485621f13c20 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:05.390570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64882c5d-507e-4fae-8e91-fe90a5091b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:05.391402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64882c5d-507e-4fae-8e91-fe90a5091b82 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:05.391850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64882c5d-507e-4fae-8e91-fe90a5091b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:05.392273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64882c5d-507e-4fae-8e91-fe90a5091b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:05.403901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64882c5d-507e-4fae-8e91-fe90a5091b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:05.405765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64882c5d-507e-4fae-8e91-fe90a5091b82 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:05.423325 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3966/7968] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:06.233526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef35e3-9b07-4dc1-b82e-7a35f23d70f0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:06.235635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8aef35e3-9b07-4dc1-b82e-7a35f23d70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:06.260609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef35e3-9b07-4dc1-b82e-7a35f23d70f0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:06.304929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:06.305486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:06.305843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:06.306038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] PATH_INFO: `/v3/projects/381f435f94204d58873853d740070c2e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:06.307994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=381f435f94204d58873853d740070c2e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:06.328020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:06.374760 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:06.439207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381f435f94204d58873853d740070c2e', 'request_id': 'req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:06.448245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381f435f94204d58873853d740070c2e', 'request_id': 'req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:06.453468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64882c5d-507e-4fae-8e91-fe90a5091b82 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:06.455486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-64882c5d-507e-4fae-8e91-fe90a5091b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:06.475472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381f435f94204d58873853d740070c2e', 'request_id': 'req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:06.480272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64882c5d-507e-4fae-8e91-fe90a5091b82 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:06.508052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] The token cache is being invalidate because project 381f435f94204d58873853d740070c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:06.508352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:06.509122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fdee9b05-1dd1-41e6-a149-a4c8e78767ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:06.511604 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4003/7969] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:06 2022] DELETE /identity/v3/projects/381f435f94204d58873853d740070c2e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:06.519432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b125d-50d4-4ff9-ab4c-aa885e2fb30c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:06.519770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b125d-50d4-4ff9-ab4c-aa885e2fb30c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:06.520052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b125d-50d4-4ff9-ab4c-aa885e2fb30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:06.551924 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:06.569713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4d3b125d-50d4-4ff9-ab4c-aa885e2fb30c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:06.573107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4d3b125d-50d4-4ff9-ab4c-aa885e2fb30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:06.627546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6f65e-2ba4-484a-b031-7dde913b7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:06.628378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f65e-2ba4-484a-b031-7dde913b7d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:06.628665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f65e-2ba4-484a-b031-7dde913b7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:06.628951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f65e-2ba4-484a-b031-7dde913b7d2b admin admin] PATH_INFO: `/v3/users/dc7cc78032a34034aed2d761e8cfe068` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:06.630942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6f65e-2ba4-484a-b031-7dde913b7d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7cc78032a34034aed2d761e8cfe068)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:06.634469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6f65e-2ba4-484a-b031-7dde913b7d2b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:06.704608 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4004/7970] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:06.718324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414e37-15a4-470a-8796-5cacfea83392 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:06.719038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414e37-15a4-470a-8796-5cacfea83392 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:06.723060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414e37-15a4-470a-8796-5cacfea83392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:06.772413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84e6f65e-2ba4-484a-b031-7dde913b7d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7cc78032a34034aed2d761e8cfe068'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:06.780488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-28414e37-15a4-470a-8796-5cacfea83392 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:06.781626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-28414e37-15a4-470a-8796-5cacfea83392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:06.801267 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4005/7971] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:06.802336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28414e37-15a4-470a-8796-5cacfea83392 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:06.820749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28414e37-15a4-470a-8796-5cacfea83392 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:06.822924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84e6f65e-2ba4-484a-b031-7dde913b7d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7cc78032a34034aed2d761e8cfe068'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:06.824688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84e6f65e-2ba4-484a-b031-7dde913b7d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7cc78032a34034aed2d761e8cfe068'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:06.830577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6371508-dd1c-4e2b-81d6-3dae9eedd71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:06.831989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371508-dd1c-4e2b-81d6-3dae9eedd71d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:06.831989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371508-dd1c-4e2b-81d6-3dae9eedd71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:06.832194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371508-dd1c-4e2b-81d6-3dae9eedd71d admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:06.832722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6371508-dd1c-4e2b-81d6-3dae9eedd71d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:06.833030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6371508-dd1c-4e2b-81d6-3dae9eedd71d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:06.834679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6371508-dd1c-4e2b-81d6-3dae9eedd71d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:06.848009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84e6f65e-2ba4-484a-b031-7dde913b7d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7cc78032a34034aed2d761e8cfe068'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:06.857936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84e6f65e-2ba4-484a-b031-7dde913b7d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7cc78032a34034aed2d761e8cfe068'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:06.867002 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4006/7972] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:37:06.868183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6371508-dd1c-4e2b-81d6-3dae9eedd71d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:06.870038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f6371508-dd1c-4e2b-81d6-3dae9eedd71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:06.873155 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3967/7973] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:06 2022] DELETE /identity/v3/users/dc7cc78032a34034aed2d761e8cfe068 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:06.877877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eec183-07bb-4cb4-b47c-24daac65c983 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:06.878179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eec183-07bb-4cb4-b47c-24daac65c983 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:06.878460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eec183-07bb-4cb4-b47c-24daac65c983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:06.895132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6371508-dd1c-4e2b-81d6-3dae9eedd71d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:06.925204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-89eec183-07bb-4cb4-b47c-24daac65c983 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:06.926452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-89eec183-07bb-4cb4-b47c-24daac65c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:07.036918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67910e-cbeb-4b63-bef5-5280536203f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:07.040473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67910e-cbeb-4b63-bef5-5280536203f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:07.040971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67910e-cbeb-4b63-bef5-5280536203f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:07.041952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67910e-cbeb-4b63-bef5-5280536203f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:07.046832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67910e-cbeb-4b63-bef5-5280536203f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:07.051601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67910e-cbeb-4b63-bef5-5280536203f9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:07.098282 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3968/7974] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:37:07.128908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eec183-07bb-4cb4-b47c-24daac65c983 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:07.131779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-89eec183-07bb-4cb4-b47c-24daac65c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:07.141341 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4007/7975] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:06 2022] POST /identity/v3/projects => generated 359 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:07.142668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67910e-cbeb-4b63-bef5-5280536203f9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:07.163364 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:07.257936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67910e-cbeb-4b63-bef5-5280536203f9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:07.266636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b6bd4-7d8d-4b42-bfbf-4e7d1a4fc97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:07.267542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6bd4-7d8d-4b42-bfbf-4e7d1a4fc97e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:07.267979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6bd4-7d8d-4b42-bfbf-4e7d1a4fc97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:07.268405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6bd4-7d8d-4b42-bfbf-4e7d1a4fc97e admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:07.269302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b6bd4-7d8d-4b42-bfbf-4e7d1a4fc97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:07.270314 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:07.275538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b6bd4-7d8d-4b42-bfbf-4e7d1a4fc97e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:07.278750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eec183-07bb-4cb4-b47c-24daac65c983 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:07.327562 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4008/7976] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:07 2022] POST /identity/v3/users => generated 280 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:07.332090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b6bd4-7d8d-4b42-bfbf-4e7d1a4fc97e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:07.362296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b6bd4-7d8d-4b42-bfbf-4e7d1a4fc97e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:07.378792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191464da-a612-450c-8045-8af8d8168e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:07.380635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191464da-a612-450c-8045-8af8d8168e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:07.383423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191464da-a612-450c-8045-8af8d8168e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:07.383423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191464da-a612-450c-8045-8af8d8168e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:07.389116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191464da-a612-450c-8045-8af8d8168e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:07.395658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191464da-a612-450c-8045-8af8d8168e72 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:07.399826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4858d-7825-446a-ba4c-a8633e3dba1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:07.410566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4858d-7825-446a-ba4c-a8633e3dba1a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:07.410566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4858d-7825-446a-ba4c-a8633e3dba1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:07.410566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4858d-7825-446a-ba4c-a8633e3dba1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:07.443117 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4009/7977] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:07.446939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191464da-a612-450c-8045-8af8d8168e72 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:07.455086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4858d-7825-446a-ba4c-a8633e3dba1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:07.456583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4858d-7825-446a-ba4c-a8633e3dba1a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:07.458757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191464da-a612-450c-8045-8af8d8168e72 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:07.464299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee0ef7-d23e-4384-932e-0dad96054fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:07.465148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0ef7-d23e-4384-932e-0dad96054fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:07.465574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0ef7-d23e-4384-932e-0dad96054fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:07.466536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0ef7-d23e-4384-932e-0dad96054fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:07.467928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee0ef7-d23e-4384-932e-0dad96054fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:07.469781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee0ef7-d23e-4384-932e-0dad96054fcf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:07.483338 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4010/7978] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:07.487319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee0ef7-d23e-4384-932e-0dad96054fcf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:07.489076 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3969/7979] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:37:07.499835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee0ef7-d23e-4384-932e-0dad96054fcf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:07.505708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120273f-a070-4d7d-9589-b22b5ffd628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:07.507066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120273f-a070-4d7d-9589-b22b5ffd628c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:07.507177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120273f-a070-4d7d-9589-b22b5ffd628c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:07.507586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120273f-a070-4d7d-9589-b22b5ffd628c admin admin] PATH_INFO: `/v3/projects/4d42344f68d9422ca260685a1e0f07c5/users/f327c8f3a100402b82f6bb3600fd8f9a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:07.526843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120273f-a070-4d7d-9589-b22b5ffd628c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d42344f68d9422ca260685a1e0f07c5, user_id=f327c8f3a100402b82f6bb3600fd8f9a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:07.530702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120273f-a070-4d7d-9589-b22b5ffd628c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:07.550030 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4011/7980] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:07 2022] PUT /identity/v3/projects/4d42344f68d9422ca260685a1e0f07c5/users/f327c8f3a100402b82f6bb3600fd8f9a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:07.561249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93c16-2317-4d13-961b-f93123823b87 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:07.561545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93c16-2317-4d13-961b-f93123823b87 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:07.562097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93c16-2317-4d13-961b-f93123823b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:07.597466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c8b93c16-2317-4d13-961b-f93123823b87 None None] MFA Rules not processed for user `f327c8f3a100402b82f6bb3600fd8f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:07.598848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8b93c16-2317-4d13-961b-f93123823b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:07.684543 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3970/7981] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:07.745411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120273f-a070-4d7d-9589-b22b5ffd628c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:07.841667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120273f-a070-4d7d-9589-b22b5ffd628c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:07.868645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6fde2-61dd-4ee1-a345-cba0b9fd3b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:07.869364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6fde2-61dd-4ee1-a345-cba0b9fd3b21 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:07.869820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6fde2-61dd-4ee1-a345-cba0b9fd3b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:07.870206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6fde2-61dd-4ee1-a345-cba0b9fd3b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:07.883925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6fde2-61dd-4ee1-a345-cba0b9fd3b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:07.886351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6fde2-61dd-4ee1-a345-cba0b9fd3b21 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:07.895431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b93c16-2317-4d13-961b-f93123823b87 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:07.897524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8b93c16-2317-4d13-961b-f93123823b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:07.910656 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4012/7982] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:08.090249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b93c16-2317-4d13-961b-f93123823b87 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:08.099404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:08.101770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:08.102088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:08.102418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] PATH_INFO: `/v3/projects/133349796718454eb3b452ed62d15a8d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:08.104919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] RBAC: Authorizing `identity:delete_project(project_id=133349796718454eb3b452ed62d15a8d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:08.107523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:08.184088 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:08.201407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133349796718454eb3b452ed62d15a8d', 'request_id': 'req-4b15bf4c-a30c-405f-8f68-103897ff510a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:08.211198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133349796718454eb3b452ed62d15a8d', 'request_id': 'req-4b15bf4c-a30c-405f-8f68-103897ff510a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:08.219051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133349796718454eb3b452ed62d15a8d', 'request_id': 'req-4b15bf4c-a30c-405f-8f68-103897ff510a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:08.241509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] The token cache is being invalidate because project 133349796718454eb3b452ed62d15a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:08.241846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:08.242659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:08.248960 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3971/7983] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:07 2022] DELETE /identity/v3/projects/133349796718454eb3b452ed62d15a8d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:08.250759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88979aa-d84f-4ffb-9b67-c42b7e81b5dc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:08.251050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88979aa-d84f-4ffb-9b67-c42b7e81b5dc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:08.251876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88979aa-d84f-4ffb-9b67-c42b7e81b5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:08.275520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:08.277770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:08.282987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e88979aa-d84f-4ffb-9b67-c42b7e81b5dc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:08.284200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e88979aa-d84f-4ffb-9b67-c42b7e81b5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:08.398650 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:08.403817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15bf4c-a30c-405f-8f68-103897ff510a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:08.418176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7eb113-c879-4f6f-9a25-5f1afb1a41ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:08.420240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eb113-c879-4f6f-9a25-5f1afb1a41ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:08.420738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eb113-c879-4f6f-9a25-5f1afb1a41ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:08.421222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eb113-c879-4f6f-9a25-5f1afb1a41ff admin admin] PATH_INFO: `/v3/users/bae6819d7c9c4172b8ded91b9fec4641` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:08.424410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7eb113-c879-4f6f-9a25-5f1afb1a41ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bae6819d7c9c4172b8ded91b9fec4641)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:08.429998 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7eb113-c879-4f6f-9a25-5f1afb1a41ff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:08.441152 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4013/7984] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:08.448460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b8dd-8d82-44ad-88e7-91bd3fbf8bd4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:08.449586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b8dd-8d82-44ad-88e7-91bd3fbf8bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:08.450798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b8dd-8d82-44ad-88e7-91bd3fbf8bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:08.495819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-99b2b8dd-8d82-44ad-88e7-91bd3fbf8bd4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:08.499009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-99b2b8dd-8d82-44ad-88e7-91bd3fbf8bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:08.515464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ea7eb113-c879-4f6f-9a25-5f1afb1a41ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bae6819d7c9c4172b8ded91b9fec4641'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:08.517546 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4014/7985] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:08.522867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2b8dd-8d82-44ad-88e7-91bd3fbf8bd4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:08.532800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2b8dd-8d82-44ad-88e7-91bd3fbf8bd4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:08.537933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf76551-550c-468e-9836-3af0bc8966f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:08.539072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf76551-550c-468e-9836-3af0bc8966f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:08.539355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf76551-550c-468e-9836-3af0bc8966f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:08.539633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf76551-550c-468e-9836-3af0bc8966f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:08.540666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf76551-550c-468e-9836-3af0bc8966f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:08.540981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf76551-550c-468e-9836-3af0bc8966f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:08.542671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf76551-550c-468e-9836-3af0bc8966f7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:08.550768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ea7eb113-c879-4f6f-9a25-5f1afb1a41ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bae6819d7c9c4172b8ded91b9fec4641'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:08.552513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ea7eb113-c879-4f6f-9a25-5f1afb1a41ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bae6819d7c9c4172b8ded91b9fec4641'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:08.556176 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4015/7986] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:37:08.561982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf76551-550c-468e-9836-3af0bc8966f7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:08.564651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cdf76551-550c-468e-9836-3af0bc8966f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:08.572026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ea7eb113-c879-4f6f-9a25-5f1afb1a41ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bae6819d7c9c4172b8ded91b9fec4641'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:08.582447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ea7eb113-c879-4f6f-9a25-5f1afb1a41ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bae6819d7c9c4172b8ded91b9fec4641'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:08.592924 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3972/7987] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:08 2022] DELETE /identity/v3/users/bae6819d7c9c4172b8ded91b9fec4641 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:08.595445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf76551-550c-468e-9836-3af0bc8966f7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:08.595608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddeec5c-ead9-45c3-abed-8923324ad7f9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:08.595842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddeec5c-ead9-45c3-abed-8923324ad7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:08.596178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddeec5c-ead9-45c3-abed-8923324ad7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:08.633050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2ddeec5c-ead9-45c3-abed-8923324ad7f9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:08.634317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ddeec5c-ead9-45c3-abed-8923324ad7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:08.707352 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:08.739674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4e94f-cd0c-4cf1-8e35-76c6f5379df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:08.740308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4e94f-cd0c-4cf1-8e35-76c6f5379df5 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:08.740588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4e94f-cd0c-4cf1-8e35-76c6f5379df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:08.740861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4e94f-cd0c-4cf1-8e35-76c6f5379df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:08.741493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4e94f-cd0c-4cf1-8e35-76c6f5379df5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:08.743444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4e94f-cd0c-4cf1-8e35-76c6f5379df5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:08.751090 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3973/7988] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:37:08.763267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddeec5c-ead9-45c3-abed-8923324ad7f9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:08.764808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ddeec5c-ead9-45c3-abed-8923324ad7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:08.816252 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4016/7989] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:08 2022] POST /identity/v3/projects => generated 369 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:08.820587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4e94f-cd0c-4cf1-8e35-76c6f5379df5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:08.893371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddeec5c-ead9-45c3-abed-8923324ad7f9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:08.909371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4e94f-cd0c-4cf1-8e35-76c6f5379df5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:08.925187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c5f88-4d31-4230-a358-392f97229c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:08.926091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5f88-4d31-4230-a358-392f97229c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:08.926546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5f88-4d31-4230-a358-392f97229c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:08.926999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5f88-4d31-4230-a358-392f97229c36 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:08.927788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c5f88-4d31-4230-a358-392f97229c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:08.929946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c5f88-4d31-4230-a358-392f97229c36 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:08.993123 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4017/7990] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:08 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:08.994659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c5f88-4d31-4230-a358-392f97229c36 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:09.006676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c5f88-4d31-4230-a358-392f97229c36 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:09.014858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bab8ad-adcf-415a-99e0-0a6794ffa0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:09.019147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab8ad-adcf-415a-99e0-0a6794ffa0cd service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:09.019610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5940b1-e490-4d2b-a801-e722d8cd535c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:09.020821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab8ad-adcf-415a-99e0-0a6794ffa0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:09.021280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab8ad-adcf-415a-99e0-0a6794ffa0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:09.022163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5940b1-e490-4d2b-a801-e722d8cd535c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:09.022648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5940b1-e490-4d2b-a801-e722d8cd535c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:09.023548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5940b1-e490-4d2b-a801-e722d8cd535c admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:09.024413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5940b1-e490-4d2b-a801-e722d8cd535c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:09.031332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5940b1-e490-4d2b-a801-e722d8cd535c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:09.046060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bab8ad-adcf-415a-99e0-0a6794ffa0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:09.048075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bab8ad-adcf-415a-99e0-0a6794ffa0cd service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:09.057908 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4018/7991] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:09.059219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5940b1-e490-4d2b-a801-e722d8cd535c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:09.076532 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3974/7992] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:09.079379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5940b1-e490-4d2b-a801-e722d8cd535c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:09.085267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cb36b-56b1-4fc2-88b3-150a8fce3afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:09.086080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cb36b-56b1-4fc2-88b3-150a8fce3afd admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:09.086516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cb36b-56b1-4fc2-88b3-150a8fce3afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:09.087005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cb36b-56b1-4fc2-88b3-150a8fce3afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:09.087811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cb36b-56b1-4fc2-88b3-150a8fce3afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:09.089571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cb36b-56b1-4fc2-88b3-150a8fce3afd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:09.100917 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4019/7993] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:09.105612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bab8ad-adcf-415a-99e0-0a6794ffa0cd service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:09.119793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bab8ad-adcf-415a-99e0-0a6794ffa0cd service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:09.139412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34a949-3f31-4715-833f-3be7a738f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:09.140098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34a949-3f31-4715-833f-3be7a738f6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:09.140381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34a949-3f31-4715-833f-3be7a738f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:09.140656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34a949-3f31-4715-833f-3be7a738f6eb admin admin] PATH_INFO: `/v3/projects/559149cb601548ac9236af1427458015/users/2d1fa5d07d1e4401873aa27cab0446e8/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:09.185877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34a949-3f31-4715-833f-3be7a738f6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=559149cb601548ac9236af1427458015, user_id=2d1fa5d07d1e4401873aa27cab0446e8, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:09.192814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34a949-3f31-4715-833f-3be7a738f6eb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:09.245882 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3975/7994] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:09 2022] PUT /identity/v3/projects/559149cb601548ac9236af1427458015/users/2d1fa5d07d1e4401873aa27cab0446e8/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:09.259513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a5565-437a-48e1-b34e-87504b518fb2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:09.259914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a5565-437a-48e1-b34e-87504b518fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:09.260194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a5565-437a-48e1-b34e-87504b518fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:09.321659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-729a5565-437a-48e1-b34e-87504b518fb2 None None] MFA Rules not processed for user `2d1fa5d07d1e4401873aa27cab0446e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:09.323624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-729a5565-437a-48e1-b34e-87504b518fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:09.359665 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:09.445111 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4020/7995] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:09.458580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34a949-3f31-4715-833f-3be7a738f6eb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:09.460506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fe34a949-3f31-4715-833f-3be7a738f6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:09.561471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34a949-3f31-4715-833f-3be7a738f6eb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:09.576208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc225e4-0633-47b3-9fd1-7b20dc95c5f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:09.577034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc225e4-0633-47b3-9fd1-7b20dc95c5f3 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:09.577648 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc225e4-0633-47b3-9fd1-7b20dc95c5f3 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:09.578074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc225e4-0633-47b3-9fd1-7b20dc95c5f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:09.601346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc225e4-0633-47b3-9fd1-7b20dc95c5f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:09.604545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc225e4-0633-47b3-9fd1-7b20dc95c5f3 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:09.634537 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3976/7996] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:09.719736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a5565-437a-48e1-b34e-87504b518fb2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:09.721375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-729a5565-437a-48e1-b34e-87504b518fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:09.883074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a5565-437a-48e1-b34e-87504b518fb2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:09.905160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:09.909336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:09.910902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:09.911288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] PATH_INFO: `/v3/projects/36469b0be3994eb08886c8dfa423a64e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:09.919727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=36469b0be3994eb08886c8dfa423a64e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:09.924916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:10.095473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36469b0be3994eb08886c8dfa423a64e', 'request_id': 'req-423ded2c-552a-4319-a620-f740ea4627ed'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:10.107385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36469b0be3994eb08886c8dfa423a64e', 'request_id': 'req-423ded2c-552a-4319-a620-f740ea4627ed'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:10.115890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36469b0be3994eb08886c8dfa423a64e', 'request_id': 'req-423ded2c-552a-4319-a620-f740ea4627ed'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:10.147278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] The token cache is being invalidate because project 36469b0be3994eb08886c8dfa423a64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:10.147851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:10.148764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:10.154916 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4021/7997] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:09 2022] DELETE /identity/v3/projects/36469b0be3994eb08886c8dfa423a64e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:10.155103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc225e4-0633-47b3-9fd1-7b20dc95c5f3 service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:10.195650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc225e4-0633-47b3-9fd1-7b20dc95c5f3 service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:10.313811 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:10.392772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b5358-c206-4498-a6b3-c2444af429c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:10.393395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b5358-c206-4498-a6b3-c2444af429c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:10.393585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b5358-c206-4498-a6b3-c2444af429c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:10.393849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b5358-c206-4498-a6b3-c2444af429c8 admin admin] PATH_INFO: `/v3/users/50db79189cb64600b87f29db1ddf1ecb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:10.395726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b5358-c206-4498-a6b3-c2444af429c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50db79189cb64600b87f29db1ddf1ecb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:10.397697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b5358-c206-4498-a6b3-c2444af429c8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:10.508793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a95b5358-c206-4498-a6b3-c2444af429c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50db79189cb64600b87f29db1ddf1ecb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:10.535751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a95b5358-c206-4498-a6b3-c2444af429c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50db79189cb64600b87f29db1ddf1ecb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:10.547108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a95b5358-c206-4498-a6b3-c2444af429c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50db79189cb64600b87f29db1ddf1ecb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:10.575936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a95b5358-c206-4498-a6b3-c2444af429c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50db79189cb64600b87f29db1ddf1ecb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:10.587500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a95b5358-c206-4498-a6b3-c2444af429c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50db79189cb64600b87f29db1ddf1ecb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:10.600306 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3977/7998] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:10 2022] DELETE /identity/v3/users/50db79189cb64600b87f29db1ddf1ecb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:10.974005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:10.975650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:10.999743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ded2c-552a-4319-a620-f740ea4627ed admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:11.115050 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:11.156456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:11.157385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:11.157730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:11.158161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] PATH_INFO: `/v3/projects/d1d3a73fc5df4d4ba3ffc9cb137fc1df` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:11.159604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d3a73fc5df4d4ba3ffc9cb137fc1df)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:11.162459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:11.258058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d3a73fc5df4d4ba3ffc9cb137fc1df', 'request_id': 'req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:11.272774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d3a73fc5df4d4ba3ffc9cb137fc1df', 'request_id': 'req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:11.283675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d3a73fc5df4d4ba3ffc9cb137fc1df', 'request_id': 'req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:11.319641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] The token cache is being invalidate because project d1d3a73fc5df4d4ba3ffc9cb137fc1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:11.319937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:11.320982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fde32b66-bb17-47bd-93ea-a5dc2ec7101a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:11.329653 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4022/7999] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:10 2022] DELETE /identity/v3/projects/d1d3a73fc5df4d4ba3ffc9cb137fc1df => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:11.333031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8501fa-ec85-4e0d-b5f4-87d4979083af None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:11.336754 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8501fa-ec85-4e0d-b5f4-87d4979083af None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:11.337405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8501fa-ec85-4e0d-b5f4-87d4979083af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:11.398155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea8501fa-ec85-4e0d-b5f4-87d4979083af None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:11.406076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea8501fa-ec85-4e0d-b5f4-87d4979083af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:11.581325 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3978/8000] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:11.589168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0430c95-25af-46ea-95fa-726bd4618367 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:11.589721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0430c95-25af-46ea-95fa-726bd4618367 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:11.590851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0430c95-25af-46ea-95fa-726bd4618367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:11.638116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e0430c95-25af-46ea-95fa-726bd4618367 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:11.641272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e0430c95-25af-46ea-95fa-726bd4618367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:11.666076 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4023/8001] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:37:11.670675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8501fa-ec85-4e0d-b5f4-87d4979083af None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:11.690084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8501fa-ec85-4e0d-b5f4-87d4979083af None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:11.705850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a52305-c029-461f-b779-ceda7231754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:11.708793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a52305-c029-461f-b779-ceda7231754b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:11.710716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a52305-c029-461f-b779-ceda7231754b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:11.711461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a52305-c029-461f-b779-ceda7231754b admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:11.713439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a52305-c029-461f-b779-ceda7231754b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:11.715727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a52305-c029-461f-b779-ceda7231754b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:11.720218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a52305-c029-461f-b779-ceda7231754b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:11.750759 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3979/8002] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:37:11.755508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0430c95-25af-46ea-95fa-726bd4618367 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:11.771539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0430c95-25af-46ea-95fa-726bd4618367 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:11.785552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654c5d1-9094-4bd0-841a-74cd430d768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:11.787883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c5d1-9094-4bd0-841a-74cd430d768a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:11.788977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c5d1-9094-4bd0-841a-74cd430d768a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:11.790176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c5d1-9094-4bd0-841a-74cd430d768a admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:11.791048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654c5d1-9094-4bd0-841a-74cd430d768a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:11.800523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654c5d1-9094-4bd0-841a-74cd430d768a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:11.895931 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4024/8003] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:11 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:37:11.900095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a52305-c029-461f-b779-ceda7231754b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:11.920159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a52305-c029-461f-b779-ceda7231754b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:11.995277 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:12.075945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdec95-9165-44ac-bddd-829398270214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:12.079549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdec95-9165-44ac-bddd-829398270214 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:12.079843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdec95-9165-44ac-bddd-829398270214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:12.083985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdec95-9165-44ac-bddd-829398270214 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:12.083985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdec95-9165-44ac-bddd-829398270214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:12.088283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdec95-9165-44ac-bddd-829398270214 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:12.180084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3980/8004] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:11 2022] POST /identity/v3/users => generated 295 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:37:12.188169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654c5d1-9094-4bd0-841a-74cd430d768a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:12.219786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654c5d1-9094-4bd0-841a-74cd430d768a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:12.233212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c7a52-ff04-41db-ac6c-5e05b7d64ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:12.233836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c7a52-ff04-41db-ac6c-5e05b7d64ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:12.234122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c7a52-ff04-41db-ac6c-5e05b7d64ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:12.237856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c7a52-ff04-41db-ac6c-5e05b7d64ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:12.241595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c7a52-ff04-41db-ac6c-5e05b7d64ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:12.243606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c7a52-ff04-41db-ac6c-5e05b7d64ca0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:12.266833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdec95-9165-44ac-bddd-829398270214 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:12.273755 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4025/8005] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:12.279446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdec95-9165-44ac-bddd-829398270214 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:12.295031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3b65-2c2e-4535-8070-36dd27ccdd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:12.295684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3b65-2c2e-4535-8070-36dd27ccdd29 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:12.296059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3b65-2c2e-4535-8070-36dd27ccdd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:12.296723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3b65-2c2e-4535-8070-36dd27ccdd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:12.298536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb3b65-2c2e-4535-8070-36dd27ccdd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:12.302478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb3b65-2c2e-4535-8070-36dd27ccdd29 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:12.337687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c7a52-ff04-41db-ac6c-5e05b7d64ca0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:12.338718 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3981/8006] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:37:12.353647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c7a52-ff04-41db-ac6c-5e05b7d64ca0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:12.367124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915433bd-d40e-490c-894d-8cfe6ad04842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:12.367803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915433bd-d40e-490c-894d-8cfe6ad04842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:12.368090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915433bd-d40e-490c-894d-8cfe6ad04842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:12.368371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915433bd-d40e-490c-894d-8cfe6ad04842 admin admin] PATH_INFO: `/v3/projects/ea2880c356f14799a174289633343efc/users/388dc6a562eb49689346b0b0dd36c254/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:12.430148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915433bd-d40e-490c-894d-8cfe6ad04842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2880c356f14799a174289633343efc, user_id=388dc6a562eb49689346b0b0dd36c254, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:12.436738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915433bd-d40e-490c-894d-8cfe6ad04842 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:12.469481 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4026/8007] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:12 2022] PUT /identity/v3/projects/ea2880c356f14799a174289633343efc/users/388dc6a562eb49689346b0b0dd36c254/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:12.483469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654db70-5c89-4220-9135-c1ee0aa57e7a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:12.483942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654db70-5c89-4220-9135-c1ee0aa57e7a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:12.484396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654db70-5c89-4220-9135-c1ee0aa57e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:12.526048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e654db70-5c89-4220-9135-c1ee0aa57e7a None None] MFA Rules not processed for user `388dc6a562eb49689346b0b0dd36c254`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:12.528374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e654db70-5c89-4220-9135-c1ee0aa57e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:12.745213 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3982/8008] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:12.751075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915433bd-d40e-490c-894d-8cfe6ad04842 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:12.753402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-915433bd-d40e-490c-894d-8cfe6ad04842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:12.999752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915433bd-d40e-490c-894d-8cfe6ad04842 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:13.022423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0a7bd-767b-4376-bbb5-7846f1b23665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:13.023089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0a7bd-767b-4376-bbb5-7846f1b23665 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:13.023374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0a7bd-767b-4376-bbb5-7846f1b23665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:13.023649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0a7bd-767b-4376-bbb5-7846f1b23665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:13.059412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0a7bd-767b-4376-bbb5-7846f1b23665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:13.059412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0a7bd-767b-4376-bbb5-7846f1b23665 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:13.075665 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4027/8009] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:21.801989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654db70-5c89-4220-9135-c1ee0aa57e7a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:21.804319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e654db70-5c89-4220-9135-c1ee0aa57e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:21.927882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654db70-5c89-4220-9135-c1ee0aa57e7a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:21.935015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:21.935960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:21.936365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:21.936787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] PATH_INFO: `/v3/users/f327c8f3a100402b82f6bb3600fd8f9a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:21.938759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f327c8f3a100402b82f6bb3600fd8f9a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:21.940897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:22.022845 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:22.032227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f327c8f3a100402b82f6bb3600fd8f9a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:22.048659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f327c8f3a100402b82f6bb3600fd8f9a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:22.054930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f327c8f3a100402b82f6bb3600fd8f9a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:22.070441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f327c8f3a100402b82f6bb3600fd8f9a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:22.099913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f327c8f3a100402b82f6bb3600fd8f9a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:22.118405 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3983/8010] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:21 2022] DELETE /identity/v3/users/f327c8f3a100402b82f6bb3600fd8f9a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:22.123932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d335ec1-97a9-4090-8ba1-bffd50c4a1cb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:22.124462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d335ec1-97a9-4090-8ba1-bffd50c4a1cb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:22.124552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d335ec1-97a9-4090-8ba1-bffd50c4a1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:22.155458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1d335ec1-97a9-4090-8ba1-bffd50c4a1cb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:22.157081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1d335ec1-97a9-4090-8ba1-bffd50c4a1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:22.182318 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:22.312324 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4028/8011] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:37:22.312906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:22.314324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:22.424746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23796a-4705-4ace-8e29-b7ea91253e27 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:22.435330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ee5af-5a53-4df4-b803-9f867de58a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:22.435965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee5af-5a53-4df4-b803-9f867de58a6e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:22.436499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee5af-5a53-4df4-b803-9f867de58a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:22.436769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee5af-5a53-4df4-b803-9f867de58a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:22.449537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ee5af-5a53-4df4-b803-9f867de58a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:22.451163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ee5af-5a53-4df4-b803-9f867de58a6e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:22.468257 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3984/8012] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:22.751471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d335ec1-97a9-4090-8ba1-bffd50c4a1cb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:22.753378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1d335ec1-97a9-4090-8ba1-bffd50c4a1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:22.788160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d335ec1-97a9-4090-8ba1-bffd50c4a1cb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:22.801223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:22.802161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:22.804851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:22.804851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] PATH_INFO: `/v3/projects/4d42344f68d9422ca260685a1e0f07c5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:22.809416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d42344f68d9422ca260685a1e0f07c5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:22.811787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:22.976822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d42344f68d9422ca260685a1e0f07c5', 'request_id': 'req-6d542836-27a6-42a7-ad4e-e49de1179071'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:23.013410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d42344f68d9422ca260685a1e0f07c5', 'request_id': 'req-6d542836-27a6-42a7-ad4e-e49de1179071'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:23.024597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d42344f68d9422ca260685a1e0f07c5', 'request_id': 'req-6d542836-27a6-42a7-ad4e-e49de1179071'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:23.061984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] The token cache is being invalidate because project 4d42344f68d9422ca260685a1e0f07c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:23.063269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:23.066850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6d542836-27a6-42a7-ad4e-e49de1179071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:23.074813 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4029/8013] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:22 2022] DELETE /identity/v3/projects/4d42344f68d9422ca260685a1e0f07c5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:23.076641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287629-331c-4b58-a2e7-c3830490f174 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:23.077140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287629-331c-4b58-a2e7-c3830490f174 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:23.077610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287629-331c-4b58-a2e7-c3830490f174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:23.114005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3a287629-331c-4b58-a2e7-c3830490f174 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:23.116562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a287629-331c-4b58-a2e7-c3830490f174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:23.302829 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3985/8014] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:23.311520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ece0-1cb9-43fc-80d1-370548e6074e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:23.312503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ece0-1cb9-43fc-80d1-370548e6074e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:23.313022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ece0-1cb9-43fc-80d1-370548e6074e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:23.393433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-49e9ece0-1cb9-43fc-80d1-370548e6074e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:23.399843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-49e9ece0-1cb9-43fc-80d1-370548e6074e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:23.426650 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4030/8015] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:23.429439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a287629-331c-4b58-a2e7-c3830490f174 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:23.447514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a287629-331c-4b58-a2e7-c3830490f174 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:23.458624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cc0d9-e75f-460b-9acc-b831f63bf55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:23.459866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc0d9-e75f-460b-9acc-b831f63bf55f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:23.460320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc0d9-e75f-460b-9acc-b831f63bf55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:23.460940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc0d9-e75f-460b-9acc-b831f63bf55f admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:23.461840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cc0d9-e75f-460b-9acc-b831f63bf55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:23.462313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cc0d9-e75f-460b-9acc-b831f63bf55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:23.464984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cc0d9-e75f-460b-9acc-b831f63bf55f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:23.489057 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3986/8016] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:37:23.495296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ece0-1cb9-43fc-80d1-370548e6074e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:23.509695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ece0-1cb9-43fc-80d1-370548e6074e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:23.535043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c76a-56b4-4f29-b6f3-b2e3bb598f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:23.535636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c76a-56b4-4f29-b6f3-b2e3bb598f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:23.535918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c76a-56b4-4f29-b6f3-b2e3bb598f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:23.536191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c76a-56b4-4f29-b6f3-b2e3bb598f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:23.536845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394c76a-56b4-4f29-b6f3-b2e3bb598f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:23.540832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394c76a-56b4-4f29-b6f3-b2e3bb598f70 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:23.628398 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4031/8017] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:23 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:23.629923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cc0d9-e75f-460b-9acc-b831f63bf55f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:23.651035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cc0d9-e75f-460b-9acc-b831f63bf55f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:23.786640 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:23.824711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3183-e752-4d21-a914-131ce6e9d23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:23.825335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3183-e752-4d21-a914-131ce6e9d23e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:23.825616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3183-e752-4d21-a914-131ce6e9d23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:23.825886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3183-e752-4d21-a914-131ce6e9d23e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:23.826526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3183-e752-4d21-a914-131ce6e9d23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:23.833126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3183-e752-4d21-a914-131ce6e9d23e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:23.923311 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3987/8018] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:23 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:23.926259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c76a-56b4-4f29-b6f3-b2e3bb598f70 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:23.943526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c76a-56b4-4f29-b6f3-b2e3bb598f70 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:23.954120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0f64d-0f52-4047-a778-b0d69fab3c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:23.954784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0f64d-0f52-4047-a778-b0d69fab3c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:23.955066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0f64d-0f52-4047-a778-b0d69fab3c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:23.955343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0f64d-0f52-4047-a778-b0d69fab3c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:23.956005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0f64d-0f52-4047-a778-b0d69fab3c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:23.957618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0f64d-0f52-4047-a778-b0d69fab3c2d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:24.023582 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4032/8019] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:24.028366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3183-e752-4d21-a914-131ce6e9d23e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:24.056932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3183-e752-4d21-a914-131ce6e9d23e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:24.076493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5daaa-5722-4cac-a76c-c360a178000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:24.077205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5daaa-5722-4cac-a76c-c360a178000c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:24.077996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5daaa-5722-4cac-a76c-c360a178000c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:24.077996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5daaa-5722-4cac-a76c-c360a178000c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:24.078401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5daaa-5722-4cac-a76c-c360a178000c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:24.081788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5daaa-5722-4cac-a76c-c360a178000c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:24.100047 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3988/8020] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:37:24.104733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0f64d-0f52-4047-a778-b0d69fab3c2d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:24.117006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0f64d-0f52-4047-a778-b0d69fab3c2d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:24.124032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809a050-91ef-43d9-9212-308d5aadafee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:24.125522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809a050-91ef-43d9-9212-308d5aadafee admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:24.126046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809a050-91ef-43d9-9212-308d5aadafee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:24.126551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809a050-91ef-43d9-9212-308d5aadafee admin admin] PATH_INFO: `/v3/projects/b229606bdad24e64a656174d1900c90c/users/cc31137d9b2a47049b1d79b8224a7ead/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:24.153876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809a050-91ef-43d9-9212-308d5aadafee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b229606bdad24e64a656174d1900c90c, user_id=cc31137d9b2a47049b1d79b8224a7ead, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:24.156960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809a050-91ef-43d9-9212-308d5aadafee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:24.190174 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4033/8021] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:24 2022] PUT /identity/v3/projects/b229606bdad24e64a656174d1900c90c/users/cc31137d9b2a47049b1d79b8224a7ead/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:24.202311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f033-20a9-46b0-8a79-50bdae9b359d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:24.202935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f033-20a9-46b0-8a79-50bdae9b359d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:24.203469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f033-20a9-46b0-8a79-50bdae9b359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:24.245026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0b32f033-20a9-46b0-8a79-50bdae9b359d None None] MFA Rules not processed for user `cc31137d9b2a47049b1d79b8224a7ead`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:24.246668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b32f033-20a9-46b0-8a79-50bdae9b359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:24.368371 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3989/8022] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:24.373337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809a050-91ef-43d9-9212-308d5aadafee admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:24.422091 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:24.451428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809a050-91ef-43d9-9212-308d5aadafee admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:24.463694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b6b48-ca7d-4068-89c2-07a79054733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:24.465836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6b48-ca7d-4068-89c2-07a79054733e admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:24.466120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6b48-ca7d-4068-89c2-07a79054733e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:24.466398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6b48-ca7d-4068-89c2-07a79054733e admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:24.467857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b6b48-ca7d-4068-89c2-07a79054733e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:24.473401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b6b48-ca7d-4068-89c2-07a79054733e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:24.540607 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4034/8023] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:24 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:24.541766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f033-20a9-46b0-8a79-50bdae9b359d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:24.556265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f033-20a9-46b0-8a79-50bdae9b359d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:24.630051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2cba-3815-44de-ab6a-bd13ed6aa0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:24.631188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2cba-3815-44de-ab6a-bd13ed6aa0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:24.631474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2cba-3815-44de-ab6a-bd13ed6aa0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:24.631758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2cba-3815-44de-ab6a-bd13ed6aa0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:24.632598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a2cba-3815-44de-ab6a-bd13ed6aa0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:24.635316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a2cba-3815-44de-ab6a-bd13ed6aa0b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:24.678142 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3990/8024] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:24 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:24.682309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b6b48-ca7d-4068-89c2-07a79054733e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:24.695265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b6b48-ca7d-4068-89c2-07a79054733e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:24.702802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c22aa0-a63d-4f0e-baf8-724ceae5d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:24.703751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c22aa0-a63d-4f0e-baf8-724ceae5d2af admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:24.704318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c22aa0-a63d-4f0e-baf8-724ceae5d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:24.704772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c22aa0-a63d-4f0e-baf8-724ceae5d2af admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:24.705633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c22aa0-a63d-4f0e-baf8-724ceae5d2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:24.707978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c22aa0-a63d-4f0e-baf8-724ceae5d2af admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:24.721767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4035/8025] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:24.725439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2cba-3815-44de-ab6a-bd13ed6aa0b0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:24.737877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2cba-3815-44de-ab6a-bd13ed6aa0b0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:24.744640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2cb0e-576c-4205-8040-365a055c8944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:24.746367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2cb0e-576c-4205-8040-365a055c8944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:24.747211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2cb0e-576c-4205-8040-365a055c8944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:24.747704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2cb0e-576c-4205-8040-365a055c8944 admin admin] PATH_INFO: `/v3/projects/9f4a398cbe81464987fef795efafbd0c/users/21819bacc5fb4ce580c0c93aa59f1c57/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:24.767819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2cb0e-576c-4205-8040-365a055c8944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4a398cbe81464987fef795efafbd0c, user_id=21819bacc5fb4ce580c0c93aa59f1c57, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:24.771191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2cb0e-576c-4205-8040-365a055c8944 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:24.794803 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3991/8026] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:24 2022] PUT /identity/v3/projects/9f4a398cbe81464987fef795efafbd0c/users/21819bacc5fb4ce580c0c93aa59f1c57/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:24.798583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c22aa0-a63d-4f0e-baf8-724ceae5d2af admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:24.835844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c22aa0-a63d-4f0e-baf8-724ceae5d2af admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:24.930859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e4fbd-2199-4c96-a1eb-c4c51c429119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:24.931754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e4fbd-2199-4c96-a1eb-c4c51c429119 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:24.932106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e4fbd-2199-4c96-a1eb-c4c51c429119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:24.932448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e4fbd-2199-4c96-a1eb-c4c51c429119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:24.933269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e4fbd-2199-4c96-a1eb-c4c51c429119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:24.935837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e4fbd-2199-4c96-a1eb-c4c51c429119 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:24.958417 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4036/8027] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:24.963159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2cb0e-576c-4205-8040-365a055c8944 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:24.979133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2cb0e-576c-4205-8040-365a055c8944 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:24.989796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68397c7b-c804-47ae-ae1f-d987368b7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:24.990784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68397c7b-c804-47ae-ae1f-d987368b7891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:24.992170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68397c7b-c804-47ae-ae1f-d987368b7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:24.992771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68397c7b-c804-47ae-ae1f-d987368b7891 admin admin] PATH_INFO: `/v3/projects/9f4a398cbe81464987fef795efafbd0c/users/21819bacc5fb4ce580c0c93aa59f1c57/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:24.997302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68397c7b-c804-47ae-ae1f-d987368b7891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4a398cbe81464987fef795efafbd0c, user_id=21819bacc5fb4ce580c0c93aa59f1c57, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:25.007540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68397c7b-c804-47ae-ae1f-d987368b7891 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:25.050540 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3992/8028] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:24 2022] PUT /identity/v3/projects/9f4a398cbe81464987fef795efafbd0c/users/21819bacc5fb4ce580c0c93aa59f1c57/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:25.054697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80a2a-98c0-40f9-aabe-83ab97e517b7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:25.054697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80a2a-98c0-40f9-aabe-83ab97e517b7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:25.054697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80a2a-98c0-40f9-aabe-83ab97e517b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:25.101355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3fd80a2a-98c0-40f9-aabe-83ab97e517b7 None None] MFA Rules not processed for user `21819bacc5fb4ce580c0c93aa59f1c57`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:25.102615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3fd80a2a-98c0-40f9-aabe-83ab97e517b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:25.223778 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4037/8029] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:37:25.231575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68397c7b-c804-47ae-ae1f-d987368b7891 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:25.233537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-68397c7b-c804-47ae-ae1f-d987368b7891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:25.250404 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:25.336769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68397c7b-c804-47ae-ae1f-d987368b7891 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:25.341437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd507-c011-4e11-9659-80ddfd217fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:25.342328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd507-c011-4e11-9659-80ddfd217fdf service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:25.342739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd507-c011-4e11-9659-80ddfd217fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:25.343133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd507-c011-4e11-9659-80ddfd217fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:25.358580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dd507-c011-4e11-9659-80ddfd217fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:25.360376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dd507-c011-4e11-9659-80ddfd217fdf service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:25.373849 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3993/8030] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:25.916102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80a2a-98c0-40f9-aabe-83ab97e517b7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:25.928972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80a2a-98c0-40f9-aabe-83ab97e517b7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:25.940972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5bb6b-dea2-4723-8977-d348ba0c2bc4 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21819bacc5fb4ce580c0c93aa59f1c57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f4a398cbe81464987fef795efafbd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:25.942436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5bb6b-dea2-4723-8977-d348ba0c2bc4 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:25.945932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5bb6b-dea2-4723-8977-d348ba0c2bc4 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:25.946301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5bb6b-dea2-4723-8977-d348ba0c2bc4 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:25.947045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5bb6b-dea2-4723-8977-d348ba0c2bc4 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:25.947361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5bb6b-dea2-4723-8977-d348ba0c2bc4 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:25.951132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5bb6b-dea2-4723-8977-d348ba0c2bc4 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:25.975454 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4038/8031] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:37:25.979547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd507-c011-4e11-9659-80ddfd217fdf service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:25.992393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd507-c011-4e11-9659-80ddfd217fdf service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:25.999676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6c4b7-ed1c-404d-af9a-8e06ba948d99 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21819bacc5fb4ce580c0c93aa59f1c57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f4a398cbe81464987fef795efafbd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:26.000474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6c4b7-ed1c-404d-af9a-8e06ba948d99 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:26.000871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6c4b7-ed1c-404d-af9a-8e06ba948d99 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:26.001244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6c4b7-ed1c-404d-af9a-8e06ba948d99 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:26.001984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6c4b7-ed1c-404d-af9a-8e06ba948d99 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:26.004165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6c4b7-ed1c-404d-af9a-8e06ba948d99 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:26.043597 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3994/8032] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:25 2022] POST /identity/v3/projects => generated 353 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:26.047346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5bb6b-dea2-4723-8977-d348ba0c2bc4 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:26.060363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5bb6b-dea2-4723-8977-d348ba0c2bc4 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:26.087212 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:26.164625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71fe31-62a6-42b1-983f-e45bfe8ea901 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21819bacc5fb4ce580c0c93aa59f1c57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f4a398cbe81464987fef795efafbd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:26.165432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71fe31-62a6-42b1-983f-e45bfe8ea901 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:26.165789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71fe31-62a6-42b1-983f-e45bfe8ea901 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:26.168227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71fe31-62a6-42b1-983f-e45bfe8ea901 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:26.168975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71fe31-62a6-42b1-983f-e45bfe8ea901 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:26.169300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71fe31-62a6-42b1-983f-e45bfe8ea901 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:26.170971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71fe31-62a6-42b1-983f-e45bfe8ea901 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:26.194486 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4039/8033] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:37:26.278113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6c4b7-ed1c-404d-af9a-8e06ba948d99 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:26.294435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6c4b7-ed1c-404d-af9a-8e06ba948d99 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:26.307051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21819bacc5fb4ce580c0c93aa59f1c57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f4a398cbe81464987fef795efafbd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:26.309445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:26.310032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:26.310632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] PATH_INFO: `/v3/projects/ffe2e1162077459ab2a1176cc932991e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:26.317007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ffe2e1162077459ab2a1176cc932991e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:26.324957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:26.421153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe2e1162077459ab2a1176cc932991e', 'request_id': 'req-314e6ec7-f303-4706-91f9-a6a4d4043c45'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:26.429783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe2e1162077459ab2a1176cc932991e', 'request_id': 'req-314e6ec7-f303-4706-91f9-a6a4d4043c45'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:26.443325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe2e1162077459ab2a1176cc932991e', 'request_id': 'req-314e6ec7-f303-4706-91f9-a6a4d4043c45'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:26.477259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] The token cache is being invalidate because project ffe2e1162077459ab2a1176cc932991e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:26.479429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:26.482350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:26.485892 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3995/8034] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:26 2022] DELETE /identity/v3/projects/ffe2e1162077459ab2a1176cc932991e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:26.855486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71fe31-62a6-42b1-983f-e45bfe8ea901 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:26.857622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dc71fe31-62a6-42b1-983f-e45bfe8ea901 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:26.889187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:26.891680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:27.032568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e6ec7-f303-4706-91f9-a6a4d4043c45 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:27.039354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71fe31-62a6-42b1-983f-e45bfe8ea901 tempest-VolumeQuotaClassesTest-8630106 tempest-VolumeQuotaClassesTest-8630106-project-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:27.040502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49232b9b-57d5-4540-a3ec-ac02afb6625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:27.041601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49232b9b-57d5-4540-a3ec-ac02afb6625b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:27.042529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49232b9b-57d5-4540-a3ec-ac02afb6625b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:27.043597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49232b9b-57d5-4540-a3ec-ac02afb6625b admin admin] PATH_INFO: `/v3/users/35032fdb83dc43d5b26d4e828d07873a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:27.047286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49232b9b-57d5-4540-a3ec-ac02afb6625b admin admin] RBAC: Authorizing `identity:delete_user(user_id=35032fdb83dc43d5b26d4e828d07873a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:27.050973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49232b9b-57d5-4540-a3ec-ac02afb6625b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:27.054181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b71f-89ac-40e7-85c5-71021710db5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:27.057314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b71f-89ac-40e7-85c5-71021710db5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:27.059717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b71f-89ac-40e7-85c5-71021710db5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:27.060020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b71f-89ac-40e7-85c5-71021710db5a admin admin] PATH_INFO: `/v3/users/cc31137d9b2a47049b1d79b8224a7ead` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:27.062249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4b71f-89ac-40e7-85c5-71021710db5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc31137d9b2a47049b1d79b8224a7ead)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:27.066851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4b71f-89ac-40e7-85c5-71021710db5a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:27.077162 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:27.142868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49232b9b-57d5-4540-a3ec-ac02afb6625b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35032fdb83dc43d5b26d4e828d07873a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:27.161374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49232b9b-57d5-4540-a3ec-ac02afb6625b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35032fdb83dc43d5b26d4e828d07873a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:27.162779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49232b9b-57d5-4540-a3ec-ac02afb6625b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35032fdb83dc43d5b26d4e828d07873a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:27.167810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7e4b71f-89ac-40e7-85c5-71021710db5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc31137d9b2a47049b1d79b8224a7ead'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:27.173782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49232b9b-57d5-4540-a3ec-ac02afb6625b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35032fdb83dc43d5b26d4e828d07873a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:27.184536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49232b9b-57d5-4540-a3ec-ac02afb6625b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35032fdb83dc43d5b26d4e828d07873a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:27.195673 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3996/8035] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:26 2022] DELETE /identity/v3/users/35032fdb83dc43d5b26d4e828d07873a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:27.200771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708669ea-7fb5-4d27-8735-13c719472955 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:27.201183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708669ea-7fb5-4d27-8735-13c719472955 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:27.201866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708669ea-7fb5-4d27-8735-13c719472955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:27.208290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7e4b71f-89ac-40e7-85c5-71021710db5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc31137d9b2a47049b1d79b8224a7ead'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:27.209538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7e4b71f-89ac-40e7-85c5-71021710db5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc31137d9b2a47049b1d79b8224a7ead'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:27.227525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7e4b71f-89ac-40e7-85c5-71021710db5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc31137d9b2a47049b1d79b8224a7ead'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:27.229643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f7e4b71f-89ac-40e7-85c5-71021710db5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc31137d9b2a47049b1d79b8224a7ead'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:27.232218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-708669ea-7fb5-4d27-8735-13c719472955 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:27.233272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-708669ea-7fb5-4d27-8735-13c719472955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:27.264827 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4040/8036] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:26 2022] DELETE /identity/v3/users/cc31137d9b2a47049b1d79b8224a7ead => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:27.269212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bf004-1043-4460-abc7-ffc34a2206e2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:27.269686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bf004-1043-4460-abc7-ffc34a2206e2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:27.270068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bf004-1043-4460-abc7-ffc34a2206e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:27.317478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-501bf004-1043-4460-abc7-ffc34a2206e2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:27.319206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-501bf004-1043-4460-abc7-ffc34a2206e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:27.337768 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3997/8037] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:27.363939 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:27.364709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708669ea-7fb5-4d27-8735-13c719472955 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:27.366272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-708669ea-7fb5-4d27-8735-13c719472955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:27.464681 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4041/8038] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:27.473395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708669ea-7fb5-4d27-8735-13c719472955 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:27.474624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bf004-1043-4460-abc7-ffc34a2206e2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:27.476951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-501bf004-1043-4460-abc7-ffc34a2206e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:27.557066 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:27.567454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8717d1-036d-4cba-9591-1086775af6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:27.568248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8717d1-036d-4cba-9591-1086775af6aa service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:27.569270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8717d1-036d-4cba-9591-1086775af6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:27.569796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8717d1-036d-4cba-9591-1086775af6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:27.580300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bf004-1043-4460-abc7-ffc34a2206e2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:27.586498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459387-8c42-4280-965c-02315028b1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:27.587242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459387-8c42-4280-965c-02315028b1fd service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:27.587412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8717d1-036d-4cba-9591-1086775af6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:27.587702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459387-8c42-4280-965c-02315028b1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:27.588068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459387-8c42-4280-965c-02315028b1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:27.590371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8717d1-036d-4cba-9591-1086775af6aa service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:27.602703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de459387-8c42-4280-965c-02315028b1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:27.604303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de459387-8c42-4280-965c-02315028b1fd service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:27.609378 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3998/8039] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:27.618653 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4042/8040] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:27.995707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8717d1-036d-4cba-9591-1086775af6aa service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:27.997241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6f8717d1-036d-4cba-9591-1086775af6aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:28.017953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8717d1-036d-4cba-9591-1086775af6aa service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:28.031875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:28.033113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:28.033820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:28.034192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] PATH_INFO: `/v3/projects/b229606bdad24e64a656174d1900c90c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:28.037298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b229606bdad24e64a656174d1900c90c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:28.039401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:28.127728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b229606bdad24e64a656174d1900c90c', 'request_id': 'req-64132e4c-9717-4f99-8341-65fc14b16379'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.137492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b229606bdad24e64a656174d1900c90c', 'request_id': 'req-64132e4c-9717-4f99-8341-65fc14b16379'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.146402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b229606bdad24e64a656174d1900c90c', 'request_id': 'req-64132e4c-9717-4f99-8341-65fc14b16379'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.167016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] The token cache is being invalidate because project b229606bdad24e64a656174d1900c90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:28.167511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.168326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.170287 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3999/8041] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:27 2022] DELETE /identity/v3/projects/b229606bdad24e64a656174d1900c90c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:28.174278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459387-8c42-4280-965c-02315028b1fd service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:28.186295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459387-8c42-4280-965c-02315028b1fd service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:28.281980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:28.282693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:28.283101 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:28.283381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] PATH_INFO: `/v3/users/21819bacc5fb4ce580c0c93aa59f1c57` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:28.284648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21819bacc5fb4ce580c0c93aa59f1c57)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:28.286626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:28.313255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:28.316679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:28.333518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64132e4c-9717-4f99-8341-65fc14b16379 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:28.342505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:28.348730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:28.348730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:28.348730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] PATH_INFO: `/v3/projects/194b80e864e84bd49f540b6032d65b20` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:28.353879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] RBAC: Authorizing `identity:delete_project(project_id=194b80e864e84bd49f540b6032d65b20)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:28.357178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:28.374806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21819bacc5fb4ce580c0c93aa59f1c57'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.403846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21819bacc5fb4ce580c0c93aa59f1c57'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.404673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21819bacc5fb4ce580c0c93aa59f1c57'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.414669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21819bacc5fb4ce580c0c93aa59f1c57'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.415565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21819bacc5fb4ce580c0c93aa59f1c57'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.423940 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:28.437294 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4043/8042] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:28 2022] DELETE /identity/v3/users/21819bacc5fb4ce580c0c93aa59f1c57 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:28.443798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194b80e864e84bd49f540b6032d65b20', 'request_id': 'req-49353cd3-e5d5-4b2e-bc42-325fdff402da'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.465563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194b80e864e84bd49f540b6032d65b20', 'request_id': 'req-49353cd3-e5d5-4b2e-bc42-325fdff402da'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.473382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194b80e864e84bd49f540b6032d65b20', 'request_id': 'req-49353cd3-e5d5-4b2e-bc42-325fdff402da'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.493824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] The token cache is being invalidate because project 194b80e864e84bd49f540b6032d65b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:28.494165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.495024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.500188 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4000/8043] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:28 2022] DELETE /identity/v3/projects/194b80e864e84bd49f540b6032d65b20 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:28.504261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:28.505715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:28.602763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46a73d-f782-4791-a3e9-f78eae08ffd6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:28.609687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2e3be-8e11-4c2e-953e-a6a0bbb990e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:28.611058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e3be-8e11-4c2e-953e-a6a0bbb990e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:28.611212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e3be-8e11-4c2e-953e-a6a0bbb990e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:28.611479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e3be-8e11-4c2e-953e-a6a0bbb990e8 admin admin] PATH_INFO: `/v3/users/0d3fd09f06874622b33c4d5318e64df9` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:28.612990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2e3be-8e11-4c2e-953e-a6a0bbb990e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3fd09f06874622b33c4d5318e64df9)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:28.616523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2e3be-8e11-4c2e-953e-a6a0bbb990e8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:28.838557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:28.840645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:28.870042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-55c2e3be-8e11-4c2e-953e-a6a0bbb990e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3fd09f06874622b33c4d5318e64df9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.897480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-55c2e3be-8e11-4c2e-953e-a6a0bbb990e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3fd09f06874622b33c4d5318e64df9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.899547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-55c2e3be-8e11-4c2e-953e-a6a0bbb990e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3fd09f06874622b33c4d5318e64df9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.917782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-55c2e3be-8e11-4c2e-953e-a6a0bbb990e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3fd09f06874622b33c4d5318e64df9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.918487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-55c2e3be-8e11-4c2e-953e-a6a0bbb990e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3fd09f06874622b33c4d5318e64df9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:28.946615 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4044/8044] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:28 2022] DELETE /identity/v3/users/0d3fd09f06874622b33c4d5318e64df9 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:28.973239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49353cd3-e5d5-4b2e-bc42-325fdff402da admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:28.975043 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:29.061191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:29.061851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.062136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.062411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] PATH_INFO: `/v3/projects/9f4a398cbe81464987fef795efafbd0c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.063602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4a398cbe81464987fef795efafbd0c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:29.065960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:29.136856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4a398cbe81464987fef795efafbd0c', 'request_id': 'req-a8fbb408-0544-4a74-bdde-70153f647185'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:29.147178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4a398cbe81464987fef795efafbd0c', 'request_id': 'req-a8fbb408-0544-4a74-bdde-70153f647185'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:29.162620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4a398cbe81464987fef795efafbd0c', 'request_id': 'req-a8fbb408-0544-4a74-bdde-70153f647185'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:29.190513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] The token cache is being invalidate because project 9f4a398cbe81464987fef795efafbd0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:29.191181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:29.192003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:29.197687 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4001/8045] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:28 2022] DELETE /identity/v3/projects/9f4a398cbe81464987fef795efafbd0c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:29.200700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa3156-7974-41be-afcc-25b64658cfbb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.201198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa3156-7974-41be-afcc-25b64658cfbb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.201398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa3156-7974-41be-afcc-25b64658cfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.227440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e3aa3156-7974-41be-afcc-25b64658cfbb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:29.230636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e3aa3156-7974-41be-afcc-25b64658cfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:29.326583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:29.328959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:29.379349 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4045/8046] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:29.390699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c189-5d72-49da-bf7a-69896b635991 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.391459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c189-5d72-49da-bf7a-69896b635991 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.391810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c189-5d72-49da-bf7a-69896b635991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.429820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6ce4c189-5d72-49da-bf7a-69896b635991 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:29.431074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6ce4c189-5d72-49da-bf7a-69896b635991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:29.442926 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4046/8047] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:29.447316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4c189-5d72-49da-bf7a-69896b635991 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:29.460668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4c189-5d72-49da-bf7a-69896b635991 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:29.466636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e080f-139f-4b63-a4b5-aa986e272f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:29.467401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e080f-139f-4b63-a4b5-aa986e272f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.467793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e080f-139f-4b63-a4b5-aa986e272f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.468166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e080f-139f-4b63-a4b5-aa986e272f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.469384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e080f-139f-4b63-a4b5-aa986e272f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:29.469790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e080f-139f-4b63-a4b5-aa986e272f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:29.472292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e080f-139f-4b63-a4b5-aa986e272f5c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:29.477046 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:29.478415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbb408-0544-4a74-bdde-70153f647185 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:29.488698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:29.490291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.490580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.495639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] PATH_INFO: `/v3/projects/35d5eb48117d4659b82d6844f1b83842` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.495968 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4047/8048] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:37:29.496078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d5eb48117d4659b82d6844f1b83842)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:29.498506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:29.506390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e080f-139f-4b63-a4b5-aa986e272f5c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:29.530075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e080f-139f-4b63-a4b5-aa986e272f5c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:29.545826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbfd24-05dc-4f29-a62f-1a0f190d918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:29.547107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbfd24-05dc-4f29-a62f-1a0f190d918a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.547443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbfd24-05dc-4f29-a62f-1a0f190d918a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.547735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbfd24-05dc-4f29-a62f-1a0f190d918a admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.548499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbfd24-05dc-4f29-a62f-1a0f190d918a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:29.552332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbfd24-05dc-4f29-a62f-1a0f190d918a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:29.564566 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:29.587129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d5eb48117d4659b82d6844f1b83842', 'request_id': 'req-9b3c381d-4107-4f72-a1de-0d8014964f93'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:29.593355 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4048/8049] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:29 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:29.594088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbfd24-05dc-4f29-a62f-1a0f190d918a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:29.601888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d5eb48117d4659b82d6844f1b83842', 'request_id': 'req-9b3c381d-4107-4f72-a1de-0d8014964f93'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:29.612844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d5eb48117d4659b82d6844f1b83842', 'request_id': 'req-9b3c381d-4107-4f72-a1de-0d8014964f93'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:29.628714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] The token cache is being invalidate because project 35d5eb48117d4659b82d6844f1b83842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:29.629026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:29.629695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9b3c381d-4107-4f72-a1de-0d8014964f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:29.632400 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4002/8050] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:29 2022] DELETE /identity/v3/projects/35d5eb48117d4659b82d6844f1b83842 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:29.638443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8639-c151-43fb-a8e7-f36402148e4b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.638773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8639-c151-43fb-a8e7-f36402148e4b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.639040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8639-c151-43fb-a8e7-f36402148e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.662111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-61ff8639-c151-43fb-a8e7-f36402148e4b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:29.664519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-61ff8639-c151-43fb-a8e7-f36402148e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:29.705701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbfd24-05dc-4f29-a62f-1a0f190d918a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:29.711318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f13c5-9da1-47b7-9677-95f2b7a3d43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:29.711942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f13c5-9da1-47b7-9677-95f2b7a3d43f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.712229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f13c5-9da1-47b7-9677-95f2b7a3d43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.712506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f13c5-9da1-47b7-9677-95f2b7a3d43f admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.716635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f13c5-9da1-47b7-9677-95f2b7a3d43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:29.719371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f13c5-9da1-47b7-9677-95f2b7a3d43f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:29.747436 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4003/8051] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:29.755619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c161c-d016-4bd4-b644-a758c2eaeddc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.755904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c161c-d016-4bd4-b644-a758c2eaeddc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.756181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c161c-d016-4bd4-b644-a758c2eaeddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.761177 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4049/8052] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:29 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:29.762352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f13c5-9da1-47b7-9677-95f2b7a3d43f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:29.766583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bf3f13c5-9da1-47b7-9677-95f2b7a3d43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:29.779610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-820c161c-d016-4bd4-b644-a758c2eaeddc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:29.780814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-820c161c-d016-4bd4-b644-a758c2eaeddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:29.787502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f13c5-9da1-47b7-9677-95f2b7a3d43f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:29.789738 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4004/8053] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:29.794188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c161c-d016-4bd4-b644-a758c2eaeddc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:29.803204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e02d3c-16a2-459b-807a-64cc6c1749f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:29.803839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e02d3c-16a2-459b-807a-64cc6c1749f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.804124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e02d3c-16a2-459b-807a-64cc6c1749f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.804550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e02d3c-16a2-459b-807a-64cc6c1749f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.804855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c161c-d016-4bd4-b644-a758c2eaeddc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:29.805416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e02d3c-16a2-459b-807a-64cc6c1749f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:29.808193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e02d3c-16a2-459b-807a-64cc6c1749f6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:29.810635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f27c1e-8450-41e6-99ff-36363dab6948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:29.811543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f27c1e-8450-41e6-99ff-36363dab6948 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.811898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f27c1e-8450-41e6-99ff-36363dab6948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.812265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f27c1e-8450-41e6-99ff-36363dab6948 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.813116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f27c1e-8450-41e6-99ff-36363dab6948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:29.813486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f27c1e-8450-41e6-99ff-36363dab6948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:29.815205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f27c1e-8450-41e6-99ff-36363dab6948 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:29.822689 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4050/8054] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:29.825324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e02d3c-16a2-459b-807a-64cc6c1749f6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:29.829269 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4005/8055] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:37:29.833788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f27c1e-8450-41e6-99ff-36363dab6948 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:29.844233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e02d3c-16a2-459b-807a-64cc6c1749f6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:29.845773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f27c1e-8450-41e6-99ff-36363dab6948 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:29.851221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636994-a625-4677-8f08-e8a223260255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:29.851948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636994-a625-4677-8f08-e8a223260255 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.852999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636994-a625-4677-8f08-e8a223260255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.852999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636994-a625-4677-8f08-e8a223260255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.853732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636994-a625-4677-8f08-e8a223260255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:29.856725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636994-a625-4677-8f08-e8a223260255 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:29.861538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca289037-e0f3-4c25-b908-d902d0075f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:29.863322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca289037-e0f3-4c25-b908-d902d0075f9f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.863815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca289037-e0f3-4c25-b908-d902d0075f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.863815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca289037-e0f3-4c25-b908-d902d0075f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.866216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca289037-e0f3-4c25-b908-d902d0075f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:29.869492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca289037-e0f3-4c25-b908-d902d0075f9f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:29.888880 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4051/8056] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:37:29.890564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca289037-e0f3-4c25-b908-d902d0075f9f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:29.912871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca289037-e0f3-4c25-b908-d902d0075f9f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:29.915868 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4006/8057] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:29 2022] POST /identity/v3/projects => generated 399 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:29.919420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a60d2-0e6e-4d6b-8f5e-70980eadde91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:29.919822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636994-a625-4677-8f08-e8a223260255 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:29.920110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a60d2-0e6e-4d6b-8f5e-70980eadde91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.920389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a60d2-0e6e-4d6b-8f5e-70980eadde91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.920670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a60d2-0e6e-4d6b-8f5e-70980eadde91 admin admin] PATH_INFO: `/v3/projects/8d97558a194b42daa9750cb197f1feaa/users/756cfafe3aca4839a8c7e23f87c569b6/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:29.957509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a60d2-0e6e-4d6b-8f5e-70980eadde91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d97558a194b42daa9750cb197f1feaa, user_id=756cfafe3aca4839a8c7e23f87c569b6, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:29.960553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a60d2-0e6e-4d6b-8f5e-70980eadde91 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:29.989981 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4052/8058] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:29 2022] PUT /identity/v3/projects/8d97558a194b42daa9750cb197f1feaa/users/756cfafe3aca4839a8c7e23f87c569b6/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:29.997208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32a677-1e80-4682-a862-fcd352bf5ab0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:29.997532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32a677-1e80-4682-a862-fcd352bf5ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:29.997996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32a677-1e80-4682-a862-fcd352bf5ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:30.043976 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2a32a677-1e80-4682-a862-fcd352bf5ab0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:30.045391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2a32a677-1e80-4682-a862-fcd352bf5ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:30.068310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636994-a625-4677-8f08-e8a223260255 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:30.122832 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:30.162383 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4053/8059] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:37:30.174202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f730-c67e-4f09-92fc-d3be1dfc32ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:30.174873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f730-c67e-4f09-92fc-d3be1dfc32ac admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:30.175154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f730-c67e-4f09-92fc-d3be1dfc32ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:30.175421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f730-c67e-4f09-92fc-d3be1dfc32ac admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:30.176471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32a677-1e80-4682-a862-fcd352bf5ab0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:30.177235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5f730-c67e-4f09-92fc-d3be1dfc32ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:30.178306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2a32a677-1e80-4682-a862-fcd352bf5ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:30.180320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5f730-c67e-4f09-92fc-d3be1dfc32ac admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:30.208573 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:30.228131 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4007/8060] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:29 2022] POST /identity/v3/users => generated 300 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:30.229028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f730-c67e-4f09-92fc-d3be1dfc32ac admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:30.249596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f730-c67e-4f09-92fc-d3be1dfc32ac admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:30.255856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80c792-76f1-4e8a-bafc-6c5607f70da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:30.256545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80c792-76f1-4e8a-bafc-6c5607f70da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:30.256831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80c792-76f1-4e8a-bafc-6c5607f70da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:30.257104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80c792-76f1-4e8a-bafc-6c5607f70da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:30.257804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80c792-76f1-4e8a-bafc-6c5607f70da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:30.260601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80c792-76f1-4e8a-bafc-6c5607f70da9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:30.264033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32a677-1e80-4682-a862-fcd352bf5ab0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:30.269290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc03a10-6c65-41ea-9265-48d2f9518a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:30.270018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc03a10-6c65-41ea-9265-48d2f9518a8c service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:30.270377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc03a10-6c65-41ea-9265-48d2f9518a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:30.272552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc03a10-6c65-41ea-9265-48d2f9518a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:30.280125 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4008/8061] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:30.284267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80c792-76f1-4e8a-bafc-6c5607f70da9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:30.284831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc03a10-6c65-41ea-9265-48d2f9518a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:30.286297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc03a10-6c65-41ea-9265-48d2f9518a8c service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:30.301059 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4054/8062] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:30.308482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80c792-76f1-4e8a-bafc-6c5607f70da9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:30.314395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e8b00-6877-439c-8f8c-e55ae424c36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:30.315309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e8b00-6877-439c-8f8c-e55ae424c36b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:30.315947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e8b00-6877-439c-8f8c-e55ae424c36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:30.316501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e8b00-6877-439c-8f8c-e55ae424c36b admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:30.317649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e8b00-6877-439c-8f8c-e55ae424c36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:30.319765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e8b00-6877-439c-8f8c-e55ae424c36b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:30.333799 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4009/8063] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:30.338531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc03a10-6c65-41ea-9265-48d2f9518a8c service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:30.351803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc03a10-6c65-41ea-9265-48d2f9518a8c service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:30.362958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a379a-63d0-4a98-b94e-52a39c8a14cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:30.365960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a379a-63d0-4a98-b94e-52a39c8a14cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:30.366254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a379a-63d0-4a98-b94e-52a39c8a14cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:30.367412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a379a-63d0-4a98-b94e-52a39c8a14cb admin admin] PATH_INFO: `/v3/projects/8af9b6aea7404f7a9cf17100301e422b/users/ad2d65d9eaa241d18aa38988563fd296/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:30.395684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a379a-63d0-4a98-b94e-52a39c8a14cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af9b6aea7404f7a9cf17100301e422b, user_id=ad2d65d9eaa241d18aa38988563fd296, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:30.398868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a379a-63d0-4a98-b94e-52a39c8a14cb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:30.422644 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4055/8064] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:30 2022] PUT /identity/v3/projects/8af9b6aea7404f7a9cf17100301e422b/users/ad2d65d9eaa241d18aa38988563fd296/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:30.433487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7df8a-fdbc-47a4-ba83-149856462d2c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:30.433979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7df8a-fdbc-47a4-ba83-149856462d2c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:30.435014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7df8a-fdbc-47a4-ba83-149856462d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:30.478481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d3b7df8a-fdbc-47a4-ba83-149856462d2c None None] MFA Rules not processed for user `ad2d65d9eaa241d18aa38988563fd296`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:30.480693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d3b7df8a-fdbc-47a4-ba83-149856462d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:30.581434 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4010/8065] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:30.585679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a379a-63d0-4a98-b94e-52a39c8a14cb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:30.739050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a379a-63d0-4a98-b94e-52a39c8a14cb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:30.749392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d2b67-eed0-48bb-a5ba-2ac1f4760275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:30.750062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d2b67-eed0-48bb-a5ba-2ac1f4760275 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:30.750339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d2b67-eed0-48bb-a5ba-2ac1f4760275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:30.750675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d2b67-eed0-48bb-a5ba-2ac1f4760275 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:30.751359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d2b67-eed0-48bb-a5ba-2ac1f4760275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:30.753378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d2b67-eed0-48bb-a5ba-2ac1f4760275 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:30.814523 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4056/8066] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:30 2022] POST /identity/v3/projects => generated 401 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:30.816699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7df8a-fdbc-47a4-ba83-149856462d2c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:30.834058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7df8a-fdbc-47a4-ba83-149856462d2c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:30.928747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d52c4-118a-4371-97ad-f84044715ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:30.929293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d52c4-118a-4371-97ad-f84044715ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:30.929583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d52c4-118a-4371-97ad-f84044715ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:30.929866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d52c4-118a-4371-97ad-f84044715ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:30.931212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d52c4-118a-4371-97ad-f84044715ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:30.935146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d52c4-118a-4371-97ad-f84044715ad2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:30.972879 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4011/8067] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:30 2022] POST /identity/v3/users => generated 307 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:30.974480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d2b67-eed0-48bb-a5ba-2ac1f4760275 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:30.988714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d2b67-eed0-48bb-a5ba-2ac1f4760275 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:30.997815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae53176-cc73-4f62-b469-100be8668481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:30.998707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae53176-cc73-4f62-b469-100be8668481 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:30.999058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae53176-cc73-4f62-b469-100be8668481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:30.999734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae53176-cc73-4f62-b469-100be8668481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:31.000511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae53176-cc73-4f62-b469-100be8668481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:31.003342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae53176-cc73-4f62-b469-100be8668481 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:31.023288 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4057/8068] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:31.024926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d52c4-118a-4371-97ad-f84044715ad2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:31.038166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d52c4-118a-4371-97ad-f84044715ad2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:31.045070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6766f2-6ed5-442d-992e-a9ce36f1554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:31.046195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6766f2-6ed5-442d-992e-a9ce36f1554c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:31.046315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6766f2-6ed5-442d-992e-a9ce36f1554c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:31.046514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6766f2-6ed5-442d-992e-a9ce36f1554c admin admin] PATH_INFO: `/v3/projects/8619ba24c8194205b32c9ecf08dabcd4/users/40f45ffe955848b9b3917565de3a69e2/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:31.070892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6766f2-6ed5-442d-992e-a9ce36f1554c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8619ba24c8194205b32c9ecf08dabcd4, user_id=40f45ffe955848b9b3917565de3a69e2, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:31.077157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6766f2-6ed5-442d-992e-a9ce36f1554c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:31.080204 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:31.106057 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4012/8069] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:31 2022] PUT /identity/v3/projects/8619ba24c8194205b32c9ecf08dabcd4/users/40f45ffe955848b9b3917565de3a69e2/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:31.109328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae53176-cc73-4f62-b469-100be8668481 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:31.129119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae53176-cc73-4f62-b469-100be8668481 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:31.259780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07631d43-9860-4241-b5fe-c8b968886ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:31.260421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07631d43-9860-4241-b5fe-c8b968886ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:31.260805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07631d43-9860-4241-b5fe-c8b968886ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:31.262666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07631d43-9860-4241-b5fe-c8b968886ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:31.263336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07631d43-9860-4241-b5fe-c8b968886ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:31.266841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07631d43-9860-4241-b5fe-c8b968886ff7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:31.288996 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4058/8070] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:31.292945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6766f2-6ed5-442d-992e-a9ce36f1554c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:31.307411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6766f2-6ed5-442d-992e-a9ce36f1554c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:31.316070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe74d14-22f7-44fd-940e-105ce7541f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:31.316753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74d14-22f7-44fd-940e-105ce7541f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:31.317038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74d14-22f7-44fd-940e-105ce7541f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:31.317319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74d14-22f7-44fd-940e-105ce7541f73 admin admin] PATH_INFO: `/v3/projects/8619ba24c8194205b32c9ecf08dabcd4/users/40f45ffe955848b9b3917565de3a69e2/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:31.326333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe74d14-22f7-44fd-940e-105ce7541f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8619ba24c8194205b32c9ecf08dabcd4, user_id=40f45ffe955848b9b3917565de3a69e2, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:31.330732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe74d14-22f7-44fd-940e-105ce7541f73 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:31.357652 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4013/8071] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:31 2022] PUT /identity/v3/projects/8619ba24c8194205b32c9ecf08dabcd4/users/40f45ffe955848b9b3917565de3a69e2/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:31.369538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40892aeb-98da-4bf7-84c3-7a69c14328e0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:31.370563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40892aeb-98da-4bf7-84c3-7a69c14328e0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:31.370845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40892aeb-98da-4bf7-84c3-7a69c14328e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:31.391235 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:31.417653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-40892aeb-98da-4bf7-84c3-7a69c14328e0 None None] MFA Rules not processed for user `40f45ffe955848b9b3917565de3a69e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:31.420157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-40892aeb-98da-4bf7-84c3-7a69c14328e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:31.572710 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4059/8072] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:31 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:31.600257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe74d14-22f7-44fd-940e-105ce7541f73 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:31.601780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bbe74d14-22f7-44fd-940e-105ce7541f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:31.648974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f01cd8-7d9f-4eb3-9f31-54f6b69c9adc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:31.649467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f01cd8-7d9f-4eb3-9f31-54f6b69c9adc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:31.649931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f01cd8-7d9f-4eb3-9f31-54f6b69c9adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:31.702361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a6f01cd8-7d9f-4eb3-9f31-54f6b69c9adc None None] MFA Rules not processed for user `756cfafe3aca4839a8c7e23f87c569b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:31.703510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a6f01cd8-7d9f-4eb3-9f31-54f6b69c9adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:31.710947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe74d14-22f7-44fd-940e-105ce7541f73 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:31.719471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4c455-51fa-4fe8-9045-2e652823e5f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:31.720102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4c455-51fa-4fe8-9045-2e652823e5f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:31.720382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4c455-51fa-4fe8-9045-2e652823e5f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:31.720656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4c455-51fa-4fe8-9045-2e652823e5f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:31.757441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4c455-51fa-4fe8-9045-2e652823e5f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:31.759868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4c455-51fa-4fe8-9045-2e652823e5f8 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:31.802894 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4014/8073] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:31 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:31.807001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4c455-51fa-4fe8-9045-2e652823e5f8 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:31.810174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3fe4c455-51fa-4fe8-9045-2e652823e5f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:31.914337 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4060/8074] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:31.921369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f01cd8-7d9f-4eb3-9f31-54f6b69c9adc None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:31.926296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4c455-51fa-4fe8-9045-2e652823e5f8 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:31.939792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:31.939792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:31.939792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:31.939792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] PATH_INFO: `/v3/users/388dc6a562eb49689346b0b0dd36c254` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:31.947334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f01cd8-7d9f-4eb3-9f31-54f6b69c9adc None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:31.951238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388dc6a562eb49689346b0b0dd36c254)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:31.953334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:31.959207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d5a1c-9070-4c8b-b692-dcdd796da315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:31.960463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d5a1c-9070-4c8b-b692-dcdd796da315 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:31.960747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d5a1c-9070-4c8b-b692-dcdd796da315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:31.961032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d5a1c-9070-4c8b-b692-dcdd796da315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:31.961697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d5a1c-9070-4c8b-b692-dcdd796da315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:31.963666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d5a1c-9070-4c8b-b692-dcdd796da315 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:32.000424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4061/8075] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:31 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:37:32.001510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d5a1c-9070-4c8b-b692-dcdd796da315 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:32.036097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388dc6a562eb49689346b0b0dd36c254'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:32.053107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388dc6a562eb49689346b0b0dd36c254'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:32.053882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388dc6a562eb49689346b0b0dd36c254'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:32.065856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388dc6a562eb49689346b0b0dd36c254'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:32.076351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388dc6a562eb49689346b0b0dd36c254'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:32.084816 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4015/8076] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:31 2022] DELETE /identity/v3/users/388dc6a562eb49689346b0b0dd36c254 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:32.085865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:32.087465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:32.094159 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:32.100460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d5a1c-9070-4c8b-b692-dcdd796da315 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:32.118233 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:32.194575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fab76-cf1b-45c7-80b9-4167ea05fe61 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:32.203537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3fcb1-e4b8-4c60-a92b-274b5425df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:32.204271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3fcb1-e4b8-4c60-a92b-274b5425df86 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:32.204776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3fcb1-e4b8-4c60-a92b-274b5425df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:32.205103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3fcb1-e4b8-4c60-a92b-274b5425df86 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:32.205721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3fcb1-e4b8-4c60-a92b-274b5425df86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:32.207817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3fcb1-e4b8-4c60-a92b-274b5425df86 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:32.214433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c696f-9653-44af-ae09-14cd993c9a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:32.215586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c696f-9653-44af-ae09-14cd993c9a05 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:32.216080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c696f-9653-44af-ae09-14cd993c9a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:32.216729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c696f-9653-44af-ae09-14cd993c9a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:32.218963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4e3c696f-9653-44af-ae09-14cd993c9a05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:32.243524 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4016/8077] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:32 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:32.245950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b550026-61cc-4efd-8d4b-edab066086f6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:32.246420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b550026-61cc-4efd-8d4b-edab066086f6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:32.247040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b550026-61cc-4efd-8d4b-edab066086f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:32.268963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9b550026-61cc-4efd-8d4b-edab066086f6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:32.270189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b550026-61cc-4efd-8d4b-edab066086f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:32.279428 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4017/8078] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:32.280380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b550026-61cc-4efd-8d4b-edab066086f6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:32.291455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b550026-61cc-4efd-8d4b-edab066086f6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:32.295599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c696f-9653-44af-ae09-14cd993c9a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:32.297730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf37770-1dcc-4585-8176-47b46edeb0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:32.298311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c696f-9653-44af-ae09-14cd993c9a05 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:32.298511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf37770-1dcc-4585-8176-47b46edeb0ea admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:32.298910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf37770-1dcc-4585-8176-47b46edeb0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:32.299254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf37770-1dcc-4585-8176-47b46edeb0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:32.299989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf37770-1dcc-4585-8176-47b46edeb0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:32.301733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf37770-1dcc-4585-8176-47b46edeb0ea admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:32.312958 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4062/8079] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:32.314351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c696f-9653-44af-ae09-14cd993c9a05 service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:32.316090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4e3c696f-9653-44af-ae09-14cd993c9a05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:32.331084 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4018/8080] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:32.336693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf37770-1dcc-4585-8176-47b46edeb0ea admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:32.361963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf37770-1dcc-4585-8176-47b46edeb0ea admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:32.377471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6eff7-51e9-494c-9d0a-4181d9ee3400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:32.378450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6eff7-51e9-494c-9d0a-4181d9ee3400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:32.378842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6eff7-51e9-494c-9d0a-4181d9ee3400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:32.379186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6eff7-51e9-494c-9d0a-4181d9ee3400 admin admin] PATH_INFO: `/v3/projects/756f303799d14105ae15dedfe3cb8691/users/adb2af7c33344ebba5dc3e8400d4c90c/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:32.403249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6eff7-51e9-494c-9d0a-4181d9ee3400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756f303799d14105ae15dedfe3cb8691, user_id=adb2af7c33344ebba5dc3e8400d4c90c, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:32.409124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6eff7-51e9-494c-9d0a-4181d9ee3400 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:32.427969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c696f-9653-44af-ae09-14cd993c9a05 service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:32.434294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdfd91-fa6e-469c-a653-210274302017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:32.435738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdfd91-fa6e-469c-a653-210274302017 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:32.436326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdfd91-fa6e-469c-a653-210274302017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:32.436676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdfd91-fa6e-469c-a653-210274302017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:32.443094 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4019/8081] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:32 2022] PUT /identity/v3/projects/756f303799d14105ae15dedfe3cb8691/users/adb2af7c33344ebba5dc3e8400d4c90c/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:32.447536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6eff7-51e9-494c-9d0a-4181d9ee3400 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:32.450082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdfd91-fa6e-469c-a653-210274302017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:32.452192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdfd91-fa6e-469c-a653-210274302017 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:32.478291 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4063/8082] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:32.603671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6eff7-51e9-494c-9d0a-4181d9ee3400 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:32.612799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68ff3b-ed6b-4af0-b0d5-ca734d5d15d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:32.613534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68ff3b-ed6b-4af0-b0d5-ca734d5d15d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:32.613858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68ff3b-ed6b-4af0-b0d5-ca734d5d15d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:32.614228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68ff3b-ed6b-4af0-b0d5-ca734d5d15d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:32.615073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68ff3b-ed6b-4af0-b0d5-ca734d5d15d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:32.617430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68ff3b-ed6b-4af0-b0d5-ca734d5d15d7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:32.651635 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4020/8083] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:32.652681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdfd91-fa6e-469c-a653-210274302017 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:32.666152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdfd91-fa6e-469c-a653-210274302017 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:32.671868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d451c-c7eb-4619-85ba-782634efee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:32.672534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d451c-c7eb-4619-85ba-782634efee32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:32.672817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d451c-c7eb-4619-85ba-782634efee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:32.673096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d451c-c7eb-4619-85ba-782634efee32 admin admin] PATH_INFO: `/v3/projects/756f303799d14105ae15dedfe3cb8691/users/adb2af7c33344ebba5dc3e8400d4c90c/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:32.675259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d451c-c7eb-4619-85ba-782634efee32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756f303799d14105ae15dedfe3cb8691, user_id=adb2af7c33344ebba5dc3e8400d4c90c, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:32.678462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d451c-c7eb-4619-85ba-782634efee32 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:32.691852 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4064/8084] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:32 2022] PUT /identity/v3/projects/756f303799d14105ae15dedfe3cb8691/users/adb2af7c33344ebba5dc3e8400d4c90c/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:32.774637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68ff3b-ed6b-4af0-b0d5-ca734d5d15d7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:32.777082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a68ff3b-ed6b-4af0-b0d5-ca734d5d15d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:32.801395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68ff3b-ed6b-4af0-b0d5-ca734d5d15d7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:32.898544 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:32.921400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:32.922070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:32.922357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:32.922693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] PATH_INFO: `/v3/projects/ea2880c356f14799a174289633343efc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:32.930650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2880c356f14799a174289633343efc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:32.933221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:33.055261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2880c356f14799a174289633343efc', 'request_id': 'req-1cac04ef-22a1-4b8c-965c-33193c0d95a6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:33.070277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2880c356f14799a174289633343efc', 'request_id': 'req-1cac04ef-22a1-4b8c-965c-33193c0d95a6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:33.080553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2880c356f14799a174289633343efc', 'request_id': 'req-1cac04ef-22a1-4b8c-965c-33193c0d95a6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:33.102022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] The token cache is being invalidate because project ea2880c356f14799a174289633343efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:33.102264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:33.105914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1cac04ef-22a1-4b8c-965c-33193c0d95a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:33.112152 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4021/8085] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:32 2022] DELETE /identity/v3/projects/ea2880c356f14799a174289633343efc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:33.114918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33980cff-ff75-4a5e-a02b-29d2d2663ae6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:33.115216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33980cff-ff75-4a5e-a02b-29d2d2663ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:33.115495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33980cff-ff75-4a5e-a02b-29d2d2663ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:33.160102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-33980cff-ff75-4a5e-a02b-29d2d2663ae6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:33.161679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-33980cff-ff75-4a5e-a02b-29d2d2663ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:33.277461 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:33.298728 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4065/8086] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:33.304266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d740af8-9106-442a-a591-46af35d0ca4e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:33.304575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d740af8-9106-442a-a591-46af35d0ca4e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:33.304810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d740af8-9106-442a-a591-46af35d0ca4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:33.334858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0d740af8-9106-442a-a591-46af35d0ca4e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:33.336181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0d740af8-9106-442a-a591-46af35d0ca4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:33.355971 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4022/8087] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:33.361343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33980cff-ff75-4a5e-a02b-29d2d2663ae6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:33.393433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33980cff-ff75-4a5e-a02b-29d2d2663ae6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:33.405109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1b03c-5b73-4bb4-ae42-a15ce04a6420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:33.405911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b03c-5b73-4bb4-ae42-a15ce04a6420 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:33.407314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b03c-5b73-4bb4-ae42-a15ce04a6420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:33.407942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b03c-5b73-4bb4-ae42-a15ce04a6420 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:33.408948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1b03c-5b73-4bb4-ae42-a15ce04a6420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:33.409786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1b03c-5b73-4bb4-ae42-a15ce04a6420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:33.412089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1b03c-5b73-4bb4-ae42-a15ce04a6420 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:33.427313 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4066/8088] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:37:33.434844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d740af8-9106-442a-a591-46af35d0ca4e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:33.446438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d740af8-9106-442a-a591-46af35d0ca4e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:33.454078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b37f4-8c7d-4577-b1ae-5fbb1ad51d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:33.454978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b37f4-8c7d-4577-b1ae-5fbb1ad51d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:33.455432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b37f4-8c7d-4577-b1ae-5fbb1ad51d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:33.455806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b37f4-8c7d-4577-b1ae-5fbb1ad51d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:33.456614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b37f4-8c7d-4577-b1ae-5fbb1ad51d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:33.458711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b37f4-8c7d-4577-b1ae-5fbb1ad51d5c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:33.530798 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4023/8089] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:33 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:33.531987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1b03c-5b73-4bb4-ae42-a15ce04a6420 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:33.544119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1b03c-5b73-4bb4-ae42-a15ce04a6420 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:33.671088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e724df0-2641-48bd-9a7f-168f2cfcf7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:33.671905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e724df0-2641-48bd-9a7f-168f2cfcf7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:33.672277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e724df0-2641-48bd-9a7f-168f2cfcf7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:33.672648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e724df0-2641-48bd-9a7f-168f2cfcf7f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:33.673408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e724df0-2641-48bd-9a7f-168f2cfcf7f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:33.675526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e724df0-2641-48bd-9a7f-168f2cfcf7f3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:33.701458 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4067/8090] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:33 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:33.705249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b37f4-8c7d-4577-b1ae-5fbb1ad51d5c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:33.717051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b37f4-8c7d-4577-b1ae-5fbb1ad51d5c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:33.727995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301c74-7635-4572-a619-402bac51bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:33.728726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301c74-7635-4572-a619-402bac51bf7d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:33.731539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301c74-7635-4572-a619-402bac51bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:33.732550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301c74-7635-4572-a619-402bac51bf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:33.733653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8301c74-7635-4572-a619-402bac51bf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:33.739245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8301c74-7635-4572-a619-402bac51bf7d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:33.758693 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4024/8091] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:33.760049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e724df0-2641-48bd-9a7f-168f2cfcf7f3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:33.773611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e724df0-2641-48bd-9a7f-168f2cfcf7f3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:33.781116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a16c1e-ba3b-41f9-a3d7-716a193c7ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:33.782067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a16c1e-ba3b-41f9-a3d7-716a193c7ddc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:33.782641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a16c1e-ba3b-41f9-a3d7-716a193c7ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:33.783088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a16c1e-ba3b-41f9-a3d7-716a193c7ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:33.784024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a16c1e-ba3b-41f9-a3d7-716a193c7ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:33.786467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a16c1e-ba3b-41f9-a3d7-716a193c7ddc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:33.803251 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4068/8092] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:33.806797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301c74-7635-4572-a619-402bac51bf7d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:33.820416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301c74-7635-4572-a619-402bac51bf7d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:33.827029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7efe2d-359e-4a8b-921a-20d027eb368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:33.827749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7efe2d-359e-4a8b-921a-20d027eb368a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:33.828181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7efe2d-359e-4a8b-921a-20d027eb368a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:33.828667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7efe2d-359e-4a8b-921a-20d027eb368a admin admin] PATH_INFO: `/v3/projects/1ed36c34d1534f13a23a514bfaad559d/users/40fb9275d22d4e5d9bce9f210069aac9/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:33.850753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7efe2d-359e-4a8b-921a-20d027eb368a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed36c34d1534f13a23a514bfaad559d, user_id=40fb9275d22d4e5d9bce9f210069aac9, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:33.855075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7efe2d-359e-4a8b-921a-20d027eb368a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:33.891491 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4025/8093] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:33 2022] PUT /identity/v3/projects/1ed36c34d1534f13a23a514bfaad559d/users/40fb9275d22d4e5d9bce9f210069aac9/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:34.006873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0d80-0061-4b1c-b783-da06af909027 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:34.007393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0d80-0061-4b1c-b783-da06af909027 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:34.007866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0d80-0061-4b1c-b783-da06af909027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:34.025146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23996014-4e85-400b-be5d-009ddd4ed8dc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:34.025678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23996014-4e85-400b-be5d-009ddd4ed8dc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:34.026700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23996014-4e85-400b-be5d-009ddd4ed8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:34.085904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9ded0d80-0061-4b1c-b783-da06af909027 None None] MFA Rules not processed for user `40fb9275d22d4e5d9bce9f210069aac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:34.087113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9ded0d80-0061-4b1c-b783-da06af909027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:34.092396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-23996014-4e85-400b-be5d-009ddd4ed8dc None None] MFA Rules not processed for user `adb2af7c33344ebba5dc3e8400d4c90c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:34.093873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-23996014-4e85-400b-be5d-009ddd4ed8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:34.258930 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:34.266190 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4069/8094] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:34.274755 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4026/8095] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:34.287067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded0d80-0061-4b1c-b783-da06af909027 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:34.288501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda467b-147d-4d24-91d2-0de67e78f52c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:34.288627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9ded0d80-0061-4b1c-b783-da06af909027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:34.288878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda467b-147d-4d24-91d2-0de67e78f52c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:34.289231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda467b-147d-4d24-91d2-0de67e78f52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:34.328036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bbda467b-147d-4d24-91d2-0de67e78f52c None None] MFA Rules not processed for user `756cfafe3aca4839a8c7e23f87c569b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:34.329253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bbda467b-147d-4d24-91d2-0de67e78f52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:34.395792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded0d80-0061-4b1c-b783-da06af909027 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:34.399675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdc0f6-e5f9-4a75-a18b-4fbf00a58f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:34.400288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdc0f6-e5f9-4a75-a18b-4fbf00a58f97 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:34.400569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdc0f6-e5f9-4a75-a18b-4fbf00a58f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:34.400844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdc0f6-e5f9-4a75-a18b-4fbf00a58f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:34.412877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdc0f6-e5f9-4a75-a18b-4fbf00a58f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:34.416060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdc0f6-e5f9-4a75-a18b-4fbf00a58f97 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:34.420496 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:34.426720 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4027/8096] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:37:34.427505 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4070/8097] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:34.438539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda467b-147d-4d24-91d2-0de67e78f52c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:34.441675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bbda467b-147d-4d24-91d2-0de67e78f52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:34.540713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda467b-147d-4d24-91d2-0de67e78f52c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:34.557114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5df7f0-c719-4e2c-8be3-606b4b823854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:34.559403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5df7f0-c719-4e2c-8be3-606b4b823854 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:34.559644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5df7f0-c719-4e2c-8be3-606b4b823854 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:34.559924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5df7f0-c719-4e2c-8be3-606b4b823854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:34.562696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ce5df7f0-c719-4e2c-8be3-606b4b823854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:34.574878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5df7f0-c719-4e2c-8be3-606b4b823854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:34.576405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5df7f0-c719-4e2c-8be3-606b4b823854 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:34.587275 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4028/8098] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:34.951487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdc0f6-e5f9-4a75-a18b-4fbf00a58f97 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:34.952911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c5bdc0f6-e5f9-4a75-a18b-4fbf00a58f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:34.999910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdc0f6-e5f9-4a75-a18b-4fbf00a58f97 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:35.007646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1911a0-d53f-4c7d-a05f-958e00fbb5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:35.008274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1911a0-d53f-4c7d-a05f-958e00fbb5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:35.008615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1911a0-d53f-4c7d-a05f-958e00fbb5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:35.008973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1911a0-d53f-4c7d-a05f-958e00fbb5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:35.012146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-aa1911a0-d53f-4c7d-a05f-958e00fbb5b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:35.031881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1911a0-d53f-4c7d-a05f-958e00fbb5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:35.033340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1911a0-d53f-4c7d-a05f-958e00fbb5b3 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:35.056958 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4071/8099] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:35.176690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5df7f0-c719-4e2c-8be3-606b4b823854 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:35.260115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5df7f0-c719-4e2c-8be3-606b4b823854 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:35.265955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:35.266640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:35.267071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:35.267353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] PATH_INFO: `/v3/users/40fb9275d22d4e5d9bce9f210069aac9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:35.268731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=40fb9275d22d4e5d9bce9f210069aac9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:35.270774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:35.319524 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:35.346362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40fb9275d22d4e5d9bce9f210069aac9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:35.366907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40fb9275d22d4e5d9bce9f210069aac9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:35.368208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40fb9275d22d4e5d9bce9f210069aac9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:35.381089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40fb9275d22d4e5d9bce9f210069aac9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:35.395576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40fb9275d22d4e5d9bce9f210069aac9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:35.406439 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4029/8100] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:35 2022] DELETE /identity/v3/users/40fb9275d22d4e5d9bce9f210069aac9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:35.410877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd64d97-45e6-4fcf-bb2b-f494669a2789 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:35.411368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd64d97-45e6-4fcf-bb2b-f494669a2789 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:35.411495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd64d97-45e6-4fcf-bb2b-f494669a2789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:35.445894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-abd64d97-45e6-4fcf-bb2b-f494669a2789 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:35.447390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-abd64d97-45e6-4fcf-bb2b-f494669a2789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:35.509246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:35.510914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:35.607882 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4072/8101] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:35.617366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd64d97-45e6-4fcf-bb2b-f494669a2789 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:35.619060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-abd64d97-45e6-4fcf-bb2b-f494669a2789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:35.677589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800ce86-bdc3-4745-bf59-f680fb4fe45f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:35.685317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0491a22-3e42-4689-8b23-59486820656f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:35.686405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0491a22-3e42-4689-8b23-59486820656f service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:35.686538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0491a22-3e42-4689-8b23-59486820656f service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:35.686785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0491a22-3e42-4689-8b23-59486820656f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:35.688781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0491a22-3e42-4689-8b23-59486820656f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:35.706783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0491a22-3e42-4689-8b23-59486820656f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:35.708905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0491a22-3e42-4689-8b23-59486820656f service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:35.726926 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4030/8102] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:37:35.729957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd64d97-45e6-4fcf-bb2b-f494669a2789 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:35.733950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1af51-a7e5-4a7a-a222-a4d1bf0755e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:35.734565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1af51-a7e5-4a7a-a222-a4d1bf0755e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:35.734875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1af51-a7e5-4a7a-a222-a4d1bf0755e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:35.735153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1af51-a7e5-4a7a-a222-a4d1bf0755e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:35.746288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1af51-a7e5-4a7a-a222-a4d1bf0755e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:35.749390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1af51-a7e5-4a7a-a222-a4d1bf0755e8 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:35.786451 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4073/8103] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:37:36.225642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0491a22-3e42-4689-8b23-59486820656f service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:36.227932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0491a22-3e42-4689-8b23-59486820656f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:36.256939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0491a22-3e42-4689-8b23-59486820656f service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:36.268344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:36.269184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:36.271353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:36.272222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] PATH_INFO: `/v3/projects/1ed36c34d1534f13a23a514bfaad559d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:36.275104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed36c34d1534f13a23a514bfaad559d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:36.280557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:36.361981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed36c34d1534f13a23a514bfaad559d', 'request_id': 'req-9cd263b2-d41f-4fac-af27-6a5e271fe360'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:36.371132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed36c34d1534f13a23a514bfaad559d', 'request_id': 'req-9cd263b2-d41f-4fac-af27-6a5e271fe360'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:36.379408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed36c34d1534f13a23a514bfaad559d', 'request_id': 'req-9cd263b2-d41f-4fac-af27-6a5e271fe360'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:36.399815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] The token cache is being invalidate because project 1ed36c34d1534f13a23a514bfaad559d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:36.400603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:36.401702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9cd263b2-d41f-4fac-af27-6a5e271fe360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:36.403928 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4031/8104] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:36 2022] DELETE /identity/v3/projects/1ed36c34d1534f13a23a514bfaad559d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:36.411198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1669c1-b161-438a-80a9-59ee0b23030b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:36.412308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1669c1-b161-438a-80a9-59ee0b23030b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:36.412881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1669c1-b161-438a-80a9-59ee0b23030b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:36.437686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dd1669c1-b161-438a-80a9-59ee0b23030b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:36.439229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dd1669c1-b161-438a-80a9-59ee0b23030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:36.512856 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4074/8105] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:36.520202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152f1b8-d004-4e83-9436-c519732880f3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:36.520482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152f1b8-d004-4e83-9436-c519732880f3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:36.520761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152f1b8-d004-4e83-9436-c519732880f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:36.545223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8152f1b8-d004-4e83-9436-c519732880f3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:36.547151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8152f1b8-d004-4e83-9436-c519732880f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:36.564499 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4032/8106] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:36.568506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1669c1-b161-438a-80a9-59ee0b23030b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:36.580186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1669c1-b161-438a-80a9-59ee0b23030b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:36.590328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87efe-b752-4df4-8af5-9d928aaf350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:36.590990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87efe-b752-4df4-8af5-9d928aaf350d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:36.591345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87efe-b752-4df4-8af5-9d928aaf350d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:36.591625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87efe-b752-4df4-8af5-9d928aaf350d admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:36.592379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a87efe-b752-4df4-8af5-9d928aaf350d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:36.592724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a87efe-b752-4df4-8af5-9d928aaf350d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:36.594539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a87efe-b752-4df4-8af5-9d928aaf350d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:36.621738 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4075/8107] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:37:36.626089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152f1b8-d004-4e83-9436-c519732880f3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:36.639005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152f1b8-d004-4e83-9436-c519732880f3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:36.681096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3092cea-fd7a-47c7-9e11-0401eea6890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:36.682120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3092cea-fd7a-47c7-9e11-0401eea6890d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:36.682687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3092cea-fd7a-47c7-9e11-0401eea6890d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:36.683176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3092cea-fd7a-47c7-9e11-0401eea6890d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:36.684032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3092cea-fd7a-47c7-9e11-0401eea6890d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:36.686538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3092cea-fd7a-47c7-9e11-0401eea6890d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:36.714954 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:36.757054 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4033/8108] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:36 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:36.759560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87efe-b752-4df4-8af5-9d928aaf350d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:36.775604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87efe-b752-4df4-8af5-9d928aaf350d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:36.808759 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:36.906836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b53a-f9cc-4ae2-bb8d-0b21f3d356df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:36.908120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b53a-f9cc-4ae2-bb8d-0b21f3d356df admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:36.908826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b53a-f9cc-4ae2-bb8d-0b21f3d356df admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:36.909270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b53a-f9cc-4ae2-bb8d-0b21f3d356df admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:36.910062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b53a-f9cc-4ae2-bb8d-0b21f3d356df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:36.912590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b53a-f9cc-4ae2-bb8d-0b21f3d356df admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:37.019826 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4076/8109] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:36 2022] POST /identity/v3/users => generated 286 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:37.023850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3092cea-fd7a-47c7-9e11-0401eea6890d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:37.042519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3092cea-fd7a-47c7-9e11-0401eea6890d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:37.067465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfba53-a17b-49bc-80f5-c09b96401bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:37.068096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfba53-a17b-49bc-80f5-c09b96401bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:37.068373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfba53-a17b-49bc-80f5-c09b96401bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:37.068938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfba53-a17b-49bc-80f5-c09b96401bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:37.069597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfba53-a17b-49bc-80f5-c09b96401bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:37.071318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfba53-a17b-49bc-80f5-c09b96401bd9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:37.086927 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4034/8110] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:37.089261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b53a-f9cc-4ae2-bb8d-0b21f3d356df admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:37.106335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b53a-f9cc-4ae2-bb8d-0b21f3d356df admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:37.125348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780800f3-ab8e-4229-b1cd-a88639fbc6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:37.126420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780800f3-ab8e-4229-b1cd-a88639fbc6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:37.126796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780800f3-ab8e-4229-b1cd-a88639fbc6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:37.127200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780800f3-ab8e-4229-b1cd-a88639fbc6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:37.128038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780800f3-ab8e-4229-b1cd-a88639fbc6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:37.129857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780800f3-ab8e-4229-b1cd-a88639fbc6c7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:37.171695 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4077/8111] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:37.175866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfba53-a17b-49bc-80f5-c09b96401bd9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:37.189097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfba53-a17b-49bc-80f5-c09b96401bd9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:37.195365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e33fe-6bdc-457e-8825-325f1857887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:37.196244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e33fe-6bdc-457e-8825-325f1857887d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:37.196634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e33fe-6bdc-457e-8825-325f1857887d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:37.197089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e33fe-6bdc-457e-8825-325f1857887d admin admin] PATH_INFO: `/v3/projects/7a3f03ab7dc04a60a3d4e3d44f0f5b30/users/76da78efce134f31a15cb80e68dfa435/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:37.246989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e33fe-6bdc-457e-8825-325f1857887d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3f03ab7dc04a60a3d4e3d44f0f5b30, user_id=76da78efce134f31a15cb80e68dfa435, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:37.246989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e33fe-6bdc-457e-8825-325f1857887d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:37.280631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e33ac2-bdf4-4e85-a67e-d443a59ee494 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:37.280948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e33ac2-bdf4-4e85-a67e-d443a59ee494 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:37.281557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e33ac2-bdf4-4e85-a67e-d443a59ee494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:37.284627 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4035/8112] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:37 2022] PUT /identity/v3/projects/7a3f03ab7dc04a60a3d4e3d44f0f5b30/users/76da78efce134f31a15cb80e68dfa435/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:37.314473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-33e33ac2-bdf4-4e85-a67e-d443a59ee494 None None] MFA Rules not processed for user `76da78efce134f31a15cb80e68dfa435`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:37.315828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-33e33ac2-bdf4-4e85-a67e-d443a59ee494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:37.449583 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4078/8113] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:37.452148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e33fe-6bdc-457e-8825-325f1857887d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:37.549416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e33fe-6bdc-457e-8825-325f1857887d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:37.555308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f92c8-7205-46fe-b12c-085fd768edd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:37.555973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f92c8-7205-46fe-b12c-085fd768edd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:37.556502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f92c8-7205-46fe-b12c-085fd768edd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:37.556787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f92c8-7205-46fe-b12c-085fd768edd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:37.558155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f92c8-7205-46fe-b12c-085fd768edd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:37.560484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f92c8-7205-46fe-b12c-085fd768edd8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:37.616526 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4036/8114] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:37 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:37.621036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e33ac2-bdf4-4e85-a67e-d443a59ee494 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:37.634544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e33ac2-bdf4-4e85-a67e-d443a59ee494 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:37.702393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee19fc0-dd4d-417d-8ebd-72dc1d7feabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:37.703294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee19fc0-dd4d-417d-8ebd-72dc1d7feabf admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:37.703748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee19fc0-dd4d-417d-8ebd-72dc1d7feabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:37.704208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee19fc0-dd4d-417d-8ebd-72dc1d7feabf admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:37.705191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee19fc0-dd4d-417d-8ebd-72dc1d7feabf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:37.707639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee19fc0-dd4d-417d-8ebd-72dc1d7feabf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:37.749505 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4079/8115] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:37 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:37.754767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f92c8-7205-46fe-b12c-085fd768edd8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:37.772068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f92c8-7205-46fe-b12c-085fd768edd8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:37.785400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df481033-839c-4a58-aee0-73c0d25d5584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:37.786130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df481033-839c-4a58-aee0-73c0d25d5584 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:37.786442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df481033-839c-4a58-aee0-73c0d25d5584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:37.787128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df481033-839c-4a58-aee0-73c0d25d5584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:37.787846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df481033-839c-4a58-aee0-73c0d25d5584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:37.790703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df481033-839c-4a58-aee0-73c0d25d5584 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:37.820014 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4037/8116] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:37.821146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee19fc0-dd4d-417d-8ebd-72dc1d7feabf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:37.837801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee19fc0-dd4d-417d-8ebd-72dc1d7feabf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:37.844953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45583db3-41eb-44ec-9693-2c9e0d82de6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:37.845979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583db3-41eb-44ec-9693-2c9e0d82de6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:37.854145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583db3-41eb-44ec-9693-2c9e0d82de6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:37.854777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583db3-41eb-44ec-9693-2c9e0d82de6b admin admin] PATH_INFO: `/v3/projects/758ba680056841c3bec98eb8a6803c15/users/d0ae820cd46042ac9baa1a5198cb5bdb/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:37.870319 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:37.879284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45583db3-41eb-44ec-9693-2c9e0d82de6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=758ba680056841c3bec98eb8a6803c15, user_id=d0ae820cd46042ac9baa1a5198cb5bdb, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:37.883030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45583db3-41eb-44ec-9693-2c9e0d82de6b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:37.917382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df481033-839c-4a58-aee0-73c0d25d5584 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:37.923782 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4080/8117] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:37 2022] PUT /identity/v3/projects/758ba680056841c3bec98eb8a6803c15/users/d0ae820cd46042ac9baa1a5198cb5bdb/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:37.937868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df481033-839c-4a58-aee0-73c0d25d5584 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:38.028085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3743-411f-4a62-a7de-c75e107cedf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:38.028706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3743-411f-4a62-a7de-c75e107cedf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:38.028989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3743-411f-4a62-a7de-c75e107cedf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:38.029282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3743-411f-4a62-a7de-c75e107cedf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:38.029906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f3743-411f-4a62-a7de-c75e107cedf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:38.031683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f3743-411f-4a62-a7de-c75e107cedf6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:38.043161 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4038/8118] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:38.047357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45583db3-41eb-44ec-9693-2c9e0d82de6b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:38.058859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45583db3-41eb-44ec-9693-2c9e0d82de6b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:38.063383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae5ca-7cc4-4281-ae31-3afd67450c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:38.064043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae5ca-7cc4-4281-ae31-3afd67450c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:38.064322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae5ca-7cc4-4281-ae31-3afd67450c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:38.064588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae5ca-7cc4-4281-ae31-3afd67450c70 admin admin] PATH_INFO: `/v3/projects/758ba680056841c3bec98eb8a6803c15/users/d0ae820cd46042ac9baa1a5198cb5bdb/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:38.066466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae5ca-7cc4-4281-ae31-3afd67450c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758ba680056841c3bec98eb8a6803c15, user_id=d0ae820cd46042ac9baa1a5198cb5bdb, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:38.069159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae5ca-7cc4-4281-ae31-3afd67450c70 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:38.080350 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4081/8119] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:38 2022] PUT /identity/v3/projects/758ba680056841c3bec98eb8a6803c15/users/d0ae820cd46042ac9baa1a5198cb5bdb/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:38.091064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831944-d705-4109-a398-554496fbd46d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:38.091354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831944-d705-4109-a398-554496fbd46d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:38.091628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831944-d705-4109-a398-554496fbd46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:38.122445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-73831944-d705-4109-a398-554496fbd46d None None] MFA Rules not processed for user `d0ae820cd46042ac9baa1a5198cb5bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:38.123702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-73831944-d705-4109-a398-554496fbd46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:38.167398 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:38.263599 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4039/8120] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:38.265903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae5ca-7cc4-4281-ae31-3afd67450c70 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:38.268123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d2bae5ca-7cc4-4281-ae31-3afd67450c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:38.434450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae5ca-7cc4-4281-ae31-3afd67450c70 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:38.462391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b758ffd-4880-47e9-97d3-3d3885999d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:38.463102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758ffd-4880-47e9-97d3-3d3885999d8d service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:38.468899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758ffd-4880-47e9-97d3-3d3885999d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:38.474627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758ffd-4880-47e9-97d3-3d3885999d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:38.499626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b758ffd-4880-47e9-97d3-3d3885999d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:38.501545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b758ffd-4880-47e9-97d3-3d3885999d8d service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:38.533096 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4082/8121] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:39.380711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831944-d705-4109-a398-554496fbd46d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:39.515839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831944-d705-4109-a398-554496fbd46d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:39.520654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:39.521386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:39.521803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:39.522084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] PATH_INFO: `/v3/users/76da78efce134f31a15cb80e68dfa435` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:39.523372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76da78efce134f31a15cb80e68dfa435)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:39.525349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:39.629623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76da78efce134f31a15cb80e68dfa435'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:39.667311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76da78efce134f31a15cb80e68dfa435'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:39.669010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76da78efce134f31a15cb80e68dfa435'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:39.682951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76da78efce134f31a15cb80e68dfa435'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:39.705658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76da78efce134f31a15cb80e68dfa435'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:39.716763 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4040/8122] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:39 2022] DELETE /identity/v3/users/76da78efce134f31a15cb80e68dfa435 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:39.721402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0e3e-604f-4620-a333-c8ea4dcca69d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:39.721882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0e3e-604f-4620-a333-c8ea4dcca69d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:39.722008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0e3e-604f-4620-a333-c8ea4dcca69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:39.765076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b4fb0e3e-604f-4620-a333-c8ea4dcca69d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:39.766374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b4fb0e3e-604f-4620-a333-c8ea4dcca69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:39.869129 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4083/8123] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:39.878705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:39.881066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:39.945508 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:40.015836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c4af6-dd60-4af1-be38-6da701efba15 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:40.020472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05013b2-1edb-4724-8f90-f226b123bef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:40.021354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05013b2-1edb-4724-8f90-f226b123bef9 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:40.022378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05013b2-1edb-4724-8f90-f226b123bef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:40.022903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05013b2-1edb-4724-8f90-f226b123bef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:40.036517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05013b2-1edb-4724-8f90-f226b123bef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:40.038304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05013b2-1edb-4724-8f90-f226b123bef9 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:40.051342 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4041/8124] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:40.666068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb0e3e-604f-4620-a333-c8ea4dcca69d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:40.668695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b4fb0e3e-604f-4620-a333-c8ea4dcca69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:40.708404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb0e3e-604f-4620-a333-c8ea4dcca69d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:40.725123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72aeac4-1b93-48e4-a923-b29c0f451cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:40.729539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aeac4-1b93-48e4-a923-b29c0f451cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:40.730132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aeac4-1b93-48e4-a923-b29c0f451cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:40.730669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aeac4-1b93-48e4-a923-b29c0f451cfd admin admin] PATH_INFO: `/v3/users/ad2d65d9eaa241d18aa38988563fd296` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:40.750460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aeac4-1b93-48e4-a923-b29c0f451cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2d65d9eaa241d18aa38988563fd296)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:40.752800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aeac4-1b93-48e4-a923-b29c0f451cfd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:40.930552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d72aeac4-1b93-48e4-a923-b29c0f451cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2d65d9eaa241d18aa38988563fd296'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:40.948696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d72aeac4-1b93-48e4-a923-b29c0f451cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2d65d9eaa241d18aa38988563fd296'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:40.951768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d72aeac4-1b93-48e4-a923-b29c0f451cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2d65d9eaa241d18aa38988563fd296'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:40.980703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d72aeac4-1b93-48e4-a923-b29c0f451cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2d65d9eaa241d18aa38988563fd296'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:40.981723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d72aeac4-1b93-48e4-a923-b29c0f451cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2d65d9eaa241d18aa38988563fd296'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:40.984902 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:41.004322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05013b2-1edb-4724-8f90-f226b123bef9 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:41.005973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a05013b2-1edb-4724-8f90-f226b123bef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:41.006733 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4084/8125] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:40 2022] DELETE /identity/v3/users/ad2d65d9eaa241d18aa38988563fd296 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:41.011057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541e961-731d-477e-ab54-c3f6dc9bf454 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:41.011618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541e961-731d-477e-ab54-c3f6dc9bf454 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:41.012166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541e961-731d-477e-ab54-c3f6dc9bf454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:41.030361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05013b2-1edb-4724-8f90-f226b123bef9 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:41.071459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9541e961-731d-477e-ab54-c3f6dc9bf454 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:41.074277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9541e961-731d-477e-ab54-c3f6dc9bf454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:41.140609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:41.141576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:41.141973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:41.142318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] PATH_INFO: `/v3/projects/7a3f03ab7dc04a60a3d4e3d44f0f5b30` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:41.143806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3f03ab7dc04a60a3d4e3d44f0f5b30)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:41.146751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:41.214195 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4085/8126] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:41.241638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541e961-731d-477e-ab54-c3f6dc9bf454 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:41.247761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9541e961-731d-477e-ab54-c3f6dc9bf454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:41.264072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3f03ab7dc04a60a3d4e3d44f0f5b30', 'request_id': 'req-4768c098-8550-48d3-ac81-fde080e6afc4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:41.281116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3f03ab7dc04a60a3d4e3d44f0f5b30', 'request_id': 'req-4768c098-8550-48d3-ac81-fde080e6afc4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:41.289737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3f03ab7dc04a60a3d4e3d44f0f5b30', 'request_id': 'req-4768c098-8550-48d3-ac81-fde080e6afc4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:41.313849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] The token cache is being invalidate because project 7a3f03ab7dc04a60a3d4e3d44f0f5b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:41.314419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:41.315760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:41.323524 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4042/8127] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:41 2022] DELETE /identity/v3/projects/7a3f03ab7dc04a60a3d4e3d44f0f5b30 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:41.324907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:41.327400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:41.356965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541e961-731d-477e-ab54-c3f6dc9bf454 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:41.410852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768c098-8550-48d3-ac81-fde080e6afc4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:41.416867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:41.417677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:41.417965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:41.418236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] PATH_INFO: `/v3/users/d0ae820cd46042ac9baa1a5198cb5bdb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:41.419435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ae820cd46042ac9baa1a5198cb5bdb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:41.422449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:41.425792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152286-5591-4165-9d52-7461f12d71a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:41.426411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152286-5591-4165-9d52-7461f12d71a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:41.426729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152286-5591-4165-9d52-7461f12d71a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:41.427010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152286-5591-4165-9d52-7461f12d71a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:41.427751 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:41.430411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cb152286-5591-4165-9d52-7461f12d71a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:41.447085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152286-5591-4165-9d52-7461f12d71a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:41.450067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152286-5591-4165-9d52-7461f12d71a3 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:41.462012 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4086/8128] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:41.489667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ae820cd46042ac9baa1a5198cb5bdb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:41.505282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ae820cd46042ac9baa1a5198cb5bdb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:41.506426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ae820cd46042ac9baa1a5198cb5bdb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:41.517777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ae820cd46042ac9baa1a5198cb5bdb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:41.528845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ae820cd46042ac9baa1a5198cb5bdb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:41.540054 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4043/8129] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:41 2022] DELETE /identity/v3/users/d0ae820cd46042ac9baa1a5198cb5bdb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:42.040725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152286-5591-4165-9d52-7461f12d71a3 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:42.043357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cb152286-5591-4165-9d52-7461f12d71a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:42.065704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152286-5591-4165-9d52-7461f12d71a3 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:42.083932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:42.085621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:42.180648 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:42.196283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28d493-16d5-48c3-a0c0-a0f594f93be4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:42.202488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:42.203259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:42.203588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:42.203865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] PATH_INFO: `/v3/projects/758ba680056841c3bec98eb8a6803c15` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:42.205125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=758ba680056841c3bec98eb8a6803c15)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:42.205672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:42.206931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:42.207475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:42.208467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:42.208833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] PATH_INFO: `/v3/projects/8af9b6aea7404f7a9cf17100301e422b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:42.212157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af9b6aea7404f7a9cf17100301e422b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:42.214987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:42.270220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758ba680056841c3bec98eb8a6803c15', 'request_id': 'req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.277689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758ba680056841c3bec98eb8a6803c15', 'request_id': 'req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.285125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758ba680056841c3bec98eb8a6803c15', 'request_id': 'req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.296886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af9b6aea7404f7a9cf17100301e422b', 'request_id': 'req-540f2c40-24cb-4252-80b6-089835379ed2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.305170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] The token cache is being invalidate because project 758ba680056841c3bec98eb8a6803c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:42.305363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af9b6aea7404f7a9cf17100301e422b', 'request_id': 'req-540f2c40-24cb-4252-80b6-089835379ed2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.305895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.306889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2dd77920-b5a5-4bab-9a3e-b1187f2038dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.309489 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4044/8130] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:42 2022] DELETE /identity/v3/projects/758ba680056841c3bec98eb8a6803c15 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:42.315265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69086d71-7594-4151-ba40-39128b93d7aa None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:42.315748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69086d71-7594-4151-ba40-39128b93d7aa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:42.316023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69086d71-7594-4151-ba40-39128b93d7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:42.322620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af9b6aea7404f7a9cf17100301e422b', 'request_id': 'req-540f2c40-24cb-4252-80b6-089835379ed2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.340410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] The token cache is being invalidate because project 8af9b6aea7404f7a9cf17100301e422b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:42.341362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.341953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.346698 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4087/8131] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:42 2022] DELETE /identity/v3/projects/8af9b6aea7404f7a9cf17100301e422b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:42.347724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:42.347846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-69086d71-7594-4151-ba40-39128b93d7aa None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:42.348993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-69086d71-7594-4151-ba40-39128b93d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:42.349217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:42.377840 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:42.432786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2c40-24cb-4252-80b6-089835379ed2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:42.440593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:42.441761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:42.442063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:42.442277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] PATH_INFO: `/v3/users/40f45ffe955848b9b3917565de3a69e2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:42.444605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f45ffe955848b9b3917565de3a69e2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:42.446547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:42.459031 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4045/8132] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:42.481426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b3af-c93a-4a46-982f-0809725569f0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:42.481844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b3af-c93a-4a46-982f-0809725569f0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:42.482664 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b3af-c93a-4a46-982f-0809725569f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:42.533070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f45ffe955848b9b3917565de3a69e2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.533587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d126b3af-c93a-4a46-982f-0809725569f0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:42.538256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d126b3af-c93a-4a46-982f-0809725569f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:42.565820 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4046/8133] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:37:42.565820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126b3af-c93a-4a46-982f-0809725569f0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:42.565820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126b3af-c93a-4a46-982f-0809725569f0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:42.571082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f45ffe955848b9b3917565de3a69e2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.572004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f45ffe955848b9b3917565de3a69e2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.574898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4779ce-0a34-4c58-a63d-5e2ccb71da84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:42.575520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4779ce-0a34-4c58-a63d-5e2ccb71da84 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:42.575800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4779ce-0a34-4c58-a63d-5e2ccb71da84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:42.576866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4779ce-0a34-4c58-a63d-5e2ccb71da84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:42.576866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4779ce-0a34-4c58-a63d-5e2ccb71da84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:42.577149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4779ce-0a34-4c58-a63d-5e2ccb71da84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:42.578761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4779ce-0a34-4c58-a63d-5e2ccb71da84 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:42.584494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f45ffe955848b9b3917565de3a69e2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.585610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f45ffe955848b9b3917565de3a69e2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:42.595449 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4047/8134] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:37:42.596474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4779ce-0a34-4c58-a63d-5e2ccb71da84 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:42.598244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b4779ce-0a34-4c58-a63d-5e2ccb71da84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:42.607167 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:42.612820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4779ce-0a34-4c58-a63d-5e2ccb71da84 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:42.613339 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4088/8135] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:42 2022] DELETE /identity/v3/users/40f45ffe955848b9b3917565de3a69e2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:42.707871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cddc4-c111-4ffe-84d8-71f1b2cdc668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:42.709504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cddc4-c111-4ffe-84d8-71f1b2cdc668 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:42.710093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cddc4-c111-4ffe-84d8-71f1b2cdc668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:42.710802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cddc4-c111-4ffe-84d8-71f1b2cdc668 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:42.714006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cddc4-c111-4ffe-84d8-71f1b2cdc668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:42.718054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cddc4-c111-4ffe-84d8-71f1b2cdc668 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:42.764022 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4048/8136] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:42 2022] POST /identity/v3/projects => generated 363 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:42.768568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:42.781468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a7ff7-346e-4937-ba3f-aa586c22e66a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:42.857321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a00b38-73cd-4bff-b5af-4719d3d74796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:42.858267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00b38-73cd-4bff-b5af-4719d3d74796 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:42.858781 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00b38-73cd-4bff-b5af-4719d3d74796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:42.859240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00b38-73cd-4bff-b5af-4719d3d74796 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:42.860057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a00b38-73cd-4bff-b5af-4719d3d74796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:42.862351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a00b38-73cd-4bff-b5af-4719d3d74796 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:42.893321 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4089/8137] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:42 2022] POST /identity/v3/users => generated 282 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:42.897283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cddc4-c111-4ffe-84d8-71f1b2cdc668 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:42.908692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cddc4-c111-4ffe-84d8-71f1b2cdc668 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:42.914641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284f8e8-81c8-4c29-a5c8-05ee60e5b028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:42.915385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284f8e8-81c8-4c29-a5c8-05ee60e5b028 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:42.915678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284f8e8-81c8-4c29-a5c8-05ee60e5b028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:42.915964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284f8e8-81c8-4c29-a5c8-05ee60e5b028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:42.917189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284f8e8-81c8-4c29-a5c8-05ee60e5b028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:42.919456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284f8e8-81c8-4c29-a5c8-05ee60e5b028 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:42.931130 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4049/8138] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:42.935214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a00b38-73cd-4bff-b5af-4719d3d74796 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:42.946530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a00b38-73cd-4bff-b5af-4719d3d74796 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:42.952652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f88df-483a-407b-a343-679025f697dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:42.953475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f88df-483a-407b-a343-679025f697dc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:42.953906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f88df-483a-407b-a343-679025f697dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:42.954324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f88df-483a-407b-a343-679025f697dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:42.955170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f88df-483a-407b-a343-679025f697dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:42.956955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f88df-483a-407b-a343-679025f697dc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:42.984083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284f8e8-81c8-4c29-a5c8-05ee60e5b028 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:42.986388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3284f8e8-81c8-4c29-a5c8-05ee60e5b028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:42.993200 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4090/8139] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:42.998734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f88df-483a-407b-a343-679025f697dc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.018992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284f8e8-81c8-4c29-a5c8-05ee60e5b028 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.033872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f88df-483a-407b-a343-679025f697dc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.039297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec97b5-f71a-4106-8b8f-935389ab667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.040136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec97b5-f71a-4106-8b8f-935389ab667d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.040485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec97b5-f71a-4106-8b8f-935389ab667d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.040830 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec97b5-f71a-4106-8b8f-935389ab667d admin admin] PATH_INFO: `/v3/projects/37a270336a82421988da7e54f242d31c/users/f6213e486ccd489b9bfe0ea01588d6b7/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.041464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.042399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.042735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.043016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] PATH_INFO: `/v3/projects/8619ba24c8194205b32c9ecf08dabcd4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.048399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8619ba24c8194205b32c9ecf08dabcd4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.050534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.060939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec97b5-f71a-4106-8b8f-935389ab667d admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a270336a82421988da7e54f242d31c, user_id=f6213e486ccd489b9bfe0ea01588d6b7, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.064011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec97b5-f71a-4106-8b8f-935389ab667d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.084356 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4091/8140] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:42 2022] PUT /identity/v3/projects/37a270336a82421988da7e54f242d31c/users/f6213e486ccd489b9bfe0ea01588d6b7/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:43.096022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe27fa5-9cbd-4dda-a484-d90c4b9f65be None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.096722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe27fa5-9cbd-4dda-a484-d90c4b9f65be None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.097357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe27fa5-9cbd-4dda-a484-d90c4b9f65be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.123641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8619ba24c8194205b32c9ecf08dabcd4', 'request_id': 'req-fd00f9d9-78eb-4688-abff-fae179523dfd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:43.130999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8619ba24c8194205b32c9ecf08dabcd4', 'request_id': 'req-fd00f9d9-78eb-4688-abff-fae179523dfd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:43.138033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7fe27fa5-9cbd-4dda-a484-d90c4b9f65be None None] MFA Rules not processed for user `f6213e486ccd489b9bfe0ea01588d6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:43.139915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7fe27fa5-9cbd-4dda-a484-d90c4b9f65be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:43.140349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8619ba24c8194205b32c9ecf08dabcd4', 'request_id': 'req-fd00f9d9-78eb-4688-abff-fae179523dfd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:43.142189 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:43.167619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] The token cache is being invalidate because project 8619ba24c8194205b32c9ecf08dabcd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:43.168201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:43.169116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd00f9d9-78eb-4688-abff-fae179523dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:43.171317 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4050/8141] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:42 2022] DELETE /identity/v3/projects/8619ba24c8194205b32c9ecf08dabcd4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:43.175982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa760ea-4009-40b0-bb66-a9921f6f942e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.176561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa760ea-4009-40b0-bb66-a9921f6f942e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.177022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa760ea-4009-40b0-bb66-a9921f6f942e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.207259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cfa760ea-4009-40b0-bb66-a9921f6f942e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:43.210034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cfa760ea-4009-40b0-bb66-a9921f6f942e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:43.236717 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4092/8142] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:37:43.242909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe27fa5-9cbd-4dda-a484-d90c4b9f65be None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.245056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7fe27fa5-9cbd-4dda-a484-d90c4b9f65be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:43.296701 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4051/8143] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:37:43.304117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb143fd-5622-49f0-a75b-0647c555d0eb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.304483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb143fd-5622-49f0-a75b-0647c555d0eb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.304824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb143fd-5622-49f0-a75b-0647c555d0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.314525 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:43.349080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-aeb143fd-5622-49f0-a75b-0647c555d0eb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:43.350660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aeb143fd-5622-49f0-a75b-0647c555d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:43.359984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe27fa5-9cbd-4dda-a484-d90c4b9f65be None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.360594 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4052/8144] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:43.364968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb143fd-5622-49f0-a75b-0647c555d0eb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.373673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389715b-72bd-4010-ba13-eea1efd4beca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.374306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389715b-72bd-4010-ba13-eea1efd4beca admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.374590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389715b-72bd-4010-ba13-eea1efd4beca admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.374895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389715b-72bd-4010-ba13-eea1efd4beca admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.375542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389715b-72bd-4010-ba13-eea1efd4beca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.377476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389715b-72bd-4010-ba13-eea1efd4beca admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.379208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb143fd-5622-49f0-a75b-0647c555d0eb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.385320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc8900-d4c1-45ac-ab95-9842f95c10fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.386564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc8900-d4c1-45ac-ab95-9842f95c10fd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.387107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc8900-d4c1-45ac-ab95-9842f95c10fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.387659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc8900-d4c1-45ac-ab95-9842f95c10fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.388481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc8900-d4c1-45ac-ab95-9842f95c10fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:43.389007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc8900-d4c1-45ac-ab95-9842f95c10fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.390803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc8900-d4c1-45ac-ab95-9842f95c10fd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.405898 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4053/8145] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:37:43.411143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc8900-d4c1-45ac-ab95-9842f95c10fd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.426241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc8900-d4c1-45ac-ab95-9842f95c10fd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.434046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf00808-0b55-427d-8ffe-5139d6b42ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.434707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf00808-0b55-427d-8ffe-5139d6b42ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.434991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf00808-0b55-427d-8ffe-5139d6b42ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.435267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf00808-0b55-427d-8ffe-5139d6b42ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.436219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf00808-0b55-427d-8ffe-5139d6b42ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.438677 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4093/8146] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:43 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:43.438849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf00808-0b55-427d-8ffe-5139d6b42ef2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.441369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389715b-72bd-4010-ba13-eea1efd4beca admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.512101 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4054/8147] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:43.513319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf00808-0b55-427d-8ffe-5139d6b42ef2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.590058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389715b-72bd-4010-ba13-eea1efd4beca admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.642645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf00808-0b55-427d-8ffe-5139d6b42ef2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.657474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aca1f-2bb8-4fad-adc4-1d808658bb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.658157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aca1f-2bb8-4fad-adc4-1d808658bb80 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.658505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aca1f-2bb8-4fad-adc4-1d808658bb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.658742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aca1f-2bb8-4fad-adc4-1d808658bb80 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.659903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aca1f-2bb8-4fad-adc4-1d808658bb80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.661877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aca1f-2bb8-4fad-adc4-1d808658bb80 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.674411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec806a0-85a9-4a81-90ae-8e12640d4025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.674967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec806a0-85a9-4a81-90ae-8e12640d4025 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.675252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec806a0-85a9-4a81-90ae-8e12640d4025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.675528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec806a0-85a9-4a81-90ae-8e12640d4025 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.676163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec806a0-85a9-4a81-90ae-8e12640d4025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.678284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec806a0-85a9-4a81-90ae-8e12640d4025 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.689929 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4055/8148] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:43 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:43.693988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aca1f-2bb8-4fad-adc4-1d808658bb80 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.706259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aca1f-2bb8-4fad-adc4-1d808658bb80 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.712715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc4202-6b9a-4c7e-86cc-10fc283e2f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.713535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc4202-6b9a-4c7e-86cc-10fc283e2f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.713945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc4202-6b9a-4c7e-86cc-10fc283e2f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.714224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc4202-6b9a-4c7e-86cc-10fc283e2f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.714945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc4202-6b9a-4c7e-86cc-10fc283e2f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.716848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc4202-6b9a-4c7e-86cc-10fc283e2f7c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.718126 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4094/8149] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:43 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:37:43.721841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec806a0-85a9-4a81-90ae-8e12640d4025 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.729498 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4056/8150] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:37:43.733279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc4202-6b9a-4c7e-86cc-10fc283e2f7c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.737931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec806a0-85a9-4a81-90ae-8e12640d4025 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.745654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4a0ef-549c-400f-acff-e2e2542fc51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.746646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4a0ef-549c-400f-acff-e2e2542fc51b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.747000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc4202-6b9a-4c7e-86cc-10fc283e2f7c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.747318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4a0ef-549c-400f-acff-e2e2542fc51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.747856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4a0ef-549c-400f-acff-e2e2542fc51b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.748695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4a0ef-549c-400f-acff-e2e2542fc51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.750783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4a0ef-549c-400f-acff-e2e2542fc51b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.753134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0feae5-6e18-458c-b598-e2f491bb68dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.754135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0feae5-6e18-458c-b598-e2f491bb68dd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.754369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0feae5-6e18-458c-b598-e2f491bb68dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.754877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0feae5-6e18-458c-b598-e2f491bb68dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.755555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0feae5-6e18-458c-b598-e2f491bb68dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.757358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0feae5-6e18-458c-b598-e2f491bb68dd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.767168 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4095/8151] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:43.770243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4a0ef-549c-400f-acff-e2e2542fc51b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.770980 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4057/8152] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:37:43.774718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0feae5-6e18-458c-b598-e2f491bb68dd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.786511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4a0ef-549c-400f-acff-e2e2542fc51b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.788373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0feae5-6e18-458c-b598-e2f491bb68dd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.792173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894edf6c-ce4f-480f-a85f-a38a45e0337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.792982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894edf6c-ce4f-480f-a85f-a38a45e0337a admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.793270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894edf6c-ce4f-480f-a85f-a38a45e0337a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.793562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894edf6c-ce4f-480f-a85f-a38a45e0337a admin admin] PATH_INFO: `/v3/projects/f9e72cb1f23d471eb2ae6a1e1fcf3be2/users/a3d482cc44574ad6ae304e22e275e5a2/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.793798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999974e-628e-4379-b047-1eacd68da21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:43.794526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999974e-628e-4379-b047-1eacd68da21a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.794973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999974e-628e-4379-b047-1eacd68da21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.795304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999974e-628e-4379-b047-1eacd68da21a admin admin] PATH_INFO: `/v3/projects/80eaeff2b9dc4449975614f76cedf5ed/users/3779ddd66e72431b9b8d79167159f137/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.813932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894edf6c-ce4f-480f-a85f-a38a45e0337a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e72cb1f23d471eb2ae6a1e1fcf3be2, user_id=a3d482cc44574ad6ae304e22e275e5a2, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.817210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999974e-628e-4379-b047-1eacd68da21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80eaeff2b9dc4449975614f76cedf5ed, user_id=3779ddd66e72431b9b8d79167159f137, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:43.818723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894edf6c-ce4f-480f-a85f-a38a45e0337a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.820257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999974e-628e-4379-b047-1eacd68da21a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:43.828297 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:43.840038 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4096/8153] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:43 2022] PUT /identity/v3/projects/f9e72cb1f23d471eb2ae6a1e1fcf3be2/users/a3d482cc44574ad6ae304e22e275e5a2/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:43.841878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894edf6c-ce4f-480f-a85f-a38a45e0337a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:43.850387 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4058/8154] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:43 2022] PUT /identity/v3/projects/80eaeff2b9dc4449975614f76cedf5ed/users/3779ddd66e72431b9b8d79167159f137/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:43.862862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe557d8-3da8-4998-85f7-1530ea5cf092 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:43.865687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe557d8-3da8-4998-85f7-1530ea5cf092 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:43.866625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe557d8-3da8-4998-85f7-1530ea5cf092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:43.907529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6fe557d8-3da8-4998-85f7-1530ea5cf092 None None] MFA Rules not processed for user `3779ddd66e72431b9b8d79167159f137`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:43.909037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6fe557d8-3da8-4998-85f7-1530ea5cf092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:43.922125 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:43.960593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894edf6c-ce4f-480f-a85f-a38a45e0337a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:43.996914 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4059/8155] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:44.001411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe557d8-3da8-4998-85f7-1530ea5cf092 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:44.059450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772ffb3-0ecc-4390-a870-cd80b078c06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:44.060100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772ffb3-0ecc-4390-a870-cd80b078c06d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:44.060360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772ffb3-0ecc-4390-a870-cd80b078c06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:44.061040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772ffb3-0ecc-4390-a870-cd80b078c06d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:44.067020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772ffb3-0ecc-4390-a870-cd80b078c06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:44.069707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772ffb3-0ecc-4390-a870-cd80b078c06d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:44.091446 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4097/8156] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:44.099532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772ffb3-0ecc-4390-a870-cd80b078c06d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:44.115918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe557d8-3da8-4998-85f7-1530ea5cf092 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:44.119355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772ffb3-0ecc-4390-a870-cd80b078c06d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:44.126785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c577fc6-86bc-49a8-8a74-5e3351afab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:44.127478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da823758-b360-4044-8d7f-00d3573fa51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:44.128393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577fc6-86bc-49a8-8a74-5e3351afab2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:44.128744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da823758-b360-4044-8d7f-00d3573fa51c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:44.129091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577fc6-86bc-49a8-8a74-5e3351afab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:44.129458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da823758-b360-4044-8d7f-00d3573fa51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:44.129935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577fc6-86bc-49a8-8a74-5e3351afab2b admin admin] PATH_INFO: `/v3/projects/f9e72cb1f23d471eb2ae6a1e1fcf3be2/users/a3d482cc44574ad6ae304e22e275e5a2/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:44.130292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da823758-b360-4044-8d7f-00d3573fa51c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:44.132492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da823758-b360-4044-8d7f-00d3573fa51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:44.135590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c577fc6-86bc-49a8-8a74-5e3351afab2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e72cb1f23d471eb2ae6a1e1fcf3be2, user_id=a3d482cc44574ad6ae304e22e275e5a2, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:44.136370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da823758-b360-4044-8d7f-00d3573fa51c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:44.140379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c577fc6-86bc-49a8-8a74-5e3351afab2b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:44.155743 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4098/8157] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:44 2022] PUT /identity/v3/projects/f9e72cb1f23d471eb2ae6a1e1fcf3be2/users/a3d482cc44574ad6ae304e22e275e5a2/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:44.174672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f403e-1d4b-44c1-bffd-7179036cf0f1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:44.175894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f403e-1d4b-44c1-bffd-7179036cf0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:44.176198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f403e-1d4b-44c1-bffd-7179036cf0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:44.212020 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4060/8158] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:44 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:37:44.213792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da823758-b360-4044-8d7f-00d3573fa51c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:44.268412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-379f403e-1d4b-44c1-bffd-7179036cf0f1 None None] MFA Rules not processed for user `a3d482cc44574ad6ae304e22e275e5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:44.269807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-379f403e-1d4b-44c1-bffd-7179036cf0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:44.299542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da823758-b360-4044-8d7f-00d3573fa51c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:44.310048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be45528-59fd-44e3-ba5a-8c3936ca01c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:44.310997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be45528-59fd-44e3-ba5a-8c3936ca01c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:44.311285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be45528-59fd-44e3-ba5a-8c3936ca01c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:44.311879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be45528-59fd-44e3-ba5a-8c3936ca01c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:44.312727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be45528-59fd-44e3-ba5a-8c3936ca01c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:44.315105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be45528-59fd-44e3-ba5a-8c3936ca01c3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:44.357096 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:44.375658 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4061/8159] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:44 2022] POST /identity/v3/users => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:44.376996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be45528-59fd-44e3-ba5a-8c3936ca01c3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:44.423178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be45528-59fd-44e3-ba5a-8c3936ca01c3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:44.431018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b4d3d-ce2d-41f0-a4a9-83e8c3d51675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:44.432354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b4d3d-ce2d-41f0-a4a9-83e8c3d51675 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:44.432721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b4d3d-ce2d-41f0-a4a9-83e8c3d51675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:44.433097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b4d3d-ce2d-41f0-a4a9-83e8c3d51675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:44.433812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b4d3d-ce2d-41f0-a4a9-83e8c3d51675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:44.434178 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4099/8160] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:44.436690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b4d3d-ce2d-41f0-a4a9-83e8c3d51675 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:44.456778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f403e-1d4b-44c1-bffd-7179036cf0f1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:44.458306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-379f403e-1d4b-44c1-bffd-7179036cf0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:44.476778 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4062/8161] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:44.478319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b4d3d-ce2d-41f0-a4a9-83e8c3d51675 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:44.497026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b4d3d-ce2d-41f0-a4a9-83e8c3d51675 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:44.510436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0474fb-d7ed-467e-8607-07e666b5331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:44.511295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0474fb-d7ed-467e-8607-07e666b5331f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:44.511579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0474fb-d7ed-467e-8607-07e666b5331f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:44.511858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0474fb-d7ed-467e-8607-07e666b5331f admin admin] PATH_INFO: `/v3/projects/bfebdad607744483a90dfd0c389b2a10/users/be8c907aa8014a06b57c6f8d94428297/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:44.551063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0474fb-d7ed-467e-8607-07e666b5331f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfebdad607744483a90dfd0c389b2a10, user_id=be8c907aa8014a06b57c6f8d94428297, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:44.555580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0474fb-d7ed-467e-8607-07e666b5331f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:44.589560 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4063/8162] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:44 2022] PUT /identity/v3/projects/bfebdad607744483a90dfd0c389b2a10/users/be8c907aa8014a06b57c6f8d94428297/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:44.593221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0474fb-d7ed-467e-8607-07e666b5331f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:44.596718 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:44.606523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f403e-1d4b-44c1-bffd-7179036cf0f1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:44.747986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334b0b6-2eaf-4318-94cb-1e49a7763d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:44.748845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334b0b6-2eaf-4318-94cb-1e49a7763d00 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:44.749312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334b0b6-2eaf-4318-94cb-1e49a7763d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:44.749742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334b0b6-2eaf-4318-94cb-1e49a7763d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:44.780146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0474fb-d7ed-467e-8607-07e666b5331f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:44.786085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c521de-a053-499f-aa30-c1e0f067c639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:44.787150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c521de-a053-499f-aa30-c1e0f067c639 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:44.787597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c521de-a053-499f-aa30-c1e0f067c639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:44.787884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c521de-a053-499f-aa30-c1e0f067c639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:44.788558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c521de-a053-499f-aa30-c1e0f067c639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:44.790632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c521de-a053-499f-aa30-c1e0f067c639 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:44.805373 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4064/8163] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:44.810871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c521de-a053-499f-aa30-c1e0f067c639 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:44.833785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c521de-a053-499f-aa30-c1e0f067c639 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:44.843390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583a461-da5f-40fd-9743-256ef580a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:44.844558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583a461-da5f-40fd-9743-256ef580a02e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:44.844846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583a461-da5f-40fd-9743-256ef580a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:44.845128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583a461-da5f-40fd-9743-256ef580a02e admin admin] PATH_INFO: `/v3/projects/bfebdad607744483a90dfd0c389b2a10/users/be8c907aa8014a06b57c6f8d94428297/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:44.847977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583a461-da5f-40fd-9743-256ef580a02e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfebdad607744483a90dfd0c389b2a10, user_id=be8c907aa8014a06b57c6f8d94428297, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:44.852277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583a461-da5f-40fd-9743-256ef580a02e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:44.869108 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4065/8164] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:44 2022] PUT /identity/v3/projects/bfebdad607744483a90dfd0c389b2a10/users/be8c907aa8014a06b57c6f8d94428297/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:44.869262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334b0b6-2eaf-4318-94cb-1e49a7763d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:44.871241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334b0b6-2eaf-4318-94cb-1e49a7763d00 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:44.879921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa0b6a-1298-4c9b-be44-ee6dc45acebe None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:44.880114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa0b6a-1298-4c9b-be44-ee6dc45acebe None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:44.880364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa0b6a-1298-4c9b-be44-ee6dc45acebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:44.883963 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4100/8165] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:44.912961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7eaa0b6a-1298-4c9b-be44-ee6dc45acebe None None] MFA Rules not processed for user `be8c907aa8014a06b57c6f8d94428297`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:44.914143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7eaa0b6a-1298-4c9b-be44-ee6dc45acebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:44.992011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334b0b6-2eaf-4318-94cb-1e49a7763d00 service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:45.004523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334b0b6-2eaf-4318-94cb-1e49a7763d00 service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:45.006753 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4066/8166] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:37:45.019898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa0b6a-1298-4c9b-be44-ee6dc45acebe None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:45.021353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7eaa0b6a-1298-4c9b-be44-ee6dc45acebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:45.064768 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:45.095814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62810540-a6f1-435f-b4c1-6963d6e1318f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:45.096673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810540-a6f1-435f-b4c1-6963d6e1318f service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:45.097214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810540-a6f1-435f-b4c1-6963d6e1318f service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:45.097477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810540-a6f1-435f-b4c1-6963d6e1318f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:45.098310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa0b6a-1298-4c9b-be44-ee6dc45acebe None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:45.102084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e499e12-c55f-4269-8fa6-ed39970c0503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:45.102897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e499e12-c55f-4269-8fa6-ed39970c0503 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:45.103382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e499e12-c55f-4269-8fa6-ed39970c0503 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:45.104171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e499e12-c55f-4269-8fa6-ed39970c0503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:45.115733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e499e12-c55f-4269-8fa6-ed39970c0503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:45.117694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e499e12-c55f-4269-8fa6-ed39970c0503 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:45.139719 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4067/8167] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:37:45.171585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62810540-a6f1-435f-b4c1-6963d6e1318f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:45.173748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62810540-a6f1-435f-b4c1-6963d6e1318f service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:45.187407 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4101/8168] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:37:45.279581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e499e12-c55f-4269-8fa6-ed39970c0503 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:45.295173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e499e12-c55f-4269-8fa6-ed39970c0503 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:45.305332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15317a8d-85ec-4d3b-affa-ad55a419bad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:45.307298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15317a8d-85ec-4d3b-affa-ad55a419bad9 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:45.308523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15317a8d-85ec-4d3b-affa-ad55a419bad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:45.309193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15317a8d-85ec-4d3b-affa-ad55a419bad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:45.432169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15317a8d-85ec-4d3b-affa-ad55a419bad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:45.435618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15317a8d-85ec-4d3b-affa-ad55a419bad9 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:45.451520 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4068/8169] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:48.611719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62810540-a6f1-435f-b4c1-6963d6e1318f service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:48.614113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-62810540-a6f1-435f-b4c1-6963d6e1318f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:48.635054 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:48.840608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62810540-a6f1-435f-b4c1-6963d6e1318f service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:48.852255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebb47f-930d-41cc-89a8-4a223c77771e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:48.853057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebb47f-930d-41cc-89a8-4a223c77771e service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:48.853905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebb47f-930d-41cc-89a8-4a223c77771e service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:48.854222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebb47f-930d-41cc-89a8-4a223c77771e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:48.858269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-71ebb47f-930d-41cc-89a8-4a223c77771e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:48.876712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebb47f-930d-41cc-89a8-4a223c77771e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:48.878331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebb47f-930d-41cc-89a8-4a223c77771e service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:48.892581 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4102/8170] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:49.674810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15317a8d-85ec-4d3b-affa-ad55a419bad9 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:49.676287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-15317a8d-85ec-4d3b-affa-ad55a419bad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:49.843082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15317a8d-85ec-4d3b-affa-ad55a419bad9 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:49.849312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85e747-e3ce-44b6-8b3c-dd501267e5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:49.850328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e747-e3ce-44b6-8b3c-dd501267e5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:49.851371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e747-e3ce-44b6-8b3c-dd501267e5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:49.851371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e747-e3ce-44b6-8b3c-dd501267e5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:49.854288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf85e747-e3ce-44b6-8b3c-dd501267e5e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:49.873548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85e747-e3ce-44b6-8b3c-dd501267e5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:49.888975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85e747-e3ce-44b6-8b3c-dd501267e5e7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:49.920606 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4069/8171] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:50.730207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebb47f-930d-41cc-89a8-4a223c77771e service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:50.901043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebb47f-930d-41cc-89a8-4a223c77771e service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:50.922181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:50.923297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:50.923583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:50.923856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] PATH_INFO: `/v3/users/3779ddd66e72431b9b8d79167159f137` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:50.929860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3779ddd66e72431b9b8d79167159f137)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:50.937999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:51.131719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3779ddd66e72431b9b8d79167159f137'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:51.182066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3779ddd66e72431b9b8d79167159f137'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:51.186434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3779ddd66e72431b9b8d79167159f137'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:51.213174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3779ddd66e72431b9b8d79167159f137'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:51.214924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3779ddd66e72431b9b8d79167159f137'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:51.270695 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4103/8172] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:50 2022] DELETE /identity/v3/users/3779ddd66e72431b9b8d79167159f137 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:51.272439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ceb83-a89b-402b-bcc5-37b36af88cf4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:51.272913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ceb83-a89b-402b-bcc5-37b36af88cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:51.273243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ceb83-a89b-402b-bcc5-37b36af88cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:51.348065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-000ceb83-a89b-402b-bcc5-37b36af88cf4 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:51.349280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-000ceb83-a89b-402b-bcc5-37b36af88cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:51.575211 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4070/8173] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:51.595529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:51.598709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:51.639932 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:51.804385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd8b24-92a9-4e50-a242-4d104e1b62c3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:51.818361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecf149-3612-4a7f-8a12-e590fcf58f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:51.819037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecf149-3612-4a7f-8a12-e590fcf58f62 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:51.819310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecf149-3612-4a7f-8a12-e590fcf58f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:51.819578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecf149-3612-4a7f-8a12-e590fcf58f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:51.864196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecf149-3612-4a7f-8a12-e590fcf58f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:51.865681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecf149-3612-4a7f-8a12-e590fcf58f62 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:51.906097 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4104/8174] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:52.977943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ceb83-a89b-402b-bcc5-37b36af88cf4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:52.980111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-000ceb83-a89b-402b-bcc5-37b36af88cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:53.016351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ceb83-a89b-402b-bcc5-37b36af88cf4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:53.040311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:53.041221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:53.041541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:53.042038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] PATH_INFO: `/v3/projects/80eaeff2b9dc4449975614f76cedf5ed` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:53.043978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80eaeff2b9dc4449975614f76cedf5ed)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:53.049942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:53.114722 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:53.332971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80eaeff2b9dc4449975614f76cedf5ed', 'request_id': 'req-eb303947-5b64-4747-a1a6-d2982d186618'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:53.363885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80eaeff2b9dc4449975614f76cedf5ed', 'request_id': 'req-eb303947-5b64-4747-a1a6-d2982d186618'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:53.386987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80eaeff2b9dc4449975614f76cedf5ed', 'request_id': 'req-eb303947-5b64-4747-a1a6-d2982d186618'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:53.439275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] The token cache is being invalidate because project 80eaeff2b9dc4449975614f76cedf5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:53.439710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:53.444038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:53.445647 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4071/8175] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:52 2022] DELETE /identity/v3/projects/80eaeff2b9dc4449975614f76cedf5ed => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:53.455187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecf149-3612-4a7f-8a12-e590fcf58f62 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:53.483219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecf149-3612-4a7f-8a12-e590fcf58f62 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:53.700195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12ef7a-fa7f-4402-8aea-a5ad0f74bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:53.701283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ef7a-fa7f-4402-8aea-a5ad0f74bbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:53.701719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ef7a-fa7f-4402-8aea-a5ad0f74bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:53.702003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ef7a-fa7f-4402-8aea-a5ad0f74bbad admin admin] PATH_INFO: `/v3/users/be8c907aa8014a06b57c6f8d94428297` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:53.703602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12ef7a-fa7f-4402-8aea-a5ad0f74bbad admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8c907aa8014a06b57c6f8d94428297)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:53.708890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12ef7a-fa7f-4402-8aea-a5ad0f74bbad admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:53.875707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1a12ef7a-fa7f-4402-8aea-a5ad0f74bbad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8c907aa8014a06b57c6f8d94428297'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:53.936793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1a12ef7a-fa7f-4402-8aea-a5ad0f74bbad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8c907aa8014a06b57c6f8d94428297'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:53.937805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1a12ef7a-fa7f-4402-8aea-a5ad0f74bbad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8c907aa8014a06b57c6f8d94428297'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:53.960814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1a12ef7a-fa7f-4402-8aea-a5ad0f74bbad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8c907aa8014a06b57c6f8d94428297'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:53.960814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1a12ef7a-fa7f-4402-8aea-a5ad0f74bbad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8c907aa8014a06b57c6f8d94428297'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:54.001686 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4105/8176] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:37:53 2022] DELETE /identity/v3/users/be8c907aa8014a06b57c6f8d94428297 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:54.668826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:54.670255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:54.692641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb303947-5b64-4747-a1a6-d2982d186618 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:54.856774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:54.857381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:54.857500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:54.857718 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] PATH_INFO: `/v3/projects/bfebdad607744483a90dfd0c389b2a10` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:54.859036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfebdad607744483a90dfd0c389b2a10)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:54.860986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:55.039064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfebdad607744483a90dfd0c389b2a10', 'request_id': 'req-5527a752-d61e-464a-bed7-7a32d41ea5d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:55.050262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfebdad607744483a90dfd0c389b2a10', 'request_id': 'req-5527a752-d61e-464a-bed7-7a32d41ea5d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:55.065415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfebdad607744483a90dfd0c389b2a10', 'request_id': 'req-5527a752-d61e-464a-bed7-7a32d41ea5d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:55.111572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] The token cache is being invalidate because project bfebdad607744483a90dfd0c389b2a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:37:55.111970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:55.112894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5527a752-d61e-464a-bed7-7a32d41ea5d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:37:55.120451 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4072/8177] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:37:54 2022] DELETE /identity/v3/projects/bfebdad607744483a90dfd0c389b2a10 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:55.122029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98057c9d-c2aa-4ef4-9267-030c1b013c45 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:55.122894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98057c9d-c2aa-4ef4-9267-030c1b013c45 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:55.123354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98057c9d-c2aa-4ef4-9267-030c1b013c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:55.162701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-98057c9d-c2aa-4ef4-9267-030c1b013c45 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:55.163999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-98057c9d-c2aa-4ef4-9267-030c1b013c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:55.219168 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:55.306348 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4106/8178] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:55.323384 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31c559-6a41-4cee-a5f8-799c45a3e46d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:55.323646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31c559-6a41-4cee-a5f8-799c45a3e46d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:55.323923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31c559-6a41-4cee-a5f8-799c45a3e46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:55.355092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-af31c559-6a41-4cee-a5f8-799c45a3e46d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:55.356683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-af31c559-6a41-4cee-a5f8-799c45a3e46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:55.367127 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4073/8179] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:55.371778 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98057c9d-c2aa-4ef4-9267-030c1b013c45 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:55.385933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98057c9d-c2aa-4ef4-9267-030c1b013c45 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:55.392344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2bdda-8643-4bac-abdc-d0d58d834aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:55.393204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2bdda-8643-4bac-abdc-d0d58d834aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:55.393712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2bdda-8643-4bac-abdc-d0d58d834aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:55.394434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2bdda-8643-4bac-abdc-d0d58d834aaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:55.395464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2bdda-8643-4bac-abdc-d0d58d834aaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:37:55.395978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2bdda-8643-4bac-abdc-d0d58d834aaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:55.398123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2bdda-8643-4bac-abdc-d0d58d834aaa admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:55.436447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31c559-6a41-4cee-a5f8-799c45a3e46d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:55.440359 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4107/8180] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:37:55.449778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31c559-6a41-4cee-a5f8-799c45a3e46d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:55.468688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40389-7701-4738-a8a5-13256df738db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:55.469334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40389-7701-4738-a8a5-13256df738db admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:55.469618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40389-7701-4738-a8a5-13256df738db admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:55.469877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40389-7701-4738-a8a5-13256df738db admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:55.470528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff40389-7701-4738-a8a5-13256df738db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:55.472653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff40389-7701-4738-a8a5-13256df738db admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:55.508238 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:55.530547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2bdda-8643-4bac-abdc-d0d58d834aaa admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:55.534659 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4074/8181] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:55 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:55.562872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2bdda-8643-4bac-abdc-d0d58d834aaa admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:55.685432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40389-7701-4738-a8a5-13256df738db admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:55.688413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ff40389-7701-4738-a8a5-13256df738db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:55.772109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36e92e-1d31-4663-9a1c-4753a7e82014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:55.772847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36e92e-1d31-4663-9a1c-4753a7e82014 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:55.773131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36e92e-1d31-4663-9a1c-4753a7e82014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:55.777663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36e92e-1d31-4663-9a1c-4753a7e82014 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:55.778352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36e92e-1d31-4663-9a1c-4753a7e82014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:55.780592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36e92e-1d31-4663-9a1c-4753a7e82014 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:55.804679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40389-7701-4738-a8a5-13256df738db admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:55.810928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7da2e5-eb76-49ee-aba6-50022b6b02d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:55.811844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da2e5-eb76-49ee-aba6-50022b6b02d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:55.812356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da2e5-eb76-49ee-aba6-50022b6b02d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:55.812772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7da2e5-eb76-49ee-aba6-50022b6b02d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:55.815113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2c7da2e5-eb76-49ee-aba6-50022b6b02d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:55.849608 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4108/8182] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:55 2022] POST /identity/v3/users => generated 284 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:37:55.850853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36e92e-1d31-4663-9a1c-4753a7e82014 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:55.870949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36e92e-1d31-4663-9a1c-4753a7e82014 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:55.884793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c63c74-9298-4be5-b8d9-e737da9cc8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:55.885391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c63c74-9298-4be5-b8d9-e737da9cc8dc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:55.885872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c63c74-9298-4be5-b8d9-e737da9cc8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:55.886364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c63c74-9298-4be5-b8d9-e737da9cc8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:55.887450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c63c74-9298-4be5-b8d9-e737da9cc8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:55.889622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c63c74-9298-4be5-b8d9-e737da9cc8dc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:55.916862 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4109/8183] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:55.918669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c63c74-9298-4be5-b8d9-e737da9cc8dc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:55.947609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c63c74-9298-4be5-b8d9-e737da9cc8dc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:55.964172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7da2e5-eb76-49ee-aba6-50022b6b02d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:55.966172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7da2e5-eb76-49ee-aba6-50022b6b02d8 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:55.968658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11e24-851c-47b9-a816-25f3d8f32b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:55.969448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11e24-851c-47b9-a816-25f3d8f32b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:55.969732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11e24-851c-47b9-a816-25f3d8f32b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:55.970004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11e24-851c-47b9-a816-25f3d8f32b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:55.970674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11e24-851c-47b9-a816-25f3d8f32b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:55.972408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11e24-851c-47b9-a816-25f3d8f32b9b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:55.992487 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4075/8184] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:37:55.998013 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4110/8185] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:56.000178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7da2e5-eb76-49ee-aba6-50022b6b02d8 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:56.031359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7da2e5-eb76-49ee-aba6-50022b6b02d8 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:56.048469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8fe2b-eab0-4bca-8616-d698590d6ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:56.052872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8fe2b-eab0-4bca-8616-d698590d6ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:56.053432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8fe2b-eab0-4bca-8616-d698590d6ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:56.053716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8fe2b-eab0-4bca-8616-d698590d6ca5 admin admin] PATH_INFO: `/v3/projects/ebfd882d110140dda09fc9cfcb920d76/users/cea5c2cbdaec4fdda08131f408cf0e3a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:56.102224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8fe2b-eab0-4bca-8616-d698590d6ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfd882d110140dda09fc9cfcb920d76, user_id=cea5c2cbdaec4fdda08131f408cf0e3a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:56.105080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8fe2b-eab0-4bca-8616-d698590d6ca5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:56.147458 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4076/8186] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:55 2022] PUT /identity/v3/projects/ebfd882d110140dda09fc9cfcb920d76/users/cea5c2cbdaec4fdda08131f408cf0e3a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:37:56.150233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe53592-f9fb-4988-8d46-0d17df9c5050 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:56.150761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe53592-f9fb-4988-8d46-0d17df9c5050 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:56.150923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe53592-f9fb-4988-8d46-0d17df9c5050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:56.232755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dbe53592-f9fb-4988-8d46-0d17df9c5050 None None] MFA Rules not processed for user `cea5c2cbdaec4fdda08131f408cf0e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:56.233972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dbe53592-f9fb-4988-8d46-0d17df9c5050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:56.376634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8fe2b-eab0-4bca-8616-d698590d6ca5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:56.388793 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4111/8187] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:56.457405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8fe2b-eab0-4bca-8616-d698590d6ca5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:56.463311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea43f7-e2b8-46c5-8023-994e62940904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:56.465505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea43f7-e2b8-46c5-8023-994e62940904 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:56.465930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea43f7-e2b8-46c5-8023-994e62940904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:56.466870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea43f7-e2b8-46c5-8023-994e62940904 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:56.468041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea43f7-e2b8-46c5-8023-994e62940904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:56.470307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea43f7-e2b8-46c5-8023-994e62940904 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:56.543079 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4077/8188] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:37:56 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:56.545245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe53592-f9fb-4988-8d46-0d17df9c5050 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:56.561122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe53592-f9fb-4988-8d46-0d17df9c5050 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:56.583998 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:56.708658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce0a32-f827-4007-9dd4-2dac0aba813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:56.709639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce0a32-f827-4007-9dd4-2dac0aba813f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:56.710122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce0a32-f827-4007-9dd4-2dac0aba813f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:56.710672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce0a32-f827-4007-9dd4-2dac0aba813f admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:56.711357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce0a32-f827-4007-9dd4-2dac0aba813f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:56.714236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce0a32-f827-4007-9dd4-2dac0aba813f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:56.769505 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4112/8189] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:37:56 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:37:56.773742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea43f7-e2b8-46c5-8023-994e62940904 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:56.797657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea43f7-e2b8-46c5-8023-994e62940904 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:56.818338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9bac1-2fcf-403d-8034-d634c2735222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:56.819042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9bac1-2fcf-403d-8034-d634c2735222 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:56.819350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9bac1-2fcf-403d-8034-d634c2735222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:56.819628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9bac1-2fcf-403d-8034-d634c2735222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:56.820284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9bac1-2fcf-403d-8034-d634c2735222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:56.822381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9bac1-2fcf-403d-8034-d634c2735222 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:56.836044 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:37:56.849773 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4078/8190] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:56.851597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce0a32-f827-4007-9dd4-2dac0aba813f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:56.865077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce0a32-f827-4007-9dd4-2dac0aba813f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:56.872278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136098c0-795f-4f52-94e3-e5d0fafa99c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:56.873309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136098c0-795f-4f52-94e3-e5d0fafa99c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:56.873834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136098c0-795f-4f52-94e3-e5d0fafa99c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:56.874319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136098c0-795f-4f52-94e3-e5d0fafa99c6 admin admin] PATH_INFO: `/v3/projects/ff6f0a805cc64752b34b0ce7de0dd119/users/517246d2751e4ffdbdf1ba309c62a747/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:56.899275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136098c0-795f-4f52-94e3-e5d0fafa99c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6f0a805cc64752b34b0ce7de0dd119, user_id=517246d2751e4ffdbdf1ba309c62a747, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:56.902678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136098c0-795f-4f52-94e3-e5d0fafa99c6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:56.923303 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4113/8191] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:56 2022] PUT /identity/v3/projects/ff6f0a805cc64752b34b0ce7de0dd119/users/517246d2751e4ffdbdf1ba309c62a747/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:56.938401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9bac1-2fcf-403d-8034-d634c2735222 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:56.951546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9bac1-2fcf-403d-8034-d634c2735222 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:57.059112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914a021-3607-4de9-9f0c-1fdc3e3b7d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:57.059827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914a021-3607-4de9-9f0c-1fdc3e3b7d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:57.060410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914a021-3607-4de9-9f0c-1fdc3e3b7d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:57.060789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914a021-3607-4de9-9f0c-1fdc3e3b7d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:57.061455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914a021-3607-4de9-9f0c-1fdc3e3b7d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:57.063290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914a021-3607-4de9-9f0c-1fdc3e3b7d1a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:57.077697 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4079/8192] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:37:57.082940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136098c0-795f-4f52-94e3-e5d0fafa99c6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:57.109364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136098c0-795f-4f52-94e3-e5d0fafa99c6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:57.123096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ade18-d7f9-4fe2-a380-c5f70490beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:57.123988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ade18-d7f9-4fe2-a380-c5f70490beff admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:57.124427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ade18-d7f9-4fe2-a380-c5f70490beff admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:57.124858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ade18-d7f9-4fe2-a380-c5f70490beff admin admin] PATH_INFO: `/v3/projects/ff6f0a805cc64752b34b0ce7de0dd119/users/517246d2751e4ffdbdf1ba309c62a747/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:57.128919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ade18-d7f9-4fe2-a380-c5f70490beff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6f0a805cc64752b34b0ce7de0dd119, user_id=517246d2751e4ffdbdf1ba309c62a747, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:57.136582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ade18-d7f9-4fe2-a380-c5f70490beff admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:57.171816 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4114/8193] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:37:57 2022] PUT /identity/v3/projects/ff6f0a805cc64752b34b0ce7de0dd119/users/517246d2751e4ffdbdf1ba309c62a747/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:37:57.174867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12ff48-23c4-46a1-90a0-1ec2ce2f0767 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:57.175281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12ff48-23c4-46a1-90a0-1ec2ce2f0767 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:57.176001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12ff48-23c4-46a1-90a0-1ec2ce2f0767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:57.219222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-eb12ff48-23c4-46a1-90a0-1ec2ce2f0767 None None] MFA Rules not processed for user `517246d2751e4ffdbdf1ba309c62a747`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:37:57.221340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb12ff48-23c4-46a1-90a0-1ec2ce2f0767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:37:57.409689 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4080/8194] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:37:57.423912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ade18-d7f9-4fe2-a380-c5f70490beff admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:57.556602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ade18-d7f9-4fe2-a380-c5f70490beff admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:57.560911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053449-27f1-4563-8b5b-4cebddbad35b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:57.561536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053449-27f1-4563-8b5b-4cebddbad35b service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:57.561812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053449-27f1-4563-8b5b-4cebddbad35b service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:57.562080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053449-27f1-4563-8b5b-4cebddbad35b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:57.593727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0053449-27f1-4563-8b5b-4cebddbad35b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:57.597536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0053449-27f1-4563-8b5b-4cebddbad35b service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:57.622914 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4115/8195] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:37:57.914333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12ff48-23c4-46a1-90a0-1ec2ce2f0767 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:37:57.932603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12ff48-23c4-46a1-90a0-1ec2ce2f0767 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:37:57.942386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce354dd-53e8-4d31-8282-97dd7452298d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:37:57.945477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce354dd-53e8-4d31-8282-97dd7452298d service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:37:57.945885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce354dd-53e8-4d31-8282-97dd7452298d service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:37:57.947093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce354dd-53e8-4d31-8282-97dd7452298d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:37:58.044422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce354dd-53e8-4d31-8282-97dd7452298d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:37:58.045894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce354dd-53e8-4d31-8282-97dd7452298d service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:37:58.057840 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4081/8196] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:37:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:07.609219 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:07.915823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053449-27f1-4563-8b5b-4cebddbad35b service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:08.051492 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:08.106206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053449-27f1-4563-8b5b-4cebddbad35b service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:08.130059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:08.130748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:08.131037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:08.131452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] PATH_INFO: `/v3/users/cea5c2cbdaec4fdda08131f408cf0e3a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:08.139397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea5c2cbdaec4fdda08131f408cf0e3a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:08.141398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:08.250431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea5c2cbdaec4fdda08131f408cf0e3a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:08.278393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea5c2cbdaec4fdda08131f408cf0e3a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:08.279209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea5c2cbdaec4fdda08131f408cf0e3a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:08.299218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea5c2cbdaec4fdda08131f408cf0e3a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:08.299877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea5c2cbdaec4fdda08131f408cf0e3a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:08.333660 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4116/8197] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:07 2022] DELETE /identity/v3/users/cea5c2cbdaec4fdda08131f408cf0e3a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:08.338258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f430626-efcd-4cd4-bd63-244a89e01767 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:08.338552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f430626-efcd-4cd4-bd63-244a89e01767 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:08.338861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f430626-efcd-4cd4-bd63-244a89e01767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:08.393902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0f430626-efcd-4cd4-bd63-244a89e01767 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:08.395159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0f430626-efcd-4cd4-bd63-244a89e01767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:08.562688 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4082/8198] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:08.570023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:08.571678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:08.740567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80583-74f0-40d1-84f3-28e76c5d7ffa admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:08.751840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181cde1-e6d3-4494-81d4-bb7c5e0f5ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:08.753222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181cde1-e6d3-4494-81d4-bb7c5e0f5ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:08.753828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181cde1-e6d3-4494-81d4-bb7c5e0f5ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:08.753828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181cde1-e6d3-4494-81d4-bb7c5e0f5ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:08.797049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181cde1-e6d3-4494-81d4-bb7c5e0f5ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:08.802537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181cde1-e6d3-4494-81d4-bb7c5e0f5ea6 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:08.840784 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4117/8199] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:09.334247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f430626-efcd-4cd4-bd63-244a89e01767 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:09.335803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0f430626-efcd-4cd4-bd63-244a89e01767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:09.375636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f430626-efcd-4cd4-bd63-244a89e01767 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:09.398372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:09.400656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:09.401117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:09.401553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] PATH_INFO: `/v3/projects/ebfd882d110140dda09fc9cfcb920d76` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:09.403227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebfd882d110140dda09fc9cfcb920d76)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:09.408479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:09.518397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebfd882d110140dda09fc9cfcb920d76', 'request_id': 'req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:09.541239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebfd882d110140dda09fc9cfcb920d76', 'request_id': 'req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:09.553514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebfd882d110140dda09fc9cfcb920d76', 'request_id': 'req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:09.622708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] The token cache is being invalidate because project ebfd882d110140dda09fc9cfcb920d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:09.624424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:09.627671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:09.635312 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4083/8200] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:09 2022] DELETE /identity/v3/projects/ebfd882d110140dda09fc9cfcb920d76 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:09.641350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181cde1-e6d3-4494-81d4-bb7c5e0f5ea6 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:09.662538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181cde1-e6d3-4494-81d4-bb7c5e0f5ea6 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:09.701861 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:09.781655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f97cb-4b91-46c2-a9c4-ba9d9aa586ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:09.782296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f97cb-4b91-46c2-a9c4-ba9d9aa586ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:09.782485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f97cb-4b91-46c2-a9c4-ba9d9aa586ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:09.782947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f97cb-4b91-46c2-a9c4-ba9d9aa586ce admin admin] PATH_INFO: `/v3/users/517246d2751e4ffdbdf1ba309c62a747` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:09.795425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f97cb-4b91-46c2-a9c4-ba9d9aa586ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=517246d2751e4ffdbdf1ba309c62a747)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:09.797643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f97cb-4b91-46c2-a9c4-ba9d9aa586ce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:09.888068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a33f97cb-4b91-46c2-a9c4-ba9d9aa586ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517246d2751e4ffdbdf1ba309c62a747'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:09.916476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a33f97cb-4b91-46c2-a9c4-ba9d9aa586ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517246d2751e4ffdbdf1ba309c62a747'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:09.917224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a33f97cb-4b91-46c2-a9c4-ba9d9aa586ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517246d2751e4ffdbdf1ba309c62a747'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:09.931772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a33f97cb-4b91-46c2-a9c4-ba9d9aa586ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517246d2751e4ffdbdf1ba309c62a747'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:09.932408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a33f97cb-4b91-46c2-a9c4-ba9d9aa586ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517246d2751e4ffdbdf1ba309c62a747'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:09.978911 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4118/8201] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:09 2022] DELETE /identity/v3/users/517246d2751e4ffdbdf1ba309c62a747 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:38:10.599140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:10.605456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:10.630531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3e9ec-18d8-4f89-807a-8e382f11dcd9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:10.859837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:10.860492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:10.860768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:10.861040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] PATH_INFO: `/v3/projects/ff6f0a805cc64752b34b0ce7de0dd119` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:10.863502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6f0a805cc64752b34b0ce7de0dd119)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:10.880746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:10.988758 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:11.031499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6f0a805cc64752b34b0ce7de0dd119', 'request_id': 'req-b3ef7867-0df2-4069-8db2-4074247cbc8c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:11.045067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6f0a805cc64752b34b0ce7de0dd119', 'request_id': 'req-b3ef7867-0df2-4069-8db2-4074247cbc8c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:11.055572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6f0a805cc64752b34b0ce7de0dd119', 'request_id': 'req-b3ef7867-0df2-4069-8db2-4074247cbc8c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:11.084833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] The token cache is being invalidate because project ff6f0a805cc64752b34b0ce7de0dd119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:11.085266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:11.088800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b3ef7867-0df2-4069-8db2-4074247cbc8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:11.095809 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4084/8202] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:10 2022] DELETE /identity/v3/projects/ff6f0a805cc64752b34b0ce7de0dd119 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:11.100368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbadc01-6e39-441e-9386-d965afee95d1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:11.101321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbadc01-6e39-441e-9386-d965afee95d1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:11.102014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbadc01-6e39-441e-9386-d965afee95d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:11.175545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3fbadc01-6e39-441e-9386-d965afee95d1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:11.176816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3fbadc01-6e39-441e-9386-d965afee95d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:11.342508 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4119/8203] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:11.357614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e1b26-9252-4178-adac-4b225fe268a2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:11.358248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e1b26-9252-4178-adac-4b225fe268a2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:11.358817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e1b26-9252-4178-adac-4b225fe268a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:11.406913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-536e1b26-9252-4178-adac-4b225fe268a2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:11.408182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-536e1b26-9252-4178-adac-4b225fe268a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:11.444409 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4085/8204] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:11.452174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbadc01-6e39-441e-9386-d965afee95d1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:11.484054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbadc01-6e39-441e-9386-d965afee95d1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:11.490180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be553e3-90db-4748-8b06-9c82070b3516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:11.491046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be553e3-90db-4748-8b06-9c82070b3516 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:11.491553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be553e3-90db-4748-8b06-9c82070b3516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:11.492010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be553e3-90db-4748-8b06-9c82070b3516 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:11.494058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be553e3-90db-4748-8b06-9c82070b3516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:38:11.494380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be553e3-90db-4748-8b06-9c82070b3516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:11.496276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be553e3-90db-4748-8b06-9c82070b3516 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:11.520098 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4120/8205] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:38:11.524631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e1b26-9252-4178-adac-4b225fe268a2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:11.537712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e1b26-9252-4178-adac-4b225fe268a2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:11.543113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2407d17-8e74-4834-bc6b-91497e610a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:11.543854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407d17-8e74-4834-bc6b-91497e610a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:11.544313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407d17-8e74-4834-bc6b-91497e610a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:11.544770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407d17-8e74-4834-bc6b-91497e610a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:11.545564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2407d17-8e74-4834-bc6b-91497e610a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:11.548006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2407d17-8e74-4834-bc6b-91497e610a1a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:11.641451 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4086/8206] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:11 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:11.649925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be553e3-90db-4748-8b06-9c82070b3516 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:11.666953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be553e3-90db-4748-8b06-9c82070b3516 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:11.775124 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:11.870957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1be0f2-037a-47a3-ae47-549c7bcba8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:11.873408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be0f2-037a-47a3-ae47-549c7bcba8bc admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:11.873834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be0f2-037a-47a3-ae47-549c7bcba8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:11.874217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be0f2-037a-47a3-ae47-549c7bcba8bc admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:11.875257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1be0f2-037a-47a3-ae47-549c7bcba8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:11.880701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1be0f2-037a-47a3-ae47-549c7bcba8bc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:11.959711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2407d17-8e74-4834-bc6b-91497e610a1a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:11.983731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2407d17-8e74-4834-bc6b-91497e610a1a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:11.989898 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4121/8207] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:11 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:12.028128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1be54-f8a7-4d4d-bc8f-4bb1a8797f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:12.029839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1be54-f8a7-4d4d-bc8f-4bb1a8797f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:12.030123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1be54-f8a7-4d4d-bc8f-4bb1a8797f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:12.030396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1be54-f8a7-4d4d-bc8f-4bb1a8797f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:12.031106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1be54-f8a7-4d4d-bc8f-4bb1a8797f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:12.034986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1be54-f8a7-4d4d-bc8f-4bb1a8797f70 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:12.065194 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4087/8208] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:12.066751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1be0f2-037a-47a3-ae47-549c7bcba8bc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:12.079309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1be0f2-037a-47a3-ae47-549c7bcba8bc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:12.089369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80761e4-6c60-450e-98d9-481b88f139c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:12.090043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80761e4-6c60-450e-98d9-481b88f139c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:12.090358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80761e4-6c60-450e-98d9-481b88f139c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:12.090684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80761e4-6c60-450e-98d9-481b88f139c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:12.091403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80761e4-6c60-450e-98d9-481b88f139c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:12.093085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80761e4-6c60-450e-98d9-481b88f139c7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:12.117965 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4122/8209] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:12.122164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1be54-f8a7-4d4d-bc8f-4bb1a8797f70 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:12.144780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1be54-f8a7-4d4d-bc8f-4bb1a8797f70 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:12.166160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9922a0-7c65-458f-8011-82ebb5b03153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:12.172992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9922a0-7c65-458f-8011-82ebb5b03153 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:12.172992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9922a0-7c65-458f-8011-82ebb5b03153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:12.172992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9922a0-7c65-458f-8011-82ebb5b03153 admin admin] PATH_INFO: `/v3/projects/ddb8840c1db54d0db72e3fd002aa52dc/users/493d18efe4874f7590530d70ba2173a9/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:12.197395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9922a0-7c65-458f-8011-82ebb5b03153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb8840c1db54d0db72e3fd002aa52dc, user_id=493d18efe4874f7590530d70ba2173a9, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:12.206041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9922a0-7c65-458f-8011-82ebb5b03153 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:12.277145 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4088/8210] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:12 2022] PUT /identity/v3/projects/ddb8840c1db54d0db72e3fd002aa52dc/users/493d18efe4874f7590530d70ba2173a9/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:12.279452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118f6c0-205a-4dbc-a668-1a53d414fa02 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:12.306290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118f6c0-205a-4dbc-a668-1a53d414fa02 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:12.306854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118f6c0-205a-4dbc-a668-1a53d414fa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:12.399547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4118f6c0-205a-4dbc-a668-1a53d414fa02 None None] MFA Rules not processed for user `493d18efe4874f7590530d70ba2173a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:12.402221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4118f6c0-205a-4dbc-a668-1a53d414fa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:12.616607 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4123/8211] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:12.621552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9922a0-7c65-458f-8011-82ebb5b03153 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:12.755683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9922a0-7c65-458f-8011-82ebb5b03153 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:12.783743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61d3de-2eb1-47ac-8f7a-6409391a35c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:12.784696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61d3de-2eb1-47ac-8f7a-6409391a35c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:12.785317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61d3de-2eb1-47ac-8f7a-6409391a35c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:12.785736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61d3de-2eb1-47ac-8f7a-6409391a35c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:12.786540 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61d3de-2eb1-47ac-8f7a-6409391a35c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:12.789932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61d3de-2eb1-47ac-8f7a-6409391a35c4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:12.827237 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4089/8212] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:12 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:12.831487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118f6c0-205a-4dbc-a668-1a53d414fa02 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:12.858969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118f6c0-205a-4dbc-a668-1a53d414fa02 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:13.121536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c17b0-434b-4002-99eb-e6d29c6eb768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:13.122853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c17b0-434b-4002-99eb-e6d29c6eb768 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:13.122853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c17b0-434b-4002-99eb-e6d29c6eb768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:13.124791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c17b0-434b-4002-99eb-e6d29c6eb768 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:13.125877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c17b0-434b-4002-99eb-e6d29c6eb768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:13.130011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c17b0-434b-4002-99eb-e6d29c6eb768 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:13.180316 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4124/8213] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:12 2022] POST /identity/v3/users => generated 291 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:13.181187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61d3de-2eb1-47ac-8f7a-6409391a35c4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:13.198329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61d3de-2eb1-47ac-8f7a-6409391a35c4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:13.219480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9187c-76c4-4e1b-a05a-4ecfc992c868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:13.220412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9187c-76c4-4e1b-a05a-4ecfc992c868 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:13.220412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9187c-76c4-4e1b-a05a-4ecfc992c868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:13.220615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9187c-76c4-4e1b-a05a-4ecfc992c868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:13.221216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9187c-76c4-4e1b-a05a-4ecfc992c868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:13.222871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9187c-76c4-4e1b-a05a-4ecfc992c868 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:13.244917 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4090/8214] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:13.246355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c17b0-434b-4002-99eb-e6d29c6eb768 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:13.262871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c17b0-434b-4002-99eb-e6d29c6eb768 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:13.273082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dd061-64ef-4a1e-9c57-e6c0d423b7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:13.274282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dd061-64ef-4a1e-9c57-e6c0d423b7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:13.274567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dd061-64ef-4a1e-9c57-e6c0d423b7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:13.274883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dd061-64ef-4a1e-9c57-e6c0d423b7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:13.275538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3dd061-64ef-4a1e-9c57-e6c0d423b7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:13.277188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3dd061-64ef-4a1e-9c57-e6c0d423b7d4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:13.288144 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4125/8215] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:13.296193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9187c-76c4-4e1b-a05a-4ecfc992c868 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:13.340944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9187c-76c4-4e1b-a05a-4ecfc992c868 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:13.387466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00b856-55af-446b-a7ba-34cad38c2345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:13.388310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00b856-55af-446b-a7ba-34cad38c2345 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:13.388602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00b856-55af-446b-a7ba-34cad38c2345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:13.391588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00b856-55af-446b-a7ba-34cad38c2345 admin admin] PATH_INFO: `/v3/projects/68fe8dc752ba40ff818daacfcb36c160/users/732e7dbd5016411d99455682fa6f3444/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:13.451788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00b856-55af-446b-a7ba-34cad38c2345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fe8dc752ba40ff818daacfcb36c160, user_id=732e7dbd5016411d99455682fa6f3444, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:13.455238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00b856-55af-446b-a7ba-34cad38c2345 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:13.477360 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:13.483123 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4091/8216] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:13 2022] PUT /identity/v3/projects/68fe8dc752ba40ff818daacfcb36c160/users/732e7dbd5016411d99455682fa6f3444/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:13.494938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad097d-61e8-4be3-9ce7-1f8a228fae69 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:13.495651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad097d-61e8-4be3-9ce7-1f8a228fae69 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:13.496272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad097d-61e8-4be3-9ce7-1f8a228fae69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:13.558413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b2ad097d-61e8-4be3-9ce7-1f8a228fae69 None None] MFA Rules not processed for user `732e7dbd5016411d99455682fa6f3444`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:13.560107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b2ad097d-61e8-4be3-9ce7-1f8a228fae69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:13.568604 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:13.733264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beedf2-a1fb-4523-811e-cfee7ecd0467 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:13.736837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beedf2-a1fb-4523-811e-cfee7ecd0467 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:13.737134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beedf2-a1fb-4523-811e-cfee7ecd0467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:13.744035 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4126/8217] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:13.744914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad097d-61e8-4be3-9ce7-1f8a228fae69 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:13.813210 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-55beedf2-a1fb-4523-811e-cfee7ecd0467 None None] MFA Rules not processed for user `6a1352ee9dbe4587800e17d8b3287252`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:13.821416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-55beedf2-a1fb-4523-811e-cfee7ecd0467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:13.844811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad097d-61e8-4be3-9ce7-1f8a228fae69 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:13.862461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae47d44-2a93-4d03-8a56-e09e1ad188f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:13.863131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae47d44-2a93-4d03-8a56-e09e1ad188f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:13.863411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae47d44-2a93-4d03-8a56-e09e1ad188f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:13.863682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae47d44-2a93-4d03-8a56-e09e1ad188f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:13.866077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae47d44-2a93-4d03-8a56-e09e1ad188f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:13.872921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae47d44-2a93-4d03-8a56-e09e1ad188f3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:13.949529 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4127/8218] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:13 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:13.950346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae47d44-2a93-4d03-8a56-e09e1ad188f3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:14.077714 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4092/8219] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:14.115538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae47d44-2a93-4d03-8a56-e09e1ad188f3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:14.168766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddb5f5-a688-45a6-bb06-6f5cad85aa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:14.169445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddb5f5-a688-45a6-bb06-6f5cad85aa5c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:14.169677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddb5f5-a688-45a6-bb06-6f5cad85aa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:14.169939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddb5f5-a688-45a6-bb06-6f5cad85aa5c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:14.170563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddb5f5-a688-45a6-bb06-6f5cad85aa5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:14.174730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddb5f5-a688-45a6-bb06-6f5cad85aa5c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:14.206915 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4128/8220] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:13 2022] POST /identity/v3/users => generated 298 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:14.208078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beedf2-a1fb-4523-811e-cfee7ecd0467 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:14.229274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beedf2-a1fb-4523-811e-cfee7ecd0467 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:14.265585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465668e-2b10-4d83-b9a1-e3e6e3801f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:14.266235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465668e-2b10-4d83-b9a1-e3e6e3801f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:14.266516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465668e-2b10-4d83-b9a1-e3e6e3801f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:14.266853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465668e-2b10-4d83-b9a1-e3e6e3801f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:14.267489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465668e-2b10-4d83-b9a1-e3e6e3801f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:14.269169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465668e-2b10-4d83-b9a1-e3e6e3801f95 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:14.303878 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4093/8221] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:14.311550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddb5f5-a688-45a6-bb06-6f5cad85aa5c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:14.319933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddb5f5-a688-45a6-bb06-6f5cad85aa5c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:14.334077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdaee5-1673-4aba-bd86-2b097d86fe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:14.335722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdaee5-1673-4aba-bd86-2b097d86fe8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:14.337261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdaee5-1673-4aba-bd86-2b097d86fe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:14.337261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdaee5-1673-4aba-bd86-2b097d86fe8a admin admin] PATH_INFO: `/v3/projects/717eeaee540a4c7fa9cf2e9f8f72de64/users/f88d55e32fa440eeae43affda2e76c73/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:14.377835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdaee5-1673-4aba-bd86-2b097d86fe8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=717eeaee540a4c7fa9cf2e9f8f72de64, user_id=f88d55e32fa440eeae43affda2e76c73, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:14.385789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdaee5-1673-4aba-bd86-2b097d86fe8a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:14.393200 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:14.416096 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4129/8222] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:14 2022] PUT /identity/v3/projects/717eeaee540a4c7fa9cf2e9f8f72de64/users/f88d55e32fa440eeae43affda2e76c73/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:14.420019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465668e-2b10-4d83-b9a1-e3e6e3801f95 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:14.438414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465668e-2b10-4d83-b9a1-e3e6e3801f95 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:14.591324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a58c34-3646-4901-b3be-1c6afb0c1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:14.595974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58c34-3646-4901-b3be-1c6afb0c1e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:14.596261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58c34-3646-4901-b3be-1c6afb0c1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:14.596529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58c34-3646-4901-b3be-1c6afb0c1e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:14.597187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a58c34-3646-4901-b3be-1c6afb0c1e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:14.600550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a58c34-3646-4901-b3be-1c6afb0c1e1a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:14.632382 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4094/8223] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:14.635788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdaee5-1673-4aba-bd86-2b097d86fe8a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:14.661613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdaee5-1673-4aba-bd86-2b097d86fe8a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:14.669893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f48ea-17aa-4aae-acd3-4e4c268678a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:14.670899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f48ea-17aa-4aae-acd3-4e4c268678a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:14.671765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f48ea-17aa-4aae-acd3-4e4c268678a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:14.671938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f48ea-17aa-4aae-acd3-4e4c268678a0 admin admin] PATH_INFO: `/v3/projects/717eeaee540a4c7fa9cf2e9f8f72de64/users/f88d55e32fa440eeae43affda2e76c73/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:14.674263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f48ea-17aa-4aae-acd3-4e4c268678a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717eeaee540a4c7fa9cf2e9f8f72de64, user_id=f88d55e32fa440eeae43affda2e76c73, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:14.677153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f48ea-17aa-4aae-acd3-4e4c268678a0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:14.698902 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4130/8224] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:14 2022] PUT /identity/v3/projects/717eeaee540a4c7fa9cf2e9f8f72de64/users/f88d55e32fa440eeae43affda2e76c73/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:38:14.812745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ea225-5065-4951-878f-f1b21e398a6a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:14.813037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ea225-5065-4951-878f-f1b21e398a6a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:14.814090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ea225-5065-4951-878f-f1b21e398a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:14.850281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-be9ea225-5065-4951-878f-f1b21e398a6a None None] MFA Rules not processed for user `f88d55e32fa440eeae43affda2e76c73`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:14.853003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be9ea225-5065-4951-878f-f1b21e398a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:14.984549 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4095/8225] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:14.994132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f48ea-17aa-4aae-acd3-4e4c268678a0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:14.995872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b88f48ea-17aa-4aae-acd3-4e4c268678a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:15.199693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f48ea-17aa-4aae-acd3-4e4c268678a0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:15.216764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828f68-cd5c-4efb-a3b6-d2ef269fd22b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:15.217432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828f68-cd5c-4efb-a3b6-d2ef269fd22b service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:15.217712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828f68-cd5c-4efb-a3b6-d2ef269fd22b service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:15.217984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828f68-cd5c-4efb-a3b6-d2ef269fd22b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:15.424813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828f68-cd5c-4efb-a3b6-d2ef269fd22b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:15.426406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828f68-cd5c-4efb-a3b6-d2ef269fd22b service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:15.478673 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4131/8226] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:18.335226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ea225-5065-4951-878f-f1b21e398a6a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:18.337254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be9ea225-5065-4951-878f-f1b21e398a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:18.368674 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:18.484305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ea225-5065-4951-878f-f1b21e398a6a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:18.499693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8b6dd-e5d2-4c2b-9c00-4bd07336faa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:18.500504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8b6dd-e5d2-4c2b-9c00-4bd07336faa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:18.500842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8b6dd-e5d2-4c2b-9c00-4bd07336faa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:18.501284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8b6dd-e5d2-4c2b-9c00-4bd07336faa1 admin admin] PATH_INFO: `/v3/users/f6213e486ccd489b9bfe0ea01588d6b7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:18.503407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8b6dd-e5d2-4c2b-9c00-4bd07336faa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6213e486ccd489b9bfe0ea01588d6b7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:18.505544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8b6dd-e5d2-4c2b-9c00-4bd07336faa1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:18.550373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828f68-cd5c-4efb-a3b6-d2ef269fd22b service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:18.557834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4b828f68-cd5c-4efb-a3b6-d2ef269fd22b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:18.604279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828f68-cd5c-4efb-a3b6-d2ef269fd22b service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:18.619388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0852caf-6b26-4065-895f-3db6357c2f8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:18.619984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0852caf-6b26-4065-895f-3db6357c2f8e service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:18.620301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0852caf-6b26-4065-895f-3db6357c2f8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:18.620578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0852caf-6b26-4065-895f-3db6357c2f8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:18.649426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11e8b6dd-e5d2-4c2b-9c00-4bd07336faa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6213e486ccd489b9bfe0ea01588d6b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:18.672958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11e8b6dd-e5d2-4c2b-9c00-4bd07336faa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6213e486ccd489b9bfe0ea01588d6b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:18.675483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11e8b6dd-e5d2-4c2b-9c00-4bd07336faa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6213e486ccd489b9bfe0ea01588d6b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:18.698003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11e8b6dd-e5d2-4c2b-9c00-4bd07336faa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6213e486ccd489b9bfe0ea01588d6b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:18.708046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-11e8b6dd-e5d2-4c2b-9c00-4bd07336faa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6213e486ccd489b9bfe0ea01588d6b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:18.724014 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4096/8227] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:18 2022] DELETE /identity/v3/users/f6213e486ccd489b9bfe0ea01588d6b7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:18.729338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae95db-c8b5-4d80-80e0-2fb819ffe47f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:18.729906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae95db-c8b5-4d80-80e0-2fb819ffe47f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:18.730581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae95db-c8b5-4d80-80e0-2fb819ffe47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:18.761058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-45ae95db-c8b5-4d80-80e0-2fb819ffe47f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:18.762677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45ae95db-c8b5-4d80-80e0-2fb819ffe47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:18.773256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0852caf-6b26-4065-895f-3db6357c2f8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:18.776442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0852caf-6b26-4065-895f-3db6357c2f8e service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:18.796890 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4132/8228] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:18.838302 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4097/8229] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:18.868102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0852caf-6b26-4065-895f-3db6357c2f8e service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:18.870223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f0852caf-6b26-4065-895f-3db6357c2f8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:18.982145 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:19.058943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0852caf-6b26-4065-895f-3db6357c2f8e service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:19.201600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbcdbe-e897-4b73-97bb-f4b9087f4350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:19.202317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbcdbe-e897-4b73-97bb-f4b9087f4350 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:19.203203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbcdbe-e897-4b73-97bb-f4b9087f4350 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:19.204285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbcdbe-e897-4b73-97bb-f4b9087f4350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:19.227687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbcdbe-e897-4b73-97bb-f4b9087f4350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:19.229619 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbcdbe-e897-4b73-97bb-f4b9087f4350 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:19.246925 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4133/8230] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:38:19.855821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae95db-c8b5-4d80-80e0-2fb819ffe47f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:19.857256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45ae95db-c8b5-4d80-80e0-2fb819ffe47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:19.874576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae95db-c8b5-4d80-80e0-2fb819ffe47f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:19.884068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:19.884927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:19.885869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:19.886330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] PATH_INFO: `/v3/projects/37a270336a82421988da7e54f242d31c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:19.888437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a270336a82421988da7e54f242d31c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:19.896274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:19.939784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbcdbe-e897-4b73-97bb-f4b9087f4350 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:19.943325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5abbcdbe-e897-4b73-97bb-f4b9087f4350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:20.034925 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:20.087536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a270336a82421988da7e54f242d31c', 'request_id': 'req-2af234ac-b8e9-4806-a7b8-962f7ef50b83'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:20.097519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbcdbe-e897-4b73-97bb-f4b9087f4350 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:20.100167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a270336a82421988da7e54f242d31c', 'request_id': 'req-2af234ac-b8e9-4806-a7b8-962f7ef50b83'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:20.120868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a270336a82421988da7e54f242d31c', 'request_id': 'req-2af234ac-b8e9-4806-a7b8-962f7ef50b83'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:20.153447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] The token cache is being invalidate because project 37a270336a82421988da7e54f242d31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:20.153797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:20.154799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:20.156783 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4098/8231] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:19 2022] DELETE /identity/v3/projects/37a270336a82421988da7e54f242d31c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:20.161478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:20.163293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:20.196729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d8496-8256-4400-bdff-0bcca51c462d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:20.199338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d8496-8256-4400-bdff-0bcca51c462d service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:20.199627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d8496-8256-4400-bdff-0bcca51c462d service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:20.201720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d8496-8256-4400-bdff-0bcca51c462d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:20.207274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4c2d8496-8256-4400-bdff-0bcca51c462d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:20.274688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af234ac-b8e9-4806-a7b8-962f7ef50b83 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:20.282636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee524c25-6285-4d3b-9893-08818299beb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:20.283833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524c25-6285-4d3b-9893-08818299beb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:20.284660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524c25-6285-4d3b-9893-08818299beb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:20.285147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524c25-6285-4d3b-9893-08818299beb1 admin admin] PATH_INFO: `/v3/users/a3d482cc44574ad6ae304e22e275e5a2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:20.288550 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee524c25-6285-4d3b-9893-08818299beb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d482cc44574ad6ae304e22e275e5a2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:20.292204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee524c25-6285-4d3b-9893-08818299beb1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:20.352899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d8496-8256-4400-bdff-0bcca51c462d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:20.354179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d8496-8256-4400-bdff-0bcca51c462d service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:20.360484 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:20.363194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee524c25-6285-4d3b-9893-08818299beb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d482cc44574ad6ae304e22e275e5a2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:20.366397 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4134/8232] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:38:20.381956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee524c25-6285-4d3b-9893-08818299beb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d482cc44574ad6ae304e22e275e5a2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:20.383904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee524c25-6285-4d3b-9893-08818299beb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d482cc44574ad6ae304e22e275e5a2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:20.399178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee524c25-6285-4d3b-9893-08818299beb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d482cc44574ad6ae304e22e275e5a2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:20.411698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ee524c25-6285-4d3b-9893-08818299beb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d482cc44574ad6ae304e22e275e5a2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:20.424196 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4099/8233] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:20 2022] DELETE /identity/v3/users/a3d482cc44574ad6ae304e22e275e5a2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:38:20.908774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d8496-8256-4400-bdff-0bcca51c462d service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:20.988308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d8496-8256-4400-bdff-0bcca51c462d service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:21.096961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:21.097631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:21.097912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:21.098251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] PATH_INFO: `/v3/projects/f9e72cb1f23d471eb2ae6a1e1fcf3be2` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:21.110585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e72cb1f23d471eb2ae6a1e1fcf3be2)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:21.112881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:21.209072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e72cb1f23d471eb2ae6a1e1fcf3be2', 'request_id': 'req-63726835-8259-4c80-b11a-855f05301e11'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:21.225313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e72cb1f23d471eb2ae6a1e1fcf3be2', 'request_id': 'req-63726835-8259-4c80-b11a-855f05301e11'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:21.234225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e72cb1f23d471eb2ae6a1e1fcf3be2', 'request_id': 'req-63726835-8259-4c80-b11a-855f05301e11'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:21.259187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] The token cache is being invalidate because project f9e72cb1f23d471eb2ae6a1e1fcf3be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:21.259596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:21.260386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-63726835-8259-4c80-b11a-855f05301e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:21.262402 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4135/8234] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:20 2022] DELETE /identity/v3/projects/f9e72cb1f23d471eb2ae6a1e1fcf3be2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:21.267837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b3382-b61a-42ad-ba5a-b8c4269a3d03 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:21.269355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b3382-b61a-42ad-ba5a-b8c4269a3d03 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:21.269866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b3382-b61a-42ad-ba5a-b8c4269a3d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:21.307484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f27b3382-b61a-42ad-ba5a-b8c4269a3d03 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:21.309173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f27b3382-b61a-42ad-ba5a-b8c4269a3d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:21.371280 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:21.426506 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4100/8235] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:21.427768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0bd20-9af1-4cee-bf9e-7ffa6a270681 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:21.428052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0bd20-9af1-4cee-bf9e-7ffa6a270681 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:21.428329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0bd20-9af1-4cee-bf9e-7ffa6a270681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:21.472504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9ef0bd20-9af1-4cee-bf9e-7ffa6a270681 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:21.474081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9ef0bd20-9af1-4cee-bf9e-7ffa6a270681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:21.485007 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4136/8236] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:21.489105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b3382-b61a-42ad-ba5a-b8c4269a3d03 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:21.515825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b3382-b61a-42ad-ba5a-b8c4269a3d03 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:21.529389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f00e91-1f1b-4e82-b1af-3d73b071b369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:21.530024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f00e91-1f1b-4e82-b1af-3d73b071b369 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:21.530313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f00e91-1f1b-4e82-b1af-3d73b071b369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:21.530593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f00e91-1f1b-4e82-b1af-3d73b071b369 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:21.531286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f00e91-1f1b-4e82-b1af-3d73b071b369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:38:21.531600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f00e91-1f1b-4e82-b1af-3d73b071b369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:21.533226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f00e91-1f1b-4e82-b1af-3d73b071b369 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:21.550306 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4101/8237] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:38:21.550986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0bd20-9af1-4cee-bf9e-7ffa6a270681 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:21.565191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0bd20-9af1-4cee-bf9e-7ffa6a270681 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:21.576742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4f4c2-0962-46f6-820a-ad27f5fe3090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:21.577364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4f4c2-0962-46f6-820a-ad27f5fe3090 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:21.577642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4f4c2-0962-46f6-820a-ad27f5fe3090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:21.577912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4f4c2-0962-46f6-820a-ad27f5fe3090 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:21.579255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4f4c2-0962-46f6-820a-ad27f5fe3090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:21.581183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4f4c2-0962-46f6-820a-ad27f5fe3090 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:21.686075 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4137/8238] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:21 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:38:21.687678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f00e91-1f1b-4e82-b1af-3d73b071b369 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:21.703075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f00e91-1f1b-4e82-b1af-3d73b071b369 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:21.872973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154c27b-a9f1-4db4-9f7d-28169eca5883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:21.873593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c27b-a9f1-4db4-9f7d-28169eca5883 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:21.873871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c27b-a9f1-4db4-9f7d-28169eca5883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:21.874142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c27b-a9f1-4db4-9f7d-28169eca5883 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:21.875056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154c27b-a9f1-4db4-9f7d-28169eca5883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:21.877010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154c27b-a9f1-4db4-9f7d-28169eca5883 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:21.922103 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4102/8239] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:21 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:38:21.926156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4f4c2-0962-46f6-820a-ad27f5fe3090 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:22.021022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4f4c2-0962-46f6-820a-ad27f5fe3090 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:22.028581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74baf38-2d03-4976-929c-062291c1aa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:22.029598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74baf38-2d03-4976-929c-062291c1aa84 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:22.030074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74baf38-2d03-4976-929c-062291c1aa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:22.030631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74baf38-2d03-4976-929c-062291c1aa84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:22.031429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74baf38-2d03-4976-929c-062291c1aa84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:22.033239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74baf38-2d03-4976-929c-062291c1aa84 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:22.047527 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4138/8240] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:22.051352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154c27b-a9f1-4db4-9f7d-28169eca5883 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:22.096442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154c27b-a9f1-4db4-9f7d-28169eca5883 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:22.102900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367ac9b-a8a9-478c-8194-bfb0e0737da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:22.103804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367ac9b-a8a9-478c-8194-bfb0e0737da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:22.104236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367ac9b-a8a9-478c-8194-bfb0e0737da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:22.104902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367ac9b-a8a9-478c-8194-bfb0e0737da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:22.105736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367ac9b-a8a9-478c-8194-bfb0e0737da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:22.107562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367ac9b-a8a9-478c-8194-bfb0e0737da8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:22.122375 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4103/8241] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:22.126350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74baf38-2d03-4976-929c-062291c1aa84 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:22.143644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74baf38-2d03-4976-929c-062291c1aa84 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:22.148992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba756b-6a12-4cb9-b72e-dc4bc0a8ddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:22.149589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba756b-6a12-4cb9-b72e-dc4bc0a8ddbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:22.149867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba756b-6a12-4cb9-b72e-dc4bc0a8ddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:22.150579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba756b-6a12-4cb9-b72e-dc4bc0a8ddbb admin admin] PATH_INFO: `/v3/projects/aa498e0dc09d4397a90115ad3968789e/users/9111199454e342b8bf28e7bc70987435/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:22.171235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba756b-6a12-4cb9-b72e-dc4bc0a8ddbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa498e0dc09d4397a90115ad3968789e, user_id=9111199454e342b8bf28e7bc70987435, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:22.175083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba756b-6a12-4cb9-b72e-dc4bc0a8ddbb admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:22.201191 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4139/8242] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:22 2022] PUT /identity/v3/projects/aa498e0dc09d4397a90115ad3968789e/users/9111199454e342b8bf28e7bc70987435/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:22.212630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba5e9c-4729-4767-9bfe-761271a3ea22 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:22.212928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba5e9c-4729-4767-9bfe-761271a3ea22 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:22.213197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba5e9c-4729-4767-9bfe-761271a3ea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:22.247763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-47ba5e9c-4729-4767-9bfe-761271a3ea22 None None] MFA Rules not processed for user `9111199454e342b8bf28e7bc70987435`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:22.248987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-47ba5e9c-4729-4767-9bfe-761271a3ea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:22.371705 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:22.386385 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4104/8243] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:22.388066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba756b-6a12-4cb9-b72e-dc4bc0a8ddbb admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:22.394658 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:22.559812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba756b-6a12-4cb9-b72e-dc4bc0a8ddbb admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:22.577787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecfb61-015f-477b-9421-1f0151c2e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:22.578828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecfb61-015f-477b-9421-1f0151c2e061 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:22.579050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecfb61-015f-477b-9421-1f0151c2e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:22.579322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecfb61-015f-477b-9421-1f0151c2e061 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:22.580212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecfb61-015f-477b-9421-1f0151c2e061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:22.581894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecfb61-015f-477b-9421-1f0151c2e061 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:22.674046 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4140/8244] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:22 2022] POST /identity/v3/projects => generated 383 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:22.677205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba5e9c-4729-4767-9bfe-761271a3ea22 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:22.692788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba5e9c-4729-4767-9bfe-761271a3ea22 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:22.893843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fd6a3-1cfa-42e1-a245-4e673b382ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:22.894467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fd6a3-1cfa-42e1-a245-4e673b382ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:22.894774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fd6a3-1cfa-42e1-a245-4e673b382ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:22.895046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fd6a3-1cfa-42e1-a245-4e673b382ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:22.895681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fd6a3-1cfa-42e1-a245-4e673b382ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:22.901081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fd6a3-1cfa-42e1-a245-4e673b382ff2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:22.987014 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4105/8245] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:22 2022] POST /identity/v3/users => generated 298 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:22.988247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecfb61-015f-477b-9421-1f0151c2e061 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:23.006205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecfb61-015f-477b-9421-1f0151c2e061 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:23.021839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf41ad3-90ed-4285-9ec5-67bd1eb7b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:23.027644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41ad3-90ed-4285-9ec5-67bd1eb7b776 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:23.028307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41ad3-90ed-4285-9ec5-67bd1eb7b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:23.029204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41ad3-90ed-4285-9ec5-67bd1eb7b776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:23.033090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf41ad3-90ed-4285-9ec5-67bd1eb7b776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:23.035395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf41ad3-90ed-4285-9ec5-67bd1eb7b776 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:23.067592 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4141/8246] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:23.068829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fd6a3-1cfa-42e1-a245-4e673b382ff2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:23.084315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fd6a3-1cfa-42e1-a245-4e673b382ff2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:23.108794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec29adc-0689-4f36-9718-d55166ac2d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:23.109670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec29adc-0689-4f36-9718-d55166ac2d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:23.109962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec29adc-0689-4f36-9718-d55166ac2d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:23.110617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec29adc-0689-4f36-9718-d55166ac2d77 admin admin] PATH_INFO: `/v3/projects/4f096b1ee55a485182b50f0c5d22f4a3/users/a2ddf9a0fea3426c81dee6286106761f/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:23.160129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec29adc-0689-4f36-9718-d55166ac2d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f096b1ee55a485182b50f0c5d22f4a3, user_id=a2ddf9a0fea3426c81dee6286106761f, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:23.164687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec29adc-0689-4f36-9718-d55166ac2d77 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:23.197033 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4106/8247] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:23 2022] PUT /identity/v3/projects/4f096b1ee55a485182b50f0c5d22f4a3/users/a2ddf9a0fea3426c81dee6286106761f/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:23.200981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf41ad3-90ed-4285-9ec5-67bd1eb7b776 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:23.216964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf41ad3-90ed-4285-9ec5-67bd1eb7b776 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:23.344931 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007223c8-5b8d-44aa-9fb9-965705dea8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:23.345576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007223c8-5b8d-44aa-9fb9-965705dea8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:23.345862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007223c8-5b8d-44aa-9fb9-965705dea8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:23.346132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007223c8-5b8d-44aa-9fb9-965705dea8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:23.346966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007223c8-5b8d-44aa-9fb9-965705dea8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:23.348581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007223c8-5b8d-44aa-9fb9-965705dea8b9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:23.376215 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4142/8248] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:23.380059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec29adc-0689-4f36-9718-d55166ac2d77 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:23.395380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec29adc-0689-4f36-9718-d55166ac2d77 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:23.403721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c010b7-b843-473f-8493-41116b560261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:23.404525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c010b7-b843-473f-8493-41116b560261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:23.404956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c010b7-b843-473f-8493-41116b560261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:23.405323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c010b7-b843-473f-8493-41116b560261 admin admin] PATH_INFO: `/v3/projects/4f096b1ee55a485182b50f0c5d22f4a3/users/a2ddf9a0fea3426c81dee6286106761f/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:23.414897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c010b7-b843-473f-8493-41116b560261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f096b1ee55a485182b50f0c5d22f4a3, user_id=a2ddf9a0fea3426c81dee6286106761f, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:23.419489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c010b7-b843-473f-8493-41116b560261 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:23.452877 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4107/8249] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:23 2022] PUT /identity/v3/projects/4f096b1ee55a485182b50f0c5d22f4a3/users/a2ddf9a0fea3426c81dee6286106761f/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:23.453423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dea0e4-74bf-4fc0-a554-e3a256c81a43 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:23.453722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dea0e4-74bf-4fc0-a554-e3a256c81a43 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:23.454002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dea0e4-74bf-4fc0-a554-e3a256c81a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:23.497721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-26dea0e4-74bf-4fc0-a554-e3a256c81a43 None None] MFA Rules not processed for user `a2ddf9a0fea3426c81dee6286106761f`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:23.499170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-26dea0e4-74bf-4fc0-a554-e3a256c81a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:23.587412 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:23.594487 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4143/8250] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:23.606850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c010b7-b843-473f-8493-41116b560261 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:23.608751 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-02c010b7-b843-473f-8493-41116b560261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:23.718063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c010b7-b843-473f-8493-41116b560261 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:23.722416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348aa8-71d2-4f46-9774-a6f446720ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:23.723093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348aa8-71d2-4f46-9774-a6f446720ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:23.723379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348aa8-71d2-4f46-9774-a6f446720ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:23.723662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348aa8-71d2-4f46-9774-a6f446720ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:23.791425 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:23.815894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90348aa8-71d2-4f46-9774-a6f446720ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:23.817661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90348aa8-71d2-4f46-9774-a6f446720ad6 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:23.841168 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4108/8251] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:30.211420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dea0e4-74bf-4fc0-a554-e3a256c81a43 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:30.230554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dea0e4-74bf-4fc0-a554-e3a256c81a43 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:30.235080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad40b2-2d1a-46c3-9b55-efcf1f57f007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:30.235713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad40b2-2d1a-46c3-9b55-efcf1f57f007 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:30.236042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad40b2-2d1a-46c3-9b55-efcf1f57f007 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:30.236327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad40b2-2d1a-46c3-9b55-efcf1f57f007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:30.253255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad40b2-2d1a-46c3-9b55-efcf1f57f007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:30.254765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad40b2-2d1a-46c3-9b55-efcf1f57f007 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:30.266162 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4144/8252] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:38:31.056770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348aa8-71d2-4f46-9774-a6f446720ad6 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:31.058892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-90348aa8-71d2-4f46-9774-a6f446720ad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:31.246070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348aa8-71d2-4f46-9774-a6f446720ad6 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:31.250914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:31.251565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:31.251846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:31.252123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] PATH_INFO: `/v3/users/493d18efe4874f7590530d70ba2173a9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:31.253277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=493d18efe4874f7590530d70ba2173a9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:31.255270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:31.353095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493d18efe4874f7590530d70ba2173a9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:31.383891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493d18efe4874f7590530d70ba2173a9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:31.384883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493d18efe4874f7590530d70ba2173a9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:31.399641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493d18efe4874f7590530d70ba2173a9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:31.411680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493d18efe4874f7590530d70ba2173a9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:31.427641 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4109/8253] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:31 2022] DELETE /identity/v3/users/493d18efe4874f7590530d70ba2173a9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:31.430137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d93294-54bd-436b-a65b-bd17e1ca84d7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:31.431132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d93294-54bd-436b-a65b-bd17e1ca84d7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:31.431590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d93294-54bd-436b-a65b-bd17e1ca84d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:31.470422 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-46d93294-54bd-436b-a65b-bd17e1ca84d7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:31.472596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-46d93294-54bd-436b-a65b-bd17e1ca84d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:31.551481 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4145/8254] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:31.565493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:31.567063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:31.665994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba401eda-c288-49a9-baad-3f006d44f4ef admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:31.670109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e3e62-7811-4b2c-9d67-27b042c2dc5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:31.670994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e3e62-7811-4b2c-9d67-27b042c2dc5a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:31.671399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e3e62-7811-4b2c-9d67-27b042c2dc5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:31.671774 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e3e62-7811-4b2c-9d67-27b042c2dc5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:31.685505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e3e62-7811-4b2c-9d67-27b042c2dc5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:31.687832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e3e62-7811-4b2c-9d67-27b042c2dc5a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:31.720900 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4110/8255] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:32.248534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d93294-54bd-436b-a65b-bd17e1ca84d7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:32.250377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-46d93294-54bd-436b-a65b-bd17e1ca84d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:32.289657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d93294-54bd-436b-a65b-bd17e1ca84d7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:32.297173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:32.298820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:32.299100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:32.299374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] PATH_INFO: `/v3/projects/ddb8840c1db54d0db72e3fd002aa52dc` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:32.301646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb8840c1db54d0db72e3fd002aa52dc)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:32.307963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:32.439666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb8840c1db54d0db72e3fd002aa52dc', 'request_id': 'req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:32.453999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb8840c1db54d0db72e3fd002aa52dc', 'request_id': 'req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:32.467516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb8840c1db54d0db72e3fd002aa52dc', 'request_id': 'req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:32.490116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] The token cache is being invalidate because project ddb8840c1db54d0db72e3fd002aa52dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:32.490409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:32.496927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:32.498552 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4146/8256] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:32 2022] DELETE /identity/v3/projects/ddb8840c1db54d0db72e3fd002aa52dc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:32.503093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e3e62-7811-4b2c-9d67-27b042c2dc5a service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:32.513767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e3e62-7811-4b2c-9d67-27b042c2dc5a service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:32.531751 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:32.620107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:32.621356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:32.621977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:32.622426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] PATH_INFO: `/v3/users/732e7dbd5016411d99455682fa6f3444` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:32.624094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=732e7dbd5016411d99455682fa6f3444)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:32.627618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:32.703078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732e7dbd5016411d99455682fa6f3444'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:32.721134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732e7dbd5016411d99455682fa6f3444'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:32.721967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732e7dbd5016411d99455682fa6f3444'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:32.731481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732e7dbd5016411d99455682fa6f3444'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:32.745666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732e7dbd5016411d99455682fa6f3444'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:32.754240 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4111/8257] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:32 2022] DELETE /identity/v3/users/732e7dbd5016411d99455682fa6f3444 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:33.119948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:33.121802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:33.150504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefdad9-ea79-44a4-90d1-015ebdc09c9e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:33.251698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:33.252241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:33.252517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:33.252789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] PATH_INFO: `/v3/projects/68fe8dc752ba40ff818daacfcb36c160` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:33.262576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fe8dc752ba40ff818daacfcb36c160)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:33.266069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:33.292893 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:33.379118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fe8dc752ba40ff818daacfcb36c160', 'request_id': 'req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:33.391505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fe8dc752ba40ff818daacfcb36c160', 'request_id': 'req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:33.401490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fe8dc752ba40ff818daacfcb36c160', 'request_id': 'req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:33.429955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] The token cache is being invalidate because project 68fe8dc752ba40ff818daacfcb36c160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:33.430250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:33.431315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:33.432943 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4147/8258] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:33 2022] DELETE /identity/v3/projects/68fe8dc752ba40ff818daacfcb36c160 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:33.437295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:33.438962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:33.465964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfca60-9009-42e5-ae0f-bbea4250a9a8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:33.570843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:33.572207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:33.572673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:33.573112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] PATH_INFO: `/v3/users/f88d55e32fa440eeae43affda2e76c73` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:33.574936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88d55e32fa440eeae43affda2e76c73)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:33.577522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:33.640162 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:33.656338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88d55e32fa440eeae43affda2e76c73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:33.671930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88d55e32fa440eeae43affda2e76c73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:33.672702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88d55e32fa440eeae43affda2e76c73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:33.682132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88d55e32fa440eeae43affda2e76c73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:33.692104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88d55e32fa440eeae43affda2e76c73'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:33.699625 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4112/8259] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:33 2022] DELETE /identity/v3/users/f88d55e32fa440eeae43affda2e76c73 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:34.170464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:34.172665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:34.197430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b17d-c39d-4d5c-a8b4-cf3bde8b86ef admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:34.292130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:34.292768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:34.293045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:34.293336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] PATH_INFO: `/v3/projects/717eeaee540a4c7fa9cf2e9f8f72de64` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:34.294767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=717eeaee540a4c7fa9cf2e9f8f72de64)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:34.296756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:34.363377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717eeaee540a4c7fa9cf2e9f8f72de64', 'request_id': 'req-aa762a67-dd41-4254-9521-aaf8d779e2df'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:34.373506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717eeaee540a4c7fa9cf2e9f8f72de64', 'request_id': 'req-aa762a67-dd41-4254-9521-aaf8d779e2df'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:34.407762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717eeaee540a4c7fa9cf2e9f8f72de64', 'request_id': 'req-aa762a67-dd41-4254-9521-aaf8d779e2df'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:34.419313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:34.421167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:34.456839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3361aa-07ab-49cb-90ea-fe6232739248 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:34.457551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] The token cache is being invalidate because project 717eeaee540a4c7fa9cf2e9f8f72de64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:34.457890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:34.459045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-aa762a67-dd41-4254-9521-aaf8d779e2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:34.462949 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4148/8260] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:34 2022] DELETE /identity/v3/projects/717eeaee540a4c7fa9cf2e9f8f72de64 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:34.467655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4159276-24c1-4968-8ac6-eadcb5c93fba None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:34.468004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4159276-24c1-4968-8ac6-eadcb5c93fba None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:34.469052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4159276-24c1-4968-8ac6-eadcb5c93fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:34.562328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e4159276-24c1-4968-8ac6-eadcb5c93fba None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:34.567602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e4159276-24c1-4968-8ac6-eadcb5c93fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:34.627540 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:34.665541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbbdde-d95f-4527-a9e0-cf9ac130c667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:34.666467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbbdde-d95f-4527-a9e0-cf9ac130c667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:34.666923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbbdde-d95f-4527-a9e0-cf9ac130c667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:34.667338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbbdde-d95f-4527-a9e0-cf9ac130c667 admin admin] PATH_INFO: `/v3/users/2d1fa5d07d1e4401873aa27cab0446e8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:34.668710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbbdde-d95f-4527-a9e0-cf9ac130c667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1fa5d07d1e4401873aa27cab0446e8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:34.674028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbbdde-d95f-4527-a9e0-cf9ac130c667 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:34.783633 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4149/8261] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:34.784979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eece4-1ce7-4e69-8e91-ed6dd0a7acf2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:34.785264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eece4-1ce7-4e69-8e91-ed6dd0a7acf2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:34.785542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eece4-1ce7-4e69-8e91-ed6dd0a7acf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:34.785757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c2dbbdde-d95f-4527-a9e0-cf9ac130c667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1fa5d07d1e4401873aa27cab0446e8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:34.814792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c2dbbdde-d95f-4527-a9e0-cf9ac130c667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1fa5d07d1e4401873aa27cab0446e8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:34.815776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c2dbbdde-d95f-4527-a9e0-cf9ac130c667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1fa5d07d1e4401873aa27cab0446e8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:34.827792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c2dbbdde-d95f-4527-a9e0-cf9ac130c667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1fa5d07d1e4401873aa27cab0446e8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:34.858027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c2dbbdde-d95f-4527-a9e0-cf9ac130c667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1fa5d07d1e4401873aa27cab0446e8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:34.858269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f98eece4-1ce7-4e69-8e91-ed6dd0a7acf2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:34.870286 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f98eece4-1ce7-4e69-8e91-ed6dd0a7acf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:34.872580 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4113/8262] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:34 2022] DELETE /identity/v3/users/2d1fa5d07d1e4401873aa27cab0446e8 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:34.874139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400db41-6a1a-417e-9c2d-ee976b7d7ae3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:34.874378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400db41-6a1a-417e-9c2d-ee976b7d7ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:34.874613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400db41-6a1a-417e-9c2d-ee976b7d7ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:34.927216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3400db41-6a1a-417e-9c2d-ee976b7d7ae3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:34.931086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3400db41-6a1a-417e-9c2d-ee976b7d7ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:34.962997 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4150/8263] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:34.963965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98eece4-1ce7-4e69-8e91-ed6dd0a7acf2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:34.982389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98eece4-1ce7-4e69-8e91-ed6dd0a7acf2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:34.990147 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:34.998629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584663-dc05-4274-917c-8fce551f3144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:34.999275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584663-dc05-4274-917c-8fce551f3144 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:34.999722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584663-dc05-4274-917c-8fce551f3144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:34.999992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584663-dc05-4274-917c-8fce551f3144 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:35.002929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1584663-dc05-4274-917c-8fce551f3144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:38:35.003800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1584663-dc05-4274-917c-8fce551f3144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:35.008574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1584663-dc05-4274-917c-8fce551f3144 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:35.036819 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4151/8264] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:38:35.037884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584663-dc05-4274-917c-8fce551f3144 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:35.057173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584663-dc05-4274-917c-8fce551f3144 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:35.064814 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4114/8265] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:35.071179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f600f8-8c13-4fc8-82b0-faddb305b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:35.072053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f600f8-8c13-4fc8-82b0-faddb305b759 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:35.072432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f600f8-8c13-4fc8-82b0-faddb305b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:35.072893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f600f8-8c13-4fc8-82b0-faddb305b759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:35.073728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f600f8-8c13-4fc8-82b0-faddb305b759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:35.075970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400db41-6a1a-417e-9c2d-ee976b7d7ae3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:35.077669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3400db41-6a1a-417e-9c2d-ee976b7d7ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:35.082545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f600f8-8c13-4fc8-82b0-faddb305b759 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:35.149212 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4152/8266] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:35 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:35.150138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f600f8-8c13-4fc8-82b0-faddb305b759 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:35.196679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400db41-6a1a-417e-9c2d-ee976b7d7ae3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:35.250805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f600f8-8c13-4fc8-82b0-faddb305b759 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:35.257957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cba7e-31e9-41ea-931f-9af040ac53d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:35.258900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cba7e-31e9-41ea-931f-9af040ac53d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:35.259960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cba7e-31e9-41ea-931f-9af040ac53d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:35.260338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cba7e-31e9-41ea-931f-9af040ac53d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:35.261130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cba7e-31e9-41ea-931f-9af040ac53d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:35.264308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cba7e-31e9-41ea-931f-9af040ac53d4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:35.277639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc741d9a-63ad-4fc9-97b9-191186b6f054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:35.278487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc741d9a-63ad-4fc9-97b9-191186b6f054 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:35.278904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc741d9a-63ad-4fc9-97b9-191186b6f054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:35.279183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc741d9a-63ad-4fc9-97b9-191186b6f054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:35.294388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc741d9a-63ad-4fc9-97b9-191186b6f054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:35.295974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc741d9a-63ad-4fc9-97b9-191186b6f054 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:35.302297 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4153/8267] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:35 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:35.303748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cba7e-31e9-41ea-931f-9af040ac53d4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:35.306893 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4115/8268] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:35.315569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cba7e-31e9-41ea-931f-9af040ac53d4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:35.337682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0507a-93ad-46e7-861a-0d55cdd0742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:35.338327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0507a-93ad-46e7-861a-0d55cdd0742e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:35.338665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0507a-93ad-46e7-861a-0d55cdd0742e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:35.338925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0507a-93ad-46e7-861a-0d55cdd0742e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:35.339582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0507a-93ad-46e7-861a-0d55cdd0742e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:35.341195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0507a-93ad-46e7-861a-0d55cdd0742e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:35.372453 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4154/8269] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:35.372857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc741d9a-63ad-4fc9-97b9-191186b6f054 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:35.386010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc741d9a-63ad-4fc9-97b9-191186b6f054 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:35.391873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a8d2f-4001-4caf-a6f6-75ac9ad20a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:35.392697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8d2f-4001-4caf-a6f6-75ac9ad20a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:35.393056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8d2f-4001-4caf-a6f6-75ac9ad20a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:35.393408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8d2f-4001-4caf-a6f6-75ac9ad20a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:35.394395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a8d2f-4001-4caf-a6f6-75ac9ad20a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:35.396719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a8d2f-4001-4caf-a6f6-75ac9ad20a12 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:35.415790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0507a-93ad-46e7-861a-0d55cdd0742e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:35.423227 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4116/8270] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:38:35.427733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0507a-93ad-46e7-861a-0d55cdd0742e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:35.437270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ce77-b1c8-4318-bc82-81ea48d89ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:35.438860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ce77-b1c8-4318-bc82-81ea48d89ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:35.439259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ce77-b1c8-4318-bc82-81ea48d89ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:35.439693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ce77-b1c8-4318-bc82-81ea48d89ff0 admin admin] PATH_INFO: `/v3/projects/f1c510da44b8420aaefefc62b67f2bec/users/dcf580f97641423a83eef98acc713946/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:35.463329 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:35.471503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ce77-b1c8-4318-bc82-81ea48d89ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c510da44b8420aaefefc62b67f2bec, user_id=dcf580f97641423a83eef98acc713946, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:35.474954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ce77-b1c8-4318-bc82-81ea48d89ff0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:35.510899 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4155/8271] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:35 2022] PUT /identity/v3/projects/f1c510da44b8420aaefefc62b67f2bec/users/dcf580f97641423a83eef98acc713946/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:35.519159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135cad5-fe46-49e5-a9aa-7d129c27a7af None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:35.519750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135cad5-fe46-49e5-a9aa-7d129c27a7af None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:35.521371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135cad5-fe46-49e5-a9aa-7d129c27a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:35.562701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8135cad5-fe46-49e5-a9aa-7d129c27a7af None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:35.566349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8135cad5-fe46-49e5-a9aa-7d129c27a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:35.684801 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4117/8272] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:35.697074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ce77-b1c8-4318-bc82-81ea48d89ff0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:35.701236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5bd7ce77-b1c8-4318-bc82-81ea48d89ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:35.744784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135cad5-fe46-49e5-a9aa-7d129c27a7af None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:35.747762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8135cad5-fe46-49e5-a9aa-7d129c27a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:35.773815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135cad5-fe46-49e5-a9aa-7d129c27a7af None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:35.791192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:35.791192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:35.791192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:35.791192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] PATH_INFO: `/v3/projects/559149cb601548ac9236af1427458015` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:35.791637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559149cb601548ac9236af1427458015)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:35.793267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:35.831880 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:35.896485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ce77-b1c8-4318-bc82-81ea48d89ff0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:35.900169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559149cb601548ac9236af1427458015', 'request_id': 'req-950cdef7-33d6-4e81-8721-8ab28c98d617'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:35.907177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559149cb601548ac9236af1427458015', 'request_id': 'req-950cdef7-33d6-4e81-8721-8ab28c98d617'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:35.917863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559149cb601548ac9236af1427458015', 'request_id': 'req-950cdef7-33d6-4e81-8721-8ab28c98d617'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:35.953675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] The token cache is being invalidate because project 559149cb601548ac9236af1427458015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:35.953977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:35.955771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-950cdef7-33d6-4e81-8721-8ab28c98d617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:35.958034 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4118/8273] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:35 2022] DELETE /identity/v3/projects/559149cb601548ac9236af1427458015 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:35.981728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a5ce-8921-4344-8446-e399aa02c6fd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:35.982017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a5ce-8921-4344-8446-e399aa02c6fd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:35.982296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a5ce-8921-4344-8446-e399aa02c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:36.031828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-00b3a5ce-8921-4344-8446-e399aa02c6fd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:36.032973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-00b3a5ce-8921-4344-8446-e399aa02c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:36.062900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28186fe-2edd-4009-811b-d299bd3718fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:36.063518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28186fe-2edd-4009-811b-d299bd3718fb service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:36.063797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28186fe-2edd-4009-811b-d299bd3718fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:36.064068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28186fe-2edd-4009-811b-d299bd3718fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:36.072890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e28186fe-2edd-4009-811b-d299bd3718fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:36.167972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28186fe-2edd-4009-811b-d299bd3718fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:36.169543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28186fe-2edd-4009-811b-d299bd3718fb service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:36.180923 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4156/8274] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:36.195777 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4119/8275] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:36.203794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f981bc0-6568-46b4-b886-cf85b1b92d04 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:36.204789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f981bc0-6568-46b4-b886-cf85b1b92d04 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:36.205268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f981bc0-6568-46b4-b886-cf85b1b92d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:36.239916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-5f981bc0-6568-46b4-b886-cf85b1b92d04 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:36.242946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5f981bc0-6568-46b4-b886-cf85b1b92d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:36.259836 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4157/8276] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:36.264109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3a5ce-8921-4344-8446-e399aa02c6fd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:36.286195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3a5ce-8921-4344-8446-e399aa02c6fd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:36.318075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d20ab-904b-4fc6-94f0-cef9bbcd0b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:36.318715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d20ab-904b-4fc6-94f0-cef9bbcd0b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:36.320360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d20ab-904b-4fc6-94f0-cef9bbcd0b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:36.320360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d20ab-904b-4fc6-94f0-cef9bbcd0b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:36.320745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d20ab-904b-4fc6-94f0-cef9bbcd0b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:38:36.321054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d20ab-904b-4fc6-94f0-cef9bbcd0b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:36.322737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d20ab-904b-4fc6-94f0-cef9bbcd0b54 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:36.359948 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4120/8277] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:38:36.362231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f981bc0-6568-46b4-b886-cf85b1b92d04 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:36.388681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f981bc0-6568-46b4-b886-cf85b1b92d04 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:36.403439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9a14a-dc28-434e-8da9-595c124b048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:36.404102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9a14a-dc28-434e-8da9-595c124b048c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:36.404413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9a14a-dc28-434e-8da9-595c124b048c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:36.404673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9a14a-dc28-434e-8da9-595c124b048c admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:36.405775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9a14a-dc28-434e-8da9-595c124b048c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:36.407858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9a14a-dc28-434e-8da9-595c124b048c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:36.474193 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4158/8278] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:36 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:36.476298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d20ab-904b-4fc6-94f0-cef9bbcd0b54 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:36.490291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d20ab-904b-4fc6-94f0-cef9bbcd0b54 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:36.574735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ccae6-607d-4e5b-93f6-c0cc9b5fd8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:36.575367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ccae6-607d-4e5b-93f6-c0cc9b5fd8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:36.575654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ccae6-607d-4e5b-93f6-c0cc9b5fd8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:36.575987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ccae6-607d-4e5b-93f6-c0cc9b5fd8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:36.576789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ccae6-607d-4e5b-93f6-c0cc9b5fd8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:36.579117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ccae6-607d-4e5b-93f6-c0cc9b5fd8c4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:36.628688 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4121/8279] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:36 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:38:36.629102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9a14a-dc28-434e-8da9-595c124b048c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:36.648051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9a14a-dc28-434e-8da9-595c124b048c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:36.662179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c85d-7ff3-47b9-b3bb-fdc5cbad1e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:36.663205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c85d-7ff3-47b9-b3bb-fdc5cbad1e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:36.663491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c85d-7ff3-47b9-b3bb-fdc5cbad1e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:36.663764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c85d-7ff3-47b9-b3bb-fdc5cbad1e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:36.664420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c85d-7ff3-47b9-b3bb-fdc5cbad1e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:36.666094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c85d-7ff3-47b9-b3bb-fdc5cbad1e6b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:36.692777 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4159/8280] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:38:36.698752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ccae6-607d-4e5b-93f6-c0cc9b5fd8c4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:36.712033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ccae6-607d-4e5b-93f6-c0cc9b5fd8c4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:36.718853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f775-3869-42ff-a41d-78c4f22e7f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:36.719646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f775-3869-42ff-a41d-78c4f22e7f8e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:36.720068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f775-3869-42ff-a41d-78c4f22e7f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:36.720448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f775-3869-42ff-a41d-78c4f22e7f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:36.721215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92f775-3869-42ff-a41d-78c4f22e7f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:36.723472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92f775-3869-42ff-a41d-78c4f22e7f8e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:36.757325 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4122/8281] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:36.757902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c85d-7ff3-47b9-b3bb-fdc5cbad1e6b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:36.773555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c85d-7ff3-47b9-b3bb-fdc5cbad1e6b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:36.787283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964df96-1863-4d6e-a5f0-227cd3afa428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:36.788618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964df96-1863-4d6e-a5f0-227cd3afa428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:36.788894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964df96-1863-4d6e-a5f0-227cd3afa428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:36.789283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964df96-1863-4d6e-a5f0-227cd3afa428 admin admin] PATH_INFO: `/v3/projects/f16c12f8868b422f91f974c77c61619b/users/6e64a8f5efba46beae2e06203c608c67/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:36.827740 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:36.832152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964df96-1863-4d6e-a5f0-227cd3afa428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16c12f8868b422f91f974c77c61619b, user_id=6e64a8f5efba46beae2e06203c608c67, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:36.835870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964df96-1863-4d6e-a5f0-227cd3afa428 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:36.876132 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4160/8282] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:36 2022] PUT /identity/v3/projects/f16c12f8868b422f91f974c77c61619b/users/6e64a8f5efba46beae2e06203c608c67/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:36.879218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959c75-01e6-4c0e-a52a-3c8e5ce0976c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:36.879756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959c75-01e6-4c0e-a52a-3c8e5ce0976c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:36.880285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959c75-01e6-4c0e-a52a-3c8e5ce0976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:36.983846 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:37.016694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-95959c75-01e6-4c0e-a52a-3c8e5ce0976c None None] MFA Rules not processed for user `6e64a8f5efba46beae2e06203c608c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:37.017927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-95959c75-01e6-4c0e-a52a-3c8e5ce0976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:37.121431 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4123/8283] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:37.122650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964df96-1863-4d6e-a5f0-227cd3afa428 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:37.124594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c964df96-1863-4d6e-a5f0-227cd3afa428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:37.261115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964df96-1863-4d6e-a5f0-227cd3afa428 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:37.271292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec327f2-9631-41a6-95f6-1016e206838a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:37.273317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec327f2-9631-41a6-95f6-1016e206838a service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:37.273743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec327f2-9631-41a6-95f6-1016e206838a service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:37.274110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec327f2-9631-41a6-95f6-1016e206838a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:37.294106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec327f2-9631-41a6-95f6-1016e206838a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:37.296967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec327f2-9631-41a6-95f6-1016e206838a service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:37.319013 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4161/8284] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:37.567965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8b22-15cd-42f6-a9d8-7a6f9d72c620 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:37.568502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8b22-15cd-42f6-a9d8-7a6f9d72c620 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:37.570224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8b22-15cd-42f6-a9d8-7a6f9d72c620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:37.648822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-581d8b22-15cd-42f6-a9d8-7a6f9d72c620 None None] MFA Rules not processed for user `dcf580f97641423a83eef98acc713946`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:37.650233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-581d8b22-15cd-42f6-a9d8-7a6f9d72c620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:37.909858 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4124/8285] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:38.153053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec327f2-9631-41a6-95f6-1016e206838a service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:38.168594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec327f2-9631-41a6-95f6-1016e206838a service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:38.173074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543d65b-acca-4914-a20a-6013bada8d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:38.173982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543d65b-acca-4914-a20a-6013bada8d5b service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:38.174268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543d65b-acca-4914-a20a-6013bada8d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:38.174543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543d65b-acca-4914-a20a-6013bada8d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:38.185909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543d65b-acca-4914-a20a-6013bada8d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:38.187903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543d65b-acca-4914-a20a-6013bada8d5b service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:38.198173 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4162/8286] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:39.670819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb65743-230d-43d7-9ba2-0362d369ba5f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:39.671694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb65743-230d-43d7-9ba2-0362d369ba5f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:39.672121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb65743-230d-43d7-9ba2-0362d369ba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:39.695320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ecb65743-230d-43d7-9ba2-0362d369ba5f None None] MFA Rules not processed for user `dcf580f97641423a83eef98acc713946`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:39.696843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ecb65743-230d-43d7-9ba2-0362d369ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:39.704381 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4125/8287] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:41.750543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543d65b-acca-4914-a20a-6013bada8d5b service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:41.752195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8543d65b-acca-4914-a20a-6013bada8d5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:41.857078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543d65b-acca-4914-a20a-6013bada8d5b service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:41.867858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:41.868767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:41.869122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:41.869474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] PATH_INFO: `/v3/users/756cfafe3aca4839a8c7e23f87c569b6` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:41.870786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756cfafe3aca4839a8c7e23f87c569b6)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:41.873048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:41.952700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756cfafe3aca4839a8c7e23f87c569b6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:41.970845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756cfafe3aca4839a8c7e23f87c569b6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:41.971936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756cfafe3aca4839a8c7e23f87c569b6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:41.983695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756cfafe3aca4839a8c7e23f87c569b6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:41.984606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756cfafe3aca4839a8c7e23f87c569b6'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.000555 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:42.009849 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4163/8288] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:41 2022] DELETE /identity/v3/users/756cfafe3aca4839a8c7e23f87c569b6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:42.313022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb65743-230d-43d7-9ba2-0362d369ba5f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:42.328870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb65743-230d-43d7-9ba2-0362d369ba5f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:42.426224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:42.427161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:42.427776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:42.428246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] PATH_INFO: `/v3/projects/8d97558a194b42daa9750cb197f1feaa` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:42.448105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d97558a194b42daa9750cb197f1feaa)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:42.460140 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:42.496202 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:42.532633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d97558a194b42daa9750cb197f1feaa', 'request_id': 'req-d282370c-8b9b-4d23-8df2-8d40b34fad4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.540319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d97558a194b42daa9750cb197f1feaa', 'request_id': 'req-d282370c-8b9b-4d23-8df2-8d40b34fad4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.548235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d97558a194b42daa9750cb197f1feaa', 'request_id': 'req-d282370c-8b9b-4d23-8df2-8d40b34fad4b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.565800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] The token cache is being invalidate because project 8d97558a194b42daa9750cb197f1feaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:42.566372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.568234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.570883 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4126/8289] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:42 2022] DELETE /identity/v3/projects/8d97558a194b42daa9750cb197f1feaa => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:42.574666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:42.576237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:42.594464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00738d1-db6b-4972-a0fe-781772897886 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:42.677744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:42.678775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:42.679603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:42.679603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] PATH_INFO: `/v3/users/adb2af7c33344ebba5dc3e8400d4c90c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:42.680609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb2af7c33344ebba5dc3e8400d4c90c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:42.682952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:42.727756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:42.730216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:42.757193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282370c-8b9b-4d23-8df2-8d40b34fad4b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:42.763086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb2af7c33344ebba5dc3e8400d4c90c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.767768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9e09f-fb05-4b8c-abbe-ff0a3fce7b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:42.768988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e09f-fb05-4b8c-abbe-ff0a3fce7b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:42.769906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e09f-fb05-4b8c-abbe-ff0a3fce7b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:42.770697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e09f-fb05-4b8c-abbe-ff0a3fce7b77 admin admin] PATH_INFO: `/v3/users/9111199454e342b8bf28e7bc70987435` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:42.772595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9e09f-fb05-4b8c-abbe-ff0a3fce7b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9111199454e342b8bf28e7bc70987435)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:42.775237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9e09f-fb05-4b8c-abbe-ff0a3fce7b77 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:42.778006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb2af7c33344ebba5dc3e8400d4c90c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.779027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb2af7c33344ebba5dc3e8400d4c90c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.789658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb2af7c33344ebba5dc3e8400d4c90c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.790722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb2af7c33344ebba5dc3e8400d4c90c'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.830869 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4164/8290] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:42 2022] DELETE /identity/v3/users/adb2af7c33344ebba5dc3e8400d4c90c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:38:42.831624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:42.833444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:42.863851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76f9e09f-fb05-4b8c-abbe-ff0a3fce7b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9111199454e342b8bf28e7bc70987435'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.901957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76f9e09f-fb05-4b8c-abbe-ff0a3fce7b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9111199454e342b8bf28e7bc70987435'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.902810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76f9e09f-fb05-4b8c-abbe-ff0a3fce7b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9111199454e342b8bf28e7bc70987435'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.929267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76f9e09f-fb05-4b8c-abbe-ff0a3fce7b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9111199454e342b8bf28e7bc70987435'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.942275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-76f9e09f-fb05-4b8c-abbe-ff0a3fce7b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9111199454e342b8bf28e7bc70987435'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:42.961059 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4127/8291] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:42 2022] DELETE /identity/v3/users/9111199454e342b8bf28e7bc70987435 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:42.965378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5b1f5-ed2e-4f1f-8230-b0021e0c01de None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:42.965672 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5b1f5-ed2e-4f1f-8230-b0021e0c01de None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:42.965961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5b1f5-ed2e-4f1f-8230-b0021e0c01de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:42.967384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fada405-6bff-46c1-b815-1471a9faf899 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:43.003678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-efb5b1f5-ed2e-4f1f-8230-b0021e0c01de None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:43.004920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-efb5b1f5-ed2e-4f1f-8230-b0021e0c01de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:43.029969 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:43.099990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5424-28ea-424e-9680-b7e9da2bba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:43.100709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5424-28ea-424e-9680-b7e9da2bba58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:43.101012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5424-28ea-424e-9680-b7e9da2bba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:43.101454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5424-28ea-424e-9680-b7e9da2bba58 admin admin] PATH_INFO: `/v3/users/6e64a8f5efba46beae2e06203c608c67` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:43.102543 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4128/8292] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:38:43.105971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd5424-28ea-424e-9680-b7e9da2bba58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e64a8f5efba46beae2e06203c608c67)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:43.108560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd5424-28ea-424e-9680-b7e9da2bba58 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:43.124633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5b1f5-ed2e-4f1f-8230-b0021e0c01de None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:43.126915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-efb5b1f5-ed2e-4f1f-8230-b0021e0c01de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:43.200296 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:43.225276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-02dd5424-28ea-424e-9680-b7e9da2bba58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e64a8f5efba46beae2e06203c608c67'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:43.259241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-02dd5424-28ea-424e-9680-b7e9da2bba58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e64a8f5efba46beae2e06203c608c67'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:43.260565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-02dd5424-28ea-424e-9680-b7e9da2bba58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e64a8f5efba46beae2e06203c608c67'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:43.266035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5b1f5-ed2e-4f1f-8230-b0021e0c01de None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:43.279135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-02dd5424-28ea-424e-9680-b7e9da2bba58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e64a8f5efba46beae2e06203c608c67'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:43.280205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-02dd5424-28ea-424e-9680-b7e9da2bba58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e64a8f5efba46beae2e06203c608c67'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:43.294548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ea7f9-af20-481d-a9e6-9bbe54b4362a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:43.295806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ea7f9-af20-481d-a9e6-9bbe54b4362a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:43.296881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ea7f9-af20-481d-a9e6-9bbe54b4362a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:43.297359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ea7f9-af20-481d-a9e6-9bbe54b4362a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:43.301419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-591ea7f9-af20-481d-a9e6-9bbe54b4362a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:43.304960 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4165/8293] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:42 2022] DELETE /identity/v3/users/6e64a8f5efba46beae2e06203c608c67 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:43.311446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450f4d-ec0a-48cc-8462-4cb15016f0e3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:43.312112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450f4d-ec0a-48cc-8462-4cb15016f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:43.312605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450f4d-ec0a-48cc-8462-4cb15016f0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:43.345243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ea7f9-af20-481d-a9e6-9bbe54b4362a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:43.349507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ea7f9-af20-481d-a9e6-9bbe54b4362a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:43.382651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b3450f4d-ec0a-48cc-8462-4cb15016f0e3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:43.383902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b3450f4d-ec0a-48cc-8462-4cb15016f0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:43.392108 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4129/8294] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:38:43.393387 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ea7f9-af20-481d-a9e6-9bbe54b4362a service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:43.398728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-591ea7f9-af20-481d-a9e6-9bbe54b4362a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:43.425802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ea7f9-af20-481d-a9e6-9bbe54b4362a service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:43.519778 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4166/8295] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:43.537124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450f4d-ec0a-48cc-8462-4cb15016f0e3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:43.538841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b3450f4d-ec0a-48cc-8462-4cb15016f0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:43.579199 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:43.582133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:43.583816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:43.584288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] PATH_INFO: `/v3/projects/756f303799d14105ae15dedfe3cb8691` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:43.588082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=756f303799d14105ae15dedfe3cb8691)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:43.597572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:43.653799 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:43.674086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450f4d-ec0a-48cc-8462-4cb15016f0e3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:43.688248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1c522-2fd8-4146-9b65-d990b3aa999e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:43.688882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c522-2fd8-4146-9b65-d990b3aa999e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:43.689339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c522-2fd8-4146-9b65-d990b3aa999e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:43.689502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c522-2fd8-4146-9b65-d990b3aa999e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:43.704268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1c522-2fd8-4146-9b65-d990b3aa999e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:43.706373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1c522-2fd8-4146-9b65-d990b3aa999e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:43.720352 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4167/8296] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:38:43.740150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756f303799d14105ae15dedfe3cb8691', 'request_id': 'req-59dff895-0f5f-447b-ac20-545c1e7dd3b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:43.752380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756f303799d14105ae15dedfe3cb8691', 'request_id': 'req-59dff895-0f5f-447b-ac20-545c1e7dd3b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:43.759827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756f303799d14105ae15dedfe3cb8691', 'request_id': 'req-59dff895-0f5f-447b-ac20-545c1e7dd3b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:43.789000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] The token cache is being invalidate because project 756f303799d14105ae15dedfe3cb8691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:43.789326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:43.790028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-59dff895-0f5f-447b-ac20-545c1e7dd3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:43.793602 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4130/8297] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:43 2022] DELETE /identity/v3/projects/756f303799d14105ae15dedfe3cb8691 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:43.798064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6f15b-3886-40ac-81b5-8bfd46a7a149 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:43.798654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6f15b-3886-40ac-81b5-8bfd46a7a149 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:43.798869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6f15b-3886-40ac-81b5-8bfd46a7a149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:43.852470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d5e6f15b-3886-40ac-81b5-8bfd46a7a149 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:43.857119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d5e6f15b-3886-40ac-81b5-8bfd46a7a149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:43.979534 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4168/8298] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:43.987543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c9ff1-bdd8-4853-9721-b65bab4225dd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:43.987897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c9ff1-bdd8-4853-9721-b65bab4225dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:43.988152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c9ff1-bdd8-4853-9721-b65bab4225dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.013789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-360c9ff1-bdd8-4853-9721-b65bab4225dd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:44.015061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-360c9ff1-bdd8-4853-9721-b65bab4225dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:44.027863 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4131/8299] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:44.032616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6f15b-3886-40ac-81b5-8bfd46a7a149 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:44.046016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6f15b-3886-40ac-81b5-8bfd46a7a149 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:44.054928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c9ff1-bdd8-4853-9721-b65bab4225dd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:44.055972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9983de-8987-48f2-b95d-bf3a445d55fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:44.056813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-360c9ff1-bdd8-4853-9721-b65bab4225dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:44.057607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9983de-8987-48f2-b95d-bf3a445d55fc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.059091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9983de-8987-48f2-b95d-bf3a445d55fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.059961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9983de-8987-48f2-b95d-bf3a445d55fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.061355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9983de-8987-48f2-b95d-bf3a445d55fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:38:44.061606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9983de-8987-48f2-b95d-bf3a445d55fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:44.063726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9983de-8987-48f2-b95d-bf3a445d55fc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:44.074218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c9ff1-bdd8-4853-9721-b65bab4225dd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:44.079145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:44.079914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.083940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.083940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] PATH_INFO: `/v3/projects/aa498e0dc09d4397a90115ad3968789e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.083940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa498e0dc09d4397a90115ad3968789e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:44.085589 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4169/8300] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:38:44.085836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:44.087674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9983de-8987-48f2-b95d-bf3a445d55fc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:44.098674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9983de-8987-48f2-b95d-bf3a445d55fc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:44.105242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a9e7c-9713-4ccc-aac5-a380b09a9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:44.105890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a9e7c-9713-4ccc-aac5-a380b09a9e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.106172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a9e7c-9713-4ccc-aac5-a380b09a9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.106448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a9e7c-9713-4ccc-aac5-a380b09a9e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.107125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a9e7c-9713-4ccc-aac5-a380b09a9e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:44.109227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a9e7c-9713-4ccc-aac5-a380b09a9e07 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:44.147298 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4170/8301] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:44 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:44.149447 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:44.150230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a9e7c-9713-4ccc-aac5-a380b09a9e07 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:44.152629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa498e0dc09d4397a90115ad3968789e', 'request_id': 'req-993ef141-76b3-4fc2-8628-58a846530658'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.163953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa498e0dc09d4397a90115ad3968789e', 'request_id': 'req-993ef141-76b3-4fc2-8628-58a846530658'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.172528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa498e0dc09d4397a90115ad3968789e', 'request_id': 'req-993ef141-76b3-4fc2-8628-58a846530658'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.197913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] The token cache is being invalidate because project aa498e0dc09d4397a90115ad3968789e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:44.198385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.201322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.203431 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4132/8302] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:44 2022] DELETE /identity/v3/projects/aa498e0dc09d4397a90115ad3968789e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:44.207691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:44.211842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:44.243626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a9e7c-9713-4ccc-aac5-a380b09a9e07 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:44.263629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05521f-ee58-487a-ac21-abf8c856d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:44.264906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05521f-ee58-487a-ac21-abf8c856d740 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.265254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05521f-ee58-487a-ac21-abf8c856d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.265586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05521f-ee58-487a-ac21-abf8c856d740 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.266345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05521f-ee58-487a-ac21-abf8c856d740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:44.268321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05521f-ee58-487a-ac21-abf8c856d740 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:44.302017 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4171/8303] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:44 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:44.310339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05521f-ee58-487a-ac21-abf8c856d740 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:44.314340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5a05521f-ee58-487a-ac21-abf8c856d740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:44.335655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05521f-ee58-487a-ac21-abf8c856d740 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:44.341578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db2a9-74c8-44f8-9461-f953bfd52490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:44.342278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db2a9-74c8-44f8-9461-f953bfd52490 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.342845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db2a9-74c8-44f8-9461-f953bfd52490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.343193 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db2a9-74c8-44f8-9461-f953bfd52490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.343730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef141-76b3-4fc2-8628-58a846530658 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:44.343983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41db2a9-74c8-44f8-9461-f953bfd52490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:44.346078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41db2a9-74c8-44f8-9461-f953bfd52490 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:44.350444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:44.351768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.352414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.352841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] PATH_INFO: `/v3/users/a2ddf9a0fea3426c81dee6286106761f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.354295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ddf9a0fea3426c81dee6286106761f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:44.357354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:44.360379 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4172/8304] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:44.364070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db2a9-74c8-44f8-9461-f953bfd52490 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:44.380737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db2a9-74c8-44f8-9461-f953bfd52490 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:44.387013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6347b7-6f26-45dd-ba42-2d8f23c46438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:44.387759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6347b7-6f26-45dd-ba42-2d8f23c46438 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.388141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6347b7-6f26-45dd-ba42-2d8f23c46438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.388537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6347b7-6f26-45dd-ba42-2d8f23c46438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.389388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6347b7-6f26-45dd-ba42-2d8f23c46438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:44.393453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6347b7-6f26-45dd-ba42-2d8f23c46438 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:44.422271 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4173/8305] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:38:44.423603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6347b7-6f26-45dd-ba42-2d8f23c46438 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:44.431167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-da6347b7-6f26-45dd-ba42-2d8f23c46438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:44.447824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6347b7-6f26-45dd-ba42-2d8f23c46438 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:44.453272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:44.453779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.454172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.454452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] PATH_INFO: `/v3/projects/f16c12f8868b422f91f974c77c61619b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.455933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16c12f8868b422f91f974c77c61619b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:44.458358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:44.462895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ddf9a0fea3426c81dee6286106761f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.477920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ddf9a0fea3426c81dee6286106761f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.478806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ddf9a0fea3426c81dee6286106761f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.479841 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:44.491237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ddf9a0fea3426c81dee6286106761f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.504677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ddf9a0fea3426c81dee6286106761f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.511677 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4133/8306] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:44 2022] DELETE /identity/v3/users/a2ddf9a0fea3426c81dee6286106761f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:38:44.512287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:44.513830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:44.553487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16c12f8868b422f91f974c77c61619b', 'request_id': 'req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.583250 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:44.597445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6465f3e-57de-44c4-ac26-baeac5bab735 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:44.601740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16c12f8868b422f91f974c77c61619b', 'request_id': 'req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.609320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78062d9-79a3-4517-8d27-a9c3b7195bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:44.610391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78062d9-79a3-4517-8d27-a9c3b7195bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.610928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78062d9-79a3-4517-8d27-a9c3b7195bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.611450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78062d9-79a3-4517-8d27-a9c3b7195bbe admin admin] PATH_INFO: `/v3/projects/66337fecfa204f6786f40ef95d25100e/users/91aa9dcd126545dca506e75f7a11b9d6/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.621973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16c12f8868b422f91f974c77c61619b', 'request_id': 'req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.645563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] The token cache is being invalidate because project f16c12f8868b422f91f974c77c61619b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:44.646047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.648061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1ac4f4bd-99d8-4fbe-9fb4-5020df6451ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:44.653429 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4174/8307] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:44 2022] DELETE /identity/v3/projects/f16c12f8868b422f91f974c77c61619b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:44.655464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0277af-aafe-43fd-afd6-042bd511b28a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.655838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0277af-aafe-43fd-afd6-042bd511b28a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.656171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0277af-aafe-43fd-afd6-042bd511b28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.657099 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78062d9-79a3-4517-8d27-a9c3b7195bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=66337fecfa204f6786f40ef95d25100e, user_id=91aa9dcd126545dca506e75f7a11b9d6, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:44.661392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78062d9-79a3-4517-8d27-a9c3b7195bbe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:44.684868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6c0277af-aafe-43fd-afd6-042bd511b28a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:44.686419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6c0277af-aafe-43fd-afd6-042bd511b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:44.695425 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4134/8308] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:44 2022] PUT /identity/v3/projects/66337fecfa204f6786f40ef95d25100e/users/91aa9dcd126545dca506e75f7a11b9d6/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:44.801622 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4175/8309] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:44.805393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015324-fddf-4a20-a5db-589f51969325 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.805879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015324-fddf-4a20-a5db-589f51969325 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.806164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015324-fddf-4a20-a5db-589f51969325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.810626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f12f5-28bf-41bc-a354-7ccfe75382d5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.810991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f12f5-28bf-41bc-a354-7ccfe75382d5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.811270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f12f5-28bf-41bc-a354-7ccfe75382d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.842540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e78f12f5-28bf-41bc-a354-7ccfe75382d5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:44.844788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e78f12f5-28bf-41bc-a354-7ccfe75382d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:44.864954 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4176/8310] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:38:44.868248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f12f5-28bf-41bc-a354-7ccfe75382d5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:44.869833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-91015324-fddf-4a20-a5db-589f51969325 None None] MFA Rules not processed for user `91aa9dcd126545dca506e75f7a11b9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:44.879266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-91015324-fddf-4a20-a5db-589f51969325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:44.892969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f12f5-28bf-41bc-a354-7ccfe75382d5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:44.904386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7554e-a278-49ab-b886-a9a8457adeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:44.905253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7554e-a278-49ab-b886-a9a8457adeac admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:44.905538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7554e-a278-49ab-b886-a9a8457adeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:44.905811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7554e-a278-49ab-b886-a9a8457adeac admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:44.906468 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7554e-a278-49ab-b886-a9a8457adeac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:38:44.906798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7554e-a278-49ab-b886-a9a8457adeac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:44.908425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7554e-a278-49ab-b886-a9a8457adeac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:44.962929 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4177/8311] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:38:44.964297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7554e-a278-49ab-b886-a9a8457adeac admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:44.991850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7554e-a278-49ab-b886-a9a8457adeac admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:45.022317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df998d7-65c3-4695-bf0e-cd1c4e9215bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:45.023250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df998d7-65c3-4695-bf0e-cd1c4e9215bf admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:45.023685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df998d7-65c3-4695-bf0e-cd1c4e9215bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:45.024135 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df998d7-65c3-4695-bf0e-cd1c4e9215bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:45.024954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df998d7-65c3-4695-bf0e-cd1c4e9215bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:45.036828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df998d7-65c3-4695-bf0e-cd1c4e9215bf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:45.064385 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4135/8312] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:45.077946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91015324-fddf-4a20-a5db-589f51969325 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:45.080556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-91015324-fddf-4a20-a5db-589f51969325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:45.107980 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4178/8313] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:44 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:45.112221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df998d7-65c3-4695-bf0e-cd1c4e9215bf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:45.203220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91015324-fddf-4a20-a5db-589f51969325 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:45.240074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df998d7-65c3-4695-bf0e-cd1c4e9215bf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:45.249632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4133cda-23e2-412f-8228-1f028c6ac410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:45.250264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4133cda-23e2-412f-8228-1f028c6ac410 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:45.250545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4133cda-23e2-412f-8228-1f028c6ac410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:45.251025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4133cda-23e2-412f-8228-1f028c6ac410 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:45.251669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4133cda-23e2-412f-8228-1f028c6ac410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:45.253673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4133cda-23e2-412f-8228-1f028c6ac410 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:45.272011 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:45.294628 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4179/8314] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:45 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:45.299078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4133cda-23e2-412f-8228-1f028c6ac410 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:45.314268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4133cda-23e2-412f-8228-1f028c6ac410 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:45.321869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68509dc7-e262-4c3a-9a74-75ea1ef50a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:45.322463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7674d9-a064-4cbf-a4df-99a7e6111e67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:45.323752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7674d9-a064-4cbf-a4df-99a7e6111e67 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:45.323752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7674d9-a064-4cbf-a4df-99a7e6111e67 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:45.323969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7674d9-a064-4cbf-a4df-99a7e6111e67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:45.324162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68509dc7-e262-4c3a-9a74-75ea1ef50a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:45.324593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68509dc7-e262-4c3a-9a74-75ea1ef50a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:45.325151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68509dc7-e262-4c3a-9a74-75ea1ef50a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:45.325950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68509dc7-e262-4c3a-9a74-75ea1ef50a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:45.327988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68509dc7-e262-4c3a-9a74-75ea1ef50a3e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:45.346107 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4180/8315] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:45.350864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68509dc7-e262-4c3a-9a74-75ea1ef50a3e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:45.366708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68509dc7-e262-4c3a-9a74-75ea1ef50a3e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:45.374306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf778b-079f-479c-b614-6abbddc0130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:45.375556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf778b-079f-479c-b614-6abbddc0130d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:45.375994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf778b-079f-479c-b614-6abbddc0130d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:45.376694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf778b-079f-479c-b614-6abbddc0130d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:45.377516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf778b-079f-479c-b614-6abbddc0130d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:45.380185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf778b-079f-479c-b614-6abbddc0130d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:45.394840 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4181/8316] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:45.399490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf778b-079f-479c-b614-6abbddc0130d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:45.407992 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:45.422667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf778b-079f-479c-b614-6abbddc0130d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:45.428621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a0337-ba1b-4734-807c-aa87c31d0d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:45.430185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0337-ba1b-4734-807c-aa87c31d0d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:45.432327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0337-ba1b-4734-807c-aa87c31d0d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:45.433287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0337-ba1b-4734-807c-aa87c31d0d96 admin admin] PATH_INFO: `/v3/projects/685b93141a3e4728a75512d11b80ce3b/users/cae850e6c84a4d11963a512c786c88e7/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:45.455449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a0337-ba1b-4734-807c-aa87c31d0d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=685b93141a3e4728a75512d11b80ce3b, user_id=cae850e6c84a4d11963a512c786c88e7, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:45.460200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a0337-ba1b-4734-807c-aa87c31d0d96 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:45.465512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7674d9-a064-4cbf-a4df-99a7e6111e67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:45.470108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7674d9-a064-4cbf-a4df-99a7e6111e67 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:45.486768 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4182/8317] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:45 2022] PUT /identity/v3/projects/685b93141a3e4728a75512d11b80ce3b/users/cae850e6c84a4d11963a512c786c88e7/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:38:45.495031 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4136/8318] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:45.501088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefca0ed-8dca-4b66-8bc0-2ef3cf240871 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:45.501585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefca0ed-8dca-4b66-8bc0-2ef3cf240871 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:45.502029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefca0ed-8dca-4b66-8bc0-2ef3cf240871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:45.560213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cefca0ed-8dca-4b66-8bc0-2ef3cf240871 None None] MFA Rules not processed for user `cae850e6c84a4d11963a512c786c88e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:45.563466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cefca0ed-8dca-4b66-8bc0-2ef3cf240871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:45.647560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7674d9-a064-4cbf-a4df-99a7e6111e67 service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:45.649329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cd7674d9-a064-4cbf-a4df-99a7e6111e67 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:45.680032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7674d9-a064-4cbf-a4df-99a7e6111e67 service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:45.744295 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4183/8319] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:45.758447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefca0ed-8dca-4b66-8bc0-2ef3cf240871 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:45.760350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cefca0ed-8dca-4b66-8bc0-2ef3cf240871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:45.781272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:45.781916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:45.782245 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:45.782524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] PATH_INFO: `/v3/projects/4f096b1ee55a485182b50f0c5d22f4a3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:45.783700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f096b1ee55a485182b50f0c5d22f4a3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:45.785619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:45.843791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefca0ed-8dca-4b66-8bc0-2ef3cf240871 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:45.856058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f096b1ee55a485182b50f0c5d22f4a3', 'request_id': 'req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:45.865563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f096b1ee55a485182b50f0c5d22f4a3', 'request_id': 'req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:45.874714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f096b1ee55a485182b50f0c5d22f4a3', 'request_id': 'req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:45.895089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] The token cache is being invalidate because project 4f096b1ee55a485182b50f0c5d22f4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:45.895523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:45.897457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0dbe4930-a5f4-477d-b270-9c0bf09bea2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:45.899905 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4137/8320] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:45 2022] DELETE /identity/v3/projects/4f096b1ee55a485182b50f0c5d22f4a3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:45.904957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66b810-60d8-4ea4-8a3b-fdc9ee72b770 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:45.905204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66b810-60d8-4ea4-8a3b-fdc9ee72b770 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:45.905549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66b810-60d8-4ea4-8a3b-fdc9ee72b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:45.919574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0a3a2-30fc-4ab5-b8d0-8716bac2445a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:45.920371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0a3a2-30fc-4ab5-b8d0-8716bac2445a service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:45.920774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0a3a2-30fc-4ab5-b8d0-8716bac2445a service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:45.921651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0a3a2-30fc-4ab5-b8d0-8716bac2445a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:45.923788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-15c0a3a2-30fc-4ab5-b8d0-8716bac2445a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:45.929667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8f66b810-60d8-4ea4-8a3b-fdc9ee72b770 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:45.931040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8f66b810-60d8-4ea4-8a3b-fdc9ee72b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:45.937555 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:46.030908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0a3a2-30fc-4ab5-b8d0-8716bac2445a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:46.032482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0a3a2-30fc-4ab5-b8d0-8716bac2445a service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:46.043937 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4184/8321] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:38:46.055473 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4138/8322] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:38:46.083240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67861dc-6833-472f-8025-bc4da3368b74 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:46.083525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67861dc-6833-472f-8025-bc4da3368b74 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:46.083798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67861dc-6833-472f-8025-bc4da3368b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:46.106320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e67861dc-6833-472f-8025-bc4da3368b74 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:46.107614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e67861dc-6833-472f-8025-bc4da3368b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:46.117108 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4185/8323] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:46.121141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66b810-60d8-4ea4-8a3b-fdc9ee72b770 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:46.139710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66b810-60d8-4ea4-8a3b-fdc9ee72b770 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:46.155177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8f181-9dc6-41f7-93ae-7994c70639b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:46.155177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8f181-9dc6-41f7-93ae-7994c70639b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:46.155177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8f181-9dc6-41f7-93ae-7994c70639b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:46.155177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8f181-9dc6-41f7-93ae-7994c70639b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:46.155617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8f181-9dc6-41f7-93ae-7994c70639b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:38:46.159611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8f181-9dc6-41f7-93ae-7994c70639b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:46.160205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8f181-9dc6-41f7-93ae-7994c70639b7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:46.163738 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:46.189165 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4139/8324] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:38:46.189735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67861dc-6833-472f-8025-bc4da3368b74 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:46.200391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67861dc-6833-472f-8025-bc4da3368b74 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:46.207132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd4ee-3d37-4e96-bd2a-b65fcca9cd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:46.207875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd4ee-3d37-4e96-bd2a-b65fcca9cd34 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:46.208242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd4ee-3d37-4e96-bd2a-b65fcca9cd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:46.209595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd4ee-3d37-4e96-bd2a-b65fcca9cd34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:46.211412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fd4ee-3d37-4e96-bd2a-b65fcca9cd34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:46.213337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fd4ee-3d37-4e96-bd2a-b65fcca9cd34 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:46.256707 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4186/8325] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:46 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:38:46.258142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8f181-9dc6-41f7-93ae-7994c70639b7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:46.274766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8f181-9dc6-41f7-93ae-7994c70639b7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:46.368109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074f201-a75e-4d8e-bc4a-8acd06682d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:46.368598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f201-a75e-4d8e-bc4a-8acd06682d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:46.368878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f201-a75e-4d8e-bc4a-8acd06682d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:46.369155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f201-a75e-4d8e-bc4a-8acd06682d5a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:46.369746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074f201-a75e-4d8e-bc4a-8acd06682d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:46.371704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074f201-a75e-4d8e-bc4a-8acd06682d5a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:46.412570 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4140/8326] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:46 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:38:46.416952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd4ee-3d37-4e96-bd2a-b65fcca9cd34 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:46.433630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd4ee-3d37-4e96-bd2a-b65fcca9cd34 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:46.449094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadaf48-9dd4-4171-8ef0-78a1102c509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:46.449729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadaf48-9dd4-4171-8ef0-78a1102c509e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:46.450006 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadaf48-9dd4-4171-8ef0-78a1102c509e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:46.450361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadaf48-9dd4-4171-8ef0-78a1102c509e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:46.450947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadaf48-9dd4-4171-8ef0-78a1102c509e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:46.452734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadaf48-9dd4-4171-8ef0-78a1102c509e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:46.480831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074f201-a75e-4d8e-bc4a-8acd06682d5a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:46.481687 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4187/8327] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:46.492251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074f201-a75e-4d8e-bc4a-8acd06682d5a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:46.498674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf190e1-95fa-4203-99bc-f4355221e4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:46.499360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf190e1-95fa-4203-99bc-f4355221e4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:46.499712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf190e1-95fa-4203-99bc-f4355221e4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:46.500241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf190e1-95fa-4203-99bc-f4355221e4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:46.501109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf190e1-95fa-4203-99bc-f4355221e4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:46.502818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf190e1-95fa-4203-99bc-f4355221e4d0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:46.518633 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4141/8328] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:38:46.523709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadaf48-9dd4-4171-8ef0-78a1102c509e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:46.535970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadaf48-9dd4-4171-8ef0-78a1102c509e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:46.559756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b6c72-86d1-46ef-b68f-48c494a91758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:46.560541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6c72-86d1-46ef-b68f-48c494a91758 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:46.560894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6c72-86d1-46ef-b68f-48c494a91758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:46.561228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6c72-86d1-46ef-b68f-48c494a91758 admin admin] PATH_INFO: `/v3/projects/e3045d44934f44c58ad112dfcb29b88c/users/f1e4fbcaad1b48388ca82641121d9564/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:46.578848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b6c72-86d1-46ef-b68f-48c494a91758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3045d44934f44c58ad112dfcb29b88c, user_id=f1e4fbcaad1b48388ca82641121d9564, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:46.581538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b6c72-86d1-46ef-b68f-48c494a91758 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:46.598805 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4188/8329] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:46 2022] PUT /identity/v3/projects/e3045d44934f44c58ad112dfcb29b88c/users/f1e4fbcaad1b48388ca82641121d9564/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:46.610153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536df9-d1ff-4426-a6be-38e13b4428f9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:46.610502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536df9-d1ff-4426-a6be-38e13b4428f9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:46.610934 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536df9-d1ff-4426-a6be-38e13b4428f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:46.644638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d3536df9-d1ff-4426-a6be-38e13b4428f9 None None] MFA Rules not processed for user `f1e4fbcaad1b48388ca82641121d9564`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:46.645892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d3536df9-d1ff-4426-a6be-38e13b4428f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:46.737773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b6c72-86d1-46ef-b68f-48c494a91758 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:46.739496 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4142/8330] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:46.968891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b6c72-86d1-46ef-b68f-48c494a91758 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:46.978698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded8b9-ff6f-471e-bbfb-e994807cbe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:46.979486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded8b9-ff6f-471e-bbfb-e994807cbe34 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:46.979930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded8b9-ff6f-471e-bbfb-e994807cbe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:46.980369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded8b9-ff6f-471e-bbfb-e994807cbe34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:46.981530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ded8b9-ff6f-471e-bbfb-e994807cbe34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:46.984561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ded8b9-ff6f-471e-bbfb-e994807cbe34 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:47.051646 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4189/8331] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:46 2022] POST /identity/v3/projects => generated 369 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:47.056837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3536df9-d1ff-4426-a6be-38e13b4428f9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:47.070865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3536df9-d1ff-4426-a6be-38e13b4428f9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:47.181410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a1cb5-76ee-4502-b84c-810baf1287ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:47.182228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a1cb5-76ee-4502-b84c-810baf1287ad admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:47.182519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a1cb5-76ee-4502-b84c-810baf1287ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:47.182827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a1cb5-76ee-4502-b84c-810baf1287ad admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:47.183469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a1cb5-76ee-4502-b84c-810baf1287ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:47.185972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a1cb5-76ee-4502-b84c-810baf1287ad admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:47.198128 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:47.219168 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4143/8332] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:47 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:47.222819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded8b9-ff6f-471e-bbfb-e994807cbe34 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:47.236381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded8b9-ff6f-471e-bbfb-e994807cbe34 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:47.241445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee301d65-2ede-4834-b400-d52d370dd959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:47.242160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee301d65-2ede-4834-b400-d52d370dd959 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:47.242512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee301d65-2ede-4834-b400-d52d370dd959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:47.242837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee301d65-2ede-4834-b400-d52d370dd959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:47.243631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee301d65-2ede-4834-b400-d52d370dd959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:47.245268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee301d65-2ede-4834-b400-d52d370dd959 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:47.257814 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4190/8333] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:38:47.261815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a1cb5-76ee-4502-b84c-810baf1287ad admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:47.273305 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a1cb5-76ee-4502-b84c-810baf1287ad admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:47.278134 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5646f-1a50-4d3b-8cff-83ec6186ef64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:47.278918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5646f-1a50-4d3b-8cff-83ec6186ef64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:47.279303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5646f-1a50-4d3b-8cff-83ec6186ef64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:47.279638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5646f-1a50-4d3b-8cff-83ec6186ef64 admin admin] PATH_INFO: `/v3/projects/2bf901e49d1c40f9b928fce5ae6dd6d5/users/b5c0d54549404fc58ad95ce55aca7deb/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:47.297411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5646f-1a50-4d3b-8cff-83ec6186ef64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf901e49d1c40f9b928fce5ae6dd6d5, user_id=b5c0d54549404fc58ad95ce55aca7deb, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:47.301412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5646f-1a50-4d3b-8cff-83ec6186ef64 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:47.318716 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4144/8334] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:47 2022] PUT /identity/v3/projects/2bf901e49d1c40f9b928fce5ae6dd6d5/users/b5c0d54549404fc58ad95ce55aca7deb/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:47.322458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee301d65-2ede-4834-b400-d52d370dd959 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:47.333070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee301d65-2ede-4834-b400-d52d370dd959 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:47.350022 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:47.413280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e413a-1df2-425c-8bfb-2ab8df78b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:47.413280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e413a-1df2-425c-8bfb-2ab8df78b7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:47.413557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e413a-1df2-425c-8bfb-2ab8df78b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:47.413785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e413a-1df2-425c-8bfb-2ab8df78b7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:47.414374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e413a-1df2-425c-8bfb-2ab8df78b7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:47.416659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e413a-1df2-425c-8bfb-2ab8df78b7e2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:47.429072 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4191/8335] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:47.433065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5646f-1a50-4d3b-8cff-83ec6186ef64 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:47.448081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5646f-1a50-4d3b-8cff-83ec6186ef64 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:47.455521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ab483-e4c9-4597-ba44-3b3dcc0ea298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:47.459512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ab483-e4c9-4597-ba44-3b3dcc0ea298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:47.460551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ab483-e4c9-4597-ba44-3b3dcc0ea298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:47.461101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ab483-e4c9-4597-ba44-3b3dcc0ea298 admin admin] PATH_INFO: `/v3/projects/2bf901e49d1c40f9b928fce5ae6dd6d5/users/b5c0d54549404fc58ad95ce55aca7deb/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:47.466415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ab483-e4c9-4597-ba44-3b3dcc0ea298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf901e49d1c40f9b928fce5ae6dd6d5, user_id=b5c0d54549404fc58ad95ce55aca7deb, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:47.469291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ab483-e4c9-4597-ba44-3b3dcc0ea298 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:47.485780 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4145/8336] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:47 2022] PUT /identity/v3/projects/2bf901e49d1c40f9b928fce5ae6dd6d5/users/b5c0d54549404fc58ad95ce55aca7deb/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:38:47.497808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a511258-093a-4976-b4f0-805ad5751396 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:47.498044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a511258-093a-4976-b4f0-805ad5751396 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:47.498326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a511258-093a-4976-b4f0-805ad5751396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:47.535813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3a511258-093a-4976-b4f0-805ad5751396 None None] MFA Rules not processed for user `b5c0d54549404fc58ad95ce55aca7deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:47.537490 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3a511258-093a-4976-b4f0-805ad5751396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:47.627942 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4192/8337] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:47.639621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ab483-e4c9-4597-ba44-3b3dcc0ea298 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:47.641344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-800ab483-e4c9-4597-ba44-3b3dcc0ea298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:47.716401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ab483-e4c9-4597-ba44-3b3dcc0ea298 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:47.720234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2be25-b4b8-4ef2-8ff6-334a3effc6df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:47.720847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2be25-b4b8-4ef2-8ff6-334a3effc6df service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:47.721124 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2be25-b4b8-4ef2-8ff6-334a3effc6df service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:47.721392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2be25-b4b8-4ef2-8ff6-334a3effc6df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:47.733737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2be25-b4b8-4ef2-8ff6-334a3effc6df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:47.735421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2be25-b4b8-4ef2-8ff6-334a3effc6df service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:47.749087 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4146/8338] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:47.797949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a511258-093a-4976-b4f0-805ad5751396 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:47.799615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3a511258-093a-4976-b4f0-805ad5751396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:47.822462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a511258-093a-4976-b4f0-805ad5751396 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:47.827082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fa363-ca75-4a59-a819-30b8d037a3a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:47.827757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fa363-ca75-4a59-a819-30b8d037a3a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:47.828038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fa363-ca75-4a59-a819-30b8d037a3a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:47.828313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fa363-ca75-4a59-a819-30b8d037a3a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:47.895243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fa363-ca75-4a59-a819-30b8d037a3a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:47.896834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fa363-ca75-4a59-a819-30b8d037a3a8 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:47.906707 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4193/8339] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:52.198154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2be25-b4b8-4ef2-8ff6-334a3effc6df service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:52.337237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2be25-b4b8-4ef2-8ff6-334a3effc6df service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:52.343396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:52.344058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:52.344343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:52.344618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] PATH_INFO: `/v3/users/f1e4fbcaad1b48388ca82641121d9564` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:52.345797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e4fbcaad1b48388ca82641121d9564)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:52.353224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:52.417028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e4fbcaad1b48388ca82641121d9564'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:52.419496 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:52.432609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e4fbcaad1b48388ca82641121d9564'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:52.433359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e4fbcaad1b48388ca82641121d9564'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:52.441848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e4fbcaad1b48388ca82641121d9564'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:52.451524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e4fbcaad1b48388ca82641121d9564'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:52.462989 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4147/8340] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:52 2022] DELETE /identity/v3/users/f1e4fbcaad1b48388ca82641121d9564 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:52.464907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219fee-ce3b-4a3c-b891-b9506a8bf867 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:52.465419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219fee-ce3b-4a3c-b891-b9506a8bf867 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:52.465419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219fee-ce3b-4a3c-b891-b9506a8bf867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:52.503747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ec219fee-ce3b-4a3c-b891-b9506a8bf867 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:52.506012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ec219fee-ce3b-4a3c-b891-b9506a8bf867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:52.534902 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:52.585549 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4194/8341] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:52.593784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:52.595411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:52.735825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680a986-e985-4d23-a22b-d6ac851441ff admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:52.747047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e208a0-d6fc-42ef-979a-70f73a8fe899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:52.747686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e208a0-d6fc-42ef-979a-70f73a8fe899 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:52.749487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e208a0-d6fc-42ef-979a-70f73a8fe899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:52.749771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e208a0-d6fc-42ef-979a-70f73a8fe899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:52.778812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e208a0-d6fc-42ef-979a-70f73a8fe899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:52.780312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e208a0-d6fc-42ef-979a-70f73a8fe899 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:52.795963 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4148/8342] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:53.204681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec219fee-ce3b-4a3c-b891-b9506a8bf867 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:53.211237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ec219fee-ce3b-4a3c-b891-b9506a8bf867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:53.252012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec219fee-ce3b-4a3c-b891-b9506a8bf867 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:53.269474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:53.270130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:53.270412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:53.270713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] PATH_INFO: `/v3/projects/e3045d44934f44c58ad112dfcb29b88c` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:53.275446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3045d44934f44c58ad112dfcb29b88c)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:53.277356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:53.334867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3045d44934f44c58ad112dfcb29b88c', 'request_id': 'req-de097d1e-c36b-479a-8783-a723a8d45003'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:53.341349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3045d44934f44c58ad112dfcb29b88c', 'request_id': 'req-de097d1e-c36b-479a-8783-a723a8d45003'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:53.348596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3045d44934f44c58ad112dfcb29b88c', 'request_id': 'req-de097d1e-c36b-479a-8783-a723a8d45003'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:53.370452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] The token cache is being invalidate because project e3045d44934f44c58ad112dfcb29b88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:53.370955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:53.371647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:53.373203 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4195/8343] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:53 2022] DELETE /identity/v3/projects/e3045d44934f44c58ad112dfcb29b88c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:53.377296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e208a0-d6fc-42ef-979a-70f73a8fe899 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:53.391644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e208a0-d6fc-42ef-979a-70f73a8fe899 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:53.489572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c769e85-c74c-46e4-919d-4499ee1f3936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:53.491203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c769e85-c74c-46e4-919d-4499ee1f3936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:53.491492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c769e85-c74c-46e4-919d-4499ee1f3936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:53.491816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c769e85-c74c-46e4-919d-4499ee1f3936 admin admin] PATH_INFO: `/v3/users/b5c0d54549404fc58ad95ce55aca7deb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:53.493190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c769e85-c74c-46e4-919d-4499ee1f3936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c0d54549404fc58ad95ce55aca7deb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:53.495406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c769e85-c74c-46e4-919d-4499ee1f3936 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:53.597011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c769e85-c74c-46e4-919d-4499ee1f3936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c0d54549404fc58ad95ce55aca7deb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:53.622052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c769e85-c74c-46e4-919d-4499ee1f3936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c0d54549404fc58ad95ce55aca7deb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:53.622896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c769e85-c74c-46e4-919d-4499ee1f3936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c0d54549404fc58ad95ce55aca7deb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:53.633223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c769e85-c74c-46e4-919d-4499ee1f3936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c0d54549404fc58ad95ce55aca7deb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:53.635525 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:53.647464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c769e85-c74c-46e4-919d-4499ee1f3936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c0d54549404fc58ad95ce55aca7deb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:53.658895 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4149/8344] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:53 2022] DELETE /identity/v3/users/b5c0d54549404fc58ad95ce55aca7deb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:54.108419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:54.110568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:54.138804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de097d1e-c36b-479a-8783-a723a8d45003 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:54.231072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:54.235350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:54.235688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:54.236673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] PATH_INFO: `/v3/projects/2bf901e49d1c40f9b928fce5ae6dd6d5` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:54.238866 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf901e49d1c40f9b928fce5ae6dd6d5)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:54.241394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:54.329588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf901e49d1c40f9b928fce5ae6dd6d5', 'request_id': 'req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:54.334579 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:54.339486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf901e49d1c40f9b928fce5ae6dd6d5', 'request_id': 'req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:54.351946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf901e49d1c40f9b928fce5ae6dd6d5', 'request_id': 'req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:54.368382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] The token cache is being invalidate because project 2bf901e49d1c40f9b928fce5ae6dd6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:54.368582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:54.369352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f9ed2d0b-ed0a-4259-acbf-1bcab4c89cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:54.371317 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4196/8345] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:54 2022] DELETE /identity/v3/projects/2bf901e49d1c40f9b928fce5ae6dd6d5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:54.381615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdfc55-46a2-47a7-8642-d36ce99df9d3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:54.382151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdfc55-46a2-47a7-8642-d36ce99df9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:54.382151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdfc55-46a2-47a7-8642-d36ce99df9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:54.469239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f3bdfc55-46a2-47a7-8642-d36ce99df9d3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:54.488887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f3bdfc55-46a2-47a7-8642-d36ce99df9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:54.591421 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4150/8346] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:54.599816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24783f-1029-46ae-bc19-37c97128eb4f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:54.600898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24783f-1029-46ae-bc19-37c97128eb4f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:54.601186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24783f-1029-46ae-bc19-37c97128eb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:54.630241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3e24783f-1029-46ae-bc19-37c97128eb4f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:54.631962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3e24783f-1029-46ae-bc19-37c97128eb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:54.643668 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4197/8347] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:38:54.647927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdfc55-46a2-47a7-8642-d36ce99df9d3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:54.667211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdfc55-46a2-47a7-8642-d36ce99df9d3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:54.686750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ec399-48fe-484d-9b74-2b82013bfbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:54.687400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ec399-48fe-484d-9b74-2b82013bfbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:54.687683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ec399-48fe-484d-9b74-2b82013bfbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:54.687960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ec399-48fe-484d-9b74-2b82013bfbf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:54.688630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ec399-48fe-484d-9b74-2b82013bfbf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:38:54.689198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ec399-48fe-484d-9b74-2b82013bfbf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:54.691145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ec399-48fe-484d-9b74-2b82013bfbf4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:54.706155 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4151/8348] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:38:54.710840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24783f-1029-46ae-bc19-37c97128eb4f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:54.721205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24783f-1029-46ae-bc19-37c97128eb4f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:54.726821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75ad6-0338-4408-9751-592584c99881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:54.727443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75ad6-0338-4408-9751-592584c99881 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:54.727725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75ad6-0338-4408-9751-592584c99881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:54.728001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75ad6-0338-4408-9751-592584c99881 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:54.728654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75ad6-0338-4408-9751-592584c99881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:54.730586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75ad6-0338-4408-9751-592584c99881 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:54.767738 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4198/8349] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:54 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:38:54.773331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ec399-48fe-484d-9b74-2b82013bfbf4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:54.790693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ec399-48fe-484d-9b74-2b82013bfbf4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:54.918577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d293937-f7e7-452a-92cd-b6dd32e070fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:54.919404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d293937-f7e7-452a-92cd-b6dd32e070fe admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:54.920234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d293937-f7e7-452a-92cd-b6dd32e070fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:54.920602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d293937-f7e7-452a-92cd-b6dd32e070fe admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:54.921373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d293937-f7e7-452a-92cd-b6dd32e070fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:54.924348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d293937-f7e7-452a-92cd-b6dd32e070fe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:54.963143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75ad6-0338-4408-9751-592584c99881 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:54.975815 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4152/8350] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:54 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:54.978858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75ad6-0338-4408-9751-592584c99881 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:55.002563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adef7b7-3ecf-46ab-9fda-0751d5e67228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:55.003575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adef7b7-3ecf-46ab-9fda-0751d5e67228 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:55.003861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adef7b7-3ecf-46ab-9fda-0751d5e67228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:55.004141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adef7b7-3ecf-46ab-9fda-0751d5e67228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:55.004806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adef7b7-3ecf-46ab-9fda-0751d5e67228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:55.007645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adef7b7-3ecf-46ab-9fda-0751d5e67228 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:55.023784 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4199/8351] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:55.025665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d293937-f7e7-452a-92cd-b6dd32e070fe admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:55.038888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d293937-f7e7-452a-92cd-b6dd32e070fe admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:55.061451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204730d-c0d6-47e5-b485-5cee5fb73e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:55.062125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204730d-c0d6-47e5-b485-5cee5fb73e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:55.062411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204730d-c0d6-47e5-b485-5cee5fb73e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:55.062730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204730d-c0d6-47e5-b485-5cee5fb73e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:55.063451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204730d-c0d6-47e5-b485-5cee5fb73e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:55.065337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204730d-c0d6-47e5-b485-5cee5fb73e97 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:55.080102 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4153/8352] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:55.084375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adef7b7-3ecf-46ab-9fda-0751d5e67228 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:55.098319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adef7b7-3ecf-46ab-9fda-0751d5e67228 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:55.104008 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14ed4f-33c0-423f-8d57-cc7c410881dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:55.104691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14ed4f-33c0-423f-8d57-cc7c410881dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:55.104977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14ed4f-33c0-423f-8d57-cc7c410881dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:55.105257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14ed4f-33c0-423f-8d57-cc7c410881dc admin admin] PATH_INFO: `/v3/projects/0cd716cf05b14bc09ecb0d75318caf23/users/02e1fd84a63942a5abf1262af885b247/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:55.127596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14ed4f-33c0-423f-8d57-cc7c410881dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd716cf05b14bc09ecb0d75318caf23, user_id=02e1fd84a63942a5abf1262af885b247, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:55.132283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14ed4f-33c0-423f-8d57-cc7c410881dc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:55.162826 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4200/8353] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:55 2022] PUT /identity/v3/projects/0cd716cf05b14bc09ecb0d75318caf23/users/02e1fd84a63942a5abf1262af885b247/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:55.164114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0adad-448a-4aa9-a8eb-231cbe239e69 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:55.165565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0adad-448a-4aa9-a8eb-231cbe239e69 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:55.165859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0adad-448a-4aa9-a8eb-231cbe239e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:55.186961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14ed4f-33c0-423f-8d57-cc7c410881dc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:55.188449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-aa14ed4f-33c0-423f-8d57-cc7c410881dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:55.223938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c7e0adad-448a-4aa9-a8eb-231cbe239e69 None None] MFA Rules not processed for user `02e1fd84a63942a5abf1262af885b247`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:55.226574 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7e0adad-448a-4aa9-a8eb-231cbe239e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:55.340925 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:55.377681 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4154/8354] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:55.382915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0adad-448a-4aa9-a8eb-231cbe239e69 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:55.407461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14ed4f-33c0-423f-8d57-cc7c410881dc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:55.413660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf5a8-f1ed-4dda-bd6d-6a40d39a4515 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:55.414282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf5a8-f1ed-4dda-bd6d-6a40d39a4515 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:55.414566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf5a8-f1ed-4dda-bd6d-6a40d39a4515 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:55.414877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf5a8-f1ed-4dda-bd6d-6a40d39a4515 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:55.418145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-db0bf5a8-f1ed-4dda-bd6d-6a40d39a4515 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:55.435952 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bf5a8-f1ed-4dda-bd6d-6a40d39a4515 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:55.437917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bf5a8-f1ed-4dda-bd6d-6a40d39a4515 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:55.457298 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4201/8355] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:38:55.491042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0adad-448a-4aa9-a8eb-231cbe239e69 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:55.497949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271e24-2596-4bff-8f06-cc0881d0661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:55.498825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271e24-2596-4bff-8f06-cc0881d0661b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:55.499273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271e24-2596-4bff-8f06-cc0881d0661b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:55.499712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271e24-2596-4bff-8f06-cc0881d0661b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:55.500494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de271e24-2596-4bff-8f06-cc0881d0661b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:55.502588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de271e24-2596-4bff-8f06-cc0881d0661b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:55.548492 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4155/8356] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:55 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:38:55.553123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf5a8-f1ed-4dda-bd6d-6a40d39a4515 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:55.570817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf5a8-f1ed-4dda-bd6d-6a40d39a4515 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:55.751727 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:55.766406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92c449-cfd5-4434-a521-8283948305c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:55.768022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92c449-cfd5-4434-a521-8283948305c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:55.769156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92c449-cfd5-4434-a521-8283948305c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:55.770461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92c449-cfd5-4434-a521-8283948305c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:55.773948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92c449-cfd5-4434-a521-8283948305c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:55.776147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92c449-cfd5-4434-a521-8283948305c2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:55.834778 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4202/8357] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:55 2022] POST /identity/v3/users => generated 299 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:55.836743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271e24-2596-4bff-8f06-cc0881d0661b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:55.853075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271e24-2596-4bff-8f06-cc0881d0661b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:55.862285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba55d1-1872-457f-8b70-287ae7c41fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:55.863997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba55d1-1872-457f-8b70-287ae7c41fee admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:55.865163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba55d1-1872-457f-8b70-287ae7c41fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:55.866879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba55d1-1872-457f-8b70-287ae7c41fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:55.867650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba55d1-1872-457f-8b70-287ae7c41fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:55.871556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba55d1-1872-457f-8b70-287ae7c41fee admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:55.901533 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4156/8358] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:55.903894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92c449-cfd5-4434-a521-8283948305c2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:55.916273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92c449-cfd5-4434-a521-8283948305c2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:55.922962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff1a41-3267-4f0e-b9dc-1846db918c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:55.924208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff1a41-3267-4f0e-b9dc-1846db918c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:55.924884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff1a41-3267-4f0e-b9dc-1846db918c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:55.925372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff1a41-3267-4f0e-b9dc-1846db918c7d admin admin] PATH_INFO: `/v3/projects/73f26652a9d34abfb9c89131343f61e7/users/0ad5674d982947c9a96aed11073cdb06/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:55.948346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff1a41-3267-4f0e-b9dc-1846db918c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f26652a9d34abfb9c89131343f61e7, user_id=0ad5674d982947c9a96aed11073cdb06, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:55.951782 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff1a41-3267-4f0e-b9dc-1846db918c7d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:55.986962 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4203/8359] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:55 2022] PUT /identity/v3/projects/73f26652a9d34abfb9c89131343f61e7/users/0ad5674d982947c9a96aed11073cdb06/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:55.991615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba55d1-1872-457f-8b70-287ae7c41fee admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:56.006443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba55d1-1872-457f-8b70-287ae7c41fee admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:56.227414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8416c-3de1-4ada-8da7-a0fdc3eec22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:56.228452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8416c-3de1-4ada-8da7-a0fdc3eec22f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:56.228894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8416c-3de1-4ada-8da7-a0fdc3eec22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:56.229344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8416c-3de1-4ada-8da7-a0fdc3eec22f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:56.230311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8416c-3de1-4ada-8da7-a0fdc3eec22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:56.232690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8416c-3de1-4ada-8da7-a0fdc3eec22f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:56.257851 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4157/8360] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:38:56.262160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff1a41-3267-4f0e-b9dc-1846db918c7d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:56.284822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff1a41-3267-4f0e-b9dc-1846db918c7d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:56.297333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbf9b9-c662-4396-b283-ddb8ee16d9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:56.298032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbf9b9-c662-4396-b283-ddb8ee16d9dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:56.303297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbf9b9-c662-4396-b283-ddb8ee16d9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:56.303657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbf9b9-c662-4396-b283-ddb8ee16d9dd admin admin] PATH_INFO: `/v3/projects/73f26652a9d34abfb9c89131343f61e7/users/0ad5674d982947c9a96aed11073cdb06/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:56.308253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbf9b9-c662-4396-b283-ddb8ee16d9dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f26652a9d34abfb9c89131343f61e7, user_id=0ad5674d982947c9a96aed11073cdb06, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:56.314491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbf9b9-c662-4396-b283-ddb8ee16d9dd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:56.368279 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4204/8361] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:38:56 2022] PUT /identity/v3/projects/73f26652a9d34abfb9c89131343f61e7/users/0ad5674d982947c9a96aed11073cdb06/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:38:56.370646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826c620-dd1c-4025-8517-bbcbf86a6e04 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:56.370957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826c620-dd1c-4025-8517-bbcbf86a6e04 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:56.371233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826c620-dd1c-4025-8517-bbcbf86a6e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:56.426112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9826c620-dd1c-4025-8517-bbcbf86a6e04 None None] MFA Rules not processed for user `0ad5674d982947c9a96aed11073cdb06`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:56.430331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9826c620-dd1c-4025-8517-bbcbf86a6e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:56.495114 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:56.531774 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4158/8362] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:56.543181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbf9b9-c662-4396-b283-ddb8ee16d9dd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:56.545109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-aabbf9b9-c662-4396-b283-ddb8ee16d9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:56.619225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbf9b9-c662-4396-b283-ddb8ee16d9dd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:56.623565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91e947-4eab-4d4e-956c-fb1bc6613e8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:56.624443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91e947-4eab-4d4e-956c-fb1bc6613e8d service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:56.624729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91e947-4eab-4d4e-956c-fb1bc6613e8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:56.625012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91e947-4eab-4d4e-956c-fb1bc6613e8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:56.636088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91e947-4eab-4d4e-956c-fb1bc6613e8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:56.637837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91e947-4eab-4d4e-956c-fb1bc6613e8d service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:56.650518 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4205/8363] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:56.736824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826c620-dd1c-4025-8517-bbcbf86a6e04 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:56.826991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826c620-dd1c-4025-8517-bbcbf86a6e04 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:56.831935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:56.832588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:56.832871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:56.833147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] PATH_INFO: `/v3/users/02e1fd84a63942a5abf1262af885b247` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:56.835311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e1fd84a63942a5abf1262af885b247)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:56.840790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:56.906065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e1fd84a63942a5abf1262af885b247'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:56.921620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e1fd84a63942a5abf1262af885b247'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:56.922498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e1fd84a63942a5abf1262af885b247'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:56.939823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e1fd84a63942a5abf1262af885b247'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:56.951656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e1fd84a63942a5abf1262af885b247'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:56.972951 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4159/8364] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:56 2022] DELETE /identity/v3/users/02e1fd84a63942a5abf1262af885b247 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:56.978542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1551-1208-488e-bac1-805f0f5998e1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:56.978542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1551-1208-488e-bac1-805f0f5998e1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:56.978783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1551-1208-488e-bac1-805f0f5998e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:57.011290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-941d1551-1208-488e-bac1-805f0f5998e1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:57.012590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-941d1551-1208-488e-bac1-805f0f5998e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:57.090750 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4206/8365] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:57.102390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:57.104367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:57.200408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f41bc-f809-43e4-a99f-18425882c2aa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:57.205476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b6a62-685b-46db-9177-278008554a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:57.206376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6a62-685b-46db-9177-278008554a17 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:57.206710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6a62-685b-46db-9177-278008554a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:57.206986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6a62-685b-46db-9177-278008554a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:57.227463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b6a62-685b-46db-9177-278008554a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:57.229059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b6a62-685b-46db-9177-278008554a17 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:57.245417 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4160/8366] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:38:57.984159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d1551-1208-488e-bac1-805f0f5998e1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:57.985777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-941d1551-1208-488e-bac1-805f0f5998e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:58.006553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d1551-1208-488e-bac1-805f0f5998e1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:58.015753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:58.016595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:58.016883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:58.017158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] PATH_INFO: `/v3/projects/0cd716cf05b14bc09ecb0d75318caf23` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:58.018993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd716cf05b14bc09ecb0d75318caf23)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:58.021769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:58.082552 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:58.093805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd716cf05b14bc09ecb0d75318caf23', 'request_id': 'req-b8626506-438e-4a0e-8687-7b2563fa04e2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:58.114114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd716cf05b14bc09ecb0d75318caf23', 'request_id': 'req-b8626506-438e-4a0e-8687-7b2563fa04e2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:58.128457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd716cf05b14bc09ecb0d75318caf23', 'request_id': 'req-b8626506-438e-4a0e-8687-7b2563fa04e2'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:58.147227 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] The token cache is being invalidate because project 0cd716cf05b14bc09ecb0d75318caf23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:58.147835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:58.148696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:58.150833 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4207/8367] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:57 2022] DELETE /identity/v3/projects/0cd716cf05b14bc09ecb0d75318caf23 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:58.154735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b6a62-685b-46db-9177-278008554a17 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:58.161098 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:58.166895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b6a62-685b-46db-9177-278008554a17 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:58.281302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d1bec-7495-4a50-9586-380ffdd36de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:58.281955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d1bec-7495-4a50-9586-380ffdd36de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:58.282234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d1bec-7495-4a50-9586-380ffdd36de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:58.282510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d1bec-7495-4a50-9586-380ffdd36de6 admin admin] PATH_INFO: `/v3/users/0ad5674d982947c9a96aed11073cdb06` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:58.284090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d1bec-7495-4a50-9586-380ffdd36de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad5674d982947c9a96aed11073cdb06)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:58.286639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d1bec-7495-4a50-9586-380ffdd36de6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:58.407940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c2d1bec-7495-4a50-9586-380ffdd36de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad5674d982947c9a96aed11073cdb06'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:58.440565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c2d1bec-7495-4a50-9586-380ffdd36de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad5674d982947c9a96aed11073cdb06'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:58.441965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c2d1bec-7495-4a50-9586-380ffdd36de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad5674d982947c9a96aed11073cdb06'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:58.463723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c2d1bec-7495-4a50-9586-380ffdd36de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad5674d982947c9a96aed11073cdb06'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:58.482072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0c2d1bec-7495-4a50-9586-380ffdd36de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad5674d982947c9a96aed11073cdb06'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:58.516773 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4161/8368] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:38:58 2022] DELETE /identity/v3/users/0ad5674d982947c9a96aed11073cdb06 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:59.343157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:59.345143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:59.368940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8626506-438e-4a0e-8687-7b2563fa04e2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:59.462824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:59.463536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:59.463839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:59.464121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] PATH_INFO: `/v3/projects/73f26652a9d34abfb9c89131343f61e7` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:59.465312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f26652a9d34abfb9c89131343f61e7)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:59.467327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:59.519070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f26652a9d34abfb9c89131343f61e7', 'request_id': 'req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:59.527592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f26652a9d34abfb9c89131343f61e7', 'request_id': 'req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:59.534492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f26652a9d34abfb9c89131343f61e7', 'request_id': 'req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:59.553257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] The token cache is being invalidate because project 73f26652a9d34abfb9c89131343f61e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:38:59.553755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:59.554589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-64575e7b-2587-4ead-b7ef-ea1f8f10eb1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:38:59.556508 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4208/8369] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:38:59 2022] DELETE /identity/v3/projects/73f26652a9d34abfb9c89131343f61e7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:38:59.561784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ae3e0-0574-4690-a157-4aad16a3dbe1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:59.562234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ae3e0-0574-4690-a157-4aad16a3dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:59.562522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ae3e0-0574-4690-a157-4aad16a3dbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:59.626064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5f5ae3e0-0574-4690-a157-4aad16a3dbe1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:59.627327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5f5ae3e0-0574-4690-a157-4aad16a3dbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:59.729563 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:38:59.745452 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4162/8370] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:38:59.753171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dca85-845e-481e-b2b2-9723caac56b7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:59.753453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dca85-845e-481e-b2b2-9723caac56b7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:59.753720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dca85-845e-481e-b2b2-9723caac56b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:59.786265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-355dca85-845e-481e-b2b2-9723caac56b7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:38:59.788047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-355dca85-845e-481e-b2b2-9723caac56b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:38:59.802688 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4209/8371] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:38:59.806986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ae3e0-0574-4690-a157-4aad16a3dbe1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:59.822110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ae3e0-0574-4690-a157-4aad16a3dbe1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:59.832383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bd909-03f7-4c32-b3fe-80aa98e98d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:59.833643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bd909-03f7-4c32-b3fe-80aa98e98d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:59.834013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bd909-03f7-4c32-b3fe-80aa98e98d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:59.834927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bd909-03f7-4c32-b3fe-80aa98e98d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:59.835789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bd909-03f7-4c32-b3fe-80aa98e98d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:38:59.836249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bd909-03f7-4c32-b3fe-80aa98e98d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:59.838790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bd909-03f7-4c32-b3fe-80aa98e98d1e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:59.858268 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4163/8372] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:38:59.862321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dca85-845e-481e-b2b2-9723caac56b7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:59.879031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dca85-845e-481e-b2b2-9723caac56b7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:38:59.884862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d3def-28ca-43e7-afcb-01f2e064c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:38:59.885484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d3def-28ca-43e7-afcb-01f2e064c894 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:38:59.885763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d3def-28ca-43e7-afcb-01f2e064c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:38:59.886195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d3def-28ca-43e7-afcb-01f2e064c894 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:38:59.886888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d3def-28ca-43e7-afcb-01f2e064c894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:38:59.888837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d3def-28ca-43e7-afcb-01f2e064c894 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:38:59.937883 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4210/8373] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:38:59 2022] POST /identity/v3/projects => generated 391 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:38:59.941025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bd909-03f7-4c32-b3fe-80aa98e98d1e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:38:59.968053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bd909-03f7-4c32-b3fe-80aa98e98d1e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:00.059863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f54b94-3ba7-4925-8f2e-d73018c2f7ff None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:00.060376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f54b94-3ba7-4925-8f2e-d73018c2f7ff None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:00.060838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f54b94-3ba7-4925-8f2e-d73018c2f7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:00.086053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b8f54b94-3ba7-4925-8f2e-d73018c2f7ff None None] MFA Rules not processed for user `dcf580f97641423a83eef98acc713946`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:00.088068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b8f54b94-3ba7-4925-8f2e-d73018c2f7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:00.159468 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:00.167316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51218f0d-7a9b-441f-b448-0e178c6a4a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:00.168104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51218f0d-7a9b-441f-b448-0e178c6a4a03 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:00.168383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51218f0d-7a9b-441f-b448-0e178c6a4a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:00.168651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51218f0d-7a9b-441f-b448-0e178c6a4a03 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:00.169295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51218f0d-7a9b-441f-b448-0e178c6a4a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:00.173901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51218f0d-7a9b-441f-b448-0e178c6a4a03 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:00.217282 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4211/8374] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:00.226366 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4164/8375] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:38:59 2022] POST /identity/v3/users => generated 296 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:39:00.234584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f54b94-3ba7-4925-8f2e-d73018c2f7ff None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:00.250780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f54b94-3ba7-4925-8f2e-d73018c2f7ff None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:00.259485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b844-8402-471b-958d-4e5caffc57f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:00.260111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b844-8402-471b-958d-4e5caffc57f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:00.260397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b844-8402-471b-958d-4e5caffc57f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:00.260673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b844-8402-471b-958d-4e5caffc57f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:00.261341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9b844-8402-471b-958d-4e5caffc57f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:00.263173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9b844-8402-471b-958d-4e5caffc57f5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:00.282254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51218f0d-7a9b-441f-b448-0e178c6a4a03 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:00.292725 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4212/8376] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:39:00.298084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51218f0d-7a9b-441f-b448-0e178c6a4a03 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:00.316083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ace7c5-194c-4dab-974e-9499bd739716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:00.318227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace7c5-194c-4dab-974e-9499bd739716 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:00.318522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace7c5-194c-4dab-974e-9499bd739716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:00.318834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace7c5-194c-4dab-974e-9499bd739716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:00.319485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ace7c5-194c-4dab-974e-9499bd739716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:00.332459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ace7c5-194c-4dab-974e-9499bd739716 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:00.357544 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4165/8377] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:39:00.378038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b844-8402-471b-958d-4e5caffc57f5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:00.437051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b844-8402-471b-958d-4e5caffc57f5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:00.455424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803968e8-d679-4d95-8159-1b2d290c4c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:00.456107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803968e8-d679-4d95-8159-1b2d290c4c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:00.456398 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803968e8-d679-4d95-8159-1b2d290c4c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:00.456676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803968e8-d679-4d95-8159-1b2d290c4c4e admin admin] PATH_INFO: `/v3/projects/3cf76234e47945188873b7829607d68f/users/67c68955e76c439999cfbf621bc9b02f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:00.504969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803968e8-d679-4d95-8159-1b2d290c4c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf76234e47945188873b7829607d68f, user_id=67c68955e76c439999cfbf621bc9b02f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:00.507963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803968e8-d679-4d95-8159-1b2d290c4c4e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:00.543656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5276a-4458-447c-b345-8d5c4d70690a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:00.544024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5276a-4458-447c-b345-8d5c4d70690a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:00.544311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5276a-4458-447c-b345-8d5c4d70690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:00.547563 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4213/8378] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:39:00 2022] PUT /identity/v3/projects/3cf76234e47945188873b7829607d68f/users/67c68955e76c439999cfbf621bc9b02f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:00.579731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4fc5276a-4458-447c-b345-8d5c4d70690a None None] MFA Rules not processed for user `67c68955e76c439999cfbf621bc9b02f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:00.581809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4fc5276a-4458-447c-b345-8d5c4d70690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:00.697864 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4166/8379] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:00.698565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803968e8-d679-4d95-8159-1b2d290c4c4e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:00.795905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803968e8-d679-4d95-8159-1b2d290c4c4e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:00.801497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af3dbb-e394-41cf-8c7d-f06f3673389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:00.802868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af3dbb-e394-41cf-8c7d-f06f3673389c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:00.803516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af3dbb-e394-41cf-8c7d-f06f3673389c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:00.803867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af3dbb-e394-41cf-8c7d-f06f3673389c admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:00.804606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af3dbb-e394-41cf-8c7d-f06f3673389c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:00.806656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af3dbb-e394-41cf-8c7d-f06f3673389c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:00.847508 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4214/8380] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:39:00 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:39:00.847810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5276a-4458-447c-b345-8d5c4d70690a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:00.868714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5276a-4458-447c-b345-8d5c4d70690a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:00.951506 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:00.967706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435fa1c-027a-4ad9-b033-3b2ea1d5822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:00.968665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435fa1c-027a-4ad9-b033-3b2ea1d5822f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:00.969875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435fa1c-027a-4ad9-b033-3b2ea1d5822f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:00.970944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435fa1c-027a-4ad9-b033-3b2ea1d5822f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:00.971602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435fa1c-027a-4ad9-b033-3b2ea1d5822f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:00.975987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435fa1c-027a-4ad9-b033-3b2ea1d5822f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:01.026166 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4167/8381] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:39:00 2022] POST /identity/v3/users => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:39:01.029787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af3dbb-e394-41cf-8c7d-f06f3673389c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:01.043100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af3dbb-e394-41cf-8c7d-f06f3673389c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:01.048621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac164-d5e7-4c3d-a514-4907537b4eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:01.049522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac164-d5e7-4c3d-a514-4907537b4eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:01.050034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac164-d5e7-4c3d-a514-4907537b4eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:01.050537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac164-d5e7-4c3d-a514-4907537b4eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:01.051416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ac164-d5e7-4c3d-a514-4907537b4eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:01.054363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ac164-d5e7-4c3d-a514-4907537b4eb6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:01.067967 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4215/8382] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:39:01.071792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435fa1c-027a-4ad9-b033-3b2ea1d5822f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:01.088383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435fa1c-027a-4ad9-b033-3b2ea1d5822f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:01.105080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926ca4d-f151-4a72-8e85-1d6bbbca8ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:01.105769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926ca4d-f151-4a72-8e85-1d6bbbca8ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:01.106056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926ca4d-f151-4a72-8e85-1d6bbbca8ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:01.106335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926ca4d-f151-4a72-8e85-1d6bbbca8ca2 admin admin] PATH_INFO: `/v3/projects/abe730ff4cf9450a8361d11b7181635e/users/de98325b22c04ba8b409afa3f1cd6ece/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:01.131128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926ca4d-f151-4a72-8e85-1d6bbbca8ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe730ff4cf9450a8361d11b7181635e, user_id=de98325b22c04ba8b409afa3f1cd6ece, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:01.134734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926ca4d-f151-4a72-8e85-1d6bbbca8ca2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:01.153839 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4168/8383] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:39:01 2022] PUT /identity/v3/projects/abe730ff4cf9450a8361d11b7181635e/users/de98325b22c04ba8b409afa3f1cd6ece/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:39:01.155366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac164-d5e7-4c3d-a514-4907537b4eb6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:01.167648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac164-d5e7-4c3d-a514-4907537b4eb6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:01.247446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10a28-a76b-4d21-aa66-42001c5030c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:01.248335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10a28-a76b-4d21-aa66-42001c5030c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:01.248712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10a28-a76b-4d21-aa66-42001c5030c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:01.249083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10a28-a76b-4d21-aa66-42001c5030c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:01.249833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10a28-a76b-4d21-aa66-42001c5030c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:01.251639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10a28-a76b-4d21-aa66-42001c5030c8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:01.266640 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4216/8384] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:39:01.269793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926ca4d-f151-4a72-8e85-1d6bbbca8ca2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:01.286368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926ca4d-f151-4a72-8e85-1d6bbbca8ca2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:01.296890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb8438-2567-4745-8535-99104c480225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:01.297620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb8438-2567-4745-8535-99104c480225 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:01.297997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb8438-2567-4745-8535-99104c480225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:01.298271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb8438-2567-4745-8535-99104c480225 admin admin] PATH_INFO: `/v3/projects/abe730ff4cf9450a8361d11b7181635e/users/de98325b22c04ba8b409afa3f1cd6ece/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:01.300735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb8438-2567-4745-8535-99104c480225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe730ff4cf9450a8361d11b7181635e, user_id=de98325b22c04ba8b409afa3f1cd6ece, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:01.304483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb8438-2567-4745-8535-99104c480225 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:01.327942 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4169/8385] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:39:01 2022] PUT /identity/v3/projects/abe730ff4cf9450a8361d11b7181635e/users/de98325b22c04ba8b409afa3f1cd6ece/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:01.330240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ef242-3fad-439d-813d-280e75c5a02a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:01.330828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ef242-3fad-439d-813d-280e75c5a02a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:01.331169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ef242-3fad-439d-813d-280e75c5a02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:01.360334 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:01.381029 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-202ef242-3fad-439d-813d-280e75c5a02a None None] MFA Rules not processed for user `de98325b22c04ba8b409afa3f1cd6ece`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:01.383926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-202ef242-3fad-439d-813d-280e75c5a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:01.504128 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4217/8386] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:01.862963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb8438-2567-4745-8535-99104c480225 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:01.862963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-61cb8438-2567-4745-8535-99104c480225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:01.939736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb8438-2567-4745-8535-99104c480225 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:01.945319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811bda6-3648-488d-a225-ad26714cf701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:01.946043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811bda6-3648-488d-a225-ad26714cf701 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:01.946371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811bda6-3648-488d-a225-ad26714cf701 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:01.946744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811bda6-3648-488d-a225-ad26714cf701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:01.981709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811bda6-3648-488d-a225-ad26714cf701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:01.983392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811bda6-3648-488d-a225-ad26714cf701 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:01.997007 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4170/8387] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:39:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:39:02.188775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ef242-3fad-439d-813d-280e75c5a02a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:02.222228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ef242-3fad-439d-813d-280e75c5a02a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:02.234855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7c71a-c785-4519-b283-604d49f96921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:02.235585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c71a-c785-4519-b283-604d49f96921 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:02.235926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c71a-c785-4519-b283-604d49f96921 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:02.236277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c71a-c785-4519-b283-604d49f96921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:02.340192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7c71a-c785-4519-b283-604d49f96921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:02.344022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7c71a-c785-4519-b283-604d49f96921 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:02.362652 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4218/8388] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:39:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:39:10.279865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811bda6-3648-488d-a225-ad26714cf701 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:10.447665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811bda6-3648-488d-a225-ad26714cf701 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:10.460248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:10.463131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:10.463131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:10.463131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] PATH_INFO: `/v3/users/67c68955e76c439999cfbf621bc9b02f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:10.465726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c68955e76c439999cfbf621bc9b02f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:10.468290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:10.578539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c68955e76c439999cfbf621bc9b02f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:10.589388 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:10.639884 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c68955e76c439999cfbf621bc9b02f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:10.641854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c68955e76c439999cfbf621bc9b02f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:10.675229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c68955e76c439999cfbf621bc9b02f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:10.713858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c68955e76c439999cfbf621bc9b02f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:10.744782 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4171/8389] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:39:10 2022] DELETE /identity/v3/users/67c68955e76c439999cfbf621bc9b02f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:10.747199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e9819-70b3-4977-83dc-be6a343aec82 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:10.747199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e9819-70b3-4977-83dc-be6a343aec82 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:10.747199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e9819-70b3-4977-83dc-be6a343aec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:10.783239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-992e9819-70b3-4977-83dc-be6a343aec82 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:10.786134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-992e9819-70b3-4977-83dc-be6a343aec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:10.939558 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4219/8390] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:10.950029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:10.951851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:11.252430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c2e40-0c42-418f-853a-285c2e4c5b75 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:11.264238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bea1f7-1594-4271-9276-1511e9eb6002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:11.264809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bea1f7-1594-4271-9276-1511e9eb6002 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:11.265148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bea1f7-1594-4271-9276-1511e9eb6002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:11.265582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bea1f7-1594-4271-9276-1511e9eb6002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:11.325145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bea1f7-1594-4271-9276-1511e9eb6002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:11.331816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bea1f7-1594-4271-9276-1511e9eb6002 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:11.366950 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4172/8391] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:39:11.997379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e9819-70b3-4977-83dc-be6a343aec82 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:12.001886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-992e9819-70b3-4977-83dc-be6a343aec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:12.025524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e9819-70b3-4977-83dc-be6a343aec82 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:12.034587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:12.035911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:12.037178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:12.037178 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] PATH_INFO: `/v3/projects/3cf76234e47945188873b7829607d68f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:12.040732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf76234e47945188873b7829607d68f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:12.043002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:12.125046 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:12.174374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf76234e47945188873b7829607d68f', 'request_id': 'req-a3e8666f-b317-4aff-ba23-13db88e62354'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:12.204534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf76234e47945188873b7829607d68f', 'request_id': 'req-a3e8666f-b317-4aff-ba23-13db88e62354'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:12.232745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf76234e47945188873b7829607d68f', 'request_id': 'req-a3e8666f-b317-4aff-ba23-13db88e62354'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:12.307404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] The token cache is being invalidate because project 3cf76234e47945188873b7829607d68f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:39:12.307861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:12.311705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:12.315687 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4220/8392] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:39:11 2022] DELETE /identity/v3/projects/3cf76234e47945188873b7829607d68f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:12.323295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bea1f7-1594-4271-9276-1511e9eb6002 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:12.342216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bea1f7-1594-4271-9276-1511e9eb6002 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:12.436462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a91f9-eb10-4a4a-9eb7-71881ab2c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:12.436963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a91f9-eb10-4a4a-9eb7-71881ab2c91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:12.437267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a91f9-eb10-4a4a-9eb7-71881ab2c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:12.437735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a91f9-eb10-4a4a-9eb7-71881ab2c91c admin admin] PATH_INFO: `/v3/users/de98325b22c04ba8b409afa3f1cd6ece` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:12.439630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a91f9-eb10-4a4a-9eb7-71881ab2c91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de98325b22c04ba8b409afa3f1cd6ece)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:12.442171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a91f9-eb10-4a4a-9eb7-71881ab2c91c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:12.612972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a7a91f9-eb10-4a4a-9eb7-71881ab2c91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de98325b22c04ba8b409afa3f1cd6ece'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:12.650852 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:12.655238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a7a91f9-eb10-4a4a-9eb7-71881ab2c91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de98325b22c04ba8b409afa3f1cd6ece'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:12.656868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a7a91f9-eb10-4a4a-9eb7-71881ab2c91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de98325b22c04ba8b409afa3f1cd6ece'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:12.671323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a7a91f9-eb10-4a4a-9eb7-71881ab2c91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de98325b22c04ba8b409afa3f1cd6ece'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:12.688070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a7a91f9-eb10-4a4a-9eb7-71881ab2c91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de98325b22c04ba8b409afa3f1cd6ece'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:12.699955 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4173/8393] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:39:12 2022] DELETE /identity/v3/users/de98325b22c04ba8b409afa3f1cd6ece => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:13.323009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:13.325308 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:13.342635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8666f-b317-4aff-ba23-13db88e62354 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:13.497968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:13.500817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:13.503230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:13.503768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] PATH_INFO: `/v3/projects/abe730ff4cf9450a8361d11b7181635e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:13.511460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe730ff4cf9450a8361d11b7181635e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:13.513372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:13.602635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe730ff4cf9450a8361d11b7181635e', 'request_id': 'req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:13.609479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe730ff4cf9450a8361d11b7181635e', 'request_id': 'req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:13.633864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe730ff4cf9450a8361d11b7181635e', 'request_id': 'req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:13.655735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] The token cache is being invalidate because project abe730ff4cf9450a8361d11b7181635e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:39:13.655941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:13.656630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-59d7cbe9-0a5a-461a-b5ee-9eba4c3fef54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:13.665380 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4221/8394] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:39:13 2022] DELETE /identity/v3/projects/abe730ff4cf9450a8361d11b7181635e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:13.669079 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bf0ea-54f4-4feb-b125-d365a8015e18 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:13.669597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bf0ea-54f4-4feb-b125-d365a8015e18 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:13.669875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bf0ea-54f4-4feb-b125-d365a8015e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:13.694026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b35bf0ea-54f4-4feb-b125-d365a8015e18 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:13.695274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b35bf0ea-54f4-4feb-b125-d365a8015e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:13.832016 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4174/8395] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:13.841727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a5c49-60dd-4b7a-a525-5740c164781b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:13.841890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a5c49-60dd-4b7a-a525-5740c164781b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:13.842086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a5c49-60dd-4b7a-a525-5740c164781b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:13.868800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7f6a5c49-60dd-4b7a-a525-5740c164781b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:13.870523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7f6a5c49-60dd-4b7a-a525-5740c164781b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:13.879118 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4222/8396] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:13.884790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bf0ea-54f4-4feb-b125-d365a8015e18 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:13.897092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bf0ea-54f4-4feb-b125-d365a8015e18 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:13.905444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79f8b2-c18f-440f-8524-5445e61c8c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:13.906064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79f8b2-c18f-440f-8524-5445e61c8c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:13.906350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79f8b2-c18f-440f-8524-5445e61c8c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:13.906662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79f8b2-c18f-440f-8524-5445e61c8c81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:13.907319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79f8b2-c18f-440f-8524-5445e61c8c81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:39:13.907627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79f8b2-c18f-440f-8524-5445e61c8c81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:13.909310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79f8b2-c18f-440f-8524-5445e61c8c81 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:13.929537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a5c49-60dd-4b7a-a525-5740c164781b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:13.930690 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4175/8397] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:39:13.940460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a5c49-60dd-4b7a-a525-5740c164781b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:13.954233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cd1d3-7de9-4999-b2e8-6261d880b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:13.954898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cd1d3-7de9-4999-b2e8-6261d880b48c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:13.955182 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cd1d3-7de9-4999-b2e8-6261d880b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:13.955455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cd1d3-7de9-4999-b2e8-6261d880b48c admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:13.956246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cd1d3-7de9-4999-b2e8-6261d880b48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:13.976615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cd1d3-7de9-4999-b2e8-6261d880b48c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:14.044048 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4223/8398] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:39:13 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:39:14.047880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79f8b2-c18f-440f-8524-5445e61c8c81 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:14.059911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79f8b2-c18f-440f-8524-5445e61c8c81 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:14.204187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ca61d-738b-42c5-8ebc-80837a3ec509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:14.204834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ca61d-738b-42c5-8ebc-80837a3ec509 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:14.205120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ca61d-738b-42c5-8ebc-80837a3ec509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:14.205398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ca61d-738b-42c5-8ebc-80837a3ec509 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:14.206049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ca61d-738b-42c5-8ebc-80837a3ec509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:14.210557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ca61d-738b-42c5-8ebc-80837a3ec509 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:14.240226 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4176/8399] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:39:14 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:39:14.244850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cd1d3-7de9-4999-b2e8-6261d880b48c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:14.256027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cd1d3-7de9-4999-b2e8-6261d880b48c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:14.260559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e9bf2-5229-4b00-9273-05a45d992232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:14.261156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e9bf2-5229-4b00-9273-05a45d992232 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:14.261433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e9bf2-5229-4b00-9273-05a45d992232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:14.261712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e9bf2-5229-4b00-9273-05a45d992232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:14.262352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e9bf2-5229-4b00-9273-05a45d992232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:14.263972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e9bf2-5229-4b00-9273-05a45d992232 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:14.274824 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4224/8400] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:39:14.278878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ca61d-738b-42c5-8ebc-80837a3ec509 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:14.290065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ca61d-738b-42c5-8ebc-80837a3ec509 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:14.295280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b25bbe-fcde-4986-9fd6-0a99a2f072c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:14.295907 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b25bbe-fcde-4986-9fd6-0a99a2f072c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:14.296346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b25bbe-fcde-4986-9fd6-0a99a2f072c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:14.296626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b25bbe-fcde-4986-9fd6-0a99a2f072c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:14.297286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b25bbe-fcde-4986-9fd6-0a99a2f072c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:14.299018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b25bbe-fcde-4986-9fd6-0a99a2f072c3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:14.316241 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4177/8401] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:39:14.317684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e9bf2-5229-4b00-9273-05a45d992232 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:14.328785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e9bf2-5229-4b00-9273-05a45d992232 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:14.334105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f55e29-32f2-4a2f-a654-9b2f17919520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:14.334929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55e29-32f2-4a2f-a654-9b2f17919520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:14.335277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55e29-32f2-4a2f-a654-9b2f17919520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:14.335697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55e29-32f2-4a2f-a654-9b2f17919520 admin admin] PATH_INFO: `/v3/projects/99b3208974714002ad7e4237b1f343d6/users/ca07218a78254a05ba3f52a3a6109a3c/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:14.338797 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:14.364058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f55e29-32f2-4a2f-a654-9b2f17919520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b3208974714002ad7e4237b1f343d6, user_id=ca07218a78254a05ba3f52a3a6109a3c, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:14.366995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f55e29-32f2-4a2f-a654-9b2f17919520 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:14.383730 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4225/8402] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:39:14 2022] PUT /identity/v3/projects/99b3208974714002ad7e4237b1f343d6/users/ca07218a78254a05ba3f52a3a6109a3c/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:14.394527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fce04-0b23-4c0b-b60f-1650f2d914ec None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:14.396715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fce04-0b23-4c0b-b60f-1650f2d914ec None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:14.396996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fce04-0b23-4c0b-b60f-1650f2d914ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:14.429557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-281fce04-0b23-4c0b-b60f-1650f2d914ec None None] MFA Rules not processed for user `ca07218a78254a05ba3f52a3a6109a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:14.431041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-281fce04-0b23-4c0b-b60f-1650f2d914ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:14.481742 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:14.553518 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4178/8403] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:14.643787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f55e29-32f2-4a2f-a654-9b2f17919520 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:14.647635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-66f55e29-32f2-4a2f-a654-9b2f17919520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:14.734336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f55e29-32f2-4a2f-a654-9b2f17919520 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:14.741772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70de82-3c50-409b-84f9-144f7aec7227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:14.744128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70de82-3c50-409b-84f9-144f7aec7227 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:14.745892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70de82-3c50-409b-84f9-144f7aec7227 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:14.745892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70de82-3c50-409b-84f9-144f7aec7227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:14.761031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70de82-3c50-409b-84f9-144f7aec7227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:14.762741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70de82-3c50-409b-84f9-144f7aec7227 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:14.776767 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4226/8404] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:39:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:39:17.411759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c843-a9d5-46b6-990e-bc8f8998ee71 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:17.412244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c843-a9d5-46b6-990e-bc8f8998ee71 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:17.412529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c843-a9d5-46b6-990e-bc8f8998ee71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:17.437825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8c22c843-a9d5-46b6-990e-bc8f8998ee71 None None] MFA Rules not processed for user `ca07218a78254a05ba3f52a3a6109a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:17.438852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8c22c843-a9d5-46b6-990e-bc8f8998ee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:17.449126 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4179/8405] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:22.998388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537fa9c-2a5b-4179-b5e0-e335e19dbc11 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:22.999811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537fa9c-2a5b-4179-b5e0-e335e19dbc11 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:22.999811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537fa9c-2a5b-4179-b5e0-e335e19dbc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:23.080854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6537fa9c-2a5b-4179-b5e0-e335e19dbc11 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:23.082461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6537fa9c-2a5b-4179-b5e0-e335e19dbc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:23.198779 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4227/8406] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:39:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:23.324735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c843-a9d5-46b6-990e-bc8f8998ee71 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:23.325686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8c22c843-a9d5-46b6-990e-bc8f8998ee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:23.560832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c843-a9d5-46b6-990e-bc8f8998ee71 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:23.567961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54945508-16cc-4735-baad-c02229de05e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:23.569132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945508-16cc-4735-baad-c02229de05e8 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:23.569622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945508-16cc-4735-baad-c02229de05e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:23.570173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945508-16cc-4735-baad-c02229de05e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:23.604227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54945508-16cc-4735-baad-c02229de05e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:23.610338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54945508-16cc-4735-baad-c02229de05e8 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:23.678840 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4180/8407] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:39:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:39:33.180458 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=72,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:33.663316 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=52 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:37.418540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537fa9c-2a5b-4179-b5e0-e335e19dbc11 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:37.420238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6537fa9c-2a5b-4179-b5e0-e335e19dbc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:37.451209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537fa9c-2a5b-4179-b5e0-e335e19dbc11 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:37.459587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d1dab-77c4-4070-bf25-4f9a4b4f2451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:37.460702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1dab-77c4-4070-bf25-4f9a4b4f2451 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:37.461290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1dab-77c4-4070-bf25-4f9a4b4f2451 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:37.461725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1dab-77c4-4070-bf25-4f9a4b4f2451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:37.464644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f76d1dab-77c4-4070-bf25-4f9a4b4f2451 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:37.667465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d1dab-77c4-4070-bf25-4f9a4b4f2451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:37.670246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d1dab-77c4-4070-bf25-4f9a4b4f2451 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:37.695912 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4228/8408] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:39:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:39:42.005443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54945508-16cc-4735-baad-c02229de05e8 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:42.007076 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-54945508-16cc-4735-baad-c02229de05e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:42.184714 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54945508-16cc-4735-baad-c02229de05e8 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:42.190431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:42.191130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:42.191447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:42.191792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] PATH_INFO: `/v3/users/91aa9dcd126545dca506e75f7a11b9d6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:42.193044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91aa9dcd126545dca506e75f7a11b9d6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:42.195108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:42.332069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91aa9dcd126545dca506e75f7a11b9d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:42.350853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91aa9dcd126545dca506e75f7a11b9d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:42.351611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91aa9dcd126545dca506e75f7a11b9d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:42.375118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91aa9dcd126545dca506e75f7a11b9d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:42.394658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91aa9dcd126545dca506e75f7a11b9d6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:42.408883 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4181/8409] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:39:42 2022] DELETE /identity/v3/users/91aa9dcd126545dca506e75f7a11b9d6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:42.410525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398356-a491-49a9-b26f-1b52898430b2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:42.411023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398356-a491-49a9-b26f-1b52898430b2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:42.411122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398356-a491-49a9-b26f-1b52898430b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:42.463787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d3398356-a491-49a9-b26f-1b52898430b2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:42.465316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d3398356-a491-49a9-b26f-1b52898430b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:42.600604 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4229/8410] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:42.601624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:42.603479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:42.819033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a11b7-3260-4526-b9ae-1f62947b8202 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:42.828451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531469f-1dbd-4ee8-906a-059cc57ec9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:42.830198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531469f-1dbd-4ee8-906a-059cc57ec9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:42.830826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531469f-1dbd-4ee8-906a-059cc57ec9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:42.831314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531469f-1dbd-4ee8-906a-059cc57ec9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:42.859175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531469f-1dbd-4ee8-906a-059cc57ec9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:42.860988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531469f-1dbd-4ee8-906a-059cc57ec9a4 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:42.883551 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4182/8411] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:39:43.292502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3398356-a491-49a9-b26f-1b52898430b2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:43.294130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d3398356-a491-49a9-b26f-1b52898430b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:43.319528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3398356-a491-49a9-b26f-1b52898430b2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:43.332604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:43.333809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:43.334206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:43.334500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] PATH_INFO: `/v3/projects/66337fecfa204f6786f40ef95d25100e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:43.335922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66337fecfa204f6786f40ef95d25100e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:43.338115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:43.471607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66337fecfa204f6786f40ef95d25100e', 'request_id': 'req-46bc2bed-9de3-4abc-beda-13784eb00165'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:43.483640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66337fecfa204f6786f40ef95d25100e', 'request_id': 'req-46bc2bed-9de3-4abc-beda-13784eb00165'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:43.499921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66337fecfa204f6786f40ef95d25100e', 'request_id': 'req-46bc2bed-9de3-4abc-beda-13784eb00165'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:43.523963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] The token cache is being invalidate because project 66337fecfa204f6786f40ef95d25100e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:39:43.524334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:43.527547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-46bc2bed-9de3-4abc-beda-13784eb00165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:39:43.531144 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4230/8412] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:39:43 2022] DELETE /identity/v3/projects/66337fecfa204f6786f40ef95d25100e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:43.538274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d43a0-74fe-45ed-be4e-031df69392ef None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:43.538845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d43a0-74fe-45ed-be4e-031df69392ef None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:43.539449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d43a0-74fe-45ed-be4e-031df69392ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:43.572972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f85d43a0-74fe-45ed-be4e-031df69392ef None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:43.574674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f85d43a0-74fe-45ed-be4e-031df69392ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:43.600618 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:43.686517 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4183/8413] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:43.688293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006984dc-6f99-4351-a1f6-ff8b29858226 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:43.688572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006984dc-6f99-4351-a1f6-ff8b29858226 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:43.688853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006984dc-6f99-4351-a1f6-ff8b29858226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:43.722488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-006984dc-6f99-4351-a1f6-ff8b29858226 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:43.723893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-006984dc-6f99-4351-a1f6-ff8b29858226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:43.738784 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4231/8414] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:39:43.742657 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d43a0-74fe-45ed-be4e-031df69392ef None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:43.758450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d43a0-74fe-45ed-be4e-031df69392ef None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:43.766524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e62976-1d4b-4e55-ab83-4aa79f7bc5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:43.767175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e62976-1d4b-4e55-ab83-4aa79f7bc5fb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:43.767457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e62976-1d4b-4e55-ab83-4aa79f7bc5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:43.769739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e62976-1d4b-4e55-ab83-4aa79f7bc5fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:43.770518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e62976-1d4b-4e55-ab83-4aa79f7bc5fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:39:43.770874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e62976-1d4b-4e55-ab83-4aa79f7bc5fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:43.774717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e62976-1d4b-4e55-ab83-4aa79f7bc5fb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:43.793143 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4184/8415] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:39:43.797500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006984dc-6f99-4351-a1f6-ff8b29858226 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:43.816371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006984dc-6f99-4351-a1f6-ff8b29858226 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:43.822775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f0b2a-7ca2-4215-88dd-8e9653deeae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:43.823390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f0b2a-7ca2-4215-88dd-8e9653deeae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:43.823681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f0b2a-7ca2-4215-88dd-8e9653deeae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:43.823953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f0b2a-7ca2-4215-88dd-8e9653deeae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:43.824578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f0b2a-7ca2-4215-88dd-8e9653deeae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:43.827461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f0b2a-7ca2-4215-88dd-8e9653deeae8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:43.853490 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:43.879853 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4232/8416] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:39:43 2022] POST /identity/v3/projects => generated 391 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:39:43.880843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e62976-1d4b-4e55-ab83-4aa79f7bc5fb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:43.899637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e62976-1d4b-4e55-ab83-4aa79f7bc5fb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:44.066237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec369b-095f-4b3b-98a1-992e2e058079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:44.068230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec369b-095f-4b3b-98a1-992e2e058079 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:44.068734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec369b-095f-4b3b-98a1-992e2e058079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:44.069887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec369b-095f-4b3b-98a1-992e2e058079 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:44.071446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec369b-095f-4b3b-98a1-992e2e058079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:44.077703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec369b-095f-4b3b-98a1-992e2e058079 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:44.142150 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4185/8417] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:39:43 2022] POST /identity/v3/users => generated 296 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:39:44.147120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f0b2a-7ca2-4215-88dd-8e9653deeae8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:44.162665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f0b2a-7ca2-4215-88dd-8e9653deeae8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:44.175795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333b05-f6f8-4a0d-a18d-2a3346365ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:44.179844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333b05-f6f8-4a0d-a18d-2a3346365ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:44.180351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333b05-f6f8-4a0d-a18d-2a3346365ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:44.181287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333b05-f6f8-4a0d-a18d-2a3346365ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:44.182762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6333b05-f6f8-4a0d-a18d-2a3346365ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:44.184677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6333b05-f6f8-4a0d-a18d-2a3346365ee2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:44.207727 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4233/8418] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:39:44.212126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec369b-095f-4b3b-98a1-992e2e058079 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:44.233443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec369b-095f-4b3b-98a1-992e2e058079 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:44.245763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b41e1-3c88-4b25-b250-cd7e1d8e8c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:44.246963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b41e1-3c88-4b25-b250-cd7e1d8e8c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:44.246963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b41e1-3c88-4b25-b250-cd7e1d8e8c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:44.247405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b41e1-3c88-4b25-b250-cd7e1d8e8c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:44.248170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b41e1-3c88-4b25-b250-cd7e1d8e8c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:44.250200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b41e1-3c88-4b25-b250-cd7e1d8e8c5b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:44.277260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333b05-f6f8-4a0d-a18d-2a3346365ee2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:44.283028 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4186/8419] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:39:44.291372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333b05-f6f8-4a0d-a18d-2a3346365ee2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:44.303382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25327c21-ef7b-45df-9696-3fe74006d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:44.304234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25327c21-ef7b-45df-9696-3fe74006d3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:44.304615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25327c21-ef7b-45df-9696-3fe74006d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:44.305047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25327c21-ef7b-45df-9696-3fe74006d3bd admin admin] PATH_INFO: `/v3/projects/7955fc0f32784de19c7e0bd32b5afe1b/users/4ac7b60e4e094354a9692bb46c3ebf8d/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:44.339564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25327c21-ef7b-45df-9696-3fe74006d3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7955fc0f32784de19c7e0bd32b5afe1b, user_id=4ac7b60e4e094354a9692bb46c3ebf8d, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:44.348957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25327c21-ef7b-45df-9696-3fe74006d3bd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:44.466418 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4234/8420] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:39:44 2022] PUT /identity/v3/projects/7955fc0f32784de19c7e0bd32b5afe1b/users/4ac7b60e4e094354a9692bb46c3ebf8d/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:44.501953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40859054-9dcb-457e-a63d-0d903fd6f39b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:44.502214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40859054-9dcb-457e-a63d-0d903fd6f39b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:44.508097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40859054-9dcb-457e-a63d-0d903fd6f39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:44.574360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-40859054-9dcb-457e-a63d-0d903fd6f39b None None] MFA Rules not processed for user `4ac7b60e4e094354a9692bb46c3ebf8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:44.575732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-40859054-9dcb-457e-a63d-0d903fd6f39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:44.713323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25327c21-ef7b-45df-9696-3fe74006d3bd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:44.727237 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4187/8421] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:44.913351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25327c21-ef7b-45df-9696-3fe74006d3bd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:44.929434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7270f2-fa06-47ba-9369-660f640b7c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:44.930841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7270f2-fa06-47ba-9369-660f640b7c38 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:44.930841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7270f2-fa06-47ba-9369-660f640b7c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:44.930841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7270f2-fa06-47ba-9369-660f640b7c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:44.932003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7270f2-fa06-47ba-9369-660f640b7c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:44.935784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7270f2-fa06-47ba-9369-660f640b7c38 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:44.988783 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4235/8422] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:39:44 2022] POST /identity/v3/projects => generated 391 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:39:44.993430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40859054-9dcb-457e-a63d-0d903fd6f39b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:45.009965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40859054-9dcb-457e-a63d-0d903fd6f39b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:45.028062 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:45.121403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6f17b-855d-41b0-b2b5-e18841d9d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:45.122399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6f17b-855d-41b0-b2b5-e18841d9d181 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:45.122702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6f17b-855d-41b0-b2b5-e18841d9d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:45.123213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6f17b-855d-41b0-b2b5-e18841d9d181 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:45.124436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6f17b-855d-41b0-b2b5-e18841d9d181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:45.127014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6f17b-855d-41b0-b2b5-e18841d9d181 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:45.172055 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4188/8423] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:39:44 2022] POST /identity/v3/users => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:39:45.172494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7270f2-fa06-47ba-9369-660f640b7c38 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:45.187271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7270f2-fa06-47ba-9369-660f640b7c38 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:45.207146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cfaf7-175e-49e7-8395-b6bb4ec18da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:45.208157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cfaf7-175e-49e7-8395-b6bb4ec18da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:45.208623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cfaf7-175e-49e7-8395-b6bb4ec18da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:45.209319 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cfaf7-175e-49e7-8395-b6bb4ec18da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:45.209972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cfaf7-175e-49e7-8395-b6bb4ec18da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:45.211677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cfaf7-175e-49e7-8395-b6bb4ec18da9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:45.239498 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4236/8424] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:39:45.248548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6f17b-855d-41b0-b2b5-e18841d9d181 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:45.264762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6f17b-855d-41b0-b2b5-e18841d9d181 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:45.276945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581e3f7-cf49-4308-9709-badf7c2797f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:45.277806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581e3f7-cf49-4308-9709-badf7c2797f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:45.277902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581e3f7-cf49-4308-9709-badf7c2797f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:45.278115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581e3f7-cf49-4308-9709-badf7c2797f4 admin admin] PATH_INFO: `/v3/projects/c3001c93c94c45fe9cd98aabdae3af9d/users/78162c558ced44a9991f777185a2dfcb/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:45.315846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581e3f7-cf49-4308-9709-badf7c2797f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3001c93c94c45fe9cd98aabdae3af9d, user_id=78162c558ced44a9991f777185a2dfcb, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:45.320478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581e3f7-cf49-4308-9709-badf7c2797f4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:45.350785 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4189/8425] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:39:45 2022] PUT /identity/v3/projects/c3001c93c94c45fe9cd98aabdae3af9d/users/78162c558ced44a9991f777185a2dfcb/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:45.359682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cfaf7-175e-49e7-8395-b6bb4ec18da9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:45.375257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cfaf7-175e-49e7-8395-b6bb4ec18da9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:45.537417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99f301-985d-4b56-9eb0-83ae9f53b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:45.538109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99f301-985d-4b56-9eb0-83ae9f53b98e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:45.538677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99f301-985d-4b56-9eb0-83ae9f53b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:45.539203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99f301-985d-4b56-9eb0-83ae9f53b98e admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:45.539903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99f301-985d-4b56-9eb0-83ae9f53b98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:45.541673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99f301-985d-4b56-9eb0-83ae9f53b98e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:45.558629 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4237/8426] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:39:45.563200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581e3f7-cf49-4308-9709-badf7c2797f4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:45.582747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581e3f7-cf49-4308-9709-badf7c2797f4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:45.588285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe39bb-6ea1-4a0f-8325-97bbd15f9a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:45.589038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe39bb-6ea1-4a0f-8325-97bbd15f9a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:45.589328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe39bb-6ea1-4a0f-8325-97bbd15f9a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:45.589605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe39bb-6ea1-4a0f-8325-97bbd15f9a26 admin admin] PATH_INFO: `/v3/projects/c3001c93c94c45fe9cd98aabdae3af9d/users/78162c558ced44a9991f777185a2dfcb/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:45.592155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe39bb-6ea1-4a0f-8325-97bbd15f9a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3001c93c94c45fe9cd98aabdae3af9d, user_id=78162c558ced44a9991f777185a2dfcb, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:45.594896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe39bb-6ea1-4a0f-8325-97bbd15f9a26 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:45.628989 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4190/8427] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:39:45 2022] PUT /identity/v3/projects/c3001c93c94c45fe9cd98aabdae3af9d/users/78162c558ced44a9991f777185a2dfcb/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:39:45.631890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612fd2f-563e-4a03-812d-d7e830c954b0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:45.632221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612fd2f-563e-4a03-812d-d7e830c954b0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:45.633164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612fd2f-563e-4a03-812d-d7e830c954b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:45.711285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a612fd2f-563e-4a03-812d-d7e830c954b0 None None] MFA Rules not processed for user `78162c558ced44a9991f777185a2dfcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:45.712677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a612fd2f-563e-4a03-812d-d7e830c954b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:45.745269 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:45.860612 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4238/8428] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:45.878300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe39bb-6ea1-4a0f-8325-97bbd15f9a26 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:45.880440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6bbe39bb-6ea1-4a0f-8325-97bbd15f9a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:46.137225 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe39bb-6ea1-4a0f-8325-97bbd15f9a26 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:46.149693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11b566-4d74-4345-baa9-e95f05e6bce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:46.150739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b566-4d74-4345-baa9-e95f05e6bce0 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:46.151008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b566-4d74-4345-baa9-e95f05e6bce0 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:46.151295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b566-4d74-4345-baa9-e95f05e6bce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:46.241414 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:46.250130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11b566-4d74-4345-baa9-e95f05e6bce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:46.253393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11b566-4d74-4345-baa9-e95f05e6bce0 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:46.286118 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4191/8429] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:39:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:39:50.168671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612fd2f-563e-4a03-812d-d7e830c954b0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:50.170166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a612fd2f-563e-4a03-812d-d7e830c954b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:50.311233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612fd2f-563e-4a03-812d-d7e830c954b0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:50.319401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087bf4d-fdeb-49be-bf30-f0d5acf4042b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:50.320331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087bf4d-fdeb-49be-bf30-f0d5acf4042b service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:50.320621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087bf4d-fdeb-49be-bf30-f0d5acf4042b service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:50.321107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087bf4d-fdeb-49be-bf30-f0d5acf4042b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:50.322743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3087bf4d-fdeb-49be-bf30-f0d5acf4042b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:50.342089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087bf4d-fdeb-49be-bf30-f0d5acf4042b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:50.342949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087bf4d-fdeb-49be-bf30-f0d5acf4042b service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:50.360263 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4239/8430] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:39:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:39:51.399726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11b566-4d74-4345-baa9-e95f05e6bce0 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:51.401235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c11b566-4d74-4345-baa9-e95f05e6bce0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:51.534052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11b566-4d74-4345-baa9-e95f05e6bce0 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:51.558476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3bf39-eede-4db5-af41-94dd36103077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:51.559662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3bf39-eede-4db5-af41-94dd36103077 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:51.560253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3bf39-eede-4db5-af41-94dd36103077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:51.561565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3bf39-eede-4db5-af41-94dd36103077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:51.577320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3bf39-eede-4db5-af41-94dd36103077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:51.579458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3bf39-eede-4db5-af41-94dd36103077 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:51.592714 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4192/8431] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:39:51 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:39:55.580748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a551fd3-2bd6-47ce-a40e-c3793927fe1a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:55.581864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a551fd3-2bd6-47ce-a40e-c3793927fe1a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:55.582347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a551fd3-2bd6-47ce-a40e-c3793927fe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:55.637036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4a551fd3-2bd6-47ce-a40e-c3793927fe1a None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:55.641074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4a551fd3-2bd6-47ce-a40e-c3793927fe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:55.784210 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4240/8432] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:39:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:39:55.803853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3bf39-eede-4db5-af41-94dd36103077 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:55.806946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8bb3bf39-eede-4db5-af41-94dd36103077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:55.973728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3bf39-eede-4db5-af41-94dd36103077 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:55.982894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13dba4-54fd-462c-8b50-493d8f1bc54b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:55.983555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13dba4-54fd-462c-8b50-493d8f1bc54b service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:55.983836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13dba4-54fd-462c-8b50-493d8f1bc54b service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:55.984111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13dba4-54fd-462c-8b50-493d8f1bc54b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:55.995088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13dba4-54fd-462c-8b50-493d8f1bc54b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:55.998329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13dba4-54fd-462c-8b50-493d8f1bc54b service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:56.012417 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4193/8433] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:39:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:39:57.469951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f6048-2149-48bd-ba8a-bcc73e1a7032 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:57.470770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f6048-2149-48bd-ba8a-bcc73e1a7032 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:57.470770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f6048-2149-48bd-ba8a-bcc73e1a7032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:57.527690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dd7f6048-2149-48bd-ba8a-bcc73e1a7032 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:57.537236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dd7f6048-2149-48bd-ba8a-bcc73e1a7032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:57.538585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675601-a29a-4ff0-b0d7-123f8068c44a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:57.539103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675601-a29a-4ff0-b0d7-123f8068c44a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:57.539206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675601-a29a-4ff0-b0d7-123f8068c44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:57.554161 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4241/8434] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:57.580271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f6048-2149-48bd-ba8a-bcc73e1a7032 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:57.594761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cf675601-a29a-4ff0-b0d7-123f8068c44a None None] MFA Rules not processed for user `4ac7b60e4e094354a9692bb46c3ebf8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:57.596256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf675601-a29a-4ff0-b0d7-123f8068c44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:57.598148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f6048-2149-48bd-ba8a-bcc73e1a7032 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:57.606928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709992bf-f47b-4749-bbc8-3b748528ebf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:57.610144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709992bf-f47b-4749-bbc8-3b748528ebf0 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:57.612289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709992bf-f47b-4749-bbc8-3b748528ebf0 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:57.613034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709992bf-f47b-4749-bbc8-3b748528ebf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:57.624075 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4194/8435] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:57.645184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709992bf-f47b-4749-bbc8-3b748528ebf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:57.654421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709992bf-f47b-4749-bbc8-3b748528ebf0 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:57.702425 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4242/8436] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:39:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:39:58.444149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7b6c-fd7c-43e6-ab04-d994d9491248 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:58.444743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7b6c-fd7c-43e6-ab04-d994d9491248 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:58.445233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7b6c-fd7c-43e6-ab04-d994d9491248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:58.503355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-336e7b6c-fd7c-43e6-ab04-d994d9491248 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:58.515285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-336e7b6c-fd7c-43e6-ab04-d994d9491248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:58.542551 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4195/8437] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:39:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:58.556224 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709992bf-f47b-4749-bbc8-3b748528ebf0 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:58.582388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709992bf-f47b-4749-bbc8-3b748528ebf0 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:58.601247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e38de-c1bf-4188-aa5a-a1d70fa03637 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:58.601884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e38de-c1bf-4188-aa5a-a1d70fa03637 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:58.602170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e38de-c1bf-4188-aa5a-a1d70fa03637 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:58.602439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e38de-c1bf-4188-aa5a-a1d70fa03637 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:58.639834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e38de-c1bf-4188-aa5a-a1d70fa03637 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:58.642779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e38de-c1bf-4188-aa5a-a1d70fa03637 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:58.683325 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4243/8438] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:39:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:39:59.640295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531990-4a4c-45ee-9ce8-6947093a3ab0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:59.641340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531990-4a4c-45ee-9ce8-6947093a3ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:59.641796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531990-4a4c-45ee-9ce8-6947093a3ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:59.693678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0a531990-4a4c-45ee-9ce8-6947093a3ab0 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:39:59.695269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0a531990-4a4c-45ee-9ce8-6947093a3ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:39:59.723564 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4196/8439] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:39:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:39:59.745037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e38de-c1bf-4188-aa5a-a1d70fa03637 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:39:59.772922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e38de-c1bf-4188-aa5a-a1d70fa03637 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:39:59.805652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87299cd-aa25-44cf-b39b-6d695130bff7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:39:59.809930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87299cd-aa25-44cf-b39b-6d695130bff7 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:39:59.812032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87299cd-aa25-44cf-b39b-6d695130bff7 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:39:59.813527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87299cd-aa25-44cf-b39b-6d695130bff7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:39:59.849673 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:39:59.873702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87299cd-aa25-44cf-b39b-6d695130bff7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:39:59.875377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87299cd-aa25-44cf-b39b-6d695130bff7 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:39:59.921445 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4244/8440] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:39:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:40:07.071382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a531990-4a4c-45ee-9ce8-6947093a3ab0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:07.073654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0a531990-4a4c-45ee-9ce8-6947093a3ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:07.076340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee1c11-a9b2-4037-a8ac-5ec48505b58e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:07.076812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee1c11-a9b2-4037-a8ac-5ec48505b58e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:07.076899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee1c11-a9b2-4037-a8ac-5ec48505b58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:07.141885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-66ee1c11-a9b2-4037-a8ac-5ec48505b58e None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:07.143867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-66ee1c11-a9b2-4037-a8ac-5ec48505b58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:07.156794 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4245/8441] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:40:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:40:07.171035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee1c11-a9b2-4037-a8ac-5ec48505b58e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:07.201999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee1c11-a9b2-4037-a8ac-5ec48505b58e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:07.214731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e1583-45bc-4065-a974-54a8efa72fa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:07.215740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e1583-45bc-4065-a974-54a8efa72fa1 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:07.216399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e1583-45bc-4065-a974-54a8efa72fa1 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:07.216999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e1583-45bc-4065-a974-54a8efa72fa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:07.236440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e1583-45bc-4065-a974-54a8efa72fa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:07.242233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e1583-45bc-4065-a974-54a8efa72fa1 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:07.253938 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4246/8442] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:40:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:40:07.302010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a531990-4a4c-45ee-9ce8-6947093a3ab0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:07.312077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:07.313663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:07.313961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:07.315375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] PATH_INFO: `/v3/users/ca07218a78254a05ba3f52a3a6109a3c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:07.318077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca07218a78254a05ba3f52a3a6109a3c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:07.321091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:07.338955 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:07.432796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca07218a78254a05ba3f52a3a6109a3c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:07.458810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca07218a78254a05ba3f52a3a6109a3c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:07.460170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca07218a78254a05ba3f52a3a6109a3c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:07.480520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca07218a78254a05ba3f52a3a6109a3c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:07.502460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca07218a78254a05ba3f52a3a6109a3c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:07.516410 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4197/8443] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:40:07 2022] DELETE /identity/v3/users/ca07218a78254a05ba3f52a3a6109a3c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:07.522486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64e85-2609-47f7-9b14-5d1f4ce9e8e3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:07.522719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64e85-2609-47f7-9b14-5d1f4ce9e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:07.523010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64e85-2609-47f7-9b14-5d1f4ce9e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:07.574089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3ea64e85-2609-47f7-9b14-5d1f4ce9e8e3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:07.579748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3ea64e85-2609-47f7-9b14-5d1f4ce9e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:07.798799 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4247/8444] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:07.824608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:07.827058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:07.946892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d755349-80f1-42ee-89e8-26b7d93e0c68 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:07.951938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af8022-0627-4c07-af07-7afba19dd5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:07.952610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af8022-0627-4c07-af07-7afba19dd5fc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:07.952869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af8022-0627-4c07-af07-7afba19dd5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:07.953151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af8022-0627-4c07-af07-7afba19dd5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:07.978850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af8022-0627-4c07-af07-7afba19dd5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:07.980295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af8022-0627-4c07-af07-7afba19dd5fc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:08.015349 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4198/8445] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:08.496001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64e85-2609-47f7-9b14-5d1f4ce9e8e3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:08.498413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3ea64e85-2609-47f7-9b14-5d1f4ce9e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:08.524219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64e85-2609-47f7-9b14-5d1f4ce9e8e3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:08.539097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:08.541017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:08.541838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:08.544151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] PATH_INFO: `/v3/projects/99b3208974714002ad7e4237b1f343d6` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:08.550397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b3208974714002ad7e4237b1f343d6)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:08.553726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:08.702657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b3208974714002ad7e4237b1f343d6', 'request_id': 'req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:08.721955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b3208974714002ad7e4237b1f343d6', 'request_id': 'req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:08.736283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b3208974714002ad7e4237b1f343d6', 'request_id': 'req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:08.757278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] The token cache is being invalidate because project 99b3208974714002ad7e4237b1f343d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:40:08.757602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:08.758257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:08.771072 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4248/8446] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:40:08 2022] DELETE /identity/v3/projects/99b3208974714002ad7e4237b1f343d6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:12.230546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af8022-0627-4c07-af07-7afba19dd5fc service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:12.232167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-29af8022-0627-4c07-af07-7afba19dd5fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:12.254961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af8022-0627-4c07-af07-7afba19dd5fc service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:12.351624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c30b5e-7815-44b2-9d68-7a8ea11f4075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:12.352285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30b5e-7815-44b2-9d68-7a8ea11f4075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:12.352569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30b5e-7815-44b2-9d68-7a8ea11f4075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:12.352850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30b5e-7815-44b2-9d68-7a8ea11f4075 admin admin] PATH_INFO: `/v3/users/dcf580f97641423a83eef98acc713946` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:12.354100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c30b5e-7815-44b2-9d68-7a8ea11f4075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf580f97641423a83eef98acc713946)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:12.356337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c30b5e-7815-44b2-9d68-7a8ea11f4075 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:12.423610 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:12.446867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49c30b5e-7815-44b2-9d68-7a8ea11f4075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf580f97641423a83eef98acc713946'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:12.474543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49c30b5e-7815-44b2-9d68-7a8ea11f4075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf580f97641423a83eef98acc713946'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:12.475932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49c30b5e-7815-44b2-9d68-7a8ea11f4075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf580f97641423a83eef98acc713946'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:12.495693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49c30b5e-7815-44b2-9d68-7a8ea11f4075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf580f97641423a83eef98acc713946'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:12.510007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-49c30b5e-7815-44b2-9d68-7a8ea11f4075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf580f97641423a83eef98acc713946'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:12.519863 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4199/8447] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:40:12 2022] DELETE /identity/v3/users/dcf580f97641423a83eef98acc713946 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:12.720917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:12.722683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:12.738086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1a81-0f92-4bd9-b08a-6c4745a41d32 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:12.793416 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:12.801372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:12.802303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:12.802722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:12.803203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] PATH_INFO: `/v3/projects/f1c510da44b8420aaefefc62b67f2bec` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:12.804793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c510da44b8420aaefefc62b67f2bec)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:12.807340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:12.854425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c510da44b8420aaefefc62b67f2bec', 'request_id': 'req-c196b0a6-d6f2-427b-8a65-3823426a3744'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:12.860159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c510da44b8420aaefefc62b67f2bec', 'request_id': 'req-c196b0a6-d6f2-427b-8a65-3823426a3744'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:12.867123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c510da44b8420aaefefc62b67f2bec', 'request_id': 'req-c196b0a6-d6f2-427b-8a65-3823426a3744'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:12.881648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] The token cache is being invalidate because project f1c510da44b8420aaefefc62b67f2bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:40:12.882345 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:12.883231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c196b0a6-d6f2-427b-8a65-3823426a3744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:12.890197 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4249/8448] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:40:12 2022] DELETE /identity/v3/projects/f1c510da44b8420aaefefc62b67f2bec => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:12.891600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d22bb-4f25-4cc1-bb70-96cd1d5f67bd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:12.891963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d22bb-4f25-4cc1-bb70-96cd1d5f67bd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:12.892365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d22bb-4f25-4cc1-bb70-96cd1d5f67bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:12.914523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1e8d22bb-4f25-4cc1-bb70-96cd1d5f67bd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:12.915795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1e8d22bb-4f25-4cc1-bb70-96cd1d5f67bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:12.993758 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4200/8449] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:13.002491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73aeb4-13a2-4a1f-a314-85654eccd752 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:13.002822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73aeb4-13a2-4a1f-a314-85654eccd752 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:13.003122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73aeb4-13a2-4a1f-a314-85654eccd752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:13.031737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4c73aeb4-13a2-4a1f-a314-85654eccd752 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:13.033337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4c73aeb4-13a2-4a1f-a314-85654eccd752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:13.045488 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4250/8450] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:13.046930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d22bb-4f25-4cc1-bb70-96cd1d5f67bd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:13.059127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d22bb-4f25-4cc1-bb70-96cd1d5f67bd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:13.064591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d783393-d4e1-463a-9f95-302ed04a160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:13.065226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d783393-d4e1-463a-9f95-302ed04a160f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:13.065510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d783393-d4e1-463a-9f95-302ed04a160f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:13.065785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d783393-d4e1-463a-9f95-302ed04a160f admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:13.066436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d783393-d4e1-463a-9f95-302ed04a160f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:40:13.066788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d783393-d4e1-463a-9f95-302ed04a160f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:13.069457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d783393-d4e1-463a-9f95-302ed04a160f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:13.086991 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4201/8451] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:40:13.091498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73aeb4-13a2-4a1f-a314-85654eccd752 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:13.101288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73aeb4-13a2-4a1f-a314-85654eccd752 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:13.106226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39a1fa-ad07-4fe5-b960-d82fe66e1c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:13.107444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39a1fa-ad07-4fe5-b960-d82fe66e1c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:13.107722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39a1fa-ad07-4fe5-b960-d82fe66e1c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:13.107996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39a1fa-ad07-4fe5-b960-d82fe66e1c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:13.108632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39a1fa-ad07-4fe5-b960-d82fe66e1c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:13.111378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39a1fa-ad07-4fe5-b960-d82fe66e1c9a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:13.139604 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4251/8452] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:40:13 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:13.143945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d783393-d4e1-463a-9f95-302ed04a160f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:13.154170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d783393-d4e1-463a-9f95-302ed04a160f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:13.218208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6fc64-aae9-41c3-9d3f-5247824385ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:13.218903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6fc64-aae9-41c3-9d3f-5247824385ae admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:13.219186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6fc64-aae9-41c3-9d3f-5247824385ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:13.219489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6fc64-aae9-41c3-9d3f-5247824385ae admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:13.220203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6fc64-aae9-41c3-9d3f-5247824385ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:13.222392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6fc64-aae9-41c3-9d3f-5247824385ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:13.252876 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4202/8453] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:40:13 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:13.255841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39a1fa-ad07-4fe5-b960-d82fe66e1c9a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:13.267982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39a1fa-ad07-4fe5-b960-d82fe66e1c9a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:13.274529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a7487-6cf6-45d9-855f-2aac65b48d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:13.275175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a7487-6cf6-45d9-855f-2aac65b48d06 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:13.275456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a7487-6cf6-45d9-855f-2aac65b48d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:13.275731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a7487-6cf6-45d9-855f-2aac65b48d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:13.276626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a7487-6cf6-45d9-855f-2aac65b48d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:13.278409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a7487-6cf6-45d9-855f-2aac65b48d06 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:13.292239 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4252/8454] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:13.296048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6fc64-aae9-41c3-9d3f-5247824385ae admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:13.317643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6fc64-aae9-41c3-9d3f-5247824385ae admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:13.350669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5dbd0-80fd-4943-9399-46b7a43b47bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:13.350669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5dbd0-80fd-4943-9399-46b7a43b47bf admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:13.350669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5dbd0-80fd-4943-9399-46b7a43b47bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:13.350669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5dbd0-80fd-4943-9399-46b7a43b47bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:13.351271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5dbd0-80fd-4943-9399-46b7a43b47bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:13.351755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5dbd0-80fd-4943-9399-46b7a43b47bf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:13.372622 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4203/8455] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:40:13.374672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a7487-6cf6-45d9-855f-2aac65b48d06 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:13.390259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a7487-6cf6-45d9-855f-2aac65b48d06 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:13.402056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82e802-58e3-45f2-bd65-708ecf67eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:13.404161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82e802-58e3-45f2-bd65-708ecf67eb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:13.404453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82e802-58e3-45f2-bd65-708ecf67eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:13.404737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82e802-58e3-45f2-bd65-708ecf67eb8b admin admin] PATH_INFO: `/v3/projects/9da993cd67924787914612c9ab771fd7/users/f2859f324b1b490287ef1cfff18995ef/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:13.453007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82e802-58e3-45f2-bd65-708ecf67eb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da993cd67924787914612c9ab771fd7, user_id=f2859f324b1b490287ef1cfff18995ef, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:13.455876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82e802-58e3-45f2-bd65-708ecf67eb8b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:13.498164 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4253/8456] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:40:13 2022] PUT /identity/v3/projects/9da993cd67924787914612c9ab771fd7/users/f2859f324b1b490287ef1cfff18995ef/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:13.500940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe35f5-72d3-4823-b37e-eb06dc8e2847 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:13.502634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe35f5-72d3-4823-b37e-eb06dc8e2847 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:13.503161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe35f5-72d3-4823-b37e-eb06dc8e2847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:13.547235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bbfe35f5-72d3-4823-b37e-eb06dc8e2847 None None] MFA Rules not processed for user `f2859f324b1b490287ef1cfff18995ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:13.549189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bbfe35f5-72d3-4823-b37e-eb06dc8e2847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:13.554393 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:13.699817 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4204/8457] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:13.714181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82e802-58e3-45f2-bd65-708ecf67eb8b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:13.716764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7b82e802-58e3-45f2-bd65-708ecf67eb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:13.872895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82e802-58e3-45f2-bd65-708ecf67eb8b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:13.884260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8657ca2-dfe6-4f9a-acb9-f1b884a9dcd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:13.885258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8657ca2-dfe6-4f9a-acb9-f1b884a9dcd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:13.885823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8657ca2-dfe6-4f9a-acb9-f1b884a9dcd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:13.886457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8657ca2-dfe6-4f9a-acb9-f1b884a9dcd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:13.903250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8657ca2-dfe6-4f9a-acb9-f1b884a9dcd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:13.904759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8657ca2-dfe6-4f9a-acb9-f1b884a9dcd1 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:13.919465 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4254/8458] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:16.377731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe35f5-72d3-4823-b37e-eb06dc8e2847 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:16.379823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bbfe35f5-72d3-4823-b37e-eb06dc8e2847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:16.492697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe35f5-72d3-4823-b37e-eb06dc8e2847 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:16.506293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179923d-46e4-4e17-9e49-cd50f7880c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:16.510463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179923d-46e4-4e17-9e49-cd50f7880c7f service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:16.510920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179923d-46e4-4e17-9e49-cd50f7880c7f service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:16.511348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179923d-46e4-4e17-9e49-cd50f7880c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:16.514639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6179923d-46e4-4e17-9e49-cd50f7880c7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:16.542947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179923d-46e4-4e17-9e49-cd50f7880c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:16.545353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179923d-46e4-4e17-9e49-cd50f7880c7f service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:16.565641 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4205/8459] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:22.676780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8657ca2-dfe6-4f9a-acb9-f1b884a9dcd1 service cinder] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:22.679211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b8657ca2-dfe6-4f9a-acb9-f1b884a9dcd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:22.740709 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:22.790570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8657ca2-dfe6-4f9a-acb9-f1b884a9dcd1 service cinder] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:22.796405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:22.797998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:22.798505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:22.799034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] PATH_INFO: `/v3/users/cae850e6c84a4d11963a512c786c88e7` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:22.800373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae850e6c84a4d11963a512c786c88e7)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:22.802751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:22.865629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae850e6c84a4d11963a512c786c88e7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:22.880599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae850e6c84a4d11963a512c786c88e7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:22.881329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae850e6c84a4d11963a512c786c88e7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:22.889876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae850e6c84a4d11963a512c786c88e7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:22.890503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae850e6c84a4d11963a512c786c88e7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:22.911641 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4255/8460] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:40:22 2022] DELETE /identity/v3/users/cae850e6c84a4d11963a512c786c88e7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:22.915810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d30e-5a17-4c68-aed4-f704fe06dd89 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:22.916371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d30e-5a17-4c68-aed4-f704fe06dd89 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:22.916371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d30e-5a17-4c68-aed4-f704fe06dd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:22.938103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c935d30e-5a17-4c68-aed4-f704fe06dd89 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:22.939400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c935d30e-5a17-4c68-aed4-f704fe06dd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:23.031417 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4206/8461] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:40:23.040452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:23.041977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:23.117441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f12fcf-441b-4dd1-bf78-b75cc47d9a69 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:23.124819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911941cf-6715-4b96-a95c-a76739bf6981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:23.126188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911941cf-6715-4b96-a95c-a76739bf6981 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:23.126562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911941cf-6715-4b96-a95c-a76739bf6981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:23.127065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911941cf-6715-4b96-a95c-a76739bf6981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:23.138769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911941cf-6715-4b96-a95c-a76739bf6981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:23.140606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911941cf-6715-4b96-a95c-a76739bf6981 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:23.155744 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4256/8462] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:23.500341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d30e-5a17-4c68-aed4-f704fe06dd89 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:23.502162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c935d30e-5a17-4c68-aed4-f704fe06dd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:23.522493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d30e-5a17-4c68-aed4-f704fe06dd89 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:23.545929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:23.548459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:23.548852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:23.563231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] PATH_INFO: `/v3/projects/685b93141a3e4728a75512d11b80ce3b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:23.565832 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=685b93141a3e4728a75512d11b80ce3b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:23.567860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:23.621017 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:23.649223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '685b93141a3e4728a75512d11b80ce3b', 'request_id': 'req-dc411065-4c50-4573-96de-c33720612f72'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:23.659371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '685b93141a3e4728a75512d11b80ce3b', 'request_id': 'req-dc411065-4c50-4573-96de-c33720612f72'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:23.666406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '685b93141a3e4728a75512d11b80ce3b', 'request_id': 'req-dc411065-4c50-4573-96de-c33720612f72'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:23.683351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] The token cache is being invalidate because project 685b93141a3e4728a75512d11b80ce3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:40:23.683700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:23.684471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc411065-4c50-4573-96de-c33720612f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:23.686991 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4207/8463] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:40:23 2022] DELETE /identity/v3/projects/685b93141a3e4728a75512d11b80ce3b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:23.692879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2f065-245b-4196-bc06-ca24f36755dc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:23.693417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2f065-245b-4196-bc06-ca24f36755dc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:23.693530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2f065-245b-4196-bc06-ca24f36755dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:23.715819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e4a2f065-245b-4196-bc06-ca24f36755dc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:23.717056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e4a2f065-245b-4196-bc06-ca24f36755dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:23.768681 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:23.803873 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4257/8464] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:23.812038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867106d-d928-4b5a-9de9-cd8e4b0746c0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:23.812331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867106d-d928-4b5a-9de9-cd8e4b0746c0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:23.812695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867106d-d928-4b5a-9de9-cd8e4b0746c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:23.844059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e867106d-d928-4b5a-9de9-cd8e4b0746c0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:23.845360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e867106d-d928-4b5a-9de9-cd8e4b0746c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:23.858821 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4208/8465] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:23.865034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2f065-245b-4196-bc06-ca24f36755dc None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:23.877696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2f065-245b-4196-bc06-ca24f36755dc None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:23.890064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0306-652b-4848-8ac1-beee8c34b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:23.890064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0306-652b-4848-8ac1-beee8c34b21a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:23.897046 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0306-652b-4848-8ac1-beee8c34b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:23.897451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0306-652b-4848-8ac1-beee8c34b21a admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:23.898186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e0306-652b-4848-8ac1-beee8c34b21a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:40:23.898504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e0306-652b-4848-8ac1-beee8c34b21a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:23.900177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e0306-652b-4848-8ac1-beee8c34b21a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:23.923523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867106d-d928-4b5a-9de9-cd8e4b0746c0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:23.924862 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4258/8466] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:40:23.936843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867106d-d928-4b5a-9de9-cd8e4b0746c0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:23.946261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73416676-1868-49ce-946a-104c695bf5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:23.946970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416676-1868-49ce-946a-104c695bf5ae admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:23.947259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416676-1868-49ce-946a-104c695bf5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:23.947561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416676-1868-49ce-946a-104c695bf5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:23.948213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73416676-1868-49ce-946a-104c695bf5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:23.950416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73416676-1868-49ce-946a-104c695bf5ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:23.988827 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4209/8467] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:40:23 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:40:24.000186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0306-652b-4848-8ac1-beee8c34b21a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.015978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0306-652b-4848-8ac1-beee8c34b21a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:24.074336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ccbfc-9538-44f5-aaa4-1876580dde08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:24.074974 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ccbfc-9538-44f5-aaa4-1876580dde08 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.075256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ccbfc-9538-44f5-aaa4-1876580dde08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.075526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ccbfc-9538-44f5-aaa4-1876580dde08 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.076177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ccbfc-9538-44f5-aaa4-1876580dde08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:24.078088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ccbfc-9538-44f5-aaa4-1876580dde08 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:24.099514 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4259/8468] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:40:23 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:24.103445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73416676-1868-49ce-946a-104c695bf5ae admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.114875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73416676-1868-49ce-946a-104c695bf5ae admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:24.119434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af24a6-cabc-4274-8d32-a42108b5670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:24.120034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af24a6-cabc-4274-8d32-a42108b5670c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.120352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af24a6-cabc-4274-8d32-a42108b5670c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.120624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af24a6-cabc-4274-8d32-a42108b5670c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.121263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af24a6-cabc-4274-8d32-a42108b5670c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:24.122911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af24a6-cabc-4274-8d32-a42108b5670c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:24.133110 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4210/8469] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:24.137010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ccbfc-9538-44f5-aaa4-1876580dde08 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.146867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ccbfc-9538-44f5-aaa4-1876580dde08 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:24.152056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccfa25-fa7c-4513-827f-152fbbf3c430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:24.152663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccfa25-fa7c-4513-827f-152fbbf3c430 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.152927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccfa25-fa7c-4513-827f-152fbbf3c430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.153200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccfa25-fa7c-4513-827f-152fbbf3c430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.154007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccfa25-fa7c-4513-827f-152fbbf3c430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:24.155445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccfa25-fa7c-4513-827f-152fbbf3c430 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:24.167529 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4260/8470] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:24.171688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af24a6-cabc-4274-8d32-a42108b5670c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.186521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af24a6-cabc-4274-8d32-a42108b5670c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:24.191837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f98c0-cbd6-4906-84af-d6d2378e8793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:24.192637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f98c0-cbd6-4906-84af-d6d2378e8793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.192959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f98c0-cbd6-4906-84af-d6d2378e8793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.193318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f98c0-cbd6-4906-84af-d6d2378e8793 admin admin] PATH_INFO: `/v3/projects/8ef9725c71164a6d9a8f39ec80a73748/users/97cb465affcf4b328550d1f7b4dfeddf/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.210235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f98c0-cbd6-4906-84af-d6d2378e8793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef9725c71164a6d9a8f39ec80a73748, user_id=97cb465affcf4b328550d1f7b4dfeddf, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:24.212958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f98c0-cbd6-4906-84af-d6d2378e8793 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:24.227072 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4211/8471] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:40:24 2022] PUT /identity/v3/projects/8ef9725c71164a6d9a8f39ec80a73748/users/97cb465affcf4b328550d1f7b4dfeddf/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:40:24.239174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2bcb2-b8d4-4941-9f22-f06fe9585338 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.239459 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2bcb2-b8d4-4941-9f22-f06fe9585338 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.239734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2bcb2-b8d4-4941-9f22-f06fe9585338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.271390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fdb2bcb2-b8d4-4941-9f22-f06fe9585338 None None] MFA Rules not processed for user `97cb465affcf4b328550d1f7b4dfeddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:24.272610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fdb2bcb2-b8d4-4941-9f22-f06fe9585338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:24.344641 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4261/8472] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:24.349794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f98c0-cbd6-4906-84af-d6d2378e8793 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.414000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f98c0-cbd6-4906-84af-d6d2378e8793 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:24.418659 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ce428-0a96-43e3-802f-b459e31d418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:24.419267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ce428-0a96-43e3-802f-b459e31d418c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.419542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ce428-0a96-43e3-802f-b459e31d418c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.419810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ce428-0a96-43e3-802f-b459e31d418c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.420427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ce428-0a96-43e3-802f-b459e31d418c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:24.422871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ce428-0a96-43e3-802f-b459e31d418c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:24.458743 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4212/8473] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:40:24 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:24.460329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2bcb2-b8d4-4941-9f22-f06fe9585338 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.473037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2bcb2-b8d4-4941-9f22-f06fe9585338 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:24.519807 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:24.536081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f344564-c842-43fc-bd4e-e167d8c97947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:24.536694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f344564-c842-43fc-bd4e-e167d8c97947 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.537102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f344564-c842-43fc-bd4e-e167d8c97947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.537454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f344564-c842-43fc-bd4e-e167d8c97947 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.538091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f344564-c842-43fc-bd4e-e167d8c97947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:24.541233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f344564-c842-43fc-bd4e-e167d8c97947 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:24.568402 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4262/8474] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:40:24 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:24.572573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ce428-0a96-43e3-802f-b459e31d418c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.584256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ce428-0a96-43e3-802f-b459e31d418c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:24.589208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0827c-85a5-4a08-ba4c-89769857ca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:24.589897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0827c-85a5-4a08-ba4c-89769857ca65 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.590254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0827c-85a5-4a08-ba4c-89769857ca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.590628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0827c-85a5-4a08-ba4c-89769857ca65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.591349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0827c-85a5-4a08-ba4c-89769857ca65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:24.593072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0827c-85a5-4a08-ba4c-89769857ca65 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:24.605277 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4213/8475] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:24.609456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f344564-c842-43fc-bd4e-e167d8c97947 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.620250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f344564-c842-43fc-bd4e-e167d8c97947 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:24.624869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130fe86-a0bd-4b79-9e8c-2399ff51442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:24.626085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130fe86-a0bd-4b79-9e8c-2399ff51442c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.626362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130fe86-a0bd-4b79-9e8c-2399ff51442c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.626758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130fe86-a0bd-4b79-9e8c-2399ff51442c admin admin] PATH_INFO: `/v3/projects/9dc649cd84f54bcb8ea541ed89246977/users/15d39db5317449428ae777d0bfca8df7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.642366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130fe86-a0bd-4b79-9e8c-2399ff51442c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc649cd84f54bcb8ea541ed89246977, user_id=15d39db5317449428ae777d0bfca8df7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:24.645109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130fe86-a0bd-4b79-9e8c-2399ff51442c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:24.659670 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4263/8476] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:40:24 2022] PUT /identity/v3/projects/9dc649cd84f54bcb8ea541ed89246977/users/15d39db5317449428ae777d0bfca8df7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:24.663665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0827c-85a5-4a08-ba4c-89769857ca65 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.674465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0827c-85a5-4a08-ba4c-89769857ca65 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:24.695509 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:24.748417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290d153-d57d-47ca-8e5e-af054c55bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:24.748978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290d153-d57d-47ca-8e5e-af054c55bec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.749288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290d153-d57d-47ca-8e5e-af054c55bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.749565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290d153-d57d-47ca-8e5e-af054c55bec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.750785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290d153-d57d-47ca-8e5e-af054c55bec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:24.752454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290d153-d57d-47ca-8e5e-af054c55bec7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:24.767574 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4214/8477] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:24.771628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130fe86-a0bd-4b79-9e8c-2399ff51442c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.782860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130fe86-a0bd-4b79-9e8c-2399ff51442c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:24.787681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f515457-c8c9-47d5-bdf8-7f183becf6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:24.788356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f515457-c8c9-47d5-bdf8-7f183becf6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.788639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f515457-c8c9-47d5-bdf8-7f183becf6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.788919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f515457-c8c9-47d5-bdf8-7f183becf6e7 admin admin] PATH_INFO: `/v3/projects/9dc649cd84f54bcb8ea541ed89246977/users/15d39db5317449428ae777d0bfca8df7/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.790918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f515457-c8c9-47d5-bdf8-7f183becf6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc649cd84f54bcb8ea541ed89246977, user_id=15d39db5317449428ae777d0bfca8df7, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:24.793708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f515457-c8c9-47d5-bdf8-7f183becf6e7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:24.805123 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4264/8478] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:40:24 2022] PUT /identity/v3/projects/9dc649cd84f54bcb8ea541ed89246977/users/15d39db5317449428ae777d0bfca8df7/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:24.816947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc0930-efc0-4710-bc0a-e3efc8c79325 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.817247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc0930-efc0-4710-bc0a-e3efc8c79325 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.817524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc0930-efc0-4710-bc0a-e3efc8c79325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.840853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f515457-c8c9-47d5-bdf8-7f183becf6e7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.842676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6f515457-c8c9-47d5-bdf8-7f183becf6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:24.862790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dabc0930-efc0-4710-bc0a-e3efc8c79325 None None] MFA Rules not processed for user `15d39db5317449428ae777d0bfca8df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:24.863634 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dabc0930-efc0-4710-bc0a-e3efc8c79325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:24.945257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f515457-c8c9-47d5-bdf8-7f183becf6e7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:24.951564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55539278-b4ba-492f-978f-bfafb761bc44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:24.952515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55539278-b4ba-492f-978f-bfafb761bc44 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:24.953241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55539278-b4ba-492f-978f-bfafb761bc44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:24.954481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55539278-b4ba-492f-978f-bfafb761bc44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:24.958470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-55539278-b4ba-492f-978f-bfafb761bc44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:24.979855 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4215/8479] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:24.995322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc0930-efc0-4710-bc0a-e3efc8c79325 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:24.996910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dabc0930-efc0-4710-bc0a-e3efc8c79325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:25.023049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc0930-efc0-4710-bc0a-e3efc8c79325 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:25.027906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c80a36-83bf-4514-9003-3af9418d9385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:25.028723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80a36-83bf-4514-9003-3af9418d9385 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:25.028990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80a36-83bf-4514-9003-3af9418d9385 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:25.029332 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80a36-83bf-4514-9003-3af9418d9385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:25.073065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55539278-b4ba-492f-978f-bfafb761bc44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:25.075217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55539278-b4ba-492f-978f-bfafb761bc44 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:25.099564 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4265/8480] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:25.115015 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c80a36-83bf-4514-9003-3af9418d9385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:25.116492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c80a36-83bf-4514-9003-3af9418d9385 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:25.132804 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4216/8481] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:25.733019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55539278-b4ba-492f-978f-bfafb761bc44 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:25.734641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-55539278-b4ba-492f-978f-bfafb761bc44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:25.801440 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:25.815649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c80a36-83bf-4514-9003-3af9418d9385 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:25.817101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-65c80a36-83bf-4514-9003-3af9418d9385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:25.836123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c80a36-83bf-4514-9003-3af9418d9385 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:25.841212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15ccbf-c9ab-4bc2-af32-84b7720c79c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:25.841955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ccbf-c9ab-4bc2-af32-84b7720c79c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:25.842087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55539278-b4ba-492f-978f-bfafb761bc44 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:25.842364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ccbf-c9ab-4bc2-af32-84b7720c79c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:25.842750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ccbf-c9ab-4bc2-af32-84b7720c79c9 admin admin] PATH_INFO: `/v3/users/6a1352ee9dbe4587800e17d8b3287252` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:25.844854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15ccbf-c9ab-4bc2-af32-84b7720c79c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1352ee9dbe4587800e17d8b3287252)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:25.846960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15ccbf-c9ab-4bc2-af32-84b7720c79c9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:25.847893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840c69c-8dca-4625-94e4-fafb9b0c60fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:25.848741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840c69c-8dca-4625-94e4-fafb9b0c60fc service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:25.849020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840c69c-8dca-4625-94e4-fafb9b0c60fc service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:25.849291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840c69c-8dca-4625-94e4-fafb9b0c60fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:25.851213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2840c69c-8dca-4625-94e4-fafb9b0c60fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:25.893794 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:25.903370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aa15ccbf-c9ab-4bc2-af32-84b7720c79c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1352ee9dbe4587800e17d8b3287252'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:25.922368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840c69c-8dca-4625-94e4-fafb9b0c60fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:25.924171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840c69c-8dca-4625-94e4-fafb9b0c60fc service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:25.925080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aa15ccbf-c9ab-4bc2-af32-84b7720c79c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1352ee9dbe4587800e17d8b3287252'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:25.925901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aa15ccbf-c9ab-4bc2-af32-84b7720c79c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1352ee9dbe4587800e17d8b3287252'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:25.933843 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4266/8482] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:40:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:40:25.936112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aa15ccbf-c9ab-4bc2-af32-84b7720c79c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1352ee9dbe4587800e17d8b3287252'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:25.945163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-aa15ccbf-c9ab-4bc2-af32-84b7720c79c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1352ee9dbe4587800e17d8b3287252'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:25.952278 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4217/8483] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:40:25 2022] DELETE /identity/v3/users/6a1352ee9dbe4587800e17d8b3287252 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:40:26.150725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840c69c-8dca-4625-94e4-fafb9b0c60fc service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:26.165233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840c69c-8dca-4625-94e4-fafb9b0c60fc service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:26.229386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:26.230175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:26.230516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:26.230890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] PATH_INFO: `/v3/projects/e3d1b3bb7d3e4d6e9ac2e77cd77a4642` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:26.233757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d1b3bb7d3e4d6e9ac2e77cd77a4642)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:26.235960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:26.301992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'request_id': 'req-4478593e-caad-4b2a-82fb-633536458872'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:26.309220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'request_id': 'req-4478593e-caad-4b2a-82fb-633536458872'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:26.317205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d1b3bb7d3e4d6e9ac2e77cd77a4642', 'request_id': 'req-4478593e-caad-4b2a-82fb-633536458872'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:26.334014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] The token cache is being invalidate because project e3d1b3bb7d3e4d6e9ac2e77cd77a4642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:40:26.334499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:26.335366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4478593e-caad-4b2a-82fb-633536458872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:26.337263 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4267/8484] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:40:26 2022] DELETE /identity/v3/projects/e3d1b3bb7d3e4d6e9ac2e77cd77a4642 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:26.342792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6285ab-1cd2-48cd-b05b-9ffb057afb42 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:26.343628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6285ab-1cd2-48cd-b05b-9ffb057afb42 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:26.344626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6285ab-1cd2-48cd-b05b-9ffb057afb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:26.366734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cb6285ab-1cd2-48cd-b05b-9ffb057afb42 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:26.368295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cb6285ab-1cd2-48cd-b05b-9ffb057afb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:26.448424 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4218/8485] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:26.458701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49830b3-e414-4caf-8167-8a226b696d67 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:26.459434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49830b3-e414-4caf-8167-8a226b696d67 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:26.459434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49830b3-e414-4caf-8167-8a226b696d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:26.483557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d49830b3-e414-4caf-8167-8a226b696d67 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:26.485289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d49830b3-e414-4caf-8167-8a226b696d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:26.493541 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4268/8486] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:26.497784 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6285ab-1cd2-48cd-b05b-9ffb057afb42 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:26.510412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6285ab-1cd2-48cd-b05b-9ffb057afb42 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:26.516070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36711e-7ec6-4288-8847-467ea193ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:26.516955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36711e-7ec6-4288-8847-467ea193ce75 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:26.517471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36711e-7ec6-4288-8847-467ea193ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:26.517823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36711e-7ec6-4288-8847-467ea193ce75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:26.518538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36711e-7ec6-4288-8847-467ea193ce75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:40:26.519072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36711e-7ec6-4288-8847-467ea193ce75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:26.520768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36711e-7ec6-4288-8847-467ea193ce75 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:26.536567 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4219/8487] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:40:26.538052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49830b3-e414-4caf-8167-8a226b696d67 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:26.550635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49830b3-e414-4caf-8167-8a226b696d67 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:26.556310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46b485-7f57-4644-9a97-30ff8d5534bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:26.557298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46b485-7f57-4644-9a97-30ff8d5534bf admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:26.557675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46b485-7f57-4644-9a97-30ff8d5534bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:26.558024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46b485-7f57-4644-9a97-30ff8d5534bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:26.558780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46b485-7f57-4644-9a97-30ff8d5534bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:26.560784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46b485-7f57-4644-9a97-30ff8d5534bf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:26.571819 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:26.608277 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4269/8488] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:40:26 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:26.612709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36711e-7ec6-4288-8847-467ea193ce75 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:26.626030 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36711e-7ec6-4288-8847-467ea193ce75 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:26.694274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd5268-1a0d-4914-9227-bb9f95070dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:26.694728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd5268-1a0d-4914-9227-bb9f95070dff admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:26.695106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd5268-1a0d-4914-9227-bb9f95070dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:26.695480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd5268-1a0d-4914-9227-bb9f95070dff admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:26.696209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd5268-1a0d-4914-9227-bb9f95070dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:26.698230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd5268-1a0d-4914-9227-bb9f95070dff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:26.726652 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4220/8489] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:40:26 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:40:26.726874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46b485-7f57-4644-9a97-30ff8d5534bf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:26.739372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46b485-7f57-4644-9a97-30ff8d5534bf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:26.744281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b0be-da5b-43bf-ab5d-7db5f2a6f020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:26.744891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b0be-da5b-43bf-ab5d-7db5f2a6f020 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:26.745167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b0be-da5b-43bf-ab5d-7db5f2a6f020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:26.745486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b0be-da5b-43bf-ab5d-7db5f2a6f020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:26.746129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950b0be-da5b-43bf-ab5d-7db5f2a6f020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:26.748506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950b0be-da5b-43bf-ab5d-7db5f2a6f020 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:26.759899 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4270/8490] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:26.763724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd5268-1a0d-4914-9227-bb9f95070dff admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:26.774286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd5268-1a0d-4914-9227-bb9f95070dff admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:26.779636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4097d8-bf6c-476d-a47d-443c0e3f4dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:26.780293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4097d8-bf6c-476d-a47d-443c0e3f4dcd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:26.780625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4097d8-bf6c-476d-a47d-443c0e3f4dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:26.780951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4097d8-bf6c-476d-a47d-443c0e3f4dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:26.781691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4097d8-bf6c-476d-a47d-443c0e3f4dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:26.783488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4097d8-bf6c-476d-a47d-443c0e3f4dcd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:26.795756 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4221/8491] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:26.800774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b0be-da5b-43bf-ab5d-7db5f2a6f020 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:26.812358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b0be-da5b-43bf-ab5d-7db5f2a6f020 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:26.818159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa003d-9433-4bea-99c1-98c34cd00695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:26.818948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa003d-9433-4bea-99c1-98c34cd00695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:26.819298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa003d-9433-4bea-99c1-98c34cd00695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:26.819639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa003d-9433-4bea-99c1-98c34cd00695 admin admin] PATH_INFO: `/v3/projects/34dbd4701bda4f45aede025625e8a70c/users/39237f8cb746437b9c4bdcf664648d23/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:26.847273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa003d-9433-4bea-99c1-98c34cd00695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34dbd4701bda4f45aede025625e8a70c, user_id=39237f8cb746437b9c4bdcf664648d23, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:26.850516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa003d-9433-4bea-99c1-98c34cd00695 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:26.866749 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4271/8492] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:40:26 2022] PUT /identity/v3/projects/34dbd4701bda4f45aede025625e8a70c/users/39237f8cb746437b9c4bdcf664648d23/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:26.872026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5620457-2ed2-4c41-a307-8d582f4d66a7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:26.872966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5620457-2ed2-4c41-a307-8d582f4d66a7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:26.872966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5620457-2ed2-4c41-a307-8d582f4d66a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:26.906367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d5620457-2ed2-4c41-a307-8d582f4d66a7 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:26.907924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5620457-2ed2-4c41-a307-8d582f4d66a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:26.933460 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:26.987495 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4222/8493] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:26.997935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa003d-9433-4bea-99c1-98c34cd00695 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:26.999834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-46fa003d-9433-4bea-99c1-98c34cd00695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:27.066982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa003d-9433-4bea-99c1-98c34cd00695 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:27.071084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1df7d2-db0a-4861-95b4-fbfdad1d5c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:27.071817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1df7d2-db0a-4861-95b4-fbfdad1d5c85 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:27.072231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1df7d2-db0a-4861-95b4-fbfdad1d5c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:27.072757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1df7d2-db0a-4861-95b4-fbfdad1d5c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:27.084536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1df7d2-db0a-4861-95b4-fbfdad1d5c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:27.086221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1df7d2-db0a-4861-95b4-fbfdad1d5c85 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:27.099586 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4272/8494] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:27.649485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5620457-2ed2-4c41-a307-8d582f4d66a7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:27.651477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5620457-2ed2-4c41-a307-8d582f4d66a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:27.673507 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5620457-2ed2-4c41-a307-8d582f4d66a7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:27.678106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83bd56-7a22-4f4a-b2f2-f8de2d0713be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:27.678892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83bd56-7a22-4f4a-b2f2-f8de2d0713be service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:27.679241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83bd56-7a22-4f4a-b2f2-f8de2d0713be service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:27.680144 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83bd56-7a22-4f4a-b2f2-f8de2d0713be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:27.682327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9e83bd56-7a22-4f4a-b2f2-f8de2d0713be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:27.769987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83bd56-7a22-4f4a-b2f2-f8de2d0713be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:27.771486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83bd56-7a22-4f4a-b2f2-f8de2d0713be service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:27.783405 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4223/8495] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:34.091348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4db2f-e581-4516-964d-6e14c0924710 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:34.091889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4db2f-e581-4516-964d-6e14c0924710 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:34.092192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4db2f-e581-4516-964d-6e14c0924710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:34.169318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-38b4db2f-e581-4516-964d-6e14c0924710 None None] MFA Rules not processed for user `39237f8cb746437b9c4bdcf664648d23`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:34.170793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-38b4db2f-e581-4516-964d-6e14c0924710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:34.325455 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4273/8496] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:34.335509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83bd56-7a22-4f4a-b2f2-f8de2d0713be service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:34.356242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83bd56-7a22-4f4a-b2f2-f8de2d0713be service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:34.372441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f09de-4262-466a-bebd-105183963a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:34.373047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f09de-4262-466a-bebd-105183963a2f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:34.373434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f09de-4262-466a-bebd-105183963a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:34.373804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f09de-4262-466a-bebd-105183963a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:34.375442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f09de-4262-466a-bebd-105183963a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:34.381117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f09de-4262-466a-bebd-105183963a2f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:34.439683 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4224/8497] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:40:34 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:34.443330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4db2f-e581-4516-964d-6e14c0924710 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:34.488254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4db2f-e581-4516-964d-6e14c0924710 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:34.584983 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:34.644050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09171ebd-db76-40fd-8daa-7ae3d6b932c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:34.644671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09171ebd-db76-40fd-8daa-7ae3d6b932c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:34.644945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09171ebd-db76-40fd-8daa-7ae3d6b932c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:34.645228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09171ebd-db76-40fd-8daa-7ae3d6b932c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:34.645883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09171ebd-db76-40fd-8daa-7ae3d6b932c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:34.648114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09171ebd-db76-40fd-8daa-7ae3d6b932c2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:34.709893 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4274/8498] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:40:34 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:34.714254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f09de-4262-466a-bebd-105183963a2f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:34.731984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f09de-4262-466a-bebd-105183963a2f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:34.742730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9d6bd-849b-47e8-afed-4aa67a1c5c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:34.742730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9d6bd-849b-47e8-afed-4aa67a1c5c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:34.742730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9d6bd-849b-47e8-afed-4aa67a1c5c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:34.743333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9d6bd-849b-47e8-afed-4aa67a1c5c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:34.744562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9d6bd-849b-47e8-afed-4aa67a1c5c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:34.747768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9d6bd-849b-47e8-afed-4aa67a1c5c37 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:34.763184 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4225/8499] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:34.768526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09171ebd-db76-40fd-8daa-7ae3d6b932c2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:34.787503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09171ebd-db76-40fd-8daa-7ae3d6b932c2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:34.819498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153e696-0ad2-4b92-9db2-f3922732e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:34.820695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153e696-0ad2-4b92-9db2-f3922732e4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:34.820988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153e696-0ad2-4b92-9db2-f3922732e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:34.821277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153e696-0ad2-4b92-9db2-f3922732e4f5 admin admin] PATH_INFO: `/v3/projects/991226255ee84b04885a36a7311bd137/users/dee978231d424f7a94f09fdfa97d7c04/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:34.868032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153e696-0ad2-4b92-9db2-f3922732e4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991226255ee84b04885a36a7311bd137, user_id=dee978231d424f7a94f09fdfa97d7c04, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:34.870957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153e696-0ad2-4b92-9db2-f3922732e4f5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:34.888239 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4275/8500] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:40:34 2022] PUT /identity/v3/projects/991226255ee84b04885a36a7311bd137/users/dee978231d424f7a94f09fdfa97d7c04/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:34.893055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9d6bd-849b-47e8-afed-4aa67a1c5c37 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:34.908785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9d6bd-849b-47e8-afed-4aa67a1c5c37 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:35.092824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecef63-890a-4b7e-9a94-8f0b837147d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:35.094240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecef63-890a-4b7e-9a94-8f0b837147d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:35.094639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecef63-890a-4b7e-9a94-8f0b837147d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:35.095052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecef63-890a-4b7e-9a94-8f0b837147d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:35.096067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecef63-890a-4b7e-9a94-8f0b837147d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:35.100321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecef63-890a-4b7e-9a94-8f0b837147d1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:35.155579 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4226/8501] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:35.156581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153e696-0ad2-4b92-9db2-f3922732e4f5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:35.177127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153e696-0ad2-4b92-9db2-f3922732e4f5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:35.190766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c4dc1-a81e-4434-a159-c4dc3a588677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:35.191457 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c4dc1-a81e-4434-a159-c4dc3a588677 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:35.191746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c4dc1-a81e-4434-a159-c4dc3a588677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:35.192027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c4dc1-a81e-4434-a159-c4dc3a588677 admin admin] PATH_INFO: `/v3/projects/991226255ee84b04885a36a7311bd137/users/dee978231d424f7a94f09fdfa97d7c04/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:35.200412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c4dc1-a81e-4434-a159-c4dc3a588677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991226255ee84b04885a36a7311bd137, user_id=dee978231d424f7a94f09fdfa97d7c04, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:35.204689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c4dc1-a81e-4434-a159-c4dc3a588677 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:35.231674 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4276/8502] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:40:35 2022] PUT /identity/v3/projects/991226255ee84b04885a36a7311bd137/users/dee978231d424f7a94f09fdfa97d7c04/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:40:36.102023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f63d8-c1e1-46d0-abbf-f9f692ced59b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:36.102498 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f63d8-c1e1-46d0-abbf-f9f692ced59b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:36.102898 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f63d8-c1e1-46d0-abbf-f9f692ced59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:36.138781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-898f63d8-c1e1-46d0-abbf-f9f692ced59b None None] MFA Rules not processed for user `97cb465affcf4b328550d1f7b4dfeddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:36.139591 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-898f63d8-c1e1-46d0-abbf-f9f692ced59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:36.167337 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:36.263362 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4227/8503] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:36.315371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c4dc1-a81e-4434-a159-c4dc3a588677 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:36.318034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a77c4dc1-a81e-4434-a159-c4dc3a588677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:36.517214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c4dc1-a81e-4434-a159-c4dc3a588677 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:36.535428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775429e-dade-4355-9a46-8baa86f99afd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:36.537211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775429e-dade-4355-9a46-8baa86f99afd service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:36.538530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775429e-dade-4355-9a46-8baa86f99afd service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:36.539261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775429e-dade-4355-9a46-8baa86f99afd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:36.545983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6775429e-dade-4355-9a46-8baa86f99afd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:36.834934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775429e-dade-4355-9a46-8baa86f99afd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:36.843745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775429e-dade-4355-9a46-8baa86f99afd service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:36.888244 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4277/8504] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:41.397716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f63d8-c1e1-46d0-abbf-f9f692ced59b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:41.547885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f63d8-c1e1-46d0-abbf-f9f692ced59b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:41.558412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066818-2e15-4928-b8ef-3a0219fd10d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:41.559077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066818-2e15-4928-b8ef-3a0219fd10d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:41.559366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066818-2e15-4928-b8ef-3a0219fd10d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:41.559639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066818-2e15-4928-b8ef-3a0219fd10d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:41.561411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ab066818-2e15-4928-b8ef-3a0219fd10d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:41.589466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab066818-2e15-4928-b8ef-3a0219fd10d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:41.591234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab066818-2e15-4928-b8ef-3a0219fd10d6 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:41.616343 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4228/8505] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:42.990968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80144a45-2ebc-40a7-a4d7-5c3efdf8f7c6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:42.990968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80144a45-2ebc-40a7-a4d7-5c3efdf8f7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:42.990968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80144a45-2ebc-40a7-a4d7-5c3efdf8f7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:43.053676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-80144a45-2ebc-40a7-a4d7-5c3efdf8f7c6 None None] MFA Rules not processed for user `dee978231d424f7a94f09fdfa97d7c04`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:43.058626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-80144a45-2ebc-40a7-a4d7-5c3efdf8f7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:43.110719 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:43.229344 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4278/8506] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:43.257119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066818-2e15-4928-b8ef-3a0219fd10d6 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:43.258781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ab066818-2e15-4928-b8ef-3a0219fd10d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:43.279859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066818-2e15-4928-b8ef-3a0219fd10d6 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:43.288071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3b22b-e662-48c2-8000-efb22d1ccd3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:43.289082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3b22b-e662-48c2-8000-efb22d1ccd3c service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:43.289518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3b22b-e662-48c2-8000-efb22d1ccd3c service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:43.289975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3b22b-e662-48c2-8000-efb22d1ccd3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:43.308058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3b22b-e662-48c2-8000-efb22d1ccd3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:43.309847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3b22b-e662-48c2-8000-efb22d1ccd3c service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:43.329778 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4229/8507] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:43.841874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80144a45-2ebc-40a7-a4d7-5c3efdf8f7c6 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:43.843642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-80144a45-2ebc-40a7-a4d7-5c3efdf8f7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:43.996487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80144a45-2ebc-40a7-a4d7-5c3efdf8f7c6 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:44.007644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace9546-bec7-4e80-959e-92dc2debcfe1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:44.008664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9546-bec7-4e80-959e-92dc2debcfe1 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:44.009162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9546-bec7-4e80-959e-92dc2debcfe1 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:44.009650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9546-bec7-4e80-959e-92dc2debcfe1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:44.012024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8ace9546-bec7-4e80-959e-92dc2debcfe1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:44.058755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace9546-bec7-4e80-959e-92dc2debcfe1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:44.065393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace9546-bec7-4e80-959e-92dc2debcfe1 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:44.084497 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4279/8508] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:44.439836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3b22b-e662-48c2-8000-efb22d1ccd3c service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:44.441622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e2d3b22b-e662-48c2-8000-efb22d1ccd3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:44.464964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3b22b-e662-48c2-8000-efb22d1ccd3c service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:44.475690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e5fa5-e4e2-4b30-a7ff-42e275698b01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:44.476596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e5fa5-e4e2-4b30-a7ff-42e275698b01 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:44.476978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e5fa5-e4e2-4b30-a7ff-42e275698b01 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:44.477352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e5fa5-e4e2-4b30-a7ff-42e275698b01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:44.479276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-985e5fa5-e4e2-4b30-a7ff-42e275698b01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:44.496267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e5fa5-e4e2-4b30-a7ff-42e275698b01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:44.497890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e5fa5-e4e2-4b30-a7ff-42e275698b01 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:44.511822 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4230/8509] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:49.688188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace9546-bec7-4e80-959e-92dc2debcfe1 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:49.708083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace9546-bec7-4e80-959e-92dc2debcfe1 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:49.719454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd717b-872e-4513-b9e6-5ef52b1f1d92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:49.720090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd717b-872e-4513-b9e6-5ef52b1f1d92 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:49.720370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd717b-872e-4513-b9e6-5ef52b1f1d92 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:49.720787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd717b-872e-4513-b9e6-5ef52b1f1d92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:49.723035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9bbd717b-872e-4513-b9e6-5ef52b1f1d92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:49.746811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd717b-872e-4513-b9e6-5ef52b1f1d92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:49.753903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd717b-872e-4513-b9e6-5ef52b1f1d92 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:49.804198 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4280/8510] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:50.400548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e5fa5-e4e2-4b30-a7ff-42e275698b01 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:50.416433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e5fa5-e4e2-4b30-a7ff-42e275698b01 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:50.420452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f7c73-76e4-45d0-a4fc-5655c877fe6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:50.421207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7c73-76e4-45d0-a4fc-5655c877fe6e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:50.421497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7c73-76e4-45d0-a4fc-5655c877fe6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:50.421782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7c73-76e4-45d0-a4fc-5655c877fe6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:50.424037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f66f7c73-76e4-45d0-a4fc-5655c877fe6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:50.439842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f7c73-76e4-45d0-a4fc-5655c877fe6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:50.441726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f7c73-76e4-45d0-a4fc-5655c877fe6e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:50.462564 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4231/8511] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:50.741595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd717b-872e-4513-b9e6-5ef52b1f1d92 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:50.760033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd717b-872e-4513-b9e6-5ef52b1f1d92 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:50.773133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86845ce9-c5e8-42c7-bc67-dcc96e666fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:50.774023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86845ce9-c5e8-42c7-bc67-dcc96e666fbd service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:50.774532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86845ce9-c5e8-42c7-bc67-dcc96e666fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:50.775550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86845ce9-c5e8-42c7-bc67-dcc96e666fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:50.783558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-86845ce9-c5e8-42c7-bc67-dcc96e666fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:50.821251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86845ce9-c5e8-42c7-bc67-dcc96e666fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:50.823094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86845ce9-c5e8-42c7-bc67-dcc96e666fbd service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:50.846509 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4281/8512] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:51.029104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f7c73-76e4-45d0-a4fc-5655c877fe6e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:51.062900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f7c73-76e4-45d0-a4fc-5655c877fe6e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:51.083276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255ec93-3292-44c2-a7d4-124980634270 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:51.084190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255ec93-3292-44c2-a7d4-124980634270 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:51.084670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255ec93-3292-44c2-a7d4-124980634270 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:51.085137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255ec93-3292-44c2-a7d4-124980634270 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:51.088119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0255ec93-3292-44c2-a7d4-124980634270 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:51.110556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255ec93-3292-44c2-a7d4-124980634270 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:51.126567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255ec93-3292-44c2-a7d4-124980634270 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:51.159100 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4232/8513] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:51.425196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86845ce9-c5e8-42c7-bc67-dcc96e666fbd service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:51.439562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86845ce9-c5e8-42c7-bc67-dcc96e666fbd service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:51.446153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62099e1f-4468-4fc5-9cfe-ad2405ce2974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:51.446823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62099e1f-4468-4fc5-9cfe-ad2405ce2974 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:51.449470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62099e1f-4468-4fc5-9cfe-ad2405ce2974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:51.449813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62099e1f-4468-4fc5-9cfe-ad2405ce2974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:51.458059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-62099e1f-4468-4fc5-9cfe-ad2405ce2974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:51.482838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62099e1f-4468-4fc5-9cfe-ad2405ce2974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:51.484655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62099e1f-4468-4fc5-9cfe-ad2405ce2974 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:51.513171 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4282/8514] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:55.142059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255ec93-3292-44c2-a7d4-124980634270 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:55.184798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255ec93-3292-44c2-a7d4-124980634270 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:55.185618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62099e1f-4468-4fc5-9cfe-ad2405ce2974 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:55.195288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c805d-13ee-4024-8f09-df49e30f115a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:55.196036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c805d-13ee-4024-8f09-df49e30f115a service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:55.196331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c805d-13ee-4024-8f09-df49e30f115a service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:55.196614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c805d-13ee-4024-8f09-df49e30f115a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:55.199930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9a7c805d-13ee-4024-8f09-df49e30f115a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:55.218895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c805d-13ee-4024-8f09-df49e30f115a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:55.221653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c805d-13ee-4024-8f09-df49e30f115a service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:55.242110 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4233/8515] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:40:55.281266 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:55.285303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62099e1f-4468-4fc5-9cfe-ad2405ce2974 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:55.291617 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:55.294239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:55.294570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:55.295024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] PATH_INFO: `/v3/users/39237f8cb746437b9c4bdcf664648d23` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:55.296915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] RBAC: Authorizing `identity:delete_user(user_id=39237f8cb746437b9c4bdcf664648d23)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:55.298950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:55.359562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39237f8cb746437b9c4bdcf664648d23'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:55.372659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39237f8cb746437b9c4bdcf664648d23'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:55.373968 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39237f8cb746437b9c4bdcf664648d23'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:55.383368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39237f8cb746437b9c4bdcf664648d23'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:55.383900 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39237f8cb746437b9c4bdcf664648d23'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:55.398950 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4283/8516] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:40:55 2022] DELETE /identity/v3/users/39237f8cb746437b9c4bdcf664648d23 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:55.622868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c805d-13ee-4024-8f09-df49e30f115a service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:55.645417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c805d-13ee-4024-8f09-df49e30f115a service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:55.746391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:55.747084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:55.747367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:55.747646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] PATH_INFO: `/v3/projects/34dbd4701bda4f45aede025625e8a70c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:55.748895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=34dbd4701bda4f45aede025625e8a70c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:55.750935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:55.754022 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:55.810106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34dbd4701bda4f45aede025625e8a70c', 'request_id': 'req-28056424-0940-4893-bce4-8a6ba46b2f3e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:55.818982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34dbd4701bda4f45aede025625e8a70c', 'request_id': 'req-28056424-0940-4893-bce4-8a6ba46b2f3e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:55.829737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34dbd4701bda4f45aede025625e8a70c', 'request_id': 'req-28056424-0940-4893-bce4-8a6ba46b2f3e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:55.847085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] The token cache is being invalidate because project 34dbd4701bda4f45aede025625e8a70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:40:55.847788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:55.848816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:55.850789 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4234/8517] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:40:55 2022] DELETE /identity/v3/projects/34dbd4701bda4f45aede025625e8a70c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:55.855147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:55.856678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:55.877532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fc660-af87-416e-b00d-5ee281e1004f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:55.948014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:55.948662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:55.949073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:55.949353 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] PATH_INFO: `/v3/users/dee978231d424f7a94f09fdfa97d7c04` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:55.950732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee978231d424f7a94f09fdfa97d7c04)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:55.953684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:56.036755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee978231d424f7a94f09fdfa97d7c04'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:56.053783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee978231d424f7a94f09fdfa97d7c04'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:56.054864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee978231d424f7a94f09fdfa97d7c04'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:56.077106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee978231d424f7a94f09fdfa97d7c04'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:56.077954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee978231d424f7a94f09fdfa97d7c04'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:56.095099 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:56.113366 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4284/8518] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:40:55 2022] DELETE /identity/v3/users/dee978231d424f7a94f09fdfa97d7c04 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:56.530850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:56.532972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:56.550817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28056424-0940-4893-bce4-8a6ba46b2f3e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:56.682049 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:56.682842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:56.683223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:56.683725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] PATH_INFO: `/v3/projects/991226255ee84b04885a36a7311bd137` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:56.687275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991226255ee84b04885a36a7311bd137)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:56.689369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:56.693886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:56.696846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:56.829386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991226255ee84b04885a36a7311bd137', 'request_id': 'req-d5d63340-7a79-44b1-802b-ab3d4c8adca5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:56.851601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991226255ee84b04885a36a7311bd137', 'request_id': 'req-d5d63340-7a79-44b1-802b-ab3d4c8adca5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:56.864054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991226255ee84b04885a36a7311bd137', 'request_id': 'req-d5d63340-7a79-44b1-802b-ab3d4c8adca5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:56.892513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] The token cache is being invalidate because project 991226255ee84b04885a36a7311bd137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:40:56.893161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:56.894286 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d5d63340-7a79-44b1-802b-ab3d4c8adca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:40:56.896156 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4235/8519] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:40:56 2022] DELETE /identity/v3/projects/991226255ee84b04885a36a7311bd137 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:56.909870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787933a-4c8a-4b91-80ed-f9eacc820be8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:56.911595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67b0dd-1aa7-4943-bc3e-62dcf41c7543 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:56.912917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787933a-4c8a-4b91-80ed-f9eacc820be8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:56.913343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787933a-4c8a-4b91-80ed-f9eacc820be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:56.942612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5787933a-4c8a-4b91-80ed-f9eacc820be8 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:56.944012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5787933a-4c8a-4b91-80ed-f9eacc820be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:56.965191 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:57.035481 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4236/8520] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:57.036528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5928-0760-469d-828d-d3cf6e44fb53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:57.037187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5928-0760-469d-828d-d3cf6e44fb53 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:57.037477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5928-0760-469d-828d-d3cf6e44fb53 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:57.037840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5928-0760-469d-828d-d3cf6e44fb53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:57.039963 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-31ad5928-0760-469d-828d-d3cf6e44fb53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:57.043963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece504-7434-4949-9809-b7214acaa405 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:57.044496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece504-7434-4949-9809-b7214acaa405 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:57.044971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece504-7434-4949-9809-b7214acaa405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:57.058365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad5928-0760-469d-828d-d3cf6e44fb53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:57.060903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad5928-0760-469d-828d-d3cf6e44fb53 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:57.073582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-98ece504-7434-4949-9809-b7214acaa405 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:57.074911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-98ece504-7434-4949-9809-b7214acaa405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:57.084615 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4237/8521] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:57.088783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ece504-7434-4949-9809-b7214acaa405 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:57.099001 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4285/8522] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:40:57.104538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ece504-7434-4949-9809-b7214acaa405 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:57.111461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ba10b-abcd-43d0-8cf4-1f7b4282eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:57.112178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ba10b-abcd-43d0-8cf4-1f7b4282eb25 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:57.112522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ba10b-abcd-43d0-8cf4-1f7b4282eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:57.112866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ba10b-abcd-43d0-8cf4-1f7b4282eb25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:57.113670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ba10b-abcd-43d0-8cf4-1f7b4282eb25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:40:57.114040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ba10b-abcd-43d0-8cf4-1f7b4282eb25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:57.115790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ba10b-abcd-43d0-8cf4-1f7b4282eb25 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:57.142240 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4238/8523] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:40:57.147034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5928-0760-469d-828d-d3cf6e44fb53 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:57.161358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5928-0760-469d-828d-d3cf6e44fb53 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:57.166925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd79b53-78a3-4fde-ac8f-1c2d7af5d255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:57.167647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79b53-78a3-4fde-ac8f-1c2d7af5d255 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:57.168542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79b53-78a3-4fde-ac8f-1c2d7af5d255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:57.168914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79b53-78a3-4fde-ac8f-1c2d7af5d255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:57.169645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd79b53-78a3-4fde-ac8f-1c2d7af5d255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:57.172469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd79b53-78a3-4fde-ac8f-1c2d7af5d255 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:57.212006 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4286/8524] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:40:57 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:40:57.216699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ba10b-abcd-43d0-8cf4-1f7b4282eb25 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:57.231364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ba10b-abcd-43d0-8cf4-1f7b4282eb25 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:57.317456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2b8d-04aa-41b4-8d04-30a64a0233a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:57.318133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2b8d-04aa-41b4-8d04-30a64a0233a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:57.318416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2b8d-04aa-41b4-8d04-30a64a0233a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:57.318905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2b8d-04aa-41b4-8d04-30a64a0233a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:57.319794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef2b8d-04aa-41b4-8d04-30a64a0233a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:57.321773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef2b8d-04aa-41b4-8d04-30a64a0233a8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:57.352894 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4239/8525] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:40:57 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:57.356924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd79b53-78a3-4fde-ac8f-1c2d7af5d255 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:57.371646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd79b53-78a3-4fde-ac8f-1c2d7af5d255 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:57.379848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d6af6-7c98-408a-91f9-2a009f4ead2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:57.380660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d6af6-7c98-408a-91f9-2a009f4ead2b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:57.381232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d6af6-7c98-408a-91f9-2a009f4ead2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:57.381679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d6af6-7c98-408a-91f9-2a009f4ead2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:57.382488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d6af6-7c98-408a-91f9-2a009f4ead2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:57.384431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d6af6-7c98-408a-91f9-2a009f4ead2b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:57.402236 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4287/8526] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:57.407392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2b8d-04aa-41b4-8d04-30a64a0233a8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:57.426135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2b8d-04aa-41b4-8d04-30a64a0233a8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:57.433564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddad1e-aac2-41d0-803e-5b59933ea53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:57.435694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddad1e-aac2-41d0-803e-5b59933ea53e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:57.438816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddad1e-aac2-41d0-803e-5b59933ea53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:57.439306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddad1e-aac2-41d0-803e-5b59933ea53e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:57.440151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddad1e-aac2-41d0-803e-5b59933ea53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:57.444083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddad1e-aac2-41d0-803e-5b59933ea53e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:57.479489 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4240/8527] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:57.483566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d6af6-7c98-408a-91f9-2a009f4ead2b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:57.497104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d6af6-7c98-408a-91f9-2a009f4ead2b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:57.506652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc25c92-eca7-41e9-b1e1-50b07de83aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:57.507662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc25c92-eca7-41e9-b1e1-50b07de83aab admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:57.508303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc25c92-eca7-41e9-b1e1-50b07de83aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:57.509073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc25c92-eca7-41e9-b1e1-50b07de83aab admin admin] PATH_INFO: `/v3/projects/24fa631aa4214c399af20711a739f128/users/a4554021870a4d6b9f7deca8ebfd3142/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:57.533581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc25c92-eca7-41e9-b1e1-50b07de83aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fa631aa4214c399af20711a739f128, user_id=a4554021870a4d6b9f7deca8ebfd3142, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:57.538082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc25c92-eca7-41e9-b1e1-50b07de83aab admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:57.557799 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4288/8528] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:40:57 2022] PUT /identity/v3/projects/24fa631aa4214c399af20711a739f128/users/a4554021870a4d6b9f7deca8ebfd3142/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:40:57.570024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60112d-78bf-4e78-b3e7-87e14cfa3941 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:57.570611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60112d-78bf-4e78-b3e7-87e14cfa3941 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:57.570611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60112d-78bf-4e78-b3e7-87e14cfa3941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:57.645054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dd60112d-78bf-4e78-b3e7-87e14cfa3941 None None] MFA Rules not processed for user `a4554021870a4d6b9f7deca8ebfd3142`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:57.646354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dd60112d-78bf-4e78-b3e7-87e14cfa3941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:57.779534 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4241/8529] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:57.781015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc25c92-eca7-41e9-b1e1-50b07de83aab admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:57.882462 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:57.964537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc25c92-eca7-41e9-b1e1-50b07de83aab admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:57.970032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcc4a7-39f0-4ef6-907b-d40614a9070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:57.970681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcc4a7-39f0-4ef6-907b-d40614a9070f admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:57.971023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcc4a7-39f0-4ef6-907b-d40614a9070f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:57.971304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcc4a7-39f0-4ef6-907b-d40614a9070f admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:57.971947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcc4a7-39f0-4ef6-907b-d40614a9070f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:57.973910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcc4a7-39f0-4ef6-907b-d40614a9070f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:58.009694 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4289/8530] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:40:57 2022] POST /identity/v3/projects => generated 389 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:58.010805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60112d-78bf-4e78-b3e7-87e14cfa3941 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:58.022945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60112d-78bf-4e78-b3e7-87e14cfa3941 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:58.033722 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:58.148167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe169544-17e1-4249-a45b-d5c9858ac60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:58.148923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe169544-17e1-4249-a45b-d5c9858ac60f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:58.149284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe169544-17e1-4249-a45b-d5c9858ac60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:58.151228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe169544-17e1-4249-a45b-d5c9858ac60f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:58.152062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe169544-17e1-4249-a45b-d5c9858ac60f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:58.156372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe169544-17e1-4249-a45b-d5c9858ac60f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:58.252701 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4242/8531] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:40:58 2022] POST /identity/v3/users => generated 295 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:40:58.256456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcc4a7-39f0-4ef6-907b-d40614a9070f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:58.267640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcc4a7-39f0-4ef6-907b-d40614a9070f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:58.282472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65d5d5-e558-4967-af44-8a22170ea1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:58.282472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65d5d5-e558-4967-af44-8a22170ea1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:58.282472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65d5d5-e558-4967-af44-8a22170ea1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:58.283100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65d5d5-e558-4967-af44-8a22170ea1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:58.283354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65d5d5-e558-4967-af44-8a22170ea1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:58.285577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65d5d5-e558-4967-af44-8a22170ea1f9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:58.322763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe169544-17e1-4249-a45b-d5c9858ac60f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:58.328061 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4290/8532] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:58.334392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe169544-17e1-4249-a45b-d5c9858ac60f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:58.341082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0efd3-21b2-4b89-81fb-c71e7780079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:58.342739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0efd3-21b2-4b89-81fb-c71e7780079a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:58.343482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0efd3-21b2-4b89-81fb-c71e7780079a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:58.343482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0efd3-21b2-4b89-81fb-c71e7780079a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:58.344091 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0efd3-21b2-4b89-81fb-c71e7780079a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:58.346031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0efd3-21b2-4b89-81fb-c71e7780079a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:58.365950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65d5d5-e558-4967-af44-8a22170ea1f9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:58.376991 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4243/8533] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:58.377518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65d5d5-e558-4967-af44-8a22170ea1f9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:58.384083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad5f05-d1bf-481a-95be-2ca80973a2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:58.394711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5f05-d1bf-481a-95be-2ca80973a2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:58.395004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5f05-d1bf-481a-95be-2ca80973a2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:58.395302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5f05-d1bf-481a-95be-2ca80973a2ff admin admin] PATH_INFO: `/v3/projects/6447ad90bc0a41db8e4c0b997a41de6b/users/91ab38d8471840f19735b2f95e0c9e44/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:58.423987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad5f05-d1bf-481a-95be-2ca80973a2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6447ad90bc0a41db8e4c0b997a41de6b, user_id=91ab38d8471840f19735b2f95e0c9e44, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:58.427105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad5f05-d1bf-481a-95be-2ca80973a2ff admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:58.466395 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4291/8534] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:40:58 2022] PUT /identity/v3/projects/6447ad90bc0a41db8e4c0b997a41de6b/users/91ab38d8471840f19735b2f95e0c9e44/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:58.485815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdfc30-fbcf-46c2-82cd-b8bbc0405c26 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:58.487202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdfc30-fbcf-46c2-82cd-b8bbc0405c26 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:58.487582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdfc30-fbcf-46c2-82cd-b8bbc0405c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:58.563970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c4fdfc30-fbcf-46c2-82cd-b8bbc0405c26 None None] MFA Rules not processed for user `91ab38d8471840f19735b2f95e0c9e44`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:58.565298 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c4fdfc30-fbcf-46c2-82cd-b8bbc0405c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:58.657704 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4244/8535] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:58.662130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad5f05-d1bf-481a-95be-2ca80973a2ff admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:58.739088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad5f05-d1bf-481a-95be-2ca80973a2ff admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:58.744085 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e766d5-194a-4f0e-b391-96e5a24a1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:58.744789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e766d5-194a-4f0e-b391-96e5a24a1cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:58.745104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e766d5-194a-4f0e-b391-96e5a24a1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:58.745383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e766d5-194a-4f0e-b391-96e5a24a1cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:58.746435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e766d5-194a-4f0e-b391-96e5a24a1cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:58.749120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e766d5-194a-4f0e-b391-96e5a24a1cbe admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:58.786022 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4292/8536] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:40:58 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:58.787859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdfc30-fbcf-46c2-82cd-b8bbc0405c26 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:58.799848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdfc30-fbcf-46c2-82cd-b8bbc0405c26 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:58.866394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1731690-6c2f-4e4a-a93e-3354ed2c9430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:58.867445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1731690-6c2f-4e4a-a93e-3354ed2c9430 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:58.867649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1731690-6c2f-4e4a-a93e-3354ed2c9430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:58.867969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1731690-6c2f-4e4a-a93e-3354ed2c9430 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:58.868638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1731690-6c2f-4e4a-a93e-3354ed2c9430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:58.870638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1731690-6c2f-4e4a-a93e-3354ed2c9430 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:58.895513 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4245/8537] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:40:58 2022] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:40:58.899653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e766d5-194a-4f0e-b391-96e5a24a1cbe admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:58.926686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e766d5-194a-4f0e-b391-96e5a24a1cbe admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:58.944625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c902f-1323-4f54-a5dc-a69b773bf821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:58.946110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c902f-1323-4f54-a5dc-a69b773bf821 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:58.946471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c902f-1323-4f54-a5dc-a69b773bf821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:58.946860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c902f-1323-4f54-a5dc-a69b773bf821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:58.947627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c902f-1323-4f54-a5dc-a69b773bf821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:58.954159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c902f-1323-4f54-a5dc-a69b773bf821 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:58.981548 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4293/8538] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:40:58.985955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1731690-6c2f-4e4a-a93e-3354ed2c9430 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:59.001799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1731690-6c2f-4e4a-a93e-3354ed2c9430 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:59.010288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02015aae-5ab6-4102-9100-87000ba6e59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:59.011105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02015aae-5ab6-4102-9100-87000ba6e59a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:59.011518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02015aae-5ab6-4102-9100-87000ba6e59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:59.011865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02015aae-5ab6-4102-9100-87000ba6e59a admin admin] PATH_INFO: `/v3/projects/3d9e84a6a3d8481f980fb178c1b1a4a8/users/f0dbb113f1094ecea455bf0107554b16/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:59.017827 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:59.034982 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02015aae-5ab6-4102-9100-87000ba6e59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9e84a6a3d8481f980fb178c1b1a4a8, user_id=f0dbb113f1094ecea455bf0107554b16, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:59.038155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02015aae-5ab6-4102-9100-87000ba6e59a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:59.053950 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4246/8539] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:40:58 2022] PUT /identity/v3/projects/3d9e84a6a3d8481f980fb178c1b1a4a8/users/f0dbb113f1094ecea455bf0107554b16/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:40:59.058404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c902f-1323-4f54-a5dc-a69b773bf821 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:59.070489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c902f-1323-4f54-a5dc-a69b773bf821 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:59.116100 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:40:59.130656 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0613479-3b06-4867-8f25-8aaf94d65638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:59.131148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613479-3b06-4867-8f25-8aaf94d65638 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:59.131427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613479-3b06-4867-8f25-8aaf94d65638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:59.131702 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613479-3b06-4867-8f25-8aaf94d65638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:59.132342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0613479-3b06-4867-8f25-8aaf94d65638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:59.133953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0613479-3b06-4867-8f25-8aaf94d65638 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:59.147946 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4294/8540] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:40:59.149388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02015aae-5ab6-4102-9100-87000ba6e59a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:59.161262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02015aae-5ab6-4102-9100-87000ba6e59a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:59.165996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd737d-7852-414c-a988-96e9b212e59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:59.166694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd737d-7852-414c-a988-96e9b212e59e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:59.166977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd737d-7852-414c-a988-96e9b212e59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:59.167252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd737d-7852-414c-a988-96e9b212e59e admin admin] PATH_INFO: `/v3/projects/3d9e84a6a3d8481f980fb178c1b1a4a8/users/f0dbb113f1094ecea455bf0107554b16/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:59.169240 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd737d-7852-414c-a988-96e9b212e59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9e84a6a3d8481f980fb178c1b1a4a8, user_id=f0dbb113f1094ecea455bf0107554b16, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:59.171993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd737d-7852-414c-a988-96e9b212e59e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:59.182828 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4247/8541] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:40:59 2022] PUT /identity/v3/projects/3d9e84a6a3d8481f980fb178c1b1a4a8/users/f0dbb113f1094ecea455bf0107554b16/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:40:59.193867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902167-a253-4a73-a78b-055ad05373d2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:59.194153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902167-a253-4a73-a78b-055ad05373d2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:59.194429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902167-a253-4a73-a78b-055ad05373d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:59.231149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-69902167-a253-4a73-a78b-055ad05373d2 None None] MFA Rules not processed for user `f0dbb113f1094ecea455bf0107554b16`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:40:59.232384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-69902167-a253-4a73-a78b-055ad05373d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:59.301556 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4295/8542] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:40:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:40:59.317217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd737d-7852-414c-a988-96e9b212e59e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:40:59.319026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-08dd737d-7852-414c-a988-96e9b212e59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:40:59.434733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd737d-7852-414c-a988-96e9b212e59e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:40:59.440650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e4d8-a456-4fd0-a858-93091e653d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:40:59.441282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e4d8-a456-4fd0-a858-93091e653d43 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:40:59.441566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e4d8-a456-4fd0-a858-93091e653d43 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:40:59.441841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e4d8-a456-4fd0-a858-93091e653d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:40:59.509470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716e4d8-a456-4fd0-a858-93091e653d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:40:59.511135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716e4d8-a456-4fd0-a858-93091e653d43 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:40:59.522798 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4248/8543] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:40:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:41:01.947672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69902167-a253-4a73-a78b-055ad05373d2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:01.949738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-69902167-a253-4a73-a78b-055ad05373d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:02.055424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69902167-a253-4a73-a78b-055ad05373d2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:02.059920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61692f-e331-4791-a5f1-21ca5dfefead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:02.060948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61692f-e331-4791-a5f1-21ca5dfefead service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:02.061633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61692f-e331-4791-a5f1-21ca5dfefead service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:02.062118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61692f-e331-4791-a5f1-21ca5dfefead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:02.078518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61692f-e331-4791-a5f1-21ca5dfefead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:02.080146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61692f-e331-4791-a5f1-21ca5dfefead service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:02.094689 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4296/8544] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:41:01 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:41:06.201586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fade1e-c469-44a8-80d1-fecb6e87ef5e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:06.202177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fade1e-c469-44a8-80d1-fecb6e87ef5e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:06.202177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fade1e-c469-44a8-80d1-fecb6e87ef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:06.290696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-27fade1e-c469-44a8-80d1-fecb6e87ef5e None None] MFA Rules not processed for user `a4554021870a4d6b9f7deca8ebfd3142`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:06.292236 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-27fade1e-c469-44a8-80d1-fecb6e87ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:06.307275 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4249/8545] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:12.088637 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=72 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:16.270255 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=70,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:18.046983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61692f-e331-4791-a5f1-21ca5dfefead service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:18.048520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9d61692f-e331-4791-a5f1-21ca5dfefead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:18.120157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61692f-e331-4791-a5f1-21ca5dfefead service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:18.125249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:18.125884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:18.126167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:18.126446 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] PATH_INFO: `/v3/users/f2859f324b1b490287ef1cfff18995ef` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:18.127603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2859f324b1b490287ef1cfff18995ef)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:18.129536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:18.179608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2859f324b1b490287ef1cfff18995ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:18.192609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2859f324b1b490287ef1cfff18995ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:18.193383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2859f324b1b490287ef1cfff18995ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:18.201743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2859f324b1b490287ef1cfff18995ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:18.202201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2859f324b1b490287ef1cfff18995ef'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:18.215357 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4297/8546] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:41:18 2022] DELETE /identity/v3/users/f2859f324b1b490287ef1cfff18995ef => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:18.220526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d6669-945e-4448-b212-8a1f4e3d823c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:18.220991 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d6669-945e-4448-b212-8a1f4e3d823c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:18.221138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d6669-945e-4448-b212-8a1f4e3d823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:18.240509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-324d6669-945e-4448-b212-8a1f4e3d823c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:18.241644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-324d6669-945e-4448-b212-8a1f4e3d823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:18.301032 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4250/8547] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:18.311355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:18.312839 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:18.378200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c4db-c832-480e-9891-6cbbf792f460 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:18.381935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740edc-ac28-4886-b4da-8880177e7d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:18.382551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740edc-ac28-4886-b4da-8880177e7d89 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:18.382860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740edc-ac28-4886-b4da-8880177e7d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:18.383132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740edc-ac28-4886-b4da-8880177e7d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:18.393944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740edc-ac28-4886-b4da-8880177e7d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:18.395428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740edc-ac28-4886-b4da-8880177e7d89 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:18.405396 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4298/8548] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:41:18.699281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d6669-945e-4448-b212-8a1f4e3d823c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:18.704123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-324d6669-945e-4448-b212-8a1f4e3d823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:18.738576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d6669-945e-4448-b212-8a1f4e3d823c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:18.749935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:18.750609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:18.750908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:18.751180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] PATH_INFO: `/v3/projects/9da993cd67924787914612c9ab771fd7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:18.752403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da993cd67924787914612c9ab771fd7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:18.755080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:18.819619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da993cd67924787914612c9ab771fd7', 'request_id': 'req-71f59f41-d9be-4fff-9e66-f13e56bbd01f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:18.826670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da993cd67924787914612c9ab771fd7', 'request_id': 'req-71f59f41-d9be-4fff-9e66-f13e56bbd01f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:18.833237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da993cd67924787914612c9ab771fd7', 'request_id': 'req-71f59f41-d9be-4fff-9e66-f13e56bbd01f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:18.851185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] The token cache is being invalidate because project 9da993cd67924787914612c9ab771fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:41:18.851637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:18.852408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71f59f41-d9be-4fff-9e66-f13e56bbd01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:18.854367 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4251/8549] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:41:18 2022] DELETE /identity/v3/projects/9da993cd67924787914612c9ab771fd7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:18.859564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e686f48-8473-457d-bba3-a58c43f46a8b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:18.859970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e686f48-8473-457d-bba3-a58c43f46a8b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:18.860340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e686f48-8473-457d-bba3-a58c43f46a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:18.881049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2e686f48-8473-457d-bba3-a58c43f46a8b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:18.882419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2e686f48-8473-457d-bba3-a58c43f46a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:18.902694 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:18.949095 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4299/8550] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:18.957890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfd28-5fec-4491-bb64-4d0ef614f99e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:18.958184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfd28-5fec-4491-bb64-4d0ef614f99e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:18.958463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfd28-5fec-4491-bb64-4d0ef614f99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:18.987475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-137cfd28-5fec-4491-bb64-4d0ef614f99e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:18.989109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-137cfd28-5fec-4491-bb64-4d0ef614f99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:19.001343 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4252/8551] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:19.005836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e686f48-8473-457d-bba3-a58c43f46a8b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:19.018005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e686f48-8473-457d-bba3-a58c43f46a8b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:19.023404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5df667-bc26-491c-917b-51c56f94a646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:19.023404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5df667-bc26-491c-917b-51c56f94a646 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:19.023687 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5df667-bc26-491c-917b-51c56f94a646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:19.023955 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5df667-bc26-491c-917b-51c56f94a646 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:19.024684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5df667-bc26-491c-917b-51c56f94a646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:41:19.024914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5df667-bc26-491c-917b-51c56f94a646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:19.026540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5df667-bc26-491c-917b-51c56f94a646 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:19.042465 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4300/8552] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:41:19.043638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cfd28-5fec-4491-bb64-4d0ef614f99e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:19.059491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cfd28-5fec-4491-bb64-4d0ef614f99e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:19.065234 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ca42d-e472-4586-8747-b90e49c74759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:19.065920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ca42d-e472-4586-8747-b90e49c74759 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:19.066265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ca42d-e472-4586-8747-b90e49c74759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:19.066615 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ca42d-e472-4586-8747-b90e49c74759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:19.067274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ca42d-e472-4586-8747-b90e49c74759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:19.069201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ca42d-e472-4586-8747-b90e49c74759 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:19.097407 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4253/8553] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:41:19 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:41:19.101246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5df667-bc26-491c-917b-51c56f94a646 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:19.112406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5df667-bc26-491c-917b-51c56f94a646 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:19.176467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a74b43-70d6-4a36-9cfd-8df8ec53a5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:19.177073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a74b43-70d6-4a36-9cfd-8df8ec53a5cc admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:19.177352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a74b43-70d6-4a36-9cfd-8df8ec53a5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:19.177623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a74b43-70d6-4a36-9cfd-8df8ec53a5cc admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:19.178275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a74b43-70d6-4a36-9cfd-8df8ec53a5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:19.180244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a74b43-70d6-4a36-9cfd-8df8ec53a5cc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:19.203109 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4301/8554] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:41:19 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:41:19.207178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ca42d-e472-4586-8747-b90e49c74759 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:19.217894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ca42d-e472-4586-8747-b90e49c74759 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:19.222526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d68a8-ebca-4be1-b78e-db72afb53814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:19.223220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d68a8-ebca-4be1-b78e-db72afb53814 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:19.223735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d68a8-ebca-4be1-b78e-db72afb53814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:19.224014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d68a8-ebca-4be1-b78e-db72afb53814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:19.224655 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d68a8-ebca-4be1-b78e-db72afb53814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:19.226314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d68a8-ebca-4be1-b78e-db72afb53814 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:19.239636 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4254/8555] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:41:19.243474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a74b43-70d6-4a36-9cfd-8df8ec53a5cc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:19.253992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a74b43-70d6-4a36-9cfd-8df8ec53a5cc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:19.258879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b1e07-accb-4927-90ac-62cb55051daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:19.259485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b1e07-accb-4927-90ac-62cb55051daa admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:19.259762 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b1e07-accb-4927-90ac-62cb55051daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:19.260049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b1e07-accb-4927-90ac-62cb55051daa admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:19.260663 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b1e07-accb-4927-90ac-62cb55051daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:19.262248 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b1e07-accb-4927-90ac-62cb55051daa admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:19.274287 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4302/8556] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:41:19.278975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d68a8-ebca-4be1-b78e-db72afb53814 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:19.289651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d68a8-ebca-4be1-b78e-db72afb53814 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:19.295600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e931-c93c-437d-92ec-6b4b216c0629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:19.296394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e931-c93c-437d-92ec-6b4b216c0629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:19.296678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e931-c93c-437d-92ec-6b4b216c0629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:19.297010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e931-c93c-437d-92ec-6b4b216c0629 admin admin] PATH_INFO: `/v3/projects/9cba8f81c3974396aea3918b711e5803/users/ad4bf340951b4fd08e1cecccde3dae8a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:19.314398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5e931-c93c-437d-92ec-6b4b216c0629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cba8f81c3974396aea3918b711e5803, user_id=ad4bf340951b4fd08e1cecccde3dae8a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:19.317299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5e931-c93c-437d-92ec-6b4b216c0629 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:19.330467 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4255/8557] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:41:19 2022] PUT /identity/v3/projects/9cba8f81c3974396aea3918b711e5803/users/ad4bf340951b4fd08e1cecccde3dae8a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:41:19.340669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445c79b-6ad3-4002-ab7f-d1184fbebd09 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:19.341555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445c79b-6ad3-4002-ab7f-d1184fbebd09 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:19.341898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445c79b-6ad3-4002-ab7f-d1184fbebd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:19.371625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3445c79b-6ad3-4002-ab7f-d1184fbebd09 None None] MFA Rules not processed for user `ad4bf340951b4fd08e1cecccde3dae8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:19.372910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3445c79b-6ad3-4002-ab7f-d1184fbebd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:19.443522 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4303/8558] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:19.454983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e931-c93c-437d-92ec-6b4b216c0629 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:19.456712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eca5e931-c93c-437d-92ec-6b4b216c0629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:19.481738 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:19.548108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e931-c93c-437d-92ec-6b4b216c0629 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:19.551815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bc037-c81b-4364-a7d1-a9b26719f0c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:19.552429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bc037-c81b-4364-a7d1-a9b26719f0c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:19.552710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bc037-c81b-4364-a7d1-a9b26719f0c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:19.552985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bc037-c81b-4364-a7d1-a9b26719f0c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:19.562394 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bc037-c81b-4364-a7d1-a9b26719f0c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:19.563877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bc037-c81b-4364-a7d1-a9b26719f0c3 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:19.573105 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4256/8559] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:41:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:41:19.599727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445c79b-6ad3-4002-ab7f-d1184fbebd09 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:19.618457 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:19.664873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445c79b-6ad3-4002-ab7f-d1184fbebd09 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:19.670060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:19.670744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:19.671028 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:19.671304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] PATH_INFO: `/v3/users/ad4bf340951b4fd08e1cecccde3dae8a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:19.672444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4bf340951b4fd08e1cecccde3dae8a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:19.674381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:19.723058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4bf340951b4fd08e1cecccde3dae8a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:19.735710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4bf340951b4fd08e1cecccde3dae8a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:19.736430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4bf340951b4fd08e1cecccde3dae8a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:19.744340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4bf340951b4fd08e1cecccde3dae8a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:19.745040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4bf340951b4fd08e1cecccde3dae8a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:19.758378 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4304/8560] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:41:19 2022] DELETE /identity/v3/users/ad4bf340951b4fd08e1cecccde3dae8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:19.762886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b3be-0197-4954-b4e8-6f0bc279d2af None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:19.763317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b3be-0197-4954-b4e8-6f0bc279d2af None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:19.763698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b3be-0197-4954-b4e8-6f0bc279d2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:19.783084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8b36b3be-0197-4954-b4e8-6f0bc279d2af None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:19.784314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8b36b3be-0197-4954-b4e8-6f0bc279d2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:19.849366 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4257/8561] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:41:19.859946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:19.861368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:19.924710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880e27e-7633-4d60-a6e5-a0276955771c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:19.928701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707bbeb-cb10-4d4b-a910-e23f4cc10153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:19.929372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707bbeb-cb10-4d4b-a910-e23f4cc10153 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:19.929654 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707bbeb-cb10-4d4b-a910-e23f4cc10153 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:19.929930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707bbeb-cb10-4d4b-a910-e23f4cc10153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:19.939719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707bbeb-cb10-4d4b-a910-e23f4cc10153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:19.942469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707bbeb-cb10-4d4b-a910-e23f4cc10153 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:19.951462 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4305/8562] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:41:20.234957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36b3be-0197-4954-b4e8-6f0bc279d2af None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:20.236620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8b36b3be-0197-4954-b4e8-6f0bc279d2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:20.259630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36b3be-0197-4954-b4e8-6f0bc279d2af None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:20.265599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:20.266250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:20.266534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:20.266881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] PATH_INFO: `/v3/projects/9cba8f81c3974396aea3918b711e5803` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:20.268036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cba8f81c3974396aea3918b711e5803)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:20.269983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:20.319218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cba8f81c3974396aea3918b711e5803', 'request_id': 'req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:20.325146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cba8f81c3974396aea3918b711e5803', 'request_id': 'req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:20.334003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cba8f81c3974396aea3918b711e5803', 'request_id': 'req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:20.347633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] The token cache is being invalidate because project 9cba8f81c3974396aea3918b711e5803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:41:20.347922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:20.348543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fdb4bc83-08e4-4b42-8f53-40aa2cd525e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:20.350175 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4258/8563] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:41:20 2022] DELETE /identity/v3/projects/9cba8f81c3974396aea3918b711e5803 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:20.356586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53159-3d53-446e-a869-df7a64fe116d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:20.357741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53159-3d53-446e-a869-df7a64fe116d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:20.357741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53159-3d53-446e-a869-df7a64fe116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:20.377014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d9b53159-3d53-446e-a869-df7a64fe116d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:20.378222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d9b53159-3d53-446e-a869-df7a64fe116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:20.417423 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:20.448888 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4306/8564] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:20.457062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc32e5-7cf7-4fe5-9f99-53e2caf22c90 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:20.457348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc32e5-7cf7-4fe5-9f99-53e2caf22c90 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:20.457624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc32e5-7cf7-4fe5-9f99-53e2caf22c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:20.477177 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fddc32e5-7cf7-4fe5-9f99-53e2caf22c90 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:20.478389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fddc32e5-7cf7-4fe5-9f99-53e2caf22c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:20.487221 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4259/8565] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:20.491570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b53159-3d53-446e-a869-df7a64fe116d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:20.502063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b53159-3d53-446e-a869-df7a64fe116d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:20.507369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c0ec-d87f-4cba-b09e-594c56d9ce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:20.508097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c0ec-d87f-4cba-b09e-594c56d9ce2d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:20.508447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c0ec-d87f-4cba-b09e-594c56d9ce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:20.508795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c0ec-d87f-4cba-b09e-594c56d9ce2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:20.509653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9c0ec-d87f-4cba-b09e-594c56d9ce2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:41:20.510042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9c0ec-d87f-4cba-b09e-594c56d9ce2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:20.511860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9c0ec-d87f-4cba-b09e-594c56d9ce2d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:20.524418 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4307/8566] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:41:20.529321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc32e5-7cf7-4fe5-9f99-53e2caf22c90 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:20.539778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc32e5-7cf7-4fe5-9f99-53e2caf22c90 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:20.545006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16fb47-0440-482f-9d83-edc3c2e0e3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:20.545620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16fb47-0440-482f-9d83-edc3c2e0e3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:20.545905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16fb47-0440-482f-9d83-edc3c2e0e3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:20.546185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16fb47-0440-482f-9d83-edc3c2e0e3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:20.546857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16fb47-0440-482f-9d83-edc3c2e0e3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:20.549435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16fb47-0440-482f-9d83-edc3c2e0e3d5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:20.572569 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:20.584157 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4260/8567] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:41:20 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:41:20.585598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c0ec-d87f-4cba-b09e-594c56d9ce2d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:20.596113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c0ec-d87f-4cba-b09e-594c56d9ce2d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:20.654634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b05c29-5aa5-4a4b-ac77-de4877779f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:20.655266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05c29-5aa5-4a4b-ac77-de4877779f2c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:20.655567 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05c29-5aa5-4a4b-ac77-de4877779f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:20.655841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05c29-5aa5-4a4b-ac77-de4877779f2c admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:20.656493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b05c29-5aa5-4a4b-ac77-de4877779f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:20.658538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b05c29-5aa5-4a4b-ac77-de4877779f2c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:20.685587 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4308/8568] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:41:20 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:41:20.687155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16fb47-0440-482f-9d83-edc3c2e0e3d5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:20.697929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16fb47-0440-482f-9d83-edc3c2e0e3d5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:20.703017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97652c43-1f9f-4cb3-bf71-d6943206d533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:20.703626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97652c43-1f9f-4cb3-bf71-d6943206d533 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:20.703909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97652c43-1f9f-4cb3-bf71-d6943206d533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:20.704212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97652c43-1f9f-4cb3-bf71-d6943206d533 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:20.704859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97652c43-1f9f-4cb3-bf71-d6943206d533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:20.706468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97652c43-1f9f-4cb3-bf71-d6943206d533 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:20.718624 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4261/8569] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:41:20.721392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b05c29-5aa5-4a4b-ac77-de4877779f2c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:20.732510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b05c29-5aa5-4a4b-ac77-de4877779f2c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:20.737277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a353c-d0c1-4768-a2e8-f934bf0884f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:20.737880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a353c-d0c1-4768-a2e8-f934bf0884f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:20.738160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a353c-d0c1-4768-a2e8-f934bf0884f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:20.738438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a353c-d0c1-4768-a2e8-f934bf0884f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:20.739132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a353c-d0c1-4768-a2e8-f934bf0884f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:20.740811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a353c-d0c1-4768-a2e8-f934bf0884f1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:20.753146 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4309/8570] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:41:20.757909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97652c43-1f9f-4cb3-bf71-d6943206d533 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:20.768547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97652c43-1f9f-4cb3-bf71-d6943206d533 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:20.773314 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf1d8-9348-4248-9f1f-894dc463c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:20.774035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf1d8-9348-4248-9f1f-894dc463c477 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:20.774400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf1d8-9348-4248-9f1f-894dc463c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:20.774783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf1d8-9348-4248-9f1f-894dc463c477 admin admin] PATH_INFO: `/v3/projects/f1d201d3328f483595de62c5463edc4c/users/e06d0c6c5c6f45ecb37bf8298493be42/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:20.789722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caf1d8-9348-4248-9f1f-894dc463c477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d201d3328f483595de62c5463edc4c, user_id=e06d0c6c5c6f45ecb37bf8298493be42, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:20.792531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caf1d8-9348-4248-9f1f-894dc463c477 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:20.807514 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4262/8571] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:41:20 2022] PUT /identity/v3/projects/f1d201d3328f483595de62c5463edc4c/users/e06d0c6c5c6f45ecb37bf8298493be42/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:20.818075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ef5d-2e8a-430b-82af-4a2d428fcc39 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:20.818363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ef5d-2e8a-430b-82af-4a2d428fcc39 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:20.818661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ef5d-2e8a-430b-82af-4a2d428fcc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:20.848875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1737ef5d-2e8a-430b-82af-4a2d428fcc39 None None] MFA Rules not processed for user `e06d0c6c5c6f45ecb37bf8298493be42`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:20.850017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1737ef5d-2e8a-430b-82af-4a2d428fcc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:20.919145 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4310/8572] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:20.930128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf1d8-9348-4248-9f1f-894dc463c477 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:20.932192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a7caf1d8-9348-4248-9f1f-894dc463c477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:20.998168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf1d8-9348-4248-9f1f-894dc463c477 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:21.002048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fa1d4-9287-4554-800c-696378f6d49f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:21.002735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa1d4-9287-4554-800c-696378f6d49f service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:21.003020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa1d4-9287-4554-800c-696378f6d49f service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:21.003297 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa1d4-9287-4554-800c-696378f6d49f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:21.012564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fa1d4-9287-4554-800c-696378f6d49f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:21.014253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fa1d4-9287-4554-800c-696378f6d49f service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:21.024379 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4263/8573] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:41:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:41:30.915911 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:31.019857 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:34.283076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737ef5d-2e8a-430b-82af-4a2d428fcc39 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:34.346632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737ef5d-2e8a-430b-82af-4a2d428fcc39 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:34.351103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:34.351728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:34.352012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:34.352282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] PATH_INFO: `/v3/users/e06d0c6c5c6f45ecb37bf8298493be42` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:34.353388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06d0c6c5c6f45ecb37bf8298493be42)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:34.355332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:34.404577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06d0c6c5c6f45ecb37bf8298493be42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:34.417156 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06d0c6c5c6f45ecb37bf8298493be42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:34.417849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06d0c6c5c6f45ecb37bf8298493be42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:34.425748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06d0c6c5c6f45ecb37bf8298493be42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:34.426424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06d0c6c5c6f45ecb37bf8298493be42'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:34.439686 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4311/8574] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:41:34 2022] DELETE /identity/v3/users/e06d0c6c5c6f45ecb37bf8298493be42 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:34.443894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739172f-4ea8-4008-bf12-17c533bd29d6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:34.444405 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739172f-4ea8-4008-bf12-17c533bd29d6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:34.444567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739172f-4ea8-4008-bf12-17c533bd29d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:34.464824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8739172f-4ea8-4008-bf12-17c533bd29d6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:34.466035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8739172f-4ea8-4008-bf12-17c533bd29d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:34.528653 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4264/8575] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:34.535967 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:34.537352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:34.598626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c45b6-65ce-4dbb-9ba6-3951ba33f69d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:34.602339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5a32d-f744-4442-9a7b-c1b84054c160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:34.602971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a32d-f744-4442-9a7b-c1b84054c160 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:34.603270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a32d-f744-4442-9a7b-c1b84054c160 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:34.603539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a32d-f744-4442-9a7b-c1b84054c160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:34.612700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5a32d-f744-4442-9a7b-c1b84054c160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:34.614120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5a32d-f744-4442-9a7b-c1b84054c160 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:34.623424 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4312/8576] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:41:34.902248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739172f-4ea8-4008-bf12-17c533bd29d6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:34.903999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8739172f-4ea8-4008-bf12-17c533bd29d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:34.928172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739172f-4ea8-4008-bf12-17c533bd29d6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:34.934096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:34.934849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:34.935129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:34.935399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] PATH_INFO: `/v3/projects/f1d201d3328f483595de62c5463edc4c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:34.936619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d201d3328f483595de62c5463edc4c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:34.938619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:34.990356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d201d3328f483595de62c5463edc4c', 'request_id': 'req-4a9cdce2-2b27-483a-8482-1090913fb653'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:34.996208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d201d3328f483595de62c5463edc4c', 'request_id': 'req-4a9cdce2-2b27-483a-8482-1090913fb653'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:35.002952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d201d3328f483595de62c5463edc4c', 'request_id': 'req-4a9cdce2-2b27-483a-8482-1090913fb653'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:35.018262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] The token cache is being invalidate because project f1d201d3328f483595de62c5463edc4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:41:35.018555 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:35.019250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a9cdce2-2b27-483a-8482-1090913fb653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:35.020824 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4265/8577] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:41:34 2022] DELETE /identity/v3/projects/f1d201d3328f483595de62c5463edc4c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:35.026890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674feb-3243-4741-a836-63ce5de4b6e0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:35.027181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674feb-3243-4741-a836-63ce5de4b6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:35.027461 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674feb-3243-4741-a836-63ce5de4b6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:35.049160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9a674feb-3243-4741-a836-63ce5de4b6e0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:35.050349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9a674feb-3243-4741-a836-63ce5de4b6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:35.068905 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:35.116595 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4313/8578] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:35.125909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614017-454c-4f6d-9c8c-1d38cdd77b6a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:35.126191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614017-454c-4f6d-9c8c-1d38cdd77b6a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:35.126477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614017-454c-4f6d-9c8c-1d38cdd77b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:35.146046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-95614017-454c-4f6d-9c8c-1d38cdd77b6a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:35.147270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-95614017-454c-4f6d-9c8c-1d38cdd77b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:35.155528 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4266/8579] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:41:35.159809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674feb-3243-4741-a836-63ce5de4b6e0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:35.169574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674feb-3243-4741-a836-63ce5de4b6e0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:35.174807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28766268-02e8-43eb-a129-2d2e0c16e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:35.175407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28766268-02e8-43eb-a129-2d2e0c16e02e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:35.175684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28766268-02e8-43eb-a129-2d2e0c16e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:35.175983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28766268-02e8-43eb-a129-2d2e0c16e02e admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:35.176648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28766268-02e8-43eb-a129-2d2e0c16e02e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:41:35.176951 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28766268-02e8-43eb-a129-2d2e0c16e02e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:35.178538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28766268-02e8-43eb-a129-2d2e0c16e02e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:35.191529 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4314/8580] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:41:35.195846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95614017-454c-4f6d-9c8c-1d38cdd77b6a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:35.206063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95614017-454c-4f6d-9c8c-1d38cdd77b6a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:35.210666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224c849-9713-47fa-979e-903de1036e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:35.211261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c849-9713-47fa-979e-903de1036e38 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:35.211542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c849-9713-47fa-979e-903de1036e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:35.211815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c849-9713-47fa-979e-903de1036e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:35.212450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224c849-9713-47fa-979e-903de1036e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:35.214357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224c849-9713-47fa-979e-903de1036e38 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:35.240782 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4267/8581] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:41:35 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:41:35.244954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28766268-02e8-43eb-a129-2d2e0c16e02e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:35.255610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28766268-02e8-43eb-a129-2d2e0c16e02e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:35.311740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d124ed-e4ca-47f3-a67c-4100b730ffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:35.312647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d124ed-e4ca-47f3-a67c-4100b730ffe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:35.312647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d124ed-e4ca-47f3-a67c-4100b730ffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:35.312873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d124ed-e4ca-47f3-a67c-4100b730ffe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:35.313380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d124ed-e4ca-47f3-a67c-4100b730ffe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:35.315360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d124ed-e4ca-47f3-a67c-4100b730ffe3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:35.341717 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4315/8582] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:41:35 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:41:35.343316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224c849-9713-47fa-979e-903de1036e38 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:35.353993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224c849-9713-47fa-979e-903de1036e38 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:35.359110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a28239-3a69-4cac-8688-997fdc16d83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:35.359891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a28239-3a69-4cac-8688-997fdc16d83d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:35.360176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a28239-3a69-4cac-8688-997fdc16d83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:35.360497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a28239-3a69-4cac-8688-997fdc16d83d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:35.361154 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a28239-3a69-4cac-8688-997fdc16d83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:35.362894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a28239-3a69-4cac-8688-997fdc16d83d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:35.374669 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4268/8583] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:41:35.378921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d124ed-e4ca-47f3-a67c-4100b730ffe3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:35.389425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d124ed-e4ca-47f3-a67c-4100b730ffe3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:35.396016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe27766-c6ba-4a55-b885-1e96ec04f638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:35.396750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27766-c6ba-4a55-b885-1e96ec04f638 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:35.396964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27766-c6ba-4a55-b885-1e96ec04f638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:35.397199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27766-c6ba-4a55-b885-1e96ec04f638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:35.397817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe27766-c6ba-4a55-b885-1e96ec04f638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:35.399577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe27766-c6ba-4a55-b885-1e96ec04f638 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:35.411416 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4316/8584] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:41:35.415636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a28239-3a69-4cac-8688-997fdc16d83d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:35.426458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a28239-3a69-4cac-8688-997fdc16d83d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:35.431667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037519b0-c129-4197-9673-d25b2372d063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:35.432342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037519b0-c129-4197-9673-d25b2372d063 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:35.432646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037519b0-c129-4197-9673-d25b2372d063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:35.432918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037519b0-c129-4197-9673-d25b2372d063 admin admin] PATH_INFO: `/v3/projects/7f7810d0abea4300b8f0e15222b03e76/users/065bfbbef4bb41228a5162cda9a7b43a/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:35.448035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037519b0-c129-4197-9673-d25b2372d063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7810d0abea4300b8f0e15222b03e76, user_id=065bfbbef4bb41228a5162cda9a7b43a, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:35.450709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037519b0-c129-4197-9673-d25b2372d063 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:35.463959 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4269/8585] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:41:35 2022] PUT /identity/v3/projects/7f7810d0abea4300b8f0e15222b03e76/users/065bfbbef4bb41228a5162cda9a7b43a/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:35.468954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efca8-30b3-4059-8ebc-4105461ec39d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:35.469242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efca8-30b3-4059-8ebc-4105461ec39d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:35.469531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efca8-30b3-4059-8ebc-4105461ec39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:35.489497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-702efca8-30b3-4059-8ebc-4105461ec39d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:35.490715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-702efca8-30b3-4059-8ebc-4105461ec39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:35.550038 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4317/8586] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:35.560165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037519b0-c129-4197-9673-d25b2372d063 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:35.564360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-037519b0-c129-4197-9673-d25b2372d063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:35.585587 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:35.626777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037519b0-c129-4197-9673-d25b2372d063 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:35.630465 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a62e4-c45f-4397-af9f-e060b0817193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:35.631036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a62e4-c45f-4397-af9f-e060b0817193 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:35.631315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a62e4-c45f-4397-af9f-e060b0817193 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:35.631585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a62e4-c45f-4397-af9f-e060b0817193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:35.640572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a62e4-c45f-4397-af9f-e060b0817193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:35.642004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a62e4-c45f-4397-af9f-e060b0817193 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:35.651180 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4270/8587] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:41:39.724185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2c079-5f0b-4da2-b2cb-890db2b62975 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:39.724718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2c079-5f0b-4da2-b2cb-890db2b62975 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:39.724718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2c079-5f0b-4da2-b2cb-890db2b62975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:39.754849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4ad2c079-5f0b-4da2-b2cb-890db2b62975 None None] MFA Rules not processed for user `065bfbbef4bb41228a5162cda9a7b43a`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:39.756080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4ad2c079-5f0b-4da2-b2cb-890db2b62975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:39.774546 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:39.831834 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4318/8588] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:41:39.836582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a62e4-c45f-4397-af9f-e060b0817193 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:39.847282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a62e4-c45f-4397-af9f-e060b0817193 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:39.851984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0607953-0313-4a91-b018-fed7ab443177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:39.852596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607953-0313-4a91-b018-fed7ab443177 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:39.852876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607953-0313-4a91-b018-fed7ab443177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:39.853148 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607953-0313-4a91-b018-fed7ab443177 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:39.853787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0607953-0313-4a91-b018-fed7ab443177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:39.855766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0607953-0313-4a91-b018-fed7ab443177 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:39.881957 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4271/8589] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:41:39 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:41:39.883478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2c079-5f0b-4da2-b2cb-890db2b62975 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:39.895961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2c079-5f0b-4da2-b2cb-890db2b62975 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:39.900510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32f10d-5b98-46a2-808c-5b4f0c728ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:39.901126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32f10d-5b98-46a2-808c-5b4f0c728ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:39.901411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32f10d-5b98-46a2-808c-5b4f0c728ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:39.901715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32f10d-5b98-46a2-808c-5b4f0c728ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:39.902362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32f10d-5b98-46a2-808c-5b4f0c728ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:39.904014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32f10d-5b98-46a2-808c-5b4f0c728ca7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:39.915251 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4319/8590] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:41:39.919455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0607953-0313-4a91-b018-fed7ab443177 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:39.930481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0607953-0313-4a91-b018-fed7ab443177 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:39.935330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25333b22-b476-4579-94a7-144582502b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:39.936087 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25333b22-b476-4579-94a7-144582502b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:39.936374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25333b22-b476-4579-94a7-144582502b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:39.936677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25333b22-b476-4579-94a7-144582502b8a admin admin] PATH_INFO: `/v3/system/users/39d7195f935349ada0bb0aeb5419f355/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:40.093090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25333b22-b476-4579-94a7-144582502b8a admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=39d7195f935349ada0bb0aeb5419f355, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:40.094235 n-d-master-1 devstack@keystone.service[81854]: WARNING py.warnings [None req-25333b22-b476-4579-94a7-144582502b8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 02 01:41:40.094235 n-d-master-1 devstack@keystone.service[81854]: warnings.warn(msg) Oct 02 01:41:40.094235 n-d-master-1 devstack@keystone.service[81854]: Oct 02 01:41:40.095115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25333b22-b476-4579-94a7-144582502b8a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:40.104551 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4272/8591] 10.222.0.23 () {60 vars in 1378 bytes} [Sun Oct 2 01:41:39 2022] PUT /identity/v3/system/users/39d7195f935349ada0bb0aeb5419f355/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:40.115730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018a01-cd75-4195-8c4d-f587ed1d13ef None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:40.116019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018a01-cd75-4195-8c4d-f587ed1d13ef None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:40.116293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018a01-cd75-4195-8c4d-f587ed1d13ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:40.145364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-37018a01-cd75-4195-8c4d-f587ed1d13ef None None] MFA Rules not processed for user `39d7195f935349ada0bb0aeb5419f355`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:41:40.146653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-37018a01-cd75-4195-8c4d-f587ed1d13ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:40.224123 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4320/8592] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:41:40 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 02 01:41:40.228698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25333b22-b476-4579-94a7-144582502b8a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:40.329596 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25333b22-b476-4579-94a7-144582502b8a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:40.359739 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:40.365562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0cf29-ddea-45bd-a61c-1df12690e9fb None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d7195f935349ada0bb0aeb5419f355', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:40.366367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0cf29-ddea-45bd-a61c-1df12690e9fb None tempest-ImageQuotaTest-1649819470-system-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:40.366866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0cf29-ddea-45bd-a61c-1df12690e9fb None tempest-ImageQuotaTest-1649819470-system-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:40.367165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0cf29-ddea-45bd-a61c-1df12690e9fb None tempest-ImageQuotaTest-1649819470-system-admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:40.367953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0cf29-ddea-45bd-a61c-1df12690e9fb None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:40.369355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0cf29-ddea-45bd-a61c-1df12690e9fb None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:40.377290 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4273/8593] 10.222.0.23 () {58 vars in 1110 bytes} [Sun Oct 2 01:41:40 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:41:40.381708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37018a01-cd75-4195-8c4d-f587ed1d13ef None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:40.457092 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:40.486141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37018a01-cd75-4195-8c4d-f587ed1d13ef None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:40.520170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8e29-94fb-4a0e-b250-b5b12c12d78e None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d7195f935349ada0bb0aeb5419f355', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:40.520774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8e29-94fb-4a0e-b250-b5b12c12d78e None tempest-ImageQuotaTest-1649819470-system-admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:40.521054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8e29-94fb-4a0e-b250-b5b12c12d78e None tempest-ImageQuotaTest-1649819470-system-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:40.521337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8e29-94fb-4a0e-b250-b5b12c12d78e None tempest-ImageQuotaTest-1649819470-system-admin] PATH_INFO: `/v3/limits` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:40.521987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8e29-94fb-4a0e-b250-b5b12c12d78e None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:40.523303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8e29-94fb-4a0e-b250-b5b12c12d78e None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-a54d8e29-94fb-4a0e-b250-b5b12c12d78e None tempest-ImageQuotaTest-1649819470-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 02 01:41:40.564868 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 01:41:40.566131 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4321/8594] 10.222.0.23 () {60 vars in 1126 bytes} [Sun Oct 2 01:41:40 2022] POST /identity/v3/limits => generated 124 bytes in 185 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 02 01:41:40.571216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0cf29-ddea-45bd-a61c-1df12690e9fb None tempest-ImageQuotaTest-1649819470-system-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:40.676468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0cf29-ddea-45bd-a61c-1df12690e9fb None tempest-ImageQuotaTest-1649819470-system-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:40.711224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a56e3-86dc-454e-a303-43fc1c81b51e None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d7195f935349ada0bb0aeb5419f355', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:40.711840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a56e3-86dc-454e-a303-43fc1c81b51e None tempest-ImageQuotaTest-1649819470-system-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:40.712120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a56e3-86dc-454e-a303-43fc1c81b51e None tempest-ImageQuotaTest-1649819470-system-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:40.712393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a56e3-86dc-454e-a303-43fc1c81b51e None tempest-ImageQuotaTest-1649819470-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:40.713101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a56e3-86dc-454e-a303-43fc1c81b51e None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:40.714053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a56e3-86dc-454e-a303-43fc1c81b51e None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:40.722663 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4274/8595] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:41:40 2022] GET /identity/v3/registered_limits => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:41:40.730987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8e29-94fb-4a0e-b250-b5b12c12d78e None tempest-ImageQuotaTest-1649819470-system-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:40.842587 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8e29-94fb-4a0e-b250-b5b12c12d78e None tempest-ImageQuotaTest-1649819470-system-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:40.875811 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:40.884258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b6a04-1f8e-493e-adea-28481cb774cd None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d7195f935349ada0bb0aeb5419f355', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:40.884872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b6a04-1f8e-493e-adea-28481cb774cd None tempest-ImageQuotaTest-1649819470-system-admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:40.885157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b6a04-1f8e-493e-adea-28481cb774cd None tempest-ImageQuotaTest-1649819470-system-admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:40.885434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b6a04-1f8e-493e-adea-28481cb774cd None tempest-ImageQuotaTest-1649819470-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:40.886052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b6a04-1f8e-493e-adea-28481cb774cd None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:40.887183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b6a04-1f8e-493e-adea-28481cb774cd None tempest-ImageQuotaTest-1649819470-system-admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:40.894656 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4322/8596] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 2 01:41:40 2022] GET /identity/v3/registered_limits => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:41:44.219842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a56e3-86dc-454e-a303-43fc1c81b51e None tempest-ImageQuotaTest-1649819470-system-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:44.234720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a56e3-86dc-454e-a303-43fc1c81b51e None tempest-ImageQuotaTest-1649819470-system-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:44.239520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:44.240156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:44.240444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:44.240719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] PATH_INFO: `/v3/users/065bfbbef4bb41228a5162cda9a7b43a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:44.241859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065bfbbef4bb41228a5162cda9a7b43a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:44.243872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:44.292522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065bfbbef4bb41228a5162cda9a7b43a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.302528 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:44.305336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065bfbbef4bb41228a5162cda9a7b43a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.306319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065bfbbef4bb41228a5162cda9a7b43a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.314730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065bfbbef4bb41228a5162cda9a7b43a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.322022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065bfbbef4bb41228a5162cda9a7b43a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.327784 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4275/8597] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:41:44 2022] DELETE /identity/v3/users/065bfbbef4bb41228a5162cda9a7b43a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:44.507120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b6a04-1f8e-493e-adea-28481cb774cd None tempest-ImageQuotaTest-1649819470-system-admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:44.508903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c09b6a04-1f8e-493e-adea-28481cb774cd None tempest-ImageQuotaTest-1649819470-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:41:44.595878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b6a04-1f8e-493e-adea-28481cb774cd None tempest-ImageQuotaTest-1649819470-system-admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:44.600392 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:44.601020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:44.601305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:44.601581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] PATH_INFO: `/v3/projects/7f7810d0abea4300b8f0e15222b03e76` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:44.602739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7810d0abea4300b8f0e15222b03e76)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:44.604644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:44.650342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7810d0abea4300b8f0e15222b03e76', 'request_id': 'req-a19efbd5-2a1a-42d8-835a-a96318396f7e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.655612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7810d0abea4300b8f0e15222b03e76', 'request_id': 'req-a19efbd5-2a1a-42d8-835a-a96318396f7e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.661689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7810d0abea4300b8f0e15222b03e76', 'request_id': 'req-a19efbd5-2a1a-42d8-835a-a96318396f7e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.674942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] The token cache is being invalidate because project 7f7810d0abea4300b8f0e15222b03e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:41:44.675266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.675950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a19efbd5-2a1a-42d8-835a-a96318396f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.677455 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4323/8598] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:41:44 2022] DELETE /identity/v3/projects/7f7810d0abea4300b8f0e15222b03e76 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:44.681697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:41:44.692536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb4f7c-33ed-4dd0-bead-01d8350d6c83 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:41:44.747158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:41:44.747794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:41:44.748077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:41:44.748352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] PATH_INFO: `/v3/users/39d7195f935349ada0bb0aeb5419f355` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:41:44.749467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d7195f935349ada0bb0aeb5419f355)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:41:44.752129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:41:44.814128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d7195f935349ada0bb0aeb5419f355'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.827300 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d7195f935349ada0bb0aeb5419f355'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.828060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d7195f935349ada0bb0aeb5419f355'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.836101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d7195f935349ada0bb0aeb5419f355'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.843282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d7195f935349ada0bb0aeb5419f355'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:41:44.855387 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4276/8599] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:41:44 2022] DELETE /identity/v3/users/39d7195f935349ada0bb0aeb5419f355 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:41:54.670819 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:41:54.846523 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=13,keystone:SELECT=64,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:00.658775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65d842-656f-41f6-8fa2-0fe5b1585e23 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:00.659341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65d842-656f-41f6-8fa2-0fe5b1585e23 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:00.659341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65d842-656f-41f6-8fa2-0fe5b1585e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:00.680677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0c65d842-656f-41f6-8fa2-0fe5b1585e23 None None] MFA Rules not processed for user `a4554021870a4d6b9f7deca8ebfd3142`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:42:00.682137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0c65d842-656f-41f6-8fa2-0fe5b1585e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:00.743912 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4324/8600] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:42:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:42:01.511082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:01.512595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:01.639316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46093207-8b37-402c-a55e-8d43bc13f3db admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:01.649335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4858c-ae43-44f7-b450-46749ffb5b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:01.650227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4858c-ae43-44f7-b450-46749ffb5b6d service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:01.650725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4858c-ae43-44f7-b450-46749ffb5b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:01.651190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4858c-ae43-44f7-b450-46749ffb5b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:01.657048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-afa4858c-ae43-44f7-b450-46749ffb5b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:01.803600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4858c-ae43-44f7-b450-46749ffb5b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:01.815050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4858c-ae43-44f7-b450-46749ffb5b6d service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:01.857162 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4277/8601] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:42:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:42:10.736301 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=25 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:11.847329 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=58 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:16.695181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa01437-4367-4e54-8bb8-a7bb0830d471 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:16.695692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa01437-4367-4e54-8bb8-a7bb0830d471 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:16.695815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa01437-4367-4e54-8bb8-a7bb0830d471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:16.715950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ffa01437-4367-4e54-8bb8-a7bb0830d471 None None] MFA Rules not processed for user `97cb465affcf4b328550d1f7b4dfeddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:42:16.717324 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ffa01437-4367-4e54-8bb8-a7bb0830d471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:16.772121 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4325/8602] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:42:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:42:26.765268 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=25 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:29.744740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5f208-5bba-48a0-b5a5-92b14c9480c8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:29.746258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5f208-5bba-48a0-b5a5-92b14c9480c8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:29.746930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5f208-5bba-48a0-b5a5-92b14c9480c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:29.787425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6bf5f208-5bba-48a0-b5a5-92b14c9480c8 None None] MFA Rules not processed for user `4ac7b60e4e094354a9692bb46c3ebf8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:42:29.790371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6bf5f208-5bba-48a0-b5a5-92b14c9480c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:29.962052 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4278/8603] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:42:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:42:36.200471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa01437-4367-4e54-8bb8-a7bb0830d471 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:36.202519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ffa01437-4367-4e54-8bb8-a7bb0830d471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:36.279767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa01437-4367-4e54-8bb8-a7bb0830d471 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:36.284233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:36.284881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:36.285165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:36.285436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] PATH_INFO: `/v3/users/a4554021870a4d6b9f7deca8ebfd3142` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:36.286812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4554021870a4d6b9f7deca8ebfd3142)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:36.288760 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:36.350027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4554021870a4d6b9f7deca8ebfd3142'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:36.369509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4554021870a4d6b9f7deca8ebfd3142'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:36.370566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4554021870a4d6b9f7deca8ebfd3142'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:36.380625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4554021870a4d6b9f7deca8ebfd3142'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:36.381240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4554021870a4d6b9f7deca8ebfd3142'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:36.396819 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4326/8604] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:42:36 2022] DELETE /identity/v3/users/a4554021870a4d6b9f7deca8ebfd3142 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:42:36.401281 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093de6-db1b-445b-ad24-c9fe3f70751d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:36.402142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093de6-db1b-445b-ad24-c9fe3f70751d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:36.402633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093de6-db1b-445b-ad24-c9fe3f70751d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:36.427705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-39093de6-db1b-445b-ad24-c9fe3f70751d None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:42:36.428949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-39093de6-db1b-445b-ad24-c9fe3f70751d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:36.502526 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4279/8605] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:42:36.514177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:36.516449 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:36.579645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54d23d-13e3-4164-94e4-a5b36583ef86 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:36.583339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898fd9-25a5-4d6a-9b23-19c557bab545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:36.583969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898fd9-25a5-4d6a-9b23-19c557bab545 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:36.584249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898fd9-25a5-4d6a-9b23-19c557bab545 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:36.584517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898fd9-25a5-4d6a-9b23-19c557bab545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:36.595002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d898fd9-25a5-4d6a-9b23-19c557bab545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:36.596603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d898fd9-25a5-4d6a-9b23-19c557bab545 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:36.608664 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4327/8606] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:42:36.789509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39093de6-db1b-445b-ad24-c9fe3f70751d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:36.791219 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-39093de6-db1b-445b-ad24-c9fe3f70751d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:36.805355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39093de6-db1b-445b-ad24-c9fe3f70751d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:36.817888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:36.818570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:36.818889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:36.819167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] PATH_INFO: `/v3/projects/24fa631aa4214c399af20711a739f128` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:36.820900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=24fa631aa4214c399af20711a739f128)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:36.824034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:36.944395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24fa631aa4214c399af20711a739f128', 'request_id': 'req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:36.956080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24fa631aa4214c399af20711a739f128', 'request_id': 'req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:36.978897 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24fa631aa4214c399af20711a739f128', 'request_id': 'req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.000987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] The token cache is being invalidate because project 24fa631aa4214c399af20711a739f128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:42:37.001229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.001891 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.007651 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4280/8607] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:42:36 2022] DELETE /identity/v3/projects/24fa631aa4214c399af20711a739f128 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:42:37.009236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898fd9-25a5-4d6a-9b23-19c557bab545 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:37.021820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898fd9-25a5-4d6a-9b23-19c557bab545 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:37.054650 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:37.127337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:37.128004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:37.128280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:37.128550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] PATH_INFO: `/v3/users/91ab38d8471840f19735b2f95e0c9e44` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:37.129675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ab38d8471840f19735b2f95e0c9e44)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:37.131674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:37.180767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ab38d8471840f19735b2f95e0c9e44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.193898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ab38d8471840f19735b2f95e0c9e44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.194710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ab38d8471840f19735b2f95e0c9e44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.204266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ab38d8471840f19735b2f95e0c9e44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.205235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ab38d8471840f19735b2f95e0c9e44'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.231786 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4328/8608] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:42:37 2022] DELETE /identity/v3/users/91ab38d8471840f19735b2f95e0c9e44 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:42:37.535377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:37.536947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:37.562690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9a82-f36c-4df0-984d-2b47093b7b3f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:37.596320 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:37.631673 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:37.632322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:37.632598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:37.632871 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] PATH_INFO: `/v3/projects/6447ad90bc0a41db8e4c0b997a41de6b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:37.634050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=6447ad90bc0a41db8e4c0b997a41de6b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:37.636121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:37.697454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6447ad90bc0a41db8e4c0b997a41de6b', 'request_id': 'req-a586875e-74e4-4976-930a-efd579a353ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.703693 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6447ad90bc0a41db8e4c0b997a41de6b', 'request_id': 'req-a586875e-74e4-4976-930a-efd579a353ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.710759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6447ad90bc0a41db8e4c0b997a41de6b', 'request_id': 'req-a586875e-74e4-4976-930a-efd579a353ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.725810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] The token cache is being invalidate because project 6447ad90bc0a41db8e4c0b997a41de6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:42:37.726107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.726785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.729114 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4281/8609] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:42:37 2022] DELETE /identity/v3/projects/6447ad90bc0a41db8e4c0b997a41de6b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:42:37.732849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:37.734258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:37.746998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa780-d39a-4fd1-8210-6a5db95320db admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:37.804271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41692373-5ae4-4855-a554-3dbb7e0c1e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:37.804820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41692373-5ae4-4855-a554-3dbb7e0c1e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:37.805099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41692373-5ae4-4855-a554-3dbb7e0c1e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:37.805371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41692373-5ae4-4855-a554-3dbb7e0c1e9b admin admin] PATH_INFO: `/v3/users/f0dbb113f1094ecea455bf0107554b16` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:37.806789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41692373-5ae4-4855-a554-3dbb7e0c1e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0dbb113f1094ecea455bf0107554b16)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:37.808709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41692373-5ae4-4855-a554-3dbb7e0c1e9b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:37.856487 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:37.860015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-41692373-5ae4-4855-a554-3dbb7e0c1e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0dbb113f1094ecea455bf0107554b16'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.875247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-41692373-5ae4-4855-a554-3dbb7e0c1e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0dbb113f1094ecea455bf0107554b16'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.875958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-41692373-5ae4-4855-a554-3dbb7e0c1e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0dbb113f1094ecea455bf0107554b16'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.882980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-41692373-5ae4-4855-a554-3dbb7e0c1e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0dbb113f1094ecea455bf0107554b16'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.883691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-41692373-5ae4-4855-a554-3dbb7e0c1e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0dbb113f1094ecea455bf0107554b16'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:37.896884 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4329/8610] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:42:37 2022] DELETE /identity/v3/users/f0dbb113f1094ecea455bf0107554b16 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:42:38.082097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:38.083972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:38.115538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586875e-74e4-4976-930a-efd579a353ef admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:38.174033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:38.174697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:38.174977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:38.175248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] PATH_INFO: `/v3/projects/3d9e84a6a3d8481f980fb178c1b1a4a8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:38.176705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9e84a6a3d8481f980fb178c1b1a4a8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:38.178618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:38.225283 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9e84a6a3d8481f980fb178c1b1a4a8', 'request_id': 'req-18a9280d-a28e-4b74-bdb1-9297a6947782'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:38.231211 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9e84a6a3d8481f980fb178c1b1a4a8', 'request_id': 'req-18a9280d-a28e-4b74-bdb1-9297a6947782'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:38.234088 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:38.239242 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9e84a6a3d8481f980fb178c1b1a4a8', 'request_id': 'req-18a9280d-a28e-4b74-bdb1-9297a6947782'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:38.253097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] The token cache is being invalidate because project 3d9e84a6a3d8481f980fb178c1b1a4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:42:38.253393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:38.254056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-18a9280d-a28e-4b74-bdb1-9297a6947782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:42:38.255840 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4282/8611] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:42:38 2022] DELETE /identity/v3/projects/3d9e84a6a3d8481f980fb178c1b1a4a8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:42:38.261582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98d9a-bb75-4b53-bb37-7bcb1da26fb3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:38.262114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98d9a-bb75-4b53-bb37-7bcb1da26fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:38.262241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98d9a-bb75-4b53-bb37-7bcb1da26fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:38.288610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a0f98d9a-bb75-4b53-bb37-7bcb1da26fb3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:42:38.290146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a0f98d9a-bb75-4b53-bb37-7bcb1da26fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:38.361935 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4330/8612] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:42:38.370266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19873793-2277-4d03-994c-88aa6b0673dd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:38.370841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19873793-2277-4d03-994c-88aa6b0673dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:38.371810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19873793-2277-4d03-994c-88aa6b0673dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:38.398547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-19873793-2277-4d03-994c-88aa6b0673dd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:42:38.400928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-19873793-2277-4d03-994c-88aa6b0673dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:38.414106 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4283/8613] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:42:38.415589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f98d9a-bb75-4b53-bb37-7bcb1da26fb3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:38.427513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f98d9a-bb75-4b53-bb37-7bcb1da26fb3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:38.432840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b794cb-83b2-44e2-a20a-3f453b84661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:38.433444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b794cb-83b2-44e2-a20a-3f453b84661b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:38.433721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b794cb-83b2-44e2-a20a-3f453b84661b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:38.433993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b794cb-83b2-44e2-a20a-3f453b84661b admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:38.434658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b794cb-83b2-44e2-a20a-3f453b84661b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:42:38.435115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b794cb-83b2-44e2-a20a-3f453b84661b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:38.436745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b794cb-83b2-44e2-a20a-3f453b84661b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:38.448790 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4331/8614] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:42:38.453623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19873793-2277-4d03-994c-88aa6b0673dd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:38.463308 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19873793-2277-4d03-994c-88aa6b0673dd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:38.468607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1069a0-206c-4ba6-9f6a-d1bbbeeee6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:38.469212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1069a0-206c-4ba6-9f6a-d1bbbeeee6bd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:38.469525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1069a0-206c-4ba6-9f6a-d1bbbeeee6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:38.469834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1069a0-206c-4ba6-9f6a-d1bbbeeee6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:38.470482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1069a0-206c-4ba6-9f6a-d1bbbeeee6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:38.472444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1069a0-206c-4ba6-9f6a-d1bbbeeee6bd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:38.502484 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4284/8615] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:42:38 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:42:38.506728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b794cb-83b2-44e2-a20a-3f453b84661b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:38.517493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b794cb-83b2-44e2-a20a-3f453b84661b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:38.575636 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0888f1-05ed-45eb-8b9c-b8442644bda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:38.576244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0888f1-05ed-45eb-8b9c-b8442644bda6 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:38.576517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0888f1-05ed-45eb-8b9c-b8442644bda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:38.576787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0888f1-05ed-45eb-8b9c-b8442644bda6 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:38.577420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0888f1-05ed-45eb-8b9c-b8442644bda6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:38.579509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0888f1-05ed-45eb-8b9c-b8442644bda6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:38.601584 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4332/8616] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:42:38 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:42:38.605724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1069a0-206c-4ba6-9f6a-d1bbbeeee6bd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:38.617041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1069a0-206c-4ba6-9f6a-d1bbbeeee6bd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:38.621849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a41887-8012-4ab1-8ae5-1aa94f7af7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:38.622791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a41887-8012-4ab1-8ae5-1aa94f7af7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:38.623136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a41887-8012-4ab1-8ae5-1aa94f7af7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:38.623554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a41887-8012-4ab1-8ae5-1aa94f7af7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:38.624267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a41887-8012-4ab1-8ae5-1aa94f7af7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:38.625949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a41887-8012-4ab1-8ae5-1aa94f7af7bc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:38.639622 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4285/8617] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:42:38.640788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0888f1-05ed-45eb-8b9c-b8442644bda6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:38.651498 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0888f1-05ed-45eb-8b9c-b8442644bda6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:38.656632 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6976bd-c030-4722-99f6-d5074d1f9ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:38.657843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6976bd-c030-4722-99f6-d5074d1f9ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:38.657843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6976bd-c030-4722-99f6-d5074d1f9ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:38.657843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6976bd-c030-4722-99f6-d5074d1f9ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:38.658436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6976bd-c030-4722-99f6-d5074d1f9ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:38.660124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6976bd-c030-4722-99f6-d5074d1f9ca6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:38.671493 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4333/8618] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:42:38.675721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a41887-8012-4ab1-8ae5-1aa94f7af7bc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:38.686059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a41887-8012-4ab1-8ae5-1aa94f7af7bc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:38.691319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d7157-b116-4588-a14b-5b468748f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:38.691984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d7157-b116-4588-a14b-5b468748f65d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:38.692268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d7157-b116-4588-a14b-5b468748f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:38.692608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d7157-b116-4588-a14b-5b468748f65d admin admin] PATH_INFO: `/v3/projects/1ff590c5b5cc499386a58d5b84c7462b/users/30c3d05e92dd463e81ccc5a557e46fa3/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:38.710306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d7157-b116-4588-a14b-5b468748f65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff590c5b5cc499386a58d5b84c7462b, user_id=30c3d05e92dd463e81ccc5a557e46fa3, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:38.713193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d7157-b116-4588-a14b-5b468748f65d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:38.728470 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4286/8619] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:42:38 2022] PUT /identity/v3/projects/1ff590c5b5cc499386a58d5b84c7462b/users/30c3d05e92dd463e81ccc5a557e46fa3/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:42:38.734254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf2fed-a8f3-4096-a7ee-8fffbc658696 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:38.734541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf2fed-a8f3-4096-a7ee-8fffbc658696 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:38.734843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf2fed-a8f3-4096-a7ee-8fffbc658696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:38.776879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-69cf2fed-a8f3-4096-a7ee-8fffbc658696 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:42:38.778106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-69cf2fed-a8f3-4096-a7ee-8fffbc658696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:38.804312 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:38.852757 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4334/8620] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:42:38.864097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d7157-b116-4588-a14b-5b468748f65d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:38.866072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b52d7157-b116-4588-a14b-5b468748f65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:38.940762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d7157-b116-4588-a14b-5b468748f65d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:38.944916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b6ae8-c133-485b-85ec-705c41e34dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:38.945698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b6ae8-c133-485b-85ec-705c41e34dee service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:38.945980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b6ae8-c133-485b-85ec-705c41e34dee service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:38.946250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b6ae8-c133-485b-85ec-705c41e34dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:38.956340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b6ae8-c133-485b-85ec-705c41e34dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:38.958063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b6ae8-c133-485b-85ec-705c41e34dee service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:38.984425 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4287/8621] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:42:43.803357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0f7b4-7675-45c2-af46-3f1380645c7d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:43.803850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0f7b4-7675-45c2-af46-3f1380645c7d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:43.803992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0f7b4-7675-45c2-af46-3f1380645c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:43.838934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6de0f7b4-7675-45c2-af46-3f1380645c7d None None] MFA Rules not processed for user `30c3d05e92dd463e81ccc5a557e46fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:42:43.840153 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6de0f7b4-7675-45c2-af46-3f1380645c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:43.926793 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4335/8622] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:42:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:42:43.931605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b6ae8-c133-485b-85ec-705c41e34dee service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:43.947243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b6ae8-c133-485b-85ec-705c41e34dee service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:43.952844 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f602a1-5cea-4289-91ef-cba4749eca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:43.953476 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f602a1-5cea-4289-91ef-cba4749eca43 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:43.953759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f602a1-5cea-4289-91ef-cba4749eca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:43.954028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f602a1-5cea-4289-91ef-cba4749eca43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:43.954687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f602a1-5cea-4289-91ef-cba4749eca43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:43.956604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f602a1-5cea-4289-91ef-cba4749eca43 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:43.987878 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4288/8623] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:42:43 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:42:43.991703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0f7b4-7675-45c2-af46-3f1380645c7d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:44.007076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0f7b4-7675-45c2-af46-3f1380645c7d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:44.074216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dddad-9003-4b21-b8e9-3e5a612093a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:44.074864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dddad-9003-4b21-b8e9-3e5a612093a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:44.075147 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dddad-9003-4b21-b8e9-3e5a612093a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:44.075973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dddad-9003-4b21-b8e9-3e5a612093a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:44.076731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dddad-9003-4b21-b8e9-3e5a612093a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:44.078701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dddad-9003-4b21-b8e9-3e5a612093a3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:44.105127 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4336/8624] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:42:43 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:42:44.106284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f602a1-5cea-4289-91ef-cba4749eca43 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:44.117171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f602a1-5cea-4289-91ef-cba4749eca43 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:44.122107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435ad7e-c0e8-4ebb-b847-bcbbeb3c3529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:44.123290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435ad7e-c0e8-4ebb-b847-bcbbeb3c3529 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:44.123810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435ad7e-c0e8-4ebb-b847-bcbbeb3c3529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:44.124088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435ad7e-c0e8-4ebb-b847-bcbbeb3c3529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:44.124741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435ad7e-c0e8-4ebb-b847-bcbbeb3c3529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:44.126395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435ad7e-c0e8-4ebb-b847-bcbbeb3c3529 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:44.141248 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4289/8625] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:42:44.142332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dddad-9003-4b21-b8e9-3e5a612093a3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:44.152725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dddad-9003-4b21-b8e9-3e5a612093a3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:44.158443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35478f-3804-4e32-9d81-1575e14ffce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:44.159162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35478f-3804-4e32-9d81-1575e14ffce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:44.159447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35478f-3804-4e32-9d81-1575e14ffce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:44.159725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35478f-3804-4e32-9d81-1575e14ffce9 admin admin] PATH_INFO: `/v3/projects/e3ed1a8a81fb42f3906625eefc8e27d8/users/6707790e3658497a8cb0412f88ccc70a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:44.177050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35478f-3804-4e32-9d81-1575e14ffce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ed1a8a81fb42f3906625eefc8e27d8, user_id=6707790e3658497a8cb0412f88ccc70a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:44.179896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35478f-3804-4e32-9d81-1575e14ffce9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:44.198656 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4337/8626] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:42:44 2022] PUT /identity/v3/projects/e3ed1a8a81fb42f3906625eefc8e27d8/users/6707790e3658497a8cb0412f88ccc70a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:42:44.202241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435ad7e-c0e8-4ebb-b847-bcbbeb3c3529 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:44.213679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435ad7e-c0e8-4ebb-b847-bcbbeb3c3529 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:44.279737 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:44.288028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbaf93-a1f7-402c-b580-419bf0842c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:44.288841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbaf93-a1f7-402c-b580-419bf0842c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:44.289304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbaf93-a1f7-402c-b580-419bf0842c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:44.289747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbaf93-a1f7-402c-b580-419bf0842c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:44.290914 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbaf93-a1f7-402c-b580-419bf0842c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:44.292756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbaf93-a1f7-402c-b580-419bf0842c7f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:44.307287 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4290/8627] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 01:42:44.308735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35478f-3804-4e32-9d81-1575e14ffce9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:44.320092 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35478f-3804-4e32-9d81-1575e14ffce9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:44.324783 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b08083-c34f-4946-8055-efc0bc23b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:44.326032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b08083-c34f-4946-8055-efc0bc23b685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:44.326856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b08083-c34f-4946-8055-efc0bc23b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:44.326856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b08083-c34f-4946-8055-efc0bc23b685 admin admin] PATH_INFO: `/v3/projects/e3ed1a8a81fb42f3906625eefc8e27d8/users/6707790e3658497a8cb0412f88ccc70a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:44.328697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b08083-c34f-4946-8055-efc0bc23b685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ed1a8a81fb42f3906625eefc8e27d8, user_id=6707790e3658497a8cb0412f88ccc70a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:44.331415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b08083-c34f-4946-8055-efc0bc23b685 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:44.343310 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4338/8628] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:42:44 2022] PUT /identity/v3/projects/e3ed1a8a81fb42f3906625eefc8e27d8/users/6707790e3658497a8cb0412f88ccc70a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:42:49.764296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c16c-d0a7-42f8-ab9b-a5f038af7fa0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:49.764821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c16c-d0a7-42f8-ab9b-a5f038af7fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:49.764942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c16c-d0a7-42f8-ab9b-a5f038af7fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:49.797034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0992c16c-d0a7-42f8-ab9b-a5f038af7fa0 None None] MFA Rules not processed for user `6707790e3658497a8cb0412f88ccc70a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:42:49.798338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0992c16c-d0a7-42f8-ab9b-a5f038af7fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:49.905442 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4291/8629] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:42:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:42:49.914144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b08083-c34f-4946-8055-efc0bc23b685 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:49.917002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-37b08083-c34f-4946-8055-efc0bc23b685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:49.932816 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:42:50.004568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b08083-c34f-4946-8055-efc0bc23b685 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:50.011347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bc98b-2ec7-483e-801c-7b46e05c06c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:50.012025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bc98b-2ec7-483e-801c-7b46e05c06c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:50.012246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bc98b-2ec7-483e-801c-7b46e05c06c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:50.012524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bc98b-2ec7-483e-801c-7b46e05c06c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:50.023364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bc98b-2ec7-483e-801c-7b46e05c06c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:50.025409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bc98b-2ec7-483e-801c-7b46e05c06c6 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:50.041601 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4339/8630] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:42:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:42:50.145735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c16c-d0a7-42f8-ab9b-a5f038af7fa0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:50.161746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c16c-d0a7-42f8-ab9b-a5f038af7fa0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:50.167051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2de71f-8588-401e-bf7e-921091574c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:50.167795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2de71f-8588-401e-bf7e-921091574c7f service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:50.168171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2de71f-8588-401e-bf7e-921091574c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:50.168516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2de71f-8588-401e-bf7e-921091574c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:50.228629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2de71f-8588-401e-bf7e-921091574c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:50.230083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2de71f-8588-401e-bf7e-921091574c7f service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:50.239332 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4292/8631] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:42:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:42:51.723416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25443811-cc32-4542-8030-39dfe4f88c4c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:51.723966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25443811-cc32-4542-8030-39dfe4f88c4c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:51.724095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25443811-cc32-4542-8030-39dfe4f88c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:51.746183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-25443811-cc32-4542-8030-39dfe4f88c4c None None] MFA Rules not processed for user `30c3d05e92dd463e81ccc5a557e46fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:42:51.747664 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-25443811-cc32-4542-8030-39dfe4f88c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:51.754507 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4340/8632] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:42:52.033343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2de71f-8588-401e-bf7e-921091574c7f service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:52.034867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed2de71f-8588-401e-bf7e-921091574c7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:52.101806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2de71f-8588-401e-bf7e-921091574c7f service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:52.105382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5705a07-6302-4584-88ff-67b6193356f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:52.105984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5705a07-6302-4584-88ff-67b6193356f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:52.106899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5705a07-6302-4584-88ff-67b6193356f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:52.107180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5705a07-6302-4584-88ff-67b6193356f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:52.108952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b5705a07-6302-4584-88ff-67b6193356f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:52.121773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5705a07-6302-4584-88ff-67b6193356f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:52.123397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5705a07-6302-4584-88ff-67b6193356f3 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:52.135745 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4293/8633] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:42:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:42:52.584827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25443811-cc32-4542-8030-39dfe4f88c4c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:52.586435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-25443811-cc32-4542-8030-39dfe4f88c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:52.677743 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25443811-cc32-4542-8030-39dfe4f88c4c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:52.683218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea3522-3cfe-4802-84bb-4e528811a920 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:52.683819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3522-3cfe-4802-84bb-4e528811a920 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:52.684097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3522-3cfe-4802-84bb-4e528811a920 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:52.684370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3522-3cfe-4802-84bb-4e528811a920 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:52.686366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-25ea3522-3cfe-4802-84bb-4e528811a920 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:52.702116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea3522-3cfe-4802-84bb-4e528811a920 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:52.703794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea3522-3cfe-4802-84bb-4e528811a920 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:52.718286 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4341/8634] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:42:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:42:54.716889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5705a07-6302-4584-88ff-67b6193356f3 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:42:54.729501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5705a07-6302-4584-88ff-67b6193356f3 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:42:54.734378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a0782-8ad3-422a-9257-4f9dfb8825ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:42:54.735195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0782-8ad3-422a-9257-4f9dfb8825ea service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:42:54.736249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0782-8ad3-422a-9257-4f9dfb8825ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:42:54.736770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0782-8ad3-422a-9257-4f9dfb8825ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:42:54.738859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-762a0782-8ad3-422a-9257-4f9dfb8825ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:42:54.752728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a0782-8ad3-422a-9257-4f9dfb8825ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:42:54.754278 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a0782-8ad3-422a-9257-4f9dfb8825ea service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:42:54.766729 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4294/8635] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:42:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:43:02.710010 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=61 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:04.759576 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:10.300403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea3522-3cfe-4802-84bb-4e528811a920 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:43:10.301946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-25ea3522-3cfe-4802-84bb-4e528811a920 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:43:10.387560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea3522-3cfe-4802-84bb-4e528811a920 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:43:10.392991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634209fc-8f8d-4050-8ba7-23e8e47187e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:43:10.393594 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634209fc-8f8d-4050-8ba7-23e8e47187e6 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:43:10.393872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634209fc-8f8d-4050-8ba7-23e8e47187e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:43:10.394151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634209fc-8f8d-4050-8ba7-23e8e47187e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:43:10.395841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-634209fc-8f8d-4050-8ba7-23e8e47187e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:43:10.411365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634209fc-8f8d-4050-8ba7-23e8e47187e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:43:10.412970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634209fc-8f8d-4050-8ba7-23e8e47187e6 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:43:10.428056 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4342/8636] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:43:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:43:19.761163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e47b12-4f1b-494d-ad38-383876b1efbc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:43:19.762564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e47b12-4f1b-494d-ad38-383876b1efbc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:43:19.763173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e47b12-4f1b-494d-ad38-383876b1efbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:43:19.809074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-59e47b12-4f1b-494d-ad38-383876b1efbc None None] MFA Rules not processed for user `97cb465affcf4b328550d1f7b4dfeddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:43:19.810670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-59e47b12-4f1b-494d-ad38-383876b1efbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:43:19.883314 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4295/8637] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:43:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:43:20.421520 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=34 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:25.933213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcebe2-d071-48c5-8eff-fd0f9461b3fb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:43:25.933871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcebe2-d071-48c5-8eff-fd0f9461b3fb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:43:25.933871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcebe2-d071-48c5-8eff-fd0f9461b3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:43:25.953795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-89fcebe2-d071-48c5-8eff-fd0f9461b3fb None None] MFA Rules not processed for user `30c3d05e92dd463e81ccc5a557e46fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:43:25.955160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-89fcebe2-d071-48c5-8eff-fd0f9461b3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:43:25.963817 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4343/8638] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:43:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:43:29.872273 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=25 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:43:35.949841 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:00.785738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e47b12-4f1b-494d-ad38-383876b1efbc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:00.787204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-59e47b12-4f1b-494d-ad38-383876b1efbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:00.806675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e47b12-4f1b-494d-ad38-383876b1efbc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:00.812735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4aa21c-8ee2-427a-854c-8b14efa359bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:00.813343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa21c-8ee2-427a-854c-8b14efa359bf service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:00.813621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa21c-8ee2-427a-854c-8b14efa359bf service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:00.813893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa21c-8ee2-427a-854c-8b14efa359bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:00.815641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f4aa21c-8ee2-427a-854c-8b14efa359bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:00.830072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4aa21c-8ee2-427a-854c-8b14efa359bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:00.831702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4aa21c-8ee2-427a-854c-8b14efa359bf service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:00.845429 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4296/8639] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:44:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:44:10.840868 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:13.646629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcebe2-d071-48c5-8eff-fd0f9461b3fb None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:13.648749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-89fcebe2-d071-48c5-8eff-fd0f9461b3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:13.749020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcebe2-d071-48c5-8eff-fd0f9461b3fb None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:13.754399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:13.755169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:13.755505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:13.755832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] PATH_INFO: `/v3/users/97cb465affcf4b328550d1f7b4dfeddf` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:13.757131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97cb465affcf4b328550d1f7b4dfeddf)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:13.759169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:13.844880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97cb465affcf4b328550d1f7b4dfeddf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:13.859532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97cb465affcf4b328550d1f7b4dfeddf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:13.860334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97cb465affcf4b328550d1f7b4dfeddf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:13.869079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97cb465affcf4b328550d1f7b4dfeddf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:13.869883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97cb465affcf4b328550d1f7b4dfeddf'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:13.884091 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4344/8640] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:44:13 2022] DELETE /identity/v3/users/97cb465affcf4b328550d1f7b4dfeddf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:44:13.888719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf5c6a-9df1-4291-8640-e85b02b65767 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:13.889662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf5c6a-9df1-4291-8640-e85b02b65767 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:13.890122 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf5c6a-9df1-4291-8640-e85b02b65767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:13.934187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8caf5c6a-9df1-4291-8640-e85b02b65767 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:13.935760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8caf5c6a-9df1-4291-8640-e85b02b65767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:14.008708 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4297/8641] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:44:14.019724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:14.021166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:14.086400 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add5de6-8c26-4e24-8f10-f8265ac5c2f2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:14.091600 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed58703-9309-4c6d-b75e-cb2d07589429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:14.092287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed58703-9309-4c6d-b75e-cb2d07589429 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:14.092638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed58703-9309-4c6d-b75e-cb2d07589429 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:14.092984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed58703-9309-4c6d-b75e-cb2d07589429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:14.103598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed58703-9309-4c6d-b75e-cb2d07589429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:14.105119 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed58703-9309-4c6d-b75e-cb2d07589429 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:14.116253 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4345/8642] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:44:14.301374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf5c6a-9df1-4291-8640-e85b02b65767 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:14.302993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8caf5c6a-9df1-4291-8640-e85b02b65767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:14.317338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf5c6a-9df1-4291-8640-e85b02b65767 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:14.322028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:14.322798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:14.323077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:14.323924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] PATH_INFO: `/v3/projects/8ef9725c71164a6d9a8f39ec80a73748` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:14.325081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef9725c71164a6d9a8f39ec80a73748)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:14.327187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:14.374684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef9725c71164a6d9a8f39ec80a73748', 'request_id': 'req-a9912508-8bc9-4617-ae49-74da8873379a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.380368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef9725c71164a6d9a8f39ec80a73748', 'request_id': 'req-a9912508-8bc9-4617-ae49-74da8873379a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.386958 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef9725c71164a6d9a8f39ec80a73748', 'request_id': 'req-a9912508-8bc9-4617-ae49-74da8873379a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.398817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] The token cache is being invalidate because project 8ef9725c71164a6d9a8f39ec80a73748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:44:14.399109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.399764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.401247 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4298/8643] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:44:14 2022] DELETE /identity/v3/projects/8ef9725c71164a6d9a8f39ec80a73748 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:44:14.405283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed58703-9309-4c6d-b75e-cb2d07589429 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:14.414879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed58703-9309-4c6d-b75e-cb2d07589429 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:14.434023 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:14.473671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b244b-0492-407a-aae1-e58701470231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:14.474300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b244b-0492-407a-aae1-e58701470231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:14.474583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b244b-0492-407a-aae1-e58701470231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:14.474886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b244b-0492-407a-aae1-e58701470231 admin admin] PATH_INFO: `/v3/users/15d39db5317449428ae777d0bfca8df7` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:14.476003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b244b-0492-407a-aae1-e58701470231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d39db5317449428ae777d0bfca8df7)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:14.477933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b244b-0492-407a-aae1-e58701470231 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:14.523051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a46b244b-0492-407a-aae1-e58701470231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d39db5317449428ae777d0bfca8df7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.535890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a46b244b-0492-407a-aae1-e58701470231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d39db5317449428ae777d0bfca8df7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.536574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a46b244b-0492-407a-aae1-e58701470231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d39db5317449428ae777d0bfca8df7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.544408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a46b244b-0492-407a-aae1-e58701470231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d39db5317449428ae777d0bfca8df7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.545071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a46b244b-0492-407a-aae1-e58701470231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d39db5317449428ae777d0bfca8df7'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.557755 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4346/8644] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:44:14 2022] DELETE /identity/v3/users/15d39db5317449428ae777d0bfca8df7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:44:14.834239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:14.835709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:14.849702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9912508-8bc9-4617-ae49-74da8873379a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:14.908926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:14.909696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:14.909980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:14.910254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] PATH_INFO: `/v3/projects/9dc649cd84f54bcb8ea541ed89246977` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:14.911410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc649cd84f54bcb8ea541ed89246977)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:14.913336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:14.946098 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:14.965783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc649cd84f54bcb8ea541ed89246977', 'request_id': 'req-bef47526-1d1a-4838-a2ce-d301f4bc64ec'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.972611 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc649cd84f54bcb8ea541ed89246977', 'request_id': 'req-bef47526-1d1a-4838-a2ce-d301f4bc64ec'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.980758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc649cd84f54bcb8ea541ed89246977', 'request_id': 'req-bef47526-1d1a-4838-a2ce-d301f4bc64ec'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.993647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] The token cache is being invalidate because project 9dc649cd84f54bcb8ea541ed89246977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:44:14.993944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.994589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bef47526-1d1a-4838-a2ce-d301f4bc64ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:14.996708 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4299/8645] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:44:14 2022] DELETE /identity/v3/projects/9dc649cd84f54bcb8ea541ed89246977 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:44:15.003315 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f1b17-9286-47e4-b949-766028f90125 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.003821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f1b17-9286-47e4-b949-766028f90125 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.003990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f1b17-9286-47e4-b949-766028f90125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.023997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a83f1b17-9286-47e4-b949-766028f90125 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:15.025208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a83f1b17-9286-47e4-b949-766028f90125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:15.085649 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4347/8646] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:44:15.095526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d92a1-3ac1-4229-be58-1adede4901b5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.095734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d92a1-3ac1-4229-be58-1adede4901b5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.096012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d92a1-3ac1-4229-be58-1adede4901b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.115831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6f3d92a1-3ac1-4229-be58-1adede4901b5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:15.117121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6f3d92a1-3ac1-4229-be58-1adede4901b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:15.125654 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4300/8647] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:44:15.129867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f1b17-9286-47e4-b949-766028f90125 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:15.139877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f1b17-9286-47e4-b949-766028f90125 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:15.144342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb934fb-5e08-4c78-9c5f-d8a2ce6d2a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:15.144936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb934fb-5e08-4c78-9c5f-d8a2ce6d2a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.145211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb934fb-5e08-4c78-9c5f-d8a2ce6d2a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.145478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb934fb-5e08-4c78-9c5f-d8a2ce6d2a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.146113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb934fb-5e08-4c78-9c5f-d8a2ce6d2a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:44:15.146413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb934fb-5e08-4c78-9c5f-d8a2ce6d2a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:15.148050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb934fb-5e08-4c78-9c5f-d8a2ce6d2a0b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:15.162643 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4348/8648] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:44:15.164624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d92a1-3ac1-4229-be58-1adede4901b5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:15.175170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d92a1-3ac1-4229-be58-1adede4901b5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:15.179875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4933a-36b8-4163-8afb-56742640eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:15.180732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4933a-36b8-4163-8afb-56742640eacc admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.181013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4933a-36b8-4163-8afb-56742640eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.181304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4933a-36b8-4163-8afb-56742640eacc admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.181923 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4933a-36b8-4163-8afb-56742640eacc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:15.183889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4933a-36b8-4163-8afb-56742640eacc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:15.216244 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4301/8649] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:44:15 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:44:15.217366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb934fb-5e08-4c78-9c5f-d8a2ce6d2a0b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:15.227693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb934fb-5e08-4c78-9c5f-d8a2ce6d2a0b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:15.264040 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:15.298052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492f4dc-1db5-4a96-bb33-01f7a32d257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:15.298690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492f4dc-1db5-4a96-bb33-01f7a32d257a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.298969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492f4dc-1db5-4a96-bb33-01f7a32d257a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.299238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492f4dc-1db5-4a96-bb33-01f7a32d257a admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.299876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492f4dc-1db5-4a96-bb33-01f7a32d257a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:15.301918 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492f4dc-1db5-4a96-bb33-01f7a32d257a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:15.324316 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4349/8650] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:44:15 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:44:15.328570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4933a-36b8-4163-8afb-56742640eacc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:15.339629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4933a-36b8-4163-8afb-56742640eacc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:15.345487 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46fb61-d88c-41f3-a8eb-b7060a99e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:15.346130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46fb61-d88c-41f3-a8eb-b7060a99e1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.346474 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46fb61-d88c-41f3-a8eb-b7060a99e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.346840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46fb61-d88c-41f3-a8eb-b7060a99e1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.347542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46fb61-d88c-41f3-a8eb-b7060a99e1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:15.349208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46fb61-d88c-41f3-a8eb-b7060a99e1ce admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:15.360003 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4302/8651] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:44:15.367792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492f4dc-1db5-4a96-bb33-01f7a32d257a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:15.379661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492f4dc-1db5-4a96-bb33-01f7a32d257a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:15.384624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba0f5-5a7d-4448-b6ea-e9a03dc25963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:15.385294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba0f5-5a7d-4448-b6ea-e9a03dc25963 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.385642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba0f5-5a7d-4448-b6ea-e9a03dc25963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.386826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba0f5-5a7d-4448-b6ea-e9a03dc25963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.387551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba0f5-5a7d-4448-b6ea-e9a03dc25963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:15.389211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba0f5-5a7d-4448-b6ea-e9a03dc25963 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:15.403689 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4350/8652] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:44:15.408346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46fb61-d88c-41f3-a8eb-b7060a99e1ce admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:15.421703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46fb61-d88c-41f3-a8eb-b7060a99e1ce admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:15.427036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd13721-7e23-4a80-85f2-40bf9a3d7608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:15.427948 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd13721-7e23-4a80-85f2-40bf9a3d7608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.428408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd13721-7e23-4a80-85f2-40bf9a3d7608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.428678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd13721-7e23-4a80-85f2-40bf9a3d7608 admin admin] PATH_INFO: `/v3/projects/45e66590ce714dd7a35f1538fe5b0874/users/996124511ad840069bc5bf4c564182ea/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.465023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd13721-7e23-4a80-85f2-40bf9a3d7608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e66590ce714dd7a35f1538fe5b0874, user_id=996124511ad840069bc5bf4c564182ea, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:15.468571 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd13721-7e23-4a80-85f2-40bf9a3d7608 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:15.485441 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4303/8653] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:44:15 2022] PUT /identity/v3/projects/45e66590ce714dd7a35f1538fe5b0874/users/996124511ad840069bc5bf4c564182ea/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:44:15.497773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21112c62-1e03-403f-832e-d598c6075b64 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.498086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21112c62-1e03-403f-832e-d598c6075b64 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.498332 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21112c62-1e03-403f-832e-d598c6075b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.528887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-21112c62-1e03-403f-832e-d598c6075b64 None None] MFA Rules not processed for user `996124511ad840069bc5bf4c564182ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:15.530367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-21112c62-1e03-403f-832e-d598c6075b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:15.599124 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4351/8654] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:44:15.604011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd13721-7e23-4a80-85f2-40bf9a3d7608 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:15.673043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd13721-7e23-4a80-85f2-40bf9a3d7608 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:15.677745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05304f79-e775-431a-8724-cb08439890bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:15.678371 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05304f79-e775-431a-8724-cb08439890bf admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.678679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05304f79-e775-431a-8724-cb08439890bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.678959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05304f79-e775-431a-8724-cb08439890bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.679601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05304f79-e775-431a-8724-cb08439890bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:15.681763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05304f79-e775-431a-8724-cb08439890bf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:15.710946 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4304/8655] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:44:15 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:44:15.715544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21112c62-1e03-403f-832e-d598c6075b64 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:15.726831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21112c62-1e03-403f-832e-d598c6075b64 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:15.788860 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17e21c-99ac-4232-a789-bceb0484e78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:15.789391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17e21c-99ac-4232-a789-bceb0484e78b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.789668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17e21c-99ac-4232-a789-bceb0484e78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.790033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17e21c-99ac-4232-a789-bceb0484e78b admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.790874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17e21c-99ac-4232-a789-bceb0484e78b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:15.793431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17e21c-99ac-4232-a789-bceb0484e78b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:15.820616 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4352/8656] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:44:15 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:44:15.821865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05304f79-e775-431a-8724-cb08439890bf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:15.837512 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05304f79-e775-431a-8724-cb08439890bf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:15.848705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a4f19-b9ae-4975-84a3-af5b9e6b3dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:15.849456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4f19-b9ae-4975-84a3-af5b9e6b3dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.849740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4f19-b9ae-4975-84a3-af5b9e6b3dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.850073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4f19-b9ae-4975-84a3-af5b9e6b3dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.850839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a4f19-b9ae-4975-84a3-af5b9e6b3dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:15.852458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a4f19-b9ae-4975-84a3-af5b9e6b3dd0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:15.866355 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4305/8657] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:44:15.871610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17e21c-99ac-4232-a789-bceb0484e78b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:15.882588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17e21c-99ac-4232-a789-bceb0484e78b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:15.888809 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40447e37-1aea-4a18-b2ef-0df72bea106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:15.889603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40447e37-1aea-4a18-b2ef-0df72bea106a admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.890103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40447e37-1aea-4a18-b2ef-0df72bea106a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.890473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40447e37-1aea-4a18-b2ef-0df72bea106a admin admin] PATH_INFO: `/v3/projects/ebd45ad723e34c9587953041166c0e16/users/ae901f91a258497abdc194bbfdf475ea/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:15.907581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40447e37-1aea-4a18-b2ef-0df72bea106a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd45ad723e34c9587953041166c0e16, user_id=ae901f91a258497abdc194bbfdf475ea, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:15.910580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40447e37-1aea-4a18-b2ef-0df72bea106a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:15.940060 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4353/8658] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:44:15 2022] PUT /identity/v3/projects/ebd45ad723e34c9587953041166c0e16/users/ae901f91a258497abdc194bbfdf475ea/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:44:15.957514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111cd13-54b3-4475-bf71-3b5439944008 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:15.958523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111cd13-54b3-4475-bf71-3b5439944008 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:15.959419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111cd13-54b3-4475-bf71-3b5439944008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:16.020395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f111cd13-54b3-4475-bf71-3b5439944008 None None] MFA Rules not processed for user `ae901f91a258497abdc194bbfdf475ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:16.022063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f111cd13-54b3-4475-bf71-3b5439944008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:16.040805 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:16.108221 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4306/8659] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:15 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:44:16.162269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40447e37-1aea-4a18-b2ef-0df72bea106a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:16.167610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-40447e37-1aea-4a18-b2ef-0df72bea106a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:16.178150 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:16.291129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40447e37-1aea-4a18-b2ef-0df72bea106a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:16.307546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3a55-d864-42b0-90cb-b0c351d52414 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:16.308399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3a55-d864-42b0-90cb-b0c351d52414 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:16.308813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3a55-d864-42b0-90cb-b0c351d52414 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:16.308941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3a55-d864-42b0-90cb-b0c351d52414 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:16.321362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d3a55-d864-42b0-90cb-b0c351d52414 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:16.323847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d3a55-d864-42b0-90cb-b0c351d52414 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:16.336124 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4354/8660] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:44:17.134662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111cd13-54b3-4475-bf71-3b5439944008 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:17.204469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111cd13-54b3-4475-bf71-3b5439944008 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:17.209173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:17.209810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:17.210088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:17.210364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] PATH_INFO: `/v3/users/996124511ad840069bc5bf4c564182ea` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:17.211767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996124511ad840069bc5bf4c564182ea)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:17.213705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:17.267390 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996124511ad840069bc5bf4c564182ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:17.280484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996124511ad840069bc5bf4c564182ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:17.281203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996124511ad840069bc5bf4c564182ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:17.292629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996124511ad840069bc5bf4c564182ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:17.301349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996124511ad840069bc5bf4c564182ea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:17.308467 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4307/8661] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:44:17 2022] DELETE /identity/v3/users/996124511ad840069bc5bf4c564182ea => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:44:17.312829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4dd7-55d7-43de-bc0e-166966e977fd None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:17.313323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4dd7-55d7-43de-bc0e-166966e977fd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:17.313435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4dd7-55d7-43de-bc0e-166966e977fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:17.332815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7e3c4dd7-55d7-43de-bc0e-166966e977fd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:17.334012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7e3c4dd7-55d7-43de-bc0e-166966e977fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:17.397282 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4355/8662] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:44:17.407626 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:17.409214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:17.448652 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:17.480981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c25cd9-c8ff-4764-8707-f5b1babf6419 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:17.484990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc79cf-e61e-41f4-b714-9dc35278e272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:17.485811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc79cf-e61e-41f4-b714-9dc35278e272 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:17.486271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc79cf-e61e-41f4-b714-9dc35278e272 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:17.486551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc79cf-e61e-41f4-b714-9dc35278e272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:17.496614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc79cf-e61e-41f4-b714-9dc35278e272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:17.498112 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc79cf-e61e-41f4-b714-9dc35278e272 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:17.514548 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4308/8663] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:44:17.697745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e7b4a-565f-46c8-9d69-09c38ab5422a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:17.698984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e7b4a-565f-46c8-9d69-09c38ab5422a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:17.699266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e7b4a-565f-46c8-9d69-09c38ab5422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:17.723917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9b9e7b4a-565f-46c8-9d69-09c38ab5422a None None] MFA Rules not processed for user `30c3d05e92dd463e81ccc5a557e46fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:17.725848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9b9e7b4a-565f-46c8-9d69-09c38ab5422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:17.800935 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4356/8664] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:44:18.019116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc79cf-e61e-41f4-b714-9dc35278e272 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:18.020707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-06cc79cf-e61e-41f4-b714-9dc35278e272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:18.034882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc79cf-e61e-41f4-b714-9dc35278e272 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:18.039814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:18.040453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:18.040735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:18.041011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] PATH_INFO: `/v3/projects/45e66590ce714dd7a35f1538fe5b0874` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:18.043842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e66590ce714dd7a35f1538fe5b0874)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:18.045874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:18.099447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e66590ce714dd7a35f1538fe5b0874', 'request_id': 'req-6b6d3b24-665a-43f5-b82c-6d652d438f0a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.106484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e66590ce714dd7a35f1538fe5b0874', 'request_id': 'req-6b6d3b24-665a-43f5-b82c-6d652d438f0a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.112834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e66590ce714dd7a35f1538fe5b0874', 'request_id': 'req-6b6d3b24-665a-43f5-b82c-6d652d438f0a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.126432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] The token cache is being invalidate because project 45e66590ce714dd7a35f1538fe5b0874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:44:18.126759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.127388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.129199 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4309/8665] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:44:18 2022] DELETE /identity/v3/projects/45e66590ce714dd7a35f1538fe5b0874 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:44:18.133015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e7b4a-565f-46c8-9d69-09c38ab5422a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:18.143620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e7b4a-565f-46c8-9d69-09c38ab5422a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:18.171555 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:18.204048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861aa47-2752-424a-ac9f-dbc70f7761c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:18.204684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861aa47-2752-424a-ac9f-dbc70f7761c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:18.204966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861aa47-2752-424a-ac9f-dbc70f7761c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:18.205266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861aa47-2752-424a-ac9f-dbc70f7761c9 admin admin] PATH_INFO: `/v3/users/ae901f91a258497abdc194bbfdf475ea` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:18.206397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861aa47-2752-424a-ac9f-dbc70f7761c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae901f91a258497abdc194bbfdf475ea)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:18.208367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861aa47-2752-424a-ac9f-dbc70f7761c9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:18.259716 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d861aa47-2752-424a-ac9f-dbc70f7761c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae901f91a258497abdc194bbfdf475ea'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.272229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d861aa47-2752-424a-ac9f-dbc70f7761c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae901f91a258497abdc194bbfdf475ea'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.272881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d861aa47-2752-424a-ac9f-dbc70f7761c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae901f91a258497abdc194bbfdf475ea'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.282102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d861aa47-2752-424a-ac9f-dbc70f7761c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae901f91a258497abdc194bbfdf475ea'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.282878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-d861aa47-2752-424a-ac9f-dbc70f7761c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae901f91a258497abdc194bbfdf475ea'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.295785 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4357/8666] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:44:18 2022] DELETE /identity/v3/users/ae901f91a258497abdc194bbfdf475ea => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:44:18.631873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:18.633383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:18.648016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d3b24-665a-43f5-b82c-6d652d438f0a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:18.709814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:18.710453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:18.710776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:18.711254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] PATH_INFO: `/v3/projects/ebd45ad723e34c9587953041166c0e16` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:18.712157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd45ad723e34c9587953041166c0e16)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:18.714771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:18.769642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd45ad723e34c9587953041166c0e16', 'request_id': 'req-22054bb4-e668-4164-b7bd-a89bd598efda'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.775584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd45ad723e34c9587953041166c0e16', 'request_id': 'req-22054bb4-e668-4164-b7bd-a89bd598efda'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.778562 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:18.786640 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd45ad723e34c9587953041166c0e16', 'request_id': 'req-22054bb4-e668-4164-b7bd-a89bd598efda'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.804917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] The token cache is being invalidate because project ebd45ad723e34c9587953041166c0e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:44:18.805650 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.807356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22054bb4-e668-4164-b7bd-a89bd598efda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:44:18.811385 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4310/8667] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:44:18 2022] DELETE /identity/v3/projects/ebd45ad723e34c9587953041166c0e16 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:44:18.816317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ac3fd-f6ee-420f-b58f-2c1210f8f4f0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:18.816805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ac3fd-f6ee-420f-b58f-2c1210f8f4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:18.816914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ac3fd-f6ee-420f-b58f-2c1210f8f4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:18.848151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bb7ac3fd-f6ee-420f-b58f-2c1210f8f4f0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:18.849389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bb7ac3fd-f6ee-420f-b58f-2c1210f8f4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:18.927497 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4358/8668] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:44:18.937589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e428d0-18f0-4aae-8659-15c399b6240c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:18.937878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e428d0-18f0-4aae-8659-15c399b6240c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:18.938155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e428d0-18f0-4aae-8659-15c399b6240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:18.964705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c8e428d0-18f0-4aae-8659-15c399b6240c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:18.966168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8e428d0-18f0-4aae-8659-15c399b6240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:18.976293 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4311/8669] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:44:18.982168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ac3fd-f6ee-420f-b58f-2c1210f8f4f0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:18.992510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ac3fd-f6ee-420f-b58f-2c1210f8f4f0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:18.997282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180ce1-1cc1-4dd8-ab8d-9d307b4ee434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:18.997881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180ce1-1cc1-4dd8-ab8d-9d307b4ee434 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:18.998160 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180ce1-1cc1-4dd8-ab8d-9d307b4ee434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:18.998432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180ce1-1cc1-4dd8-ab8d-9d307b4ee434 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:18.999129 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180ce1-1cc1-4dd8-ab8d-9d307b4ee434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:44:18.999432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180ce1-1cc1-4dd8-ab8d-9d307b4ee434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:19.001020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180ce1-1cc1-4dd8-ab8d-9d307b4ee434 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:19.015792 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4359/8670] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 02 01:44:19.020017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e428d0-18f0-4aae-8659-15c399b6240c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:19.032783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e428d0-18f0-4aae-8659-15c399b6240c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:19.037995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7e6c-cfe8-4d8e-b19f-672bbe23e0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:19.038741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7e6c-cfe8-4d8e-b19f-672bbe23e0ad admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:19.039089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7e6c-cfe8-4d8e-b19f-672bbe23e0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:19.039576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7e6c-cfe8-4d8e-b19f-672bbe23e0ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:19.040276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c7e6c-cfe8-4d8e-b19f-672bbe23e0ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:19.042839 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c7e6c-cfe8-4d8e-b19f-672bbe23e0ad admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:19.072766 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4312/8671] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:44:19 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:44:19.077824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180ce1-1cc1-4dd8-ab8d-9d307b4ee434 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:19.088489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180ce1-1cc1-4dd8-ab8d-9d307b4ee434 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:19.122006 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:19.150533 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148d3bf-b3bb-44b0-8d8f-f8b970157330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:19.151712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148d3bf-b3bb-44b0-8d8f-f8b970157330 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:19.151995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148d3bf-b3bb-44b0-8d8f-f8b970157330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:19.152284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148d3bf-b3bb-44b0-8d8f-f8b970157330 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:19.152942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148d3bf-b3bb-44b0-8d8f-f8b970157330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:19.154981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148d3bf-b3bb-44b0-8d8f-f8b970157330 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:19.184173 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4360/8672] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:44:19 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:44:19.188392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7e6c-cfe8-4d8e-b19f-672bbe23e0ad admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:19.199624 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7e6c-cfe8-4d8e-b19f-672bbe23e0ad admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:19.204380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10d1f-eb5c-4e9e-a562-761671170cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:19.204992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10d1f-eb5c-4e9e-a562-761671170cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:19.205272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10d1f-eb5c-4e9e-a562-761671170cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:19.205547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10d1f-eb5c-4e9e-a562-761671170cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:19.206198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef10d1f-eb5c-4e9e-a562-761671170cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:19.208027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef10d1f-eb5c-4e9e-a562-761671170cc4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:19.219614 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4313/8673] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:44:19.223737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148d3bf-b3bb-44b0-8d8f-f8b970157330 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:19.236515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148d3bf-b3bb-44b0-8d8f-f8b970157330 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:19.243502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca54c59-2ddc-424e-9600-b70ed154d53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:19.244233 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca54c59-2ddc-424e-9600-b70ed154d53a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:19.245007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca54c59-2ddc-424e-9600-b70ed154d53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:19.245007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca54c59-2ddc-424e-9600-b70ed154d53a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:19.245677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca54c59-2ddc-424e-9600-b70ed154d53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:19.247608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca54c59-2ddc-424e-9600-b70ed154d53a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:19.262015 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4361/8674] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:44:19.266160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10d1f-eb5c-4e9e-a562-761671170cc4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:19.277328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10d1f-eb5c-4e9e-a562-761671170cc4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:19.283836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bc2c2-0a71-4881-a85b-3f31363f0fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:19.284449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc2c2-0a71-4881-a85b-3f31363f0fca admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:19.284764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc2c2-0a71-4881-a85b-3f31363f0fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:19.285022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc2c2-0a71-4881-a85b-3f31363f0fca admin admin] PATH_INFO: `/v3/projects/5d7ab191bb4e4b21a8a4011d8cd93f86/users/73a7c1c4929d49aea6e4e492e32ccafd/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:19.301639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bc2c2-0a71-4881-a85b-3f31363f0fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7ab191bb4e4b21a8a4011d8cd93f86, user_id=73a7c1c4929d49aea6e4e492e32ccafd, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:19.304922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bc2c2-0a71-4881-a85b-3f31363f0fca admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:19.321925 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4314/8675] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:44:19 2022] PUT /identity/v3/projects/5d7ab191bb4e4b21a8a4011d8cd93f86/users/73a7c1c4929d49aea6e4e492e32ccafd/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:44:19.327440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42faca-c336-4091-9f8c-427d301d694e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:19.327820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42faca-c336-4091-9f8c-427d301d694e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:19.328105 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42faca-c336-4091-9f8c-427d301d694e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:19.349126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-3b42faca-c336-4091-9f8c-427d301d694e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:19.350344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3b42faca-c336-4091-9f8c-427d301d694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:19.409751 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4362/8676] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:44:19.420587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bc2c2-0a71-4881-a85b-3f31363f0fca admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:19.422270 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-926bc2c2-0a71-4881-a85b-3f31363f0fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:19.481287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bc2c2-0a71-4881-a85b-3f31363f0fca admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:19.484977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf063c84-5dc7-46d3-87b1-2c8dd43f79e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:19.485580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf063c84-5dc7-46d3-87b1-2c8dd43f79e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:19.485862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf063c84-5dc7-46d3-87b1-2c8dd43f79e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:19.486138 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf063c84-5dc7-46d3-87b1-2c8dd43f79e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:19.495623 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf063c84-5dc7-46d3-87b1-2c8dd43f79e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:19.497058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf063c84-5dc7-46d3-87b1-2c8dd43f79e0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:19.507439 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4315/8677] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:44:26.278367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0a9bd-5b2f-4fb2-b17c-8e0c47273213 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:26.280768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0a9bd-5b2f-4fb2-b17c-8e0c47273213 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:26.280768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0a9bd-5b2f-4fb2-b17c-8e0c47273213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:26.325463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-dcb0a9bd-5b2f-4fb2-b17c-8e0c47273213 None None] MFA Rules not processed for user `73a7c1c4929d49aea6e4e492e32ccafd`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:26.326748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dcb0a9bd-5b2f-4fb2-b17c-8e0c47273213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:26.477853 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4363/8678] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:44:26.484260 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf063c84-5dc7-46d3-87b1-2c8dd43f79e0 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:26.505809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf063c84-5dc7-46d3-87b1-2c8dd43f79e0 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:26.520536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bd233-4f86-40b4-aa12-18f4f6ec0725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:26.521361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bd233-4f86-40b4-aa12-18f4f6ec0725 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:26.521599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bd233-4f86-40b4-aa12-18f4f6ec0725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:26.521916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bd233-4f86-40b4-aa12-18f4f6ec0725 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:26.523080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bd233-4f86-40b4-aa12-18f4f6ec0725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:26.525730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bd233-4f86-40b4-aa12-18f4f6ec0725 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:26.570789 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4316/8679] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:44:26 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:44:26.578475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0a9bd-5b2f-4fb2-b17c-8e0c47273213 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:26.599217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0a9bd-5b2f-4fb2-b17c-8e0c47273213 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:26.689200 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:26.729892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c84d3-031f-400c-8580-a1efc3c83b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:26.730618 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c84d3-031f-400c-8580-a1efc3c83b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:26.731559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c84d3-031f-400c-8580-a1efc3c83b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:26.732005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c84d3-031f-400c-8580-a1efc3c83b8d admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:26.733078 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c84d3-031f-400c-8580-a1efc3c83b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:26.736321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c84d3-031f-400c-8580-a1efc3c83b8d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:26.776927 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4364/8680] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:44:26 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:44:26.783854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bd233-4f86-40b4-aa12-18f4f6ec0725 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:26.811055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bd233-4f86-40b4-aa12-18f4f6ec0725 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:26.832108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c6e8c-f0ce-4f79-a77e-72d4b46723e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:26.833280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6e8c-f0ce-4f79-a77e-72d4b46723e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:26.833723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6e8c-f0ce-4f79-a77e-72d4b46723e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:26.834031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6e8c-f0ce-4f79-a77e-72d4b46723e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:26.834622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c6e8c-f0ce-4f79-a77e-72d4b46723e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:26.838174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c6e8c-f0ce-4f79-a77e-72d4b46723e2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:26.856232 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4317/8681] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:44:26.860535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c84d3-031f-400c-8580-a1efc3c83b8d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:26.876054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c84d3-031f-400c-8580-a1efc3c83b8d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:26.890276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e65ed-b729-4362-85e8-28a466ab9e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:26.893297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e65ed-b729-4362-85e8-28a466ab9e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:26.893814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e65ed-b729-4362-85e8-28a466ab9e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:26.894346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e65ed-b729-4362-85e8-28a466ab9e26 admin admin] PATH_INFO: `/v3/projects/ed305feed8504175ae657e353ee7c2b4/users/86df8173d53c4869bcd10786b42af569/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:26.925962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e65ed-b729-4362-85e8-28a466ab9e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed305feed8504175ae657e353ee7c2b4, user_id=86df8173d53c4869bcd10786b42af569, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:26.929513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e65ed-b729-4362-85e8-28a466ab9e26 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:26.982745 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4365/8682] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:44:26 2022] PUT /identity/v3/projects/ed305feed8504175ae657e353ee7c2b4/users/86df8173d53c4869bcd10786b42af569/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:44:26.983014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c6e8c-f0ce-4f79-a77e-72d4b46723e2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:26.994178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c6e8c-f0ce-4f79-a77e-72d4b46723e2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:27.158164 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:27.175043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b062a-4645-4f30-9bab-0671cb2c2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:27.176406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b062a-4645-4f30-9bab-0671cb2c2df1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:27.177158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b062a-4645-4f30-9bab-0671cb2c2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:27.178017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b062a-4645-4f30-9bab-0671cb2c2df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:27.179312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b062a-4645-4f30-9bab-0671cb2c2df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:27.188802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b062a-4645-4f30-9bab-0671cb2c2df1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:27.221717 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4318/8683] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:44:27.223155 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e65ed-b729-4362-85e8-28a466ab9e26 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:27.236402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e65ed-b729-4362-85e8-28a466ab9e26 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:27.250638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0a54a-ae07-4656-b980-917c6f54b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:27.251150 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0a54a-ae07-4656-b980-917c6f54b178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:27.251447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0a54a-ae07-4656-b980-917c6f54b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:27.251838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0a54a-ae07-4656-b980-917c6f54b178 admin admin] PATH_INFO: `/v3/projects/ed305feed8504175ae657e353ee7c2b4/users/86df8173d53c4869bcd10786b42af569/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:27.256563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0a54a-ae07-4656-b980-917c6f54b178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed305feed8504175ae657e353ee7c2b4, user_id=86df8173d53c4869bcd10786b42af569, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:27.261940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0a54a-ae07-4656-b980-917c6f54b178 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:27.275058 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4366/8684] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:44:27 2022] PUT /identity/v3/projects/ed305feed8504175ae657e353ee7c2b4/users/86df8173d53c4869bcd10786b42af569/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:44:33.544233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2464-3853-414f-a01d-22f3cfb9a617 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:33.544671 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2464-3853-414f-a01d-22f3cfb9a617 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:33.544791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2464-3853-414f-a01d-22f3cfb9a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:33.576866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-74bf2464-3853-414f-a01d-22f3cfb9a617 None None] MFA Rules not processed for user `86df8173d53c4869bcd10786b42af569`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:33.578106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-74bf2464-3853-414f-a01d-22f3cfb9a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:33.685512 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4319/8685] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:44:33.701492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0a54a-ae07-4656-b980-917c6f54b178 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:33.703376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e2b0a54a-ae07-4656-b980-917c6f54b178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:33.793011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0a54a-ae07-4656-b980-917c6f54b178 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:33.798579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21472f0d-302f-4392-a43e-aa9a8c03b4c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:33.799257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21472f0d-302f-4392-a43e-aa9a8c03b4c8 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:33.799525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21472f0d-302f-4392-a43e-aa9a8c03b4c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:33.799800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21472f0d-302f-4392-a43e-aa9a8c03b4c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:33.864721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21472f0d-302f-4392-a43e-aa9a8c03b4c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:33.866439 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21472f0d-302f-4392-a43e-aa9a8c03b4c8 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:33.877028 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4367/8686] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:44:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:44:35.023747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6da84-ece0-4076-b74d-d241af39a64c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:35.024257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6da84-ece0-4076-b74d-d241af39a64c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:35.024373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6da84-ece0-4076-b74d-d241af39a64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:35.049012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-58e6da84-ece0-4076-b74d-d241af39a64c None None] MFA Rules not processed for user `73a7c1c4929d49aea6e4e492e32ccafd`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:44:35.050334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-58e6da84-ece0-4076-b74d-d241af39a64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:35.060791 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4320/8687] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:44:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:44:43.872457 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=80,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:45.042319 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=41 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:44:46.971742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21472f0d-302f-4392-a43e-aa9a8c03b4c8 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:46.973152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-21472f0d-302f-4392-a43e-aa9a8c03b4c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:47.034911 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21472f0d-302f-4392-a43e-aa9a8c03b4c8 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:47.038660 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd311c-1003-423d-969f-00808b0461b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:47.039259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd311c-1003-423d-969f-00808b0461b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:47.039536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd311c-1003-423d-969f-00808b0461b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:47.039804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd311c-1003-423d-969f-00808b0461b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:47.049077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd311c-1003-423d-969f-00808b0461b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:47.050648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd311c-1003-423d-969f-00808b0461b6 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:47.060474 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4368/8688] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:44:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:44:54.150523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6da84-ece0-4076-b74d-d241af39a64c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:54.152510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-58e6da84-ece0-4076-b74d-d241af39a64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:54.227879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6da84-ece0-4076-b74d-d241af39a64c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:54.233780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8d76f-0ea0-4c6b-8b2f-a8a46f2c3413 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:54.234401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8d76f-0ea0-4c6b-8b2f-a8a46f2c3413 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:54.234734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8d76f-0ea0-4c6b-8b2f-a8a46f2c3413 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:54.235012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8d76f-0ea0-4c6b-8b2f-a8a46f2c3413 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:54.236745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28a8d76f-0ea0-4c6b-8b2f-a8a46f2c3413 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:54.251976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8d76f-0ea0-4c6b-8b2f-a8a46f2c3413 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:54.253876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8d76f-0ea0-4c6b-8b2f-a8a46f2c3413 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:54.266863 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4321/8689] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:44:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:44:55.930736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd311c-1003-423d-969f-00808b0461b6 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:44:55.932615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-21cd311c-1003-423d-969f-00808b0461b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:55.956856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd311c-1003-423d-969f-00808b0461b6 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:44:55.964405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94232f-b2a9-430a-add5-532a0900b12f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:44:55.965362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94232f-b2a9-430a-add5-532a0900b12f service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:44:55.965645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94232f-b2a9-430a-add5-532a0900b12f service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:44:55.965997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94232f-b2a9-430a-add5-532a0900b12f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:44:55.970455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ea94232f-b2a9-430a-add5-532a0900b12f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:44:56.036638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94232f-b2a9-430a-add5-532a0900b12f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:44:56.038303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94232f-b2a9-430a-add5-532a0900b12f service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:44:56.047930 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4369/8690] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:44:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:45:04.260469 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=32 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:06.044104 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=54 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:12.559064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8d76f-0ea0-4c6b-8b2f-a8a46f2c3413 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:45:12.577768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8d76f-0ea0-4c6b-8b2f-a8a46f2c3413 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:45:12.596379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f4904-c40e-4623-95c5-82a81bc1892d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:45:12.597119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f4904-c40e-4623-95c5-82a81bc1892d service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:45:12.597398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f4904-c40e-4623-95c5-82a81bc1892d service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:45:12.597710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f4904-c40e-4623-95c5-82a81bc1892d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:45:12.599514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-008f4904-c40e-4623-95c5-82a81bc1892d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:45:12.669610 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f4904-c40e-4623-95c5-82a81bc1892d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:45:12.671761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f4904-c40e-4623-95c5-82a81bc1892d service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:45:12.684532 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4322/8691] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:45:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:45:22.293862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6275d-2e3e-4c07-bec9-ff425586990e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:45:22.294364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6275d-2e3e-4c07-bec9-ff425586990e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:45:22.294364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6275d-2e3e-4c07-bec9-ff425586990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:45:22.316228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1ab6275d-2e3e-4c07-bec9-ff425586990e None None] MFA Rules not processed for user `30c3d05e92dd463e81ccc5a557e46fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:45:22.317476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1ab6275d-2e3e-4c07-bec9-ff425586990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:45:22.383232 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4370/8692] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:45:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:45:22.678289 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=30 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:23.937532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f4904-c40e-4623-95c5-82a81bc1892d service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:45:23.950055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f4904-c40e-4623-95c5-82a81bc1892d service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:45:23.954051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db564da5-ed63-4be9-a746-53b70c4cb6b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:45:23.954687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564da5-ed63-4be9-a746-53b70c4cb6b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:45:23.955036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564da5-ed63-4be9-a746-53b70c4cb6b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:45:23.955315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564da5-ed63-4be9-a746-53b70c4cb6b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:45:23.957039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-db564da5-ed63-4be9-a746-53b70c4cb6b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:45:23.986123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db564da5-ed63-4be9-a746-53b70c4cb6b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:45:23.987708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db564da5-ed63-4be9-a746-53b70c4cb6b6 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:45:23.999206 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4323/8693] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:45:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:45:26.574357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6275d-2e3e-4c07-bec9-ff425586990e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:45:26.603505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6275d-2e3e-4c07-bec9-ff425586990e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:45:26.620661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cf973-f2a7-4779-9362-01be6f98b100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:45:26.621535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf973-f2a7-4779-9362-01be6f98b100 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:45:26.621915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf973-f2a7-4779-9362-01be6f98b100 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:45:26.622391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf973-f2a7-4779-9362-01be6f98b100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:45:26.631808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cf1cf973-f2a7-4779-9362-01be6f98b100 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:45:26.660399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cf973-f2a7-4779-9362-01be6f98b100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:45:26.662183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cf973-f2a7-4779-9362-01be6f98b100 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:45:26.691109 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4371/8694] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:45:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:45:29.046395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b23029-4fca-4b08-956b-27c031894b5c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:45:29.047032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b23029-4fca-4b08-956b-27c031894b5c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:45:29.047032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b23029-4fca-4b08-956b-27c031894b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:45:29.092667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-59b23029-4fca-4b08-956b-27c031894b5c None None] MFA Rules not processed for user `4ac7b60e4e094354a9692bb46c3ebf8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:45:29.096534 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-59b23029-4fca-4b08-956b-27c031894b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:45:29.115896 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4324/8695] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:45:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:45:36.230790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cf973-f2a7-4779-9362-01be6f98b100 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:45:36.242516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cf973-f2a7-4779-9362-01be6f98b100 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:45:36.246855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d35419-d30e-413e-b5fe-e3b641cae143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:45:36.247443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d35419-d30e-413e-b5fe-e3b641cae143 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:45:36.247723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d35419-d30e-413e-b5fe-e3b641cae143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:45:36.248024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d35419-d30e-413e-b5fe-e3b641cae143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:45:36.249720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-29d35419-d30e-413e-b5fe-e3b641cae143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:45:36.269306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d35419-d30e-413e-b5fe-e3b641cae143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:45:36.270852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d35419-d30e-413e-b5fe-e3b641cae143 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:45:36.284818 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4372/8696] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:45:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:45:39.076496 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=9 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:41.325741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b23029-4fca-4b08-956b-27c031894b5c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:45:41.340797 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b23029-4fca-4b08-956b-27c031894b5c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:45:41.344781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa72b-cd21-4de7-8505-b5edb283a9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:45:41.345396 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa72b-cd21-4de7-8505-b5edb283a9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:45:41.345677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa72b-cd21-4de7-8505-b5edb283a9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:45:41.345949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa72b-cd21-4de7-8505-b5edb283a9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:45:41.347860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4a8aa72b-cd21-4de7-8505-b5edb283a9b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:45:41.361216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aa72b-cd21-4de7-8505-b5edb283a9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:45:41.362721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aa72b-cd21-4de7-8505-b5edb283a9b2 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:45:41.375542 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4325/8697] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:45:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:45:44.858681 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56c8a-e0d2-479c-8517-157b4a9ed641 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:45:44.859211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56c8a-e0d2-479c-8517-157b4a9ed641 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:45:44.859433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56c8a-e0d2-479c-8517-157b4a9ed641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:45:44.879579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1ed56c8a-e0d2-479c-8517-157b4a9ed641 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:45:44.880776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1ed56c8a-e0d2-479c-8517-157b4a9ed641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:45:44.947691 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4373/8698] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:45:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:45:45.001036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa72b-cd21-4de7-8505-b5edb283a9b2 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:45:45.002548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4a8aa72b-cd21-4de7-8505-b5edb283a9b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:45:45.090771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa72b-cd21-4de7-8505-b5edb283a9b2 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:45:45.096085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f1d5b-e492-452c-8d43-782950fef173 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:45:45.096903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f1d5b-e492-452c-8d43-782950fef173 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:45:45.097184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f1d5b-e492-452c-8d43-782950fef173 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:45:45.097457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f1d5b-e492-452c-8d43-782950fef173 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:45:45.106028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f1d5b-e492-452c-8d43-782950fef173 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:45:45.107756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f1d5b-e492-452c-8d43-782950fef173 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:45:45.116007 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4326/8699] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:45:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:45:46.392735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67cd0f-c29f-425e-a757-34e3831c8973 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:45:46.393299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67cd0f-c29f-425e-a757-34e3831c8973 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:45:46.393299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67cd0f-c29f-425e-a757-34e3831c8973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:45:46.400517 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=67 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:46.414623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2d67cd0f-c29f-425e-a757-34e3831c8973 None None] MFA Rules not processed for user `30c3d05e92dd463e81ccc5a557e46fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:45:46.416395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2d67cd0f-c29f-425e-a757-34e3831c8973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:45:46.424043 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4374/8700] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:45:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:45:55.112615 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=38 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:45:56.409830 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:16.858692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f1d5b-e492-452c-8d43-782950fef173 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:46:16.872593 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f1d5b-e492-452c-8d43-782950fef173 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:46:16.878467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04218-3b8a-4d6b-bf43-13b9c357af1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:46:16.879082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04218-3b8a-4d6b-bf43-13b9c357af1a service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:46:16.879368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04218-3b8a-4d6b-bf43-13b9c357af1a service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:46:16.879644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04218-3b8a-4d6b-bf43-13b9c357af1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:46:16.881398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-07f04218-3b8a-4d6b-bf43-13b9c357af1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:46:16.896533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f04218-3b8a-4d6b-bf43-13b9c357af1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:46:16.898277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f04218-3b8a-4d6b-bf43-13b9c357af1a service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:46:16.911424 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4327/8701] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:46:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:46:17.090237 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67cd0f-c29f-425e-a757-34e3831c8973 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:46:17.103247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67cd0f-c29f-425e-a757-34e3831c8973 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:46:17.107667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64176580-2589-4695-8ecc-e219fdb726ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:46:17.108080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64176580-2589-4695-8ecc-e219fdb726ff service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:46:17.108360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64176580-2589-4695-8ecc-e219fdb726ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:46:17.108634 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64176580-2589-4695-8ecc-e219fdb726ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:46:17.110347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-64176580-2589-4695-8ecc-e219fdb726ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:46:17.123377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64176580-2589-4695-8ecc-e219fdb726ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:46:17.124802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64176580-2589-4695-8ecc-e219fdb726ff service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:46:17.136441 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4375/8702] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:46:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:46:17.255931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04218-3b8a-4d6b-bf43-13b9c357af1a service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:46:17.268186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04218-3b8a-4d6b-bf43-13b9c357af1a service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:46:17.271769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418e8cb-67ec-4786-872e-a5935c9e13e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:46:17.272426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e8cb-67ec-4786-872e-a5935c9e13e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:46:17.272709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e8cb-67ec-4786-872e-a5935c9e13e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:46:17.272984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e8cb-67ec-4786-872e-a5935c9e13e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:46:17.274788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3418e8cb-67ec-4786-872e-a5935c9e13e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:46:17.291955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418e8cb-67ec-4786-872e-a5935c9e13e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:46:17.293386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418e8cb-67ec-4786-872e-a5935c9e13e0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:46:17.308416 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4328/8703] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:46:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:46:27.129487 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:27.300457 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=12 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:30.281876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64176580-2589-4695-8ecc-e219fdb726ff service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:46:30.311966 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64176580-2589-4695-8ecc-e219fdb726ff service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:46:30.317605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a9d39-0e26-4e43-b111-1bab69a8ea46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:46:30.318712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a9d39-0e26-4e43-b111-1bab69a8ea46 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:46:30.319228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a9d39-0e26-4e43-b111-1bab69a8ea46 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:46:30.321273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a9d39-0e26-4e43-b111-1bab69a8ea46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:46:30.323474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-732a9d39-0e26-4e43-b111-1bab69a8ea46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:46:30.348186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a9d39-0e26-4e43-b111-1bab69a8ea46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:46:30.350356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a9d39-0e26-4e43-b111-1bab69a8ea46 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:46:30.367313 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4376/8704] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:46:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:46:38.598933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679ad6a-2413-4328-a77c-fa762b01e2fa None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:46:38.600113 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679ad6a-2413-4328-a77c-fa762b01e2fa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:46:38.600605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679ad6a-2413-4328-a77c-fa762b01e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:46:38.628868 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d679ad6a-2413-4328-a77c-fa762b01e2fa None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:46:38.630970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d679ad6a-2413-4328-a77c-fa762b01e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:46:38.641867 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4329/8705] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 01:46:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:46:38.657597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a9d39-0e26-4e43-b111-1bab69a8ea46 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:46:38.676489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679ad6a-2413-4328-a77c-fa762b01e2fa None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:46:38.678047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d679ad6a-2413-4328-a77c-fa762b01e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:46:38.682534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a9d39-0e26-4e43-b111-1bab69a8ea46 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:46:38.692987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637cce2a-e413-40d7-ab39-21d10d6ba22b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:46:38.693697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cce2a-e413-40d7-ab39-21d10d6ba22b service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:46:38.694043 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cce2a-e413-40d7-ab39-21d10d6ba22b service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:46:38.694384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cce2a-e413-40d7-ab39-21d10d6ba22b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:46:38.701810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679ad6a-2413-4328-a77c-fa762b01e2fa None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:46:38.709930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637cce2a-e413-40d7-ab39-21d10d6ba22b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:46:38.712066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637cce2a-e413-40d7-ab39-21d10d6ba22b service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:46:38.719023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f87e6-6a84-496f-aa46-73549c9bf80f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:46:38.719495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f87e6-6a84-496f-aa46-73549c9bf80f service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:46:38.719780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f87e6-6a84-496f-aa46-73549c9bf80f service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:46:38.720052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f87e6-6a84-496f-aa46-73549c9bf80f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:46:38.722088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c0f87e6-6a84-496f-aa46-73549c9bf80f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:46:38.725022 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4377/8706] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:46:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:46:38.754788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f87e6-6a84-496f-aa46-73549c9bf80f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:46:38.756614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f87e6-6a84-496f-aa46-73549c9bf80f service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:46:38.777449 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4330/8707] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:46:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:46:45.435059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76284555-e76d-4d63-b93f-5bcc962c7859 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:46:45.436044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76284555-e76d-4d63-b93f-5bcc962c7859 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:46:45.436326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76284555-e76d-4d63-b93f-5bcc962c7859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:46:45.458980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-76284555-e76d-4d63-b93f-5bcc962c7859 None None] MFA Rules not processed for user `4ac7b60e4e094354a9692bb46c3ebf8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:46:45.460279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-76284555-e76d-4d63-b93f-5bcc962c7859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:46:45.469284 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4378/8708] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:46:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:46:48.765825 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=9 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:55.453539 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=15 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:46:59.166269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3fa8-cb9e-4492-8686-36b231084dd1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:46:59.166889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3fa8-cb9e-4492-8686-36b231084dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:46:59.166889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3fa8-cb9e-4492-8686-36b231084dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:46:59.185642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-018b3fa8-cb9e-4492-8686-36b231084dd1 None None] MFA Rules not processed for user `30c3d05e92dd463e81ccc5a557e46fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:46:59.186886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-018b3fa8-cb9e-4492-8686-36b231084dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:46:59.193792 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4331/8709] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:46:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:46:59.680784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76284555-e76d-4d63-b93f-5bcc962c7859 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:46:59.695526 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76284555-e76d-4d63-b93f-5bcc962c7859 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:46:59.700245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ed975-f505-4893-99db-e18d16578e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:46:59.701133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ed975-f505-4893-99db-e18d16578e0e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:46:59.701284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ed975-f505-4893-99db-e18d16578e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:46:59.701797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ed975-f505-4893-99db-e18d16578e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:46:59.703888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7a9ed975-f505-4893-99db-e18d16578e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:46:59.717416 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ed975-f505-4893-99db-e18d16578e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:46:59.719305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ed975-f505-4893-99db-e18d16578e0e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:46:59.735516 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4379/8710] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:46:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:47:02.019450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b3fa8-cb9e-4492-8686-36b231084dd1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:47:02.035892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b3fa8-cb9e-4492-8686-36b231084dd1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:47:02.041290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264c3cc-9693-41b2-b33f-83bf2843cb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:47:02.042126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c3cc-9693-41b2-b33f-83bf2843cb54 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:47:02.042590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c3cc-9693-41b2-b33f-83bf2843cb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:47:02.043730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c3cc-9693-41b2-b33f-83bf2843cb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:47:02.046856 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b264c3cc-9693-41b2-b33f-83bf2843cb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:47:02.064198 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264c3cc-9693-41b2-b33f-83bf2843cb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:47:02.065569 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264c3cc-9693-41b2-b33f-83bf2843cb54 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:47:02.081115 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4332/8711] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:47:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:47:09.724000 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:47:12.074957 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=9 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:48:00.619622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ed975-f505-4893-99db-e18d16578e0e service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:48:00.631548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ed975-f505-4893-99db-e18d16578e0e service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:48:00.635217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2949161-3536-4e92-81ca-b191243c3396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:48:00.635886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949161-3536-4e92-81ca-b191243c3396 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:48:00.636167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949161-3536-4e92-81ca-b191243c3396 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:48:00.636442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949161-3536-4e92-81ca-b191243c3396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:48:00.638148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e2949161-3536-4e92-81ca-b191243c3396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:48:00.650131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2949161-3536-4e92-81ca-b191243c3396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:48:00.651570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2949161-3536-4e92-81ca-b191243c3396 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:48:00.662120 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4380/8712] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:48:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:48:10.655903 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:48:23.401098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264c3cc-9693-41b2-b33f-83bf2843cb54 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:48:23.439522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264c3cc-9693-41b2-b33f-83bf2843cb54 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:48:23.446523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6c56a-76eb-4bfd-93b7-d81899ca073c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:48:23.447170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6c56a-76eb-4bfd-93b7-d81899ca073c service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:48:23.447483 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6c56a-76eb-4bfd-93b7-d81899ca073c service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:48:23.447764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6c56a-76eb-4bfd-93b7-d81899ca073c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:48:23.449604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-22b6c56a-76eb-4bfd-93b7-d81899ca073c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:48:23.475808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6c56a-76eb-4bfd-93b7-d81899ca073c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:48:23.477424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6c56a-76eb-4bfd-93b7-d81899ca073c service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:48:23.491065 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4333/8713] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:48:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:48:33.485751 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=21 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:04.138148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2949161-3536-4e92-81ca-b191243c3396 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:04.161944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2949161-3536-4e92-81ca-b191243c3396 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:04.167417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072ff80-b070-4366-96ef-53a79324c66f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:04.168009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072ff80-b070-4366-96ef-53a79324c66f service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:04.168289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072ff80-b070-4366-96ef-53a79324c66f service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:04.168578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072ff80-b070-4366-96ef-53a79324c66f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:04.170249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0072ff80-b070-4366-96ef-53a79324c66f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:04.206508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072ff80-b070-4366-96ef-53a79324c66f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:04.208134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072ff80-b070-4366-96ef-53a79324c66f service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:04.220588 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4381/8714] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:49:14.213878 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=20 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:17.065150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6c56a-76eb-4bfd-93b7-d81899ca073c service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:17.086436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6c56a-76eb-4bfd-93b7-d81899ca073c service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:17.091848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7995-1081-4f36-9564-24921e4a7a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:17.092442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7995-1081-4f36-9564-24921e4a7a06 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:17.092720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7995-1081-4f36-9564-24921e4a7a06 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:17.092989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7995-1081-4f36-9564-24921e4a7a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:17.094738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-69ab7995-1081-4f36-9564-24921e4a7a06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:17.105890 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7995-1081-4f36-9564-24921e4a7a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:17.107561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7995-1081-4f36-9564-24921e4a7a06 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:17.116572 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4334/8715] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:49:25.465624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1900ace-f5a6-4b33-8559-38b585793d9f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:25.466151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1900ace-f5a6-4b33-8559-38b585793d9f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:25.466151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1900ace-f5a6-4b33-8559-38b585793d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:25.485538 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f1900ace-f5a6-4b33-8559-38b585793d9f None None] MFA Rules not processed for user `30c3d05e92dd463e81ccc5a557e46fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:25.486759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f1900ace-f5a6-4b33-8559-38b585793d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:25.493592 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4382/8716] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:49:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:25.805495 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095c7d-625e-49ca-9312-b199c07a5020 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:25.806077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095c7d-625e-49ca-9312-b199c07a5020 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:25.806077 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095c7d-625e-49ca-9312-b199c07a5020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:25.866543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-20095c7d-625e-49ca-9312-b199c07a5020 None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:25.868289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20095c7d-625e-49ca-9312-b199c07a5020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:25.875120 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4335/8717] 10.222.0.23 () {58 vars in 1061 bytes} [Sun Oct 2 01:49:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:25.881013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1900ace-f5a6-4b33-8559-38b585793d9f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:25.890917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1900ace-f5a6-4b33-8559-38b585793d9f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:25.894418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adf078-b89d-425b-85c3-345cc9fa81eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:25.895050 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adf078-b89d-425b-85c3-345cc9fa81eb service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:25.895331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adf078-b89d-425b-85c3-345cc9fa81eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:25.895605 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adf078-b89d-425b-85c3-345cc9fa81eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:25.897297 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e4adf078-b89d-425b-85c3-345cc9fa81eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:25.909098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adf078-b89d-425b-85c3-345cc9fa81eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:25.910516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adf078-b89d-425b-85c3-345cc9fa81eb service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:25.920816 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4383/8718] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:49:27.372181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1422b-d91a-42d0-8671-8f38ac681b65 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:27.372676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1422b-d91a-42d0-8671-8f38ac681b65 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:27.372799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1422b-d91a-42d0-8671-8f38ac681b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:27.411911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-94d1422b-d91a-42d0-8671-8f38ac681b65 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:27.413128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-94d1422b-d91a-42d0-8671-8f38ac681b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:27.425341 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4336/8719] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:49:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:27.437077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adf078-b89d-425b-85c3-345cc9fa81eb service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:27.451644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adf078-b89d-425b-85c3-345cc9fa81eb service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:27.456571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fa82d-2d89-4756-aaf8-5b540e3e5a37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:27.457190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fa82d-2d89-4756-aaf8-5b540e3e5a37 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:27.457475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fa82d-2d89-4756-aaf8-5b540e3e5a37 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:27.457750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fa82d-2d89-4756-aaf8-5b540e3e5a37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:27.466774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fa82d-2d89-4756-aaf8-5b540e3e5a37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:27.468348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fa82d-2d89-4756-aaf8-5b540e3e5a37 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:27.478517 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4384/8720] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:49:33.184632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1199-2137-4b2b-8f3b-751b63540f10 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:33.185172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1199-2137-4b2b-8f3b-751b63540f10 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:33.185172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1199-2137-4b2b-8f3b-751b63540f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:33.211493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9f3e1199-2137-4b2b-8f3b-751b63540f10 None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:33.213249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f3e1199-2137-4b2b-8f3b-751b63540f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:33.224388 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4337/8721] 10.222.0.23 () {58 vars in 1061 bytes} [Sun Oct 2 01:49:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:33.240197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fa82d-2d89-4756-aaf8-5b540e3e5a37 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:33.254996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fa82d-2d89-4756-aaf8-5b540e3e5a37 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:33.260528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33497d9-ca3d-4b64-9a38-f854d9d3a3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:33.261378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33497d9-ca3d-4b64-9a38-f854d9d3a3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:33.261862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33497d9-ca3d-4b64-9a38-f854d9d3a3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:33.262358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33497d9-ca3d-4b64-9a38-f854d9d3a3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:33.274203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33497d9-ca3d-4b64-9a38-f854d9d3a3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:33.275969 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33497d9-ca3d-4b64-9a38-f854d9d3a3b7 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:33.306575 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4385/8722] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:49:34.213039 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e1199-2137-4b2b-8f3b-751b63540f10 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:34.222940 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e1199-2137-4b2b-8f3b-751b63540f10 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:34.227637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff9ad9-264b-4cae-a9cf-4fd274052064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:34.228479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff9ad9-264b-4cae-a9cf-4fd274052064 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:34.228957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff9ad9-264b-4cae-a9cf-4fd274052064 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:34.229407 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff9ad9-264b-4cae-a9cf-4fd274052064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:34.327110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff9ad9-264b-4cae-a9cf-4fd274052064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:34.329299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff9ad9-264b-4cae-a9cf-4fd274052064 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:34.345925 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4338/8723] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:49:41.912937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33497d9-ca3d-4b64-9a38-f854d9d3a3b7 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:41.914824 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c33497d9-ca3d-4b64-9a38-f854d9d3a3b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:41.944125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33497d9-ca3d-4b64-9a38-f854d9d3a3b7 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:41.948882 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:41.949522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:41.949803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:41.950225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] PATH_INFO: `/v3/users/4ac7b60e4e094354a9692bb46c3ebf8d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:41.951566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac7b60e4e094354a9692bb46c3ebf8d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:41.953942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:42.014668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac7b60e4e094354a9692bb46c3ebf8d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.029146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac7b60e4e094354a9692bb46c3ebf8d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.029895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac7b60e4e094354a9692bb46c3ebf8d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.038015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac7b60e4e094354a9692bb46c3ebf8d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.039373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac7b60e4e094354a9692bb46c3ebf8d'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.052591 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4386/8724] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:49:41 2022] DELETE /identity/v3/users/4ac7b60e4e094354a9692bb46c3ebf8d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:49:42.058062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ae9c8-4365-4cbb-bc91-1bcf0162baea None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:42.058546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ae9c8-4365-4cbb-bc91-1bcf0162baea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:42.058677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ae9c8-4365-4cbb-bc91-1bcf0162baea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:42.092697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-477ae9c8-4365-4cbb-bc91-1bcf0162baea None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:42.094562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-477ae9c8-4365-4cbb-bc91-1bcf0162baea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:42.151413 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:42.165225 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4339/8725] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:42.175725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:42.177369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:42.264862 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401af8df-2771-46b6-aafb-d533a8103036 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:42.268604 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428663f4-3714-4f1f-8ebf-ff317e71b3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:42.269298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428663f4-3714-4f1f-8ebf-ff317e71b3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:42.269646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428663f4-3714-4f1f-8ebf-ff317e71b3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:42.269990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428663f4-3714-4f1f-8ebf-ff317e71b3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:42.280701 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428663f4-3714-4f1f-8ebf-ff317e71b3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:42.282252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428663f4-3714-4f1f-8ebf-ff317e71b3b9 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:42.293981 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4387/8726] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:49:42.586639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ae9c8-4365-4cbb-bc91-1bcf0162baea None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:42.589441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-477ae9c8-4365-4cbb-bc91-1bcf0162baea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:42.611186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ae9c8-4365-4cbb-bc91-1bcf0162baea None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:42.616326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:42.618736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:42.619102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:42.619381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] PATH_INFO: `/v3/projects/7955fc0f32784de19c7e0bd32b5afe1b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:42.620579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7955fc0f32784de19c7e0bd32b5afe1b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:42.623313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:42.684720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7955fc0f32784de19c7e0bd32b5afe1b', 'request_id': 'req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.692174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7955fc0f32784de19c7e0bd32b5afe1b', 'request_id': 'req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.700595 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7955fc0f32784de19c7e0bd32b5afe1b', 'request_id': 'req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.720630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] The token cache is being invalidate because project 7955fc0f32784de19c7e0bd32b5afe1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:49:42.720935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.721612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.723213 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4340/8727] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:49:42 2022] DELETE /identity/v3/projects/7955fc0f32784de19c7e0bd32b5afe1b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:49:42.727407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428663f4-3714-4f1f-8ebf-ff317e71b3b9 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:42.744363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428663f4-3714-4f1f-8ebf-ff317e71b3b9 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:42.779215 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:42.840210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:42.841038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:42.841285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:42.841613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] PATH_INFO: `/v3/users/78162c558ced44a9991f777185a2dfcb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:42.842841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] RBAC: Authorizing `identity:delete_user(user_id=78162c558ced44a9991f777185a2dfcb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:42.844936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:42.901794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:42.903044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:42.921568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78162c558ced44a9991f777185a2dfcb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.937076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78162c558ced44a9991f777185a2dfcb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.937912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78162c558ced44a9991f777185a2dfcb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.949708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78162c558ced44a9991f777185a2dfcb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.950753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78162c558ced44a9991f777185a2dfcb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:42.978699 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4388/8728] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:49:42 2022] DELETE /identity/v3/users/78162c558ced44a9991f777185a2dfcb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:49:42.981630 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:42.986202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:43.027110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ecf85-a2d6-4cbb-b9e6-1814b9ad059a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:43.102164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16011a-24ad-45af-b836-15aa7620bede admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:43.107975 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:43.108622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:43.108890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:43.109161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] PATH_INFO: `/v3/users/73a7c1c4929d49aea6e4e492e32ccafd` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:43.110512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a7c1c4929d49aea6e4e492e32ccafd)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:43.111043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161377-dae4-4f96-b48f-4d3eba2a9fd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:43.112492 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:43.113125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161377-dae4-4f96-b48f-4d3eba2a9fd7 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:43.113562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161377-dae4-4f96-b48f-4d3eba2a9fd7 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:43.113857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161377-dae4-4f96-b48f-4d3eba2a9fd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:43.119032 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee161377-dae4-4f96-b48f-4d3eba2a9fd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:43.141863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee161377-dae4-4f96-b48f-4d3eba2a9fd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:43.145333 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee161377-dae4-4f96-b48f-4d3eba2a9fd7 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:43.166754 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4341/8729] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:49:43.182872 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:43.189777 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a7c1c4929d49aea6e4e492e32ccafd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.218469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a7c1c4929d49aea6e4e492e32ccafd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.219391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a7c1c4929d49aea6e4e492e32ccafd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.227884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a7c1c4929d49aea6e4e492e32ccafd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.228700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a7c1c4929d49aea6e4e492e32ccafd'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.234822 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161377-dae4-4f96-b48f-4d3eba2a9fd7 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:43.237994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ee161377-dae4-4f96-b48f-4d3eba2a9fd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:43.251803 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4389/8730] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:49:42 2022] DELETE /identity/v3/users/73a7c1c4929d49aea6e4e492e32ccafd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:49:43.256554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161377-dae4-4f96-b48f-4d3eba2a9fd7 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:43.262129 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:43.336976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:43.337620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:43.337988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:43.338164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] PATH_INFO: `/v3/projects/c3001c93c94c45fe9cd98aabdae3af9d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:43.339339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3001c93c94c45fe9cd98aabdae3af9d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:43.341256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:43.390895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3001c93c94c45fe9cd98aabdae3af9d', 'request_id': 'req-2438d2b4-0f6c-4115-b827-03afc6f2e7be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.396433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3001c93c94c45fe9cd98aabdae3af9d', 'request_id': 'req-2438d2b4-0f6c-4115-b827-03afc6f2e7be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.402721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3001c93c94c45fe9cd98aabdae3af9d', 'request_id': 'req-2438d2b4-0f6c-4115-b827-03afc6f2e7be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.417505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] The token cache is being invalidate because project c3001c93c94c45fe9cd98aabdae3af9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:49:43.417740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.418437 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.420096 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4342/8731] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:49:43 2022] DELETE /identity/v3/projects/c3001c93c94c45fe9cd98aabdae3af9d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:49:43.443769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:43.446299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:43.468676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c9e8e-9b30-43a0-acfc-40a2ee6b744a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:43.537580 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:43.538242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:43.538883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:43.539696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] PATH_INFO: `/v3/projects/5d7ab191bb4e4b21a8a4011d8cd93f86` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:43.540925 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7ab191bb4e4b21a8a4011d8cd93f86)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:43.542920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:43.597549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'request_id': 'req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.605258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'request_id': 'req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.612335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7ab191bb4e4b21a8a4011d8cd93f86', 'request_id': 'req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.628212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] The token cache is being invalidate because project 5d7ab191bb4e4b21a8a4011d8cd93f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:49:43.628517 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.629192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.631186 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4390/8732] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:49:43 2022] DELETE /identity/v3/projects/5d7ab191bb4e4b21a8a4011d8cd93f86 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:49:43.636366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:43.637869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:43.652060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438d2b4-0f6c-4115-b827-03afc6f2e7be admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:43.721171 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3e4a3-2c71-4df6-8507-f4aedb9f18a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:43.722116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3e4a3-2c71-4df6-8507-f4aedb9f18a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:43.722402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3e4a3-2c71-4df6-8507-f4aedb9f18a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:43.722723 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3e4a3-2c71-4df6-8507-f4aedb9f18a2 admin admin] PATH_INFO: `/v3/users/86df8173d53c4869bcd10786b42af569` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:43.724216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3e4a3-2c71-4df6-8507-f4aedb9f18a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86df8173d53c4869bcd10786b42af569)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:43.727136 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3e4a3-2c71-4df6-8507-f4aedb9f18a2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:43.786114 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:43.794369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4fc3e4a3-2c71-4df6-8507-f4aedb9f18a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86df8173d53c4869bcd10786b42af569'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.816153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4fc3e4a3-2c71-4df6-8507-f4aedb9f18a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86df8173d53c4869bcd10786b42af569'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.817605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4fc3e4a3-2c71-4df6-8507-f4aedb9f18a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86df8173d53c4869bcd10786b42af569'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.828027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4fc3e4a3-2c71-4df6-8507-f4aedb9f18a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86df8173d53c4869bcd10786b42af569'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.836848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4fc3e4a3-2c71-4df6-8507-f4aedb9f18a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86df8173d53c4869bcd10786b42af569'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:43.847388 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4343/8733] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:49:43 2022] DELETE /identity/v3/users/86df8173d53c4869bcd10786b42af569 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:49:44.033471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:44.035023 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:44.050210 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a55f8e-2667-44f1-b5d2-6058ff4c75a5 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:44.100534 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:44.116426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:44.117102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:44.117384 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:44.117657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] PATH_INFO: `/v3/projects/ed305feed8504175ae657e353ee7c2b4` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:44.118870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed305feed8504175ae657e353ee7c2b4)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:44.120790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:44.169257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed305feed8504175ae657e353ee7c2b4', 'request_id': 'req-bba2cac3-03f6-4dad-8e04-6dc86393fd29'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:44.175152 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed305feed8504175ae657e353ee7c2b4', 'request_id': 'req-bba2cac3-03f6-4dad-8e04-6dc86393fd29'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:44.182553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed305feed8504175ae657e353ee7c2b4', 'request_id': 'req-bba2cac3-03f6-4dad-8e04-6dc86393fd29'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:44.196695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] The token cache is being invalidate because project ed305feed8504175ae657e353ee7c2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:49:44.197120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:44.197977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-bba2cac3-03f6-4dad-8e04-6dc86393fd29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:49:44.199677 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4391/8734] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:49:44 2022] DELETE /identity/v3/projects/ed305feed8504175ae657e353ee7c2b4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:49:44.204997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd04b-79d3-4cc7-9e83-cb7de08c3fde None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:44.205492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd04b-79d3-4cc7-9e83-cb7de08c3fde None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:44.205670 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd04b-79d3-4cc7-9e83-cb7de08c3fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:44.246760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-492fd04b-79d3-4cc7-9e83-cb7de08c3fde None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:44.247947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-492fd04b-79d3-4cc7-9e83-cb7de08c3fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:44.310456 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4344/8735] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:44.319505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083d00f-5201-4a9f-bb53-77c427c25c89 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:44.319897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083d00f-5201-4a9f-bb53-77c427c25c89 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:44.320266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083d00f-5201-4a9f-bb53-77c427c25c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:44.340108 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7083d00f-5201-4a9f-bb53-77c427c25c89 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:44.341302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7083d00f-5201-4a9f-bb53-77c427c25c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:44.349466 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4392/8736] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:44.354504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd04b-79d3-4cc7-9e83-cb7de08c3fde None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:44.364261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd04b-79d3-4cc7-9e83-cb7de08c3fde None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:44.369189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6bf8b-bd0c-45a4-abc9-bdbbb6ba0322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:44.369799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6bf8b-bd0c-45a4-abc9-bdbbb6ba0322 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:44.370083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6bf8b-bd0c-45a4-abc9-bdbbb6ba0322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:44.370356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6bf8b-bd0c-45a4-abc9-bdbbb6ba0322 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:44.371060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6bf8b-bd0c-45a4-abc9-bdbbb6ba0322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:49:44.371366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6bf8b-bd0c-45a4-abc9-bdbbb6ba0322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:44.372977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6bf8b-bd0c-45a4-abc9-bdbbb6ba0322 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:44.385786 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4345/8737] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:49:44.390497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083d00f-5201-4a9f-bb53-77c427c25c89 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:44.400989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083d00f-5201-4a9f-bb53-77c427c25c89 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:44.405613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449a9d-f1da-4f31-8e35-31c729d94c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:44.406206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449a9d-f1da-4f31-8e35-31c729d94c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:44.406480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449a9d-f1da-4f31-8e35-31c729d94c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:44.406817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449a9d-f1da-4f31-8e35-31c729d94c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:44.407451 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a449a9d-f1da-4f31-8e35-31c729d94c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:44.409409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a449a9d-f1da-4f31-8e35-31c729d94c04 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:44.442863 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4393/8738] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:49:44 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:49:44.444187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6bf8b-bd0c-45a4-abc9-bdbbb6ba0322 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:44.455601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6bf8b-bd0c-45a4-abc9-bdbbb6ba0322 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:44.523962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2788c-49fe-425a-99f6-80c3046385b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:44.524931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2788c-49fe-425a-99f6-80c3046385b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:44.525232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2788c-49fe-425a-99f6-80c3046385b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:44.525510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2788c-49fe-425a-99f6-80c3046385b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:44.526141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2788c-49fe-425a-99f6-80c3046385b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:44.528115 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2788c-49fe-425a-99f6-80c3046385b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:44.550090 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4346/8739] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:49:44 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:49:44.555522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449a9d-f1da-4f31-8e35-31c729d94c04 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:44.566957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449a9d-f1da-4f31-8e35-31c729d94c04 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:44.572375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2af806-7f6d-4efc-b74f-0a24f5420d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:44.572980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af806-7f6d-4efc-b74f-0a24f5420d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:44.573261 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af806-7f6d-4efc-b74f-0a24f5420d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:44.573535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af806-7f6d-4efc-b74f-0a24f5420d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:44.574206 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2af806-7f6d-4efc-b74f-0a24f5420d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:44.575837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2af806-7f6d-4efc-b74f-0a24f5420d2a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:44.586167 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4394/8740] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:49:44.590170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2788c-49fe-425a-99f6-80c3046385b0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:44.600058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2788c-49fe-425a-99f6-80c3046385b0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:44.605463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10710587-a1c3-476a-b8fd-0ed3c90f704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:44.606060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10710587-a1c3-476a-b8fd-0ed3c90f704e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:44.606344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10710587-a1c3-476a-b8fd-0ed3c90f704e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:44.606637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10710587-a1c3-476a-b8fd-0ed3c90f704e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:44.607282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10710587-a1c3-476a-b8fd-0ed3c90f704e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:44.608886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10710587-a1c3-476a-b8fd-0ed3c90f704e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:44.622027 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4347/8741] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:49:44.626380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2af806-7f6d-4efc-b74f-0a24f5420d2a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:44.636666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2af806-7f6d-4efc-b74f-0a24f5420d2a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:44.641279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f181e7-8d54-4b7e-a79b-420e0205eef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:44.641922 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f181e7-8d54-4b7e-a79b-420e0205eef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:44.642205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f181e7-8d54-4b7e-a79b-420e0205eef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:44.642482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f181e7-8d54-4b7e-a79b-420e0205eef3 admin admin] PATH_INFO: `/v3/projects/38f7429c314949d09cd40e969e009630/users/3905f430922a4d41b17616895fe1564e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:44.657548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f181e7-8d54-4b7e-a79b-420e0205eef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f7429c314949d09cd40e969e009630, user_id=3905f430922a4d41b17616895fe1564e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:44.660253 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f181e7-8d54-4b7e-a79b-420e0205eef3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:44.673824 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4395/8742] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:49:44 2022] PUT /identity/v3/projects/38f7429c314949d09cd40e969e009630/users/3905f430922a4d41b17616895fe1564e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:49:44.679060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9c08b-c918-4c15-b00e-c3cf2e97ab58 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:44.679351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9c08b-c918-4c15-b00e-c3cf2e97ab58 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:44.679694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9c08b-c918-4c15-b00e-c3cf2e97ab58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:44.699153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2ca9c08b-c918-4c15-b00e-c3cf2e97ab58 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:44.700341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ca9c08b-c918-4c15-b00e-c3cf2e97ab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:44.704219 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:44.760733 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4348/8743] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:44.770613 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f181e7-8d54-4b7e-a79b-420e0205eef3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:44.772357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a9f181e7-8d54-4b7e-a79b-420e0205eef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:44.832240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f181e7-8d54-4b7e-a79b-420e0205eef3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:44.836792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdaa9c-cb27-4f9f-ad82-0e28af0e0df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:44.837598 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdaa9c-cb27-4f9f-ad82-0e28af0e0df8 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:44.837874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdaa9c-cb27-4f9f-ad82-0e28af0e0df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:44.838143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdaa9c-cb27-4f9f-ad82-0e28af0e0df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:44.848058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdaa9c-cb27-4f9f-ad82-0e28af0e0df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:44.849912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdaa9c-cb27-4f9f-ad82-0e28af0e0df8 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:44.861202 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4396/8744] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:49:49.428651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48401e7d-12ce-4283-8ed4-3508889d192a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:49.429756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48401e7d-12ce-4283-8ed4-3508889d192a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:49.429756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48401e7d-12ce-4283-8ed4-3508889d192a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:49.477282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-48401e7d-12ce-4283-8ed4-3508889d192a None None] MFA Rules not processed for user `3905f430922a4d41b17616895fe1564e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:49.477282 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-48401e7d-12ce-4283-8ed4-3508889d192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:49.568482 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4349/8745] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:49:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:49.574290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdaa9c-cb27-4f9f-ad82-0e28af0e0df8 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:49.586114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdaa9c-cb27-4f9f-ad82-0e28af0e0df8 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:49.591485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9625db8-db62-4b36-9b3e-2e1c75d5688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:49.592090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9625db8-db62-4b36-9b3e-2e1c75d5688c admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:49.592372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9625db8-db62-4b36-9b3e-2e1c75d5688c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:49.592684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9625db8-db62-4b36-9b3e-2e1c75d5688c admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:49.593285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9625db8-db62-4b36-9b3e-2e1c75d5688c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:49.595405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9625db8-db62-4b36-9b3e-2e1c75d5688c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:49.615919 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:49.633127 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4397/8746] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:49:49 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:49:49.637972 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48401e7d-12ce-4283-8ed4-3508889d192a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:49.653944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48401e7d-12ce-4283-8ed4-3508889d192a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:49.725079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9625db8-db62-4b36-9b3e-2e1c75d5688c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:49.727456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e9625db8-db62-4b36-9b3e-2e1c75d5688c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:49.750168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49404df5-d638-4ae6-be72-a96aebc3242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:49.750870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49404df5-d638-4ae6-be72-a96aebc3242f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:49.751157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49404df5-d638-4ae6-be72-a96aebc3242f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:49.751429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49404df5-d638-4ae6-be72-a96aebc3242f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:49.752066 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49404df5-d638-4ae6-be72-a96aebc3242f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:49.754018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49404df5-d638-4ae6-be72-a96aebc3242f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:49.779563 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4350/8747] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:49:49 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:49:49.785137 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49404df5-d638-4ae6-be72-a96aebc3242f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:49.797802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49404df5-d638-4ae6-be72-a96aebc3242f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:49.797917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9625db8-db62-4b36-9b3e-2e1c75d5688c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:49.802179 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a5ecd-4d98-4724-a9fc-543c7831e0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:49.802633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ce11-9783-4116-a5cc-52d0b0767e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:49.802837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5ecd-4d98-4724-a9fc-543c7831e0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:49.803124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5ecd-4d98-4724-a9fc-543c7831e0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:49.803263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ce11-9783-4116-a5cc-52d0b0767e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:49.803393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5ecd-4d98-4724-a9fc-543c7831e0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:49.803521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ce11-9783-4116-a5cc-52d0b0767e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:49.803927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ce11-9783-4116-a5cc-52d0b0767e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:49.804785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487ce11-9783-4116-a5cc-52d0b0767e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:49.805431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9d6a5ecd-4d98-4724-a9fc-543c7831e0c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:49.806403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487ce11-9783-4116-a5cc-52d0b0767e3e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:49.817578 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4351/8748] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:49:49.822570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ce11-9783-4116-a5cc-52d0b0767e3e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:49.839588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ce11-9783-4116-a5cc-52d0b0767e3e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:49.844807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5c8b-bad3-4492-a339-e0dfa455297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:49.845647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5c8b-bad3-4492-a339-e0dfa455297c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:49.845918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5c8b-bad3-4492-a339-e0dfa455297c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:49.846192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5c8b-bad3-4492-a339-e0dfa455297c admin admin] PATH_INFO: `/v3/projects/a7f508e656b2402e97a5fda511f38f17/users/66f3d8f41a7941e09f7b7fcba809ff28/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:49.864016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5c8b-bad3-4492-a339-e0dfa455297c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f508e656b2402e97a5fda511f38f17, user_id=66f3d8f41a7941e09f7b7fcba809ff28, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:49.867231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5c8b-bad3-4492-a339-e0dfa455297c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:49.869797 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:49.885590 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4352/8749] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:49:49 2022] PUT /identity/v3/projects/a7f508e656b2402e97a5fda511f38f17/users/66f3d8f41a7941e09f7b7fcba809ff28/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:49:49.889647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5c8b-bad3-4492-a339-e0dfa455297c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:49.899086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a5ecd-4d98-4724-a9fc-543c7831e0c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:49.900588 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a5ecd-4d98-4724-a9fc-543c7831e0c2 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:49.912138 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4398/8750] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:49:49.973425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5c8b-bad3-4492-a339-e0dfa455297c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:49.979035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d15d9-5aee-4655-b341-18f80fedd6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:49.979692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d15d9-5aee-4655-b341-18f80fedd6df admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:49.979976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d15d9-5aee-4655-b341-18f80fedd6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:49.980255 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d15d9-5aee-4655-b341-18f80fedd6df admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:49.980899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d15d9-5aee-4655-b341-18f80fedd6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:49.982546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d15d9-5aee-4655-b341-18f80fedd6df admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:49.995036 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4353/8751] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:49:50.000460 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a5ecd-4d98-4724-a9fc-543c7831e0c2 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:50.012141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a5ecd-4d98-4724-a9fc-543c7831e0c2 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:50.018443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2363e5c-3447-451f-9843-3454489604c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:50.019232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2363e5c-3447-451f-9843-3454489604c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:50.019516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2363e5c-3447-451f-9843-3454489604c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:50.019792 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2363e5c-3447-451f-9843-3454489604c7 admin admin] PATH_INFO: `/v3/projects/a7f508e656b2402e97a5fda511f38f17/users/66f3d8f41a7941e09f7b7fcba809ff28/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:50.021818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2363e5c-3447-451f-9843-3454489604c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f508e656b2402e97a5fda511f38f17, user_id=66f3d8f41a7941e09f7b7fcba809ff28, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:50.025534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2363e5c-3447-451f-9843-3454489604c7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:50.037862 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4399/8752] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:49:49 2022] PUT /identity/v3/projects/a7f508e656b2402e97a5fda511f38f17/users/66f3d8f41a7941e09f7b7fcba809ff28/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:49:55.385665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fd9af-5e89-4865-bfe4-300e10b1dc7b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:55.386146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fd9af-5e89-4865-bfe4-300e10b1dc7b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:55.386231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fd9af-5e89-4865-bfe4-300e10b1dc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:55.416232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-457fd9af-5e89-4865-bfe4-300e10b1dc7b None None] MFA Rules not processed for user `66f3d8f41a7941e09f7b7fcba809ff28`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:55.417468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-457fd9af-5e89-4865-bfe4-300e10b1dc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:55.487196 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4354/8753] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:49:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:55.498723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2363e5c-3447-451f-9843-3454489604c7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:55.500752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c2363e5c-3447-451f-9843-3454489604c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:55.610682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2363e5c-3447-451f-9843-3454489604c7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:55.618299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bb000-7c25-4df1-a975-e79564c74aa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:55.619316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bb000-7c25-4df1-a975-e79564c74aa1 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:55.619666 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bb000-7c25-4df1-a975-e79564c74aa1 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:55.620007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bb000-7c25-4df1-a975-e79564c74aa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:55.629559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bb000-7c25-4df1-a975-e79564c74aa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:55.631337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bb000-7c25-4df1-a975-e79564c74aa1 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:55.636293 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:49:55.644885 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4400/8754] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:49:55.697055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3016a4-cb73-4ffa-b31e-9fe4370ff7b7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:55.697348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3016a4-cb73-4ffa-b31e-9fe4370ff7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:55.697629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3016a4-cb73-4ffa-b31e-9fe4370ff7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:55.716466 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cb3016a4-cb73-4ffa-b31e-9fe4370ff7b7 None None] MFA Rules not processed for user `3905f430922a4d41b17616895fe1564e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:55.717665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cb3016a4-cb73-4ffa-b31e-9fe4370ff7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:55.770644 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4355/8755] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:49:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:56.435495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83abcd-1b79-4b40-8808-ed614a3a8094 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:56.436071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83abcd-1b79-4b40-8808-ed614a3a8094 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:56.436415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83abcd-1b79-4b40-8808-ed614a3a8094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:56.471842 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-be83abcd-1b79-4b40-8808-ed614a3a8094 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:49:56.473185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-be83abcd-1b79-4b40-8808-ed614a3a8094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:56.542376 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4401/8756] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:49:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:49:56.554968 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3016a4-cb73-4ffa-b31e-9fe4370ff7b7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:56.556455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cb3016a4-cb73-4ffa-b31e-9fe4370ff7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:56.574999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3016a4-cb73-4ffa-b31e-9fe4370ff7b7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:56.580244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553de92-771b-4d05-9c57-d1a012aee986 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:56.580967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553de92-771b-4d05-9c57-d1a012aee986 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:56.581321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553de92-771b-4d05-9c57-d1a012aee986 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:56.581665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553de92-771b-4d05-9c57-d1a012aee986 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:56.591493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553de92-771b-4d05-9c57-d1a012aee986 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:56.593209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553de92-771b-4d05-9c57-d1a012aee986 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:56.603918 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4356/8757] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:49:59.127755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83abcd-1b79-4b40-8808-ed614a3a8094 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:49:59.137166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-be83abcd-1b79-4b40-8808-ed614a3a8094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:59.170355 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83abcd-1b79-4b40-8808-ed614a3a8094 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:49:59.181558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b489930-8e32-432c-b30e-1c327e176902 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:49:59.182793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b489930-8e32-432c-b30e-1c327e176902 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:49:59.183121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b489930-8e32-432c-b30e-1c327e176902 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:49:59.183421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b489930-8e32-432c-b30e-1c327e176902 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:49:59.185419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1b489930-8e32-432c-b30e-1c327e176902 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:49:59.201505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b489930-8e32-432c-b30e-1c327e176902 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:49:59.203508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b489930-8e32-432c-b30e-1c327e176902 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:49:59.218517 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4402/8758] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:49:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:50:06.599538 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=1,keystone:SELECT=96 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:08.986135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071081-d207-4364-b3e1-2dd000df4f29 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:08.986739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071081-d207-4364-b3e1-2dd000df4f29 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:08.986739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071081-d207-4364-b3e1-2dd000df4f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:09.010127 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-95071081-d207-4364-b3e1-2dd000df4f29 None None] MFA Rules not processed for user `3905f430922a4d41b17616895fe1564e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:50:09.011421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-95071081-d207-4364-b3e1-2dd000df4f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:50:09.018276 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4357/8759] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:50:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:50:09.210063 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=40 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:19.004192 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:31.999553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b489930-8e32-432c-b30e-1c327e176902 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:32.091287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b489930-8e32-432c-b30e-1c327e176902 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:32.096396 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:32.097157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:32.097501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:32.097843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] PATH_INFO: `/v3/users/3905f430922a4d41b17616895fe1564e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:32.099338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3905f430922a4d41b17616895fe1564e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:32.101380 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:32.159712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3905f430922a4d41b17616895fe1564e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.173342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3905f430922a4d41b17616895fe1564e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.174100 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3905f430922a4d41b17616895fe1564e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.183440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3905f430922a4d41b17616895fe1564e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.184071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3905f430922a4d41b17616895fe1564e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.198091 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4403/8760] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:50:31 2022] DELETE /identity/v3/users/3905f430922a4d41b17616895fe1564e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:50:32.398866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95071081-d207-4364-b3e1-2dd000df4f29 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:32.410480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95071081-d207-4364-b3e1-2dd000df4f29 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:32.468755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:32.469435 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:32.469675 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:32.469952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] PATH_INFO: `/v3/projects/38f7429c314949d09cd40e969e009630` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:32.471204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f7429c314949d09cd40e969e009630)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:32.473168 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:32.522580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f7429c314949d09cd40e969e009630', 'request_id': 'req-78d28692-8774-46e3-bc37-77b1d4bc6dfd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.528504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f7429c314949d09cd40e969e009630', 'request_id': 'req-78d28692-8774-46e3-bc37-77b1d4bc6dfd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.534737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f7429c314949d09cd40e969e009630', 'request_id': 'req-78d28692-8774-46e3-bc37-77b1d4bc6dfd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.547804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] The token cache is being invalidate because project 38f7429c314949d09cd40e969e009630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:50:32.548095 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.548762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.550250 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4358/8761] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:50:32 2022] DELETE /identity/v3/projects/38f7429c314949d09cd40e969e009630 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:50:32.554241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:32.555668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:50:32.569281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005dda3-27a8-4372-9440-a6a9f601ad53 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:32.627529 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085b07b-68a7-4ae1-bfa8-57538e3f50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:32.628162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085b07b-68a7-4ae1-bfa8-57538e3f50f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:32.628443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085b07b-68a7-4ae1-bfa8-57538e3f50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:32.628717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085b07b-68a7-4ae1-bfa8-57538e3f50f2 admin admin] PATH_INFO: `/v3/users/66f3d8f41a7941e09f7b7fcba809ff28` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:32.629849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085b07b-68a7-4ae1-bfa8-57538e3f50f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f3d8f41a7941e09f7b7fcba809ff28)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:32.631865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085b07b-68a7-4ae1-bfa8-57538e3f50f2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:32.653349 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:32.679114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b085b07b-68a7-4ae1-bfa8-57538e3f50f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f3d8f41a7941e09f7b7fcba809ff28'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.692128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b085b07b-68a7-4ae1-bfa8-57538e3f50f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f3d8f41a7941e09f7b7fcba809ff28'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.692811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b085b07b-68a7-4ae1-bfa8-57538e3f50f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f3d8f41a7941e09f7b7fcba809ff28'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.700122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b085b07b-68a7-4ae1-bfa8-57538e3f50f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f3d8f41a7941e09f7b7fcba809ff28'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.700735 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-b085b07b-68a7-4ae1-bfa8-57538e3f50f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f3d8f41a7941e09f7b7fcba809ff28'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:32.713358 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4404/8762] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:50:32 2022] DELETE /identity/v3/users/66f3d8f41a7941e09f7b7fcba809ff28 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:50:32.889581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:32.891186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:50:32.904776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d28692-8774-46e3-bc37-77b1d4bc6dfd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:32.963019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:32.963678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:32.963961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:32.964235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] PATH_INFO: `/v3/projects/a7f508e656b2402e97a5fda511f38f17` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:32.965367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f508e656b2402e97a5fda511f38f17)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:32.967352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:33.002442 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:33.016470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f508e656b2402e97a5fda511f38f17', 'request_id': 'req-a6be3474-2263-459f-83bc-9a60367f890a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:33.022899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f508e656b2402e97a5fda511f38f17', 'request_id': 'req-a6be3474-2263-459f-83bc-9a60367f890a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:33.030582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f508e656b2402e97a5fda511f38f17', 'request_id': 'req-a6be3474-2263-459f-83bc-9a60367f890a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:33.043587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] The token cache is being invalidate because project a7f508e656b2402e97a5fda511f38f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:50:33.043878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:33.044505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6be3474-2263-459f-83bc-9a60367f890a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:50:33.046015 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4359/8763] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:50:32 2022] DELETE /identity/v3/projects/a7f508e656b2402e97a5fda511f38f17 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:50:33.051032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af44544-1ca0-45f2-9480-cb1d8b1f0f37 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:33.051484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af44544-1ca0-45f2-9480-cb1d8b1f0f37 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:33.051589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af44544-1ca0-45f2-9480-cb1d8b1f0f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:33.073647 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0af44544-1ca0-45f2-9480-cb1d8b1f0f37 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:50:33.075107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0af44544-1ca0-45f2-9480-cb1d8b1f0f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:50:33.135371 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4405/8764] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:50:33.144088 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976225ca-3c38-4d3f-8185-353823659d92 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:33.144376 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976225ca-3c38-4d3f-8185-353823659d92 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:33.144755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976225ca-3c38-4d3f-8185-353823659d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:33.166259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-976225ca-3c38-4d3f-8185-353823659d92 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:50:33.167486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-976225ca-3c38-4d3f-8185-353823659d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:50:33.178822 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4360/8765] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:50:33.180089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af44544-1ca0-45f2-9480-cb1d8b1f0f37 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:33.191317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af44544-1ca0-45f2-9480-cb1d8b1f0f37 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:33.195837 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63059b-064a-48aa-b677-906ee33857f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:33.196474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63059b-064a-48aa-b677-906ee33857f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:33.197311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63059b-064a-48aa-b677-906ee33857f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:33.197582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63059b-064a-48aa-b677-906ee33857f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:33.198365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63059b-064a-48aa-b677-906ee33857f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:50:33.198700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63059b-064a-48aa-b677-906ee33857f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:33.200287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63059b-064a-48aa-b677-906ee33857f2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:33.217069 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4406/8766] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:50:33.218523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976225ca-3c38-4d3f-8185-353823659d92 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:33.228532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976225ca-3c38-4d3f-8185-353823659d92 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:33.233441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22fb0f-0cf4-4dc6-8054-85dcfcdaa3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:33.234042 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22fb0f-0cf4-4dc6-8054-85dcfcdaa3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:33.234323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22fb0f-0cf4-4dc6-8054-85dcfcdaa3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:33.234631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22fb0f-0cf4-4dc6-8054-85dcfcdaa3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:33.235263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22fb0f-0cf4-4dc6-8054-85dcfcdaa3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:33.237206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22fb0f-0cf4-4dc6-8054-85dcfcdaa3a6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:33.274054 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4361/8767] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:50:33 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:50:33.278731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63059b-064a-48aa-b677-906ee33857f2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:33.288775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63059b-064a-48aa-b677-906ee33857f2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:33.345708 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee32ce-544b-4cba-97eb-5041f640b6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:33.346305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee32ce-544b-4cba-97eb-5041f640b6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:33.346590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee32ce-544b-4cba-97eb-5041f640b6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:33.346902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee32ce-544b-4cba-97eb-5041f640b6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:33.347521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee32ce-544b-4cba-97eb-5041f640b6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:33.349442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee32ce-544b-4cba-97eb-5041f640b6a3 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:33.371914 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4407/8768] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:50:33 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:50:33.375981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22fb0f-0cf4-4dc6-8054-85dcfcdaa3a6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:33.386336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22fb0f-0cf4-4dc6-8054-85dcfcdaa3a6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:33.390848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5485f0-a545-4b1a-ac95-f1325684d50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:33.391442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5485f0-a545-4b1a-ac95-f1325684d50e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:33.391720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5485f0-a545-4b1a-ac95-f1325684d50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:33.391992 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5485f0-a545-4b1a-ac95-f1325684d50e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:33.392628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5485f0-a545-4b1a-ac95-f1325684d50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:33.394215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5485f0-a545-4b1a-ac95-f1325684d50e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:33.404088 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4362/8769] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:50:33.408030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee32ce-544b-4cba-97eb-5041f640b6a3 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:33.419229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee32ce-544b-4cba-97eb-5041f640b6a3 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:33.423793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd27f35-d791-42e6-b4f6-1c2b4a05e980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:33.424417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27f35-d791-42e6-b4f6-1c2b4a05e980 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:33.424698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27f35-d791-42e6-b4f6-1c2b4a05e980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:33.424970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27f35-d791-42e6-b4f6-1c2b4a05e980 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:33.425608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd27f35-d791-42e6-b4f6-1c2b4a05e980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:33.427241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd27f35-d791-42e6-b4f6-1c2b4a05e980 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:33.439080 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4408/8770] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:50:33.443013 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5485f0-a545-4b1a-ac95-f1325684d50e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:33.453059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5485f0-a545-4b1a-ac95-f1325684d50e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:33.457599 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b1cfb-1f6e-4075-b52c-d75f3135b9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:33.458244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1cfb-1f6e-4075-b52c-d75f3135b9af admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:33.458527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1cfb-1f6e-4075-b52c-d75f3135b9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:33.458841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1cfb-1f6e-4075-b52c-d75f3135b9af admin admin] PATH_INFO: `/v3/projects/0f53e04ccec74d66a5775d25aebc3689/users/5929ff3d530a49948e4485ad032924b7/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:33.473827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b1cfb-1f6e-4075-b52c-d75f3135b9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f53e04ccec74d66a5775d25aebc3689, user_id=5929ff3d530a49948e4485ad032924b7, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:33.476454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b1cfb-1f6e-4075-b52c-d75f3135b9af admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:33.489656 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4363/8771] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:50:33 2022] PUT /identity/v3/projects/0f53e04ccec74d66a5775d25aebc3689/users/5929ff3d530a49948e4485ad032924b7/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:50:33.495453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cdc23-83f5-43b5-9a32-f4e8a9e39d6f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:33.495737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cdc23-83f5-43b5-9a32-f4e8a9e39d6f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:33.496010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cdc23-83f5-43b5-9a32-f4e8a9e39d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:33.504222 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:33.515892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1b9cdc23-83f5-43b5-9a32-f4e8a9e39d6f None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:50:33.517266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1b9cdc23-83f5-43b5-9a32-f4e8a9e39d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:50:33.575307 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4409/8772] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:50:33.585125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b1cfb-1f6e-4075-b52c-d75f3135b9af admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:33.586984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cd6b1cfb-1f6e-4075-b52c-d75f3135b9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:50:33.643036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b1cfb-1f6e-4075-b52c-d75f3135b9af admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:33.646715 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb869a0-70f4-4dad-8071-aef11f2e13ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:33.647320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb869a0-70f4-4dad-8071-aef11f2e13ee service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:33.647602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb869a0-70f4-4dad-8071-aef11f2e13ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:33.647877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb869a0-70f4-4dad-8071-aef11f2e13ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:33.657455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb869a0-70f4-4dad-8071-aef11f2e13ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:33.658919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb869a0-70f4-4dad-8071-aef11f2e13ee service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:33.668248 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4364/8773] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:50:37.521214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10718a3-0ac2-49c8-ac71-2117ac776bd8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:37.521679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10718a3-0ac2-49c8-ac71-2117ac776bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:37.521766 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10718a3-0ac2-49c8-ac71-2117ac776bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:37.553555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f10718a3-0ac2-49c8-ac71-2117ac776bd8 None None] MFA Rules not processed for user `5929ff3d530a49948e4485ad032924b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:50:37.554763 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f10718a3-0ac2-49c8-ac71-2117ac776bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:50:37.625713 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4410/8774] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:50:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:50:37.630679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb869a0-70f4-4dad-8071-aef11f2e13ee service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:37.642029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb869a0-70f4-4dad-8071-aef11f2e13ee service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:37.647467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b11370-e9ed-4e91-a30e-bca0aa96efed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:37.648153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b11370-e9ed-4e91-a30e-bca0aa96efed admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:37.648511 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b11370-e9ed-4e91-a30e-bca0aa96efed admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:37.648862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b11370-e9ed-4e91-a30e-bca0aa96efed admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:37.650228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b11370-e9ed-4e91-a30e-bca0aa96efed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:37.652837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b11370-e9ed-4e91-a30e-bca0aa96efed admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:37.681390 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4365/8775] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:50:37 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:50:37.685484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10718a3-0ac2-49c8-ac71-2117ac776bd8 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:37.697510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10718a3-0ac2-49c8-ac71-2117ac776bd8 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:37.772511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4b8a3-dda7-47bb-8f86-1858e81b5a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:37.773221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4b8a3-dda7-47bb-8f86-1858e81b5a41 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:37.773609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4b8a3-dda7-47bb-8f86-1858e81b5a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:37.773845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4b8a3-dda7-47bb-8f86-1858e81b5a41 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:37.774791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4b8a3-dda7-47bb-8f86-1858e81b5a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:37.777019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4b8a3-dda7-47bb-8f86-1858e81b5a41 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:37.802230 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4411/8776] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:50:37 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:50:37.807143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b11370-e9ed-4e91-a30e-bca0aa96efed admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:37.820215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b11370-e9ed-4e91-a30e-bca0aa96efed admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:37.825789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4cbec-497e-4b3f-a7ca-f6ce4c2fec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:37.826454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4cbec-497e-4b3f-a7ca-f6ce4c2fec07 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:37.826771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4cbec-497e-4b3f-a7ca-f6ce4c2fec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:37.827052 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4cbec-497e-4b3f-a7ca-f6ce4c2fec07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:37.827710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4cbec-497e-4b3f-a7ca-f6ce4c2fec07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:37.829425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4cbec-497e-4b3f-a7ca-f6ce4c2fec07 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:37.842230 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4366/8777] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:50:37.846759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4b8a3-dda7-47bb-8f86-1858e81b5a41 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:37.858226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4b8a3-dda7-47bb-8f86-1858e81b5a41 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:37.863706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233d073-254a-4ba3-b691-483c49c4a9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:37.864456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233d073-254a-4ba3-b691-483c49c4a9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:37.864772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233d073-254a-4ba3-b691-483c49c4a9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:37.865090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233d073-254a-4ba3-b691-483c49c4a9ee admin admin] PATH_INFO: `/v3/projects/36dacecc7d1d41c78d46ef0da7d26585/users/bb3006d5598640fb8898359d18bf3dc9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:37.884916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233d073-254a-4ba3-b691-483c49c4a9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=36dacecc7d1d41c78d46ef0da7d26585, user_id=bb3006d5598640fb8898359d18bf3dc9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:37.888231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233d073-254a-4ba3-b691-483c49c4a9ee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:37.902133 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:37.916368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4cbec-497e-4b3f-a7ca-f6ce4c2fec07 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:37.917747 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4412/8778] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:50:37 2022] PUT /identity/v3/projects/36dacecc7d1d41c78d46ef0da7d26585/users/bb3006d5598640fb8898359d18bf3dc9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:50:37.928347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4cbec-497e-4b3f-a7ca-f6ce4c2fec07 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:37.947613 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:38.007046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babc502-9970-42e0-9a7e-6bb305f5a060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:38.007753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc502-9970-42e0-9a7e-6bb305f5a060 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:38.007996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc502-9970-42e0-9a7e-6bb305f5a060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:38.008432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc502-9970-42e0-9a7e-6bb305f5a060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:38.009807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babc502-9970-42e0-9a7e-6bb305f5a060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:38.011688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babc502-9970-42e0-9a7e-6bb305f5a060 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:38.023287 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4367/8779] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:50:38.029045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233d073-254a-4ba3-b691-483c49c4a9ee admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:38.043722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233d073-254a-4ba3-b691-483c49c4a9ee admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:38.048932 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757d5d3-54f4-4055-9259-10dff661fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:38.049597 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757d5d3-54f4-4055-9259-10dff661fc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:38.049884 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757d5d3-54f4-4055-9259-10dff661fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:38.050165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757d5d3-54f4-4055-9259-10dff661fc9b admin admin] PATH_INFO: `/v3/projects/36dacecc7d1d41c78d46ef0da7d26585/users/bb3006d5598640fb8898359d18bf3dc9/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:38.052361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757d5d3-54f4-4055-9259-10dff661fc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36dacecc7d1d41c78d46ef0da7d26585, user_id=bb3006d5598640fb8898359d18bf3dc9, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:38.055263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757d5d3-54f4-4055-9259-10dff661fc9b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:38.068343 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4413/8780] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:50:38 2022] PUT /identity/v3/projects/36dacecc7d1d41c78d46ef0da7d26585/users/bb3006d5598640fb8898359d18bf3dc9/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:50:42.552838 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d278c34-3d26-48e7-8dbc-a198fac4c41a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:42.553380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d278c34-3d26-48e7-8dbc-a198fac4c41a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:42.553380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d278c34-3d26-48e7-8dbc-a198fac4c41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:42.583658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1d278c34-3d26-48e7-8dbc-a198fac4c41a None None] MFA Rules not processed for user `bb3006d5598640fb8898359d18bf3dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:50:42.585024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1d278c34-3d26-48e7-8dbc-a198fac4c41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:50:42.655916 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4368/8781] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:50:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:50:42.667644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12a57-2d8d-4a5e-9a97-389043da42f8 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:42.668130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12a57-2d8d-4a5e-9a97-389043da42f8 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:42.668223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12a57-2d8d-4a5e-9a97-389043da42f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:42.725257 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-32e12a57-2d8d-4a5e-9a97-389043da42f8 None None] MFA Rules not processed for user `7cee33d8425d4be0ba5721ec419a12e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:50:42.726581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-32e12a57-2d8d-4a5e-9a97-389043da42f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:50:42.791696 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4414/8782] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Oct 2 01:50:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:50:42.798273 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d278c34-3d26-48e7-8dbc-a198fac4c41a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:50:42.809532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d278c34-3d26-48e7-8dbc-a198fac4c41a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:50:42.813194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a107a-bdab-4645-928b-901082709ee8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:50:42.813799 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a107a-bdab-4645-928b-901082709ee8 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:50:42.814081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a107a-bdab-4645-928b-901082709ee8 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:50:42.814359 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a107a-bdab-4645-928b-901082709ee8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:50:42.878130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a107a-bdab-4645-928b-901082709ee8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:50:42.879748 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a107a-bdab-4645-928b-901082709ee8 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:50:42.890096 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4369/8783] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:50:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:50:52.788421 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:50:52.885632 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:51:05.971273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e99876-c2b6-438e-9120-d1a5d6cf4961 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:51:05.971717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e99876-c2b6-438e-9120-d1a5d6cf4961 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:51:05.971978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e99876-c2b6-438e-9120-d1a5d6cf4961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:51:06.024094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d1e99876-c2b6-438e-9120-d1a5d6cf4961 None None] MFA Rules not processed for user `a0fa4948f9b546dea031acfc0f3e3d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:51:06.025854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d1e99876-c2b6-438e-9120-d1a5d6cf4961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:51:06.092859 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4415/8784] 10.222.0.23 () {58 vars in 1040 bytes} [Sun Oct 2 01:51:05 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:51:06.099070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a107a-bdab-4645-928b-901082709ee8 service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:51:06.111874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a107a-bdab-4645-928b-901082709ee8 service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:51:06.116858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670940e-d568-43e3-902a-f7ed8dd20ee0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:51:06.118132 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670940e-d568-43e3-902a-f7ed8dd20ee0 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:51:06.118416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670940e-d568-43e3-902a-f7ed8dd20ee0 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:51:06.118904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670940e-d568-43e3-902a-f7ed8dd20ee0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:51:06.126924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670940e-d568-43e3-902a-f7ed8dd20ee0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:51:06.128632 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670940e-d568-43e3-902a-f7ed8dd20ee0 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:51:06.138711 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4370/8785] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 01:51:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 01:51:16.083871 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=40 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:51:16.135325 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:51:31.293599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785406-d0be-4409-beb0-f01433714cc2 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:51:31.294161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785406-d0be-4409-beb0-f01433714cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:51:31.294161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785406-d0be-4409-beb0-f01433714cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:51:31.314376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-73785406-d0be-4409-beb0-f01433714cc2 None None] MFA Rules not processed for user `30c3d05e92dd463e81ccc5a557e46fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:51:31.315541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-73785406-d0be-4409-beb0-f01433714cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:51:31.371042 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4416/8786] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:51:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:51:31.417250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917424-0fba-485e-bb96-6594c6aa17a9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:51:31.417744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917424-0fba-485e-bb96-6594c6aa17a9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:51:31.417834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917424-0fba-485e-bb96-6594c6aa17a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:51:31.468493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1d917424-0fba-485e-bb96-6594c6aa17a9 None None] MFA Rules not processed for user `c62cd9bcc90e4d6685c5d0fc1d8ceae3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:51:31.469726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1d917424-0fba-485e-bb96-6594c6aa17a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:51:31.531389 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4371/8787] 10.222.0.23 () {58 vars in 1060 bytes} [Sun Oct 2 01:51:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:51:31.538058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73785406-d0be-4409-beb0-f01433714cc2 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:51:31.548263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73785406-d0be-4409-beb0-f01433714cc2 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:51:31.551764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd98c9-73ee-4715-b3e1-6618beec0bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:51:31.552361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd98c9-73ee-4715-b3e1-6618beec0bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:51:31.552639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd98c9-73ee-4715-b3e1-6618beec0bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:51:31.552909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd98c9-73ee-4715-b3e1-6618beec0bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:51:31.554645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-80fd98c9-73ee-4715-b3e1-6618beec0bf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:51:31.628365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd98c9-73ee-4715-b3e1-6618beec0bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:51:31.629801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd98c9-73ee-4715-b3e1-6618beec0bf8 service cinder] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:51:31.643901 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4417/8788] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:51:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:51:41.528631 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=38 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:51:41.636431 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=59 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:08.839815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d917424-0fba-485e-bb96-6594c6aa17a9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:08.909123 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d917424-0fba-485e-bb96-6594c6aa17a9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:08.912960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384ff71-4699-4335-b3ca-55f91bbe28e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:08.913570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ff71-4699-4335-b3ca-55f91bbe28e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:08.913848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ff71-4699-4335-b3ca-55f91bbe28e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:08.914139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ff71-4699-4335-b3ca-55f91bbe28e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:08.917549 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a384ff71-4699-4335-b3ca-55f91bbe28e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:08.929716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384ff71-4699-4335-b3ca-55f91bbe28e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:08.931391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384ff71-4699-4335-b3ca-55f91bbe28e1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:08.943403 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4372/8789] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:52:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:52:18.936854 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=30 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:35.011924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655582-2c0f-490a-b640-8a5894eea75d None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:35.012435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655582-2c0f-490a-b640-8a5894eea75d None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:35.012534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655582-2c0f-490a-b640-8a5894eea75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:35.032044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d5655582-2c0f-490a-b640-8a5894eea75d None None] MFA Rules not processed for user `5929ff3d530a49948e4485ad032924b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:52:35.033434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d5655582-2c0f-490a-b640-8a5894eea75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:35.042350 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4418/8790] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:52:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:52:35.099317 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384ff71-4699-4335-b3ca-55f91bbe28e1 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:35.100848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a384ff71-4699-4335-b3ca-55f91bbe28e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:35.118903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384ff71-4699-4335-b3ca-55f91bbe28e1 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:35.123791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ea15a-0eec-44f2-a9c3-fd3df67e6623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:35.124410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ea15a-0eec-44f2-a9c3-fd3df67e6623 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:35.124697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ea15a-0eec-44f2-a9c3-fd3df67e6623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:35.124977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ea15a-0eec-44f2-a9c3-fd3df67e6623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:35.126733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c16ea15a-0eec-44f2-a9c3-fd3df67e6623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:35.144847 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ea15a-0eec-44f2-a9c3-fd3df67e6623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:35.146294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ea15a-0eec-44f2-a9c3-fd3df67e6623 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:35.174200 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4373/8791] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:52:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:52:35.477106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5655582-2c0f-490a-b640-8a5894eea75d None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:35.486433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5655582-2c0f-490a-b640-8a5894eea75d None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:35.489984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197691f7-781e-4798-b0d6-f1ef05404e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:35.490578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197691f7-781e-4798-b0d6-f1ef05404e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:35.490888 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197691f7-781e-4798-b0d6-f1ef05404e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:35.491161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197691f7-781e-4798-b0d6-f1ef05404e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:35.492859 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-197691f7-781e-4798-b0d6-f1ef05404e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:35.505314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197691f7-781e-4798-b0d6-f1ef05404e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:35.506784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197691f7-781e-4798-b0d6-f1ef05404e98 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:35.518823 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4419/8792] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:52:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:52:36.913180 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ea15a-0eec-44f2-a9c3-fd3df67e6623 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:36.914820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c16ea15a-0eec-44f2-a9c3-fd3df67e6623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:36.931842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ea15a-0eec-44f2-a9c3-fd3df67e6623 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:36.938335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852901ba-1e70-4c77-b51c-ca61d955793d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:36.939097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852901ba-1e70-4c77-b51c-ca61d955793d service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:36.939470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852901ba-1e70-4c77-b51c-ca61d955793d service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:36.939837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852901ba-1e70-4c77-b51c-ca61d955793d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:36.941737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-852901ba-1e70-4c77-b51c-ca61d955793d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:36.957019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852901ba-1e70-4c77-b51c-ca61d955793d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:36.958732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852901ba-1e70-4c77-b51c-ca61d955793d service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:36.974315 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4374/8793] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:52:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:52:39.556816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197691f7-781e-4798-b0d6-f1ef05404e98 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:39.575031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197691f7-781e-4798-b0d6-f1ef05404e98 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:39.583667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e2bb2-2b72-4bec-a8fc-95209858d501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:39.584643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e2bb2-2b72-4bec-a8fc-95209858d501 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:39.585339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e2bb2-2b72-4bec-a8fc-95209858d501 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:39.586111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e2bb2-2b72-4bec-a8fc-95209858d501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:39.589815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-317e2bb2-2b72-4bec-a8fc-95209858d501 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:39.608990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e2bb2-2b72-4bec-a8fc-95209858d501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:39.611069 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e2bb2-2b72-4bec-a8fc-95209858d501 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:39.626715 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4420/8794] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:52:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:52:46.966094 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=16 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:49.340287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852901ba-1e70-4c77-b51c-ca61d955793d service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:49.341739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-852901ba-1e70-4c77-b51c-ca61d955793d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:49.353430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852901ba-1e70-4c77-b51c-ca61d955793d service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:49.356997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae1a1b-d239-47d7-bdee-73b7cf0892fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:49.357590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae1a1b-d239-47d7-bdee-73b7cf0892fa service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:49.357869 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae1a1b-d239-47d7-bdee-73b7cf0892fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:49.358142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae1a1b-d239-47d7-bdee-73b7cf0892fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:49.359787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-19ae1a1b-d239-47d7-bdee-73b7cf0892fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:49.429726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae1a1b-d239-47d7-bdee-73b7cf0892fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:49.431831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae1a1b-d239-47d7-bdee-73b7cf0892fa service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:49.453325 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4375/8795] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:52:49.618448 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=15 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:52.814585 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e2bb2-2b72-4bec-a8fc-95209858d501 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:52.816121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-317e2bb2-2b72-4bec-a8fc-95209858d501 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:52.906977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e2bb2-2b72-4bec-a8fc-95209858d501 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:52.912151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d25f2-d264-4759-9920-9b759dc2a4cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:52.912756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d25f2-d264-4759-9920-9b759dc2a4cc service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:52.913064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d25f2-d264-4759-9920-9b759dc2a4cc service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:52.913366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d25f2-d264-4759-9920-9b759dc2a4cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:52.915929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ab9d25f2-d264-4759-9920-9b759dc2a4cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:52.930834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d25f2-d264-4759-9920-9b759dc2a4cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:52.932578 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d25f2-d264-4759-9920-9b759dc2a4cc service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:52.945709 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4421/8796] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:52:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:52:56.189085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae1a1b-d239-47d7-bdee-73b7cf0892fa service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:56.190513 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-19ae1a1b-d239-47d7-bdee-73b7cf0892fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:56.204183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae1a1b-d239-47d7-bdee-73b7cf0892fa service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:56.208821 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:56.209445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:56.209721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:56.209989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] PATH_INFO: `/v3/users/30c3d05e92dd463e81ccc5a557e46fa3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:56.223803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c3d05e92dd463e81ccc5a557e46fa3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:56.225726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:56.271565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c3d05e92dd463e81ccc5a557e46fa3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.283713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c3d05e92dd463e81ccc5a557e46fa3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.284381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c3d05e92dd463e81ccc5a557e46fa3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.291563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c3d05e92dd463e81ccc5a557e46fa3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.298585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c3d05e92dd463e81ccc5a557e46fa3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.304484 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4376/8797] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:52:56 2022] DELETE /identity/v3/users/30c3d05e92dd463e81ccc5a557e46fa3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:52:56.478399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d25f2-d264-4759-9920-9b759dc2a4cc service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:56.491590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d25f2-d264-4759-9920-9b759dc2a4cc service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:56.550373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:56.551103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:56.551386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:56.551662 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] PATH_INFO: `/v3/projects/1ff590c5b5cc499386a58d5b84c7462b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:56.562707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff590c5b5cc499386a58d5b84c7462b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:56.564629 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:56.615678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff590c5b5cc499386a58d5b84c7462b', 'request_id': 'req-e1742152-518f-43b6-acd5-ba195532646b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.621849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff590c5b5cc499386a58d5b84c7462b', 'request_id': 'req-e1742152-518f-43b6-acd5-ba195532646b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.628593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff590c5b5cc499386a58d5b84c7462b', 'request_id': 'req-e1742152-518f-43b6-acd5-ba195532646b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.642572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] The token cache is being invalidate because project 1ff590c5b5cc499386a58d5b84c7462b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:52:56.642892 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.643535 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.645364 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4422/8798] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:52:56 2022] DELETE /identity/v3/projects/1ff590c5b5cc499386a58d5b84c7462b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:52:56.649823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:56.651358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:56.665477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5344e-9768-4f3a-a302-f1f090e2bc9e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:56.710718 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:56.728080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:56.728727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:56.729007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:56.729406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] PATH_INFO: `/v3/users/6707790e3658497a8cb0412f88ccc70a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:56.744823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=6707790e3658497a8cb0412f88ccc70a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:56.746789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:56.794843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6707790e3658497a8cb0412f88ccc70a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.806840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6707790e3658497a8cb0412f88ccc70a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.807518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6707790e3658497a8cb0412f88ccc70a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.817842 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6707790e3658497a8cb0412f88ccc70a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.825742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6707790e3658497a8cb0412f88ccc70a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:56.831880 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4377/8799] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:52:56 2022] DELETE /identity/v3/users/6707790e3658497a8cb0412f88ccc70a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:52:57.007435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:57.009304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:57.016942 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:57.024534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1742152-518f-43b6-acd5-ba195532646b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:57.096823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:57.097437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:57.097715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:57.097986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] PATH_INFO: `/v3/projects/e3ed1a8a81fb42f3906625eefc8e27d8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:57.108602 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ed1a8a81fb42f3906625eefc8e27d8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:57.110509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:57.163462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ed1a8a81fb42f3906625eefc8e27d8', 'request_id': 'req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:57.169403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ed1a8a81fb42f3906625eefc8e27d8', 'request_id': 'req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:57.176181 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ed1a8a81fb42f3906625eefc8e27d8', 'request_id': 'req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:57.190176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] The token cache is being invalidate because project e3ed1a8a81fb42f3906625eefc8e27d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:52:57.190548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:57.191138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:52:57.192959 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4423/8800] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:52:57 2022] DELETE /identity/v3/projects/e3ed1a8a81fb42f3906625eefc8e27d8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:52:57.384492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:57.386073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:57.454745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32303ec1-a987-4fb3-9e69-c9ba161463ba admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:57.515605 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d868b6-67fa-4c54-860e-2055d1641d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:57.516369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d868b6-67fa-4c54-860e-2055d1641d19 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:57.516712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d868b6-67fa-4c54-860e-2055d1641d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:57.517059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d868b6-67fa-4c54-860e-2055d1641d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:57.519130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d1d868b6-67fa-4c54-860e-2055d1641d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:57.549851 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:52:57.597920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d868b6-67fa-4c54-860e-2055d1641d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:57.599499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d868b6-67fa-4c54-860e-2055d1641d19 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:57.611450 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4378/8801] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:52:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:52:59.380351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:52:59.381994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:59.396624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa708cf-b6a7-48b8-96d5-984b1a4b0a28 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:52:59.401575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfa92d-2f26-4822-b667-f30e7ad2eefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:52:59.402232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfa92d-2f26-4822-b667-f30e7ad2eefc service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:52:59.402520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfa92d-2f26-4822-b667-f30e7ad2eefc service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:52:59.402836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfa92d-2f26-4822-b667-f30e7ad2eefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:52:59.404821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1ccfa92d-2f26-4822-b667-f30e7ad2eefc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:52:59.420920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfa92d-2f26-4822-b667-f30e7ad2eefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:52:59.422579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfa92d-2f26-4822-b667-f30e7ad2eefc service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:52:59.437311 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4424/8802] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:52:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:53:07.606767 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=18 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:53:09.428179 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:53:51.321116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d868b6-67fa-4c54-860e-2055d1641d19 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:53:51.322725 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d1d868b6-67fa-4c54-860e-2055d1641d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:53:51.400902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d868b6-67fa-4c54-860e-2055d1641d19 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:53:51.406588 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:53:51.407287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:53:51.407621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:53:51.407901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] PATH_INFO: `/v3/users/5929ff3d530a49948e4485ad032924b7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:53:51.409111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5929ff3d530a49948e4485ad032924b7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:53:51.411111 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:53:51.462955 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5929ff3d530a49948e4485ad032924b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.484926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5929ff3d530a49948e4485ad032924b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.485646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5929ff3d530a49948e4485ad032924b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.495852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5929ff3d530a49948e4485ad032924b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.504126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5929ff3d530a49948e4485ad032924b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.511456 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4379/8803] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:53:51 2022] DELETE /identity/v3/users/5929ff3d530a49948e4485ad032924b7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:53:51.693330 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfa92d-2f26-4822-b667-f30e7ad2eefc service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:53:51.705973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfa92d-2f26-4822-b667-f30e7ad2eefc service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:53:51.761001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:53:51.761628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:53:51.762472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:53:51.762774 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] PATH_INFO: `/v3/projects/0f53e04ccec74d66a5775d25aebc3689` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:53:51.763897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f53e04ccec74d66a5775d25aebc3689)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:53:51.765803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:53:51.813635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f53e04ccec74d66a5775d25aebc3689', 'request_id': 'req-a76f8fe1-58bc-4760-a405-e8f44265e0b9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.819062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f53e04ccec74d66a5775d25aebc3689', 'request_id': 'req-a76f8fe1-58bc-4760-a405-e8f44265e0b9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.826388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f53e04ccec74d66a5775d25aebc3689', 'request_id': 'req-a76f8fe1-58bc-4760-a405-e8f44265e0b9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.842806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] The token cache is being invalidate because project 0f53e04ccec74d66a5775d25aebc3689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:53:51.843346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.844275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.845821 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4425/8804] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:53:51 2022] DELETE /identity/v3/projects/0f53e04ccec74d66a5775d25aebc3689 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:53:51.851203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:53:51.852638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:53:51.868639 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931a324-0b91-4ca5-926e-e09f3eabd02f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:53:51.925486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c62d0-aab1-469a-88f7-dccb36bffc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:53:51.926116 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c62d0-aab1-469a-88f7-dccb36bffc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:53:51.926395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c62d0-aab1-469a-88f7-dccb36bffc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:53:51.926696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c62d0-aab1-469a-88f7-dccb36bffc97 admin admin] PATH_INFO: `/v3/users/bb3006d5598640fb8898359d18bf3dc9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:53:51.927830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c62d0-aab1-469a-88f7-dccb36bffc97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3006d5598640fb8898359d18bf3dc9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:53:51.929771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c62d0-aab1-469a-88f7-dccb36bffc97 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:53:51.952360 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:53:51.984735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-997c62d0-aab1-469a-88f7-dccb36bffc97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3006d5598640fb8898359d18bf3dc9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.997147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-997c62d0-aab1-469a-88f7-dccb36bffc97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3006d5598640fb8898359d18bf3dc9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:51.997846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-997c62d0-aab1-469a-88f7-dccb36bffc97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3006d5598640fb8898359d18bf3dc9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:52.006837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-997c62d0-aab1-469a-88f7-dccb36bffc97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3006d5598640fb8898359d18bf3dc9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:52.013974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-997c62d0-aab1-469a-88f7-dccb36bffc97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3006d5598640fb8898359d18bf3dc9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:52.020132 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4380/8805] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:53:51 2022] DELETE /identity/v3/users/bb3006d5598640fb8898359d18bf3dc9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:53:52.199658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:53:52.201114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:53:52.214235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f8fe1-58bc-4760-a405-e8f44265e0b9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:53:52.271080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:53:52.271715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:53:52.271999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:53:52.272273 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] PATH_INFO: `/v3/projects/36dacecc7d1d41c78d46ef0da7d26585` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:53:52.273385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36dacecc7d1d41c78d46ef0da7d26585)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:53:52.275362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:53:52.313144 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:53:52.326685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36dacecc7d1d41c78d46ef0da7d26585', 'request_id': 'req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:52.332142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36dacecc7d1d41c78d46ef0da7d26585', 'request_id': 'req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:52.338127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36dacecc7d1d41c78d46ef0da7d26585', 'request_id': 'req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:52.351197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] The token cache is being invalidate because project 36dacecc7d1d41c78d46ef0da7d26585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:53:52.351510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:52.352134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-61154cbc-4e49-4624-a72f-e5e3dc4c90b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:53:52.353654 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4426/8806] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:53:52 2022] DELETE /identity/v3/projects/36dacecc7d1d41c78d46ef0da7d26585 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:54:01.856194 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1a7f-6cc5-4bd6-8492-8fba235b2336 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:01.856753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1a7f-6cc5-4bd6-8492-8fba235b2336 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:01.856753 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1a7f-6cc5-4bd6-8492-8fba235b2336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:01.877744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-098f1a7f-6cc5-4bd6-8492-8fba235b2336 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:01.879045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-098f1a7f-6cc5-4bd6-8492-8fba235b2336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:01.937335 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4381/8807] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:54:01.946699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d535e6b-ba2b-4193-b485-0de26b93d9f1 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:01.947191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d535e6b-ba2b-4193-b485-0de26b93d9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:01.947305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d535e6b-ba2b-4193-b485-0de26b93d9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:01.972720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6d535e6b-ba2b-4193-b485-0de26b93d9f1 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:01.972720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6d535e6b-ba2b-4193-b485-0de26b93d9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:01.976892 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4427/8808] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:54:01.981766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f1a7f-6cc5-4bd6-8492-8fba235b2336 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:01.992150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f1a7f-6cc5-4bd6-8492-8fba235b2336 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:01.996760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100bd4-0e91-4ac5-8512-aa154ac41378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:01.997357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100bd4-0e91-4ac5-8512-aa154ac41378 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:01.997638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100bd4-0e91-4ac5-8512-aa154ac41378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:01.997962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100bd4-0e91-4ac5-8512-aa154ac41378 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:01.998819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82100bd4-0e91-4ac5-8512-aa154ac41378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:54:01.999128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82100bd4-0e91-4ac5-8512-aa154ac41378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.000731 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82100bd4-0e91-4ac5-8512-aa154ac41378 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.012675 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4382/8809] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:54:02.024607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d535e6b-ba2b-4193-b485-0de26b93d9f1 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:02.035091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d535e6b-ba2b-4193-b485-0de26b93d9f1 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:02.040054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bd6c5-dfe8-45f3-9dd0-6f5d2173d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:02.040655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bd6c5-dfe8-45f3-9dd0-6f5d2173d91a admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.040936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bd6c5-dfe8-45f3-9dd0-6f5d2173d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.041209 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bd6c5-dfe8-45f3-9dd0-6f5d2173d91a admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.041865 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bd6c5-dfe8-45f3-9dd0-6f5d2173d91a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.043838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bd6c5-dfe8-45f3-9dd0-6f5d2173d91a admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.071584 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4428/8810] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:54:02 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:54:02.075732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100bd4-0e91-4ac5-8512-aa154ac41378 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:02.086206 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100bd4-0e91-4ac5-8512-aa154ac41378 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:02.143293 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbddf60-bf47-4119-a485-4314a1c73e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:02.143820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbddf60-bf47-4119-a485-4314a1c73e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.144105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbddf60-bf47-4119-a485-4314a1c73e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.144382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbddf60-bf47-4119-a485-4314a1c73e21 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.145002 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbddf60-bf47-4119-a485-4314a1c73e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.146952 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbddf60-bf47-4119-a485-4314a1c73e21 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.168180 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4383/8811] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:54:02 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:54:02.172448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bd6c5-dfe8-45f3-9dd0-6f5d2173d91a admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:02.183675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bd6c5-dfe8-45f3-9dd0-6f5d2173d91a admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:02.188571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a0e78-de74-42e1-883a-4f19b5b05f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:02.189175 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a0e78-de74-42e1-883a-4f19b5b05f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.189456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a0e78-de74-42e1-883a-4f19b5b05f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.189757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a0e78-de74-42e1-883a-4f19b5b05f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.190407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a0e78-de74-42e1-883a-4f19b5b05f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.192024 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a0e78-de74-42e1-883a-4f19b5b05f01 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.204127 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4429/8812] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:54:02.208096 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbddf60-bf47-4119-a485-4314a1c73e21 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:02.218560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbddf60-bf47-4119-a485-4314a1c73e21 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:02.224040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d69b42-438f-48a8-aa90-ea78a815e9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:02.224636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d69b42-438f-48a8-aa90-ea78a815e9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.224928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d69b42-438f-48a8-aa90-ea78a815e9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.225185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d69b42-438f-48a8-aa90-ea78a815e9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.225823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d69b42-438f-48a8-aa90-ea78a815e9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.227443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d69b42-438f-48a8-aa90-ea78a815e9f7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.238056 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4384/8813] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:54:02.242201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a0e78-de74-42e1-883a-4f19b5b05f01 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:02.252226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a0e78-de74-42e1-883a-4f19b5b05f01 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:02.256807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a775f2-5466-485b-aae4-f1e9801639ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:02.257475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a775f2-5466-485b-aae4-f1e9801639ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.257758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a775f2-5466-485b-aae4-f1e9801639ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.258059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a775f2-5466-485b-aae4-f1e9801639ee admin admin] PATH_INFO: `/v3/projects/6e6f688001d740868acffef436ca890f/users/9cc4261e4db8422ba1e4d2a8c970f47e/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.274056 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a775f2-5466-485b-aae4-f1e9801639ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6f688001d740868acffef436ca890f, user_id=9cc4261e4db8422ba1e4d2a8c970f47e, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.276742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a775f2-5466-485b-aae4-f1e9801639ee admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.289422 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4430/8814] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:54:02 2022] PUT /identity/v3/projects/6e6f688001d740868acffef436ca890f/users/9cc4261e4db8422ba1e4d2a8c970f47e/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:54:02.303915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db12c9-8cf9-4ad8-a35f-9beaa6925201 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.304287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db12c9-8cf9-4ad8-a35f-9beaa6925201 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.304701 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db12c9-8cf9-4ad8-a35f-9beaa6925201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.313385 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:02.334331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f8db12c9-8cf9-4ad8-a35f-9beaa6925201 None None] MFA Rules not processed for user `9cc4261e4db8422ba1e4d2a8c970f47e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:02.335581 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f8db12c9-8cf9-4ad8-a35f-9beaa6925201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:02.398562 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4385/8815] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:54:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:54:02.403177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a775f2-5466-485b-aae4-f1e9801639ee admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:02.469336 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a775f2-5466-485b-aae4-f1e9801639ee admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:02.473947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ca2f5-9736-4c05-ab72-3da81b487795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:02.474539 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ca2f5-9736-4c05-ab72-3da81b487795 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.474844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ca2f5-9736-4c05-ab72-3da81b487795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.475113 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ca2f5-9736-4c05-ab72-3da81b487795 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.475737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ca2f5-9736-4c05-ab72-3da81b487795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.477621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ca2f5-9736-4c05-ab72-3da81b487795 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.503620 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4431/8816] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:54:02 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:54:02.507752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db12c9-8cf9-4ad8-a35f-9beaa6925201 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:02.518682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db12c9-8cf9-4ad8-a35f-9beaa6925201 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:02.574159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f187bb-8929-4fa8-a490-3aaf2a905b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:02.574795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f187bb-8929-4fa8-a490-3aaf2a905b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.575083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f187bb-8929-4fa8-a490-3aaf2a905b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.575358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f187bb-8929-4fa8-a490-3aaf2a905b90 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.575980 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f187bb-8929-4fa8-a490-3aaf2a905b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.578486 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f187bb-8929-4fa8-a490-3aaf2a905b90 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.599273 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4386/8817] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:54:02 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:54:02.603311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ca2f5-9736-4c05-ab72-3da81b487795 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:02.616264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ca2f5-9736-4c05-ab72-3da81b487795 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:02.620929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27286-d106-464a-b3c6-ebeb1619b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:02.621556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27286-d106-464a-b3c6-ebeb1619b342 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.621833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27286-d106-464a-b3c6-ebeb1619b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.622104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27286-d106-464a-b3c6-ebeb1619b342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.622786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27286-d106-464a-b3c6-ebeb1619b342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.624905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27286-d106-464a-b3c6-ebeb1619b342 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.635404 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4432/8818] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:54:02.640262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f187bb-8929-4fa8-a490-3aaf2a905b90 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:02.650633 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f187bb-8929-4fa8-a490-3aaf2a905b90 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:02.655391 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811dae-1095-405d-8c7f-34e99313bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:02.656041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811dae-1095-405d-8c7f-34e99313bd32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.656325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811dae-1095-405d-8c7f-34e99313bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.656600 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811dae-1095-405d-8c7f-34e99313bd32 admin admin] PATH_INFO: `/v3/projects/8b63386b5e34448fab3193d7fa41bf81/users/b66cfb4f42f248f7918e182a959fa891/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.672446 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5811dae-1095-405d-8c7f-34e99313bd32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b63386b5e34448fab3193d7fa41bf81, user_id=b66cfb4f42f248f7918e182a959fa891, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.675155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5811dae-1095-405d-8c7f-34e99313bd32 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.688226 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4387/8819] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:54:02 2022] PUT /identity/v3/projects/8b63386b5e34448fab3193d7fa41bf81/users/b66cfb4f42f248f7918e182a959fa891/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:54:02.692252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27286-d106-464a-b3c6-ebeb1619b342 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:02.702875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27286-d106-464a-b3c6-ebeb1619b342 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:02.731028 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:02.760127 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d94a52-fd16-4a32-ab40-2f8f6ec4ec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:02.761009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d94a52-fd16-4a32-ab40-2f8f6ec4ec54 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.761299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d94a52-fd16-4a32-ab40-2f8f6ec4ec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.761573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d94a52-fd16-4a32-ab40-2f8f6ec4ec54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.762207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d94a52-fd16-4a32-ab40-2f8f6ec4ec54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.764329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d94a52-fd16-4a32-ab40-2f8f6ec4ec54 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.774149 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4433/8820] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:54:02.778276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811dae-1095-405d-8c7f-34e99313bd32 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:02.789011 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811dae-1095-405d-8c7f-34e99313bd32 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:02.793699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915d4b6-f8df-4855-8d6a-46dbef955383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:02.794347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915d4b6-f8df-4855-8d6a-46dbef955383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.794661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915d4b6-f8df-4855-8d6a-46dbef955383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.795939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915d4b6-f8df-4855-8d6a-46dbef955383 admin admin] PATH_INFO: `/v3/projects/8b63386b5e34448fab3193d7fa41bf81/users/b66cfb4f42f248f7918e182a959fa891/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.797857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915d4b6-f8df-4855-8d6a-46dbef955383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b63386b5e34448fab3193d7fa41bf81, user_id=b66cfb4f42f248f7918e182a959fa891, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:02.800566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915d4b6-f8df-4855-8d6a-46dbef955383 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:02.811922 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4388/8821] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:54:02 2022] PUT /identity/v3/projects/8b63386b5e34448fab3193d7fa41bf81/users/b66cfb4f42f248f7918e182a959fa891/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:54:02.822383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca27453-93f4-4389-833d-44e0b516c121 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.822717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca27453-93f4-4389-833d-44e0b516c121 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.823001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca27453-93f4-4389-833d-44e0b516c121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.850290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-eca27453-93f4-4389-833d-44e0b516c121 None None] MFA Rules not processed for user `b66cfb4f42f248f7918e182a959fa891`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:02.851524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eca27453-93f4-4389-833d-44e0b516c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:02.918872 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4434/8822] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:54:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:54:02.932755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27350f9d-20c2-4d03-8026-471f6182bdd4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:02.933259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27350f9d-20c2-4d03-8026-471f6182bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:02.933366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27350f9d-20c2-4d03-8026-471f6182bdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:02.953353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-27350f9d-20c2-4d03-8026-471f6182bdd4 None None] MFA Rules not processed for user `9cc4261e4db8422ba1e4d2a8c970f47e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:02.954557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-27350f9d-20c2-4d03-8026-471f6182bdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:02.995937 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:03.010498 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4389/8823] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:54:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:54:03.025425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca27453-93f4-4389-833d-44e0b516c121 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:03.027165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-eca27453-93f4-4389-833d-44e0b516c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:03.107857 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca27453-93f4-4389-833d-44e0b516c121 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:03.114025 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a0bcc-75de-4a79-9e93-ad95cc71056d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:03.114161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0bcc-75de-4a79-9e93-ad95cc71056d service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:03.114409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0bcc-75de-4a79-9e93-ad95cc71056d service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:03.114698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0bcc-75de-4a79-9e93-ad95cc71056d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:03.123564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a0bcc-75de-4a79-9e93-ad95cc71056d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:03.125140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a0bcc-75de-4a79-9e93-ad95cc71056d service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:03.134123 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4435/8824] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:54:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:54:08.115389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27350f9d-20c2-4d03-8026-471f6182bdd4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:08.116794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-27350f9d-20c2-4d03-8026-471f6182bdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:08.196411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27350f9d-20c2-4d03-8026-471f6182bdd4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:08.202424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8980ea-0d24-4347-bbdd-5be22406de0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:08.203103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8980ea-0d24-4347-bbdd-5be22406de0e service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:08.203383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8980ea-0d24-4347-bbdd-5be22406de0e service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:08.203656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8980ea-0d24-4347-bbdd-5be22406de0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:08.206071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1c8980ea-0d24-4347-bbdd-5be22406de0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:08.222357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8980ea-0d24-4347-bbdd-5be22406de0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:08.224072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8980ea-0d24-4347-bbdd-5be22406de0e service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:08.237139 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4390/8825] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:54:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:54:11.861447 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a0bcc-75de-4a79-9e93-ad95cc71056d service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:11.876059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a0bcc-75de-4a79-9e93-ad95cc71056d service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:11.881773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a51b83-bc83-44df-9667-2f9817eb3503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:11.882480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a51b83-bc83-44df-9667-2f9817eb3503 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:11.882808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a51b83-bc83-44df-9667-2f9817eb3503 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:11.883084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a51b83-bc83-44df-9667-2f9817eb3503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:11.884910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b5a51b83-bc83-44df-9667-2f9817eb3503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:11.900376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a51b83-bc83-44df-9667-2f9817eb3503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:11.901962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a51b83-bc83-44df-9667-2f9817eb3503 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:11.915917 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4436/8826] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:54:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:54:13.362277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8980ea-0d24-4347-bbdd-5be22406de0e service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:13.377041 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8980ea-0d24-4347-bbdd-5be22406de0e service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:13.382444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9b9c4-3543-452a-96b7-86395b9550ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:13.383065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9b9c4-3543-452a-96b7-86395b9550ef service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:13.383344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9b9c4-3543-452a-96b7-86395b9550ef service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:13.383617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9b9c4-3543-452a-96b7-86395b9550ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:13.392302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9b9c4-3543-452a-96b7-86395b9550ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:13.393861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9b9c4-3543-452a-96b7-86395b9550ef service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:13.403458 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4391/8827] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:54:13 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:54:13.418751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde73d17-b4a3-4001-a2b6-b1c4f1cfecb1 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:13.419242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde73d17-b4a3-4001-a2b6-b1c4f1cfecb1 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:13.419333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde73d17-b4a3-4001-a2b6-b1c4f1cfecb1 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:13.420670 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4437/8828] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:54:13.425687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9b9c4-3543-452a-96b7-86395b9550ef service nova] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:54:13.440364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9b9c4-3543-452a-96b7-86395b9550ef service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:13.448604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9b9c4-3543-452a-96b7-86395b9550ef service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:13.453481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49495db5-1fa9-4fae-8797-85d25905dd5c tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cfb4f42f248f7918e182a959fa891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b63386b5e34448fab3193d7fa41bf81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:13.454098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49495db5-1fa9-4fae-8797-85d25905dd5c tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:13.454386 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49495db5-1fa9-4fae-8797-85d25905dd5c tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:13.454700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49495db5-1fa9-4fae-8797-85d25905dd5c tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] PATH_INFO: `/v3/projects/8b63386b5e34448fab3193d7fa41bf81` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:13.455827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49495db5-1fa9-4fae-8797-85d25905dd5c tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] RBAC: Authorizing `identity:get_project(project_id=8b63386b5e34448fab3193d7fa41bf81)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:13.457612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49495db5-1fa9-4fae-8797-85d25905dd5c tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:13.459271 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4392/8829] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:54:13 2022] GET /identity/v3/projects/8b63386b5e34448fab3193d7fa41bf81 => generated 393 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:54:13.775071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7a27-6036-4841-9f31-ada866fd5c22 None None] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:13.775362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7a27-6036-4841-9f31-ada866fd5c22 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:13.775640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7a27-6036-4841-9f31-ada866fd5c22 None None] PATH_INFO: `/` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:13.777002 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4438/8830] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 2 01:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 02 01:54:13.782279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49495db5-1fa9-4fae-8797-85d25905dd5c tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Authenticating service token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 02 01:54:13.798772 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49495db5-1fa9-4fae-8797-85d25905dd5c tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:13.807584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49495db5-1fa9-4fae-8797-85d25905dd5c tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:13.812604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef0e0-1ab4-4d14-afd5-8a6755721e6f tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cfb4f42f248f7918e182a959fa891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b63386b5e34448fab3193d7fa41bf81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:13.813222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef0e0-1ab4-4d14-afd5-8a6755721e6f tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:13.813503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef0e0-1ab4-4d14-afd5-8a6755721e6f tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:13.813778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef0e0-1ab4-4d14-afd5-8a6755721e6f tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] PATH_INFO: `/v3/projects/8b63386b5e34448fab3193d7fa41bf81` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:13.814946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ef0e0-1ab4-4d14-afd5-8a6755721e6f tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] RBAC: Authorizing `identity:get_project(project_id=8b63386b5e34448fab3193d7fa41bf81)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:13.816794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ef0e0-1ab4-4d14-afd5-8a6755721e6f tempest-ServersAdminNegativeTestJSON-1515728217 tempest-ServersAdminNegativeTestJSON-1515728217-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:13.818483 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4393/8831] 10.222.0.23 () {58 vars in 1443 bytes} [Sun Oct 2 01:54:13 2022] GET /identity/v3/projects/8b63386b5e34448fab3193d7fa41bf81 => generated 393 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:54:17.695981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e7a27-6036-4841-9f31-ada866fd5c22 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:17.725511 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=100 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:17.762497 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e7a27-6036-4841-9f31-ada866fd5c22 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:17.767208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:17.767836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:17.768118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:17.768394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] PATH_INFO: `/v3/users/9cc4261e4db8422ba1e4d2a8c970f47e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:17.769530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc4261e4db8422ba1e4d2a8c970f47e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:17.771544 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:17.823679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc4261e4db8422ba1e4d2a8c970f47e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:17.835938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc4261e4db8422ba1e4d2a8c970f47e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:17.836669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc4261e4db8422ba1e4d2a8c970f47e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:17.843503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc4261e4db8422ba1e4d2a8c970f47e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:17.844232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc4261e4db8422ba1e4d2a8c970f47e'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:17.856323 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4439/8832] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:54:17 2022] DELETE /identity/v3/users/9cc4261e4db8422ba1e4d2a8c970f47e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:54:17.861825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd244d8-a0e9-4b5f-9fa7-549adcb4939b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:17.862339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd244d8-a0e9-4b5f-9fa7-549adcb4939b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:17.862459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd244d8-a0e9-4b5f-9fa7-549adcb4939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:17.882378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8fd244d8-a0e9-4b5f-9fa7-549adcb4939b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:17.883628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8fd244d8-a0e9-4b5f-9fa7-549adcb4939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:17.943472 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4394/8833] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:54:17.953463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:17.954874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:18.012936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acd0ff-79b4-43d7-b4d7-19a9a0f29ae8 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:18.016958 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2192-1385-44f1-a2a7-9a401587127c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:18.017565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2192-1385-44f1-a2a7-9a401587127c service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:18.017845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2192-1385-44f1-a2a7-9a401587127c service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:18.018114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2192-1385-44f1-a2a7-9a401587127c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:18.027120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd2192-1385-44f1-a2a7-9a401587127c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:18.028570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd2192-1385-44f1-a2a7-9a401587127c service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:18.037914 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4440/8834] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:54:18.210103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd244d8-a0e9-4b5f-9fa7-549adcb4939b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:18.211577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8fd244d8-a0e9-4b5f-9fa7-549adcb4939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:18.226834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd244d8-a0e9-4b5f-9fa7-549adcb4939b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:18.231830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:18.232551 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:18.232836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:18.233147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] PATH_INFO: `/v3/projects/6e6f688001d740868acffef436ca890f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:18.234882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6f688001d740868acffef436ca890f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:18.237202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:18.280531 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:18.284050 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6f688001d740868acffef436ca890f', 'request_id': 'req-28b2b50f-390a-4ecc-8d22-38763b29ba20'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.290155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6f688001d740868acffef436ca890f', 'request_id': 'req-28b2b50f-390a-4ecc-8d22-38763b29ba20'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.297017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6f688001d740868acffef436ca890f', 'request_id': 'req-28b2b50f-390a-4ecc-8d22-38763b29ba20'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.310580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] The token cache is being invalidate because project 6e6f688001d740868acffef436ca890f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:54:18.311147 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.311762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.313880 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4395/8835] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:54:18 2022] DELETE /identity/v3/projects/6e6f688001d740868acffef436ca890f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:54:18.317841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2192-1385-44f1-a2a7-9a401587127c service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:18.327321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2192-1385-44f1-a2a7-9a401587127c service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:18.372748 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:18.388083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fcf83-2776-484f-93e1-c8d425f4d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:18.388718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fcf83-2776-484f-93e1-c8d425f4d05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:18.388998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fcf83-2776-484f-93e1-c8d425f4d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:18.389274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fcf83-2776-484f-93e1-c8d425f4d05c admin admin] PATH_INFO: `/v3/users/b66cfb4f42f248f7918e182a959fa891` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:18.390417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fcf83-2776-484f-93e1-c8d425f4d05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66cfb4f42f248f7918e182a959fa891)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:18.392393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fcf83-2776-484f-93e1-c8d425f4d05c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:18.437877 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7e1fcf83-2776-484f-93e1-c8d425f4d05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66cfb4f42f248f7918e182a959fa891'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.449670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7e1fcf83-2776-484f-93e1-c8d425f4d05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66cfb4f42f248f7918e182a959fa891'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.450350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7e1fcf83-2776-484f-93e1-c8d425f4d05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66cfb4f42f248f7918e182a959fa891'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.458041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7e1fcf83-2776-484f-93e1-c8d425f4d05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66cfb4f42f248f7918e182a959fa891'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.458593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7e1fcf83-2776-484f-93e1-c8d425f4d05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66cfb4f42f248f7918e182a959fa891'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.471007 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4441/8836] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:54:18 2022] DELETE /identity/v3/users/b66cfb4f42f248f7918e182a959fa891 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:54:18.736969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:18.738523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:18.751941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b50f-390a-4ecc-8d22-38763b29ba20 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:18.806698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:18.807325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:18.807603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:18.807872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] PATH_INFO: `/v3/projects/8b63386b5e34448fab3193d7fa41bf81` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:18.808974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b63386b5e34448fab3193d7fa41bf81)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:18.811163 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:18.863857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b63386b5e34448fab3193d7fa41bf81', 'request_id': 'req-395489ac-e8c6-424d-a225-0f777b94ba20'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.871893 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b63386b5e34448fab3193d7fa41bf81', 'request_id': 'req-395489ac-e8c6-424d-a225-0f777b94ba20'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.879473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b63386b5e34448fab3193d7fa41bf81', 'request_id': 'req-395489ac-e8c6-424d-a225-0f777b94ba20'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.892630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] The token cache is being invalidate because project 8b63386b5e34448fab3193d7fa41bf81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:54:18.892921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.893552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395489ac-e8c6-424d-a225-0f777b94ba20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:54:18.895115 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4396/8837] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:54:18 2022] DELETE /identity/v3/projects/8b63386b5e34448fab3193d7fa41bf81 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:54:18.901093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c816-81aa-4159-aea6-b9120f91ea25 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:18.901560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c816-81aa-4159-aea6-b9120f91ea25 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:18.901678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c816-81aa-4159-aea6-b9120f91ea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:18.922833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-17d2c816-81aa-4159-aea6-b9120f91ea25 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:18.924173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-17d2c816-81aa-4159-aea6-b9120f91ea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:18.983558 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4442/8838] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 01:54:18.992051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a628-5320-4a39-94c9-94212e8d4fc9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:18.992338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a628-5320-4a39-94c9-94212e8d4fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:18.992614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a628-5320-4a39-94c9-94212e8d4fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:19.012704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dac5a628-5320-4a39-94c9-94212e8d4fc9 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:19.013910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dac5a628-5320-4a39-94c9-94212e8d4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:19.022443 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4397/8839] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:54:19.026880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c816-81aa-4159-aea6-b9120f91ea25 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:19.037228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c816-81aa-4159-aea6-b9120f91ea25 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:19.041748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975dd2-c100-4394-908b-27b35faa4092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:19.042339 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975dd2-c100-4394-908b-27b35faa4092 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:19.042644 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975dd2-c100-4394-908b-27b35faa4092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:19.042924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975dd2-c100-4394-908b-27b35faa4092 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:19.043574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975dd2-c100-4394-908b-27b35faa4092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:54:19.043879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975dd2-c100-4394-908b-27b35faa4092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:19.045473 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975dd2-c100-4394-908b-27b35faa4092 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:19.057657 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4443/8840] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:54:19.062235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a628-5320-4a39-94c9-94212e8d4fc9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:19.071326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a628-5320-4a39-94c9-94212e8d4fc9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:19.075922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca4085-612b-42c4-ad96-e7b0d2b43842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:19.076516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca4085-612b-42c4-ad96-e7b0d2b43842 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:19.076794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca4085-612b-42c4-ad96-e7b0d2b43842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:19.077065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca4085-612b-42c4-ad96-e7b0d2b43842 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:19.077698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca4085-612b-42c4-ad96-e7b0d2b43842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:19.079734 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca4085-612b-42c4-ad96-e7b0d2b43842 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:19.106291 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4398/8841] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:54:19 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 01:54:19.111252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975dd2-c100-4394-908b-27b35faa4092 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:19.121265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975dd2-c100-4394-908b-27b35faa4092 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:19.168429 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:19.179381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462bbb6-0d60-494c-810d-d9434bcdaca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:19.179983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462bbb6-0d60-494c-810d-d9434bcdaca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:19.180264 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462bbb6-0d60-494c-810d-d9434bcdaca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:19.180536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462bbb6-0d60-494c-810d-d9434bcdaca7 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:19.181163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462bbb6-0d60-494c-810d-d9434bcdaca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:19.183114 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462bbb6-0d60-494c-810d-d9434bcdaca7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:19.203937 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4444/8842] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:54:19 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:54:19.208157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca4085-612b-42c4-ad96-e7b0d2b43842 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:19.227744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca4085-612b-42c4-ad96-e7b0d2b43842 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:19.232330 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d08fe-92d5-4980-9d0d-ee3abd3e5273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:19.232937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d08fe-92d5-4980-9d0d-ee3abd3e5273 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:19.233220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d08fe-92d5-4980-9d0d-ee3abd3e5273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:19.233521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d08fe-92d5-4980-9d0d-ee3abd3e5273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:19.235172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d08fe-92d5-4980-9d0d-ee3abd3e5273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:19.236771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d08fe-92d5-4980-9d0d-ee3abd3e5273 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:19.247012 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4399/8843] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:54:19.251554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462bbb6-0d60-494c-810d-d9434bcdaca7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:19.261375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462bbb6-0d60-494c-810d-d9434bcdaca7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:19.266652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b392c8-2164-4738-88ec-d5bcf56d0d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:19.267238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b392c8-2164-4738-88ec-d5bcf56d0d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:19.267515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b392c8-2164-4738-88ec-d5bcf56d0d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:19.267784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b392c8-2164-4738-88ec-d5bcf56d0d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:19.268410 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b392c8-2164-4738-88ec-d5bcf56d0d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:19.269981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b392c8-2164-4738-88ec-d5bcf56d0d76 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:19.280382 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4445/8844] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:54:19.285212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d08fe-92d5-4980-9d0d-ee3abd3e5273 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:19.295226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d08fe-92d5-4980-9d0d-ee3abd3e5273 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:19.301235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb24c5-abf6-49a0-9c68-fb6ee1cc88a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:19.301885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb24c5-abf6-49a0-9c68-fb6ee1cc88a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:19.302166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb24c5-abf6-49a0-9c68-fb6ee1cc88a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:19.302440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb24c5-abf6-49a0-9c68-fb6ee1cc88a6 admin admin] PATH_INFO: `/v3/projects/11b6f51d1d884a7d9e91bfb03a9c1e82/users/e5f6f6deb50b4e64997c5941ca38eda9/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:19.317166 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb24c5-abf6-49a0-9c68-fb6ee1cc88a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b6f51d1d884a7d9e91bfb03a9c1e82, user_id=e5f6f6deb50b4e64997c5941ca38eda9, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:19.319903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb24c5-abf6-49a0-9c68-fb6ee1cc88a6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:19.329079 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:19.333786 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4400/8845] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:54:19 2022] PUT /identity/v3/projects/11b6f51d1d884a7d9e91bfb03a9c1e82/users/e5f6f6deb50b4e64997c5941ca38eda9/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:54:19.339640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af33fd-76bf-45ea-ac64-c1c0635e25ea None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:19.339942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af33fd-76bf-45ea-ac64-c1c0635e25ea None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:19.340215 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af33fd-76bf-45ea-ac64-c1c0635e25ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:19.359251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-40af33fd-76bf-45ea-ac64-c1c0635e25ea None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:19.360432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-40af33fd-76bf-45ea-ac64-c1c0635e25ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:19.418160 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4446/8846] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:54:19.428178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb24c5-abf6-49a0-9c68-fb6ee1cc88a6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:19.429854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d2eb24c5-abf6-49a0-9c68-fb6ee1cc88a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:19.488984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb24c5-abf6-49a0-9c68-fb6ee1cc88a6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:19.492539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6f6ff-cd1c-496a-8c85-cb861d758c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:19.493143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f6ff-cd1c-496a-8c85-cb861d758c22 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:19.493425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f6ff-cd1c-496a-8c85-cb861d758c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:19.493698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f6ff-cd1c-496a-8c85-cb861d758c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:19.503117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6f6ff-cd1c-496a-8c85-cb861d758c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:19.504554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6f6ff-cd1c-496a-8c85-cb861d758c22 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:19.513811 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4401/8847] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:54:23.763195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf07c9f-641a-46fd-830d-2fa6f47ffe90 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:23.763707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf07c9f-641a-46fd-830d-2fa6f47ffe90 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:23.763707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf07c9f-641a-46fd-830d-2fa6f47ffe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:23.794466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fcf07c9f-641a-46fd-830d-2fa6f47ffe90 None None] MFA Rules not processed for user `e5f6f6deb50b4e64997c5941ca38eda9`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:23.795732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fcf07c9f-641a-46fd-830d-2fa6f47ffe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:23.878221 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4447/8848] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:54:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:54:23.890020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3117d-8ca5-4491-a473-46efe90cd0fb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:23.891159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3117d-8ca5-4491-a473-46efe90cd0fb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:23.891438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3117d-8ca5-4491-a473-46efe90cd0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:23.911975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-70b3117d-8ca5-4491-a473-46efe90cd0fb None None] MFA Rules not processed for user `e5f6f6deb50b4e64997c5941ca38eda9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:23.913207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70b3117d-8ca5-4491-a473-46efe90cd0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:23.920156 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4402/8849] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:54:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:54:23.935214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf07c9f-641a-46fd-830d-2fa6f47ffe90 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:23.937677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fcf07c9f-641a-46fd-830d-2fa6f47ffe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:24.005805 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:24.026076 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf07c9f-641a-46fd-830d-2fa6f47ffe90 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:24.031765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7852f8-4de6-47e7-87ef-8aa2ce8fc2a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:24.032374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7852f8-4de6-47e7-87ef-8aa2ce8fc2a6 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:24.032655 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7852f8-4de6-47e7-87ef-8aa2ce8fc2a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:24.032928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7852f8-4de6-47e7-87ef-8aa2ce8fc2a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:24.040688 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7852f8-4de6-47e7-87ef-8aa2ce8fc2a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:24.042271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7852f8-4de6-47e7-87ef-8aa2ce8fc2a6 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:24.051226 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4448/8850] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:54:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:54:33.905252 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=29 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:34.047316 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:34.251716 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3117d-8ca5-4491-a473-46efe90cd0fb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:34.253369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70b3117d-8ca5-4491-a473-46efe90cd0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:34.265388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3117d-8ca5-4491-a473-46efe90cd0fb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:34.268913 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832902-3bb2-4dd1-8c0c-f3c873878277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:34.269520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832902-3bb2-4dd1-8c0c-f3c873878277 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:34.269794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832902-3bb2-4dd1-8c0c-f3c873878277 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:34.270063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832902-3bb2-4dd1-8c0c-f3c873878277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:34.271818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ff832902-3bb2-4dd1-8c0c-f3c873878277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:34.284776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff832902-3bb2-4dd1-8c0c-f3c873878277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:34.286213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff832902-3bb2-4dd1-8c0c-f3c873878277 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:34.298099 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4403/8851] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:54:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:54:34.388505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830c91-ad68-4f38-aee1-ad8d4fa561d7 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:34.388811 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830c91-ad68-4f38-aee1-ad8d4fa561d7 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:34.389087 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830c91-ad68-4f38-aee1-ad8d4fa561d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:34.409351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bd830c91-ad68-4f38-aee1-ad8d4fa561d7 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:54:34.410534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bd830c91-ad68-4f38-aee1-ad8d4fa561d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:34.471850 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4449/8852] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:54:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:54:34.483415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832902-3bb2-4dd1-8c0c-f3c873878277 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:34.484974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ff832902-3bb2-4dd1-8c0c-f3c873878277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:34.502759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832902-3bb2-4dd1-8c0c-f3c873878277 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:34.507683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2f60c-2133-4b4a-afbe-6e57911dfe3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:34.508275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2f60c-2133-4b4a-afbe-6e57911dfe3e service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:34.508553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2f60c-2133-4b4a-afbe-6e57911dfe3e service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:34.508827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2f60c-2133-4b4a-afbe-6e57911dfe3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:34.519202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2f60c-2133-4b4a-afbe-6e57911dfe3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:34.520791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2f60c-2133-4b4a-afbe-6e57911dfe3e service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:34.530590 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4404/8853] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:54:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:54:34.719197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd830c91-ad68-4f38-aee1-ad8d4fa561d7 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:34.728621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd830c91-ad68-4f38-aee1-ad8d4fa561d7 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:34.732197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873021c-9105-477d-bb74-24285295fa72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:34.732794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873021c-9105-477d-bb74-24285295fa72 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:34.733079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873021c-9105-477d-bb74-24285295fa72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:34.733834 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873021c-9105-477d-bb74-24285295fa72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:34.735846 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e873021c-9105-477d-bb74-24285295fa72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:34.752800 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873021c-9105-477d-bb74-24285295fa72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:34.754265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873021c-9105-477d-bb74-24285295fa72 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:34.767958 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4450/8854] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:54:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:54:34.834440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2f60c-2133-4b4a-afbe-6e57911dfe3e service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:54:34.847637 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2f60c-2133-4b4a-afbe-6e57911dfe3e service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:54:34.852706 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad609281-f2da-476c-94ef-ccebffb56155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:54:34.853299 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad609281-f2da-476c-94ef-ccebffb56155 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:54:34.853582 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad609281-f2da-476c-94ef-ccebffb56155 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:54:34.853854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad609281-f2da-476c-94ef-ccebffb56155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:54:34.855606 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ad609281-f2da-476c-94ef-ccebffb56155 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:54:34.867602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad609281-f2da-476c-94ef-ccebffb56155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:54:34.869184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad609281-f2da-476c-94ef-ccebffb56155 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:54:34.879458 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4405/8855] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:54:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:54:44.760307 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=35 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:54:44.875612 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=18 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:05.159991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873021c-9105-477d-bb74-24285295fa72 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:05.161414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e873021c-9105-477d-bb74-24285295fa72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:55:05.177767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873021c-9105-477d-bb74-24285295fa72 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:05.182768 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c062c-0b9e-46ea-9fdc-3ef24dbc74f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:05.183361 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c062c-0b9e-46ea-9fdc-3ef24dbc74f3 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:05.183646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c062c-0b9e-46ea-9fdc-3ef24dbc74f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:05.183921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c062c-0b9e-46ea-9fdc-3ef24dbc74f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:05.185574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-801c062c-0b9e-46ea-9fdc-3ef24dbc74f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:55:05.200166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c062c-0b9e-46ea-9fdc-3ef24dbc74f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:05.201741 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c062c-0b9e-46ea-9fdc-3ef24dbc74f3 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:05.214834 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4451/8856] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:55:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:55:15.208180 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:17.178081 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad609281-f2da-476c-94ef-ccebffb56155 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:17.191431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad609281-f2da-476c-94ef-ccebffb56155 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:17.196058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0982b-2c2c-4a79-a978-3f48bef7ecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:17.196683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0982b-2c2c-4a79-a978-3f48bef7ecaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:17.196988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0982b-2c2c-4a79-a978-3f48bef7ecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:17.197256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0982b-2c2c-4a79-a978-3f48bef7ecaf admin admin] PATH_INFO: `/v3/users/e5f6f6deb50b4e64997c5941ca38eda9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:17.198361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0982b-2c2c-4a79-a978-3f48bef7ecaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f6f6deb50b4e64997c5941ca38eda9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:17.200334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0982b-2c2c-4a79-a978-3f48bef7ecaf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:17.246684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07e0982b-2c2c-4a79-a978-3f48bef7ecaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f6f6deb50b4e64997c5941ca38eda9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:55:17.259311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07e0982b-2c2c-4a79-a978-3f48bef7ecaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f6f6deb50b4e64997c5941ca38eda9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:55:17.260009 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07e0982b-2c2c-4a79-a978-3f48bef7ecaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f6f6deb50b4e64997c5941ca38eda9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:55:17.268404 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07e0982b-2c2c-4a79-a978-3f48bef7ecaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f6f6deb50b4e64997c5941ca38eda9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:55:17.275985 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07e0982b-2c2c-4a79-a978-3f48bef7ecaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f6f6deb50b4e64997c5941ca38eda9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:55:17.284296 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4406/8857] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:55:17 2022] DELETE /identity/v3/users/e5f6f6deb50b4e64997c5941ca38eda9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:55:17.462202 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c062c-0b9e-46ea-9fdc-3ef24dbc74f3 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:17.476093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c062c-0b9e-46ea-9fdc-3ef24dbc74f3 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:17.535220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:17.535854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:17.536137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:17.536411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] PATH_INFO: `/v3/projects/11b6f51d1d884a7d9e91bfb03a9c1e82` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:17.537552 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b6f51d1d884a7d9e91bfb03a9c1e82)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:17.539505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:17.587138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'request_id': 'req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:55:17.592817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'request_id': 'req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:55:17.599066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b6f51d1d884a7d9e91bfb03a9c1e82', 'request_id': 'req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:55:17.612132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] The token cache is being invalidate because project 11b6f51d1d884a7d9e91bfb03a9c1e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:55:17.612421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:55:17.613047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-457d3cc6-fef7-4a00-bb1d-252ebdbc997f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:55:17.614511 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4452/8858] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:55:17 2022] DELETE /identity/v3/projects/11b6f51d1d884a7d9e91bfb03a9c1e82 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 01:55:17.619682 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ec3df-1a74-40db-9670-0cd320c30ae3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:17.619971 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ec3df-1a74-40db-9670-0cd320c30ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:17.620247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ec3df-1a74-40db-9670-0cd320c30ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:17.640786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-455ec3df-1a74-40db-9670-0cd320c30ae3 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:55:17.641977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-455ec3df-1a74-40db-9670-0cd320c30ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:55:17.701157 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4407/8859] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:55:17.709192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caccb1-d29d-4c0a-9397-f8fecfbc26b5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:17.709482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caccb1-d29d-4c0a-9397-f8fecfbc26b5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:17.709758 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caccb1-d29d-4c0a-9397-f8fecfbc26b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:17.731066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e0caccb1-d29d-4c0a-9397-f8fecfbc26b5 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:55:17.732611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e0caccb1-d29d-4c0a-9397-f8fecfbc26b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:55:17.741229 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4453/8860] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:55:17.746019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ec3df-1a74-40db-9670-0cd320c30ae3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:17.756251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ec3df-1a74-40db-9670-0cd320c30ae3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:17.760872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6ca93-3992-4245-96b1-e3d7c74b35b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:17.761469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6ca93-3992-4245-96b1-e3d7c74b35b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:17.761744 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6ca93-3992-4245-96b1-e3d7c74b35b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:17.762018 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6ca93-3992-4245-96b1-e3d7c74b35b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:17.762720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6ca93-3992-4245-96b1-e3d7c74b35b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:55:17.763019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6ca93-3992-4245-96b1-e3d7c74b35b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:17.764617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6ca93-3992-4245-96b1-e3d7c74b35b6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:17.776276 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4408/8861] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:55:17.781326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caccb1-d29d-4c0a-9397-f8fecfbc26b5 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:17.790730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caccb1-d29d-4c0a-9397-f8fecfbc26b5 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:17.795417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4117ee-44ae-47d5-adb3-a674c5a96dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:17.796009 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4117ee-44ae-47d5-adb3-a674c5a96dfd admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:17.796896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4117ee-44ae-47d5-adb3-a674c5a96dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:17.797212 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4117ee-44ae-47d5-adb3-a674c5a96dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:17.797939 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4117ee-44ae-47d5-adb3-a674c5a96dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:17.799887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4117ee-44ae-47d5-adb3-a674c5a96dfd admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:17.830041 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4454/8862] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:55:17 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:55:17.834372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6ca93-3992-4245-96b1-e3d7c74b35b6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:17.845218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6ca93-3992-4245-96b1-e3d7c74b35b6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:17.899181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119349e4-f428-4f30-801f-8548e092655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:17.899785 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119349e4-f428-4f30-801f-8548e092655b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:17.900064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119349e4-f428-4f30-801f-8548e092655b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:17.900337 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119349e4-f428-4f30-801f-8548e092655b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:17.900964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119349e4-f428-4f30-801f-8548e092655b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:17.902903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119349e4-f428-4f30-801f-8548e092655b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:17.911253 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:17.925758 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4409/8863] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:55:17 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:55:17.930103 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4117ee-44ae-47d5-adb3-a674c5a96dfd admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:17.940639 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4117ee-44ae-47d5-adb3-a674c5a96dfd admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:17.945563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d049b6-c157-485f-a078-ad64d4185fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:17.946154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d049b6-c157-485f-a078-ad64d4185fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:17.946435 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d049b6-c157-485f-a078-ad64d4185fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:17.946746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d049b6-c157-485f-a078-ad64d4185fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:17.947390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d049b6-c157-485f-a078-ad64d4185fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:17.949260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d049b6-c157-485f-a078-ad64d4185fe4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:17.962138 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4455/8864] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:55:17.963444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119349e4-f428-4f30-801f-8548e092655b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:17.974170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119349e4-f428-4f30-801f-8548e092655b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:17.978915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e5a63-5478-4d8e-8464-5d37955bdc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:17.979518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e5a63-5478-4d8e-8464-5d37955bdc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:17.979804 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e5a63-5478-4d8e-8464-5d37955bdc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:17.980083 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e5a63-5478-4d8e-8464-5d37955bdc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:17.980760 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e5a63-5478-4d8e-8464-5d37955bdc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:17.982372 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e5a63-5478-4d8e-8464-5d37955bdc69 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:17.993389 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4410/8865] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:55:17.997638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d049b6-c157-485f-a078-ad64d4185fe4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:18.008504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d049b6-c157-485f-a078-ad64d4185fe4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:18.013188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc562-a1d8-486e-9476-9acdd58c0521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:18.013831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc562-a1d8-486e-9476-9acdd58c0521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:18.014110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc562-a1d8-486e-9476-9acdd58c0521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:18.014386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc562-a1d8-486e-9476-9acdd58c0521 admin admin] PATH_INFO: `/v3/projects/25d936be31b84687b0f3179a6a06e869/users/63e6d9193514415799794e8bc1c8739d/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:18.039371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc562-a1d8-486e-9476-9acdd58c0521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d936be31b84687b0f3179a6a06e869, user_id=63e6d9193514415799794e8bc1c8739d, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:18.042095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc562-a1d8-486e-9476-9acdd58c0521 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:18.055532 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4456/8866] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:55:17 2022] PUT /identity/v3/projects/25d936be31b84687b0f3179a6a06e869/users/63e6d9193514415799794e8bc1c8739d/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:55:18.060658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7484621-c5b9-4464-b40b-10d59c78f2ef None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:18.060950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7484621-c5b9-4464-b40b-10d59c78f2ef None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:18.061233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7484621-c5b9-4464-b40b-10d59c78f2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:18.082443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c7484621-c5b9-4464-b40b-10d59c78f2ef None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:55:18.083697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7484621-c5b9-4464-b40b-10d59c78f2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:55:18.142536 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4411/8867] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:55:18.152188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc562-a1d8-486e-9476-9acdd58c0521 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:18.153914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2e5dc562-a1d8-486e-9476-9acdd58c0521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:55:18.184941 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:18.215070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc562-a1d8-486e-9476-9acdd58c0521 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:18.218798 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed55e5e-2e8c-43a6-b159-fbfe1b09a0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:18.219405 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55e5e-2e8c-43a6-b159-fbfe1b09a0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:18.219686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55e5e-2e8c-43a6-b159-fbfe1b09a0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:18.219959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55e5e-2e8c-43a6-b159-fbfe1b09a0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:18.228848 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed55e5e-2e8c-43a6-b159-fbfe1b09a0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:18.230280 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed55e5e-2e8c-43a6-b159-fbfe1b09a0e7 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:18.240188 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4457/8868] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:55:22.297340 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35622-234a-44b5-b045-6bb61dc05728 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:22.297817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35622-234a-44b5-b045-6bb61dc05728 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:22.297906 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35622-234a-44b5-b045-6bb61dc05728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:22.331184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e8c35622-234a-44b5-b045-6bb61dc05728 None None] MFA Rules not processed for user `63e6d9193514415799794e8bc1c8739d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:55:22.332426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e8c35622-234a-44b5-b045-6bb61dc05728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:55:22.414837 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4412/8869] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:55:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:55:22.426010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bb123-cabb-41fe-a447-c74e4cda5dba None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:22.426518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bb123-cabb-41fe-a447-c74e4cda5dba None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:22.426659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bb123-cabb-41fe-a447-c74e4cda5dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:22.450116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8f7bb123-cabb-41fe-a447-c74e4cda5dba None None] MFA Rules not processed for user `63e6d9193514415799794e8bc1c8739d`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:55:22.451375 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8f7bb123-cabb-41fe-a447-c74e4cda5dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:55:22.459489 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4458/8870] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:55:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:55:22.471910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c35622-234a-44b5-b045-6bb61dc05728 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:22.473341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e8c35622-234a-44b5-b045-6bb61dc05728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:55:22.553490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c35622-234a-44b5-b045-6bb61dc05728 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:22.559155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4314f4b-c75b-4376-b36c-cd9b70e767c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:22.559789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314f4b-c75b-4376-b36c-cd9b70e767c8 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:22.560070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314f4b-c75b-4376-b36c-cd9b70e767c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:22.560343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314f4b-c75b-4376-b36c-cd9b70e767c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:22.566278 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:22.571889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4314f4b-c75b-4376-b36c-cd9b70e767c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:22.573737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4314f4b-c75b-4376-b36c-cd9b70e767c8 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:22.585389 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4413/8871] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:55:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:55:23.210445 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bb123-cabb-41fe-a447-c74e4cda5dba None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:55:23.212058 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8f7bb123-cabb-41fe-a447-c74e4cda5dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:55:23.304728 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bb123-cabb-41fe-a447-c74e4cda5dba None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:55:23.310550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606790c-adaa-4bdb-b7c9-db26a1a03ecf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:55:23.311203 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606790c-adaa-4bdb-b7c9-db26a1a03ecf service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:55:23.311484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606790c-adaa-4bdb-b7c9-db26a1a03ecf service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:55:23.312296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606790c-adaa-4bdb-b7c9-db26a1a03ecf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:55:23.314148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a606790c-adaa-4bdb-b7c9-db26a1a03ecf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:55:23.330015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606790c-adaa-4bdb-b7c9-db26a1a03ecf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:55:23.331669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606790c-adaa-4bdb-b7c9-db26a1a03ecf service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:55:23.343195 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4459/8872] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:55:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:55:32.580131 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:55:33.337872 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=49 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:17.444269 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c756f-72fa-40bf-9121-acfbf70f210e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:56:17.444829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c756f-72fa-40bf-9121-acfbf70f210e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:56:17.444829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c756f-72fa-40bf-9121-acfbf70f210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:56:17.465625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fc6c756f-72fa-40bf-9121-acfbf70f210e None None] MFA Rules not processed for user `63e6d9193514415799794e8bc1c8739d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:56:17.466881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fc6c756f-72fa-40bf-9121-acfbf70f210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:56:17.474760 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4414/8873] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:56:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:56:18.557615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430b052-a9df-4070-8ae1-4db87b2c30bb None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:56:18.558157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430b052-a9df-4070-8ae1-4db87b2c30bb None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:56:18.558157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430b052-a9df-4070-8ae1-4db87b2c30bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:56:18.578252 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0430b052-a9df-4070-8ae1-4db87b2c30bb None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:56:18.580161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0430b052-a9df-4070-8ae1-4db87b2c30bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:56:18.588489 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4460/8874] 10.222.0.13 () {58 vars in 1015 bytes} [Sun Oct 2 01:56:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:56:18.652973 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c756f-72fa-40bf-9121-acfbf70f210e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:56:18.667276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c756f-72fa-40bf-9121-acfbf70f210e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:56:18.672072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd933d1-59f8-4ce9-bdb4-5faac894f6a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:56:18.672686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd933d1-59f8-4ce9-bdb4-5faac894f6a1 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:56:18.672962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd933d1-59f8-4ce9-bdb4-5faac894f6a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:56:18.673233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd933d1-59f8-4ce9-bdb4-5faac894f6a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:56:18.681249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd933d1-59f8-4ce9-bdb4-5faac894f6a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:56:18.682851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd933d1-59f8-4ce9-bdb4-5faac894f6a1 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:56:18.693509 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4415/8875] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:56:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:56:28.573466 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:28.688475 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=9 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:31.195226 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b870c7-e38b-4a83-a481-14dca54f85a3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:56:31.195795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b870c7-e38b-4a83-a481-14dca54f85a3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:56:31.195795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b870c7-e38b-4a83-a481-14dca54f85a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:56:31.215313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-96b870c7-e38b-4a83-a481-14dca54f85a3 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:56:31.216509 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-96b870c7-e38b-4a83-a481-14dca54f85a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:56:31.224958 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4461/8876] 10.222.0.40 () {58 vars in 1015 bytes} [Sun Oct 2 01:56:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:56:31.236960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34407ac9-af77-403d-84c4-ab5fe7f0ecac None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:56:31.237708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34407ac9-af77-403d-84c4-ab5fe7f0ecac None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:56:31.237708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34407ac9-af77-403d-84c4-ab5fe7f0ecac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:56:31.257285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-34407ac9-af77-403d-84c4-ab5fe7f0ecac None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:56:31.258505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-34407ac9-af77-403d-84c4-ab5fe7f0ecac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:56:31.267243 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4416/8877] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 2 01:56:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:56:31.273917 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b870c7-e38b-4a83-a481-14dca54f85a3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:56:31.284134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b870c7-e38b-4a83-a481-14dca54f85a3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:56:31.289711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b66fb-b6fb-4d4f-8e86-04af55765acd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:56:31.290304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b66fb-b6fb-4d4f-8e86-04af55765acd service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:56:31.290583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b66fb-b6fb-4d4f-8e86-04af55765acd service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:56:31.290891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b66fb-b6fb-4d4f-8e86-04af55765acd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:56:31.299033 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b66fb-b6fb-4d4f-8e86-04af55765acd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:56:31.300745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b66fb-b6fb-4d4f-8e86-04af55765acd service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:56:31.314812 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4462/8878] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:56:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:56:41.251716 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:56:41.308495 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=9 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:57:12.107215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34407ac9-af77-403d-84c4-ab5fe7f0ecac None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:57:12.125204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34407ac9-af77-403d-84c4-ab5fe7f0ecac None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:57:12.130776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dcd9d-24e8-4a48-bb2d-327deb58d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:57:12.131417 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dcd9d-24e8-4a48-bb2d-327deb58d6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:12.131697 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dcd9d-24e8-4a48-bb2d-327deb58d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:12.131964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dcd9d-24e8-4a48-bb2d-327deb58d6d3 admin admin] PATH_INFO: `/v3/users/63e6d9193514415799794e8bc1c8739d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:12.133261 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1dcd9d-24e8-4a48-bb2d-327deb58d6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e6d9193514415799794e8bc1c8739d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:57:12.135301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1dcd9d-24e8-4a48-bb2d-327deb58d6d3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:57:12.186999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd1dcd9d-24e8-4a48-bb2d-327deb58d6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e6d9193514415799794e8bc1c8739d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:57:12.201000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd1dcd9d-24e8-4a48-bb2d-327deb58d6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e6d9193514415799794e8bc1c8739d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:57:12.201849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd1dcd9d-24e8-4a48-bb2d-327deb58d6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e6d9193514415799794e8bc1c8739d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:57:12.210814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd1dcd9d-24e8-4a48-bb2d-327deb58d6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e6d9193514415799794e8bc1c8739d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:57:12.218738 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fd1dcd9d-24e8-4a48-bb2d-327deb58d6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e6d9193514415799794e8bc1c8739d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:57:12.225514 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4417/8879] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 01:57:12 2022] DELETE /identity/v3/users/63e6d9193514415799794e8bc1c8739d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:57:12.411973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b66fb-b6fb-4d4f-8e86-04af55765acd service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:57:12.427612 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b66fb-b6fb-4d4f-8e86-04af55765acd service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:57:12.484977 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:57:12.485532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:12.485813 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:12.486791 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] PATH_INFO: `/v3/projects/25d936be31b84687b0f3179a6a06e869` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:12.487992 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d936be31b84687b0f3179a6a06e869)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:57:12.489902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:57:12.536850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d936be31b84687b0f3179a6a06e869', 'request_id': 'req-c5c0dae8-6e7c-41de-8646-e9106a007502'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:57:12.542484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d936be31b84687b0f3179a6a06e869', 'request_id': 'req-c5c0dae8-6e7c-41de-8646-e9106a007502'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:57:12.548464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d936be31b84687b0f3179a6a06e869', 'request_id': 'req-c5c0dae8-6e7c-41de-8646-e9106a007502'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:57:12.563531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] The token cache is being invalidate because project 25d936be31b84687b0f3179a6a06e869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 01:57:12.563807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:57:12.565756 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c5c0dae8-6e7c-41de-8646-e9106a007502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 01:57:12.567324 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4463/8880] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 01:57:12 2022] DELETE /identity/v3/projects/25d936be31b84687b0f3179a6a06e869 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:57:12.572276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3218a-4c5d-4836-a107-452061576a18 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:12.572565 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3218a-4c5d-4836-a107-452061576a18 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:12.572843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3218a-4c5d-4836-a107-452061576a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:12.592291 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-79d3218a-4c5d-4836-a107-452061576a18 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:57:12.593491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79d3218a-4c5d-4836-a107-452061576a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:57:12.653027 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4418/8881] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:57:12.662041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226bb73-2250-4e2a-9800-f138a4e2211a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:12.662358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226bb73-2250-4e2a-9800-f138a4e2211a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:12.662705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226bb73-2250-4e2a-9800-f138a4e2211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:12.682669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1226bb73-2250-4e2a-9800-f138a4e2211a None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:57:12.683870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1226bb73-2250-4e2a-9800-f138a4e2211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:57:12.692650 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4464/8882] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:57:12.696957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3218a-4c5d-4836-a107-452061576a18 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:57:12.708478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3218a-4c5d-4836-a107-452061576a18 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:57:12.713494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be7098-1ecc-4596-9704-c84d993b645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:57:12.714107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be7098-1ecc-4596-9704-c84d993b645c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:12.714382 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be7098-1ecc-4596-9704-c84d993b645c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:12.714683 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be7098-1ecc-4596-9704-c84d993b645c admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:12.715325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be7098-1ecc-4596-9704-c84d993b645c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 01:57:12.715625 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be7098-1ecc-4596-9704-c84d993b645c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:57:12.717354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be7098-1ecc-4596-9704-c84d993b645c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:57:12.733788 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4419/8883] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 01:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 01:57:12.739120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226bb73-2250-4e2a-9800-f138a4e2211a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:57:12.748881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226bb73-2250-4e2a-9800-f138a4e2211a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:57:12.754359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49062905-d32f-450f-a626-a70e3f611053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:57:12.754999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49062905-d32f-450f-a626-a70e3f611053 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:12.755279 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49062905-d32f-450f-a626-a70e3f611053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:12.755548 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49062905-d32f-450f-a626-a70e3f611053 admin admin] PATH_INFO: `/v3/projects` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:12.756204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49062905-d32f-450f-a626-a70e3f611053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:57:12.758299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49062905-d32f-450f-a626-a70e3f611053 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:57:12.788202 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4465/8884] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 01:57:12 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:57:12.792430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be7098-1ecc-4596-9704-c84d993b645c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:57:12.803306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be7098-1ecc-4596-9704-c84d993b645c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:57:12.859411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a633f-501b-4813-8b64-937a8ed885ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:57:12.860020 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a633f-501b-4813-8b64-937a8ed885ba admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:12.860304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a633f-501b-4813-8b64-937a8ed885ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:12.860579 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a633f-501b-4813-8b64-937a8ed885ba admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:12.861810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a633f-501b-4813-8b64-937a8ed885ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:57:12.863775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a633f-501b-4813-8b64-937a8ed885ba admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:57:12.871754 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:57:12.887365 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4420/8885] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 01:57:12 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 01:57:12.891579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49062905-d32f-450f-a626-a70e3f611053 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:57:12.901994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49062905-d32f-450f-a626-a70e3f611053 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:57:12.906627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70099402-8522-4dfc-9d23-2d3cefd7e227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:57:12.907173 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099402-8522-4dfc-9d23-2d3cefd7e227 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:12.907450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099402-8522-4dfc-9d23-2d3cefd7e227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:12.907721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099402-8522-4dfc-9d23-2d3cefd7e227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:12.908947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70099402-8522-4dfc-9d23-2d3cefd7e227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:57:12.910524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70099402-8522-4dfc-9d23-2d3cefd7e227 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:57:12.920315 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4466/8886] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:57:12.925433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a633f-501b-4813-8b64-937a8ed885ba admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:57:12.935475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a633f-501b-4813-8b64-937a8ed885ba admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:57:12.940528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb3b4e-fbe5-45b1-8059-85576891e1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:57:12.941130 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3b4e-fbe5-45b1-8059-85576891e1ba admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:12.941414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3b4e-fbe5-45b1-8059-85576891e1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:12.941691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3b4e-fbe5-45b1-8059-85576891e1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:12.942336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb3b4e-fbe5-45b1-8059-85576891e1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:57:12.943988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb3b4e-fbe5-45b1-8059-85576891e1ba admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:57:12.954674 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4421/8887] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 01:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 01:57:12.959134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70099402-8522-4dfc-9d23-2d3cefd7e227 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:57:12.969412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70099402-8522-4dfc-9d23-2d3cefd7e227 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:57:12.974674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e87700-5da4-4fd9-9c51-5da85c0554ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:57:12.975333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e87700-5da4-4fd9-9c51-5da85c0554ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:12.975633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e87700-5da4-4fd9-9c51-5da85c0554ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:12.975902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e87700-5da4-4fd9-9c51-5da85c0554ac admin admin] PATH_INFO: `/v3/projects/0ea3f726ac484294b995890cfa5b0533/users/2429d94874654da69f134916b5659877/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:12.991204 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e87700-5da4-4fd9-9c51-5da85c0554ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea3f726ac484294b995890cfa5b0533, user_id=2429d94874654da69f134916b5659877, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:57:12.993986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e87700-5da4-4fd9-9c51-5da85c0554ac admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:57:13.006607 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4467/8888] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 01:57:12 2022] PUT /identity/v3/projects/0ea3f726ac484294b995890cfa5b0533/users/2429d94874654da69f134916b5659877/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 01:57:13.011756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87837-ab50-4cf6-8b85-7bc55aff48f2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:13.012043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87837-ab50-4cf6-8b85-7bc55aff48f2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:13.012319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87837-ab50-4cf6-8b85-7bc55aff48f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:13.031630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d2e87837-ab50-4cf6-8b85-7bc55aff48f2 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:57:13.033711 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d2e87837-ab50-4cf6-8b85-7bc55aff48f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:57:13.112687 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4422/8889] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:57:13.122516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e87700-5da4-4fd9-9c51-5da85c0554ac admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:57:13.124255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a3e87700-5da4-4fd9-9c51-5da85c0554ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:57:13.156506 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:57:13.186523 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e87700-5da4-4fd9-9c51-5da85c0554ac admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:57:13.191395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e64012-ec9f-4e80-8249-611d3d2a334f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:57:13.192003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e64012-ec9f-4e80-8249-611d3d2a334f service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:13.192287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e64012-ec9f-4e80-8249-611d3d2a334f service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:13.192563 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e64012-ec9f-4e80-8249-611d3d2a334f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:13.201945 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e64012-ec9f-4e80-8249-611d3d2a334f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:57:13.203849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e64012-ec9f-4e80-8249-611d3d2a334f service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:57:13.214782 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4468/8890] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:57:17.512745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c096b-c68b-4698-8036-3ee9fd04b98c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:17.513223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c096b-c68b-4698-8036-3ee9fd04b98c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:17.513887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c096b-c68b-4698-8036-3ee9fd04b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:17.546312 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-197c096b-c68b-4698-8036-3ee9fd04b98c None None] MFA Rules not processed for user `2429d94874654da69f134916b5659877`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:57:17.547570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-197c096b-c68b-4698-8036-3ee9fd04b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:57:17.623694 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4423/8891] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:57:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:57:17.639727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e64012-ec9f-4e80-8249-611d3d2a334f service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:57:17.641143 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a9e64012-ec9f-4e80-8249-611d3d2a334f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:57:17.726154 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e64012-ec9f-4e80-8249-611d3d2a334f service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:57:17.734890 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d995d-a760-475d-90eb-4457cdb1708d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:57:17.735503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d995d-a760-475d-90eb-4457cdb1708d service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:17.736479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d995d-a760-475d-90eb-4457cdb1708d service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:17.737096 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d995d-a760-475d-90eb-4457cdb1708d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:17.746342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d995d-a760-475d-90eb-4457cdb1708d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:57:17.748306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d995d-a760-475d-90eb-4457cdb1708d service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:57:17.759326 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4469/8892] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:57:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:57:19.062806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae983d-4115-4957-8141-e9d66a82610c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:57:19.063315 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae983d-4115-4957-8141-e9d66a82610c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:57:19.063398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae983d-4115-4957-8141-e9d66a82610c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:57:19.083860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-17ae983d-4115-4957-8141-e9d66a82610c None None] MFA Rules not processed for user `2429d94874654da69f134916b5659877`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:57:19.085098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-17ae983d-4115-4957-8141-e9d66a82610c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:57:19.092588 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4424/8893] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:57:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:57:27.754319 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=48 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:57:29.078317 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:58:04.691458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d995d-a760-475d-90eb-4457cdb1708d service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:58:04.692912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1d0d995d-a760-475d-90eb-4457cdb1708d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:04.705668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d995d-a760-475d-90eb-4457cdb1708d service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:58:04.709230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65202b-4204-48e0-a725-9775e0b2eb2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:58:04.709821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65202b-4204-48e0-a725-9775e0b2eb2f service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:04.710099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65202b-4204-48e0-a725-9775e0b2eb2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:04.710372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65202b-4204-48e0-a725-9775e0b2eb2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:04.712080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9c65202b-4204-48e0-a725-9775e0b2eb2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:04.727628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65202b-4204-48e0-a725-9775e0b2eb2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:58:04.729051 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65202b-4204-48e0-a725-9775e0b2eb2f service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:58:04.742704 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4470/8894] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:58:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:58:06.627750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae983d-4115-4957-8141-e9d66a82610c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:58:06.637661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae983d-4115-4957-8141-e9d66a82610c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:58:06.641221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a452e34-bc60-4990-988b-c6c6ade566c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:58:06.641852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452e34-bc60-4990-988b-c6c6ade566c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:06.643627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452e34-bc60-4990-988b-c6c6ade566c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:06.643902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452e34-bc60-4990-988b-c6c6ade566c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:06.645635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4a452e34-bc60-4990-988b-c6c6ade566c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:06.658564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a452e34-bc60-4990-988b-c6c6ade566c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:58:06.660334 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a452e34-bc60-4990-988b-c6c6ade566c7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:58:06.671437 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4425/8895] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:58:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:58:14.735006 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:58:16.665082 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:58:19.271844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65202b-4204-48e0-a725-9775e0b2eb2f service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:58:19.280338 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65202b-4204-48e0-a725-9775e0b2eb2f service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:58:19.284694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ce41-c6a9-4670-bcf6-a0c4744cd4cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:58:19.285293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ce41-c6a9-4670-bcf6-a0c4744cd4cc service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:19.285586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ce41-c6a9-4670-bcf6-a0c4744cd4cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:19.285854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ce41-c6a9-4670-bcf6-a0c4744cd4cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:19.287607 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1e05ce41-c6a9-4670-bcf6-a0c4744cd4cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:19.300167 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05ce41-c6a9-4670-bcf6-a0c4744cd4cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:58:19.301583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05ce41-c6a9-4670-bcf6-a0c4744cd4cc service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:58:19.311868 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4471/8896] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:58:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:58:19.809612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a452e34-bc60-4990-988b-c6c6ade566c7 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:58:19.827339 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a452e34-bc60-4990-988b-c6c6ade566c7 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:58:19.834556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf89d5-900d-4f8a-8430-b0111d8cf017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:58:19.835197 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf89d5-900d-4f8a-8430-b0111d8cf017 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:19.835480 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf89d5-900d-4f8a-8430-b0111d8cf017 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:19.835757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf89d5-900d-4f8a-8430-b0111d8cf017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:19.837566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-03bf89d5-900d-4f8a-8430-b0111d8cf017 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:19.854019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf89d5-900d-4f8a-8430-b0111d8cf017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:58:19.855770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf89d5-900d-4f8a-8430-b0111d8cf017 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:58:19.870382 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4426/8897] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:58:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:58:22.024254 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e3df4-5f64-407d-9bb8-86030355116b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:22.024840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e3df4-5f64-407d-9bb8-86030355116b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:22.024972 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e3df4-5f64-407d-9bb8-86030355116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:22.063835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-903e3df4-5f64-407d-9bb8-86030355116b None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:58:22.065110 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-903e3df4-5f64-407d-9bb8-86030355116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:22.074691 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4472/8898] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 2 01:58:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:58:28.868691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc5ea-4bf9-4476-9fdd-eb3d8bc94f09 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:28.869259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc5ea-4bf9-4476-9fdd-eb3d8bc94f09 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:28.869259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc5ea-4bf9-4476-9fdd-eb3d8bc94f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:28.901598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b96dc5ea-4bf9-4476-9fdd-eb3d8bc94f09 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:58:28.902911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b96dc5ea-4bf9-4476-9fdd-eb3d8bc94f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:28.934489 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4427/8899] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:58:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:58:28.946128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e3df4-5f64-407d-9bb8-86030355116b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:58:28.955426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e3df4-5f64-407d-9bb8-86030355116b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:58:28.959287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4944ac-1aa4-4147-99aa-e1a0e091a99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:58:28.959896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4944ac-1aa4-4147-99aa-e1a0e091a99c service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:28.960177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4944ac-1aa4-4147-99aa-e1a0e091a99c service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:28.960452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4944ac-1aa4-4147-99aa-e1a0e091a99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:28.970827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4944ac-1aa4-4147-99aa-e1a0e091a99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:58:28.973030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4944ac-1aa4-4147-99aa-e1a0e091a99c service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:58:28.984330 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4473/8900] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:58:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:58:31.332089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194068c-43cf-45e6-9e12-f3167500b62d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:31.332665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194068c-43cf-45e6-9e12-f3167500b62d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:31.332665 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194068c-43cf-45e6-9e12-f3167500b62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:31.357072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6194068c-43cf-45e6-9e12-f3167500b62d None None] MFA Rules not processed for user `2429d94874654da69f134916b5659877`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:58:31.358678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6194068c-43cf-45e6-9e12-f3167500b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:31.367061 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4428/8901] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:58:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:58:31.683390 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4944ac-1aa4-4147-99aa-e1a0e091a99c service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:58:31.692730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4944ac-1aa4-4147-99aa-e1a0e091a99c service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:58:31.696258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497417b-3bf5-456c-b379-b3e622e0738f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:58:31.696843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497417b-3bf5-456c-b379-b3e622e0738f service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:31.697122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497417b-3bf5-456c-b379-b3e622e0738f service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:31.697394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497417b-3bf5-456c-b379-b3e622e0738f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:31.699109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e497417b-3bf5-456c-b379-b3e622e0738f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:31.711041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497417b-3bf5-456c-b379-b3e622e0738f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:58:31.712443 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497417b-3bf5-456c-b379-b3e622e0738f service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:58:31.722955 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4474/8902] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:58:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:58:34.179221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff270535-f719-4c35-b440-6f028bab2ff1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:34.179790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff270535-f719-4c35-b440-6f028bab2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:34.179790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff270535-f719-4c35-b440-6f028bab2ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:34.200607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ff270535-f719-4c35-b440-6f028bab2ff1 None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:58:34.201834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ff270535-f719-4c35-b440-6f028bab2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:34.209814 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4429/8903] 10.222.0.40 () {58 vars in 1015 bytes} [Sun Oct 2 01:58:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:58:34.222134 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497417b-3bf5-456c-b379-b3e622e0738f service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:58:34.231301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497417b-3bf5-456c-b379-b3e622e0738f service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:58:34.235249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd32f2-6ac3-4727-978d-b8d5a7e0f79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:58:34.235851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd32f2-6ac3-4727-978d-b8d5a7e0f79e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:34.236136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd32f2-6ac3-4727-978d-b8d5a7e0f79e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:34.236413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd32f2-6ac3-4727-978d-b8d5a7e0f79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:34.244934 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd32f2-6ac3-4727-978d-b8d5a7e0f79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:58:34.246363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd32f2-6ac3-4727-978d-b8d5a7e0f79e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:58:34.264512 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4475/8904] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:58:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:58:34.906377 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff270535-f719-4c35-b440-6f028bab2ff1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:58:34.921699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff270535-f719-4c35-b440-6f028bab2ff1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:58:34.927807 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaf757-d37f-4fce-9129-40ceb40467b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:58:34.928416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaf757-d37f-4fce-9129-40ceb40467b4 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:34.928692 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaf757-d37f-4fce-9129-40ceb40467b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:34.928963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaf757-d37f-4fce-9129-40ceb40467b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:34.930719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45eaf757-d37f-4fce-9129-40ceb40467b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:34.946861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eaf757-d37f-4fce-9129-40ceb40467b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:58:34.948485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eaf757-d37f-4fce-9129-40ceb40467b4 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:58:34.970664 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4430/8905] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:58:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:58:42.476856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664d5c-aabf-4c6f-9505-3996bddf51f6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:42.477428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664d5c-aabf-4c6f-9505-3996bddf51f6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:42.477428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664d5c-aabf-4c6f-9505-3996bddf51f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:42.497424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-9c664d5c-aabf-4c6f-9505-3996bddf51f6 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:58:42.498658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-9c664d5c-aabf-4c6f-9505-3996bddf51f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:58:42.508126 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4476/8906] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:58:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:58:42.523883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaf757-d37f-4fce-9129-40ceb40467b4 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:58:42.535368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaf757-d37f-4fce-9129-40ceb40467b4 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:58:42.540858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f9d49-1ddf-436b-94fb-421051bc7a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:58:42.541459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9d49-1ddf-436b-94fb-421051bc7a48 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:58:42.541739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9d49-1ddf-436b-94fb-421051bc7a48 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:58:42.542007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9d49-1ddf-436b-94fb-421051bc7a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:58:42.551098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f9d49-1ddf-436b-94fb-421051bc7a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:58:42.552679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f9d49-1ddf-436b-94fb-421051bc7a48 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:58:42.563022 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4431/8907] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:58:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:58:52.492521 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=36 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:58:52.558735 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=40 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:59:36.354875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2631f9-e241-4f8c-b43f-944a029847e5 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:59:36.355477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2631f9-e241-4f8c-b43f-944a029847e5 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:59:36.355477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2631f9-e241-4f8c-b43f-944a029847e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:59:36.414122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0c2631f9-e241-4f8c-b43f-944a029847e5 None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:59:36.415363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0c2631f9-e241-4f8c-b43f-944a029847e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:59:36.440640 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4477/8908] 10.222.0.13 () {58 vars in 1015 bytes} [Sun Oct 2 01:59:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:59:36.452221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f9d49-1ddf-436b-94fb-421051bc7a48 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:59:36.470966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f9d49-1ddf-436b-94fb-421051bc7a48 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:59:36.474484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8b75b-66c1-4dca-a384-509c8378ef8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:59:36.475662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b75b-66c1-4dca-a384-509c8378ef8c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:59:36.475920 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b75b-66c1-4dca-a384-509c8378ef8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:59:36.476189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b75b-66c1-4dca-a384-509c8378ef8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:59:36.483080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8b75b-66c1-4dca-a384-509c8378ef8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:59:36.484506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8b75b-66c1-4dca-a384-509c8378ef8c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:59:36.492714 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4432/8909] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:59:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 01:59:42.907923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e3db4-c5c8-496a-829a-03cc107e21c9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:59:42.908879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e3db4-c5c8-496a-829a-03cc107e21c9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:59:42.909357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e3db4-c5c8-496a-829a-03cc107e21c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:59:42.936276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6f0e3db4-c5c8-496a-829a-03cc107e21c9 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:59:42.937693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6f0e3db4-c5c8-496a-829a-03cc107e21c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:59:42.951967 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4478/8910] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:59:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:59:42.979573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8b75b-66c1-4dca-a384-509c8378ef8c service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:59:42.996598 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8b75b-66c1-4dca-a384-509c8378ef8c service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:59:43.002285 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b16225-a3da-4834-848a-7addf41735d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:59:43.002942 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b16225-a3da-4834-848a-7addf41735d8 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:59:43.003228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b16225-a3da-4834-848a-7addf41735d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:59:43.003505 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b16225-a3da-4834-848a-7addf41735d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:59:43.013239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b16225-a3da-4834-848a-7addf41735d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:59:43.014928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b16225-a3da-4834-848a-7addf41735d8 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:59:43.025919 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4433/8911] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:59:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:59:48.227989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0097fc-c064-4e74-94b8-5621bb5ee1a4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:59:48.228540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0097fc-c064-4e74-94b8-5621bb5ee1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:59:48.228540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0097fc-c064-4e74-94b8-5621bb5ee1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:59:48.247998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-fb0097fc-c064-4e74-94b8-5621bb5ee1a4 None None] MFA Rules not processed for user `2429d94874654da69f134916b5659877`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:59:48.249111 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fb0097fc-c064-4e74-94b8-5621bb5ee1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:59:48.255788 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4479/8912] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 01:59:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:59:48.559616 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373af6ad-e734-4729-8d0a-8e5d3c17da34 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:59:48.560167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373af6ad-e734-4729-8d0a-8e5d3c17da34 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:59:48.560167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373af6ad-e734-4729-8d0a-8e5d3c17da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:59:48.579712 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-373af6ad-e734-4729-8d0a-8e5d3c17da34 None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:59:48.580903 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-373af6ad-e734-4729-8d0a-8e5d3c17da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:59:48.587554 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4434/8913] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 01:59:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:59:48.599516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0097fc-c064-4e74-94b8-5621bb5ee1a4 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:59:48.609553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0097fc-c064-4e74-94b8-5621bb5ee1a4 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:59:48.613198 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1462ca-2632-4b7b-88ec-3251068d4e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:59:48.613806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1462ca-2632-4b7b-88ec-3251068d4e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:59:48.614093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1462ca-2632-4b7b-88ec-3251068d4e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:59:48.614365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1462ca-2632-4b7b-88ec-3251068d4e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:59:48.621997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1462ca-2632-4b7b-88ec-3251068d4e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:59:48.623453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1462ca-2632-4b7b-88ec-3251068d4e1a service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:59:48.631070 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4480/8914] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:59:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 01:59:51.469524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762ccd-cfb0-40ab-b807-a530e02659b3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:59:51.470060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762ccd-cfb0-40ab-b807-a530e02659b3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:59:51.470174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762ccd-cfb0-40ab-b807-a530e02659b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:59:51.490164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-01762ccd-cfb0-40ab-b807-a530e02659b3 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 01:59:51.491546 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-01762ccd-cfb0-40ab-b807-a530e02659b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 01:59:51.500970 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4435/8915] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 01:59:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 01:59:51.516123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1462ca-2632-4b7b-88ec-3251068d4e1a service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 01:59:51.530270 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1462ca-2632-4b7b-88ec-3251068d4e1a service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 01:59:51.535961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec434-3df8-4a03-beb7-230623d161d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 01:59:51.536646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec434-3df8-4a03-beb7-230623d161d5 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 01:59:51.536994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec434-3df8-4a03-beb7-230623d161d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 01:59:51.537514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec434-3df8-4a03-beb7-230623d161d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 01:59:51.546854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec434-3df8-4a03-beb7-230623d161d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 01:59:51.548541 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec434-3df8-4a03-beb7-230623d161d5 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 01:59:51.566810 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4481/8916] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 01:59:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:00:01.484567 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=23 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:01.554967 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=45 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:28.819895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01762ccd-cfb0-40ab-b807-a530e02659b3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:00:28.832766 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01762ccd-cfb0-40ab-b807-a530e02659b3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:00:28.836759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b9fb2-6b01-4689-80b0-f7a186a447db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:00:28.837370 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b9fb2-6b01-4689-80b0-f7a186a447db service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:00:28.837647 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b9fb2-6b01-4689-80b0-f7a186a447db service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:00:28.837916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b9fb2-6b01-4689-80b0-f7a186a447db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:00:28.839805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7b5b9fb2-6b01-4689-80b0-f7a186a447db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:00:28.853033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b9fb2-6b01-4689-80b0-f7a186a447db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:00:28.854471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b9fb2-6b01-4689-80b0-f7a186a447db service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:00:28.865594 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4436/8917] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:00:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:00:28.948049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec434-3df8-4a03-beb7-230623d161d5 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:00:28.949436 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cb7ec434-3df8-4a03-beb7-230623d161d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:00:29.031121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec434-3df8-4a03-beb7-230623d161d5 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:00:29.036118 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba040-7f6c-474d-a8ec-2a3649378750 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:00:29.036723 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba040-7f6c-474d-a8ec-2a3649378750 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:00:29.037003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba040-7f6c-474d-a8ec-2a3649378750 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:00:29.037276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba040-7f6c-474d-a8ec-2a3649378750 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:00:29.039606 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e95ba040-7f6c-474d-a8ec-2a3649378750 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:00:29.050849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba040-7f6c-474d-a8ec-2a3649378750 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:00:29.052424 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba040-7f6c-474d-a8ec-2a3649378750 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:00:29.063837 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4482/8918] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:00:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:00:29.241520 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b9fb2-6b01-4689-80b0-f7a186a447db service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:00:29.250796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b9fb2-6b01-4689-80b0-f7a186a447db service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:00:29.254347 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ab52b-b4f1-4a88-82b5-9416d968070a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:00:29.254969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab52b-b4f1-4a88-82b5-9416d968070a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:00:29.255250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab52b-b4f1-4a88-82b5-9416d968070a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:00:29.255518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab52b-b4f1-4a88-82b5-9416d968070a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:00:29.257214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-299ab52b-b4f1-4a88-82b5-9416d968070a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:00:29.292878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ab52b-b4f1-4a88-82b5-9416d968070a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:00:29.294356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ab52b-b4f1-4a88-82b5-9416d968070a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:00:29.308516 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4437/8919] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:00:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:00:29.371368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba040-7f6c-474d-a8ec-2a3649378750 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:00:29.381586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba040-7f6c-474d-a8ec-2a3649378750 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:00:29.387216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e8a0a-0be3-4631-b801-d2cd92ce0e34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:00:29.387806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e8a0a-0be3-4631-b801-d2cd92ce0e34 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:00:29.388088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e8a0a-0be3-4631-b801-d2cd92ce0e34 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:00:29.388360 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e8a0a-0be3-4631-b801-d2cd92ce0e34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:00:29.390044 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c91e8a0a-0be3-4631-b801-d2cd92ce0e34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:00:29.401165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e8a0a-0be3-4631-b801-d2cd92ce0e34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:00:29.402757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e8a0a-0be3-4631-b801-d2cd92ce0e34 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:00:29.412345 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4483/8920] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:00:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:00:39.300535 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=20 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:39.408194 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=43 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:00:58.571756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d85a7-8def-4881-b097-625911c0dedd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:00:58.572338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d85a7-8def-4881-b097-625911c0dedd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:00:58.572338 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d85a7-8def-4881-b097-625911c0dedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:00:58.594060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-028d85a7-8def-4881-b097-625911c0dedd None None] MFA Rules not processed for user `2429d94874654da69f134916b5659877`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:00:58.595350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-028d85a7-8def-4881-b097-625911c0dedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:00:58.604788 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4438/8921] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:00:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:00:59.227767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e8a0a-0be3-4631-b801-d2cd92ce0e34 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:00:59.238262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e8a0a-0be3-4631-b801-d2cd92ce0e34 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:00:59.243412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6fb0a-a567-41a4-8785-a04dbfb6c662 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:00:59.244013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fb0a-a567-41a4-8785-a04dbfb6c662 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:00:59.244289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fb0a-a567-41a4-8785-a04dbfb6c662 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:00:59.244780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fb0a-a567-41a4-8785-a04dbfb6c662 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:00:59.246489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-45a6fb0a-a567-41a4-8785-a04dbfb6c662 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:00:59.258680 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6fb0a-a567-41a4-8785-a04dbfb6c662 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:00:59.260453 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6fb0a-a567-41a4-8785-a04dbfb6c662 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:00:59.271745 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4484/8922] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:00:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:01:08.587960 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:01:09.267427 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:02:10.125475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc520f5-142a-4b80-a024-9970f3ad75ad None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:02:10.125967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc520f5-142a-4b80-a024-9970f3ad75ad None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:02:10.126084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc520f5-142a-4b80-a024-9970f3ad75ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:02:10.172737 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6dc520f5-142a-4b80-a024-9970f3ad75ad None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:02:10.173935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6dc520f5-142a-4b80-a024-9970f3ad75ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:02:10.182343 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4439/8923] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 2 02:02:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:02:10.188464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6fb0a-a567-41a4-8785-a04dbfb6c662 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:02:10.199494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6fb0a-a567-41a4-8785-a04dbfb6c662 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:02:10.204515 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a80cb-59ac-4005-a3d4-1961add19acf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:02:10.205106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a80cb-59ac-4005-a3d4-1961add19acf service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:02:10.205385 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a80cb-59ac-4005-a3d4-1961add19acf service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:02:10.205658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a80cb-59ac-4005-a3d4-1961add19acf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:02:10.207365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a94a80cb-59ac-4005-a3d4-1961add19acf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:02:10.219075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a80cb-59ac-4005-a3d4-1961add19acf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:02:10.220641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a80cb-59ac-4005-a3d4-1961add19acf service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:02:10.230229 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4485/8924] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:02:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:02:13.109489 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc520f5-142a-4b80-a024-9970f3ad75ad None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:02:13.119354 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc520f5-142a-4b80-a024-9970f3ad75ad None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:02:13.125426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d4ec-58b4-4906-b314-6ab7dc5d6c07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:02:13.126025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d4ec-58b4-4906-b314-6ab7dc5d6c07 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:02:13.126309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d4ec-58b4-4906-b314-6ab7dc5d6c07 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:02:13.126585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d4ec-58b4-4906-b314-6ab7dc5d6c07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:02:13.128336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d8e7d4ec-58b4-4906-b314-6ab7dc5d6c07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:02:13.139745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7d4ec-58b4-4906-b314-6ab7dc5d6c07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:02:13.141380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7d4ec-58b4-4906-b314-6ab7dc5d6c07 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:02:13.151108 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4440/8925] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:02:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:02:20.226160 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:02:23.147060 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=19 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:02:23.417444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b705-e4e8-4659-8e9d-38bf6182e16a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:02:23.417903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b705-e4e8-4659-8e9d-38bf6182e16a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:02:23.418088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b705-e4e8-4659-8e9d-38bf6182e16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:02:23.467407 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6dc2b705-e4e8-4659-8e9d-38bf6182e16a None None] MFA Rules not processed for user `c62cd9bcc90e4d6685c5d0fc1d8ceae3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:02:23.468608 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6dc2b705-e4e8-4659-8e9d-38bf6182e16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:02:23.528147 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4486/8926] 10.222.0.23 () {58 vars in 1060 bytes} [Sun Oct 2 02:02:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 02:02:23.534323 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d4ec-58b4-4906-b314-6ab7dc5d6c07 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:02:23.543933 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d4ec-58b4-4906-b314-6ab7dc5d6c07 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:02:23.547443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b9bbc-194b-4cf8-82a4-9ae2ec29d3a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:02:23.548027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b9bbc-194b-4cf8-82a4-9ae2ec29d3a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:02:23.548311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b9bbc-194b-4cf8-82a4-9ae2ec29d3a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:02:23.548696 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b9bbc-194b-4cf8-82a4-9ae2ec29d3a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:02:23.556851 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b9bbc-194b-4cf8-82a4-9ae2ec29d3a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:02:23.558346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b9bbc-194b-4cf8-82a4-9ae2ec29d3a0 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:02:23.567090 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4441/8927] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:02:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:02:33.525223 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=38 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:02:33.562984 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:02:36.471737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65220376-3b5a-4229-8593-83ed64d1eb31 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:02:36.472307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65220376-3b5a-4229-8593-83ed64d1eb31 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:02:36.472415 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65220376-3b5a-4229-8593-83ed64d1eb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:02:36.499840 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-65220376-3b5a-4229-8593-83ed64d1eb31 None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:02:36.501149 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-65220376-3b5a-4229-8593-83ed64d1eb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:02:36.519004 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4487/8928] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 02:02:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:02:36.531108 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b9bbc-194b-4cf8-82a4-9ae2ec29d3a0 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:02:36.540475 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b9bbc-194b-4cf8-82a4-9ae2ec29d3a0 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:02:36.544040 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde2871-f8b2-49fc-af49-bc84809c85f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:02:36.544661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde2871-f8b2-49fc-af49-bc84809c85f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:02:36.544932 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde2871-f8b2-49fc-af49-bc84809c85f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:02:36.545205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde2871-f8b2-49fc-af49-bc84809c85f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:02:36.553327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde2871-f8b2-49fc-af49-bc84809c85f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:02:36.554845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde2871-f8b2-49fc-af49-bc84809c85f5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:02:36.563683 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4442/8929] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:02:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:02:46.515998 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:02:46.559200 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:28.542710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65220376-3b5a-4229-8593-83ed64d1eb31 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:28.551171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65220376-3b5a-4229-8593-83ed64d1eb31 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:28.554704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaa165-d357-4af9-b5fb-4c99616dc010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:28.555292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaa165-d357-4af9-b5fb-4c99616dc010 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:28.555927 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaa165-d357-4af9-b5fb-4c99616dc010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:28.556211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaa165-d357-4af9-b5fb-4c99616dc010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:28.565878 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaa165-d357-4af9-b5fb-4c99616dc010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:28.567341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaa165-d357-4af9-b5fb-4c99616dc010 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:28.587873 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4488/8930] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:03:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:03:38.585440 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:46.271156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde2871-f8b2-49fc-af49-bc84809c85f5 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:46.283109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde2871-f8b2-49fc-af49-bc84809c85f5 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:46.291250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb6290-9948-4d0d-a26a-150ff77864b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:46.291250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb6290-9948-4d0d-a26a-150ff77864b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:46.291250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb6290-9948-4d0d-a26a-150ff77864b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:46.291250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb6290-9948-4d0d-a26a-150ff77864b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:46.303118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb6290-9948-4d0d-a26a-150ff77864b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:46.303118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb6290-9948-4d0d-a26a-150ff77864b3 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:46.330965 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4443/8931] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:03:49.534615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b372f-e9a3-4268-91b2-6381907e92a3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:49.535151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b372f-e9a3-4268-91b2-6381907e92a3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:49.535151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b372f-e9a3-4268-91b2-6381907e92a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:49.554275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-777b372f-e9a3-4268-91b2-6381907e92a3 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:03:49.555500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-777b372f-e9a3-4268-91b2-6381907e92a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:03:49.575969 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4489/8932] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 02:03:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 02:03:49.590424 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb6290-9948-4d0d-a26a-150ff77864b3 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:49.605736 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb6290-9948-4d0d-a26a-150ff77864b3 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:49.608123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b372f-e9a3-4268-91b2-6381907e92a3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:49.613022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcbe67-6397-4a3f-a624-46305e6444d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:49.613834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcbe67-6397-4a3f-a624-46305e6444d2 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:49.614202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcbe67-6397-4a3f-a624-46305e6444d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:49.620178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcbe67-6397-4a3f-a624-46305e6444d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:49.621493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b372f-e9a3-4268-91b2-6381907e92a3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:49.627673 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da552264-2479-4c3a-9d9a-08fd4e55f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:49.628471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da552264-2479-4c3a-9d9a-08fd4e55f5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:49.628753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da552264-2479-4c3a-9d9a-08fd4e55f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:49.629027 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da552264-2479-4c3a-9d9a-08fd4e55f5c1 admin admin] PATH_INFO: `/v3/users/2429d94874654da69f134916b5659877` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:49.630256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da552264-2479-4c3a-9d9a-08fd4e55f5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2429d94874654da69f134916b5659877)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:49.630379 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcbe67-6397-4a3f-a624-46305e6444d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:49.632120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcbe67-6397-4a3f-a624-46305e6444d2 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:49.632250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da552264-2479-4c3a-9d9a-08fd4e55f5c1 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:49.643372 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4444/8933] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:03:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:03:49.688725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-da552264-2479-4c3a-9d9a-08fd4e55f5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2429d94874654da69f134916b5659877'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:03:49.704481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-da552264-2479-4c3a-9d9a-08fd4e55f5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2429d94874654da69f134916b5659877'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:03:49.705371 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-da552264-2479-4c3a-9d9a-08fd4e55f5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2429d94874654da69f134916b5659877'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:03:49.713678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-da552264-2479-4c3a-9d9a-08fd4e55f5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2429d94874654da69f134916b5659877'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:03:49.714347 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-da552264-2479-4c3a-9d9a-08fd4e55f5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2429d94874654da69f134916b5659877'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:03:49.727444 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4490/8934] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:03:49 2022] DELETE /identity/v3/users/2429d94874654da69f134916b5659877 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:03:49.903327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcbe67-6397-4a3f-a624-46305e6444d2 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:49.915448 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcbe67-6397-4a3f-a624-46305e6444d2 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:49.973676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:49.974535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:49.974857 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:49.975135 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] PATH_INFO: `/v3/projects/0ea3f726ac484294b995890cfa5b0533` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:49.976918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea3f726ac484294b995890cfa5b0533)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:49.980368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:50.027931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea3f726ac484294b995890cfa5b0533', 'request_id': 'req-642c3985-fdd4-4dc2-bd8a-f902cb549941'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:03:50.033805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea3f726ac484294b995890cfa5b0533', 'request_id': 'req-642c3985-fdd4-4dc2-bd8a-f902cb549941'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:03:50.040004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea3f726ac484294b995890cfa5b0533', 'request_id': 'req-642c3985-fdd4-4dc2-bd8a-f902cb549941'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:03:50.066035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] The token cache is being invalidate because project 0ea3f726ac484294b995890cfa5b0533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:03:50.066328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:03:50.066986 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-642c3985-fdd4-4dc2-bd8a-f902cb549941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:03:50.068489 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4445/8935] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:03:49 2022] DELETE /identity/v3/projects/0ea3f726ac484294b995890cfa5b0533 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:03:50.073776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178c576-d0f8-430d-8332-6bad421db821 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:50.074065 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178c576-d0f8-430d-8332-6bad421db821 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:50.074340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178c576-d0f8-430d-8332-6bad421db821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:50.122295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2178c576-d0f8-430d-8332-6bad421db821 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:03:50.123550 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2178c576-d0f8-430d-8332-6bad421db821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:03:50.182049 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4491/8936] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:03:50.190562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0383c4f-8c8b-4a02-b9e6-e21126a3b6cb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:50.190881 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0383c4f-8c8b-4a02-b9e6-e21126a3b6cb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:50.191159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0383c4f-8c8b-4a02-b9e6-e21126a3b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:50.213280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b0383c4f-8c8b-4a02-b9e6-e21126a3b6cb None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:03:50.214541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b0383c4f-8c8b-4a02-b9e6-e21126a3b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:03:50.222477 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4446/8937] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:03:50.226872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178c576-d0f8-430d-8332-6bad421db821 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:50.236744 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178c576-d0f8-430d-8332-6bad421db821 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:50.241232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70949d-12f1-4cce-8579-1a245401256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:50.241819 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70949d-12f1-4cce-8579-1a245401256b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:50.242098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70949d-12f1-4cce-8579-1a245401256b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:50.242370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70949d-12f1-4cce-8579-1a245401256b admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:50.243039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70949d-12f1-4cce-8579-1a245401256b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 02:03:50.243340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70949d-12f1-4cce-8579-1a245401256b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:50.244921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70949d-12f1-4cce-8579-1a245401256b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:50.257018 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4492/8938] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 02:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 02:03:50.261268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0383c4f-8c8b-4a02-b9e6-e21126a3b6cb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:50.271528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0383c4f-8c8b-4a02-b9e6-e21126a3b6cb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:50.276100 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa707d-175d-4491-b737-4cb99b16f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:50.276689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa707d-175d-4491-b737-4cb99b16f774 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:50.276970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa707d-175d-4491-b737-4cb99b16f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:50.277292 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa707d-175d-4491-b737-4cb99b16f774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:50.277935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa707d-175d-4491-b737-4cb99b16f774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:50.279950 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa707d-175d-4491-b737-4cb99b16f774 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:50.310807 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:50.321691 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4447/8939] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:03:50 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:03:50.323104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70949d-12f1-4cce-8579-1a245401256b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:50.332991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70949d-12f1-4cce-8579-1a245401256b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:50.352062 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:50.391070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14dc1e-cee9-41fa-a007-9f5a4791c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:50.391667 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14dc1e-cee9-41fa-a007-9f5a4791c642 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:50.391949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14dc1e-cee9-41fa-a007-9f5a4791c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:50.392222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14dc1e-cee9-41fa-a007-9f5a4791c642 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:50.392843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14dc1e-cee9-41fa-a007-9f5a4791c642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:50.394788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14dc1e-cee9-41fa-a007-9f5a4791c642 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:50.417482 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4493/8940] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:03:50 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 02:03:50.418949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa707d-175d-4491-b737-4cb99b16f774 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:50.429618 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa707d-175d-4491-b737-4cb99b16f774 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:50.434275 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570a898-df7a-4679-8f31-2fa4fdd69edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:50.434848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570a898-df7a-4679-8f31-2fa4fdd69edc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:50.435129 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570a898-df7a-4679-8f31-2fa4fdd69edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:50.435401 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570a898-df7a-4679-8f31-2fa4fdd69edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:50.436029 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570a898-df7a-4679-8f31-2fa4fdd69edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:50.437743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570a898-df7a-4679-8f31-2fa4fdd69edc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:50.447768 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4448/8941] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:03:50.451828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14dc1e-cee9-41fa-a007-9f5a4791c642 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:50.462352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14dc1e-cee9-41fa-a007-9f5a4791c642 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:50.466822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e90eb3-b556-4e68-97f1-37264811b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:50.467408 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90eb3-b556-4e68-97f1-37264811b47f admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:50.467685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90eb3-b556-4e68-97f1-37264811b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:50.467957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90eb3-b556-4e68-97f1-37264811b47f admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:50.468746 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e90eb3-b556-4e68-97f1-37264811b47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:50.470334 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e90eb3-b556-4e68-97f1-37264811b47f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:50.481092 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4494/8942] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:03:50.485669 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570a898-df7a-4679-8f31-2fa4fdd69edc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:50.495739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570a898-df7a-4679-8f31-2fa4fdd69edc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:50.500389 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa7eed-0730-42ec-92f3-73d0237b9da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:50.501026 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa7eed-0730-42ec-92f3-73d0237b9da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:50.501302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa7eed-0730-42ec-92f3-73d0237b9da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:50.501575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa7eed-0730-42ec-92f3-73d0237b9da4 admin admin] PATH_INFO: `/v3/projects/9123a284aa514e8481ea676fd61ab9f7/users/a45f3f8301994a87aac47bcd366c6605/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:50.516689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa7eed-0730-42ec-92f3-73d0237b9da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9123a284aa514e8481ea676fd61ab9f7, user_id=a45f3f8301994a87aac47bcd366c6605, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:50.519373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa7eed-0730-42ec-92f3-73d0237b9da4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:50.531627 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4449/8943] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:03:50 2022] PUT /identity/v3/projects/9123a284aa514e8481ea676fd61ab9f7/users/a45f3f8301994a87aac47bcd366c6605/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 02:03:50.536807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45d761-0912-4ae5-8fbb-e433f28ccdbd None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:50.537391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45d761-0912-4ae5-8fbb-e433f28ccdbd None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:50.537391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45d761-0912-4ae5-8fbb-e433f28ccdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:50.557984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-ad45d761-0912-4ae5-8fbb-e433f28ccdbd None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:03:50.559220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ad45d761-0912-4ae5-8fbb-e433f28ccdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:03:50.619398 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4495/8944] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:03:50.629238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa7eed-0730-42ec-92f3-73d0237b9da4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:50.631053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c6aa7eed-0730-42ec-92f3-73d0237b9da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:03:50.688172 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa7eed-0730-42ec-92f3-73d0237b9da4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:50.691756 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605261b-1bc3-486f-a750-2bf6f3004d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:50.692362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605261b-1bc3-486f-a750-2bf6f3004d00 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:50.692644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605261b-1bc3-486f-a750-2bf6f3004d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:50.692919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605261b-1bc3-486f-a750-2bf6f3004d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:50.702046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605261b-1bc3-486f-a750-2bf6f3004d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:50.704178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605261b-1bc3-486f-a750-2bf6f3004d00 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:50.713512 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4450/8945] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:03:54.833019 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5c05-5447-4635-9536-a2d83a059508 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:54.833482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5c05-5447-4635-9536-a2d83a059508 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:54.833482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5c05-5447-4635-9536-a2d83a059508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:54.863040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-889f5c05-5447-4635-9536-a2d83a059508 None None] MFA Rules not processed for user `a45f3f8301994a87aac47bcd366c6605`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:03:54.864232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-889f5c05-5447-4635-9536-a2d83a059508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:03:54.954267 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4496/8946] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:03:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:03:54.966084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479817-37c2-49e5-99cd-041472f90e05 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:54.966506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479817-37c2-49e5-99cd-041472f90e05 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:54.967139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479817-37c2-49e5-99cd-041472f90e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:54.991552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a9479817-37c2-49e5-99cd-041472f90e05 None None] MFA Rules not processed for user `a45f3f8301994a87aac47bcd366c6605`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:03:54.992783 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a9479817-37c2-49e5-99cd-041472f90e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:03:54.999950 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4451/8947] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:03:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:03:55.013444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f5c05-5447-4635-9536-a2d83a059508 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:55.015420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-889f5c05-5447-4635-9536-a2d83a059508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:03:55.052239 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:03:55.095978 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f5c05-5447-4635-9536-a2d83a059508 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:55.101554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068ceed-f1f1-40d1-accd-fd3538aa386a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:55.102307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068ceed-f1f1-40d1-accd-fd3538aa386a service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:55.102437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068ceed-f1f1-40d1-accd-fd3538aa386a service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:55.102737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068ceed-f1f1-40d1-accd-fd3538aa386a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:55.113432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068ceed-f1f1-40d1-accd-fd3538aa386a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:55.115159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068ceed-f1f1-40d1-accd-fd3538aa386a service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:55.125595 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4497/8948] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:03:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:03:57.924880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9479817-37c2-49e5-99cd-041472f90e05 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:03:57.940770 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9479817-37c2-49e5-99cd-041472f90e05 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:03:57.944872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aa0f9-40de-4db7-ade1-6a080b86d85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:03:57.945702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aa0f9-40de-4db7-ade1-6a080b86d85b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:03:57.945962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aa0f9-40de-4db7-ade1-6a080b86d85b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:03:57.946301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aa0f9-40de-4db7-ade1-6a080b86d85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:03:57.949993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-db6aa0f9-40de-4db7-ade1-6a080b86d85b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:03:57.987927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aa0f9-40de-4db7-ade1-6a080b86d85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:03:57.989584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aa0f9-40de-4db7-ade1-6a080b86d85b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:03:58.019161 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4452/8949] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:03:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:04:05.121122 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=20 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:05.266020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ab79-63d9-40f1-8f7a-7ca6b82b75c0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:05.266302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ab79-63d9-40f1-8f7a-7ca6b82b75c0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:05.266576 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ab79-63d9-40f1-8f7a-7ca6b82b75c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:05.285266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-11e7ab79-63d9-40f1-8f7a-7ca6b82b75c0 None None] MFA Rules not processed for user `a45f3f8301994a87aac47bcd366c6605`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:05.286467 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-11e7ab79-63d9-40f1-8f7a-7ca6b82b75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:05.293407 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4498/8950] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:07.997198 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=50,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:08.369570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aa0f9-40de-4db7-ade1-6a080b86d85b service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:08.386470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aa0f9-40de-4db7-ade1-6a080b86d85b service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:08.392514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90449b-8040-4cb0-96ef-8ee6bdc43749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:08.393443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90449b-8040-4cb0-96ef-8ee6bdc43749 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:08.393852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90449b-8040-4cb0-96ef-8ee6bdc43749 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:08.393997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90449b-8040-4cb0-96ef-8ee6bdc43749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:08.395870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fd90449b-8040-4cb0-96ef-8ee6bdc43749 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:08.409090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90449b-8040-4cb0-96ef-8ee6bdc43749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:08.410996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90449b-8040-4cb0-96ef-8ee6bdc43749 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:08.423673 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4453/8951] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:04:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 02:04:15.281027 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:18.418281 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:28.292341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7ab79-63d9-40f1-8f7a-7ca6b82b75c0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:28.303869 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7ab79-63d9-40f1-8f7a-7ca6b82b75c0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:28.308626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bc968-deb4-4ad6-a4ff-09b5525a1342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:28.309255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc968-deb4-4ad6-a4ff-09b5525a1342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:28.309601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc968-deb4-4ad6-a4ff-09b5525a1342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:28.309880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc968-deb4-4ad6-a4ff-09b5525a1342 admin admin] PATH_INFO: `/v3/users/a45f3f8301994a87aac47bcd366c6605` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:28.311074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bc968-deb4-4ad6-a4ff-09b5525a1342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45f3f8301994a87aac47bcd366c6605)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:28.313557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bc968-deb4-4ad6-a4ff-09b5525a1342 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:28.361401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e93bc968-deb4-4ad6-a4ff-09b5525a1342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45f3f8301994a87aac47bcd366c6605'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:28.373205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e93bc968-deb4-4ad6-a4ff-09b5525a1342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45f3f8301994a87aac47bcd366c6605'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:28.374694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e93bc968-deb4-4ad6-a4ff-09b5525a1342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45f3f8301994a87aac47bcd366c6605'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:28.382247 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e93bc968-deb4-4ad6-a4ff-09b5525a1342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45f3f8301994a87aac47bcd366c6605'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:28.382901 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-e93bc968-deb4-4ad6-a4ff-09b5525a1342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45f3f8301994a87aac47bcd366c6605'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:28.398229 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4499/8952] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:04:28 2022] DELETE /identity/v3/users/a45f3f8301994a87aac47bcd366c6605 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:04:28.580608 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90449b-8040-4cb0-96ef-8ee6bdc43749 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:28.593589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90449b-8040-4cb0-96ef-8ee6bdc43749 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:28.653510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:28.654093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:28.654378 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:28.654681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] PATH_INFO: `/v3/projects/9123a284aa514e8481ea676fd61ab9f7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:28.656065 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9123a284aa514e8481ea676fd61ab9f7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:28.658019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:28.704622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9123a284aa514e8481ea676fd61ab9f7', 'request_id': 'req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:28.710047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9123a284aa514e8481ea676fd61ab9f7', 'request_id': 'req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:28.716201 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9123a284aa514e8481ea676fd61ab9f7', 'request_id': 'req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:28.729153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] The token cache is being invalidate because project 9123a284aa514e8481ea676fd61ab9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:04:28.729445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:28.730062 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2aeb7e99-ce3f-4186-8bf7-994b5ee1e222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:28.731572 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4454/8953] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:04:28 2022] DELETE /identity/v3/projects/9123a284aa514e8481ea676fd61ab9f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:04:28.737214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba8ffb-3e54-4efb-9f07-fcccf58e59ae None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:28.739661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba8ffb-3e54-4efb-9f07-fcccf58e59ae None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:28.739947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba8ffb-3e54-4efb-9f07-fcccf58e59ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:28.765394 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-13ba8ffb-3e54-4efb-9f07-fcccf58e59ae None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:28.766650 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-13ba8ffb-3e54-4efb-9f07-fcccf58e59ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:28.829813 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4500/8954] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:28.837961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7aee-60d5-44eb-9b44-e86f5ca8ea28 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:28.838250 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7aee-60d5-44eb-9b44-e86f5ca8ea28 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:28.838528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7aee-60d5-44eb-9b44-e86f5ca8ea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:28.858739 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-172d7aee-60d5-44eb-9b44-e86f5ca8ea28 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:28.859912 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-172d7aee-60d5-44eb-9b44-e86f5ca8ea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:28.867645 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4455/8955] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:28.871873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba8ffb-3e54-4efb-9f07-fcccf58e59ae None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:28.882144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba8ffb-3e54-4efb-9f07-fcccf58e59ae None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:28.886684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6228c-1d63-46fa-8e7c-8698fd9be4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:28.887282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6228c-1d63-46fa-8e7c-8698fd9be4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:28.887565 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6228c-1d63-46fa-8e7c-8698fd9be4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:28.887841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6228c-1d63-46fa-8e7c-8698fd9be4e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:28.888481 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6228c-1d63-46fa-8e7c-8698fd9be4e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 02:04:28.888784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6228c-1d63-46fa-8e7c-8698fd9be4e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:28.890423 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6228c-1d63-46fa-8e7c-8698fd9be4e4 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:28.901569 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4501/8956] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 02:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 02:04:28.906536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7aee-60d5-44eb-9b44-e86f5ca8ea28 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:28.915850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7aee-60d5-44eb-9b44-e86f5ca8ea28 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:28.921226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827616b-83ad-412a-b55a-97dfe8b490e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:28.921970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827616b-83ad-412a-b55a-97dfe8b490e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:28.922316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827616b-83ad-412a-b55a-97dfe8b490e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:28.922614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827616b-83ad-412a-b55a-97dfe8b490e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:28.923256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827616b-83ad-412a-b55a-97dfe8b490e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:28.925185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827616b-83ad-412a-b55a-97dfe8b490e9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:28.952352 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4456/8957] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:04:28 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:04:28.956571 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6228c-1d63-46fa-8e7c-8698fd9be4e4 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:28.966646 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6228c-1d63-46fa-8e7c-8698fd9be4e4 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:29.023030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f99d-2717-418d-8dad-1f0a5de3a45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:29.023645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f99d-2717-418d-8dad-1f0a5de3a45b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:29.023905 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f99d-2717-418d-8dad-1f0a5de3a45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:29.024177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f99d-2717-418d-8dad-1f0a5de3a45b admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:29.024807 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0f99d-2717-418d-8dad-1f0a5de3a45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:29.026734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0f99d-2717-418d-8dad-1f0a5de3a45b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:29.034603 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:29.049131 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4502/8958] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:04:28 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:04:29.053454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827616b-83ad-412a-b55a-97dfe8b490e9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:29.065373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827616b-83ad-412a-b55a-97dfe8b490e9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:29.070996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e03c41-c0cb-4d4a-b2bd-8052e27ca769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:29.071609 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e03c41-c0cb-4d4a-b2bd-8052e27ca769 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:29.071887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e03c41-c0cb-4d4a-b2bd-8052e27ca769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:29.072160 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e03c41-c0cb-4d4a-b2bd-8052e27ca769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:29.072829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e03c41-c0cb-4d4a-b2bd-8052e27ca769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:29.074733 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e03c41-c0cb-4d4a-b2bd-8052e27ca769 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:29.086308 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4457/8959] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:04:29.090689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f99d-2717-418d-8dad-1f0a5de3a45b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:29.100880 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f99d-2717-418d-8dad-1f0a5de3a45b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:29.105717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c094f8-1fa4-4bcb-ace9-65efb1f9a5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:29.106452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c094f8-1fa4-4bcb-ace9-65efb1f9a5de admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:29.106996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c094f8-1fa4-4bcb-ace9-65efb1f9a5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:29.107274 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c094f8-1fa4-4bcb-ace9-65efb1f9a5de admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:29.107941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c094f8-1fa4-4bcb-ace9-65efb1f9a5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:29.110010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c094f8-1fa4-4bcb-ace9-65efb1f9a5de admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:29.120142 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4503/8960] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:04:29.124758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e03c41-c0cb-4d4a-b2bd-8052e27ca769 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:29.134795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e03c41-c0cb-4d4a-b2bd-8052e27ca769 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:29.140303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea105a6-4bb8-4022-8593-72140eb31509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:29.141101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea105a6-4bb8-4022-8593-72140eb31509 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:29.141380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea105a6-4bb8-4022-8593-72140eb31509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:29.141658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea105a6-4bb8-4022-8593-72140eb31509 admin admin] PATH_INFO: `/v3/projects/7df97880826a4bbe8f1b86025bba27ec/users/7722b5a168a94e9d84d2b3c57c3ad240/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:29.156787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea105a6-4bb8-4022-8593-72140eb31509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df97880826a4bbe8f1b86025bba27ec, user_id=7722b5a168a94e9d84d2b3c57c3ad240, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:29.159461 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea105a6-4bb8-4022-8593-72140eb31509 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:29.172899 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4458/8961] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:04:29 2022] PUT /identity/v3/projects/7df97880826a4bbe8f1b86025bba27ec/users/7722b5a168a94e9d84d2b3c57c3ad240/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:04:29.184037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82fb27-48f3-43f7-890b-95b788988ee6 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:29.184431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82fb27-48f3-43f7-890b-95b788988ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:29.184707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82fb27-48f3-43f7-890b-95b788988ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:29.213645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2a82fb27-48f3-43f7-890b-95b788988ee6 None None] MFA Rules not processed for user `7722b5a168a94e9d84d2b3c57c3ad240`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:29.214883 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2a82fb27-48f3-43f7-890b-95b788988ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:29.279297 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4504/8962] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:29.289666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea105a6-4bb8-4022-8593-72140eb31509 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:29.291440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aea105a6-4bb8-4022-8593-72140eb31509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:29.323617 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:29.351983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea105a6-4bb8-4022-8593-72140eb31509 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:29.355645 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb3495-8d7b-4c46-815b-d98fc5ee093e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:29.356246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3495-8d7b-4c46-815b-d98fc5ee093e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:29.356535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3495-8d7b-4c46-815b-d98fc5ee093e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:29.356803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3495-8d7b-4c46-815b-d98fc5ee093e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:29.370537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb3495-8d7b-4c46-815b-d98fc5ee093e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:29.372001 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb3495-8d7b-4c46-815b-d98fc5ee093e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:29.380930 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4459/8963] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:04:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:04:37.560750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e851529-e1bf-47f6-b6e8-9941d905427c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:37.562082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e851529-e1bf-47f6-b6e8-9941d905427c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:37.562082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e851529-e1bf-47f6-b6e8-9941d905427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:37.584115 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-6e851529-e1bf-47f6-b6e8-9941d905427c None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:37.585409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6e851529-e1bf-47f6-b6e8-9941d905427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:37.667811 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4505/8964] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 02:04:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:37.680630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb3495-8d7b-4c46-815b-d98fc5ee093e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:37.682217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0feb3495-8d7b-4c46-815b-d98fc5ee093e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:37.697684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb3495-8d7b-4c46-815b-d98fc5ee093e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:37.703702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a644d-d247-4fe3-8d58-de7a536aaadb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:37.704310 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a644d-d247-4fe3-8d58-de7a536aaadb service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:37.704801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a644d-d247-4fe3-8d58-de7a536aaadb service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:37.705084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a644d-d247-4fe3-8d58-de7a536aaadb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:37.716106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a644d-d247-4fe3-8d58-de7a536aaadb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:37.718628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a644d-d247-4fe3-8d58-de7a536aaadb service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:37.729130 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4460/8965] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:04:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:04:42.700991 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e851529-e1bf-47f6-b6e8-9941d905427c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:42.764795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e851529-e1bf-47f6-b6e8-9941d905427c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:42.769731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:42.770419 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:42.771036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:42.771314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] PATH_INFO: `/v3/users/7722b5a168a94e9d84d2b3c57c3ad240` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:42.772690 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7722b5a168a94e9d84d2b3c57c3ad240)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:42.774628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:42.779391 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:42.823648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7722b5a168a94e9d84d2b3c57c3ad240'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:42.836162 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7722b5a168a94e9d84d2b3c57c3ad240'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:42.836794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7722b5a168a94e9d84d2b3c57c3ad240'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:42.844776 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7722b5a168a94e9d84d2b3c57c3ad240'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:42.845522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7722b5a168a94e9d84d2b3c57c3ad240'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:42.857810 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4506/8966] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:04:42 2022] DELETE /identity/v3/users/7722b5a168a94e9d84d2b3c57c3ad240 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:04:42.862375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04489d-0699-4be1-872e-6c360a15a577 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:42.862908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04489d-0699-4be1-872e-6c360a15a577 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:42.863010 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04489d-0699-4be1-872e-6c360a15a577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:42.884186 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5b04489d-0699-4be1-872e-6c360a15a577 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:42.885392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5b04489d-0699-4be1-872e-6c360a15a577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:42.947134 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4461/8967] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:42.957856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:42.959391 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:43.016804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143db58-7d76-4fa7-ba84-f848bab83249 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:43.020464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9cfe6-a180-417e-bb72-34f7e7f4637b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:43.021062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9cfe6-a180-417e-bb72-34f7e7f4637b service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.021342 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9cfe6-a180-417e-bb72-34f7e7f4637b service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.021611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9cfe6-a180-417e-bb72-34f7e7f4637b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.031323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9cfe6-a180-417e-bb72-34f7e7f4637b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:43.032738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9cfe6-a180-417e-bb72-34f7e7f4637b service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:43.042583 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4507/8968] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:04:43.219268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04489d-0699-4be1-872e-6c360a15a577 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:43.220713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5b04489d-0699-4be1-872e-6c360a15a577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:43.232676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04489d-0699-4be1-872e-6c360a15a577 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:43.239031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:43.239727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.240016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.240295 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] PATH_INFO: `/v3/projects/7df97880826a4bbe8f1b86025bba27ec` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.241432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7df97880826a4bbe8f1b86025bba27ec)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:43.243408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:43.290585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7df97880826a4bbe8f1b86025bba27ec', 'request_id': 'req-07674176-f75a-4f6a-8ada-472e7d8b1344'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:43.296425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7df97880826a4bbe8f1b86025bba27ec', 'request_id': 'req-07674176-f75a-4f6a-8ada-472e7d8b1344'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:43.302497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7df97880826a4bbe8f1b86025bba27ec', 'request_id': 'req-07674176-f75a-4f6a-8ada-472e7d8b1344'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:43.315215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] The token cache is being invalidate because project 7df97880826a4bbe8f1b86025bba27ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:04:43.315508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:43.316153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-07674176-f75a-4f6a-8ada-472e7d8b1344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:43.317652 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4462/8969] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:04:43 2022] DELETE /identity/v3/projects/7df97880826a4bbe8f1b86025bba27ec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:04:43.322851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ebb5d-2611-4f8a-9a9d-4edb75741aab None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.323428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ebb5d-2611-4f8a-9a9d-4edb75741aab None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.323712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ebb5d-2611-4f8a-9a9d-4edb75741aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.344142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-7d3ebb5d-2611-4f8a-9a9d-4edb75741aab None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:43.345260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7d3ebb5d-2611-4f8a-9a9d-4edb75741aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:43.404187 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4508/8970] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:43.412046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613045-0d02-43a4-8cac-7a7309182110 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.412328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613045-0d02-43a4-8cac-7a7309182110 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.412601 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613045-0d02-43a4-8cac-7a7309182110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.434398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6e613045-0d02-43a4-8cac-7a7309182110 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:43.436660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6e613045-0d02-43a4-8cac-7a7309182110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:43.447802 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4463/8971] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:43.453053 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ebb5d-2611-4f8a-9a9d-4edb75741aab None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:43.463235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ebb5d-2611-4f8a-9a9d-4edb75741aab None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:43.469426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76635df-46e1-4f4a-b559-c1e8a9f1b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:43.470034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76635df-46e1-4f4a-b559-c1e8a9f1b6cc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.470311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76635df-46e1-4f4a-b559-c1e8a9f1b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.470623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76635df-46e1-4f4a-b559-c1e8a9f1b6cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.471276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76635df-46e1-4f4a-b559-c1e8a9f1b6cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 02:04:43.471575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76635df-46e1-4f4a-b559-c1e8a9f1b6cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:43.473159 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76635df-46e1-4f4a-b559-c1e8a9f1b6cc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:43.485513 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4509/8972] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 02:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 02:04:43.489882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e613045-0d02-43a4-8cac-7a7309182110 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:43.499790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e613045-0d02-43a4-8cac-7a7309182110 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:43.504456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c56de6-b51f-4d69-8043-befd9d6f90c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:43.505048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56de6-b51f-4d69-8043-befd9d6f90c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.505326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56de6-b51f-4d69-8043-befd9d6f90c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.505594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56de6-b51f-4d69-8043-befd9d6f90c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.506215 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c56de6-b51f-4d69-8043-befd9d6f90c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:43.508150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c56de6-b51f-4d69-8043-befd9d6f90c7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:43.535082 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4464/8973] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:04:43 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:04:43.539823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76635df-46e1-4f4a-b559-c1e8a9f1b6cc admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:43.550409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76635df-46e1-4f4a-b559-c1e8a9f1b6cc admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:43.559401 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:43.612106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c50c1-73e3-4b1f-af02-e140201eb61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:43.612712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c50c1-73e3-4b1f-af02-e140201eb61b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.612988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c50c1-73e3-4b1f-af02-e140201eb61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.613260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c50c1-73e3-4b1f-af02-e140201eb61b admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.613897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c50c1-73e3-4b1f-af02-e140201eb61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:43.615853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c50c1-73e3-4b1f-af02-e140201eb61b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:43.638474 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4510/8974] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:04:43 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 02:04:43.643055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c56de6-b51f-4d69-8043-befd9d6f90c7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:43.653454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c56de6-b51f-4d69-8043-befd9d6f90c7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:43.658559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573289-a563-4c7e-bcee-b7c744f4fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:43.659233 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573289-a563-4c7e-bcee-b7c744f4fea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.659515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573289-a563-4c7e-bcee-b7c744f4fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.659790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573289-a563-4c7e-bcee-b7c744f4fea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.660438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e573289-a563-4c7e-bcee-b7c744f4fea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:43.662051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e573289-a563-4c7e-bcee-b7c744f4fea4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:43.668035 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:43.677858 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4465/8975] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 02:04:43.679138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c50c1-73e3-4b1f-af02-e140201eb61b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:43.689352 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c50c1-73e3-4b1f-af02-e140201eb61b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:43.693942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e0b67-a6c3-4fc7-b5d0-0e645039e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:43.695519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e0b67-a6c3-4fc7-b5d0-0e645039e6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.695519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e0b67-a6c3-4fc7-b5d0-0e645039e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.695519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e0b67-a6c3-4fc7-b5d0-0e645039e6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.695833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e0b67-a6c3-4fc7-b5d0-0e645039e6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:43.697316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e0b67-a6c3-4fc7-b5d0-0e645039e6bc admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:43.711581 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4511/8976] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 02:04:43.712703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573289-a563-4c7e-bcee-b7c744f4fea4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:43.724620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573289-a563-4c7e-bcee-b7c744f4fea4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:43.729244 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3352bf-4546-428e-aaeb-3a5697b38cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:43.729880 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3352bf-4546-428e-aaeb-3a5697b38cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.730159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3352bf-4546-428e-aaeb-3a5697b38cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.730433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3352bf-4546-428e-aaeb-3a5697b38cc1 admin admin] PATH_INFO: `/v3/projects/5edec11e759d46a0acb17354a3369acd/users/3d4fc55175fd44988ba8c548fb9aefbb/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.744960 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3352bf-4546-428e-aaeb-3a5697b38cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5edec11e759d46a0acb17354a3369acd, user_id=3d4fc55175fd44988ba8c548fb9aefbb, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:43.747703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3352bf-4546-428e-aaeb-3a5697b38cc1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:43.760540 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4466/8977] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:04:43 2022] PUT /identity/v3/projects/5edec11e759d46a0acb17354a3369acd/users/3d4fc55175fd44988ba8c548fb9aefbb/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 02:04:43.771359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a943-ce53-4655-b1f1-962bdaf217a3 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.771669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a943-ce53-4655-b1f1-962bdaf217a3 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.771923 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a943-ce53-4655-b1f1-962bdaf217a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.799652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a4b2a943-ce53-4655-b1f1-962bdaf217a3 None None] MFA Rules not processed for user `3d4fc55175fd44988ba8c548fb9aefbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:43.800856 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a4b2a943-ce53-4655-b1f1-962bdaf217a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:43.864627 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4512/8978] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:43.878719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3352bf-4546-428e-aaeb-3a5697b38cc1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:43.880044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2c3352bf-4546-428e-aaeb-3a5697b38cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:43.939876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3352bf-4546-428e-aaeb-3a5697b38cc1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:43.943614 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f320b-e17f-4770-864e-7c48a6ffc9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:43.944253 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f320b-e17f-4770-864e-7c48a6ffc9cb service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:43.944538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f320b-e17f-4770-864e-7c48a6ffc9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:43.944819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f320b-e17f-4770-864e-7c48a6ffc9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:43.955732 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f320b-e17f-4770-864e-7c48a6ffc9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:43.957704 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f320b-e17f-4770-864e-7c48a6ffc9cb service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:43.972626 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4467/8979] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:04:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:04:48.543670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2a943-ce53-4655-b1f1-962bdaf217a3 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:48.607480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2a943-ce53-4655-b1f1-962bdaf217a3 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:48.611965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:48.612581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:48.612855 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:48.613123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] PATH_INFO: `/v3/users/3d4fc55175fd44988ba8c548fb9aefbb` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:48.614219 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d4fc55175fd44988ba8c548fb9aefbb)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:48.616177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:48.638305 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:48.663822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4fc55175fd44988ba8c548fb9aefbb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:48.675823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4fc55175fd44988ba8c548fb9aefbb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:48.676527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4fc55175fd44988ba8c548fb9aefbb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:48.683620 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4fc55175fd44988ba8c548fb9aefbb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:48.684230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4fc55175fd44988ba8c548fb9aefbb'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:48.696922 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4513/8980] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:04:48 2022] DELETE /identity/v3/users/3d4fc55175fd44988ba8c548fb9aefbb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:04:48.702309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9c46a-4fc8-4a7e-9ecf-a037db14bcde None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:48.702873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9c46a-4fc8-4a7e-9ecf-a037db14bcde None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:48.702873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9c46a-4fc8-4a7e-9ecf-a037db14bcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:48.721570 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-98b9c46a-4fc8-4a7e-9ecf-a037db14bcde None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:48.722794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-98b9c46a-4fc8-4a7e-9ecf-a037db14bcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:48.781302 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4468/8981] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:48.790899 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:48.792296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:48.849651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70464d00-16cf-4a8f-a40b-0b3c1c6002cf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:48.853326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08075c-e55d-41c7-b7bf-86243c1f53cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:48.853926 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08075c-e55d-41c7-b7bf-86243c1f53cf service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:48.854231 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08075c-e55d-41c7-b7bf-86243c1f53cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:48.854504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08075c-e55d-41c7-b7bf-86243c1f53cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:48.863942 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08075c-e55d-41c7-b7bf-86243c1f53cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:48.865369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08075c-e55d-41c7-b7bf-86243c1f53cf service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:48.875429 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4514/8982] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:04:49.048585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9c46a-4fc8-4a7e-9ecf-a037db14bcde None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:49.050072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-98b9c46a-4fc8-4a7e-9ecf-a037db14bcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:49.063995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9c46a-4fc8-4a7e-9ecf-a037db14bcde None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:49.068660 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:49.069309 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:49.069597 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:49.069877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] PATH_INFO: `/v3/projects/5edec11e759d46a0acb17354a3369acd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:49.071046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5edec11e759d46a0acb17354a3369acd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:49.073246 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:49.120861 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5edec11e759d46a0acb17354a3369acd', 'request_id': 'req-583b9278-7168-4aa4-86e0-e991eedd3990'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:49.126469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5edec11e759d46a0acb17354a3369acd', 'request_id': 'req-583b9278-7168-4aa4-86e0-e991eedd3990'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:49.132778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5edec11e759d46a0acb17354a3369acd', 'request_id': 'req-583b9278-7168-4aa4-86e0-e991eedd3990'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:49.145067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] The token cache is being invalidate because project 5edec11e759d46a0acb17354a3369acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:04:49.145356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:49.145977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-583b9278-7168-4aa4-86e0-e991eedd3990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:04:49.147688 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4469/8983] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:04:49 2022] DELETE /identity/v3/projects/5edec11e759d46a0acb17354a3369acd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:04:49.152506 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f8318-4d07-4271-bcf9-ef995f79c2e0 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:49.152810 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f8318-4d07-4271-bcf9-ef995f79c2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:49.153080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f8318-4d07-4271-bcf9-ef995f79c2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:49.173089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-627f8318-4d07-4271-bcf9-ef995f79c2e0 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:49.174269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-627f8318-4d07-4271-bcf9-ef995f79c2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:49.230506 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4515/8984] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:49.239681 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5e33-29e3-46fc-b643-39019ac44d56 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:49.239966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5e33-29e3-46fc-b643-39019ac44d56 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:49.240238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5e33-29e3-46fc-b643-39019ac44d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:49.247854 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:49.262765 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-acbd5e33-29e3-46fc-b643-39019ac44d56 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:49.263969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-acbd5e33-29e3-46fc-b643-39019ac44d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:49.272770 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4470/8985] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:49.276948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f8318-4d07-4271-bcf9-ef995f79c2e0 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:49.286431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f8318-4d07-4271-bcf9-ef995f79c2e0 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:49.291012 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fdcf8-84f9-47f0-9919-17d7d89f6e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:49.291530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fdcf8-84f9-47f0-9919-17d7d89f6e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:49.291806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fdcf8-84f9-47f0-9919-17d7d89f6e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:49.292071 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fdcf8-84f9-47f0-9919-17d7d89f6e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:49.292703 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fdcf8-84f9-47f0-9919-17d7d89f6e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 02:04:49.293007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fdcf8-84f9-47f0-9919-17d7d89f6e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:49.294574 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fdcf8-84f9-47f0-9919-17d7d89f6e9e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:49.305818 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4516/8986] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 02:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 02:04:49.310005 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd5e33-29e3-46fc-b643-39019ac44d56 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:49.319719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd5e33-29e3-46fc-b643-39019ac44d56 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:49.324583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7089-2279-4ac8-a4d2-b87784361efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:49.325175 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7089-2279-4ac8-a4d2-b87784361efa admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:49.325454 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7089-2279-4ac8-a4d2-b87784361efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:49.325735 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7089-2279-4ac8-a4d2-b87784361efa admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:49.326353 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7089-2279-4ac8-a4d2-b87784361efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:49.328877 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7089-2279-4ac8-a4d2-b87784361efa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:49.356428 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4471/8987] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:04:49 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:04:49.360611 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fdcf8-84f9-47f0-9919-17d7d89f6e9e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:49.370562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fdcf8-84f9-47f0-9919-17d7d89f6e9e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:49.402348 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:49.431879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abf8b6-3c9c-44fe-8cf5-16c319ec6983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:49.432547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abf8b6-3c9c-44fe-8cf5-16c319ec6983 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:49.432829 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abf8b6-3c9c-44fe-8cf5-16c319ec6983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:49.433104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abf8b6-3c9c-44fe-8cf5-16c319ec6983 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:49.433737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abf8b6-3c9c-44fe-8cf5-16c319ec6983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:49.435731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abf8b6-3c9c-44fe-8cf5-16c319ec6983 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:49.458467 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4517/8988] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:04:49 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:04:49.462662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7089-2279-4ac8-a4d2-b87784361efa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:49.473031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7089-2279-4ac8-a4d2-b87784361efa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:49.477604 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0b1b5-cf03-484f-af12-a8e8cd5157c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:49.478202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0b1b5-cf03-484f-af12-a8e8cd5157c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:49.478478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0b1b5-cf03-484f-af12-a8e8cd5157c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:49.478781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0b1b5-cf03-484f-af12-a8e8cd5157c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:49.479420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0b1b5-cf03-484f-af12-a8e8cd5157c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:49.481006 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0b1b5-cf03-484f-af12-a8e8cd5157c8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:49.491948 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4472/8989] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:04:49.495731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abf8b6-3c9c-44fe-8cf5-16c319ec6983 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:49.506382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abf8b6-3c9c-44fe-8cf5-16c319ec6983 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:49.510987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c861d-af9a-4b7b-baa3-ed331dd27f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:49.511570 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c861d-af9a-4b7b-baa3-ed331dd27f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:49.511852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c861d-af9a-4b7b-baa3-ed331dd27f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:49.512123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c861d-af9a-4b7b-baa3-ed331dd27f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:49.512757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c861d-af9a-4b7b-baa3-ed331dd27f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:49.514365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c861d-af9a-4b7b-baa3-ed331dd27f8d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:49.524401 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4518/8990] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:04:49.528366 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0b1b5-cf03-484f-af12-a8e8cd5157c8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:49.538362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0b1b5-cf03-484f-af12-a8e8cd5157c8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:49.543056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14a032-ff57-4433-8010-9719ab3e1b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:49.543638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14a032-ff57-4433-8010-9719ab3e1b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:49.543922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14a032-ff57-4433-8010-9719ab3e1b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:49.544202 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14a032-ff57-4433-8010-9719ab3e1b62 admin admin] PATH_INFO: `/v3/projects/99b7a97088bd433ebe3a0a70f027de2f/users/66aadeddc0524f2ab7c167aae9a30468/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:49.559262 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14a032-ff57-4433-8010-9719ab3e1b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b7a97088bd433ebe3a0a70f027de2f, user_id=66aadeddc0524f2ab7c167aae9a30468, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:49.561926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14a032-ff57-4433-8010-9719ab3e1b62 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:49.575738 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4473/8991] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:04:49 2022] PUT /identity/v3/projects/99b7a97088bd433ebe3a0a70f027de2f/users/66aadeddc0524f2ab7c167aae9a30468/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:04:49.581188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241c68a-0852-4dfc-a2c6-19d60c695add None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:49.581668 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241c68a-0852-4dfc-a2c6-19d60c695add None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:49.581786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241c68a-0852-4dfc-a2c6-19d60c695add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:49.600818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-8241c68a-0852-4dfc-a2c6-19d60c695add None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:49.602022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-8241c68a-0852-4dfc-a2c6-19d60c695add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:49.661021 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4519/8992] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:49.670878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14a032-ff57-4433-8010-9719ab3e1b62 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:49.673320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c14a032-ff57-4433-8010-9719ab3e1b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:49.730944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14a032-ff57-4433-8010-9719ab3e1b62 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:49.735188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362aaac7-5b61-4c8b-9625-45d987c44a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:49.735841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362aaac7-5b61-4c8b-9625-45d987c44a5f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:49.736117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362aaac7-5b61-4c8b-9625-45d987c44a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:49.736385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362aaac7-5b61-4c8b-9625-45d987c44a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:49.745257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362aaac7-5b61-4c8b-9625-45d987c44a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:49.746721 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362aaac7-5b61-4c8b-9625-45d987c44a5f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:49.756619 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4474/8993] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:04:53.930516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6f1ef-a05f-4c24-ab9d-1bc27f6c3609 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:53.931070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6f1ef-a05f-4c24-ab9d-1bc27f6c3609 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:53.931448 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6f1ef-a05f-4c24-ab9d-1bc27f6c3609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:53.965192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0df6f1ef-a05f-4c24-ab9d-1bc27f6c3609 None None] MFA Rules not processed for user `66aadeddc0524f2ab7c167aae9a30468`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:53.966960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0df6f1ef-a05f-4c24-ab9d-1bc27f6c3609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:54.042342 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4520/8994] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:54.046921 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362aaac7-5b61-4c8b-9625-45d987c44a5f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:54.057321 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362aaac7-5b61-4c8b-9625-45d987c44a5f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:54.062303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56228c39-2939-4cc2-8cc7-bf8fd47301a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:54.063324 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56228c39-2939-4cc2-8cc7-bf8fd47301a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:54.063689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56228c39-2939-4cc2-8cc7-bf8fd47301a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:54.064024 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56228c39-2939-4cc2-8cc7-bf8fd47301a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:54.064726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56228c39-2939-4cc2-8cc7-bf8fd47301a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:54.066742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56228c39-2939-4cc2-8cc7-bf8fd47301a4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:54.096581 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4475/8995] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:04:54 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:04:54.100907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6f1ef-a05f-4c24-ab9d-1bc27f6c3609 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:54.112941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6f1ef-a05f-4c24-ab9d-1bc27f6c3609 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:54.154674 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:54.181059 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bbcb6-2eb6-49ab-a4a1-9a8c11a46337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:54.181767 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bbcb6-2eb6-49ab-a4a1-9a8c11a46337 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:54.182116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bbcb6-2eb6-49ab-a4a1-9a8c11a46337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:54.182464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bbcb6-2eb6-49ab-a4a1-9a8c11a46337 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:54.183201 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bbcb6-2eb6-49ab-a4a1-9a8c11a46337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:54.185263 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bbcb6-2eb6-49ab-a4a1-9a8c11a46337 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:54.215127 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4521/8996] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:04:54 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:04:54.216500 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56228c39-2939-4cc2-8cc7-bf8fd47301a4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:54.228617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56228c39-2939-4cc2-8cc7-bf8fd47301a4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:54.236820 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4149fb-15cb-4791-a666-1d46f31ca7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:54.237532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4149fb-15cb-4791-a666-1d46f31ca7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:54.237809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4149fb-15cb-4791-a666-1d46f31ca7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:54.238078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4149fb-15cb-4791-a666-1d46f31ca7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:54.238763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4149fb-15cb-4791-a666-1d46f31ca7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:54.240416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4149fb-15cb-4791-a666-1d46f31ca7fa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:54.255777 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4476/8997] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:04:54.256904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bbcb6-2eb6-49ab-a4a1-9a8c11a46337 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:54.267996 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bbcb6-2eb6-49ab-a4a1-9a8c11a46337 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:54.272752 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892f236-13c0-4a35-a5fb-a46eb706b8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:54.273470 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f236-13c0-4a35-a5fb-a46eb706b8f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:54.273718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f236-13c0-4a35-a5fb-a46eb706b8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:54.273999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f236-13c0-4a35-a5fb-a46eb706b8f2 admin admin] PATH_INFO: `/v3/projects/6cd57fb02c934b37b9ac64947556ca07/users/a25911be624e40dea5605aa8c8379fc8/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:54.292013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892f236-13c0-4a35-a5fb-a46eb706b8f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd57fb02c934b37b9ac64947556ca07, user_id=a25911be624e40dea5605aa8c8379fc8, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:54.294828 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892f236-13c0-4a35-a5fb-a46eb706b8f2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:54.309766 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4522/8998] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:04:54 2022] PUT /identity/v3/projects/6cd57fb02c934b37b9ac64947556ca07/users/a25911be624e40dea5605aa8c8379fc8/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:04:54.314316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4149fb-15cb-4791-a666-1d46f31ca7fa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:54.325051 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4149fb-15cb-4791-a666-1d46f31ca7fa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:54.385621 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0108022-d04d-409c-9d57-9a5a4961c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:54.386289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0108022-d04d-409c-9d57-9a5a4961c6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:54.386576 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0108022-d04d-409c-9d57-9a5a4961c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:54.386917 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0108022-d04d-409c-9d57-9a5a4961c6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:54.387661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0108022-d04d-409c-9d57-9a5a4961c6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:54.389450 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0108022-d04d-409c-9d57-9a5a4961c6d1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:54.399941 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4477/8999] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 02:04:54.404094 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892f236-13c0-4a35-a5fb-a46eb706b8f2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:54.414530 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892f236-13c0-4a35-a5fb-a46eb706b8f2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:54.419158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efd9ce-b0d0-4a5c-8405-697c9b78866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:54.419804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efd9ce-b0d0-4a5c-8405-697c9b78866e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:54.420083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efd9ce-b0d0-4a5c-8405-697c9b78866e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:54.420354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efd9ce-b0d0-4a5c-8405-697c9b78866e admin admin] PATH_INFO: `/v3/projects/6cd57fb02c934b37b9ac64947556ca07/users/a25911be624e40dea5605aa8c8379fc8/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:54.422531 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efd9ce-b0d0-4a5c-8405-697c9b78866e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd57fb02c934b37b9ac64947556ca07, user_id=a25911be624e40dea5605aa8c8379fc8, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:54.425192 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efd9ce-b0d0-4a5c-8405-697c9b78866e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:54.435222 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4523/9000] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:04:54 2022] PUT /identity/v3/projects/6cd57fb02c934b37b9ac64947556ca07/users/a25911be624e40dea5605aa8c8379fc8/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:04:59.406457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098b2bd-c7c3-4c88-8abf-66c22c49cae4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:59.407072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098b2bd-c7c3-4c88-8abf-66c22c49cae4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:59.407072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098b2bd-c7c3-4c88-8abf-66c22c49cae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:59.415900 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:04:59.460117 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0098b2bd-c7c3-4c88-8abf-66c22c49cae4 None None] MFA Rules not processed for user `a25911be624e40dea5605aa8c8379fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:59.462741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0098b2bd-c7c3-4c88-8abf-66c22c49cae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:59.586477 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4478/9001] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:04:59.605255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efd9ce-b0d0-4a5c-8405-697c9b78866e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:04:59.609850 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-34efd9ce-b0d0-4a5c-8405-697c9b78866e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:59.732374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efd9ce-b0d0-4a5c-8405-697c9b78866e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:04:59.739559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d35f9-fb51-4c8f-ada1-f316661520b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:04:59.740194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d35f9-fb51-4c8f-ada1-f316661520b0 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:59.740569 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d35f9-fb51-4c8f-ada1-f316661520b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:59.740872 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d35f9-fb51-4c8f-ada1-f316661520b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:59.811374 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d35f9-fb51-4c8f-ada1-f316661520b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:04:59.813104 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d35f9-fb51-4c8f-ada1-f316661520b0 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:04:59.825248 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4524/9002] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:04:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:04:59.902484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d3609-681c-407e-81a9-774818d4dbbc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:04:59.903057 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d3609-681c-407e-81a9-774818d4dbbc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:04:59.903456 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d3609-681c-407e-81a9-774818d4dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:04:59.929984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e26d3609-681c-407e-81a9-774818d4dbbc None None] MFA Rules not processed for user `66aadeddc0524f2ab7c167aae9a30468`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:04:59.931514 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e26d3609-681c-407e-81a9-774818d4dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:04:59.943831 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4479/9003] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:04:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:05:00.236770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d35f9-fb51-4c8f-ada1-f316661520b0 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:05:00.283483 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:00.308325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d35f9-fb51-4c8f-ada1-f316661520b0 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:05:00.311920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db418a06-f20d-4a75-9555-8eb2aa8c1fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:05:00.313140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db418a06-f20d-4a75-9555-8eb2aa8c1fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:05:00.313790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db418a06-f20d-4a75-9555-8eb2aa8c1fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:05:00.313790 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db418a06-f20d-4a75-9555-8eb2aa8c1fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:05:00.316166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-db418a06-f20d-4a75-9555-8eb2aa8c1fe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:05:00.326808 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db418a06-f20d-4a75-9555-8eb2aa8c1fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:05:00.328906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db418a06-f20d-4a75-9555-8eb2aa8c1fe2 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:05:00.336776 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4525/9004] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:05:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:05:02.571119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d3609-681c-407e-81a9-774818d4dbbc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:05:02.584587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d3609-681c-407e-81a9-774818d4dbbc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:05:02.588364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469eeb-431c-43e6-95f7-1f30a8b8daee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:05:02.588979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469eeb-431c-43e6-95f7-1f30a8b8daee service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:05:02.589256 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469eeb-431c-43e6-95f7-1f30a8b8daee service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:05:02.589527 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469eeb-431c-43e6-95f7-1f30a8b8daee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:05:02.591522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-43469eeb-431c-43e6-95f7-1f30a8b8daee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:05:02.603397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43469eeb-431c-43e6-95f7-1f30a8b8daee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:05:02.604970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43469eeb-431c-43e6-95f7-1f30a8b8daee service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:05:02.616467 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4480/9005] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:05:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:05:08.753875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db418a06-f20d-4a75-9555-8eb2aa8c1fe2 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:05:08.768335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db418a06-f20d-4a75-9555-8eb2aa8c1fe2 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:05:08.773836 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794eaede-fc72-4d74-afd7-f4e9ad46d132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:05:08.774433 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eaede-fc72-4d74-afd7-f4e9ad46d132 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:05:08.774742 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eaede-fc72-4d74-afd7-f4e9ad46d132 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:05:08.775016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eaede-fc72-4d74-afd7-f4e9ad46d132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:05:08.776718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-794eaede-fc72-4d74-afd7-f4e9ad46d132 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:05:08.791357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794eaede-fc72-4d74-afd7-f4e9ad46d132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:05:08.792962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794eaede-fc72-4d74-afd7-f4e9ad46d132 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:05:08.804094 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4526/9006] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:05:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:05:11.637866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469eeb-431c-43e6-95f7-1f30a8b8daee service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:05:11.639357 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-43469eeb-431c-43e6-95f7-1f30a8b8daee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:05:11.696764 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469eeb-431c-43e6-95f7-1f30a8b8daee service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:05:11.700617 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce000f-7d98-40a5-96e4-09d50e82fb94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:05:11.701216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce000f-7d98-40a5-96e4-09d50e82fb94 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:05:11.701497 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce000f-7d98-40a5-96e4-09d50e82fb94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:05:11.701767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce000f-7d98-40a5-96e4-09d50e82fb94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:05:11.710752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce000f-7d98-40a5-96e4-09d50e82fb94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:05:11.712190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce000f-7d98-40a5-96e4-09d50e82fb94 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:05:11.721466 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4481/9007] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:05:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:05:18.799651 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=19 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:21.717264 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=67 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:36.950803 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a33012-3a9f-462f-ae31-4a2997bdf29f None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:05:36.951306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a33012-3a9f-462f-ae31-4a2997bdf29f None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:05:36.951427 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a33012-3a9f-462f-ae31-4a2997bdf29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:05:36.971195 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-e5a33012-3a9f-462f-ae31-4a2997bdf29f None None] MFA Rules not processed for user `66aadeddc0524f2ab7c167aae9a30468`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:05:36.972554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e5a33012-3a9f-462f-ae31-4a2997bdf29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:05:36.979460 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4527/9008] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:05:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:05:37.543022 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce000f-7d98-40a5-96e4-09d50e82fb94 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:05:37.544525 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-06ce000f-7d98-40a5-96e4-09d50e82fb94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:05:37.619182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce000f-7d98-40a5-96e4-09d50e82fb94 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:05:37.624471 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4eee8-00b9-4111-a3bf-19b409a53a84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:05:37.625082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4eee8-00b9-4111-a3bf-19b409a53a84 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:05:37.625365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4eee8-00b9-4111-a3bf-19b409a53a84 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:05:37.625641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4eee8-00b9-4111-a3bf-19b409a53a84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:05:37.627698 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-13c4eee8-00b9-4111-a3bf-19b409a53a84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:05:37.639190 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4eee8-00b9-4111-a3bf-19b409a53a84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:05:37.640777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4eee8-00b9-4111-a3bf-19b409a53a84 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:05:37.650498 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4482/9009] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:05:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:05:40.071907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a33012-3a9f-462f-ae31-4a2997bdf29f None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:05:40.086697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a33012-3a9f-462f-ae31-4a2997bdf29f None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:05:40.092063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc461bf-e0dc-4f2d-9b41-2aa39c56ab4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:05:40.092672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc461bf-e0dc-4f2d-9b41-2aa39c56ab4d service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:05:40.092950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc461bf-e0dc-4f2d-9b41-2aa39c56ab4d service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:05:40.093221 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc461bf-e0dc-4f2d-9b41-2aa39c56ab4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:05:40.094982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ddc461bf-e0dc-4f2d-9b41-2aa39c56ab4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:05:40.107255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc461bf-e0dc-4f2d-9b41-2aa39c56ab4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:05:40.108844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc461bf-e0dc-4f2d-9b41-2aa39c56ab4d service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:05:40.121190 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4528/9010] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:05:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:05:47.646416 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=32 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:05:50.116759 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=9 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:14.796488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e9edb-5b98-4171-91df-09e9c37e5dee None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:06:14.797007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e9edb-5b98-4171-91df-09e9c37e5dee None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:06:14.797307 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e9edb-5b98-4171-91df-09e9c37e5dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:06:14.817666 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-985e9edb-5b98-4171-91df-09e9c37e5dee None None] MFA Rules not processed for user `66aadeddc0524f2ab7c167aae9a30468`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:06:14.818910 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-985e9edb-5b98-4171-91df-09e9c37e5dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:06:14.826028 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4483/9011] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:06:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:06:15.407940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc461bf-e0dc-4f2d-9b41-2aa39c56ab4d service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:06:15.419930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc461bf-e0dc-4f2d-9b41-2aa39c56ab4d service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:06:15.425518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4202f-2e74-4d1d-a75a-80397c7973f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:06:15.426121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4202f-2e74-4d1d-a75a-80397c7973f7 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:06:15.426476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4202f-2e74-4d1d-a75a-80397c7973f7 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:06:15.426786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4202f-2e74-4d1d-a75a-80397c7973f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:06:15.428493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d3d4202f-2e74-4d1d-a75a-80397c7973f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:06:15.440674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4202f-2e74-4d1d-a75a-80397c7973f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:06:15.442256 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4202f-2e74-4d1d-a75a-80397c7973f7 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:06:15.452714 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4529/9012] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:06:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:06:24.811812 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:25.448052 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:31.871976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e9edb-5b98-4171-91df-09e9c37e5dee None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:06:31.882232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e9edb-5b98-4171-91df-09e9c37e5dee None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:06:31.885802 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef7246-8361-4e2d-80b3-0f4ae6907218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:06:31.886425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef7246-8361-4e2d-80b3-0f4ae6907218 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:06:31.886852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef7246-8361-4e2d-80b3-0f4ae6907218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:06:31.887133 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef7246-8361-4e2d-80b3-0f4ae6907218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:06:31.888929 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5fef7246-8361-4e2d-80b3-0f4ae6907218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5fef7246-8361-4e2d-80b3-0f4ae6907218 service neutron] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 02 02:06:31.898966 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 203, in _is_valid_token Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 02 02:06:31.900223 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4484/9013] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:06:31 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 02 02:06:31.983350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4202f-2e74-4d1d-a75a-80397c7973f7 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:06:31.993317 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4202f-2e74-4d1d-a75a-80397c7973f7 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:06:31.996895 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e10d61-8dde-4ff3-a88b-b583518ee5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:06:31.997482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e10d61-8dde-4ff3-a88b-b583518ee5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:06:31.997761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e10d61-8dde-4ff3-a88b-b583518ee5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:06:31.998032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e10d61-8dde-4ff3-a88b-b583518ee5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:06:31.999748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-31e10d61-8dde-4ff3-a88b-b583518ee5b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application [None req-31e10d61-8dde-4ff3-a88b-b583518ee5b7 service neutron] Could not find project: 1ff590c5b5cc499386a58d5b84c7462b.: keystone.exception.ProjectNotFound: Could not find project: 1ff590c5b5cc499386a58d5b84c7462b. Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 02 02:06:32.029426 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 02:06:32.030799 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self._validate_token_resources() Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 02 02:06:32.032156 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.get_or_create( Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application with Lock( Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._enter() Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.creator() Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application created_value = creator( Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 02 02:06:32.033409 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 02 02:06:32.037457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1ff590c5b5cc499386a58d5b84c7462b. Oct 02 02:06:32.037457 n-d-master-1 devstack@keystone.service[81853]: ERROR keystone.server.flask.application Oct 02 02:06:32.037457 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4530/9014] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:06:31 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 02 02:06:32.045064 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a72ee8-77a7-45a9-a789-6cd795be2978 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:06:32.045348 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a72ee8-77a7-45a9-a789-6cd795be2978 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:06:32.045619 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a72ee8-77a7-45a9-a789-6cd795be2978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:06:32.067444 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-18a72ee8-77a7-45a9-a789-6cd795be2978 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:06:32.068646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-18a72ee8-77a7-45a9-a789-6cd795be2978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:06:32.078236 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4485/9015] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 2 02:06:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 02:06:32.084341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e733d-1a95-4fbd-a5d2-5908a1d08c29 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:06:32.084748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e733d-1a95-4fbd-a5d2-5908a1d08c29 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:06:32.085030 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e733d-1a95-4fbd-a5d2-5908a1d08c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:06:32.104873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-bd1e733d-1a95-4fbd-a5d2-5908a1d08c29 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:06:32.106064 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bd1e733d-1a95-4fbd-a5d2-5908a1d08c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:06:32.115953 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4531/9016] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 02:06:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:06:32.125768 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a72ee8-77a7-45a9-a789-6cd795be2978 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:06:32.135755 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a72ee8-77a7-45a9-a789-6cd795be2978 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:06:32.139411 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3de41-32d5-4b8d-9251-8af35a467224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:06:32.140012 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3de41-32d5-4b8d-9251-8af35a467224 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:06:32.140289 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3de41-32d5-4b8d-9251-8af35a467224 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:06:32.140562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3de41-32d5-4b8d-9251-8af35a467224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:06:32.151452 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3de41-32d5-4b8d-9251-8af35a467224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:06:32.152818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3de41-32d5-4b8d-9251-8af35a467224 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:06:32.165095 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4486/9017] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:06:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:06:42.100003 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=7 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:42.159722 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=11 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:59.088083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e733d-1a95-4fbd-a5d2-5908a1d08c29 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:06:59.152582 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e733d-1a95-4fbd-a5d2-5908a1d08c29 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:06:59.157124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:06:59.157749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:06:59.158031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:06:59.158305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] PATH_INFO: `/v3/users/66aadeddc0524f2ab7c167aae9a30468` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:06:59.159452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66aadeddc0524f2ab7c167aae9a30468)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:06:59.162223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:06:59.207949 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66aadeddc0524f2ab7c167aae9a30468'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.219897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66aadeddc0524f2ab7c167aae9a30468'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.220564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66aadeddc0524f2ab7c167aae9a30468'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.237089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66aadeddc0524f2ab7c167aae9a30468'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.237704 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66aadeddc0524f2ab7c167aae9a30468'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.253371 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4532/9018] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:06:59 2022] DELETE /identity/v3/users/66aadeddc0524f2ab7c167aae9a30468 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:06:59.425879 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3de41-32d5-4b8d-9251-8af35a467224 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:06:59.437145 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3de41-32d5-4b8d-9251-8af35a467224 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:06:59.496304 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:06:59.496946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:06:59.497218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:06:59.497491 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] PATH_INFO: `/v3/projects/99b7a97088bd433ebe3a0a70f027de2f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:06:59.498691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b7a97088bd433ebe3a0a70f027de2f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:06:59.500543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:06:59.545628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b7a97088bd433ebe3a0a70f027de2f', 'request_id': 'req-438c7867-32a9-48c9-a249-6c2a0eb4605b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.551086 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b7a97088bd433ebe3a0a70f027de2f', 'request_id': 'req-438c7867-32a9-48c9-a249-6c2a0eb4605b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.557548 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b7a97088bd433ebe3a0a70f027de2f', 'request_id': 'req-438c7867-32a9-48c9-a249-6c2a0eb4605b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.569945 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] The token cache is being invalidate because project 99b7a97088bd433ebe3a0a70f027de2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:06:59.570239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.570901 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.572429 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4487/9019] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:06:59 2022] DELETE /identity/v3/projects/99b7a97088bd433ebe3a0a70f027de2f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:06:59.576849 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:06:59.578260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:06:59.591694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b0e7d-acca-4ae2-88eb-26199be6cb50 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:06:59.647186 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26c70d-b0ad-4c35-9de4-86eccbb889c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:06:59.647731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26c70d-b0ad-4c35-9de4-86eccbb889c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:06:59.648013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26c70d-b0ad-4c35-9de4-86eccbb889c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:06:59.648289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26c70d-b0ad-4c35-9de4-86eccbb889c7 admin admin] PATH_INFO: `/v3/users/a25911be624e40dea5605aa8c8379fc8` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:06:59.649418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26c70d-b0ad-4c35-9de4-86eccbb889c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25911be624e40dea5605aa8c8379fc8)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:06:59.651434 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26c70d-b0ad-4c35-9de4-86eccbb889c7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:06:59.672586 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:06:59.703326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1d26c70d-b0ad-4c35-9de4-86eccbb889c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25911be624e40dea5605aa8c8379fc8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.716609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1d26c70d-b0ad-4c35-9de4-86eccbb889c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25911be624e40dea5605aa8c8379fc8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.717370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1d26c70d-b0ad-4c35-9de4-86eccbb889c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25911be624e40dea5605aa8c8379fc8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.725016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1d26c70d-b0ad-4c35-9de4-86eccbb889c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25911be624e40dea5605aa8c8379fc8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.725637 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-1d26c70d-b0ad-4c35-9de4-86eccbb889c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25911be624e40dea5605aa8c8379fc8'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:06:59.738234 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4533/9020] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:06:59 2022] DELETE /identity/v3/users/a25911be624e40dea5605aa8c8379fc8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:06:59.931904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:06:59.933636 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:06:59.952758 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c7867-32a9-48c9-a249-6c2a0eb4605b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:00.020000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:00.020867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:00.021131 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:00.021364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] PATH_INFO: `/v3/projects/6cd57fb02c934b37b9ac64947556ca07` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:00.022490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd57fb02c934b37b9ac64947556ca07)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:00.024457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:00.059374 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:00.072559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd57fb02c934b37b9ac64947556ca07', 'request_id': 'req-f669aec8-07c1-411a-a125-74e29d993c63'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:07:00.078410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd57fb02c934b37b9ac64947556ca07', 'request_id': 'req-f669aec8-07c1-411a-a125-74e29d993c63'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:07:00.084826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd57fb02c934b37b9ac64947556ca07', 'request_id': 'req-f669aec8-07c1-411a-a125-74e29d993c63'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:07:00.096946 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] The token cache is being invalidate because project 6cd57fb02c934b37b9ac64947556ca07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:07:00.097237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:07:00.097882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f669aec8-07c1-411a-a125-74e29d993c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:07:00.099995 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4488/9021] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:06:59 2022] DELETE /identity/v3/projects/6cd57fb02c934b37b9ac64947556ca07 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:07:00.104962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b7af0-495b-4e61-b78f-607f1f71fa6e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:00.105430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b7af0-495b-4e61-b78f-607f1f71fa6e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:00.105532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b7af0-495b-4e61-b78f-607f1f71fa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:00.126031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-db4b7af0-495b-4e61-b78f-607f1f71fa6e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:07:00.127259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-db4b7af0-495b-4e61-b78f-607f1f71fa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:00.185084 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4534/9022] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:07:00.194226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c157f4e-7051-4781-b4c4-f5b653ed0bae None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:00.194515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c157f4e-7051-4781-b4c4-f5b653ed0bae None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:00.194825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c157f4e-7051-4781-b4c4-f5b653ed0bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:00.215296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8c157f4e-7051-4781-b4c4-f5b653ed0bae None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:07:00.216558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8c157f4e-7051-4781-b4c4-f5b653ed0bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:00.224433 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4489/9023] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:07:00.228628 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b7af0-495b-4e61-b78f-607f1f71fa6e None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:00.238132 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b7af0-495b-4e61-b78f-607f1f71fa6e None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:00.243239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183e9ff-b7ae-450c-bcb2-af6b32a4a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:00.243827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e9ff-b7ae-450c-bcb2-af6b32a4a3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:00.244102 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e9ff-b7ae-450c-bcb2-af6b32a4a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:00.244369 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e9ff-b7ae-450c-bcb2-af6b32a4a3f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:00.245000 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183e9ff-b7ae-450c-bcb2-af6b32a4a3f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 02:07:00.245298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183e9ff-b7ae-450c-bcb2-af6b32a4a3f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:00.246908 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183e9ff-b7ae-450c-bcb2-af6b32a4a3f0 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:00.258346 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4535/9024] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 02:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 02:07:00.262490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c157f4e-7051-4781-b4c4-f5b653ed0bae None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:00.272425 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c157f4e-7051-4781-b4c4-f5b653ed0bae None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:00.277084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488439b2-60a6-4399-99c6-7fe72d035536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:00.277677 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488439b2-60a6-4399-99c6-7fe72d035536 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:00.277957 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488439b2-60a6-4399-99c6-7fe72d035536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:00.278238 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488439b2-60a6-4399-99c6-7fe72d035536 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:00.278909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488439b2-60a6-4399-99c6-7fe72d035536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:00.280873 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488439b2-60a6-4399-99c6-7fe72d035536 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:00.312279 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4490/9025] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:07:00 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:07:00.313463 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183e9ff-b7ae-450c-bcb2-af6b32a4a3f0 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:00.323806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183e9ff-b7ae-450c-bcb2-af6b32a4a3f0 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:00.382537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb089145-67a3-4032-a0d6-1779afc8b0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:00.383174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb089145-67a3-4032-a0d6-1779afc8b0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:00.383458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb089145-67a3-4032-a0d6-1779afc8b0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:00.383736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb089145-67a3-4032-a0d6-1779afc8b0ce admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:00.384359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb089145-67a3-4032-a0d6-1779afc8b0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:00.386284 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb089145-67a3-4032-a0d6-1779afc8b0ce admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:00.407364 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4536/9026] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:07:00 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:07:00.411724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488439b2-60a6-4399-99c6-7fe72d035536 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:00.421967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488439b2-60a6-4399-99c6-7fe72d035536 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:00.427426 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fd16e-0368-4d1b-acaf-3b072790883d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:00.428388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fd16e-0368-4d1b-acaf-3b072790883d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:00.428872 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fd16e-0368-4d1b-acaf-3b072790883d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:00.429319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fd16e-0368-4d1b-acaf-3b072790883d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:00.430408 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fd16e-0368-4d1b-acaf-3b072790883d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:00.433710 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fd16e-0368-4d1b-acaf-3b072790883d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:00.445554 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4491/9027] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:07:00.449512 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb089145-67a3-4032-a0d6-1779afc8b0ce admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:00.460174 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb089145-67a3-4032-a0d6-1779afc8b0ce admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:00.465412 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8ad1-fc1f-4aba-9298-6421dc7b2c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:00.466003 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8ad1-fc1f-4aba-9298-6421dc7b2c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:00.466288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8ad1-fc1f-4aba-9298-6421dc7b2c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:00.466564 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8ad1-fc1f-4aba-9298-6421dc7b2c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:00.467241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f8ad1-fc1f-4aba-9298-6421dc7b2c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:00.469370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f8ad1-fc1f-4aba-9298-6421dc7b2c34 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:00.480383 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4537/9028] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 02:07:00.484575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fd16e-0368-4d1b-acaf-3b072790883d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:00.495319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fd16e-0368-4d1b-acaf-3b072790883d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:00.499894 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3409976-9e3e-4c4c-8221-7c99653d18b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:00.500535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3409976-9e3e-4c4c-8221-7c99653d18b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:00.500814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3409976-9e3e-4c4c-8221-7c99653d18b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:00.501089 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3409976-9e3e-4c4c-8221-7c99653d18b8 admin admin] PATH_INFO: `/v3/projects/e94ca75d802e46e3aa9cc7bb492107fa/users/95d2890faf84462493c012c0619b663f/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:00.516106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3409976-9e3e-4c4c-8221-7c99653d18b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94ca75d802e46e3aa9cc7bb492107fa, user_id=95d2890faf84462493c012c0619b663f, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:00.518769 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3409976-9e3e-4c4c-8221-7c99653d18b8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:00.531178 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4492/9029] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:07:00 2022] PUT /identity/v3/projects/e94ca75d802e46e3aa9cc7bb492107fa/users/95d2890faf84462493c012c0619b663f/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 02:07:00.536222 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28462-2a6f-453d-9c3a-9cadad6aca6e None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:00.536584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28462-2a6f-453d-9c3a-9cadad6aca6e None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:00.536929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28462-2a6f-453d-9c3a-9cadad6aca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:00.544973 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:00.558061 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-56a28462-2a6f-453d-9c3a-9cadad6aca6e None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:07:00.559310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-56a28462-2a6f-453d-9c3a-9cadad6aca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:00.617992 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4538/9030] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:07:00.628003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3409976-9e3e-4c4c-8221-7c99653d18b8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:00.629852 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b3409976-9e3e-4c4c-8221-7c99653d18b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:00.688510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3409976-9e3e-4c4c-8221-7c99653d18b8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:00.692192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674e77f-da78-40e2-bde4-0fc518d552fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:00.692794 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e77f-da78-40e2-bde4-0fc518d552fc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:00.693069 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e77f-da78-40e2-bde4-0fc518d552fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:00.693381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e77f-da78-40e2-bde4-0fc518d552fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:00.702538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674e77f-da78-40e2-bde4-0fc518d552fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:00.704017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674e77f-da78-40e2-bde4-0fc518d552fc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:00.713352 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4493/9031] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:07:04.832014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462417-2a0a-4757-ab0d-2850d9731712 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:04.832540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462417-2a0a-4757-ab0d-2850d9731712 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:04.832540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462417-2a0a-4757-ab0d-2850d9731712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:04.865764 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-86462417-2a0a-4757-ab0d-2850d9731712 None None] MFA Rules not processed for user `95d2890faf84462493c012c0619b663f`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:07:04.867299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-86462417-2a0a-4757-ab0d-2850d9731712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:04.939775 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4539/9032] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:07:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:07:04.945266 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674e77f-da78-40e2-bde4-0fc518d552fc service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:04.955522 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674e77f-da78-40e2-bde4-0fc518d552fc service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:04.961000 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6204abd-cee9-4f28-a0e9-1c823cfc458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:04.961694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6204abd-cee9-4f28-a0e9-1c823cfc458a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:04.962037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6204abd-cee9-4f28-a0e9-1c823cfc458a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:04.962375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6204abd-cee9-4f28-a0e9-1c823cfc458a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:04.963158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6204abd-cee9-4f28-a0e9-1c823cfc458a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:04.966047 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6204abd-cee9-4f28-a0e9-1c823cfc458a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:04.996191 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4494/9033] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:07:04 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:07:05.000476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86462417-2a0a-4757-ab0d-2850d9731712 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:05.012088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86462417-2a0a-4757-ab0d-2850d9731712 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:05.070909 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f10cf-7f52-44c6-b4d6-f26ebf6e9347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:05.071518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f10cf-7f52-44c6-b4d6-f26ebf6e9347 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:05.071801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f10cf-7f52-44c6-b4d6-f26ebf6e9347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:05.072081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f10cf-7f52-44c6-b4d6-f26ebf6e9347 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:05.072726 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f10cf-7f52-44c6-b4d6-f26ebf6e9347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:05.074679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f10cf-7f52-44c6-b4d6-f26ebf6e9347 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:05.096354 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4540/9034] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:07:04 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:07:05.101107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6204abd-cee9-4f28-a0e9-1c823cfc458a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:05.111458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6204abd-cee9-4f28-a0e9-1c823cfc458a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:05.116896 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74843c09-a8e6-4336-a1d3-5b72aa7db965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:05.117521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74843c09-a8e6-4336-a1d3-5b72aa7db965 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:05.117824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74843c09-a8e6-4336-a1d3-5b72aa7db965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:05.118090 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74843c09-a8e6-4336-a1d3-5b72aa7db965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:05.118767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74843c09-a8e6-4336-a1d3-5b72aa7db965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:05.120416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74843c09-a8e6-4336-a1d3-5b72aa7db965 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:05.131400 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4495/9035] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:07:05.135568 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f10cf-7f52-44c6-b4d6-f26ebf6e9347 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:05.145551 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f10cf-7f52-44c6-b4d6-f26ebf6e9347 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:05.150288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0face-8293-4fa6-b9c9-0b7e308711d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:05.150994 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0face-8293-4fa6-b9c9-0b7e308711d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:05.151283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0face-8293-4fa6-b9c9-0b7e308711d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:05.151557 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0face-8293-4fa6-b9c9-0b7e308711d2 admin admin] PATH_INFO: `/v3/projects/2c882f75a9e3487183444a1df48a8b5d/users/e247afbad2f34d21b88ab66b931ddb2a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:05.167804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0face-8293-4fa6-b9c9-0b7e308711d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c882f75a9e3487183444a1df48a8b5d, user_id=e247afbad2f34d21b88ab66b931ddb2a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:05.170827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0face-8293-4fa6-b9c9-0b7e308711d2 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:05.180089 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:05.185492 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4541/9036] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:07:05 2022] PUT /identity/v3/projects/2c882f75a9e3487183444a1df48a8b5d/users/e247afbad2f34d21b88ab66b931ddb2a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:07:05.189846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74843c09-a8e6-4336-a1d3-5b72aa7db965 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:05.200188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74843c09-a8e6-4336-a1d3-5b72aa7db965 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:05.225242 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:05.259577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16c199-25de-4248-af80-b53bbadf7016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:05.260217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c199-25de-4248-af80-b53bbadf7016 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:05.260504 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c199-25de-4248-af80-b53bbadf7016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:05.260788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c199-25de-4248-af80-b53bbadf7016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:05.261457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16c199-25de-4248-af80-b53bbadf7016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:05.263102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16c199-25de-4248-af80-b53bbadf7016 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:05.273294 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4496/9037] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:07:05.277575 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0face-8293-4fa6-b9c9-0b7e308711d2 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:05.288191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0face-8293-4fa6-b9c9-0b7e308711d2 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:05.292835 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67f450-9aa4-4475-87af-ea943c7f7faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:05.293484 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67f450-9aa4-4475-87af-ea943c7f7faf admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:05.293769 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67f450-9aa4-4475-87af-ea943c7f7faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:05.294049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67f450-9aa4-4475-87af-ea943c7f7faf admin admin] PATH_INFO: `/v3/projects/2c882f75a9e3487183444a1df48a8b5d/users/e247afbad2f34d21b88ab66b931ddb2a/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:05.295982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67f450-9aa4-4475-87af-ea943c7f7faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c882f75a9e3487183444a1df48a8b5d, user_id=e247afbad2f34d21b88ab66b931ddb2a, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:05.298677 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67f450-9aa4-4475-87af-ea943c7f7faf admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:05.309116 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4542/9038] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:07:05 2022] PUT /identity/v3/projects/2c882f75a9e3487183444a1df48a8b5d/users/e247afbad2f34d21b88ab66b931ddb2a/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:07:09.976195 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7302104-1fda-4571-8e38-4a2d927d1fd9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:09.977277 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7302104-1fda-4571-8e38-4a2d927d1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:09.977561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7302104-1fda-4571-8e38-4a2d927d1fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:10.009220 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c7302104-1fda-4571-8e38-4a2d927d1fd9 None None] MFA Rules not processed for user `e247afbad2f34d21b88ab66b931ddb2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:07:10.010453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7302104-1fda-4571-8e38-4a2d927d1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:10.107853 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4497/9039] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:07:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:07:10.141542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67f450-9aa4-4475-87af-ea943c7f7faf admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:10.143276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-3b67f450-9aa4-4475-87af-ea943c7f7faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:10.245276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67f450-9aa4-4475-87af-ea943c7f7faf admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:10.249429 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fecea-5f12-4eb4-a044-85aad8ec1bd1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:10.250049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fecea-5f12-4eb4-a044-85aad8ec1bd1 service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:10.250331 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fecea-5f12-4eb4-a044-85aad8ec1bd1 service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:10.250627 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fecea-5f12-4eb4-a044-85aad8ec1bd1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:10.321122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fecea-5f12-4eb4-a044-85aad8ec1bd1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:10.322623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fecea-5f12-4eb4-a044-85aad8ec1bd1 service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:10.334168 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4543/9040] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:07:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:07:10.482815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc493ad7-b8bb-4729-b6a6-b26f0be0bbe5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:10.483105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc493ad7-b8bb-4729-b6a6-b26f0be0bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:10.483380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc493ad7-b8bb-4729-b6a6-b26f0be0bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:10.542306 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bc493ad7-b8bb-4729-b6a6-b26f0be0bbe5 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:07:10.543560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bc493ad7-b8bb-4729-b6a6-b26f0be0bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:10.616205 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4498/9041] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 02:07:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:07:10.668022 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fecea-5f12-4eb4-a044-85aad8ec1bd1 service glance] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:10.669749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c05fecea-5f12-4eb4-a044-85aad8ec1bd1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:10.757546 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:10.760166 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fecea-5f12-4eb4-a044-85aad8ec1bd1 service glance] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:10.766354 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd7f14-813d-4048-a485-379d4f216aab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:10.767018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7f14-813d-4048-a485-379d4f216aab service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:10.767299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7f14-813d-4048-a485-379d4f216aab service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:10.767572 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7f14-813d-4048-a485-379d4f216aab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:10.776700 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd7f14-813d-4048-a485-379d4f216aab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:10.778311 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd7f14-813d-4048-a485-379d4f216aab service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:10.787507 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4544/9042] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:07:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:07:12.108494 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc493ad7-b8bb-4729-b6a6-b26f0be0bbe5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:12.110462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bc493ad7-b8bb-4729-b6a6-b26f0be0bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:12.141883 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:12.216141 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc493ad7-b8bb-4729-b6a6-b26f0be0bbe5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:12.227679 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c5554-cb43-40d5-b24c-1f92fd82362b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:12.228745 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c5554-cb43-40d5-b24c-1f92fd82362b service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:12.229204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c5554-cb43-40d5-b24c-1f92fd82362b service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:12.229643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c5554-cb43-40d5-b24c-1f92fd82362b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:12.231919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8a4c5554-cb43-40d5-b24c-1f92fd82362b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:12.252922 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c5554-cb43-40d5-b24c-1f92fd82362b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:12.257809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c5554-cb43-40d5-b24c-1f92fd82362b service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:12.269923 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4499/9043] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:07:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:07:18.117631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd7f14-813d-4048-a485-379d4f216aab service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:18.130675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd7f14-813d-4048-a485-379d4f216aab service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:18.136041 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd833be-769c-41d9-a038-3abc918c710c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:18.136737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd833be-769c-41d9-a038-3abc918c710c service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:18.137083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd833be-769c-41d9-a038-3abc918c710c service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:18.137418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd833be-769c-41d9-a038-3abc918c710c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:18.139417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-bcd833be-769c-41d9-a038-3abc918c710c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:18.156067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd833be-769c-41d9-a038-3abc918c710c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:18.156067 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd833be-769c-41d9-a038-3abc918c710c service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:18.173471 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4545/9044] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:07:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:07:20.001059 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e0a0-21a2-42b6-9fb6-f4ae669052ea None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:20.001537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e0a0-21a2-42b6-9fb6-f4ae669052ea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:20.001663 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e0a0-21a2-42b6-9fb6-f4ae669052ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:20.021453 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9b67e0a0-21a2-42b6-9fb6-f4ae669052ea None None] MFA Rules not processed for user `95d2890faf84462493c012c0619b663f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:07:20.022641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b67e0a0-21a2-42b6-9fb6-f4ae669052ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:20.029450 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4500/9045] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:07:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:07:21.967817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61b6c5-885d-4d4a-a310-14d19ea2c106 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:21.968356 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61b6c5-885d-4d4a-a310-14d19ea2c106 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:21.968761 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61b6c5-885d-4d4a-a310-14d19ea2c106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:21.989377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-db61b6c5-885d-4d4a-a310-14d19ea2c106 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:07:21.991197 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-db61b6c5-885d-4d4a-a310-14d19ea2c106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:07:21.998528 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4546/9046] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 02:07:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:07:22.012237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67e0a0-21a2-42b6-9fb6-f4ae669052ea None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:22.024326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67e0a0-21a2-42b6-9fb6-f4ae669052ea None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:22.029320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609cc7f-ffb4-4702-978a-0b02cb976d29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:22.029928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609cc7f-ffb4-4702-978a-0b02cb976d29 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:22.030209 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609cc7f-ffb4-4702-978a-0b02cb976d29 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:22.030484 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609cc7f-ffb4-4702-978a-0b02cb976d29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:22.038918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609cc7f-ffb4-4702-978a-0b02cb976d29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:22.040544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609cc7f-ffb4-4702-978a-0b02cb976d29 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:22.048895 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4501/9047] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:07:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:07:31.984429 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=13 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:32.045848 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=32 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:07:55.053838 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61b6c5-885d-4d4a-a310-14d19ea2c106 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:07:55.109218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61b6c5-885d-4d4a-a310-14d19ea2c106 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:07:55.112959 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00561c3a-2597-4450-ba93-d7dbabc63fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:07:55.113593 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00561c3a-2597-4450-ba93-d7dbabc63fcf service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:07:55.113873 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00561c3a-2597-4450-ba93-d7dbabc63fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:07:55.114151 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00561c3a-2597-4450-ba93-d7dbabc63fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:07:55.126496 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00561c3a-2597-4450-ba93-d7dbabc63fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:07:55.128527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00561c3a-2597-4450-ba93-d7dbabc63fcf service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:07:55.138742 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4547/9048] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:07:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:08:05.134540 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=26 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:09:21.469566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609cc7f-ffb4-4702-978a-0b02cb976d29 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:09:21.479547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609cc7f-ffb4-4702-978a-0b02cb976d29 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:09:21.483271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75b2f0-7840-4a33-a050-9bf1c11e2af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:09:21.483862 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75b2f0-7840-4a33-a050-9bf1c11e2af3 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:09:21.484143 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75b2f0-7840-4a33-a050-9bf1c11e2af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:09:21.484416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75b2f0-7840-4a33-a050-9bf1c11e2af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:09:21.486167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea75b2f0-7840-4a33-a050-9bf1c11e2af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:09:21.505963 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75b2f0-7840-4a33-a050-9bf1c11e2af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:09:21.507481 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75b2f0-7840-4a33-a050-9bf1c11e2af3 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:09:21.515624 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4502/9049] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:09:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:09:31.512176 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:09:36.510367 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00561c3a-2597-4450-ba93-d7dbabc63fcf service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:09:36.512499 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-00561c3a-2597-4450-ba93-d7dbabc63fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:09:36.555739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00561c3a-2597-4450-ba93-d7dbabc63fcf service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:09:36.559913 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82530159-be0e-48c7-9748-2993549f872a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:09:36.560537 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82530159-be0e-48c7-9748-2993549f872a service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:09:36.560817 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82530159-be0e-48c7-9748-2993549f872a service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:09:36.561089 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82530159-be0e-48c7-9748-2993549f872a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:09:36.562960 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-82530159-be0e-48c7-9748-2993549f872a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:09:36.658158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82530159-be0e-48c7-9748-2993549f872a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:09:36.659631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82530159-be0e-48c7-9748-2993549f872a service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:09:36.670573 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4548/9050] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:09:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:09:46.665846 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=57 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:10:52.419325 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75b2f0-7840-4a33-a050-9bf1c11e2af3 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:10:52.421048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea75b2f0-7840-4a33-a050-9bf1c11e2af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:10:52.487082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75b2f0-7840-4a33-a050-9bf1c11e2af3 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:10:52.495586 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbdde4-4575-4141-86d1-c31e01101cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:10:52.496251 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbdde4-4575-4141-86d1-c31e01101cd2 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:10:52.496538 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbdde4-4575-4141-86d1-c31e01101cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:10:52.496849 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbdde4-4575-4141-86d1-c31e01101cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:10:52.498541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eafbdde4-4575-4141-86d1-c31e01101cd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:10:52.512320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbdde4-4575-4141-86d1-c31e01101cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:10:52.513925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbdde4-4575-4141-86d1-c31e01101cd2 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:10:52.525771 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4503/9051] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:10:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:11:02.520843 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=23 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:05.030126 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82530159-be0e-48c7-9748-2993549f872a service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:11:05.031691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-82530159-be0e-48c7-9748-2993549f872a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:11:05.069068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82530159-be0e-48c7-9748-2993549f872a service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:11:05.076133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1c568-9f24-4bdd-8b8d-6345a0fb0337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:11:05.076739 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c568-9f24-4bdd-8b8d-6345a0fb0337 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:05.077026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c568-9f24-4bdd-8b8d-6345a0fb0337 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:05.077301 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c568-9f24-4bdd-8b8d-6345a0fb0337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:05.079072 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ecc1c568-9f24-4bdd-8b8d-6345a0fb0337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:11:05.091753 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1c568-9f24-4bdd-8b8d-6345a0fb0337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:11:05.093349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1c568-9f24-4bdd-8b8d-6345a0fb0337 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:11:05.104736 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4549/9052] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:11:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:11:07.436418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9562-06d8-4ee4-868e-1140bf2bda27 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:07.436882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9562-06d8-4ee4-868e-1140bf2bda27 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:07.436984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9562-06d8-4ee4-868e-1140bf2bda27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:07.457247 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-61fc9562-06d8-4ee4-868e-1140bf2bda27 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:11:07.458442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-61fc9562-06d8-4ee4-868e-1140bf2bda27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:11:07.469591 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4504/9053] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 02:11:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:11:07.512821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1c568-9f24-4bdd-8b8d-6345a0fb0337 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:11:07.523981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1c568-9f24-4bdd-8b8d-6345a0fb0337 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:11:07.528910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff88b-8e62-40f3-8ace-db9930df31c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:11:07.529495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff88b-8e62-40f3-8ace-db9930df31c1 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:07.529796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff88b-8e62-40f3-8ace-db9930df31c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:07.530095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff88b-8e62-40f3-8ace-db9930df31c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:07.538321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbff88b-8e62-40f3-8ace-db9930df31c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:11:07.539921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbff88b-8e62-40f3-8ace-db9930df31c1 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:11:07.547859 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4550/9054] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:11:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:11:08.029700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a2643-b254-4416-a48b-ab072e764620 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:08.029987 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a2643-b254-4416-a48b-ab072e764620 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:08.030342 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a2643-b254-4416-a48b-ab072e764620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:08.050418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a84a2643-b254-4416-a48b-ab072e764620 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:11:08.051622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a84a2643-b254-4416-a48b-ab072e764620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:11:08.059321 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4505/9055] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 02:11:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:11:08.071562 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff88b-8e62-40f3-8ace-db9930df31c1 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:11:08.082017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff88b-8e62-40f3-8ace-db9930df31c1 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:11:08.087359 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b409b-60cd-4d82-87e1-f51d5fd1b376 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:11:08.087940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b409b-60cd-4d82-87e1-f51d5fd1b376 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:08.088220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b409b-60cd-4d82-87e1-f51d5fd1b376 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:08.088487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b409b-60cd-4d82-87e1-f51d5fd1b376 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:08.096213 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b409b-60cd-4d82-87e1-f51d5fd1b376 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:11:08.097904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b409b-60cd-4d82-87e1-f51d5fd1b376 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:11:08.106359 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4551/9056] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:11:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:11:16.752930 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00193-da86-4a50-845f-048b23c8e96f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:16.753442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00193-da86-4a50-845f-048b23c8e96f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:16.753573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00193-da86-4a50-845f-048b23c8e96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:16.772635 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-09d00193-da86-4a50-845f-048b23c8e96f None None] MFA Rules not processed for user `95d2890faf84462493c012c0619b663f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:11:16.773829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-09d00193-da86-4a50-845f-048b23c8e96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:11:16.780653 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4506/9057] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:11:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 02 02:11:17.033214 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736566-60ae-4743-b5fe-5d245a8b6c38 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:17.033722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736566-60ae-4743-b5fe-5d245a8b6c38 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:17.033845 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736566-60ae-4743-b5fe-5d245a8b6c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:17.083343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-65736566-60ae-4743-b5fe-5d245a8b6c38 None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:11:17.084464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-65736566-60ae-4743-b5fe-5d245a8b6c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:11:17.091002 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4552/9058] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 02:11:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:11:17.103412 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d00193-da86-4a50-845f-048b23c8e96f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:11:17.113284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d00193-da86-4a50-845f-048b23c8e96f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:11:17.117801 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af2ede-ab3c-421e-b8a3-45dedec03b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:11:17.118409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2ede-ab3c-421e-b8a3-45dedec03b1b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:17.118720 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2ede-ab3c-421e-b8a3-45dedec03b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:17.118993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2ede-ab3c-421e-b8a3-45dedec03b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:17.126375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af2ede-ab3c-421e-b8a3-45dedec03b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:11:17.127944 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af2ede-ab3c-421e-b8a3-45dedec03b1b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:11:17.136434 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4507/9059] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:11:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:11:17.471440 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65736566-60ae-4743-b5fe-5d245a8b6c38 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:11:17.485432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65736566-60ae-4743-b5fe-5d245a8b6c38 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:11:17.491288 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a794d-d59d-43c9-bedb-cd1a43a71812 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:11:17.491902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a794d-d59d-43c9-bedb-cd1a43a71812 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:17.492187 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a794d-d59d-43c9-bedb-cd1a43a71812 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:17.492469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a794d-d59d-43c9-bedb-cd1a43a71812 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:17.494586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-689a794d-d59d-43c9-bedb-cd1a43a71812 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:11:17.521343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a794d-d59d-43c9-bedb-cd1a43a71812 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:11:17.523205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a794d-d59d-43c9-bedb-cd1a43a71812 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:11:17.533061 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4553/9060] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:11:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:11:18.783781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adc04a-846e-4c4f-8db8-20fe41b0cd85 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:18.784336 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adc04a-846e-4c4f-8db8-20fe41b0cd85 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:18.784464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adc04a-846e-4c4f-8db8-20fe41b0cd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:18.810221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-11adc04a-846e-4c4f-8db8-20fe41b0cd85 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:11:18.811518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-11adc04a-846e-4c4f-8db8-20fe41b0cd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:11:18.819845 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4508/9061] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 02:11:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:11:18.836821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a794d-d59d-43c9-bedb-cd1a43a71812 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:11:18.849455 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a794d-d59d-43c9-bedb-cd1a43a71812 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:11:18.871642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37569c-3504-41e2-93e2-27687c537506 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:11:18.872643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37569c-3504-41e2-93e2-27687c537506 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:18.873255 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37569c-3504-41e2-93e2-27687c537506 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:18.874642 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37569c-3504-41e2-93e2-27687c537506 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:18.895283 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37569c-3504-41e2-93e2-27687c537506 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:11:18.899239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37569c-3504-41e2-93e2-27687c537506 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:11:18.922362 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4554/9062] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 02 02:11:28.803466 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=18 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:28.909387 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=56 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:29.705118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adc04a-846e-4c4f-8db8-20fe41b0cd85 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:11:29.716994 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adc04a-846e-4c4f-8db8-20fe41b0cd85 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:11:29.721327 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf30f2-db9b-4a68-86b9-2ff9619a08e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:11:29.721870 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf30f2-db9b-4a68-86b9-2ff9619a08e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:29.722150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf30f2-db9b-4a68-86b9-2ff9619a08e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:29.722438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf30f2-db9b-4a68-86b9-2ff9619a08e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:29.724237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d1bf30f2-db9b-4a68-86b9-2ff9619a08e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:11:29.734443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf30f2-db9b-4a68-86b9-2ff9619a08e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:11:29.735949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf30f2-db9b-4a68-86b9-2ff9619a08e2 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:11:29.744119 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4509/9063] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:11:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:11:31.951980 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37569c-3504-41e2-93e2-27687c537506 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:11:31.961106 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37569c-3504-41e2-93e2-27687c537506 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:11:31.964714 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac887-8f57-4210-b3a7-b2f3c454b298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:11:31.965303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac887-8f57-4210-b3a7-b2f3c454b298 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:31.965579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac887-8f57-4210-b3a7-b2f3c454b298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:31.965853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac887-8f57-4210-b3a7-b2f3c454b298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:31.967584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1dac887-8f57-4210-b3a7-b2f3c454b298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:11:31.983075 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dac887-8f57-4210-b3a7-b2f3c454b298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:11:31.984503 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dac887-8f57-4210-b3a7-b2f3c454b298 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:11:31.996287 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4555/9064] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:11:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:11:36.665156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf30f2-db9b-4a68-86b9-2ff9619a08e2 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:11:36.680503 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf30f2-db9b-4a68-86b9-2ff9619a08e2 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:11:36.685866 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0527e2-ae90-49ae-ab55-b41973675e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:11:36.686469 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0527e2-ae90-49ae-ab55-b41973675e3e service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:11:36.686778 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0527e2-ae90-49ae-ab55-b41973675e3e service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:11:36.687054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0527e2-ae90-49ae-ab55-b41973675e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:11:36.688776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ca0527e2-ae90-49ae-ab55-b41973675e3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:11:36.701700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0527e2-ae90-49ae-ab55-b41973675e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:11:36.703311 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0527e2-ae90-49ae-ab55-b41973675e3e service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:11:36.714179 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4510/9065] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:11:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:11:41.991240 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:11:46.709663 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=12 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:12:19.109802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac887-8f57-4210-b3a7-b2f3c454b298 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:12:19.111260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a1dac887-8f57-4210-b3a7-b2f3c454b298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:12:19.125426 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac887-8f57-4210-b3a7-b2f3c454b298 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:12:19.130944 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51711aab-4c63-46f6-90d7-b5ab87766007 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:12:19.131589 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51711aab-4c63-46f6-90d7-b5ab87766007 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:12:19.131904 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51711aab-4c63-46f6-90d7-b5ab87766007 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:12:19.132177 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51711aab-4c63-46f6-90d7-b5ab87766007 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:12:19.140328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51711aab-4c63-46f6-90d7-b5ab87766007 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:12:19.141910 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51711aab-4c63-46f6-90d7-b5ab87766007 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:12:19.152359 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4556/9066] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:12:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:12:24.116584 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0527e2-ae90-49ae-ab55-b41973675e3e service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:12:24.127567 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0527e2-ae90-49ae-ab55-b41973675e3e service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:12:24.132649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7766ebd-da68-414c-97e8-dd33cee7d773 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:12:24.133243 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7766ebd-da68-414c-97e8-dd33cee7d773 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:12:24.133528 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7766ebd-da68-414c-97e8-dd33cee7d773 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:12:24.133806 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7766ebd-da68-414c-97e8-dd33cee7d773 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:12:24.142019 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7766ebd-da68-414c-97e8-dd33cee7d773 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:12:24.143638 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7766ebd-da68-414c-97e8-dd33cee7d773 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:12:24.153885 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4511/9067] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:12:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:12:29.148285 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:12:34.149956 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:12:44.133912 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51711aab-4c63-46f6-90d7-b5ab87766007 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:12:44.145891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51711aab-4c63-46f6-90d7-b5ab87766007 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:12:44.151993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d9cf6-368a-40da-bde1-77c1accccf02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:12:44.152586 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d9cf6-368a-40da-bde1-77c1accccf02 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:12:44.152868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d9cf6-368a-40da-bde1-77c1accccf02 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:12:44.153140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d9cf6-368a-40da-bde1-77c1accccf02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:12:44.160672 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d9cf6-368a-40da-bde1-77c1accccf02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:12:44.162244 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d9cf6-368a-40da-bde1-77c1accccf02 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:12:44.171613 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4557/9068] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:12:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:12:54.167637 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:06.159899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b119f4-8a3a-4c97-a195-6be6aed6fbad None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:06.160447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b119f4-8a3a-4c97-a195-6be6aed6fbad None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:06.160447 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b119f4-8a3a-4c97-a195-6be6aed6fbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:06.189537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-20b119f4-8a3a-4c97-a195-6be6aed6fbad None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:14:06.190776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20b119f4-8a3a-4c97-a195-6be6aed6fbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:06.198766 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4512/9069] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 02:14:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:14:06.240133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d9cf6-368a-40da-bde1-77c1accccf02 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:06.251508 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d9cf6-368a-40da-bde1-77c1accccf02 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:06.257091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc709a8e-1ddb-490b-82b1-fe32010674a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:06.257679 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc709a8e-1ddb-490b-82b1-fe32010674a8 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:06.257961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc709a8e-1ddb-490b-82b1-fe32010674a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:06.258236 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc709a8e-1ddb-490b-82b1-fe32010674a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:06.266082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc709a8e-1ddb-490b-82b1-fe32010674a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:06.267683 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc709a8e-1ddb-490b-82b1-fe32010674a8 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:06.276296 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4558/9070] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:14:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:14:06.625947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b119f4-8a3a-4c97-a195-6be6aed6fbad None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:06.646319 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b119f4-8a3a-4c97-a195-6be6aed6fbad None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:06.649954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4dff9-4f15-447d-875e-097bd545814a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:06.650560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4dff9-4f15-447d-875e-097bd545814a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:06.650875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4dff9-4f15-447d-875e-097bd545814a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:06.651153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4dff9-4f15-447d-875e-097bd545814a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:06.720983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4dff9-4f15-447d-875e-097bd545814a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:06.722441 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4dff9-4f15-447d-875e-097bd545814a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:06.742400 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4513/9071] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 02:14:09.654170 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc709a8e-1ddb-490b-82b1-fe32010674a8 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:09.693621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc709a8e-1ddb-490b-82b1-fe32010674a8 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:09.701903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66414ca-a5cd-4133-86c1-c1295b2427db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:09.707145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66414ca-a5cd-4133-86c1-c1295b2427db service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:09.708328 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66414ca-a5cd-4133-86c1-c1295b2427db service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:09.709031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66414ca-a5cd-4133-86c1-c1295b2427db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:09.716698 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e66414ca-a5cd-4133-86c1-c1295b2427db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:09.754879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66414ca-a5cd-4133-86c1-c1295b2427db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:09.756670 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66414ca-a5cd-4133-86c1-c1295b2427db service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:09.767082 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4559/9072] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:14:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:14:12.618150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4dff9-4f15-447d-875e-097bd545814a service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:12.631969 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4dff9-4f15-447d-875e-097bd545814a service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:12.637101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b4197-aae6-426c-bdde-91e90b385b2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:12.637722 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b4197-aae6-426c-bdde-91e90b385b2c service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:12.638004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b4197-aae6-426c-bdde-91e90b385b2c service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:12.638279 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b4197-aae6-426c-bdde-91e90b385b2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:12.640045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-832b4197-aae6-426c-bdde-91e90b385b2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:12.652719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b4197-aae6-426c-bdde-91e90b385b2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:12.654509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b4197-aae6-426c-bdde-91e90b385b2c service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:12.666620 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4514/9073] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:14:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:14:12.694622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66414ca-a5cd-4133-86c1-c1295b2427db service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:12.706560 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66414ca-a5cd-4133-86c1-c1295b2427db service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:12.711579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:12.712335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:12.712689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:12.713039 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] PATH_INFO: `/v3/users/95d2890faf84462493c012c0619b663f` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:12.714500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d2890faf84462493c012c0619b663f)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:12.716653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:12.762950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d2890faf84462493c012c0619b663f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:12.775298 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d2890faf84462493c012c0619b663f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:12.775979 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d2890faf84462493c012c0619b663f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:12.783165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d2890faf84462493c012c0619b663f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:12.783770 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d2890faf84462493c012c0619b663f'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:12.796901 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4560/9074] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:14:12 2022] DELETE /identity/v3/users/95d2890faf84462493c012c0619b663f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:14:12.971967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b4197-aae6-426c-bdde-91e90b385b2c service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:12.983455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b4197-aae6-426c-bdde-91e90b385b2c service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:13.040189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:13.040829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:13.041114 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:13.041385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] PATH_INFO: `/v3/projects/e94ca75d802e46e3aa9cc7bb492107fa` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:13.042620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94ca75d802e46e3aa9cc7bb492107fa)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:13.044575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:13.085626 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:13.092249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94ca75d802e46e3aa9cc7bb492107fa', 'request_id': 'req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.097771 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94ca75d802e46e3aa9cc7bb492107fa', 'request_id': 'req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.104155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94ca75d802e46e3aa9cc7bb492107fa', 'request_id': 'req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.129795 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] The token cache is being invalidate because project e94ca75d802e46e3aa9cc7bb492107fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:14:13.130101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.130786 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.132265 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4515/9075] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:14:12 2022] DELETE /identity/v3/projects/e94ca75d802e46e3aa9cc7bb492107fa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:14:13.136322 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:13.137694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:13.151026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad02f92-0218-4a4f-a55b-f2b3673d627f admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:13.204750 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93038c66-3c6b-4a4f-8936-09687970250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:13.205365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93038c66-3c6b-4a4f-8936-09687970250c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:13.205643 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93038c66-3c6b-4a4f-8936-09687970250c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:13.205916 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93038c66-3c6b-4a4f-8936-09687970250c admin admin] PATH_INFO: `/v3/users/e247afbad2f34d21b88ab66b931ddb2a` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:13.207054 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93038c66-3c6b-4a4f-8936-09687970250c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e247afbad2f34d21b88ab66b931ddb2a)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:13.209488 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93038c66-3c6b-4a4f-8936-09687970250c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:13.250393 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:13.257659 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93038c66-3c6b-4a4f-8936-09687970250c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e247afbad2f34d21b88ab66b931ddb2a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.269199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93038c66-3c6b-4a4f-8936-09687970250c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e247afbad2f34d21b88ab66b931ddb2a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.269863 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93038c66-3c6b-4a4f-8936-09687970250c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e247afbad2f34d21b88ab66b931ddb2a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.277542 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93038c66-3c6b-4a4f-8936-09687970250c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e247afbad2f34d21b88ab66b931ddb2a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.278164 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-93038c66-3c6b-4a4f-8936-09687970250c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e247afbad2f34d21b88ab66b931ddb2a'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.290502 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4561/9076] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:14:13 2022] DELETE /identity/v3/users/e247afbad2f34d21b88ab66b931ddb2a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:14:13.462533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:13.464033 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:13.476962 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb6e41-ce9e-49e7-9860-351d604aaf3f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:13.532451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:13.533080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:13.533360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:13.533629 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] PATH_INFO: `/v3/projects/2c882f75a9e3487183444a1df48a8b5d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:13.534789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c882f75a9e3487183444a1df48a8b5d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:13.537493 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:13.583518 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c882f75a9e3487183444a1df48a8b5d', 'request_id': 'req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.588885 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c882f75a9e3487183444a1df48a8b5d', 'request_id': 'req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.595142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c882f75a9e3487183444a1df48a8b5d', 'request_id': 'req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.607153 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] The token cache is being invalidate because project 2c882f75a9e3487183444a1df48a8b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:14:13.607443 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.608067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-564846b2-9fb3-4918-95f5-8b9e5c3c0cd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:14:13.609535 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4516/9077] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:14:13 2022] DELETE /identity/v3/projects/2c882f75a9e3487183444a1df48a8b5d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:14:13.615013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412897c-6c58-4aee-993a-7505754c5a35 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:13.615275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412897c-6c58-4aee-993a-7505754c5a35 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:13.615549 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412897c-6c58-4aee-993a-7505754c5a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:13.663148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-1412897c-6c58-4aee-993a-7505754c5a35 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:14:13.664372 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1412897c-6c58-4aee-993a-7505754c5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:13.721886 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4562/9078] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:14:13.730775 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0cca-6c43-4c32-a57b-1887db5d696c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:13.731230 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0cca-6c43-4c32-a57b-1887db5d696c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:13.731364 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0cca-6c43-4c32-a57b-1887db5d696c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:13.751248 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6a2f0cca-6c43-4c32-a57b-1887db5d696c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:14:13.752436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6a2f0cca-6c43-4c32-a57b-1887db5d696c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:13.761102 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4517/9079] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:14:13.765335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412897c-6c58-4aee-993a-7505754c5a35 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:13.775870 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412897c-6c58-4aee-993a-7505754c5a35 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:13.780340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b70f07-59a7-4e52-8764-0df38b4b4834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:13.780948 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b70f07-59a7-4e52-8764-0df38b4b4834 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:13.781225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b70f07-59a7-4e52-8764-0df38b4b4834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:13.781494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b70f07-59a7-4e52-8764-0df38b4b4834 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:13.782124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b70f07-59a7-4e52-8764-0df38b4b4834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 02:14:13.782421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b70f07-59a7-4e52-8764-0df38b4b4834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:13.784040 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b70f07-59a7-4e52-8764-0df38b4b4834 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:13.795317 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4563/9080] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 02:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 02:14:13.799544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f0cca-6c43-4c32-a57b-1887db5d696c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:13.808627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f0cca-6c43-4c32-a57b-1887db5d696c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:13.813228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eae32a-a53a-49ba-86d4-2ccb0ce00520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:13.813816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eae32a-a53a-49ba-86d4-2ccb0ce00520 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:13.814092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eae32a-a53a-49ba-86d4-2ccb0ce00520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:13.814360 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eae32a-a53a-49ba-86d4-2ccb0ce00520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:13.815016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eae32a-a53a-49ba-86d4-2ccb0ce00520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:13.817458 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eae32a-a53a-49ba-86d4-2ccb0ce00520 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:13.854987 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4518/9081] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:14:13 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:14:13.859168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b70f07-59a7-4e52-8764-0df38b4b4834 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:13.869732 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b70f07-59a7-4e52-8764-0df38b4b4834 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:13.925516 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77d612-badf-4538-b79a-a53f10844700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:13.926914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77d612-badf-4538-b79a-a53f10844700 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:13.927314 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77d612-badf-4538-b79a-a53f10844700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:13.927713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77d612-badf-4538-b79a-a53f10844700 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:13.928223 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77d612-badf-4538-b79a-a53f10844700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:13.930191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77d612-badf-4538-b79a-a53f10844700 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:13.952964 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4564/9082] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:14:13 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 02:14:13.957568 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eae32a-a53a-49ba-86d4-2ccb0ce00520 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:13.968392 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eae32a-a53a-49ba-86d4-2ccb0ce00520 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:13.975346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4f1a4-2822-4acd-a1d8-c92e0800f708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:13.976074 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4f1a4-2822-4acd-a1d8-c92e0800f708 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:13.976451 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4f1a4-2822-4acd-a1d8-c92e0800f708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:13.976788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4f1a4-2822-4acd-a1d8-c92e0800f708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:13.977515 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4f1a4-2822-4acd-a1d8-c92e0800f708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:13.979257 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4f1a4-2822-4acd-a1d8-c92e0800f708 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:13.985144 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:13.993530 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4519/9083] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:14:13.994954 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77d612-badf-4538-b79a-a53f10844700 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:14.006265 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77d612-badf-4538-b79a-a53f10844700 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:14.011018 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04739e-2f10-464f-9ba4-d7befc990bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:14.011706 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04739e-2f10-464f-9ba4-d7befc990bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:14.012079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04739e-2f10-464f-9ba4-d7befc990bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:14.012414 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04739e-2f10-464f-9ba4-d7befc990bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:14.013120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04739e-2f10-464f-9ba4-d7befc990bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:14.014785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04739e-2f10-464f-9ba4-d7befc990bc5 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:14.020849 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:14.030791 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4565/9084] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:14:14.032003 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4f1a4-2822-4acd-a1d8-c92e0800f708 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:14.042975 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4f1a4-2822-4acd-a1d8-c92e0800f708 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:14.048028 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7db9ff-ef9b-4538-a3c3-d0309779521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:14.048713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7db9ff-ef9b-4538-a3c3-d0309779521c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:14.049014 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7db9ff-ef9b-4538-a3c3-d0309779521c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:14.049288 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7db9ff-ef9b-4538-a3c3-d0309779521c admin admin] PATH_INFO: `/v3/projects/bbed5972f66e4bbd8d012c06ef5f384d/users/5c1075fd1070483db992c1b46001a8e0/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:14.064726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7db9ff-ef9b-4538-a3c3-d0309779521c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbed5972f66e4bbd8d012c06ef5f384d, user_id=5c1075fd1070483db992c1b46001a8e0, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:14.067767 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7db9ff-ef9b-4538-a3c3-d0309779521c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:14.080118 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4520/9085] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:14:14 2022] PUT /identity/v3/projects/bbed5972f66e4bbd8d012c06ef5f384d/users/5c1075fd1070483db992c1b46001a8e0/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:14:14.091729 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fe0a6-1cd0-4877-b7ce-b5326d0cc521 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:14.092015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fe0a6-1cd0-4877-b7ce-b5326d0cc521 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:14.092294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fe0a6-1cd0-4877-b7ce-b5326d0cc521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:14.119724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-af4fe0a6-1cd0-4877-b7ce-b5326d0cc521 None None] MFA Rules not processed for user `5c1075fd1070483db992c1b46001a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:14:14.120929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-af4fe0a6-1cd0-4877-b7ce-b5326d0cc521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:14.184422 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4566/9086] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:14:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:14:14.188819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7db9ff-ef9b-4538-a3c3-d0309779521c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:14.249373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7db9ff-ef9b-4538-a3c3-d0309779521c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:14.253977 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e95aa7-5f1a-4ca7-8b78-dc4082593899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:14.255155 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e95aa7-5f1a-4ca7-8b78-dc4082593899 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:14.255433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e95aa7-5f1a-4ca7-8b78-dc4082593899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:14.255703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e95aa7-5f1a-4ca7-8b78-dc4082593899 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:14.256320 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e95aa7-5f1a-4ca7-8b78-dc4082593899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:14.258224 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e95aa7-5f1a-4ca7-8b78-dc4082593899 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:14.284527 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4521/9087] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:14:14 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:14:14.289208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fe0a6-1cd0-4877-b7ce-b5326d0cc521 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:14.299985 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fe0a6-1cd0-4877-b7ce-b5326d0cc521 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:14.361458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5269fa-f0dc-4806-9735-35f868457eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:14.362066 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5269fa-f0dc-4806-9735-35f868457eab admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:14.362351 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5269fa-f0dc-4806-9735-35f868457eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:14.362658 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5269fa-f0dc-4806-9735-35f868457eab admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:14.363287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5269fa-f0dc-4806-9735-35f868457eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:14.365843 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5269fa-f0dc-4806-9735-35f868457eab admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:14.389964 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4567/9088] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:14:14 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:14:14.391284 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e95aa7-5f1a-4ca7-8b78-dc4082593899 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:14.403813 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e95aa7-5f1a-4ca7-8b78-dc4082593899 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:14.408541 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2d782-c418-41a8-9510-561c1c3cfdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:14.409151 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d782-c418-41a8-9510-561c1c3cfdfd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:14.409430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d782-c418-41a8-9510-561c1c3cfdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:14.409708 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d782-c418-41a8-9510-561c1c3cfdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:14.410356 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2d782-c418-41a8-9510-561c1c3cfdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:14.412819 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2d782-c418-41a8-9510-561c1c3cfdfd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:14.423646 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4522/9089] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:14:14.428483 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5269fa-f0dc-4806-9735-35f868457eab admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:14.441387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5269fa-f0dc-4806-9735-35f868457eab admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:14.448130 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6b0c6-1820-4e1a-8483-fb48b01e4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:14.448795 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b0c6-1820-4e1a-8483-fb48b01e4c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:14.449074 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b0c6-1820-4e1a-8483-fb48b01e4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:14.449368 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b0c6-1820-4e1a-8483-fb48b01e4c0c admin admin] PATH_INFO: `/v3/projects/d827c4524e5e4f019d255da203b515d0/users/084bbd0b819b4ae4b2b48098633d8512/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:14.465381 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6b0c6-1820-4e1a-8483-fb48b01e4c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d827c4524e5e4f019d255da203b515d0, user_id=084bbd0b819b4ae4b2b48098633d8512, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:14.468478 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6b0c6-1820-4e1a-8483-fb48b01e4c0c admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:14.482852 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4568/9090] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:14:14 2022] PUT /identity/v3/projects/d827c4524e5e4f019d255da203b515d0/users/084bbd0b819b4ae4b2b48098633d8512/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:14:14.487092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2d782-c418-41a8-9510-561c1c3cfdfd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:14.498007 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2d782-c418-41a8-9510-561c1c3cfdfd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:14.555526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebeb5b-55e9-4aa2-abbb-a8b85abcb133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:14.556139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebeb5b-55e9-4aa2-abbb-a8b85abcb133 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:14.556413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebeb5b-55e9-4aa2-abbb-a8b85abcb133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:14.556686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebeb5b-55e9-4aa2-abbb-a8b85abcb133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:14.557322 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebeb5b-55e9-4aa2-abbb-a8b85abcb133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:14.559149 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebeb5b-55e9-4aa2-abbb-a8b85abcb133 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:14.569422 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4523/9091] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:14:14.573801 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6b0c6-1820-4e1a-8483-fb48b01e4c0c admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:14.584020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6b0c6-1820-4e1a-8483-fb48b01e4c0c admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:14.588556 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9544c64-c602-4e50-b1b2-ed439a5a0d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:14.589196 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9544c64-c602-4e50-b1b2-ed439a5a0d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:14.589476 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9544c64-c602-4e50-b1b2-ed439a5a0d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:14.589748 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9544c64-c602-4e50-b1b2-ed439a5a0d3b admin admin] PATH_INFO: `/v3/projects/d827c4524e5e4f019d255da203b515d0/users/084bbd0b819b4ae4b2b48098633d8512/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:14.591676 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9544c64-c602-4e50-b1b2-ed439a5a0d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d827c4524e5e4f019d255da203b515d0, user_id=084bbd0b819b4ae4b2b48098633d8512, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:14.594303 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9544c64-c602-4e50-b1b2-ed439a5a0d3b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:14.604904 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4569/9092] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:14:14 2022] PUT /identity/v3/projects/d827c4524e5e4f019d255da203b515d0/users/084bbd0b819b4ae4b2b48098633d8512/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:14:14.616415 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b179-e317-43ad-85a0-6bd1e82b8a18 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:14.616700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b179-e317-43ad-85a0-6bd1e82b8a18 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:14.616974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b179-e317-43ad-85a0-6bd1e82b8a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:14.648421 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-54a7b179-e317-43ad-85a0-6bd1e82b8a18 None None] MFA Rules not processed for user `084bbd0b819b4ae4b2b48098633d8512`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:14:14.649641 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-54a7b179-e317-43ad-85a0-6bd1e82b8a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:14.683004 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:14.718526 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4524/9093] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:14:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:14:14.733458 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9544c64-c602-4e50-b1b2-ed439a5a0d3b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:14.735271 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f9544c64-c602-4e50-b1b2-ed439a5a0d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:14.782087 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:14.822482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9544c64-c602-4e50-b1b2-ed439a5a0d3b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:14.828148 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea604901-0c76-4235-a3b7-6add9f9abdd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:14.828759 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea604901-0c76-4235-a3b7-6add9f9abdd4 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:14.829042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea604901-0c76-4235-a3b7-6add9f9abdd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:14.829318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea604901-0c76-4235-a3b7-6add9f9abdd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:14.886320 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea604901-0c76-4235-a3b7-6add9f9abdd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:14.887943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea604901-0c76-4235-a3b7-6add9f9abdd4 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:14.897724 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4570/9094] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:14:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:14:17.921398 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b179-e317-43ad-85a0-6bd1e82b8a18 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:17.922974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-54a7b179-e317-43ad-85a0-6bd1e82b8a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:17.989916 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b179-e317-43ad-85a0-6bd1e82b8a18 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:17.993612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481d687-4ad4-4078-8105-a4a7c2aad391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:17.994227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d687-4ad4-4078-8105-a4a7c2aad391 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:17.994509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d687-4ad4-4078-8105-a4a7c2aad391 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:17.994814 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d687-4ad4-4078-8105-a4a7c2aad391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:18.004070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481d687-4ad4-4078-8105-a4a7c2aad391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:18.005742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481d687-4ad4-4078-8105-a4a7c2aad391 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:18.015573 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4525/9095] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:14:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:14:20.657820 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c514c2-0566-4058-bdd1-853f02f2c41b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:20.658313 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c514c2-0566-4058-bdd1-853f02f2c41b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:20.658431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c514c2-0566-4058-bdd1-853f02f2c41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:20.682577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f5c514c2-0566-4058-bdd1-853f02f2c41b None None] MFA Rules not processed for user `5c1075fd1070483db992c1b46001a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:14:20.683806 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f5c514c2-0566-4058-bdd1-853f02f2c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:20.691327 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4571/9096] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:14:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:14:21.080875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481d687-4ad4-4078-8105-a4a7c2aad391 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:21.090943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481d687-4ad4-4078-8105-a4a7c2aad391 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:21.100017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b8d84-4015-47df-98c5-7a6d0f0956ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:21.101564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b8d84-4015-47df-98c5-7a6d0f0956ea service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:21.101858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b8d84-4015-47df-98c5-7a6d0f0956ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:21.102556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b8d84-4015-47df-98c5-7a6d0f0956ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:21.105212 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9e4b8d84-4015-47df-98c5-7a6d0f0956ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:21.121928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b8d84-4015-47df-98c5-7a6d0f0956ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:21.123592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b8d84-4015-47df-98c5-7a6d0f0956ea service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:21.133899 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4526/9097] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:14:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:14:21.531924 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c514c2-0566-4058-bdd1-853f02f2c41b None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:21.533364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f5c514c2-0566-4058-bdd1-853f02f2c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:21.646122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c514c2-0566-4058-bdd1-853f02f2c41b None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:21.651471 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4daf51-754c-4805-a9de-5666ac46b759 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:21.652097 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4daf51-754c-4805-a9de-5666ac46b759 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:21.652379 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4daf51-754c-4805-a9de-5666ac46b759 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:21.652652 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4daf51-754c-4805-a9de-5666ac46b759 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:21.654733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fe4daf51-754c-4805-a9de-5666ac46b759 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:21.669957 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4daf51-754c-4805-a9de-5666ac46b759 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:21.671721 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4daf51-754c-4805-a9de-5666ac46b759 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:21.685513 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4572/9098] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:14:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:14:23.645021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b8d84-4015-47df-98c5-7a6d0f0956ea service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:14:23.647908 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9e4b8d84-4015-47df-98c5-7a6d0f0956ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:23.659523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b8d84-4015-47df-98c5-7a6d0f0956ea service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:14:23.664185 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3300b-2166-40f9-94cc-add7f4ccee24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:14:23.664809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3300b-2166-40f9-94cc-add7f4ccee24 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:14:23.665093 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3300b-2166-40f9-94cc-add7f4ccee24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:14:23.665373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3300b-2166-40f9-94cc-add7f4ccee24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:14:23.667232 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-42b3300b-2166-40f9-94cc-add7f4ccee24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:14:23.678694 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3300b-2166-40f9-94cc-add7f4ccee24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:14:23.680902 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3300b-2166-40f9-94cc-add7f4ccee24 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:14:23.690513 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4527/9099] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:14:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:14:31.678318 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=76 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:14:33.686183 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=51 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:03.170734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4daf51-754c-4805-a9de-5666ac46b759 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:15:03.180671 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4daf51-754c-4805-a9de-5666ac46b759 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:15:03.184230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea1a63-e968-423b-a77f-b54f7f6245c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:15:03.184815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1a63-e968-423b-a77f-b54f7f6245c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:15:03.185090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1a63-e968-423b-a77f-b54f7f6245c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:15:03.185358 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1a63-e968-423b-a77f-b54f7f6245c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:15:03.187073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-daea1a63-e968-423b-a77f-b54f7f6245c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:15:03.200937 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea1a63-e968-423b-a77f-b54f7f6245c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:15:03.202389 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea1a63-e968-423b-a77f-b54f7f6245c3 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:15:03.213145 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4573/9100] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:15:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:15:13.208457 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:15:20.981997 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55a36c-1577-4257-a9ab-10cc1b45631f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:15:20.982517 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55a36c-1577-4257-a9ab-10cc1b45631f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:15:20.983272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55a36c-1577-4257-a9ab-10cc1b45631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:15:21.005542 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1d55a36c-1577-4257-a9ab-10cc1b45631f None None] MFA Rules not processed for user `5c1075fd1070483db992c1b46001a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:15:21.006798 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1d55a36c-1577-4257-a9ab-10cc1b45631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:15:21.013785 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4528/9101] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:15:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:15:30.999581 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:16:54.022377 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea1a63-e968-423b-a77f-b54f7f6245c3 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:16:54.035466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea1a63-e968-423b-a77f-b54f7f6245c3 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:16:54.041826 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f7c04-69db-4103-9235-cd7df6a9044c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:16:54.042893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f7c04-69db-4103-9235-cd7df6a9044c service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:16:54.043411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f7c04-69db-4103-9235-cd7df6a9044c service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:16:54.043751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f7c04-69db-4103-9235-cd7df6a9044c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:16:54.045693 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c73f7c04-69db-4103-9235-cd7df6a9044c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:16:54.058168 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f7c04-69db-4103-9235-cd7df6a9044c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:16:54.059886 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f7c04-69db-4103-9235-cd7df6a9044c service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:16:54.072144 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4574/9102] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:16:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:16:54.215762 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55a36c-1577-4257-a9ab-10cc1b45631f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:16:54.225919 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55a36c-1577-4257-a9ab-10cc1b45631f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:16:54.229741 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d04b3-8385-4cc6-8240-44e42be44208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:16:54.230352 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d04b3-8385-4cc6-8240-44e42be44208 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:16:54.230652 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d04b3-8385-4cc6-8240-44e42be44208 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:16:54.230928 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d04b3-8385-4cc6-8240-44e42be44208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:16:54.232678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f82d04b3-8385-4cc6-8240-44e42be44208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:16:54.247423 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d04b3-8385-4cc6-8240-44e42be44208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:16:54.248883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d04b3-8385-4cc6-8240-44e42be44208 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:16:54.260631 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4529/9103] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:16:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:16:56.265289 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f7c04-69db-4103-9235-cd7df6a9044c service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:16:56.276609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f7c04-69db-4103-9235-cd7df6a9044c service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:16:56.282060 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ec563-023e-4eb5-a572-fadf1298821b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:16:56.282692 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ec563-023e-4eb5-a572-fadf1298821b service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:16:56.283093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ec563-023e-4eb5-a572-fadf1298821b service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:16:56.283300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ec563-023e-4eb5-a572-fadf1298821b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:16:56.285158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-461ec563-023e-4eb5-a572-fadf1298821b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:16:56.297387 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ec563-023e-4eb5-a572-fadf1298821b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:16:56.299001 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ec563-023e-4eb5-a572-fadf1298821b service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:16:56.309938 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4575/9104] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:16:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 02:17:04.255807 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:06.305976 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=12 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:06.689383 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a859e-a98e-4a8d-bbac-6a494d0d20fc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:17:06.690543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a859e-a98e-4a8d-bbac-6a494d0d20fc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:17:06.691017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a859e-a98e-4a8d-bbac-6a494d0d20fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:17:06.713719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4f8a859e-a98e-4a8d-bbac-6a494d0d20fc None None] MFA Rules not processed for user `5c1075fd1070483db992c1b46001a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:17:06.715400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4f8a859e-a98e-4a8d-bbac-6a494d0d20fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:17:06.723922 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4530/9105] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:17:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:17:16.707738 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:20.201260 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ec563-023e-4eb5-a572-fadf1298821b service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:17:20.202915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-461ec563-023e-4eb5-a572-fadf1298821b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:17:20.217341 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ec563-023e-4eb5-a572-fadf1298821b service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:17:20.223169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa26765-aebc-46f9-bf0a-9661dcf35fbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:17:20.223713 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa26765-aebc-46f9-bf0a-9661dcf35fbe service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:17:20.223998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa26765-aebc-46f9-bf0a-9661dcf35fbe service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:17:20.224267 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa26765-aebc-46f9-bf0a-9661dcf35fbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:17:20.226002 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7aa26765-aebc-46f9-bf0a-9661dcf35fbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:17:20.238827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa26765-aebc-46f9-bf0a-9661dcf35fbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:17:20.240141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa26765-aebc-46f9-bf0a-9661dcf35fbe service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:17:20.251584 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4576/9106] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:17:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:17:23.072909 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a859e-a98e-4a8d-bbac-6a494d0d20fc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:17:23.074361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4f8a859e-a98e-4a8d-bbac-6a494d0d20fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:17:23.089539 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a859e-a98e-4a8d-bbac-6a494d0d20fc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:17:23.094810 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fac78-f222-42fb-9ec3-530fbd4c2c97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:17:23.095418 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fac78-f222-42fb-9ec3-530fbd4c2c97 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:17:23.096326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fac78-f222-42fb-9ec3-530fbd4c2c97 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:17:23.096326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fac78-f222-42fb-9ec3-530fbd4c2c97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:17:23.098531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ae7fac78-f222-42fb-9ec3-530fbd4c2c97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:17:23.109911 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fac78-f222-42fb-9ec3-530fbd4c2c97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:17:23.111589 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fac78-f222-42fb-9ec3-530fbd4c2c97 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:17:23.122208 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4531/9107] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:17:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:17:30.246901 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:31.116454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa26765-aebc-46f9-bf0a-9661dcf35fbe service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:17:31.127240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa26765-aebc-46f9-bf0a-9661dcf35fbe service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:17:31.132999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7d62a-3ff9-4dcf-b011-7be635291a72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:17:31.133614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d62a-3ff9-4dcf-b011-7be635291a72 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:17:31.133889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d62a-3ff9-4dcf-b011-7be635291a72 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:17:31.134158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d62a-3ff9-4dcf-b011-7be635291a72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:17:31.135847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4ff7d62a-3ff9-4dcf-b011-7be635291a72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:17:31.147532 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7d62a-3ff9-4dcf-b011-7be635291a72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:17:31.149098 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7d62a-3ff9-4dcf-b011-7be635291a72 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:17:31.158570 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4577/9108] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:17:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:17:33.117915 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:41.154652 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:17:57.193855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8c60f-e11e-44c5-a762-103e380ccc8c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:17:57.194459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8c60f-e11e-44c5-a762-103e380ccc8c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:17:57.194459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8c60f-e11e-44c5-a762-103e380ccc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:17:57.215413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bcc8c60f-e11e-44c5-a762-103e380ccc8c None None] MFA Rules not processed for user `29854b3a4cda48f8a1dea8a01b4589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:17:57.216719 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bcc8c60f-e11e-44c5-a762-103e380ccc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:17:57.223549 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4532/9109] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 02:17:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:17:57.236079 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7d62a-3ff9-4dcf-b011-7be635291a72 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:17:57.245340 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7d62a-3ff9-4dcf-b011-7be635291a72 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:17:57.249016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b61ae0-4456-43ee-a3d5-500cf6f7bc1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:17:57.249615 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b61ae0-4456-43ee-a3d5-500cf6f7bc1c service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:17:57.249893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b61ae0-4456-43ee-a3d5-500cf6f7bc1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:17:57.250163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b61ae0-4456-43ee-a3d5-500cf6f7bc1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:17:57.258246 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b61ae0-4456-43ee-a3d5-500cf6f7bc1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:17:57.259720 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b61ae0-4456-43ee-a3d5-500cf6f7bc1c service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:17:57.267694 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4578/9110] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:17:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:17:57.349533 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd64e1-5143-4f5e-b1a7-3dc9109d0d80 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:17:57.349818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd64e1-5143-4f5e-b1a7-3dc9109d0d80 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:17:57.350294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd64e1-5143-4f5e-b1a7-3dc9109d0d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:17:57.390156 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-90cd64e1-5143-4f5e-b1a7-3dc9109d0d80 None None] MFA Rules not processed for user `619819f081824510a9f9e127e5070662`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:17:57.391436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-90cd64e1-5143-4f5e-b1a7-3dc9109d0d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:17:57.401230 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4533/9111] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 02:17:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:17:57.414428 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b61ae0-4456-43ee-a3d5-500cf6f7bc1c service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:17:57.428851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b61ae0-4456-43ee-a3d5-500cf6f7bc1c service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:17:57.433864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb28484-b1b6-430c-b604-b2d339857156 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:17:57.434465 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28484-b1b6-430c-b604-b2d339857156 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:17:57.434793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28484-b1b6-430c-b604-b2d339857156 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:17:57.435077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28484-b1b6-430c-b604-b2d339857156 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:17:57.445123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb28484-b1b6-430c-b604-b2d339857156 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:17:57.446897 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb28484-b1b6-430c-b604-b2d339857156 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:17:57.457558 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4579/9112] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:17:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:17:57.631787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1b8aa-cce7-4007-9d63-a418f916ba70 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:17:57.632073 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1b8aa-cce7-4007-9d63-a418f916ba70 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:17:57.632344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1b8aa-cce7-4007-9d63-a418f916ba70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:17:57.670667 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a1e1b8aa-cce7-4007-9d63-a418f916ba70 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:17:57.671874 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a1e1b8aa-cce7-4007-9d63-a418f916ba70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:17:57.682037 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4534/9113] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 02:17:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:17:57.693675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb28484-b1b6-430c-b604-b2d339857156 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:17:57.703316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb28484-b1b6-430c-b604-b2d339857156 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:17:57.707789 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c67047-c3db-4951-aa49-f6c468b7db67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:17:57.708357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c67047-c3db-4951-aa49-f6c468b7db67 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:17:57.708631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c67047-c3db-4951-aa49-f6c468b7db67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:17:57.708898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c67047-c3db-4951-aa49-f6c468b7db67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:17:57.718852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c67047-c3db-4951-aa49-f6c468b7db67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:17:57.720268 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c67047-c3db-4951-aa49-f6c468b7db67 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:17:57.731582 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4580/9114] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:17:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:17:57.795843 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1b8aa-cce7-4007-9d63-a418f916ba70 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:17:57.807410 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1b8aa-cce7-4007-9d63-a418f916ba70 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:17:57.812563 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe2e35-197c-4d30-9398-a2ee828651f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:17:57.813162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2e35-197c-4d30-9398-a2ee828651f4 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:17:57.813445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2e35-197c-4d30-9398-a2ee828651f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:17:57.813780 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2e35-197c-4d30-9398-a2ee828651f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:17:57.815537 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0afe2e35-197c-4d30-9398-a2ee828651f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:17:57.827335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe2e35-197c-4d30-9398-a2ee828651f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:17:57.828927 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe2e35-197c-4d30-9398-a2ee828651f4 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:17:57.839157 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4535/9115] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:17:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:18:07.726946 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=18 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:18:07.834991 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=27 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:18:16.369738 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c67047-c3db-4951-aa49-f6c468b7db67 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:18:16.378386 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c67047-c3db-4951-aa49-f6c468b7db67 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:18:16.382083 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0142ba8-a7fc-41fa-986c-7beb9e189fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:18:16.382707 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0142ba8-a7fc-41fa-986c-7beb9e189fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:18:16.383014 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0142ba8-a7fc-41fa-986c-7beb9e189fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:18:16.383306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0142ba8-a7fc-41fa-986c-7beb9e189fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:18:16.384987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f0142ba8-a7fc-41fa-986c-7beb9e189fb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:18:16.394183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0142ba8-a7fc-41fa-986c-7beb9e189fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:18:16.396228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0142ba8-a7fc-41fa-986c-7beb9e189fb1 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:18:16.403841 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4581/9116] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:18:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:18:26.400560 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:15.106935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe2e35-197c-4d30-9398-a2ee828651f4 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:19:15.119691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe2e35-197c-4d30-9398-a2ee828651f4 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:19:15.123440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ba135-2f3b-48b7-863f-d4abb019fc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:19:15.124046 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ba135-2f3b-48b7-863f-d4abb019fc09 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:19:15.124326 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ba135-2f3b-48b7-863f-d4abb019fc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:19:15.124630 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ba135-2f3b-48b7-863f-d4abb019fc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:19:15.136223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ba135-2f3b-48b7-863f-d4abb019fc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:19:15.137680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ba135-2f3b-48b7-863f-d4abb019fc09 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:19:15.147591 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4536/9117] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:19:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:19:16.551180 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0142ba8-a7fc-41fa-986c-7beb9e189fb1 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:19:16.565914 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0142ba8-a7fc-41fa-986c-7beb9e189fb1 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:19:16.571953 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091eda7-a503-4f65-8c3c-47a8994c4210 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:19:16.572780 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091eda7-a503-4f65-8c3c-47a8994c4210 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:19:16.573208 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091eda7-a503-4f65-8c3c-47a8994c4210 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:19:16.573734 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091eda7-a503-4f65-8c3c-47a8994c4210 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:19:16.575583 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1091eda7-a503-4f65-8c3c-47a8994c4210 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:19:16.594462 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091eda7-a503-4f65-8c3c-47a8994c4210 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:19:16.596241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091eda7-a503-4f65-8c3c-47a8994c4210 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:19:16.608344 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4582/9118] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:19:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:19:19.789781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ba135-2f3b-48b7-863f-d4abb019fc09 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:19:19.798189 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ba135-2f3b-48b7-863f-d4abb019fc09 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:19:19.802467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efdbff-9c38-40d1-8a78-8f4d30767334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:19:19.803097 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdbff-9c38-40d1-8a78-8f4d30767334 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:19:19.803375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdbff-9c38-40d1-8a78-8f4d30767334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:19:19.803646 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdbff-9c38-40d1-8a78-8f4d30767334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:19:19.812627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efdbff-9c38-40d1-8a78-8f4d30767334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:19:19.814060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efdbff-9c38-40d1-8a78-8f4d30767334 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:19:19.824041 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4537/9119] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:19:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:19:22.469971 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cd445-c4db-46f1-bc8b-a9c4b0d0da27 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:19:22.470936 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cd445-c4db-46f1-bc8b-a9c4b0d0da27 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:19:22.471376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cd445-c4db-46f1-bc8b-a9c4b0d0da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:19:22.511091 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-391cd445-c4db-46f1-bc8b-a9c4b0d0da27 None None] MFA Rules not processed for user `5c1075fd1070483db992c1b46001a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:19:22.512335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-391cd445-c4db-46f1-bc8b-a9c4b0d0da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:19:22.522504 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4583/9120] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:19:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:19:22.880205 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efdbff-9c38-40d1-8a78-8f4d30767334 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:19:22.889941 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efdbff-9c38-40d1-8a78-8f4d30767334 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:19:22.894235 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd027b-3c4d-4999-bf7d-f5bf4bdee5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:19:22.895043 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd027b-3c4d-4999-bf7d-f5bf4bdee5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:19:22.895429 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd027b-3c4d-4999-bf7d-f5bf4bdee5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:19:22.895805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd027b-3c4d-4999-bf7d-f5bf4bdee5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:19:22.905990 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd027b-3c4d-4999-bf7d-f5bf4bdee5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:19:22.907536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd027b-3c4d-4999-bf7d-f5bf4bdee5b4 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:19:22.918100 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4538/9121] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:19:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:19:23.315107 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cd445-c4db-46f1-bc8b-a9c4b0d0da27 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:19:23.328812 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cd445-c4db-46f1-bc8b-a9c4b0d0da27 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:19:23.335259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab743e1c-d4ca-4a92-967f-ef55e8e1b414 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:19:23.336112 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab743e1c-d4ca-4a92-967f-ef55e8e1b414 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:19:23.336685 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab743e1c-d4ca-4a92-967f-ef55e8e1b414 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:19:23.337122 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab743e1c-d4ca-4a92-967f-ef55e8e1b414 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:19:23.347730 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab743e1c-d4ca-4a92-967f-ef55e8e1b414 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:19:23.349329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab743e1c-d4ca-4a92-967f-ef55e8e1b414 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:19:23.374652 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4584/9122] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:19:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:19:25.953490 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd027b-3c4d-4999-bf7d-f5bf4bdee5b4 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:19:25.972420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd027b-3c4d-4999-bf7d-f5bf4bdee5b4 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:19:25.976554 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947b25d-d48c-47fa-a124-e869713562cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:19:25.977167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947b25d-d48c-47fa-a124-e869713562cc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:19:25.977445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947b25d-d48c-47fa-a124-e869713562cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:19:25.977717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947b25d-d48c-47fa-a124-e869713562cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:19:25.986036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947b25d-d48c-47fa-a124-e869713562cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:19:25.988351 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947b25d-d48c-47fa-a124-e869713562cc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:19:25.997340 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4539/9123] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:19:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:19:33.355319 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=19 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:19:35.993514 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=24 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:20:11.003894 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab743e1c-d4ca-4a92-967f-ef55e8e1b414 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:20:11.013272 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab743e1c-d4ca-4a92-967f-ef55e8e1b414 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:20:11.016788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3872fb-cc79-4df9-81a6-4145c3bd746a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:20:11.017370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3872fb-cc79-4df9-81a6-4145c3bd746a service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:20:11.017649 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3872fb-cc79-4df9-81a6-4145c3bd746a service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:20:11.017920 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3872fb-cc79-4df9-81a6-4145c3bd746a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:20:11.049081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3872fb-cc79-4df9-81a6-4145c3bd746a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:20:11.050500 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3872fb-cc79-4df9-81a6-4145c3bd746a service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:20:11.061333 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4585/9124] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:20:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:20:21.056646 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=15 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:06.098752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947b25d-d48c-47fa-a124-e869713562cc service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:21:06.120678 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947b25d-d48c-47fa-a124-e869713562cc service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:21:06.125781 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfc20c-6d4b-4767-8a1b-94ca7aa0c598 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:21:06.126381 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfc20c-6d4b-4767-8a1b-94ca7aa0c598 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:21:06.126687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfc20c-6d4b-4767-8a1b-94ca7aa0c598 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:21:06.126961 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfc20c-6d4b-4767-8a1b-94ca7aa0c598 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:21:06.128680 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-87dfc20c-6d4b-4767-8a1b-94ca7aa0c598 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:21:06.154882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfc20c-6d4b-4767-8a1b-94ca7aa0c598 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:21:06.156552 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfc20c-6d4b-4767-8a1b-94ca7aa0c598 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:21:06.167984 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4540/9125] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:21:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:21:11.907466 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac7c46-9339-4326-902a-df820adbaf89 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:21:11.908017 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac7c46-9339-4326-902a-df820adbaf89 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:21:11.908431 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac7c46-9339-4326-902a-df820adbaf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:21:11.929891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cbac7c46-9339-4326-902a-df820adbaf89 None None] MFA Rules not processed for user `5c1075fd1070483db992c1b46001a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:21:11.931450 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cbac7c46-9339-4326-902a-df820adbaf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:21:11.941398 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4586/9126] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:21:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:21:16.163524 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=15 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:21.923038 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:21:57.976162 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfc20c-6d4b-4767-8a1b-94ca7aa0c598 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:21:57.985459 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfc20c-6d4b-4767-8a1b-94ca7aa0c598 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:21:57.990169 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff082fa-b609-409c-8377-8e09fc7dc5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:21:57.990811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff082fa-b609-409c-8377-8e09fc7dc5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:21:57.991098 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff082fa-b609-409c-8377-8e09fc7dc5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:21:57.991375 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff082fa-b609-409c-8377-8e09fc7dc5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:21:58.010044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff082fa-b609-409c-8377-8e09fc7dc5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:21:58.011516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff082fa-b609-409c-8377-8e09fc7dc5a1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:21:58.022818 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4541/9127] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:21:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:22:04.332814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac7c46-9339-4326-902a-df820adbaf89 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:04.347306 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac7c46-9339-4326-902a-df820adbaf89 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:04.353547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28819942-3fa1-429f-8032-2fb6f96fde58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:04.354401 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28819942-3fa1-429f-8032-2fb6f96fde58 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:04.355004 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28819942-3fa1-429f-8032-2fb6f96fde58 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:04.355505 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28819942-3fa1-429f-8032-2fb6f96fde58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:04.365871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28819942-3fa1-429f-8032-2fb6f96fde58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:04.367669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28819942-3fa1-429f-8032-2fb6f96fde58 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:04.378968 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4587/9128] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:22:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:22:06.963545 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff082fa-b609-409c-8377-8e09fc7dc5a1 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:06.982477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff082fa-b609-409c-8377-8e09fc7dc5a1 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:06.990167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab327c-5c46-403c-a90a-daca73e914dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:06.990811 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab327c-5c46-403c-a90a-daca73e914dd service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:06.991092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab327c-5c46-403c-a90a-daca73e914dd service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:06.991368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab327c-5c46-403c-a90a-daca73e914dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:07.004440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab327c-5c46-403c-a90a-daca73e914dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:07.006436 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab327c-5c46-403c-a90a-daca73e914dd service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:07.019220 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4542/9129] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:22:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:22:11.122125 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28819942-3fa1-429f-8032-2fb6f96fde58 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:11.183733 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28819942-3fa1-429f-8032-2fb6f96fde58 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:11.188350 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:11.188961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:11.189239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:11.189540 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] PATH_INFO: `/v3/users/5c1075fd1070483db992c1b46001a8e0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:11.191362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1075fd1070483db992c1b46001a8e0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:11.193631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:11.238441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1075fd1070483db992c1b46001a8e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.251737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1075fd1070483db992c1b46001a8e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.252438 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1075fd1070483db992c1b46001a8e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.260285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1075fd1070483db992c1b46001a8e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.260930 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1075fd1070483db992c1b46001a8e0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.273917 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4588/9130] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:22:11 2022] DELETE /identity/v3/users/5c1075fd1070483db992c1b46001a8e0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:22:11.278573 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884492-6bb1-49c4-bbcf-bfd224757686 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:11.279152 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884492-6bb1-49c4-bbcf-bfd224757686 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:11.279355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884492-6bb1-49c4-bbcf-bfd224757686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:11.302482 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dd884492-6bb1-49c4-bbcf-bfd224757686 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:22:11.303642 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dd884492-6bb1-49c4-bbcf-bfd224757686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:11.364553 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4543/9131] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:22:11.374346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:11.375785 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:11.451327 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe324b16-4501-41c9-8ad8-696f7207521b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:11.455211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046a1c5-b47b-44e0-ac32-3d5b5952d50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:11.456965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046a1c5-b47b-44e0-ac32-3d5b5952d50b service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:11.457291 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046a1c5-b47b-44e0-ac32-3d5b5952d50b service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:11.457573 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046a1c5-b47b-44e0-ac32-3d5b5952d50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:11.467383 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046a1c5-b47b-44e0-ac32-3d5b5952d50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:11.468814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046a1c5-b47b-44e0-ac32-3d5b5952d50b service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:11.473883 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:11.481554 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4589/9132] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:22:11.653713 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884492-6bb1-49c4-bbcf-bfd224757686 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:11.655271 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dd884492-6bb1-49c4-bbcf-bfd224757686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:11.668644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884492-6bb1-49c4-bbcf-bfd224757686 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:11.673833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:11.674556 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:11.674935 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:11.675214 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] PATH_INFO: `/v3/projects/bbed5972f66e4bbd8d012c06ef5f384d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:11.676779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbed5972f66e4bbd8d012c06ef5f384d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:11.679329 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:11.730346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbed5972f66e4bbd8d012c06ef5f384d', 'request_id': 'req-107f1756-6357-4622-8296-44bc04156a45'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.735840 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbed5972f66e4bbd8d012c06ef5f384d', 'request_id': 'req-107f1756-6357-4622-8296-44bc04156a45'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.742388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbed5972f66e4bbd8d012c06ef5f384d', 'request_id': 'req-107f1756-6357-4622-8296-44bc04156a45'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.755125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] The token cache is being invalidate because project bbed5972f66e4bbd8d012c06ef5f384d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:22:11.755414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.756036 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.757537 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4544/9133] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:22:11 2022] DELETE /identity/v3/projects/bbed5972f66e4bbd8d012c06ef5f384d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:22:11.761737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046a1c5-b47b-44e0-ac32-3d5b5952d50b service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:11.772399 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046a1c5-b47b-44e0-ac32-3d5b5952d50b service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:11.827131 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41d3ef-8117-4f5c-af6e-6aa3f3620d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:11.827755 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d3ef-8117-4f5c-af6e-6aa3f3620d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:11.828038 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d3ef-8117-4f5c-af6e-6aa3f3620d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:11.828309 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d3ef-8117-4f5c-af6e-6aa3f3620d43 admin admin] PATH_INFO: `/v3/users/084bbd0b819b4ae4b2b48098633d8512` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:11.829420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41d3ef-8117-4f5c-af6e-6aa3f3620d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084bbd0b819b4ae4b2b48098633d8512)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:11.831964 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41d3ef-8117-4f5c-af6e-6aa3f3620d43 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:11.875142 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9e41d3ef-8117-4f5c-af6e-6aa3f3620d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084bbd0b819b4ae4b2b48098633d8512'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.887844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9e41d3ef-8117-4f5c-af6e-6aa3f3620d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084bbd0b819b4ae4b2b48098633d8512'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.888504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9e41d3ef-8117-4f5c-af6e-6aa3f3620d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084bbd0b819b4ae4b2b48098633d8512'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.895815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9e41d3ef-8117-4f5c-af6e-6aa3f3620d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084bbd0b819b4ae4b2b48098633d8512'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.896441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-9e41d3ef-8117-4f5c-af6e-6aa3f3620d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084bbd0b819b4ae4b2b48098633d8512'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:11.908393 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4590/9134] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:22:11 2022] DELETE /identity/v3/users/084bbd0b819b4ae4b2b48098633d8512 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:22:12.181815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:12.183345 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:12.201477 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f1756-6357-4622-8296-44bc04156a45 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:12.250636 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:12.264531 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:12.265106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:12.265385 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:12.265658 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] PATH_INFO: `/v3/projects/d827c4524e5e4f019d255da203b515d0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:12.266828 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d827c4524e5e4f019d255da203b515d0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:12.269313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:12.316949 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd827c4524e5e4f019d255da203b515d0', 'request_id': 'req-db560b84-b0eb-4b41-ae4c-be4141b263d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:12.322924 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd827c4524e5e4f019d255da203b515d0', 'request_id': 'req-db560b84-b0eb-4b41-ae4c-be4141b263d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:12.329146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd827c4524e5e4f019d255da203b515d0', 'request_id': 'req-db560b84-b0eb-4b41-ae4c-be4141b263d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:12.342227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] The token cache is being invalidate because project d827c4524e5e4f019d255da203b515d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:22:12.342519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:12.343179 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-db560b84-b0eb-4b41-ae4c-be4141b263d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:22:12.344662 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4545/9135] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:22:12 2022] DELETE /identity/v3/projects/d827c4524e5e4f019d255da203b515d0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:22:12.350682 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f5379-0b0a-4a40-98b3-cd536d202ffc None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:12.351140 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f5379-0b0a-4a40-98b3-cd536d202ffc None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:12.351258 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f5379-0b0a-4a40-98b3-cd536d202ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:12.381984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-c59f5379-0b0a-4a40-98b3-cd536d202ffc None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:22:12.383225 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c59f5379-0b0a-4a40-98b3-cd536d202ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:12.580225 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4591/9136] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:22:12.588892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7857c4-f604-47b8-9ef5-b9cf7f9de83c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:12.589178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7857c4-f604-47b8-9ef5-b9cf7f9de83c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:12.589455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7857c4-f604-47b8-9ef5-b9cf7f9de83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:12.609241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6c7857c4-f604-47b8-9ef5-b9cf7f9de83c None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:22:12.610463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6c7857c4-f604-47b8-9ef5-b9cf7f9de83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:12.619116 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4546/9137] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:22:12.623262 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f5379-0b0a-4a40-98b3-cd536d202ffc None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:12.632686 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f5379-0b0a-4a40-98b3-cd536d202ffc None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:12.637228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a09d3-c12b-4550-b8c4-99a2f8a8b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:12.637818 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a09d3-c12b-4550-b8c4-99a2f8a8b166 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:12.638093 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a09d3-c12b-4550-b8c4-99a2f8a8b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:12.638363 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a09d3-c12b-4550-b8c4-99a2f8a8b166 admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:12.639031 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a09d3-c12b-4550-b8c4-99a2f8a8b166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 02:22:12.639333 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a09d3-c12b-4550-b8c4-99a2f8a8b166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:12.640906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a09d3-c12b-4550-b8c4-99a2f8a8b166 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:12.643264 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:12.653689 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4592/9138] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 02:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 02:22:12.657999 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7857c4-f604-47b8-9ef5-b9cf7f9de83c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:12.667827 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7857c4-f604-47b8-9ef5-b9cf7f9de83c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:12.672380 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061934ae-0deb-4739-ba83-1e0711962f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:12.672978 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061934ae-0deb-4739-ba83-1e0711962f42 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:12.673259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061934ae-0deb-4739-ba83-1e0711962f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:12.673529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061934ae-0deb-4739-ba83-1e0711962f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:12.674178 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061934ae-0deb-4739-ba83-1e0711962f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:12.676855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061934ae-0deb-4739-ba83-1e0711962f42 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:12.705783 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4547/9139] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:22:12 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:22:12.710141 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a09d3-c12b-4550-b8c4-99a2f8a8b166 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:12.720013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a09d3-c12b-4550-b8c4-99a2f8a8b166 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:12.775444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16f0a6-e9fe-4e18-b1a7-ee9a1f755b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:12.776037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16f0a6-e9fe-4e18-b1a7-ee9a1f755b1d admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:12.776312 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16f0a6-e9fe-4e18-b1a7-ee9a1f755b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:12.776581 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16f0a6-e9fe-4e18-b1a7-ee9a1f755b1d admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:12.777200 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16f0a6-e9fe-4e18-b1a7-ee9a1f755b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:12.779169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16f0a6-e9fe-4e18-b1a7-ee9a1f755b1d admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:12.800930 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4593/9140] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:22:12 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 02:22:12.805125 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061934ae-0deb-4739-ba83-1e0711962f42 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:12.815727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061934ae-0deb-4739-ba83-1e0711962f42 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:12.820882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb13f28-eb7d-4c2a-90c9-6298624597bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:12.821488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13f28-eb7d-4c2a-90c9-6298624597bf admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:12.821818 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13f28-eb7d-4c2a-90c9-6298624597bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:12.822034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13f28-eb7d-4c2a-90c9-6298624597bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:12.822705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb13f28-eb7d-4c2a-90c9-6298624597bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:12.824313 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb13f28-eb7d-4c2a-90c9-6298624597bf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:12.836896 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4548/9141] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:22:12.840893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16f0a6-e9fe-4e18-b1a7-ee9a1f755b1d admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:12.851841 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16f0a6-e9fe-4e18-b1a7-ee9a1f755b1d admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:12.856409 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734a217-faae-42bd-8390-c538836d5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:12.856998 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a217-faae-42bd-8390-c538836d5d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:12.857276 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a217-faae-42bd-8390-c538836d5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:12.857547 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a217-faae-42bd-8390-c538836d5d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:12.858184 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734a217-faae-42bd-8390-c538836d5d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:12.859827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734a217-faae-42bd-8390-c538836d5d43 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:12.869987 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4594/9142] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:22:12.874303 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb13f28-eb7d-4c2a-90c9-6298624597bf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:12.884996 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb13f28-eb7d-4c2a-90c9-6298624597bf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:12.889612 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8fd75-b4c2-4fb6-8690-10fa0d998ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:12.890470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8fd75-b4c2-4fb6-8690-10fa0d998ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:12.890796 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8fd75-b4c2-4fb6-8690-10fa0d998ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:12.891174 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8fd75-b4c2-4fb6-8690-10fa0d998ad4 admin admin] PATH_INFO: `/v3/projects/1f05359cdbb64ee8a632f63c04d6792f/users/efefb16531ff4d68a6e3c97f845e9e12/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:12.906038 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8fd75-b4c2-4fb6-8690-10fa0d998ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f05359cdbb64ee8a632f63c04d6792f, user_id=efefb16531ff4d68a6e3c97f845e9e12, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:12.908826 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8fd75-b4c2-4fb6-8690-10fa0d998ad4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:12.922430 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4549/9143] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:22:12 2022] PUT /identity/v3/projects/1f05359cdbb64ee8a632f63c04d6792f/users/efefb16531ff4d68a6e3c97f845e9e12/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:22:12.927906 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020399-40e6-4e76-8b92-a5731361913b None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:12.928218 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020399-40e6-4e76-8b92-a5731361913b None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:12.928491 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020399-40e6-4e76-8b92-a5731361913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:12.947343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-00020399-40e6-4e76-8b92-a5731361913b None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:22:12.948521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-00020399-40e6-4e76-8b92-a5731361913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:13.007384 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4595/9144] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:22:13.017142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8fd75-b4c2-4fb6-8690-10fa0d998ad4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:13.019416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4ac8fd75-b4c2-4fb6-8690-10fa0d998ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:13.076157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8fd75-b4c2-4fb6-8690-10fa0d998ad4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:13.079855 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784925c-d438-4b09-97b0-fdcb8e590fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:13.080460 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784925c-d438-4b09-97b0-fdcb8e590fcd service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:13.081369 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784925c-d438-4b09-97b0-fdcb8e590fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:13.081649 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784925c-d438-4b09-97b0-fdcb8e590fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:13.090686 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784925c-d438-4b09-97b0-fdcb8e590fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:13.092119 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784925c-d438-4b09-97b0-fdcb8e590fcd service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:13.102162 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4550/9145] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:22:17.147853 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7172c0e-f38b-455b-bf00-82cba6060f05 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:17.148736 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7172c0e-f38b-455b-bf00-82cba6060f05 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:17.149251 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7172c0e-f38b-455b-bf00-82cba6060f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:17.182973 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-a7172c0e-f38b-455b-bf00-82cba6060f05 None None] MFA Rules not processed for user `efefb16531ff4d68a6e3c97f845e9e12`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:22:17.184404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-a7172c0e-f38b-455b-bf00-82cba6060f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:17.252879 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4596/9146] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:22:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:22:17.257496 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784925c-d438-4b09-97b0-fdcb8e590fcd service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:17.267462 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784925c-d438-4b09-97b0-fdcb8e590fcd service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:17.272656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7090344-034f-4af4-9a60-83220b6b183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:17.273258 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7090344-034f-4af4-9a60-83220b6b183f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:17.273536 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7090344-034f-4af4-9a60-83220b6b183f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:17.273853 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7090344-034f-4af4-9a60-83220b6b183f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:17.274509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7090344-034f-4af4-9a60-83220b6b183f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:17.276464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7090344-034f-4af4-9a60-83220b6b183f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:17.298740 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:17.310294 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4551/9147] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:22:17 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:22:17.311494 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7172c0e-f38b-455b-bf00-82cba6060f05 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:17.319434 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:17.326310 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7172c0e-f38b-455b-bf00-82cba6060f05 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:17.399474 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c86824-542f-4bf5-8d13-9543ac6ebac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:17.400082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c86824-542f-4bf5-8d13-9543ac6ebac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:17.400362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c86824-542f-4bf5-8d13-9543ac6ebac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:17.400695 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c86824-542f-4bf5-8d13-9543ac6ebac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:17.401259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c86824-542f-4bf5-8d13-9543ac6ebac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:17.403456 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c86824-542f-4bf5-8d13-9543ac6ebac6 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:17.449421 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4597/9148] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:22:17 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 02:22:17.454442 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7090344-034f-4af4-9a60-83220b6b183f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:17.467165 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7090344-034f-4af4-9a60-83220b6b183f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:17.474959 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bed93-9548-49a9-8b45-8478dccb1fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:17.475662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bed93-9548-49a9-8b45-8478dccb1fee admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:17.476016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bed93-9548-49a9-8b45-8478dccb1fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:17.476422 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bed93-9548-49a9-8b45-8478dccb1fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:17.477191 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bed93-9548-49a9-8b45-8478dccb1fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:17.479103 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bed93-9548-49a9-8b45-8478dccb1fee admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:17.491363 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4552/9149] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 02 02:22:17.495596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c86824-542f-4bf5-8d13-9543ac6ebac6 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:17.506651 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c86824-542f-4bf5-8d13-9543ac6ebac6 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:17.511601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029df0-846f-4e1b-8c38-4352929a908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:17.512275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029df0-846f-4e1b-8c38-4352929a908e admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:17.512555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029df0-846f-4e1b-8c38-4352929a908e admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:17.512827 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029df0-846f-4e1b-8c38-4352929a908e admin admin] PATH_INFO: `/v3/projects/430f6932aff346a9a03ac93c1d14f2b2/users/3ad525fca806493bae13f56e5fca8b93/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:17.529335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d029df0-846f-4e1b-8c38-4352929a908e admin admin] RBAC: Authorizing `identity:create_grant(project_id=430f6932aff346a9a03ac93c1d14f2b2, user_id=3ad525fca806493bae13f56e5fca8b93, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:17.532216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d029df0-846f-4e1b-8c38-4352929a908e admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:17.547397 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4598/9150] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:22:17 2022] PUT /identity/v3/projects/430f6932aff346a9a03ac93c1d14f2b2/users/3ad525fca806493bae13f56e5fca8b93/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 02:22:17.551301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bed93-9548-49a9-8b45-8478dccb1fee admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:17.562044 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bed93-9548-49a9-8b45-8478dccb1fee admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:17.623557 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a761016-fe87-463c-8155-cf18b95dd27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:17.624187 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a761016-fe87-463c-8155-cf18b95dd27c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:17.624470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a761016-fe87-463c-8155-cf18b95dd27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:17.624746 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a761016-fe87-463c-8155-cf18b95dd27c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:17.625402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a761016-fe87-463c-8155-cf18b95dd27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:17.627063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a761016-fe87-463c-8155-cf18b95dd27c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:17.641889 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4553/9151] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:22:17.644081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029df0-846f-4e1b-8c38-4352929a908e admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:17.654950 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029df0-846f-4e1b-8c38-4352929a908e admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:17.660095 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dddd2b-9c18-417f-9dc9-78295dfba891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:17.660395 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dddd2b-9c18-417f-9dc9-78295dfba891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:17.660697 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dddd2b-9c18-417f-9dc9-78295dfba891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:17.661010 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dddd2b-9c18-417f-9dc9-78295dfba891 admin admin] PATH_INFO: `/v3/projects/430f6932aff346a9a03ac93c1d14f2b2/users/3ad525fca806493bae13f56e5fca8b93/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:17.662947 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dddd2b-9c18-417f-9dc9-78295dfba891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430f6932aff346a9a03ac93c1d14f2b2, user_id=3ad525fca806493bae13f56e5fca8b93, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:17.665584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dddd2b-9c18-417f-9dc9-78295dfba891 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:17.676839 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4599/9152] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:22:17 2022] PUT /identity/v3/projects/430f6932aff346a9a03ac93c1d14f2b2/users/3ad525fca806493bae13f56e5fca8b93/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:22:22.574287 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f053c08-b474-415b-b620-6e0f85b91b84 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:22.574830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f053c08-b474-415b-b620-6e0f85b91b84 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:22.574830 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f053c08-b474-415b-b620-6e0f85b91b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:22.603761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6f053c08-b474-415b-b620-6e0f85b91b84 None None] MFA Rules not processed for user `3ad525fca806493bae13f56e5fca8b93`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:22:22.604981 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6f053c08-b474-415b-b620-6e0f85b91b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:22.697329 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4554/9153] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:22:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:22:22.716073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dddd2b-9c18-417f-9dc9-78295dfba891 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:22.717887 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-e2dddd2b-9c18-417f-9dc9-78295dfba891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:22.815128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dddd2b-9c18-417f-9dc9-78295dfba891 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:22.820719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16970ac7-1f17-4301-9c39-4eb89b458d05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:22.821323 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16970ac7-1f17-4301-9c39-4eb89b458d05 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:22.821596 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16970ac7-1f17-4301-9c39-4eb89b458d05 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:22.821867 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16970ac7-1f17-4301-9c39-4eb89b458d05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:22.910259 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:22.928080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16970ac7-1f17-4301-9c39-4eb89b458d05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:22.929722 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16970ac7-1f17-4301-9c39-4eb89b458d05 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:22.939621 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4600/9154] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:22:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:22:24.028183 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf89bdf-2303-4899-b955-acaca1e3cb06 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:24.028728 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf89bdf-2303-4899-b955-acaca1e3cb06 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:24.029056 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf89bdf-2303-4899-b955-acaca1e3cb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:24.051782 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9cf89bdf-2303-4899-b955-acaca1e3cb06 None None] MFA Rules not processed for user `efefb16531ff4d68a6e3c97f845e9e12`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:22:24.053025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9cf89bdf-2303-4899-b955-acaca1e3cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:24.061938 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4555/9155] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:22:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:22:24.426614 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16970ac7-1f17-4301-9c39-4eb89b458d05 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:24.428300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-16970ac7-1f17-4301-9c39-4eb89b458d05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:24.497599 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16970ac7-1f17-4301-9c39-4eb89b458d05 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:24.501981 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c5d31-3150-4677-900d-34c7264c2829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:24.502740 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5d31-3150-4677-900d-34c7264c2829 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:24.503068 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5d31-3150-4677-900d-34c7264c2829 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:24.503411 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5d31-3150-4677-900d-34c7264c2829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:24.505495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-310c5d31-3150-4677-900d-34c7264c2829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:24.515364 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c5d31-3150-4677-900d-34c7264c2829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:24.516805 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c5d31-3150-4677-900d-34c7264c2829 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:24.524931 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4601/9156] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:22:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:22:29.057070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf89bdf-2303-4899-b955-acaca1e3cb06 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:29.058485 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9cf89bdf-2303-4899-b955-acaca1e3cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:29.121993 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:29.140430 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf89bdf-2303-4899-b955-acaca1e3cb06 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:29.145918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8257d5-86f5-413c-93bd-b5aab74bdf91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:29.146524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8257d5-86f5-413c-93bd-b5aab74bdf91 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:29.146837 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8257d5-86f5-413c-93bd-b5aab74bdf91 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:29.147110 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8257d5-86f5-413c-93bd-b5aab74bdf91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:29.148800 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d8257d5-86f5-413c-93bd-b5aab74bdf91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:29.160231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8257d5-86f5-413c-93bd-b5aab74bdf91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:29.161812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8257d5-86f5-413c-93bd-b5aab74bdf91 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:29.172133 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4556/9157] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:22:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 02:22:34.521298 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=34 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:36.059034 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c5d31-3150-4677-900d-34c7264c2829 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:36.060559 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-310c5d31-3150-4677-900d-34c7264c2829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:36.081316 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c5d31-3150-4677-900d-34c7264c2829 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:36.086302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded7f46-9ae5-4589-99a4-4c912ba20bef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:36.086940 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded7f46-9ae5-4589-99a4-4c912ba20bef service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:36.087220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded7f46-9ae5-4589-99a4-4c912ba20bef service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:36.087495 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded7f46-9ae5-4589-99a4-4c912ba20bef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:36.089183 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-7ded7f46-9ae5-4589-99a4-4c912ba20bef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:36.101305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded7f46-9ae5-4589-99a4-4c912ba20bef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:36.102902 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded7f46-9ae5-4589-99a4-4c912ba20bef service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:36.112612 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4602/9158] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:22:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:22:37.966008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8257d5-86f5-413c-93bd-b5aab74bdf91 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:37.967809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d8257d5-86f5-413c-93bd-b5aab74bdf91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:37.985457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8257d5-86f5-413c-93bd-b5aab74bdf91 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:37.991085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b43ff5-1f47-44df-960e-9f41f2c80954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:37.991684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43ff5-1f47-44df-960e-9f41f2c80954 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:37.991966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43ff5-1f47-44df-960e-9f41f2c80954 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:37.992239 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43ff5-1f47-44df-960e-9f41f2c80954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:37.993964 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a8b43ff5-1f47-44df-960e-9f41f2c80954 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:22:38.006988 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b43ff5-1f47-44df-960e-9f41f2c80954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:38.008580 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b43ff5-1f47-44df-960e-9f41f2c80954 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:38.019732 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4557/9159] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:22:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:22:40.240501 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded7f46-9ae5-4589-99a4-4c912ba20bef service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:22:40.249525 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded7f46-9ae5-4589-99a4-4c912ba20bef service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:22:40.253816 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6e20b-2cfd-4f2f-82b2-3bada1453336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:22:40.254406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e20b-2cfd-4f2f-82b2-3bada1453336 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:22:40.254711 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e20b-2cfd-4f2f-82b2-3bada1453336 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:22:40.254982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e20b-2cfd-4f2f-82b2-3bada1453336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:22:40.263661 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6e20b-2cfd-4f2f-82b2-3bada1453336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:22:40.265063 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6e20b-2cfd-4f2f-82b2-3bada1453336 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:22:40.274205 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4603/9160] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:22:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:22:48.014621 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=15 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:22:50.270270 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=12 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:23:38.456742 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b43ff5-1f47-44df-960e-9f41f2c80954 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:23:38.466106 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b43ff5-1f47-44df-960e-9f41f2c80954 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:23:38.469651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80327ca-0428-4024-8fc3-90c356596cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:23:38.470241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80327ca-0428-4024-8fc3-90c356596cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:23:38.470521 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80327ca-0428-4024-8fc3-90c356596cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:23:38.470823 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80327ca-0428-4024-8fc3-90c356596cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:23:38.472502 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e80327ca-0428-4024-8fc3-90c356596cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:23:38.482344 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80327ca-0428-4024-8fc3-90c356596cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:23:38.483845 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80327ca-0428-4024-8fc3-90c356596cb9 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:23:38.491799 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4558/9161] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:23:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:23:48.488193 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:12.790626 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6e20b-2cfd-4f2f-82b2-3bada1453336 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:25:12.809238 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6e20b-2cfd-4f2f-82b2-3bada1453336 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:25:12.812896 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44921c-08ec-4376-b9ff-67bf4a7c7868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:25:12.813489 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44921c-08ec-4376-b9ff-67bf4a7c7868 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:12.813788 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44921c-08ec-4376-b9ff-67bf4a7c7868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:12.814057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44921c-08ec-4376-b9ff-67bf4a7c7868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:12.815775 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1d44921c-08ec-4376-b9ff-67bf4a7c7868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:12.828876 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44921c-08ec-4376-b9ff-67bf4a7c7868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:25:12.830229 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44921c-08ec-4376-b9ff-67bf4a7c7868 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:25:12.851517 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4604/9162] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:25:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:25:22.848460 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=14 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:25.147674 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037ac4-be0e-40a8-8dc8-939d00757d01 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:25.148216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037ac4-be0e-40a8-8dc8-939d00757d01 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:25.148216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037ac4-be0e-40a8-8dc8-939d00757d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:25.213402 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-11037ac4-be0e-40a8-8dc8-939d00757d01 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:25:25.214699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-11037ac4-be0e-40a8-8dc8-939d00757d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:25.284778 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4559/9163] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 02:25:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:25:25.339938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44921c-08ec-4376-b9ff-67bf4a7c7868 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:25:25.341984 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-1d44921c-08ec-4376-b9ff-67bf4a7c7868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:25.438194 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44921c-08ec-4376-b9ff-67bf4a7c7868 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:25:25.443157 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea508ddf-1bee-4a9a-8d96-5043c61db477 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:25:25.443990 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea508ddf-1bee-4a9a-8d96-5043c61db477 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:25.444357 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea508ddf-1bee-4a9a-8d96-5043c61db477 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:25.444623 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea508ddf-1bee-4a9a-8d96-5043c61db477 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:25.453674 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea508ddf-1bee-4a9a-8d96-5043c61db477 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:25:25.455282 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea508ddf-1bee-4a9a-8d96-5043c61db477 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:25:25.463862 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4605/9164] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:25:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:25:35.281578 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=44 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:35.459838 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=41 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:38.045967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11037ac4-be0e-40a8-8dc8-939d00757d01 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:25:38.057231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11037ac4-be0e-40a8-8dc8-939d00757d01 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:25:38.065467 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da511e-6a43-40d5-98bf-f19f58460a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:25:38.066084 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da511e-6a43-40d5-98bf-f19f58460a94 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:38.066374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da511e-6a43-40d5-98bf-f19f58460a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:38.066690 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da511e-6a43-40d5-98bf-f19f58460a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:38.070707 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31da511e-6a43-40d5-98bf-f19f58460a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:38.080816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da511e-6a43-40d5-98bf-f19f58460a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:25:38.082196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da511e-6a43-40d5-98bf-f19f58460a94 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:25:38.090313 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4560/9165] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:25:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:25:38.207590 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e473c-5c6b-4b67-9cbb-e7d9436a4027 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:38.208116 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e473c-5c6b-4b67-9cbb-e7d9436a4027 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:38.208217 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e473c-5c6b-4b67-9cbb-e7d9436a4027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:38.228121 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d76e473c-5c6b-4b67-9cbb-e7d9436a4027 None None] MFA Rules not processed for user `b85fc7e555f348c3ab6c63ee15f6ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:25:38.229403 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d76e473c-5c6b-4b67-9cbb-e7d9436a4027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:38.238667 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4606/9166] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 2 02:25:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:25:38.251025 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da511e-6a43-40d5-98bf-f19f58460a94 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:25:38.252535 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31da511e-6a43-40d5-98bf-f19f58460a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:38.335473 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da511e-6a43-40d5-98bf-f19f58460a94 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:25:38.339217 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c989d-c43e-42f3-94da-4b3845b07a54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:25:38.339825 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c989d-c43e-42f3-94da-4b3845b07a54 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:38.340101 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c989d-c43e-42f3-94da-4b3845b07a54 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:38.340373 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c989d-c43e-42f3-94da-4b3845b07a54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:38.350859 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c989d-c43e-42f3-94da-4b3845b07a54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:25:38.352824 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c989d-c43e-42f3-94da-4b3845b07a54 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:25:38.363506 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4561/9167] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:25:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:25:38.430941 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e473c-5c6b-4b67-9cbb-e7d9436a4027 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:25:38.440577 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e473c-5c6b-4b67-9cbb-e7d9436a4027 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:25:38.444441 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb934e0-225f-4645-9f20-7a080b66d9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:25:38.445169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb934e0-225f-4645-9f20-7a080b66d9fe service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:38.445765 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb934e0-225f-4645-9f20-7a080b66d9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:38.446278 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb934e0-225f-4645-9f20-7a080b66d9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:38.448349 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cbb934e0-225f-4645-9f20-7a080b66d9fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:38.457709 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb934e0-225f-4645-9f20-7a080b66d9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:25:38.459171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb934e0-225f-4645-9f20-7a080b66d9fe service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:25:38.467327 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4607/9168] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:25:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:25:38.543939 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c989d-c43e-42f3-94da-4b3845b07a54 service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:25:38.553399 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c989d-c43e-42f3-94da-4b3845b07a54 service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:25:38.557252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08a708-4f21-4625-9ad5-f0f066cdd29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:25:38.557848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a708-4f21-4625-9ad5-f0f066cdd29e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:38.558126 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a708-4f21-4625-9ad5-f0f066cdd29e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:38.558395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a708-4f21-4625-9ad5-f0f066cdd29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:38.560176 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f08a708-4f21-4625-9ad5-f0f066cdd29e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:38.573216 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08a708-4f21-4625-9ad5-f0f066cdd29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:25:38.574662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08a708-4f21-4625-9ad5-f0f066cdd29e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:25:38.585093 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4562/9169] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:25:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:25:38.646815 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb934e0-225f-4645-9f20-7a080b66d9fe service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:25:38.669477 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb934e0-225f-4645-9f20-7a080b66d9fe service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:25:38.674579 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c1602-90d6-42b3-be80-ea4771a75178 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:25:38.675199 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c1602-90d6-42b3-be80-ea4771a75178 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:38.675479 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c1602-90d6-42b3-be80-ea4771a75178 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:38.675747 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c1602-90d6-42b3-be80-ea4771a75178 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:38.677432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-764c1602-90d6-42b3-be80-ea4771a75178 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:38.688784 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c1602-90d6-42b3-be80-ea4771a75178 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:25:38.690343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c1602-90d6-42b3-be80-ea4771a75178 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:25:38.700362 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4608/9170] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:25:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:25:39.556759 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08a708-4f21-4625-9ad5-f0f066cdd29e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:25:39.565265 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08a708-4f21-4625-9ad5-f0f066cdd29e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:25:39.569102 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a078fba-04da-4a69-b34a-d1a84b3e5ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:25:39.569689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078fba-04da-4a69-b34a-d1a84b3e5ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:39.569965 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078fba-04da-4a69-b34a-d1a84b3e5ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:39.570267 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078fba-04da-4a69-b34a-d1a84b3e5ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:39.571983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5a078fba-04da-4a69-b34a-d1a84b3e5ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:39.581259 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a078fba-04da-4a69-b34a-d1a84b3e5ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:25:39.582730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a078fba-04da-4a69-b34a-d1a84b3e5ce4 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:25:39.590825 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4563/9171] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:25:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:25:41.188235 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a80d-c789-43d5-90c2-bd44e90bbdc4 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:41.188749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a80d-c789-43d5-90c2-bd44e90bbdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:41.189015 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a80d-c789-43d5-90c2-bd44e90bbdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:41.209487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-4150a80d-c789-43d5-90c2-bd44e90bbdc4 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:25:41.210786 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4150a80d-c789-43d5-90c2-bd44e90bbdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:41.220222 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4609/9172] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 02:25:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:25:41.232361 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a078fba-04da-4a69-b34a-d1a84b3e5ce4 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:25:41.244702 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a078fba-04da-4a69-b34a-d1a84b3e5ce4 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:25:41.249620 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e3a3d-82b0-41fd-b7f2-04d2c4dbed3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:25:41.250222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3a3d-82b0-41fd-b7f2-04d2c4dbed3b service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:41.250506 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3a3d-82b0-41fd-b7f2-04d2c4dbed3b service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:41.250829 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3a3d-82b0-41fd-b7f2-04d2c4dbed3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:41.259558 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e3a3d-82b0-41fd-b7f2-04d2c4dbed3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:25:41.261192 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e3a3d-82b0-41fd-b7f2-04d2c4dbed3b service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:25:41.269328 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4564/9173] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:25:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:25:51.204411 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=22 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:51.266048 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=59 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:25:56.086086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817ceab-c5bd-49cc-ad2f-dae11af9c085 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:56.086641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817ceab-c5bd-49cc-ad2f-dae11af9c085 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:56.086861 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817ceab-c5bd-49cc-ad2f-dae11af9c085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:56.108485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-d817ceab-c5bd-49cc-ad2f-dae11af9c085 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:25:56.109754 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-d817ceab-c5bd-49cc-ad2f-dae11af9c085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:25:56.117065 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4610/9174] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 02:25:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:25:56.130895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e3a3d-82b0-41fd-b7f2-04d2c4dbed3b service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:25:56.141900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e3a3d-82b0-41fd-b7f2-04d2c4dbed3b service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:25:56.147037 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7047ef-f131-4ee0-858b-70570235912b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:25:56.147644 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7047ef-f131-4ee0-858b-70570235912b service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:25:56.147925 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7047ef-f131-4ee0-858b-70570235912b service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:25:56.148316 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7047ef-f131-4ee0-858b-70570235912b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:25:56.157414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7047ef-f131-4ee0-858b-70570235912b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:25:56.159075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7047ef-f131-4ee0-858b-70570235912b service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:25:56.167608 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4565/9175] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:25:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:26:06.103504 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=3 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:26:06.163846 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:07.620511 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817ceab-c5bd-49cc-ad2f-dae11af9c085 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:27:07.635007 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817ceab-c5bd-49cc-ad2f-dae11af9c085 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:27:07.640893 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab787761-e7c0-43b4-a19a-5b17173d2735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:27:07.641521 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab787761-e7c0-43b4-a19a-5b17173d2735 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:27:07.641929 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab787761-e7c0-43b4-a19a-5b17173d2735 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:27:07.642482 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab787761-e7c0-43b4-a19a-5b17173d2735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:27:07.645907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ab787761-e7c0-43b4-a19a-5b17173d2735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:27:07.657718 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab787761-e7c0-43b4-a19a-5b17173d2735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:27:07.659430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab787761-e7c0-43b4-a19a-5b17173d2735 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:27:07.671883 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4611/9176] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:27:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:27:07.810432 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7047ef-f131-4ee0-858b-70570235912b service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:27:07.819876 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7047ef-f131-4ee0-858b-70570235912b service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:27:07.824188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfe8a2-ff4f-48bd-b420-c2d0e690e270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:27:07.824817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfe8a2-ff4f-48bd-b420-c2d0e690e270 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:27:07.825121 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfe8a2-ff4f-48bd-b420-c2d0e690e270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:27:07.825395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfe8a2-ff4f-48bd-b420-c2d0e690e270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:27:07.827150 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70bfe8a2-ff4f-48bd-b420-c2d0e690e270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:27:07.841276 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfe8a2-ff4f-48bd-b420-c2d0e690e270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:27:07.842687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfe8a2-ff4f-48bd-b420-c2d0e690e270 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:27:07.855199 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4566/9177] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:27:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:27:13.554868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1220d-a92c-4530-b8e2-930a53c1567c None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:27:13.555382 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1220d-a92c-4530-b8e2-930a53c1567c None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:27:13.555510 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1220d-a92c-4530-b8e2-930a53c1567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:27:13.574751 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-b7a1220d-a92c-4530-b8e2-930a53c1567c None None] MFA Rules not processed for user `efefb16531ff4d68a6e3c97f845e9e12`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:27:13.575935 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b7a1220d-a92c-4530-b8e2-930a53c1567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:27:13.582585 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4612/9178] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:27:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:27:17.850181 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:22.432341 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfe8a2-ff4f-48bd-b420-c2d0e690e270 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:27:22.433787 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70bfe8a2-ff4f-48bd-b420-c2d0e690e270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:27:22.513995 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfe8a2-ff4f-48bd-b420-c2d0e690e270 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:27:22.517815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1444b84-ea23-4ca2-af06-55ccdf80ddb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62cd9bcc90e4d6685c5d0fc1d8ceae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:27:22.518470 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1444b84-ea23-4ca2-af06-55ccdf80ddb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:27:22.518790 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1444b84-ea23-4ca2-af06-55ccdf80ddb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:27:22.519068 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1444b84-ea23-4ca2-af06-55ccdf80ddb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:27:22.527860 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1444b84-ea23-4ca2-af06-55ccdf80ddb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:27:22.529343 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1444b84-ea23-4ca2-af06-55ccdf80ddb7 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:27:22.540797 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4567/9179] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:27:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:27:23.569131 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=9 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:30.764689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1220d-a92c-4530-b8e2-930a53c1567c None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:27:30.778176 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1220d-a92c-4530-b8e2-930a53c1567c None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:27:30.783370 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8817a-a342-40f7-a398-a5b063d50472 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:27:30.783965 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8817a-a342-40f7-a398-a5b063d50472 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:27:30.784240 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8817a-a342-40f7-a398-a5b063d50472 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:27:30.784507 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8817a-a342-40f7-a398-a5b063d50472 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:27:30.786171 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0bf8817a-a342-40f7-a398-a5b063d50472 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:27:30.797797 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8817a-a342-40f7-a398-a5b063d50472 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:27:30.799420 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8817a-a342-40f7-a398-a5b063d50472 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:27:30.809053 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4613/9180] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:27:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:27:31.030740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1444b84-ea23-4ca2-af06-55ccdf80ddb7 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:27:31.043016 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1444b84-ea23-4ca2-af06-55ccdf80ddb7 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:27:31.048031 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270a8f8-2c8d-4b68-bfe8-2faff7db31c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:27:31.048628 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270a8f8-2c8d-4b68-bfe8-2faff7db31c3 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:27:31.048915 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270a8f8-2c8d-4b68-bfe8-2faff7db31c3 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:27:31.049193 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270a8f8-2c8d-4b68-bfe8-2faff7db31c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:27:31.058575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270a8f8-2c8d-4b68-bfe8-2faff7db31c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:27:31.060227 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270a8f8-2c8d-4b68-bfe8-2faff7db31c3 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:27:31.070384 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4568/9181] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:27:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:27:40.804814 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:41.066094 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=41 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:42.079814 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8817a-a342-40f7-a398-a5b063d50472 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:27:42.090486 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8817a-a342-40f7-a398-a5b063d50472 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:27:42.095527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1d0b5-9e25-4887-9695-6f5ed1c775ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:27:42.096120 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d0b5-9e25-4887-9695-6f5ed1c775ad service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:27:42.096404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d0b5-9e25-4887-9695-6f5ed1c775ad service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:27:42.096678 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d0b5-9e25-4887-9695-6f5ed1c775ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:27:42.105444 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1d0b5-9e25-4887-9695-6f5ed1c775ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:27:42.107049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1d0b5-9e25-4887-9695-6f5ed1c775ad service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:27:42.116654 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4614/9182] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:27:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:27:49.459157 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270a8f8-2c8d-4b68-bfe8-2faff7db31c3 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:27:49.472863 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270a8f8-2c8d-4b68-bfe8-2faff7db31c3 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:27:49.480966 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d6510-5bd9-44d9-b13c-256b538b7441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:27:49.481668 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d6510-5bd9-44d9-b13c-256b538b7441 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:27:49.482021 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d6510-5bd9-44d9-b13c-256b538b7441 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:27:49.482365 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d6510-5bd9-44d9-b13c-256b538b7441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:27:49.492607 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d6510-5bd9-44d9-b13c-256b538b7441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:27:49.496109 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d6510-5bd9-44d9-b13c-256b538b7441 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:27:49.508034 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4569/9183] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:27:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 02 02:27:52.112533 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:27:52.153109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1d0b5-9e25-4887-9695-6f5ed1c775ad service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:27:52.162241 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1d0b5-9e25-4887-9695-6f5ed1c775ad service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:27:52.165772 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8844762-617c-4f23-9c3c-41bddba47bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:27:52.166921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844762-617c-4f23-9c3c-41bddba47bec service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:27:52.167205 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844762-617c-4f23-9c3c-41bddba47bec service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:27:52.167480 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844762-617c-4f23-9c3c-41bddba47bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:27:52.176169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8844762-617c-4f23-9c3c-41bddba47bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:27:52.177592 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8844762-617c-4f23-9c3c-41bddba47bec service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:27:52.187955 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4615/9184] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:27:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:27:59.502669 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:28:02.183758 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:30:05.362974 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d6510-5bd9-44d9-b13c-256b538b7441 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:30:05.372237 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d6510-5bd9-44d9-b13c-256b538b7441 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:30:05.375812 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34e3f4-2d24-476e-a6b5-e02fa65342b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:30:05.376400 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34e3f4-2d24-476e-a6b5-e02fa65342b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:30:05.377662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34e3f4-2d24-476e-a6b5-e02fa65342b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:30:05.377662 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34e3f4-2d24-476e-a6b5-e02fa65342b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:30:05.384631 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34e3f4-2d24-476e-a6b5-e02fa65342b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:30:05.386054 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34e3f4-2d24-476e-a6b5-e02fa65342b4 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:30:05.393866 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4570/9185] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:30:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:30:11.285080 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8844762-617c-4f23-9c3c-41bddba47bec service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:30:11.293561 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8844762-617c-4f23-9c3c-41bddba47bec service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:30:11.297137 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497525-9ac3-4e17-a5a3-54db1ad94ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:30:11.297712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497525-9ac3-4e17-a5a3-54db1ad94ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:30:11.297993 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497525-9ac3-4e17-a5a3-54db1ad94ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:30:11.298259 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497525-9ac3-4e17-a5a3-54db1ad94ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:30:11.305220 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f497525-9ac3-4e17-a5a3-54db1ad94ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:30:11.306640 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f497525-9ac3-4e17-a5a3-54db1ad94ee2 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:30:11.314282 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4616/9186] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:30:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:30:15.164433 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34e3f4-2d24-476e-a6b5-e02fa65342b4 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:30:15.173071 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34e3f4-2d24-476e-a6b5-e02fa65342b4 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:30:15.177268 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc759f8-263f-425a-b3ac-cc3bc621403f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:30:15.177882 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc759f8-263f-425a-b3ac-cc3bc621403f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:30:15.178159 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc759f8-263f-425a-b3ac-cc3bc621403f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:30:15.178427 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc759f8-263f-425a-b3ac-cc3bc621403f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:30:15.209438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc759f8-263f-425a-b3ac-cc3bc621403f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:30:15.210904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc759f8-263f-425a-b3ac-cc3bc621403f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:30:15.221381 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4571/9187] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:30:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:30:21.310844 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=6 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:30:25.216767 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=21 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:31:41.491281 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497525-9ac3-4e17-a5a3-54db1ad94ee2 service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:41.524933 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497525-9ac3-4e17-a5a3-54db1ad94ee2 service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:41.531406 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a1580-816c-4927-ac19-5bf0f56d848d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:41.532020 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a1580-816c-4927-ac19-5bf0f56d848d service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:41.532307 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a1580-816c-4927-ac19-5bf0f56d848d service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:41.532584 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a1580-816c-4927-ac19-5bf0f56d848d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:41.534318 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0d3a1580-816c-4927-ac19-5bf0f56d848d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:31:41.570321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a1580-816c-4927-ac19-5bf0f56d848d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:41.574299 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a1580-816c-4927-ac19-5bf0f56d848d service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:41.585476 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4617/9188] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:31:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:31:50.048575 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc759f8-263f-425a-b3ac-cc3bc621403f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:50.068594 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc759f8-263f-425a-b3ac-cc3bc621403f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:50.072388 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc78d5e-d691-4c4d-a1df-308cb766a3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:50.073803 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc78d5e-d691-4c4d-a1df-308cb766a3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:50.074094 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc78d5e-d691-4c4d-a1df-308cb766a3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:50.074367 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc78d5e-d691-4c4d-a1df-308cb766a3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:50.147956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc78d5e-d691-4c4d-a1df-308cb766a3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:50.149413 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc78d5e-d691-4c4d-a1df-308cb766a3c4 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:50.170175 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4572/9189] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:31:51.580915 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=19 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:31:53.129854 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a1580-816c-4927-ac19-5bf0f56d848d service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:53.141903 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a1580-816c-4927-ac19-5bf0f56d848d service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:53.146983 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ff547-809b-44b6-8a32-9bdf31bf362a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:53.147601 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff547-809b-44b6-8a32-9bdf31bf362a service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:53.147885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff547-809b-44b6-8a32-9bdf31bf362a service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:53.148161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff547-809b-44b6-8a32-9bdf31bf362a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:53.150036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-112ff547-809b-44b6-8a32-9bdf31bf362a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:31:53.165216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ff547-809b-44b6-8a32-9bdf31bf362a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:53.167558 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ff547-809b-44b6-8a32-9bdf31bf362a service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:53.182584 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4618/9190] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:31:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:31:56.413420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc78d5e-d691-4c4d-a1df-308cb766a3c4 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:56.424850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc78d5e-d691-4c4d-a1df-308cb766a3c4 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:56.429865 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba4efa-32a7-48b3-b5e3-0de70884c424 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:56.430414 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba4efa-32a7-48b3-b5e3-0de70884c424 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:56.430726 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba4efa-32a7-48b3-b5e3-0de70884c424 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:56.431004 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba4efa-32a7-48b3-b5e3-0de70884c424 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:56.432895 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28ba4efa-32a7-48b3-b5e3-0de70884c424 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:31:56.444358 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba4efa-32a7-48b3-b5e3-0de70884c424 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:56.445947 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba4efa-32a7-48b3-b5e3-0de70884c424 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:56.457233 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4573/9191] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:31:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:31:56.472710 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ff547-809b-44b6-8a32-9bdf31bf362a service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:56.485962 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ff547-809b-44b6-8a32-9bdf31bf362a service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:56.493404 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:56.494986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:56.495727 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:56.496109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] PATH_INFO: `/v3/users/efefb16531ff4d68a6e3c97f845e9e12` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:56.499190 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efefb16531ff4d68a6e3c97f845e9e12)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:56.501250 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:56.556293 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efefb16531ff4d68a6e3c97f845e9e12'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:56.574442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efefb16531ff4d68a6e3c97f845e9e12'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:56.575504 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efefb16531ff4d68a6e3c97f845e9e12'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:56.591057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efefb16531ff4d68a6e3c97f845e9e12'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:56.592145 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efefb16531ff4d68a6e3c97f845e9e12'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:56.605246 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4619/9192] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:31:56 2022] DELETE /identity/v3/users/efefb16531ff4d68a6e3c97f845e9e12 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:31:56.785583 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba4efa-32a7-48b3-b5e3-0de70884c424 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:56.800938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba4efa-32a7-48b3-b5e3-0de70884c424 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:56.865254 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:56.865886 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:56.866167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:56.866440 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] PATH_INFO: `/v3/projects/1f05359cdbb64ee8a632f63c04d6792f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:56.867590 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f05359cdbb64ee8a632f63c04d6792f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:56.869566 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:56.915900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f05359cdbb64ee8a632f63c04d6792f', 'request_id': 'req-96929f5e-7f8d-4bee-b541-7eadd3703437'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:56.919953 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:31:56.922229 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f05359cdbb64ee8a632f63c04d6792f', 'request_id': 'req-96929f5e-7f8d-4bee-b541-7eadd3703437'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:56.929170 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f05359cdbb64ee8a632f63c04d6792f', 'request_id': 'req-96929f5e-7f8d-4bee-b541-7eadd3703437'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:56.955067 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] The token cache is being invalidate because project 1f05359cdbb64ee8a632f63c04d6792f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:31:56.955302 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:56.955918 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:56.957463 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4574/9193] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:31:56 2022] DELETE /identity/v3/projects/1f05359cdbb64ee8a632f63c04d6792f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:31:56.961493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:56.963519 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:31:56.976591 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4114be-8122-4158-89fe-164fac74c770 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:57.032011 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0cae3-71b2-40ea-8e1d-7ade87ae2bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:57.032633 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0cae3-71b2-40ea-8e1d-7ade87ae2bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:57.032915 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0cae3-71b2-40ea-8e1d-7ade87ae2bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:57.033188 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0cae3-71b2-40ea-8e1d-7ade87ae2bd7 admin admin] PATH_INFO: `/v3/users/3ad525fca806493bae13f56e5fca8b93` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:57.034296 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0cae3-71b2-40ea-8e1d-7ade87ae2bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad525fca806493bae13f56e5fca8b93)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:57.036287 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0cae3-71b2-40ea-8e1d-7ade87ae2bd7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:57.081648 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4be0cae3-71b2-40ea-8e1d-7ade87ae2bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad525fca806493bae13f56e5fca8b93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:57.092235 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:31:57.094891 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4be0cae3-71b2-40ea-8e1d-7ade87ae2bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad525fca806493bae13f56e5fca8b93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:57.095625 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4be0cae3-71b2-40ea-8e1d-7ade87ae2bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad525fca806493bae13f56e5fca8b93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:57.104675 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4be0cae3-71b2-40ea-8e1d-7ade87ae2bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad525fca806493bae13f56e5fca8b93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:57.105302 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-4be0cae3-71b2-40ea-8e1d-7ade87ae2bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad525fca806493bae13f56e5fca8b93'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:57.117535 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4620/9194] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:31:56 2022] DELETE /identity/v3/users/3ad525fca806493bae13f56e5fca8b93 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:31:57.311900 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:57.313409 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:31:57.329118 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96929f5e-7f8d-4bee-b541-7eadd3703437 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:57.392883 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:57.393523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:57.393805 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:57.394085 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] PATH_INFO: `/v3/projects/430f6932aff346a9a03ac93c1d14f2b2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:57.395221 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] RBAC: Authorizing `identity:delete_project(project_id=430f6932aff346a9a03ac93c1d14f2b2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:57.397182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:57.444854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430f6932aff346a9a03ac93c1d14f2b2', 'request_id': 'req-80530b13-246b-4d03-9fc5-06a34a46360d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:57.451464 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430f6932aff346a9a03ac93c1d14f2b2', 'request_id': 'req-80530b13-246b-4d03-9fc5-06a34a46360d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:57.458082 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430f6932aff346a9a03ac93c1d14f2b2', 'request_id': 'req-80530b13-246b-4d03-9fc5-06a34a46360d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:57.472553 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] The token cache is being invalidate because project 430f6932aff346a9a03ac93c1d14f2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:31:57.472846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:57.473510 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-80530b13-246b-4d03-9fc5-06a34a46360d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:31:57.475166 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4575/9195] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:31:57 2022] DELETE /identity/v3/projects/430f6932aff346a9a03ac93c1d14f2b2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:31:57.480277 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682047ab-eb34-456a-baf8-ede88501c450 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:57.480779 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682047ab-eb34-456a-baf8-ede88501c450 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:57.480928 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682047ab-eb34-456a-baf8-ede88501c450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:57.530005 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-682047ab-eb34-456a-baf8-ede88501c450 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:31:57.531172 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-682047ab-eb34-456a-baf8-ede88501c450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:31:57.590748 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4621/9196] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:31:57.599472 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5f98c-4c69-4263-9b0c-6b2997ca1fa6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:57.599836 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5f98c-4c69-4263-9b0c-6b2997ca1fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:57.600204 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5f98c-4c69-4263-9b0c-6b2997ca1fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:57.621875 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4db5f98c-4c69-4263-9b0c-6b2997ca1fa6 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:31:57.623200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4db5f98c-4c69-4263-9b0c-6b2997ca1fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:31:57.631491 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4576/9197] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:31:57.636421 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682047ab-eb34-456a-baf8-ede88501c450 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:57.646185 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682047ab-eb34-456a-baf8-ede88501c450 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:57.650821 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde282-1211-4a7f-a614-37ad0393109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:57.651417 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde282-1211-4a7f-a614-37ad0393109b admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:57.651694 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde282-1211-4a7f-a614-37ad0393109b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:57.651961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde282-1211-4a7f-a614-37ad0393109b admin admin] PATH_INFO: `/v3/domains` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:57.652631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde282-1211-4a7f-a614-37ad0393109b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 02 02:31:57.652919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde282-1211-4a7f-a614-37ad0393109b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:57.654527 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde282-1211-4a7f-a614-37ad0393109b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:57.666849 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4622/9198] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 2 02:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 02 02:31:57.671167 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5f98c-4c69-4263-9b0c-6b2997ca1fa6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:57.680523 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5f98c-4c69-4263-9b0c-6b2997ca1fa6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:57.685833 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56a9d3-4f48-4069-9275-0a2145cabbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:57.686439 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56a9d3-4f48-4069-9275-0a2145cabbea admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:57.686752 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56a9d3-4f48-4069-9275-0a2145cabbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:57.687023 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56a9d3-4f48-4069-9275-0a2145cabbea admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:57.687656 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56a9d3-4f48-4069-9275-0a2145cabbea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:57.689559 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56a9d3-4f48-4069-9275-0a2145cabbea admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:57.731888 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4577/9199] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:31:57 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 02 02:31:57.733036 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde282-1211-4a7f-a614-37ad0393109b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:57.743321 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde282-1211-4a7f-a614-37ad0393109b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:57.801871 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422027-ad17-4d42-bbbc-74757dd96c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:57.802397 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422027-ad17-4d42-bbbc-74757dd96c38 admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:57.802712 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422027-ad17-4d42-bbbc-74757dd96c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:57.802988 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422027-ad17-4d42-bbbc-74757dd96c38 admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:57.803616 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422027-ad17-4d42-bbbc-74757dd96c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:57.805524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422027-ad17-4d42-bbbc-74757dd96c38 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:57.827908 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4623/9200] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:31:57 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:31:57.832184 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56a9d3-4f48-4069-9275-0a2145cabbea admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:57.844060 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56a9d3-4f48-4069-9275-0a2145cabbea admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:57.848789 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575837d-b953-49f6-a935-2fdd54fd46a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:57.849397 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575837d-b953-49f6-a935-2fdd54fd46a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:57.849676 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575837d-b953-49f6-a935-2fdd54fd46a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:57.849951 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575837d-b953-49f6-a935-2fdd54fd46a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:57.850592 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575837d-b953-49f6-a935-2fdd54fd46a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:57.852263 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575837d-b953-49f6-a935-2fdd54fd46a0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:57.862479 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4578/9201] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:31:57.866749 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422027-ad17-4d42-bbbc-74757dd96c38 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:57.877522 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422027-ad17-4d42-bbbc-74757dd96c38 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:57.882090 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b86d58-5c53-4e3a-b5d7-dd9ea0eebbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:57.882717 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b86d58-5c53-4e3a-b5d7-dd9ea0eebbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:57.882999 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b86d58-5c53-4e3a-b5d7-dd9ea0eebbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:57.883269 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b86d58-5c53-4e3a-b5d7-dd9ea0eebbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:57.883907 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b86d58-5c53-4e3a-b5d7-dd9ea0eebbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:57.886304 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b86d58-5c53-4e3a-b5d7-dd9ea0eebbd9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:57.896685 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4624/9202] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:31:57.901622 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575837d-b953-49f6-a935-2fdd54fd46a0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:57.911526 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575837d-b953-49f6-a935-2fdd54fd46a0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:57.916104 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2683c-7c3e-454e-94f9-042ed1c15547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:57.916747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2683c-7c3e-454e-94f9-042ed1c15547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:57.917027 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2683c-7c3e-454e-94f9-042ed1c15547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:57.917301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2683c-7c3e-454e-94f9-042ed1c15547 admin admin] PATH_INFO: `/v3/projects/4c8d09faa16d4f00b10c9a302fe110df/users/0e0b1745c8814aa49198d4170bc2de7b/roles/beb2c562d1d14ef599b41dd5788b6e4d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:57.933011 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:31:57.938403 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2683c-7c3e-454e-94f9-042ed1c15547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8d09faa16d4f00b10c9a302fe110df, user_id=0e0b1745c8814aa49198d4170bc2de7b, role_id=beb2c562d1d14ef599b41dd5788b6e4d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:57.942252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2683c-7c3e-454e-94f9-042ed1c15547 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:57.959286 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4579/9203] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:31:57 2022] PUT /identity/v3/projects/4c8d09faa16d4f00b10c9a302fe110df/users/0e0b1745c8814aa49198d4170bc2de7b/roles/beb2c562d1d14ef599b41dd5788b6e4d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:31:57.965290 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc8dc4-5ad1-484e-9e6d-2b3db2302a33 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:57.965554 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc8dc4-5ad1-484e-9e6d-2b3db2302a33 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:57.965831 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc8dc4-5ad1-484e-9e6d-2b3db2302a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:57.985502 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-78dc8dc4-5ad1-484e-9e6d-2b3db2302a33 None None] MFA Rules not processed for user `a87a2f5ec4d74905b0b84b2127c02e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:31:57.986851 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-78dc8dc4-5ad1-484e-9e6d-2b3db2302a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:31:58.004680 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:31:58.050541 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4625/9204] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:31:58.060993 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2683c-7c3e-454e-94f9-042ed1c15547 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:31:58.062887 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-24b2683c-7c3e-454e-94f9-042ed1c15547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:31:58.121374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2683c-7c3e-454e-94f9-042ed1c15547 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:31:58.125045 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8f9bd-96fa-4f32-a564-060c8b47b5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:31:58.125788 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8f9bd-96fa-4f32-a564-060c8b47b5cf service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:31:58.126070 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8f9bd-96fa-4f32-a564-060c8b47b5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:31:58.126346 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8f9bd-96fa-4f32-a564-060c8b47b5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:31:58.136055 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8f9bd-96fa-4f32-a564-060c8b47b5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:31:58.137501 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8f9bd-96fa-4f32-a564-060c8b47b5cf service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:31:58.147328 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4580/9205] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:32:02.346242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e66555-6b9b-48be-a1d6-d03bd891a451 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:02.346802 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e66555-6b9b-48be-a1d6-d03bd891a451 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:02.347081 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e66555-6b9b-48be-a1d6-d03bd891a451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:02.375249 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-35e66555-6b9b-48be-a1d6-d03bd891a451 None None] MFA Rules not processed for user `0e0b1745c8814aa49198d4170bc2de7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:32:02.376378 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-35e66555-6b9b-48be-a1d6-d03bd891a451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:02.449738 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4626/9206] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:32:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:32:02.454290 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8f9bd-96fa-4f32-a564-060c8b47b5cf service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:02.464703 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8f9bd-96fa-4f32-a564-060c8b47b5cf service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:02.469892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24febce-3559-4620-94f7-1bea0df62d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:02.470508 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24febce-3559-4620-94f7-1bea0df62d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:02.470831 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24febce-3559-4620-94f7-1bea0df62d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:02.471107 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24febce-3559-4620-94f7-1bea0df62d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:02.471776 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24febce-3559-4620-94f7-1bea0df62d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:02.473750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24febce-3559-4620-94f7-1bea0df62d09 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:02.507127 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4581/9207] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 2 02:32:02 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:32:02.508344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e66555-6b9b-48be-a1d6-d03bd891a451 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:02.522109 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e66555-6b9b-48be-a1d6-d03bd891a451 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:02.613536 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a39b8-7d2b-4fc7-8f12-4f5f7751e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:02.614631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a39b8-7d2b-4fc7-8f12-4f5f7751e90b admin admin] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:02.614631 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a39b8-7d2b-4fc7-8f12-4f5f7751e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:02.614847 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a39b8-7d2b-4fc7-8f12-4f5f7751e90b admin admin] PATH_INFO: `/v3/users` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:02.616771 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a39b8-7d2b-4fc7-8f12-4f5f7751e90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:02.617989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a39b8-7d2b-4fc7-8f12-4f5f7751e90b admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:02.659490 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4627/9208] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 2 02:32:02 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 02 02:32:02.660938 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24febce-3559-4620-94f7-1bea0df62d09 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:02.677761 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24febce-3559-4620-94f7-1bea0df62d09 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:02.683524 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043c842-dff6-44cd-ab6b-3446edbd4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:02.684208 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043c842-dff6-44cd-ab6b-3446edbd4a61 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:02.684488 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043c842-dff6-44cd-ab6b-3446edbd4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:02.684926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043c842-dff6-44cd-ab6b-3446edbd4a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:02.685602 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043c842-dff6-44cd-ab6b-3446edbd4a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:02.687296 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043c842-dff6-44cd-ab6b-3446edbd4a61 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:02.700552 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4582/9209] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:32:02.704898 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a39b8-7d2b-4fc7-8f12-4f5f7751e90b admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:02.716163 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a39b8-7d2b-4fc7-8f12-4f5f7751e90b admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:02.721146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fe6d8-c8ad-4037-a5fa-813b971635c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:02.721858 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe6d8-c8ad-4037-a5fa-813b971635c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:02.722144 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe6d8-c8ad-4037-a5fa-813b971635c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:02.722425 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe6d8-c8ad-4037-a5fa-813b971635c9 admin admin] PATH_INFO: `/v3/projects/c5a5fdd370dd4342bd93faf6a3fcbcd7/users/0a3d996c24204a3882555f0e63fd5de0/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:02.738232 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fe6d8-c8ad-4037-a5fa-813b971635c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a5fdd370dd4342bd93faf6a3fcbcd7, user_id=0a3d996c24204a3882555f0e63fd5de0, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:02.741047 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fe6d8-c8ad-4037-a5fa-813b971635c9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:02.760630 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4628/9210] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:32:02 2022] PUT /identity/v3/projects/c5a5fdd370dd4342bd93faf6a3fcbcd7/users/0a3d996c24204a3882555f0e63fd5de0/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:32:02.764705 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043c842-dff6-44cd-ab6b-3446edbd4a61 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:02.777740 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043c842-dff6-44cd-ab6b-3446edbd4a61 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:02.840937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acd5e0-a05e-44f9-8407-84a6ae02837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:02.841564 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acd5e0-a05e-44f9-8407-84a6ae02837a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:02.841846 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acd5e0-a05e-44f9-8407-84a6ae02837a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:02.842128 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acd5e0-a05e-44f9-8407-84a6ae02837a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:02.842808 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acd5e0-a05e-44f9-8407-84a6ae02837a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:02.844468 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acd5e0-a05e-44f9-8407-84a6ae02837a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:02.856228 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4583/9211] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 2 02:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 02 02:32:02.860169 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fe6d8-c8ad-4037-a5fa-813b971635c9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:02.871514 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fe6d8-c8ad-4037-a5fa-813b971635c9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:02.876216 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eaf95-fcea-4b39-aaa2-8eb0d08657c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:02.876885 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eaf95-fcea-4b39-aaa2-8eb0d08657c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:02.877191 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eaf95-fcea-4b39-aaa2-8eb0d08657c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:02.877464 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eaf95-fcea-4b39-aaa2-8eb0d08657c9 admin admin] PATH_INFO: `/v3/projects/c5a5fdd370dd4342bd93faf6a3fcbcd7/users/0a3d996c24204a3882555f0e63fd5de0/roles/284afd30cc464e98bd3e2b1e1c42ff7e` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:02.879388 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eaf95-fcea-4b39-aaa2-8eb0d08657c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a5fdd370dd4342bd93faf6a3fcbcd7, user_id=0a3d996c24204a3882555f0e63fd5de0, role_id=284afd30cc464e98bd3e2b1e1c42ff7e)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:02.882035 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eaf95-fcea-4b39-aaa2-8eb0d08657c9 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:02.893306 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4629/9212] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 2 02:32:02 2022] PUT /identity/v3/projects/c5a5fdd370dd4342bd93faf6a3fcbcd7/users/0a3d996c24204a3882555f0e63fd5de0/roles/284afd30cc464e98bd3e2b1e1c42ff7e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:32:07.115943 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6adf1-0643-48ed-b5e2-b1e53fc15dd7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:07.116532 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6adf1-0643-48ed-b5e2-b1e53fc15dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:07.116689 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6adf1-0643-48ed-b5e2-b1e53fc15dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:07.147455 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ceb6adf1-0643-48ed-b5e2-b1e53fc15dd7 None None] MFA Rules not processed for user `0a3d996c24204a3882555f0e63fd5de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:32:07.148834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ceb6adf1-0643-48ed-b5e2-b1e53fc15dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:07.195758 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:07.221105 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4584/9213] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:32:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:32:07.238326 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eaf95-fcea-4b39-aaa2-8eb0d08657c9 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:07.240696 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-767eaf95-fcea-4b39-aaa2-8eb0d08657c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:07.247611 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:07.355086 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eaf95-fcea-4b39-aaa2-8eb0d08657c9 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:07.366691 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5559fc6-23c2-4889-a3f7-ca7040bc42c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:07.367337 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5559fc6-23c2-4889-a3f7-ca7040bc42c6 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:07.367684 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5559fc6-23c2-4889-a3f7-ca7040bc42c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:07.367889 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5559fc6-23c2-4889-a3f7-ca7040bc42c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:07.440595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5559fc6-23c2-4889-a3f7-ca7040bc42c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:07.442773 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5559fc6-23c2-4889-a3f7-ca7040bc42c6 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:07.454030 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4630/9214] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:32:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:32:08.503061 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf06c5-815f-4ad6-9d8f-86b7297ff60c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:08.503547 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf06c5-815f-4ad6-9d8f-86b7297ff60c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:08.503777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf06c5-815f-4ad6-9d8f-86b7297ff60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:08.529272 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-23cf06c5-815f-4ad6-9d8f-86b7297ff60c None None] MFA Rules not processed for user `0e0b1745c8814aa49198d4170bc2de7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:32:08.531048 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-23cf06c5-815f-4ad6-9d8f-86b7297ff60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:08.540119 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4585/9215] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:32:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:32:08.585432 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5559fc6-23c2-4889-a3f7-ca7040bc42c6 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:08.587037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-b5559fc6-23c2-4889-a3f7-ca7040bc42c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:08.645325 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5559fc6-23c2-4889-a3f7-ca7040bc42c6 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:08.649070 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81e68b-83f0-4cd9-8307-1c328c196039 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:08.649669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81e68b-83f0-4cd9-8307-1c328c196039 service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:08.650493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81e68b-83f0-4cd9-8307-1c328c196039 service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:08.651084 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81e68b-83f0-4cd9-8307-1c328c196039 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:08.652875 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ac81e68b-83f0-4cd9-8307-1c328c196039 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:08.667211 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81e68b-83f0-4cd9-8307-1c328c196039 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:08.668665 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81e68b-83f0-4cd9-8307-1c328c196039 service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:08.679491 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4631/9216] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:32:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:32:15.607241 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf06c5-815f-4ad6-9d8f-86b7297ff60c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:15.669164 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf06c5-815f-4ad6-9d8f-86b7297ff60c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:15.672816 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e5c5d-fedd-4d4b-ad74-a4f209c39a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:15.673438 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e5c5d-fedd-4d4b-ad74-a4f209c39a72 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:15.673717 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e5c5d-fedd-4d4b-ad74-a4f209c39a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:15.673989 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e5c5d-fedd-4d4b-ad74-a4f209c39a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:15.675848 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f71e5c5d-fedd-4d4b-ad74-a4f209c39a72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:15.702420 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e5c5d-fedd-4d4b-ad74-a4f209c39a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:15.703904 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e5c5d-fedd-4d4b-ad74-a4f209c39a72 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:15.711833 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4586/9217] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:32:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:32:16.436635 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81e68b-83f0-4cd9-8307-1c328c196039 service glance] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:16.438049 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-ac81e68b-83f0-4cd9-8307-1c328c196039 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:16.453032 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81e68b-83f0-4cd9-8307-1c328c196039 service glance] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:16.459189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8a03a-9bcb-414e-85a4-0dd4bf0a261f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:16.459804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8a03a-9bcb-414e-85a4-0dd4bf0a261f service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:16.460082 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8a03a-9bcb-414e-85a4-0dd4bf0a261f service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:16.460348 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8a03a-9bcb-414e-85a4-0dd4bf0a261f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:16.462042 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4ca8a03a-9bcb-414e-85a4-0dd4bf0a261f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:16.474305 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8a03a-9bcb-414e-85a4-0dd4bf0a261f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:16.475946 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8a03a-9bcb-414e-85a4-0dd4bf0a261f service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:16.492081 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4632/9218] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:32:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:32:22.614699 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e5c5d-fedd-4d4b-ad74-a4f209c39a72 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:22.623223 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e5c5d-fedd-4d4b-ad74-a4f209c39a72 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:22.626817 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cecda-4b91-4642-9a69-65ff0e891a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:22.627406 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cecda-4b91-4642-9a69-65ff0e891a1f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:22.627684 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cecda-4b91-4642-9a69-65ff0e891a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:22.627954 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cecda-4b91-4642-9a69-65ff0e891a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:22.638627 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cecda-4b91-4642-9a69-65ff0e891a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:22.641182 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cecda-4b91-4642-9a69-65ff0e891a1f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:22.657676 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4587/9219] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:32:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:32:26.486499 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:32.648075 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=49 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:35.069921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8a03a-9bcb-414e-85a4-0dd4bf0a261f service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:35.072062 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4ca8a03a-9bcb-414e-85a4-0dd4bf0a261f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:35.149724 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8a03a-9bcb-414e-85a4-0dd4bf0a261f service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:35.154622 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438677-5fd2-45b2-a072-227c7c5c0c2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:35.155239 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438677-5fd2-45b2-a072-227c7c5c0c2b service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:35.155518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438677-5fd2-45b2-a072-227c7c5c0c2b service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:35.155793 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438677-5fd2-45b2-a072-227c7c5c0c2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:35.157469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-40438677-5fd2-45b2-a072-227c7c5c0c2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:35.169133 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438677-5fd2-45b2-a072-227c7c5c0c2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:35.170731 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438677-5fd2-45b2-a072-227c7c5c0c2b service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:35.180249 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4633/9220] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:32:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:32:45.073750 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cecda-4b91-4642-9a69-65ff0e891a1f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:32:45.075226 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0e2cecda-4b91-4642-9a69-65ff0e891a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:45.090008 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cecda-4b91-4642-9a69-65ff0e891a1f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:32:45.094967 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fad8f-07e6-49d0-9f17-8612fdcaa7ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:32:45.095561 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fad8f-07e6-49d0-9f17-8612fdcaa7ac service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:32:45.095841 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fad8f-07e6-49d0-9f17-8612fdcaa7ac service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:32:45.096120 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fad8f-07e6-49d0-9f17-8612fdcaa7ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:32:45.097779 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea3fad8f-07e6-49d0-9f17-8612fdcaa7ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:32:45.109053 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fad8f-07e6-49d0-9f17-8612fdcaa7ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:32:45.110687 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fad8f-07e6-49d0-9f17-8612fdcaa7ac service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:32:45.121046 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4588/9221] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:32:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:32:45.176184 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=37 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:32:55.116457 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:25.950285 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe28c62-96e8-47f7-bc91-9c7f380371a9 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:34:25.950844 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe28c62-96e8-47f7-bc91-9c7f380371a9 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:34:25.950961 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe28c62-96e8-47f7-bc91-9c7f380371a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:34:25.970725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-cbe28c62-96e8-47f7-bc91-9c7f380371a9 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:34:25.971921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-cbe28c62-96e8-47f7-bc91-9c7f380371a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:34:26.033741 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4634/9222] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 02:34:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:34:26.088173 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fad8f-07e6-49d0-9f17-8612fdcaa7ac service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:34:26.089572 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea3fad8f-07e6-49d0-9f17-8612fdcaa7ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:34:26.158301 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fad8f-07e6-49d0-9f17-8612fdcaa7ac service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:34:26.163349 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663372c8-02a5-4436-948d-a88d3da0a6d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:34:26.163936 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663372c8-02a5-4436-948d-a88d3da0a6d9 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:34:26.164218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663372c8-02a5-4436-948d-a88d3da0a6d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:34:26.164492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663372c8-02a5-4436-948d-a88d3da0a6d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:34:26.173063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663372c8-02a5-4436-948d-a88d3da0a6d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:34:26.174749 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663372c8-02a5-4436-948d-a88d3da0a6d9 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:34:26.183554 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4589/9223] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:34:27.336016 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe28c62-96e8-47f7-bc91-9c7f380371a9 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:34:27.353822 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe28c62-96e8-47f7-bc91-9c7f380371a9 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:34:27.360469 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdccb5e-541b-43aa-b27e-2a80103d2409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:34:27.361099 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdccb5e-541b-43aa-b27e-2a80103d2409 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:34:27.361365 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdccb5e-541b-43aa-b27e-2a80103d2409 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:34:27.361638 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdccb5e-541b-43aa-b27e-2a80103d2409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:34:27.363437 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4cdccb5e-541b-43aa-b27e-2a80103d2409 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:34:27.394879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdccb5e-541b-43aa-b27e-2a80103d2409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:34:27.396603 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdccb5e-541b-43aa-b27e-2a80103d2409 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:34:27.412930 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4635/9224] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:34:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:34:35.522858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5a78-8602-439d-86a4-dff9d98b79c4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:34:35.523445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5a78-8602-439d-86a4-dff9d98b79c4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:34:35.523445 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5a78-8602-439d-86a4-dff9d98b79c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:34:35.544777 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9a0c5a78-8602-439d-86a4-dff9d98b79c4 None None] MFA Rules not processed for user `0e0b1745c8814aa49198d4170bc2de7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:34:35.545984 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9a0c5a78-8602-439d-86a4-dff9d98b79c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:34:35.552981 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4590/9225] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 2 02:34:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:34:35.881452 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdccb5e-541b-43aa-b27e-2a80103d2409 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:34:35.890868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdccb5e-541b-43aa-b27e-2a80103d2409 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:34:35.894366 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78842090-f0c1-4b27-8b96-2f2c5ab87f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:34:35.894997 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78842090-f0c1-4b27-8b96-2f2c5ab87f34 service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:34:35.895275 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78842090-f0c1-4b27-8b96-2f2c5ab87f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:34:35.895543 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78842090-f0c1-4b27-8b96-2f2c5ab87f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:34:35.897228 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-78842090-f0c1-4b27-8b96-2f2c5ab87f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:34:35.906300 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78842090-f0c1-4b27-8b96-2f2c5ab87f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:34:35.907864 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78842090-f0c1-4b27-8b96-2f2c5ab87f34 service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:34:35.916170 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4636/9226] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:34:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:34:36.261161 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c5a78-8602-439d-86a4-dff9d98b79c4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:34:36.273773 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c5a78-8602-439d-86a4-dff9d98b79c4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:34:36.279899 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080274a4-2e44-4087-bb87-178030fed55a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:34:36.280509 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080274a4-2e44-4087-bb87-178030fed55a service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:34:36.280793 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080274a4-2e44-4087-bb87-178030fed55a service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:34:36.281072 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080274a4-2e44-4087-bb87-178030fed55a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:34:36.282809 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-080274a4-2e44-4087-bb87-178030fed55a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:34:36.296092 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080274a4-2e44-4087-bb87-178030fed55a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:34:36.297763 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080274a4-2e44-4087-bb87-178030fed55a service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:34:36.308221 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4591/9227] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:34:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:34:37.580545 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681142a-2cc9-4230-89a7-ebb111c21528 None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:34:37.581045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681142a-2cc9-4230-89a7-ebb111c21528 None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:34:37.581158 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681142a-2cc9-4230-89a7-ebb111c21528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:34:37.601373 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-f681142a-2cc9-4230-89a7-ebb111c21528 None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:34:37.603234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-f681142a-2cc9-4230-89a7-ebb111c21528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:34:37.610504 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4637/9228] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 02:34:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:34:37.622834 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080274a4-2e44-4087-bb87-178030fed55a service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:34:37.635200 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080274a4-2e44-4087-bb87-178030fed55a service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:34:37.640587 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c7eec-811e-4984-8f28-2ff1ab00530a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:34:37.641231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c7eec-811e-4984-8f28-2ff1ab00530a service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:34:37.641516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c7eec-811e-4984-8f28-2ff1ab00530a service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:34:37.641791 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c7eec-811e-4984-8f28-2ff1ab00530a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:34:37.652080 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c7eec-811e-4984-8f28-2ff1ab00530a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:34:37.653688 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c7eec-811e-4984-8f28-2ff1ab00530a service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:34:37.662000 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4592/9229] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:34:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:34:47.595995 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=45 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:34:47.658691 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=47 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:35:50.424794 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681142a-2cc9-4230-89a7-ebb111c21528 None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:35:50.444329 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681142a-2cc9-4230-89a7-ebb111c21528 None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:35:50.448402 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de0eaf-c027-4a6f-b59a-7f6b1372309e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:35:50.448989 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0eaf-c027-4a6f-b59a-7f6b1372309e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:35:50.449266 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0eaf-c027-4a6f-b59a-7f6b1372309e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:35:50.449534 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de0eaf-c027-4a6f-b59a-7f6b1372309e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:35:50.451475 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c4de0eaf-c027-4a6f-b59a-7f6b1372309e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:35:50.461045 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de0eaf-c027-4a6f-b59a-7f6b1372309e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:35:50.462454 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de0eaf-c027-4a6f-b59a-7f6b1372309e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:35:50.470059 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4638/9230] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:35:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:36:00.466700 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=10 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:06.931727 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e805a-a864-49e4-9d5b-d7381de81452 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:06.932213 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e805a-a864-49e4-9d5b-d7381de81452 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:06.932335 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e805a-a864-49e4-9d5b-d7381de81452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:07.002449 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a92e805a-a864-49e4-9d5b-d7381de81452 None None] MFA Rules not processed for user `7cee33d8425d4be0ba5721ec419a12e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:37:07.003691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a92e805a-a864-49e4-9d5b-d7381de81452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:07.019453 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4593/9231] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Oct 2 02:37:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:37:07.026189 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de0eaf-c027-4a6f-b59a-7f6b1372309e service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:07.035234 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de0eaf-c027-4a6f-b59a-7f6b1372309e service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:07.038823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465b620-10d2-4f78-8bd8-9abae42716e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:07.040595 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b620-10d2-4f78-8bd8-9abae42716e4 service glance] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:07.040874 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b620-10d2-4f78-8bd8-9abae42716e4 service glance] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:07.041146 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b620-10d2-4f78-8bd8-9abae42716e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:07.042879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-4465b620-10d2-4f78-8bd8-9abae42716e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:07.056995 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465b620-10d2-4f78-8bd8-9abae42716e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:07.058487 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465b620-10d2-4f78-8bd8-9abae42716e4 service glance] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:07.078964 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4639/9232] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:37:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:37:08.281603 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e805a-a864-49e4-9d5b-d7381de81452 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:08.290956 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e805a-a864-49e4-9d5b-d7381de81452 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:08.294560 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b2179-11a2-4486-a702-1ba00568266b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cee33d8425d4be0ba5721ec419a12e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:08.295188 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b2179-11a2-4486-a702-1ba00568266b service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:08.295479 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b2179-11a2-4486-a702-1ba00568266b service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:08.295757 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b2179-11a2-4486-a702-1ba00568266b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:08.303983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b2179-11a2-4486-a702-1ba00568266b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:08.305613 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b2179-11a2-4486-a702-1ba00568266b service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:08.314578 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4594/9233] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:37:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:37:15.375520 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811c95c-8d8d-4cdf-82c1-0274b28e50ad None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:15.376013 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811c95c-8d8d-4cdf-82c1-0274b28e50ad None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:15.376128 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811c95c-8d8d-4cdf-82c1-0274b28e50ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:15.426123 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-2811c95c-8d8d-4cdf-82c1-0274b28e50ad None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:37:15.427343 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2811c95c-8d8d-4cdf-82c1-0274b28e50ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:15.444458 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4640/9234] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 2 02:37:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:37:15.487350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b2179-11a2-4486-a702-1ba00568266b service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:15.509457 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b2179-11a2-4486-a702-1ba00568266b service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:15.514395 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf28db5-874d-48bc-8665-a6045961a683 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:15.515034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28db5-874d-48bc-8665-a6045961a683 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:15.515318 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28db5-874d-48bc-8665-a6045961a683 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:15.515905 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28db5-874d-48bc-8665-a6045961a683 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:15.524867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf28db5-874d-48bc-8665-a6045961a683 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:15.526368 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf28db5-874d-48bc-8665-a6045961a683 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:15.540100 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4595/9235] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:37:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:37:24.824970 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175b784-2091-4edd-9268-7609e37c9a7a None None] REQUEST_METHOD: `POST` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:24.825518 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175b784-2091-4edd-9268-7609e37c9a7a None None] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:24.825641 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175b784-2091-4edd-9268-7609e37c9a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:24.845346 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.auth.core [None req-0175b784-2091-4edd-9268-7609e37c9a7a None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:37:24.846553 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-0175b784-2091-4edd-9268-7609e37c9a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:24.854344 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4641/9236] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 02:37:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:37:24.866222 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf28db5-874d-48bc-8665-a6045961a683 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:24.876953 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf28db5-874d-48bc-8665-a6045961a683 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:24.881926 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89721c24-b082-4df3-ad53-f4a755bc2625 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:24.882519 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89721c24-b082-4df3-ad53-f4a755bc2625 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:24.882867 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89721c24-b082-4df3-ad53-f4a755bc2625 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:24.883218 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89721c24-b082-4df3-ad53-f4a755bc2625 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:24.891274 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89721c24-b082-4df3-ad53-f4a755bc2625 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:24.892888 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89721c24-b082-4df3-ad53-f4a755bc2625 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:24.901445 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4596/9237] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:37:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:37:26.061919 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175b784-2091-4edd-9268-7609e37c9a7a None None] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:26.075555 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175b784-2091-4edd-9268-7609e37c9a7a None None] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:26.082037 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266077a-8b79-4193-9fec-6253304bb5f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:26.082705 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266077a-8b79-4193-9fec-6253304bb5f4 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:26.082987 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266077a-8b79-4193-9fec-6253304bb5f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:26.083294 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266077a-8b79-4193-9fec-6253304bb5f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:26.093881 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266077a-8b79-4193-9fec-6253304bb5f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:26.095077 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266077a-8b79-4193-9fec-6253304bb5f4 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:26.107779 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4642/9238] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:37:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:37:26.265695 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89721c24-b082-4df3-ad53-f4a755bc2625 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:26.276105 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89721c24-b082-4df3-ad53-f4a755bc2625 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:26.280331 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd7ada-8afe-48e8-9cff-b03be66570b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:26.281203 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd7ada-8afe-48e8-9cff-b03be66570b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:26.281543 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd7ada-8afe-48e8-9cff-b03be66570b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:26.281889 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd7ada-8afe-48e8-9cff-b03be66570b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:26.293747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd7ada-8afe-48e8-9cff-b03be66570b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:26.295231 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd7ada-8afe-48e8-9cff-b03be66570b4 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:26.306171 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4597/9239] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:37:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:37:28.489669 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266077a-8b79-4193-9fec-6253304bb5f4 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:28.502088 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266077a-8b79-4193-9fec-6253304bb5f4 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:28.508472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3c5a2-d633-435b-8bee-8d583b51cdc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85fc7e555f348c3ab6c63ee15f6ceb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:28.509243 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3c5a2-d633-435b-8bee-8d583b51cdc1 service nova] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:28.509745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3c5a2-d633-435b-8bee-8d583b51cdc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:28.510052 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3c5a2-d633-435b-8bee-8d583b51cdc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:28.512624 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-5ae3c5a2-d633-435b-8bee-8d583b51cdc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:28.526376 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3c5a2-d633-435b-8bee-8d583b51cdc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:28.528048 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3c5a2-d633-435b-8bee-8d583b51cdc1 service nova] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:28.539473 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4643/9240] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:37:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:37:29.108264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b3faa-d306-4f60-af3f-10ec01ed55af None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:29.108724 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b3faa-d306-4f60-af3f-10ec01ed55af None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:29.108850 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b3faa-d306-4f60-af3f-10ec01ed55af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:29.116295 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=55 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:29.129478 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-383b3faa-d306-4f60-af3f-10ec01ed55af None None] MFA Rules not processed for user `80a8390c507240e893e1fd82b2490df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 02 02:37:29.130691 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-383b3faa-d306-4f60-af3f-10ec01ed55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:29.138029 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4598/9241] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 2 02:37:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 02 02:37:29.150879 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3c5a2-d633-435b-8bee-8d583b51cdc1 service nova] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:29.162833 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3c5a2-d633-435b-8bee-8d583b51cdc1 service nova] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:29.168609 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc60d4-53c1-4897-ac97-4eb6a2de8d46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fa4948f9b546dea031acfc0f3e3d95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:29.169230 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc60d4-53c1-4897-ac97-4eb6a2de8d46 service swift] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:29.169513 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc60d4-53c1-4897-ac97-4eb6a2de8d46 service swift] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:29.169787 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc60d4-53c1-4897-ac97-4eb6a2de8d46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:29.177757 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc60d4-53c1-4897-ac97-4eb6a2de8d46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:29.179362 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc60d4-53c1-4897-ac97-4eb6a2de8d46 service swift] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:29.187383 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4644/9242] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 2 02:37:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 02 02:37:30.857970 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b3faa-d306-4f60-af3f-10ec01ed55af None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:30.879139 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b3faa-d306-4f60-af3f-10ec01ed55af None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:30.894393 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248c682-eaa3-4ca9-9ebd-7ff44bcb8937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:30.895434 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c682-eaa3-4ca9-9ebd-7ff44bcb8937 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:30.895931 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c682-eaa3-4ca9-9ebd-7ff44bcb8937 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:30.896142 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c682-eaa3-4ca9-9ebd-7ff44bcb8937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:30.906207 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248c682-eaa3-4ca9-9ebd-7ff44bcb8937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:30.907730 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248c682-eaa3-4ca9-9ebd-7ff44bcb8937 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:30.917146 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4599/9243] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:37:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:37:33.458124 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc60d4-53c1-4897-ac97-4eb6a2de8d46 service swift] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:33.463025 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=50 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:33.468938 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc60d4-53c1-4897-ac97-4eb6a2de8d46 service swift] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:33.472566 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d9ad-f32b-41b6-a34e-08f557b2d20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29854b3a4cda48f8a1dea8a01b4589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:33.473161 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d9ad-f32b-41b6-a34e-08f557b2d20e service neutron] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:33.473442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d9ad-f32b-41b6-a34e-08f557b2d20e service neutron] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:33.473715 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d9ad-f32b-41b6-a34e-08f557b2d20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:33.535493 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339d9ad-f32b-41b6-a34e-08f557b2d20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:33.536921 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339d9ad-f32b-41b6-a34e-08f557b2d20e service neutron] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:33.546428 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4645/9244] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:37:36.390035 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248c682-eaa3-4ca9-9ebd-7ff44bcb8937 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:36.422363 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248c682-eaa3-4ca9-9ebd-7ff44bcb8937 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:36.427661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8236acc-4142-4ebc-bb57-cb2839b1ab3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:36.428362 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236acc-4142-4ebc-bb57-cb2839b1ab3e service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:36.428661 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236acc-4142-4ebc-bb57-cb2839b1ab3e service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:36.429034 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236acc-4142-4ebc-bb57-cb2839b1ab3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:36.431228 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a8236acc-4142-4ebc-bb57-cb2839b1ab3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:36.444294 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8236acc-4142-4ebc-bb57-cb2839b1ab3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:36.448878 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8236acc-4142-4ebc-bb57-cb2839b1ab3e service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:36.457256 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4600/9245] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:37:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:37:39.720982 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d9ad-f32b-41b6-a34e-08f557b2d20e service neutron] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:39.730699 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d9ad-f32b-41b6-a34e-08f557b2d20e service neutron] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:39.735546 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:39.736165 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:39.736442 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:39.736832 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] PATH_INFO: `/v3/users/0e0b1745c8814aa49198d4170bc2de7b` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:39.737943 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0b1745c8814aa49198d4170bc2de7b)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:39.739868 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:39.784621 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0b1745c8814aa49198d4170bc2de7b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:39.796725 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0b1745c8814aa49198d4170bc2de7b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:39.797393 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0b1745c8814aa49198d4170bc2de7b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:39.810852 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0b1745c8814aa49198d4170bc2de7b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:39.811472 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0b1745c8814aa49198d4170bc2de7b'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:39.824474 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4646/9246] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:37:39 2022] DELETE /identity/v3/users/0e0b1745c8814aa49198d4170bc2de7b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:37:40.006431 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8236acc-4142-4ebc-bb57-cb2839b1ab3e service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:40.017654 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8236acc-4142-4ebc-bb57-cb2839b1ab3e service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:40.075158 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:40.075792 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:40.076075 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:40.076350 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] PATH_INFO: `/v3/projects/4c8d09faa16d4f00b10c9a302fe110df` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:40.077747 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8d09faa16d4f00b10c9a302fe110df)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:40.079709 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:40.125249 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8d09faa16d4f00b10c9a302fe110df', 'request_id': 'req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.130976 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8d09faa16d4f00b10c9a302fe110df', 'request_id': 'req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.138196 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8d09faa16d4f00b10c9a302fe110df', 'request_id': 'req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.152078 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] The token cache is being invalidate because project 4c8d09faa16d4f00b10c9a302fe110df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:37:40.152374 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.153017 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.154532 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4601/9247] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:37:40 2022] DELETE /identity/v3/projects/4c8d09faa16d4f00b10c9a302fe110df => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:37:40.158823 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:40.160207 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:40.173057 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47435a4-b8ee-47f0-99bd-a8f1a63c6f09 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:40.228610 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:40.229245 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:40.229528 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:40.229804 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] PATH_INFO: `/v3/users/0a3d996c24204a3882555f0e63fd5de0` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:40.231136 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a3d996c24204a3882555f0e63fd5de0)` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:40.233073 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:40.244919 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:40.282430 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a3d996c24204a3882555f0e63fd5de0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.295737 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a3d996c24204a3882555f0e63fd5de0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.296413 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a3d996c24204a3882555f0e63fd5de0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.303653 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a3d996c24204a3882555f0e63fd5de0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.304344 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.notifications [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a3d996c24204a3882555f0e63fd5de0'} {{(pid=81853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.316565 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4647/9248] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 2 02:37:40 2022] DELETE /identity/v3/users/0a3d996c24204a3882555f0e63fd5de0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 02 02:37:40.498516 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:40.499983 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:40.515743 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb9e23-8724-4385-8d52-c2f3c0c08ea9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:40.565080 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:40.576815 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a87a2f5ec4d74905b0b84b2127c02e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd709e757c564f0baea68763e7e07e28', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:40.577700 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:40.577979 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:40.578264 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] PATH_INFO: `/v3/projects/c5a5fdd370dd4342bd93faf6a3fcbcd7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:40.579416 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a5fdd370dd4342bd93faf6a3fcbcd7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:40.581328 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:40.628419 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a5fdd370dd4342bd93faf6a3fcbcd7', 'request_id': 'req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.634355 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a5fdd370dd4342bd93faf6a3fcbcd7', 'request_id': 'req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.640463 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a5fdd370dd4342bd93faf6a3fcbcd7', 'request_id': 'req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.653562 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] The token cache is being invalidate because project c5a5fdd370dd4342bd93faf6a3fcbcd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 02 02:37:40.653854 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.654492 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 02 02:37:40.656044 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4602/9249] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 2 02:37:40 2022] DELETE /identity/v3/projects/c5a5fdd370dd4342bd93faf6a3fcbcd7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 02 02:37:42.042335 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:42.043796 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:42.112485 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660ca5c-d29c-4bc0-a0f2-816182182cb7 admin admin] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:42.171139 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5106c-0c47-4107-bb66-1702a4f90858 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:42.171745 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5106c-0c47-4107-bb66-1702a4f90858 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:42.172026 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5106c-0c47-4107-bb66-1702a4f90858 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:42.172295 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5106c-0c47-4107-bb66-1702a4f90858 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:42.173986 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.fernet_utils [None req-63c5106c-0c47-4107-bb66-1702a4f90858 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:42.185657 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5106c-0c47-4107-bb66-1702a4f90858 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:42.187292 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5106c-0c47-4107-bb66-1702a4f90858 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:42.197545 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4648/9250] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:37:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:37:50.650461 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:37:51.064643 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:37:51.066063 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:51.081529 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28535a8d-2cd4-4a78-8bf9-ae965b425ed2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:37:51.086651 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a82a4e-92e9-43e2-9305-9d65a33142e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:37:51.087280 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a82a4e-92e9-43e2-9305-9d65a33142e2 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:37:51.087585 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a82a4e-92e9-43e2-9305-9d65a33142e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:37:51.087858 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a82a4e-92e9-43e2-9305-9d65a33142e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:37:51.089577 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b1a82a4e-92e9-43e2-9305-9d65a33142e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 02 02:37:51.100937 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a82a4e-92e9-43e2-9305-9d65a33142e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:37:51.102653 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a82a4e-92e9-43e2-9305-9d65a33142e2 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:37:51.112395 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4603/9251] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:37:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:37:52.192879 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:DELETE=10,keystone:SELECT=80,keystone:INSERT=1 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:38:01.108217 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:42:49.034689 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5106c-0c47-4107-bb66-1702a4f90858 service placement] Authenticating user token {{(pid=81853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:42:49.079418 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5106c-0c47-4107-bb66-1702a4f90858 service placement] Validating token access rules against request {{(pid=81853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:42:49.084645 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17277a0-2469-4b65-b514-5c0c7af28666 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:42:49.085242 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17277a0-2469-4b65-b514-5c0c7af28666 service placement] REQUEST_METHOD: `GET` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:42:49.085524 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17277a0-2469-4b65-b514-5c0c7af28666 service placement] SCRIPT_NAME: `/identity` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:42:49.085799 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17277a0-2469-4b65-b514-5c0c7af28666 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:42:49.095138 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17277a0-2469-4b65-b514-5c0c7af28666 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:42:49.096719 n-d-master-1 devstack@keystone.service[81853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17277a0-2469-4b65-b514-5c0c7af28666 service placement] RBAC: Authorization granted {{(pid=81853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:42:49.107408 n-d-master-1 devstack@keystone.service[81853]: [pid: 81853|app: 0|req: 4649/9252] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:42:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:42:58.078544 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a82a4e-92e9-43e2-9305-9d65a33142e2 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 02 02:42:58.129146 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a82a4e-92e9-43e2-9305-9d65a33142e2 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 02 02:42:58.134252 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7ed0c-6c44-4eb2-bbca-4778fb1777b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619819f081824510a9f9e127e5070662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2904782f42d6469190a89864c9e71ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 02 02:42:58.134892 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7ed0c-6c44-4eb2-bbca-4778fb1777b5 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 02 02:42:58.135181 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7ed0c-6c44-4eb2-bbca-4778fb1777b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 02 02:42:58.135499 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7ed0c-6c44-4eb2-bbca-4778fb1777b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 02 02:42:58.145058 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7ed0c-6c44-4eb2-bbca-4778fb1777b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 02 02:42:58.146685 n-d-master-1 devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7ed0c-6c44-4eb2-bbca-4778fb1777b5 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 02 02:42:58.157144 n-d-master-1 devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4604/9253] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 2 02:42:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 02 02:42:59.102282 n-d-master-1 devstack@keystone.service[81853]: DEBUG dbcounter [-] [81853] Writing DB stats keystone:SELECT=20 {{(pid=81853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 02:43:08.152911 n-d-master-1 devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=20 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}